2024-09-11T21:44:11.668 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T21:44:11.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T21:44:11.802 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901411' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiEjLtnimaJq6b4kcNaDA7gPIzf/DJn8ysoxKNsk789a8TS0ePx6no+IgUYVNS0qn7Iwek4G8aRYjOtA0utHsk= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUgtV58WjMecMvmmbxsPtkVgMNWDUlvdzp6pxBEOEhpxPdKGlCOEs2pjAjeuPzNHtlQNbc6SZCpslSLkCvnjY4= smithi193.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLNoXbWlioya2bsTOEgtrQaUHeDc+3+pxZyC+Qlpi3JTiKdygXj4sGbRsNNBrh224+aH3ldHzqXiHZzTDYZWuvY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T21:44:11.802 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T21:44:11.803 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T21:44:11.803 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T21:44:11.804 INFO:teuthology.task.internal:Checking packages... 2024-09-11T21:44:11.826 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T21:44:11.826 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T21:44:11.826 INFO:teuthology.packaging:ref: None 2024-09-11T21:44:11.826 INFO:teuthology.packaging:tag: None 2024-09-11T21:44:11.826 INFO:teuthology.packaging:branch: squid 2024-09-11T21:44:11.826 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:44:11.826 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T21:44:12.067 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-11T21:44:12.069 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T21:44:12.076 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T21:44:12.076 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T21:44:12.082 INFO:teuthology.task.internal:Saving configuration 2024-09-11T21:44:12.107 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T21:44:12.114 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T21:44:12.140 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 21:38:36.600026', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiEjLtnimaJq6b4kcNaDA7gPIzf/DJn8ysoxKNsk789a8TS0ePx6no+IgUYVNS0qn7Iwek4G8aRYjOtA0utHsk='} 2024-09-11T21:44:12.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 21:38:36.602010', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUgtV58WjMecMvmmbxsPtkVgMNWDUlvdzp6pxBEOEhpxPdKGlCOEs2pjAjeuPzNHtlQNbc6SZCpslSLkCvnjY4='} 2024-09-11T21:44:12.183 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 21:38:36.603532', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLNoXbWlioya2bsTOEgtrQaUHeDc+3+pxZyC+Qlpi3JTiKdygXj4sGbRsNNBrh224+aH3ldHzqXiHZzTDYZWuvY='} 2024-09-11T21:44:12.183 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T21:44:12.189 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-11T21:44:12.189 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-11T21:44:12.190 INFO:teuthology.task.internal:roles: ubuntu@smithi193.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-11T21:44:12.190 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T21:44:12.273 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f30a15f36d0>, signals=[15]) 2024-09-11T21:44:12.273 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T21:44:12.279 INFO:teuthology.task.internal:Opening connections... 2024-09-11T21:44:12.279 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T21:44:12.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:44:12.362 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-09-11T21:44:12.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:44:12.449 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi193.front.sepia.ceph.com 2024-09-11T21:44:12.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:44:12.527 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T21:44:12.533 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-09-11T21:44:12.552 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-09-11T21:44:12.553 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-09-11T21:44:12.611 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-09-11T21:44:12.611 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2024-09-11T21:44:12.611 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-09-11T21:44:12.611 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-09-11T21:44:12.611 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2024-09-11T21:44:12.611 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2024-09-11T21:44:12.612 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T21:44:12.612 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-09-11T21:44:12.612 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2024-09-11T21:44:12.612 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T21:44:12.612 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-09-11T21:44:12.612 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T21:44:12.612 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T21:44:12.612 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T21:44:12.613 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-09-11T21:44:12.638 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-09-11T21:44:12.657 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-09-11T21:44:12.658 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-09-11T21:44:12.716 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-09-11T21:44:12.717 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-09-11T21:44:12.717 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-09-11T21:44:12.717 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-09-11T21:44:12.717 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-09-11T21:44:12.717 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-09-11T21:44:12.717 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T21:44:12.717 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-09-11T21:44:12.717 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-09-11T21:44:12.717 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T21:44:12.717 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-09-11T21:44:12.717 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T21:44:12.718 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T21:44:12.718 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T21:44:12.718 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-09-11T21:44:12.738 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-09-11T21:44:12.757 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-09-11T21:44:12.758 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-09-11T21:44:12.816 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2024-09-11T21:44:12.816 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2024-09-11T21:44:12.816 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2024-09-11T21:44:12.816 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2024-09-11T21:44:12.816 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2024-09-11T21:44:12.816 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2024-09-11T21:44:12.817 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T21:44:12.817 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-09-11T21:44:12.817 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2024-09-11T21:44:12.817 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T21:44:12.817 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2024-09-11T21:44:12.817 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T21:44:12.817 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T21:44:12.817 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T21:44:12.817 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-09-11T21:44:12.838 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T21:44:12.849 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T21:44:12.877 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T21:44:12.877 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-09-11T21:44:12.879 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-09-11T21:44:12.882 DEBUG:teuthology.orchestra.run.smithi193:> test '!' -e /home/ubuntu/cephtest 2024-09-11T21:44:12.899 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T21:44:12.905 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T21:44:12.905 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-09-11T21:44:12.937 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-09-11T21:44:12.940 DEBUG:teuthology.orchestra.run.smithi193:> test -z $(ls -A /var/lib/ceph) 2024-09-11T21:44:13.185 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T21:44:13.265 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T21:44:13.280 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-11T21:44:13.280 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-11T21:44:13.281 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-11T21:44:13.281 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T21:44:13.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T21:44:13.298 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-09-11T21:44:13.357 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-503.el9.x86_64 2024-09-11T21:44:13.357 INFO:teuthology.task.kernel:Running kernel on smithi152: 5.14.0-503.el9.x86_64 2024-09-11T21:44:13.357 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2024-09-11T21:44:17.815 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.2 MB 00:02 2024-09-11T21:44:19.816 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-11T21:44:24.717 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 5.9 MB/s | 6.5 MB 00:01 2024-09-11T21:44:26.926 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-11T21:44:27.814 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-11T21:44:33.245 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T21:44:35.510 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T21:44:35.510 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T21:44:35.599 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-11T21:44:35.605 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-11T21:44:35.605 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-11T21:44:35.605 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-11T21:44:35.605 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-11T21:44:35.605 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T21:44:35.605 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-11T21:44:35.605 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T21:44:35.605 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T21:44:35.606 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T21:44:35.606 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:44:35.606 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-11T21:44:35.606 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-11T21:44:35.606 INFO:teuthology.orchestra.run.smithi152.stdout:Install 4 Packages 2024-09-11T21:44:35.606 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:44:35.606 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 79 M 2024-09-11T21:44:35.607 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 126 M 2024-09-11T21:44:35.607 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-11T21:44:36.496 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 37 kB/s | 23 kB 00:00 2024-09-11T21:44:39.496 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 9.6 MB/s | 35 MB 00:03 2024-09-11T21:44:39.746 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.1 MB/s | 16 MB 00:03 2024-09-11T21:44:40.221 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 7.7 MB/s | 29 MB 00:03 2024-09-11T21:44:40.222 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-11T21:44:40.222 INFO:teuthology.orchestra.run.smithi152.stdout:Total 17 MB/s | 79 MB 00:04 2024-09-11T21:44:40.897 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-11T21:44:41.230 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-11T21:44:41.230 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-11T21:44:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-11T21:44:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-11T21:44:44.640 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-11T21:44:45.398 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T21:44:45.481 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T21:44:48.287 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T21:44:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T21:44:53.238 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T21:44:53.270 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T21:44:58.115 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T21:45:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T21:45:36.175 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T21:45:36.540 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T21:45:36.541 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T21:45:36.541 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T21:45:36.541 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T21:45:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T21:45:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:45:37.381 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-11T21:45:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T21:45:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T21:45:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T21:45:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T21:45:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:45:37.381 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-11T21:45:37.714 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T21:45:37.795 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T21:45:37.795 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T21:45:37.795 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T21:45:37.795 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T21:45:37.795 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T21:45:37.796 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-11T21:45:37.796 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T21:45:37.796 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T21:45:37.854 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T21:45:37.855 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T21:45:37.855 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2024-09-11T21:45:37.896 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2024-09-11T21:45:37.896 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2024-09-11T21:45:37.896 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.06 2024-09-11T21:45:37.896 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 82.el9 2024-09-11T21:45:37.896 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2024-09-11T21:45:37.896 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T21:45:37.896 INFO:teuthology.orchestra.run.smithi152.stdout:Group : Unspecified 2024-09-11T21:45:37.896 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 8274670 2024-09-11T21:45:37.896 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2024-09-11T21:45:37.896 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : builder@centos.org 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T21:45:37.897 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2024-09-11T21:45:37.898 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:45:37.898 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T21:45:37.898 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T21:45:37.899 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 5.14.0-505.el9.x86_64 2024-09-11T21:45:37.899 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T21:45:38.597 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-09-11T21:45:39.994 INFO:teuthology.orchestra.run.smithi152.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T21:45:40.043 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-09-11T21:45:40.045 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-09-11T21:45:40.060 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.LM7D8jhUIM 2024-09-11T21:45:40.061 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LM7D8jhUIM 2024-09-11T21:45:40.135 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.LM7D8jhUIM 2024-09-11T21:45:40.281 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.LM7D8jhUIM is 6KB 2024-09-11T21:45:40.329 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.LM7D8jhUIM 2024-09-11T21:45:40.344 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T21:45:40.407 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T21:45:40.407 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T21:45:40.407 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T21:45:40.407 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T21:45:40.409 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T21:45:40.539 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2024-09-11T21:46:10.542 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-11T21:46:10.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-11T21:46:10.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:46:29.057 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-11T21:46:38.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-11T21:46:38.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:46:41.117 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-11T21:46:53.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-11T21:46:53.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:47:53.121 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T21:48:08.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-11T21:48:08.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:48:08.616 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-11T21:48:08.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-11T21:48:08.981 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-11T21:48:08.981 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-09-11T21:48:08.997 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-505.el9.x86_64 2024-09-11T21:48:08.997 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T21:48:08.998 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T21:48:08.998 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T21:48:09.999 DEBUG:teuthology.parallel:result is None 2024-09-11T21:48:09.999 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T21:48:10.007 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T21:48:10.007 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T21:48:10.010 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T21:48:10.012 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T21:48:10.031 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T21:48:10.038 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T21:48:10.048 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T21:48:10.049 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T21:48:10.068 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T21:48:10.071 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T21:48:10.370 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T21:48:10.378 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T21:48:10.378 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T21:48:10.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T21:48:10.396 DEBUG:teuthology.orchestra.run.smithi193:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T21:48:10.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T21:48:10.413 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T21:48:10.416 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T21:48:10.438 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T21:48:10.472 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T21:48:10.493 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T21:48:10.515 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T21:48:10.516 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T21:48:10.534 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T21:48:10.535 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T21:48:10.536 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T21:48:10.546 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T21:48:10.546 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T21:48:10.549 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T21:48:10.554 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T21:48:10.581 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T21:48:10.592 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T21:48:10.592 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T21:48:10.618 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T21:48:10.623 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T21:48:10.639 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T21:48:10.718 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T21:48:10.788 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T21:48:10.829 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T21:48:10.871 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:48:10.871 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T21:48:10.936 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T21:48:10.982 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T21:48:11.035 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T21:48:11.120 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T21:48:11.162 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-11T21:48:11.163 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T21:48:11.230 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T21:48:11.280 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T21:48:11.335 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T21:48:11.373 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T21:48:11.422 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-11T21:48:11.422 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T21:48:11.489 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-09-11T21:48:11.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-09-11T21:48:11.494 DEBUG:teuthology.orchestra.run.smithi193:> sudo service rsyslog restart 2024-09-11T21:48:11.535 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T21:48:11.543 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T21:48:11.565 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T21:48:12.025 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T21:48:12.032 INFO:teuthology.task.internal:Starting timer... 2024-09-11T21:48:12.032 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T21:48:12.058 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T21:48:12.067 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-11T21:48:12.067 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-09-11T21:48:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-09-11T21:48:12.140 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2024-09-11T21:48:12.202 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2024-09-11T21:48:12.204 DEBUG:teuthology.orchestra.run.smithi193:> sudo service auditd rotate 2024-09-11T21:48:12.277 INFO:teuthology.orchestra.run.smithi193.stdout:Rotating logs: 2024-09-11T21:48:12.279 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T21:48:12.279 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-09-11T21:48:12.302 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-09-11T21:48:12.302 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2024-09-11T21:48:12.328 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2024-09-11T21:48:12.328 DEBUG:teuthology.orchestra.run.smithi193:> /usr/sbin/getenforce 2024-09-11T21:48:12.349 INFO:teuthology.orchestra.run.smithi193.stdout:Permissive 2024-09-11T21:48:12.349 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi152.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi193.front.sepia.ceph.com': 'permissive'} 2024-09-11T21:48:12.349 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T21:48:12.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T21:48:12.378 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T21:48:12.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T21:48:12.406 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T21:48:12.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T21:48:12.432 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T21:48:12.433 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-09-11T21:48:12.472 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2024-09-11T21:48:12.502 DEBUG:teuthology.orchestra.run.smithi193:> sudo /usr/sbin/setenforce permissive 2024-09-11T21:48:12.533 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T21:48:12.542 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T21:48:12.545 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T21:48:12.691 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T21:48:12.702 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T21:48:12.703 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi152.front.sepia.ceph.com,smithi179.front.sepia.ceph.com,smithi193.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T21:52:20.705 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com'), Remote(name='ubuntu@smithi193.front.sepia.ceph.com')] 2024-09-11T21:52:20.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-11T21:52:20.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:52:20.787 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-11T21:52:20.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-11T21:52:20.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-11T21:52:20.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:52:20.939 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-11T21:52:21.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-11T21:52:21.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-11T21:52:21.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:52:21.093 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-09-11T21:52:21.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-11T21:52:21.168 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T21:52:21.185 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T21:52:21.185 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T21:52:21.185 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T21:52:21.188 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T21:52:21.188 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T21:52:21.190 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T21:52:21.191 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T21:52:21.217 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T21:52:21.218 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T21:52:21.233 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T21:52:21.233 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T21:52:21.238 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T21:52:21.253 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T21:52:21.257 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2024-09-11T21:52:21.258 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-09-11T21:52:21.268 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2024-09-11T21:52:21.269 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-09-11T21:52:21.277 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: ntpd: command not found 2024-09-11T21:52:21.282 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T21:52:21.283 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T21:52:21.288 INFO:teuthology.orchestra.run.smithi193.stdout:506 Cannot talk to daemon 2024-09-11T21:52:21.296 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T21:52:21.297 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T21:52:21.303 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T21:52:21.317 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T21:52:21.353 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-09-11T21:52:21.354 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-11T21:52:21.357 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T21:52:21.357 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-09-11T21:52:21.357 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.357 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.357 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.357 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.358 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T21:52:21.359 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-11T21:52:21.359 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.359 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.359 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.359 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.370 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-09-11T21:52:21.374 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T21:52:21.374 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-09-11T21:52:21.374 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.374 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.374 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.374 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T21:52:21.375 INFO:teuthology.run_tasks:Running task install... 2024-09-11T21:52:21.384 DEBUG:teuthology.task.install:project ceph 2024-09-11T21:52:21.384 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T21:52:21.384 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T21:52:21.384 INFO:teuthology.task.install:Using flavor: default 2024-09-11T21:52:21.390 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T21:52:21.390 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T21:52:21.390 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T21:52:21.391 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:52:21.393 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T21:52:21.393 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:52:21.394 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T21:52:21.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:52:21.541 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T21:52:21.541 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T21:52:21.545 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T21:52:21.545 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T21:52:21.551 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T21:52:21.552 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T21:52:21.651 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T21:52:21.652 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-11T21:52:21.652 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T21:52:21.663 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T21:52:21.664 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-11T21:52:21.664 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T21:52:21.666 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T21:52:21.666 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:52:21.666 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T21:52:21.678 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T21:52:21.679 DEBUG:teuthology.orchestra.run.smithi193:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T21:52:21.691 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T21:52:21.691 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T21:52:21.692 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T21:52:21.693 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T21:52:21.745 DEBUG:teuthology.orchestra.run.smithi193:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T21:52:21.757 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T21:52:21.759 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T21:52:21.821 DEBUG:teuthology.orchestra.run.smithi193:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T21:52:21.832 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T21:52:21.834 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T21:52:21.885 INFO:teuthology.orchestra.run.smithi193.stdout:check_obsoletes = 1 2024-09-11T21:52:21.887 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum clean all 2024-09-11T21:52:21.896 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2024-09-11T21:52:21.899 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2024-09-11T21:52:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-09-11T21:52:21.901 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-09-11T21:52:22.110 INFO:teuthology.orchestra.run.smithi193.stdout:45 files removed 2024-09-11T21:52:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:45 files removed 2024-09-11T21:52:22.125 INFO:teuthology.orchestra.run.smithi152.stdout:45 files removed 2024-09-11T21:52:22.137 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T21:52:22.151 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T21:52:22.152 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T21:52:22.680 INFO:teuthology.orchestra.run.smithi193.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-11T21:52:22.707 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-11T21:52:22.718 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 292 kB/s | 84 kB 00:00 2024-09-11T21:52:22.956 INFO:teuthology.orchestra.run.smithi193.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-11T21:52:22.991 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-11T21:52:23.002 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-11T21:52:23.215 INFO:teuthology.orchestra.run.smithi193.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-11T21:52:23.257 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-11T21:52:23.278 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-11T21:52:23.853 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-11T21:52:24.616 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.2 MB 00:01 2024-09-11T21:52:25.912 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-11T21:52:27.290 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.2 MB 00:04 2024-09-11T21:52:29.109 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 20 MB 00:03 2024-09-11T21:52:30.216 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-11T21:52:30.688 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-11T21:52:32.247 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-11T21:52:33.094 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-11T21:52:33.567 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-11T21:52:35.085 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-11T21:52:35.666 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-11T21:52:35.872 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-11T21:52:37.134 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-11T21:52:38.413 INFO:teuthology.orchestra.run.smithi193.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-11T21:52:38.566 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-11T21:52:40.885 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T21:52:40.886 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T21:52:40.897 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T21:52:40.898 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T21:52:40.899 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T21:52:40.900 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T21:52:40.901 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T21:52:40.904 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T21:52:40.905 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T21:52:40.967 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-09-11T21:52:40.977 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================== 2024-09-11T21:52:40.977 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-09-11T21:52:40.977 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================== 2024-09-11T21:52:40.977 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-09-11T21:52:40.977 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T21:52:40.977 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T21:52:40.977 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T21:52:40.977 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T21:52:40.978 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T21:52:40.979 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T21:52:40.979 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T21:52:40.979 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T21:52:40.979 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T21:52:40.979 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T21:52:40.979 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T21:52:40.979 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T21:52:40.979 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T21:52:40.979 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T21:52:40.979 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T21:52:40.979 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T21:52:40.980 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T21:52:40.980 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T21:52:40.980 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T21:52:40.980 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T21:52:40.980 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T21:52:40.980 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T21:52:40.980 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T21:52:40.980 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T21:52:40.980 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T21:52:40.980 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T21:52:40.980 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T21:52:40.981 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T21:52:40.982 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T21:52:40.983 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T21:52:40.983 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T21:52:40.983 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T21:52:40.983 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T21:52:40.983 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T21:52:40.983 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T21:52:40.983 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T21:52:40.983 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T21:52:40.983 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T21:52:40.983 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T21:52:40.983 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T21:52:40.984 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T21:52:40.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T21:52:40.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T21:52:40.987 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T21:52:40.988 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T21:52:40.988 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T21:52:40.988 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T21:52:40.988 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T21:52:40.988 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T21:52:40.988 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T21:52:40.988 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T21:52:40.988 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T21:52:40.988 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T21:52:40.988 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T21:52:40.988 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T21:52:40.989 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout:Installing weak dependencies: 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:52:40.990 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-09-11T21:52:40.991 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================== 2024-09-11T21:52:40.991 INFO:teuthology.orchestra.run.smithi179.stdout:Install 148 Packages 2024-09-11T21:52:40.991 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 8 Packages 2024-09-11T21:52:40.991 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:52:40.991 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 226 M 2024-09-11T21:52:40.991 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-09-11T21:52:41.278 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T21:52:41.476 INFO:teuthology.orchestra.run.smithi179.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-11T21:52:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.8 MB/s | 897 kB 00:00 2024-09-11T21:52:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.3 MB/s | 145 kB 00:00 2024-09-11T21:52:41.843 INFO:teuthology.orchestra.run.smithi179.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-11T21:52:41.935 INFO:teuthology.orchestra.run.smithi179.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-11T21:52:41.985 INFO:teuthology.orchestra.run.smithi179.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-11T21:52:42.211 INFO:teuthology.orchestra.run.smithi179.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-11T21:52:42.536 INFO:teuthology.orchestra.run.smithi179.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 21 MB 00:01 2024-09-11T21:52:42.586 INFO:teuthology.orchestra.run.smithi179.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 508 kB/s | 25 kB 00:00 2024-09-11T21:52:42.953 INFO:teuthology.orchestra.run.smithi179.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 17 MB/s | 17 MB 00:00 2024-09-11T21:52:43.003 INFO:teuthology.orchestra.run.smithi179.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-11T21:52:43.087 INFO:teuthology.orchestra.run.smithi179.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 325 kB/s | 27 kB 00:00 2024-09-11T21:52:43.154 INFO:teuthology.orchestra.run.smithi179.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 476 kB/s | 32 kB 00:00 2024-09-11T21:52:43.246 INFO:teuthology.orchestra.run.smithi179.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.0 MB/s | 752 kB 00:00 2024-09-11T21:52:43.354 INFO:teuthology.orchestra.run.smithi179.stdout:(15/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 9.3 MB/s | 11 MB 00:01 2024-09-11T21:52:43.380 INFO:teuthology.orchestra.run.smithi179.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.2 MB/s | 163 kB 00:00 2024-09-11T21:52:43.405 INFO:teuthology.orchestra.run.smithi179.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-11T21:52:43.430 INFO:teuthology.orchestra.run.smithi179.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 9.9 MB/s | 506 kB 00:00 2024-09-11T21:52:43.481 INFO:teuthology.orchestra.run.smithi179.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 905 kB/s | 45 kB 00:00 2024-09-11T21:52:43.548 INFO:teuthology.orchestra.run.smithi179.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.0 MB/s | 136 kB 00:00 2024-09-11T21:52:43.614 INFO:teuthology.orchestra.run.smithi179.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-11T21:52:43.690 INFO:teuthology.orchestra.run.smithi179.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.2 MB/s | 321 kB 00:00 2024-09-11T21:52:43.765 INFO:teuthology.orchestra.run.smithi179.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.9 MB/s | 301 kB 00:00 2024-09-11T21:52:43.773 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T21:52:43.774 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T21:52:43.787 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T21:52:43.788 INFO:teuthology.orchestra.run.smithi152.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T21:52:43.789 INFO:teuthology.orchestra.run.smithi152.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T21:52:43.790 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T21:52:43.792 INFO:teuthology.orchestra.run.smithi152.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T21:52:43.795 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T21:52:43.796 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T21:52:43.840 INFO:teuthology.orchestra.run.smithi179.stdout:(24/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-11T21:52:43.858 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-11T21:52:43.865 INFO:teuthology.orchestra.run.smithi179.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 994 kB/s | 100 kB 00:00 2024-09-11T21:52:43.869 INFO:teuthology.orchestra.run.smithi193.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-11T21:52:43.871 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-11T21:52:43.871 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-11T21:52:43.871 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-11T21:52:43.871 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-11T21:52:43.871 INFO:teuthology.orchestra.run.smithi152.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T21:52:43.871 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T21:52:43.871 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T21:52:43.871 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T21:52:43.872 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T21:52:43.873 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T21:52:43.874 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T21:52:43.875 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T21:52:43.875 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T21:52:43.875 INFO:teuthology.orchestra.run.smithi152.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T21:52:43.875 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T21:52:43.875 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-11T21:52:43.875 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T21:52:43.875 INFO:teuthology.orchestra.run.smithi152.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T21:52:43.875 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T21:52:43.875 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T21:52:43.875 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T21:52:43.875 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T21:52:43.876 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T21:52:43.876 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T21:52:43.876 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T21:52:43.876 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T21:52:43.876 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T21:52:43.876 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T21:52:43.876 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T21:52:43.876 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T21:52:43.876 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T21:52:43.876 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T21:52:43.876 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T21:52:43.877 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T21:52:43.877 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T21:52:43.877 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T21:52:43.877 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T21:52:43.877 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T21:52:43.877 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T21:52:43.877 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T21:52:43.877 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T21:52:43.877 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T21:52:43.877 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T21:52:43.878 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T21:52:43.878 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T21:52:43.878 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T21:52:43.878 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T21:52:43.878 INFO:teuthology.orchestra.run.smithi152.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T21:52:43.878 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T21:52:43.878 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T21:52:43.878 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T21:52:43.878 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T21:52:43.878 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T21:52:43.878 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T21:52:43.879 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T21:52:43.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T21:52:43.881 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T21:52:43.881 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T21:52:43.881 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T21:52:43.881 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T21:52:43.881 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T21:52:43.881 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T21:52:43.881 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T21:52:43.881 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T21:52:43.881 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T21:52:43.881 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T21:52:43.882 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T21:52:43.882 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T21:52:43.882 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T21:52:43.882 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T21:52:43.882 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T21:52:43.882 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T21:52:43.882 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T21:52:43.882 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T21:52:43.882 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T21:52:43.882 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T21:52:43.883 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T21:52:43.883 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T21:52:43.883 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T21:52:43.883 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T21:52:43.883 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T21:52:43.883 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T21:52:43.883 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T21:52:43.883 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T21:52:43.883 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T21:52:43.884 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T21:52:43.884 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T21:52:43.884 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T21:52:43.884 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T21:52:43.884 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T21:52:43.884 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T21:52:43.884 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T21:52:43.884 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T21:52:43.884 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T21:52:43.884 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:52:43.885 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-11T21:52:43.886 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-11T21:52:43.886 INFO:teuthology.orchestra.run.smithi152.stdout:Install 148 Packages 2024-09-11T21:52:43.886 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 8 Packages 2024-09-11T21:52:43.886 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:52:43.886 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 226 M 2024-09-11T21:52:43.886 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-11T21:52:43.892 INFO:teuthology.orchestra.run.smithi179.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T21:52:43.950 INFO:teuthology.orchestra.run.smithi179.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-11T21:52:44.050 INFO:teuthology.orchestra.run.smithi179.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 3.1 MB 00:00 2024-09-11T21:52:44.075 INFO:teuthology.orchestra.run.smithi179.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 254 kB/s | 32 kB 00:00 2024-09-11T21:52:44.100 INFO:teuthology.orchestra.run.smithi179.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-11T21:52:44.576 INFO:teuthology.orchestra.run.smithi179.stdout:(31/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 24 MB/s | 49 MB 00:01 2024-09-11T21:52:44.579 INFO:teuthology.orchestra.run.smithi152.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-11T21:52:44.651 INFO:teuthology.orchestra.run.smithi179.stdout:(32/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 6.2 MB/s | 3.6 MB 00:00 2024-09-11T21:52:44.701 INFO:teuthology.orchestra.run.smithi179.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.0 MB/s | 249 kB 00:00 2024-09-11T21:52:44.726 INFO:teuthology.orchestra.run.smithi179.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 658 kB/s | 49 kB 00:00 2024-09-11T21:52:44.746 INFO:teuthology.orchestra.run.smithi152.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 5.3 MB/s | 897 kB 00:00 2024-09-11T21:52:44.760 INFO:teuthology.orchestra.run.smithi179.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 281 kB/s | 16 kB 00:00 2024-09-11T21:52:44.785 INFO:teuthology.orchestra.run.smithi179.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-11T21:52:44.821 INFO:teuthology.orchestra.run.smithi152.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.9 MB/s | 145 kB 00:00 2024-09-11T21:52:44.869 INFO:teuthology.orchestra.run.smithi179.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 9.6 MB/s | 7.4 MB 00:00 2024-09-11T21:52:44.894 INFO:teuthology.orchestra.run.smithi179.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 168 kB/s | 18 kB 00:00 2024-09-11T21:52:44.928 INFO:teuthology.orchestra.run.smithi179.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.5 MB/s | 765 kB 00:00 2024-09-11T21:52:45.037 INFO:teuthology.orchestra.run.smithi179.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-11T21:52:45.063 INFO:teuthology.orchestra.run.smithi152.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 9.9 MB/s | 2.4 MB 00:00 2024-09-11T21:52:45.087 INFO:teuthology.orchestra.run.smithi179.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-11T21:52:45.137 INFO:teuthology.orchestra.run.smithi179.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-11T21:52:45.138 INFO:teuthology.orchestra.run.smithi152.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 8.0 MB/s | 5.4 MB 00:00 2024-09-11T21:52:45.170 INFO:teuthology.orchestra.run.smithi179.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-11T21:52:45.197 INFO:teuthology.orchestra.run.smithi152.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-11T21:52:45.197 INFO:teuthology.orchestra.run.smithi179.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.7 MB/s | 106 kB 00:00 2024-09-11T21:52:45.222 INFO:teuthology.orchestra.run.smithi179.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-11T21:52:45.256 INFO:teuthology.orchestra.run.smithi179.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-09-11T21:52:45.281 INFO:teuthology.orchestra.run.smithi179.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-11T21:52:45.306 INFO:teuthology.orchestra.run.smithi179.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-11T21:52:45.331 INFO:teuthology.orchestra.run.smithi179.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 8.9 MB/s | 689 kB 00:00 2024-09-11T21:52:45.357 INFO:teuthology.orchestra.run.smithi179.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-11T21:52:45.374 INFO:teuthology.orchestra.run.smithi179.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 518 kB/s | 22 kB 00:00 2024-09-11T21:52:45.408 INFO:teuthology.orchestra.run.smithi179.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 7.3 MB/s | 943 kB 00:00 2024-09-11T21:52:45.425 INFO:teuthology.orchestra.run.smithi179.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 649 kB/s | 33 kB 00:00 2024-09-11T21:52:45.450 INFO:teuthology.orchestra.run.smithi179.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-11T21:52:45.475 INFO:teuthology.orchestra.run.smithi179.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-11T21:52:45.480 INFO:teuthology.orchestra.run.smithi152.stdout:(7/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 21 MB/s | 21 MB 00:01 2024-09-11T21:52:45.500 INFO:teuthology.orchestra.run.smithi179.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-11T21:52:45.526 INFO:teuthology.orchestra.run.smithi179.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-11T21:52:45.551 INFO:teuthology.orchestra.run.smithi179.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-09-11T21:52:45.555 INFO:teuthology.orchestra.run.smithi152.stdout:(8/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-11T21:52:45.610 INFO:teuthology.orchestra.run.smithi179.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-11T21:52:45.630 INFO:teuthology.orchestra.run.smithi152.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 336 kB/s | 25 kB 00:00 2024-09-11T21:52:45.643 INFO:teuthology.orchestra.run.smithi179.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-11T21:52:45.668 INFO:teuthology.orchestra.run.smithi179.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 420 kB/s | 24 kB 00:00 2024-09-11T21:52:45.694 INFO:teuthology.orchestra.run.smithi179.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-11T21:52:45.719 INFO:teuthology.orchestra.run.smithi179.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-11T21:52:45.744 INFO:teuthology.orchestra.run.smithi179.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-11T21:52:45.769 INFO:teuthology.orchestra.run.smithi179.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-11T21:52:45.795 INFO:teuthology.orchestra.run.smithi179.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-11T21:52:45.870 INFO:teuthology.orchestra.run.smithi179.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-11T21:52:45.940 INFO:teuthology.orchestra.run.smithi179.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 26 MB/s | 4.9 MB 00:00 2024-09-11T21:52:45.979 INFO:teuthology.orchestra.run.smithi179.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-11T21:52:45.989 INFO:teuthology.orchestra.run.smithi152.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 21 MB/s | 11 MB 00:00 2024-09-11T21:52:46.004 INFO:teuthology.orchestra.run.smithi179.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-11T21:52:46.071 INFO:teuthology.orchestra.run.smithi179.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-11T21:52:46.105 INFO:teuthology.orchestra.run.smithi179.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-11T21:52:46.130 INFO:teuthology.orchestra.run.smithi179.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-11T21:52:46.147 INFO:teuthology.orchestra.run.smithi193.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T21:52:46.149 INFO:teuthology.orchestra.run.smithi193.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T21:52:46.162 INFO:teuthology.orchestra.run.smithi193.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T21:52:46.162 INFO:teuthology.orchestra.run.smithi193.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T21:52:46.163 INFO:teuthology.orchestra.run.smithi193.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T21:52:46.165 INFO:teuthology.orchestra.run.smithi193.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T21:52:46.166 INFO:teuthology.orchestra.run.smithi193.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T21:52:46.169 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T21:52:46.170 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T21:52:46.172 INFO:teuthology.orchestra.run.smithi179.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-11T21:52:46.181 INFO:teuthology.orchestra.run.smithi152.stdout:(11/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 17 MB/s | 17 MB 00:00 2024-09-11T21:52:46.215 INFO:teuthology.orchestra.run.smithi152.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.0 MB/s | 228 kB 00:00 2024-09-11T21:52:46.232 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-11T21:52:46.240 INFO:teuthology.orchestra.run.smithi152.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 460 kB/s | 27 kB 00:00 2024-09-11T21:52:46.246 INFO:teuthology.orchestra.run.smithi193.stdout:====================================================================================== 2024-09-11T21:52:46.246 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-11T21:52:46.246 INFO:teuthology.orchestra.run.smithi193.stdout:====================================================================================== 2024-09-11T21:52:46.246 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-11T21:52:46.246 INFO:teuthology.orchestra.run.smithi193.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T21:52:46.246 INFO:teuthology.orchestra.run.smithi193.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T21:52:46.246 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T21:52:46.246 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T21:52:46.246 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T21:52:46.247 INFO:teuthology.orchestra.run.smithi193.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T21:52:46.248 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T21:52:46.248 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T21:52:46.248 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T21:52:46.248 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T21:52:46.248 INFO:teuthology.orchestra.run.smithi193.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T21:52:46.248 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T21:52:46.248 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T21:52:46.248 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T21:52:46.248 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T21:52:46.248 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T21:52:46.248 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrading: 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T21:52:46.249 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T21:52:46.250 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T21:52:46.251 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T21:52:46.252 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T21:52:46.253 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T21:52:46.254 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T21:52:46.255 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T21:52:46.255 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T21:52:46.255 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T21:52:46.255 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T21:52:46.255 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T21:52:46.255 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T21:52:46.255 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T21:52:46.255 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T21:52:46.255 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T21:52:46.255 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T21:52:46.255 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T21:52:46.256 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T21:52:46.257 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T21:52:46.258 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout:Installing weak dependencies: 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:52:46.259 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-11T21:52:46.260 INFO:teuthology.orchestra.run.smithi193.stdout:====================================================================================== 2024-09-11T21:52:46.260 INFO:teuthology.orchestra.run.smithi193.stdout:Install 148 Packages 2024-09-11T21:52:46.260 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrade 8 Packages 2024-09-11T21:52:46.260 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:52:46.260 INFO:teuthology.orchestra.run.smithi179.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-11T21:52:46.261 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 226 M 2024-09-11T21:52:46.261 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-11T21:52:46.265 INFO:teuthology.orchestra.run.smithi152.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 634 kB/s | 32 kB 00:00 2024-09-11T21:52:46.280 INFO:teuthology.orchestra.run.smithi179.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-11T21:52:46.299 INFO:teuthology.orchestra.run.smithi152.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 752 kB 00:00 2024-09-11T21:52:46.306 INFO:teuthology.orchestra.run.smithi179.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-11T21:52:46.324 INFO:teuthology.orchestra.run.smithi152.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-11T21:52:46.331 INFO:teuthology.orchestra.run.smithi179.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-11T21:52:46.341 INFO:teuthology.orchestra.run.smithi152.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 3.0 MB/s | 127 kB 00:00 2024-09-11T21:52:46.356 INFO:teuthology.orchestra.run.smithi179.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-11T21:52:46.375 INFO:teuthology.orchestra.run.smithi152.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 9.9 MB/s | 506 kB 00:00 2024-09-11T21:52:46.382 INFO:teuthology.orchestra.run.smithi179.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-11T21:52:46.407 INFO:teuthology.orchestra.run.smithi179.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-11T21:52:46.442 INFO:teuthology.orchestra.run.smithi152.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 678 kB/s | 45 kB 00:00 2024-09-11T21:52:46.500 INFO:teuthology.orchestra.run.smithi152.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.3 MB/s | 136 kB 00:00 2024-09-11T21:52:46.507 INFO:teuthology.orchestra.run.smithi179.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-11T21:52:46.533 INFO:teuthology.orchestra.run.smithi179.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-11T21:52:46.558 INFO:teuthology.orchestra.run.smithi179.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-11T21:52:46.583 INFO:teuthology.orchestra.run.smithi179.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-11T21:52:46.601 INFO:teuthology.orchestra.run.smithi152.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 21 MB/s | 5.3 MB 00:00 2024-09-11T21:52:46.608 INFO:teuthology.orchestra.run.smithi179.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-11T21:52:46.626 INFO:teuthology.orchestra.run.smithi152.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.3 MB/s | 162 kB 00:00 2024-09-11T21:52:46.634 INFO:teuthology.orchestra.run.smithi179.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-11T21:52:46.659 INFO:teuthology.orchestra.run.smithi179.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-11T21:52:46.659 INFO:teuthology.orchestra.run.smithi152.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-11T21:52:46.684 INFO:teuthology.orchestra.run.smithi179.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-11T21:52:46.685 INFO:teuthology.orchestra.run.smithi152.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-11T21:52:46.701 INFO:teuthology.orchestra.run.smithi179.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-11T21:52:46.710 INFO:teuthology.orchestra.run.smithi152.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-11T21:52:46.718 INFO:teuthology.orchestra.run.smithi179.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-11T21:52:46.735 INFO:teuthology.orchestra.run.smithi152.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T21:52:46.785 INFO:teuthology.orchestra.run.smithi179.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-11T21:52:46.786 INFO:teuthology.orchestra.run.smithi152.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.4 MB/s | 171 kB 00:00 2024-09-11T21:52:46.802 INFO:teuthology.orchestra.run.smithi179.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 499 kB/s | 42 kB 00:00 2024-09-11T21:52:46.819 INFO:teuthology.orchestra.run.smithi179.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-11T21:52:46.853 INFO:teuthology.orchestra.run.smithi179.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-11T21:52:46.878 INFO:teuthology.orchestra.run.smithi152.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-11T21:52:46.878 INFO:teuthology.orchestra.run.smithi179.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-11T21:52:46.895 INFO:teuthology.orchestra.run.smithi179.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-11T21:52:46.903 INFO:teuthology.orchestra.run.smithi152.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 272 kB/s | 32 kB 00:00 2024-09-11T21:52:46.928 INFO:teuthology.orchestra.run.smithi152.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-11T21:52:46.928 INFO:teuthology.orchestra.run.smithi179.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-11T21:52:46.946 INFO:teuthology.orchestra.run.smithi179.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T21:52:46.953 INFO:teuthology.orchestra.run.smithi193.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-11T21:52:46.965 INFO:teuthology.orchestra.run.smithi179.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.8 MB/s | 96 kB 00:00 2024-09-11T21:52:46.988 INFO:teuthology.orchestra.run.smithi179.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-11T21:52:47.013 INFO:teuthology.orchestra.run.smithi179.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-11T21:52:47.088 INFO:teuthology.orchestra.run.smithi179.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-11T21:52:47.153 INFO:teuthology.orchestra.run.smithi152.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 14 MB/s | 3.6 MB 00:00 2024-09-11T21:52:47.220 INFO:teuthology.orchestra.run.smithi152.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-11T21:52:47.255 INFO:teuthology.orchestra.run.smithi179.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-11T21:52:47.279 INFO:teuthology.orchestra.run.smithi152.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 846 kB/s | 49 kB 00:00 2024-09-11T21:52:47.314 INFO:teuthology.orchestra.run.smithi179.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.4 MB/s | 548 kB 00:00 2024-09-11T21:52:47.339 INFO:teuthology.orchestra.run.smithi179.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-09-11T21:52:47.354 INFO:teuthology.orchestra.run.smithi193.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.2 MB/s | 897 kB 00:00 2024-09-11T21:52:47.371 INFO:teuthology.orchestra.run.smithi152.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-11T21:52:47.381 INFO:teuthology.orchestra.run.smithi179.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-11T21:52:47.396 INFO:teuthology.orchestra.run.smithi152.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 141 kB/s | 16 kB 00:00 2024-09-11T21:52:47.406 INFO:teuthology.orchestra.run.smithi179.stdout:(108/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.0 MB/s | 309 kB 00:00 2024-09-11T21:52:47.429 INFO:teuthology.orchestra.run.smithi193.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.9 MB/s | 145 kB 00:00 2024-09-11T21:52:47.429 INFO:teuthology.orchestra.run.smithi152.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-11T21:52:47.440 INFO:teuthology.orchestra.run.smithi179.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.8 MB/s | 49 kB 00:00 2024-09-11T21:52:47.463 INFO:teuthology.orchestra.run.smithi152.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 11 MB/s | 765 kB 00:00 2024-09-11T21:52:47.465 INFO:teuthology.orchestra.run.smithi179.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-11T21:52:47.488 INFO:teuthology.orchestra.run.smithi152.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 311 kB/s | 18 kB 00:00 2024-09-11T21:52:47.490 INFO:teuthology.orchestra.run.smithi179.stdout:(111/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 238 kB/s | 26 kB 00:00 2024-09-11T21:52:47.516 INFO:teuthology.orchestra.run.smithi179.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-11T21:52:47.558 INFO:teuthology.orchestra.run.smithi179.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-11T21:52:47.583 INFO:teuthology.orchestra.run.smithi179.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T21:52:47.608 INFO:teuthology.orchestra.run.smithi179.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T21:52:47.633 INFO:teuthology.orchestra.run.smithi179.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-11T21:52:47.664 INFO:teuthology.orchestra.run.smithi152.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 399 kB/s | 80 kB 00:00 2024-09-11T21:52:47.667 INFO:teuthology.orchestra.run.smithi179.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.6 MB/s | 839 kB 00:00 2024-09-11T21:52:47.692 INFO:teuthology.orchestra.run.smithi179.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-11T21:52:47.726 INFO:teuthology.orchestra.run.smithi179.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-11T21:52:47.760 INFO:teuthology.orchestra.run.smithi179.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-11T21:52:47.764 INFO:teuthology.orchestra.run.smithi152.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-11T21:52:47.789 INFO:teuthology.orchestra.run.smithi152.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-11T21:52:47.813 INFO:teuthology.orchestra.run.smithi193.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 6.2 MB/s | 2.4 MB 00:00 2024-09-11T21:52:47.823 INFO:teuthology.orchestra.run.smithi152.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-11T21:52:47.843 INFO:teuthology.orchestra.run.smithi179.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-09-11T21:52:47.868 INFO:teuthology.orchestra.run.smithi179.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 1.5 MB/s | 220 kB 00:00 2024-09-11T21:52:47.894 INFO:teuthology.orchestra.run.smithi179.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-11T21:52:47.919 INFO:teuthology.orchestra.run.smithi179.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-11T21:52:47.936 INFO:teuthology.orchestra.run.smithi179.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-09-11T21:52:47.953 INFO:teuthology.orchestra.run.smithi179.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 693 kB/s | 23 kB 00:00 2024-09-11T21:52:47.970 INFO:teuthology.orchestra.run.smithi179.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 582 kB/s | 19 kB 00:00 2024-09-11T21:52:47.987 INFO:teuthology.orchestra.run.smithi179.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 589 kB/s | 20 kB 00:00 2024-09-11T21:52:47.996 INFO:teuthology.orchestra.run.smithi193.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.6 MB/s | 5.4 MB 00:01 2024-09-11T21:52:48.004 INFO:teuthology.orchestra.run.smithi179.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-11T21:52:48.030 INFO:teuthology.orchestra.run.smithi193.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 7.0 MB/s | 1.5 MB 00:00 2024-09-11T21:52:48.037 INFO:teuthology.orchestra.run.smithi179.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-11T21:52:48.054 INFO:teuthology.orchestra.run.smithi179.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-11T21:52:48.088 INFO:teuthology.orchestra.run.smithi179.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-11T21:52:48.113 INFO:teuthology.orchestra.run.smithi179.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-11T21:52:48.147 INFO:teuthology.orchestra.run.smithi179.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-11T21:52:48.172 INFO:teuthology.orchestra.run.smithi179.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-11T21:52:48.198 INFO:teuthology.orchestra.run.smithi179.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-11T21:52:48.222 INFO:teuthology.orchestra.run.smithi179.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-11T21:52:48.248 INFO:teuthology.orchestra.run.smithi179.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T21:52:48.273 INFO:teuthology.orchestra.run.smithi179.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-11T21:52:48.298 INFO:teuthology.orchestra.run.smithi179.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-11T21:52:48.307 INFO:teuthology.orchestra.run.smithi152.stdout:(43/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 18 MB/s | 49 MB 00:02 2024-09-11T21:52:48.324 INFO:teuthology.orchestra.run.smithi179.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-11T21:52:48.330 INFO:teuthology.orchestra.run.smithi193.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-11T21:52:48.332 INFO:teuthology.orchestra.run.smithi152.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 209 kB/s | 106 kB 00:00 2024-09-11T21:52:48.357 INFO:teuthology.orchestra.run.smithi179.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-11T21:52:48.374 INFO:teuthology.orchestra.run.smithi179.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T21:52:48.391 INFO:teuthology.orchestra.run.smithi152.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-11T21:52:48.399 INFO:teuthology.orchestra.run.smithi179.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T21:52:48.424 INFO:teuthology.orchestra.run.smithi152.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 1.9 MB/s | 1.2 MB 00:00 2024-09-11T21:52:48.425 INFO:teuthology.orchestra.run.smithi179.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-11T21:52:48.449 INFO:teuthology.orchestra.run.smithi152.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-11T21:52:48.450 INFO:teuthology.orchestra.run.smithi179.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T21:52:48.475 INFO:teuthology.orchestra.run.smithi179.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-11T21:52:48.508 INFO:teuthology.orchestra.run.smithi152.stdout:(48/156): python3-pycparser-2.20-6.el9.noarch.r 674 kB/s | 135 kB 00:00 2024-09-11T21:52:48.517 INFO:teuthology.orchestra.run.smithi179.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-11T21:52:48.626 INFO:teuthology.orchestra.run.smithi179.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 21 MB/s | 2.3 MB 00:00 2024-09-11T21:52:48.650 INFO:teuthology.orchestra.run.smithi152.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 755 kB/s | 107 kB 00:00 2024-09-11T21:52:48.675 INFO:teuthology.orchestra.run.smithi152.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-09-11T21:52:48.700 INFO:teuthology.orchestra.run.smithi152.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-11T21:52:48.710 INFO:teuthology.orchestra.run.smithi179.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 22 MB/s | 1.8 MB 00:00 2024-09-11T21:52:48.752 INFO:teuthology.orchestra.run.smithi179.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 978 kB/s | 41 kB 00:00 2024-09-11T21:52:48.759 INFO:teuthology.orchestra.run.smithi152.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-11T21:52:48.784 INFO:teuthology.orchestra.run.smithi152.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-11T21:52:48.802 INFO:teuthology.orchestra.run.smithi179.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-11T21:52:48.831 INFO:teuthology.orchestra.run.smithi152.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-11T21:52:48.859 INFO:teuthology.orchestra.run.smithi152.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 244 kB/s | 18 kB 00:00 2024-09-11T21:52:48.877 INFO:teuthology.orchestra.run.smithi179.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-11T21:52:48.885 INFO:teuthology.orchestra.run.smithi152.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 208 kB/s | 11 kB 00:00 2024-09-11T21:52:48.918 INFO:teuthology.orchestra.run.smithi152.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-11T21:52:48.944 INFO:teuthology.orchestra.run.smithi152.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-11T21:52:48.961 INFO:teuthology.orchestra.run.smithi179.stdout:(154/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.7 MB/s | 3.4 MB 00:00 2024-09-11T21:52:48.989 INFO:teuthology.orchestra.run.smithi193.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 9.8 MB/s | 21 MB 00:02 2024-09-11T21:52:49.011 INFO:teuthology.orchestra.run.smithi179.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-09-11T21:52:49.061 INFO:teuthology.orchestra.run.smithi152.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-11T21:52:49.061 INFO:teuthology.orchestra.run.smithi179.stdout:(156/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 5.4 MB/s | 3.2 MB 00:00 2024-09-11T21:52:49.067 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-09-11T21:52:49.067 INFO:teuthology.orchestra.run.smithi179.stdout:Total 28 MB/s | 226 MB 00:08 2024-09-11T21:52:49.094 INFO:teuthology.orchestra.run.smithi152.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-11T21:52:49.119 INFO:teuthology.orchestra.run.smithi152.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-11T21:52:49.140 INFO:teuthology.orchestra.run.smithi193.stdout:(9/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 13 MB/s | 11 MB 00:00 2024-09-11T21:52:49.145 INFO:teuthology.orchestra.run.smithi152.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-11T21:52:49.156 INFO:teuthology.orchestra.run.smithi193.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 151 kB/s | 25 kB 00:00 2024-09-11T21:52:49.195 INFO:teuthology.orchestra.run.smithi152.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-11T21:52:49.220 INFO:teuthology.orchestra.run.smithi152.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-11T21:52:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-11T21:52:49.323 INFO:teuthology.orchestra.run.smithi193.stdout:(11/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 13 MB/s | 17 MB 00:01 2024-09-11T21:52:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.5 MB/s | 3.0 MB 00:00 2024-09-11T21:52:49.349 INFO:teuthology.orchestra.run.smithi193.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.2 MB/s | 228 kB 00:00 2024-09-11T21:52:49.365 INFO:teuthology.orchestra.run.smithi193.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 649 kB/s | 27 kB 00:00 2024-09-11T21:52:49.391 INFO:teuthology.orchestra.run.smithi193.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 754 kB/s | 32 kB 00:00 2024-09-11T21:52:49.450 INFO:teuthology.orchestra.run.smithi193.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.8 MB/s | 752 kB 00:00 2024-09-11T21:52:49.475 INFO:teuthology.orchestra.run.smithi193.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.9 MB/s | 163 kB 00:00 2024-09-11T21:52:49.508 INFO:teuthology.orchestra.run.smithi193.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-11T21:52:49.542 INFO:teuthology.orchestra.run.smithi193.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-11T21:52:49.596 INFO:teuthology.orchestra.run.smithi152.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 6.0 MB/s | 1.6 MB 00:00 2024-09-11T21:52:49.618 INFO:teuthology.orchestra.run.smithi193.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 602 kB/s | 45 kB 00:00 2024-09-11T21:52:49.693 INFO:teuthology.orchestra.run.smithi193.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-11T21:52:49.768 INFO:teuthology.orchestra.run.smithi193.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 162 kB 00:00 2024-09-11T21:52:49.771 INFO:teuthology.orchestra.run.smithi152.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-11T21:52:49.830 INFO:teuthology.orchestra.run.smithi152.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-11T21:52:49.881 INFO:teuthology.orchestra.run.smithi193.stdout:(22/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-11T21:52:49.906 INFO:teuthology.orchestra.run.smithi193.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.3 MB/s | 321 kB 00:00 2024-09-11T21:52:49.932 INFO:teuthology.orchestra.run.smithi193.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.9 MB/s | 301 kB 00:00 2024-09-11T21:52:49.957 INFO:teuthology.orchestra.run.smithi193.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-11T21:52:49.982 INFO:teuthology.orchestra.run.smithi193.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T21:52:50.013 INFO:teuthology.orchestra.run.smithi152.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-09-11T21:52:50.049 INFO:teuthology.orchestra.run.smithi193.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-11T21:52:50.080 INFO:teuthology.orchestra.run.smithi152.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 5.7 MB/s | 4.9 MB 00:00 2024-09-11T21:52:50.139 INFO:teuthology.orchestra.run.smithi152.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-11T21:52:50.158 INFO:teuthology.orchestra.run.smithi193.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-11T21:52:50.183 INFO:teuthology.orchestra.run.smithi193.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 238 kB/s | 32 kB 00:00 2024-09-11T21:52:50.217 INFO:teuthology.orchestra.run.smithi193.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.4 MB/s | 146 kB 00:00 2024-09-11T21:52:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-09-11T21:52:50.281 INFO:teuthology.orchestra.run.smithi152.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-11T21:52:50.317 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-09-11T21:52:50.365 INFO:teuthology.orchestra.run.smithi152.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-11T21:52:50.448 INFO:teuthology.orchestra.run.smithi152.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-11T21:52:50.469 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-09-11T21:52:50.469 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-09-11T21:52:50.484 INFO:teuthology.orchestra.run.smithi193.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 12 MB/s | 3.6 MB 00:00 2024-09-11T21:52:50.490 INFO:teuthology.orchestra.run.smithi152.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-09-11T21:52:50.532 INFO:teuthology.orchestra.run.smithi152.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-11T21:52:50.543 INFO:teuthology.orchestra.run.smithi193.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.2 MB/s | 249 kB 00:00 2024-09-11T21:52:50.591 INFO:teuthology.orchestra.run.smithi152.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T21:52:50.618 INFO:teuthology.orchestra.run.smithi193.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 658 kB/s | 49 kB 00:00 2024-09-11T21:52:50.641 INFO:teuthology.orchestra.run.smithi152.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-09-11T21:52:50.685 INFO:teuthology.orchestra.run.smithi193.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 247 kB/s | 16 kB 00:00 2024-09-11T21:52:50.750 INFO:teuthology.orchestra.run.smithi152.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 6.3 MB/s | 5.8 MB 00:00 2024-09-11T21:52:50.777 INFO:teuthology.orchestra.run.smithi193.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-11T21:52:50.802 INFO:teuthology.orchestra.run.smithi193.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.4 MB/s | 285 kB 00:00 2024-09-11T21:52:50.808 INFO:teuthology.orchestra.run.smithi152.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-11T21:52:50.867 INFO:teuthology.orchestra.run.smithi152.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-11T21:52:50.917 INFO:teuthology.orchestra.run.smithi152.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-11T21:52:50.959 INFO:teuthology.orchestra.run.smithi152.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-11T21:52:51.068 INFO:teuthology.orchestra.run.smithi152.stdout:(86/156): python3-babel-2.9.1-2.el9.noarch.rpm 6.4 MB/s | 6.0 MB 00:00 2024-09-11T21:52:51.093 INFO:teuthology.orchestra.run.smithi152.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-09-11T21:52:51.118 INFO:teuthology.orchestra.run.smithi152.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-11T21:52:51.160 INFO:teuthology.orchestra.run.smithi152.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-11T21:52:51.185 INFO:teuthology.orchestra.run.smithi152.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-11T21:52:51.202 INFO:teuthology.orchestra.run.smithi152.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-11T21:52:51.236 INFO:teuthology.orchestra.run.smithi193.stdout:(37/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 23 MB/s | 49 MB 00:02 2024-09-11T21:52:51.244 INFO:teuthology.orchestra.run.smithi152.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-11T21:52:51.261 INFO:teuthology.orchestra.run.smithi193.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 40 kB/s | 18 kB 00:00 2024-09-11T21:52:51.286 INFO:teuthology.orchestra.run.smithi152.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-11T21:52:51.303 INFO:teuthology.orchestra.run.smithi193.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 1.4 MB/s | 765 kB 00:00 2024-09-11T21:52:51.345 INFO:teuthology.orchestra.run.smithi152.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-11T21:52:51.412 INFO:teuthology.orchestra.run.smithi152.stdout:(95/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.6 MB/s | 5.1 MB 00:00 2024-09-11T21:52:51.437 INFO:teuthology.orchestra.run.smithi152.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 390 kB/s | 36 kB 00:00 2024-09-11T21:52:51.470 INFO:teuthology.orchestra.run.smithi152.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-09-11T21:52:51.521 INFO:teuthology.orchestra.run.smithi152.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-11T21:52:51.546 INFO:teuthology.orchestra.run.smithi152.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 770 kB/s | 58 kB 00:00 2024-09-11T21:52:51.571 INFO:teuthology.orchestra.run.smithi152.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-11T21:52:51.596 INFO:teuthology.orchestra.run.smithi152.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T21:52:51.621 INFO:teuthology.orchestra.run.smithi152.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-11T21:52:51.720 INFO:teuthology.orchestra.run.smithi193.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 165 kB/s | 80 kB 00:00 2024-09-11T21:52:51.845 INFO:teuthology.orchestra.run.smithi193.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 353 kB/s | 191 kB 00:00 2024-09-11T21:52:52.012 INFO:teuthology.orchestra.run.smithi193.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 868 kB/s | 253 kB 00:00 2024-09-11T21:52:52.080 INFO:teuthology.orchestra.run.smithi193.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 980 kB/s | 801 kB 00:00 2024-09-11T21:52:52.121 INFO:teuthology.orchestra.run.smithi193.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 979 kB/s | 106 kB 00:00 2024-09-11T21:52:52.130 INFO:teuthology.orchestra.run.smithi152.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 42 kB/s | 22 kB 00:00 2024-09-11T21:52:52.189 INFO:teuthology.orchestra.run.smithi152.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-11T21:52:52.197 INFO:teuthology.orchestra.run.smithi193.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-11T21:52:52.222 INFO:teuthology.orchestra.run.smithi152.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T21:52:52.239 INFO:teuthology.orchestra.run.smithi193.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-11T21:52:52.256 INFO:teuthology.orchestra.run.smithi152.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 583 kB/s | 19 kB 00:00 2024-09-11T21:52:52.268 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-09-11T21:52:52.269 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-09-11T21:52:52.314 INFO:teuthology.orchestra.run.smithi193.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-11T21:52:52.356 INFO:teuthology.orchestra.run.smithi193.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.4 MB/s | 1.2 MB 00:00 2024-09-11T21:52:52.356 INFO:teuthology.orchestra.run.smithi152.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-09-11T21:52:52.381 INFO:teuthology.orchestra.run.smithi152.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T21:52:52.407 INFO:teuthology.orchestra.run.smithi152.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T21:52:52.432 INFO:teuthology.orchestra.run.smithi152.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T21:52:52.474 INFO:teuthology.orchestra.run.smithi152.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-11T21:52:52.481 INFO:teuthology.orchestra.run.smithi193.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 854 kB/s | 107 kB 00:00 2024-09-11T21:52:52.507 INFO:teuthology.orchestra.run.smithi152.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-11T21:52:52.515 INFO:teuthology.orchestra.run.smithi193.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-11T21:52:52.541 INFO:teuthology.orchestra.run.smithi152.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-11T21:52:52.566 INFO:teuthology.orchestra.run.smithi152.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T21:52:52.590 INFO:teuthology.orchestra.run.smithi193.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 199 kB/s | 22 kB 00:00 2024-09-11T21:52:52.592 INFO:teuthology.orchestra.run.smithi152.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T21:52:52.617 INFO:teuthology.orchestra.run.smithi152.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-11T21:52:52.632 INFO:teuthology.orchestra.run.smithi193.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-11T21:52:52.642 INFO:teuthology.orchestra.run.smithi152.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-11T21:52:52.691 INFO:teuthology.orchestra.run.smithi193.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-11T21:52:52.726 INFO:teuthology.orchestra.run.smithi152.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-11T21:52:52.768 INFO:teuthology.orchestra.run.smithi152.stdout:(119/156): protobuf-compiler-3.14.0-13.el9.x86_ 753 kB/s | 863 kB 00:01 2024-09-11T21:52:52.800 INFO:teuthology.orchestra.run.smithi193.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-11T21:52:52.801 INFO:teuthology.orchestra.run.smithi152.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-11T21:52:52.833 INFO:teuthology.orchestra.run.smithi193.stdout:(55/156): bison-3.7.4-5.el9.x86_64.rpm 1.8 MB/s | 943 kB 00:00 2024-09-11T21:52:52.909 INFO:teuthology.orchestra.run.smithi193.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-11T21:52:52.976 INFO:teuthology.orchestra.run.smithi193.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.7 MB/s | 3.0 MB 00:00 2024-09-11T21:52:53.002 INFO:teuthology.orchestra.run.smithi152.stdout:(121/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.9 MB/s | 16 MB 00:01 2024-09-11T21:52:53.009 INFO:teuthology.orchestra.run.smithi193.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 912 kB/s | 160 kB 00:00 2024-09-11T21:52:53.027 INFO:teuthology.orchestra.run.smithi152.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 851 kB/s | 220 kB 00:00 2024-09-11T21:52:53.034 INFO:teuthology.orchestra.run.smithi193.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 360 kB/s | 45 kB 00:00 2024-09-11T21:52:53.052 INFO:teuthology.orchestra.run.smithi152.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 626 kB/s | 11 kB 00:00 2024-09-11T21:52:53.069 INFO:teuthology.orchestra.run.smithi152.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.2 MB/s | 18 kB 00:00 2024-09-11T21:52:53.086 INFO:teuthology.orchestra.run.smithi152.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-11T21:52:53.101 INFO:teuthology.orchestra.run.smithi193.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2024-09-11T21:52:53.103 INFO:teuthology.orchestra.run.smithi152.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-11T21:52:53.128 INFO:teuthology.orchestra.run.smithi152.stdout:(127/156): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-09-11T21:52:53.143 INFO:teuthology.orchestra.run.smithi193.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-11T21:52:53.145 INFO:teuthology.orchestra.run.smithi152.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-09-11T21:52:53.171 INFO:teuthology.orchestra.run.smithi152.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T21:52:53.196 INFO:teuthology.orchestra.run.smithi152.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T21:52:53.210 INFO:teuthology.orchestra.run.smithi193.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-11T21:52:53.213 INFO:teuthology.orchestra.run.smithi152.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-11T21:52:53.246 INFO:teuthology.orchestra.run.smithi152.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-11T21:52:53.263 INFO:teuthology.orchestra.run.smithi152.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 996 kB/s | 16 kB 00:00 2024-09-11T21:52:53.269 INFO:teuthology.orchestra.run.smithi193.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-11T21:52:53.288 INFO:teuthology.orchestra.run.smithi152.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-11T21:52:53.322 INFO:teuthology.orchestra.run.smithi152.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-11T21:52:53.328 INFO:teuthology.orchestra.run.smithi193.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-11T21:52:53.339 INFO:teuthology.orchestra.run.smithi152.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-11T21:52:53.353 INFO:teuthology.orchestra.run.smithi193.stdout:(65/156): libtool-2.4.6-46.el9.x86_64.rpm 1.7 MB/s | 581 kB 00:00 2024-09-11T21:52:53.378 INFO:teuthology.orchestra.run.smithi193.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-11T21:52:53.389 INFO:teuthology.orchestra.run.smithi152.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-11T21:52:53.415 INFO:teuthology.orchestra.run.smithi152.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 332 kB/s | 31 kB 00:00 2024-09-11T21:52:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-11T21:52:53.465 INFO:teuthology.orchestra.run.smithi152.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-11T21:52:53.491 INFO:teuthology.orchestra.run.smithi152.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-11T21:52:53.516 INFO:teuthology.orchestra.run.smithi152.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-11T21:52:53.541 INFO:teuthology.orchestra.run.smithi152.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T21:52:53.566 INFO:teuthology.orchestra.run.smithi152.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T21:52:53.591 INFO:teuthology.orchestra.run.smithi152.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-11T21:52:53.617 INFO:teuthology.orchestra.run.smithi152.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-11T21:52:53.642 INFO:teuthology.orchestra.run.smithi152.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T21:52:53.692 INFO:teuthology.orchestra.run.smithi152.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T21:52:53.703 INFO:teuthology.orchestra.run.smithi193.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-09-11T21:52:53.845 INFO:teuthology.orchestra.run.smithi193.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 6.3 MB/s | 910 kB 00:00 2024-09-11T21:52:53.909 INFO:teuthology.orchestra.run.smithi152.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-11T21:52:53.954 INFO:teuthology.orchestra.run.smithi193.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-11T21:52:53.968 INFO:teuthology.orchestra.run.smithi152.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 9.8 MB/s | 3.4 MB 00:00 2024-09-11T21:52:54.018 INFO:teuthology.orchestra.run.smithi152.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 7.1 MB/s | 2.3 MB 00:00 2024-09-11T21:52:54.029 INFO:teuthology.orchestra.run.smithi193.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 7.0 MB/s | 4.9 MB 00:00 2024-09-11T21:52:54.085 INFO:teuthology.orchestra.run.smithi152.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 3.6 MB/s | 249 kB 00:00 2024-09-11T21:52:54.110 INFO:teuthology.orchestra.run.smithi152.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 287 kB/s | 41 kB 00:00 2024-09-11T21:52:54.185 INFO:teuthology.orchestra.run.smithi152.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-11T21:52:54.246 INFO:teuthology.orchestra.run.smithi193.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-09-11T21:52:54.355 INFO:teuthology.orchestra.run.smithi193.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 807 kB/s | 87 kB 00:00 2024-09-11T21:52:54.361 INFO:teuthology.orchestra.run.smithi152.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 2.4 MB 00:00 2024-09-11T21:52:54.427 INFO:teuthology.orchestra.run.smithi152.stdout:(156/156): NetworkManager-libnm-1.49.90-1.el9.x 3.5 MB/s | 1.8 MB 00:00 2024-09-11T21:52:54.434 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-11T21:52:54.434 INFO:teuthology.orchestra.run.smithi152.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-11T21:52:55.214 INFO:teuthology.orchestra.run.smithi193.stdout:(73/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 4.4 MB 00:01 2024-09-11T21:52:55.305 INFO:teuthology.orchestra.run.smithi193.stdout:(74/156): python3-babel-2.9.1-2.el9.noarch.rpm 6.3 MB/s | 6.0 MB 00:00 2024-09-11T21:52:55.331 INFO:teuthology.orchestra.run.smithi193.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 525 kB/s | 61 kB 00:00 2024-09-11T21:52:55.423 INFO:teuthology.orchestra.run.smithi193.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-11T21:52:55.456 INFO:teuthology.orchestra.run.smithi193.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-11T21:52:55.557 INFO:teuthology.orchestra.run.smithi193.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 191 kB/s | 26 kB 00:00 2024-09-11T21:52:55.582 INFO:teuthology.orchestra.run.smithi193.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-09-11T21:52:55.652 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-11T21:52:55.674 INFO:teuthology.orchestra.run.smithi193.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-11T21:52:55.699 INFO:teuthology.orchestra.run.smithi193.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-09-11T21:52:55.803 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-11T21:52:55.803 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-11T21:52:55.816 INFO:teuthology.orchestra.run.smithi193.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-11T21:52:55.934 INFO:teuthology.orchestra.run.smithi193.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-11T21:52:56.050 INFO:teuthology.orchestra.run.smithi193.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 662 kB/s | 77 kB 00:00 2024-09-11T21:52:56.167 INFO:teuthology.orchestra.run.smithi193.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-11T21:52:56.284 INFO:teuthology.orchestra.run.smithi193.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-11T21:52:56.410 INFO:teuthology.orchestra.run.smithi193.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-11T21:52:56.568 INFO:teuthology.orchestra.run.smithi193.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.7 MB/s | 5.1 MB 00:00 2024-09-11T21:52:56.594 INFO:teuthology.orchestra.run.smithi193.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-11T21:52:56.694 INFO:teuthology.orchestra.run.smithi193.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 407 kB/s | 51 kB 00:00 2024-09-11T21:52:56.719 INFO:teuthology.orchestra.run.smithi193.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 428 kB/s | 54 kB 00:00 2024-09-11T21:52:56.828 INFO:teuthology.orchestra.run.smithi193.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-11T21:52:56.936 INFO:teuthology.orchestra.run.smithi193.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-11T21:52:57.053 INFO:teuthology.orchestra.run.smithi193.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-11T21:52:57.170 INFO:teuthology.orchestra.run.smithi193.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 307 kB/s | 36 kB 00:00 2024-09-11T21:52:57.279 INFO:teuthology.orchestra.run.smithi193.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-11T21:52:57.479 INFO:teuthology.orchestra.run.smithi193.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-11T21:52:57.588 INFO:teuthology.orchestra.run.smithi193.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-09-11T21:52:57.705 INFO:teuthology.orchestra.run.smithi193.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 820 kB/s | 96 kB 00:00 2024-09-11T21:52:57.847 INFO:teuthology.orchestra.run.smithi193.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 450 kB/s | 64 kB 00:00 2024-09-11T21:52:57.956 INFO:teuthology.orchestra.run.smithi193.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-11T21:52:58.019 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-11T21:52:58.020 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-11T21:52:58.072 INFO:teuthology.orchestra.run.smithi193.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-11T21:52:58.314 INFO:teuthology.orchestra.run.smithi193.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-11T21:52:58.373 INFO:teuthology.orchestra.run.smithi193.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-11T21:52:58.398 INFO:teuthology.orchestra.run.smithi193.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-11T21:52:58.424 INFO:teuthology.orchestra.run.smithi193.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-11T21:52:58.524 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-09-11T21:52:58.549 INFO:teuthology.orchestra.run.smithi193.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-11T21:52:58.574 INFO:teuthology.orchestra.run.smithi193.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T21:52:58.600 INFO:teuthology.orchestra.run.smithi193.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T21:52:58.616 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T21:52:58.625 INFO:teuthology.orchestra.run.smithi193.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T21:52:58.650 INFO:teuthology.orchestra.run.smithi193.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-11T21:52:58.653 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T21:52:58.692 INFO:teuthology.orchestra.run.smithi193.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-11T21:52:58.706 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T21:52:58.734 INFO:teuthology.orchestra.run.smithi193.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-11T21:52:58.741 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T21:52:58.760 INFO:teuthology.orchestra.run.smithi193.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T21:52:58.766 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T21:52:58.785 INFO:teuthology.orchestra.run.smithi193.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T21:52:58.809 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T21:52:58.810 INFO:teuthology.orchestra.run.smithi193.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-11T21:52:58.835 INFO:teuthology.orchestra.run.smithi193.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-11T21:52:58.869 INFO:teuthology.orchestra.run.smithi193.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-11T21:52:58.894 INFO:teuthology.orchestra.run.smithi193.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-09-11T21:52:58.920 INFO:teuthology.orchestra.run.smithi193.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-11T21:52:58.995 INFO:teuthology.orchestra.run.smithi193.stdout:(121/156): python3-grpcio-1.46.7-10.el9.x86_64. 27 MB/s | 2.0 MB 00:00 2024-09-11T21:52:59.021 INFO:teuthology.orchestra.run.smithi193.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-11T21:52:59.037 INFO:teuthology.orchestra.run.smithi193.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 637 kB/s | 11 kB 00:00 2024-09-11T21:52:59.054 INFO:teuthology.orchestra.run.smithi193.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-11T21:52:59.071 INFO:teuthology.orchestra.run.smithi193.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-11T21:52:59.088 INFO:teuthology.orchestra.run.smithi193.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-11T21:52:59.114 INFO:teuthology.orchestra.run.smithi193.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 782 kB/s | 20 kB 00:00 2024-09-11T21:52:59.130 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T21:52:59.156 INFO:teuthology.orchestra.run.smithi193.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 24 MB/s | 1.0 MB 00:00 2024-09-11T21:52:59.231 INFO:teuthology.orchestra.run.smithi193.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 618 kB/s | 46 kB 00:00 2024-09-11T21:52:59.261 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T21:52:59.399 INFO:teuthology.orchestra.run.smithi193.stdout:(130/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.0 MB/s | 16 MB 00:02 2024-09-11T21:52:59.424 INFO:teuthology.orchestra.run.smithi193.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 410 kB/s | 79 kB 00:00 2024-09-11T21:52:59.456 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T21:52:59.457 INFO:teuthology.orchestra.run.smithi193.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 10 MB/s | 272 kB 00:00 2024-09-11T21:52:59.483 INFO:teuthology.orchestra.run.smithi193.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 712 kB/s | 16 kB 00:00 2024-09-11T21:52:59.493 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T21:52:59.508 INFO:teuthology.orchestra.run.smithi193.stdout:(134/156): python3-natsort-7.1.1-5.el9.noarch.r 530 kB/s | 58 kB 00:00 2024-09-11T21:52:59.533 INFO:teuthology.orchestra.run.smithi193.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-11T21:52:59.559 INFO:teuthology.orchestra.run.smithi193.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-11T21:52:59.584 INFO:teuthology.orchestra.run.smithi193.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-11T21:52:59.585 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T21:52:59.609 INFO:teuthology.orchestra.run.smithi193.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T21:52:59.614 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T21:52:59.635 INFO:teuthology.orchestra.run.smithi193.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-11T21:52:59.660 INFO:teuthology.orchestra.run.smithi193.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-11T21:52:59.685 INFO:teuthology.orchestra.run.smithi193.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-11T21:52:59.710 INFO:teuthology.orchestra.run.smithi193.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-11T21:52:59.736 INFO:teuthology.orchestra.run.smithi193.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-11T21:52:59.761 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T21:52:59.761 INFO:teuthology.orchestra.run.smithi193.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-11T21:52:59.786 INFO:teuthology.orchestra.run.smithi193.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-11T21:52:59.811 INFO:teuthology.orchestra.run.smithi193.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-11T21:52:59.819 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T21:52:59.847 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T21:52:59.862 INFO:teuthology.orchestra.run.smithi193.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-11T21:52:59.951 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T21:52:59.973 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T21:53:00.036 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T21:53:00.057 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T21:53:00.071 INFO:teuthology.orchestra.run.smithi193.stdout:(148/156): postgresql-server-13.16-1.el9.x86_64 967 kB/s | 5.8 MB 00:06 2024-09-11T21:53:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T21:53:00.137 INFO:teuthology.orchestra.run.smithi193.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-11T21:53:00.196 INFO:teuthology.orchestra.run.smithi193.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.5 MB/s | 3.2 MB 00:00 2024-09-11T21:53:00.260 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T21:53:00.321 INFO:teuthology.orchestra.run.smithi193.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 326 kB/s | 41 kB 00:00 2024-09-11T21:53:00.432 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T21:53:00.463 INFO:teuthology.orchestra.run.smithi193.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 5.9 MB/s | 2.3 MB 00:00 2024-09-11T21:53:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T21:53:00.597 INFO:teuthology.orchestra.run.smithi193.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-11T21:53:00.676 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T21:53:00.722 INFO:teuthology.orchestra.run.smithi193.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 621 kB/s | 249 kB 00:00 2024-09-11T21:53:00.757 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T21:53:00.864 INFO:teuthology.orchestra.run.smithi193.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 2.4 MB 00:00 2024-09-11T21:53:00.977 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T21:53:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T21:53:01.203 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T21:53:01.237 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T21:53:01.239 INFO:teuthology.orchestra.run.smithi193.stdout:(156/156): NetworkManager-libnm-1.49.90-1.el9.x 1.6 MB/s | 1.8 MB 00:01 2024-09-11T21:53:01.245 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-11T21:53:01.245 INFO:teuthology.orchestra.run.smithi193.stdout:Total 15 MB/s | 226 MB 00:14 2024-09-11T21:53:01.272 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T21:53:01.345 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T21:53:01.390 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T21:53:01.421 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T21:53:01.465 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T21:53:01.497 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T21:53:01.525 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T21:53:01.595 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T21:53:01.648 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T21:53:01.686 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T21:53:01.734 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T21:53:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T21:53:01.852 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T21:53:01.896 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T21:53:01.924 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T21:53:01.997 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T21:53:02.039 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T21:53:02.113 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T21:53:02.255 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T21:53:02.308 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T21:53:02.477 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-11T21:53:02.629 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-11T21:53:02.629 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-11T21:53:02.836 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T21:53:02.921 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T21:53:02.950 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T21:53:02.992 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T21:53:03.030 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T21:53:03.072 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T21:53:03.231 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T21:53:03.300 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T21:53:03.355 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T21:53:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T21:53:03.459 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T21:53:03.495 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T21:53:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T21:53:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T21:53:03.620 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T21:53:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T21:53:03.803 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T21:53:03.851 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T21:53:03.892 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T21:53:03.995 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T21:53:04.026 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T21:53:04.065 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T21:53:04.091 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T21:53:04.116 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T21:53:04.191 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T21:53:04.326 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T21:53:04.356 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T21:53:04.372 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-11T21:53:04.384 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T21:53:04.418 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T21:53:04.458 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T21:53:04.473 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T21:53:04.489 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T21:53:04.519 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T21:53:04.519 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-11T21:53:04.520 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-11T21:53:04.522 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T21:53:04.554 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T21:53:04.587 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T21:53:04.588 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T21:53:04.621 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T21:53:04.629 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T21:53:04.647 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T21:53:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T21:53:04.706 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T21:53:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T21:53:04.977 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T21:53:05.016 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T21:53:05.039 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T21:53:05.119 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T21:53:05.167 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T21:53:05.231 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T21:53:05.481 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T21:53:05.524 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T21:53:05.600 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T21:53:05.629 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T21:53:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T21:53:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T21:53:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T21:53:05.892 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T21:53:05.939 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T21:53:05.973 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T21:53:05.990 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T21:53:06.012 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T21:53:06.075 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T21:53:06.076 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T21:53:06.105 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T21:53:06.130 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T21:53:06.136 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T21:53:06.181 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T21:53:06.271 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T21:53:06.307 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T21:53:06.308 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T21:53:06.493 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T21:53:06.500 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T21:53:06.523 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T21:53:06.601 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T21:53:06.653 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T21:53:06.766 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T21:53:06.837 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T21:53:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T21:53:07.181 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T21:53:07.244 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T21:53:07.273 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T21:53:07.313 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T21:53:07.353 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T21:53:07.354 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T21:53:07.439 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T21:53:07.486 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T21:53:07.518 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T21:53:07.562 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T21:53:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T21:53:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T21:53:07.699 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T21:53:07.752 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T21:53:07.784 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T21:53:07.827 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T21:53:07.902 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T21:53:07.938 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T21:53:07.981 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T21:53:08.010 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T21:53:08.079 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T21:53:08.133 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T21:53:08.223 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T21:53:08.363 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T21:53:08.418 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T21:53:08.566 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T21:53:08.644 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T21:53:08.671 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T21:53:08.705 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T21:53:08.932 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T21:53:09.013 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T21:53:09.013 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T21:53:09.042 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T21:53:09.068 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T21:53:09.085 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T21:53:09.123 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T21:53:09.166 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T21:53:09.174 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T21:53:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T21:53:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T21:53:09.330 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T21:53:09.393 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T21:53:09.477 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T21:53:09.544 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T21:53:09.585 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T21:53:09.621 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T21:53:09.668 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T21:53:09.704 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T21:53:09.710 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T21:53:09.747 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T21:53:09.754 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T21:53:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T21:53:09.825 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T21:53:09.856 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T21:53:09.924 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T21:53:09.974 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T21:53:10.023 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T21:53:10.125 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T21:53:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T21:53:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T21:53:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T21:53:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T21:53:10.342 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T21:53:10.464 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T21:53:10.505 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T21:53:10.533 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T21:53:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T21:53:10.802 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T21:53:10.841 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T21:53:10.879 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T21:53:10.914 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T21:53:10.929 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-11T21:53:10.947 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T21:53:10.989 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T21:53:11.023 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T21:53:11.034 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T21:53:11.111 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T21:53:11.137 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T21:53:11.161 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T21:53:11.201 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T21:53:11.236 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T21:53:11.269 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T21:53:11.295 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T21:53:11.303 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T21:53:11.346 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T21:53:11.351 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T21:53:11.684 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T21:53:11.804 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T21:53:11.927 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T21:53:11.956 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T21:53:12.047 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T21:53:12.067 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T21:53:12.076 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T21:53:12.124 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T21:53:12.143 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T21:53:12.157 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T21:53:12.177 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T21:53:12.223 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T21:53:12.256 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T21:53:12.282 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T21:53:12.310 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T21:53:12.312 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T21:53:12.356 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T21:53:12.413 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T21:53:12.436 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T21:53:12.460 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T21:53:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T21:53:12.501 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T21:53:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T21:53:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T21:53:12.683 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T21:53:12.723 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T21:53:12.724 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T21:53:12.798 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T21:53:12.801 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T21:53:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T21:53:12.872 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T21:53:12.964 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T21:53:12.964 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T21:53:12.964 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T21:53:12.964 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:12.998 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T21:53:13.003 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T21:53:13.102 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T21:53:13.192 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T21:53:13.404 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T21:53:13.455 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T21:53:13.510 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T21:53:13.571 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T21:53:13.627 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T21:53:13.664 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T21:53:13.699 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T21:53:13.772 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T21:53:13.816 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T21:53:13.856 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T21:53:13.917 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T21:53:13.949 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T21:53:13.977 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T21:53:14.047 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T21:53:14.100 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T21:53:14.130 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T21:53:14.174 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T21:53:14.260 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T21:53:14.302 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T21:53:14.345 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T21:53:14.373 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T21:53:14.443 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T21:53:14.488 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T21:53:14.562 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T21:53:14.704 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T21:53:14.758 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T21:53:14.821 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T21:53:14.902 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T21:53:14.929 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T21:53:14.963 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T21:53:15.272 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T21:53:15.279 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T21:53:15.348 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T21:53:15.358 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T21:53:15.387 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T21:53:15.430 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T21:53:15.441 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T21:53:15.468 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T21:53:15.489 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T21:53:15.510 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T21:53:15.525 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T21:53:15.675 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T21:53:15.746 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T21:53:15.810 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T21:53:15.884 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T21:53:15.914 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T21:53:15.950 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T21:53:15.997 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T21:53:16.000 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T21:53:16.033 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T21:53:16.037 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T21:53:16.076 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T21:53:16.108 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T21:53:16.119 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T21:53:16.139 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T21:53:16.254 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T21:53:16.312 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T21:53:16.354 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T21:53:16.456 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T21:53:16.487 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T21:53:16.527 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T21:53:16.553 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T21:53:16.653 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T21:53:16.897 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T21:53:17.021 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T21:53:17.086 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T21:53:17.116 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T21:53:17.150 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T21:53:17.189 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T21:53:17.221 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T21:53:17.251 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T21:53:17.294 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T21:53:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T21:53:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T21:53:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T21:53:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T21:53:17.542 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T21:53:17.573 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T21:53:17.676 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T21:53:17.732 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T21:53:18.448 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T21:53:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T21:53:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T21:53:18.606 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T21:53:18.630 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T21:53:18.642 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T21:53:18.677 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T21:53:18.723 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T21:53:18.818 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T21:53:18.875 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T21:53:19.058 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T21:53:19.090 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T21:53:19.167 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T21:53:19.190 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T21:53:19.229 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T21:53:19.321 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T21:53:19.321 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T21:53:19.321 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T21:53:19.321 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:19.355 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T21:53:19.825 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T21:53:19.938 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T21:53:21.151 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T21:53:21.229 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T21:53:21.256 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T21:53:21.290 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T21:53:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T21:53:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T21:53:21.743 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T21:53:21.774 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T21:53:21.810 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T21:53:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T21:53:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T21:53:22.402 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T21:53:22.424 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T21:53:24.777 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T21:53:24.777 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2024-09-11T21:53:24.777 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2024-09-11T21:53:24.777 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2024-09-11T21:53:24.777 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2024-09-11T21:53:24.777 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2024-09-11T21:53:24.777 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /root 2024-09-11T21:53:24.777 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2024-09-11T21:53:24.777 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:24.789 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T21:53:24.838 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T21:53:24.961 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T21:53:24.977 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T21:53:24.978 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:24.978 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T21:53:24.978 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:25.381 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T21:53:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T21:53:25.491 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T21:53:25.491 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T21:53:25.491 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T21:53:25.491 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:53:25.519 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T21:53:26.447 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T21:53:26.475 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T21:53:26.475 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:26.475 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T21:53:26.475 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T21:53:26.475 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T21:53:26.476 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:26.706 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T21:53:26.730 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T21:53:26.730 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:26.730 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T21:53:26.730 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T21:53:26.730 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T21:53:26.730 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:27.165 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T21:53:27.189 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T21:53:27.189 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:27.189 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T21:53:27.190 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T21:53:27.190 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T21:53:27.190 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:27.295 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T21:53:27.352 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T21:53:27.407 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T21:53:27.593 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T21:53:27.649 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T21:53:27.737 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T21:53:27.824 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T21:53:27.963 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T21:53:28.008 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T21:53:28.040 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T21:53:28.067 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T21:53:28.545 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T21:53:28.575 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T21:53:28.607 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T21:53:28.670 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T21:53:28.698 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T21:53:29.743 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T21:53:29.801 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T21:53:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T21:53:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T21:53:30.911 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T21:53:31.078 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T21:53:31.110 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T21:53:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T21:53:31.136 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:31.136 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T21:53:31.136 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T21:53:31.136 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T21:53:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T21:53:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T21:53:31.228 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T21:53:31.228 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-09-11T21:53:31.229 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-09-11T21:53:31.229 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-09-11T21:53:31.229 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-09-11T21:53:31.229 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-09-11T21:53:31.229 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /root 2024-09-11T21:53:31.229 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-09-11T21:53:31.229 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:31.296 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T21:53:31.359 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T21:53:31.406 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T21:53:31.422 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T21:53:31.422 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:31.422 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T21:53:31.422 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:32.285 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T21:53:32.314 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T21:53:32.339 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T21:53:32.339 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:32.339 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T21:53:32.339 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T21:53:32.339 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T21:53:32.339 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:32.389 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T21:53:32.413 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T21:53:32.413 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:32.414 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T21:53:32.414 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:32.474 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T21:53:32.498 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T21:53:32.498 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:32.498 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T21:53:32.498 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T21:53:32.498 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T21:53:32.499 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:32.799 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T21:53:32.823 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T21:53:32.823 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:32.823 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T21:53:32.823 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T21:53:32.823 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T21:53:32.823 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:32.918 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T21:53:32.945 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T21:53:32.945 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:32.945 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T21:53:32.945 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T21:53:32.945 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T21:53:32.945 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:33.185 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T21:53:33.208 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T21:53:33.209 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:33.209 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T21:53:33.209 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T21:53:33.209 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T21:53:33.209 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:33.644 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T21:53:33.667 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T21:53:33.667 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:33.667 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T21:53:33.667 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T21:53:33.667 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T21:53:33.667 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:33.782 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T21:53:33.838 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T21:53:33.902 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T21:53:34.094 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T21:53:34.144 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T21:53:34.221 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T21:53:34.318 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T21:53:34.465 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T21:53:34.513 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T21:53:34.551 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T21:53:34.579 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T21:53:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T21:53:35.019 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T21:53:35.050 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T21:53:35.112 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T21:53:35.141 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T21:53:36.177 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T21:53:36.218 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T21:53:37.178 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T21:53:37.219 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T21:53:37.321 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T21:53:37.361 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T21:53:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T21:53:37.444 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T21:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T21:53:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T21:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T21:53:37.522 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T21:53:37.546 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T21:53:37.546 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:37.546 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T21:53:37.546 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T21:53:37.546 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T21:53:37.546 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:37.596 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T21:53:37.606 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T21:53:37.608 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /sys 2024-09-11T21:53:37.609 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /proc 2024-09-11T21:53:37.609 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /mnt 2024-09-11T21:53:37.609 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /var/tmp 2024-09-11T21:53:37.609 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /home 2024-09-11T21:53:37.609 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /root 2024-09-11T21:53:37.609 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /tmp 2024-09-11T21:53:37.609 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:53:37.609 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T21:53:37.676 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T21:53:37.705 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T21:53:37.732 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T21:53:37.761 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T21:53:37.762 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T21:53:37.783 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T21:53:37.792 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T21:53:37.800 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T21:53:37.800 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:37.800 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T21:53:37.800 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:53:37.830 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T21:53:38.436 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T21:53:38.478 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T21:53:38.499 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T21:53:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T21:53:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T21:53:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T21:53:38.747 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:38.748 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T21:53:38.748 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T21:53:38.748 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T21:53:38.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:38.791 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T21:53:38.814 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T21:53:38.814 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:38.814 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T21:53:38.814 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:38.858 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T21:53:38.881 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T21:53:38.881 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:38.882 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T21:53:38.882 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T21:53:38.882 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T21:53:38.882 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:39.184 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T21:53:39.207 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T21:53:39.207 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:39.207 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T21:53:39.207 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T21:53:39.207 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T21:53:39.207 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:39.294 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T21:53:39.321 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T21:53:39.321 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:39.321 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T21:53:39.321 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T21:53:39.321 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T21:53:39.321 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:53:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T21:53:39.424 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T21:53:39.465 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T21:53:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T21:53:39.547 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T21:53:39.569 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T21:53:39.569 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:39.569 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T21:53:39.569 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T21:53:39.569 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T21:53:39.569 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:53:39.577 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T21:53:39.603 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T21:53:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T21:53:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T21:53:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T21:53:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T21:53:39.814 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T21:53:39.839 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T21:53:39.845 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T21:53:39.845 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T21:53:40.012 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T21:53:40.024 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T21:53:40.024 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T21:53:40.036 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T21:53:40.036 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:40.036 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T21:53:40.037 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T21:53:40.037 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T21:53:40.037 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:53:40.108 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T21:53:40.143 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T21:53:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T21:53:40.199 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T21:53:40.255 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T21:53:40.440 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T21:53:40.491 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T21:53:40.566 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T21:53:40.655 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T21:53:40.793 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T21:53:40.856 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T21:53:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T21:53:40.915 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T21:53:41.366 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T21:53:41.398 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T21:53:41.429 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T21:53:41.500 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T21:53:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T21:53:42.578 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T21:53:42.614 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T21:53:43.584 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T21:53:43.615 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T21:53:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T21:53:43.788 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T21:53:43.837 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T21:53:43.880 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T21:53:43.886 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T21:53:43.918 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T21:53:43.934 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T21:53:43.945 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T21:53:43.960 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T21:53:43.960 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:43.960 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T21:53:43.960 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T21:53:43.960 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T21:53:43.960 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:53:44.009 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T21:53:44.021 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T21:53:44.129 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T21:53:44.145 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T21:53:44.175 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T21:53:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T21:53:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T21:53:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T21:53:44.306 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T21:53:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T21:53:44.895 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T21:53:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T21:53:45.103 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T21:53:45.137 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T21:53:45.161 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T21:53:45.161 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:45.161 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T21:53:45.161 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T21:53:45.161 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T21:53:45.161 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:53:45.205 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T21:53:45.227 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T21:53:45.228 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:45.228 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T21:53:45.228 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:53:45.272 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T21:53:45.295 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T21:53:45.296 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:45.296 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T21:53:45.296 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T21:53:45.296 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T21:53:45.296 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:53:45.606 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T21:53:45.629 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T21:53:45.630 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T21:53:45.630 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T21:53:45.630 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T21:53:45.630 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T21:53:45.630 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:53:45.772 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T21:53:45.772 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T21:53:45.772 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T21:53:45.772 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T21:53:45.773 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T21:53:45.774 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T21:53:45.775 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T21:53:45.776 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T21:53:45.777 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T21:53:45.778 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T21:53:45.779 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T21:53:45.780 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T21:53:45.781 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T21:53:45.782 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T21:53:45.783 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T21:53:45.784 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T21:53:45.784 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T21:53:45.784 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T21:53:45.784 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T21:53:45.784 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T21:53:45.784 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T21:53:45.784 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T21:53:45.784 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T21:53:45.784 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T21:53:45.785 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T21:53:45.785 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T21:53:45.785 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T21:53:45.785 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T21:53:45.866 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T21:53:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T21:53:46.030 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T21:53:46.069 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T21:53:46.094 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T21:53:46.120 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T21:53:46.120 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T21:53:46.204 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T21:53:46.205 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T21:53:46.288 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T21:53:46.313 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T21:53:46.318 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T21:53:46.318 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T21:53:46.506 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T21:53:46.506 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T21:53:46.591 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T21:53:46.655 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T21:53:48.243 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T21:53:48.244 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:48.244 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-09-11T21:53:48.244 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T21:53:48.244 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T21:53:48.244 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T21:53:48.244 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T21:53:48.244 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.244 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.244 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T21:53:48.244 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T21:53:48.245 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-09-11T21:53:48.245 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T21:53:48.245 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T21:53:48.245 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T21:53:48.245 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T21:53:48.245 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.245 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.245 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.247 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.248 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:48.249 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.249 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.249 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.249 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:48.249 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:48.249 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.249 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.249 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:48.249 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T21:53:48.249 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T21:53:48.249 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T21:53:48.250 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T21:53:48.250 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T21:53:48.250 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T21:53:48.250 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T21:53:48.250 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T21:53:48.250 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T21:53:48.250 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T21:53:48.250 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T21:53:48.250 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.250 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.250 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T21:53:48.251 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T21:53:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.253 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T21:53:48.254 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T21:53:48.255 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T21:53:48.256 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T21:53:48.257 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.258 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.259 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:48.259 INFO:teuthology.orchestra.run.smithi179.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T21:53:48.259 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T21:53:48.259 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T21:53:48.259 INFO:teuthology.orchestra.run.smithi179.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T21:53:48.259 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T21:53:48.259 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T21:53:48.259 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T21:53:48.259 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:53:48.259 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-09-11T21:53:48.668 DEBUG:teuthology.parallel:result is None 2024-09-11T21:53:50.185 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T21:53:50.226 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T21:53:50.267 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T21:53:50.299 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T21:53:50.327 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T21:53:50.507 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T21:53:50.565 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T21:53:50.596 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T21:53:50.625 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T21:53:50.680 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T21:53:51.299 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T21:53:51.345 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T21:53:51.366 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T21:53:52.208 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T21:53:52.301 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T21:53:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T21:53:52.411 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T21:53:52.412 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T21:53:52.412 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T21:53:52.412 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T21:53:52.412 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T21:53:52.412 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T21:53:52.412 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T21:53:52.412 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T21:53:52.412 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T21:53:52.412 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T21:53:52.412 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T21:53:52.412 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T21:53:52.413 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T21:53:52.414 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T21:53:52.414 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T21:53:52.425 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T21:53:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T21:53:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T21:53:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T21:53:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T21:53:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T21:53:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T21:53:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T21:53:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T21:53:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T21:53:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T21:53:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T21:53:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T21:53:52.428 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T21:53:52.428 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T21:53:52.428 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T21:53:52.428 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T21:53:52.428 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T21:53:52.428 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T21:53:52.428 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T21:53:52.428 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T21:53:52.428 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T21:53:52.428 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T21:53:52.429 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T21:53:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T21:53:52.431 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T21:53:52.432 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T21:53:52.433 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T21:53:52.434 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T21:53:52.435 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T21:53:52.436 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T21:53:52.436 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T21:53:52.436 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T21:53:52.436 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T21:53:52.436 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T21:53:52.436 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T21:53:52.436 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T21:53:52.436 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T21:53:52.436 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T21:53:52.436 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T21:53:52.436 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T21:53:52.454 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T21:53:52.480 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T21:53:52.514 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T21:53:52.515 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T21:53:52.607 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T21:53:52.607 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T21:53:52.699 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T21:53:52.724 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T21:53:52.730 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T21:53:52.730 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T21:53:52.910 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T21:53:52.910 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T21:53:53.002 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T21:53:53.066 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T21:53:54.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T21:53:54.958 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:54.959 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-09-11T21:53:54.959 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T21:53:54.959 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T21:53:54.959 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T21:53:54.959 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T21:53:54.959 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.959 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.959 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T21:53:54.959 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T21:53:54.959 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-11T21:53:54.959 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T21:53:54.960 INFO:teuthology.orchestra.run.smithi152.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T21:53:54.960 INFO:teuthology.orchestra.run.smithi152.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T21:53:54.960 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T21:53:54.960 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.960 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.960 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.960 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.960 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:54.960 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.960 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.960 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.961 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:54.961 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:54.961 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:54.961 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:54.961 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:54.961 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.961 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.961 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:54.961 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.961 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T21:53:54.962 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T21:53:54.963 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T21:53:54.964 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T21:53:54.965 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T21:53:54.966 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T21:53:54.967 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T21:53:54.968 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T21:53:54.969 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T21:53:54.970 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T21:53:54.971 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T21:53:54.971 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.971 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.971 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:53:54.971 INFO:teuthology.orchestra.run.smithi152.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T21:53:54.971 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T21:53:54.971 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T21:53:54.971 INFO:teuthology.orchestra.run.smithi152.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T21:53:54.971 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T21:53:54.971 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T21:53:54.972 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T21:53:54.972 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:53:54.972 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-11T21:53:55.412 DEBUG:teuthology.parallel:result is None 2024-09-11T21:53:58.609 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T21:53:58.609 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T21:53:58.610 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T21:53:58.610 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T21:53:58.610 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T21:53:58.610 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T21:53:58.610 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T21:53:58.610 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T21:53:58.610 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T21:53:58.610 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T21:53:58.610 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T21:53:58.610 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T21:53:58.610 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T21:53:58.611 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T21:53:58.612 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T21:53:58.612 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T21:53:58.612 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T21:53:58.612 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T21:53:58.612 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T21:53:58.612 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T21:53:58.612 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T21:53:58.624 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T21:53:58.624 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T21:53:58.624 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T21:53:58.625 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T21:53:58.626 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T21:53:58.626 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T21:53:58.626 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T21:53:58.626 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T21:53:58.626 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T21:53:58.626 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T21:53:58.626 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T21:53:58.626 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T21:53:58.626 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T21:53:58.626 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T21:53:58.626 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T21:53:58.627 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T21:53:58.627 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T21:53:58.627 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T21:53:58.627 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T21:53:58.627 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T21:53:58.627 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T21:53:58.627 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T21:53:58.627 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T21:53:58.627 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T21:53:58.627 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T21:53:58.627 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T21:53:58.628 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T21:53:58.629 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T21:53:58.629 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T21:53:58.629 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T21:53:58.629 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T21:53:58.629 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T21:53:58.629 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T21:53:58.629 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T21:53:58.629 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T21:53:58.629 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T21:53:58.629 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T21:53:58.629 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T21:53:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T21:53:58.631 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T21:53:58.631 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T21:53:58.631 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T21:53:58.631 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T21:53:58.631 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T21:53:58.631 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T21:53:58.631 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T21:53:58.631 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T21:53:58.632 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T21:53:58.632 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T21:53:58.632 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T21:53:58.632 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T21:53:58.632 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T21:53:58.632 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T21:53:58.632 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T21:53:58.632 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T21:53:58.632 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T21:53:58.632 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T21:53:58.632 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T21:53:58.633 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T21:53:58.634 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T21:53:58.634 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T21:53:58.634 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T21:53:58.634 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T21:53:58.634 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T21:53:58.634 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T21:53:58.634 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T21:53:58.634 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T21:53:58.634 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T21:53:58.634 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T21:53:58.634 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T21:53:58.635 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T21:53:58.636 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T21:53:58.636 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T21:53:58.636 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T21:54:01.472 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T21:54:01.472 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout:Upgraded: 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T21:54:01.473 INFO:teuthology.orchestra.run.smithi193.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T21:54:01.474 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T21:54:01.474 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.474 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.474 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.474 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.474 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:54:01.474 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.474 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.474 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.474 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:54:01.475 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:54:01.476 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.476 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.476 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T21:54:01.476 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T21:54:01.476 INFO:teuthology.orchestra.run.smithi193.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T21:54:01.476 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T21:54:01.476 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T21:54:01.476 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T21:54:01.476 INFO:teuthology.orchestra.run.smithi193.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T21:54:01.476 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T21:54:01.476 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.477 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.478 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T21:54:01.478 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.478 INFO:teuthology.orchestra.run.smithi193.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T21:54:01.478 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T21:54:01.478 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T21:54:01.478 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T21:54:01.478 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T21:54:01.478 INFO:teuthology.orchestra.run.smithi193.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T21:54:01.478 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T21:54:01.478 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T21:54:01.479 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T21:54:01.479 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T21:54:01.479 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T21:54:01.479 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T21:54:01.479 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T21:54:01.479 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T21:54:01.479 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T21:54:01.479 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T21:54:01.480 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T21:54:01.481 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T21:54:01.481 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T21:54:01.481 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T21:54:01.481 INFO:teuthology.orchestra.run.smithi193.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T21:54:01.481 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T21:54:01.481 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T21:54:01.481 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T21:54:01.481 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T21:54:01.481 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T21:54:01.481 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T21:54:01.482 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T21:54:01.483 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T21:54:01.483 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T21:54:01.483 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T21:54:01.483 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T21:54:01.483 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T21:54:01.483 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T21:54:01.484 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T21:54:01.484 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T21:54:01.484 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T21:54:01.484 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T21:54:01.484 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T21:54:01.485 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T21:54:01.485 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T21:54:01.485 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T21:54:01.485 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T21:54:01.485 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.485 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.485 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T21:54:01.485 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T21:54:01.485 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T21:54:01.486 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.486 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T21:54:01.486 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T21:54:01.486 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T21:54:01.486 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T21:54:01.486 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T21:54:01.486 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T21:54:01.486 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T21:54:01.486 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T21:54:01.487 INFO:teuthology.orchestra.run.smithi193.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T21:54:01.488 INFO:teuthology.orchestra.run.smithi193.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T21:54:01.488 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T21:54:01.488 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T21:54:01.488 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T21:54:01.488 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:54:01.488 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-11T21:54:01.908 DEBUG:teuthology.parallel:result is None 2024-09-11T21:54:01.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:54:02.060 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T21:54:02.087 INFO:teuthology.orchestra.run.smithi152.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T21:54:02.087 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T21:54:02.087 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T21:54:02.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:54:02.226 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T21:54:02.253 INFO:teuthology.orchestra.run.smithi179.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T21:54:02.253 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T21:54:02.253 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T21:54:02.255 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:54:02.395 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T21:54:02.418 INFO:teuthology.orchestra.run.smithi193.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T21:54:02.418 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T21:54:02.418 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T21:54:02.420 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T21:54:02.420 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:54:02.421 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T21:54:02.453 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-11T21:54:02.453 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T21:54:02.486 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-11T21:54:02.486 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T21:54:02.513 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T21:54:02.514 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:54:02.514 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T21:54:02.543 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T21:54:02.611 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-11T21:54:02.611 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T21:54:02.640 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T21:54:02.705 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-11T21:54:02.706 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T21:54:02.731 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T21:54:02.795 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T21:54:02.796 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:54:02.796 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T21:54:02.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T21:54:02.892 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-11T21:54:02.892 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T21:54:02.917 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T21:54:02.983 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-11T21:54:02.983 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T21:54:03.008 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T21:54:03.072 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T21:54:03.073 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:54:03.073 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T21:54:03.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T21:54:03.170 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-11T21:54:03.170 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T21:54:03.196 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T21:54:03.262 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-11T21:54:03.262 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T21:54:03.287 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T21:54:03.352 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-11T21:54:03.444 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-11T21:54:03.445 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:54:03.445 INFO:tasks.cephadm:Cluster fsid is 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:54:03.445 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-11T21:54:03.446 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.152', 'mon.b': '172.21.15.179', 'mon.c': '172.21.15.193'} 2024-09-11T21:54:03.446 INFO:tasks.cephadm:First mon is mon.a on smithi152 2024-09-11T21:54:03.446 INFO:tasks.cephadm:First mgr is x 2024-09-11T21:54:03.446 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-11T21:54:03.446 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s) 2024-09-11T21:54:03.476 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname $(hostname -s) 2024-09-11T21:54:03.501 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname $(hostname -s) 2024-09-11T21:54:03.525 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-11T21:54:03.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:54:03.672 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-11T21:54:03.813 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:54:03.814 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T21:54:03.815 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T21:54:03.815 DEBUG:teuthology.orchestra.run.smithi152:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T21:54:04.189 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 21:54 /home/ubuntu/cephtest/cephadm 2024-09-11T21:54:04.190 DEBUG:teuthology.orchestra.run.smithi179:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T21:54:04.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 21:54 /home/ubuntu/cephtest/cephadm 2024-09-11T21:54:04.543 DEBUG:teuthology.orchestra.run.smithi193:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T21:54:04.942 INFO:teuthology.orchestra.run.smithi193.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 21:54 /home/ubuntu/cephtest/cephadm 2024-09-11T21:54:04.942 DEBUG:teuthology.orchestra.run.smithi152:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T21:54:04.962 DEBUG:teuthology.orchestra.run.smithi179:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T21:54:04.981 DEBUG:teuthology.orchestra.run.smithi193:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T21:54:05.015 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-11T21:54:05.015 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T21:54:05.017 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T21:54:05.024 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T21:54:06.529 INFO:teuthology.orchestra.run.smithi179.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T21:54:06.679 INFO:teuthology.orchestra.run.smithi193.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T21:54:06.685 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T21:54:38.234 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-11T21:54:38.235 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T21:54:38.235 INFO:teuthology.orchestra.run.smithi179.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T21:54:38.235 INFO:teuthology.orchestra.run.smithi179.stdout: "repo_digests": [ 2024-09-11T21:54:38.235 INFO:teuthology.orchestra.run.smithi179.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T21:54:38.235 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-11T21:54:38.235 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-11T21:54:52.426 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T21:54:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T21:54:52.426 INFO:teuthology.orchestra.run.smithi152.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T21:54:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: "repo_digests": [ 2024-09-11T21:54:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T21:54:52.427 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T21:54:52.427 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T21:54:54.642 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-11T21:54:54.643 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T21:54:54.643 INFO:teuthology.orchestra.run.smithi193.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T21:54:54.643 INFO:teuthology.orchestra.run.smithi193.stdout: "repo_digests": [ 2024-09-11T21:54:54.643 INFO:teuthology.orchestra.run.smithi193.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T21:54:54.643 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-09-11T21:54:54.643 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-11T21:54:54.673 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph 2024-09-11T21:54:54.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph 2024-09-11T21:54:54.739 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /etc/ceph 2024-09-11T21:54:54.769 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /etc/ceph 2024-09-11T21:54:54.798 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /etc/ceph 2024-09-11T21:54:54.828 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 777 /etc/ceph 2024-09-11T21:54:54.856 INFO:tasks.cephadm:Writing seed config... 2024-09-11T21:54:54.858 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-11T21:54:54.858 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-11T21:54:54.858 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-11T21:54:54.858 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-11T21:54:54.858 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-11T21:54:54.858 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-11T21:54:54.858 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-11T21:54:54.858 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-11T21:54:54.858 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-11T21:54:54.858 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-11T21:54:54.859 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-11T21:54:54.859 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-11T21:54:54.859 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-11T21:54:54.859 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-11T21:54:54.859 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-11T21:54:54.859 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-11T21:54:54.859 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-11T21:54:54.859 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-11T21:54:54.859 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-11T21:54:54.859 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-11T21:54:54.859 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-11T21:54:54.860 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-11T21:54:54.860 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-11T21:54:54.860 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-11T21:54:54.860 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-11T21:54:54.860 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-11T21:54:54.861 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-11T21:54:54.861 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-11T21:54:54.861 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-11T21:54:54.861 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-11T21:54:54.861 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-11T21:54:54.861 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-11T21:54:54.862 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-11T21:54:54.862 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-11T21:54:54.862 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-11T21:54:54.862 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-11T21:54:54.862 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-11T21:54:54.862 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-11T21:54:54.862 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-11T21:54:54.862 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-11T21:54:54.862 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-11T21:54:54.862 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-11T21:54:54.862 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-11T21:54:54.863 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-11T21:54:54.863 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-11T21:54:54.863 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-11T21:54:54.863 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-11T21:54:54.863 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-11T21:54:54.863 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-11T21:54:54.863 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-11T21:54:54.863 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-11T21:54:54.865 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:54:54.865 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-11T21:54:54.883 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5c140ed8-7088-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-11T21:54:54.883 DEBUG:teuthology.orchestra.run.smithi152:mon.a> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.a.service 2024-09-11T21:54:54.926 DEBUG:teuthology.orchestra.run.smithi152:mgr.x> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.x.service 2024-09-11T21:54:54.969 INFO:tasks.cephadm:Bootstrapping... 2024-09-11T21:54:54.970 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.152 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-11T21:54:55.176 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-11T21:54:55.176 INFO:teuthology.orchestra.run.smithi152.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '5c140ed8-7088-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.152', '--skip-admin-label'] 2024-09-11T21:54:55.176 INFO:teuthology.orchestra.run.smithi152.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-11T21:54:55.177 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying podman|docker is present... 2024-09-11T21:54:55.200 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stdout 5.2.2 2024-09-11T21:54:55.200 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying lvm2 is present... 2024-09-11T21:54:55.200 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying time synchronization is in place... 2024-09-11T21:54:55.208 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T21:54:55.208 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T21:54:55.214 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T21:54:55.214 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2024-09-11T21:54:55.221 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout enabled 2024-09-11T21:54:55.227 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout active 2024-09-11T21:54:55.227 INFO:teuthology.orchestra.run.smithi152.stdout:Unit chronyd.service is enabled and running 2024-09-11T21:54:55.228 INFO:teuthology.orchestra.run.smithi152.stdout:Repeating the final host check... 2024-09-11T21:54:55.274 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stdout 5.2.2 2024-09-11T21:54:55.275 INFO:teuthology.orchestra.run.smithi152.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-11T21:54:55.275 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl is present 2024-09-11T21:54:55.275 INFO:teuthology.orchestra.run.smithi152.stdout:lvcreate is present 2024-09-11T21:54:55.281 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T21:54:55.281 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T21:54:55.287 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T21:54:55.287 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2024-09-11T21:54:55.293 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout enabled 2024-09-11T21:54:55.300 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout active 2024-09-11T21:54:55.301 INFO:teuthology.orchestra.run.smithi152.stdout:Unit chronyd.service is enabled and running 2024-09-11T21:54:55.301 INFO:teuthology.orchestra.run.smithi152.stdout:Host looks OK 2024-09-11T21:54:55.301 INFO:teuthology.orchestra.run.smithi152.stdout:Cluster fsid: 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:54:55.301 INFO:teuthology.orchestra.run.smithi152.stdout:Acquiring lock 140394820170752 on /run/cephadm/5c140ed8-7088-11ef-bcea-c7b262605968.lock 2024-09-11T21:54:55.301 INFO:teuthology.orchestra.run.smithi152.stdout:Lock 140394820170752 acquired on /run/cephadm/5c140ed8-7088-11ef-bcea-c7b262605968.lock 2024-09-11T21:54:55.301 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying IP 172.21.15.152 port 3300 ... 2024-09-11T21:54:55.301 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying IP 172.21.15.152 port 6789 ... 2024-09-11T21:54:55.301 INFO:teuthology.orchestra.run.smithi152.stdout:Base mon IP(s) is [172.21.15.152:3300, 172.21.15.152:6789], mon addrv is [v2:172.21.15.152:3300,v1:172.21.15.152:6789] 2024-09-11T21:54:55.304 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.152 metric 100 2024-09-11T21:54:55.304 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.152 metric 100 2024-09-11T21:54:55.307 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-11T21:54:55.307 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-11T21:54:55.307 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-11T21:54:55.310 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-11T21:54:55.310 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-11T21:54:55.310 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T21:54:55.310 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-11T21:54:55.310 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:6de3/64 scope link noprefixroute 2024-09-11T21:54:55.310 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T21:54:55.310 INFO:teuthology.orchestra.run.smithi152.stdout:Mon IP `172.21.15.152` is in CIDR network `172.21.0.0/20` 2024-09-11T21:54:55.310 INFO:teuthology.orchestra.run.smithi152.stdout:Mon IP `172.21.15.152` is in CIDR network `172.21.0.0/20` 2024-09-11T21:54:55.310 INFO:teuthology.orchestra.run.smithi152.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-11T21:54:55.311 INFO:teuthology.orchestra.run.smithi152.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-11T21:54:55.311 INFO:teuthology.orchestra.run.smithi152.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T21:54:55.779 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T21:54:55.779 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T21:54:55.779 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Getting image source signatures 2024-09-11T21:54:55.779 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-11T21:54:55.779 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-11T21:54:55.780 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T21:54:55.780 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-11T21:54:56.709 INFO:teuthology.orchestra.run.smithi152.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T21:54:56.709 INFO:teuthology.orchestra.run.smithi152.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T21:54:56.709 INFO:teuthology.orchestra.run.smithi152.stdout:Extracting ceph user uid/gid from container image... 2024-09-11T21:54:57.641 INFO:teuthology.orchestra.run.smithi152.stdout:stat: stdout 167 167 2024-09-11T21:54:57.641 INFO:teuthology.orchestra.run.smithi152.stdout:Creating initial keys... 2024-09-11T21:54:58.645 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph-authtool: stdout AQCxEeJmjbTwNxAAzIv+4lBqlnhTO8WogprSOA== 2024-09-11T21:54:59.593 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph-authtool: stdout AQCyEeJmR4fGORAAuz2AlJmR1XZHI32AQDaciw== 2024-09-11T21:55:00.499 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph-authtool: stdout AQCzEeJmyvgoNhAAmDXPXXCGUwXMNsMBG295Aw== 2024-09-11T21:55:00.499 INFO:teuthology.orchestra.run.smithi152.stdout:Creating initial monmap... 2024-09-11T21:55:01.407 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T21:55:01.407 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-11T21:55:01.407 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:01.407 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T21:55:01.407 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool for a [v2:172.21.15.152:3300,v1:172.21.15.152:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T21:55:01.407 INFO:teuthology.orchestra.run.smithi152.stdout:setting min_mon_release = quincy 2024-09-11T21:55:01.407 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: set fsid to 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:01.407 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T21:55:01.408 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:55:01.408 INFO:teuthology.orchestra.run.smithi152.stdout:Creating mon... 2024-09-11T21:55:02.346 INFO:teuthology.orchestra.run.smithi152.stdout:create mon.a on 2024-09-11T21:55:02.547 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-11T21:55:02.707 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-11T21:55:02.926 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5c140ed8-7088-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-5c140ed8-7088-11ef-bcea-c7b262605968.target. 2024-09-11T21:55:02.926 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5c140ed8-7088-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-5c140ed8-7088-11ef-bcea-c7b262605968.target. 2024-09-11T21:55:03.167 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.a 2024-09-11T21:55:03.167 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-11T21:55:03.345 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5c140ed8-7088-11ef-bcea-c7b262605968.target.wants/ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-5c140ed8-7088-11ef-bcea-c7b262605968@.service. 2024-09-11T21:55:03.868 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:03 smithi152 podman[30801]: 2024-09-11 21:55:03.827024012 +0000 UTC m=+0.342395474 container start cf151685a7d8bf3f5064dba09dab514db92eda047d1110fda1417045597754ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-11T21:55:03.868 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:03 smithi152 ceph-mon[30820]: mkfs 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:03.922 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T21:55:03.922 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout disabled 2024-09-11T21:55:03.929 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T21:55:03.929 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2024-09-11T21:55:03.929 INFO:teuthology.orchestra.run.smithi152.stdout:firewalld.service is not enabled 2024-09-11T21:55:03.929 INFO:teuthology.orchestra.run.smithi152.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T21:55:03.930 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mon to start... 2024-09-11T21:55:03.930 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mon... 2024-09-11T21:55:04.138 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:03 smithi152 ceph-mon[30820]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T21:55:04.138 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:03 smithi152 bash[30801]: cf151685a7d8bf3f5064dba09dab514db92eda047d1110fda1417045597754ee 2024-09-11T21:55:04.138 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:03 smithi152 systemd[1]: Started Ceph mon.a for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T21:55:04.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T21:55:04.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: monmap epoch 1 2024-09-11T21:55:04.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:04.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: last_changed 2024-09-11T21:55:00.803593+0000 2024-09-11T21:55:04.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: created 2024-09-11T21:55:00.803593+0000 2024-09-11T21:55:04.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: min_mon_release 19 (squid) 2024-09-11T21:55:04.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: election_strategy: 1 2024-09-11T21:55:04.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: 0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2024-09-11T21:55:04.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: fsmap 2024-09-11T21:55:04.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T21:55:04.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: mgrmap e1: no daemons active 2024-09-11T21:55:04.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:04 smithi152 ceph-mon[30820]: from='client.? 172.21.15.152:0/3526357291' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-11T21:55:04.986 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout cluster: 2024-09-11T21:55:04.992 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout id: 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:04.992 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-11T21:55:04.992 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout services: 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.532358s) 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout data: 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout pgs: 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2024-09-11T21:55:04.993 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.328+0000 7f30e41f6640 1 Processor -- start 2024-09-11T21:55:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.328+0000 7f30e41f6640 1 -- start start 2024-09-11T21:55:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.328+0000 7f30e41f6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc107cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.328+0000 7f30e41f6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc108290 con 0x7f30dc1078c0 2024-09-11T21:55:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.329+0000 7f30e1f92640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc107cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.329+0000 7f30e1f92640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc107cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57252/0 (socket says 172.21.15.152:57252) 2024-09-11T21:55:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.329+0000 7f30e1f92640 1 -- 172.21.15.152:0/1948237692 learned_addr learned my addr 172.21.15.152:0/1948237692 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.329+0000 7f30e1f92640 1 -- 172.21.15.152:0/1948237692 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc108ac0 con 0x7f30dc1078c0 2024-09-11T21:55:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.331+0000 7f30e1f92640 1 --2- 172.21.15.152:0/1948237692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc107cc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009820 tx=0x7f30cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edebd355f353df0b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.331+0000 7f30e0f90640 1 -- 172.21.15.152:0/1948237692 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30cc037070 con 0x7f30dc1078c0 2024-09-11T21:55:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.331+0000 7f30e0f90640 1 -- 172.21.15.152:0/1948237692 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30cc032440 con 0x7f30dc1078c0 2024-09-11T21:55:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.331+0000 7f30e0f90640 1 -- 172.21.15.152:0/1948237692 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30cc032740 con 0x7f30dc1078c0 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.332+0000 7f30e41f6640 1 -- 172.21.15.152:0/1948237692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 msgr2=0x7f30dc107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.332+0000 7f30e41f6640 1 --2- 172.21.15.152:0/1948237692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc107cc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009820 tx=0x7f30cc02a270 comp rx=0 tx=0).stop 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.332+0000 7f30e41f6640 1 -- 172.21.15.152:0/1948237692 shutdown_connections 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.332+0000 7f30e41f6640 1 --2- 172.21.15.152:0/1948237692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc107cc0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.332+0000 7f30e41f6640 1 -- 172.21.15.152:0/1948237692 >> 172.21.15.152:0/1948237692 conn(0x7f30dc103090 msgr2=0x7f30dc1054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.332+0000 7f30e41f6640 1 -- 172.21.15.152:0/1948237692 shutdown_connections 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.332+0000 7f30e41f6640 1 -- 172.21.15.152:0/1948237692 wait complete. 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.333+0000 7f30e41f6640 1 Processor -- start 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.333+0000 7f30e41f6640 1 -- start start 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.333+0000 7f30e41f6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc19b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.333+0000 7f30e41f6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc109060 con 0x7f30dc1078c0 2024-09-11T21:55:04.995 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.333+0000 7f30e1f92640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc19b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.333+0000 7f30e1f92640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc19b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57262/0 (socket says 172.21.15.152:57262) 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.333+0000 7f30e1f92640 1 -- 172.21.15.152:0/3526357291 learned_addr learned my addr 172.21.15.152:0/3526357291 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.333+0000 7f30e1f92640 1 -- 172.21.15.152:0/3526357291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc19b5a0 con 0x7f30dc1078c0 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.333+0000 7f30e1f92640 1 --2- 172.21.15.152:0/3526357291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc19b060 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0090b0 tx=0x7f30cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.334+0000 7f30d2ffd640 1 -- 172.21.15.152:0/3526357291 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30cc041070 con 0x7f30dc1078c0 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.334+0000 7f30d2ffd640 1 -- 172.21.15.152:0/3526357291 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30cc03c7a0 con 0x7f30dc1078c0 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.334+0000 7f30e41f6640 1 -- 172.21.15.152:0/3526357291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30dc19b830 con 0x7f30dc1078c0 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.334+0000 7f30d2ffd640 1 -- 172.21.15.152:0/3526357291 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30cc037040 con 0x7f30dc1078c0 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.334+0000 7f30e41f6640 1 -- 172.21.15.152:0/3526357291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30dc19e520 con 0x7f30dc1078c0 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.334+0000 7f30d2ffd640 1 -- 172.21.15.152:0/3526357291 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f30cc044070 con 0x7f30dc1078c0 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.334+0000 7f30d2ffd640 1 -- 172.21.15.152:0/3526357291 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f30cc03d3f0 con 0x7f30dc1078c0 2024-09-11T21:55:04.996 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.335+0000 7f30e41f6640 1 -- 172.21.15.152:0/3526357291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30dc1096b0 con 0x7f30dc1078c0 2024-09-11T21:55:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.337+0000 7f30d2ffd640 1 -- 172.21.15.152:0/3526357291 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f30cc046450 con 0x7f30dc1078c0 2024-09-11T21:55:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.395+0000 7f30e41f6640 1 -- 172.21.15.152:0/3526357291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f30dc19ea70 con 0x7f30dc1078c0 2024-09-11T21:55:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.395+0000 7f30d2ffd640 1 -- 172.21.15.152:0/3526357291 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f30cc046630 con 0x7f30dc1078c0 2024-09-11T21:55:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.396+0000 7f30e41f6640 1 -- 172.21.15.152:0/3526357291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 msgr2=0x7f30dc19b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.396+0000 7f30e41f6640 1 --2- 172.21.15.152:0/3526357291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc19b060 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0090b0 tx=0x7f30cc0046c0 comp rx=0 tx=0).stop 2024-09-11T21:55:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.396+0000 7f30e41f6640 1 -- 172.21.15.152:0/3526357291 shutdown_connections 2024-09-11T21:55:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.396+0000 7f30e41f6640 1 --2- 172.21.15.152:0/3526357291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc1078c0 0x7f30dc19b060 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.396+0000 7f30e41f6640 1 -- 172.21.15.152:0/3526357291 >> 172.21.15.152:0/3526357291 conn(0x7f30dc103090 msgr2=0x7f30dc18f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.397+0000 7f30e41f6640 1 -- 172.21.15.152:0/3526357291 shutdown_connections 2024-09-11T21:55:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:04.397+0000 7f30e41f6640 1 -- 172.21.15.152:0/3526357291 wait complete. 2024-09-11T21:55:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:mon is available 2024-09-11T21:55:04.998 INFO:teuthology.orchestra.run.smithi152.stdout:Assimilating anything we can from ceph.conf... 2024-09-11T21:55:06.054 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:05 smithi152 ceph-mon[30820]: from='client.? 172.21.15.152:0/2858616726' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T21:55:06.054 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:05 smithi152 ceph-mon[30820]: from='client.? 172.21.15.152:0/2858616726' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout fsid = 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.152:3300,v1:172.21.15.152:6789] 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T21:55:06.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2024-09-11T21:55:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T21:55:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T21:55:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T21:55:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T21:55:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T21:55:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T21:55:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.419+0000 7f40079dd640 1 Processor -- start 2024-09-11T21:55:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.419+0000 7f40079dd640 1 -- start start 2024-09-11T21:55:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.419+0000 7f40079dd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400010a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.419+0000 7f40079dd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f400007be60 con 0x7f40001083b0 2024-09-11T21:55:06.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.419+0000 7f4005779640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400010a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.419+0000 7f4005779640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400010a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57276/0 (socket says 172.21.15.152:57276) 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.419+0000 7f4005779640 1 -- 172.21.15.152:0/2541191846 learned_addr learned my addr 172.21.15.152:0/2541191846 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.420+0000 7f4005779640 1 -- 172.21.15.152:0/2541191846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400010ace0 con 0x7f40001083b0 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.420+0000 7f4005779640 1 --2- 172.21.15.152:0/2541191846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400010a7a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc009820 tx=0x7f3ffc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d192a7a4a045d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.420+0000 7f3ff7fff640 1 -- 172.21.15.152:0/2541191846 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc037070 con 0x7f40001083b0 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.420+0000 7f3ff7fff640 1 -- 172.21.15.152:0/2541191846 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ffc032440 con 0x7f40001083b0 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.420+0000 7f3ff7fff640 1 -- 172.21.15.152:0/2541191846 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc032740 con 0x7f40001083b0 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.421+0000 7f40079dd640 1 -- 172.21.15.152:0/2541191846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 msgr2=0x7f400010a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.421+0000 7f40079dd640 1 --2- 172.21.15.152:0/2541191846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400010a7a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc009820 tx=0x7f3ffc02a270 comp rx=0 tx=0).stop 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.421+0000 7f40079dd640 1 -- 172.21.15.152:0/2541191846 shutdown_connections 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.421+0000 7f40079dd640 1 --2- 172.21.15.152:0/2541191846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400010a7a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:06.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.421+0000 7f40079dd640 1 -- 172.21.15.152:0/2541191846 >> 172.21.15.152:0/2541191846 conn(0x7f4000102010 msgr2=0x7f4000104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.421+0000 7f40079dd640 1 -- 172.21.15.152:0/2541191846 shutdown_connections 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.421+0000 7f40079dd640 1 -- 172.21.15.152:0/2541191846 wait complete. 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.422+0000 7f40079dd640 1 Processor -- start 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.422+0000 7f40079dd640 1 -- start start 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.422+0000 7f40079dd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400019b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.422+0000 7f40079dd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f400010b1c0 con 0x7f40001083b0 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.422+0000 7f4005779640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400019b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.422+0000 7f4005779640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400019b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57282/0 (socket says 172.21.15.152:57282) 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.422+0000 7f4005779640 1 -- 172.21.15.152:0/2858616726 learned_addr learned my addr 172.21.15.152:0/2858616726 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.422+0000 7f4005779640 1 -- 172.21.15.152:0/2858616726 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400019b5f0 con 0x7f40001083b0 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.422+0000 7f4005779640 1 --2- 172.21.15.152:0/2858616726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400019b0b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0090b0 tx=0x7f3ffc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.423+0000 7f3ff67fc640 1 -- 172.21.15.152:0/2858616726 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc041070 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.423+0000 7f3ff67fc640 1 -- 172.21.15.152:0/2858616726 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ffc03c7a0 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.423+0000 7f40079dd640 1 -- 172.21.15.152:0/2858616726 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400019b880 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.423+0000 7f3ff67fc640 1 -- 172.21.15.152:0/2858616726 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc037040 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.423+0000 7f40079dd640 1 -- 172.21.15.152:0/2858616726 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f400019e570 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.423+0000 7f3ff67fc640 1 -- 172.21.15.152:0/2858616726 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3ffc044070 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.423+0000 7f3ff67fc640 1 -- 172.21.15.152:0/2858616726 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3ffc03d3f0 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.424+0000 7f40079dd640 1 -- 172.21.15.152:0/2858616726 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4000108810 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.426+0000 7f3ff67fc640 1 -- 172.21.15.152:0/2858616726 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3ffc046450 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.481+0000 7f40079dd640 1 -- 172.21.15.152:0/2858616726 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f400002d980 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.485+0000 7f3ff67fc640 1 -- 172.21.15.152:0/2858616726 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f3ffc046630 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.485+0000 7f3ff67fc640 1 -- 172.21.15.152:0/2858616726 <== mon.0 v2:172.21.15.152:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ffc056070 con 0x7f40001083b0 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.485+0000 7f40079dd640 1 -- 172.21.15.152:0/2858616726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 msgr2=0x7f400019b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:06.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.485+0000 7f40079dd640 1 --2- 172.21.15.152:0/2858616726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400019b0b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0090b0 tx=0x7f3ffc0046c0 comp rx=0 tx=0).stop 2024-09-11T21:55:06.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.486+0000 7f40079dd640 1 -- 172.21.15.152:0/2858616726 shutdown_connections 2024-09-11T21:55:06.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.486+0000 7f40079dd640 1 --2- 172.21.15.152:0/2858616726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40001083b0 0x7f400019b0b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:06.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.486+0000 7f40079dd640 1 -- 172.21.15.152:0/2858616726 >> 172.21.15.152:0/2858616726 conn(0x7f4000102010 msgr2=0x7f4000103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:06.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.486+0000 7f40079dd640 1 -- 172.21.15.152:0/2858616726 shutdown_connections 2024-09-11T21:55:06.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:05.486+0000 7f40079dd640 1 -- 172.21.15.152:0/2858616726 wait complete. 2024-09-11T21:55:06.068 INFO:teuthology.orchestra.run.smithi152.stdout:Generating new minimal ceph.conf... 2024-09-11T21:55:07.034 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.407+0000 7fce17a2d640 1 Processor -- start 2024-09-11T21:55:07.034 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.407+0000 7fce17a2d640 1 -- start start 2024-09-11T21:55:07.034 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.407+0000 7fce17a2d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1007c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:07.034 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.407+0000 7fce17a2d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fce1007c7f0 con 0x7fce1007de00 2024-09-11T21:55:07.034 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.407+0000 7fce157c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1007c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:07.034 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.407+0000 7fce157c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1007c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57286/0 (socket says 172.21.15.152:57286) 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.407+0000 7fce157c9640 1 -- 172.21.15.152:0/3606181840 learned_addr learned my addr 172.21.15.152:0/3606181840 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.408+0000 7fce157c9640 1 -- 172.21.15.152:0/3606181840 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1007c970 con 0x7fce1007de00 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.408+0000 7fce157c9640 1 --2- 172.21.15.152:0/3606181840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1007c2b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009820 tx=0x7fce0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5ab9f275649b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.408+0000 7fce07fff640 1 -- 172.21.15.152:0/3606181840 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce0c037070 con 0x7fce1007de00 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.408+0000 7fce07fff640 1 -- 172.21.15.152:0/3606181840 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce0c032900 con 0x7fce1007de00 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.409+0000 7fce07fff640 1 -- 172.21.15.152:0/3606181840 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce0c030850 con 0x7fce1007de00 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.409+0000 7fce17a2d640 1 -- 172.21.15.152:0/3606181840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 msgr2=0x7fce1007c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.409+0000 7fce17a2d640 1 --2- 172.21.15.152:0/3606181840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1007c2b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009820 tx=0x7fce0c02a270 comp rx=0 tx=0).stop 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.409+0000 7fce17a2d640 1 -- 172.21.15.152:0/3606181840 shutdown_connections 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.409+0000 7fce17a2d640 1 --2- 172.21.15.152:0/3606181840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1007c2b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.409+0000 7fce17a2d640 1 -- 172.21.15.152:0/3606181840 >> 172.21.15.152:0/3606181840 conn(0x7fce10103120 msgr2=0x7fce10105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:07.035 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.409+0000 7fce17a2d640 1 -- 172.21.15.152:0/3606181840 shutdown_connections 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.409+0000 7fce17a2d640 1 -- 172.21.15.152:0/3606181840 wait complete. 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.410+0000 7fce17a2d640 1 Processor -- start 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.410+0000 7fce17a2d640 1 -- start start 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.410+0000 7fce17a2d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1019dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.410+0000 7fce17a2d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fce1010df40 con 0x7fce1007de00 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.410+0000 7fce157c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1019dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.410+0000 7fce157c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1019dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57290/0 (socket says 172.21.15.152:57290) 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.410+0000 7fce157c9640 1 -- 172.21.15.152:0/85499697 learned_addr learned my addr 172.21.15.152:0/85499697 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.410+0000 7fce157c9640 1 -- 172.21.15.152:0/85499697 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1019e010 con 0x7fce1007de00 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.410+0000 7fce157c9640 1 --2- 172.21.15.152:0/85499697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1019dad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0097f0 tx=0x7fce0c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.411+0000 7fce067fc640 1 -- 172.21.15.152:0/85499697 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce0c042070 con 0x7fce1007de00 2024-09-11T21:55:07.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.411+0000 7fce067fc640 1 -- 172.21.15.152:0/85499697 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce0c03ba10 con 0x7fce1007de00 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.411+0000 7fce17a2d640 1 -- 172.21.15.152:0/85499697 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1019e2a0 con 0x7fce1007de00 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.411+0000 7fce067fc640 1 -- 172.21.15.152:0/85499697 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce0c037070 con 0x7fce1007de00 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.411+0000 7fce17a2d640 1 -- 172.21.15.152:0/85499697 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce101a0f90 con 0x7fce1007de00 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.411+0000 7fce067fc640 1 -- 172.21.15.152:0/85499697 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fce0c045070 con 0x7fce1007de00 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.411+0000 7fce067fc640 1 -- 172.21.15.152:0/85499697 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fce0c047d70 con 0x7fce1007de00 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.412+0000 7fce17a2d640 1 -- 172.21.15.152:0/85499697 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1007c330 con 0x7fce1007de00 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.414+0000 7fce067fc640 1 -- 172.21.15.152:0/85499697 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fce0c04c070 con 0x7fce1007de00 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.470+0000 7fce17a2d640 1 -- 172.21.15.152:0/85499697 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fce101a1160 con 0x7fce1007de00 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.470+0000 7fce067fc640 1 -- 172.21.15.152:0/85499697 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7fce0c0328a0 con 0x7fce1007de00 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.471+0000 7fce17a2d640 1 -- 172.21.15.152:0/85499697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 msgr2=0x7fce1019dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.471+0000 7fce17a2d640 1 --2- 172.21.15.152:0/85499697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1019dad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0097f0 tx=0x7fce0c032ce0 comp rx=0 tx=0).stop 2024-09-11T21:55:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.471+0000 7fce17a2d640 1 -- 172.21.15.152:0/85499697 shutdown_connections 2024-09-11T21:55:07.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.471+0000 7fce17a2d640 1 --2- 172.21.15.152:0/85499697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1007de00 0x7fce1019dad0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:07.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.471+0000 7fce17a2d640 1 -- 172.21.15.152:0/85499697 >> 172.21.15.152:0/85499697 conn(0x7fce10103120 msgr2=0x7fce10103ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:07.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.471+0000 7fce17a2d640 1 -- 172.21.15.152:0/85499697 shutdown_connections 2024-09-11T21:55:07.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:06.471+0000 7fce17a2d640 1 -- 172.21.15.152:0/85499697 wait complete. 2024-09-11T21:55:07.038 INFO:teuthology.orchestra.run.smithi152.stdout:Restarting the monitor... 2024-09-11T21:55:07.048 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:06 smithi152 ceph-mon[30820]: from='client.? 172.21.15.152:0/85499697' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:55:07.331 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:07 smithi152 systemd[1]: Stopping Ceph mon.a for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T21:55:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:07 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a[30816]: 2024-09-11T21:55:07.330+0000 7f1eec624640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T21:55:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:07 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a[30816]: 2024-09-11T21:55:07.330+0000 7f1eec624640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-11T21:55:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:07 smithi152 podman[31064]: 2024-09-11 21:55:07.555472471 +0000 UTC m=+0.357955309 container died cf151685a7d8bf3f5064dba09dab514db92eda047d1110fda1417045597754ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-11T21:55:08.164 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:07 smithi152 podman[31064]: 2024-09-11 21:55:07.971924361 +0000 UTC m=+0.774407201 container cleanup cf151685a7d8bf3f5064dba09dab514db92eda047d1110fda1417045597754ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T21:55:08.164 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:07 smithi152 bash[31064]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a 2024-09-11T21:55:08.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 podman[31079]: 2024-09-11 21:55:08.164353208 +0000 UTC m=+0.605647273 container remove cf151685a7d8bf3f5064dba09dab514db92eda047d1110fda1417045597754ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T21:55:08.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 systemd[1]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T21:55:08.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 systemd[1]: Stopped Ceph mon.a for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T21:55:08.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 systemd[1]: Starting Ceph mon.a for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T21:55:08.777 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 podman[31170]: 2024-09-11 21:55:08.397569535 +0000 UTC m=+0.015794683 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:55:08.778 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 podman[31170]: 2024-09-11 21:55:08.507179092 +0000 UTC m=+0.125404268 container create 0cc5c0da4320a4b5642c808bb332e2a458e1abab2be4993c02f02c68666b8034 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T21:55:08.778 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 podman[31170]: 2024-09-11 21:55:08.702242161 +0000 UTC m=+0.320467302 container init 0cc5c0da4320a4b5642c808bb332e2a458e1abab2be4993c02f02c68666b8034 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-11T21:55:08.778 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 podman[31170]: 2024-09-11 21:55:08.705254068 +0000 UTC m=+0.323479202 container start 0cc5c0da4320a4b5642c808bb332e2a458e1abab2be4993c02f02c68666b8034 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T21:55:08.778 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T21:55:08.778 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T21:55:08.778 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: pidfile_write: ignore empty --pid-file 2024-09-11T21:55:08.778 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: load: jerasure load: lrc 2024-09-11T21:55:08.778 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: RocksDB version: 7.9.2 2024-09-11T21:55:08.778 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Git sha 0 2024-09-11T21:55:08.778 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T21:55:08.778 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: DB SUMMARY 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: DB Session ID: RBYIBRVLSEQI4G5HMTWV 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: CURRENT file: CURRENT 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 107242 ; 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.error_if_exists: 0 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.create_if_missing: 0 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.paranoid_checks: 1 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T21:55:08.779 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.env: 0x555a0a720940 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.info_log: 0x555a0bceb6e0 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.statistics: (nil) 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.use_fsync: 0 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_log_file_size: 0 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T21:55:08.780 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.allow_fallocate: 1 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.use_direct_reads: 0 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.db_log_dir: 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.wal_dir: 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T21:55:08.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T21:55:08.782 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T21:55:08.782 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T21:55:08.782 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.write_buffer_manager: 0x555a0bcfadc0 2024-09-11T21:55:08.782 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T21:55:08.782 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T21:55:08.782 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T21:55:08.782 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T21:55:08.782 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T21:55:08.783 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T21:55:08.783 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T21:55:08.783 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.unordered_write: 0 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.row_cache: None 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.wal_filter: None 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.two_write_queues: 0 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T21:55:08.784 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.wal_compression: 0 2024-09-11T21:55:08.785 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.atomic_flush: 0 2024-09-11T21:55:08.785 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T21:55:08.785 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T21:55:08.785 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T21:55:08.785 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.log_readahead_size: 0 2024-09-11T21:55:08.785 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_background_jobs: 2 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_background_compactions: -1 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_subcompactions: 1 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T21:55:08.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_open_files: -1 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_background_flushes: -1 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Compression algorithms supported: 2024-09-11T21:55:08.787 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: kZSTD supported: 0 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: kXpressCompression supported: 0 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: kBZip2Compression supported: 0 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: kLZ4Compression supported: 1 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: kZlibCompression supported: 1 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: kSnappyCompression supported: 1 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T21:55:08.788 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.merge_operator: 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_filter: None 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555a0bceb320) 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout: cache_index_and_filter_blocks: 1 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout: pin_top_level_index_and_filter: 1 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout: index_type: 0 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout: data_block_index_type: 0 2024-09-11T21:55:08.789 INFO:journalctl@ceph.mon.a.smithi152.stdout: index_shortening: 1 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: checksum: 4 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: no_block_cache: 0 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: block_cache: 0x555a0bcdf1f0 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: block_cache_name: BinnedLRUCache 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: block_cache_options: 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: capacity : 536870912 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: num_shard_bits : 4 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: strict_capacity_limit : 0 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: high_pri_pool_ratio: 0.000 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: block_cache_compressed: (nil) 2024-09-11T21:55:08.790 INFO:journalctl@ceph.mon.a.smithi152.stdout: persistent_cache: (nil) 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: block_size: 4096 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: block_size_deviation: 10 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: block_restart_interval: 16 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: index_block_restart_interval: 1 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: metadata_block_size: 4096 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: partition_filters: 0 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: use_delta_encoding: 1 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: filter_policy: bloomfilter 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: whole_key_filtering: 1 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: verify_compression: 0 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: read_amp_bytes_per_bit: 0 2024-09-11T21:55:08.791 INFO:journalctl@ceph.mon.a.smithi152.stdout: format_version: 5 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout: enable_index_compression: 1 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout: block_align: 0 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout: max_auto_readahead_size: 262144 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout: prepopulate_block_cache: 0 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout: initial_auto_readahead_size: 8192 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compression: NoCompression 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T21:55:08.792 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.num_levels: 7 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T21:55:08.793 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T21:55:08.794 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T21:55:08.795 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T21:55:08.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T21:55:08.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T21:55:08.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T21:55:08.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T21:55:08.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T21:55:08.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T21:55:08.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T21:55:08.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T21:55:08.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T21:55:08.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T21:55:08.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.inplace_update_support: 0 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T21:55:08.797 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T21:55:08.798 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.bloom_locality: 0 2024-09-11T21:55:08.798 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.max_successive_merges: 0 2024-09-11T21:55:08.798 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T21:55:08.798 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T21:55:08.798 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T21:55:08.798 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T21:55:08.798 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.ttl: 2592000 2024-09-11T21:55:08.798 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T21:55:08.798 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T21:55:08.798 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T21:55:08.798 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.enable_blob_files: false 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.min_blob_size: 0 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-11T21:55:08.799 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7e15d7b2-795c-47bb-911a-7df630194b6f 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726091708731660, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726091708732803, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 102125, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 336, "table_properties": {"data_size": 100013, "index_size": 304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14782, "raw_average_key_size": 50, "raw_value_size": 92015, "raw_average_value_size": 311, "num_data_blocks": 12, "num_entries": 295, "num_filter_entries": 295, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726091708, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7e15d7b2-795c-47bb-911a-7df630194b6f", "db_session_id": "RBYIBRVLSEQI4G5HMTWV", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726091708732932, "job": 1, "event": "recovery_finished"} 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555a0bd0ce00 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: DB pointer 0x555a0be08000 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout: ** DB Stats ** 2024-09-11T21:55:08.800 INFO:journalctl@ceph.mon.a.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T21:55:08.801 INFO:journalctl@ceph.mon.a.smithi152.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T21:55:08.801 INFO:journalctl@ceph.mon.a.smithi152.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T21:55:08.801 INFO:journalctl@ceph.mon.a.smithi152.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T21:55:08.801 INFO:journalctl@ceph.mon.a.smithi152.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T21:55:08.801 INFO:journalctl@ceph.mon.a.smithi152.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T21:55:08.801 INFO:journalctl@ceph.mon.a.smithi152.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T21:55:08.801 INFO:journalctl@ceph.mon.a.smithi152.stdout: 2024-09-11T21:55:08.801 INFO:journalctl@ceph.mon.a.smithi152.stdout: ** Compaction Stats [default] ** 2024-09-11T21:55:08.801 INFO:journalctl@ceph.mon.a.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T21:55:08.802 INFO:journalctl@ceph.mon.a.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T21:55:08.802 INFO:journalctl@ceph.mon.a.smithi152.stdout: L0 2/0 101.59 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T21:55:08.802 INFO:journalctl@ceph.mon.a.smithi152.stdout: Sum 2/0 101.59 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T21:55:08.802 INFO:journalctl@ceph.mon.a.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T21:55:08.802 INFO:journalctl@ceph.mon.a.smithi152.stdout: 2024-09-11T21:55:08.802 INFO:journalctl@ceph.mon.a.smithi152.stdout: ** Compaction Stats [default] ** 2024-09-11T21:55:08.802 INFO:journalctl@ceph.mon.a.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T21:55:08.802 INFO:journalctl@ceph.mon.a.smithi152.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T21:55:08.802 INFO:journalctl@ceph.mon.a.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 126.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T21:55:08.802 INFO:journalctl@ceph.mon.a.smithi152.stdout: 2024-09-11T21:55:08.802 INFO:journalctl@ceph.mon.a.smithi152.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: Cumulative compaction: 0.00 GB write, 27.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: Interval compaction: 0.00 GB write, 27.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: Block cache BinnedLRUCache@0x555a0bcdf1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-11T21:55:08.803 INFO:journalctl@ceph.mon.a.smithi152.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout: 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: starting mon.a rank 0 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: mon.a@-1(???) e1 preinit fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: mon.a@-1(???).mds e1 new map 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: mon.a@-1(???).mds e1 print_map 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout: e1 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout: btime 2024-09-11T21:55:03:864852+0000 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout: legacy client fscid: -1 2024-09-11T21:55:08.804 INFO:journalctl@ceph.mon.a.smithi152.stdout: 2024-09-11T21:55:08.805 INFO:journalctl@ceph.mon.a.smithi152.stdout: No filesystems configured 2024-09-11T21:55:08.805 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T21:55:08.805 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T21:55:08.805 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T21:55:08.805 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T21:55:08.805 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-11T21:55:08.805 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 bash[31170]: 0cc5c0da4320a4b5642c808bb332e2a458e1abab2be4993c02f02c68666b8034 2024-09-11T21:55:08.805 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 systemd[1]: Started Ceph mon.a for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T21:55:08.805 INFO:teuthology.orchestra.run.smithi152.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-11T21:55:09.053 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T21:55:09.053 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: monmap epoch 1 2024-09-11T21:55:09.053 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:09.053 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: last_changed 2024-09-11T21:55:00.803593+0000 2024-09-11T21:55:09.053 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: created 2024-09-11T21:55:00.803593+0000 2024-09-11T21:55:09.053 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: min_mon_release 19 (squid) 2024-09-11T21:55:09.053 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: election_strategy: 1 2024-09-11T21:55:09.053 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: 0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2024-09-11T21:55:09.054 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: fsmap 2024-09-11T21:55:09.054 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T21:55:09.054 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:08 smithi152 ceph-mon[31188]: mgrmap e1: no daemons active 2024-09-11T21:55:09.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.236+0000 7fde8c431640 1 Processor -- start 2024-09-11T21:55:09.841 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.236+0000 7fde8c431640 1 -- start start 2024-09-11T21:55:09.841 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.236+0000 7fde8c431640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde84105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:09.842 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.236+0000 7fde8c431640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fde84106570 con 0x7fde84105ba0 2024-09-11T21:55:09.842 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.237+0000 7fde8a1cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde84105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:09.842 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.237+0000 7fde8a1cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde84105fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57300/0 (socket says 172.21.15.152:57300) 2024-09-11T21:55:09.842 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.237+0000 7fde8a1cd640 1 -- 172.21.15.152:0/4286178960 learned_addr learned my addr 172.21.15.152:0/4286178960 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:09.842 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.237+0000 7fde8a1cd640 1 -- 172.21.15.152:0/4286178960 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde84108b80 con 0x7fde84105ba0 2024-09-11T21:55:09.842 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.239+0000 7fde8a1cd640 1 --2- 172.21.15.152:0/4286178960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde84105fa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fde80009820 tx=0x7fde8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eea8dc39659bf07 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:09.842 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.239+0000 7fde891cb640 1 -- 172.21.15.152:0/4286178960 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde80037070 con 0x7fde84105ba0 2024-09-11T21:55:09.842 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.239+0000 7fde891cb640 1 -- 172.21.15.152:0/4286178960 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde80032900 con 0x7fde84105ba0 2024-09-11T21:55:09.842 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.239+0000 7fde891cb640 1 -- 172.21.15.152:0/4286178960 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde80030850 con 0x7fde84105ba0 2024-09-11T21:55:09.842 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.239+0000 7fde8c431640 1 -- 172.21.15.152:0/4286178960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 msgr2=0x7fde84105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:09.842 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.239+0000 7fde8c431640 1 --2- 172.21.15.152:0/4286178960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde84105fa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fde80009820 tx=0x7fde8002a270 comp rx=0 tx=0).stop 2024-09-11T21:55:09.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.240+0000 7fde8c431640 1 -- 172.21.15.152:0/4286178960 shutdown_connections 2024-09-11T21:55:09.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.240+0000 7fde8c431640 1 --2- 172.21.15.152:0/4286178960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde84105fa0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:09.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.240+0000 7fde8c431640 1 -- 172.21.15.152:0/4286178960 >> 172.21.15.152:0/4286178960 conn(0x7fde84101770 msgr2=0x7fde84103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:09.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.240+0000 7fde8c431640 1 -- 172.21.15.152:0/4286178960 shutdown_connections 2024-09-11T21:55:09.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.240+0000 7fde8c431640 1 -- 172.21.15.152:0/4286178960 wait complete. 2024-09-11T21:55:09.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.240+0000 7fde8c431640 1 Processor -- start 2024-09-11T21:55:09.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.240+0000 7fde8c431640 1 -- start start 2024-09-11T21:55:09.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.240+0000 7fde8c431640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde8419b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:09.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.240+0000 7fde8c431640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fde8410bdb0 con 0x7fde84105ba0 2024-09-11T21:55:09.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.240+0000 7fde8a1cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde8419b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:09.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.241+0000 7fde8a1cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde8419b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57310/0 (socket says 172.21.15.152:57310) 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.241+0000 7fde8a1cd640 1 -- 172.21.15.152:0/3794893911 learned_addr learned my addr 172.21.15.152:0/3794893911 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.241+0000 7fde8a1cd640 1 -- 172.21.15.152:0/3794893911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8419be30 con 0x7fde84105ba0 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.241+0000 7fde8a1cd640 1 --2- 172.21.15.152:0/3794893911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde8419b8f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fde80009940 tx=0x7fde80032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.241+0000 7fde7b7fe640 1 -- 172.21.15.152:0/3794893911 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde80042070 con 0x7fde84105ba0 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.241+0000 7fde7b7fe640 1 -- 172.21.15.152:0/3794893911 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde800308c0 con 0x7fde84105ba0 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.241+0000 7fde8c431640 1 -- 172.21.15.152:0/3794893911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8419c0c0 con 0x7fde84105ba0 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.241+0000 7fde7b7fe640 1 -- 172.21.15.152:0/3794893911 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde80037040 con 0x7fde84105ba0 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.241+0000 7fde8c431640 1 -- 172.21.15.152:0/3794893911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde8419edb0 con 0x7fde84105ba0 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.241+0000 7fde7b7fe640 1 -- 172.21.15.152:0/3794893911 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fde80045070 con 0x7fde84105ba0 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.241+0000 7fde7b7fe640 1 -- 172.21.15.152:0/3794893911 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fde80047780 con 0x7fde84105ba0 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.242+0000 7fde8c431640 1 -- 172.21.15.152:0/3794893911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde84106020 con 0x7fde84105ba0 2024-09-11T21:55:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.244+0000 7fde7b7fe640 1 -- 172.21.15.152:0/3794893911 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fde80046de0 con 0x7fde84105ba0 2024-09-11T21:55:09.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.300+0000 7fde8c431640 1 -- 172.21.15.152:0/3794893911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fde8419ef80 con 0x7fde84105ba0 2024-09-11T21:55:09.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.305+0000 7fde7b7fe640 1 -- 172.21.15.152:0/3794893911 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fde800327b0 con 0x7fde84105ba0 2024-09-11T21:55:09.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.305+0000 7fde8c431640 1 -- 172.21.15.152:0/3794893911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 msgr2=0x7fde8419b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:09.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.305+0000 7fde8c431640 1 --2- 172.21.15.152:0/3794893911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde8419b8f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fde80009940 tx=0x7fde80032ce0 comp rx=0 tx=0).stop 2024-09-11T21:55:09.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.306+0000 7fde8c431640 1 -- 172.21.15.152:0/3794893911 shutdown_connections 2024-09-11T21:55:09.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.306+0000 7fde8c431640 1 --2- 172.21.15.152:0/3794893911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde84105ba0 0x7fde8419b8f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:09.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.306+0000 7fde8c431640 1 -- 172.21.15.152:0/3794893911 >> 172.21.15.152:0/3794893911 conn(0x7fde84101770 msgr2=0x7fde84102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:09.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.306+0000 7fde8c431640 1 -- 172.21.15.152:0/3794893911 shutdown_connections 2024-09-11T21:55:09.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:09.306+0000 7fde8c431640 1 -- 172.21.15.152:0/3794893911 wait complete. 2024-09-11T21:55:09.845 INFO:teuthology.orchestra.run.smithi152.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-11T21:55:09.867 INFO:teuthology.orchestra.run.smithi152.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-11T21:55:09.867 INFO:teuthology.orchestra.run.smithi152.stdout:Creating mgr... 2024-09-11T21:55:09.867 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-11T21:55:09.868 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-11T21:55:10.116 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.x 2024-09-11T21:55:10.116 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-11T21:55:10.264 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5c140ed8-7088-11ef-bcea-c7b262605968.target.wants/ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-5c140ed8-7088-11ef-bcea-c7b262605968@.service. 2024-09-11T21:55:10.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:10 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3794893911' entity='client.admin' 2024-09-11T21:55:10.781 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:10 smithi152 podman[31397]: 2024-09-11 21:55:10.708165543 +0000 UTC m=+0.325723710 container start 9a399836b4ff06ef50f4e63eb623f83dcc1e3d8835a04b0c94b699923d7c1376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T21:55:10.781 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:10 smithi152 bash[31397]: 9a399836b4ff06ef50f4e63eb623f83dcc1e3d8835a04b0c94b699923d7c1376 2024-09-11T21:55:10.797 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T21:55:10.797 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout disabled 2024-09-11T21:55:10.805 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T21:55:10.805 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2024-09-11T21:55:10.805 INFO:teuthology.orchestra.run.smithi152.stdout:firewalld.service is not enabled 2024-09-11T21:55:10.806 INFO:teuthology.orchestra.run.smithi152.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T21:55:10.815 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T21:55:10.815 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout disabled 2024-09-11T21:55:10.823 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T21:55:10.823 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2024-09-11T21:55:10.823 INFO:teuthology.orchestra.run.smithi152.stdout:firewalld.service is not enabled 2024-09-11T21:55:10.823 INFO:teuthology.orchestra.run.smithi152.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-11T21:55:10.823 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mgr to start... 2024-09-11T21:55:10.824 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mgr... 2024-09-11T21:55:11.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:10 smithi152 systemd[1]: Started Ceph mgr.x for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T21:55:11.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:10 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:10.836+0000 7f08491d3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T21:55:11.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:10 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:10.896+0000 7f08491d3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T21:55:11.589 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:11 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:11.234+0000 7f08491d3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T21:55:11.589 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:11 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:11.301+0000 7f08491d3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T21:55:11.589 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:11 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:11.449+0000 7f08491d3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T21:55:11.589 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:11 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:11.588+0000 7f08491d3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T21:55:12.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:11 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:11.905+0000 7f08491d3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T21:55:12.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:12 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:11.967+0000 7f08491d3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T21:55:12.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:12 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:12.151+0000 7f08491d3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T21:55:13.423 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:13 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:13.042+0000 7f08491d3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T21:55:13.423 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:13 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:13.110+0000 7f08491d3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T21:55:13.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:13 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/4030396204' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T21:55:13.979 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:13 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:13.858+0000 7f08491d3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T21:55:13.979 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:13 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:13.978+0000 7f08491d3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T21:55:14.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:14.128+0000 7f08491d3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T21:55:14.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:14.193+0000 7f08491d3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T21:55:14.644 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:14.346+0000 7f08491d3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T21:55:14.644 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:14.417+0000 7f08491d3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T21:55:14.644 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:14.478+0000 7f08491d3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T21:55:14.644 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:14.643+0000 7f08491d3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T21:55:14.926 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:14.709+0000 7f08491d3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T21:55:14.926 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:14.779+0000 7f08491d3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T21:55:14.926 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:14.864+0000 7f08491d3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T21:55:14.926 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:14.925+0000 7f08491d3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T21:55:15.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:14.984+0000 7f08491d3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T21:55:16.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:15.780+0000 7f08491d3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T21:55:16.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: Activating manager daemon x 2024-09-11T21:55:16.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: mgrmap e2: x(active, starting, since 0.00305401s) 2024-09-11T21:55:16.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: from='mgr.14100 172.21.15.152:0/2636127011' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T21:55:16.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: from='mgr.14100 172.21.15.152:0/2636127011' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T21:55:16.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: from='mgr.14100 172.21.15.152:0/2636127011' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T21:55:16.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: from='mgr.14100 172.21.15.152:0/2636127011' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:55:16.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: from='mgr.14100 172.21.15.152:0/2636127011' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T21:55:16.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: Manager daemon x is now available 2024-09-11T21:55:16.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: from='mgr.14100 172.21.15.152:0/2636127011' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T21:55:16.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: from='mgr.14100 172.21.15.152:0/2636127011' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T21:55:16.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: from='mgr.14100 172.21.15.152:0/2636127011' entity='mgr.x' 2024-09-11T21:55:16.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: from='mgr.14100 172.21.15.152:0/2636127011' entity='mgr.x' 2024-09-11T21:55:16.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:15 smithi152 ceph-mon[31188]: from='mgr.14100 172.21.15.152:0/2636127011' entity='mgr.x' 2024-09-11T21:55:17.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:17 smithi152 ceph-mon[31188]: mgrmap e3: x(active, since 1.00753s) 2024-09-11T21:55:19.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:18 smithi152 ceph-mon[31188]: mgrmap e4: x(active, since 2s) 2024-09-11T21:55:20.240 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2024-09-11T21:55:20.240 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2024-09-11T21:55:20.240 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsid": "5c140ed8-7088-11ef-bcea-c7b262605968", 2024-09-11T21:55:20.240 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T21:55:20.240 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T21:55:20.240 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T21:55:20.240 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T21:55:20.240 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 0 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:20.241 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T21:55:20.242 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T21:55:20.242 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T21:55:20.242 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T21:55:20.242 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T21:55:20.249 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T21:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T21:55:03:864852+0000", 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T21:55:20.251 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T21:55:03.865690+0000", 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2024-09-11T21:55:20.252 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.766+0000 7fc0b06a1640 1 Processor -- start 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.766+0000 7fc0b06a1640 1 -- start start 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.766+0000 7fc0b06a1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a8106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.766+0000 7fc0b06a1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8107150 con 0x7fc0a8106780 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.767+0000 7fc0ae43d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a8106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.767+0000 7fc0ae43d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a8106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56398/0 (socket says 172.21.15.152:56398) 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.767+0000 7fc0ae43d640 1 -- 172.21.15.152:0/3268998872 learned_addr learned my addr 172.21.15.152:0/3268998872 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.767+0000 7fc0ae43d640 1 -- 172.21.15.152:0/3268998872 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a8107980 con 0x7fc0a8106780 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.768+0000 7fc0ae43d640 1 --2- 172.21.15.152:0/3268998872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a8106b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009820 tx=0x7fc0a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916db0612af8ffc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.768+0000 7fc0ad43b640 1 -- 172.21.15.152:0/3268998872 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4037070 con 0x7fc0a8106780 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.768+0000 7fc0ad43b640 1 -- 172.21.15.152:0/3268998872 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0a4032900 con 0x7fc0a8106780 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.768+0000 7fc0ad43b640 1 -- 172.21.15.152:0/3268998872 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4030850 con 0x7fc0a8106780 2024-09-11T21:55:20.253 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.769+0000 7fc0b06a1640 1 -- 172.21.15.152:0/3268998872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 msgr2=0x7fc0a8106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.769+0000 7fc0b06a1640 1 --2- 172.21.15.152:0/3268998872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a8106b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009820 tx=0x7fc0a402a270 comp rx=0 tx=0).stop 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.769+0000 7fc0b06a1640 1 -- 172.21.15.152:0/3268998872 shutdown_connections 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.769+0000 7fc0b06a1640 1 --2- 172.21.15.152:0/3268998872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a8106b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.769+0000 7fc0b06a1640 1 -- 172.21.15.152:0/3268998872 >> 172.21.15.152:0/3268998872 conn(0x7fc0a8101fb0 msgr2=0x7fc0a81043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.769+0000 7fc0b06a1640 1 -- 172.21.15.152:0/3268998872 shutdown_connections 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.769+0000 7fc0b06a1640 1 -- 172.21.15.152:0/3268998872 wait complete. 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.770+0000 7fc0b06a1640 1 Processor -- start 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.770+0000 7fc0b06a1640 1 -- start start 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.770+0000 7fc0b06a1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.770+0000 7fc0b06a1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a810ad30 con 0x7fc0a8106780 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.770+0000 7fc0ae43d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.770+0000 7fc0ae43d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a819a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56406/0 (socket says 172.21.15.152:56406) 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.770+0000 7fc0ae43d640 1 -- 172.21.15.152:0/4030396204 learned_addr learned my addr 172.21.15.152:0/4030396204 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.770+0000 7fc0ae43d640 1 -- 172.21.15.152:0/4030396204 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a819acf0 con 0x7fc0a8106780 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.770+0000 7fc0ae43d640 1 --2- 172.21.15.152:0/4030396204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a819a7b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009940 tx=0x7fc0a4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.771+0000 7fc09f7fe640 1 -- 172.21.15.152:0/4030396204 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4042070 con 0x7fc0a8106780 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.771+0000 7fc09f7fe640 1 -- 172.21.15.152:0/4030396204 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0a40308c0 con 0x7fc0a8106780 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.771+0000 7fc0b06a1640 1 -- 172.21.15.152:0/4030396204 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a819af80 con 0x7fc0a8106780 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.771+0000 7fc09f7fe640 1 -- 172.21.15.152:0/4030396204 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4037040 con 0x7fc0a8106780 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.771+0000 7fc0b06a1640 1 -- 172.21.15.152:0/4030396204 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a819b3e0 con 0x7fc0a8106780 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.771+0000 7fc09f7fe640 1 -- 172.21.15.152:0/4030396204 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc0a4045070 con 0x7fc0a8106780 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.771+0000 7fc09f7fe640 1 -- 172.21.15.152:0/4030396204 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc0a4047b70 con 0x7fc0a8106780 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.772+0000 7fc0b06a1640 1 -- 172.21.15.152:0/4030396204 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a810aeb0 con 0x7fc0a8106780 2024-09-11T21:55:20.255 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.774+0000 7fc09f7fe640 1 -- 172.21.15.152:0/4030396204 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc0a40327b0 con 0x7fc0a8106780 2024-09-11T21:55:20.256 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.835+0000 7fc0b06a1640 1 -- 172.21.15.152:0/4030396204 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc0a8074cb0 con 0x7fc0a8106780 2024-09-11T21:55:20.256 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.835+0000 7fc09f7fe640 1 -- 172.21.15.152:0/4030396204 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fc0a403c760 con 0x7fc0a8106780 2024-09-11T21:55:20.256 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.836+0000 7fc0b06a1640 1 -- 172.21.15.152:0/4030396204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 msgr2=0x7fc0a819a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:20.256 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.836+0000 7fc0b06a1640 1 --2- 172.21.15.152:0/4030396204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a819a7b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009940 tx=0x7fc0a4032ce0 comp rx=0 tx=0).stop 2024-09-11T21:55:20.256 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.836+0000 7fc0b06a1640 1 -- 172.21.15.152:0/4030396204 shutdown_connections 2024-09-11T21:55:20.256 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.836+0000 7fc0b06a1640 1 --2- 172.21.15.152:0/4030396204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a8106780 0x7fc0a819a7b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:20.256 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.836+0000 7fc0b06a1640 1 -- 172.21.15.152:0/4030396204 >> 172.21.15.152:0/4030396204 conn(0x7fc0a8101fb0 msgr2=0x7fc0a8102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:20.256 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.836+0000 7fc0b06a1640 1 -- 172.21.15.152:0/4030396204 shutdown_connections 2024-09-11T21:55:20.256 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:13.836+0000 7fc0b06a1640 1 -- 172.21.15.152:0/4030396204 wait complete. 2024-09-11T21:55:20.256 INFO:teuthology.orchestra.run.smithi152.stdout:mgr not available, waiting (1/15)... 2024-09-11T21:55:23.232 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:22 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/397402954' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T21:55:23.513 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2024-09-11T21:55:23.513 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2024-09-11T21:55:23.513 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsid": "5c140ed8-7088-11ef-bcea-c7b262605968", 2024-09-11T21:55:23.513 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 0 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2024-09-11T21:55:23.514 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T21:55:23.515 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:23.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T21:55:23.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T21:55:23.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T21:55:23.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T21:55:23.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T21:55:23.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T21:55:23.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T21:55:23.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T21:55:23.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T21:55:23.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:23.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T21:55:03:864852+0000", 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2024-09-11T21:55:23.517 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T21:55:03.865690+0000", 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.658+0000 7f44a5769640 1 Processor -- start 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.659+0000 7f44a5769640 1 -- start start 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.659+0000 7f44a5769640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a0106c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.659+0000 7f44a5769640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01071d0 con 0x7f44a0106800 2024-09-11T21:55:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.659+0000 7f449effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a0106c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:23.519 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.659+0000 7f449effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a0106c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56480/0 (socket says 172.21.15.152:56480) 2024-09-11T21:55:23.519 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.659+0000 7f449effd640 1 -- 172.21.15.152:0/1533286482 learned_addr learned my addr 172.21.15.152:0/1533286482 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:23.519 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.659+0000 7f449effd640 1 -- 172.21.15.152:0/1533286482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a0107a00 con 0x7f44a0106800 2024-09-11T21:55:23.519 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.660+0000 7f449effd640 1 --2- 172.21.15.152:0/1533286482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a0106c00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4490009820 tx=0x7f449002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e0e71bf74988d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:23.519 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.660+0000 7f449dffb640 1 -- 172.21.15.152:0/1533286482 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4490037070 con 0x7f44a0106800 2024-09-11T21:55:23.519 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.660+0000 7f449dffb640 1 -- 172.21.15.152:0/1533286482 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4490032900 con 0x7f44a0106800 2024-09-11T21:55:23.519 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.660+0000 7f449dffb640 1 -- 172.21.15.152:0/1533286482 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4490030850 con 0x7f44a0106800 2024-09-11T21:55:23.519 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.661+0000 7f44a5769640 1 -- 172.21.15.152:0/1533286482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 msgr2=0x7f44a0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:23.519 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.661+0000 7f44a5769640 1 --2- 172.21.15.152:0/1533286482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a0106c00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4490009820 tx=0x7f449002a270 comp rx=0 tx=0).stop 2024-09-11T21:55:23.519 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.661+0000 7f44a5769640 1 -- 172.21.15.152:0/1533286482 shutdown_connections 2024-09-11T21:55:23.519 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.661+0000 7f44a5769640 1 --2- 172.21.15.152:0/1533286482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a0106c00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:23.520 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.661+0000 7f44a5769640 1 -- 172.21.15.152:0/1533286482 >> 172.21.15.152:0/1533286482 conn(0x7f44a0102010 msgr2=0x7f44a0104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:23.520 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.661+0000 7f44a5769640 1 -- 172.21.15.152:0/1533286482 shutdown_connections 2024-09-11T21:55:23.520 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.661+0000 7f44a5769640 1 -- 172.21.15.152:0/1533286482 wait complete. 2024-09-11T21:55:23.520 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.661+0000 7f44a5769640 1 Processor -- start 2024-09-11T21:55:23.520 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.662+0000 7f44a5769640 1 -- start start 2024-09-11T21:55:23.520 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.662+0000 7f44a5769640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a007ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:23.520 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.662+0000 7f44a5769640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f44a010adb0 con 0x7f44a0106800 2024-09-11T21:55:23.520 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.662+0000 7f449effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a007ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:23.520 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.662+0000 7f449effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a007ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56484/0 (socket says 172.21.15.152:56484) 2024-09-11T21:55:23.520 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.662+0000 7f449effd640 1 -- 172.21.15.152:0/397402954 learned_addr learned my addr 172.21.15.152:0/397402954 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:23.520 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.663+0000 7f449effd640 1 -- 172.21.15.152:0/397402954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a019e640 con 0x7f44a0106800 2024-09-11T21:55:23.521 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.663+0000 7f449effd640 1 --2- 172.21.15.152:0/397402954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a007ba40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f44900097f0 tx=0x7f4490030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:23.521 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.663+0000 7f4487fff640 1 -- 172.21.15.152:0/397402954 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4490037040 con 0x7f44a0106800 2024-09-11T21:55:23.521 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.663+0000 7f4487fff640 1 -- 172.21.15.152:0/397402954 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4490040070 con 0x7f44a0106800 2024-09-11T21:55:23.521 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.663+0000 7f44a5769640 1 -- 172.21.15.152:0/397402954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a019e810 con 0x7f44a0106800 2024-09-11T21:55:23.521 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.663+0000 7f4487fff640 1 -- 172.21.15.152:0/397402954 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f449003a390 con 0x7f44a0106800 2024-09-11T21:55:23.521 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.663+0000 7f44a5769640 1 -- 172.21.15.152:0/397402954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a019ebb0 con 0x7f44a0106800 2024-09-11T21:55:23.521 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.664+0000 7f4487fff640 1 -- 172.21.15.152:0/397402954 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f449003a630 con 0x7f44a0106800 2024-09-11T21:55:23.521 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.664+0000 7f44a5769640 1 -- 172.21.15.152:0/397402954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a010af30 con 0x7f44a0106800 2024-09-11T21:55:23.521 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.664+0000 7f4487fff640 1 --2- 172.21.15.152:0/397402954 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f4488038f20 0x7f448803b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:23.521 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.665+0000 7f4487fff640 1 -- 172.21.15.152:0/397402954 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f449006c110 con 0x7f44a0106800 2024-09-11T21:55:23.522 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.665+0000 7f449e7fc640 1 --2- 172.21.15.152:0/397402954 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f4488038f20 0x7f448803b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:23.522 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.665+0000 7f449e7fc640 1 --2- 172.21.15.152:0/397402954 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f4488038f20 0x7f448803b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f44940098c0 tx=0x7f4494006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:23.522 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.670+0000 7f4487fff640 1 -- 172.21.15.152:0/397402954 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f449003a9d0 con 0x7f44a0106800 2024-09-11T21:55:23.522 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.906+0000 7f44a5769640 1 -- 172.21.15.152:0/397402954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f44a019f440 con 0x7f44a0106800 2024-09-11T21:55:23.522 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.907+0000 7f4487fff640 1 -- 172.21.15.152:0/397402954 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f449006be70 con 0x7f44a0106800 2024-09-11T21:55:23.522 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.909+0000 7f44a5769640 1 -- 172.21.15.152:0/397402954 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f4488038f20 msgr2=0x7f448803b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:23.522 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.909+0000 7f44a5769640 1 --2- 172.21.15.152:0/397402954 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f4488038f20 0x7f448803b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f44940098c0 tx=0x7f4494006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:23.522 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.909+0000 7f44a5769640 1 -- 172.21.15.152:0/397402954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 msgr2=0x7f44a007ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:23.522 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.909+0000 7f44a5769640 1 --2- 172.21.15.152:0/397402954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a007ba40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f44900097f0 tx=0x7f4490030d80 comp rx=0 tx=0).stop 2024-09-11T21:55:23.522 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.909+0000 7f44a5769640 1 -- 172.21.15.152:0/397402954 shutdown_connections 2024-09-11T21:55:23.523 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.909+0000 7f44a5769640 1 --2- 172.21.15.152:0/397402954 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f4488038f20 0x7f448803b3e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:23.523 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.909+0000 7f44a5769640 1 --2- 172.21.15.152:0/397402954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a0106800 0x7f44a007ba40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:23.523 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.909+0000 7f44a5769640 1 -- 172.21.15.152:0/397402954 >> 172.21.15.152:0/397402954 conn(0x7f44a0102010 msgr2=0x7f44a0102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:23.523 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.909+0000 7f44a5769640 1 -- 172.21.15.152:0/397402954 shutdown_connections 2024-09-11T21:55:23.523 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:22.909+0000 7f44a5769640 1 -- 172.21.15.152:0/397402954 wait complete. 2024-09-11T21:55:23.523 INFO:teuthology.orchestra.run.smithi152.stdout:mgr is available 2024-09-11T21:55:24.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:24 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/139366766' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T21:55:24.633 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2024-09-11T21:55:24.633 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T21:55:24.634 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout fsid = 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:24.634 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.152:3300,v1:172.21.15.152:6789] 2024-09-11T21:55:24.634 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T21:55:24.634 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T21:55:24.634 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T21:55:24.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T21:55:24.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2024-09-11T21:55:24.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T21:55:24.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T21:55:24.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2024-09-11T21:55:24.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T21:55:24.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T21:55:24.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T21:55:24.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T21:55:24.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T21:55:24.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T21:55:24.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.913+0000 7f280e79f640 1 Processor -- start 2024-09-11T21:55:24.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.913+0000 7f280e79f640 1 -- start start 2024-09-11T21:55:24.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.913+0000 7f280e79f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f2808107cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:24.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.913+0000 7f280e79f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2808108290 con 0x7f28081078c0 2024-09-11T21:55:24.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.913+0000 7f2807fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f2808107cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:24.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.913+0000 7f2807fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f2808107cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46306/0 (socket says 172.21.15.152:46306) 2024-09-11T21:55:24.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.913+0000 7f2807fff640 1 -- 172.21.15.152:0/3856165070 learned_addr learned my addr 172.21.15.152:0/3856165070 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:24.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.914+0000 7f2807fff640 1 -- 172.21.15.152:0/3856165070 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2808108ac0 con 0x7f28081078c0 2024-09-11T21:55:24.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.914+0000 7f2807fff640 1 --2- 172.21.15.152:0/3856165070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f2808107cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009820 tx=0x7f27f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cdfb5add2a956d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:24.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.914+0000 7f2806ffd640 1 -- 172.21.15.152:0/3856165070 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8037070 con 0x7f28081078c0 2024-09-11T21:55:24.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.915+0000 7f2806ffd640 1 -- 172.21.15.152:0/3856165070 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27f8032900 con 0x7f28081078c0 2024-09-11T21:55:24.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.915+0000 7f2806ffd640 1 -- 172.21.15.152:0/3856165070 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8030850 con 0x7f28081078c0 2024-09-11T21:55:24.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.915+0000 7f280e79f640 1 -- 172.21.15.152:0/3856165070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 msgr2=0x7f2808107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:24.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.915+0000 7f280e79f640 1 --2- 172.21.15.152:0/3856165070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f2808107cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009820 tx=0x7f27f802a270 comp rx=0 tx=0).stop 2024-09-11T21:55:24.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.915+0000 7f280e79f640 1 -- 172.21.15.152:0/3856165070 shutdown_connections 2024-09-11T21:55:24.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.915+0000 7f280e79f640 1 --2- 172.21.15.152:0/3856165070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f2808107cc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:24.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.915+0000 7f280e79f640 1 -- 172.21.15.152:0/3856165070 >> 172.21.15.152:0/3856165070 conn(0x7f2808103090 msgr2=0x7f28081054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.915+0000 7f280e79f640 1 -- 172.21.15.152:0/3856165070 shutdown_connections 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.915+0000 7f280e79f640 1 -- 172.21.15.152:0/3856165070 wait complete. 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.916+0000 7f280e79f640 1 Processor -- start 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.916+0000 7f280e79f640 1 -- start start 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.916+0000 7f280e79f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f280819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.916+0000 7f280e79f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f280810be70 con 0x7f28081078c0 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.916+0000 7f2807fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f280819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.916+0000 7f2807fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f280819b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46310/0 (socket says 172.21.15.152:46310) 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.916+0000 7f2807fff640 1 -- 172.21.15.152:0/139366766 learned_addr learned my addr 172.21.15.152:0/139366766 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.916+0000 7f2807fff640 1 -- 172.21.15.152:0/139366766 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280819be50 con 0x7f28081078c0 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.917+0000 7f2807fff640 1 --2- 172.21.15.152:0/139366766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f280819b910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f27f80097f0 tx=0x7f27f8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:24.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.917+0000 7f28057fa640 1 -- 172.21.15.152:0/139366766 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8042070 con 0x7f28081078c0 2024-09-11T21:55:24.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.917+0000 7f28057fa640 1 -- 172.21.15.152:0/139366766 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27f8032ca0 con 0x7f28081078c0 2024-09-11T21:55:24.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.917+0000 7f280e79f640 1 -- 172.21.15.152:0/139366766 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f280819c0e0 con 0x7f28081078c0 2024-09-11T21:55:24.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.917+0000 7f28057fa640 1 -- 172.21.15.152:0/139366766 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8037040 con 0x7f28081078c0 2024-09-11T21:55:24.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.917+0000 7f280e79f640 1 -- 172.21.15.152:0/139366766 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f280819edd0 con 0x7f28081078c0 2024-09-11T21:55:24.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.918+0000 7f28057fa640 1 -- 172.21.15.152:0/139366766 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f27f8045070 con 0x7f28081078c0 2024-09-11T21:55:24.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.918+0000 7f28057fa640 1 --2- 172.21.15.152:0/139366766 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f27f0038f20 0x7f27f003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:24.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.918+0000 7f28057fa640 1 -- 172.21.15.152:0/139366766 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f27f806bed0 con 0x7f28081078c0 2024-09-11T21:55:24.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.918+0000 7f280e79f640 1 -- 172.21.15.152:0/139366766 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f280810bff0 con 0x7f28081078c0 2024-09-11T21:55:24.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.918+0000 7f28077fe640 1 --2- 172.21.15.152:0/139366766 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f27f0038f20 0x7f27f003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:24.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.918+0000 7f28077fe640 1 --2- 172.21.15.152:0/139366766 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f27f0038f20 0x7f27f003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0098c0 tx=0x7f27fc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:24.640 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:23.923+0000 7f28057fa640 1 -- 172.21.15.152:0/139366766 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27f806b8f0 con 0x7f28081078c0 2024-09-11T21:55:24.640 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.088+0000 7f280e79f640 1 -- 172.21.15.152:0/139366766 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f2808107d40 con 0x7f28081078c0 2024-09-11T21:55:24.640 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.090+0000 7f28057fa640 1 -- 172.21.15.152:0/139366766 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7f27f8050eb0 con 0x7f28081078c0 2024-09-11T21:55:24.640 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.092+0000 7f280e79f640 1 -- 172.21.15.152:0/139366766 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f27f0038f20 msgr2=0x7f27f003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:24.640 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.092+0000 7f280e79f640 1 --2- 172.21.15.152:0/139366766 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f27f0038f20 0x7f27f003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0098c0 tx=0x7f27fc006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:24.640 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.092+0000 7f280e79f640 1 -- 172.21.15.152:0/139366766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 msgr2=0x7f280819b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:24.640 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.092+0000 7f280e79f640 1 --2- 172.21.15.152:0/139366766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f280819b910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f27f80097f0 tx=0x7f27f8030ec0 comp rx=0 tx=0).stop 2024-09-11T21:55:24.641 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.092+0000 7f280e79f640 1 -- 172.21.15.152:0/139366766 shutdown_connections 2024-09-11T21:55:24.641 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.092+0000 7f280e79f640 1 --2- 172.21.15.152:0/139366766 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f27f0038f20 0x7f27f003b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:24.641 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.092+0000 7f280e79f640 1 --2- 172.21.15.152:0/139366766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28081078c0 0x7f280819b910 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:24.641 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.092+0000 7f280e79f640 1 -- 172.21.15.152:0/139366766 >> 172.21.15.152:0/139366766 conn(0x7f2808103090 msgr2=0x7f2808103ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:24.641 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.092+0000 7f280e79f640 1 -- 172.21.15.152:0/139366766 shutdown_connections 2024-09-11T21:55:24.641 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:24.092+0000 7f280e79f640 1 -- 172.21.15.152:0/139366766 wait complete. 2024-09-11T21:55:24.641 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling cephadm module... 2024-09-11T21:55:25.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:25 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/947552851' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-11T21:55:25.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: ignoring --setuser ceph since I am not root 2024-09-11T21:55:25.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: ignoring --setgroup ceph since I am not root 2024-09-11T21:55:25.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:25.420+0000 7f45f944c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T21:55:25.481 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:25.478+0000 7f45f944c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T21:55:25.821 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.013+0000 7f637a2ec640 1 Processor -- start 2024-09-11T21:55:25.821 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.013+0000 7f637a2ec640 1 -- start start 2024-09-11T21:55:25.821 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.013+0000 7f637a2ec640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:25.821 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.013+0000 7f637a2ec640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f637407c830 con 0x7f637407de40 2024-09-11T21:55:25.821 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.013+0000 7f6373fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:25.821 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.013+0000 7f6373fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637407c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46316/0 (socket says 172.21.15.152:46316) 2024-09-11T21:55:25.821 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.013+0000 7f6373fff640 1 -- 172.21.15.152:0/1322998659 learned_addr learned my addr 172.21.15.152:0/1322998659 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.013+0000 7f6373fff640 1 -- 172.21.15.152:0/1322998659 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637407c9b0 con 0x7f637407de40 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.014+0000 7f6373fff640 1 --2- 172.21.15.152:0/1322998659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637407c2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6364009820 tx=0x7f636402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260c0407a589aafe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.014+0000 7f63737fe640 1 -- 172.21.15.152:0/1322998659 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6364037070 con 0x7f637407de40 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.014+0000 7f63737fe640 1 -- 172.21.15.152:0/1322998659 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6364032900 con 0x7f637407de40 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.014+0000 7f63737fe640 1 -- 172.21.15.152:0/1322998659 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63640308e0 con 0x7f637407de40 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.015+0000 7f637a2ec640 1 -- 172.21.15.152:0/1322998659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 msgr2=0x7f637407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.015+0000 7f637a2ec640 1 --2- 172.21.15.152:0/1322998659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637407c2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6364009820 tx=0x7f636402a300 comp rx=0 tx=0).stop 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.015+0000 7f637a2ec640 1 -- 172.21.15.152:0/1322998659 shutdown_connections 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.015+0000 7f637a2ec640 1 --2- 172.21.15.152:0/1322998659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637407c2f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.015+0000 7f637a2ec640 1 -- 172.21.15.152:0/1322998659 >> 172.21.15.152:0/1322998659 conn(0x7f6374103110 msgr2=0x7f6374105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.015+0000 7f637a2ec640 1 -- 172.21.15.152:0/1322998659 shutdown_connections 2024-09-11T21:55:25.822 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.015+0000 7f637a2ec640 1 -- 172.21.15.152:0/1322998659 wait complete. 2024-09-11T21:55:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.015+0000 7f637a2ec640 1 Processor -- start 2024-09-11T21:55:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.015+0000 7f637a2ec640 1 -- start start 2024-09-11T21:55:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f637a2ec640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637419daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f637a2ec640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f637410df10 con 0x7f637407de40 2024-09-11T21:55:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f6373fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637419daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f6373fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637419daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46324/0 (socket says 172.21.15.152:46324) 2024-09-11T21:55:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f6373fff640 1 -- 172.21.15.152:0/947552851 learned_addr learned my addr 172.21.15.152:0/947552851 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f6373fff640 1 -- 172.21.15.152:0/947552851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637419dfe0 con 0x7f637407de40 2024-09-11T21:55:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f6373fff640 1 --2- 172.21.15.152:0/947552851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637419daa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6364030610 tx=0x7f6364032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f6371ffb640 1 -- 172.21.15.152:0/947552851 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6364037040 con 0x7f637407de40 2024-09-11T21:55:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f637a2ec640 1 -- 172.21.15.152:0/947552851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637419e270 con 0x7f637407de40 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f6371ffb640 1 -- 172.21.15.152:0/947552851 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6364040070 con 0x7f637407de40 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f6371ffb640 1 -- 172.21.15.152:0/947552851 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f636403a390 con 0x7f637407de40 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.016+0000 7f637a2ec640 1 -- 172.21.15.152:0/947552851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63741a0f60 con 0x7f637407de40 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.017+0000 7f6371ffb640 1 -- 172.21.15.152:0/947552851 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f636403a690 con 0x7f637407de40 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.017+0000 7f637a2ec640 1 -- 172.21.15.152:0/947552851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f637407c370 con 0x7f637407de40 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.017+0000 7f6371ffb640 1 --2- 172.21.15.152:0/947552851 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f6360038f20 0x7f636003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.017+0000 7f6371ffb640 1 -- 172.21.15.152:0/947552851 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f636406be70 con 0x7f637407de40 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.018+0000 7f636bfff640 1 --2- 172.21.15.152:0/947552851 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f6360038f20 0x7f636003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.018+0000 7f636bfff640 1 --2- 172.21.15.152:0/947552851 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f6360038f20 0x7f636003b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f635c0098c0 tx=0x7f635c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.022+0000 7f6371ffb640 1 -- 172.21.15.152:0/947552851 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6364031e80 con 0x7f637407de40 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.229+0000 7f637a2ec640 1 -- 172.21.15.152:0/947552851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f63741a15e0 con 0x7f637407de40 2024-09-11T21:55:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.280+0000 7f6371ffb640 1 -- 172.21.15.152:0/947552851 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f6364041270 con 0x7f637407de40 2024-09-11T21:55:25.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.282+0000 7f6371ffb640 1 -- 172.21.15.152:0/947552851 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f6364032900 con 0x7f637407de40 2024-09-11T21:55:25.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.283+0000 7f637a2ec640 1 -- 172.21.15.152:0/947552851 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f6360038f20 msgr2=0x7f636003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:25.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.283+0000 7f637a2ec640 1 --2- 172.21.15.152:0/947552851 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f6360038f20 0x7f636003b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f635c0098c0 tx=0x7f635c006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:25.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.283+0000 7f637a2ec640 1 -- 172.21.15.152:0/947552851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 msgr2=0x7f637419daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:25.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.283+0000 7f637a2ec640 1 --2- 172.21.15.152:0/947552851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637419daa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6364030610 tx=0x7f6364032670 comp rx=0 tx=0).stop 2024-09-11T21:55:25.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.283+0000 7f637a2ec640 1 -- 172.21.15.152:0/947552851 shutdown_connections 2024-09-11T21:55:25.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.283+0000 7f637a2ec640 1 --2- 172.21.15.152:0/947552851 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f6360038f20 0x7f636003b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:25.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.283+0000 7f637a2ec640 1 --2- 172.21.15.152:0/947552851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f637407de40 0x7f637419daa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:25.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.283+0000 7f637a2ec640 1 -- 172.21.15.152:0/947552851 >> 172.21.15.152:0/947552851 conn(0x7f6374103110 msgr2=0x7f6374103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:25.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.283+0000 7f637a2ec640 1 -- 172.21.15.152:0/947552851 shutdown_connections 2024-09-11T21:55:25.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:25.283+0000 7f637a2ec640 1 -- 172.21.15.152:0/947552851 wait complete. 2024-09-11T21:55:25.941 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:25.628+0000 7f45f944c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T21:55:25.941 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:25.695+0000 7f45f944c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T21:55:25.941 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:25.862+0000 7f45f944c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T21:55:26.200 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:26.025+0000 7f45f944c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T21:55:26.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:26 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/947552851' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-11T21:55:26.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:26 smithi152 ceph-mon[31188]: mgrmap e5: x(active, since 9s) 2024-09-11T21:55:26.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:26.348+0000 7f45f944c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T21:55:26.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:26.412+0000 7f45f944c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T21:55:26.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:26.609+0000 7f45f944c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T21:55:27.566 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:27 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2570193960' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T21:55:27.567 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:27 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:27.498+0000 7f45f944c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T21:55:27.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:27 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:27.565+0000 7f45f944c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T21:55:28.550 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:28.290+0000 7f45f944c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T21:55:28.551 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:28.407+0000 7f45f944c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T21:55:28.663 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2024-09-11T21:55:28.663 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-11T21:55:28.664 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T21:55:28.664 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T21:55:28.664 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T21:55:28.664 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2024-09-11T21:55:28.664 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.277+0000 7f9e89fcd640 1 Processor -- start 2024-09-11T21:55:28.664 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.277+0000 7f9e89fcd640 1 -- start start 2024-09-11T21:55:28.664 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.278+0000 7f9e89fcd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e84107cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:28.664 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.278+0000 7f9e89fcd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9e84108290 con 0x7f9e841078c0 2024-09-11T21:55:28.664 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.278+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e84107cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:28.664 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.278+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e84107cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46354/0 (socket says 172.21.15.152:46354) 2024-09-11T21:55:28.665 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.278+0000 7f9e837fe640 1 -- 172.21.15.152:0/1728339398 learned_addr learned my addr 172.21.15.152:0/1728339398 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:28.665 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.278+0000 7f9e837fe640 1 -- 172.21.15.152:0/1728339398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e84108ac0 con 0x7f9e841078c0 2024-09-11T21:55:28.665 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.279+0000 7f9e837fe640 1 --2- 172.21.15.152:0/1728339398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e84107cc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009820 tx=0x7f9e7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600ab6a73e91ec08 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:28.665 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.279+0000 7f9e82ffd640 1 -- 172.21.15.152:0/1728339398 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e74037070 con 0x7f9e841078c0 2024-09-11T21:55:28.665 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.279+0000 7f9e82ffd640 1 -- 172.21.15.152:0/1728339398 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e74032900 con 0x7f9e841078c0 2024-09-11T21:55:28.665 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.279+0000 7f9e82ffd640 1 -- 172.21.15.152:0/1728339398 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e74030850 con 0x7f9e841078c0 2024-09-11T21:55:28.665 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.280+0000 7f9e89fcd640 1 -- 172.21.15.152:0/1728339398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 msgr2=0x7f9e84107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:28.665 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.280+0000 7f9e89fcd640 1 --2- 172.21.15.152:0/1728339398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e84107cc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009820 tx=0x7f9e7402a270 comp rx=0 tx=0).stop 2024-09-11T21:55:28.665 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.280+0000 7f9e89fcd640 1 -- 172.21.15.152:0/1728339398 shutdown_connections 2024-09-11T21:55:28.665 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.280+0000 7f9e89fcd640 1 --2- 172.21.15.152:0/1728339398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e84107cc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.280+0000 7f9e89fcd640 1 -- 172.21.15.152:0/1728339398 >> 172.21.15.152:0/1728339398 conn(0x7f9e841030b0 msgr2=0x7f9e841054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.280+0000 7f9e89fcd640 1 -- 172.21.15.152:0/1728339398 shutdown_connections 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.280+0000 7f9e89fcd640 1 -- 172.21.15.152:0/1728339398 wait complete. 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.280+0000 7f9e89fcd640 1 Processor -- start 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.280+0000 7f9e89fcd640 1 -- start start 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.280+0000 7f9e89fcd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e8419b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.280+0000 7f9e89fcd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8410be70 con 0x7f9e841078c0 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.281+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e8419b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.281+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e8419b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46356/0 (socket says 172.21.15.152:46356) 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.281+0000 7f9e837fe640 1 -- 172.21.15.152:0/2570193960 learned_addr learned my addr 172.21.15.152:0/2570193960 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.281+0000 7f9e837fe640 1 -- 172.21.15.152:0/2570193960 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8419be20 con 0x7f9e841078c0 2024-09-11T21:55:28.666 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.281+0000 7f9e837fe640 1 --2- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e8419b8e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009940 tx=0x7f9e74032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.281+0000 7f9e817fa640 1 -- 172.21.15.152:0/2570193960 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e74042070 con 0x7f9e841078c0 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.281+0000 7f9e817fa640 1 -- 172.21.15.152:0/2570193960 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e740308c0 con 0x7f9e841078c0 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.281+0000 7f9e89fcd640 1 -- 172.21.15.152:0/2570193960 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8419c0b0 con 0x7f9e841078c0 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.281+0000 7f9e817fa640 1 -- 172.21.15.152:0/2570193960 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e74037040 con 0x7f9e841078c0 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.281+0000 7f9e89fcd640 1 -- 172.21.15.152:0/2570193960 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8419eda0 con 0x7f9e841078c0 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.282+0000 7f9e817fa640 1 -- 172.21.15.152:0/2570193960 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f9e74045070 con 0x7f9e841078c0 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.282+0000 7f9e89fcd640 1 -- 172.21.15.152:0/2570193960 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8410bff0 con 0x7f9e841078c0 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.282+0000 7f9e817fa640 1 --2- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f9e70038f70 0x7f9e7003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.283+0000 7f9e817fa640 1 -- 172.21.15.152:0/2570193960 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9e7406bff0 con 0x7f9e841078c0 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.282+0000 7f9e7bfff640 1 -- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f9e70038f70 msgr2=0x7f9e7003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1349026414 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.283+0000 7f9e7bfff640 1 --2- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f9e70038f70 0x7f9e7003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T21:55:28.667 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.287+0000 7f9e817fa640 1 -- 172.21.15.152:0/2570193960 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e7402fd90 con 0x7f9e841078c0 2024-09-11T21:55:28.668 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.484+0000 7f9e7bfff640 1 -- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f9e70038f70 msgr2=0x7f9e7003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1349026414 2024-09-11T21:55:28.668 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.484+0000 7f9e7bfff640 1 --2- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f9e70038f70 0x7f9e7003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T21:55:28.668 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.507+0000 7f9e89fcd640 1 -- 172.21.15.152:0/2570193960 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f9e8419f410 con 0x7f9e841078c0 2024-09-11T21:55:28.668 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.507+0000 7f9e817fa640 1 -- 172.21.15.152:0/2570193960 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f9e740327b0 con 0x7f9e841078c0 2024-09-11T21:55:28.668 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.509+0000 7f9e89fcd640 1 -- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f9e70038f70 msgr2=0x7f9e7003b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T21:55:28.668 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.509+0000 7f9e89fcd640 1 --2- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f9e70038f70 0x7f9e7003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:28.668 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.509+0000 7f9e89fcd640 1 -- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 msgr2=0x7f9e8419b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:28.668 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.509+0000 7f9e89fcd640 1 --2- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e8419b8e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009940 tx=0x7f9e74032ce0 comp rx=0 tx=0).stop 2024-09-11T21:55:28.668 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.509+0000 7f9e89fcd640 1 -- 172.21.15.152:0/2570193960 shutdown_connections 2024-09-11T21:55:28.669 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.509+0000 7f9e89fcd640 1 --2- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f9e70038f70 0x7f9e7003b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:28.669 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.509+0000 7f9e89fcd640 1 --2- 172.21.15.152:0/2570193960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e841078c0 0x7f9e8419b8e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:28.669 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.509+0000 7f9e89fcd640 1 -- 172.21.15.152:0/2570193960 >> 172.21.15.152:0/2570193960 conn(0x7f9e841030b0 msgr2=0x7f9e84103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:28.669 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.509+0000 7f9e89fcd640 1 -- 172.21.15.152:0/2570193960 shutdown_connections 2024-09-11T21:55:28.669 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:26.509+0000 7f9e89fcd640 1 -- 172.21.15.152:0/2570193960 wait complete. 2024-09-11T21:55:28.669 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for the mgr to restart... 2024-09-11T21:55:28.669 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mgr epoch 5... 2024-09-11T21:55:28.838 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:28.549+0000 7f45f944c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T21:55:28.838 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:28.613+0000 7f45f944c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T21:55:28.838 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:28.767+0000 7f45f944c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T21:55:28.838 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:28.837+0000 7f45f944c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T21:55:29.097 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:28.898+0000 7f45f944c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T21:55:29.097 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:29.062+0000 7f45f944c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T21:55:29.399 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:29.132+0000 7f45f944c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T21:55:29.399 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:29.198+0000 7f45f944c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T21:55:29.399 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:29.280+0000 7f45f944c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T21:55:29.399 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:29.340+0000 7f45f944c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T21:55:29.400 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:29.398+0000 7f45f944c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T21:55:30.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:30.177+0000 7f45f944c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T21:55:30.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: Active manager daemon x restarted 2024-09-11T21:55:30.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: Activating manager daemon x 2024-09-11T21:55:30.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: osdmap e2: 0 total, 0 up, 0 in 2024-09-11T21:55:30.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: mgrmap e6: x(active, starting, since 0.00399409s) 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: Manager daemon x is now available 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T21:55:30.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:30 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T21:55:31.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-mon[31188]: Found migration_current of "None". Setting to last migration. 2024-09-11T21:55:31.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:31.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:31.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-mon[31188]: mgrmap e7: x(active, since 1.00596s) 2024-09-11T21:55:31.739 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2024-09-11T21:55:31.739 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-11T21:55:31.739 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T21:55:31.739 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2024-09-11T21:55:31.739 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.096+0000 7f0adc1b2640 1 Processor -- start 2024-09-11T21:55:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.096+0000 7f0adc1b2640 1 -- start start 2024-09-11T21:55:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.097+0000 7f0adc1b2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad4107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.097+0000 7f0adc1b2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad4108320 con 0x7f0ad4107950 2024-09-11T21:55:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.097+0000 7f0ad9f4e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad4107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.097+0000 7f0ad9f4e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad4107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46368/0 (socket says 172.21.15.152:46368) 2024-09-11T21:55:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.097+0000 7f0ad9f4e640 1 -- 172.21.15.152:0/1757865207 learned_addr learned my addr 172.21.15.152:0/1757865207 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.097+0000 7f0ad9f4e640 1 -- 172.21.15.152:0/1757865207 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad4108b00 con 0x7f0ad4107950 2024-09-11T21:55:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.098+0000 7f0ad9f4e640 1 --2- 172.21.15.152:0/1757865207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad4107d50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009820 tx=0x7f0ad002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d4bec92b23c210 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.098+0000 7f0ad8f4c640 1 -- 172.21.15.152:0/1757865207 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad0037070 con 0x7f0ad4107950 2024-09-11T21:55:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.098+0000 7f0ad8f4c640 1 -- 172.21.15.152:0/1757865207 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ad0032900 con 0x7f0ad4107950 2024-09-11T21:55:31.741 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.098+0000 7f0ad8f4c640 1 -- 172.21.15.152:0/1757865207 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad0030850 con 0x7f0ad4107950 2024-09-11T21:55:31.741 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.099+0000 7f0adc1b2640 1 -- 172.21.15.152:0/1757865207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 msgr2=0x7f0ad4107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:31.741 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.099+0000 7f0adc1b2640 1 --2- 172.21.15.152:0/1757865207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad4107d50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009820 tx=0x7f0ad002a270 comp rx=0 tx=0).stop 2024-09-11T21:55:31.741 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.099+0000 7f0adc1b2640 1 -- 172.21.15.152:0/1757865207 shutdown_connections 2024-09-11T21:55:31.741 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.099+0000 7f0adc1b2640 1 --2- 172.21.15.152:0/1757865207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad4107d50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:31.741 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.099+0000 7f0adc1b2640 1 -- 172.21.15.152:0/1757865207 >> 172.21.15.152:0/1757865207 conn(0x7f0ad4103120 msgr2=0x7f0ad4105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:31.741 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.099+0000 7f0adc1b2640 1 -- 172.21.15.152:0/1757865207 shutdown_connections 2024-09-11T21:55:31.741 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.099+0000 7f0adc1b2640 1 -- 172.21.15.152:0/1757865207 wait complete. 2024-09-11T21:55:31.741 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.100+0000 7f0adc1b2640 1 Processor -- start 2024-09-11T21:55:31.741 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.100+0000 7f0adc1b2640 1 -- start start 2024-09-11T21:55:31.741 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.100+0000 7f0adc1b2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:31.742 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.100+0000 7f0adc1b2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad410beb0 con 0x7f0ad4107950 2024-09-11T21:55:31.742 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.100+0000 7f0ad9f4e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:31.742 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.100+0000 7f0ad9f4e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad419b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46372/0 (socket says 172.21.15.152:46372) 2024-09-11T21:55:31.742 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.100+0000 7f0ad9f4e640 1 -- 172.21.15.152:0/3911505151 learned_addr learned my addr 172.21.15.152:0/3911505151 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:31.742 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.100+0000 7f0ad9f4e640 1 -- 172.21.15.152:0/3911505151 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad419bdf0 con 0x7f0ad4107950 2024-09-11T21:55:31.742 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.101+0000 7f0ad9f4e640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad419b8b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009940 tx=0x7f0ad0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:31.742 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.101+0000 7f0ac6ffd640 1 -- 172.21.15.152:0/3911505151 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad0042070 con 0x7f0ad4107950 2024-09-11T21:55:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.101+0000 7f0ac6ffd640 1 -- 172.21.15.152:0/3911505151 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ad00308c0 con 0x7f0ad4107950 2024-09-11T21:55:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.101+0000 7f0adc1b2640 1 -- 172.21.15.152:0/3911505151 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad419c080 con 0x7f0ad4107950 2024-09-11T21:55:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.101+0000 7f0adc1b2640 1 -- 172.21.15.152:0/3911505151 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad419ed70 con 0x7f0ad4107950 2024-09-11T21:55:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.101+0000 7f0ac6ffd640 1 -- 172.21.15.152:0/3911505151 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad0037040 con 0x7f0ad4107950 2024-09-11T21:55:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.102+0000 7f0ac6ffd640 1 -- 172.21.15.152:0/3911505151 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f0ad0045070 con 0x7f0ad4107950 2024-09-11T21:55:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.102+0000 7f0ac6ffd640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f0ac0038f70 0x7f0ac003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.102+0000 7f0adc1b2640 1 -- 172.21.15.152:0/3911505151 --> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0ab8000d40 con 0x7f0ac0038f70 2024-09-11T21:55:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.102+0000 7f0ac6ffd640 1 -- 172.21.15.152:0/3911505151 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0ad006bfa0 con 0x7f0ad4107950 2024-09-11T21:55:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.102+0000 7f0ad974d640 1 -- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f0ac0038f70 msgr2=0x7f0ac003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1349026414 2024-09-11T21:55:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.102+0000 7f0ad974d640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f0ac0038f70 0x7f0ac003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T21:55:31.744 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.303+0000 7f0ad974d640 1 -- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f0ac0038f70 msgr2=0x7f0ac003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1349026414 2024-09-11T21:55:31.744 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.303+0000 7f0ad974d640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f0ac0038f70 0x7f0ac003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T21:55:31.744 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.704+0000 7f0ad974d640 1 -- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f0ac0038f70 msgr2=0x7f0ac003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1349026414 2024-09-11T21:55:31.744 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:29.704+0000 7f0ad974d640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f0ac0038f70 0x7f0ac003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T21:55:31.744 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:30.181+0000 7f0ac6ffd640 1 -- 172.21.15.152:0/3911505151 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f0ad006ab20 con 0x7f0ad4107950 2024-09-11T21:55:31.744 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:30.181+0000 7f0ac6ffd640 1 -- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f0ac0038f70 msgr2=0x7f0ac003b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T21:55:31.744 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:30.181+0000 7f0ac6ffd640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f0ac0038f70 0x7f0ac003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:31.744 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.182+0000 7f0ac6ffd640 1 -- 172.21.15.152:0/3911505151 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f0ad006dc50 con 0x7f0ad4107950 2024-09-11T21:55:31.744 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.182+0000 7f0ac6ffd640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f0ac003c6b0 0x7f0ac003eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.182+0000 7f0ac6ffd640 1 -- 172.21.15.152:0/3911505151 --> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0ab8000d40 con 0x7f0ac003c6b0 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.182+0000 7f0ad974d640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f0ac003c6b0 0x7f0ac003eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.183+0000 7f0ad974d640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f0ac003c6b0 0x7f0ac003eaa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8006fd0 tx=0x7f0ac8006dc0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.184+0000 7f0ac6ffd640 1 -- 172.21.15.152:0/3911505151 <== mgr.14116 v2:172.21.15.152:6800/1144560416 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f0ab8000d40 con 0x7f0ac003c6b0 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.190+0000 7f0adc1b2640 1 -- 172.21.15.152:0/3911505151 --> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f0ab80027b0 con 0x7f0ac003c6b0 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0ac6ffd640 1 -- 172.21.15.152:0/3911505151 <== mgr.14116 v2:172.21.15.152:6800/1144560416 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f0ab80027b0 con 0x7f0ac003c6b0 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0adc1b2640 1 -- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f0ac003c6b0 msgr2=0x7f0ac003eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0adc1b2640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f0ac003c6b0 0x7f0ac003eaa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8006fd0 tx=0x7f0ac8006dc0 comp rx=0 tx=0).stop 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0adc1b2640 1 -- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 msgr2=0x7f0ad419b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0adc1b2640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad419b8b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009940 tx=0x7f0ad0032ce0 comp rx=0 tx=0).stop 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0adc1b2640 1 -- 172.21.15.152:0/3911505151 shutdown_connections 2024-09-11T21:55:31.745 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0adc1b2640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f0ac003c6b0 0x7f0ac003eaa0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:31.746 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0adc1b2640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:6800/1349026414,v1:172.21.15.152:6801/1349026414] conn(0x7f0ac0038f70 0x7f0ac003b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:31.746 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0adc1b2640 1 --2- 172.21.15.152:0/3911505151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ad4107950 0x7f0ad419b8b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:31.746 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0adc1b2640 1 -- 172.21.15.152:0/3911505151 >> 172.21.15.152:0/3911505151 conn(0x7f0ad4103120 msgr2=0x7f0ad4103cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:31.746 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0adc1b2640 1 -- 172.21.15.152:0/3911505151 shutdown_connections 2024-09-11T21:55:31.746 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:31.191+0000 7f0adc1b2640 1 -- 172.21.15.152:0/3911505151 wait complete. 2024-09-11T21:55:31.746 INFO:teuthology.orchestra.run.smithi152.stdout:mgr epoch 5 is available 2024-09-11T21:55:31.746 INFO:teuthology.orchestra.run.smithi152.stdout:Setting orchestrator backend to cephadm... 2024-09-11T21:55:32.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:31.846+0000 7f45607a6640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:21:55:31] ENGINE Error in HTTPServer.serve 2024-09-11T21:55:32.230 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: Traceback (most recent call last): 2024-09-11T21:55:32.231 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T21:55:32.231 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self._connections.run(self.expiration_interval) 2024-09-11T21:55:32.231 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T21:55:32.231 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self._run(expiration_interval) 2024-09-11T21:55:32.231 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T21:55:32.231 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T21:55:32.231 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T21:55:32.231 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T21:55:32.231 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T21:55:32.231 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: s = self.context.wrap_socket( 2024-09-11T21:55:32.232 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T21:55:32.232 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: return self.sslsocket_class._create( 2024-09-11T21:55:32.232 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T21:55:32.232 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self.do_handshake() 2024-09-11T21:55:32.232 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T21:55:32.232 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self._sslobj.do_handshake() 2024-09-11T21:55:32.232 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T21:55:32.232 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:32.606 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:32 smithi152 ceph-mon[31188]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T21:55:32.607 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:32 smithi152 ceph-mon[31188]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T21:55:32.607 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:32 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:55:33.203 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.417+0000 7f48c7e5c640 1 Processor -- start 2024-09-11T21:55:33.203 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.417+0000 7f48c7e5c640 1 -- start start 2024-09-11T21:55:33.203 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.417+0000 7f48c7e5c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c0107cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:33.203 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.417+0000 7f48c7e5c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f48c01082a0 con 0x7f48c01078d0 2024-09-11T21:55:33.203 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.417+0000 7f48c5bf8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c0107cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:33.203 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.417+0000 7f48c5bf8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c0107cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46448/0 (socket says 172.21.15.152:46448) 2024-09-11T21:55:33.203 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.417+0000 7f48c5bf8640 1 -- 172.21.15.152:0/3731720745 learned_addr learned my addr 172.21.15.152:0/3731720745 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:33.203 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.418+0000 7f48c5bf8640 1 -- 172.21.15.152:0/3731720745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c0108ad0 con 0x7f48c01078d0 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.418+0000 7f48c5bf8640 1 --2- 172.21.15.152:0/3731720745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c0107cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009e80 tx=0x7f48b002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58b7698f803ee59 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.418+0000 7f48c4bf6640 1 -- 172.21.15.152:0/3731720745 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b0036070 con 0x7f48c01078d0 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.418+0000 7f48c4bf6640 1 -- 172.21.15.152:0/3731720745 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f48b00318c0 con 0x7f48c01078d0 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.418+0000 7f48c4bf6640 1 -- 172.21.15.152:0/3731720745 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b0007ab0 con 0x7f48c01078d0 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.419+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3731720745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 msgr2=0x7f48c0107cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.419+0000 7f48c7e5c640 1 --2- 172.21.15.152:0/3731720745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c0107cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009e80 tx=0x7f48b002a7a0 comp rx=0 tx=0).stop 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.419+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3731720745 shutdown_connections 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.419+0000 7f48c7e5c640 1 --2- 172.21.15.152:0/3731720745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c0107cd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.419+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3731720745 >> 172.21.15.152:0/3731720745 conn(0x7f48c0103060 msgr2=0x7f48c01054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.419+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3731720745 shutdown_connections 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.419+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3731720745 wait complete. 2024-09-11T21:55:33.204 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.420+0000 7f48c7e5c640 1 Processor -- start 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.420+0000 7f48c7e5c640 1 -- start start 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.420+0000 7f48c7e5c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.420+0000 7f48c7e5c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f48c010be80 con 0x7f48c01078d0 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.420+0000 7f48c5bf8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.420+0000 7f48c5bf8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c019b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46454/0 (socket says 172.21.15.152:46454) 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.420+0000 7f48c5bf8640 1 -- 172.21.15.152:0/3866223409 learned_addr learned my addr 172.21.15.152:0/3866223409 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.420+0000 7f48c5bf8640 1 -- 172.21.15.152:0/3866223409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c019be30 con 0x7f48c01078d0 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.421+0000 7f48c5bf8640 1 --2- 172.21.15.152:0/3866223409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c019b8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f48b002ad90 tx=0x7f48b0031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.421+0000 7f48beffd640 1 -- 172.21.15.152:0/3866223409 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b0036050 con 0x7f48c01078d0 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.421+0000 7f48beffd640 1 -- 172.21.15.152:0/3866223409 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f48b0042070 con 0x7f48c01078d0 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.421+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3866223409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c019c0c0 con 0x7f48c01078d0 2024-09-11T21:55:33.205 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.421+0000 7f48beffd640 1 -- 172.21.15.152:0/3866223409 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b003d7e0 con 0x7f48c01078d0 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.421+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3866223409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c019edb0 con 0x7f48c01078d0 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.422+0000 7f48beffd640 1 -- 172.21.15.152:0/3866223409 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f48b003da90 con 0x7f48c01078d0 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.422+0000 7f48beffd640 1 --2- 172.21.15.152:0/3866223409 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f48a8038fc0 0x7f48a803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.422+0000 7f48beffd640 1 -- 172.21.15.152:0/3866223409 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f48b0007e00 con 0x7f48c01078d0 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.422+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3866223409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c010c000 con 0x7f48c01078d0 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.422+0000 7f48c53f7640 1 --2- 172.21.15.152:0/3866223409 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f48a8038fc0 0x7f48a803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.422+0000 7f48c53f7640 1 --2- 172.21.15.152:0/3866223409 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f48a8038fc0 0x7f48a803b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48b40098c0 tx=0x7f48b4006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.427+0000 7f48beffd640 1 -- 172.21.15.152:0/3866223409 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f48b0039de0 con 0x7f48c01078d0 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.605+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3866223409 --> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f48c0104330 con 0x7f48a8038fc0 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.610+0000 7f48beffd640 1 -- 172.21.15.152:0/3866223409 <== mgr.14116 v2:172.21.15.152:6800/1144560416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f48c0104330 con 0x7f48a8038fc0 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.612+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3866223409 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f48a8038fc0 msgr2=0x7f48a803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:33.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.612+0000 7f48c7e5c640 1 --2- 172.21.15.152:0/3866223409 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f48a8038fc0 0x7f48a803b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48b40098c0 tx=0x7f48b4006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:33.207 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.612+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3866223409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 msgr2=0x7f48c019b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:33.207 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.612+0000 7f48c7e5c640 1 --2- 172.21.15.152:0/3866223409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c019b8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f48b002ad90 tx=0x7f48b0031ca0 comp rx=0 tx=0).stop 2024-09-11T21:55:33.207 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.613+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3866223409 shutdown_connections 2024-09-11T21:55:33.207 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.613+0000 7f48c7e5c640 1 --2- 172.21.15.152:0/3866223409 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f48a8038fc0 0x7f48a803b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:33.207 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.613+0000 7f48c7e5c640 1 --2- 172.21.15.152:0/3866223409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48c01078d0 0x7f48c019b8f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:33.207 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.613+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3866223409 >> 172.21.15.152:0/3866223409 conn(0x7f48c0103060 msgr2=0x7f48c0103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:33.207 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.613+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3866223409 shutdown_connections 2024-09-11T21:55:33.207 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:32.613+0000 7f48c7e5c640 1 -- 172.21.15.152:0/3866223409 wait complete. 2024-09-11T21:55:33.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:33 smithi152 ceph-mon[31188]: [11/Sep/2024:21:55:31] ENGINE Bus STARTING 2024-09-11T21:55:33.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:33 smithi152 ceph-mon[31188]: [11/Sep/2024:21:55:31] ENGINE Serving on http://172.21.15.152:8765 2024-09-11T21:55:33.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:33 smithi152 ceph-mon[31188]: [11/Sep/2024:21:55:31] ENGINE Serving on https://172.21.15.152:7150 2024-09-11T21:55:33.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:33 smithi152 ceph-mon[31188]: [11/Sep/2024:21:55:31] ENGINE Bus STARTED 2024-09-11T21:55:33.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:33 smithi152 ceph-mon[31188]: [11/Sep/2024:21:55:31] ENGINE Error in HTTPServer.serve 2024-09-11T21:55:33.480 INFO:journalctl@ceph.mon.a.smithi152.stdout: Traceback (most recent call last): 2024-09-11T21:55:33.480 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T21:55:33.480 INFO:journalctl@ceph.mon.a.smithi152.stdout: self._connections.run(self.expiration_interval) 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: self._run(expiration_interval) 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: s = self.context.wrap_socket( 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: return self.sslsocket_class._create( 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: self.do_handshake() 2024-09-11T21:55:33.481 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T21:55:33.482 INFO:journalctl@ceph.mon.a.smithi152.stdout: self._sslobj.do_handshake() 2024-09-11T21:55:33.482 INFO:journalctl@ceph.mon.a.smithi152.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T21:55:33.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:33 smithi152 ceph-mon[31188]: mgrmap e8: x(active, since 2s) 2024-09-11T21:55:33.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:33 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:33.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:33 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:55:34.294 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-11T21:55:34.294 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.592+0000 7f43a006b640 1 Processor -- start 2024-09-11T21:55:34.294 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.592+0000 7f43a006b640 1 -- start start 2024-09-11T21:55:34.294 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.592+0000 7f43a006b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439807c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:34.294 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.592+0000 7f43a006b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f439807c7f0 con 0x7f439807de00 2024-09-11T21:55:34.294 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.592+0000 7f439de07640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439807c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:34.294 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.592+0000 7f439de07640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439807c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40768/0 (socket says 172.21.15.152:40768) 2024-09-11T21:55:34.294 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.592+0000 7f439de07640 1 -- 172.21.15.152:0/1240807178 learned_addr learned my addr 172.21.15.152:0/1240807178 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.593+0000 7f439de07640 1 -- 172.21.15.152:0/1240807178 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439807c970 con 0x7f439807de00 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.593+0000 7f439de07640 1 --2- 172.21.15.152:0/1240807178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439807c2b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4394009820 tx=0x7f439402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1363a9679aed06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.593+0000 7f439ce05640 1 -- 172.21.15.152:0/1240807178 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4394037070 con 0x7f439807de00 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.593+0000 7f439ce05640 1 -- 172.21.15.152:0/1240807178 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4394032900 con 0x7f439807de00 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.593+0000 7f439ce05640 1 -- 172.21.15.152:0/1240807178 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4394030850 con 0x7f439807de00 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.594+0000 7f43a006b640 1 -- 172.21.15.152:0/1240807178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 msgr2=0x7f439807c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.594+0000 7f43a006b640 1 --2- 172.21.15.152:0/1240807178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439807c2b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4394009820 tx=0x7f439402a270 comp rx=0 tx=0).stop 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.594+0000 7f43a006b640 1 -- 172.21.15.152:0/1240807178 shutdown_connections 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.594+0000 7f43a006b640 1 --2- 172.21.15.152:0/1240807178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439807c2b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.594+0000 7f43a006b640 1 -- 172.21.15.152:0/1240807178 >> 172.21.15.152:0/1240807178 conn(0x7f4398103110 msgr2=0x7f4398105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.594+0000 7f43a006b640 1 -- 172.21.15.152:0/1240807178 shutdown_connections 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.594+0000 7f43a006b640 1 -- 172.21.15.152:0/1240807178 wait complete. 2024-09-11T21:55:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.595+0000 7f43a006b640 1 Processor -- start 2024-09-11T21:55:34.296 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.595+0000 7f43a006b640 1 -- start start 2024-09-11T21:55:34.296 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.595+0000 7f43a006b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439819dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:34.296 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.595+0000 7f43a006b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f439810df50 con 0x7f439807de00 2024-09-11T21:55:34.296 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.595+0000 7f439de07640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439819dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:34.296 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.595+0000 7f439de07640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439819dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40778/0 (socket says 172.21.15.152:40778) 2024-09-11T21:55:34.296 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.595+0000 7f439de07640 1 -- 172.21.15.152:0/2495855750 learned_addr learned my addr 172.21.15.152:0/2495855750 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:34.296 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.595+0000 7f439de07640 1 -- 172.21.15.152:0/2495855750 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439819e020 con 0x7f439807de00 2024-09-11T21:55:34.296 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.595+0000 7f439de07640 1 --2- 172.21.15.152:0/2495855750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439819dae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43940097f0 tx=0x7f4394032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:34.296 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.595+0000 7f438effd640 1 -- 172.21.15.152:0/2495855750 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4394042070 con 0x7f439807de00 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.596+0000 7f43a006b640 1 -- 172.21.15.152:0/2495855750 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f439819e2b0 con 0x7f439807de00 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.596+0000 7f438effd640 1 -- 172.21.15.152:0/2495855750 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f439403ba10 con 0x7f439807de00 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.596+0000 7f438effd640 1 -- 172.21.15.152:0/2495855750 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4394037070 con 0x7f439807de00 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.596+0000 7f43a006b640 1 -- 172.21.15.152:0/2495855750 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43981a0fa0 con 0x7f439807de00 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.596+0000 7f438effd640 1 -- 172.21.15.152:0/2495855750 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4394045070 con 0x7f439807de00 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.597+0000 7f438effd640 1 --2- 172.21.15.152:0/2495855750 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f4384038f70 0x7f438403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.597+0000 7f43a006b640 1 -- 172.21.15.152:0/2495855750 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f439807c330 con 0x7f439807de00 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.597+0000 7f438effd640 1 -- 172.21.15.152:0/2495855750 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f439406be80 con 0x7f439807de00 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.597+0000 7f439d606640 1 --2- 172.21.15.152:0/2495855750 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f4384038f70 0x7f438403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.597+0000 7f439d606640 1 --2- 172.21.15.152:0/2495855750 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f4384038f70 0x7f438403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f43880098c0 tx=0x7f4388006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.601+0000 7f438effd640 1 -- 172.21.15.152:0/2495855750 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f439402e200 con 0x7f439807de00 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.768+0000 7f43a006b640 1 -- 172.21.15.152:0/2495855750 --> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f43981043d0 con 0x7f4384038f70 2024-09-11T21:55:34.297 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.769+0000 7f438effd640 1 -- 172.21.15.152:0/2495855750 <== mgr.14116 v2:172.21.15.152:6800/1144560416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f43981043d0 con 0x7f4384038f70 2024-09-11T21:55:34.298 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.772+0000 7f43a006b640 1 -- 172.21.15.152:0/2495855750 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f4384038f70 msgr2=0x7f438403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:34.298 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.772+0000 7f43a006b640 1 --2- 172.21.15.152:0/2495855750 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f4384038f70 0x7f438403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f43880098c0 tx=0x7f4388006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:34.298 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.772+0000 7f43a006b640 1 -- 172.21.15.152:0/2495855750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 msgr2=0x7f439819dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:34.298 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.772+0000 7f43a006b640 1 --2- 172.21.15.152:0/2495855750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439819dae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43940097f0 tx=0x7f4394032ce0 comp rx=0 tx=0).stop 2024-09-11T21:55:34.298 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.772+0000 7f43a006b640 1 -- 172.21.15.152:0/2495855750 shutdown_connections 2024-09-11T21:55:34.298 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.772+0000 7f43a006b640 1 --2- 172.21.15.152:0/2495855750 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f4384038f70 0x7f438403b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:34.298 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.772+0000 7f43a006b640 1 --2- 172.21.15.152:0/2495855750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439807de00 0x7f439819dae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:34.298 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.772+0000 7f43a006b640 1 -- 172.21.15.152:0/2495855750 >> 172.21.15.152:0/2495855750 conn(0x7f4398103110 msgr2=0x7f4398103cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:34.298 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.772+0000 7f43a006b640 1 -- 172.21.15.152:0/2495855750 shutdown_connections 2024-09-11T21:55:34.298 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:33.772+0000 7f43a006b640 1 -- 172.21.15.152:0/2495855750 wait complete. 2024-09-11T21:55:34.299 INFO:teuthology.orchestra.run.smithi152.stdout:Generating ssh key... 2024-09-11T21:55:34.410 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:34 smithi152 ceph-mon[31188]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:55:35.416 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-mon[31188]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:55:35.417 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:35.417 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:35.417 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: Generating public/private rsa key pair. 2024-09-11T21:55:35.417 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: Your identification has been saved in /tmp/tmpx3b34319/key 2024-09-11T21:55:35.417 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: Your public key has been saved in /tmp/tmpx3b34319/key.pub 2024-09-11T21:55:35.417 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: The key fingerprint is: 2024-09-11T21:55:35.417 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: SHA256:Eqd5c+kuJ8pPVPzyqBABhTKT1fZZ2ZZG8j/syCVFscw ceph-5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: The key's randomart image is: 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: +---[RSA 3072]----+ 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: | oo+. .+..o. | 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: | = ..o .oo=+ . | 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: | + .o..ooo. E | 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: | *o. o + | 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: | = S + o = | 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: | = + = = . | 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: | . . o + . | 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: | . ooo. | 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: | ooo+. | 2024-09-11T21:55:35.418 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: +----[SHA256]-----+ 2024-09-11T21:55:35.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.698+0000 7f344378e640 1 Processor -- start 2024-09-11T21:55:35.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.698+0000 7f344378e640 1 -- start start 2024-09-11T21:55:35.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.698+0000 7f344378e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c10a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:35.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.698+0000 7f344378e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f343c07bea0 con 0x7f343c108340 2024-09-11T21:55:35.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.698+0000 7f344152a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c10a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:35.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.698+0000 7f344152a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c10a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40788/0 (socket says 172.21.15.152:40788) 2024-09-11T21:55:35.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.698+0000 7f344152a640 1 -- 172.21.15.152:0/3987195345 learned_addr learned my addr 172.21.15.152:0/3987195345 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:35.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.699+0000 7f344152a640 1 -- 172.21.15.152:0/3987195345 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c10ac70 con 0x7f343c108340 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.699+0000 7f344152a640 1 --2- 172.21.15.152:0/3987195345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c10a730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3438009820 tx=0x7f343802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92129d4dc00d13f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.699+0000 7f3433fff640 1 -- 172.21.15.152:0/3987195345 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3438037070 con 0x7f343c108340 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.699+0000 7f3433fff640 1 -- 172.21.15.152:0/3987195345 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3438032900 con 0x7f343c108340 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.699+0000 7f3433fff640 1 -- 172.21.15.152:0/3987195345 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3438030850 con 0x7f343c108340 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.700+0000 7f344378e640 1 -- 172.21.15.152:0/3987195345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 msgr2=0x7f343c10a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.700+0000 7f344378e640 1 --2- 172.21.15.152:0/3987195345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c10a730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3438009820 tx=0x7f343802a270 comp rx=0 tx=0).stop 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.700+0000 7f344378e640 1 -- 172.21.15.152:0/3987195345 shutdown_connections 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.700+0000 7f344378e640 1 --2- 172.21.15.152:0/3987195345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c10a730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.700+0000 7f344378e640 1 -- 172.21.15.152:0/3987195345 >> 172.21.15.152:0/3987195345 conn(0x7f343c101fe0 msgr2=0x7f343c104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.700+0000 7f344378e640 1 -- 172.21.15.152:0/3987195345 shutdown_connections 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.700+0000 7f344378e640 1 -- 172.21.15.152:0/3987195345 wait complete. 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.701+0000 7f344378e640 1 Processor -- start 2024-09-11T21:55:35.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.701+0000 7f344378e640 1 -- start start 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.701+0000 7f344378e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.701+0000 7f344378e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f343c10bd10 con 0x7f343c108340 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.701+0000 7f344152a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.701+0000 7f344152a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c19b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40792/0 (socket says 172.21.15.152:40792) 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.701+0000 7f344152a640 1 -- 172.21.15.152:0/99741385 learned_addr learned my addr 172.21.15.152:0/99741385 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.701+0000 7f344152a640 1 -- 172.21.15.152:0/99741385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c19bdd0 con 0x7f343c108340 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.701+0000 7f344152a640 1 --2- 172.21.15.152:0/99741385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c19b890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f34380097f0 tx=0x7f3438030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.702+0000 7f34327fc640 1 -- 172.21.15.152:0/99741385 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3438037040 con 0x7f343c108340 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.702+0000 7f34327fc640 1 -- 172.21.15.152:0/99741385 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3438040070 con 0x7f343c108340 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.702+0000 7f34327fc640 1 -- 172.21.15.152:0/99741385 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f343803a390 con 0x7f343c108340 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.702+0000 7f344378e640 1 -- 172.21.15.152:0/99741385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c19c060 con 0x7f343c108340 2024-09-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.702+0000 7f344378e640 1 -- 172.21.15.152:0/99741385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c19ed50 con 0x7f343c108340 2024-09-11T21:55:35.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.702+0000 7f34327fc640 1 -- 172.21.15.152:0/99741385 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f343803a630 con 0x7f343c108340 2024-09-11T21:55:35.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.703+0000 7f34327fc640 1 --2- 172.21.15.152:0/99741385 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f3428038f70 0x7f342803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:35.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.703+0000 7f34327fc640 1 -- 172.21.15.152:0/99741385 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f343806c4c0 con 0x7f343c108340 2024-09-11T21:55:35.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.703+0000 7f344378e640 1 -- 172.21.15.152:0/99741385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343c1087a0 con 0x7f343c108340 2024-09-11T21:55:35.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.703+0000 7f3440d29640 1 --2- 172.21.15.152:0/99741385 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f3428038f70 0x7f342803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:35.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.703+0000 7f3440d29640 1 --2- 172.21.15.152:0/99741385 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f3428038f70 0x7f342803b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f342c0098c0 tx=0x7f342c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:35.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.708+0000 7f34327fc640 1 -- 172.21.15.152:0/99741385 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f343804a200 con 0x7f343c108340 2024-09-11T21:55:35.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:34.873+0000 7f344378e640 1 -- 172.21.15.152:0/99741385 --> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f343c1032a0 con 0x7f3428038f70 2024-09-11T21:55:35.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:35.123+0000 7f34327fc640 1 -- 172.21.15.152:0/99741385 <== mgr.14116 v2:172.21.15.152:6800/1144560416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f343c1032a0 con 0x7f3428038f70 2024-09-11T21:55:35.714 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:35.125+0000 7f344378e640 1 -- 172.21.15.152:0/99741385 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f3428038f70 msgr2=0x7f342803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:35.714 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:35.125+0000 7f344378e640 1 --2- 172.21.15.152:0/99741385 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f3428038f70 0x7f342803b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f342c0098c0 tx=0x7f342c006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:35.714 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:35.125+0000 7f344378e640 1 -- 172.21.15.152:0/99741385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 msgr2=0x7f343c19b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:35.714 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:35.125+0000 7f344378e640 1 --2- 172.21.15.152:0/99741385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c19b890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f34380097f0 tx=0x7f3438030d80 comp rx=0 tx=0).stop 2024-09-11T21:55:35.714 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:35.125+0000 7f344378e640 1 -- 172.21.15.152:0/99741385 shutdown_connections 2024-09-11T21:55:35.714 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:35.125+0000 7f344378e640 1 --2- 172.21.15.152:0/99741385 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f3428038f70 0x7f342803b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:35.715 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:35.125+0000 7f344378e640 1 --2- 172.21.15.152:0/99741385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c108340 0x7f343c19b890 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:35.715 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:35.125+0000 7f344378e640 1 -- 172.21.15.152:0/99741385 >> 172.21.15.152:0/99741385 conn(0x7f343c101fe0 msgr2=0x7f343c102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:35.715 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:35.125+0000 7f344378e640 1 -- 172.21.15.152:0/99741385 shutdown_connections 2024-09-11T21:55:35.715 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:35.125+0000 7f344378e640 1 -- 172.21.15.152:0/99741385 wait complete. 2024-09-11T21:55:36.261 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:36 smithi152 ceph-mon[31188]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:55:36.261 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:36 smithi152 ceph-mon[31188]: Generating ssh key... 2024-09-11T21:55:36.835 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAzbvHCBvsyMvb0JGcrTZ8GtnOdzBVSxXCEDyGh8vHJO2KfkL8rk1PSpkBZGoLcWMwI8HHTV736rnpkMFZ4XxG6JoGi5/VVl6Mom0Mepa2dAliorO1/slducf3xZCQxmQk2aG5af5TybKoZd9ksiUb+Eo9GteQxEFsWBCcYB3xRy6Vy9i8cn+dmpAk/y2fZYaPwsZJZTiDSgy3gtm52pAlnNbJcNSPFrHjxdjBDbSs7OzsAAjzgXxkaN2bpsKxtZ5OixYekviaE8nRbB1Ml3tWM34vGx032RVbvkrNfCTQREgrpEY7SuDiVzhlthxSdA0NZThwtFRPJobn9LO0SnVjaKGdJZth2yyGCQN806f6VPkzyzviDz/XknLdXgSSSN0EAmVZ8TXYSg8a/uostKkCsidJRV9DgOogBW/phxDP8E9IAr6+AEGbpJSl3hOi0cyIlFjmUxFUz80PtGlcGUjHsvDI8SdVJP4wdDMDwQnqUmLCqbcIkUGOY3PRKd5UYm8= ceph-5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:55:36.835 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.083+0000 7fa40e39a640 1 Processor -- start 2024-09-11T21:55:36.835 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.083+0000 7fa40e39a640 1 -- start start 2024-09-11T21:55:36.835 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.084+0000 7fa40e39a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40810a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:36.835 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.084+0000 7fa40e39a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa40807be60 con 0x7fa408108350 2024-09-11T21:55:36.835 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.084+0000 7fa407fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40810a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:36.835 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.084+0000 7fa407fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40810a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40804/0 (socket says 172.21.15.152:40804) 2024-09-11T21:55:36.835 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.084+0000 7fa407fff640 1 -- 172.21.15.152:0/1162412239 learned_addr learned my addr 172.21.15.152:0/1162412239 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.084+0000 7fa407fff640 1 -- 172.21.15.152:0/1162412239 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40810ac80 con 0x7fa408108350 2024-09-11T21:55:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.085+0000 7fa407fff640 1 --2- 172.21.15.152:0/1162412239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40810a740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009820 tx=0x7fa3f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c025dd1eeb1bdbe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.085+0000 7fa406ffd640 1 -- 172.21.15.152:0/1162412239 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3f8037070 con 0x7fa408108350 2024-09-11T21:55:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.085+0000 7fa406ffd640 1 -- 172.21.15.152:0/1162412239 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3f8032900 con 0x7fa408108350 2024-09-11T21:55:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.085+0000 7fa406ffd640 1 -- 172.21.15.152:0/1162412239 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3f8030850 con 0x7fa408108350 2024-09-11T21:55:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.085+0000 7fa40e39a640 1 -- 172.21.15.152:0/1162412239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 msgr2=0x7fa40810a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.085+0000 7fa40e39a640 1 --2- 172.21.15.152:0/1162412239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40810a740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009820 tx=0x7fa3f802a270 comp rx=0 tx=0).stop 2024-09-11T21:55:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.086+0000 7fa40e39a640 1 -- 172.21.15.152:0/1162412239 shutdown_connections 2024-09-11T21:55:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.086+0000 7fa40e39a640 1 --2- 172.21.15.152:0/1162412239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40810a740 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.086+0000 7fa40e39a640 1 -- 172.21.15.152:0/1162412239 >> 172.21.15.152:0/1162412239 conn(0x7fa408101ef0 msgr2=0x7fa408104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.086+0000 7fa40e39a640 1 -- 172.21.15.152:0/1162412239 shutdown_connections 2024-09-11T21:55:36.837 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.086+0000 7fa40e39a640 1 -- 172.21.15.152:0/1162412239 wait complete. 2024-09-11T21:55:36.837 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.086+0000 7fa40e39a640 1 Processor -- start 2024-09-11T21:55:36.837 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.086+0000 7fa40e39a640 1 -- start start 2024-09-11T21:55:36.837 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa40e39a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:36.837 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa40e39a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa40810bcc0 con 0x7fa408108350 2024-09-11T21:55:36.837 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa407fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:36.837 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa407fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40814/0 (socket says 172.21.15.152:40814) 2024-09-11T21:55:36.837 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa407fff640 1 -- 172.21.15.152:0/2327459346 learned_addr learned my addr 172.21.15.152:0/2327459346 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:36.838 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa407fff640 1 -- 172.21.15.152:0/2327459346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40819be20 con 0x7fa408108350 2024-09-11T21:55:36.838 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa407fff640 1 --2- 172.21.15.152:0/2327459346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40819b8e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80097f0 tx=0x7fa3f8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:36.838 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa4057fa640 1 -- 172.21.15.152:0/2327459346 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3f8042070 con 0x7fa408108350 2024-09-11T21:55:36.838 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa4057fa640 1 -- 172.21.15.152:0/2327459346 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3f8032ca0 con 0x7fa408108350 2024-09-11T21:55:36.838 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa40e39a640 1 -- 172.21.15.152:0/2327459346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa40819c0b0 con 0x7fa408108350 2024-09-11T21:55:36.838 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa4057fa640 1 -- 172.21.15.152:0/2327459346 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3f8037040 con 0x7fa408108350 2024-09-11T21:55:36.838 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.087+0000 7fa40e39a640 1 -- 172.21.15.152:0/2327459346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa40819eda0 con 0x7fa408108350 2024-09-11T21:55:36.838 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.088+0000 7fa4057fa640 1 -- 172.21.15.152:0/2327459346 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa3f8045070 con 0x7fa408108350 2024-09-11T21:55:36.838 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.088+0000 7fa4057fa640 1 --2- 172.21.15.152:0/2327459346 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fa3f0038f70 0x7fa3f003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:36.839 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.088+0000 7fa4057fa640 1 -- 172.21.15.152:0/2327459346 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa3f806bfa0 con 0x7fa408108350 2024-09-11T21:55:36.839 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.088+0000 7fa40e39a640 1 -- 172.21.15.152:0/2327459346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4081087b0 con 0x7fa408108350 2024-09-11T21:55:36.839 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.088+0000 7fa4077fe640 1 --2- 172.21.15.152:0/2327459346 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fa3f0038f70 0x7fa3f003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:36.839 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.089+0000 7fa4077fe640 1 --2- 172.21.15.152:0/2327459346 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fa3f0038f70 0x7fa3f003b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0098c0 tx=0x7fa3fc006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:36.839 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.093+0000 7fa4057fa640 1 -- 172.21.15.152:0/2327459346 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3f8045520 con 0x7fa408108350 2024-09-11T21:55:36.840 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.260+0000 7fa40e39a640 1 -- 172.21.15.152:0/2327459346 --> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fa408103290 con 0x7fa3f0038f70 2024-09-11T21:55:36.840 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.261+0000 7fa4057fa640 1 -- 172.21.15.152:0/2327459346 <== mgr.14116 v2:172.21.15.152:6800/1144560416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fa408103290 con 0x7fa3f0038f70 2024-09-11T21:55:36.840 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.263+0000 7fa40e39a640 1 -- 172.21.15.152:0/2327459346 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fa3f0038f70 msgr2=0x7fa3f003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:36.840 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.263+0000 7fa40e39a640 1 --2- 172.21.15.152:0/2327459346 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fa3f0038f70 0x7fa3f003b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0098c0 tx=0x7fa3fc006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:36.840 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.263+0000 7fa40e39a640 1 -- 172.21.15.152:0/2327459346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 msgr2=0x7fa40819b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:36.840 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.263+0000 7fa40e39a640 1 --2- 172.21.15.152:0/2327459346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40819b8e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80097f0 tx=0x7fa3f8030ec0 comp rx=0 tx=0).stop 2024-09-11T21:55:36.840 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.263+0000 7fa40e39a640 1 -- 172.21.15.152:0/2327459346 shutdown_connections 2024-09-11T21:55:36.840 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.263+0000 7fa40e39a640 1 --2- 172.21.15.152:0/2327459346 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fa3f0038f70 0x7fa3f003b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:36.840 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.263+0000 7fa40e39a640 1 --2- 172.21.15.152:0/2327459346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa408108350 0x7fa40819b8e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:36.840 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.263+0000 7fa40e39a640 1 -- 172.21.15.152:0/2327459346 >> 172.21.15.152:0/2327459346 conn(0x7fa408101ef0 msgr2=0x7fa408102b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:36.840 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.263+0000 7fa40e39a640 1 -- 172.21.15.152:0/2327459346 shutdown_connections 2024-09-11T21:55:36.841 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:36.263+0000 7fa40e39a640 1 -- 172.21.15.152:0/2327459346 wait complete. 2024-09-11T21:55:36.841 INFO:teuthology.orchestra.run.smithi152.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-11T21:55:36.841 INFO:teuthology.orchestra.run.smithi152.stdout:Adding key to root@localhost authorized_keys... 2024-09-11T21:55:36.841 INFO:teuthology.orchestra.run.smithi152.stdout:Adding host smithi152... 2024-09-11T21:55:37.402 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:37 smithi152 ceph-mon[31188]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:55:38.448 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:38 smithi152 ceph-mon[31188]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "addr": "172.21.15.152", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:55:38.449 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:38 smithi152 ceph-mon[31188]: Deploying cephadm binary to smithi152 2024-09-11T21:55:41.167 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Added host 'smithi152' with addr '172.21.15.152' 2024-09-11T21:55:41.167 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.224+0000 7ff318a6b640 1 Processor -- start 2024-09-11T21:55:41.167 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.224+0000 7ff318a6b640 1 -- start start 2024-09-11T21:55:41.168 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.224+0000 7ff318a6b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31407b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:41.168 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.224+0000 7ff318a6b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff31407b7b0 con 0x7ff31407cd80 2024-09-11T21:55:41.168 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.225+0000 7ff31259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31407b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:41.168 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.225+0000 7ff31259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31407b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40816/0 (socket says 172.21.15.152:40816) 2024-09-11T21:55:41.168 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.225+0000 7ff31259c640 1 -- 172.21.15.152:0/1256414432 learned_addr learned my addr 172.21.15.152:0/1256414432 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:41.168 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.225+0000 7ff31259c640 1 -- 172.21.15.152:0/1256414432 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31407b930 con 0x7ff31407cd80 2024-09-11T21:55:41.168 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.226+0000 7ff31259c640 1 --2- 172.21.15.152:0/1256414432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31407b1e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff304009820 tx=0x7ff30402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217468d83d4d7c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:41.168 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.226+0000 7ff311d9b640 1 -- 172.21.15.152:0/1256414432 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff304037070 con 0x7ff31407cd80 2024-09-11T21:55:41.168 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.226+0000 7ff311d9b640 1 -- 172.21.15.152:0/1256414432 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff304032900 con 0x7ff31407cd80 2024-09-11T21:55:41.168 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.226+0000 7ff311d9b640 1 -- 172.21.15.152:0/1256414432 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff304030850 con 0x7ff31407cd80 2024-09-11T21:55:41.168 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.226+0000 7ff318a6b640 1 -- 172.21.15.152:0/1256414432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 msgr2=0x7ff31407b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.226+0000 7ff318a6b640 1 --2- 172.21.15.152:0/1256414432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31407b1e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff304009820 tx=0x7ff30402a270 comp rx=0 tx=0).stop 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.227+0000 7ff318a6b640 1 -- 172.21.15.152:0/1256414432 shutdown_connections 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.227+0000 7ff318a6b640 1 --2- 172.21.15.152:0/1256414432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31407b1e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.227+0000 7ff318a6b640 1 -- 172.21.15.152:0/1256414432 >> 172.21.15.152:0/1256414432 conn(0x7ff3141030b0 msgr2=0x7ff3141054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.227+0000 7ff318a6b640 1 -- 172.21.15.152:0/1256414432 shutdown_connections 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.227+0000 7ff318a6b640 1 -- 172.21.15.152:0/1256414432 wait complete. 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.227+0000 7ff318a6b640 1 Processor -- start 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.227+0000 7ff318a6b640 1 -- start start 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.227+0000 7ff318a6b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31419dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.227+0000 7ff318a6b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff31410df30 con 0x7ff31407cd80 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.228+0000 7ff31259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31419dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:41.169 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.228+0000 7ff31259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31419dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40832/0 (socket says 172.21.15.152:40832) 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.228+0000 7ff31259c640 1 -- 172.21.15.152:0/3226307595 learned_addr learned my addr 172.21.15.152:0/3226307595 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.228+0000 7ff31259c640 1 -- 172.21.15.152:0/3226307595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31419e000 con 0x7ff31407cd80 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.228+0000 7ff31259c640 1 --2- 172.21.15.152:0/3226307595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31419dac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff304032ce0 tx=0x7ff304032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.228+0000 7ff30b7fe640 1 -- 172.21.15.152:0/3226307595 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff304042070 con 0x7ff31407cd80 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.228+0000 7ff30b7fe640 1 -- 172.21.15.152:0/3226307595 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3040308c0 con 0x7ff31407cd80 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.228+0000 7ff318a6b640 1 -- 172.21.15.152:0/3226307595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff31419e290 con 0x7ff31407cd80 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.228+0000 7ff30b7fe640 1 -- 172.21.15.152:0/3226307595 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff304037040 con 0x7ff31407cd80 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.228+0000 7ff318a6b640 1 -- 172.21.15.152:0/3226307595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3141a0f80 con 0x7ff31407cd80 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.229+0000 7ff30b7fe640 1 -- 172.21.15.152:0/3226307595 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff304045070 con 0x7ff31407cd80 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.229+0000 7ff30b7fe640 1 --2- 172.21.15.152:0/3226307595 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7ff300038fc0 0x7ff30003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.229+0000 7ff318a6b640 1 -- 172.21.15.152:0/3226307595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff31407b260 con 0x7ff31407cd80 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.229+0000 7ff30b7fe640 1 -- 172.21.15.152:0/3226307595 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff30406c050 con 0x7ff31407cd80 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.229+0000 7ff30bfff640 1 --2- 172.21.15.152:0/3226307595 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7ff300038fc0 0x7ff30003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:41.170 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.230+0000 7ff30bfff640 1 --2- 172.21.15.152:0/3226307595 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7ff300038fc0 0x7ff30003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0098c0 tx=0x7ff2fc006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:41.171 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.234+0000 7ff30b7fe640 1 -- 172.21.15.152:0/3226307595 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff304042210 con 0x7ff31407cd80 2024-09-11T21:55:41.171 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:37.401+0000 7ff318a6b640 1 -- 172.21.15.152:0/3226307595 --> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi152", "addr": "172.21.15.152", "target": ["mon-mgr", ""]}) -- 0x7ff314104350 con 0x7ff300038fc0 2024-09-11T21:55:41.171 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:40.594+0000 7ff30b7fe640 1 -- 172.21.15.152:0/3226307595 <== mgr.14116 v2:172.21.15.152:6800/1144560416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7ff314104350 con 0x7ff300038fc0 2024-09-11T21:55:41.171 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:40.598+0000 7ff318a6b640 1 -- 172.21.15.152:0/3226307595 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7ff300038fc0 msgr2=0x7ff30003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:41.171 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:40.598+0000 7ff318a6b640 1 --2- 172.21.15.152:0/3226307595 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7ff300038fc0 0x7ff30003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0098c0 tx=0x7ff2fc006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:41.171 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:40.598+0000 7ff318a6b640 1 -- 172.21.15.152:0/3226307595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 msgr2=0x7ff31419dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:41.171 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:40.598+0000 7ff318a6b640 1 --2- 172.21.15.152:0/3226307595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31419dac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff304032ce0 tx=0x7ff304032d10 comp rx=0 tx=0).stop 2024-09-11T21:55:41.171 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:40.598+0000 7ff318a6b640 1 -- 172.21.15.152:0/3226307595 shutdown_connections 2024-09-11T21:55:41.171 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:40.598+0000 7ff318a6b640 1 --2- 172.21.15.152:0/3226307595 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7ff300038fc0 0x7ff30003b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:41.171 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:40.598+0000 7ff318a6b640 1 --2- 172.21.15.152:0/3226307595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31407cd80 0x7ff31419dac0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:41.171 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:40.598+0000 7ff318a6b640 1 -- 172.21.15.152:0/3226307595 >> 172.21.15.152:0/3226307595 conn(0x7ff3141030b0 msgr2=0x7ff314103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:41.172 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:40.598+0000 7ff318a6b640 1 -- 172.21.15.152:0/3226307595 shutdown_connections 2024-09-11T21:55:41.172 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:40.598+0000 7ff318a6b640 1 -- 172.21.15.152:0/3226307595 wait complete. 2024-09-11T21:55:41.172 INFO:teuthology.orchestra.run.smithi152.stdout:Deploying unmanaged mon service... 2024-09-11T21:55:41.804 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:41 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:41.804 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:41 smithi152 ceph-mon[31188]: Added host smithi152 2024-09-11T21:55:41.804 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:41 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:55:42.579 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-11T21:55:42.579 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.566+0000 7f5041080640 1 Processor -- start 2024-09-11T21:55:42.579 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.566+0000 7f5041080640 1 -- start start 2024-09-11T21:55:42.579 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.567+0000 7f5041080640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c107cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:42.579 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.567+0000 7f5041080640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f503c108290 con 0x7f503c1078c0 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.567+0000 7f503ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c107cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.567+0000 7f503ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c107cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40844/0 (socket says 172.21.15.152:40844) 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.567+0000 7f503ad9d640 1 -- 172.21.15.152:0/3545672610 learned_addr learned my addr 172.21.15.152:0/3545672610 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.567+0000 7f503ad9d640 1 -- 172.21.15.152:0/3545672610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503c108ac0 con 0x7f503c1078c0 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.568+0000 7f503ad9d640 1 --2- 172.21.15.152:0/3545672610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c107cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f502c009820 tx=0x7f502c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635fa28129ceaa77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.568+0000 7f5039d9b640 1 -- 172.21.15.152:0/3545672610 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f502c037070 con 0x7f503c1078c0 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.568+0000 7f5039d9b640 1 -- 172.21.15.152:0/3545672610 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f502c032900 con 0x7f503c1078c0 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.568+0000 7f5039d9b640 1 -- 172.21.15.152:0/3545672610 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f502c030850 con 0x7f503c1078c0 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.568+0000 7f5041080640 1 -- 172.21.15.152:0/3545672610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 msgr2=0x7f503c107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.568+0000 7f5041080640 1 --2- 172.21.15.152:0/3545672610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c107cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f502c009820 tx=0x7f502c02a270 comp rx=0 tx=0).stop 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.568+0000 7f5041080640 1 -- 172.21.15.152:0/3545672610 shutdown_connections 2024-09-11T21:55:42.580 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.568+0000 7f5041080640 1 --2- 172.21.15.152:0/3545672610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c107cc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:42.581 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.568+0000 7f5041080640 1 -- 172.21.15.152:0/3545672610 >> 172.21.15.152:0/3545672610 conn(0x7f503c103090 msgr2=0x7f503c1054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:42.581 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.568+0000 7f5041080640 1 -- 172.21.15.152:0/3545672610 shutdown_connections 2024-09-11T21:55:42.581 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.568+0000 7f5041080640 1 -- 172.21.15.152:0/3545672610 wait complete. 2024-09-11T21:55:42.581 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.569+0000 7f5041080640 1 Processor -- start 2024-09-11T21:55:42.581 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.569+0000 7f5041080640 1 -- start start 2024-09-11T21:55:42.581 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f5041080640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:42.581 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f5041080640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f503c10be70 con 0x7f503c1078c0 2024-09-11T21:55:42.581 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f503ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:42.581 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f503ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c19b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40852/0 (socket says 172.21.15.152:40852) 2024-09-11T21:55:42.581 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f503ad9d640 1 -- 172.21.15.152:0/3838560963 learned_addr learned my addr 172.21.15.152:0/3838560963 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:42.582 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f503ad9d640 1 -- 172.21.15.152:0/3838560963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503c19be50 con 0x7f503c1078c0 2024-09-11T21:55:42.582 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f503ad9d640 1 --2- 172.21.15.152:0/3838560963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c19b910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f502c0097f0 tx=0x7f502c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:42.582 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f5023fff640 1 -- 172.21.15.152:0/3838560963 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f502c042070 con 0x7f503c1078c0 2024-09-11T21:55:42.582 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f5023fff640 1 -- 172.21.15.152:0/3838560963 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f502c032ca0 con 0x7f503c1078c0 2024-09-11T21:55:42.582 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f5041080640 1 -- 172.21.15.152:0/3838560963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503c19c0e0 con 0x7f503c1078c0 2024-09-11T21:55:42.582 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f5023fff640 1 -- 172.21.15.152:0/3838560963 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f502c037040 con 0x7f503c1078c0 2024-09-11T21:55:42.582 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.570+0000 7f5041080640 1 -- 172.21.15.152:0/3838560963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f503c19edd0 con 0x7f503c1078c0 2024-09-11T21:55:42.582 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.571+0000 7f5023fff640 1 -- 172.21.15.152:0/3838560963 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f502c045070 con 0x7f503c1078c0 2024-09-11T21:55:42.582 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.571+0000 7f5041080640 1 -- 172.21.15.152:0/3838560963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f503c10bff0 con 0x7f503c1078c0 2024-09-11T21:55:42.583 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.571+0000 7f5023fff640 1 --2- 172.21.15.152:0/3838560963 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5024038fc0 0x7f502403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:42.583 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.572+0000 7f5023fff640 1 -- 172.21.15.152:0/3838560963 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f502c06bec0 con 0x7f503c1078c0 2024-09-11T21:55:42.583 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.572+0000 7f503a59c640 1 --2- 172.21.15.152:0/3838560963 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5024038fc0 0x7f502403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:42.583 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.572+0000 7f503a59c640 1 --2- 172.21.15.152:0/3838560963 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5024038fc0 0x7f502403b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f50300098c0 tx=0x7f5030006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:42.583 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.576+0000 7f5023fff640 1 -- 172.21.15.152:0/3838560963 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f502c045360 con 0x7f503c1078c0 2024-09-11T21:55:42.583 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.802+0000 7f5041080640 1 -- 172.21.15.152:0/3838560963 --> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f503c1043b0 con 0x7f5024038fc0 2024-09-11T21:55:42.583 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.807+0000 7f5023fff640 1 -- 172.21.15.152:0/3838560963 <== mgr.14116 v2:172.21.15.152:6800/1144560416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f503c1043b0 con 0x7f5024038fc0 2024-09-11T21:55:42.583 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.810+0000 7f5041080640 1 -- 172.21.15.152:0/3838560963 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5024038fc0 msgr2=0x7f502403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:42.583 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.810+0000 7f5041080640 1 --2- 172.21.15.152:0/3838560963 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5024038fc0 0x7f502403b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f50300098c0 tx=0x7f5030006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:42.583 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.810+0000 7f5041080640 1 -- 172.21.15.152:0/3838560963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 msgr2=0x7f503c19b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:42.584 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.810+0000 7f5041080640 1 --2- 172.21.15.152:0/3838560963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c19b910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f502c0097f0 tx=0x7f502c030ec0 comp rx=0 tx=0).stop 2024-09-11T21:55:42.584 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.810+0000 7f5041080640 1 -- 172.21.15.152:0/3838560963 shutdown_connections 2024-09-11T21:55:42.584 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.810+0000 7f5041080640 1 --2- 172.21.15.152:0/3838560963 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5024038fc0 0x7f502403b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:42.584 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.810+0000 7f5041080640 1 --2- 172.21.15.152:0/3838560963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f503c1078c0 0x7f503c19b910 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:42.584 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.810+0000 7f5041080640 1 -- 172.21.15.152:0/3838560963 >> 172.21.15.152:0/3838560963 conn(0x7f503c103090 msgr2=0x7f503c103ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:42.584 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.810+0000 7f5041080640 1 -- 172.21.15.152:0/3838560963 shutdown_connections 2024-09-11T21:55:42.584 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:41.810+0000 7f5041080640 1 -- 172.21.15.152:0/3838560963 wait complete. 2024-09-11T21:55:42.584 INFO:teuthology.orchestra.run.smithi152.stdout:Deploying unmanaged mgr service... 2024-09-11T21:55:42.895 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:42 smithi152 ceph-mon[31188]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:55:42.896 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:42 smithi152 ceph-mon[31188]: Saving service mon spec with placement count:5 2024-09-11T21:55:42.896 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:42 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:44.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:44 smithi152 ceph-mon[31188]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:55:44.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:44 smithi152 ceph-mon[31188]: Saving service mgr spec with placement count:2 2024-09-11T21:55:44.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:44 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:44.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-11T21:55:44.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.978+0000 7fad8701c640 1 Processor -- start 2024-09-11T21:55:44.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.978+0000 7fad8701c640 1 -- start start 2024-09-11T21:55:44.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.978+0000 7fad8701c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad80107d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:44.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.978+0000 7fad8701c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad80108330 con 0x7fad80107960 2024-09-11T21:55:44.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.978+0000 7fad84db8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad80107d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:44.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.978+0000 7fad84db8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad80107d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40866/0 (socket says 172.21.15.152:40866) 2024-09-11T21:55:44.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.978+0000 7fad84db8640 1 -- 172.21.15.152:0/2026804252 learned_addr learned my addr 172.21.15.152:0/2026804252 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:44.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.978+0000 7fad84db8640 1 -- 172.21.15.152:0/2026804252 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad80108b10 con 0x7fad80107960 2024-09-11T21:55:44.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.979+0000 7fad84db8640 1 --2- 172.21.15.152:0/2026804252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad80107d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fad74009820 tx=0x7fad7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca9864fa8bf465f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:44.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.979+0000 7fad7f7fe640 1 -- 172.21.15.152:0/2026804252 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad74037070 con 0x7fad80107960 2024-09-11T21:55:44.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.979+0000 7fad7f7fe640 1 -- 172.21.15.152:0/2026804252 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad74032900 con 0x7fad80107960 2024-09-11T21:55:44.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.979+0000 7fad7f7fe640 1 -- 172.21.15.152:0/2026804252 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad74030850 con 0x7fad80107960 2024-09-11T21:55:44.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.980+0000 7fad8701c640 1 -- 172.21.15.152:0/2026804252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 msgr2=0x7fad80107d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.980+0000 7fad8701c640 1 --2- 172.21.15.152:0/2026804252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad80107d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fad74009820 tx=0x7fad7402a270 comp rx=0 tx=0).stop 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.980+0000 7fad8701c640 1 -- 172.21.15.152:0/2026804252 shutdown_connections 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.980+0000 7fad8701c640 1 --2- 172.21.15.152:0/2026804252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad80107d60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.980+0000 7fad8701c640 1 -- 172.21.15.152:0/2026804252 >> 172.21.15.152:0/2026804252 conn(0x7fad80103110 msgr2=0x7fad80105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.980+0000 7fad8701c640 1 -- 172.21.15.152:0/2026804252 shutdown_connections 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.980+0000 7fad8701c640 1 -- 172.21.15.152:0/2026804252 wait complete. 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.980+0000 7fad8701c640 1 Processor -- start 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.980+0000 7fad8701c640 1 -- start start 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.981+0000 7fad8701c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad8019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.981+0000 7fad8701c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad8010bec0 con 0x7fad80107960 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.981+0000 7fad84db8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad8019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:44.724 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.981+0000 7fad84db8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad8019b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40882/0 (socket says 172.21.15.152:40882) 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.981+0000 7fad84db8640 1 -- 172.21.15.152:0/601829733 learned_addr learned my addr 172.21.15.152:0/601829733 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.981+0000 7fad84db8640 1 -- 172.21.15.152:0/601829733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8019bde0 con 0x7fad80107960 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.981+0000 7fad84db8640 1 --2- 172.21.15.152:0/601829733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad8019b8a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fad74009940 tx=0x7fad74032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.981+0000 7fad7dffb640 1 -- 172.21.15.152:0/601829733 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad74042070 con 0x7fad80107960 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.981+0000 7fad8701c640 1 -- 172.21.15.152:0/601829733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8019c070 con 0x7fad80107960 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.981+0000 7fad7dffb640 1 -- 172.21.15.152:0/601829733 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad740308c0 con 0x7fad80107960 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.981+0000 7fad7dffb640 1 -- 172.21.15.152:0/601829733 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad74037040 con 0x7fad80107960 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.982+0000 7fad8701c640 1 -- 172.21.15.152:0/601829733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad8019ed60 con 0x7fad80107960 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.982+0000 7fad7dffb640 1 -- 172.21.15.152:0/601829733 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fad74045070 con 0x7fad80107960 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.982+0000 7fad8701c640 1 -- 172.21.15.152:0/601829733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad80107de0 con 0x7fad80107960 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.983+0000 7fad7dffb640 1 --2- 172.21.15.152:0/601829733 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fad70038f70 0x7fad7003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:44.725 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.983+0000 7fad7dffb640 1 -- 172.21.15.152:0/601829733 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fad7406c270 con 0x7fad80107960 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.983+0000 7fad7ffff640 1 --2- 172.21.15.152:0/601829733 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fad70038f70 0x7fad7003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.983+0000 7fad7ffff640 1 --2- 172.21.15.152:0/601829733 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fad70038f70 0x7fad7003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0098c0 tx=0x7fad6c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:42.987+0000 7fad7dffb640 1 -- 172.21.15.152:0/601829733 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad74045520 con 0x7fad80107960 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.172+0000 7fad8701c640 1 -- 172.21.15.152:0/601829733 --> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fad801043d0 con 0x7fad70038f70 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.176+0000 7fad7dffb640 1 -- 172.21.15.152:0/601829733 <== mgr.14116 v2:172.21.15.152:6800/1144560416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fad801043d0 con 0x7fad70038f70 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.178+0000 7fad8701c640 1 -- 172.21.15.152:0/601829733 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fad70038f70 msgr2=0x7fad7003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.178+0000 7fad8701c640 1 --2- 172.21.15.152:0/601829733 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fad70038f70 0x7fad7003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0098c0 tx=0x7fad6c006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.178+0000 7fad8701c640 1 -- 172.21.15.152:0/601829733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 msgr2=0x7fad8019b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.178+0000 7fad8701c640 1 --2- 172.21.15.152:0/601829733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad8019b8a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fad74009940 tx=0x7fad74032ce0 comp rx=0 tx=0).stop 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.178+0000 7fad8701c640 1 -- 172.21.15.152:0/601829733 shutdown_connections 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.178+0000 7fad8701c640 1 --2- 172.21.15.152:0/601829733 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fad70038f70 0x7fad7003b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.178+0000 7fad8701c640 1 --2- 172.21.15.152:0/601829733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80107960 0x7fad8019b8a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:44.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.178+0000 7fad8701c640 1 -- 172.21.15.152:0/601829733 >> 172.21.15.152:0/601829733 conn(0x7fad80103110 msgr2=0x7fad80103cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:44.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.178+0000 7fad8701c640 1 -- 172.21.15.152:0/601829733 shutdown_connections 2024-09-11T21:55:44.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:43.178+0000 7fad8701c640 1 -- 172.21.15.152:0/601829733 wait complete. 2024-09-11T21:55:45.364 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:45 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:45.364 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:45 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:46.609 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:46 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/78343067' entity='client.admin' 2024-09-11T21:55:46.609 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:46 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:46.615 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.171+0000 7f5fab578640 1 Processor -- start 2024-09-11T21:55:46.616 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.171+0000 7f5fab578640 1 -- start start 2024-09-11T21:55:46.616 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.172+0000 7f5fab578640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa407c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:46.616 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.172+0000 7f5fab578640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa407c900 con 0x7f5fa407de80 2024-09-11T21:55:46.616 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.172+0000 7f5fa9314640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa407c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:46.616 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.172+0000 7f5fa9314640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa407c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54326/0 (socket says 172.21.15.152:54326) 2024-09-11T21:55:46.616 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.172+0000 7f5fa9314640 1 -- 172.21.15.152:0/3035575964 learned_addr learned my addr 172.21.15.152:0/3035575964 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:46.616 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.172+0000 7f5fa9314640 1 -- 172.21.15.152:0/3035575964 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa407ca80 con 0x7f5fa407de80 2024-09-11T21:55:46.616 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.173+0000 7f5fa9314640 1 --2- 172.21.15.152:0/3035575964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa407c330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0009820 tx=0x7f5fa002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4457c450aaff0a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:46.616 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.173+0000 7f5f9bfff640 1 -- 172.21.15.152:0/3035575964 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa0037070 con 0x7f5fa407de80 2024-09-11T21:55:46.616 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.173+0000 7f5f9bfff640 1 -- 172.21.15.152:0/3035575964 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fa0032920 con 0x7f5fa407de80 2024-09-11T21:55:46.616 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.173+0000 7f5f9bfff640 1 -- 172.21.15.152:0/3035575964 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa0030810 con 0x7f5fa407de80 2024-09-11T21:55:46.617 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.173+0000 7f5fab578640 1 -- 172.21.15.152:0/3035575964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 msgr2=0x7f5fa407c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:46.617 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.173+0000 7f5fab578640 1 --2- 172.21.15.152:0/3035575964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa407c330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0009820 tx=0x7f5fa002a270 comp rx=0 tx=0).stop 2024-09-11T21:55:46.617 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.173+0000 7f5fab578640 1 -- 172.21.15.152:0/3035575964 shutdown_connections 2024-09-11T21:55:46.617 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.173+0000 7f5fab578640 1 --2- 172.21.15.152:0/3035575964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa407c330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:46.617 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.173+0000 7f5fab578640 1 -- 172.21.15.152:0/3035575964 >> 172.21.15.152:0/3035575964 conn(0x7f5fa4103110 msgr2=0x7f5fa4105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:46.617 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.174+0000 7f5fab578640 1 -- 172.21.15.152:0/3035575964 shutdown_connections 2024-09-11T21:55:46.617 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.174+0000 7f5fab578640 1 -- 172.21.15.152:0/3035575964 wait complete. 2024-09-11T21:55:46.617 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.174+0000 7f5fab578640 1 Processor -- start 2024-09-11T21:55:46.617 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.174+0000 7f5fab578640 1 -- start start 2024-09-11T21:55:46.617 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.174+0000 7f5fab578640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:46.617 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.174+0000 7f5fab578640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa410df20 con 0x7f5fa407de80 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.174+0000 7f5fa9314640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.174+0000 7f5fa9314640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa419da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54328/0 (socket says 172.21.15.152:54328) 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.174+0000 7f5fa9314640 1 -- 172.21.15.152:0/78343067 learned_addr learned my addr 172.21.15.152:0/78343067 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.175+0000 7f5fa9314640 1 -- 172.21.15.152:0/78343067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa419dfc0 con 0x7f5fa407de80 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.175+0000 7f5fa9314640 1 --2- 172.21.15.152:0/78343067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa419da80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00097f0 tx=0x7f5fa00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.175+0000 7f5f9a7fc640 1 -- 172.21.15.152:0/78343067 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa0037040 con 0x7f5fa407de80 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.175+0000 7f5f9a7fc640 1 -- 172.21.15.152:0/78343067 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fa0030cc0 con 0x7f5fa407de80 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.175+0000 7f5fab578640 1 -- 172.21.15.152:0/78343067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa419e250 con 0x7f5fa407de80 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.175+0000 7f5f9a7fc640 1 -- 172.21.15.152:0/78343067 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa003a6b0 con 0x7f5fa407de80 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.175+0000 7f5fab578640 1 -- 172.21.15.152:0/78343067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa41a0f40 con 0x7f5fa407de80 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.176+0000 7f5f9a7fc640 1 -- 172.21.15.152:0/78343067 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5fa003a850 con 0x7f5fa407de80 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.176+0000 7f5fab578640 1 -- 172.21.15.152:0/78343067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa407c3b0 con 0x7f5fa407de80 2024-09-11T21:55:46.618 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.176+0000 7f5f9a7fc640 1 --2- 172.21.15.152:0/78343067 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5f90038fc0 0x7f5f9003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.176+0000 7f5f9a7fc640 1 -- 172.21.15.152:0/78343067 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5fa006c5d0 con 0x7f5fa407de80 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.176+0000 7f5fa8b13640 1 --2- 172.21.15.152:0/78343067 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5f90038fc0 0x7f5f9003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.177+0000 7f5fa8b13640 1 --2- 172.21.15.152:0/78343067 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5f90038fc0 0x7f5f9003b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5f940098c0 tx=0x7f5f94006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.181+0000 7f5f9a7fc640 1 -- 172.21.15.152:0/78343067 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5fa0031c30 con 0x7f5fa407de80 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.362+0000 7f5fab578640 1 -- 172.21.15.152:0/78343067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f5fa41a1530 con 0x7f5fa407de80 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.367+0000 7f5f9a7fc640 1 -- 172.21.15.152:0/78343067 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f5fa0044920 con 0x7f5fa407de80 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.370+0000 7f5fab578640 1 -- 172.21.15.152:0/78343067 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5f90038fc0 msgr2=0x7f5f9003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.370+0000 7f5fab578640 1 --2- 172.21.15.152:0/78343067 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5f90038fc0 0x7f5f9003b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5f940098c0 tx=0x7f5f94006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.370+0000 7f5fab578640 1 -- 172.21.15.152:0/78343067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 msgr2=0x7f5fa419da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.370+0000 7f5fab578640 1 --2- 172.21.15.152:0/78343067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa419da80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00097f0 tx=0x7f5fa00327b0 comp rx=0 tx=0).stop 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.370+0000 7f5fab578640 1 -- 172.21.15.152:0/78343067 shutdown_connections 2024-09-11T21:55:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.370+0000 7f5fab578640 1 --2- 172.21.15.152:0/78343067 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f5f90038fc0 0x7f5f9003b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:46.620 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.370+0000 7f5fab578640 1 --2- 172.21.15.152:0/78343067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fa407de80 0x7f5fa419da80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:46.620 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.370+0000 7f5fab578640 1 -- 172.21.15.152:0/78343067 >> 172.21.15.152:0/78343067 conn(0x7f5fa4103110 msgr2=0x7f5fa4103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:46.620 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.370+0000 7f5fab578640 1 -- 172.21.15.152:0/78343067 shutdown_connections 2024-09-11T21:55:46.620 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:45.370+0000 7f5fab578640 1 -- 172.21.15.152:0/78343067 wait complete. 2024-09-11T21:55:47.731 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.973+0000 7fc141c57640 1 Processor -- start 2024-09-11T21:55:47.731 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.973+0000 7fc141c57640 1 -- start start 2024-09-11T21:55:47.732 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.973+0000 7fc141c57640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c107d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:47.732 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.973+0000 7fc141c57640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c108330 con 0x7fc13c107960 2024-09-11T21:55:47.732 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.974+0000 7fc13b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c107d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:47.732 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.974+0000 7fc13b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c107d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54330/0 (socket says 172.21.15.152:54330) 2024-09-11T21:55:47.732 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.974+0000 7fc13b7fe640 1 -- 172.21.15.152:0/3725877047 learned_addr learned my addr 172.21.15.152:0/3725877047 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:47.732 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.974+0000 7fc13b7fe640 1 -- 172.21.15.152:0/3725877047 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c108b10 con 0x7fc13c107960 2024-09-11T21:55:47.732 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.974+0000 7fc13b7fe640 1 --2- 172.21.15.152:0/3725877047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c107d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009e80 tx=0x7fc12c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bc7becdbe995a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:47.732 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.975+0000 7fc13a7fc640 1 -- 172.21.15.152:0/3725877047 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c036070 con 0x7fc13c107960 2024-09-11T21:55:47.732 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.975+0000 7fc13a7fc640 1 -- 172.21.15.152:0/3725877047 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc12c0318e0 con 0x7fc13c107960 2024-09-11T21:55:47.732 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.975+0000 7fc13a7fc640 1 -- 172.21.15.152:0/3725877047 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c007a00 con 0x7fc13c107960 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.975+0000 7fc141c57640 1 -- 172.21.15.152:0/3725877047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 msgr2=0x7fc13c107d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.975+0000 7fc141c57640 1 --2- 172.21.15.152:0/3725877047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c107d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009e80 tx=0x7fc12c02a7a0 comp rx=0 tx=0).stop 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.975+0000 7fc141c57640 1 -- 172.21.15.152:0/3725877047 shutdown_connections 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.975+0000 7fc141c57640 1 --2- 172.21.15.152:0/3725877047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c107d60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.975+0000 7fc141c57640 1 -- 172.21.15.152:0/3725877047 >> 172.21.15.152:0/3725877047 conn(0x7fc13c103110 msgr2=0x7fc13c105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.975+0000 7fc141c57640 1 -- 172.21.15.152:0/3725877047 shutdown_connections 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.975+0000 7fc141c57640 1 -- 172.21.15.152:0/3725877047 wait complete. 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.976+0000 7fc141c57640 1 Processor -- start 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.976+0000 7fc141c57640 1 -- start start 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.976+0000 7fc141c57640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.976+0000 7fc141c57640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c10bec0 con 0x7fc13c107960 2024-09-11T21:55:47.733 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.976+0000 7fc13b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.976+0000 7fc13b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c19b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54332/0 (socket says 172.21.15.152:54332) 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.976+0000 7fc13b7fe640 1 -- 172.21.15.152:0/3248437057 learned_addr learned my addr 172.21.15.152:0/3248437057 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.977+0000 7fc13b7fe640 1 -- 172.21.15.152:0/3248437057 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c19be00 con 0x7fc13c107960 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.977+0000 7fc13b7fe640 1 --2- 172.21.15.152:0/3248437057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c19b8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc12c031cc0 tx=0x7fc12c031cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.977+0000 7fc138ff9640 1 -- 172.21.15.152:0/3248437057 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c036050 con 0x7fc13c107960 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.977+0000 7fc138ff9640 1 -- 172.21.15.152:0/3248437057 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc12c042070 con 0x7fc13c107960 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.977+0000 7fc141c57640 1 -- 172.21.15.152:0/3248437057 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13c19c090 con 0x7fc13c107960 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.977+0000 7fc138ff9640 1 -- 172.21.15.152:0/3248437057 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c03d8e0 con 0x7fc13c107960 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.977+0000 7fc141c57640 1 -- 172.21.15.152:0/3248437057 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13c19ed80 con 0x7fc13c107960 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.978+0000 7fc138ff9640 1 -- 172.21.15.152:0/3248437057 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc12c03dbe0 con 0x7fc13c107960 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.978+0000 7fc141c57640 1 -- 172.21.15.152:0/3248437057 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc13c107de0 con 0x7fc13c107960 2024-09-11T21:55:47.734 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.978+0000 7fc138ff9640 1 --2- 172.21.15.152:0/3248437057 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fc124038f70 0x7fc12403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:47.735 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.978+0000 7fc138ff9640 1 -- 172.21.15.152:0/3248437057 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc12c06d400 con 0x7fc13c107960 2024-09-11T21:55:47.735 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.978+0000 7fc13affd640 1 --2- 172.21.15.152:0/3248437057 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fc124038f70 0x7fc12403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:47.735 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.979+0000 7fc13affd640 1 --2- 172.21.15.152:0/3248437057 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fc124038f70 0x7fc12403b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098c0 tx=0x7fc130006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:47.735 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:46.983+0000 7fc138ff9640 1 -- 172.21.15.152:0/3248437057 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc12c044310 con 0x7fc13c107960 2024-09-11T21:55:47.735 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.151+0000 7fc141c57640 1 -- 172.21.15.152:0/3248437057 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fc13c19f3e0 con 0x7fc13c107960 2024-09-11T21:55:47.735 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.154+0000 7fc138ff9640 1 -- 172.21.15.152:0/3248437057 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fc12c04dcf0 con 0x7fc13c107960 2024-09-11T21:55:47.735 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.156+0000 7fc141c57640 1 -- 172.21.15.152:0/3248437057 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fc124038f70 msgr2=0x7fc12403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:47.735 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.156+0000 7fc141c57640 1 --2- 172.21.15.152:0/3248437057 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fc124038f70 0x7fc12403b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098c0 tx=0x7fc130006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:47.735 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.156+0000 7fc141c57640 1 -- 172.21.15.152:0/3248437057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 msgr2=0x7fc13c19b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:47.735 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.156+0000 7fc141c57640 1 --2- 172.21.15.152:0/3248437057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c19b8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc12c031cc0 tx=0x7fc12c031cf0 comp rx=0 tx=0).stop 2024-09-11T21:55:47.735 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.156+0000 7fc141c57640 1 -- 172.21.15.152:0/3248437057 shutdown_connections 2024-09-11T21:55:47.736 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.156+0000 7fc141c57640 1 --2- 172.21.15.152:0/3248437057 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fc124038f70 0x7fc12403b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:47.736 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.156+0000 7fc141c57640 1 --2- 172.21.15.152:0/3248437057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc13c107960 0x7fc13c19b8c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:47.736 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.156+0000 7fc141c57640 1 -- 172.21.15.152:0/3248437057 >> 172.21.15.152:0/3248437057 conn(0x7fc13c103110 msgr2=0x7fc13c103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:47.736 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.157+0000 7fc141c57640 1 -- 172.21.15.152:0/3248437057 shutdown_connections 2024-09-11T21:55:47.736 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:47.157+0000 7fc141c57640 1 -- 172.21.15.152:0/3248437057 wait complete. 2024-09-11T21:55:47.736 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling the dashboard module... 2024-09-11T21:55:48.366 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:48 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3248437057' entity='client.admin' 2024-09-11T21:55:49.607 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:49 smithi152 ceph-mon[31188]: from='mgr.14116 172.21.15.152:0/2946959553' entity='mgr.x' 2024-09-11T21:55:49.607 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:49 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/508445856' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-11T21:55:49.607 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: ignoring --setuser ceph since I am not root 2024-09-11T21:55:49.607 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: ignoring --setgroup ceph since I am not root 2024-09-11T21:55:49.607 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:49.398+0000 7fe32d7f3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T21:55:49.607 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:49.455+0000 7fe32d7f3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T21:55:49.607 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:49.604+0000 7fe32d7f3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T21:55:49.967 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:49.673+0000 7fe32d7f3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T21:55:49.967 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:49.822+0000 7fe32d7f3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T21:55:49.968 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:49.965+0000 7fe32d7f3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T21:55:50.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.130+0000 7f9da7f65640 1 Processor -- start 2024-09-11T21:55:50.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.130+0000 7f9da7f65640 1 -- start start 2024-09-11T21:55:50.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.131+0000 7f9da7f65640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da010a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:50.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.131+0000 7f9da7f65640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9da0075ad0 con 0x7f9da0108310 2024-09-11T21:55:50.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.131+0000 7f9da5d01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da010a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.131+0000 7f9da5d01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da010a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54346/0 (socket says 172.21.15.152:54346) 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.131+0000 7f9da5d01640 1 -- 172.21.15.152:0/3309241219 learned_addr learned my addr 172.21.15.152:0/3309241219 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.131+0000 7f9da5d01640 1 -- 172.21.15.152:0/3309241219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da010ac40 con 0x7f9da0108310 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.132+0000 7f9da5d01640 1 --2- 172.21.15.152:0/3309241219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da010a700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009820 tx=0x7f9d9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16db930ef7f64f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.132+0000 7f9da4cff640 1 -- 172.21.15.152:0/3309241219 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d9c037070 con 0x7f9da0108310 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.132+0000 7f9da4cff640 1 -- 172.21.15.152:0/3309241219 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d9c032920 con 0x7f9da0108310 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.132+0000 7f9da4cff640 1 -- 172.21.15.152:0/3309241219 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d9c030810 con 0x7f9da0108310 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.132+0000 7f9da7f65640 1 -- 172.21.15.152:0/3309241219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 msgr2=0x7f9da010a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.132+0000 7f9da7f65640 1 --2- 172.21.15.152:0/3309241219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da010a700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009820 tx=0x7f9d9c02a270 comp rx=0 tx=0).stop 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.133+0000 7f9da7f65640 1 -- 172.21.15.152:0/3309241219 shutdown_connections 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.133+0000 7f9da7f65640 1 --2- 172.21.15.152:0/3309241219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da010a700 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.133+0000 7f9da7f65640 1 -- 172.21.15.152:0/3309241219 >> 172.21.15.152:0/3309241219 conn(0x7f9da0101fb0 msgr2=0x7f9da01043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:50.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.133+0000 7f9da7f65640 1 -- 172.21.15.152:0/3309241219 shutdown_connections 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.133+0000 7f9da7f65640 1 -- 172.21.15.152:0/3309241219 wait complete. 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.133+0000 7f9da7f65640 1 Processor -- start 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.133+0000 7f9da7f65640 1 -- start start 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.133+0000 7f9da7f65640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da0107b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.133+0000 7f9da7f65640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9da010bc60 con 0x7f9da0108310 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.134+0000 7f9da5d01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da0107b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.134+0000 7f9da5d01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da0107b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54352/0 (socket says 172.21.15.152:54352) 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.134+0000 7f9da5d01640 1 -- 172.21.15.152:0/508445856 learned_addr learned my addr 172.21.15.152:0/508445856 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.134+0000 7f9da5d01640 1 -- 172.21.15.152:0/508445856 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da01080d0 con 0x7f9da0108310 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.134+0000 7f9da5d01640 1 --2- 172.21.15.152:0/508445856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da0107b90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0097f0 tx=0x7f9d9c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.134+0000 7f9d96ffd640 1 -- 172.21.15.152:0/508445856 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d9c037040 con 0x7f9da0108310 2024-09-11T21:55:50.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.134+0000 7f9d96ffd640 1 -- 172.21.15.152:0/508445856 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d9c030cc0 con 0x7f9da0108310 2024-09-11T21:55:50.265 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.134+0000 7f9da7f65640 1 -- 172.21.15.152:0/508445856 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da01062c0 con 0x7f9da0108310 2024-09-11T21:55:50.265 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.134+0000 7f9d96ffd640 1 -- 172.21.15.152:0/508445856 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d9c03a6b0 con 0x7f9da0108310 2024-09-11T21:55:50.265 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.134+0000 7f9da7f65640 1 -- 172.21.15.152:0/508445856 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da0106800 con 0x7f9da0108310 2024-09-11T21:55:50.265 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.135+0000 7f9d96ffd640 1 -- 172.21.15.152:0/508445856 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9d9c03a8a0 con 0x7f9da0108310 2024-09-11T21:55:50.265 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.135+0000 7f9da7f65640 1 -- 172.21.15.152:0/508445856 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da0108770 con 0x7f9da0108310 2024-09-11T21:55:50.265 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.135+0000 7f9d96ffd640 1 --2- 172.21.15.152:0/508445856 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f9d8c038f70 0x7f9d8c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:50.265 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.136+0000 7f9d96ffd640 1 -- 172.21.15.152:0/508445856 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9d9c06c530 con 0x7f9da0108310 2024-09-11T21:55:50.265 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.136+0000 7f9da5500640 1 --2- 172.21.15.152:0/508445856 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f9d8c038f70 0x7f9d8c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:50.265 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.136+0000 7f9da5500640 1 --2- 172.21.15.152:0/508445856 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f9d8c038f70 0x7f9d8c03b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d900098c0 tx=0x7f9d90006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:50.266 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.140+0000 7f9d96ffd640 1 -- 172.21.15.152:0/508445856 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d9c03bba0 con 0x7f9da0108310 2024-09-11T21:55:50.266 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:48.364+0000 7f9da7f65640 1 -- 172.21.15.152:0/508445856 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f9da0107150 con 0x7f9da0108310 2024-09-11T21:55:50.266 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.249+0000 7f9d96ffd640 1 -- 172.21.15.152:0/508445856 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f9da0107150 con 0x7f9da0108310 2024-09-11T21:55:50.266 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.250+0000 7f9d96ffd640 1 -- 172.21.15.152:0/508445856 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f9d9c02fd60 con 0x7f9da0108310 2024-09-11T21:55:50.266 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.252+0000 7f9da7f65640 1 -- 172.21.15.152:0/508445856 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f9d8c038f70 msgr2=0x7f9d8c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:50.266 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.252+0000 7f9da7f65640 1 --2- 172.21.15.152:0/508445856 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f9d8c038f70 0x7f9d8c03b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d900098c0 tx=0x7f9d90006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:50.266 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.252+0000 7f9da7f65640 1 -- 172.21.15.152:0/508445856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 msgr2=0x7f9da0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:50.266 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.252+0000 7f9da7f65640 1 --2- 172.21.15.152:0/508445856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da0107b90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0097f0 tx=0x7f9d9c0327b0 comp rx=0 tx=0).stop 2024-09-11T21:55:50.266 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.252+0000 7f9da7f65640 1 -- 172.21.15.152:0/508445856 shutdown_connections 2024-09-11T21:55:50.266 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.252+0000 7f9da7f65640 1 --2- 172.21.15.152:0/508445856 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7f9d8c038f70 0x7f9d8c03b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:50.267 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.252+0000 7f9da7f65640 1 --2- 172.21.15.152:0/508445856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da0108310 0x7f9da0107b90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:50.267 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.252+0000 7f9da7f65640 1 -- 172.21.15.152:0/508445856 >> 172.21.15.152:0/508445856 conn(0x7f9da0101fb0 msgr2=0x7f9da0102bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:50.267 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.252+0000 7f9da7f65640 1 -- 172.21.15.152:0/508445856 shutdown_connections 2024-09-11T21:55:50.267 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:49.252+0000 7f9da7f65640 1 -- 172.21.15.152:0/508445856 wait complete. 2024-09-11T21:55:50.539 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:50 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/508445856' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-11T21:55:50.539 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:50 smithi152 ceph-mon[31188]: mgrmap e9: x(active, since 19s) 2024-09-11T21:55:50.539 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:50 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:50.282+0000 7fe32d7f3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T21:55:50.539 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:50 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:50.344+0000 7fe32d7f3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T21:55:50.539 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:50 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:50.536+0000 7fe32d7f3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T21:55:51.445 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:51 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2743789471' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T21:55:51.447 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2024-09-11T21:55:51.454 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-11T21:55:51.454 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T21:55:51.455 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T21:55:51.455 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T21:55:51.455 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2024-09-11T21:55:51.455 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.651+0000 7fdae26a3640 1 Processor -- start 2024-09-11T21:55:51.455 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.651+0000 7fdae26a3640 1 -- start start 2024-09-11T21:55:51.455 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.652+0000 7fdae26a3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc10a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:51.455 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.652+0000 7fdae26a3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc07be40 con 0x7fdadc108380 2024-09-11T21:55:51.455 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.652+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc10a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:51.455 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.652+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc10a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54384/0 (socket says 172.21.15.152:54384) 2024-09-11T21:55:51.456 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.652+0000 7fdadbfff640 1 -- 172.21.15.152:0/1243435427 learned_addr learned my addr 172.21.15.152:0/1243435427 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:51.456 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.652+0000 7fdadbfff640 1 -- 172.21.15.152:0/1243435427 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc10acb0 con 0x7fdadc108380 2024-09-11T21:55:51.456 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.653+0000 7fdadbfff640 1 --2- 172.21.15.152:0/1243435427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc10a770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009820 tx=0x7fdacc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade67d5fb6cadbac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:51.456 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.653+0000 7fdadaffd640 1 -- 172.21.15.152:0/1243435427 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc037070 con 0x7fdadc108380 2024-09-11T21:55:51.456 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.653+0000 7fdadaffd640 1 -- 172.21.15.152:0/1243435427 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdacc032920 con 0x7fdadc108380 2024-09-11T21:55:51.456 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.653+0000 7fdadaffd640 1 -- 172.21.15.152:0/1243435427 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc030810 con 0x7fdadc108380 2024-09-11T21:55:51.457 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.654+0000 7fdae26a3640 1 -- 172.21.15.152:0/1243435427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 msgr2=0x7fdadc10a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:51.457 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.654+0000 7fdae26a3640 1 --2- 172.21.15.152:0/1243435427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc10a770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009820 tx=0x7fdacc02a270 comp rx=0 tx=0).stop 2024-09-11T21:55:51.457 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.654+0000 7fdae26a3640 1 -- 172.21.15.152:0/1243435427 shutdown_connections 2024-09-11T21:55:51.457 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.654+0000 7fdae26a3640 1 --2- 172.21.15.152:0/1243435427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc10a770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:51.457 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.654+0000 7fdae26a3640 1 -- 172.21.15.152:0/1243435427 >> 172.21.15.152:0/1243435427 conn(0x7fdadc101f60 msgr2=0x7fdadc104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:51.457 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.654+0000 7fdae26a3640 1 -- 172.21.15.152:0/1243435427 shutdown_connections 2024-09-11T21:55:51.458 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.654+0000 7fdae26a3640 1 -- 172.21.15.152:0/1243435427 wait complete. 2024-09-11T21:55:51.458 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.654+0000 7fdae26a3640 1 Processor -- start 2024-09-11T21:55:51.458 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.655+0000 7fdae26a3640 1 -- start start 2024-09-11T21:55:51.458 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.655+0000 7fdae26a3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc107c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:51.458 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.655+0000 7fdae26a3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc10bd30 con 0x7fdadc108380 2024-09-11T21:55:51.458 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.655+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:51.458 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.655+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc107c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54394/0 (socket says 172.21.15.152:54394) 2024-09-11T21:55:51.458 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.655+0000 7fdadbfff640 1 -- 172.21.15.152:0/2743789471 learned_addr learned my addr 172.21.15.152:0/2743789471 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:51.458 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.655+0000 7fdadbfff640 1 -- 172.21.15.152:0/2743789471 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc108140 con 0x7fdadc108380 2024-09-11T21:55:51.459 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.655+0000 7fdadbfff640 1 --2- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc107c00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdacc030380 tx=0x7fdacc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:51.459 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.656+0000 7fdad97fa640 1 -- 172.21.15.152:0/2743789471 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc037040 con 0x7fdadc108380 2024-09-11T21:55:51.459 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.656+0000 7fdad97fa640 1 -- 172.21.15.152:0/2743789471 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdacc040070 con 0x7fdadc108380 2024-09-11T21:55:51.459 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.656+0000 7fdae26a3640 1 -- 172.21.15.152:0/2743789471 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdadc106330 con 0x7fdadc108380 2024-09-11T21:55:51.459 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.656+0000 7fdad97fa640 1 -- 172.21.15.152:0/2743789471 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc03a7b0 con 0x7fdadc108380 2024-09-11T21:55:51.459 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.656+0000 7fdae26a3640 1 -- 172.21.15.152:0/2743789471 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdadc106870 con 0x7fdadc108380 2024-09-11T21:55:51.459 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.657+0000 7fdad97fa640 1 -- 172.21.15.152:0/2743789471 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fdacc03a9e0 con 0x7fdadc108380 2024-09-11T21:55:51.459 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.657+0000 7fdad97fa640 1 --2- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fdac8039020 0x7fdac803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:51.459 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.657+0000 7fdad97fa640 1 -- 172.21.15.152:0/2743789471 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdacc06d670 con 0x7fdadc108380 2024-09-11T21:55:51.459 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.657+0000 7fdadb7fe640 1 -- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fdac8039020 msgr2=0x7fdac803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1144560416 2024-09-11T21:55:51.460 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.657+0000 7fdadb7fe640 1 --2- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fdac8039020 0x7fdac803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T21:55:51.460 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.657+0000 7fdae26a3640 1 -- 172.21.15.152:0/2743789471 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdadc1087e0 con 0x7fdadc108380 2024-09-11T21:55:51.460 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.662+0000 7fdad97fa640 1 -- 172.21.15.152:0/2743789471 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdacc044c70 con 0x7fdadc108380 2024-09-11T21:55:51.460 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.858+0000 7fdadb7fe640 1 -- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fdac8039020 msgr2=0x7fdac803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1144560416 2024-09-11T21:55:51.461 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.858+0000 7fdadb7fe640 1 --2- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fdac8039020 0x7fdac803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T21:55:51.461 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.879+0000 7fdae26a3640 1 -- 172.21.15.152:0/2743789471 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fdadc106e20 con 0x7fdadc108380 2024-09-11T21:55:51.461 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.880+0000 7fdad97fa640 1 -- 172.21.15.152:0/2743789471 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fdacc041270 con 0x7fdadc108380 2024-09-11T21:55:51.461 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.882+0000 7fdae26a3640 1 -- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fdac8039020 msgr2=0x7fdac803b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T21:55:51.461 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.882+0000 7fdae26a3640 1 --2- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fdac8039020 0x7fdac803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:51.461 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.882+0000 7fdae26a3640 1 -- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 msgr2=0x7fdadc107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:51.461 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.882+0000 7fdae26a3640 1 --2- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc107c00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdacc030380 tx=0x7fdacc032670 comp rx=0 tx=0).stop 2024-09-11T21:55:51.461 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.882+0000 7fdae26a3640 1 -- 172.21.15.152:0/2743789471 shutdown_connections 2024-09-11T21:55:51.461 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.882+0000 7fdae26a3640 1 --2- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fdac8039020 0x7fdac803b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:51.461 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.882+0000 7fdae26a3640 1 --2- 172.21.15.152:0/2743789471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc108380 0x7fdadc107c00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:51.462 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.882+0000 7fdae26a3640 1 -- 172.21.15.152:0/2743789471 >> 172.21.15.152:0/2743789471 conn(0x7fdadc101f60 msgr2=0x7fdadc102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:51.462 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.882+0000 7fdae26a3640 1 -- 172.21.15.152:0/2743789471 shutdown_connections 2024-09-11T21:55:51.462 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:50.882+0000 7fdae26a3640 1 -- 172.21.15.152:0/2743789471 wait complete. 2024-09-11T21:55:51.462 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for the mgr to restart... 2024-09-11T21:55:51.462 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mgr epoch 9... 2024-09-11T21:55:51.730 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:51 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:51.455+0000 7fe32d7f3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T21:55:51.730 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:51 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:51.527+0000 7fe32d7f3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T21:55:52.318 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:52.270+0000 7fe32d7f3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T21:55:52.610 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:52.392+0000 7fe32d7f3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T21:55:52.610 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:52.544+0000 7fe32d7f3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T21:55:52.610 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:52.609+0000 7fe32d7f3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T21:55:52.898 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:52.765+0000 7fe32d7f3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T21:55:52.898 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:52.835+0000 7fe32d7f3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T21:55:52.898 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:52.897+0000 7fe32d7f3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T21:55:53.198 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:53.061+0000 7fe32d7f3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T21:55:53.199 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:53.129+0000 7fe32d7f3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T21:55:53.199 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:53.197+0000 7fe32d7f3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T21:55:53.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:53.283+0000 7fe32d7f3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T21:55:53.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:53.346+0000 7fe32d7f3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T21:55:53.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:53.405+0000 7fe32d7f3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T21:55:54.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:54.192+0000 7fe32d7f3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T21:55:54.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: Active manager daemon x restarted 2024-09-11T21:55:54.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: Activating manager daemon x 2024-09-11T21:55:54.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: osdmap e3: 0 total, 0 up, 0 in 2024-09-11T21:55:54.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: mgrmap e10: x(active, starting, since 0.00348168s) 2024-09-11T21:55:54.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:55:54.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T21:55:54.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T21:55:54.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T21:55:54.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T21:55:54.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: Manager daemon x is now available 2024-09-11T21:55:54.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:55:54.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T21:55:54.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T21:55:56.090 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:55.991+0000 7fe2932bc640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:21:55:55] ENGINE Error in HTTPServer.serve 2024-09-11T21:55:56.090 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: Traceback (most recent call last): 2024-09-11T21:55:56.090 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T21:55:56.090 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self._connections.run(self.expiration_interval) 2024-09-11T21:55:56.090 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T21:55:56.090 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self._run(expiration_interval) 2024-09-11T21:55:56.090 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T21:55:56.090 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T21:55:56.091 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T21:55:56.091 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T21:55:56.091 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T21:55:56.091 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: s = self.context.wrap_socket( 2024-09-11T21:55:56.091 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T21:55:56.091 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: return self.sslsocket_class._create( 2024-09-11T21:55:56.091 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T21:55:56.091 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self.do_handshake() 2024-09-11T21:55:56.091 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T21:55:56.092 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self._sslobj.do_handshake() 2024-09-11T21:55:56.092 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T21:55:56.092 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 21:55:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T21:55:56.100 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2024-09-11T21:55:56.100 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-11T21:55:56.100 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T21:55:56.100 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2024-09-11T21:55:56.100 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.827+0000 7fce80861640 1 Processor -- start 2024-09-11T21:55:56.100 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.827+0000 7fce80861640 1 -- start start 2024-09-11T21:55:56.101 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.827+0000 7fce80861640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c10a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:56.101 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.827+0000 7fce80861640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c075a70 con 0x7fce7c108370 2024-09-11T21:55:56.101 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.827+0000 7fce7a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c10a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:56.101 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.827+0000 7fce7a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c10a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54410/0 (socket says 172.21.15.152:54410) 2024-09-11T21:55:56.101 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.827+0000 7fce7a59c640 1 -- 172.21.15.152:0/1173077516 learned_addr learned my addr 172.21.15.152:0/1173077516 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:56.101 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.827+0000 7fce7a59c640 1 -- 172.21.15.152:0/1173077516 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c10aca0 con 0x7fce7c108370 2024-09-11T21:55:56.101 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.828+0000 7fce7a59c640 1 --2- 172.21.15.152:0/1173077516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c10a760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009820 tx=0x7fce6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760a3b2fdb406d33 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:56.101 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.828+0000 7fce79d9b640 1 -- 172.21.15.152:0/1173077516 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c037070 con 0x7fce7c108370 2024-09-11T21:55:56.101 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.828+0000 7fce79d9b640 1 -- 172.21.15.152:0/1173077516 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce6c032920 con 0x7fce7c108370 2024-09-11T21:55:56.102 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.828+0000 7fce79d9b640 1 -- 172.21.15.152:0/1173077516 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c030810 con 0x7fce7c108370 2024-09-11T21:55:56.102 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.829+0000 7fce80861640 1 -- 172.21.15.152:0/1173077516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 msgr2=0x7fce7c10a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:56.102 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.829+0000 7fce80861640 1 --2- 172.21.15.152:0/1173077516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c10a760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009820 tx=0x7fce6c02a270 comp rx=0 tx=0).stop 2024-09-11T21:55:56.102 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.829+0000 7fce80861640 1 -- 172.21.15.152:0/1173077516 shutdown_connections 2024-09-11T21:55:56.102 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.829+0000 7fce80861640 1 --2- 172.21.15.152:0/1173077516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c10a760 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:56.102 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.829+0000 7fce80861640 1 -- 172.21.15.152:0/1173077516 >> 172.21.15.152:0/1173077516 conn(0x7fce7c101fb0 msgr2=0x7fce7c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:56.102 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.829+0000 7fce80861640 1 -- 172.21.15.152:0/1173077516 shutdown_connections 2024-09-11T21:55:56.102 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.829+0000 7fce80861640 1 -- 172.21.15.152:0/1173077516 wait complete. 2024-09-11T21:55:56.102 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.830+0000 7fce80861640 1 Processor -- start 2024-09-11T21:55:56.102 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.830+0000 7fce80861640 1 -- start start 2024-09-11T21:55:56.102 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.830+0000 7fce80861640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.830+0000 7fce80861640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c10bcc0 con 0x7fce7c108370 2024-09-11T21:55:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.830+0000 7fce7a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.830+0000 7fce7a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54418/0 (socket says 172.21.15.152:54418) 2024-09-11T21:55:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.830+0000 7fce7a59c640 1 -- 172.21.15.152:0/2368351090 learned_addr learned my addr 172.21.15.152:0/2368351090 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.830+0000 7fce7a59c640 1 -- 172.21.15.152:0/2368351090 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c19bde0 con 0x7fce7c108370 2024-09-11T21:55:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.831+0000 7fce7a59c640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c19b8a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce6c030380 tx=0x7fce6c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.831+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c037040 con 0x7fce7c108370 2024-09-11T21:55:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.831+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce6c040070 con 0x7fce7c108370 2024-09-11T21:55:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.831+0000 7fce80861640 1 -- 172.21.15.152:0/2368351090 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7c19c070 con 0x7fce7c108370 2024-09-11T21:55:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.831+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c03a7b0 con 0x7fce7c108370 2024-09-11T21:55:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.831+0000 7fce80861640 1 -- 172.21.15.152:0/2368351090 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7c19ed60 con 0x7fce7c108370 2024-09-11T21:55:56.104 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.832+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fce6c03aa30 con 0x7fce7c108370 2024-09-11T21:55:56.104 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.832+0000 7fce737fe640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 0x7fce6803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:56.104 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.832+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 --> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fce6803bb90 con 0x7fce68038fc0 2024-09-11T21:55:56.104 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.832+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fce6c06c660 con 0x7fce7c108370 2024-09-11T21:55:56.104 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.832+0000 7fce73fff640 1 -- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 msgr2=0x7fce6803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1144560416 2024-09-11T21:55:56.104 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:51.832+0000 7fce73fff640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 0x7fce6803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T21:55:56.104 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:52.033+0000 7fce73fff640 1 -- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 msgr2=0x7fce6803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1144560416 2024-09-11T21:55:56.104 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:52.033+0000 7fce73fff640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 0x7fce6803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T21:55:56.104 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:52.434+0000 7fce73fff640 1 -- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 msgr2=0x7fce6803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1144560416 2024-09-11T21:55:56.104 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:52.434+0000 7fce73fff640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 0x7fce6803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T21:55:56.105 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:53.235+0000 7fce73fff640 1 -- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 msgr2=0x7fce6803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1144560416 2024-09-11T21:55:56.105 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:53.235+0000 7fce73fff640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 0x7fce6803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T21:55:56.105 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:54.196+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7fce6c06b110 con 0x7fce7c108370 2024-09-11T21:55:56.105 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:54.196+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 msgr2=0x7fce6803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T21:55:56.105 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:54.196+0000 7fce737fe640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 0x7fce6803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:56.105 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.198+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fce6c045460 con 0x7fce7c108370 2024-09-11T21:55:56.105 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.198+0000 7fce737fe640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fce6803ca80 0x7fce6803ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:56.105 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.198+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fce6803bb90 con 0x7fce6803ca80 2024-09-11T21:55:56.105 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.198+0000 7fce73fff640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fce6803ca80 0x7fce6803ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:56.105 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.199+0000 7fce73fff640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fce6803ca80 0x7fce6803ee70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fce64003980 tx=0x7fce64006e10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:56.106 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.200+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fce6803bb90 con 0x7fce6803ca80 2024-09-11T21:55:56.106 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.207+0000 7fce80861640 1 -- 172.21.15.152:0/2368351090 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fce7c1087d0 con 0x7fce6803ca80 2024-09-11T21:55:56.106 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.207+0000 7fce737fe640 1 -- 172.21.15.152:0/2368351090 <== mgr.14148 v2:172.21.15.152:6800/3828412393 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fce7c1087d0 con 0x7fce6803ca80 2024-09-11T21:55:56.106 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.207+0000 7fce80861640 1 -- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fce6803ca80 msgr2=0x7fce6803ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:56.106 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.207+0000 7fce80861640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fce6803ca80 0x7fce6803ee70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fce64003980 tx=0x7fce64006e10 comp rx=0 tx=0).stop 2024-09-11T21:55:56.106 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.207+0000 7fce80861640 1 -- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 msgr2=0x7fce7c19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:56.106 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.207+0000 7fce80861640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c19b8a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce6c030380 tx=0x7fce6c032670 comp rx=0 tx=0).stop 2024-09-11T21:55:56.106 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.207+0000 7fce80861640 1 -- 172.21.15.152:0/2368351090 shutdown_connections 2024-09-11T21:55:56.106 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.207+0000 7fce80861640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fce6803ca80 0x7fce6803ee70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:56.106 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.207+0000 7fce80861640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:6800/1144560416,v1:172.21.15.152:6801/1144560416] conn(0x7fce68038fc0 0x7fce6803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:56.106 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.207+0000 7fce80861640 1 --2- 172.21.15.152:0/2368351090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c108370 0x7fce7c19b8a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:56.107 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.208+0000 7fce80861640 1 -- 172.21.15.152:0/2368351090 >> 172.21.15.152:0/2368351090 conn(0x7fce7c101fb0 msgr2=0x7fce7c102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:56.107 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.208+0000 7fce80861640 1 -- 172.21.15.152:0/2368351090 shutdown_connections 2024-09-11T21:55:56.107 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:55.208+0000 7fce80861640 1 -- 172.21.15.152:0/2368351090 wait complete. 2024-09-11T21:55:56.107 INFO:teuthology.orchestra.run.smithi152.stdout:mgr epoch 9 is available 2024-09-11T21:55:56.107 INFO:teuthology.orchestra.run.smithi152.stdout:Generating a dashboard self-signed certificate... 2024-09-11T21:55:56.348 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:56 smithi152 ceph-mon[31188]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T21:55:56.349 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:56 smithi152 ceph-mon[31188]: mgrmap e11: x(active, since 1.00632s) 2024-09-11T21:55:56.349 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:56 smithi152 ceph-mon[31188]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T21:55:56.349 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:55:57.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-11T21:55:57.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.541+0000 7ff60da9c640 1 Processor -- start 2024-09-11T21:55:57.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.541+0000 7ff60da9c640 1 -- start start 2024-09-11T21:55:57.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.541+0000 7ff60da9c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff608106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:57.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.541+0000 7ff60da9c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff608107150 con 0x7ff608106780 2024-09-11T21:55:57.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.542+0000 7ff6077fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff608106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:57.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.542+0000 7ff6077fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff608106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53412/0 (socket says 172.21.15.152:53412) 2024-09-11T21:55:57.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.542+0000 7ff6077fe640 1 -- 172.21.15.152:0/3038312087 learned_addr learned my addr 172.21.15.152:0/3038312087 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:57.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.542+0000 7ff6077fe640 1 -- 172.21.15.152:0/3038312087 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff608107980 con 0x7ff608106780 2024-09-11T21:55:57.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.543+0000 7ff6077fe640 1 --2- 172.21.15.152:0/3038312087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff608106b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009820 tx=0x7ff5f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2931db6febb46bee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:57.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.543+0000 7ff6067fc640 1 -- 172.21.15.152:0/3038312087 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8037070 con 0x7ff608106780 2024-09-11T21:55:57.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.543+0000 7ff6067fc640 1 -- 172.21.15.152:0/3038312087 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5f8032920 con 0x7ff608106780 2024-09-11T21:55:57.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.543+0000 7ff6067fc640 1 -- 172.21.15.152:0/3038312087 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8030810 con 0x7ff608106780 2024-09-11T21:55:57.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.544+0000 7ff60da9c640 1 -- 172.21.15.152:0/3038312087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 msgr2=0x7ff608106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:57.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.544+0000 7ff60da9c640 1 --2- 172.21.15.152:0/3038312087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff608106b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009820 tx=0x7ff5f802a270 comp rx=0 tx=0).stop 2024-09-11T21:55:57.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.544+0000 7ff60da9c640 1 -- 172.21.15.152:0/3038312087 shutdown_connections 2024-09-11T21:55:57.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.544+0000 7ff60da9c640 1 --2- 172.21.15.152:0/3038312087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff608106b80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:57.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.544+0000 7ff60da9c640 1 -- 172.21.15.152:0/3038312087 >> 172.21.15.152:0/3038312087 conn(0x7ff608101fb0 msgr2=0x7ff6081043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.544+0000 7ff60da9c640 1 -- 172.21.15.152:0/3038312087 shutdown_connections 2024-09-11T21:55:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.544+0000 7ff60da9c640 1 -- 172.21.15.152:0/3038312087 wait complete. 2024-09-11T21:55:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.545+0000 7ff60da9c640 1 Processor -- start 2024-09-11T21:55:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.545+0000 7ff60da9c640 1 -- start start 2024-09-11T21:55:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.545+0000 7ff60da9c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff60819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.545+0000 7ff60da9c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff60810ad30 con 0x7ff608106780 2024-09-11T21:55:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.545+0000 7ff6077fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff60819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.545+0000 7ff6077fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff60819a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53416/0 (socket says 172.21.15.152:53416) 2024-09-11T21:55:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.545+0000 7ff6077fe640 1 -- 172.21.15.152:0/3969031495 learned_addr learned my addr 172.21.15.152:0/3969031495 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.545+0000 7ff6077fe640 1 -- 172.21.15.152:0/3969031495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60819ad10 con 0x7ff608106780 2024-09-11T21:55:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.545+0000 7ff6077fe640 1 --2- 172.21.15.152:0/3969031495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff60819a7d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8030560 tx=0x7ff5f8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.546+0000 7ff604ff9640 1 -- 172.21.15.152:0/3969031495 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8037040 con 0x7ff608106780 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.546+0000 7ff604ff9640 1 -- 172.21.15.152:0/3969031495 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5f8040070 con 0x7ff608106780 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.546+0000 7ff60da9c640 1 -- 172.21.15.152:0/3969031495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff60819afa0 con 0x7ff608106780 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.546+0000 7ff604ff9640 1 -- 172.21.15.152:0/3969031495 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f803a740 con 0x7ff608106780 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.546+0000 7ff60da9c640 1 -- 172.21.15.152:0/3969031495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff60819dc90 con 0x7ff608106780 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.547+0000 7ff604ff9640 1 -- 172.21.15.152:0/3969031495 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7ff5f803a9b0 con 0x7ff608106780 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.547+0000 7ff604ff9640 1 --2- 172.21.15.152:0/3969031495 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff5f0038eb0 0x7ff5f003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.547+0000 7ff604ff9640 1 -- 172.21.15.152:0/3969031495 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff5f806d590 con 0x7ff608106780 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.547+0000 7ff60da9c640 1 -- 172.21.15.152:0/3969031495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff60810aeb0 con 0x7ff608106780 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.547+0000 7ff606ffd640 1 --2- 172.21.15.152:0/3969031495 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff5f0038eb0 0x7ff5f003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.547+0000 7ff606ffd640 1 --2- 172.21.15.152:0/3969031495 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff5f0038eb0 0x7ff5f003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0098c0 tx=0x7ff5fc006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:57.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.553+0000 7ff604ff9640 1 -- 172.21.15.152:0/3969031495 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff5f8042e30 con 0x7ff608106780 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.700+0000 7ff604ff9640 1 -- 172.21.15.152:0/3969031495 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7ff5f8045980 con 0x7ff608106780 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.730+0000 7ff60da9c640 1 -- 172.21.15.152:0/3969031495 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7ff608103300 con 0x7ff5f0038eb0 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.775+0000 7ff604ff9640 1 -- 172.21.15.152:0/3969031495 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7ff608103300 con 0x7ff5f0038eb0 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.778+0000 7ff60da9c640 1 -- 172.21.15.152:0/3969031495 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff5f0038eb0 msgr2=0x7ff5f003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.778+0000 7ff60da9c640 1 --2- 172.21.15.152:0/3969031495 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff5f0038eb0 0x7ff5f003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0098c0 tx=0x7ff5fc006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.778+0000 7ff60da9c640 1 -- 172.21.15.152:0/3969031495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 msgr2=0x7ff60819a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.778+0000 7ff60da9c640 1 --2- 172.21.15.152:0/3969031495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff60819a7d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8030560 tx=0x7ff5f8032670 comp rx=0 tx=0).stop 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.778+0000 7ff60da9c640 1 -- 172.21.15.152:0/3969031495 shutdown_connections 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.778+0000 7ff60da9c640 1 --2- 172.21.15.152:0/3969031495 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff5f0038eb0 0x7ff5f003b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.778+0000 7ff60da9c640 1 --2- 172.21.15.152:0/3969031495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff608106780 0x7ff60819a7d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.778+0000 7ff60da9c640 1 -- 172.21.15.152:0/3969031495 >> 172.21.15.152:0/3969031495 conn(0x7ff608101fb0 msgr2=0x7ff608102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:57.325 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.778+0000 7ff60da9c640 1 -- 172.21.15.152:0/3969031495 shutdown_connections 2024-09-11T21:55:57.326 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:56.778+0000 7ff60da9c640 1 -- 172.21.15.152:0/3969031495 wait complete. 2024-09-11T21:55:57.326 INFO:teuthology.orchestra.run.smithi152.stdout:Creating initial admin user... 2024-09-11T21:55:57.431 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:57 smithi152 ceph-mon[31188]: [11/Sep/2024:21:55:55] ENGINE Bus STARTING 2024-09-11T21:55:57.431 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:57 smithi152 ceph-mon[31188]: [11/Sep/2024:21:55:55] ENGINE Serving on http://172.21.15.152:8765 2024-09-11T21:55:57.431 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:57 smithi152 ceph-mon[31188]: [11/Sep/2024:21:55:55] ENGINE Serving on https://172.21.15.152:7150 2024-09-11T21:55:57.431 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:57 smithi152 ceph-mon[31188]: [11/Sep/2024:21:55:55] ENGINE Bus STARTED 2024-09-11T21:55:57.431 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:57 smithi152 ceph-mon[31188]: [11/Sep/2024:21:55:55] ENGINE Error in HTTPServer.serve 2024-09-11T21:55:57.431 INFO:journalctl@ceph.mon.a.smithi152.stdout: Traceback (most recent call last): 2024-09-11T21:55:57.431 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: self._connections.run(self.expiration_interval) 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: self._run(expiration_interval) 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: s = self.context.wrap_socket( 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: return self.sslsocket_class._create( 2024-09-11T21:55:57.432 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T21:55:57.433 INFO:journalctl@ceph.mon.a.smithi152.stdout: self.do_handshake() 2024-09-11T21:55:57.433 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T21:55:57.433 INFO:journalctl@ceph.mon.a.smithi152.stdout: self._sslobj.do_handshake() 2024-09-11T21:55:57.433 INFO:journalctl@ceph.mon.a.smithi152.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T21:55:57.433 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:57 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:55:57.433 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:57 smithi152 ceph-mon[31188]: mgrmap e12: x(active, since 2s) 2024-09-11T21:55:57.433 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:57 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:55:57.433 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:57 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:55:58.457 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:58 smithi152 ceph-mon[31188]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:55:59.319 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$mdgSse3J3AJLFIFIQ4wNsuhg/1zGCl6Pq0NNdauaX5ObIyEFbO8Rq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726091758, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-11T21:55:59.319 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.326+0000 7f5943a17640 1 Processor -- start 2024-09-11T21:55:59.319 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.326+0000 7f5943a17640 1 -- start start 2024-09-11T21:55:59.319 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.327+0000 7f5943a17640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c107d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:59.319 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.327+0000 7f5943a17640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f593c108360 con 0x7f593c107990 2024-09-11T21:55:59.319 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.327+0000 7f59417b3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c107d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:59.319 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.327+0000 7f59417b3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c107d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53422/0 (socket says 172.21.15.152:53422) 2024-09-11T21:55:59.320 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.327+0000 7f59417b3640 1 -- 172.21.15.152:0/2257508533 learned_addr learned my addr 172.21.15.152:0/2257508533 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:59.320 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.327+0000 7f59417b3640 1 -- 172.21.15.152:0/2257508533 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c108b40 con 0x7f593c107990 2024-09-11T21:55:59.320 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.328+0000 7f59417b3640 1 --2- 172.21.15.152:0/2257508533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c107d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5938009820 tx=0x7f593802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de52894f8022d404 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:59.320 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.328+0000 7f5933fff640 1 -- 172.21.15.152:0/2257508533 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5938037070 con 0x7f593c107990 2024-09-11T21:55:59.320 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.328+0000 7f5933fff640 1 -- 172.21.15.152:0/2257508533 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5938032920 con 0x7f593c107990 2024-09-11T21:55:59.320 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.328+0000 7f5933fff640 1 -- 172.21.15.152:0/2257508533 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5938030810 con 0x7f593c107990 2024-09-11T21:55:59.320 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.329+0000 7f5943a17640 1 -- 172.21.15.152:0/2257508533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 msgr2=0x7f593c107d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:59.320 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.329+0000 7f5943a17640 1 --2- 172.21.15.152:0/2257508533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c107d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5938009820 tx=0x7f593802a270 comp rx=0 tx=0).stop 2024-09-11T21:55:59.320 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.329+0000 7f5943a17640 1 -- 172.21.15.152:0/2257508533 shutdown_connections 2024-09-11T21:55:59.320 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.329+0000 7f5943a17640 1 --2- 172.21.15.152:0/2257508533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c107d90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:59.320 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.329+0000 7f5943a17640 1 -- 172.21.15.152:0/2257508533 >> 172.21.15.152:0/2257508533 conn(0x7f593c103180 msgr2=0x7f593c1055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:59.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.329+0000 7f5943a17640 1 -- 172.21.15.152:0/2257508533 shutdown_connections 2024-09-11T21:55:59.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.329+0000 7f5943a17640 1 -- 172.21.15.152:0/2257508533 wait complete. 2024-09-11T21:55:59.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.329+0000 7f5943a17640 1 Processor -- start 2024-09-11T21:55:59.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.329+0000 7f5943a17640 1 -- start start 2024-09-11T21:55:59.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f5943a17640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:59.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f5943a17640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f593c10bef0 con 0x7f593c107990 2024-09-11T21:55:59.321 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f59417b3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:59.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f59417b3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c19b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53424/0 (socket says 172.21.15.152:53424) 2024-09-11T21:55:59.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f59417b3640 1 -- 172.21.15.152:0/2367028006 learned_addr learned my addr 172.21.15.152:0/2367028006 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:55:59.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f59417b3640 1 -- 172.21.15.152:0/2367028006 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c19bf20 con 0x7f593c107990 2024-09-11T21:55:59.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f59417b3640 1 --2- 172.21.15.152:0/2367028006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c19b9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5938030560 tx=0x7f5938032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:59.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f59327fc640 1 -- 172.21.15.152:0/2367028006 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5938037040 con 0x7f593c107990 2024-09-11T21:55:59.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f59327fc640 1 -- 172.21.15.152:0/2367028006 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5938040070 con 0x7f593c107990 2024-09-11T21:55:59.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f5943a17640 1 -- 172.21.15.152:0/2367028006 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593c19c1b0 con 0x7f593c107990 2024-09-11T21:55:59.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f59327fc640 1 -- 172.21.15.152:0/2367028006 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f593803a740 con 0x7f593c107990 2024-09-11T21:55:59.322 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.330+0000 7f5943a17640 1 -- 172.21.15.152:0/2367028006 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593c19eea0 con 0x7f593c107990 2024-09-11T21:55:59.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.331+0000 7f59327fc640 1 -- 172.21.15.152:0/2367028006 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f593803b420 con 0x7f593c107990 2024-09-11T21:55:59.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.331+0000 7f59327fc640 1 --2- 172.21.15.152:0/2367028006 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5928038fc0 0x7f592803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:55:59.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.331+0000 7f5943a17640 1 -- 172.21.15.152:0/2367028006 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593c10c070 con 0x7f593c107990 2024-09-11T21:55:59.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.332+0000 7f59327fc640 1 -- 172.21.15.152:0/2367028006 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f593806c6d0 con 0x7f593c107990 2024-09-11T21:55:59.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.332+0000 7f5940fb2640 1 --2- 172.21.15.152:0/2367028006 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5928038fc0 0x7f592803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:55:59.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.332+0000 7f5940fb2640 1 --2- 172.21.15.152:0/2367028006 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5928038fc0 0x7f592803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f592c0098c0 tx=0x7f592c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:55:59.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.336+0000 7f59327fc640 1 -- 172.21.15.152:0/2367028006 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f593804a200 con 0x7f593c107990 2024-09-11T21:55:59.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.523+0000 7f5943a17640 1 -- 172.21.15.152:0/2367028006 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f593c107e10 con 0x7f5928038fc0 2024-09-11T21:55:59.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.745+0000 7f59327fc640 1 -- 172.21.15.152:0/2367028006 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f593c107e10 con 0x7f5928038fc0 2024-09-11T21:55:59.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.748+0000 7f5943a17640 1 -- 172.21.15.152:0/2367028006 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5928038fc0 msgr2=0x7f592803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:59.323 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.748+0000 7f5943a17640 1 --2- 172.21.15.152:0/2367028006 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5928038fc0 0x7f592803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f592c0098c0 tx=0x7f592c006db0 comp rx=0 tx=0).stop 2024-09-11T21:55:59.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.748+0000 7f5943a17640 1 -- 172.21.15.152:0/2367028006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 msgr2=0x7f593c19b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:55:59.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.748+0000 7f5943a17640 1 --2- 172.21.15.152:0/2367028006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c19b9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5938030560 tx=0x7f5938032670 comp rx=0 tx=0).stop 2024-09-11T21:55:59.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.748+0000 7f5943a17640 1 -- 172.21.15.152:0/2367028006 shutdown_connections 2024-09-11T21:55:59.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.748+0000 7f5943a17640 1 --2- 172.21.15.152:0/2367028006 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5928038fc0 0x7f592803b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:59.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.748+0000 7f5943a17640 1 --2- 172.21.15.152:0/2367028006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c107990 0x7f593c19b9e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:55:59.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.748+0000 7f5943a17640 1 -- 172.21.15.152:0/2367028006 >> 172.21.15.152:0/2367028006 conn(0x7f593c103180 msgr2=0x7f593c103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:55:59.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.748+0000 7f5943a17640 1 -- 172.21.15.152:0/2367028006 shutdown_connections 2024-09-11T21:55:59.324 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:58.748+0000 7f5943a17640 1 -- 172.21.15.152:0/2367028006 wait complete. 2024-09-11T21:55:59.324 INFO:teuthology.orchestra.run.smithi152.stdout:Fetching dashboard port number... 2024-09-11T21:55:59.912 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:59 smithi152 ceph-mon[31188]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:55:59.912 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:55:59 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:00.476 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 8443 2024-09-11T21:56:00.476 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.734+0000 7f51ed281640 1 Processor -- start 2024-09-11T21:56:00.476 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.735+0000 7f51ed281640 1 -- start start 2024-09-11T21:56:00.476 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.735+0000 7f51ed281640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e8105f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:00.476 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.735+0000 7f51ed281640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8106530 con 0x7f51e8105b60 2024-09-11T21:56:00.476 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.735+0000 7f51e6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e8105f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:00.476 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.735+0000 7f51e6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e8105f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53430/0 (socket says 172.21.15.152:53430) 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.735+0000 7f51e6ffd640 1 -- 172.21.15.152:0/2740038332 learned_addr learned my addr 172.21.15.152:0/2740038332 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.735+0000 7f51e6ffd640 1 -- 172.21.15.152:0/2740038332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e8108b40 con 0x7f51e8105b60 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.736+0000 7f51e6ffd640 1 --2- 172.21.15.152:0/2740038332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e8105f60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009820 tx=0x7f51d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa1bf9337cdae5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.736+0000 7f51e5ffb640 1 -- 172.21.15.152:0/2740038332 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d8037070 con 0x7f51e8105b60 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.736+0000 7f51e5ffb640 1 -- 172.21.15.152:0/2740038332 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51d8032920 con 0x7f51e8105b60 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.736+0000 7f51e5ffb640 1 -- 172.21.15.152:0/2740038332 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d8030810 con 0x7f51e8105b60 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.737+0000 7f51ed281640 1 -- 172.21.15.152:0/2740038332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 msgr2=0x7f51e8105f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.737+0000 7f51ed281640 1 --2- 172.21.15.152:0/2740038332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e8105f60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009820 tx=0x7f51d802a270 comp rx=0 tx=0).stop 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.737+0000 7f51ed281640 1 -- 172.21.15.152:0/2740038332 shutdown_connections 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.737+0000 7f51ed281640 1 --2- 172.21.15.152:0/2740038332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e8105f60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.737+0000 7f51ed281640 1 -- 172.21.15.152:0/2740038332 >> 172.21.15.152:0/2740038332 conn(0x7f51e8101750 msgr2=0x7f51e8103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:00.477 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.737+0000 7f51ed281640 1 -- 172.21.15.152:0/2740038332 shutdown_connections 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.737+0000 7f51ed281640 1 -- 172.21.15.152:0/2740038332 wait complete. 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.737+0000 7f51ed281640 1 Processor -- start 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.737+0000 7f51ed281640 1 -- start start 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51ed281640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e81083c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51ed281640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f51e810bd70 con 0x7f51e8105b60 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51e6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e81083c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51e6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e81083c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53446/0 (socket says 172.21.15.152:53446) 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51e6ffd640 1 -- 172.21.15.152:0/261022775 learned_addr learned my addr 172.21.15.152:0/261022775 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51e6ffd640 1 -- 172.21.15.152:0/261022775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e8108900 con 0x7f51e8105b60 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51e6ffd640 1 --2- 172.21.15.152:0/261022775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e81083c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f51d8030560 tx=0x7f51d8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51cffff640 1 -- 172.21.15.152:0/261022775 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d8037040 con 0x7f51e8105b60 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51cffff640 1 -- 172.21.15.152:0/261022775 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51d8040070 con 0x7f51e8105b60 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51cffff640 1 -- 172.21.15.152:0/261022775 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d803a6d0 con 0x7f51e8105b60 2024-09-11T21:56:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51ed281640 1 -- 172.21.15.152:0/261022775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e8106af0 con 0x7f51e8105b60 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.738+0000 7f51ed281640 1 -- 172.21.15.152:0/261022775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e8107030 con 0x7f51e8105b60 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.739+0000 7f51cffff640 1 -- 172.21.15.152:0/261022775 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f51d803a940 con 0x7f51e8105b60 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.739+0000 7f51ed281640 1 -- 172.21.15.152:0/261022775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e8105fe0 con 0x7f51e8105b60 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.740+0000 7f51cffff640 1 --2- 172.21.15.152:0/261022775 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51d0038fc0 0x7f51d003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.740+0000 7f51cffff640 1 -- 172.21.15.152:0/261022775 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f51d806c7f0 con 0x7f51e8105b60 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.740+0000 7f51e67fc640 1 --2- 172.21.15.152:0/261022775 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51d0038fc0 0x7f51d003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.740+0000 7f51e67fc640 1 --2- 172.21.15.152:0/261022775 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51d0038fc0 0x7f51d003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0098c0 tx=0x7f51dc006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.744+0000 7f51cffff640 1 -- 172.21.15.152:0/261022775 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51d8032920 con 0x7f51e8105b60 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.911+0000 7f51ed281640 1 -- 172.21.15.152:0/261022775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f51e81072b0 con 0x7f51e8105b60 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.911+0000 7f51cffff640 1 -- 172.21.15.152:0/261022775 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f51d803ad80 con 0x7f51e8105b60 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.914+0000 7f51ed281640 1 -- 172.21.15.152:0/261022775 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51d0038fc0 msgr2=0x7f51d003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.914+0000 7f51ed281640 1 --2- 172.21.15.152:0/261022775 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51d0038fc0 0x7f51d003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0098c0 tx=0x7f51dc006db0 comp rx=0 tx=0).stop 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.914+0000 7f51ed281640 1 -- 172.21.15.152:0/261022775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 msgr2=0x7f51e81083c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.914+0000 7f51ed281640 1 --2- 172.21.15.152:0/261022775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e81083c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f51d8030560 tx=0x7f51d8032670 comp rx=0 tx=0).stop 2024-09-11T21:56:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.914+0000 7f51ed281640 1 -- 172.21.15.152:0/261022775 shutdown_connections 2024-09-11T21:56:00.480 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.914+0000 7f51ed281640 1 --2- 172.21.15.152:0/261022775 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51d0038fc0 0x7f51d003b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:00.480 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.914+0000 7f51ed281640 1 --2- 172.21.15.152:0/261022775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e8105b60 0x7f51e81083c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:00.480 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.914+0000 7f51ed281640 1 -- 172.21.15.152:0/261022775 >> 172.21.15.152:0/261022775 conn(0x7f51e8101750 msgr2=0x7f51e8102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:00.480 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.914+0000 7f51ed281640 1 -- 172.21.15.152:0/261022775 shutdown_connections 2024-09-11T21:56:00.480 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:55:59.914+0000 7f51ed281640 1 -- 172.21.15.152:0/261022775 wait complete. 2024-09-11T21:56:00.483 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T21:56:00.484 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout disabled 2024-09-11T21:56:00.490 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T21:56:00.491 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2024-09-11T21:56:00.491 INFO:teuthology.orchestra.run.smithi152.stdout:firewalld.service is not enabled 2024-09-11T21:56:00.491 INFO:teuthology.orchestra.run.smithi152.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-11T21:56:00.493 INFO:teuthology.orchestra.run.smithi152.stdout:Ceph Dashboard is now available at: 2024-09-11T21:56:00.493 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:00.493 INFO:teuthology.orchestra.run.smithi152.stdout: URL: https://smithi152.front.sepia.ceph.com:8443/ 2024-09-11T21:56:00.493 INFO:teuthology.orchestra.run.smithi152.stdout: User: admin 2024-09-11T21:56:00.493 INFO:teuthology.orchestra.run.smithi152.stdout: Password: aro5eks2di 2024-09-11T21:56:00.493 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:00.494 INFO:teuthology.orchestra.run.smithi152.stdout:Saving cluster configuration to /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config directory 2024-09-11T21:56:00.871 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:00 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/261022775' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-11T21:56:01.761 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:01 smithi152 ceph-mon[31188]: mgrmap e13: x(active, since 6s) 2024-09-11T21:56:01.762 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:01 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1361208608' entity='client.admin' 2024-09-11T21:56:01.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.875+0000 7fc17863c640 1 Processor -- start 2024-09-11T21:56:01.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.875+0000 7fc17863c640 1 -- start start 2024-09-11T21:56:01.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.875+0000 7fc17863c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc170106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:01.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.875+0000 7fc17863c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc170107150 con 0x7fc170106780 2024-09-11T21:56:01.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.876+0000 7fc1763d8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc170106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:01.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.876+0000 7fc1763d8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc170106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53456/0 (socket says 172.21.15.152:53456) 2024-09-11T21:56:01.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.876+0000 7fc1763d8640 1 -- 172.21.15.152:0/3233408521 learned_addr learned my addr 172.21.15.152:0/3233408521 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:01.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.876+0000 7fc1763d8640 1 -- 172.21.15.152:0/3233408521 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc170107980 con 0x7fc170106780 2024-09-11T21:56:01.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.877+0000 7fc1763d8640 1 --2- 172.21.15.152:0/3233408521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc170106b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc160009e80 tx=0x7fc16002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ca48a859a8fc4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:01.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.877+0000 7fc1753d6640 1 -- 172.21.15.152:0/3233408521 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc160036070 con 0x7fc170106780 2024-09-11T21:56:01.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.877+0000 7fc1753d6640 1 -- 172.21.15.152:0/3233408521 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1600318e0 con 0x7fc170106780 2024-09-11T21:56:01.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.877+0000 7fc1753d6640 1 -- 172.21.15.152:0/3233408521 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc160007a00 con 0x7fc170106780 2024-09-11T21:56:01.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.877+0000 7fc17863c640 1 -- 172.21.15.152:0/3233408521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 msgr2=0x7fc170106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:01.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.877+0000 7fc17863c640 1 --2- 172.21.15.152:0/3233408521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc170106b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc160009e80 tx=0x7fc16002a7a0 comp rx=0 tx=0).stop 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.878+0000 7fc17863c640 1 -- 172.21.15.152:0/3233408521 shutdown_connections 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.878+0000 7fc17863c640 1 --2- 172.21.15.152:0/3233408521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc170106b80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.878+0000 7fc17863c640 1 -- 172.21.15.152:0/3233408521 >> 172.21.15.152:0/3233408521 conn(0x7fc170101fb0 msgr2=0x7fc1701043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.878+0000 7fc17863c640 1 -- 172.21.15.152:0/3233408521 shutdown_connections 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.878+0000 7fc17863c640 1 -- 172.21.15.152:0/3233408521 wait complete. 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.878+0000 7fc17863c640 1 Processor -- start 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.878+0000 7fc17863c640 1 -- start start 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.878+0000 7fc17863c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc1701919b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.878+0000 7fc17863c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc17010ad30 con 0x7fc170106780 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.879+0000 7fc1763d8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc1701919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.879+0000 7fc1763d8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc1701919b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53472/0 (socket says 172.21.15.152:53472) 2024-09-11T21:56:01.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.879+0000 7fc1763d8640 1 -- 172.21.15.152:0/1361208608 learned_addr learned my addr 172.21.15.152:0/1361208608 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.879+0000 7fc1763d8640 1 -- 172.21.15.152:0/1361208608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc170191ef0 con 0x7fc170106780 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.879+0000 7fc1763d8640 1 --2- 172.21.15.152:0/1361208608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc1701919b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc16002acc0 tx=0x7fc160031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.879+0000 7fc16f7fe640 1 -- 172.21.15.152:0/1361208608 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc160036050 con 0x7fc170106780 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.879+0000 7fc16f7fe640 1 -- 172.21.15.152:0/1361208608 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc160037040 con 0x7fc170106780 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.879+0000 7fc17863c640 1 -- 172.21.15.152:0/1361208608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1701900e0 con 0x7fc170106780 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.879+0000 7fc16f7fe640 1 -- 172.21.15.152:0/1361208608 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16003b890 con 0x7fc170106780 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.879+0000 7fc17863c640 1 -- 172.21.15.152:0/1361208608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc170190620 con 0x7fc170106780 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.880+0000 7fc16f7fe640 1 -- 172.21.15.152:0/1361208608 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fc160044020 con 0x7fc170106780 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.880+0000 7fc16f7fe640 1 --2- 172.21.15.152:0/1361208608 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1580390c0 0x7fc15803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.880+0000 7fc16f7fe640 1 -- 172.21.15.152:0/1361208608 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc160042020 con 0x7fc170106780 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.880+0000 7fc17863c640 1 -- 172.21.15.152:0/1361208608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17010aeb0 con 0x7fc170106780 2024-09-11T21:56:01.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.880+0000 7fc175bd7640 1 --2- 172.21.15.152:0/1361208608 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1580390c0 0x7fc15803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.881+0000 7fc175bd7640 1 --2- 172.21.15.152:0/1361208608 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1580390c0 0x7fc15803b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1640098c0 tx=0x7fc164006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:00.885+0000 7fc16f7fe640 1 -- 172.21.15.152:0/1361208608 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc16004b020 con 0x7fc170106780 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.135+0000 7fc17863c640 1 -- 172.21.15.152:0/1361208608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fc170195610 con 0x7fc170106780 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.137+0000 7fc16f7fe640 1 -- 172.21.15.152:0/1361208608 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fc160039b70 con 0x7fc170106780 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.139+0000 7fc17863c640 1 -- 172.21.15.152:0/1361208608 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1580390c0 msgr2=0x7fc15803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.139+0000 7fc17863c640 1 --2- 172.21.15.152:0/1361208608 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1580390c0 0x7fc15803b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1640098c0 tx=0x7fc164006db0 comp rx=0 tx=0).stop 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.139+0000 7fc17863c640 1 -- 172.21.15.152:0/1361208608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 msgr2=0x7fc1701919b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.139+0000 7fc17863c640 1 --2- 172.21.15.152:0/1361208608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc1701919b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc16002acc0 tx=0x7fc160031cc0 comp rx=0 tx=0).stop 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.139+0000 7fc17863c640 1 -- 172.21.15.152:0/1361208608 shutdown_connections 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.139+0000 7fc17863c640 1 --2- 172.21.15.152:0/1361208608 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1580390c0 0x7fc15803b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:01.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.139+0000 7fc17863c640 1 --2- 172.21.15.152:0/1361208608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc170106780 0x7fc1701919b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.139+0000 7fc17863c640 1 -- 172.21.15.152:0/1361208608 >> 172.21.15.152:0/1361208608 conn(0x7fc170101fb0 msgr2=0x7fc170102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.140+0000 7fc17863c640 1 -- 172.21.15.152:0/1361208608 shutdown_connections 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2024-09-11T21:56:01.140+0000 7fc17863c640 1 -- 172.21.15.152:0/1361208608 wait complete. 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout:Or, if you are only running a single cluster on this host: 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:01.772 INFO:teuthology.orchestra.run.smithi152.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-11T21:56:01.773 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:01.773 INFO:teuthology.orchestra.run.smithi152.stdout: ceph telemetry on 2024-09-11T21:56:01.773 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:01.773 INFO:teuthology.orchestra.run.smithi152.stdout:For more information see: 2024-09-11T21:56:01.773 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:01.773 INFO:teuthology.orchestra.run.smithi152.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-11T21:56:01.773 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:01.773 INFO:teuthology.orchestra.run.smithi152.stdout:Bootstrap complete. 2024-09-11T21:56:01.804 INFO:tasks.cephadm:Fetching config... 2024-09-11T21:56:01.805 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:56:01.805 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-11T21:56:01.821 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-11T21:56:01.821 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:56:01.821 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-11T21:56:01.878 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-11T21:56:01.878 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:56:01.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-11T21:56:01.943 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-11T21:56:01.943 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:56:01.943 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-11T21:56:01.999 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-11T21:56:01.999 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAzbvHCBvsyMvb0JGcrTZ8GtnOdzBVSxXCEDyGh8vHJO2KfkL8rk1PSpkBZGoLcWMwI8HHTV736rnpkMFZ4XxG6JoGi5/VVl6Mom0Mepa2dAliorO1/slducf3xZCQxmQk2aG5af5TybKoZd9ksiUb+Eo9GteQxEFsWBCcYB3xRy6Vy9i8cn+dmpAk/y2fZYaPwsZJZTiDSgy3gtm52pAlnNbJcNSPFrHjxdjBDbSs7OzsAAjzgXxkaN2bpsKxtZ5OixYekviaE8nRbB1Ml3tWM34vGx032RVbvkrNfCTQREgrpEY7SuDiVzhlthxSdA0NZThwtFRPJobn9LO0SnVjaKGdJZth2yyGCQN806f6VPkzyzviDz/XknLdXgSSSN0EAmVZ8TXYSg8a/uostKkCsidJRV9DgOogBW/phxDP8E9IAr6+AEGbpJSl3hOi0cyIlFjmUxFUz80PtGlcGUjHsvDI8SdVJP4wdDMDwQnqUmLCqbcIkUGOY3PRKd5UYm8= ceph-5c140ed8-7088-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T21:56:02.083 INFO:teuthology.orchestra.run.smithi152.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAzbvHCBvsyMvb0JGcrTZ8GtnOdzBVSxXCEDyGh8vHJO2KfkL8rk1PSpkBZGoLcWMwI8HHTV736rnpkMFZ4XxG6JoGi5/VVl6Mom0Mepa2dAliorO1/slducf3xZCQxmQk2aG5af5TybKoZd9ksiUb+Eo9GteQxEFsWBCcYB3xRy6Vy9i8cn+dmpAk/y2fZYaPwsZJZTiDSgy3gtm52pAlnNbJcNSPFrHjxdjBDbSs7OzsAAjzgXxkaN2bpsKxtZ5OixYekviaE8nRbB1Ml3tWM34vGx032RVbvkrNfCTQREgrpEY7SuDiVzhlthxSdA0NZThwtFRPJobn9LO0SnVjaKGdJZth2yyGCQN806f6VPkzyzviDz/XknLdXgSSSN0EAmVZ8TXYSg8a/uostKkCsidJRV9DgOogBW/phxDP8E9IAr6+AEGbpJSl3hOi0cyIlFjmUxFUz80PtGlcGUjHsvDI8SdVJP4wdDMDwQnqUmLCqbcIkUGOY3PRKd5UYm8= ceph-5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:02.094 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAzbvHCBvsyMvb0JGcrTZ8GtnOdzBVSxXCEDyGh8vHJO2KfkL8rk1PSpkBZGoLcWMwI8HHTV736rnpkMFZ4XxG6JoGi5/VVl6Mom0Mepa2dAliorO1/slducf3xZCQxmQk2aG5af5TybKoZd9ksiUb+Eo9GteQxEFsWBCcYB3xRy6Vy9i8cn+dmpAk/y2fZYaPwsZJZTiDSgy3gtm52pAlnNbJcNSPFrHjxdjBDbSs7OzsAAjzgXxkaN2bpsKxtZ5OixYekviaE8nRbB1Ml3tWM34vGx032RVbvkrNfCTQREgrpEY7SuDiVzhlthxSdA0NZThwtFRPJobn9LO0SnVjaKGdJZth2yyGCQN806f6VPkzyzviDz/XknLdXgSSSN0EAmVZ8TXYSg8a/uostKkCsidJRV9DgOogBW/phxDP8E9IAr6+AEGbpJSl3hOi0cyIlFjmUxFUz80PtGlcGUjHsvDI8SdVJP4wdDMDwQnqUmLCqbcIkUGOY3PRKd5UYm8= ceph-5c140ed8-7088-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T21:56:02.136 INFO:teuthology.orchestra.run.smithi179.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAzbvHCBvsyMvb0JGcrTZ8GtnOdzBVSxXCEDyGh8vHJO2KfkL8rk1PSpkBZGoLcWMwI8HHTV736rnpkMFZ4XxG6JoGi5/VVl6Mom0Mepa2dAliorO1/slducf3xZCQxmQk2aG5af5TybKoZd9ksiUb+Eo9GteQxEFsWBCcYB3xRy6Vy9i8cn+dmpAk/y2fZYaPwsZJZTiDSgy3gtm52pAlnNbJcNSPFrHjxdjBDbSs7OzsAAjzgXxkaN2bpsKxtZ5OixYekviaE8nRbB1Ml3tWM34vGx032RVbvkrNfCTQREgrpEY7SuDiVzhlthxSdA0NZThwtFRPJobn9LO0SnVjaKGdJZth2yyGCQN806f6VPkzyzviDz/XknLdXgSSSN0EAmVZ8TXYSg8a/uostKkCsidJRV9DgOogBW/phxDP8E9IAr6+AEGbpJSl3hOi0cyIlFjmUxFUz80PtGlcGUjHsvDI8SdVJP4wdDMDwQnqUmLCqbcIkUGOY3PRKd5UYm8= ceph-5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:02.149 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAzbvHCBvsyMvb0JGcrTZ8GtnOdzBVSxXCEDyGh8vHJO2KfkL8rk1PSpkBZGoLcWMwI8HHTV736rnpkMFZ4XxG6JoGi5/VVl6Mom0Mepa2dAliorO1/slducf3xZCQxmQk2aG5af5TybKoZd9ksiUb+Eo9GteQxEFsWBCcYB3xRy6Vy9i8cn+dmpAk/y2fZYaPwsZJZTiDSgy3gtm52pAlnNbJcNSPFrHjxdjBDbSs7OzsAAjzgXxkaN2bpsKxtZ5OixYekviaE8nRbB1Ml3tWM34vGx032RVbvkrNfCTQREgrpEY7SuDiVzhlthxSdA0NZThwtFRPJobn9LO0SnVjaKGdJZth2yyGCQN806f6VPkzyzviDz/XknLdXgSSSN0EAmVZ8TXYSg8a/uostKkCsidJRV9DgOogBW/phxDP8E9IAr6+AEGbpJSl3hOi0cyIlFjmUxFUz80PtGlcGUjHsvDI8SdVJP4wdDMDwQnqUmLCqbcIkUGOY3PRKd5UYm8= ceph-5c140ed8-7088-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T21:56:02.190 INFO:teuthology.orchestra.run.smithi193.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAzbvHCBvsyMvb0JGcrTZ8GtnOdzBVSxXCEDyGh8vHJO2KfkL8rk1PSpkBZGoLcWMwI8HHTV736rnpkMFZ4XxG6JoGi5/VVl6Mom0Mepa2dAliorO1/slducf3xZCQxmQk2aG5af5TybKoZd9ksiUb+Eo9GteQxEFsWBCcYB3xRy6Vy9i8cn+dmpAk/y2fZYaPwsZJZTiDSgy3gtm52pAlnNbJcNSPFrHjxdjBDbSs7OzsAAjzgXxkaN2bpsKxtZ5OixYekviaE8nRbB1Ml3tWM34vGx032RVbvkrNfCTQREgrpEY7SuDiVzhlthxSdA0NZThwtFRPJobn9LO0SnVjaKGdJZth2yyGCQN806f6VPkzyzviDz/XknLdXgSSSN0EAmVZ8TXYSg8a/uostKkCsidJRV9DgOogBW/phxDP8E9IAr6+AEGbpJSl3hOi0cyIlFjmUxFUz80PtGlcGUjHsvDI8SdVJP4wdDMDwQnqUmLCqbcIkUGOY3PRKd5UYm8= ceph-5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:02.202 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-11T21:56:02.450 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:56:03.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.949+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/2161847870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd98100530 msgr2=0x7fdd98100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.949+0000 7fdd9d6c6640 1 --2- 172.21.15.152:0/2161847870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd98100530 0x7fdd98100930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009880 tx=0x7fdd8802a5d0 comp rx=0 tx=0).stop 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.949+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/2161847870 shutdown_connections 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.949+0000 7fdd9d6c6640 1 --2- 172.21.15.152:0/2161847870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd98100530 0x7fdd98100930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.949+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/2161847870 >> 172.21.15.152:0/2161847870 conn(0x7fdd980fbca0 msgr2=0x7fdd980fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.949+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/2161847870 shutdown_connections 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.949+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/2161847870 wait complete. 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.949+0000 7fdd9d6c6640 1 Processor -- start 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.950+0000 7fdd9d6c6640 1 -- start start 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.950+0000 7fdd9d6c6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd98100530 0x7fdd9806a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.950+0000 7fdd9d6c6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdd98106640 con 0x7fdd98100530 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.950+0000 7fdd96ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd98100530 0x7fdd9806a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.950+0000 7fdd96ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd98100530 0x7fdd9806a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53492/0 (socket says 172.21.15.152:53492) 2024-09-11T21:56:03.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.950+0000 7fdd96ffd640 1 -- 172.21.15.152:0/3649926933 learned_addr learned my addr 172.21.15.152:0/3649926933 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.950+0000 7fdd96ffd640 1 -- 172.21.15.152:0/3649926933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd98197900 con 0x7fdd98100530 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.950+0000 7fdd96ffd640 1 --2- 172.21.15.152:0/3649926933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd98100530 0x7fdd9806a140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd88004f60 tx=0x7fdd880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.950+0000 7fdd8ffff640 1 -- 172.21.15.152:0/3649926933 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd8803f070 con 0x7fdd98100530 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.950+0000 7fdd8ffff640 1 -- 172.21.15.152:0/3649926933 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd88004d40 con 0x7fdd98100530 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.950+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/3649926933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd9819bf10 con 0x7fdd98100530 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.951+0000 7fdd8ffff640 1 -- 172.21.15.152:0/3649926933 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd88035030 con 0x7fdd98100530 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.951+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/3649926933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd9819c2b0 con 0x7fdd98100530 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.952+0000 7fdd8ffff640 1 -- 172.21.15.152:0/3649926933 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fdd88042070 con 0x7fdd98100530 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.952+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/3649926933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd98106dc0 con 0x7fdd98100530 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.952+0000 7fdd8ffff640 1 --2- 172.21.15.152:0/3649926933 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdd84039060 0x7fdd8403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.952+0000 7fdd8ffff640 1 -- 172.21.15.152:0/3649926933 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdd8806cce0 con 0x7fdd98100530 2024-09-11T21:56:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.952+0000 7fdd967fc640 1 --2- 172.21.15.152:0/3649926933 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdd84039060 0x7fdd8403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.952+0000 7fdd967fc640 1 --2- 172.21.15.152:0/3649926933 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdd84039060 0x7fdd8403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdd800098c0 tx=0x7fdd80006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:02.957+0000 7fdd8ffff640 1 -- 172.21.15.152:0/3649926933 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd88040260 con 0x7fdd98100530 2024-09-11T21:56:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.126+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/3649926933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fdd9802d9b0 con 0x7fdd98100530 2024-09-11T21:56:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.128+0000 7fdd8ffff640 1 -- 172.21.15.152:0/3649926933 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fdd880307a0 con 0x7fdd98100530 2024-09-11T21:56:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.131+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/3649926933 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdd84039060 msgr2=0x7fdd8403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.131+0000 7fdd9d6c6640 1 --2- 172.21.15.152:0/3649926933 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdd84039060 0x7fdd8403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdd800098c0 tx=0x7fdd80006db0 comp rx=0 tx=0).stop 2024-09-11T21:56:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.131+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/3649926933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd98100530 msgr2=0x7fdd9806a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.131+0000 7fdd9d6c6640 1 --2- 172.21.15.152:0/3649926933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd98100530 0x7fdd9806a140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd88004f60 tx=0x7fdd880048f0 comp rx=0 tx=0).stop 2024-09-11T21:56:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.131+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/3649926933 shutdown_connections 2024-09-11T21:56:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.131+0000 7fdd9d6c6640 1 --2- 172.21.15.152:0/3649926933 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdd84039060 0x7fdd8403b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.131+0000 7fdd9d6c6640 1 --2- 172.21.15.152:0/3649926933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd98100530 0x7fdd9806a140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.131+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/3649926933 >> 172.21.15.152:0/3649926933 conn(0x7fdd980fbca0 msgr2=0x7fdd980fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.131+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/3649926933 shutdown_connections 2024-09-11T21:56:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:03.131+0000 7fdd9d6c6640 1 -- 172.21.15.152:0/3649926933 wait complete. 2024-09-11T21:56:03.683 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-11T21:56:03.683 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-11T21:56:04.166 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:56:04.371 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:04 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3649926933' entity='client.admin' 2024-09-11T21:56:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.974+0000 7f077f49a640 1 -- 172.21.15.152:0/1266325503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778101640 msgr2=0x7f0778101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.974+0000 7f077f49a640 1 --2- 172.21.15.152:0/1266325503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778101640 0x7f0778101a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0774009880 tx=0x7f077402a5d0 comp rx=0 tx=0).stop 2024-09-11T21:56:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.974+0000 7f077f49a640 1 -- 172.21.15.152:0/1266325503 shutdown_connections 2024-09-11T21:56:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.974+0000 7f077f49a640 1 --2- 172.21.15.152:0/1266325503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778101640 0x7f0778101a40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.974+0000 7f077f49a640 1 -- 172.21.15.152:0/1266325503 >> 172.21.15.152:0/1266325503 conn(0x7f07780fcdf0 msgr2=0x7f07780ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.975+0000 7f077f49a640 1 -- 172.21.15.152:0/1266325503 shutdown_connections 2024-09-11T21:56:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.975+0000 7f077f49a640 1 -- 172.21.15.152:0/1266325503 wait complete. 2024-09-11T21:56:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.975+0000 7f077f49a640 1 Processor -- start 2024-09-11T21:56:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.975+0000 7f077f49a640 1 -- start start 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.976+0000 7f077f49a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778101640 0x7f0778199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.976+0000 7f077f49a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0778107750 con 0x7f0778101640 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.976+0000 7f077d236640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778101640 0x7f0778199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.976+0000 7f077d236640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778101640 0x7f0778199070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33856/0 (socket says 172.21.15.152:33856) 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.976+0000 7f077d236640 1 -- 172.21.15.152:0/1975847969 learned_addr learned my addr 172.21.15.152:0/1975847969 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.976+0000 7f077d236640 1 -- 172.21.15.152:0/1975847969 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07781995b0 con 0x7f0778101640 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.976+0000 7f077d236640 1 --2- 172.21.15.152:0/1975847969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778101640 0x7f0778199070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0774009230 tx=0x7f07740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.976+0000 7f076e7fc640 1 -- 172.21.15.152:0/1975847969 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f077403f070 con 0x7f0778101640 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.976+0000 7f077f49a640 1 -- 172.21.15.152:0/1975847969 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0778199840 con 0x7f0778101640 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.977+0000 7f076e7fc640 1 -- 172.21.15.152:0/1975847969 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0774003ad0 con 0x7f0778101640 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.977+0000 7f077f49a640 1 -- 172.21.15.152:0/1975847969 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077819c530 con 0x7f0778101640 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.977+0000 7f076e7fc640 1 -- 172.21.15.152:0/1975847969 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0774035030 con 0x7f0778101640 2024-09-11T21:56:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.977+0000 7f077f49a640 1 -- 172.21.15.152:0/1975847969 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0778107ed0 con 0x7f0778101640 2024-09-11T21:56:05.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.978+0000 7f076e7fc640 1 -- 172.21.15.152:0/1975847969 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f0774042070 con 0x7f0778101640 2024-09-11T21:56:05.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.978+0000 7f076e7fc640 1 --2- 172.21.15.152:0/1975847969 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0764039060 0x7f076403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:05.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.978+0000 7f076e7fc640 1 -- 172.21.15.152:0/1975847969 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f077406cd80 con 0x7f0778101640 2024-09-11T21:56:05.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.978+0000 7f077ca35640 1 --2- 172.21.15.152:0/1975847969 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0764039060 0x7f076403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:05.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.978+0000 7f077ca35640 1 --2- 172.21.15.152:0/1975847969 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0764039060 0x7f076403b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f07680098c0 tx=0x7f0768006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:05.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:04.983+0000 7f076e7fc640 1 -- 172.21.15.152:0/1975847969 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0774039350 con 0x7f0778101640 2024-09-11T21:56:05.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.162+0000 7f077f49a640 1 -- 172.21.15.152:0/1975847969 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f077802d830 con 0x7f0764039060 2024-09-11T21:56:05.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.166+0000 7f076e7fc640 1 -- 172.21.15.152:0/1975847969 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f077802d830 con 0x7f0764039060 2024-09-11T21:56:05.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.168+0000 7f077f49a640 1 -- 172.21.15.152:0/1975847969 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0764039060 msgr2=0x7f076403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:05.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.168+0000 7f077f49a640 1 --2- 172.21.15.152:0/1975847969 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0764039060 0x7f076403b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f07680098c0 tx=0x7f0768006db0 comp rx=0 tx=0).stop 2024-09-11T21:56:05.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.168+0000 7f077f49a640 1 -- 172.21.15.152:0/1975847969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778101640 msgr2=0x7f0778199070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:05.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.168+0000 7f077f49a640 1 --2- 172.21.15.152:0/1975847969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778101640 0x7f0778199070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0774009230 tx=0x7f07740048f0 comp rx=0 tx=0).stop 2024-09-11T21:56:05.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.168+0000 7f077f49a640 1 -- 172.21.15.152:0/1975847969 shutdown_connections 2024-09-11T21:56:05.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.168+0000 7f077f49a640 1 --2- 172.21.15.152:0/1975847969 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0764039060 0x7f076403b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:05.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.168+0000 7f077f49a640 1 --2- 172.21.15.152:0/1975847969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778101640 0x7f0778199070 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:05.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.168+0000 7f077f49a640 1 -- 172.21.15.152:0/1975847969 >> 172.21.15.152:0/1975847969 conn(0x7f07780fcdf0 msgr2=0x7f07780ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:05.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.168+0000 7f077f49a640 1 -- 172.21.15.152:0/1975847969 shutdown_connections 2024-09-11T21:56:05.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:05.168+0000 7f077f49a640 1 -- 172.21.15.152:0/1975847969 wait complete. 2024-09-11T21:56:05.965 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi179 2024-09-11T21:56:05.965 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-11T21:56:05.965 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.conf 2024-09-11T21:56:05.983 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-11T21:56:05.983 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T21:56:06.040 INFO:tasks.cephadm:Adding host smithi179 to orchestrator... 2024-09-11T21:56:06.040 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch host add smithi179 2024-09-11T21:56:06.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:06 smithi152 ceph-mon[31188]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:56:06.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:06 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:56:06.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.924+0000 7f01862e5640 1 -- 172.21.15.152:0/1407924926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0180100520 msgr2=0x7f0180100920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.924+0000 7f01862e5640 1 --2- 172.21.15.152:0/1407924926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0180100520 0x7f0180100920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0170009880 tx=0x7f017002a5d0 comp rx=0 tx=0).stop 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.924+0000 7f01862e5640 1 -- 172.21.15.152:0/1407924926 shutdown_connections 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.924+0000 7f01862e5640 1 --2- 172.21.15.152:0/1407924926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0180100520 0x7f0180100920 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.924+0000 7f01862e5640 1 -- 172.21.15.152:0/1407924926 >> 172.21.15.152:0/1407924926 conn(0x7f01800fbcb0 msgr2=0x7f01800fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.924+0000 7f01862e5640 1 -- 172.21.15.152:0/1407924926 shutdown_connections 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.924+0000 7f01862e5640 1 -- 172.21.15.152:0/1407924926 wait complete. 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.925+0000 7f01862e5640 1 Processor -- start 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.925+0000 7f01862e5640 1 -- start start 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.925+0000 7f01862e5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0180100520 0x7f01800fdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.925+0000 7f01862e5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0180106630 con 0x7f0180100520 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.925+0000 7f017ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0180100520 0x7f01800fdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:06.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.925+0000 7f017ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0180100520 0x7f01800fdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33880/0 (socket says 172.21.15.152:33880) 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.925+0000 7f017ffff640 1 -- 172.21.15.152:0/308924453 learned_addr learned my addr 172.21.15.152:0/308924453 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.925+0000 7f017ffff640 1 -- 172.21.15.152:0/308924453 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01800fe0b0 con 0x7f0180100520 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.926+0000 7f017ffff640 1 --2- 172.21.15.152:0/308924453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0180100520 0x7f01800fdb70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0170004f60 tx=0x7f01700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.926+0000 7f017d7fa640 1 -- 172.21.15.152:0/308924453 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f017003f070 con 0x7f0180100520 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.926+0000 7f017d7fa640 1 -- 172.21.15.152:0/308924453 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0170004d40 con 0x7f0180100520 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.926+0000 7f01862e5640 1 -- 172.21.15.152:0/308924453 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01800fc2a0 con 0x7f0180100520 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.926+0000 7f017d7fa640 1 -- 172.21.15.152:0/308924453 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0170035030 con 0x7f0180100520 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.926+0000 7f01862e5640 1 -- 172.21.15.152:0/308924453 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01800fc7e0 con 0x7f0180100520 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.927+0000 7f017d7fa640 1 -- 172.21.15.152:0/308924453 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f0170042070 con 0x7f0180100520 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.927+0000 7f017d7fa640 1 --2- 172.21.15.152:0/308924453 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0168039060 0x7f016803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.927+0000 7f01862e5640 1 -- 172.21.15.152:0/308924453 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0180106db0 con 0x7f0180100520 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.927+0000 7f017d7fa640 1 -- 172.21.15.152:0/308924453 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f017006ccd0 con 0x7f0180100520 2024-09-11T21:56:06.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.927+0000 7f017f7fe640 1 --2- 172.21.15.152:0/308924453 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0168039060 0x7f016803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:06.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.928+0000 7f017f7fe640 1 --2- 172.21.15.152:0/308924453 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0168039060 0x7f016803b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f01740098c0 tx=0x7f0174006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:06.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:06.932+0000 7f017d7fa640 1 -- 172.21.15.152:0/308924453 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f017002c140 con 0x7f0180100520 2024-09-11T21:56:07.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:07.112+0000 7f01862e5640 1 -- 172.21.15.152:0/308924453 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}) -- 0x7f01801902c0 con 0x7f0168039060 2024-09-11T21:56:07.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:07.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:07.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:56:07.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:07.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:07.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-11T21:56:07.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: Updating smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:07.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-11T21:56:07.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: Updating smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T21:56:07.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:56:07.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:07.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:07.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:07.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:07.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:07.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:07.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:08.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:08 smithi152 ceph-mon[31188]: Deploying cephadm binary to smithi179 2024-09-11T21:56:10.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:10.304+0000 7f017d7fa640 1 -- 172.21.15.152:0/308924453 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f01801902c0 con 0x7f0168039060 2024-09-11T21:56:10.305 INFO:teuthology.orchestra.run.smithi152.stdout:Added host 'smithi179' with addr '172.21.15.179' 2024-09-11T21:56:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:10.307+0000 7f01862e5640 1 -- 172.21.15.152:0/308924453 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0168039060 msgr2=0x7f016803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:10.307+0000 7f01862e5640 1 --2- 172.21.15.152:0/308924453 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0168039060 0x7f016803b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f01740098c0 tx=0x7f0174006db0 comp rx=0 tx=0).stop 2024-09-11T21:56:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:10.307+0000 7f01862e5640 1 -- 172.21.15.152:0/308924453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0180100520 msgr2=0x7f01800fdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:10.307+0000 7f01862e5640 1 --2- 172.21.15.152:0/308924453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0180100520 0x7f01800fdb70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0170004f60 tx=0x7f01700048f0 comp rx=0 tx=0).stop 2024-09-11T21:56:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:10.307+0000 7f01862e5640 1 -- 172.21.15.152:0/308924453 shutdown_connections 2024-09-11T21:56:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:10.307+0000 7f01862e5640 1 --2- 172.21.15.152:0/308924453 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0168039060 0x7f016803b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:10.307+0000 7f01862e5640 1 --2- 172.21.15.152:0/308924453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0180100520 0x7f01800fdb70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:10.307+0000 7f01862e5640 1 -- 172.21.15.152:0/308924453 >> 172.21.15.152:0/308924453 conn(0x7f01800fbcb0 msgr2=0x7f018006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:10.307+0000 7f01862e5640 1 -- 172.21.15.152:0/308924453 shutdown_connections 2024-09-11T21:56:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:10.307+0000 7f01862e5640 1 -- 172.21.15.152:0/308924453 wait complete. 2024-09-11T21:56:10.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T21:56:11.162 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:56:11.572 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:11.572 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:11 smithi152 ceph-mon[31188]: Added host smithi179 2024-09-11T21:56:11.572 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:11.572 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:11.572 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:11.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.584+0000 7f6812c63640 1 -- 172.21.15.152:0/1475177804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f680c107660 msgr2=0x7f680c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:11.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.584+0000 7f6812c63640 1 --2- 172.21.15.152:0/1475177804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f680c107660 0x7f680c107a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6800009880 tx=0x7f680002a5d0 comp rx=0 tx=0).stop 2024-09-11T21:56:11.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.585+0000 7f6812c63640 1 -- 172.21.15.152:0/1475177804 shutdown_connections 2024-09-11T21:56:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.585+0000 7f6812c63640 1 --2- 172.21.15.152:0/1475177804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f680c107660 0x7f680c107a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.585+0000 7f6812c63640 1 -- 172.21.15.152:0/1475177804 >> 172.21.15.152:0/1475177804 conn(0x7f680c0fd2b0 msgr2=0x7f680c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.585+0000 7f6812c63640 1 -- 172.21.15.152:0/1475177804 shutdown_connections 2024-09-11T21:56:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.585+0000 7f6812c63640 1 -- 172.21.15.152:0/1475177804 wait complete. 2024-09-11T21:56:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.585+0000 7f6812c63640 1 Processor -- start 2024-09-11T21:56:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.585+0000 7f6812c63640 1 -- start start 2024-09-11T21:56:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.585+0000 7f6812c63640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f680c107660 0x7f680c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.585+0000 7f6812c63640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f680c10bc70 con 0x7f680c107660 2024-09-11T21:56:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.586+0000 7f68109ff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f680c107660 0x7f680c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.586+0000 7f68109ff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f680c107660 0x7f680c1970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33900/0 (socket says 172.21.15.152:33900) 2024-09-11T21:56:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.586+0000 7f68109ff640 1 -- 172.21.15.152:0/2905007750 learned_addr learned my addr 172.21.15.152:0/2905007750 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.586+0000 7f68109ff640 1 -- 172.21.15.152:0/2905007750 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c1975e0 con 0x7f680c107660 2024-09-11T21:56:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.586+0000 7f68109ff640 1 --2- 172.21.15.152:0/2905007750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f680c107660 0x7f680c1970a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6800009230 tx=0x7f6800003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.586+0000 7f6809ffb640 1 -- 172.21.15.152:0/2905007750 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f680003f070 con 0x7f680c107660 2024-09-11T21:56:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.586+0000 7f6809ffb640 1 -- 172.21.15.152:0/2905007750 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f680003bc80 con 0x7f680c107660 2024-09-11T21:56:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.586+0000 7f6812c63640 1 -- 172.21.15.152:0/2905007750 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680c1978d0 con 0x7f680c107660 2024-09-11T21:56:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.586+0000 7f6809ffb640 1 -- 172.21.15.152:0/2905007750 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6800035030 con 0x7f680c107660 2024-09-11T21:56:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.586+0000 7f6812c63640 1 -- 172.21.15.152:0/2905007750 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680c19b970 con 0x7f680c107660 2024-09-11T21:56:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.587+0000 7f6809ffb640 1 -- 172.21.15.152:0/2905007750 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f6800042070 con 0x7f680c107660 2024-09-11T21:56:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.587+0000 7f6812c63640 1 -- 172.21.15.152:0/2905007750 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680c102d10 con 0x7f680c107660 2024-09-11T21:56:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.588+0000 7f6809ffb640 1 --2- 172.21.15.152:0/2905007750 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f67fc039060 0x7f67fc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.588+0000 7f6809ffb640 1 -- 172.21.15.152:0/2905007750 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f680006cc50 con 0x7f680c107660 2024-09-11T21:56:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.588+0000 7f680bfff640 1 --2- 172.21.15.152:0/2905007750 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f67fc039060 0x7f67fc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:11.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.588+0000 7f680bfff640 1 --2- 172.21.15.152:0/2905007750 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f67fc039060 0x7f67fc03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f67f80098c0 tx=0x7f67f8006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:11.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.592+0000 7f6809ffb640 1 -- 172.21.15.152:0/2905007750 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6800072020 con 0x7f680c107660 2024-09-11T21:56:11.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.768+0000 7f6812c63640 1 -- 172.21.15.152:0/2905007750 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f680c198400 con 0x7f67fc039060 2024-09-11T21:56:11.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.769+0000 7f6809ffb640 1 -- 172.21.15.152:0/2905007750 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f680c198400 con 0x7f67fc039060 2024-09-11T21:56:11.770 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:11.770 INFO:teuthology.orchestra.run.smithi152.stdout:[{"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}, {"addr": "172.21.15.179", "hostname": "smithi179", "labels": [], "status": ""}] 2024-09-11T21:56:11.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.771+0000 7f6812c63640 1 -- 172.21.15.152:0/2905007750 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f67fc039060 msgr2=0x7f67fc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:11.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.771+0000 7f6812c63640 1 --2- 172.21.15.152:0/2905007750 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f67fc039060 0x7f67fc03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f67f80098c0 tx=0x7f67f8006db0 comp rx=0 tx=0).stop 2024-09-11T21:56:11.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.771+0000 7f6812c63640 1 -- 172.21.15.152:0/2905007750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f680c107660 msgr2=0x7f680c1970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:11.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.771+0000 7f6812c63640 1 --2- 172.21.15.152:0/2905007750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f680c107660 0x7f680c1970a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6800009230 tx=0x7f6800003d40 comp rx=0 tx=0).stop 2024-09-11T21:56:11.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.771+0000 7f6812c63640 1 -- 172.21.15.152:0/2905007750 shutdown_connections 2024-09-11T21:56:11.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.771+0000 7f6812c63640 1 --2- 172.21.15.152:0/2905007750 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f67fc039060 0x7f67fc03b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:11.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.771+0000 7f6812c63640 1 --2- 172.21.15.152:0/2905007750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f680c107660 0x7f680c1970a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:11.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.771+0000 7f6812c63640 1 -- 172.21.15.152:0/2905007750 >> 172.21.15.152:0/2905007750 conn(0x7f680c0fd2b0 msgr2=0x7f680c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:11.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.771+0000 7f6812c63640 1 -- 172.21.15.152:0/2905007750 shutdown_connections 2024-09-11T21:56:11.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:11.771+0000 7f6812c63640 1 -- 172.21.15.152:0/2905007750 wait complete. 2024-09-11T21:56:12.352 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi193 2024-09-11T21:56:12.352 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-11T21:56:12.352 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/etc/ceph/ceph.conf 2024-09-11T21:56:12.372 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-11T21:56:12.372 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T21:56:12.430 INFO:tasks.cephadm:Adding host smithi193 to orchestrator... 2024-09-11T21:56:12.430 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch host add smithi193 2024-09-11T21:56:12.668 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:56:12.908 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:12.908 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:12 smithi152 ceph-mon[31188]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T21:56:13.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.102+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/2615816271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ab4106590 msgr2=0x7f6ab4106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:13.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.102+0000 7f6ab8ccc640 1 --2- 172.21.15.152:0/2615816271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ab4106590 0x7f6ab4106970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009880 tx=0x7f6aa402a5d0 comp rx=0 tx=0).stop 2024-09-11T21:56:13.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.102+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/2615816271 shutdown_connections 2024-09-11T21:56:13.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.102+0000 7f6ab8ccc640 1 --2- 172.21.15.152:0/2615816271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ab4106590 0x7f6ab4106970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:13.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.102+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/2615816271 >> 172.21.15.152:0/2615816271 conn(0x7f6ab40fc1a0 msgr2=0x7f6ab40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:13.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.102+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/2615816271 shutdown_connections 2024-09-11T21:56:13.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.102+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/2615816271 wait complete. 2024-09-11T21:56:13.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.103+0000 7f6ab8ccc640 1 Processor -- start 2024-09-11T21:56:13.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.103+0000 7f6ab8ccc640 1 -- start start 2024-09-11T21:56:13.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.103+0000 7f6ab8ccc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ab4106590 0x7f6ab4197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:13.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.103+0000 7f6ab8ccc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab410abc0 con 0x7f6ab4106590 2024-09-11T21:56:13.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.103+0000 7f6ab259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ab4106590 0x7f6ab4197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:13.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.103+0000 7f6ab259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ab4106590 0x7f6ab4197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33914/0 (socket says 172.21.15.152:33914) 2024-09-11T21:56:13.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.103+0000 7f6ab259c640 1 -- 172.21.15.152:0/3690092926 learned_addr learned my addr 172.21.15.152:0/3690092926 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:13.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.104+0000 7f6ab259c640 1 -- 172.21.15.152:0/3690092926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab4197640 con 0x7f6ab4106590 2024-09-11T21:56:13.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.104+0000 7f6ab259c640 1 --2- 172.21.15.152:0/3690092926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ab4106590 0x7f6ab4197100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009230 tx=0x7f6aa4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:13.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.104+0000 7f6aabfff640 1 -- 172.21.15.152:0/3690092926 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6aa403f070 con 0x7f6ab4106590 2024-09-11T21:56:13.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.104+0000 7f6aabfff640 1 -- 172.21.15.152:0/3690092926 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa403bc80 con 0x7f6ab4106590 2024-09-11T21:56:13.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.104+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/3690092926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab41978d0 con 0x7f6ab4106590 2024-09-11T21:56:13.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.104+0000 7f6aabfff640 1 -- 172.21.15.152:0/3690092926 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6aa4035030 con 0x7f6ab4106590 2024-09-11T21:56:13.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.104+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/3690092926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab419b9d0 con 0x7f6ab4106590 2024-09-11T21:56:13.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.105+0000 7f6aabfff640 1 -- 172.21.15.152:0/3690092926 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f6aa4042070 con 0x7f6ab4106590 2024-09-11T21:56:13.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.105+0000 7f6aabfff640 1 --2- 172.21.15.152:0/3690092926 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6aa00390c0 0x7f6aa003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:13.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.105+0000 7f6aabfff640 1 -- 172.21.15.152:0/3690092926 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6aa406ccd0 con 0x7f6ab4106590 2024-09-11T21:56:13.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.105+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/3690092926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab4101c00 con 0x7f6ab4106590 2024-09-11T21:56:13.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.105+0000 7f6aa9d9b640 1 --2- 172.21.15.152:0/3690092926 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6aa00390c0 0x7f6aa003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:13.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.105+0000 7f6aa9d9b640 1 --2- 172.21.15.152:0/3690092926 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6aa00390c0 0x7f6aa003b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0098c0 tx=0x7f6a9c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:13.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.110+0000 7f6aabfff640 1 -- 172.21.15.152:0/3690092926 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6aa4031dd0 con 0x7f6ab4106590 2024-09-11T21:56:13.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:13.279+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/3690092926 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi193", "target": ["mon-mgr", ""]}) -- 0x7f6ab41069f0 con 0x7f6aa00390c0 2024-09-11T21:56:13.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:13 smithi152 ceph-mon[31188]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi193", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:56:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:15 smithi152 ceph-mon[31188]: Deploying cephadm binary to smithi193 2024-09-11T21:56:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:15 smithi152 ceph-mon[31188]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:56:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:15.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:16.478+0000 7f6aabfff640 1 -- 172.21.15.152:0/3690092926 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f6ab41069f0 con 0x7f6aa00390c0 2024-09-11T21:56:16.480 INFO:teuthology.orchestra.run.smithi152.stdout:Added host 'smithi193' with addr '172.21.15.193' 2024-09-11T21:56:16.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:16 smithi152 ceph-mon[31188]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-11T21:56:16.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:16 smithi152 ceph-mon[31188]: Updating smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:16.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:16 smithi152 ceph-mon[31188]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-11T21:56:16.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:16 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:16.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:16 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:16.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:16 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:16.481+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/3690092926 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6aa00390c0 msgr2=0x7f6aa003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:16.481+0000 7f6ab8ccc640 1 --2- 172.21.15.152:0/3690092926 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6aa00390c0 0x7f6aa003b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0098c0 tx=0x7f6a9c006db0 comp rx=0 tx=0).stop 2024-09-11T21:56:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:16.481+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/3690092926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ab4106590 msgr2=0x7f6ab4197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:16.481+0000 7f6ab8ccc640 1 --2- 172.21.15.152:0/3690092926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ab4106590 0x7f6ab4197100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009230 tx=0x7f6aa4003d40 comp rx=0 tx=0).stop 2024-09-11T21:56:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:16.481+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/3690092926 shutdown_connections 2024-09-11T21:56:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:16.481+0000 7f6ab8ccc640 1 --2- 172.21.15.152:0/3690092926 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6aa00390c0 0x7f6aa003b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:16.481+0000 7f6ab8ccc640 1 --2- 172.21.15.152:0/3690092926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ab4106590 0x7f6ab4197100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:16.481+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/3690092926 >> 172.21.15.152:0/3690092926 conn(0x7f6ab40fc1a0 msgr2=0x7f6ab4069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:16.481+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/3690092926 shutdown_connections 2024-09-11T21:56:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:16.481+0000 7f6ab8ccc640 1 -- 172.21.15.152:0/3690092926 wait complete. 2024-09-11T21:56:17.077 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T21:56:17.319 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:56:17.440 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:17 smithi152 ceph-mon[31188]: Updating smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T21:56:17.440 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:17 smithi152 ceph-mon[31188]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:17.440 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:17.440 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:17.440 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:17.440 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:17.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.740+0000 7f9eb19e9640 1 -- 172.21.15.152:0/2259060650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eac1027e0 msgr2=0x7f9eac102bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:17.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.740+0000 7f9eb19e9640 1 --2- 172.21.15.152:0/2259060650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eac1027e0 0x7f9eac102bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009880 tx=0x7f9e9c02a670 comp rx=0 tx=0).stop 2024-09-11T21:56:17.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.740+0000 7f9eb19e9640 1 -- 172.21.15.152:0/2259060650 shutdown_connections 2024-09-11T21:56:17.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.740+0000 7f9eb19e9640 1 --2- 172.21.15.152:0/2259060650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eac1027e0 0x7f9eac102bc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:17.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.740+0000 7f9eb19e9640 1 -- 172.21.15.152:0/2259060650 >> 172.21.15.152:0/2259060650 conn(0x7f9eac0fc1a0 msgr2=0x7f9eac0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:17.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.740+0000 7f9eb19e9640 1 -- 172.21.15.152:0/2259060650 shutdown_connections 2024-09-11T21:56:17.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.740+0000 7f9eb19e9640 1 -- 172.21.15.152:0/2259060650 wait complete. 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.741+0000 7f9eb19e9640 1 Processor -- start 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.741+0000 7f9eb19e9640 1 -- start start 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.741+0000 7f9eb19e9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eac1027e0 0x7f9eac197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.741+0000 7f9eb19e9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac10bce0 con 0x7f9eac1027e0 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.741+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eac1027e0 0x7f9eac197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.741+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eac1027e0 0x7f9eac197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45370/0 (socket says 172.21.15.152:45370) 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.741+0000 7f9eaaffd640 1 -- 172.21.15.152:0/3114787372 learned_addr learned my addr 172.21.15.152:0/3114787372 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.741+0000 7f9eaaffd640 1 -- 172.21.15.152:0/3114787372 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac1976c0 con 0x7f9eac1027e0 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.741+0000 7f9eaaffd640 1 --2- 172.21.15.152:0/3114787372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eac1027e0 0x7f9eac197180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009230 tx=0x7f9e9c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.742+0000 7f9eb09e7640 1 -- 172.21.15.152:0/3114787372 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e9c03f070 con 0x7f9eac1027e0 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.742+0000 7f9eb09e7640 1 -- 172.21.15.152:0/3114787372 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e9c03bc80 con 0x7f9eac1027e0 2024-09-11T21:56:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.742+0000 7f9eb19e9640 1 -- 172.21.15.152:0/3114787372 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eac197950 con 0x7f9eac1027e0 2024-09-11T21:56:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.742+0000 7f9eb09e7640 1 -- 172.21.15.152:0/3114787372 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e9c035030 con 0x7f9eac1027e0 2024-09-11T21:56:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.742+0000 7f9eb19e9640 1 -- 172.21.15.152:0/3114787372 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eac197db0 con 0x7f9eac1027e0 2024-09-11T21:56:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.742+0000 7f9eb09e7640 1 -- 172.21.15.152:0/3114787372 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f9e9c042070 con 0x7f9eac1027e0 2024-09-11T21:56:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.743+0000 7f9eb09e7640 1 --2- 172.21.15.152:0/3114787372 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9e980390c0 0x7f9e9803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.743+0000 7f9eb09e7640 1 -- 172.21.15.152:0/3114787372 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9e9c03b800 con 0x7f9eac1027e0 2024-09-11T21:56:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.743+0000 7f9eb19e9640 1 -- 172.21.15.152:0/3114787372 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eac06a760 con 0x7f9eac1027e0 2024-09-11T21:56:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.743+0000 7f9ea27fc640 1 --2- 172.21.15.152:0/3114787372 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9e980390c0 0x7f9e9803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.743+0000 7f9ea27fc640 1 --2- 172.21.15.152:0/3114787372 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9e980390c0 0x7f9e9803b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9e940098c0 tx=0x7f9e94006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.748+0000 7f9eb09e7640 1 -- 172.21.15.152:0/3114787372 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e9c03ba50 con 0x7f9eac1027e0 2024-09-11T21:56:17.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.920+0000 7f9eb19e9640 1 -- 172.21.15.152:0/3114787372 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9eac198510 con 0x7f9e980390c0 2024-09-11T21:56:17.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.921+0000 7f9eb09e7640 1 -- 172.21.15.152:0/3114787372 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f9eac198510 con 0x7f9e980390c0 2024-09-11T21:56:17.922 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:17.922 INFO:teuthology.orchestra.run.smithi152.stdout:[{"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}, {"addr": "172.21.15.179", "hostname": "smithi179", "labels": [], "status": ""}, {"addr": "172.21.15.193", "hostname": "smithi193", "labels": [], "status": ""}] 2024-09-11T21:56:17.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.923+0000 7f9eb19e9640 1 -- 172.21.15.152:0/3114787372 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9e980390c0 msgr2=0x7f9e9803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:17.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.923+0000 7f9eb19e9640 1 --2- 172.21.15.152:0/3114787372 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9e980390c0 0x7f9e9803b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9e940098c0 tx=0x7f9e94006db0 comp rx=0 tx=0).stop 2024-09-11T21:56:17.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.923+0000 7f9eb19e9640 1 -- 172.21.15.152:0/3114787372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eac1027e0 msgr2=0x7f9eac197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:17.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.923+0000 7f9eb19e9640 1 --2- 172.21.15.152:0/3114787372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eac1027e0 0x7f9eac197180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009230 tx=0x7f9e9c003d40 comp rx=0 tx=0).stop 2024-09-11T21:56:17.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.924+0000 7f9eb19e9640 1 -- 172.21.15.152:0/3114787372 shutdown_connections 2024-09-11T21:56:17.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.924+0000 7f9eb19e9640 1 --2- 172.21.15.152:0/3114787372 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9e980390c0 0x7f9e9803b580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:17.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.924+0000 7f9eb19e9640 1 --2- 172.21.15.152:0/3114787372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eac1027e0 0x7f9eac197180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:17.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.924+0000 7f9eb19e9640 1 -- 172.21.15.152:0/3114787372 >> 172.21.15.152:0/3114787372 conn(0x7f9eac0fc1a0 msgr2=0x7f9eac103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:17.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.924+0000 7f9eb19e9640 1 -- 172.21.15.152:0/3114787372 shutdown_connections 2024-09-11T21:56:17.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:17.924+0000 7f9eb19e9640 1 -- 172.21.15.152:0/3114787372 wait complete. 2024-09-11T21:56:18.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:18 smithi152 ceph-mon[31188]: Added host smithi193 2024-09-11T21:56:18.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:18 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:18.531 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-11T21:56:18.532 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-11T21:56:18.775 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:56:19.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.217+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1041449183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ff8107660 msgr2=0x7f1ff8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:19.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.217+0000 7f1ffcb31640 1 --2- 172.21.15.152:0/1041449183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ff8107660 0x7f1ff8107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009880 tx=0x7f1fe802a5d0 comp rx=0 tx=0).stop 2024-09-11T21:56:19.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.217+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1041449183 shutdown_connections 2024-09-11T21:56:19.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.217+0000 7f1ffcb31640 1 --2- 172.21.15.152:0/1041449183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ff8107660 0x7f1ff8107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:19.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.217+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1041449183 >> 172.21.15.152:0/1041449183 conn(0x7f1ff80fd2b0 msgr2=0x7f1ff80ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:19.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.217+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1041449183 shutdown_connections 2024-09-11T21:56:19.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.217+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1041449183 wait complete. 2024-09-11T21:56:19.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.218+0000 7f1ffcb31640 1 Processor -- start 2024-09-11T21:56:19.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.218+0000 7f1ffcb31640 1 -- start start 2024-09-11T21:56:19.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.218+0000 7f1ffcb31640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ff8107660 0x7f1ff81970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:19.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.218+0000 7f1ffcb31640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff810bc70 con 0x7f1ff8107660 2024-09-11T21:56:19.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.218+0000 7f1ff659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ff8107660 0x7f1ff81970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:19.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.218+0000 7f1ff659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ff8107660 0x7f1ff81970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45384/0 (socket says 172.21.15.152:45384) 2024-09-11T21:56:19.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.218+0000 7f1ff659c640 1 -- 172.21.15.152:0/1963693196 learned_addr learned my addr 172.21.15.152:0/1963693196 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:19.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.218+0000 7f1ff659c640 1 -- 172.21.15.152:0/1963693196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff81975e0 con 0x7f1ff8107660 2024-09-11T21:56:19.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.218+0000 7f1ff659c640 1 --2- 172.21.15.152:0/1963693196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ff8107660 0x7f1ff81970a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009230 tx=0x7f1fe8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:19.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.219+0000 7f1fe77fe640 1 -- 172.21.15.152:0/1963693196 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe803f070 con 0x7f1ff8107660 2024-09-11T21:56:19.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.219+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1963693196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff81978d0 con 0x7f1ff8107660 2024-09-11T21:56:19.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.219+0000 7f1fe77fe640 1 -- 172.21.15.152:0/1963693196 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fe803bc80 con 0x7f1ff8107660 2024-09-11T21:56:19.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.219+0000 7f1fe77fe640 1 -- 172.21.15.152:0/1963693196 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe8035030 con 0x7f1ff8107660 2024-09-11T21:56:19.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.219+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1963693196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff819b970 con 0x7f1ff8107660 2024-09-11T21:56:19.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.220+0000 7f1fe77fe640 1 -- 172.21.15.152:0/1963693196 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f1fe8042070 con 0x7f1ff8107660 2024-09-11T21:56:19.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.220+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1963693196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff8102d10 con 0x7f1ff8107660 2024-09-11T21:56:19.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.220+0000 7f1fe77fe640 1 --2- 172.21.15.152:0/1963693196 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1fe0039060 0x7f1fe003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:19.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.220+0000 7f1fe77fe640 1 -- 172.21.15.152:0/1963693196 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1fe806cc50 con 0x7f1ff8107660 2024-09-11T21:56:19.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.220+0000 7f1ff5d9b640 1 --2- 172.21.15.152:0/1963693196 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1fe0039060 0x7f1fe003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:19.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.220+0000 7f1ff5d9b640 1 --2- 172.21.15.152:0/1963693196 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1fe0039060 0x7f1fe003b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0098c0 tx=0x7f1fec006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:19.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.225+0000 7f1fe77fe640 1 -- 172.21.15.152:0/1963693196 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1fe8072020 con 0x7f1ff8107660 2024-09-11T21:56:19.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:19.395+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1963693196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1ff8198400 con 0x7f1ff8107660 2024-09-11T21:56:19.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:19 smithi152 ceph-mon[31188]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T21:56:19.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:19 smithi152 ceph-mon[31188]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:20.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:20.208+0000 7f1fe77fe640 1 -- 172.21.15.152:0/1963693196 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f1fe804c350 con 0x7f1ff8107660 2024-09-11T21:56:20.209 INFO:teuthology.orchestra.run.smithi152.stderr:adjusted tunables profile to default 2024-09-11T21:56:20.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:20.211+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1963693196 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1fe0039060 msgr2=0x7f1fe003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:20.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:20.211+0000 7f1ffcb31640 1 --2- 172.21.15.152:0/1963693196 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1fe0039060 0x7f1fe003b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0098c0 tx=0x7f1fec006db0 comp rx=0 tx=0).stop 2024-09-11T21:56:20.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:20.211+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1963693196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ff8107660 msgr2=0x7f1ff81970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:20.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:20.211+0000 7f1ffcb31640 1 --2- 172.21.15.152:0/1963693196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ff8107660 0x7f1ff81970a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009230 tx=0x7f1fe8003d40 comp rx=0 tx=0).stop 2024-09-11T21:56:20.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:20.211+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1963693196 shutdown_connections 2024-09-11T21:56:20.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:20.211+0000 7f1ffcb31640 1 --2- 172.21.15.152:0/1963693196 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1fe0039060 0x7f1fe003b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:20.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:20.211+0000 7f1ffcb31640 1 --2- 172.21.15.152:0/1963693196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ff8107660 0x7f1ff81970a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:20.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:20.211+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1963693196 >> 172.21.15.152:0/1963693196 conn(0x7f1ff80fd2b0 msgr2=0x7f1ff80feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:20.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:20.211+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1963693196 shutdown_connections 2024-09-11T21:56:20.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:20.211+0000 7f1ffcb31640 1 -- 172.21.15.152:0/1963693196 wait complete. 2024-09-11T21:56:20.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:20 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1963693196' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T21:56:20.796 INFO:tasks.cephadm:Adding mon.a on smithi152 2024-09-11T21:56:20.796 INFO:tasks.cephadm:Adding mon.b on smithi179 2024-09-11T21:56:20.796 INFO:tasks.cephadm:Adding mon.c on smithi193 2024-09-11T21:56:20.797 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi152:172.21.15.152=a;smithi179:172.21.15.179=b;smithi193:172.21.15.193=c' 2024-09-11T21:56:21.041 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T21:56:21.087 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T21:56:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:21 smithi152 ceph-mon[31188]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:21 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1963693196' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T21:56:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:21 smithi152 ceph-mon[31188]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T21:56:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:21 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:21 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:21 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:21 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:21 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi193", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:56:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:21 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:21 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:21.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.597+0000 7f3544d17640 1 -- 172.21.15.193:0/2689847490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3540100990 msgr2=0x7f3540100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:21.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.597+0000 7f3544d17640 1 --2- 172.21.15.193:0/2689847490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3540100990 0x7f3540100d70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3530009c20 tx=0x7f353002aa90 comp rx=0 tx=0).stop 2024-09-11T21:56:21.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.597+0000 7f3544d17640 1 -- 172.21.15.193:0/2689847490 shutdown_connections 2024-09-11T21:56:21.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.597+0000 7f3544d17640 1 --2- 172.21.15.193:0/2689847490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3540100990 0x7f3540100d70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:21.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.597+0000 7f3544d17640 1 -- 172.21.15.193:0/2689847490 >> 172.21.15.193:0/2689847490 conn(0x7f3540076250 msgr2=0x7f3540076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:21.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.597+0000 7f3544d17640 1 -- 172.21.15.193:0/2689847490 shutdown_connections 2024-09-11T21:56:21.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.597+0000 7f3544d17640 1 -- 172.21.15.193:0/2689847490 wait complete. 2024-09-11T21:56:21.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.598+0000 7f3544d17640 1 Processor -- start 2024-09-11T21:56:21.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.598+0000 7f3544d17640 1 -- start start 2024-09-11T21:56:21.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.598+0000 7f3544d17640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3540100990 0x7f3540195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:21.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.598+0000 7f3544d17640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f354010ab90 con 0x7f3540100990 2024-09-11T21:56:21.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.599+0000 7f353e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3540100990 0x7f3540195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:21.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.599+0000 7f353e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3540100990 0x7f3540195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.193:59984/0 (socket says 172.21.15.193:59984) 2024-09-11T21:56:21.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.599+0000 7f353e59c640 1 -- 172.21.15.193:0/1628816762 learned_addr learned my addr 172.21.15.193:0/1628816762 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-11T21:56:21.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.599+0000 7f353e59c640 1 -- 172.21.15.193:0/1628816762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3540196390 con 0x7f3540100990 2024-09-11T21:56:21.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.599+0000 7f353e59c640 1 --2- 172.21.15.193:0/1628816762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3540100990 0x7f3540195e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3530005e30 tx=0x7f353002fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:21.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.599+0000 7f35377fe640 1 -- 172.21.15.193:0/1628816762 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3530047070 con 0x7f3540100990 2024-09-11T21:56:21.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.599+0000 7f35377fe640 1 -- 172.21.15.193:0/1628816762 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3530003df0 con 0x7f3540100990 2024-09-11T21:56:21.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.599+0000 7f3544d17640 1 -- 172.21.15.193:0/1628816762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3540196680 con 0x7f3540100990 2024-09-11T21:56:21.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.599+0000 7f35377fe640 1 -- 172.21.15.193:0/1628816762 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3530033050 con 0x7f3540100990 2024-09-11T21:56:21.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.599+0000 7f3544d17640 1 -- 172.21.15.193:0/1628816762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3540196b40 con 0x7f3540100990 2024-09-11T21:56:21.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.600+0000 7f35377fe640 1 -- 172.21.15.193:0/1628816762 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f353004a070 con 0x7f3540100990 2024-09-11T21:56:21.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.600+0000 7f3544d17640 1 -- 172.21.15.193:0/1628816762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3540101c40 con 0x7f3540100990 2024-09-11T21:56:21.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.601+0000 7f35377fe640 1 --2- 172.21.15.193:0/1628816762 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f352c0390c0 0x7f352c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:21.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.601+0000 7f35377fe640 1 -- 172.21.15.193:0/1628816762 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f353003e030 con 0x7f3540100990 2024-09-11T21:56:21.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.601+0000 7f353dd9b640 1 --2- 172.21.15.193:0/1628816762 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f352c0390c0 0x7f352c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:21.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.601+0000 7f353dd9b640 1 --2- 172.21.15.193:0/1628816762 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f352c0390c0 0x7f352c03b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f35280098c0 tx=0x7f3528006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:21.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.605+0000 7f35377fe640 1 -- 172.21.15.193:0/1628816762 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35300373b0 con 0x7f3540100990 2024-09-11T21:56:21.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.783+0000 7f3544d17640 1 -- 172.21.15.193:0/1628816762 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi152:172.21.15.152=a;smithi179:172.21.15.179=b;smithi193:172.21.15.193=c", "target": ["mon-mgr", ""]}) -- 0x7f3540069cf0 con 0x7f352c0390c0 2024-09-11T21:56:21.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.788+0000 7f35377fe640 1 -- 172.21.15.193:0/1628816762 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3540069cf0 con 0x7f352c0390c0 2024-09-11T21:56:21.789 INFO:teuthology.orchestra.run.smithi193.stdout:Scheduled mon update... 2024-09-11T21:56:21.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.790+0000 7f3544d17640 1 -- 172.21.15.193:0/1628816762 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f352c0390c0 msgr2=0x7f352c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:21.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.790+0000 7f3544d17640 1 --2- 172.21.15.193:0/1628816762 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f352c0390c0 0x7f352c03b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f35280098c0 tx=0x7f3528006db0 comp rx=0 tx=0).stop 2024-09-11T21:56:21.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.790+0000 7f3544d17640 1 -- 172.21.15.193:0/1628816762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3540100990 msgr2=0x7f3540195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:21.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.790+0000 7f3544d17640 1 --2- 172.21.15.193:0/1628816762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3540100990 0x7f3540195e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3530005e30 tx=0x7f353002fc10 comp rx=0 tx=0).stop 2024-09-11T21:56:21.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.790+0000 7f3544d17640 1 -- 172.21.15.193:0/1628816762 shutdown_connections 2024-09-11T21:56:21.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.790+0000 7f3544d17640 1 --2- 172.21.15.193:0/1628816762 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f352c0390c0 0x7f352c03b580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:21.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.790+0000 7f3544d17640 1 --2- 172.21.15.193:0/1628816762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3540100990 0x7f3540195e50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:21.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.790+0000 7f3544d17640 1 -- 172.21.15.193:0/1628816762 >> 172.21.15.193:0/1628816762 conn(0x7f3540076250 msgr2=0x7f35401020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:21.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.790+0000 7f3544d17640 1 -- 172.21.15.193:0/1628816762 shutdown_connections 2024-09-11T21:56:21.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:21.790+0000 7f3544d17640 1 -- 172.21.15.193:0/1628816762 wait complete. 2024-09-11T21:56:22.381 DEBUG:teuthology.orchestra.run.smithi179:mon.b> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.b.service 2024-09-11T21:56:22.384 DEBUG:teuthology.orchestra.run.smithi193:mon.c> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.c.service 2024-09-11T21:56:22.386 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T21:56:22.387 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T21:56:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-11T21:56:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-11T21:56:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:22.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:22.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:22.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:23.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:23 smithi152 ceph-mon[31188]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T21:56:23.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:23 smithi152 ceph-mon[31188]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi152:172.21.15.152=a;smithi179:172.21.15.179=b;smithi193:172.21.15.193=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:56:23.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:23 smithi152 ceph-mon[31188]: Saving service mon spec with placement smithi152:172.21.15.152=a;smithi179:172.21.15.179=b;smithi193:172.21.15.193=c;count:3 2024-09-11T21:56:23.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:23 smithi152 ceph-mon[31188]: Deploying daemon mon.c on smithi193 2024-09-11T21:56:23.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:23 smithi152 ceph-mon[31188]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:23.949 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:24.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.361+0000 7f873bde9640 1 -- 172.21.15.193:0/544747508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8734106590 msgr2=0x7f8734106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:24.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.361+0000 7f873bde9640 1 --2- 172.21.15.193:0/544747508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8734106590 0x7f8734106970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8730009880 tx=0x7f873002a5d0 comp rx=0 tx=0).stop 2024-09-11T21:56:24.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.361+0000 7f873bde9640 1 -- 172.21.15.193:0/544747508 shutdown_connections 2024-09-11T21:56:24.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.361+0000 7f873bde9640 1 --2- 172.21.15.193:0/544747508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8734106590 0x7f8734106970 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:24.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.361+0000 7f873bde9640 1 -- 172.21.15.193:0/544747508 >> 172.21.15.193:0/544747508 conn(0x7f87340fc1a0 msgr2=0x7f87340fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:24.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.361+0000 7f873bde9640 1 -- 172.21.15.193:0/544747508 shutdown_connections 2024-09-11T21:56:24.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.361+0000 7f873bde9640 1 -- 172.21.15.193:0/544747508 wait complete. 2024-09-11T21:56:24.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.361+0000 7f873bde9640 1 Processor -- start 2024-09-11T21:56:24.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.361+0000 7f873bde9640 1 -- start start 2024-09-11T21:56:24.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.362+0000 7f873bde9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8734106590 0x7f8734197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:24.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.362+0000 7f873bde9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f873410abc0 con 0x7f8734106590 2024-09-11T21:56:24.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.362+0000 7f8739b85640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8734106590 0x7f8734197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:24.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.362+0000 7f8739b85640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8734106590 0x7f8734197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.193:60000/0 (socket says 172.21.15.193:60000) 2024-09-11T21:56:24.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.362+0000 7f8739b85640 1 -- 172.21.15.193:0/3691109782 learned_addr learned my addr 172.21.15.193:0/3691109782 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-11T21:56:24.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.362+0000 7f8739b85640 1 -- 172.21.15.193:0/3691109782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8734197640 con 0x7f8734106590 2024-09-11T21:56:24.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.363+0000 7f8739b85640 1 --2- 172.21.15.193:0/3691109782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8734106590 0x7f8734197100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8730009230 tx=0x7f8730003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:24.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.363+0000 7f872affd640 1 -- 172.21.15.193:0/3691109782 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873003f070 con 0x7f8734106590 2024-09-11T21:56:24.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.363+0000 7f872affd640 1 -- 172.21.15.193:0/3691109782 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f873003bc80 con 0x7f8734106590 2024-09-11T21:56:24.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.363+0000 7f873bde9640 1 -- 172.21.15.193:0/3691109782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87341978d0 con 0x7f8734106590 2024-09-11T21:56:24.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.363+0000 7f872affd640 1 -- 172.21.15.193:0/3691109782 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8730035030 con 0x7f8734106590 2024-09-11T21:56:24.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.363+0000 7f873bde9640 1 -- 172.21.15.193:0/3691109782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f873419b9d0 con 0x7f8734106590 2024-09-11T21:56:24.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.364+0000 7f873bde9640 1 -- 172.21.15.193:0/3691109782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8734101c00 con 0x7f8734106590 2024-09-11T21:56:24.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.364+0000 7f872affd640 1 -- 172.21.15.193:0/3691109782 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f8730042070 con 0x7f8734106590 2024-09-11T21:56:24.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.364+0000 7f872affd640 1 --2- 172.21.15.193:0/3691109782 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f8720039060 0x7f872003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:24.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.364+0000 7f872affd640 1 -- 172.21.15.193:0/3691109782 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f873006ce00 con 0x7f8734106590 2024-09-11T21:56:24.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.364+0000 7f8739384640 1 --2- 172.21.15.193:0/3691109782 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f8720039060 0x7f872003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:24.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.365+0000 7f8739384640 1 --2- 172.21.15.193:0/3691109782 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f8720039060 0x7f872003b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f87240098c0 tx=0x7f8724006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:24.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.369+0000 7f872affd640 1 -- 172.21.15.193:0/3691109782 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87300372d0 con 0x7f8734106590 2024-09-11T21:56:24.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.611+0000 7f873bde9640 1 -- 172.21.15.193:0/3691109782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f87341069f0 con 0x7f8734106590 2024-09-11T21:56:24.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.611+0000 7f872affd640 1 -- 172.21.15.193:0/3691109782 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f8730031570 con 0x7f8734106590 2024-09-11T21:56:24.612 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:56:24.613 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","modified":"2024-09-11T21:55:00.803593Z","created":"2024-09-11T21:55:00.803593Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T21:56:24.613 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-11T21:56:24.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.614+0000 7f873bde9640 1 -- 172.21.15.193:0/3691109782 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f8720039060 msgr2=0x7f872003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:24.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.614+0000 7f873bde9640 1 --2- 172.21.15.193:0/3691109782 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f8720039060 0x7f872003b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f87240098c0 tx=0x7f8724006db0 comp rx=0 tx=0).stop 2024-09-11T21:56:24.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.615+0000 7f873bde9640 1 -- 172.21.15.193:0/3691109782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8734106590 msgr2=0x7f8734197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:24.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.615+0000 7f873bde9640 1 --2- 172.21.15.193:0/3691109782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8734106590 0x7f8734197100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8730009230 tx=0x7f8730003d40 comp rx=0 tx=0).stop 2024-09-11T21:56:24.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.615+0000 7f873bde9640 1 -- 172.21.15.193:0/3691109782 shutdown_connections 2024-09-11T21:56:24.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.615+0000 7f873bde9640 1 --2- 172.21.15.193:0/3691109782 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f8720039060 0x7f872003b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:24.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.615+0000 7f873bde9640 1 --2- 172.21.15.193:0/3691109782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8734106590 0x7f8734197100 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:24.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.615+0000 7f873bde9640 1 -- 172.21.15.193:0/3691109782 >> 172.21.15.193:0/3691109782 conn(0x7f87340fc1a0 msgr2=0x7f8734069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:24.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.615+0000 7f873bde9640 1 -- 172.21.15.193:0/3691109782 shutdown_connections 2024-09-11T21:56:24.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:24.615+0000 7f873bde9640 1 -- 172.21.15.193:0/3691109782 wait complete. 2024-09-11T21:56:25.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:25 smithi152 ceph-mon[31188]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:25.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:25 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/3691109782' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T21:56:26.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:26 smithi193 systemd[1]: Started Ceph mon.c for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T21:56:26.585 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T21:56:26.585 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T21:56:26.830 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T21:56:31.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.639+0000 7f6601de5640 1 -- 172.21.15.193:0/3172271806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65e4003530 msgr2=0x7f65e40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:31.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.639+0000 7f6601de5640 1 --2- 172.21.15.193:0/3172271806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65e4003530 0x7f65e40059c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f65fc1016c0 tx=0x7f65ec02c490 comp rx=0 tx=0).stop 2024-09-11T21:56:31.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.639+0000 7f6601de5640 1 -- 172.21.15.193:0/3172271806 shutdown_connections 2024-09-11T21:56:31.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.639+0000 7f6601de5640 1 --2- 172.21.15.193:0/3172271806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65e4003530 0x7f65e40059c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:31.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.639+0000 7f6601de5640 1 -- 172.21.15.193:0/3172271806 >> 172.21.15.193:0/3172271806 conn(0x7f65fc0fc280 msgr2=0x7f65fc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:31.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.639+0000 7f6601de5640 1 -- 172.21.15.193:0/3172271806 shutdown_connections 2024-09-11T21:56:31.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.639+0000 7f6601de5640 1 -- 172.21.15.193:0/3172271806 wait complete. 2024-09-11T21:56:31.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.640+0000 7f6601de5640 1 Processor -- start 2024-09-11T21:56:31.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.641+0000 7f6601de5640 1 -- start start 2024-09-11T21:56:31.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.641+0000 7f6601de5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65e4003530 0x7f65fc197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:31.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.641+0000 7f6601de5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65fc197840 0x7f65fc19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:31.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.641+0000 7f6601de5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc108690 con 0x7f65fc197840 2024-09-11T21:56:31.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.641+0000 7f6601de5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc108510 con 0x7f65e4003530 2024-09-11T21:56:31.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.641+0000 7f65fb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65e4003530 0x7f65fc197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:31.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65fb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65e4003530 0x7f65fc197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:32862/0 (socket says 172.21.15.193:32862) 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65fb7fe640 1 -- 172.21.15.193:0/1136487021 learned_addr learned my addr 172.21.15.193:0/1136487021 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65faffd640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65fc197840 0x7f65fc19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65fb7fe640 1 -- 172.21.15.193:0/1136487021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65e4003530 msgr2=0x7f65fc197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65fb7fe640 1 -- 172.21.15.193:0/1136487021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65e4003530 msgr2=0x7f65fc197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65fb7fe640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65e4003530 0x7f65fc197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65fb7fe640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65e4003530 0x7f65fc197300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65faffd640 1 -- 172.21.15.193:0/1136487021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65e4003530 msgr2=0x7f65fc197300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65faffd640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65e4003530 0x7f65fc197300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65faffd640 1 -- 172.21.15.193:0/1136487021 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc197e60 con 0x7f65fc197840 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65faffd640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65fc197840 0x7f65fc19bbd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65f000b3d0 tx=0x7f65f000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.642+0000 7f65f8ff9640 1 -- 172.21.15.193:0/1136487021 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f65f0011630 con 0x7f65fc197840 2024-09-11T21:56:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.643+0000 7f65f8ff9640 1 -- 172.21.15.193:0/1136487021 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f0011cb0 con 0x7f65fc197840 2024-09-11T21:56:31.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.643+0000 7f6601de5640 1 -- 172.21.15.193:0/1136487021 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc19c110 con 0x7f65fc197840 2024-09-11T21:56:31.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.643+0000 7f65f8ff9640 1 -- 172.21.15.193:0/1136487021 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f65f0010df0 con 0x7f65fc197840 2024-09-11T21:56:31.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.643+0000 7f6601de5640 1 -- 172.21.15.193:0/1136487021 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc19c6d0 con 0x7f65fc197840 2024-09-11T21:56:31.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.644+0000 7f65f8ff9640 1 -- 172.21.15.193:0/1136487021 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f65f0018020 con 0x7f65fc197840 2024-09-11T21:56:31.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.644+0000 7f6601de5640 1 -- 172.21.15.193:0/1136487021 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65fc19c9e0 con 0x7f65fc197840 2024-09-11T21:56:31.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.644+0000 7f65f8ff9640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f65e8038e00 0x7f65e803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:31.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.644+0000 7f65f8ff9640 1 -- 172.21.15.193:0/1136487021 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f65f004bc70 con 0x7f65fc197840 2024-09-11T21:56:31.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.644+0000 7f65fb7fe640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f65e8038e00 0x7f65e803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:31.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.645+0000 7f65fb7fe640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f65e8038e00 0x7f65e803b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f65ec012c10 tx=0x7f65ec0323a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:31.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.649+0000 7f65f8ff9640 1 -- 172.21.15.193:0/1136487021 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f65f001f020 con 0x7f65fc197840 2024-09-11T21:56:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:56:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: mon.a calling monitor election 2024-09-11T21:56:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: mon.c calling monitor election 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: monmap epoch 2 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: last_changed 2024-09-11T21:56:26.341666+0000 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: created 2024-09-11T21:55:00.803593+0000 2024-09-11T21:56:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: min_mon_release 19 (squid) 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: election_strategy: 1 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: 0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: fsmap 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: mgrmap e13: x(active, since 37s) 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: overall HEALTH_OK 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:31.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: mon.a calling monitor election 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: mon.c calling monitor election 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T21:56:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: monmap epoch 2 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: last_changed 2024-09-11T21:56:26.341666+0000 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: created 2024-09-11T21:55:00.803593+0000 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: min_mon_release 19 (squid) 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: election_strategy: 1 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: 0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: fsmap 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: mgrmap e13: x(active, since 37s) 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: overall HEALTH_OK 2024-09-11T21:56:31.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:31.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:31.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:31.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:31.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:31.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.884+0000 7f6601de5640 1 -- 172.21.15.193:0/1136487021 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f65fc1986c0 con 0x7f65fc197840 2024-09-11T21:56:31.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.884+0000 7f65f8ff9640 1 -- 172.21.15.193:0/1136487021 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f65f0018310 con 0x7f65fc197840 2024-09-11T21:56:31.885 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:56:31.885 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":2,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","modified":"2024-09-11T21:56:26.341666Z","created":"2024-09-11T21:55:00.803593Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:3300","nonce":0},{"type":"v1","addr":"172.21.15.193:6789","nonce":0}]},"addr":"172.21.15.193:6789/0","public_addr":"172.21.15.193:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T21:56:31.886 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 2 2024-09-11T21:56:31.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.886+0000 7f6601de5640 1 -- 172.21.15.193:0/1136487021 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f65e8038e00 msgr2=0x7f65e803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:31.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.886+0000 7f6601de5640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f65e8038e00 0x7f65e803b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f65ec012c10 tx=0x7f65ec0323a0 comp rx=0 tx=0).stop 2024-09-11T21:56:31.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.886+0000 7f6601de5640 1 -- 172.21.15.193:0/1136487021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65fc197840 msgr2=0x7f65fc19bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:31.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.886+0000 7f6601de5640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65fc197840 0x7f65fc19bbd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65f000b3d0 tx=0x7f65f000b890 comp rx=0 tx=0).stop 2024-09-11T21:56:31.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.886+0000 7f6601de5640 1 -- 172.21.15.193:0/1136487021 shutdown_connections 2024-09-11T21:56:31.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.886+0000 7f6601de5640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65fc197840 0x7f65fc19bbd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:31.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.886+0000 7f6601de5640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f65e8038e00 0x7f65e803b2c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:31.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.886+0000 7f6601de5640 1 --2- 172.21.15.193:0/1136487021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65e4003530 0x7f65fc197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:31.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.886+0000 7f6601de5640 1 -- 172.21.15.193:0/1136487021 >> 172.21.15.193:0/1136487021 conn(0x7f65fc0fc280 msgr2=0x7f65fc104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:31.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.887+0000 7f6601de5640 1 -- 172.21.15.193:0/1136487021 shutdown_connections 2024-09-11T21:56:31.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:31.887+0000 7f6601de5640 1 -- 172.21.15.193:0/1136487021 wait complete. 2024-09-11T21:56:32.443 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:32 smithi193 ceph-mon[35545]: Deploying daemon mon.b on smithi179 2024-09-11T21:56:32.443 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:32 smithi193 ceph-mon[35545]: from='client.? 172.21.15.193:0/1136487021' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T21:56:32.443 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:32 smithi193 ceph-mon[35545]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:32.443 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:32 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:32 smithi152 ceph-mon[31188]: Deploying daemon mon.b on smithi179 2024-09-11T21:56:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:32 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/1136487021' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T21:56:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:32 smithi152 ceph-mon[31188]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:32 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:33.446 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T21:56:33.446 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T21:56:33.699 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T21:56:34.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.131+0000 7f17bd11e640 1 -- 172.21.15.193:0/2859847062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17b8106650 msgr2=0x7f17b8106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.131+0000 7f17bd11e640 1 --2- 172.21.15.193:0/2859847062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17b8106650 0x7f17b8106a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009880 tx=0x7f17a802a5d0 comp rx=0 tx=0).stop 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.131+0000 7f17bd11e640 1 -- 172.21.15.193:0/2859847062 shutdown_connections 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.131+0000 7f17bd11e640 1 --2- 172.21.15.193:0/2859847062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17b8106650 0x7f17b8106a30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.131+0000 7f17bd11e640 1 -- 172.21.15.193:0/2859847062 >> 172.21.15.193:0/2859847062 conn(0x7f17b80fc280 msgr2=0x7f17b80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.131+0000 7f17bd11e640 1 -- 172.21.15.193:0/2859847062 shutdown_connections 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.131+0000 7f17bd11e640 1 -- 172.21.15.193:0/2859847062 wait complete. 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.131+0000 7f17bd11e640 1 Processor -- start 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17bd11e640 1 -- start start 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17bd11e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17b8106650 0x7f17b81962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17bd11e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b8196810 0x7f17b819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17bd11e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17b810ac80 con 0x7f17b8106650 2024-09-11T21:56:34.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17bd11e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f17b810ab00 con 0x7f17b8196810 2024-09-11T21:56:34.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17b659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b8196810 0x7f17b819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:34.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17b659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b8196810 0x7f17b819aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:32872/0 (socket says 172.21.15.193:32872) 2024-09-11T21:56:34.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17b659c640 1 -- 172.21.15.193:0/1334326113 learned_addr learned my addr 172.21.15.193:0/1334326113 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-11T21:56:34.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17b659c640 1 -- 172.21.15.193:0/1334326113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b8196810 msgr2=0x7f17b819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T21:56:34.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17b659c640 1 -- 172.21.15.193:0/1334326113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b8196810 msgr2=0x7f17b819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T21:56:34.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17b659c640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b8196810 0x7f17b819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T21:56:34.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17b6d9d640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17b8106650 0x7f17b81962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:34.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.132+0000 7f17b659c640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b8196810 0x7f17b819aba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T21:56:34.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.133+0000 7f17b6d9d640 1 -- 172.21.15.193:0/1334326113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b8196810 msgr2=0x7f17b819aba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T21:56:34.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.133+0000 7f17b6d9d640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b8196810 0x7f17b819aba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:34.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.133+0000 7f17b6d9d640 1 -- 172.21.15.193:0/1334326113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b8196e30 con 0x7f17b8106650 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.133+0000 7f17b6d9d640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17b8106650 0x7f17b81962d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17a8005ab0 tx=0x7f17a8032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.133+0000 7f179ffff640 1 -- 172.21.15.193:0/1334326113 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f17a8035070 con 0x7f17b8106650 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.133+0000 7f17bd11e640 1 -- 172.21.15.193:0/1334326113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b819b0e0 con 0x7f17b8106650 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.134+0000 7f17bd11e640 1 -- 172.21.15.193:0/1334326113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b819b640 con 0x7f17b8106650 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.134+0000 7f179ffff640 1 -- 172.21.15.193:0/1334326113 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a8032e40 con 0x7f17b8106650 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.134+0000 7f179ffff640 1 -- 172.21.15.193:0/1334326113 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f17a803ba50 con 0x7f17b8106650 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.134+0000 7f179ffff640 1 -- 172.21.15.193:0/1334326113 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f17a8042030 con 0x7f17b8106650 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.134+0000 7f17bd11e640 1 -- 172.21.15.193:0/1334326113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b8101cc0 con 0x7f17b8106650 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.135+0000 7f179ffff640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17a0038e00 0x7f17a003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.135+0000 7f179ffff640 1 -- 172.21.15.193:0/1334326113 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f17a8040070 con 0x7f17b8106650 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.135+0000 7f17b659c640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17a0038e00 0x7f17a003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:34.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.135+0000 7f17b659c640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17a0038e00 0x7f17a003b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f17ac006a90 tx=0x7f17ac006a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:34.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.140+0000 7f179ffff640 1 -- 172.21.15.193:0/1334326113 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17a8003800 con 0x7f17b8106650 2024-09-11T21:56:34.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.370+0000 7f17bd11e640 1 -- 172.21.15.193:0/1334326113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f17b819b8f0 con 0x7f17b8106650 2024-09-11T21:56:34.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.370+0000 7f179ffff640 1 -- 172.21.15.193:0/1334326113 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f17a803bbf0 con 0x7f17b8106650 2024-09-11T21:56:34.371 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:56:34.371 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":2,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","modified":"2024-09-11T21:56:26.341666Z","created":"2024-09-11T21:55:00.803593Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:3300","nonce":0},{"type":"v1","addr":"172.21.15.193:6789","nonce":0}]},"addr":"172.21.15.193:6789/0","public_addr":"172.21.15.193:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T21:56:34.372 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 2 2024-09-11T21:56:34.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.372+0000 7f17bd11e640 1 -- 172.21.15.193:0/1334326113 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17a0038e00 msgr2=0x7f17a003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:34.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.372+0000 7f17bd11e640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17a0038e00 0x7f17a003b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f17ac006a90 tx=0x7f17ac006a20 comp rx=0 tx=0).stop 2024-09-11T21:56:34.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.372+0000 7f17bd11e640 1 -- 172.21.15.193:0/1334326113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17b8106650 msgr2=0x7f17b81962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:34.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.372+0000 7f17bd11e640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17b8106650 0x7f17b81962d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17a8005ab0 tx=0x7f17a8032c50 comp rx=0 tx=0).stop 2024-09-11T21:56:34.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.372+0000 7f17bd11e640 1 -- 172.21.15.193:0/1334326113 shutdown_connections 2024-09-11T21:56:34.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.372+0000 7f17bd11e640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17a0038e00 0x7f17a003b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:34.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.372+0000 7f17bd11e640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b8196810 0x7f17b819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:34.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.372+0000 7f17bd11e640 1 --2- 172.21.15.193:0/1334326113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17b8106650 0x7f17b81962d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:34.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.372+0000 7f17bd11e640 1 -- 172.21.15.193:0/1334326113 >> 172.21.15.193:0/1334326113 conn(0x7f17b80fc280 msgr2=0x7f17b80fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:34.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.373+0000 7f17bd11e640 1 -- 172.21.15.193:0/1334326113 shutdown_connections 2024-09-11T21:56:34.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:34.373+0000 7f17bd11e640 1 -- 172.21.15.193:0/1334326113 wait complete. 2024-09-11T21:56:35.324 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 podman[35584]: 2024-09-11 21:56:35.301617461 +0000 UTC m=+0.342567351 container start cbe9b448ac45f1b6859740997f137826d01d025cca37329878e847194383aa27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T21:56:35.324 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T21:56:35.324 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T21:56:35.324 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: pidfile_write: ignore empty --pid-file 2024-09-11T21:56:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:35 smithi193 ceph-mon[35545]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:35 smithi193 ceph-mon[35545]: from='client.? 172.21.15.193:0/1334326113' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T21:56:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:35 smithi152 ceph-mon[31188]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:35 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/1334326113' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T21:56:35.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: load: jerasure load: lrc 2024-09-11T21:56:35.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: RocksDB version: 7.9.2 2024-09-11T21:56:35.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Git sha 0 2024-09-11T21:56:35.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T21:56:35.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: DB SUMMARY 2024-09-11T21:56:35.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: DB Session ID: PB6AH4YL7IL3KD4M385I 2024-09-11T21:56:35.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: CURRENT file: CURRENT 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.error_if_exists: 0 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.create_if_missing: 0 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.paranoid_checks: 1 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.env: 0x55dc018c4940 2024-09-11T21:56:35.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.info_log: 0x55dc036ed6e0 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.statistics: (nil) 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.use_fsync: 0 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_log_file_size: 0 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.allow_fallocate: 1 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T21:56:35.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T21:56:35.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.use_direct_reads: 0 2024-09-11T21:56:35.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T21:56:35.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T21:56:35.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.db_log_dir: 2024-09-11T21:56:35.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.wal_dir: 2024-09-11T21:56:35.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T21:56:35.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T21:56:35.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T21:56:35.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T21:56:35.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T21:56:35.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T21:56:35.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T21:56:35.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T21:56:35.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.write_buffer_manager: 0x55dc036fcdc0 2024-09-11T21:56:35.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T21:56:35.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.unordered_write: 0 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T21:56:35.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.row_cache: None 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.wal_filter: None 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.two_write_queues: 0 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.wal_compression: 0 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.atomic_flush: 0 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.log_readahead_size: 0 2024-09-11T21:56:35.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T21:56:35.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T21:56:35.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T21:56:35.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T21:56:35.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T21:56:35.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T21:56:35.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T21:56:35.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_background_jobs: 2 2024-09-11T21:56:35.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_background_compactions: -1 2024-09-11T21:56:35.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_subcompactions: 1 2024-09-11T21:56:35.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T21:56:35.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_open_files: -1 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_background_flushes: -1 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Compression algorithms supported: 2024-09-11T21:56:35.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: kZSTD supported: 0 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: kXpressCompression supported: 0 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: kBZip2Compression supported: 0 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: kLZ4Compression supported: 1 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: kZlibCompression supported: 1 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: kSnappyCompression supported: 1 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.merge_operator: 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_filter: None 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dc036ed320) 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout: cache_index_and_filter_blocks: 1 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout: pin_top_level_index_and_filter: 1 2024-09-11T21:56:35.808 INFO:journalctl@ceph.mon.b.smithi179.stdout: index_type: 0 2024-09-11T21:56:35.809 INFO:journalctl@ceph.mon.b.smithi179.stdout: data_block_index_type: 0 2024-09-11T21:56:35.809 INFO:journalctl@ceph.mon.b.smithi179.stdout: index_shortening: 1 2024-09-11T21:56:35.809 INFO:journalctl@ceph.mon.b.smithi179.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T21:56:35.809 INFO:journalctl@ceph.mon.b.smithi179.stdout: checksum: 4 2024-09-11T21:56:35.809 INFO:journalctl@ceph.mon.b.smithi179.stdout: no_block_cache: 0 2024-09-11T21:56:35.809 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache: 0x55dc036e11f0 2024-09-11T21:56:35.809 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache_name: BinnedLRUCache 2024-09-11T21:56:35.809 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache_options: 2024-09-11T21:56:35.809 INFO:journalctl@ceph.mon.b.smithi179.stdout: capacity : 536870912 2024-09-11T21:56:35.812 INFO:journalctl@ceph.mon.b.smithi179.stdout: num_shard_bits : 4 2024-09-11T21:56:35.812 INFO:journalctl@ceph.mon.b.smithi179.stdout: strict_capacity_limit : 0 2024-09-11T21:56:35.812 INFO:journalctl@ceph.mon.b.smithi179.stdout: high_pri_pool_ratio: 0.000 2024-09-11T21:56:35.812 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache_compressed: (nil) 2024-09-11T21:56:35.812 INFO:journalctl@ceph.mon.b.smithi179.stdout: persistent_cache: (nil) 2024-09-11T21:56:35.812 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_size: 4096 2024-09-11T21:56:35.812 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_size_deviation: 10 2024-09-11T21:56:35.812 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_restart_interval: 16 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: index_block_restart_interval: 1 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: metadata_block_size: 4096 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: partition_filters: 0 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: use_delta_encoding: 1 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: filter_policy: bloomfilter 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: whole_key_filtering: 1 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: verify_compression: 0 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: read_amp_bytes_per_bit: 0 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: format_version: 5 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: enable_index_compression: 1 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_align: 0 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: max_auto_readahead_size: 262144 2024-09-11T21:56:35.813 INFO:journalctl@ceph.mon.b.smithi179.stdout: prepopulate_block_cache: 0 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout: initial_auto_readahead_size: 8192 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compression: NoCompression 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.num_levels: 7 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T21:56:35.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T21:56:35.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T21:56:35.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T21:56:35.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T21:56:35.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T21:56:35.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T21:56:35.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T21:56:35.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T21:56:35.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T21:56:35.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T21:56:35.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T21:56:35.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T21:56:35.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T21:56:35.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T21:56:35.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.inplace_update_support: 0 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.bloom_locality: 0 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.max_successive_merges: 0 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.ttl: 2592000 2024-09-11T21:56:35.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.enable_blob_files: false 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.min_blob_size: 0 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T21:56:35.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f69d1ee2-8a75-4aa0-9fde-80a00c926c39 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726091795328758, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726091795329175, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726091795, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f69d1ee2-8a75-4aa0-9fde-80a00c926c39", "db_session_id": "PB6AH4YL7IL3KD4M385I", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726091795329270, "job": 1, "event": "recovery_finished"} 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55dc0370ee00 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: DB pointer 0x55dc0380a000 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T21:56:35.821 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** DB Stats ** 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** Compaction Stats [default] ** 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T21:56:35.822 INFO:journalctl@ceph.mon.b.smithi179.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** Compaction Stats [default] ** 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T21:56:35.823 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout: Block cache BinnedLRUCache@0x55dc036e11f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-11T21:56:35.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: using public_addr v2:172.21.15.179:0/0 -> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: starting mon.b rank -1 at public addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] at bind addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(???) e0 preinit fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).mds e1 new map 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout: e1 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout: btime 2024-09-11T21:55:03:864852+0000 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout: legacy client fscid: -1 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout: No filesystems configured 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-11T21:56:35.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: Added host smithi193 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:35.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1963693196' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1963693196' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi193", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:35.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi152:172.21.15.152=a;smithi179:172.21.15.179=b;smithi193:172.21.15.193=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:56:35.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: Saving service mon spec with placement smithi152:172.21.15.152=a;smithi179:172.21.15.179=b;smithi193:172.21.15.193=c;count:3 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: Deploying daemon mon.c on smithi193 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/3691109782' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.a calling monitor election 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.c calling monitor election 2024-09-11T21:56:35.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: monmap epoch 2 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: last_changed 2024-09-11T21:56:26.341666+0000 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: created 2024-09-11T21:55:00.803593+0000 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: min_mon_release 19 (squid) 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: election_strategy: 1 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: 0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-11T21:56:35.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: fsmap 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mgrmap e13: x(active, since 37s) 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: overall HEALTH_OK 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: Deploying daemon mon.b on smithi179 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/1136487021' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:35.831 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:35.832 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:35.832 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/1334326113' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T21:56:35.832 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 ceph-mon[35603]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T21:56:35.832 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 bash[35584]: cbe9b448ac45f1b6859740997f137826d01d025cca37329878e847194383aa27 2024-09-11T21:56:35.832 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:35 smithi179 systemd[1]: Started Ceph mon.b for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T21:56:35.972 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T21:56:35.972 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T21:56:36.215 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T21:56:40.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:56:40.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: mon.a calling monitor election 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: mon.c calling monitor election 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: mon.b calling monitor election 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:40.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: monmap epoch 3 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: last_changed 2024-09-11T21:56:35.354741+0000 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: created 2024-09-11T21:55:00.803593+0000 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: min_mon_release 19 (squid) 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: election_strategy: 1 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: 0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: 2: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: fsmap 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T21:56:40.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: mgrmap e13: x(active, since 46s) 2024-09-11T21:56:40.733 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: overall HEALTH_OK 2024-09-11T21:56:40.733 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:40.733 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:40.733 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:40.733 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:40.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:56:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: mon.a calling monitor election 2024-09-11T21:56:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: mon.c calling monitor election 2024-09-11T21:56:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: mon.b calling monitor election 2024-09-11T21:56:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: monmap epoch 3 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: last_changed 2024-09-11T21:56:35.354741+0000 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: created 2024-09-11T21:55:00.803593+0000 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: min_mon_release 19 (squid) 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: election_strategy: 1 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: 0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-11T21:56:40.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: 2: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-09-11T21:56:40.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: fsmap 2024-09-11T21:56:40.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T21:56:40.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: mgrmap e13: x(active, since 46s) 2024-09-11T21:56:40.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: overall HEALTH_OK 2024-09-11T21:56:40.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:40.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:40.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:40.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:40.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:56:40.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: mon.a calling monitor election 2024-09-11T21:56:40.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: mon.c calling monitor election 2024-09-11T21:56:40.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:56:40.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:40.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: mon.b calling monitor election 2024-09-11T21:56:40.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:40.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:40.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:40.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T21:56:40.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: monmap epoch 3 2024-09-11T21:56:40.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:40.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: last_changed 2024-09-11T21:56:35.354741+0000 2024-09-11T21:56:40.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: created 2024-09-11T21:55:00.803593+0000 2024-09-11T21:56:40.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: min_mon_release 19 (squid) 2024-09-11T21:56:40.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: election_strategy: 1 2024-09-11T21:56:40.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: 0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2024-09-11T21:56:40.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.c 2024-09-11T21:56:40.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: 2: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-09-11T21:56:40.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: fsmap 2024-09-11T21:56:40.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T21:56:40.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: mgrmap e13: x(active, since 46s) 2024-09-11T21:56:40.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: overall HEALTH_OK 2024-09-11T21:56:40.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:40.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:40.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:40.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:41.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.055+0000 7f77d58ad640 1 -- 172.21.15.193:0/4203460911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77bc003530 msgr2=0x7f77bc0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:41.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.055+0000 7f77d58ad640 1 --2- 172.21.15.193:0/4203460911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77bc003530 0x7f77bc0059c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77d01016c0 tx=0x7f77c002c490 comp rx=0 tx=0).stop 2024-09-11T21:56:41.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.055+0000 7f77d58ad640 1 -- 172.21.15.193:0/4203460911 shutdown_connections 2024-09-11T21:56:41.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.055+0000 7f77d58ad640 1 --2- 172.21.15.193:0/4203460911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77bc003530 0x7f77bc0059c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:41.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.055+0000 7f77d58ad640 1 -- 172.21.15.193:0/4203460911 >> 172.21.15.193:0/4203460911 conn(0x7f77d00fc280 msgr2=0x7f77d00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:41.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.055+0000 7f77d58ad640 1 -- 172.21.15.193:0/4203460911 shutdown_connections 2024-09-11T21:56:41.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.055+0000 7f77d58ad640 1 -- 172.21.15.193:0/4203460911 wait complete. 2024-09-11T21:56:41.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.056+0000 7f77d58ad640 1 Processor -- start 2024-09-11T21:56:41.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77d58ad640 1 -- start start 2024-09-11T21:56:41.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77d58ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77bc003530 0x7f77d0197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:41.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77d58ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d01978d0 0x7f77d019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:41.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77d58ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d019c1a0 0x7f77d019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:41.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77d58ad640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f77d0108680 con 0x7f77d01978d0 2024-09-11T21:56:41.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77d58ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f77d0108500 con 0x7f77bc003530 2024-09-11T21:56:41.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77d58ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f77d0108800 con 0x7f77d019c1a0 2024-09-11T21:56:41.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ce7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d01978d0 0x7f77d019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:41.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ce7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d01978d0 0x7f77d019bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.193:49688/0 (socket says 172.21.15.193:49688) 2024-09-11T21:56:41.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ce7fc640 1 -- 172.21.15.193:0/2430954832 learned_addr learned my addr 172.21.15.193:0/2430954832 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-11T21:56:41.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77cf7fe640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d019c1a0 0x7f77d019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:41.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ceffd640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77bc003530 0x7f77d0197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:41.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77cf7fe640 1 -- 172.21.15.193:0/2430954832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d019c1a0 msgr2=0x7f77d019c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-11T21:56:41.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77cf7fe640 1 -- 172.21.15.193:0/2430954832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d019c1a0 msgr2=0x7f77d019c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T21:56:41.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77cf7fe640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d019c1a0 0x7f77d019c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77cf7fe640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d019c1a0 0x7f77d019c650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ceffd640 1 -- 172.21.15.193:0/2430954832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77bc003530 msgr2=0x7f77d0197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ceffd640 1 -- 172.21.15.193:0/2430954832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77bc003530 msgr2=0x7f77d0197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ce7fc640 1 -- 172.21.15.193:0/2430954832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d019c1a0 msgr2=0x7f77d019c650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ceffd640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77bc003530 0x7f77d0197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ce7fc640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d019c1a0 0x7f77d019c650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ce7fc640 1 -- 172.21.15.193:0/2430954832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77bc003530 msgr2=0x7f77d0197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ceffd640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77bc003530 0x7f77d0197390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ce7fc640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77bc003530 0x7f77d0197390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.057+0000 7f77ce7fc640 1 -- 172.21.15.193:0/2430954832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d01a3f10 con 0x7f77d01978d0 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.058+0000 7f77ce7fc640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d01978d0 0x7f77d019bc60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77b800b520 tx=0x7f77b800b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.058+0000 7f77d48ab640 1 -- 172.21.15.193:0/2430954832 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b8004230 con 0x7f77d01978d0 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.058+0000 7f77d48ab640 1 -- 172.21.15.193:0/2430954832 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77b80043d0 con 0x7f77d01978d0 2024-09-11T21:56:41.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.058+0000 7f77d48ab640 1 -- 172.21.15.193:0/2430954832 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b8003d60 con 0x7f77d01978d0 2024-09-11T21:56:41.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.058+0000 7f77d58ad640 1 -- 172.21.15.193:0/2430954832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d01a4140 con 0x7f77d01978d0 2024-09-11T21:56:41.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.058+0000 7f77d58ad640 1 -- 172.21.15.193:0/2430954832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d01a46d0 con 0x7f77d01978d0 2024-09-11T21:56:41.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.059+0000 7f77d48ab640 1 -- 172.21.15.193:0/2430954832 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f77b800e070 con 0x7f77d01978d0 2024-09-11T21:56:41.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.059+0000 7f77d58ad640 1 -- 172.21.15.193:0/2430954832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d0101cc0 con 0x7f77d01978d0 2024-09-11T21:56:41.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.059+0000 7f77d48ab640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77b00394f0 0x7f77b003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:41.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.059+0000 7f77d48ab640 1 -- 172.21.15.193:0/2430954832 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f77b804bc60 con 0x7f77d01978d0 2024-09-11T21:56:41.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.059+0000 7f77ceffd640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77b00394f0 0x7f77b003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:41.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.060+0000 7f77ceffd640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77b00394f0 0x7f77b003b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f77c002ca00 tx=0x7f77c002c990 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:41.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.064+0000 7f77d48ab640 1 -- 172.21.15.193:0/2430954832 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77b8014020 con 0x7f77d01978d0 2024-09-11T21:56:41.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.303+0000 7f77d58ad640 1 -- 172.21.15.193:0/2430954832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f77d01a4a60 con 0x7f77d01978d0 2024-09-11T21:56:41.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.304+0000 7f77d48ab640 1 -- 172.21.15.193:0/2430954832 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1289 (secure 0 0 0) 0x7f77b800ed70 con 0x7f77d01978d0 2024-09-11T21:56:41.305 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:56:41.305 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":3,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","modified":"2024-09-11T21:56:35.354741Z","created":"2024-09-11T21:55:00.803593Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:3300","nonce":0},{"type":"v1","addr":"172.21.15.193:6789","nonce":0}]},"addr":"172.21.15.193:6789/0","public_addr":"172.21.15.193:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:3300","nonce":0},{"type":"v1","addr":"172.21.15.179:6789","nonce":0}]},"addr":"172.21.15.179:6789/0","public_addr":"172.21.15.179:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-11T21:56:41.305 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 3 2024-09-11T21:56:41.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 -- 172.21.15.193:0/2430954832 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77b00394f0 msgr2=0x7f77b003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:41.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77b00394f0 0x7f77b003b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f77c002ca00 tx=0x7f77c002c990 comp rx=0 tx=0).stop 2024-09-11T21:56:41.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 -- 172.21.15.193:0/2430954832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d01978d0 msgr2=0x7f77d019bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:41.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d01978d0 0x7f77d019bc60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77b800b520 tx=0x7f77b800b9e0 comp rx=0 tx=0).stop 2024-09-11T21:56:41.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 -- 172.21.15.193:0/2430954832 shutdown_connections 2024-09-11T21:56:41.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77b00394f0 0x7f77b003b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:41.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77d019c1a0 0x7f77d019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:41.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77d01978d0 0x7f77d019bc60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:41.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 --2- 172.21.15.193:0/2430954832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77bc003530 0x7f77d0197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:41.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 -- 172.21.15.193:0/2430954832 >> 172.21.15.193:0/2430954832 conn(0x7f77d00fc280 msgr2=0x7f77d0105950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:41.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 -- 172.21.15.193:0/2430954832 shutdown_connections 2024-09-11T21:56:41.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:41.306+0000 7f77d58ad640 1 -- 172.21.15.193:0/2430954832 wait complete. 2024-09-11T21:56:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:41 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:41 smithi193 ceph-mon[35545]: from='client.? 172.21.15.193:0/2430954832' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T21:56:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:41 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:41.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:41 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:41.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:41 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/2430954832' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T21:56:41.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:41 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:41 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:41 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/2430954832' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T21:56:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:41 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:56:42.085 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-11T21:56:42.085 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-11T21:56:42.338 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:56:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-11T21:56:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-11T21:56:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-11T21:56:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: Updating smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: Updating smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: Reconfiguring daemon mon.a on smithi152 2024-09-11T21:56:42.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:42 smithi152 ceph-mon[31188]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:42.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-11T21:56:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-11T21:56:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-11T21:56:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: Updating smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: Updating smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T21:56:42.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:42.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T21:56:42.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:42.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: Reconfiguring daemon mon.a on smithi152 2024-09-11T21:56:42.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:42 smithi179 ceph-mon[35603]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:42.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:42.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:42.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-11T21:56:42.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-11T21:56:42.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-11T21:56:42.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: Updating smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:42.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:42.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: Updating smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T21:56:42.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:42.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T21:56:42.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:42.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: Reconfiguring daemon mon.a on smithi152 2024-09-11T21:56:42.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:42 smithi193 ceph-mon[35545]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:42.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.963+0000 7f5e593ab640 1 -- 172.21.15.152:0/2664068651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54107690 msgr2=0x7f5e54107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:42.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.964+0000 7f5e593ab640 1 --2- 172.21.15.152:0/2664068651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54107690 0x7f5e54107a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009c20 tx=0x7f5e4402aa90 comp rx=0 tx=0).stop 2024-09-11T21:56:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.964+0000 7f5e593ab640 1 -- 172.21.15.152:0/2664068651 shutdown_connections 2024-09-11T21:56:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.964+0000 7f5e593ab640 1 --2- 172.21.15.152:0/2664068651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54107690 0x7f5e54107a70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.964+0000 7f5e593ab640 1 -- 172.21.15.152:0/2664068651 >> 172.21.15.152:0/2664068651 conn(0x7f5e54076250 msgr2=0x7f5e54076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.964+0000 7f5e593ab640 1 -- 172.21.15.152:0/2664068651 shutdown_connections 2024-09-11T21:56:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.964+0000 7f5e593ab640 1 -- 172.21.15.152:0/2664068651 wait complete. 2024-09-11T21:56:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.964+0000 7f5e593ab640 1 Processor -- start 2024-09-11T21:56:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.964+0000 7f5e593ab640 1 -- start start 2024-09-11T21:56:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e593ab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54107690 0x7f5e541973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e593ab640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e541978f0 0x7f5e5419bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e593ab640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5419c1c0 0x7f5e5419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e593ab640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5410bc90 con 0x7f5e54107690 2024-09-11T21:56:42.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e593ab640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5410bb10 con 0x7f5e5419c1c0 2024-09-11T21:56:42.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e593ab640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5410be10 con 0x7f5e541978f0 2024-09-11T21:56:42.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e52ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54107690 0x7f5e541973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:42.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e52ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54107690 0x7f5e541973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52702/0 (socket says 172.21.15.152:52702) 2024-09-11T21:56:42.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e52ffd640 1 -- 172.21.15.152:0/3983390178 learned_addr learned my addr 172.21.15.152:0/3983390178 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:42.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e52ffd640 1 -- 172.21.15.152:0/3983390178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e541978f0 msgr2=0x7f5e5419bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:42.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e527fc640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e541978f0 0x7f5e5419bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:42.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e537fe640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5419c1c0 0x7f5e5419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:42.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e52ffd640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e541978f0 0x7f5e5419bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:42.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e52ffd640 1 -- 172.21.15.152:0/3983390178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5419c1c0 msgr2=0x7f5e5419c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:42.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e52ffd640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5419c1c0 0x7f5e5419c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:42.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e52ffd640 1 -- 172.21.15.152:0/3983390178 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e541a3f30 con 0x7f5e54107690 2024-09-11T21:56:42.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e527fc640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e541978f0 0x7f5e5419bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T21:56:42.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e537fe640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5419c1c0 0x7f5e5419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T21:56:42.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e52ffd640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54107690 0x7f5e541973b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e44005e30 tx=0x7f5e44003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:42.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.965+0000 7f5e4bfff640 1 -- 172.21.15.152:0/3983390178 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44047070 con 0x7f5e54107690 2024-09-11T21:56:42.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.966+0000 7f5e593ab640 1 -- 172.21.15.152:0/3983390178 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e541a4100 con 0x7f5e54107690 2024-09-11T21:56:42.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.966+0000 7f5e4bfff640 1 -- 172.21.15.152:0/3983390178 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e4402e8a0 con 0x7f5e54107690 2024-09-11T21:56:42.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.966+0000 7f5e4bfff640 1 -- 172.21.15.152:0/3983390178 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44033050 con 0x7f5e54107690 2024-09-11T21:56:42.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.966+0000 7f5e593ab640 1 -- 172.21.15.152:0/3983390178 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e541a4680 con 0x7f5e54107690 2024-09-11T21:56:42.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.966+0000 7f5e4bfff640 1 -- 172.21.15.152:0/3983390178 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f5e4404a070 con 0x7f5e54107690 2024-09-11T21:56:42.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.967+0000 7f5e4bfff640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5e400394f0 0x7f5e4003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:42.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.967+0000 7f5e593ab640 1 -- 172.21.15.152:0/3983390178 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e54107af0 con 0x7f5e54107690 2024-09-11T21:56:42.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.967+0000 7f5e4bfff640 1 -- 172.21.15.152:0/3983390178 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5e4406d2a0 con 0x7f5e54107690 2024-09-11T21:56:42.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.967+0000 7f5e527fc640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5e400394f0 0x7f5e4003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:42.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.967+0000 7f5e527fc640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5e400394f0 0x7f5e4003b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c007920 tx=0x7f5e3c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:42.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:42.971+0000 7f5e4bfff640 1 -- 172.21.15.152:0/3983390178 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e4404b3b0 con 0x7f5e54107690 2024-09-11T21:56:43.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.143+0000 7f5e593ab640 1 -- 172.21.15.152:0/3983390178 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f5e541a4910 con 0x7f5e54107690 2024-09-11T21:56:43.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.143+0000 7f5e4bfff640 1 -- 172.21.15.152:0/3983390178 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7f5e44048d80 con 0x7f5e54107690 2024-09-11T21:56:43.144 INFO:teuthology.orchestra.run.smithi152.stdout:# minimal ceph.conf for 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:43.144 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2024-09-11T21:56:43.144 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T21:56:43.144 INFO:teuthology.orchestra.run.smithi152.stdout: mon_host = [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] 2024-09-11T21:56:43.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 -- 172.21.15.152:0/3983390178 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5e400394f0 msgr2=0x7f5e4003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:43.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5e400394f0 0x7f5e4003b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c007920 tx=0x7f5e3c008040 comp rx=0 tx=0).stop 2024-09-11T21:56:43.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 -- 172.21.15.152:0/3983390178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54107690 msgr2=0x7f5e541973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:43.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54107690 0x7f5e541973b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e44005e30 tx=0x7f5e44003d00 comp rx=0 tx=0).stop 2024-09-11T21:56:43.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 -- 172.21.15.152:0/3983390178 shutdown_connections 2024-09-11T21:56:43.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5419c1c0 0x7f5e5419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:43.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5e400394f0 0x7f5e4003b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:43.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e541978f0 0x7f5e5419bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:43.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 --2- 172.21.15.152:0/3983390178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54107690 0x7f5e541973b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:43.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 -- 172.21.15.152:0/3983390178 >> 172.21.15.152:0/3983390178 conn(0x7f5e54076250 msgr2=0x7f5e540fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:43.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 -- 172.21.15.152:0/3983390178 shutdown_connections 2024-09-11T21:56:43.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:43.145+0000 7f5e593ab640 1 -- 172.21.15.152:0/3983390178 wait complete. 2024-09-11T21:56:43.879 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-11T21:56:43.879 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:56:43.879 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T21:56:43.907 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:56:43.907 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T21:56:43.971 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-11T21:56:43.971 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T21:56:44.005 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-11T21:56:44.005 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T21:56:44.075 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-11T21:56:44.075 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T21:56:44.107 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-11T21:56:44.107 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T21:56:44.176 INFO:tasks.cephadm:Adding mgr.x on smithi152 2024-09-11T21:56:44.176 INFO:tasks.cephadm:Adding mgr.y on smithi179 2024-09-11T21:56:44.177 INFO:tasks.cephadm:Adding mgr.z on smithi193 2024-09-11T21:56:44.177 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi152=x;smithi179=y;smithi193=z' 2024-09-11T21:56:44.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:44 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3983390178' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:44.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:44 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3983390178' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:44.460 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T21:56:44.574 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:44 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3983390178' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:44.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.908+0000 7f0657552640 1 -- 172.21.15.193:0/871243430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06501016e0 msgr2=0x7f0650101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:44.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.908+0000 7f0657552640 1 --2- 172.21.15.193:0/871243430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06501016e0 0x7f0650101ae0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f064c009880 tx=0x7f064c02a5d0 comp rx=0 tx=0).stop 2024-09-11T21:56:44.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.908+0000 7f0657552640 1 -- 172.21.15.193:0/871243430 shutdown_connections 2024-09-11T21:56:44.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.908+0000 7f0657552640 1 --2- 172.21.15.193:0/871243430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06501016e0 0x7f0650101ae0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:44.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.908+0000 7f0657552640 1 -- 172.21.15.193:0/871243430 >> 172.21.15.193:0/871243430 conn(0x7f06500fce90 msgr2=0x7f06500ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:44.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.908+0000 7f0657552640 1 -- 172.21.15.193:0/871243430 shutdown_connections 2024-09-11T21:56:44.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.908+0000 7f0657552640 1 -- 172.21.15.193:0/871243430 wait complete. 2024-09-11T21:56:44.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0657552640 1 Processor -- start 2024-09-11T21:56:44.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0657552640 1 -- start start 2024-09-11T21:56:44.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0657552640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06501016e0 0x7f0650075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:44.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0657552640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06500745e0 0x7f0650074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:44.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0657552640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0650074fa0 0x7f06501a1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:44.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0657552640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f06501077d0 con 0x7f06500745e0 2024-09-11T21:56:44.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0657552640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0650107650 con 0x7f06501016e0 2024-09-11T21:56:44.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0657552640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0650107950 con 0x7f0650074fa0 2024-09-11T21:56:44.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0655aef640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0650074fa0 0x7f06501a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:44.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0655aef640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0650074fa0 0x7f06501a1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:34660/0 (socket says 172.21.15.193:34660) 2024-09-11T21:56:44.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0655aef640 1 -- 172.21.15.193:0/122366567 learned_addr learned my addr 172.21.15.193:0/122366567 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-11T21:56:44.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f06552ee640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06501016e0 0x7f0650075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:44.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0654aed640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06500745e0 0x7f0650074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:44.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0655aef640 1 -- 172.21.15.193:0/122366567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06501016e0 msgr2=0x7f0650075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:44.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0655aef640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06501016e0 0x7f0650075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:44.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0655aef640 1 -- 172.21.15.193:0/122366567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06500745e0 msgr2=0x7f0650074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:44.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0655aef640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06500745e0 0x7f0650074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:44.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.909+0000 7f0655aef640 1 -- 172.21.15.193:0/122366567 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06501a15d0 con 0x7f0650074fa0 2024-09-11T21:56:44.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.910+0000 7f0655aef640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0650074fa0 0x7f06501a1040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f064800ba50 tx=0x7f064800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:44.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.910+0000 7f06467fc640 1 -- 172.21.15.193:0/122366567 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648019070 con 0x7f0650074fa0 2024-09-11T21:56:44.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.910+0000 7f06467fc640 1 -- 172.21.15.193:0/122366567 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f064800cbe0 con 0x7f0650074fa0 2024-09-11T21:56:44.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.910+0000 7f0657552640 1 -- 172.21.15.193:0/122366567 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06501a18c0 con 0x7f0650074fa0 2024-09-11T21:56:44.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.910+0000 7f06467fc640 1 -- 172.21.15.193:0/122366567 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06480076a0 con 0x7f0650074fa0 2024-09-11T21:56:44.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.910+0000 7f0657552640 1 -- 172.21.15.193:0/122366567 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06501a1e30 con 0x7f0650074fa0 2024-09-11T21:56:44.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.911+0000 7f06467fc640 1 -- 172.21.15.193:0/122366567 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f064801c070 con 0x7f0650074fa0 2024-09-11T21:56:44.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.911+0000 7f06467fc640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f063c0394f0 0x7f063c03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:44.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.911+0000 7f0657552640 1 -- 172.21.15.193:0/122366567 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0650190590 con 0x7f0650074fa0 2024-09-11T21:56:44.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.911+0000 7f06467fc640 1 -- 172.21.15.193:0/122366567 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f064804bc10 con 0x7f0650074fa0 2024-09-11T21:56:44.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.911+0000 7f06552ee640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f063c0394f0 0x7f063c03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:44.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.911+0000 7f06552ee640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f063c0394f0 0x7f063c03b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f064c009230 tx=0x7f064c0315d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:44.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:44.916+0000 7f06467fc640 1 -- 172.21.15.193:0/122366567 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06480112a0 con 0x7f0650074fa0 2024-09-11T21:56:45.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.092+0000 7f0657552640 1 -- 172.21.15.193:0/122366567 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi152=x;smithi179=y;smithi193=z", "target": ["mon-mgr", ""]}) -- 0x7f06500626c0 con 0x7f063c0394f0 2024-09-11T21:56:45.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.097+0000 7f06467fc640 1 -- 172.21.15.193:0/122366567 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f06500626c0 con 0x7f063c0394f0 2024-09-11T21:56:45.098 INFO:teuthology.orchestra.run.smithi193.stdout:Scheduled mgr update... 2024-09-11T21:56:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 -- 172.21.15.193:0/122366567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f063c0394f0 msgr2=0x7f063c03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f063c0394f0 0x7f063c03b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f064c009230 tx=0x7f064c0315d0 comp rx=0 tx=0).stop 2024-09-11T21:56:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 -- 172.21.15.193:0/122366567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0650074fa0 msgr2=0x7f06501a1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0650074fa0 0x7f06501a1040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f064800ba50 tx=0x7f064800bf10 comp rx=0 tx=0).stop 2024-09-11T21:56:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 -- 172.21.15.193:0/122366567 shutdown_connections 2024-09-11T21:56:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f063c0394f0 0x7f063c03b9b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0650074fa0 0x7f06501a1040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06500745e0 0x7f0650074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:45.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 --2- 172.21.15.193:0/122366567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06501016e0 0x7f0650075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:45.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 -- 172.21.15.193:0/122366567 >> 172.21.15.193:0/122366567 conn(0x7f06500fce90 msgr2=0x7f06500fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:45.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 -- 172.21.15.193:0/122366567 shutdown_connections 2024-09-11T21:56:45.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:56:45.099+0000 7f0657552640 1 -- 172.21.15.193:0/122366567 wait complete. 2024-09-11T21:56:45.380 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:45 smithi193 ceph-mon[35545]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:45.380 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:45 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.380 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:45 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.380 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:45 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.380 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:45 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:45.380 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:45 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T21:56:45.381 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:45 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:45.381 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:45 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:45 smithi179 ceph-mon[35603]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:45.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:45 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:45 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:45 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:45 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:45.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:45 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T21:56:45.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:45 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:45.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:45 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.641 DEBUG:teuthology.orchestra.run.smithi179:mgr.y> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.y.service 2024-09-11T21:56:45.644 DEBUG:teuthology.orchestra.run.smithi193:mgr.z> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.z.service 2024-09-11T21:56:45.646 INFO:tasks.cephadm:Deploying OSDs... 2024-09-11T21:56:45.646 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T21:56:45.646 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T21:56:45.664 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T21:56:45.664 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-09-11T21:56:45.721 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T21:56:45.722 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:45.722 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T21:56:45.722 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:45.722 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:45.722 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-11 21:56:04.964713078 +0000 2024-09-11T21:56:45.722 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-11 21:51:35.230708362 +0000 2024-09-11T21:56:45.722 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-11 21:51:35.230708362 +0000 2024-09-11T21:56:45.722 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-11 21:51:35.230708362 +0000 2024-09-11T21:56:45.722 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T21:56:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:45 smithi152 ceph-mon[31188]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:45 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:45 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:45 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:45 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:45 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T21:56:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:45 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:45 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-11T21:56:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-11T21:56:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.00025327 s, 2.0 MB/s 2024-09-11T21:56:45.757 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T21:56:45.815 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-09-11T21:56:45.872 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T21:56:45.872 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:45.872 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-11T21:56:45.872 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:45.872 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:45.872 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-11 21:56:04.995712697 +0000 2024-09-11T21:56:45.872 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-11 21:51:35.561704163 +0000 2024-09-11T21:56:45.872 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-11 21:51:35.561704163 +0000 2024-09-11T21:56:45.872 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-11 21:51:35.561704163 +0000 2024-09-11T21:56:45.873 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T21:56:45.937 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-11T21:56:45.937 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-11T21:56:45.937 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.0002094 s, 2.4 MB/s 2024-09-11T21:56:45.938 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T21:56:45.995 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-09-11T21:56:46.051 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T21:56:46.052 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:46.052 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-11T21:56:46.052 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:46.052 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:46.052 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-11 21:56:05.025712329 +0000 2024-09-11T21:56:46.052 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-11 21:51:35.878700142 +0000 2024-09-11T21:56:46.052 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-11 21:51:35.878700142 +0000 2024-09-11T21:56:46.052 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-11 21:51:35.878700142 +0000 2024-09-11T21:56:46.052 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T21:56:46.115 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-11T21:56:46.115 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-11T21:56:46.115 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000169461 s, 3.0 MB/s 2024-09-11T21:56:46.116 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T21:56:46.172 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-09-11T21:56:46.227 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T21:56:46.228 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:46.228 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-11T21:56:46.228 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:46.228 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:46.228 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-11 21:56:05.053711985 +0000 2024-09-11T21:56:46.228 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-11 21:51:36.191696172 +0000 2024-09-11T21:56:46.228 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-11 21:51:36.191696172 +0000 2024-09-11T21:56:46.228 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-11 21:51:36.191696172 +0000 2024-09-11T21:56:46.229 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T21:56:46.291 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-11T21:56:46.292 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-11T21:56:46.292 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.00022022 s, 2.3 MB/s 2024-09-11T21:56:46.293 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T21:56:46.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:46 smithi179 ceph-mon[35603]: Reconfiguring mon.b (monmap changed)... 2024-09-11T21:56:46.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:46 smithi179 ceph-mon[35603]: Reconfiguring daemon mon.b on smithi179 2024-09-11T21:56:46.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:46 smithi179 ceph-mon[35603]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi152=x;smithi179=y;smithi193=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:56:46.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:46 smithi179 ceph-mon[35603]: Saving service mgr spec with placement smithi152=x;smithi179=y;smithi193=z;count:3 2024-09-11T21:56:46.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:46.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:46.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:46.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T21:56:46.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:46.350 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-11T21:56:46.350 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T21:56:46.366 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T21:56:46.366 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-09-11T21:56:46.422 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T21:56:46.422 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:46.422 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T21:56:46.422 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:46.422 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:46.423 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-11 21:56:34.780364770 +0000 2024-09-11T21:56:46.423 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-11 21:52:00.381692436 +0000 2024-09-11T21:56:46.423 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-11 21:52:00.381692436 +0000 2024-09-11T21:56:46.423 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-11 21:52:00.381692436 +0000 2024-09-11T21:56:46.423 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T21:56:46.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:46 smithi152 ceph-mon[31188]: Reconfiguring mon.b (monmap changed)... 2024-09-11T21:56:46.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:46 smithi152 ceph-mon[31188]: Reconfiguring daemon mon.b on smithi179 2024-09-11T21:56:46.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:46 smithi152 ceph-mon[31188]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi152=x;smithi179=y;smithi193=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:56:46.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:46 smithi152 ceph-mon[31188]: Saving service mgr spec with placement smithi152=x;smithi179=y;smithi193=z;count:3 2024-09-11T21:56:46.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:46.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:46.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:46.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T21:56:46.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:46.486 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-11T21:56:46.486 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-11T21:56:46.486 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000255414 s, 2.0 MB/s 2024-09-11T21:56:46.487 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T21:56:46.522 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:46 smithi193 ceph-mon[35545]: Reconfiguring mon.b (monmap changed)... 2024-09-11T21:56:46.522 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:46 smithi193 ceph-mon[35545]: Reconfiguring daemon mon.b on smithi179 2024-09-11T21:56:46.522 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:46 smithi193 ceph-mon[35545]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi152=x;smithi179=y;smithi193=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:56:46.522 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:46 smithi193 ceph-mon[35545]: Saving service mgr spec with placement smithi152=x;smithi179=y;smithi193=z;count:3 2024-09-11T21:56:46.522 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:46.522 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:46.522 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T21:56:46.522 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T21:56:46.522 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:46.543 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-09-11T21:56:46.598 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T21:56:46.599 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:46.599 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-11T21:56:46.599 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:46.599 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:46.599 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-11 21:56:34.781364747 +0000 2024-09-11T21:56:46.599 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-11 21:52:00.708684865 +0000 2024-09-11T21:56:46.599 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-11 21:52:00.708684865 +0000 2024-09-11T21:56:46.599 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-11 21:52:00.708684865 +0000 2024-09-11T21:56:46.600 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T21:56:46.661 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-11T21:56:46.661 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-11T21:56:46.661 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000184343 s, 2.8 MB/s 2024-09-11T21:56:46.663 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T21:56:46.720 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-09-11T21:56:46.776 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T21:56:46.776 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:46.776 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T21:56:46.776 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:46.776 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:46.776 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-11 21:56:34.781364747 +0000 2024-09-11T21:56:46.777 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-11 21:52:01.043677110 +0000 2024-09-11T21:56:46.777 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-11 21:52:01.043677110 +0000 2024-09-11T21:56:46.777 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-11 21:52:01.043677110 +0000 2024-09-11T21:56:46.777 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T21:56:46.839 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-11T21:56:46.839 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-11T21:56:46.840 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000203942 s, 2.5 MB/s 2024-09-11T21:56:46.841 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T21:56:46.897 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-09-11T21:56:46.952 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T21:56:46.952 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:46.952 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-11T21:56:46.952 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:46.952 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:46.953 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-11 21:56:34.781364747 +0000 2024-09-11T21:56:46.953 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-11 21:52:01.375669423 +0000 2024-09-11T21:56:46.953 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-11 21:52:01.375669423 +0000 2024-09-11T21:56:46.953 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-11 21:52:01.375669423 +0000 2024-09-11T21:56:46.953 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T21:56:47.015 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-11T21:56:47.016 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-11T21:56:47.016 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000187572 s, 2.7 MB/s 2024-09-11T21:56:47.017 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T21:56:47.073 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-11T21:56:47.073 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T21:56:47.090 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T21:56:47.090 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_1 2024-09-11T21:56:47.149 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T21:56:47.149 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:47.149 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-11T21:56:47.149 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:47.149 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:47.149 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-11 21:56:25.812840096 +0000 2024-09-11T21:56:47.149 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-11 21:51:53.295720753 +0000 2024-09-11T21:56:47.150 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-11 21:51:53.295720753 +0000 2024-09-11T21:56:47.150 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-11 21:51:53.295720753 +0000 2024-09-11T21:56:47.150 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T21:56:47.216 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-11T21:56:47.216 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-11T21:56:47.216 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000200225 s, 2.6 MB/s 2024-09-11T21:56:47.218 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T21:56:47.273 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_2 2024-09-11T21:56:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T21:56:47.329 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:47.329 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-11T21:56:47.329 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:47.329 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:47.329 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-11 21:56:25.813840080 +0000 2024-09-11T21:56:47.329 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-11 21:51:53.604715581 +0000 2024-09-11T21:56:47.329 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-11 21:51:53.605715564 +0000 2024-09-11T21:56:47.330 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-11 21:51:53.604715581 +0000 2024-09-11T21:56:47.330 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T21:56:47.393 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-11T21:56:47.393 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-11T21:56:47.393 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000200377 s, 2.6 MB/s 2024-09-11T21:56:47.394 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T21:56:47.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:47 smithi193 ceph-mon[35545]: Reconfiguring mon.c (monmap changed)... 2024-09-11T21:56:47.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:47 smithi193 ceph-mon[35545]: Reconfiguring daemon mon.c on smithi193 2024-09-11T21:56:47.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:47 smithi193 ceph-mon[35545]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:47.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:47.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:47.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:47.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:47.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:47.435 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:47.435 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T21:56:47.450 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_3 2024-09-11T21:56:47.507 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T21:56:47.507 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:47.507 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-11T21:56:47.507 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:47.507 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:47.507 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-11 21:56:25.813840080 +0000 2024-09-11T21:56:47.507 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-11 21:51:53.932710091 +0000 2024-09-11T21:56:47.508 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-11 21:51:53.932710091 +0000 2024-09-11T21:56:47.508 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-11 21:51:53.932710091 +0000 2024-09-11T21:56:47.508 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T21:56:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:47 smithi179 ceph-mon[35603]: Reconfiguring mon.c (monmap changed)... 2024-09-11T21:56:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:47 smithi179 ceph-mon[35603]: Reconfiguring daemon mon.c on smithi193 2024-09-11T21:56:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:47 smithi179 ceph-mon[35603]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:47.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:47.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:47.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:47.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:47.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T21:56:47.573 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-11T21:56:47.573 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-11T21:56:47.573 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000167481 s, 3.1 MB/s 2024-09-11T21:56:47.575 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T21:56:47.631 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_4 2024-09-11T21:56:47.686 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T21:56:47.687 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T21:56:47.687 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-11T21:56:47.687 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T21:56:47.687 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T21:56:47.687 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-11 21:56:25.813840080 +0000 2024-09-11T21:56:47.687 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-11 21:51:54.246704835 +0000 2024-09-11T21:56:47.687 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-11 21:51:54.246704835 +0000 2024-09-11T21:56:47.687 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-11 21:51:54.246704835 +0000 2024-09-11T21:56:47.687 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T21:56:47.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:47 smithi152 ceph-mon[31188]: Reconfiguring mon.c (monmap changed)... 2024-09-11T21:56:47.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:47 smithi152 ceph-mon[31188]: Reconfiguring daemon mon.c on smithi193 2024-09-11T21:56:47.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:47 smithi152 ceph-mon[31188]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:47.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:47.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:47.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:47.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:47.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:47.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:47.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T21:56:47.750 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-11T21:56:47.751 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-11T21:56:47.751 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000170091 s, 3.0 MB/s 2024-09-11T21:56:47.752 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T21:56:47.808 INFO:tasks.cephadm:Deploying osd.0 on smithi152 with /dev/vg_nvme/lv_4... 2024-09-11T21:56:47.809 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T21:56:48.061 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:56:48.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T21:56:48.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T21:56:48.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:48.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:48 smithi193 ceph-mon[35545]: Deploying daemon mgr.z on smithi193 2024-09-11T21:56:48.457 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T21:56:48.457 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T21:56:48.457 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:48.457 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:48 smithi152 ceph-mon[31188]: Deploying daemon mgr.z on smithi193 2024-09-11T21:56:48.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T21:56:48.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T21:56:48.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:48 smithi179 ceph-mon[35603]: Deploying daemon mgr.z on smithi193 2024-09-11T21:56:49.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:49 smithi193 ceph-mon[35545]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:49.326 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:49 smithi193 podman[37342]: 2024-09-11 21:56:49.269814476 +0000 UTC m=+0.113941713 container create 1e1903b35b26499d458f09a4b59eb0eedf05b3978c8954ebb3b30c7febe8cc14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T21:56:49.507 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:49 smithi152 ceph-mon[31188]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:49.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:49 smithi179 ceph-mon[35603]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:49.622 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:49 smithi193 podman[37342]: 2024-09-11 21:56:49.480425717 +0000 UTC m=+0.324552958 container init 1e1903b35b26499d458f09a4b59eb0eedf05b3978c8954ebb3b30c7febe8cc14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T21:56:49.622 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:49 smithi193 podman[37342]: 2024-09-11 21:56:49.483276506 +0000 UTC m=+0.327403749 container start 1e1903b35b26499d458f09a4b59eb0eedf05b3978c8954ebb3b30c7febe8cc14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-11T21:56:49.622 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:49 smithi193 ceph-mgr[37361]: -- 172.21.15.193:0/3332944505 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559994e310e0 con 0x559994e0e800 2024-09-11T21:56:49.622 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:49 smithi193 bash[37342]: 1e1903b35b26499d458f09a4b59eb0eedf05b3978c8954ebb3b30c7febe8cc14 2024-09-11T21:56:49.622 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:49 smithi193 systemd[1]: Started Ceph mgr.z for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T21:56:49.890 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:49.620+0000 7fbee4cc3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T21:56:49.890 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:49.678+0000 7fbee4cc3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T21:56:49.890 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:49.824+0000 7fbee4cc3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T21:56:49.890 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:49.889+0000 7fbee4cc3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T21:56:50.172 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:50.034+0000 7fbee4cc3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T21:56:50.172 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:50.171+0000 7fbee4cc3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T21:56:50.580 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:56:50.606 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_4 2024-09-11T21:56:50.826 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:50.481+0000 7fbee4cc3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T21:56:50.826 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:50.541+0000 7fbee4cc3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T21:56:50.826 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:50.725+0000 7fbee4cc3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T21:56:50.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:50.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:50.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:50.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T21:56:50.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T21:56:50.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T21:56:50.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:50.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-mon[35545]: Deploying daemon mgr.y on smithi179 2024-09-11T21:56:50.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:50 smithi193 ceph-mon[35545]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:50.849 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:56:50.962 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:50 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:50.962 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:50 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:50.962 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:50 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:50.962 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:50 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T21:56:50.963 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:50 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T21:56:50.963 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:50 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T21:56:50.963 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:50 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:50.963 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:50 smithi152 ceph-mon[31188]: Deploying daemon mgr.y on smithi179 2024-09-11T21:56:50.963 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:50 smithi152 ceph-mon[31188]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:51.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:50 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:51.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:50 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:51.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:50 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:51.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:50 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T21:56:51.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:50 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T21:56:51.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:50 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T21:56:51.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:50 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:51.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:50 smithi179 ceph-mon[35603]: Deploying daemon mgr.y on smithi179 2024-09-11T21:56:51.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:50 smithi179 ceph-mon[35603]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:51.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.279+0000 7fad88e54640 1 -- 172.21.15.152:0/3720262103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad841026e0 msgr2=0x7fad84104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:51.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.279+0000 7fad88e54640 1 --2- 172.21.15.152:0/3720262103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad841026e0 0x7fad84104ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad74009900 tx=0x7fad7402a410 comp rx=0 tx=0).stop 2024-09-11T21:56:51.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.279+0000 7fad88e54640 1 -- 172.21.15.152:0/3720262103 shutdown_connections 2024-09-11T21:56:51.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.279+0000 7fad88e54640 1 --2- 172.21.15.152:0/3720262103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad84107940 0x7fad84109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:51.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.279+0000 7fad88e54640 1 --2- 172.21.15.152:0/3720262103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad84105010 0x7fad84107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:51.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.279+0000 7fad88e54640 1 --2- 172.21.15.152:0/3720262103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad841026e0 0x7fad84104ad0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:51.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.279+0000 7fad88e54640 1 -- 172.21.15.152:0/3720262103 >> 172.21.15.152:0/3720262103 conn(0x7fad840fc280 msgr2=0x7fad840fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.280+0000 7fad88e54640 1 -- 172.21.15.152:0/3720262103 shutdown_connections 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.280+0000 7fad88e54640 1 -- 172.21.15.152:0/3720262103 wait complete. 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.280+0000 7fad88e54640 1 Processor -- start 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.280+0000 7fad88e54640 1 -- start start 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad88e54640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad841026e0 0x7fad84197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad88e54640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad84105010 0x7fad84198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad88e54640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad84107940 0x7fad8419f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad88e54640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad8410d860 con 0x7fad84107940 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad88e54640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fad8410d6e0 con 0x7fad841026e0 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad88e54640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fad8410d9e0 con 0x7fad84105010 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad82d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad84107940 0x7fad8419f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:51.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad82d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad84107940 0x7fad8419f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47084/0 (socket says 172.21.15.152:47084) 2024-09-11T21:56:51.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad79d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad84105010 0x7fad84198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:51.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad82d9d640 1 -- 172.21.15.152:0/3550235135 learned_addr learned my addr 172.21.15.152:0/3550235135 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:56:51.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad8259c640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad841026e0 0x7fad84197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:51.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad82d9d640 1 -- 172.21.15.152:0/3550235135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad84105010 msgr2=0x7fad84198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:51.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad82d9d640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad84105010 0x7fad84198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:51.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad82d9d640 1 -- 172.21.15.152:0/3550235135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad841026e0 msgr2=0x7fad84197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:56:51.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad82d9d640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad841026e0 0x7fad84197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:56:51.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad82d9d640 1 -- 172.21.15.152:0/3550235135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8419fb70 con 0x7fad84107940 2024-09-11T21:56:51.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad82d9d640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad84107940 0x7fad8419f500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009fd0 tx=0x7fad7c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:51.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad7bfff640 1 -- 172.21.15.152:0/3550235135 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c017070 con 0x7fad84107940 2024-09-11T21:56:51.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad88e54640 1 -- 172.21.15.152:0/3550235135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8419fe60 con 0x7fad84107940 2024-09-11T21:56:51.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad7bfff640 1 -- 172.21.15.152:0/3550235135 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad7c003e50 con 0x7fad84107940 2024-09-11T21:56:51.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad7bfff640 1 -- 172.21.15.152:0/3550235135 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0106c0 con 0x7fad84107940 2024-09-11T21:56:51.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.281+0000 7fad88e54640 1 -- 172.21.15.152:0/3550235135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad841a02c0 con 0x7fad84107940 2024-09-11T21:56:51.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.282+0000 7fad7bfff640 1 -- 172.21.15.152:0/3550235135 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fad7c010860 con 0x7fad84107940 2024-09-11T21:56:51.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.282+0000 7fad7bfff640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fad700392c0 0x7fad7003b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:56:51.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.282+0000 7fad7bfff640 1 -- 172.21.15.152:0/3550235135 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fad7c04d140 con 0x7fad84107940 2024-09-11T21:56:51.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.283+0000 7fad8259c640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fad700392c0 0x7fad7003b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:56:51.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.283+0000 7fad88e54640 1 -- 172.21.15.152:0/3550235135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad840fdd70 con 0x7fad84107940 2024-09-11T21:56:51.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.283+0000 7fad8259c640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fad700392c0 0x7fad7003b780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad740314e0 tx=0x7fad74000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:56:51.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.287+0000 7fad7bfff640 1 -- 172.21.15.152:0/3550235135 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad7c01f170 con 0x7fad84107940 2024-09-11T21:56:51.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:51.461+0000 7fad88e54640 1 -- 172.21.15.152:0/3550235135 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fad84062630 con 0x7fad700392c0 2024-09-11T21:56:51.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:51 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:56:51.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:51 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:56:51.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:51 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:51.797 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:51 smithi179 systemd[1]: Starting Ceph mgr.y for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T21:56:51.940 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:51 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:56:51.940 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:51 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:56:51.940 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:51 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:52.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:51 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:56:52.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:51 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:56:52.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:51 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:52.077 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:51 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:51.599+0000 7fbee4cc3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T21:56:52.077 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:51 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:51.666+0000 7fbee4cc3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T21:56:52.177 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:51 smithi179 podman[36957]: 2024-09-11 21:56:51.908358012 +0000 UTC m=+0.098843580 container create ad81e25ae915ac667d7e39c05e16bd72fefee6c69d23d256bda3e09cb476e83a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T21:56:52.178 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:51 smithi179 podman[36957]: 2024-09-11 21:56:51.825282934 +0000 UTC m=+0.015768502 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T21:56:52.178 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:52 smithi179 podman[36957]: 2024-09-11 21:56:52.102477514 +0000 UTC m=+0.292963081 container init ad81e25ae915ac667d7e39c05e16bd72fefee6c69d23d256bda3e09cb476e83a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T21:56:52.178 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:52 smithi179 podman[36957]: 2024-09-11 21:56:52.106069629 +0000 UTC m=+0.296555204 container start ad81e25ae915ac667d7e39c05e16bd72fefee6c69d23d256bda3e09cb476e83a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-11T21:56:52.178 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:52 smithi179 ceph-mgr[36976]: -- 172.21.15.179:0/2787657096 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a38800d0e0 con 0x55a387feb400 2024-09-11T21:56:52.178 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:52 smithi179 bash[36957]: ad81e25ae915ac667d7e39c05e16bd72fefee6c69d23d256bda3e09cb476e83a 2024-09-11T21:56:52.460 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:52 smithi179 systemd[1]: Started Ceph mgr.y for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T21:56:52.460 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:52.237+0000 7fd9e8ff1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T21:56:52.460 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:52.299+0000 7fd9e8ff1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T21:56:52.460 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:52.458+0000 7fd9e8ff1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T21:56:52.655 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:52.381+0000 7fbee4cc3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T21:56:52.656 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:52.502+0000 7fbee4cc3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T21:56:52.656 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:52.654+0000 7fbee4cc3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T21:56:52.796 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:52.525+0000 7fd9e8ff1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T21:56:52.796 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:52.701+0000 7fd9e8ff1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T21:56:52.936 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:52.723+0000 7fbee4cc3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T21:56:52.936 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:52.881+0000 7fbee4cc3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T21:56:53.191 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:52.865+0000 7fd9e8ff1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T21:56:53.243 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:52.951+0000 7fbee4cc3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T21:56:53.243 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:53.014+0000 7fbee4cc3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T21:56:53.243 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:53.177+0000 7fbee4cc3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T21:56:53.243 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:53.242+0000 7fbee4cc3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T21:56:53.391 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:53 smithi152 ceph-mon[31188]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:56:53.392 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:53 smithi152 ceph-mon[31188]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:53.392 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.392 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.392 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.392 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.392 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:53.468 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:53 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:53.189+0000 7fd9e8ff1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T21:56:53.468 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:53 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:53.252+0000 7fd9e8ff1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T21:56:53.468 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:53 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:53.466+0000 7fd9e8ff1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T21:56:53.468 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:53 smithi179 ceph-mon[35603]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:56:53.468 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:53 smithi179 ceph-mon[35603]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:53.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:53.520 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-mon[35545]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:56:53.520 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-mon[35545]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:53.520 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.520 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.520 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.520 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:53.521 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:56:53.521 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:53.309+0000 7fbee4cc3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T21:56:53.521 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:53.398+0000 7fbee4cc3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T21:56:53.521 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:53.460+0000 7fbee4cc3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T21:56:53.521 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:53.519+0000 7fbee4cc3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T21:56:54.576 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T21:56:54.305+0000 7fbee4cc3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T21:56:54.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:54.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:54.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: Reconfiguring daemon mgr.x on smithi152 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2232265380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90c6f283-df62-405d-921a-5a8144b114f3"}]: dispatch 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2232265380' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90c6f283-df62-405d-921a-5a8144b114f3"}]': finished 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2459756496' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:56:54.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: Standby manager daemon z started 2024-09-11T21:56:54.579 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T21:56:54.579 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T21:56:54.579 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T21:56:54.579 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:54 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T21:56:54.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: Reconfiguring daemon mgr.x on smithi152 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2232265380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90c6f283-df62-405d-921a-5a8144b114f3"}]: dispatch 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2232265380' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90c6f283-df62-405d-921a-5a8144b114f3"}]': finished 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T21:56:54.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:56:54.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:54.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2459756496' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:56:54.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: Standby manager daemon z started 2024-09-11T21:56:54.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T21:56:54.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T21:56:54.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T21:56:54.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:54 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T21:56:54.796 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:54.352+0000 7fd9e8ff1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T21:56:54.796 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:54.420+0000 7fd9e8ff1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T21:56:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:56:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T21:56:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T21:56:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T21:56:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: Reconfiguring daemon mgr.x on smithi152 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2232265380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90c6f283-df62-405d-921a-5a8144b114f3"}]: dispatch 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2232265380' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90c6f283-df62-405d-921a-5a8144b114f3"}]': finished 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2459756496' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: Standby manager daemon z started 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T21:56:54.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T21:56:54.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:54 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.193:0/2774279517' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T21:56:55.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:55.246+0000 7fad7bfff640 1 -- 172.21.15.152:0/3550235135 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 14) ==== 92061+0+0 (secure 0 0 0) 0x7fad7c00f8e0 con 0x7fad84107940 2024-09-11T21:56:55.398 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:55.138+0000 7fd9e8ff1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T21:56:55.399 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:55.253+0000 7fd9e8ff1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T21:56:55.675 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:55.397+0000 7fd9e8ff1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T21:56:55.676 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:55.457+0000 7fd9e8ff1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T21:56:55.676 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:55.606+0000 7fd9e8ff1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T21:56:55.676 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:55.673+0000 7fd9e8ff1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T21:56:55.957 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:55.734+0000 7fd9e8ff1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T21:56:55.957 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:55.890+0000 7fd9e8ff1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T21:56:55.957 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:55.955+0000 7fd9e8ff1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T21:56:56.223 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:56 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:56.022+0000 7fd9e8ff1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T21:56:56.223 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:56 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:56.103+0000 7fd9e8ff1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T21:56:56.223 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:56 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:56.162+0000 7fd9e8ff1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T21:56:56.223 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:56 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:56.221+0000 7fd9e8ff1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T21:56:56.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:56 smithi179 ceph-mon[35603]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-11T21:56:56.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T21:56:56.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:56 smithi193 ceph-mon[35545]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-11T21:56:56.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T21:56:56.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:56 smithi152 ceph-mon[31188]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-11T21:56:56.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T21:56:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:56:57.258+0000 7fad7bfff640 1 -- 172.21.15.152:0/3550235135 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7fad7c00f3c0 con 0x7fad84107940 2024-09-11T21:56:57.296 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 21:56:57 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T21:56:57.011+0000 7fd9e8ff1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T21:56:57.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:57 smithi179 ceph-mon[35603]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:57.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:57 smithi179 ceph-mon[35603]: Standby manager daemon y started 2024-09-11T21:56:57.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:57 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T21:56:57.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:57 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T21:56:57.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:57 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T21:56:57.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:57 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T21:56:57.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:57 smithi193 ceph-mon[35545]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:57.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:57 smithi193 ceph-mon[35545]: Standby manager daemon y started 2024-09-11T21:56:57.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:57 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T21:56:57.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:57 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T21:56:57.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:57 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T21:56:57.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:57 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T21:56:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:57 smithi152 ceph-mon[31188]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:57 smithi152 ceph-mon[31188]: Standby manager daemon y started 2024-09-11T21:56:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:57 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T21:56:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:57 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T21:56:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:57 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T21:56:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:57 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.179:0/4038755604' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T21:56:58.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:58 smithi179 ceph-mon[35603]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-11T21:56:58.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:58 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T21:56:58.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:58 smithi193 ceph-mon[35545]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-11T21:56:58.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:58 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T21:56:58.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:58 smithi152 ceph-mon[31188]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-11T21:56:58.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:58 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T21:56:59.465 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:56:59 smithi152 ceph-mon[31188]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:59.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:56:59 smithi179 ceph-mon[35603]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:56:59.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:56:59 smithi193 ceph-mon[35545]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:01.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:01 smithi179 ceph-mon[35603]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:01.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:01 smithi193 ceph-mon[35545]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:01.630 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:01 smithi152 ceph-mon[31188]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:02.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:02.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:02.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:02.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:02.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:02.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:02.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:02 smithi179 ceph-mon[35603]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:02.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:02.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:02.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:02.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:02.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:02.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:02.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:02 smithi193 ceph-mon[35545]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:02.837 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:02.838 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:02.838 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:02.838 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:02.838 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:02.838 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:02.838 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:02 smithi152 ceph-mon[31188]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:04.097 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:04 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T21:57:04.097 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:04 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:04.097 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:04 smithi193 ceph-mon[35545]: Deploying daemon osd.0 on smithi152 2024-09-11T21:57:04.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:04 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T21:57:04.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:04 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:04.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:04 smithi152 ceph-mon[31188]: Deploying daemon osd.0 on smithi152 2024-09-11T21:57:04.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:04 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T21:57:04.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:04 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:04.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:04 smithi179 ceph-mon[35603]: Deploying daemon osd.0 on smithi152 2024-09-11T21:57:05.200 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:05 smithi152 ceph-mon[31188]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:05.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:05 smithi193 ceph-mon[35545]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:05.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:05 smithi179 ceph-mon[35603]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:07.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:07 smithi179 ceph-mon[35603]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:07.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:07 smithi193 ceph-mon[35545]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:07 smithi152 ceph-mon[31188]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:09.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:09 smithi152 ceph-mon[31188]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:09.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:09 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:09.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:09 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:09.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:09 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:09.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:09 smithi179 ceph-mon[35603]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:09.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:09 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:09.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:09 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:09.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:09 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:09 smithi193 ceph-mon[35545]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:09 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:09 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:09 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:11.537 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:11 smithi152 ceph-mon[31188]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:11.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:11 smithi179 ceph-mon[35603]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:11.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:11 smithi193 ceph-mon[35545]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:12.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:12.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:12.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:12.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:12.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:12.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:12 smithi152 ceph-mon[31188]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:13.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:13.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:13.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:12 smithi179 ceph-mon[35603]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:13.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:13.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:12 smithi193 ceph-mon[35545]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:13.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.364+0000 7fad7bfff640 1 -- 172.21.15.152:0/3550235135 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fad84062630 con 0x7fad700392c0 2024-09-11T21:57:13.365 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 0 on host 'smithi152' 2024-09-11T21:57:13.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.367+0000 7fad88e54640 1 -- 172.21.15.152:0/3550235135 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fad700392c0 msgr2=0x7fad7003b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:57:13.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.367+0000 7fad88e54640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fad700392c0 0x7fad7003b780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad740314e0 tx=0x7fad74000bc0 comp rx=0 tx=0).stop 2024-09-11T21:57:13.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.367+0000 7fad88e54640 1 -- 172.21.15.152:0/3550235135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad84107940 msgr2=0x7fad8419f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:57:13.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.367+0000 7fad88e54640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad84107940 0x7fad8419f500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009fd0 tx=0x7fad7c00b260 comp rx=0 tx=0).stop 2024-09-11T21:57:13.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.368+0000 7fad88e54640 1 -- 172.21.15.152:0/3550235135 shutdown_connections 2024-09-11T21:57:13.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.368+0000 7fad88e54640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad84107940 0x7fad8419f500 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:13.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.368+0000 7fad88e54640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fad700392c0 0x7fad7003b780 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:13.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.368+0000 7fad88e54640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad84105010 0x7fad84198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:13.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.368+0000 7fad88e54640 1 --2- 172.21.15.152:0/3550235135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad841026e0 0x7fad84197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:13.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.368+0000 7fad88e54640 1 -- 172.21.15.152:0/3550235135 >> 172.21.15.152:0/3550235135 conn(0x7fad840fc280 msgr2=0x7fad84103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:57:13.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.368+0000 7fad88e54640 1 -- 172.21.15.152:0/3550235135 shutdown_connections 2024-09-11T21:57:13.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:57:13.368+0000 7fad88e54640 1 -- 172.21.15.152:0/3550235135 wait complete. 2024-09-11T21:57:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:13 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:13 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:13 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:13.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:13 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:13.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:13 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:13.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:13 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:14.024 DEBUG:teuthology.orchestra.run.smithi152:osd.0> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.0.service 2024-09-11T21:57:14.027 INFO:tasks.cephadm:Deploying osd.1 on smithi179 with /dev/vg_nvme/lv_4... 2024-09-11T21:57:14.027 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T21:57:14.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:13 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:14.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:13 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:14.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:13 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:14.273 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T21:57:14.699 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:14 smithi179 ceph-mon[35603]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:14.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:14 smithi193 ceph-mon[35545]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:14.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:14 smithi152 ceph-mon[31188]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:15.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:15 smithi152 ceph-mon[31188]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T21:57:15.730 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 21:57:15 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0[44734]: 2024-09-11T21:57:15.503+0000 7f973d089640 -1 osd.0 0 log_to_monitors true 2024-09-11T21:57:15.975 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:15 smithi179 ceph-mon[35603]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T21:57:16.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:15 smithi193 ceph-mon[35545]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T21:57:16.636 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:16 smithi179 ceph-mon[35603]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T21:57:16.636 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:16 smithi179 ceph-mon[35603]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T21:57:16.636 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:16 smithi179 ceph-mon[35603]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T21:57:16.636 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:16 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:16.636 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:16 smithi179 ceph-mon[35603]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:16.639 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:57:16.666 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_4 2024-09-11T21:57:16.712 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 21:57:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0[44734]: 2024-09-11T21:57:16.612+0000 7f97387e9640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T21:57:16.712 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 21:57:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0[44734]: 2024-09-11T21:57:16.618+0000 7f9734e23640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T21:57:16.712 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:16 smithi152 ceph-mon[31188]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T21:57:16.712 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:16 smithi152 ceph-mon[31188]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T21:57:16.713 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:16 smithi152 ceph-mon[31188]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T21:57:16.713 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:16 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:16.713 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:16 smithi152 ceph-mon[31188]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:16.937 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T21:57:17.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:16 smithi193 ceph-mon[35545]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T21:57:17.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:16 smithi193 ceph-mon[35545]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T21:57:17.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:16 smithi193 ceph-mon[35545]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T21:57:17.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:16 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:17.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:16 smithi193 ceph-mon[35545]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:17.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.440+0000 7f757e7ed640 1 -- 172.21.15.179:0/197028972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578101740 msgr2=0x7f7578108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:57:17.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.440+0000 7f757e7ed640 1 --2- 172.21.15.179:0/197028972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578101740 0x7f7578108fe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7570009ca0 tx=0x7f757002a8c0 comp rx=0 tx=0).stop 2024-09-11T21:57:17.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.440+0000 7f757e7ed640 1 -- 172.21.15.179:0/197028972 shutdown_connections 2024-09-11T21:57:17.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.440+0000 7f757e7ed640 1 --2- 172.21.15.179:0/197028972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578101740 0x7f7578108fe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:17.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.440+0000 7f757e7ed640 1 --2- 172.21.15.179:0/197028972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7578100d80 0x7f7578101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:17.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.440+0000 7f757e7ed640 1 --2- 172.21.15.179:0/197028972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7578102120 0x7f7578102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:17.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.440+0000 7f757e7ed640 1 -- 172.21.15.179:0/197028972 >> 172.21.15.179:0/197028972 conn(0x7f75780fba40 msgr2=0x7f75780fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:57:17.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.440+0000 7f757e7ed640 1 -- 172.21.15.179:0/197028972 shutdown_connections 2024-09-11T21:57:17.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.440+0000 7f757e7ed640 1 -- 172.21.15.179:0/197028972 wait complete. 2024-09-11T21:57:17.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.441+0000 7f757e7ed640 1 Processor -- start 2024-09-11T21:57:17.456 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.441+0000 7f757e7ed640 1 -- start start 2024-09-11T21:57:17.456 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.441+0000 7f757e7ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578100d80 0x7f7578197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:57:17.456 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.441+0000 7f757e7ed640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7578101740 0x7f7578198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:57:17.456 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.441+0000 7f757e7ed640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7578102120 0x7f757819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:57:17.456 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.441+0000 7f757e7ed640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f757810d910 con 0x7f7578101740 2024-09-11T21:57:17.456 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.441+0000 7f757e7ed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f757810d790 con 0x7f7578100d80 2024-09-11T21:57:17.456 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.441+0000 7f757e7ed640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f757810da90 con 0x7f7578102120 2024-09-11T21:57:17.456 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.441+0000 7f7577fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578100d80 0x7f7578197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:57:17.456 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.441+0000 7f7577fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578100d80 0x7f7578197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:51126/0 (socket says 172.21.15.179:51126) 2024-09-11T21:57:17.456 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.441+0000 7f7577fff640 1 -- 172.21.15.179:0/2344600249 learned_addr learned my addr 172.21.15.179:0/2344600249 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f757cd8a640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7578102120 0x7f757819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f75777fe640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7578101740 0x7f7578198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f7577fff640 1 -- 172.21.15.179:0/2344600249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7578102120 msgr2=0x7f757819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f7577fff640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7578102120 0x7f757819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f7577fff640 1 -- 172.21.15.179:0/2344600249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7578101740 msgr2=0x7f7578198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f7577fff640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7578101740 0x7f7578198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f7577fff640 1 -- 172.21.15.179:0/2344600249 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757819fb40 con 0x7f7578100d80 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f7577fff640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578100d80 0x7f7578197f10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f756800c970 tx=0x7f756800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f75757fa640 1 -- 172.21.15.179:0/2344600249 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568004220 con 0x7f7578100d80 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f75757fa640 1 -- 172.21.15.179:0/2344600249 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75680043c0 con 0x7f7578100d80 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f757e7ed640 1 -- 172.21.15.179:0/2344600249 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757819fe30 con 0x7f7578100d80 2024-09-11T21:57:17.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f75757fa640 1 -- 172.21.15.179:0/2344600249 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756800f450 con 0x7f7578100d80 2024-09-11T21:57:17.458 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.442+0000 7f757e7ed640 1 -- 172.21.15.179:0/2344600249 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75781a02e0 con 0x7f7578100d80 2024-09-11T21:57:17.458 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.443+0000 7f757e7ed640 1 -- 172.21.15.179:0/2344600249 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7578107fb0 con 0x7f7578100d80 2024-09-11T21:57:17.458 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.444+0000 7f75757fa640 1 -- 172.21.15.179:0/2344600249 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f75680079b0 con 0x7f7578100d80 2024-09-11T21:57:17.458 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.445+0000 7f75757fa640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f75640a2ba0 0x7f75640a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:57:17.458 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.445+0000 7f75757fa640 1 -- 172.21.15.179:0/2344600249 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f75680cd1f0 con 0x7f7578100d80 2024-09-11T21:57:17.458 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.445+0000 7f75777fe640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f75640a2ba0 0x7f75640a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:57:17.458 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.445+0000 7f75777fe640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f75640a2ba0 0x7f75640a5060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7560005d00 tx=0x7f7560005c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:57:17.458 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.449+0000 7f75757fa640 1 -- 172.21.15.179:0/2344600249 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7568014030 con 0x7f7578100d80 2024-09-11T21:57:17.623 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:17.622+0000 7f757e7ed640 1 -- 172.21.15.179:0/2344600249 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7578062630 con 0x7f75640a2ba0 2024-09-11T21:57:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T21:57:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T21:57:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi152 2024-09-11T21:57:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:17.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:57:17.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi152 to 17088M 2024-09-11T21:57:17.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:17.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:17.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:17.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:18.024 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T21:57:18.024 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T21:57:18.024 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:18.024 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:18.024 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi152 2024-09-11T21:57:18.025 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:18.025 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:18.025 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:57:18.025 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi152 to 17088M 2024-09-11T21:57:18.025 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:18.025 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:18.025 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:18.025 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:18.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: from='osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T21:57:18.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T21:57:18.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:18.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:18.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi152 2024-09-11T21:57:18.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:18.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:18.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:57:18.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi152 to 17088M 2024-09-11T21:57:18.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:18.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:18.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:18.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:18.927 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:18 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T21:57:18.927 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:18 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T21:57:18.927 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:18 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:18.927 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:18 smithi179 ceph-mon[35603]: osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293] boot 2024-09-11T21:57:18.928 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:18 smithi179 ceph-mon[35603]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T21:57:18.928 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:18 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:18.928 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:18 smithi179 ceph-mon[35603]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:57:18.928 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:18 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:57:18.928 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:18 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:57:18.928 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:18 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:18.928 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:18 smithi179 ceph-mon[35603]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:18.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:18 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T21:57:18.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:18 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T21:57:18.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:18 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:18.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:18 smithi152 ceph-mon[31188]: osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293] boot 2024-09-11T21:57:18.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:18 smithi152 ceph-mon[31188]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T21:57:18.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:18 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:18.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:18 smithi152 ceph-mon[31188]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:57:18.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:18 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:57:18.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:18 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:57:18.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:18 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:18.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:18 smithi152 ceph-mon[31188]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:19.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:18 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T21:57:19.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:18 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T21:57:19.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:18 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:19.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:18 smithi193 ceph-mon[35545]: osd.0 [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293] boot 2024-09-11T21:57:19.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:18 smithi193 ceph-mon[35545]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T21:57:19.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:18 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T21:57:19.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:18 smithi193 ceph-mon[35545]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:57:19.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:18 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:57:19.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:18 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:57:19.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:18 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:19.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:18 smithi193 ceph-mon[35545]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T21:57:19.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:19 smithi152 ceph-mon[31188]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T21:57:20.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:19 smithi179 ceph-mon[35603]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T21:57:20.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:19 smithi193 ceph-mon[35545]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T21:57:20.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:20 smithi179 ceph-mon[35603]: from='client.? 172.21.15.179:0/1061440405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bae9c7-4c9c-499c-a480-3c2a5817269c"}]: dispatch 2024-09-11T21:57:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:20 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bae9c7-4c9c-499c-a480-3c2a5817269c"}]: dispatch 2024-09-11T21:57:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:20 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36bae9c7-4c9c-499c-a480-3c2a5817269c"}]': finished 2024-09-11T21:57:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:20 smithi179 ceph-mon[35603]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T21:57:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:20 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:20 smithi179 ceph-mon[35603]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:20 smithi179 ceph-mon[35603]: from='client.? 172.21.15.179:0/3276957939' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:57:20.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:20 smithi152 ceph-mon[31188]: from='client.? 172.21.15.179:0/1061440405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bae9c7-4c9c-499c-a480-3c2a5817269c"}]: dispatch 2024-09-11T21:57:20.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:20 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bae9c7-4c9c-499c-a480-3c2a5817269c"}]: dispatch 2024-09-11T21:57:20.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:20 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36bae9c7-4c9c-499c-a480-3c2a5817269c"}]': finished 2024-09-11T21:57:20.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:20 smithi152 ceph-mon[31188]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T21:57:20.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:20 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:20.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:20 smithi152 ceph-mon[31188]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:20.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:20 smithi152 ceph-mon[31188]: from='client.? 172.21.15.179:0/3276957939' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:57:21.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:20 smithi193 ceph-mon[35545]: from='client.? 172.21.15.179:0/1061440405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bae9c7-4c9c-499c-a480-3c2a5817269c"}]: dispatch 2024-09-11T21:57:21.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:20 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bae9c7-4c9c-499c-a480-3c2a5817269c"}]: dispatch 2024-09-11T21:57:21.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:20 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36bae9c7-4c9c-499c-a480-3c2a5817269c"}]': finished 2024-09-11T21:57:21.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:20 smithi193 ceph-mon[35545]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T21:57:21.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:20 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:21.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:20 smithi193 ceph-mon[35545]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:21.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:20 smithi193 ceph-mon[35545]: from='client.? 172.21.15.179:0/3276957939' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:57:23.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:23 smithi179 ceph-mon[35603]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:23.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:23 smithi193 ceph-mon[35545]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:23.683 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:23 smithi152 ceph-mon[31188]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:25.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:25 smithi179 ceph-mon[35603]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:25 smithi193 ceph-mon[35545]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:25 smithi152 ceph-mon[31188]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:27.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:27 smithi179 ceph-mon[35603]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:27.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:27 smithi193 ceph-mon[35545]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:27 smithi152 ceph-mon[31188]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:29.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:29 smithi179 ceph-mon[35603]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:29.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T21:57:29.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:29.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:29 smithi179 ceph-mon[35603]: Deploying daemon osd.1 on smithi179 2024-09-11T21:57:29.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:29 smithi193 ceph-mon[35545]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:29.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T21:57:29.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:29.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:29 smithi193 ceph-mon[35545]: Deploying daemon osd.1 on smithi179 2024-09-11T21:57:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:29 smithi152 ceph-mon[31188]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T21:57:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:29 smithi152 ceph-mon[31188]: Deploying daemon osd.1 on smithi179 2024-09-11T21:57:31.474 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:31 smithi179 ceph-mon[35603]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:31.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:31 smithi193 ceph-mon[35545]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:31 smithi152 ceph-mon[31188]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:33.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:33 smithi179 ceph-mon[35603]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:33.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:33 smithi193 ceph-mon[35545]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:33.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:33 smithi152 ceph-mon[31188]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:35.380 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:35 smithi179 ceph-mon[35603]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:35.380 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:35.380 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:35.380 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:35 smithi193 ceph-mon[35545]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:35 smithi152 ceph-mon[31188]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:37 smithi179 ceph-mon[35603]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:37 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:37 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:37 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:37 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:37 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:37 smithi193 ceph-mon[35545]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:37 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:37 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:37 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:37 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:37 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:37 smithi152 ceph-mon[31188]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:37 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:37 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:37 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:37 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:37 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:38.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.668+0000 7f75757fa640 1 -- 172.21.15.179:0/2344600249 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7578062630 con 0x7f75640a2ba0 2024-09-11T21:57:38.670 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 1 on host 'smithi179' 2024-09-11T21:57:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 -- 172.21.15.179:0/2344600249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f75640a2ba0 msgr2=0x7f75640a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:57:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f75640a2ba0 0x7f75640a5060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7560005d00 tx=0x7f7560005c50 comp rx=0 tx=0).stop 2024-09-11T21:57:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 -- 172.21.15.179:0/2344600249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578100d80 msgr2=0x7f7578197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:57:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578100d80 0x7f7578197f10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f756800c970 tx=0x7f756800ce30 comp rx=0 tx=0).stop 2024-09-11T21:57:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 -- 172.21.15.179:0/2344600249 shutdown_connections 2024-09-11T21:57:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f75640a2ba0 0x7f75640a5060 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7578102120 0x7f757819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7578101740 0x7f7578198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:38.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 --2- 172.21.15.179:0/2344600249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578100d80 0x7f7578197f10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:38.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 -- 172.21.15.179:0/2344600249 >> 172.21.15.179:0/2344600249 conn(0x7f75780fba40 msgr2=0x7f7578105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:57:38.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 -- 172.21.15.179:0/2344600249 shutdown_connections 2024-09-11T21:57:38.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:57:38.670+0000 7f757e7ed640 1 -- 172.21.15.179:0/2344600249 wait complete. 2024-09-11T21:57:39.267 DEBUG:teuthology.orchestra.run.smithi179:osd.1> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.1.service 2024-09-11T21:57:39.270 INFO:tasks.cephadm:Deploying osd.2 on smithi193 with /dev/vg_nvme/lv_4... 2024-09-11T21:57:39.270 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T21:57:39.505 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:39 smithi179 ceph-mon[35603]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:39.506 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:39.506 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:39.506 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:39.526 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T21:57:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:39 smithi193 ceph-mon[35545]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:39.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:39.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:39 smithi152 ceph-mon[31188]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:39.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:57:39.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:39.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:41.047 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 21:57:40 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1[40102]: 2024-09-11T21:57:40.914+0000 7f108cd02640 -1 osd.1 0 log_to_monitors true 2024-09-11T21:57:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:41 smithi193 ceph-mon[35545]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:41 smithi193 ceph-mon[35545]: from='osd.1 [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T21:57:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:41 smithi193 ceph-mon[35545]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T21:57:41.622 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:41 smithi179 ceph-mon[35603]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:41.623 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:41 smithi179 ceph-mon[35603]: from='osd.1 [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T21:57:41.623 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:41 smithi179 ceph-mon[35603]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T21:57:41.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:41 smithi152 ceph-mon[31188]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:41.733 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:41 smithi152 ceph-mon[31188]: from='osd.1 [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T21:57:41.733 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:41 smithi152 ceph-mon[31188]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T21:57:41.872 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:57:41.898 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_4 2024-09-11T21:57:42.147 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T21:57:42.539 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T21:57:42.539 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T21:57:42.539 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:42.539 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: from='osd.1 [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:57:42.539 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:57:42.539 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.539 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.539 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:57:42.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:42.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:42.540 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.621+0000 7f0d53035640 1 -- 172.21.15.193:0/2811707613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d4c102690 msgr2=0x7f0d4c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:57:42.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.621+0000 7f0d53035640 1 --2- 172.21.15.193:0/2811707613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d4c102690 0x7f0d4c108f20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009ca0 tx=0x7f0d4402a8c0 comp rx=0 tx=0).stop 2024-09-11T21:57:42.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.621+0000 7f0d53035640 1 -- 172.21.15.193:0/2811707613 shutdown_connections 2024-09-11T21:57:42.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.621+0000 7f0d53035640 1 --2- 172.21.15.193:0/2811707613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d4c102690 0x7f0d4c108f20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:42.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.621+0000 7f0d53035640 1 --2- 172.21.15.193:0/2811707613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d4c101cd0 0x7f0d4c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:42.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.621+0000 7f0d53035640 1 --2- 172.21.15.193:0/2811707613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d4c100ad0 0x7f0d4c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:42.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.621+0000 7f0d53035640 1 -- 172.21.15.193:0/2811707613 >> 172.21.15.193:0/2811707613 conn(0x7f0d4c0fc280 msgr2=0x7f0d4c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:57:42.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.621+0000 7f0d53035640 1 -- 172.21.15.193:0/2811707613 shutdown_connections 2024-09-11T21:57:42.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.621+0000 7f0d53035640 1 -- 172.21.15.193:0/2811707613 wait complete. 2024-09-11T21:57:42.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.621+0000 7f0d53035640 1 Processor -- start 2024-09-11T21:57:42.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.621+0000 7f0d53035640 1 -- start start 2024-09-11T21:57:42.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d53035640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d4c100ad0 0x7f0d4c104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d53035640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d4c101cd0 0x7f0d4c1030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d53035640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d4c102690 0x7f0d4c1035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d53035640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c10c750 con 0x7f0d4c102690 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d53035640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c10c5d0 con 0x7f0d4c101cd0 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d53035640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c10c8d0 con 0x7f0d4c100ad0 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d50dd1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d4c100ad0 0x7f0d4c104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d50dd1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d4c100ad0 0x7f0d4c104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:44400/0 (socket says 172.21.15.193:44400) 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d50dd1640 1 -- 172.21.15.193:0/1084507094 learned_addr learned my addr 172.21.15.193:0/1084507094 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d43fff640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d4c101cd0 0x7f0d4c1030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d515d2640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d4c102690 0x7f0d4c1035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d50dd1640 1 -- 172.21.15.193:0/1084507094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d4c101cd0 msgr2=0x7f0d4c1030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:57:42.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d50dd1640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d4c101cd0 0x7f0d4c1030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:42.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d50dd1640 1 -- 172.21.15.193:0/1084507094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d4c102690 msgr2=0x7f0d4c1035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:57:42.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d50dd1640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d4c102690 0x7f0d4c1035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:57:42.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d50dd1640 1 -- 172.21.15.193:0/1084507094 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4c103eb0 con 0x7f0d4c100ad0 2024-09-11T21:57:42.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d50dd1640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d4c100ad0 0x7f0d4c104a60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800e9c0 tx=0x7f0d4800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:57:42.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d41ffb640 1 -- 172.21.15.193:0/1084507094 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800ccc0 con 0x7f0d4c100ad0 2024-09-11T21:57:42.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d41ffb640 1 -- 172.21.15.193:0/1084507094 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d480035f0 con 0x7f0d4c100ad0 2024-09-11T21:57:42.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d53035640 1 -- 172.21.15.193:0/1084507094 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4c1a1f90 con 0x7f0d4c100ad0 2024-09-11T21:57:42.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.622+0000 7f0d41ffb640 1 -- 172.21.15.193:0/1084507094 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800ce60 con 0x7f0d4c100ad0 2024-09-11T21:57:42.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.623+0000 7f0d53035640 1 -- 172.21.15.193:0/1084507094 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d4c1a2380 con 0x7f0d4c100ad0 2024-09-11T21:57:42.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.623+0000 7f0d53035640 1 -- 172.21.15.193:0/1084507094 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d4c1a2640 con 0x7f0d4c100ad0 2024-09-11T21:57:42.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.625+0000 7f0d41ffb640 1 -- 172.21.15.193:0/1084507094 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f0d480037a0 con 0x7f0d4c100ad0 2024-09-11T21:57:42.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.625+0000 7f0d41ffb640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0d340a2b70 0x7f0d340a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:57:42.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.626+0000 7f0d41ffb640 1 -- 172.21.15.193:0/1084507094 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f0d480cdaf0 con 0x7f0d4c100ad0 2024-09-11T21:57:42.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.626+0000 7f0d43fff640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0d340a2b70 0x7f0d340a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:57:42.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.626+0000 7f0d43fff640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0d340a2b70 0x7f0d340a5030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c1047e0 tx=0x7f0d3c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:57:42.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.629+0000 7f0d41ffb640 1 -- 172.21.15.193:0/1084507094 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d4809c3c0 con 0x7f0d4c100ad0 2024-09-11T21:57:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T21:57:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T21:57:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: from='osd.1 [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:57:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:57:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:57:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:42.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.796 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1[40102]: 2024-09-11T21:57:42.306+0000 7f1088462640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T21:57:42.796 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1[40102]: 2024-09-11T21:57:42.309+0000 7f1084a9c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T21:57:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T21:57:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T21:57:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: from='osd.1 [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:57:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:57:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:57:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:57:42.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:57:42.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:57:42.803+0000 7f0d53035640 1 -- 172.21.15.193:0/1084507094 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0d4c1a2810 con 0x7f0d340a2b70 2024-09-11T21:57:43.533 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:43 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi179 2024-09-11T21:57:43.533 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:43 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi179 to 17088M 2024-09-11T21:57:43.533 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:43 smithi193 ceph-mon[35545]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:43.533 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:43 smithi193 ceph-mon[35545]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T21:57:43.533 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:43 smithi193 ceph-mon[35545]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T21:57:43.533 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:43 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:43.534 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:43 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:43.534 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:43 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:57:43.534 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:43 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:57:43.534 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:43 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:43 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi179 2024-09-11T21:57:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:43 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi179 to 17088M 2024-09-11T21:57:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:43 smithi152 ceph-mon[31188]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:43 smithi152 ceph-mon[31188]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T21:57:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:43 smithi152 ceph-mon[31188]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T21:57:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:43 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:43 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:43 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:57:43.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:43 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:57:43.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:43 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:43.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:43 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi179 2024-09-11T21:57:43.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:43 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi179 to 17088M 2024-09-11T21:57:43.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:43 smithi179 ceph-mon[35603]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:43.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:43 smithi179 ceph-mon[35603]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T21:57:43.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:43 smithi179 ceph-mon[35603]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T21:57:43.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:43 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:43.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:43 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:43.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:43 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:57:43.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:43 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:57:43.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:43 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:44.444 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:44 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T21:57:44.444 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:44 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T21:57:44.444 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:44 smithi193 ceph-mon[35545]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:57:44.444 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:44 smithi193 ceph-mon[35545]: osd.1 [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273] boot 2024-09-11T21:57:44.444 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:44 smithi193 ceph-mon[35545]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T21:57:44.444 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:44 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:44 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T21:57:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:44 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T21:57:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:44 smithi152 ceph-mon[31188]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:57:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:44 smithi152 ceph-mon[31188]: osd.1 [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273] boot 2024-09-11T21:57:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:44 smithi152 ceph-mon[31188]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T21:57:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:44 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:44.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:44 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T21:57:44.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:44 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T21:57:44.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:44 smithi179 ceph-mon[35603]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:57:44.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:44 smithi179 ceph-mon[35603]: osd.1 [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273] boot 2024-09-11T21:57:44.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:44 smithi179 ceph-mon[35603]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T21:57:44.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:44 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T21:57:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:45 smithi193 ceph-mon[35545]: pgmap v58: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:45 smithi193 ceph-mon[35545]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T21:57:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:45 smithi193 ceph-mon[35545]: from='client.? 172.21.15.193:0/551301683' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707f080b-8903-43a4-ae5a-75a4b32e1842"}]: dispatch 2024-09-11T21:57:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:45 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707f080b-8903-43a4-ae5a-75a4b32e1842"}]: dispatch 2024-09-11T21:57:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:45 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "707f080b-8903-43a4-ae5a-75a4b32e1842"}]': finished 2024-09-11T21:57:45.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:45 smithi193 ceph-mon[35545]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T21:57:45.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:45 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:57:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:45 smithi152 ceph-mon[31188]: pgmap v58: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:45 smithi152 ceph-mon[31188]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T21:57:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:45 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/551301683' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707f080b-8903-43a4-ae5a-75a4b32e1842"}]: dispatch 2024-09-11T21:57:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:45 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707f080b-8903-43a4-ae5a-75a4b32e1842"}]: dispatch 2024-09-11T21:57:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:45 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "707f080b-8903-43a4-ae5a-75a4b32e1842"}]': finished 2024-09-11T21:57:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:45 smithi152 ceph-mon[31188]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T21:57:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:45 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:57:45.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:45 smithi179 ceph-mon[35603]: pgmap v58: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-11T21:57:45.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:45 smithi179 ceph-mon[35603]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T21:57:45.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:45 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/551301683' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707f080b-8903-43a4-ae5a-75a4b32e1842"}]: dispatch 2024-09-11T21:57:45.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:45 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707f080b-8903-43a4-ae5a-75a4b32e1842"}]: dispatch 2024-09-11T21:57:45.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:45 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "707f080b-8903-43a4-ae5a-75a4b32e1842"}]': finished 2024-09-11T21:57:45.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:45 smithi179 ceph-mon[35603]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T21:57:45.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:45 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:57:46.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:46 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/2087364362' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:57:46.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:46 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/2087364362' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:57:46.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:46 smithi193 ceph-mon[35545]: from='client.? 172.21.15.193:0/2087364362' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:57:47.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:47 smithi152 ceph-mon[31188]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:47 smithi179 ceph-mon[35603]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:47.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:47 smithi193 ceph-mon[35545]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:48.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:48 smithi152 ceph-mon[31188]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:48.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:48 smithi179 ceph-mon[35603]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:48.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:48 smithi193 ceph-mon[35545]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:51.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:51 smithi193 ceph-mon[35545]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:51.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:51 smithi179 ceph-mon[35603]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:51.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:51 smithi152 ceph-mon[31188]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:53.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:53 smithi193 ceph-mon[35545]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:53.532 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:53 smithi152 ceph-mon[31188]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:53.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:53 smithi179 ceph-mon[35603]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:54.440 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T21:57:54.441 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:54.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T21:57:54.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:54.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T21:57:54.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:57:55.371 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:55 smithi193 ceph-mon[35545]: Deploying daemon osd.2 on smithi193 2024-09-11T21:57:55.372 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:55 smithi193 ceph-mon[35545]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:55.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:55 smithi179 ceph-mon[35603]: Deploying daemon osd.2 on smithi193 2024-09-11T21:57:55.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:55 smithi179 ceph-mon[35603]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:55.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:55 smithi152 ceph-mon[31188]: Deploying daemon osd.2 on smithi193 2024-09-11T21:57:55.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:55 smithi152 ceph-mon[31188]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:57.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:57 smithi179 ceph-mon[35603]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:57.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:57 smithi193 ceph-mon[35545]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:57 smithi152 ceph-mon[31188]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:59.457 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:57:59 smithi193 ceph-mon[35545]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:59.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:57:59 smithi179 ceph-mon[35603]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:57:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:57:59 smithi152 ceph-mon[31188]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:00.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:00.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:00.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:00.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:00.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:00.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:01.457 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:01 smithi193 ceph-mon[35545]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:01.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:01 smithi179 ceph-mon[35603]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:01.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:01 smithi152 ceph-mon[31188]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:03.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:03 smithi179 ceph-mon[35603]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:03.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:03 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:03.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:03 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:03.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:03 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:03.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:03 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:03.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:03 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:03.557 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:03 smithi193 ceph-mon[35545]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:03.558 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:03 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:03.558 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:03 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:03.558 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:03 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:03.558 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:03 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:03.558 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:03 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:03.599 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 2 on host 'smithi193' 2024-09-11T21:58:03.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.598+0000 7f0d41ffb640 1 -- 172.21.15.193:0/1084507094 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0d4c1a2810 con 0x7f0d340a2b70 2024-09-11T21:58:03.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 -- 172.21.15.193:0/1084507094 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0d340a2b70 msgr2=0x7f0d340a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:03.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0d340a2b70 0x7f0d340a5030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c1047e0 tx=0x7f0d3c00a2d0 comp rx=0 tx=0).stop 2024-09-11T21:58:03.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 -- 172.21.15.193:0/1084507094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d4c100ad0 msgr2=0x7f0d4c104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:03.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d4c100ad0 0x7f0d4c104a60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800e9c0 tx=0x7f0d4800edc0 comp rx=0 tx=0).stop 2024-09-11T21:58:03.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 -- 172.21.15.193:0/1084507094 shutdown_connections 2024-09-11T21:58:03.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d4c102690 0x7f0d4c1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:03.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d4c101cd0 0x7f0d4c1030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:03.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0d340a2b70 0x7f0d340a5030 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:03.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 --2- 172.21.15.193:0/1084507094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d4c100ad0 0x7f0d4c104a60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:03.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 -- 172.21.15.193:0/1084507094 >> 172.21.15.193:0/1084507094 conn(0x7f0d4c0fc280 msgr2=0x7f0d4c0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:58:03.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 -- 172.21.15.193:0/1084507094 shutdown_connections 2024-09-11T21:58:03.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:03.601+0000 7f0d53035640 1 -- 172.21.15.193:0/1084507094 wait complete. 2024-09-11T21:58:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:03 smithi152 ceph-mon[31188]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:03 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:03 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:03 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:03 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:03 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:04.316 DEBUG:teuthology.orchestra.run.smithi193:osd.2> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.2.service 2024-09-11T21:58:04.318 INFO:tasks.cephadm:Deploying osd.3 on smithi152 with /dev/vg_nvme/lv_3... 2024-09-11T21:58:04.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T21:58:04.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:04 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:04.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:04 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:04.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:04 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:04.562 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:58:04.574 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:04 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:04.574 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:04 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:04.574 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:04 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:04.683 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:04 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:04.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:04 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:04.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:04 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:05.544 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:05 smithi193 ceph-mon[35545]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:05.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:05 smithi179 ceph-mon[35603]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:05.640 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:05 smithi152 ceph-mon[31188]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:05.826 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 21:58:05 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2[40518]: 2024-09-11T21:58:05.643+0000 7f7d9dfa4640 -1 osd.2 0 log_to_monitors true 2024-09-11T21:58:06.401 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:06 smithi193 ceph-mon[35545]: from='osd.2 [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T21:58:06.401 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:06 smithi193 ceph-mon[35545]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T21:58:06.502 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:06 smithi152 ceph-mon[31188]: from='osd.2 [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T21:58:06.502 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:06 smithi152 ceph-mon[31188]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T21:58:06.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:06 smithi179 ceph-mon[35603]: from='osd.2 [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T21:58:06.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:06 smithi179 ceph-mon[35603]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T21:58:07.002 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:58:07.027 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_3 2024-09-11T21:58:07.282 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:58:07.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:07.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T21:58:07.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T21:58:07.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:07.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: from='osd.2 [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:58:07.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:58:07.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:07.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:07.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:07.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.635 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:07.635 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T21:58:07.635 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T21:58:07.635 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:07.635 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: from='osd.2 [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:58:07.635 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:58:07.635 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.636 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.636 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:07.636 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.636 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:07.636 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:07.636 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.717+0000 7f047f708640 1 -- 172.21.15.152:0/2773612918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04781026d0 msgr2=0x7f0478108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:07.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.717+0000 7f047f708640 1 --2- 172.21.15.152:0/2773612918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04781026d0 0x7f0478108f60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0470009ca0 tx=0x7f047002a8c0 comp rx=0 tx=0).stop 2024-09-11T21:58:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.717+0000 7f047f708640 1 -- 172.21.15.152:0/2773612918 shutdown_connections 2024-09-11T21:58:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.717+0000 7f047f708640 1 --2- 172.21.15.152:0/2773612918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04781026d0 0x7f0478108f60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.717+0000 7f047f708640 1 --2- 172.21.15.152:0/2773612918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0478101d10 0x7f0478102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.717+0000 7f047f708640 1 --2- 172.21.15.152:0/2773612918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0478100b10 0x7f0478100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.717+0000 7f047f708640 1 -- 172.21.15.152:0/2773612918 >> 172.21.15.152:0/2773612918 conn(0x7f04780fc2a0 msgr2=0x7f04780fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:58:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.717+0000 7f047f708640 1 -- 172.21.15.152:0/2773612918 shutdown_connections 2024-09-11T21:58:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.717+0000 7f047f708640 1 -- 172.21.15.152:0/2773612918 wait complete. 2024-09-11T21:58:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047f708640 1 Processor -- start 2024-09-11T21:58:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047f708640 1 -- start start 2024-09-11T21:58:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047f708640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0478100b10 0x7f047819a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047f708640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0478101d10 0x7f047819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047f708640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04781026d0 0x7f04781a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047f708640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f047810c790 con 0x7f0478100b10 2024-09-11T21:58:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047f708640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f047810c610 con 0x7f04781026d0 2024-09-11T21:58:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047f708640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f047810c910 con 0x7f0478101d10 2024-09-11T21:58:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047d4a4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0478100b10 0x7f047819a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047d4a4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0478100b10 0x7f047819a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46022/0 (socket says 172.21.15.152:46022) 2024-09-11T21:58:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047d4a4640 1 -- 172.21.15.152:0/1668513226 learned_addr learned my addr 172.21.15.152:0/1668513226 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:58:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047cca3640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0478101d10 0x7f047819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.718+0000 7f047dca5640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04781026d0 0x7f04781a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f047d4a4640 1 -- 172.21.15.152:0/1668513226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0478101d10 msgr2=0x7f047819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f047d4a4640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0478101d10 0x7f047819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f047d4a4640 1 -- 172.21.15.152:0/1668513226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04781026d0 msgr2=0x7f04781a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f047d4a4640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04781026d0 0x7f04781a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f047d4a4640 1 -- 172.21.15.152:0/1668513226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04781a1d70 con 0x7f0478100b10 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f047cca3640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0478101d10 0x7f047819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f047dca5640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04781026d0 0x7f04781a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f047d4a4640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0478100b10 0x7f047819a140 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f047400d770 tx=0x7f047400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f046e7fc640 1 -- 172.21.15.152:0/1668513226 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474017070 con 0x7f0478100b10 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f047f708640 1 -- 172.21.15.152:0/1668513226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04781a2060 con 0x7f0478100b10 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f046e7fc640 1 -- 172.21.15.152:0/1668513226 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0474009c30 con 0x7f0478100b10 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f046e7fc640 1 -- 172.21.15.152:0/1668513226 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474003dd0 con 0x7f0478100b10 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.719+0000 7f047f708640 1 -- 172.21.15.152:0/1668513226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04781a25a0 con 0x7f0478100b10 2024-09-11T21:58:07.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.720+0000 7f047f708640 1 -- 172.21.15.152:0/1668513226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04781a2800 con 0x7f0478100b10 2024-09-11T21:58:07.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.721+0000 7f046e7fc640 1 -- 172.21.15.152:0/1668513226 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f0474003f70 con 0x7f0478100b10 2024-09-11T21:58:07.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.722+0000 7f046e7fc640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f04640a2b20 0x7f04640a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:07.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.722+0000 7f047cca3640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f04640a2b20 0x7f04640a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:07.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.722+0000 7f046e7fc640 1 -- 172.21.15.152:0/1668513226 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f04740cd220 con 0x7f0478100b10 2024-09-11T21:58:07.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.722+0000 7f047cca3640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f04640a2b20 0x7f04640a4fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f047819b660 tx=0x7f0468005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:58:07.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.726+0000 7f046e7fc640 1 -- 172.21.15.152:0/1668513226 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f047409b8d0 con 0x7f0478100b10 2024-09-11T21:58:07.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:07.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T21:58:07.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T21:58:07.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:07.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: from='osd.2 [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:58:07.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:58:07.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:07.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:07.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:07.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:07.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:07.900+0000 7f047f708640 1 -- 172.21.15.152:0/1668513226 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f04780fe4e0 con 0x7f04640a2b20 2024-09-11T21:58:08.576 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2[40518]: 2024-09-11T21:58:08.149+0000 7f7d9a73b640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T21:58:08.576 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2[40518]: 2024-09-11T21:58:08.156+0000 7f7d91d36640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T21:58:08.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi193 2024-09-11T21:58:08.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi193 to 17088M 2024-09-11T21:58:08.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-mon[35545]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T21:58:08.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-mon[35545]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T21:58:08.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:08.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:08.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:58:08.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:58:08.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:08.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:08 smithi193 ceph-mon[35545]: from='osd.2 ' entity='osd.2' 2024-09-11T21:58:08.638 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:08 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi193 2024-09-11T21:58:08.639 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:08 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi193 to 17088M 2024-09-11T21:58:08.639 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:08 smithi152 ceph-mon[31188]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T21:58:08.639 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:08 smithi152 ceph-mon[31188]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T21:58:08.639 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:08 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:08.639 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:08 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:08.639 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:08 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:58:08.639 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:08 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:58:08.639 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:08 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:08.639 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:08 smithi152 ceph-mon[31188]: from='osd.2 ' entity='osd.2' 2024-09-11T21:58:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:08 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi193 2024-09-11T21:58:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:08 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi193 to 17088M 2024-09-11T21:58:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:08 smithi179 ceph-mon[35603]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T21:58:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:08 smithi179 ceph-mon[35603]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T21:58:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:08 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:08 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:08 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:58:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:08 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:58:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:08 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:08 smithi179 ceph-mon[35603]: from='osd.2 ' entity='osd.2' 2024-09-11T21:58:09.545 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:09 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T21:58:09.545 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:09 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T21:58:09.545 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:09 smithi152 ceph-mon[31188]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:58:09.545 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:09 smithi152 ceph-mon[31188]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:09.545 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:09 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:09.545 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:09 smithi152 ceph-mon[31188]: osd.2 [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263] boot 2024-09-11T21:58:09.546 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:09 smithi152 ceph-mon[31188]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T21:58:09.546 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:09 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:09 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T21:58:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:09 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T21:58:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:09 smithi193 ceph-mon[35545]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:58:09.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:09 smithi193 ceph-mon[35545]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:09.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:09 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:09.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:09 smithi193 ceph-mon[35545]: osd.2 [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263] boot 2024-09-11T21:58:09.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:09 smithi193 ceph-mon[35545]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T21:58:09.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:09 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:09 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T21:58:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:09 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T21:58:09.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:09 smithi179 ceph-mon[35603]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:58:09.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:09 smithi179 ceph-mon[35603]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T21:58:09.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:09 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:09.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:09 smithi179 ceph-mon[35603]: osd.2 [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263] boot 2024-09-11T21:58:09.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:09 smithi179 ceph-mon[35603]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T21:58:09.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:09 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T21:58:10.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:10 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1355189506' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e9e11a6-41be-4ea6-824b-295fdf0430b6"}]: dispatch 2024-09-11T21:58:10.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:10 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1355189506' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e9e11a6-41be-4ea6-824b-295fdf0430b6"}]': finished 2024-09-11T21:58:10.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:10 smithi152 ceph-mon[31188]: osdmap e19: 4 total, 3 up, 4 in 2024-09-11T21:58:10.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:10 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:10.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:10 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1355189506' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e9e11a6-41be-4ea6-824b-295fdf0430b6"}]: dispatch 2024-09-11T21:58:10.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:10 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1355189506' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e9e11a6-41be-4ea6-824b-295fdf0430b6"}]': finished 2024-09-11T21:58:10.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:10 smithi179 ceph-mon[35603]: osdmap e19: 4 total, 3 up, 4 in 2024-09-11T21:58:10.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:10 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:10.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:10 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1355189506' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e9e11a6-41be-4ea6-824b-295fdf0430b6"}]: dispatch 2024-09-11T21:58:10.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:10 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1355189506' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e9e11a6-41be-4ea6-824b-295fdf0430b6"}]': finished 2024-09-11T21:58:10.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:10 smithi193 ceph-mon[35545]: osdmap e19: 4 total, 3 up, 4 in 2024-09-11T21:58:10.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:10 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:11 smithi179 ceph-mon[35603]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T21:58:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:11 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2853142638' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:58:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T21:58:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:11 smithi179 ceph-mon[35603]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T21:58:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T21:58:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:11 smithi193 ceph-mon[35545]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T21:58:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:11 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2853142638' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:58:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T21:58:11.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:11 smithi193 ceph-mon[35545]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T21:58:11.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:11.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T21:58:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:11 smithi152 ceph-mon[31188]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T21:58:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:11 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2853142638' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:58:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T21:58:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:11 smithi152 ceph-mon[31188]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T21:58:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T21:58:12.895 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 21:58:12 smithi152 sudo[49610]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T21:58:12.895 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 21:58:12 smithi152 sudo[49610]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:12.895 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 21:58:12 smithi152 sudo[49610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:12.895 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 21:58:12 smithi152 sudo[49610]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:13.230 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 21:58:12 smithi152 sudo[49616]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T21:58:13.230 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 21:58:12 smithi152 sudo[49616]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:13.230 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 21:58:12 smithi152 sudo[49616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:13.230 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 21:58:12 smithi152 sudo[49616]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:13.424 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 21:58:13 smithi179 sudo[44270]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T21:58:13.425 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 21:58:13 smithi179 sudo[44270]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:13.425 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 21:58:13 smithi179 sudo[44270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:13.425 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 21:58:13 smithi179 sudo[44270]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:13.425 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:13 smithi179 ceph-mon[35603]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:13.425 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:13 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T21:58:13.425 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:13 smithi179 ceph-mon[35603]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T21:58:13.425 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:13 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:13.425 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:13 smithi179 ceph-mon[35603]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T21:58:13.425 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:13 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:13.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:13 smithi193 ceph-mon[35545]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:13.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:13 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T21:58:13.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:13 smithi193 ceph-mon[35545]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T21:58:13.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:13 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:13.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:13 smithi193 ceph-mon[35545]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T21:58:13.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:13 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:13 smithi152 ceph-mon[31188]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:13 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T21:58:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:13 smithi152 ceph-mon[31188]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T21:58:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:13 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:13 smithi152 ceph-mon[31188]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T21:58:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:13 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:13.796 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 21:58:13 smithi179 sudo[44273]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T21:58:13.796 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 21:58:13 smithi179 sudo[44273]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:13.796 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 21:58:13 smithi179 sudo[44273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:13.797 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 21:58:13 smithi179 sudo[44273]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:13.949 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 21:58:13 smithi193 sudo[44459]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T21:58:13.950 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 21:58:13 smithi193 sudo[44459]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:13.950 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 21:58:13 smithi193 sudo[44459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:13.950 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 21:58:13 smithi193 sudo[44459]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:14.326 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 21:58:13 smithi193 sudo[44462]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T21:58:14.326 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 21:58:13 smithi193 sudo[44462]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:14.326 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 21:58:13 smithi193 sudo[44462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:14.326 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 21:58:13 smithi193 sudo[44462]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:14.472 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 sudo[50000]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T21:58:14.472 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 sudo[50000]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:14.472 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 sudo[50000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:14.472 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 sudo[50000]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 sudo[50188]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T21:58:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 sudo[50188]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 sudo[50188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 sudo[50188]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 ceph-mon[31188]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T21:58:14.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:14.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:14.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:14.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:14 smithi152 ceph-mon[31188]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T21:58:14.733 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 ceph-mon[35545]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T21:58:14.733 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:14.733 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:14.733 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:14.733 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 ceph-mon[35545]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T21:58:14.733 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 sudo[44465]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T21:58:14.733 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 sudo[44465]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:14.733 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 sudo[44465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:14.733 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 sudo[44465]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:14.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:14 smithi179 ceph-mon[35603]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T21:58:14.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:14 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:14.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:14 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:14.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:14 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:14.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:14 smithi179 ceph-mon[35603]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T21:58:15.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 sudo[44468]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T21:58:15.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 sudo[44468]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:15.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 sudo[44468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:15.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:14 smithi193 sudo[44468]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:15.471 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 sudo[44276]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T21:58:15.471 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 sudo[44276]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:15.472 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 sudo[44276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:15.472 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 sudo[44276]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:15.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:15.484+0000 7f046e7fc640 1 -- 172.21.15.152:0/1668513226 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f0474004260 con 0x7f0478100b10 2024-09-11T21:58:15.700 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:15.700 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: Cluster is now healthy 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T21:58:15.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:58:15.702 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:58:15.702 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:58:15.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 sudo[44279]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T21:58:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 sudo[44279]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T21:58:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 sudo[44279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T21:58:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 sudo[44279]: pam_unix(sudo:session): session closed for user root 2024-09-11T21:58:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T21:58:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:58:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:58:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:58:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T21:58:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:58:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:58:15.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:58:15.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T21:58:15.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: Cluster is now healthy 2024-09-11T21:58:15.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T21:58:15.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T21:58:15.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:58:15.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:58:15.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:58:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T21:58:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: Cluster is now healthy 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T21:58:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T21:58:16.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:16 smithi152 ceph-mon[31188]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T21:58:16.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:16 smithi152 ceph-mon[31188]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T21:58:16.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:16 smithi152 ceph-mon[31188]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:16.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:16 smithi179 ceph-mon[35603]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T21:58:16.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:16 smithi179 ceph-mon[35603]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T21:58:16.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:16 smithi179 ceph-mon[35603]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:16.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:16 smithi193 ceph-mon[35545]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T21:58:16.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:16 smithi193 ceph-mon[35545]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T21:58:16.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:16 smithi193 ceph-mon[35545]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:19.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:19 smithi179 ceph-mon[35603]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:19.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:19 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T21:58:19.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:19 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:19.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:19 smithi193 ceph-mon[35545]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:19.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:19 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T21:58:19.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:19 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:19.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:19 smithi152 ceph-mon[31188]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:19.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:19 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T21:58:19.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:19 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:20.329 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:20 smithi152 ceph-mon[31188]: Deploying daemon osd.3 on smithi152 2024-09-11T21:58:20.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:20 smithi179 ceph-mon[35603]: Deploying daemon osd.3 on smithi152 2024-09-11T21:58:20.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:20 smithi193 ceph-mon[35545]: Deploying daemon osd.3 on smithi152 2024-09-11T21:58:21.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:21 smithi179 ceph-mon[35603]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-11T21:58:21.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:21 smithi193 ceph-mon[35545]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-11T21:58:21.594 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:21 smithi152 ceph-mon[31188]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-11T21:58:23.474 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:23 smithi152 ceph-mon[31188]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-11T21:58:23.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:23 smithi179 ceph-mon[35603]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-11T21:58:23.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:23 smithi193 ceph-mon[35545]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-11T21:58:25.445 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:25 smithi152 ceph-mon[31188]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-11T21:58:25.445 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:25.445 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:25.445 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:25.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:25 smithi179 ceph-mon[35603]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-11T21:58:25.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:25.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:25.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:25 smithi193 ceph-mon[35545]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-11T21:58:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:27.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:27 smithi152 ceph-mon[31188]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T21:58:27.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:27.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:27.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:27.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:27.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:27.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:27 smithi179 ceph-mon[35603]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T21:58:27.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:27.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:27.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:27.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:27.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:27.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:27 smithi193 ceph-mon[35545]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T21:58:27.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:27.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:27.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:27.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:27.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:28.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.564+0000 7f046e7fc640 1 -- 172.21.15.152:0/1668513226 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f04780fe4e0 con 0x7f04640a2b20 2024-09-11T21:58:28.566 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 3 on host 'smithi152' 2024-09-11T21:58:28.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 -- 172.21.15.152:0/1668513226 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f04640a2b20 msgr2=0x7f04640a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:28.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f04640a2b20 0x7f04640a4fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f047819b660 tx=0x7f0468005f90 comp rx=0 tx=0).stop 2024-09-11T21:58:28.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 -- 172.21.15.152:0/1668513226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0478100b10 msgr2=0x7f047819a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:28.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0478100b10 0x7f047819a140 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f047400d770 tx=0x7f047400dc30 comp rx=0 tx=0).stop 2024-09-11T21:58:28.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 -- 172.21.15.152:0/1668513226 shutdown_connections 2024-09-11T21:58:28.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04781026d0 0x7f04781a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:28.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f04640a2b20 0x7f04640a4fe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:28.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0478101d10 0x7f047819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:28.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 --2- 172.21.15.152:0/1668513226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0478100b10 0x7f047819a140 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:28.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 -- 172.21.15.152:0/1668513226 >> 172.21.15.152:0/1668513226 conn(0x7f04780fc2a0 msgr2=0x7f04780fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:58:28.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 -- 172.21.15.152:0/1668513226 shutdown_connections 2024-09-11T21:58:28.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:58:28.567+0000 7f047f708640 1 -- 172.21.15.152:0/1668513226 wait complete. 2024-09-11T21:58:29.221 DEBUG:teuthology.orchestra.run.smithi152:osd.3> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.3.service 2024-09-11T21:58:29.224 INFO:tasks.cephadm:Deploying osd.4 on smithi179 with /dev/vg_nvme/lv_3... 2024-09-11T21:58:29.224 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T21:58:29.477 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T21:58:29.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:29 smithi152 ceph-mon[31188]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T21:58:29.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:29.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:29.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:29.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:29 smithi179 ceph-mon[35603]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T21:58:29.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:29.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:29.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:29.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:29 smithi193 ceph-mon[35545]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T21:58:29.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:29.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:29.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:31.296 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 21:58:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3[51231]: 2024-09-11T21:58:31.034+0000 7fb50dbb1640 -1 osd.3 0 log_to_monitors true 2024-09-11T21:58:31.313 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:31 smithi179 ceph-mon[35603]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T21:58:31.313 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:31 smithi179 ceph-mon[35603]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T21:58:31.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:31 smithi193 ceph-mon[35545]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T21:58:31.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:31 smithi193 ceph-mon[35545]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T21:58:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:31 smithi152 ceph-mon[31188]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T21:58:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:31 smithi152 ceph-mon[31188]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T21:58:31.881 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:58:31.906 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_3 2024-09-11T21:58:32.165 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T21:58:32.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T21:58:32.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T21:58:32.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T21:58:32.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:32.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:32.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:32.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:32.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:32.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:32 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T21:58:32.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T21:58:32.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T21:58:32.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:32.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:32.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:32.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:32.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:32.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:32 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.665 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.664+0000 7fdfcf956640 1 -- 172.21.15.179:0/1181237903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfc8101c00 msgr2=0x7fdfc8102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:32.665 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.664+0000 7fdfcf956640 1 --2- 172.21.15.179:0/1181237903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfc8101c00 0x7fdfc8102000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009900 tx=0x7fdfc402a410 comp rx=0 tx=0).stop 2024-09-11T21:58:32.665 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.664+0000 7fdfcf956640 1 -- 172.21.15.179:0/1181237903 shutdown_connections 2024-09-11T21:58:32.665 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.664+0000 7fdfcf956640 1 --2- 172.21.15.179:0/1181237903 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfc81037c0 0x7fdfc810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:32.665 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.664+0000 7fdfcf956640 1 --2- 172.21.15.179:0/1181237903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc8102e00 0x7fdfc8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:32.666 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.664+0000 7fdfcf956640 1 --2- 172.21.15.179:0/1181237903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfc8101c00 0x7fdfc8102000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:32.666 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.664+0000 7fdfcf956640 1 -- 172.21.15.179:0/1181237903 >> 172.21.15.179:0/1181237903 conn(0x7fdfc80fd390 msgr2=0x7fdfc80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:58:32.666 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.664+0000 7fdfcf956640 1 -- 172.21.15.179:0/1181237903 shutdown_connections 2024-09-11T21:58:32.666 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.664+0000 7fdfcf956640 1 -- 172.21.15.179:0/1181237903 wait complete. 2024-09-11T21:58:32.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfcf956640 1 Processor -- start 2024-09-11T21:58:32.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfcf956640 1 -- start start 2024-09-11T21:58:32.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfcf956640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfc8101c00 0x7fdfc8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:32.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfcf956640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc8102e00 0x7fdfc80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:32.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfcf956640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfc81037c0 0x7fdfc8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:32.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfcf956640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc810d860 con 0x7fdfc8102e00 2024-09-11T21:58:32.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfcf956640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc810d6e0 con 0x7fdfc8101c00 2024-09-11T21:58:32.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfcf956640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc810d9e0 con 0x7fdfc81037c0 2024-09-11T21:58:32.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfcd6f2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfc8101c00 0x7fdfc8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfcd6f2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfc8101c00 0x7fdfc8075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:59362/0 (socket says 172.21.15.179:59362) 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfcd6f2640 1 -- 172.21.15.179:0/520377053 learned_addr learned my addr 172.21.15.179:0/520377053 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.665+0000 7fdfccef1640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc8102e00 0x7fdfc80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfcdef3640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfc81037c0 0x7fdfc8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfcd6f2640 1 -- 172.21.15.179:0/520377053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfc81037c0 msgr2=0x7fdfc8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfcd6f2640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfc81037c0 0x7fdfc8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfcd6f2640 1 -- 172.21.15.179:0/520377053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc8102e00 msgr2=0x7fdfc80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfcd6f2640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc8102e00 0x7fdfc80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfcd6f2640 1 -- 172.21.15.179:0/520377053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc80753e0 con 0x7fdfc8101c00 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfcdef3640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfc81037c0 0x7fdfc8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfcd6f2640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfc8101c00 0x7fdfc8075f90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4031610 tx=0x7fdfc40043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfbe7fc640 1 -- 172.21.15.179:0/520377053 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc403f030 con 0x7fdfc8101c00 2024-09-11T21:58:32.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfbe7fc640 1 -- 172.21.15.179:0/520377053 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfc4003ce0 con 0x7fdfc8101c00 2024-09-11T21:58:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfcf956640 1 -- 172.21.15.179:0/520377053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc81a1fe0 con 0x7fdfc8101c00 2024-09-11T21:58:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfbe7fc640 1 -- 172.21.15.179:0/520377053 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4035070 con 0x7fdfc8101c00 2024-09-11T21:58:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.666+0000 7fdfcf956640 1 -- 172.21.15.179:0/520377053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc81a23d0 con 0x7fdfc8101c00 2024-09-11T21:58:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.667+0000 7fdfcf956640 1 -- 172.21.15.179:0/520377053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc8108fa0 con 0x7fdfc8101c00 2024-09-11T21:58:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.668+0000 7fdfbe7fc640 1 -- 172.21.15.179:0/520377053 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fdfc4042030 con 0x7fdfc8101c00 2024-09-11T21:58:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.669+0000 7fdfbe7fc640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdfb40a2c00 0x7fdfb40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.669+0000 7fdfbe7fc640 1 -- 172.21.15.179:0/520377053 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3389+0+0 (secure 0 0 0) 0x7fdfc40ee250 con 0x7fdfc8101c00 2024-09-11T21:58:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.669+0000 7fdfccef1640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdfb40a2c00 0x7fdfb40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.669+0000 7fdfccef1640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdfb40a2c00 0x7fdfb40a50c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8075d10 tx=0x7fdfb800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:58:32.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.673+0000 7fdfbe7fc640 1 -- 172.21.15.179:0/520377053 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdfc40bc4f0 con 0x7fdfc8101c00 2024-09-11T21:58:32.730 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3[51231]: 2024-09-11T21:58:32.305+0000 7fb509311640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T21:58:32.730 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3[51231]: 2024-09-11T21:58:32.312+0000 7fb50594b640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T21:58:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T21:58:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T21:58:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T21:58:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:32.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:32.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:32.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:32.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:32 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:32.846 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:32.845+0000 7fdfcf956640 1 -- 172.21.15.179:0/520377053 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fdfc8062630 con 0x7fdfb40a2c00 2024-09-11T21:58:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:33 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi152 2024-09-11T21:58:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:33 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi152 to 8544M 2024-09-11T21:58:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:33 smithi179 ceph-mon[35603]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:33 smithi179 ceph-mon[35603]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T21:58:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:33 smithi179 ceph-mon[35603]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T21:58:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:58:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:58:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:33.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:33 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi152 2024-09-11T21:58:33.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:33 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi152 to 8544M 2024-09-11T21:58:33.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:33 smithi193 ceph-mon[35545]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:33.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:33 smithi193 ceph-mon[35545]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T21:58:33.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:33 smithi193 ceph-mon[35545]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T21:58:33.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:33.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:33.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:58:33.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:58:33.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:33.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:33 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi152 2024-09-11T21:58:33.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:33 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi152 to 8544M 2024-09-11T21:58:33.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:33 smithi152 ceph-mon[31188]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:33.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:33 smithi152 ceph-mon[31188]: from='osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T21:58:33.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:33 smithi152 ceph-mon[31188]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T21:58:33.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:33.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:33.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:58:33.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:58:33.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:34.452 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:34 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T21:58:34.452 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:34 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T21:58:34.452 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:34 smithi179 ceph-mon[35603]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:58:34.452 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:34 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:34.452 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:34 smithi179 ceph-mon[35603]: osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450] boot 2024-09-11T21:58:34.452 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:34 smithi179 ceph-mon[35603]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T21:58:34.452 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:34 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:34.453 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:34 smithi179 ceph-mon[35603]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T21:58:34.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:34 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T21:58:34.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:34 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T21:58:34.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:34 smithi193 ceph-mon[35545]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:58:34.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:34 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:34.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:34 smithi193 ceph-mon[35545]: osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450] boot 2024-09-11T21:58:34.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:34 smithi193 ceph-mon[35545]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T21:58:34.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:34 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:34.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:34 smithi193 ceph-mon[35545]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T21:58:34.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:34 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T21:58:34.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:34 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T21:58:34.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:34 smithi152 ceph-mon[31188]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:58:34.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:34 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:34.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:34 smithi152 ceph-mon[31188]: osd.3 [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450] boot 2024-09-11T21:58:34.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:34 smithi152 ceph-mon[31188]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T21:58:34.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:34 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T21:58:34.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:34 smithi152 ceph-mon[31188]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T21:58:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:35 smithi193 ceph-mon[35545]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:35 smithi193 ceph-mon[35545]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T21:58:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:35 smithi193 ceph-mon[35545]: from='client.? 172.21.15.179:0/1988742797' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb5c9ac5-985a-42db-8bd3-805d3122d3a8"}]: dispatch 2024-09-11T21:58:35.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:35 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb5c9ac5-985a-42db-8bd3-805d3122d3a8"}]: dispatch 2024-09-11T21:58:35.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:35 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb5c9ac5-985a-42db-8bd3-805d3122d3a8"}]': finished 2024-09-11T21:58:35.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:35 smithi193 ceph-mon[35545]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T21:58:35.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:35.699 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:35 smithi179 ceph-mon[35603]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:35.699 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:35 smithi179 ceph-mon[35603]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T21:58:35.699 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:35 smithi179 ceph-mon[35603]: from='client.? 172.21.15.179:0/1988742797' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb5c9ac5-985a-42db-8bd3-805d3122d3a8"}]: dispatch 2024-09-11T21:58:35.699 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:35 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb5c9ac5-985a-42db-8bd3-805d3122d3a8"}]: dispatch 2024-09-11T21:58:35.700 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:35 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb5c9ac5-985a-42db-8bd3-805d3122d3a8"}]': finished 2024-09-11T21:58:35.700 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:35 smithi179 ceph-mon[35603]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T21:58:35.700 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:35 smithi152 ceph-mon[31188]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T21:58:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:35 smithi152 ceph-mon[31188]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T21:58:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:35 smithi152 ceph-mon[31188]: from='client.? 172.21.15.179:0/1988742797' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb5c9ac5-985a-42db-8bd3-805d3122d3a8"}]: dispatch 2024-09-11T21:58:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:35 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb5c9ac5-985a-42db-8bd3-805d3122d3a8"}]: dispatch 2024-09-11T21:58:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:35 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb5c9ac5-985a-42db-8bd3-805d3122d3a8"}]': finished 2024-09-11T21:58:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:35 smithi152 ceph-mon[31188]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T21:58:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:36.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:36 smithi152 ceph-mon[31188]: from='client.? 172.21.15.179:0/1711998566' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:58:36.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:36 smithi152 ceph-mon[31188]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T21:58:36.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:36 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:36.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:36 smithi179 ceph-mon[35603]: from='client.? 172.21.15.179:0/1711998566' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:58:36.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:36 smithi179 ceph-mon[35603]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T21:58:36.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:36 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:36.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:36 smithi193 ceph-mon[35545]: from='client.? 172.21.15.179:0/1711998566' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:58:36.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:36 smithi193 ceph-mon[35545]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T21:58:36.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:36 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:37 smithi152 ceph-mon[31188]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:37 smithi179 ceph-mon[35603]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:37.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:37 smithi193 ceph-mon[35545]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:38.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:38 smithi152 ceph-mon[31188]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:38.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:38 smithi179 ceph-mon[35603]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:38.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:38 smithi193 ceph-mon[35545]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:41.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:41 smithi179 ceph-mon[35603]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T21:58:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:41 smithi193 ceph-mon[35545]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T21:58:41.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:41 smithi152 ceph-mon[31188]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T21:58:43.540 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:43 smithi179 ceph-mon[35603]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-11T21:58:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:43 smithi193 ceph-mon[35545]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-11T21:58:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:43 smithi152 ceph-mon[31188]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-11T21:58:44.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:44 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T21:58:44.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:44 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:44.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:44 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T21:58:44.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:44 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:44 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T21:58:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:44 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:45.542 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:45 smithi179 ceph-mon[35603]: Deploying daemon osd.4 on smithi179 2024-09-11T21:58:45.542 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:45 smithi179 ceph-mon[35603]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-11T21:58:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:45 smithi193 ceph-mon[35545]: Deploying daemon osd.4 on smithi179 2024-09-11T21:58:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:45 smithi193 ceph-mon[35545]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-11T21:58:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:45 smithi152 ceph-mon[31188]: Deploying daemon osd.4 on smithi179 2024-09-11T21:58:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:45 smithi152 ceph-mon[31188]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-11T21:58:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:47 smithi179 ceph-mon[35603]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-11T21:58:47.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:47 smithi193 ceph-mon[35545]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-11T21:58:47.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:47 smithi152 ceph-mon[31188]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-11T21:58:49.362 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:49 smithi179 ceph-mon[35603]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:58:49.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:49 smithi193 ceph-mon[35545]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:58:49.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:49 smithi152 ceph-mon[31188]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:58:50.346 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:50 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:50.347 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:50 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:50.347 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:50 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:50.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:50 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:50.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:50 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:50.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:50 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:50.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:50 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:50.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:50 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:50.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:50 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:51.367 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:51 smithi179 ceph-mon[35603]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:58:51.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:51 smithi193 ceph-mon[35545]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:58:51.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:51 smithi152 ceph-mon[31188]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:58:52.785 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.784+0000 7fdfbe7fc640 1 -- 172.21.15.179:0/520377053 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdfc8062630 con 0x7fdfb40a2c00 2024-09-11T21:58:52.785 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 4 on host 'smithi179' 2024-09-11T21:58:52.787 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.786+0000 7fdfcf956640 1 -- 172.21.15.179:0/520377053 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdfb40a2c00 msgr2=0x7fdfb40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:52.787 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.786+0000 7fdfcf956640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdfb40a2c00 0x7fdfb40a50c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8075d10 tx=0x7fdfb800b390 comp rx=0 tx=0).stop 2024-09-11T21:58:52.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.786+0000 7fdfcf956640 1 -- 172.21.15.179:0/520377053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfc8101c00 msgr2=0x7fdfc8075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:52.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.786+0000 7fdfcf956640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfc8101c00 0x7fdfc8075f90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4031610 tx=0x7fdfc40043b0 comp rx=0 tx=0).stop 2024-09-11T21:58:52.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.787+0000 7fdfcf956640 1 -- 172.21.15.179:0/520377053 shutdown_connections 2024-09-11T21:58:52.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.787+0000 7fdfcf956640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdfb40a2c00 0x7fdfb40a50c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:52.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.787+0000 7fdfcf956640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfc81037c0 0x7fdfc8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:52.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.787+0000 7fdfcf956640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc8102e00 0x7fdfc80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:52.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.787+0000 7fdfcf956640 1 --2- 172.21.15.179:0/520377053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfc8101c00 0x7fdfc8075f90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:52.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.787+0000 7fdfcf956640 1 -- 172.21.15.179:0/520377053 >> 172.21.15.179:0/520377053 conn(0x7fdfc80fd390 msgr2=0x7fdfc8106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:58:52.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.787+0000 7fdfcf956640 1 -- 172.21.15.179:0/520377053 shutdown_connections 2024-09-11T21:58:52.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:58:52.787+0000 7fdfcf956640 1 -- 172.21.15.179:0/520377053 wait complete. 2024-09-11T21:58:53.334 DEBUG:teuthology.orchestra.run.smithi179:osd.4> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.4.service 2024-09-11T21:58:53.337 INFO:tasks.cephadm:Deploying osd.5 on smithi193 with /dev/vg_nvme/lv_3... 2024-09-11T21:58:53.337 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T21:58:53.358 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.358 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.358 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:53.358 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:53.359 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.359 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:53 smithi179 ceph-mon[35603]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:53.359 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:53.359 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.359 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:53.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:53.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:53 smithi152 ceph-mon[31188]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:53.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:53.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:53 smithi193 ceph-mon[35545]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:53.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:58:53.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:53.591 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T21:58:55.372 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:55 smithi193 ceph-mon[35545]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:55.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:55 smithi179 ceph-mon[35603]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:55.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:55 smithi152 ceph-mon[31188]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:56.086 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T21:58:56.108 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 21:58:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4[47038]: 2024-09-11T21:58:55.906+0000 7f9ff9b3b640 -1 osd.4 0 log_to_monitors true 2024-09-11T21:58:56.111 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_3 2024-09-11T21:58:56.360 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T21:58:56.368 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:56 smithi193 ceph-mon[35545]: from='osd.4 [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T21:58:56.369 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:56 smithi193 ceph-mon[35545]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T21:58:56.369 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.369 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.369 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:56.369 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:56.369 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.369 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:56.369 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:56.369 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:56 smithi179 ceph-mon[35603]: from='osd.4 [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T21:58:56.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:56 smithi179 ceph-mon[35603]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T21:58:56.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:56.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:56.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:56.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:56.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:56 smithi152 ceph-mon[31188]: from='osd.4 [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T21:58:56.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:56 smithi152 ceph-mon[31188]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T21:58:56.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:56.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:58:56.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:56.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:58:56.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:58:56.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.816+0000 7f8182554640 1 -- 172.21.15.193:0/2333735110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f817c102e00 msgr2=0x7f817c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:56.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.816+0000 7f8182554640 1 --2- 172.21.15.193:0/2333735110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f817c102e00 0x7f817c103280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8170009900 tx=0x7f817002a410 comp rx=0 tx=0).stop 2024-09-11T21:58:56.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.816+0000 7f8182554640 1 -- 172.21.15.193:0/2333735110 shutdown_connections 2024-09-11T21:58:56.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.816+0000 7f8182554640 1 --2- 172.21.15.193:0/2333735110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f817c1037c0 0x7f817c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:56.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.816+0000 7f8182554640 1 --2- 172.21.15.193:0/2333735110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f817c102e00 0x7f817c103280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:56.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.816+0000 7f8182554640 1 --2- 172.21.15.193:0/2333735110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f817c101c00 0x7f817c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:56.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.816+0000 7f8182554640 1 -- 172.21.15.193:0/2333735110 >> 172.21.15.193:0/2333735110 conn(0x7f817c0fd390 msgr2=0x7f817c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:58:56.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.816+0000 7f8182554640 1 -- 172.21.15.193:0/2333735110 shutdown_connections 2024-09-11T21:58:56.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.816+0000 7f8182554640 1 -- 172.21.15.193:0/2333735110 wait complete. 2024-09-11T21:58:56.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f8182554640 1 Processor -- start 2024-09-11T21:58:56.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f8182554640 1 -- start start 2024-09-11T21:58:56.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f8182554640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f817c101c00 0x7f817c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:56.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f8182554640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f817c102e00 0x7f817c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:56.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f8182554640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f817c1037c0 0x7f817c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:56.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f8182554640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f817c10d880 con 0x7f817c102e00 2024-09-11T21:58:56.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f8182554640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f817c10d700 con 0x7f817c101c00 2024-09-11T21:58:56.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f8182554640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f817c10da00 con 0x7f817c1037c0 2024-09-11T21:58:56.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f8180af1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f817c1037c0 0x7f817c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f817bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f817c101c00 0x7f817c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f8180af1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f817c1037c0 0x7f817c19f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:56740/0 (socket says 172.21.15.193:56740) 2024-09-11T21:58:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f8180af1640 1 -- 172.21.15.193:0/1735560086 learned_addr learned my addr 172.21.15.193:0/1735560086 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-11T21:58:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.817+0000 7f817b7fe640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f817c102e00 0x7f817c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f817bfff640 1 -- 172.21.15.193:0/1735560086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f817c1037c0 msgr2=0x7f817c19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f817bfff640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f817c1037c0 0x7f817c19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f817bfff640 1 -- 172.21.15.193:0/1735560086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f817c102e00 msgr2=0x7f817c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:58:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f817bfff640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f817c102e00 0x7f817c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:58:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f817bfff640 1 -- 172.21.15.193:0/1735560086 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c19fb00 con 0x7f817c101c00 2024-09-11T21:58:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f8180af1640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f817c1037c0 0x7f817c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T21:58:56.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f817bfff640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f817c101c00 0x7f817c197ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f816c00d6a0 tx=0x7f816c00db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:58:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f81797fa640 1 -- 172.21.15.193:0/1735560086 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c017070 con 0x7f817c101c00 2024-09-11T21:58:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f8182554640 1 -- 172.21.15.193:0/1735560086 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817c19fdf0 con 0x7f817c101c00 2024-09-11T21:58:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f8182554640 1 -- 172.21.15.193:0/1735560086 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f817c1a0250 con 0x7f817c101c00 2024-09-11T21:58:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f81797fa640 1 -- 172.21.15.193:0/1735560086 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f816c009d00 con 0x7f817c101c00 2024-09-11T21:58:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.818+0000 7f81797fa640 1 -- 172.21.15.193:0/1735560086 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c020060 con 0x7f817c101c00 2024-09-11T21:58:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.819+0000 7f8182554640 1 -- 172.21.15.193:0/1735560086 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f817c108fb0 con 0x7f817c101c00 2024-09-11T21:58:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.820+0000 7f81797fa640 1 -- 172.21.15.193:0/1735560086 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f816c004340 con 0x7f817c101c00 2024-09-11T21:58:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.821+0000 7f81797fa640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f81640a2bb0 0x7f81640a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:58:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.821+0000 7f81797fa640 1 -- 172.21.15.193:0/1735560086 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3805+0+0 (secure 0 0 0) 0x7f816c0cd710 con 0x7f817c101c00 2024-09-11T21:58:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.821+0000 7f817b7fe640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f81640a2bb0 0x7f81640a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:58:56.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.821+0000 7f817b7fe640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f81640a2bb0 0x7f81640a5070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f81700314e0 tx=0x7f8170000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:58:56.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.824+0000 7f81797fa640 1 -- 172.21.15.193:0/1735560086 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f816c09b120 con 0x7f817c101c00 2024-09-11T21:58:56.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:58:56.997+0000 7f8182554640 1 -- 172.21.15.193:0/1735560086 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f817c062630 con 0x7f81640a2bb0 2024-09-11T21:58:57.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:57 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi179 2024-09-11T21:58:57.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:57 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi179 to 8544M 2024-09-11T21:58:57.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:57 smithi179 ceph-mon[35603]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:57.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:57 smithi179 ceph-mon[35603]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T21:58:57.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:57 smithi179 ceph-mon[35603]: from='osd.4 [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:58:57.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:57 smithi179 ceph-mon[35603]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T21:58:57.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:57 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:57.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:57 smithi179 ceph-mon[35603]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:58:57.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:57 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:58:57.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:57 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:58:57.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:57 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:57 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi179 2024-09-11T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:57 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi179 to 8544M 2024-09-11T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:57 smithi193 ceph-mon[35545]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:57 smithi193 ceph-mon[35545]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:57 smithi193 ceph-mon[35545]: from='osd.4 [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:57 smithi193 ceph-mon[35545]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:57 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:57 smithi193 ceph-mon[35545]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:57 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:57 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:57 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:57 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi179 2024-09-11T21:58:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:57 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi179 to 8544M 2024-09-11T21:58:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:57 smithi152 ceph-mon[31188]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:57 smithi152 ceph-mon[31188]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T21:58:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:57 smithi152 ceph-mon[31188]: from='osd.4 [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:58:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:57 smithi152 ceph-mon[31188]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T21:58:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:57 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:57.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:57 smithi152 ceph-mon[31188]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T21:58:57.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:57 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:58:57.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:57 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:58:57.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:57 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:58:58.350 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:58 smithi193 ceph-mon[35545]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:58:58.350 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:58 smithi193 ceph-mon[35545]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T21:58:58.350 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:58 smithi193 ceph-mon[35545]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T21:58:58.350 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:58 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:58.350 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:58 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:58.350 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:58 smithi193 ceph-mon[35545]: from='osd.4 ' entity='osd.4' 2024-09-11T21:58:58.546 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 21:58:58 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4[47038]: 2024-09-11T21:58:58.057+0000 7f9ff529b640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T21:58:58.546 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 21:58:58 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4[47038]: 2024-09-11T21:58:58.067+0000 7f9fed8cd640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T21:58:58.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:58 smithi179 ceph-mon[35603]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:58:58.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:58 smithi179 ceph-mon[35603]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T21:58:58.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:58 smithi179 ceph-mon[35603]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T21:58:58.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:58 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:58.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:58 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:58.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:58 smithi179 ceph-mon[35603]: from='osd.4 ' entity='osd.4' 2024-09-11T21:58:58.608 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:58 smithi152 ceph-mon[31188]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:58:58.608 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:58 smithi152 ceph-mon[31188]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T21:58:58.608 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:58 smithi152 ceph-mon[31188]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T21:58:58.608 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:58 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:58.608 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:58 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:58.609 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:58 smithi152 ceph-mon[31188]: from='osd.4 ' entity='osd.4' 2024-09-11T21:58:59.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:59 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T21:58:59.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:59 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T21:58:59.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:59 smithi193 ceph-mon[35545]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:59.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:59 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:59.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:59 smithi193 ceph-mon[35545]: osd.4 [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024] boot 2024-09-11T21:58:59.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:59 smithi193 ceph-mon[35545]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T21:58:59.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:58:59 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:59 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T21:58:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:59 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T21:58:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:59 smithi152 ceph-mon[31188]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:59 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:59 smithi152 ceph-mon[31188]: osd.4 [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024] boot 2024-09-11T21:58:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:59 smithi152 ceph-mon[31188]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T21:58:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:58:59 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:59 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T21:58:59.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:59 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T21:58:59.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:59 smithi179 ceph-mon[35603]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-11T21:58:59.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:59 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:58:59.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:59 smithi179 ceph-mon[35603]: osd.4 [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024] boot 2024-09-11T21:58:59.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:59 smithi179 ceph-mon[35603]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T21:58:59.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:58:59 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T21:59:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:00 smithi193 ceph-mon[35545]: from='client.? 172.21.15.193:0/1839260780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8500e2aa-d805-460a-9a18-f74bef94f647"}]: dispatch 2024-09-11T21:59:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:00 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8500e2aa-d805-460a-9a18-f74bef94f647"}]: dispatch 2024-09-11T21:59:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:00 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8500e2aa-d805-460a-9a18-f74bef94f647"}]': finished 2024-09-11T21:59:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:00 smithi193 ceph-mon[35545]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T21:59:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:00 smithi193 ceph-mon[35545]: from='client.? 172.21.15.193:0/545353856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:59:00.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:00 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/1839260780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8500e2aa-d805-460a-9a18-f74bef94f647"}]: dispatch 2024-09-11T21:59:00.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:00 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8500e2aa-d805-460a-9a18-f74bef94f647"}]: dispatch 2024-09-11T21:59:00.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:00 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8500e2aa-d805-460a-9a18-f74bef94f647"}]': finished 2024-09-11T21:59:00.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:00 smithi152 ceph-mon[31188]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T21:59:00.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:00.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:00 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/545353856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:59:00.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:00 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/1839260780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8500e2aa-d805-460a-9a18-f74bef94f647"}]: dispatch 2024-09-11T21:59:00.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:00 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8500e2aa-d805-460a-9a18-f74bef94f647"}]: dispatch 2024-09-11T21:59:00.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:00 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8500e2aa-d805-460a-9a18-f74bef94f647"}]': finished 2024-09-11T21:59:00.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:00 smithi179 ceph-mon[35603]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T21:59:00.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:00.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:00 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/545353856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:59:01.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:01 smithi193 ceph-mon[35545]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:01.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:01 smithi193 ceph-mon[35545]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T21:59:01.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:01 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:01.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:01 smithi152 ceph-mon[31188]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:01.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:01 smithi152 ceph-mon[31188]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T21:59:01.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:01 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:01 smithi179 ceph-mon[35603]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:01 smithi179 ceph-mon[35603]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T21:59:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:01 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:03.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:03 smithi193 ceph-mon[35545]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:03.598 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:03 smithi179 ceph-mon[35603]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:03 smithi152 ceph-mon[31188]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:05.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:05 smithi193 ceph-mon[35545]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:05.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:05 smithi152 ceph-mon[31188]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:05.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:05 smithi179 ceph-mon[35603]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:07.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:07 smithi193 ceph-mon[35545]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:07 smithi152 ceph-mon[31188]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:07.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:07 smithi179 ceph-mon[35603]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:08.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:08 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T21:59:08.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:08 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:08.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:08 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T21:59:08.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:08 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:08 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T21:59:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:08 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:09.451 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:09 smithi193 ceph-mon[35545]: Deploying daemon osd.5 on smithi193 2024-09-11T21:59:09.452 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:09 smithi193 ceph-mon[35545]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:09.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:09 smithi152 ceph-mon[31188]: Deploying daemon osd.5 on smithi193 2024-09-11T21:59:09.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:09 smithi152 ceph-mon[31188]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:09 smithi179 ceph-mon[35603]: Deploying daemon osd.5 on smithi193 2024-09-11T21:59:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:09 smithi179 ceph-mon[35603]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:11 smithi152 ceph-mon[31188]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:11 smithi179 ceph-mon[35603]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:11 smithi193 ceph-mon[35545]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:13.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:13 smithi193 ceph-mon[35545]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:13 smithi152 ceph-mon[31188]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:13 smithi179 ceph-mon[35603]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:14.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:14 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:14.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:14 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:14.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:14 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:14 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:14 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:14 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:14.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:14 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:14.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:14 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:14.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:14 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:15.528 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:15 smithi193 ceph-mon[35545]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:15.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:15 smithi152 ceph-mon[31188]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:15.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:15 smithi179 ceph-mon[35603]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:16.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:16 smithi193 ceph-mon[35545]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:16.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:16 smithi152 ceph-mon[31188]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:16.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:16 smithi179 ceph-mon[35603]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:17.773 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:17.773 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:17.773 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:17.773 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:17.773 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:17.816 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 5 on host 'smithi193' 2024-09-11T21:59:17.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.814+0000 7f81797fa640 1 -- 172.21.15.193:0/1735560086 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f817c062630 con 0x7f81640a2bb0 2024-09-11T21:59:17.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.816+0000 7f8182554640 1 -- 172.21.15.193:0/1735560086 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f81640a2bb0 msgr2=0x7f81640a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:59:17.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.816+0000 7f8182554640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f81640a2bb0 0x7f81640a5070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f81700314e0 tx=0x7f8170000bc0 comp rx=0 tx=0).stop 2024-09-11T21:59:17.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.816+0000 7f8182554640 1 -- 172.21.15.193:0/1735560086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f817c101c00 msgr2=0x7f817c197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:59:17.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.816+0000 7f8182554640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f817c101c00 0x7f817c197ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f816c00d6a0 tx=0x7f816c00db60 comp rx=0 tx=0).stop 2024-09-11T21:59:17.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.816+0000 7f8182554640 1 -- 172.21.15.193:0/1735560086 shutdown_connections 2024-09-11T21:59:17.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.816+0000 7f8182554640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f81640a2bb0 0x7f81640a5070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:17.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.816+0000 7f8182554640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f817c1037c0 0x7f817c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:17.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.816+0000 7f8182554640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f817c102e00 0x7f817c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:17.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.816+0000 7f8182554640 1 --2- 172.21.15.193:0/1735560086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f817c101c00 0x7f817c197ed0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:17.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.816+0000 7f8182554640 1 -- 172.21.15.193:0/1735560086 >> 172.21.15.193:0/1735560086 conn(0x7f817c0fd390 msgr2=0x7f817c106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:59:17.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.816+0000 7f8182554640 1 -- 172.21.15.193:0/1735560086 shutdown_connections 2024-09-11T21:59:17.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T21:59:17.817+0000 7f8182554640 1 -- 172.21.15.193:0/1735560086 wait complete. 2024-09-11T21:59:18.419 DEBUG:teuthology.orchestra.run.smithi193:osd.5> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.5.service 2024-09-11T21:59:18.422 INFO:tasks.cephadm:Deploying osd.6 on smithi152 with /dev/vg_nvme/lv_2... 2024-09-11T21:59:18.422 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T21:59:18.647 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:18 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:18.648 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:18 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:18.648 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:18 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:18.648 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:18 smithi193 ceph-mon[35545]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:18.676 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:59:18.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:18 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:18.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:18 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:18.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:18 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:18.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:18 smithi152 ceph-mon[31188]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:18.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:18 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:18.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:18 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:18.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:18 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:18.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:18 smithi179 ceph-mon[35603]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:19.999 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 21:59:19 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T21:59:19.937+0000 7f29d4b97640 -1 osd.5 0 log_to_monitors true 2024-09-11T21:59:20.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:19 smithi152 ceph-mon[31188]: from='osd.5 [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T21:59:20.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:19 smithi152 ceph-mon[31188]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T21:59:20.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:19 smithi179 ceph-mon[35603]: from='osd.5 [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T21:59:20.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:19 smithi179 ceph-mon[35603]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T21:59:20.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:19 smithi193 ceph-mon[35545]: from='osd.5 [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T21:59:20.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:19 smithi193 ceph-mon[35545]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T21:59:20.989 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T21:59:21.020 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_2 2024-09-11T21:59:21.026 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:21 smithi152 ceph-mon[31188]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T21:59:21.027 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:21 smithi152 ceph-mon[31188]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T21:59:21.027 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:21 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:21.027 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:21 smithi152 ceph-mon[31188]: from='osd.5 [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:59:21.027 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:21 smithi152 ceph-mon[31188]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:59:21.027 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:21 smithi152 ceph-mon[31188]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:21.076 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 21:59:21 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T21:59:21.010+0000 7f29d02f7640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T21:59:21.076 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 21:59:21 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T21:59:21.019+0000 7f29cc931640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T21:59:21.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:21 smithi193 ceph-mon[35545]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T21:59:21.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:21 smithi193 ceph-mon[35545]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T21:59:21.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:21 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:21.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:21 smithi193 ceph-mon[35545]: from='osd.5 [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:59:21.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:21 smithi193 ceph-mon[35545]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:59:21.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:21 smithi193 ceph-mon[35545]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:21.284 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T21:59:21.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:21 smithi179 ceph-mon[35603]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T21:59:21.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:21 smithi179 ceph-mon[35603]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T21:59:21.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:21 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:21.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:21 smithi179 ceph-mon[35603]: from='osd.5 [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:59:21.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:21 smithi179 ceph-mon[35603]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T21:59:21.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:21 smithi179 ceph-mon[35603]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:21.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.783+0000 7f6e7bed0640 1 -- 172.21.15.152:0/3008858507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e74101cd0 msgr2=0x7f6e74102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:59:21.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.783+0000 7f6e7bed0640 1 --2- 172.21.15.152:0/3008858507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e74101cd0 0x7f6e74102150 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009900 tx=0x7f6e6802a410 comp rx=0 tx=0).stop 2024-09-11T21:59:21.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.783+0000 7f6e7bed0640 1 -- 172.21.15.152:0/3008858507 shutdown_connections 2024-09-11T21:59:21.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.783+0000 7f6e7bed0640 1 --2- 172.21.15.152:0/3008858507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74102690 0x7f6e74108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:21.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.783+0000 7f6e7bed0640 1 --2- 172.21.15.152:0/3008858507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e74101cd0 0x7f6e74102150 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:21.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.783+0000 7f6e7bed0640 1 --2- 172.21.15.152:0/3008858507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e74100ad0 0x7f6e74100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:21.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.783+0000 7f6e7bed0640 1 -- 172.21.15.152:0/3008858507 >> 172.21.15.152:0/3008858507 conn(0x7f6e740fc280 msgr2=0x7f6e740fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:59:21.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.783+0000 7f6e7bed0640 1 -- 172.21.15.152:0/3008858507 shutdown_connections 2024-09-11T21:59:21.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.783+0000 7f6e7bed0640 1 -- 172.21.15.152:0/3008858507 wait complete. 2024-09-11T21:59:21.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e7bed0640 1 Processor -- start 2024-09-11T21:59:21.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e7bed0640 1 -- start start 2024-09-11T21:59:21.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e7bed0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e74100ad0 0x7f6e74104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:59:21.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e7bed0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e74101cd0 0x7f6e741030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:59:21.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e7bed0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74102690 0x7f6e741035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:59:21.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e7bed0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7410c750 con 0x7f6e74100ad0 2024-09-11T21:59:21.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e7bed0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7410c5d0 con 0x7f6e74101cd0 2024-09-11T21:59:21.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e7bed0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7410c8d0 con 0x7f6e74102690 2024-09-11T21:59:21.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e79c6c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e74100ad0 0x7f6e74104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:59:21.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e79c6c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e74100ad0 0x7f6e74104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42198/0 (socket says 172.21.15.152:42198) 2024-09-11T21:59:21.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e79c6c640 1 -- 172.21.15.152:0/2811792890 learned_addr learned my addr 172.21.15.152:0/2811792890 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T21:59:21.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e7946b640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e74101cd0 0x7f6e741030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:59:21.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e7a46d640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74102690 0x7f6e741035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:59:21.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e79c6c640 1 -- 172.21.15.152:0/2811792890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74102690 msgr2=0x7f6e741035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:59:21.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e79c6c640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74102690 0x7f6e741035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:21.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e79c6c640 1 -- 172.21.15.152:0/2811792890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e74101cd0 msgr2=0x7f6e741030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:59:21.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e79c6c640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e74101cd0 0x7f6e741030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:21.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.784+0000 7f6e79c6c640 1 -- 172.21.15.152:0/2811792890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e74103eb0 con 0x7f6e74100ad0 2024-09-11T21:59:21.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.785+0000 7f6e79c6c640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e74100ad0 0x7f6e74104a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400ea80 tx=0x7f6e6400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:59:21.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.785+0000 7f6e72ffd640 1 -- 172.21.15.152:0/2811792890 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6400ce40 con 0x7f6e74100ad0 2024-09-11T21:59:21.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.785+0000 7f6e72ffd640 1 -- 172.21.15.152:0/2811792890 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e64011950 con 0x7f6e74100ad0 2024-09-11T21:59:21.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.785+0000 7f6e72ffd640 1 -- 172.21.15.152:0/2811792890 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6401ab80 con 0x7f6e74100ad0 2024-09-11T21:59:21.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.785+0000 7f6e7bed0640 1 -- 172.21.15.152:0/2811792890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e741a20f0 con 0x7f6e74100ad0 2024-09-11T21:59:21.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.785+0000 7f6e7bed0640 1 -- 172.21.15.152:0/2811792890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e741a25b0 con 0x7f6e74100ad0 2024-09-11T21:59:21.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.786+0000 7f6e7bed0640 1 -- 172.21.15.152:0/2811792890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e74100ed0 con 0x7f6e74100ad0 2024-09-11T21:59:21.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.787+0000 7f6e72ffd640 1 -- 172.21.15.152:0/2811792890 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6e64011b00 con 0x7f6e74100ad0 2024-09-11T21:59:21.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.788+0000 7f6e72ffd640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6e5c0a2c00 0x7f6e5c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:59:21.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.788+0000 7f6e7946b640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6e5c0a2c00 0x7f6e5c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:59:21.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.788+0000 7f6e72ffd640 1 -- 172.21.15.152:0/2811792890 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7f6e640ce5f0 con 0x7f6e74100ad0 2024-09-11T21:59:21.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.788+0000 7f6e7946b640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6e5c0a2c00 0x7f6e5c0a50c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e68031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:59:21.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.792+0000 7f6e72ffd640 1 -- 172.21.15.152:0/2811792890 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e64016030 con 0x7f6e74100ad0 2024-09-11T21:59:21.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:21.968+0000 7f6e7bed0640 1 -- 172.21.15.152:0/2811792890 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6e7406a710 con 0x7f6e5c0a2c00 2024-09-11T21:59:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T21:59:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T21:59:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi193 2024-09-11T21:59:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:22.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:22.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi193 to 8544M 2024-09-11T21:59:22.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:22.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:22.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:59:22.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:59:22.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:22.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi193 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi193 to 8544M 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:22.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:22.298 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.298 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:59:22.298 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:59:22.298 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:22.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T21:59:22.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T21:59:22.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:22.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:22.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi193 2024-09-11T21:59:22.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:22.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:22.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi193 to 8544M 2024-09-11T21:59:22.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:22.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:22.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:22.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:59:22.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:59:22.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:23.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:23 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T21:59:23.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:23 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T21:59:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:23 smithi179 ceph-mon[35603]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:59:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:23 smithi179 ceph-mon[35603]: osd.5 [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713] boot 2024-09-11T21:59:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:23 smithi179 ceph-mon[35603]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T21:59:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:23 smithi179 ceph-mon[35603]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:23.305 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:23 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T21:59:23.306 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:23 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T21:59:23.306 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:23 smithi152 ceph-mon[31188]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:59:23.306 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:23.306 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:23 smithi152 ceph-mon[31188]: osd.5 [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713] boot 2024-09-11T21:59:23.306 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:23 smithi152 ceph-mon[31188]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T21:59:23.306 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:23.306 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:23 smithi152 ceph-mon[31188]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:23 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T21:59:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:23 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T21:59:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:23 smithi193 ceph-mon[35545]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:59:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:23 smithi193 ceph-mon[35545]: osd.5 [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713] boot 2024-09-11T21:59:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:23 smithi193 ceph-mon[35545]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T21:59:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T21:59:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:23 smithi193 ceph-mon[35545]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T21:59:24.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:24 smithi152 ceph-mon[31188]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T21:59:24.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:24 smithi179 ceph-mon[35603]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T21:59:24.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:24 smithi193 ceph-mon[35545]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T21:59:25.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:25 smithi152 ceph-mon[31188]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T21:59:25.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:25 smithi152 ceph-mon[31188]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:25.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:25 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/747368257' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7efd5367-8d24-4036-81b2-b58b801435dd"}]: dispatch 2024-09-11T21:59:25.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:25 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/747368257' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7efd5367-8d24-4036-81b2-b58b801435dd"}]': finished 2024-09-11T21:59:25.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:25 smithi152 ceph-mon[31188]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T21:59:25.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:25.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:25 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3882148105' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:59:25.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:25 smithi179 ceph-mon[35603]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T21:59:25.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:25 smithi179 ceph-mon[35603]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:25.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:25 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/747368257' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7efd5367-8d24-4036-81b2-b58b801435dd"}]: dispatch 2024-09-11T21:59:25.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:25 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/747368257' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7efd5367-8d24-4036-81b2-b58b801435dd"}]': finished 2024-09-11T21:59:25.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:25 smithi179 ceph-mon[35603]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T21:59:25.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:25.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:25 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3882148105' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:59:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:25 smithi193 ceph-mon[35545]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T21:59:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:25 smithi193 ceph-mon[35545]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:25 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/747368257' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7efd5367-8d24-4036-81b2-b58b801435dd"}]: dispatch 2024-09-11T21:59:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:25 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/747368257' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7efd5367-8d24-4036-81b2-b58b801435dd"}]': finished 2024-09-11T21:59:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:25 smithi193 ceph-mon[35545]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T21:59:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:25 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3882148105' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:59:26.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:26 smithi152 ceph-mon[31188]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T21:59:26.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:26 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:26.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:26 smithi179 ceph-mon[35603]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T21:59:26.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:26 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:26 smithi193 ceph-mon[35545]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T21:59:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:26 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:27 smithi152 ceph-mon[31188]: pgmap v137: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T21:59:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:27 smithi152 ceph-mon[31188]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-11T21:59:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:27 smithi152 ceph-mon[31188]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T21:59:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:27.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:27 smithi179 ceph-mon[35603]: pgmap v137: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T21:59:27.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:27 smithi179 ceph-mon[35603]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-11T21:59:27.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:27 smithi179 ceph-mon[35603]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T21:59:27.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:27 smithi193 ceph-mon[35545]: pgmap v137: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T21:59:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:27 smithi193 ceph-mon[35545]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-11T21:59:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:27 smithi193 ceph-mon[35545]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T21:59:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:29.669 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:29 smithi152 ceph-mon[31188]: pgmap v139: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T21:59:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:29 smithi179 ceph-mon[35603]: pgmap v139: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T21:59:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:29 smithi193 ceph-mon[35545]: pgmap v139: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T21:59:30.681 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:30 smithi152 ceph-mon[31188]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T21:59:30.681 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:30 smithi152 ceph-mon[31188]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-11T21:59:30.681 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:30 smithi152 ceph-mon[31188]: Cluster is now healthy 2024-09-11T21:59:30.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:30 smithi179 ceph-mon[35603]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T21:59:30.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:30 smithi179 ceph-mon[35603]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-11T21:59:30.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:30 smithi179 ceph-mon[35603]: Cluster is now healthy 2024-09-11T21:59:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:30 smithi193 ceph-mon[35545]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T21:59:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:30 smithi193 ceph-mon[35545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-11T21:59:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:30 smithi193 ceph-mon[35545]: Cluster is now healthy 2024-09-11T21:59:33.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:33 smithi179 ceph-mon[35603]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-11T21:59:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T21:59:33.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:33.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:33 smithi193 ceph-mon[35545]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-11T21:59:33.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T21:59:33.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:33.600 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:33 smithi152 ceph-mon[31188]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-11T21:59:33.600 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T21:59:33.600 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:34.554 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:34 smithi193 ceph-mon[35545]: Deploying daemon osd.6 on smithi152 2024-09-11T21:59:34.633 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:34 smithi152 ceph-mon[31188]: Deploying daemon osd.6 on smithi152 2024-09-11T21:59:34.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:34 smithi179 ceph-mon[35603]: Deploying daemon osd.6 on smithi152 2024-09-11T21:59:35.432 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:35 smithi152 ceph-mon[31188]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-11T21:59:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:35 smithi193 ceph-mon[35545]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-11T21:59:35.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:35 smithi179 ceph-mon[35603]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-11T21:59:37.569 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:37 smithi152 ceph-mon[31188]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T21:59:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:37 smithi193 ceph-mon[35545]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T21:59:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:37 smithi179 ceph-mon[35603]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T21:59:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:39 smithi152 ceph-mon[31188]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:59:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:39 smithi193 ceph-mon[35545]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:59:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:39.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:39 smithi179 ceph-mon[35603]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:59:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:39.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:39.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:41.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:41 smithi152 ceph-mon[31188]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:59:41.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:41 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:41 smithi193 ceph-mon[35545]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:59:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:41 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:41 smithi179 ceph-mon[35603]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T21:59:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:41 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:42.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.441+0000 7f6e72ffd640 1 -- 172.21.15.152:0/2811792890 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6e7406a710 con 0x7f6e5c0a2c00 2024-09-11T21:59:42.442 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:42.442 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:42.442 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:42.442 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:42 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:42.443 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 6 on host 'smithi152' 2024-09-11T21:59:42.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.443+0000 7f6e7bed0640 1 -- 172.21.15.152:0/2811792890 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6e5c0a2c00 msgr2=0x7f6e5c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:59:42.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.443+0000 7f6e7bed0640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6e5c0a2c00 0x7f6e5c0a50c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e68031400 comp rx=0 tx=0).stop 2024-09-11T21:59:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.443+0000 7f6e7bed0640 1 -- 172.21.15.152:0/2811792890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e74100ad0 msgr2=0x7f6e74104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:59:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.443+0000 7f6e7bed0640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e74100ad0 0x7f6e74104a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400ea80 tx=0x7f6e6400ef40 comp rx=0 tx=0).stop 2024-09-11T21:59:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.444+0000 7f6e7bed0640 1 -- 172.21.15.152:0/2811792890 shutdown_connections 2024-09-11T21:59:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.444+0000 7f6e7bed0640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6e5c0a2c00 0x7f6e5c0a50c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.444+0000 7f6e7bed0640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74102690 0x7f6e741035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.444+0000 7f6e7bed0640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e74101cd0 0x7f6e741030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.444+0000 7f6e7bed0640 1 --2- 172.21.15.152:0/2811792890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e74100ad0 0x7f6e74104a60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.444+0000 7f6e7bed0640 1 -- 172.21.15.152:0/2811792890 >> 172.21.15.152:0/2811792890 conn(0x7f6e740fc280 msgr2=0x7f6e7406a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:59:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.444+0000 7f6e7bed0640 1 -- 172.21.15.152:0/2811792890 shutdown_connections 2024-09-11T21:59:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T21:59:42.444+0000 7f6e7bed0640 1 -- 172.21.15.152:0/2811792890 wait complete. 2024-09-11T21:59:42.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:42.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:42.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:42.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:42 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:42.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:42.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:42.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:42 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:43.028 DEBUG:teuthology.orchestra.run.smithi152:osd.6> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.6.service 2024-09-11T21:59:43.070 INFO:tasks.cephadm:Deploying osd.7 on smithi179 with /dev/vg_nvme/lv_2... 2024-09-11T21:59:43.070 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T21:59:43.321 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T21:59:43.442 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:43 smithi179 ceph-mon[35603]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:43.442 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:43 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:43.442 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:43 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:43.442 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:43 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:43 smithi193 ceph-mon[35545]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:43 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:43 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:43 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:43 smithi152 ceph-mon[31188]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:43 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T21:59:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:43 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:43 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:45.221 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 21:59:44 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T21:59:44.812+0000 7fe396b90640 -1 osd.6 0 log_to_monitors true 2024-09-11T21:59:45.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:45 smithi152 ceph-mon[31188]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:45 smithi152 ceph-mon[31188]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T21:59:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:45 smithi193 ceph-mon[35545]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:45 smithi193 ceph-mon[35545]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T21:59:45.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:45 smithi179 ceph-mon[35603]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:45.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:45 smithi179 ceph-mon[35603]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T21:59:45.815 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T21:59:45.847 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_2 2024-09-11T21:59:46.095 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T21:59:46.468 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T21:59:46.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: osdmap e43: 7 total, 6 up, 7 in 2024-09-11T21:59:46.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T21:59:46.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:46.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:46.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:46.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:46.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.469 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:46.470 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:46.470 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.470 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T21:59:46.470 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: osdmap e44: 7 total, 6 up, 7 in 2024-09-11T21:59:46.470 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:46 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:46.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.550+0000 7f57924e4640 1 -- 172.21.15.179:0/1168264102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c101d10 msgr2=0x7f578c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:59:46.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.550+0000 7f57924e4640 1 --2- 172.21.15.179:0/1168264102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c101d10 0x7f578c102190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5780009900 tx=0x7f578002a410 comp rx=0 tx=0).stop 2024-09-11T21:59:46.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.550+0000 7f57924e4640 1 -- 172.21.15.179:0/1168264102 shutdown_connections 2024-09-11T21:59:46.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.550+0000 7f57924e4640 1 --2- 172.21.15.179:0/1168264102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f578c1026d0 0x7f578c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:46.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.550+0000 7f57924e4640 1 --2- 172.21.15.179:0/1168264102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c101d10 0x7f578c102190 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:46.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.550+0000 7f57924e4640 1 --2- 172.21.15.179:0/1168264102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f578c100b10 0x7f578c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:46.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.550+0000 7f57924e4640 1 -- 172.21.15.179:0/1168264102 >> 172.21.15.179:0/1168264102 conn(0x7f578c0fc2a0 msgr2=0x7f578c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T21:59:46.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.550+0000 7f57924e4640 1 -- 172.21.15.179:0/1168264102 shutdown_connections 2024-09-11T21:59:46.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.550+0000 7f57924e4640 1 -- 172.21.15.179:0/1168264102 wait complete. 2024-09-11T21:59:46.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f57924e4640 1 Processor -- start 2024-09-11T21:59:46.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f57924e4640 1 -- start start 2024-09-11T21:59:46.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f57924e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c100b10 0x7f578c197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:59:46.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f57924e4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f578c101d10 0x7f578c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:59:46.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f57924e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f578c1026d0 0x7f578c19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:59:46.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f57924e4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f578c10d920 con 0x7f578c101d10 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f57924e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f578c10d7a0 con 0x7f578c100b10 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f57924e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f578c10daa0 con 0x7f578c1026d0 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f578b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f578c101d10 0x7f578c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f578bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c100b10 0x7f578c197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f578b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f578c101d10 0x7f578c198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.179:55700/0 (socket says 172.21.15.179:55700) 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f578b7fe640 1 -- 172.21.15.179:0/1336006816 learned_addr learned my addr 172.21.15.179:0/1336006816 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.551+0000 7f578bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c100b10 0x7f578c197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:58080/0 (socket says 172.21.15.179:58080) 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f5790a81640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f578c1026d0 0x7f578c19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f578bfff640 1 -- 172.21.15.179:0/1336006816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f578c1026d0 msgr2=0x7f578c19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f578bfff640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f578c1026d0 0x7f578c19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f578bfff640 1 -- 172.21.15.179:0/1336006816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f578c101d10 msgr2=0x7f578c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f578bfff640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f578c101d10 0x7f578c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T21:59:46.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f578bfff640 1 -- 172.21.15.179:0/1336006816 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578c19fc00 con 0x7f578c100b10 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f5790a81640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f578c1026d0 0x7f578c19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f578bfff640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c100b10 0x7f578c197fd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f578c101b70 tx=0x7f577c00dbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f57897fa640 1 -- 172.21.15.179:0/1336006816 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c017070 con 0x7f578c100b10 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f57897fa640 1 -- 172.21.15.179:0/1336006816 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f577c010460 con 0x7f578c100b10 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f57924e4640 1 -- 172.21.15.179:0/1336006816 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578c19fef0 con 0x7f578c100b10 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f57897fa640 1 -- 172.21.15.179:0/1336006816 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c00f620 con 0x7f578c100b10 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.552+0000 7f57924e4640 1 -- 172.21.15.179:0/1336006816 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578c1a0370 con 0x7f578c100b10 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.553+0000 7f57924e4640 1 -- 172.21.15.179:0/1336006816 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578c107eb0 con 0x7f578c100b10 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.554+0000 7f57897fa640 1 -- 172.21.15.179:0/1336006816 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f577c01a070 con 0x7f578c100b10 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.555+0000 7f57897fa640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f57740a2bb0 0x7f57740a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.555+0000 7f57897fa640 1 -- 172.21.15.179:0/1336006816 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4685+0+0 (secure 0 0 0) 0x7f577c0cdb60 con 0x7f578c100b10 2024-09-11T21:59:46.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.555+0000 7f578b7fe640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f57740a2bb0 0x7f57740a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T21:59:46.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.555+0000 7f578b7fe640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f57740a2bb0 0x7f57740a5070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5780031440 tx=0x7f57800315b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T21:59:46.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.559+0000 7f57897fa640 1 -- 172.21.15.179:0/1336006816 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f577c09b8f0 con 0x7f578c100b10 2024-09-11T21:59:46.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T21:59:46.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: osdmap e43: 7 total, 6 up, 7 in 2024-09-11T21:59:46.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T21:59:46.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:46.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:46.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:46.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:46.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:46.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:46.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T21:59:46.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: osdmap e44: 7 total, 6 up, 7 in 2024-09-11T21:59:46.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:46 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:46.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T21:59:46.732+0000 7f57924e4640 1 -- 172.21.15.179:0/1336006816 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f578c062630 con 0x7f57740a2bb0 2024-09-11T21:59:46.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T21:59:46.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: osdmap e43: 7 total, 6 up, 7 in 2024-09-11T21:59:46.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T21:59:46.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:46.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:46.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:46.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T21:59:46.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:46.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T21:59:46.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T21:59:46.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T21:59:46.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: osdmap e44: 7 total, 6 up, 7 in 2024-09-11T21:59:46.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:46 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:47.396 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:47 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi152 2024-09-11T21:59:47.396 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:47 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi152 to 5696M 2024-09-11T21:59:47.396 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:47 smithi179 ceph-mon[35603]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:47.397 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:47.397 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:47 smithi179 ceph-mon[35603]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:59:47.397 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:59:47.397 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:59:47.397 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:47.397 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:47 smithi179 ceph-mon[35603]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' 2024-09-11T21:59:47.397 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:47.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T21:59:47.146+0000 7fe3922f0640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T21:59:47.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T21:59:47.158+0000 7fe38a922640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T21:59:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi152 2024-09-11T21:59:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi152 to 5696M 2024-09-11T21:59:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-mon[31188]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-mon[31188]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:59:47.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:59:47.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:59:47.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:47.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-mon[31188]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' 2024-09-11T21:59:47.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:47.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:47 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi152 2024-09-11T21:59:47.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:47 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi152 to 5696M 2024-09-11T21:59:47.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:47 smithi193 ceph-mon[35545]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:47.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:47.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:47 smithi193 ceph-mon[35545]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T21:59:47.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T21:59:47.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T21:59:47.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:47.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:47 smithi193 ceph-mon[35545]: from='osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290]' entity='osd.6' 2024-09-11T21:59:47.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:48.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:48 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T21:59:48.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:48 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T21:59:48.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:48 smithi179 ceph-mon[35603]: osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290] boot 2024-09-11T21:59:48.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:48 smithi179 ceph-mon[35603]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T21:59:48.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:48 smithi179 ceph-mon[35603]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:48.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:48 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T21:59:48.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:48 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T21:59:48.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:48 smithi152 ceph-mon[31188]: osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290] boot 2024-09-11T21:59:48.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:48 smithi152 ceph-mon[31188]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T21:59:48.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:48.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:48 smithi152 ceph-mon[31188]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:48.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:48 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T21:59:48.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:48 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T21:59:48.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:48 smithi193 ceph-mon[35545]: osd.6 [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290] boot 2024-09-11T21:59:48.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:48 smithi193 ceph-mon[35545]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T21:59:48.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T21:59:48.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:48 smithi193 ceph-mon[35545]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T21:59:49.543 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:49 smithi179 ceph-mon[35603]: from='client.? 172.21.15.179:0/2473058718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3a68129-77a1-49ce-a517-862c73892209"}]: dispatch 2024-09-11T21:59:49.543 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:49 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3a68129-77a1-49ce-a517-862c73892209"}]: dispatch 2024-09-11T21:59:49.543 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:49 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3a68129-77a1-49ce-a517-862c73892209"}]': finished 2024-09-11T21:59:49.543 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:49 smithi179 ceph-mon[35603]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T21:59:49.543 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:49 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T21:59:49.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:49 smithi152 ceph-mon[31188]: from='client.? 172.21.15.179:0/2473058718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3a68129-77a1-49ce-a517-862c73892209"}]: dispatch 2024-09-11T21:59:49.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:49 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3a68129-77a1-49ce-a517-862c73892209"}]: dispatch 2024-09-11T21:59:49.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:49 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3a68129-77a1-49ce-a517-862c73892209"}]': finished 2024-09-11T21:59:49.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:49 smithi152 ceph-mon[31188]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T21:59:49.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:49 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T21:59:49.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:49 smithi193 ceph-mon[35545]: from='client.? 172.21.15.179:0/2473058718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3a68129-77a1-49ce-a517-862c73892209"}]: dispatch 2024-09-11T21:59:49.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:49 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3a68129-77a1-49ce-a517-862c73892209"}]: dispatch 2024-09-11T21:59:49.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:49 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3a68129-77a1-49ce-a517-862c73892209"}]': finished 2024-09-11T21:59:49.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:49 smithi193 ceph-mon[35545]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T21:59:49.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:49 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T21:59:50.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:50 smithi152 ceph-mon[31188]: from='client.? 172.21.15.179:0/1083432783' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:59:50.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:50 smithi152 ceph-mon[31188]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:50.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:50 smithi179 ceph-mon[35603]: from='client.? 172.21.15.179:0/1083432783' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:59:50.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:50 smithi179 ceph-mon[35603]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:50.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:50 smithi193 ceph-mon[35545]: from='client.? 172.21.15.179:0/1083432783' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T21:59:50.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:50 smithi193 ceph-mon[35545]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:53.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:53 smithi179 ceph-mon[35603]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:53 smithi193 ceph-mon[35545]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:53.708 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:53 smithi152 ceph-mon[31188]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:55.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:55 smithi179 ceph-mon[35603]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:55.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:55 smithi193 ceph-mon[35545]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:55.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:55 smithi152 ceph-mon[31188]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:57.477 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:57 smithi179 ceph-mon[35603]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:57.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:57 smithi193 ceph-mon[35545]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:57 smithi152 ceph-mon[31188]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:58.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:58 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T21:59:58.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:58 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:58.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:58 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T21:59:58.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:58 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:58.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:58 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T21:59:58.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:58 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T21:59:59.402 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:59 smithi179 ceph-mon[35603]: Deploying daemon osd.7 on smithi179 2024-09-11T21:59:59.402 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 21:59:59 smithi179 ceph-mon[35603]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:59.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:59 smithi193 ceph-mon[35545]: Deploying daemon osd.7 on smithi179 2024-09-11T21:59:59.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 21:59:59 smithi193 ceph-mon[35545]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T21:59:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:59 smithi152 ceph-mon[31188]: Deploying daemon osd.7 on smithi179 2024-09-11T21:59:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 21:59:59 smithi152 ceph-mon[31188]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:00.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:00 smithi179 ceph-mon[35603]: overall HEALTH_OK 2024-09-11T22:00:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:00 smithi193 ceph-mon[35545]: overall HEALTH_OK 2024-09-11T22:00:00.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:00 smithi152 ceph-mon[31188]: overall HEALTH_OK 2024-09-11T22:00:01.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:01 smithi193 ceph-mon[35545]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:01.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:01 smithi152 ceph-mon[31188]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:01.765 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:01 smithi179 ceph-mon[35603]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:03.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:03 smithi179 ceph-mon[35603]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:03.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:03 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:03.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:03 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:03.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:03 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:03.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:03 smithi193 ceph-mon[35545]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:03.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:03 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:03.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:03 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:03.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:03 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:03 smithi152 ceph-mon[31188]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:03 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:03 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:03 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:05.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:05 smithi193 ceph-mon[35545]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:05.663 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:05 smithi179 ceph-mon[35603]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:05.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:05 smithi152 ceph-mon[31188]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:06.826 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.825+0000 7f57897fa640 1 -- 172.21.15.179:0/1336006816 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f578c062630 con 0x7f57740a2bb0 2024-09-11T22:00:06.826 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 7 on host 'smithi179' 2024-09-11T22:00:06.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 -- 172.21.15.179:0/1336006816 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f57740a2bb0 msgr2=0x7f57740a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:06.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f57740a2bb0 0x7f57740a5070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5780031440 tx=0x7f57800315b0 comp rx=0 tx=0).stop 2024-09-11T22:00:06.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 -- 172.21.15.179:0/1336006816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c100b10 msgr2=0x7f578c197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:06.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c100b10 0x7f578c197fd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f578c101b70 tx=0x7f577c00dbb0 comp rx=0 tx=0).stop 2024-09-11T22:00:06.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 -- 172.21.15.179:0/1336006816 shutdown_connections 2024-09-11T22:00:06.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f57740a2bb0 0x7f57740a5070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:06.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f578c1026d0 0x7f578c19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:06.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f578c101d10 0x7f578c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:06.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 --2- 172.21.15.179:0/1336006816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c100b10 0x7f578c197fd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:06.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 -- 172.21.15.179:0/1336006816 >> 172.21.15.179:0/1336006816 conn(0x7f578c0fc2a0 msgr2=0x7f578c105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:00:06.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 -- 172.21.15.179:0/1336006816 shutdown_connections 2024-09-11T22:00:06.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:00:06.827+0000 7f57924e4640 1 -- 172.21.15.179:0/1336006816 wait complete. 2024-09-11T22:00:07.120 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:06 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.120 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:06 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.121 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:06 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:07.121 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:06 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:07.121 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:06 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.121 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:06 smithi179 ceph-mon[35603]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:07.121 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:06 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:07.121 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:06 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.121 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:06 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:06 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:06 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:06 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:07.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:06 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:07.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:06 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:06 smithi152 ceph-mon[31188]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:07.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:06 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:07.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:06 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:06 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:06 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:06 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:06 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:07.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:06 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:07.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:06 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:06 smithi193 ceph-mon[35545]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:07.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:06 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:07.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:06 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:06 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:07.433 DEBUG:teuthology.orchestra.run.smithi179:osd.7> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.7.service 2024-09-11T22:00:07.435 INFO:tasks.cephadm:Deploying osd.8 on smithi193 with /dev/vg_nvme/lv_2... 2024-09-11T22:00:07.436 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T22:00:07.693 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:00:09.408 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:09 smithi179 ceph-mon[35603]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:09 smithi193 ceph-mon[35545]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:09.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:09 smithi152 ceph-mon[31188]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:09.796 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:00:09 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:00:09.406+0000 7f89f5339640 -1 osd.7 0 log_to_monitors true 2024-09-11T22:00:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T22:00:10.039 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_2 2024-09-11T22:00:10.291 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:00:10.303 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:10 smithi193 ceph-mon[35545]: from='osd.7 [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:00:10.303 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:10 smithi193 ceph-mon[35545]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:00:10.481 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:10 smithi179 ceph-mon[35603]: from='osd.7 [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:00:10.481 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:10 smithi179 ceph-mon[35603]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:00:10.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:10 smithi152 ceph-mon[31188]: from='osd.7 [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:00:10.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:10 smithi152 ceph-mon[31188]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:00:10.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.779+0000 7f9054513640 1 -- 172.21.15.193:0/785250567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f904c100ad0 msgr2=0x7f904c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.779+0000 7f9054513640 1 --2- 172.21.15.193:0/785250567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f904c100ad0 0x7f904c100ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f903c009900 tx=0x7f903c02a410 comp rx=0 tx=0).stop 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.779+0000 7f9054513640 1 -- 172.21.15.193:0/785250567 shutdown_connections 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.779+0000 7f9054513640 1 --2- 172.21.15.193:0/785250567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f904c102690 0x7f904c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.779+0000 7f9054513640 1 --2- 172.21.15.193:0/785250567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f904c101cd0 0x7f904c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.779+0000 7f9054513640 1 --2- 172.21.15.193:0/785250567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f904c100ad0 0x7f904c100ed0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.779+0000 7f9054513640 1 -- 172.21.15.193:0/785250567 >> 172.21.15.193:0/785250567 conn(0x7f904c0fc280 msgr2=0x7f904c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.779+0000 7f9054513640 1 -- 172.21.15.193:0/785250567 shutdown_connections 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.779+0000 7f9054513640 1 -- 172.21.15.193:0/785250567 wait complete. 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.779+0000 7f9054513640 1 Processor -- start 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.779+0000 7f9054513640 1 -- start start 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9054513640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f904c100ad0 0x7f904c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:00:10.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9054513640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f904c101cd0 0x7f904c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9054513640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f904c102690 0x7f904c19f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9054513640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f904c10c7b0 con 0x7f904c100ad0 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9054513640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f904c10c630 con 0x7f904c101cd0 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9054513640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f904c10c930 con 0x7f904c102690 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9052ab0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f904c102690 0x7f904c19f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9051aae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f904c101cd0 0x7f904c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9051aae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f904c101cd0 0x7f904c19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.193:40768/0 (socket says 172.21.15.193:40768) 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9052ab0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f904c102690 0x7f904c19f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:47726/0 (socket says 172.21.15.193:47726) 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9051aae640 1 -- 172.21.15.193:0/4040317897 learned_addr learned my addr 172.21.15.193:0/4040317897 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f90522af640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f904c100ad0 0x7f904c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9052ab0640 1 -- 172.21.15.193:0/4040317897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f904c101cd0 msgr2=0x7f904c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9052ab0640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f904c101cd0 0x7f904c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:10.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9052ab0640 1 -- 172.21.15.193:0/4040317897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f904c100ad0 msgr2=0x7f904c06aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:10.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9052ab0640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f904c100ad0 0x7f904c06aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:10.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9052ab0640 1 -- 172.21.15.193:0/4040317897 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c19fbf0 con 0x7f904c102690 2024-09-11T22:00:10.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9051aae640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f904c101cd0 0x7f904c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:00:10.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f9052ab0640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f904c102690 0x7f904c19f2e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f904400e940 tx=0x7f904400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:00:10.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.780+0000 7f90437fe640 1 -- 172.21.15.193:0/4040317897 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044004d20 con 0x7f904c102690 2024-09-11T22:00:10.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.781+0000 7f9054513640 1 -- 172.21.15.193:0/4040317897 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904c19fe80 con 0x7f904c102690 2024-09-11T22:00:10.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.781+0000 7f90437fe640 1 -- 172.21.15.193:0/4040317897 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9044005020 con 0x7f904c102690 2024-09-11T22:00:10.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.781+0000 7f90437fe640 1 -- 172.21.15.193:0/4040317897 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90440116b0 con 0x7f904c102690 2024-09-11T22:00:10.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.781+0000 7f9054513640 1 -- 172.21.15.193:0/4040317897 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f904c1a0410 con 0x7f904c102690 2024-09-11T22:00:10.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.782+0000 7f9054513640 1 -- 172.21.15.193:0/4040317897 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f904c100ed0 con 0x7f904c102690 2024-09-11T22:00:10.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.783+0000 7f90437fe640 1 -- 172.21.15.193:0/4040317897 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f90440054d0 con 0x7f904c102690 2024-09-11T22:00:10.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.783+0000 7f90437fe640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90380a2c00 0x7f90380a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:00:10.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.783+0000 7f90437fe640 1 -- 172.21.15.193:0/4040317897 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5101+0+0 (secure 0 0 0) 0x7f90440ce3b0 con 0x7f904c102690 2024-09-11T22:00:10.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.784+0000 7f90522af640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90380a2c00 0x7f90380a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:00:10.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.784+0000 7f90522af640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90380a2c00 0x7f90380a50c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f903c005ab0 tx=0x7f903c000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:00:10.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.788+0000 7f90437fe640 1 -- 172.21.15.193:0/4040317897 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9044016030 con 0x7f904c102690 2024-09-11T22:00:10.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:10.969+0000 7f9054513640 1 -- 172.21.15.193:0/4040317897 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f904c0626f0 con 0x7f90380a2c00 2024-09-11T22:00:11.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:11.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T22:00:11.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T22:00:11.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:11.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='osd.7 [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:00:11.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:00:11.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:11.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:11.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:11.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:11.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:11.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:00:11.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:00:11.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T22:00:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T22:00:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='osd.7 [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:00:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:00:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:11.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:11.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:11.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:11.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:11.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:00:11.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:00:11.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T22:00:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='osd.7 [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:11.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:00:11.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:00:11.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:12.546 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:00:12 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:00:12.065+0000 7f89f1ad0640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T22:00:12.546 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:00:12 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:00:12.079+0000 7f89e90cb640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:00:12.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:12 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi179 2024-09-11T22:00:12.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:12 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi179 to 5696M 2024-09-11T22:00:12.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:12 smithi179 ceph-mon[35603]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:00:12.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:12 smithi179 ceph-mon[35603]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T22:00:12.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:12 smithi179 ceph-mon[35603]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T22:00:12.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:12.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:12.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:12 smithi179 ceph-mon[35603]: from='osd.7 ' entity='osd.7' 2024-09-11T22:00:12.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:12 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi179 2024-09-11T22:00:12.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:12 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi179 to 5696M 2024-09-11T22:00:12.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:12 smithi193 ceph-mon[35545]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:00:12.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:12 smithi193 ceph-mon[35545]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T22:00:12.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:12 smithi193 ceph-mon[35545]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T22:00:12.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:12.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:12.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:12 smithi193 ceph-mon[35545]: from='osd.7 ' entity='osd.7' 2024-09-11T22:00:12.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:12 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi179 2024-09-11T22:00:12.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:12 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi179 to 5696M 2024-09-11T22:00:12.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:12 smithi152 ceph-mon[31188]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:00:12.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:12 smithi152 ceph-mon[31188]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T22:00:12.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:12 smithi152 ceph-mon[31188]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T22:00:12.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:12.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:12.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:12 smithi152 ceph-mon[31188]: from='osd.7 ' entity='osd.7' 2024-09-11T22:00:13.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:13 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T22:00:13.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:13 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T22:00:13.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:13 smithi193 ceph-mon[35545]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:13.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:13 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:13.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:13 smithi193 ceph-mon[35545]: osd.7 [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699] boot 2024-09-11T22:00:13.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:13 smithi193 ceph-mon[35545]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T22:00:13.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:13 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:13 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T22:00:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:13 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T22:00:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:13 smithi152 ceph-mon[31188]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:13 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:13 smithi152 ceph-mon[31188]: osd.7 [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699] boot 2024-09-11T22:00:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:13 smithi152 ceph-mon[31188]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T22:00:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:13 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:13 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T22:00:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:13 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T22:00:13.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:13 smithi179 ceph-mon[35603]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:00:13.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:13 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:13.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:13 smithi179 ceph-mon[35603]: osd.7 [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699] boot 2024-09-11T22:00:13.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:13 smithi179 ceph-mon[35603]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T22:00:13.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:13 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:00:14.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:14 smithi193 ceph-mon[35545]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T22:00:14.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:14 smithi193 ceph-mon[35545]: from='client.? 172.21.15.193:0/4153634480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d9b684e-3bb8-4aee-abc2-1e654068425d"}]: dispatch 2024-09-11T22:00:14.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:14 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d9b684e-3bb8-4aee-abc2-1e654068425d"}]: dispatch 2024-09-11T22:00:14.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:14 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d9b684e-3bb8-4aee-abc2-1e654068425d"}]': finished 2024-09-11T22:00:14.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:14 smithi193 ceph-mon[35545]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T22:00:14.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:14 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:14.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:14 smithi193 ceph-mon[35545]: from='client.? 172.21.15.193:0/4032408250' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:00:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:14 smithi152 ceph-mon[31188]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T22:00:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:14 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/4153634480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d9b684e-3bb8-4aee-abc2-1e654068425d"}]: dispatch 2024-09-11T22:00:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:14 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d9b684e-3bb8-4aee-abc2-1e654068425d"}]: dispatch 2024-09-11T22:00:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:14 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d9b684e-3bb8-4aee-abc2-1e654068425d"}]': finished 2024-09-11T22:00:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:14 smithi152 ceph-mon[31188]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T22:00:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:14 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:14.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:14 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/4032408250' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:00:14.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:14 smithi179 ceph-mon[35603]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T22:00:14.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:14 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/4153634480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d9b684e-3bb8-4aee-abc2-1e654068425d"}]: dispatch 2024-09-11T22:00:14.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:14 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d9b684e-3bb8-4aee-abc2-1e654068425d"}]: dispatch 2024-09-11T22:00:14.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:14 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d9b684e-3bb8-4aee-abc2-1e654068425d"}]': finished 2024-09-11T22:00:14.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:14 smithi179 ceph-mon[35603]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T22:00:14.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:14 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:14.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:14 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/4032408250' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:00:15.655 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:15 smithi179 ceph-mon[35603]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:15.655 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:15 smithi179 ceph-mon[35603]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T22:00:15.655 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:15.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:15 smithi152 ceph-mon[31188]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:15.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:15 smithi152 ceph-mon[31188]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T22:00:15.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:15 smithi193 ceph-mon[35545]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:15 smithi193 ceph-mon[35545]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T22:00:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:16.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:16 smithi179 ceph-mon[35603]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T22:00:16.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:16 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:16.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:16 smithi179 ceph-mon[35603]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:16.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:16 smithi152 ceph-mon[31188]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T22:00:16.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:16 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:16.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:16 smithi152 ceph-mon[31188]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:16.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:16 smithi193 ceph-mon[35545]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T22:00:16.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:16 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:16.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:16 smithi193 ceph-mon[35545]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:17 smithi152 ceph-mon[31188]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T22:00:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:17 smithi179 ceph-mon[35603]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T22:00:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:17.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:17 smithi193 ceph-mon[35545]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T22:00:17.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:18.699 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:18 smithi193 ceph-mon[35545]: pgmap v176: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:18.744 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:18 smithi152 ceph-mon[31188]: pgmap v176: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:18.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:18 smithi179 ceph-mon[35603]: pgmap v176: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:21.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:21 smithi193 ceph-mon[35545]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:21.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:21 smithi152 ceph-mon[31188]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:21 smithi179 ceph-mon[35603]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:22.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T22:00:22.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:22.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T22:00:22.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:22.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T22:00:22.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:23 smithi193 ceph-mon[35545]: Deploying daemon osd.8 on smithi193 2024-09-11T22:00:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:23 smithi193 ceph-mon[35545]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:23.631 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:23 smithi152 ceph-mon[31188]: Deploying daemon osd.8 on smithi193 2024-09-11T22:00:23.631 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:23 smithi152 ceph-mon[31188]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:23.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:23 smithi179 ceph-mon[35603]: Deploying daemon osd.8 on smithi193 2024-09-11T22:00:23.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:23 smithi179 ceph-mon[35603]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:25.569 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:25 smithi193 ceph-mon[35545]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:25 smithi152 ceph-mon[31188]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:25 smithi179 ceph-mon[35603]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:27.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:27 smithi193 ceph-mon[35545]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:27.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:27 smithi152 ceph-mon[31188]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:27.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:27 smithi179 ceph-mon[35603]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:28.456 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:28 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:28.456 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:28 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:28.456 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:28 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:28.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:28 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:28.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:28 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:28.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:28 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:28 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:28 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:28 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:29.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:29 smithi193 ceph-mon[35545]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:29 smithi152 ceph-mon[31188]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:29.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:29 smithi179 ceph-mon[35603]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:31.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.206+0000 7f90437fe640 1 -- 172.21.15.193:0/4040317897 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f904c0626f0 con 0x7f90380a2c00 2024-09-11T22:00:31.208 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 8 on host 'smithi193' 2024-09-11T22:00:31.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 -- 172.21.15.193:0/4040317897 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90380a2c00 msgr2=0x7f90380a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:31.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90380a2c00 0x7f90380a50c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f903c005ab0 tx=0x7f903c000bc0 comp rx=0 tx=0).stop 2024-09-11T22:00:31.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 -- 172.21.15.193:0/4040317897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f904c102690 msgr2=0x7f904c19f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:31.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f904c102690 0x7f904c19f2e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f904400e940 tx=0x7f904400ee00 comp rx=0 tx=0).stop 2024-09-11T22:00:31.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 -- 172.21.15.193:0/4040317897 shutdown_connections 2024-09-11T22:00:31.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90380a2c00 0x7f90380a50c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f904c102690 0x7f904c19f2e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f904c101cd0 0x7f904c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 --2- 172.21.15.193:0/4040317897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f904c100ad0 0x7f904c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 -- 172.21.15.193:0/4040317897 >> 172.21.15.193:0/4040317897 conn(0x7f904c0fc280 msgr2=0x7f904c1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:00:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 -- 172.21.15.193:0/4040317897 shutdown_connections 2024-09-11T22:00:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:00:31.208+0000 7f9054513640 1 -- 172.21.15.193:0/4040317897 wait complete. 2024-09-11T22:00:31.513 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:31 smithi193 ceph-mon[35545]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:31.513 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.513 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.513 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:31.513 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:31.513 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.513 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:31.513 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.513 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:31 smithi179 ceph-mon[35603]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:31.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:31.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:31.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:31.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:31 smithi152 ceph-mon[31188]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:31.824 DEBUG:teuthology.orchestra.run.smithi193:osd.8> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.8.service 2024-09-11T22:00:31.827 INFO:tasks.cephadm:Deploying osd.9 on smithi152 with /dev/vg_nvme/lv_1... 2024-09-11T22:00:31.827 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T22:00:32.083 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:00:33.439 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:33 smithi152 ceph-mon[31188]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:33.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:33 smithi179 ceph-mon[35603]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:33.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:33 smithi193 ceph-mon[35545]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:34.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:00:33 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:00:33.965+0000 7fb09ca64640 -1 osd.8 0 log_to_monitors true 2024-09-11T22:00:34.458 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:34 smithi193 ceph-mon[35545]: from='osd.8 [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:00:34.458 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:34 smithi193 ceph-mon[35545]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:00:34.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:34 smithi152 ceph-mon[31188]: from='osd.8 [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:00:34.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:34 smithi152 ceph-mon[31188]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:00:34.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:34 smithi179 ceph-mon[35603]: from='osd.8 [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:00:34.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:34 smithi179 ceph-mon[35603]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:00:34.623 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:00:34.655 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_1 2024-09-11T22:00:34.902 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:00:35.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.397+0000 7faa40b18640 1 -- 172.21.15.152:0/62061027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa3c100b10 msgr2=0x7faa3c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:35.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.397+0000 7faa40b18640 1 --2- 172.21.15.152:0/62061027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa3c100b10 0x7faa3c100f10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faa24009900 tx=0x7faa2402a410 comp rx=0 tx=0).stop 2024-09-11T22:00:35.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.397+0000 7faa40b18640 1 -- 172.21.15.152:0/62061027 shutdown_connections 2024-09-11T22:00:35.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.397+0000 7faa40b18640 1 --2- 172.21.15.152:0/62061027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa3c1026d0 0x7faa3c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:35.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.397+0000 7faa40b18640 1 --2- 172.21.15.152:0/62061027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa3c101d10 0x7faa3c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:35.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.397+0000 7faa40b18640 1 --2- 172.21.15.152:0/62061027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa3c100b10 0x7faa3c100f10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:35.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.397+0000 7faa40b18640 1 -- 172.21.15.152:0/62061027 >> 172.21.15.152:0/62061027 conn(0x7faa3c0fc2a0 msgr2=0x7faa3c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:00:35.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.397+0000 7faa40b18640 1 -- 172.21.15.152:0/62061027 shutdown_connections 2024-09-11T22:00:35.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.397+0000 7faa40b18640 1 -- 172.21.15.152:0/62061027 wait complete. 2024-09-11T22:00:35.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa40b18640 1 Processor -- start 2024-09-11T22:00:35.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa40b18640 1 -- start start 2024-09-11T22:00:35.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa40b18640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa3c100b10 0x7faa3c06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:00:35.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa40b18640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa3c101d10 0x7faa3c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:00:35.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa40b18640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa3c1026d0 0x7faa3c19f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:00:35.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa40b18640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c10c770 con 0x7faa3c100b10 2024-09-11T22:00:35.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa40b18640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c10c5f0 con 0x7faa3c1026d0 2024-09-11T22:00:35.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa40b18640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c10c8f0 con 0x7faa3c101d10 2024-09-11T22:00:35.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa3a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa3c100b10 0x7faa3c06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:00:35.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa3a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa3c100b10 0x7faa3c06b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52622/0 (socket says 172.21.15.152:52622) 2024-09-11T22:00:35.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa3a59c640 1 -- 172.21.15.152:0/4112053583 learned_addr learned my addr 172.21.15.152:0/4112053583 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:00:35.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa39d9b640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa3c101d10 0x7faa3c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:00:35.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.398+0000 7faa3ad9d640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa3c1026d0 0x7faa3c19f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:00:35.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa3a59c640 1 -- 172.21.15.152:0/4112053583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa3c101d10 msgr2=0x7faa3c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:35.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa3a59c640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa3c101d10 0x7faa3c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:35.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa3a59c640 1 -- 172.21.15.152:0/4112053583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa3c1026d0 msgr2=0x7faa3c19f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:35.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa3a59c640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa3c1026d0 0x7faa3c19f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:35.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa3a59c640 1 -- 172.21.15.152:0/4112053583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c19fb90 con 0x7faa3c100b10 2024-09-11T22:00:35.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa3ad9d640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa3c1026d0 0x7faa3c19f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:00:35.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa3a59c640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa3c100b10 0x7faa3c06b2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faa24031610 tx=0x7faa24004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:00:35.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa337fe640 1 -- 172.21.15.152:0/4112053583 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24048070 con 0x7faa3c100b10 2024-09-11T22:00:35.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa337fe640 1 -- 172.21.15.152:0/4112053583 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa2403ab50 con 0x7faa3c100b10 2024-09-11T22:00:35.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa40b18640 1 -- 172.21.15.152:0/4112053583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c196a30 con 0x7faa3c100b10 2024-09-11T22:00:35.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa337fe640 1 -- 172.21.15.152:0/4112053583 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24035050 con 0x7faa3c100b10 2024-09-11T22:00:35.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.399+0000 7faa40b18640 1 -- 172.21.15.152:0/4112053583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c196f10 con 0x7faa3c100b10 2024-09-11T22:00:35.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.400+0000 7faa40b18640 1 -- 172.21.15.152:0/4112053583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3c107f60 con 0x7faa3c100b10 2024-09-11T22:00:35.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.401+0000 7faa337fe640 1 -- 172.21.15.152:0/4112053583 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7faa2404b070 con 0x7faa3c100b10 2024-09-11T22:00:35.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.402+0000 7faa337fe640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faa280a2b80 0x7faa280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:00:35.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.402+0000 7faa39d9b640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faa280a2b80 0x7faa280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:00:35.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.402+0000 7faa337fe640 1 -- 172.21.15.152:0/4112053583 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5549+0+0 (secure 0 0 0) 0x7faa240f2270 con 0x7faa3c100b10 2024-09-11T22:00:35.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.403+0000 7faa39d9b640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faa280a2b80 0x7faa280a5040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa3c06b870 tx=0x7faa2c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:00:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.406+0000 7faa337fe640 1 -- 172.21.15.152:0/4112053583 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa240801b0 con 0x7faa3c100b10 2024-09-11T22:00:35.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:35.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T22:00:35.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T22:00:35.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:35.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='osd.8 [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:00:35.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:00:35.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:35.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:35.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:35.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:35.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:35.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:35.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:35.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:35.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:35.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:35.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T22:00:35.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T22:00:35.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:35.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='osd.8 [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:00:35.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:00:35.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:35.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:35.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:35.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:35.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:35.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:35.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:35.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:35.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:35.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:35.581+0000 7faa40b18640 1 -- 172.21.15.152:0/4112053583 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7faa3c198360 con 0x7faa280a2b80 2024-09-11T22:00:35.582 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:35.582 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T22:00:35.582 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T22:00:35.582 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:35.582 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='osd.8 [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:00:35.582 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:00:35.582 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:35.582 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:35.583 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:35.583 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:35.583 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:00:35.583 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:35.583 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:35.583 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:00:35.583 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:36.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:00:36.063+0000 7fb0981c4640 -1 osd.8 0 waiting for initial osdmap 2024-09-11T22:00:36.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:00:36.075+0000 7fb0907f6640 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:00:36.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi193 2024-09-11T22:00:36.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi193 to 5696M 2024-09-11T22:00:36.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-mon[35545]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T22:00:36.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-mon[35545]: osdmap e56: 9 total, 8 up, 9 in 2024-09-11T22:00:36.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:36.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:36.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:00:36.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:00:36.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:36.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:36 smithi193 ceph-mon[35545]: from='osd.8 ' entity='osd.8' 2024-09-11T22:00:36.622 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:36 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi193 2024-09-11T22:00:36.622 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:36 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi193 to 5696M 2024-09-11T22:00:36.622 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:36 smithi152 ceph-mon[31188]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T22:00:36.622 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:36 smithi152 ceph-mon[31188]: osdmap e56: 9 total, 8 up, 9 in 2024-09-11T22:00:36.622 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:36 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:36.622 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:36 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:36.622 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:36 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:00:36.622 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:36 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:00:36.622 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:36 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:36.622 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:36 smithi152 ceph-mon[31188]: from='osd.8 ' entity='osd.8' 2024-09-11T22:00:36.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:36 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi193 2024-09-11T22:00:36.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:36 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi193 to 5696M 2024-09-11T22:00:36.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:36 smithi179 ceph-mon[35603]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T22:00:36.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:36 smithi179 ceph-mon[35603]: osdmap e56: 9 total, 8 up, 9 in 2024-09-11T22:00:36.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:36 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:36.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:36 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:36.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:36 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:00:36.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:36 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:00:36.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:36 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:36.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:36 smithi179 ceph-mon[35603]: from='osd.8 ' entity='osd.8' 2024-09-11T22:00:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:37 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T22:00:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:37 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T22:00:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:37 smithi193 ceph-mon[35545]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:00:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:37 smithi193 ceph-mon[35545]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:37 smithi193 ceph-mon[35545]: osd.8 [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713] boot 2024-09-11T22:00:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:37 smithi193 ceph-mon[35545]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T22:00:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:37 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:37.664 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:37 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T22:00:37.664 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:37 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T22:00:37.664 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:37 smithi152 ceph-mon[31188]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:00:37.664 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:37 smithi152 ceph-mon[31188]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:37.664 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:37 smithi152 ceph-mon[31188]: osd.8 [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713] boot 2024-09-11T22:00:37.664 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:37 smithi152 ceph-mon[31188]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T22:00:37.664 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:37 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:37 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T22:00:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:37 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T22:00:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:37 smithi179 ceph-mon[35603]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:00:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:37 smithi179 ceph-mon[35603]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:00:37.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:37 smithi179 ceph-mon[35603]: osd.8 [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713] boot 2024-09-11T22:00:37.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:37 smithi179 ceph-mon[35603]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T22:00:37.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:37 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:00:38.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:38 smithi152 ceph-mon[31188]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T22:00:38.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:38 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2197906633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e04aa14-c831-4546-bae0-c4fa460b8d9f"}]: dispatch 2024-09-11T22:00:38.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:38 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2197906633' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e04aa14-c831-4546-bae0-c4fa460b8d9f"}]': finished 2024-09-11T22:00:38.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:38 smithi152 ceph-mon[31188]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T22:00:38.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:38 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:00:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:38 smithi193 ceph-mon[35545]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T22:00:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:38 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2197906633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e04aa14-c831-4546-bae0-c4fa460b8d9f"}]: dispatch 2024-09-11T22:00:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:38 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2197906633' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e04aa14-c831-4546-bae0-c4fa460b8d9f"}]': finished 2024-09-11T22:00:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:38 smithi193 ceph-mon[35545]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T22:00:38.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:38 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:00:38.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:38 smithi179 ceph-mon[35603]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T22:00:38.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:38 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2197906633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e04aa14-c831-4546-bae0-c4fa460b8d9f"}]: dispatch 2024-09-11T22:00:38.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:38 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2197906633' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e04aa14-c831-4546-bae0-c4fa460b8d9f"}]': finished 2024-09-11T22:00:38.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:38 smithi179 ceph-mon[35603]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T22:00:38.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:38 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:00:39.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:39 smithi152 ceph-mon[31188]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:39.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:39 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2811241971' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:00:39.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:39 smithi152 ceph-mon[31188]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T22:00:39.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:00:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:39 smithi179 ceph-mon[35603]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:39 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2811241971' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:00:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:39 smithi179 ceph-mon[35603]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T22:00:39.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:00:39.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:39 smithi193 ceph-mon[35545]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:39.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:39 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2811241971' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:00:39.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:39 smithi193 ceph-mon[35545]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T22:00:39.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:00:41.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:40 smithi193 ceph-mon[35545]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T22:00:41.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:40 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:00:41.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:40 smithi193 ceph-mon[35545]: pgmap v194: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-11T22:00:41.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:40 smithi152 ceph-mon[31188]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T22:00:41.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:40 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:00:41.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:40 smithi152 ceph-mon[31188]: pgmap v194: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-11T22:00:41.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:40 smithi179 ceph-mon[35603]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T22:00:41.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:40 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:00:41.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:40 smithi179 ceph-mon[35603]: pgmap v194: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-11T22:00:43.418 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:43 smithi152 ceph-mon[31188]: pgmap v195: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-11T22:00:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:43 smithi193 ceph-mon[35545]: pgmap v195: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-11T22:00:43.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:43 smithi179 ceph-mon[35603]: pgmap v195: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-11T22:00:45.473 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:45 smithi152 ceph-mon[31188]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-11T22:00:45.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:45 smithi179 ceph-mon[35603]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-11T22:00:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:45 smithi193 ceph-mon[35545]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-11T22:00:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:47 smithi152 ceph-mon[31188]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:00:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T22:00:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:47 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:47.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:47 smithi193 ceph-mon[35545]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:00:47.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T22:00:47.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:47 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:47 smithi179 ceph-mon[35603]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:00:47.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T22:00:47.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:47 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:00:48.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:48 smithi152 ceph-mon[31188]: Deploying daemon osd.9 on smithi152 2024-09-11T22:00:48.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:48 smithi193 ceph-mon[35545]: Deploying daemon osd.9 on smithi152 2024-09-11T22:00:48.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:48 smithi179 ceph-mon[35603]: Deploying daemon osd.9 on smithi152 2024-09-11T22:00:49.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:49 smithi152 ceph-mon[31188]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:49.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:49 smithi193 ceph-mon[35545]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:49.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:49 smithi179 ceph-mon[35603]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:51.374 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:51 smithi152 ceph-mon[31188]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:51.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:51 smithi193 ceph-mon[35545]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:51.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:51 smithi179 ceph-mon[35603]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:53 smithi193 ceph-mon[35545]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:53 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:53.621 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:53 smithi152 ceph-mon[31188]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:53.621 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:53.621 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:53.621 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:53 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:53 smithi179 ceph-mon[35603]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:00:53.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:53.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:53 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:55.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:55 smithi193 ceph-mon[35545]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:55.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:55 smithi152 ceph-mon[31188]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:55.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:55 smithi179 ceph-mon[35603]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:55.848 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 9 on host 'smithi152' 2024-09-11T22:00:55.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.847+0000 7faa337fe640 1 -- 172.21.15.152:0/4112053583 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faa3c198360 con 0x7faa280a2b80 2024-09-11T22:00:55.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 -- 172.21.15.152:0/4112053583 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faa280a2b80 msgr2=0x7faa280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:55.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faa280a2b80 0x7faa280a5040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa3c06b870 tx=0x7faa2c00b410 comp rx=0 tx=0).stop 2024-09-11T22:00:55.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 -- 172.21.15.152:0/4112053583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa3c100b10 msgr2=0x7faa3c06b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:00:55.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa3c100b10 0x7faa3c06b2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faa24031610 tx=0x7faa24004270 comp rx=0 tx=0).stop 2024-09-11T22:00:55.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 -- 172.21.15.152:0/4112053583 shutdown_connections 2024-09-11T22:00:55.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa3c1026d0 0x7faa3c19f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:55.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faa280a2b80 0x7faa280a5040 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:55.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa3c101d10 0x7faa3c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:55.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 --2- 172.21.15.152:0/4112053583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa3c100b10 0x7faa3c06b2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:00:55.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 -- 172.21.15.152:0/4112053583 >> 172.21.15.152:0/4112053583 conn(0x7faa3c0fc2a0 msgr2=0x7faa3c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:00:55.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 -- 172.21.15.152:0/4112053583 shutdown_connections 2024-09-11T22:00:55.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:00:55.850+0000 7faa40b18640 1 -- 172.21.15.152:0/4112053583 wait complete. 2024-09-11T22:00:56.636 DEBUG:teuthology.orchestra.run.smithi152:osd.9> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.9.service 2024-09-11T22:00:56.639 INFO:tasks.cephadm:Deploying osd.10 on smithi179 with /dev/vg_nvme/lv_1... 2024-09-11T22:00:56.639 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T22:00:56.895 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:00:56.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:56.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:56.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:56 smithi152 ceph-mon[31188]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:56.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:56.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:57.015 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:57.015 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:57.016 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:56 smithi179 ceph-mon[35603]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:57.016 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:57.016 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:57.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:57.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:57.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:56 smithi193 ceph-mon[35545]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:57.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:57.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:00:59.230 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:00:58 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:00:58.974+0000 7fe51c937640 -1 osd.9 0 log_to_monitors true 2024-09-11T22:00:59.316 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-11T22:00:59.342 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_1 2024-09-11T22:00:59.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:59 smithi193 ceph-mon[35545]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:59.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:00:59 smithi193 ceph-mon[35545]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T22:00:59.596 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:00:59.624 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:59 smithi179 ceph-mon[35603]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:59.624 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:00:59 smithi179 ceph-mon[35603]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T22:00:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:59 smithi152 ceph-mon[31188]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:00:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:00:59 smithi152 ceph-mon[31188]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T22:01:00.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.073+0000 7f8321b12640 1 -- 172.21.15.179:0/2258562008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c1026b0 msgr2=0x7f831c108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:00.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.073+0000 7f8321b12640 1 --2- 172.21.15.179:0/2258562008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c1026b0 0x7f831c108f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8314009ca0 tx=0x7f831402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:01:00.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.073+0000 7f8321b12640 1 -- 172.21.15.179:0/2258562008 shutdown_connections 2024-09-11T22:01:00.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.073+0000 7f8321b12640 1 --2- 172.21.15.179:0/2258562008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c1026b0 0x7f831c108f40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:00.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.073+0000 7f8321b12640 1 --2- 172.21.15.179:0/2258562008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c101cf0 0x7f831c102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:00.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.073+0000 7f8321b12640 1 --2- 172.21.15.179:0/2258562008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f831c100af0 0x7f831c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:00.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.073+0000 7f8321b12640 1 -- 172.21.15.179:0/2258562008 >> 172.21.15.179:0/2258562008 conn(0x7f831c0fc2a0 msgr2=0x7f831c0fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:00.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8321b12640 1 -- 172.21.15.179:0/2258562008 shutdown_connections 2024-09-11T22:01:00.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8321b12640 1 -- 172.21.15.179:0/2258562008 wait complete. 2024-09-11T22:01:00.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8321b12640 1 Processor -- start 2024-09-11T22:01:00.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8321b12640 1 -- start start 2024-09-11T22:01:00.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8321b12640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c100af0 0x7f831c06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:00.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8321b12640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c101cf0 0x7f831c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:00.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8321b12640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f831c1026b0 0x7f831c19f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:00.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8321b12640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f831c10c7d0 con 0x7f831c1026b0 2024-09-11T22:01:00.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8321b12640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f831c10c650 con 0x7f831c101cf0 2024-09-11T22:01:00.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8321b12640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f831c10c950 con 0x7f831c100af0 2024-09-11T22:01:00.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8313fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c101cf0 0x7f831c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:00.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.074+0000 7f8313fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c101cf0 0x7f831c19ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39488/0 (socket says 172.21.15.179:39488) 2024-09-11T22:01:00.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f8313fff640 1 -- 172.21.15.179:0/994422278 learned_addr learned my addr 172.21.15.179:0/994422278 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-11T22:01:00.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f831b7fe640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c100af0 0x7f831c06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:00.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f831bfff640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f831c1026b0 0x7f831c19f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:00.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f8313fff640 1 -- 172.21.15.179:0/994422278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c100af0 msgr2=0x7f831c06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:00.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f8313fff640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c100af0 0x7f831c06b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:00.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f8313fff640 1 -- 172.21.15.179:0/994422278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f831c1026b0 msgr2=0x7f831c19f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:00.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f8313fff640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f831c1026b0 0x7f831c19f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:00.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f8313fff640 1 -- 172.21.15.179:0/994422278 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831c19fbe0 con 0x7f831c101cf0 2024-09-11T22:01:00.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f8313fff640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c101cf0 0x7f831c19ccb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f830400b4a0 tx=0x7f830400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:00.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f83197fa640 1 -- 172.21.15.179:0/994422278 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304014070 con 0x7f831c101cf0 2024-09-11T22:01:00.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f83197fa640 1 -- 172.21.15.179:0/994422278 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8304010af0 con 0x7f831c101cf0 2024-09-11T22:01:00.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f8321b12640 1 -- 172.21.15.179:0/994422278 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831c19fe70 con 0x7f831c101cf0 2024-09-11T22:01:00.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f83197fa640 1 -- 172.21.15.179:0/994422278 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304017d10 con 0x7f831c101cf0 2024-09-11T22:01:00.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.075+0000 7f8321b12640 1 -- 172.21.15.179:0/994422278 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f831c1a03f0 con 0x7f831c101cf0 2024-09-11T22:01:00.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.076+0000 7f8321b12640 1 -- 172.21.15.179:0/994422278 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f831c107ec0 con 0x7f831c101cf0 2024-09-11T22:01:00.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.078+0000 7f83197fa640 1 -- 172.21.15.179:0/994422278 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f8304017070 con 0x7f831c101cf0 2024-09-11T22:01:00.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.079+0000 7f83197fa640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f83080a2c00 0x7f83080a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:00.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.079+0000 7f83197fa640 1 -- 172.21.15.179:0/994422278 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5965+0+0 (secure 0 0 0) 0x7f83040cdcf0 con 0x7f831c101cf0 2024-09-11T22:01:00.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.079+0000 7f831b7fe640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f83080a2c00 0x7f83080a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:00.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.079+0000 7f831b7fe640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f83080a2c00 0x7f83080a50c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f831c101b50 tx=0x7f830c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:00.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.081+0000 7f83197fa640 1 -- 172.21.15.179:0/994422278 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f830409af30 con 0x7f831c101cf0 2024-09-11T22:01:00.262 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:00.261+0000 7f8321b12640 1 -- 172.21.15.179:0/994422278 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f831c062630 con 0x7f83080a2c00 2024-09-11T22:01:00.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T22:01:00.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T22:01:00.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T22:01:00.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:00.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T22:01:00.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: osdmap e63: 10 total, 9 up, 10 in 2024-09-11T22:01:00.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:00.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:00 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T22:01:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T22:01:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:00.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:00.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:00.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:01:00.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:01:00.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:00.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T22:01:00.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: osdmap e63: 10 total, 9 up, 10 in 2024-09-11T22:01:00.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:00.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:00 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:00.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:01:00.313+0000 7fe518097640 -1 osd.9 0 waiting for initial osdmap 2024-09-11T22:01:00.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:01:00.325+0000 7fe5146d1640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:01:00.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T22:01:00.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T22:01:00.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-11T22:01:00.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:00.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:00.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:00.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:00.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:00.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:00.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:00.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:00.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:01:00.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:01:00.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:00.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-11T22:01:00.733 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: osdmap e63: 10 total, 9 up, 10 in 2024-09-11T22:01:00.733 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:00.733 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:00 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:01.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:01 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi152 2024-09-11T22:01:01.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:01 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi152 to 4272M 2024-09-11T22:01:01.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:01 smithi193 ceph-mon[35545]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:01:01.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:01 smithi193 ceph-mon[35545]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:01:01.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:01 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:01.712 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:01 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi152 2024-09-11T22:01:01.712 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:01 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi152 to 4272M 2024-09-11T22:01:01.712 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:01 smithi179 ceph-mon[35603]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:01:01.712 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:01 smithi179 ceph-mon[35603]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:01:01.712 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:01 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:01.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:01 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi152 2024-09-11T22:01:01.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:01 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi152 to 4272M 2024-09-11T22:01:01.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:01 smithi152 ceph-mon[31188]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:01:01.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:01 smithi152 ceph-mon[31188]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:01:01.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:01 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:02.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:02 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T22:01:02.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:02 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T22:01:02.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:02 smithi179 ceph-mon[35603]: osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769] boot 2024-09-11T22:01:02.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:02 smithi179 ceph-mon[35603]: osdmap e64: 10 total, 10 up, 10 in 2024-09-11T22:01:02.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:02.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:02 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T22:01:02.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:02 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T22:01:02.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:02 smithi152 ceph-mon[31188]: osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769] boot 2024-09-11T22:01:02.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:02 smithi152 ceph-mon[31188]: osdmap e64: 10 total, 10 up, 10 in 2024-09-11T22:01:02.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:02.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:02 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T22:01:02.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:02 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T22:01:02.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:02 smithi193 ceph-mon[35545]: osd.9 [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769] boot 2024-09-11T22:01:02.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:02 smithi193 ceph-mon[35545]: osdmap e64: 10 total, 10 up, 10 in 2024-09-11T22:01:02.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:01:03.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:03 smithi179 ceph-mon[35603]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:01:03.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:03 smithi179 ceph-mon[35603]: osdmap e65: 10 total, 10 up, 10 in 2024-09-11T22:01:03.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:03 smithi179 ceph-mon[35603]: from='client.? 172.21.15.179:0/3828667597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ded37595-f1a3-4d43-a4be-d84ead52418e"}]: dispatch 2024-09-11T22:01:03.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:03 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ded37595-f1a3-4d43-a4be-d84ead52418e"}]: dispatch 2024-09-11T22:01:03.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:03 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ded37595-f1a3-4d43-a4be-d84ead52418e"}]': finished 2024-09-11T22:01:03.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:03 smithi179 ceph-mon[35603]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T22:01:03.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:03 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:03.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:03 smithi179 ceph-mon[35603]: from='client.? 172.21.15.179:0/3270819859' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:01:03.727 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:03 smithi193 ceph-mon[35545]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:01:03.728 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:03 smithi193 ceph-mon[35545]: osdmap e65: 10 total, 10 up, 10 in 2024-09-11T22:01:03.728 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:03 smithi193 ceph-mon[35545]: from='client.? 172.21.15.179:0/3828667597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ded37595-f1a3-4d43-a4be-d84ead52418e"}]: dispatch 2024-09-11T22:01:03.728 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:03 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ded37595-f1a3-4d43-a4be-d84ead52418e"}]: dispatch 2024-09-11T22:01:03.728 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:03 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ded37595-f1a3-4d43-a4be-d84ead52418e"}]': finished 2024-09-11T22:01:03.728 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:03 smithi193 ceph-mon[35545]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T22:01:03.728 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:03 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:03.728 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:03 smithi193 ceph-mon[35545]: from='client.? 172.21.15.179:0/3270819859' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:01:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:03 smithi152 ceph-mon[31188]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:01:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:03 smithi152 ceph-mon[31188]: osdmap e65: 10 total, 10 up, 10 in 2024-09-11T22:01:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:03 smithi152 ceph-mon[31188]: from='client.? 172.21.15.179:0/3828667597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ded37595-f1a3-4d43-a4be-d84ead52418e"}]: dispatch 2024-09-11T22:01:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:03 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ded37595-f1a3-4d43-a4be-d84ead52418e"}]: dispatch 2024-09-11T22:01:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:03 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ded37595-f1a3-4d43-a4be-d84ead52418e"}]': finished 2024-09-11T22:01:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:03 smithi152 ceph-mon[31188]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T22:01:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:03 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:03 smithi152 ceph-mon[31188]: from='client.? 172.21.15.179:0/3270819859' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:01:05.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:05 smithi152 ceph-mon[31188]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:05.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:05 smithi179 ceph-mon[35603]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:05.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:05 smithi193 ceph-mon[35545]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:07.613 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:07 smithi179 ceph-mon[35603]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:07 smithi152 ceph-mon[31188]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:07 smithi193 ceph-mon[35545]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:09.585 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:09 smithi179 ceph-mon[35603]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:09.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:09 smithi152 ceph-mon[31188]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:09.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:09 smithi193 ceph-mon[35545]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:11.641 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:11 smithi179 ceph-mon[35603]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:11.641 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T22:01:11.641 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:11 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:11 smithi152 ceph-mon[31188]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T22:01:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:11 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:11 smithi193 ceph-mon[35545]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T22:01:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:11 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:12.644 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:12 smithi179 ceph-mon[35603]: Deploying daemon osd.10 on smithi179 2024-09-11T22:01:12.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:12 smithi152 ceph-mon[31188]: Deploying daemon osd.10 on smithi179 2024-09-11T22:01:12.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:12 smithi193 ceph-mon[35545]: Deploying daemon osd.10 on smithi179 2024-09-11T22:01:13.635 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:13 smithi179 ceph-mon[35603]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:13 smithi152 ceph-mon[31188]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:13.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:13 smithi193 ceph-mon[35545]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:15.486 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:15 smithi179 ceph-mon[35603]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:15.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:15 smithi152 ceph-mon[31188]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:15 smithi193 ceph-mon[35545]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:17 smithi152 ceph-mon[31188]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:17 smithi179 ceph-mon[35603]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:17.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:17 smithi193 ceph-mon[35545]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:17.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:17.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:17.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:18.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:18 smithi152 ceph-mon[31188]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:18.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:18 smithi179 ceph-mon[35603]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:18.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:18 smithi193 ceph-mon[35545]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:19.541 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.539+0000 7f83197fa640 1 -- 172.21.15.179:0/994422278 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f831c062630 con 0x7f83080a2c00 2024-09-11T22:01:19.542 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 10 on host 'smithi179' 2024-09-11T22:01:19.543 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 -- 172.21.15.179:0/994422278 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f83080a2c00 msgr2=0x7f83080a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:19.543 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f83080a2c00 0x7f83080a50c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f831c101b50 tx=0x7f830c00a2d0 comp rx=0 tx=0).stop 2024-09-11T22:01:19.543 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 -- 172.21.15.179:0/994422278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c101cf0 msgr2=0x7f831c19ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:19.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c101cf0 0x7f831c19ccb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f830400b4a0 tx=0x7f830400b960 comp rx=0 tx=0).stop 2024-09-11T22:01:19.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 -- 172.21.15.179:0/994422278 shutdown_connections 2024-09-11T22:01:19.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f831c1026b0 0x7f831c19f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:19.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c101cf0 0x7f831c19ccb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:19.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f83080a2c00 0x7f83080a50c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:19.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 --2- 172.21.15.179:0/994422278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c100af0 0x7f831c06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:19.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 -- 172.21.15.179:0/994422278 >> 172.21.15.179:0/994422278 conn(0x7f831c0fc2a0 msgr2=0x7f831c105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:19.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 -- 172.21.15.179:0/994422278 shutdown_connections 2024-09-11T22:01:19.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-11T22:01:19.541+0000 7f8321b12640 1 -- 172.21.15.179:0/994422278 wait complete. 2024-09-11T22:01:20.126 DEBUG:teuthology.orchestra.run.smithi179:osd.10> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.10.service 2024-09-11T22:01:20.129 INFO:tasks.cephadm:Deploying osd.11 on smithi193 with /dev/vg_nvme/lv_1... 2024-09-11T22:01:20.129 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T22:01:20.386 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:01:20.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:20 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:20 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:20 smithi179 ceph-mon[35603]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:20 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:20 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:20.824 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:20 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:20.824 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:20 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:20.824 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:20 smithi193 ceph-mon[35545]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:20.824 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:20 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:20.824 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:20 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:20.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:20 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:20.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:20 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:20.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:20 smithi152 ceph-mon[31188]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:20.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:20 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:20.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:20 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.130 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-11T22:01:23.157 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_1 2024-09-11T22:01:23.165 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:01:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:01:22.957+0000 7fc899c08640 -1 osd.10 0 log_to_monitors true 2024-09-11T22:01:23.416 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:23.416 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='osd.10 [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:01:23.416 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:01:23.416 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.416 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.416 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.416 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.416 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.416 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.416 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.417 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:23.417 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:23.417 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:23 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.417 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:01:23.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:23.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='osd.10 [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:01:23.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:01:23.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:23.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:23.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:23 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:23.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='osd.10 [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:01:23.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:01:23.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:23.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.684 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:23.685 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:23.685 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:23 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:23.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.861+0000 7fd80b75d640 1 -- 172.21.15.193:0/2066226260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd804101e50 msgr2=0x7fd8041086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:23.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.861+0000 7fd80b75d640 1 --2- 172.21.15.193:0/2066226260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd804101e50 0x7fd8041086e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009ca0 tx=0x7fd7fc02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:01:23.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.861+0000 7fd80b75d640 1 -- 172.21.15.193:0/2066226260 shutdown_connections 2024-09-11T22:01:23.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.861+0000 7fd80b75d640 1 --2- 172.21.15.193:0/2066226260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd804101e50 0x7fd8041086e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:23.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.861+0000 7fd80b75d640 1 --2- 172.21.15.193:0/2066226260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd804101490 0x7fd804101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:23.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.861+0000 7fd80b75d640 1 --2- 172.21.15.193:0/2066226260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd804100290 0x7fd804100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:23.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.861+0000 7fd80b75d640 1 -- 172.21.15.193:0/2066226260 >> 172.21.15.193:0/2066226260 conn(0x7fd8040fba40 msgr2=0x7fd8040fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:23.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.861+0000 7fd80b75d640 1 -- 172.21.15.193:0/2066226260 shutdown_connections 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.861+0000 7fd80b75d640 1 -- 172.21.15.193:0/2066226260 wait complete. 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.861+0000 7fd80b75d640 1 Processor -- start 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.861+0000 7fd80b75d640 1 -- start start 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd80b75d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd804100290 0x7fd804197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd80b75d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd804101490 0x7fd804198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd80b75d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd804101e50 0x7fd80419f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd80b75d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd80410b670 con 0x7fd804100290 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd80b75d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd80410b4f0 con 0x7fd804101e50 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd80b75d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd80410b7f0 con 0x7fd804101490 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd808cf8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd804101490 0x7fd804198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd808cf8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd804101490 0x7fd804198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:55954/0 (socket says 172.21.15.193:55954) 2024-09-11T22:01:23.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd808cf8640 1 -- 172.21.15.193:0/3014912114 learned_addr learned my addr 172.21.15.193:0/3014912114 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-11T22:01:23.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd8094f9640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd804100290 0x7fd804197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:23.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd809cfa640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd804101e50 0x7fd80419f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:23.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd808cf8640 1 -- 172.21.15.193:0/3014912114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd804101e50 msgr2=0x7fd80419f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:23.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd808cf8640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd804101e50 0x7fd80419f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:23.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd808cf8640 1 -- 172.21.15.193:0/3014912114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd804100290 msgr2=0x7fd804197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:23.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd808cf8640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd804100290 0x7fd804197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:23.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd808cf8640 1 -- 172.21.15.193:0/3014912114 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80419fb10 con 0x7fd804101490 2024-09-11T22:01:23.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd808cf8640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd804101490 0x7fd804198420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400d950 tx=0x7fd7f400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:23.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd7fa7fc640 1 -- 172.21.15.193:0/3014912114 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4017070 con 0x7fd804101490 2024-09-11T22:01:23.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd80b75d640 1 -- 172.21.15.193:0/3014912114 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd80419fe00 con 0x7fd804101490 2024-09-11T22:01:23.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd7fa7fc640 1 -- 172.21.15.193:0/3014912114 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f4009c30 con 0x7fd804101490 2024-09-11T22:01:23.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.862+0000 7fd7fa7fc640 1 -- 172.21.15.193:0/3014912114 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400f6b0 con 0x7fd804101490 2024-09-11T22:01:23.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.863+0000 7fd80b75d640 1 -- 172.21.15.193:0/3014912114 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8041a0300 con 0x7fd804101490 2024-09-11T22:01:23.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.863+0000 7fd80b75d640 1 -- 172.21.15.193:0/3014912114 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8041a0530 con 0x7fd804101490 2024-09-11T22:01:23.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.864+0000 7fd7fa7fc640 1 -- 172.21.15.193:0/3014912114 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd7f40109d0 con 0x7fd804101490 2024-09-11T22:01:23.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.865+0000 7fd7fa7fc640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd7f00a2c30 0x7fd7f00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:23.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.865+0000 7fd7fa7fc640 1 -- 172.21.15.193:0/3014912114 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6398+0+0 (secure 0 0 0) 0x7fd7f40ce3c0 con 0x7fd804101490 2024-09-11T22:01:23.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.865+0000 7fd8094f9640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd7f00a2c30 0x7fd7f00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:23.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.866+0000 7fd8094f9640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd7f00a2c30 0x7fd7f00a50f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd800005fd0 tx=0x7fd80000b510 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:23.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:23.869+0000 7fd7fa7fc640 1 -- 172.21.15.193:0/3014912114 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7f409baa0 con 0x7fd804101490 2024-09-11T22:01:24.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:24.043+0000 7fd80b75d640 1 -- 172.21.15.193:0/3014912114 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd804108190 con 0x7fd7f00a2c30 2024-09-11T22:01:24.575 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi179 2024-09-11T22:01:24.575 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi179 to 4272M 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='osd.10 [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: osdmap e67: 11 total, 10 up, 11 in 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:01:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:24.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T22:01:24.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: osdmap e68: 11 total, 10 up, 11 in 2024-09-11T22:01:24.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:24 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:24.700 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi179 2024-09-11T22:01:24.700 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi179 to 4272M 2024-09-11T22:01:24.700 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='osd.10 [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: osdmap e67: 11 total, 10 up, 11 in 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T22:01:24.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: osdmap e68: 11 total, 10 up, 11 in 2024-09-11T22:01:24.702 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:24 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:24.796 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:01:24.320+0000 7fc895368640 -1 osd.10 0 waiting for initial osdmap 2024-09-11T22:01:24.796 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:01:24.337+0000 7fc8919a2640 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:01:24.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi179 2024-09-11T22:01:24.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi179 to 4272M 2024-09-11T22:01:24.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T22:01:24.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='osd.10 [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:01:24.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: osdmap e67: 11 total, 10 up, 11 in 2024-09-11T22:01:24.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:24.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-11T22:01:24.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:24.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:24.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:24.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:24.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:01:24.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:01:24.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:24.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-11T22:01:24.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: osdmap e68: 11 total, 10 up, 11 in 2024-09-11T22:01:24.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:24 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:25.469 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:25 smithi193 ceph-mon[35545]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:01:25.469 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:25 smithi193 ceph-mon[35545]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:25.469 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:25.469 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:25 smithi193 ceph-mon[35545]: osd.10 [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047] boot 2024-09-11T22:01:25.469 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:25 smithi193 ceph-mon[35545]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T22:01:25.469 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:25 smithi152 ceph-mon[31188]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:01:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:25 smithi152 ceph-mon[31188]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:25 smithi152 ceph-mon[31188]: osd.10 [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047] boot 2024-09-11T22:01:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:25 smithi152 ceph-mon[31188]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T22:01:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:25 smithi179 ceph-mon[35603]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:01:25.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:25 smithi179 ceph-mon[35603]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:01:25.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:25.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:25 smithi179 ceph-mon[35603]: osd.10 [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047] boot 2024-09-11T22:01:25.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:25 smithi179 ceph-mon[35603]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T22:01:25.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:01:26.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:26 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T22:01:26.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:26 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T22:01:26.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:26 smithi193 ceph-mon[35545]: osdmap e70: 11 total, 11 up, 11 in 2024-09-11T22:01:26.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:26 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T22:01:26.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:26 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T22:01:26.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:26 smithi152 ceph-mon[31188]: osdmap e70: 11 total, 11 up, 11 in 2024-09-11T22:01:26.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:26 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T22:01:26.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:26 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T22:01:26.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:26 smithi179 ceph-mon[35603]: osdmap e70: 11 total, 11 up, 11 in 2024-09-11T22:01:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:27 smithi152 ceph-mon[31188]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:27 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/423102628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98e6a47b-2ec0-43d7-aa2e-76a751b4579d"}]: dispatch 2024-09-11T22:01:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:27 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98e6a47b-2ec0-43d7-aa2e-76a751b4579d"}]: dispatch 2024-09-11T22:01:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:27 smithi152 ceph-mon[31188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98e6a47b-2ec0-43d7-aa2e-76a751b4579d"}]': finished 2024-09-11T22:01:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:27 smithi152 ceph-mon[31188]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T22:01:27.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:27.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:27 smithi152 ceph-mon[31188]: from='client.? 172.21.15.193:0/2508814638' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:01:27.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:27 smithi179 ceph-mon[35603]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:27.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:27 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/423102628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98e6a47b-2ec0-43d7-aa2e-76a751b4579d"}]: dispatch 2024-09-11T22:01:27.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:27 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98e6a47b-2ec0-43d7-aa2e-76a751b4579d"}]: dispatch 2024-09-11T22:01:27.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:27 smithi179 ceph-mon[35603]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98e6a47b-2ec0-43d7-aa2e-76a751b4579d"}]': finished 2024-09-11T22:01:27.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:27 smithi179 ceph-mon[35603]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T22:01:27.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:27.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:27 smithi179 ceph-mon[35603]: from='client.? 172.21.15.193:0/2508814638' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:01:27.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:27 smithi193 ceph-mon[35545]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:27.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:27 smithi193 ceph-mon[35545]: from='client.? 172.21.15.193:0/423102628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98e6a47b-2ec0-43d7-aa2e-76a751b4579d"}]: dispatch 2024-09-11T22:01:27.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:27 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98e6a47b-2ec0-43d7-aa2e-76a751b4579d"}]: dispatch 2024-09-11T22:01:27.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:27 smithi193 ceph-mon[35545]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98e6a47b-2ec0-43d7-aa2e-76a751b4579d"}]': finished 2024-09-11T22:01:27.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:27 smithi193 ceph-mon[35545]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T22:01:27.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:27.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:27 smithi193 ceph-mon[35545]: from='client.? 172.21.15.193:0/2508814638' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:01:28.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:28 smithi179 ceph-mon[35603]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T22:01:28.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:28 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:28 smithi179 ceph-mon[35603]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:28 smithi193 ceph-mon[35545]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T22:01:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:28 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:28 smithi193 ceph-mon[35545]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:28.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:28 smithi152 ceph-mon[31188]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T22:01:28.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:28 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:28.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:28 smithi152 ceph-mon[31188]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:29 smithi179 ceph-mon[35603]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T22:01:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:29 smithi193 ceph-mon[35545]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T22:01:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:29 smithi152 ceph-mon[31188]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T22:01:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:30.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:30 smithi179 ceph-mon[35603]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T22:01:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:30 smithi193 ceph-mon[35545]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T22:01:30.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:30 smithi152 ceph-mon[31188]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T22:01:33.461 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:33 smithi193 ceph-mon[35545]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-11T22:01:33.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:33 smithi152 ceph-mon[31188]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-11T22:01:33.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:33 smithi179 ceph-mon[35603]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-11T22:01:35.572 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:35 smithi193 ceph-mon[35545]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-11T22:01:35.572 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T22:01:35.572 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:35 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:35.715 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:35 smithi179 ceph-mon[35603]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-11T22:01:35.716 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T22:01:35.716 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:35 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:35.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:35 smithi152 ceph-mon[31188]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-11T22:01:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T22:01:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:35 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:36.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:36 smithi193 ceph-mon[35545]: Deploying daemon osd.11 on smithi193 2024-09-11T22:01:36.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:36 smithi152 ceph-mon[31188]: Deploying daemon osd.11 on smithi193 2024-09-11T22:01:36.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:36 smithi179 ceph-mon[35603]: Deploying daemon osd.11 on smithi193 2024-09-11T22:01:37.510 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:37 smithi193 ceph-mon[35545]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-11T22:01:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:37 smithi152 ceph-mon[31188]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-11T22:01:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:37 smithi179 ceph-mon[35603]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-11T22:01:39.414 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:39 smithi193 ceph-mon[35545]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:01:39.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:39 smithi152 ceph-mon[31188]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:01:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:39 smithi179 ceph-mon[35603]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:01:41.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:41 smithi152 ceph-mon[31188]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:41.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:41 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:41.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:41 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:41.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:41 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:41 smithi179 ceph-mon[35603]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:41 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:41 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:41.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:41 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:41.819 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:41 smithi193 ceph-mon[35545]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:41.819 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:41 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:41.819 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:41 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:41.819 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:41 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:43 smithi152 ceph-mon[31188]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:43.753 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:43 smithi193 ceph-mon[35545]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:43.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:43 smithi179 ceph-mon[35603]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:44.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.094+0000 7fd7fa7fc640 1 -- 172.21.15.193:0/3014912114 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd804108190 con 0x7fd7f00a2c30 2024-09-11T22:01:44.096 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 11 on host 'smithi193' 2024-09-11T22:01:44.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 -- 172.21.15.193:0/3014912114 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd7f00a2c30 msgr2=0x7fd7f00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:44.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd7f00a2c30 0x7fd7f00a50f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd800005fd0 tx=0x7fd80000b510 comp rx=0 tx=0).stop 2024-09-11T22:01:44.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 -- 172.21.15.193:0/3014912114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd804101490 msgr2=0x7fd804198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:44.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd804101490 0x7fd804198420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400d950 tx=0x7fd7f400de10 comp rx=0 tx=0).stop 2024-09-11T22:01:44.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 -- 172.21.15.193:0/3014912114 shutdown_connections 2024-09-11T22:01:44.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd804101e50 0x7fd80419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:44.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd7f00a2c30 0x7fd7f00a50f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:44.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd804101490 0x7fd804198420 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:44.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 --2- 172.21.15.193:0/3014912114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd804100290 0x7fd804197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:44.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 -- 172.21.15.193:0/3014912114 >> 172.21.15.193:0/3014912114 conn(0x7fd8040fba40 msgr2=0x7fd804106a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:44.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 -- 172.21.15.193:0/3014912114 shutdown_connections 2024-09-11T22:01:44.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:44.097+0000 7fd80b75d640 1 -- 172.21.15.193:0/3014912114 wait complete. 2024-09-11T22:01:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:44 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:44 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:44 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:44 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:44 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:44 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:44.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:44 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:44 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:44 smithi152 ceph-mon[31188]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:44.741 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:44 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.741 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:44 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.741 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:44 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:44.741 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:44 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:44.741 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:44 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.741 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:44 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:44.741 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:44 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.741 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:44 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.741 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:44 smithi193 ceph-mon[35545]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:44.768 DEBUG:teuthology.orchestra.run.smithi193:osd.11> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.11.service 2024-09-11T22:01:44.771 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-11T22:01:44.771 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T22:01:44.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:44 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:44 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:44 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:44.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:44 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:44.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:44 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:44 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:44.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:44 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:44 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:44.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:44 smithi179 ceph-mon[35603]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:45.028 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:01:45.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.524+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3656655535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0e0101cd0 msgr2=0x7fa0e0102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:45.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.524+0000 7fa0e6fbb640 1 --2- 172.21.15.152:0/3656655535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0e0101cd0 0x7fa0e0102150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009900 tx=0x7fa0cc02a410 comp rx=0 tx=0).stop 2024-09-11T22:01:45.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.524+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3656655535 shutdown_connections 2024-09-11T22:01:45.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.524+0000 7fa0e6fbb640 1 --2- 172.21.15.152:0/3656655535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0e0102690 0x7fa0e0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:45.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.524+0000 7fa0e6fbb640 1 --2- 172.21.15.152:0/3656655535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0e0101cd0 0x7fa0e0102150 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:45.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.524+0000 7fa0e6fbb640 1 --2- 172.21.15.152:0/3656655535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0e0100ad0 0x7fa0e0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:45.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.524+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3656655535 >> 172.21.15.152:0/3656655535 conn(0x7fa0e00fc280 msgr2=0x7fa0e00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:45.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.524+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3656655535 shutdown_connections 2024-09-11T22:01:45.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.524+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3656655535 wait complete. 2024-09-11T22:01:45.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.524+0000 7fa0e6fbb640 1 Processor -- start 2024-09-11T22:01:45.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.524+0000 7fa0e6fbb640 1 -- start start 2024-09-11T22:01:45.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e6fbb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0e0100ad0 0x7fa0e0196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:45.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e6fbb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0e0101cd0 0x7fa0e0197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:45.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e6fbb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0e0102690 0x7fa0e019e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:45.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e6fbb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e010c750 con 0x7fa0e0100ad0 2024-09-11T22:01:45.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e6fbb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e010c5d0 con 0x7fa0e0101cd0 2024-09-11T22:01:45.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e6fbb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e010c8d0 con 0x7fa0e0102690 2024-09-11T22:01:45.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e4d57640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0e0100ad0 0x7fa0e0196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:45.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e4d57640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0e0100ad0 0x7fa0e0196e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50990/0 (socket says 172.21.15.152:50990) 2024-09-11T22:01:45.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e4d57640 1 -- 172.21.15.152:0/3187581249 learned_addr learned my addr 172.21.15.152:0/3187581249 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:01:45.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e5558640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0e0102690 0x7fa0e019e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0dffff640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0e0101cd0 0x7fa0e0197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e4d57640 1 -- 172.21.15.152:0/3187581249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0e0102690 msgr2=0x7fa0e019e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e4d57640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0e0102690 0x7fa0e019e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e4d57640 1 -- 172.21.15.152:0/3187581249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0e0101cd0 msgr2=0x7fa0e0197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e4d57640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0e0101cd0 0x7fa0e0197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e4d57640 1 -- 172.21.15.152:0/3187581249 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e019ea50 con 0x7fa0e0100ad0 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e5558640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0e0102690 0x7fa0e019e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0e4d57640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0e0100ad0 0x7fa0e0196e20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400e9c0 tx=0x7fa0d400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.525+0000 7fa0ddffb640 1 -- 172.21.15.152:0/3187581249 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400cd80 con 0x7fa0e0100ad0 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.526+0000 7fa0ddffb640 1 -- 172.21.15.152:0/3187581249 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0d40035f0 con 0x7fa0e0100ad0 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.526+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3187581249 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e019ed40 con 0x7fa0e0100ad0 2024-09-11T22:01:45.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.526+0000 7fa0ddffb640 1 -- 172.21.15.152:0/3187581249 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4010690 con 0x7fa0e0100ad0 2024-09-11T22:01:45.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.526+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3187581249 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e019f1a0 con 0x7fa0e0100ad0 2024-09-11T22:01:45.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.527+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3187581249 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e0107ec0 con 0x7fa0e0100ad0 2024-09-11T22:01:45.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.528+0000 7fa0ddffb640 1 -- 172.21.15.152:0/3187581249 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa0d40037a0 con 0x7fa0e0100ad0 2024-09-11T22:01:45.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.528+0000 7fa0ddffb640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa0d00a2bb0 0x7fa0d00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:45.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.529+0000 7fa0dffff640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa0d00a2bb0 0x7fa0d00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:45.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.529+0000 7fa0ddffb640 1 -- 172.21.15.152:0/3187581249 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6809+0+0 (secure 0 0 0) 0x7fa0d40cef10 con 0x7fa0e0100ad0 2024-09-11T22:01:45.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.529+0000 7fa0dffff640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa0d00a2bb0 0x7fa0d00a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc000c00 tx=0x7fa0cc0315d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:45.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.533+0000 7fa0ddffb640 1 -- 172.21.15.152:0/3187581249 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa0d409c450 con 0x7fa0e0100ad0 2024-09-11T22:01:45.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.699+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3187581249 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa0e0062e90 con 0x7fa0e0100ad0 2024-09-11T22:01:45.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.700+0000 7fa0ddffb640 1 -- 172.21.15.152:0/3187581249 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7fa0d409bd50 con 0x7fa0e0100ad0 2024-09-11T22:01:45.701 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:01:45.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.702+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3187581249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa0d00a2bb0 msgr2=0x7fa0d00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:45.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.702+0000 7fa0e6fbb640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa0d00a2bb0 0x7fa0d00a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc000c00 tx=0x7fa0cc0315d0 comp rx=0 tx=0).stop 2024-09-11T22:01:45.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.702+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3187581249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0e0100ad0 msgr2=0x7fa0e0196e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:45.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.702+0000 7fa0e6fbb640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0e0100ad0 0x7fa0e0196e20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400e9c0 tx=0x7fa0d400ee80 comp rx=0 tx=0).stop 2024-09-11T22:01:45.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.703+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3187581249 shutdown_connections 2024-09-11T22:01:45.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.703+0000 7fa0e6fbb640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa0d00a2bb0 0x7fa0d00a5070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:45.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.703+0000 7fa0e6fbb640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0e0102690 0x7fa0e019e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:45.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.703+0000 7fa0e6fbb640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0e0101cd0 0x7fa0e0197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:45.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.703+0000 7fa0e6fbb640 1 --2- 172.21.15.152:0/3187581249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0e0100ad0 0x7fa0e0196e20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:45.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.703+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3187581249 >> 172.21.15.152:0/3187581249 conn(0x7fa0e00fc280 msgr2=0x7fa0e0105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:45.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.703+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3187581249 shutdown_connections 2024-09-11T22:01:45.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:45.703+0000 7fa0e6fbb640 1 -- 172.21.15.152:0/3187581249 wait complete. 2024-09-11T22:01:46.367 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:46 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3187581249' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:01:46.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:46 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3187581249' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:01:46.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:46 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3187581249' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:01:46.547 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726092085,"num_in_osds":12,"osd_in_since":1726092086,"num_remapped_pgs":0} 2024-09-11T22:01:46.950 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:01:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:01:46.623+0000 7f8d600d1640 -1 osd.11 0 log_to_monitors true 2024-09-11T22:01:47.262 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:47 smithi193 ceph-mon[35545]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:47.262 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:47 smithi193 ceph-mon[35545]: from='osd.11 [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:01:47.262 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:47 smithi193 ceph-mon[35545]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:01:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:47 smithi152 ceph-mon[31188]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:47 smithi152 ceph-mon[31188]: from='osd.11 [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:01:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:47 smithi152 ceph-mon[31188]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:01:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:47 smithi179 ceph-mon[35603]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:47 smithi179 ceph-mon[35603]: from='osd.11 [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:01:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:47 smithi179 ceph-mon[35603]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:01:47.549 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T22:01:47.817 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:01:48.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T22:01:48.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: osdmap e74: 12 total, 11 up, 12 in 2024-09-11T22:01:48.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:48.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='osd.11 [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:01:48.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:01:48.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:48.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:48.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:48.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:48.232 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:48.232 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:48 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:48.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.314+0000 7f5cc789b640 1 -- 172.21.15.152:0/116082281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc0104fd0 msgr2=0x7f5cc01073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:48.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.314+0000 7f5cc789b640 1 --2- 172.21.15.152:0/116082281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc0104fd0 0x7f5cc01073c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009900 tx=0x7f5cbc02a410 comp rx=0 tx=0).stop 2024-09-11T22:01:48.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.314+0000 7f5cc789b640 1 -- 172.21.15.152:0/116082281 shutdown_connections 2024-09-11T22:01:48.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.314+0000 7f5cc789b640 1 --2- 172.21.15.152:0/116082281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cc0107900 0x7f5cc0109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:48.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.314+0000 7f5cc789b640 1 --2- 172.21.15.152:0/116082281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc0104fd0 0x7f5cc01073c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:48.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.314+0000 7f5cc789b640 1 --2- 172.21.15.152:0/116082281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cc01026a0 0x7f5cc0104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:48.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.314+0000 7f5cc789b640 1 -- 172.21.15.152:0/116082281 >> 172.21.15.152:0/116082281 conn(0x7f5cc00fc2a0 msgr2=0x7f5cc00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:48.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.314+0000 7f5cc789b640 1 -- 172.21.15.152:0/116082281 shutdown_connections 2024-09-11T22:01:48.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.314+0000 7f5cc789b640 1 -- 172.21.15.152:0/116082281 wait complete. 2024-09-11T22:01:48.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.314+0000 7f5cc789b640 1 Processor -- start 2024-09-11T22:01:48.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.314+0000 7f5cc789b640 1 -- start start 2024-09-11T22:01:48.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc789b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cc01026a0 0x7f5cc0102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:48.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc789b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc0104fd0 0x7f5cc0100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:48.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc789b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cc0107900 0x7f5cc0100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:48.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc789b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc010d8f0 con 0x7f5cc0104fd0 2024-09-11T22:01:48.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc789b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc010d770 con 0x7f5cc01026a0 2024-09-11T22:01:48.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc789b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc010da70 con 0x7f5cc0107900 2024-09-11T22:01:48.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc4e36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc0104fd0 0x7f5cc0100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc4e36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc0104fd0 0x7f5cc0100650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51004/0 (socket says 172.21.15.152:51004) 2024-09-11T22:01:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc4e36640 1 -- 172.21.15.152:0/3822705931 learned_addr learned my addr 172.21.15.152:0/3822705931 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:01:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc5e38640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cc0107900 0x7f5cc0100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc5637640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cc01026a0 0x7f5cc0102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc4e36640 1 -- 172.21.15.152:0/3822705931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cc0107900 msgr2=0x7f5cc0100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc4e36640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cc0107900 0x7f5cc0100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc4e36640 1 -- 172.21.15.152:0/3822705931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cc01026a0 msgr2=0x7f5cc0102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc4e36640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cc01026a0 0x7f5cc0102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc4e36640 1 -- 172.21.15.152:0/3822705931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc0101450 con 0x7f5cc0104fd0 2024-09-11T22:01:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc5637640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cc01026a0 0x7f5cc0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:01:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc4e36640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc0104fd0 0x7f5cc0100650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc031610 tx=0x7f5cbc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cb67fc640 1 -- 172.21.15.152:0/3822705931 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc03f030 con 0x7f5cc0104fd0 2024-09-11T22:01:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc789b640 1 -- 172.21.15.152:0/3822705931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc01a20d0 con 0x7f5cc0104fd0 2024-09-11T22:01:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cb67fc640 1 -- 172.21.15.152:0/3822705931 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cbc003ce0 con 0x7f5cc0104fd0 2024-09-11T22:01:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cb67fc640 1 -- 172.21.15.152:0/3822705931 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc035070 con 0x7f5cc0104fd0 2024-09-11T22:01:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.315+0000 7f5cc789b640 1 -- 172.21.15.152:0/3822705931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc01a2580 con 0x7f5cc0104fd0 2024-09-11T22:01:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.317+0000 7f5cc789b640 1 -- 172.21.15.152:0/3822705931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc00fdd90 con 0x7f5cc0104fd0 2024-09-11T22:01:48.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.318+0000 7f5cb67fc640 1 -- 172.21.15.152:0/3822705931 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5cbc042030 con 0x7f5cc0104fd0 2024-09-11T22:01:48.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.318+0000 7f5cb67fc640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5cac0a2b80 0x7f5cac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:48.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.319+0000 7f5cc5637640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5cac0a2b80 0x7f5cac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:48.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.319+0000 7f5cb67fc640 1 -- 172.21.15.152:0/3822705931 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6847+0+0 (secure 0 0 0) 0x7f5cbc0ef0c0 con 0x7f5cc0104fd0 2024-09-11T22:01:48.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.319+0000 7f5cc5637640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5cac0a2b80 0x7f5cac0a5040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0005d00 tx=0x7f5cb0005ed0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.323+0000 7f5cb67fc640 1 -- 172.21.15.152:0/3822705931 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5cbc0bc540 con 0x7f5cc0104fd0 2024-09-11T22:01:48.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.488+0000 7f5cc789b640 1 -- 172.21.15.152:0/3822705931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5cc0062df0 con 0x7f5cc0104fd0 2024-09-11T22:01:48.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.489+0000 7f5cb67fc640 1 -- 172.21.15.152:0/3822705931 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f5cbc0bbe40 con 0x7f5cc0104fd0 2024-09-11T22:01:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:01:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 -- 172.21.15.152:0/3822705931 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5cac0a2b80 msgr2=0x7f5cac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5cac0a2b80 0x7f5cac0a5040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0005d00 tx=0x7f5cb0005ed0 comp rx=0 tx=0).stop 2024-09-11T22:01:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 -- 172.21.15.152:0/3822705931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc0104fd0 msgr2=0x7f5cc0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc0104fd0 0x7f5cc0100650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc031610 tx=0x7f5cbc0043b0 comp rx=0 tx=0).stop 2024-09-11T22:01:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 -- 172.21.15.152:0/3822705931 shutdown_connections 2024-09-11T22:01:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5cac0a2b80 0x7f5cac0a5040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cc0107900 0x7f5cc0100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc0104fd0 0x7f5cc0100650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 --2- 172.21.15.152:0/3822705931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cc01026a0 0x7f5cc0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 -- 172.21.15.152:0/3822705931 >> 172.21.15.152:0/3822705931 conn(0x7f5cc00fc2a0 msgr2=0x7f5cc0102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 -- 172.21.15.152:0/3822705931 shutdown_connections 2024-09-11T22:01:48.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:48.491+0000 7f5cc789b640 1 -- 172.21.15.152:0/3822705931 wait complete. 2024-09-11T22:01:48.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: osdmap e74: 12 total, 11 up, 12 in 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='osd.11 [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:48.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:48.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:48.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:48 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:48.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T22:01:48.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: osdmap e74: 12 total, 11 up, 12 in 2024-09-11T22:01:48.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='osd.11 [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:48.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:49.192 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1726092085,"num_in_osds":12,"osd_in_since":1726092086,"num_remapped_pgs":0} 2024-09-11T22:01:49.326 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:01:48.894+0000 7f8d5c868640 -1 osd.11 0 waiting for initial osdmap 2024-09-11T22:01:49.326 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:01:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:01:48.908+0000 7f8d53e63640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:01:49.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:49 smithi193 ceph-mon[35545]: Detected new or changed devices on smithi193 2024-09-11T22:01:49.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:49 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi193 to 4272M 2024-09-11T22:01:49.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:49 smithi193 ceph-mon[35545]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T22:01:49.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:49 smithi193 ceph-mon[35545]: osdmap e75: 12 total, 11 up, 12 in 2024-09-11T22:01:49.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:49 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:49.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:49 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:49.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:49 smithi193 ceph-mon[35545]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:49.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:49 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3822705931' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:01:49.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:49 smithi193 ceph-mon[35545]: from='osd.11 ' entity='osd.11' 2024-09-11T22:01:49.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:49 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:49.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:49 smithi152 ceph-mon[31188]: Detected new or changed devices on smithi193 2024-09-11T22:01:49.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:49 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi193 to 4272M 2024-09-11T22:01:49.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:49 smithi152 ceph-mon[31188]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T22:01:49.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:49 smithi152 ceph-mon[31188]: osdmap e75: 12 total, 11 up, 12 in 2024-09-11T22:01:49.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:49 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:49.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:49 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:49.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:49 smithi152 ceph-mon[31188]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:49.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:49 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3822705931' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:01:49.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:49 smithi152 ceph-mon[31188]: from='osd.11 ' entity='osd.11' 2024-09-11T22:01:49.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:49 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:49.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:49 smithi179 ceph-mon[35603]: Detected new or changed devices on smithi193 2024-09-11T22:01:49.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:49 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi193 to 4272M 2024-09-11T22:01:49.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:49 smithi179 ceph-mon[35603]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-11T22:01:49.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:49 smithi179 ceph-mon[35603]: osdmap e75: 12 total, 11 up, 12 in 2024-09-11T22:01:49.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:49 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:49.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:49 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:49.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:49 smithi179 ceph-mon[35603]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:01:49.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:49 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3822705931' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:01:49.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:49 smithi179 ceph-mon[35603]: from='osd.11 ' entity='osd.11' 2024-09-11T22:01:49.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:49 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:50.194 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T22:01:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:01:50.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:50 smithi152 ceph-mon[31188]: purged_snaps scrub starts 2024-09-11T22:01:50.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:50 smithi152 ceph-mon[31188]: purged_snaps scrub ok 2024-09-11T22:01:50.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:50 smithi152 ceph-mon[31188]: osd.11 [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791] boot 2024-09-11T22:01:50.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:50 smithi152 ceph-mon[31188]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T22:01:50.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:50 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:50.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:50 smithi179 ceph-mon[35603]: purged_snaps scrub starts 2024-09-11T22:01:50.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:50 smithi179 ceph-mon[35603]: purged_snaps scrub ok 2024-09-11T22:01:50.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:50 smithi179 ceph-mon[35603]: osd.11 [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791] boot 2024-09-11T22:01:50.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:50 smithi179 ceph-mon[35603]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T22:01:50.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:50 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:50.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:50 smithi193 ceph-mon[35545]: purged_snaps scrub starts 2024-09-11T22:01:50.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:50 smithi193 ceph-mon[35545]: purged_snaps scrub ok 2024-09-11T22:01:50.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:50 smithi193 ceph-mon[35545]: osd.11 [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791] boot 2024-09-11T22:01:50.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:50 smithi193 ceph-mon[35545]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T22:01:50.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:50 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:01:50.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.828+0000 7fd15eede640 1 -- 172.21.15.152:0/241997841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd158101cd0 msgr2=0x7fd158102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:50.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.828+0000 7fd15eede640 1 --2- 172.21.15.152:0/241997841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd158101cd0 0x7fd158102150 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd148009900 tx=0x7fd14802a410 comp rx=0 tx=0).stop 2024-09-11T22:01:50.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.828+0000 7fd15eede640 1 -- 172.21.15.152:0/241997841 shutdown_connections 2024-09-11T22:01:50.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.828+0000 7fd15eede640 1 --2- 172.21.15.152:0/241997841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd158102690 0x7fd158108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:50.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.828+0000 7fd15eede640 1 --2- 172.21.15.152:0/241997841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd158101cd0 0x7fd158102150 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:50.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.828+0000 7fd15eede640 1 --2- 172.21.15.152:0/241997841 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd158100ad0 0x7fd158100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:50.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.828+0000 7fd15eede640 1 -- 172.21.15.152:0/241997841 >> 172.21.15.152:0/241997841 conn(0x7fd1580fc280 msgr2=0x7fd1580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:50.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.828+0000 7fd15eede640 1 -- 172.21.15.152:0/241997841 shutdown_connections 2024-09-11T22:01:50.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.828+0000 7fd15eede640 1 -- 172.21.15.152:0/241997841 wait complete. 2024-09-11T22:01:50.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.828+0000 7fd15eede640 1 Processor -- start 2024-09-11T22:01:50.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15eede640 1 -- start start 2024-09-11T22:01:50.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15eede640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd158100ad0 0x7fd158195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:50.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15eede640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd158101cd0 0x7fd158196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15eede640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd158102690 0x7fd15819d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15eede640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd15810c750 con 0x7fd158102690 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15eede640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd15810c5d0 con 0x7fd158101cd0 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15eede640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd15810c8d0 con 0x7fd158100ad0 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15d47b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd158102690 0x7fd15819d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15d47b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd158102690 0x7fd15819d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51012/0 (socket says 172.21.15.152:51012) 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15d47b640 1 -- 172.21.15.152:0/2235171658 learned_addr learned my addr 172.21.15.152:0/2235171658 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15cc7a640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd158100ad0 0x7fd158195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd14ffff640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd158101cd0 0x7fd158196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15d47b640 1 -- 172.21.15.152:0/2235171658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd158100ad0 msgr2=0x7fd158195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15d47b640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd158100ad0 0x7fd158195d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:50.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15d47b640 1 -- 172.21.15.152:0/2235171658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd158101cd0 msgr2=0x7fd158196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:50.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15d47b640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd158101cd0 0x7fd158196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:50.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15d47b640 1 -- 172.21.15.152:0/2235171658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15819d970 con 0x7fd158102690 2024-09-11T22:01:50.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd15d47b640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd158102690 0x7fd15819d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd15000eaa0 tx=0x7fd15000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:50.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.829+0000 7fd14dffb640 1 -- 172.21.15.152:0/2235171658 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15000cdb0 con 0x7fd158102690 2024-09-11T22:01:50.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.830+0000 7fd15eede640 1 -- 172.21.15.152:0/2235171658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15819dc60 con 0x7fd158102690 2024-09-11T22:01:50.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.830+0000 7fd14dffb640 1 -- 172.21.15.152:0/2235171658 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd150005020 con 0x7fd158102690 2024-09-11T22:01:50.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.830+0000 7fd14dffb640 1 -- 172.21.15.152:0/2235171658 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1500116b0 con 0x7fd158102690 2024-09-11T22:01:50.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.830+0000 7fd15eede640 1 -- 172.21.15.152:0/2235171658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd15819e120 con 0x7fd158102690 2024-09-11T22:01:50.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.831+0000 7fd15eede640 1 -- 172.21.15.152:0/2235171658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd15819e3e0 con 0x7fd158102690 2024-09-11T22:01:50.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.832+0000 7fd14dffb640 1 -- 172.21.15.152:0/2235171658 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd150005560 con 0x7fd158102690 2024-09-11T22:01:50.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.832+0000 7fd14dffb640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1400a2bb0 0x7fd1400a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:50.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.832+0000 7fd15cc7a640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1400a2bb0 0x7fd1400a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:50.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.833+0000 7fd14dffb640 1 -- 172.21.15.152:0/2235171658 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd1500cee70 con 0x7fd158102690 2024-09-11T22:01:50.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.833+0000 7fd15cc7a640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1400a2bb0 0x7fd1400a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd158101b30 tx=0x7fd154005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:50.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:50.837+0000 7fd14dffb640 1 -- 172.21.15.152:0/2235171658 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd150016030 con 0x7fd158102690 2024-09-11T22:01:51.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.002+0000 7fd15eede640 1 -- 172.21.15.152:0/2235171658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd1581afb60 con 0x7fd158102690 2024-09-11T22:01:51.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.003+0000 7fd14dffb640 1 -- 172.21.15.152:0/2235171658 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7fd15009c1d0 con 0x7fd158102690 2024-09-11T22:01:51.004 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:01:51.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 -- 172.21.15.152:0/2235171658 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1400a2bb0 msgr2=0x7fd1400a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:51.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1400a2bb0 0x7fd1400a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd158101b30 tx=0x7fd154005f90 comp rx=0 tx=0).stop 2024-09-11T22:01:51.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 -- 172.21.15.152:0/2235171658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd158102690 msgr2=0x7fd15819d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:51.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd158102690 0x7fd15819d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd15000eaa0 tx=0x7fd15000ef60 comp rx=0 tx=0).stop 2024-09-11T22:01:51.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 -- 172.21.15.152:0/2235171658 shutdown_connections 2024-09-11T22:01:51.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd158102690 0x7fd15819d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:51.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd158101cd0 0x7fd158196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:51.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1400a2bb0 0x7fd1400a5070 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:51.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 --2- 172.21.15.152:0/2235171658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd158100ad0 0x7fd158195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:51.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 -- 172.21.15.152:0/2235171658 >> 172.21.15.152:0/2235171658 conn(0x7fd1580fc280 msgr2=0x7fd15806a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:51.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 -- 172.21.15.152:0/2235171658 shutdown_connections 2024-09-11T22:01:51.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:51.005+0000 7fd15eede640 1 -- 172.21.15.152:0/2235171658 wait complete. 2024-09-11T22:01:51.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:51 smithi152 ceph-mon[31188]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:51.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:51 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2235171658' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:01:51.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:51 smithi179 ceph-mon[35603]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:51.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:51 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2235171658' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:01:51.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:51 smithi193 ceph-mon[35545]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:51.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:51 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2235171658' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:01:51.732 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726092109,"num_in_osds":12,"osd_in_since":1726092086,"num_remapped_pgs":0} 2024-09-11T22:01:51.732 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:01:51.976 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:01:52.421 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:52 smithi152 ceph-mon[31188]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T22:01:52.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.420+0000 7f9031c9a640 1 -- 172.21.15.152:0/1417928241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f902c106f50 msgr2=0x7f902c10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.420+0000 7f9031c9a640 1 --2- 172.21.15.152:0/1417928241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f902c106f50 0x7f902c10eaf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9024009930 tx=0x7f902402a420 comp rx=0 tx=0).stop 2024-09-11T22:01:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.420+0000 7f9031c9a640 1 -- 172.21.15.152:0/1417928241 shutdown_connections 2024-09-11T22:01:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.420+0000 7f9031c9a640 1 --2- 172.21.15.152:0/1417928241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f902c106f50 0x7f902c10eaf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.420+0000 7f9031c9a640 1 --2- 172.21.15.152:0/1417928241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c100d00 0x7f902c106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.420+0000 7f9031c9a640 1 --2- 172.21.15.152:0/1417928241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c100350 0x7f902c100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.420+0000 7f9031c9a640 1 -- 172.21.15.152:0/1417928241 >> 172.21.15.152:0/1417928241 conn(0x7f902c077210 msgr2=0x7f902c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.420+0000 7f9031c9a640 1 -- 172.21.15.152:0/1417928241 shutdown_connections 2024-09-11T22:01:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.420+0000 7f9031c9a640 1 -- 172.21.15.152:0/1417928241 wait complete. 2024-09-11T22:01:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.420+0000 7f9031c9a640 1 Processor -- start 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f9031c9a640 1 -- start start 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f9031c9a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c100350 0x7f902c1012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f9031c9a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c100d00 0x7f902c101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f9031c9a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f902c106f50 0x7f902c101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f9031c9a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f902c111fa0 con 0x7f902c106f50 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f9031c9a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f902c111e20 con 0x7f902c100350 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f9031c9a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f902c112120 con 0x7f902c100d00 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f902bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f902c106f50 0x7f902c101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f902bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f902c106f50 0x7f902c101d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51026/0 (socket says 172.21.15.152:51026) 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f902bfff640 1 -- 172.21.15.152:0/120606745 learned_addr learned my addr 172.21.15.152:0/120606745 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f902affd640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c100d00 0x7f902c101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f902b7fe640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c100350 0x7f902c1012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f902bfff640 1 -- 172.21.15.152:0/120606745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c100d00 msgr2=0x7f902c101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f902bfff640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c100d00 0x7f902c101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f902bfff640 1 -- 172.21.15.152:0/120606745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c100350 msgr2=0x7f902c1012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f902bfff640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c100350 0x7f902c1012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f902bfff640 1 -- 172.21.15.152:0/120606745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c1a6920 con 0x7f902c106f50 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.421+0000 7f902bfff640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f902c106f50 0x7f902c101d50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9024005ab0 tx=0x7f90240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.422+0000 7f9028ff9640 1 -- 172.21.15.152:0/120606745 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902403f030 con 0x7f902c106f50 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.422+0000 7f9028ff9640 1 -- 172.21.15.152:0/120606745 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9024003ce0 con 0x7f902c106f50 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.422+0000 7f9031c9a640 1 -- 172.21.15.152:0/120606745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902c1a6bb0 con 0x7f902c106f50 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.422+0000 7f9028ff9640 1 -- 172.21.15.152:0/120606745 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024035070 con 0x7f902c106f50 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.422+0000 7f9031c9a640 1 -- 172.21.15.152:0/120606745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902c1a70e0 con 0x7f902c106f50 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.423+0000 7f9031c9a640 1 -- 172.21.15.152:0/120606745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f902c100730 con 0x7f902c106f50 2024-09-11T22:01:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.424+0000 7f9028ff9640 1 -- 172.21.15.152:0/120606745 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f9024042030 con 0x7f902c106f50 2024-09-11T22:01:52.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.424+0000 7f9028ff9640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90140a2c00 0x7f90140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:52.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.425+0000 7f902b7fe640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90140a2c00 0x7f90140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:52.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.425+0000 7f9028ff9640 1 -- 172.21.15.152:0/120606745 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f90240ef430 con 0x7f902c106f50 2024-09-11T22:01:52.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.425+0000 7f902b7fe640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90140a2c00 0x7f90140a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f901c005c40 tx=0x7f901c00a780 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:52.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.428+0000 7f9028ff9640 1 -- 172.21.15.152:0/120606745 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90240bc830 con 0x7f902c106f50 2024-09-11T22:01:52.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:52 smithi179 ceph-mon[35603]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T22:01:52.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:52 smithi193 ceph-mon[35545]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T22:01:52.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.598+0000 7f9031c9a640 1 -- 172.21.15.152:0/120606745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f902c102800 con 0x7f902c106f50 2024-09-11T22:01:52.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.599+0000 7f9028ff9640 1 -- 172.21.15.152:0/120606745 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18539 (secure 0 0 0) 0x7f902c102800 con 0x7f902c106f50 2024-09-11T22:01:52.599 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:01:52.600 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":77,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:01:51.120067+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:01:52.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 -- 172.21.15.152:0/120606745 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90140a2c00 msgr2=0x7f90140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:52.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90140a2c00 0x7f90140a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f901c005c40 tx=0x7f901c00a780 comp rx=0 tx=0).stop 2024-09-11T22:01:52.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 -- 172.21.15.152:0/120606745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f902c106f50 msgr2=0x7f902c101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:52.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f902c106f50 0x7f902c101d50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9024005ab0 tx=0x7f90240042f0 comp rx=0 tx=0).stop 2024-09-11T22:01:52.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 -- 172.21.15.152:0/120606745 shutdown_connections 2024-09-11T22:01:52.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f902c106f50 0x7f902c101d50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:52.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f90140a2c00 0x7f90140a50c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:52.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c100d00 0x7f902c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:52.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 --2- 172.21.15.152:0/120606745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c100350 0x7f902c1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:52.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 -- 172.21.15.152:0/120606745 >> 172.21.15.152:0/120606745 conn(0x7f902c077210 msgr2=0x7f902c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:52.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 -- 172.21.15.152:0/120606745 shutdown_connections 2024-09-11T22:01:52.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:52.601+0000 7f9031c9a640 1 -- 172.21.15.152:0/120606745 wait complete. 2024-09-11T22:01:53.334 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T21:58:10.500177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:01:53.334 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-11T22:01:53.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:53 smithi152 ceph-mon[31188]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:53.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:53 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/120606745' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:01:53.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:53 smithi179 ceph-mon[35603]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:53.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:53 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/120606745' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:01:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:53 smithi193 ceph-mon[35545]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:53 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/120606745' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:01:53.577 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:01:54.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.013+0000 7f504c283640 1 -- 172.21.15.152:0/3618225861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5044101de0 msgr2=0x7f50441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:54.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.013+0000 7f504c283640 1 --2- 172.21.15.152:0/3618225861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5044101de0 0x7f50441021c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5034009900 tx=0x7f503402a410 comp rx=0 tx=0).stop 2024-09-11T22:01:54.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.013+0000 7f504c283640 1 -- 172.21.15.152:0/3618225861 shutdown_connections 2024-09-11T22:01:54.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.013+0000 7f504c283640 1 --2- 172.21.15.152:0/3618225861 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5044106f10 0x7f504410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:54.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.013+0000 7f504c283640 1 --2- 172.21.15.152:0/3618225861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5044102790 0x7f50441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:54.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.013+0000 7f504c283640 1 --2- 172.21.15.152:0/3618225861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5044101de0 0x7f50441021c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:54.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.013+0000 7f504c283640 1 -- 172.21.15.152:0/3618225861 >> 172.21.15.152:0/3618225861 conn(0x7f50440fd8c0 msgr2=0x7f50440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:54.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.013+0000 7f504c283640 1 -- 172.21.15.152:0/3618225861 shutdown_connections 2024-09-11T22:01:54.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.013+0000 7f504c283640 1 -- 172.21.15.152:0/3618225861 wait complete. 2024-09-11T22:01:54.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504c283640 1 Processor -- start 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504c283640 1 -- start start 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504c283640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5044101de0 0x7f5044198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504c283640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5044102790 0x7f5044198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504c283640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5044106f10 0x7f504419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504c283640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5044111f30 con 0x7f5044101de0 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504c283640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5044111db0 con 0x7f5044102790 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504c283640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f50441120b0 con 0x7f5044106f10 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504a01f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5044101de0 0x7f5044198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504a01f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5044101de0 0x7f5044198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34938/0 (socket says 172.21.15.152:34938) 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504a01f640 1 -- 172.21.15.152:0/2547064337 learned_addr learned my addr 172.21.15.152:0/2547064337 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.014+0000 7f504a820640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5044106f10 0x7f504419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:54.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.015+0000 7f504a01f640 1 -- 172.21.15.152:0/2547064337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5044106f10 msgr2=0x7f504419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.015+0000 7f504a01f640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5044106f10 0x7f504419ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.015+0000 7f504a01f640 1 -- 172.21.15.152:0/2547064337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5044102790 msgr2=0x7f5044198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.015+0000 7f504a01f640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5044102790 0x7f5044198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.015+0000 7f504a01f640 1 -- 172.21.15.152:0/2547064337 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504419d3b0 con 0x7f5044101de0 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.015+0000 7f504a01f640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5044101de0 0x7f5044198400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5034005ab0 tx=0x7f50340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.015+0000 7f503b7fe640 1 -- 172.21.15.152:0/2547064337 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503403f030 con 0x7f5044101de0 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.015+0000 7f503b7fe640 1 -- 172.21.15.152:0/2547064337 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5034003ce0 con 0x7f5044101de0 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.015+0000 7f504c283640 1 -- 172.21.15.152:0/2547064337 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f504419d640 con 0x7f5044101de0 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.015+0000 7f503b7fe640 1 -- 172.21.15.152:0/2547064337 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5034035070 con 0x7f5044101de0 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.015+0000 7f504c283640 1 -- 172.21.15.152:0/2547064337 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50441a4f80 con 0x7f5044101de0 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.016+0000 7f504c283640 1 -- 172.21.15.152:0/2547064337 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50441021c0 con 0x7f5044101de0 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.017+0000 7f503b7fe640 1 -- 172.21.15.152:0/2547064337 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5034042030 con 0x7f5044101de0 2024-09-11T22:01:54.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.018+0000 7f503b7fe640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f50300a2c00 0x7f50300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:54.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.018+0000 7f504981e640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f50300a2c00 0x7f50300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:54.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.018+0000 7f503b7fe640 1 -- 172.21.15.152:0/2547064337 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f50340ef0f0 con 0x7f5044101de0 2024-09-11T22:01:54.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.018+0000 7f504981e640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f50300a2c00 0x7f50300a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50440fdce0 tx=0x7f5040005bf0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:54.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.022+0000 7f503b7fe640 1 -- 172.21.15.152:0/2547064337 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50340bc4f0 con 0x7f5044101de0 2024-09-11T22:01:54.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.186+0000 7f504c283640 1 -- 172.21.15.152:0/2547064337 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f504410a0f0 con 0x7f5044101de0 2024-09-11T22:01:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.186+0000 7f503b7fe640 1 -- 172.21.15.152:0/2547064337 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f50340bbdf0 con 0x7f5044101de0 2024-09-11T22:01:54.187 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-09-11T22:01:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 -- 172.21.15.152:0/2547064337 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f50300a2c00 msgr2=0x7f50300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f50300a2c00 0x7f50300a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50440fdce0 tx=0x7f5040005bf0 comp rx=0 tx=0).stop 2024-09-11T22:01:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 -- 172.21.15.152:0/2547064337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5044101de0 msgr2=0x7f5044198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5044101de0 0x7f5044198400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5034005ab0 tx=0x7f50340042f0 comp rx=0 tx=0).stop 2024-09-11T22:01:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 -- 172.21.15.152:0/2547064337 shutdown_connections 2024-09-11T22:01:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f50300a2c00 0x7f50300a50c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:54.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5044106f10 0x7f504419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:54.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5044102790 0x7f5044198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:54.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 --2- 172.21.15.152:0/2547064337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5044101de0 0x7f5044198400 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:54.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 -- 172.21.15.152:0/2547064337 >> 172.21.15.152:0/2547064337 conn(0x7f50440fd8c0 msgr2=0x7f50440fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:54.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 -- 172.21.15.152:0/2547064337 shutdown_connections 2024-09-11T22:01:54.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:54.188+0000 7f504c283640 1 -- 172.21.15.152:0/2547064337 wait complete. 2024-09-11T22:01:54.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:54 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2547064337' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:01:54.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:54 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2547064337' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:01:54.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:54 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2547064337' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:01:54.840 INFO:tasks.cephadm:Adding mds.a on smithi152 2024-09-11T22:01:54.840 INFO:tasks.cephadm:Adding mds.d on smithi152 2024-09-11T22:01:54.840 INFO:tasks.cephadm:Adding mds.g on smithi152 2024-09-11T22:01:54.840 INFO:tasks.cephadm:Adding mds.j on smithi152 2024-09-11T22:01:54.841 INFO:tasks.cephadm:Adding mds.b on smithi179 2024-09-11T22:01:54.841 INFO:tasks.cephadm:Adding mds.e on smithi179 2024-09-11T22:01:54.841 INFO:tasks.cephadm:Adding mds.h on smithi179 2024-09-11T22:01:54.841 INFO:tasks.cephadm:Adding mds.k on smithi179 2024-09-11T22:01:54.841 INFO:tasks.cephadm:Adding mds.c on smithi193 2024-09-11T22:01:54.841 INFO:tasks.cephadm:Adding mds.f on smithi193 2024-09-11T22:01:54.841 INFO:tasks.cephadm:Adding mds.i on smithi193 2024-09-11T22:01:54.841 INFO:tasks.cephadm:Adding mds.l on smithi193 2024-09-11T22:01:54.841 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi152=a;smithi152=d;smithi152=g;smithi152=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l' 2024-09-11T22:01:55.098 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:01:55.532 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:55 smithi193 ceph-mon[35545]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:55.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.539+0000 7f63ebad9640 1 -- 172.21.15.193:0/887273161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e4100b00 msgr2=0x7f63e4100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:55.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.539+0000 7f63ebad9640 1 --2- 172.21.15.193:0/887273161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e4100b00 0x7f63e4100f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009900 tx=0x7f63e002a410 comp rx=0 tx=0).stop 2024-09-11T22:01:55.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.539+0000 7f63ebad9640 1 -- 172.21.15.193:0/887273161 shutdown_connections 2024-09-11T22:01:55.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.539+0000 7f63ebad9640 1 --2- 172.21.15.193:0/887273161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e41026c0 0x7f63e4108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:55.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.539+0000 7f63ebad9640 1 --2- 172.21.15.193:0/887273161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e4101d00 0x7f63e4102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.539+0000 7f63ebad9640 1 --2- 172.21.15.193:0/887273161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e4100b00 0x7f63e4100f00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.539+0000 7f63ebad9640 1 -- 172.21.15.193:0/887273161 >> 172.21.15.193:0/887273161 conn(0x7f63e40fc270 msgr2=0x7f63e40fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.539+0000 7f63ebad9640 1 -- 172.21.15.193:0/887273161 shutdown_connections 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.539+0000 7f63ebad9640 1 -- 172.21.15.193:0/887273161 wait complete. 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63ebad9640 1 Processor -- start 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63ebad9640 1 -- start start 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63ebad9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e4100b00 0x7f63e406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63ebad9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e4101d00 0x7f63e419f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63ebad9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e41026c0 0x7f63e41a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63ebad9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f63e410c780 con 0x7f63e4100b00 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63ebad9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f63e410c600 con 0x7f63e4101d00 2024-09-11T22:01:55.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63ebad9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f63e410c900 con 0x7f63e41026c0 2024-09-11T22:01:55.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63ea076640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e41026c0 0x7f63e41a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:55.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63ea076640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e41026c0 0x7f63e41a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:45792/0 (socket says 172.21.15.193:45792) 2024-09-11T22:01:55.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63ea076640 1 -- 172.21.15.193:0/1867325950 learned_addr learned my addr 172.21.15.193:0/1867325950 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-11T22:01:55.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63e9074640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e4101d00 0x7f63e419f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:55.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.540+0000 7f63e9875640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e4100b00 0x7f63e406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:55.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.541+0000 7f63ea076640 1 -- 172.21.15.193:0/1867325950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e4101d00 msgr2=0x7f63e419f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:55.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.541+0000 7f63ea076640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e4101d00 0x7f63e419f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:55.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.541+0000 7f63ea076640 1 -- 172.21.15.193:0/1867325950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e4100b00 msgr2=0x7f63e406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:55.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.541+0000 7f63ea076640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e4100b00 0x7f63e406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:55.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.541+0000 7f63ea076640 1 -- 172.21.15.193:0/1867325950 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e41a1e60 con 0x7f63e41026c0 2024-09-11T22:01:55.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.541+0000 7f63ea076640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e41026c0 0x7f63e41a1670 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00eaa0 tx=0x7f63dc00ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:55.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.541+0000 7f63daffd640 1 -- 172.21.15.193:0/1867325950 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00cdb0 con 0x7f63e41026c0 2024-09-11T22:01:55.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.541+0000 7f63daffd640 1 -- 172.21.15.193:0/1867325950 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63dc005020 con 0x7f63e41026c0 2024-09-11T22:01:55.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.541+0000 7f63ebad9640 1 -- 172.21.15.193:0/1867325950 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e41a20f0 con 0x7f63e41026c0 2024-09-11T22:01:55.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.541+0000 7f63daffd640 1 -- 172.21.15.193:0/1867325950 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0116b0 con 0x7f63e41026c0 2024-09-11T22:01:55.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.541+0000 7f63ebad9640 1 -- 172.21.15.193:0/1867325950 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e41a25e0 con 0x7f63e41026c0 2024-09-11T22:01:55.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.542+0000 7f63ebad9640 1 -- 172.21.15.193:0/1867325950 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e4107ff0 con 0x7f63e41026c0 2024-09-11T22:01:55.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.543+0000 7f63daffd640 1 -- 172.21.15.193:0/1867325950 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f63dc005560 con 0x7f63e41026c0 2024-09-11T22:01:55.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.544+0000 7f63daffd640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f63d00a2bb0 0x7f63d00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:55.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.544+0000 7f63daffd640 1 -- 172.21.15.193:0/1867325950 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f63dc0ced20 con 0x7f63e41026c0 2024-09-11T22:01:55.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.544+0000 7f63e9875640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f63d00a2bb0 0x7f63d00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:55.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.545+0000 7f63e9875640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f63d00a2bb0 0x7f63d00a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009230 tx=0x7f63e00315b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:55.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:55 smithi179 ceph-mon[35603]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:55.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.548+0000 7f63daffd640 1 -- 172.21.15.193:0/1867325950 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63dc016030 con 0x7f63e41026c0 2024-09-11T22:01:55.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.723+0000 7f63ebad9640 1 -- 172.21.15.193:0/1867325950 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi152=a;smithi152=d;smithi152=g;smithi152=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}) -- 0x7f63e40627f0 con 0x7f63d00a2bb0 2024-09-11T22:01:55.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:55 smithi152 ceph-mon[31188]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:55.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.733+0000 7f63daffd640 1 -- 172.21.15.193:0/1867325950 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f63e40627f0 con 0x7f63d00a2bb0 2024-09-11T22:01:55.734 INFO:teuthology.orchestra.run.smithi193.stdout:Scheduled mds.all update... 2024-09-11T22:01:55.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 -- 172.21.15.193:0/1867325950 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f63d00a2bb0 msgr2=0x7f63d00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:55.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f63d00a2bb0 0x7f63d00a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009230 tx=0x7f63e00315b0 comp rx=0 tx=0).stop 2024-09-11T22:01:55.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 -- 172.21.15.193:0/1867325950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e41026c0 msgr2=0x7f63e41a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:55.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e41026c0 0x7f63e41a1670 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00eaa0 tx=0x7f63dc00ef60 comp rx=0 tx=0).stop 2024-09-11T22:01:55.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 -- 172.21.15.193:0/1867325950 shutdown_connections 2024-09-11T22:01:55.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f63d00a2bb0 0x7f63d00a5070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:55.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e41026c0 0x7f63e41a1670 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:55.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e4101d00 0x7f63e419f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:55.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 --2- 172.21.15.193:0/1867325950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e4100b00 0x7f63e406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:55.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 -- 172.21.15.193:0/1867325950 >> 172.21.15.193:0/1867325950 conn(0x7f63e40fc270 msgr2=0x7f63e41051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:55.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 -- 172.21.15.193:0/1867325950 shutdown_connections 2024-09-11T22:01:55.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-11T22:01:55.735+0000 7f63ebad9640 1 -- 172.21.15.193:0/1867325950 wait complete. 2024-09-11T22:01:56.492 DEBUG:teuthology.orchestra.run.smithi152:mds.a> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.a.service 2024-09-11T22:01:56.495 DEBUG:teuthology.orchestra.run.smithi152:mds.d> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.d.service 2024-09-11T22:01:56.538 DEBUG:teuthology.orchestra.run.smithi152:mds.g> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.g.service 2024-09-11T22:01:56.582 DEBUG:teuthology.orchestra.run.smithi152:mds.j> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.j.service 2024-09-11T22:01:56.624 DEBUG:teuthology.orchestra.run.smithi179:mds.b> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.b.service 2024-09-11T22:01:56.627 DEBUG:teuthology.orchestra.run.smithi179:mds.e> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.e.service 2024-09-11T22:01:56.671 DEBUG:teuthology.orchestra.run.smithi179:mds.h> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.h.service 2024-09-11T22:01:56.713 DEBUG:teuthology.orchestra.run.smithi179:mds.k> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.k.service 2024-09-11T22:01:56.756 DEBUG:teuthology.orchestra.run.smithi193:mds.c> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.c.service 2024-09-11T22:01:56.759 DEBUG:teuthology.orchestra.run.smithi193:mds.f> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.f.service 2024-09-11T22:01:56.804 DEBUG:teuthology.orchestra.run.smithi193:mds.i> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.i.service 2024-09-11T22:01:56.846 DEBUG:teuthology.orchestra.run.smithi193:mds.l> sudo journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.l.service 2024-09-11T22:01:56.889 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-11T22:01:56.890 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:01:56.914 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi152=a;smithi152=d;smithi152=g;smithi152=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:01:56.914 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: Saving service mds.all spec with placement smithi152=a;smithi152=d;smithi152=g;smithi152=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-11T22:01:56.914 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:56.914 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:56.914 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:56.914 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:56.914 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:56.914 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:01:56.915 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:01:56.915 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:56.915 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: Deploying daemon mds.l on smithi193 2024-09-11T22:01:56.915 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:56 smithi152 ceph-mon[31188]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:57.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi152=a;smithi152=d;smithi152=g;smithi152=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:01:57.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: Saving service mds.all spec with placement smithi152=a;smithi152=d;smithi152=g;smithi152=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-11T22:01:57.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:57.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:57.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:57.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:57.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:57.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:01:57.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:01:57.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:57.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: Deploying daemon mds.l on smithi193 2024-09-11T22:01:57.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:56 smithi193 ceph-mon[35545]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:57.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi152=a;smithi152=d;smithi152=g;smithi152=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:01:57.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: Saving service mds.all spec with placement smithi152=a;smithi152=d;smithi152=g;smithi152=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-11T22:01:57.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:57.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:01:57.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:57.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:01:57.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:57.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:01:57.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:01:57.048 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:57.048 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: Deploying daemon mds.l on smithi193 2024-09-11T22:01:57.048 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:56 smithi179 ceph-mon[35603]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:57.136 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:01:57.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.595+0000 7f645c380640 1 -- 172.21.15.152:0/1390409694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6454102db0 msgr2=0x7f6454103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:57.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.595+0000 7f645c380640 1 --2- 172.21.15.152:0/1390409694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6454102db0 0x7f6454103190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6444009cd0 tx=0x7f644402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:01:57.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 -- 172.21.15.152:0/1390409694 shutdown_connections 2024-09-11T22:01:57.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 --2- 172.21.15.152:0/1390409694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64541082e0 0x7f645410ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:57.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 --2- 172.21.15.152:0/1390409694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6454103760 0x7f6454107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:57.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 --2- 172.21.15.152:0/1390409694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6454102db0 0x7f6454103190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:57.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 -- 172.21.15.152:0/1390409694 >> 172.21.15.152:0/1390409694 conn(0x7f64540fc7d0 msgr2=0x7f64540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:57.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 -- 172.21.15.152:0/1390409694 shutdown_connections 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 -- 172.21.15.152:0/1390409694 wait complete. 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 Processor -- start 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 -- start start 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6454102db0 0x7f6454198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6454103760 0x7f6454198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64541082e0 0x7f645419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f64541120b0 con 0x7f6454102db0 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6454111f30 con 0x7f64541082e0 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645c380640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6454112230 con 0x7f6454103760 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.596+0000 7f645a11c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6454102db0 0x7f6454198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645a11c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6454102db0 0x7f6454198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34962/0 (socket says 172.21.15.152:34962) 2024-09-11T22:01:57.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645a11c640 1 -- 172.21.15.152:0/85772543 learned_addr learned my addr 172.21.15.152:0/85772543 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645a91d640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64541082e0 0x7f645419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645991b640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6454103760 0x7f6454198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645a11c640 1 -- 172.21.15.152:0/85772543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6454103760 msgr2=0x7f6454198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645a11c640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6454103760 0x7f6454198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645a11c640 1 -- 172.21.15.152:0/85772543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64541082e0 msgr2=0x7f645419ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645a11c640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64541082e0 0x7f645419ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645a11c640 1 -- 172.21.15.152:0/85772543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645419d520 con 0x7f6454102db0 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645a91d640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64541082e0 0x7f645419ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645a11c640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6454102db0 0x7f6454198570 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f644402ae00 tx=0x7f6444003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f64537fe640 1 -- 172.21.15.152:0/85772543 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444004240 con 0x7f6454102db0 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f64537fe640 1 -- 172.21.15.152:0/85772543 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6444031d50 con 0x7f6454102db0 2024-09-11T22:01:57.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645c380640 1 -- 172.21.15.152:0/85772543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645419d7b0 con 0x7f6454102db0 2024-09-11T22:01:57.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f64537fe640 1 -- 172.21.15.152:0/85772543 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644403a400 con 0x7f6454102db0 2024-09-11T22:01:57.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.597+0000 7f645c380640 1 -- 172.21.15.152:0/85772543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64541a50f0 con 0x7f6454102db0 2024-09-11T22:01:57.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.598+0000 7f645c380640 1 -- 172.21.15.152:0/85772543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6454103190 con 0x7f6454102db0 2024-09-11T22:01:57.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.599+0000 7f64537fe640 1 -- 172.21.15.152:0/85772543 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f64440306c0 con 0x7f6454102db0 2024-09-11T22:01:57.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.600+0000 7f64537fe640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f643c0a2c00 0x7f643c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:01:57.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.600+0000 7f645991b640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f643c0a2c00 0x7f643c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:01:57.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.600+0000 7f64537fe640 1 -- 172.21.15.152:0/85772543 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f644402e030 con 0x7f6454102db0 2024-09-11T22:01:57.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.600+0000 7f645991b640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f643c0a2c00 0x7f643c0a50c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6448005fd0 tx=0x7f6448005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:01:57.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.604+0000 7f64537fe640 1 -- 172.21.15.152:0/85772543 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64440bd110 con 0x7f6454102db0 2024-09-11T22:01:57.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.804+0000 7f645c380640 1 -- 172.21.15.152:0/85772543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f645410a2c0 con 0x7f6454102db0 2024-09-11T22:01:57.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.804+0000 7f64537fe640 1 -- 172.21.15.152:0/85772543 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f64440bca10 con 0x7f6454102db0 2024-09-11T22:01:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:01:57.805 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"btime":"2024-09-11T21:55:03:864852+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-11T22:01:57.806 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 1 2024-09-11T22:01:57.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 -- 172.21.15.152:0/85772543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f643c0a2c00 msgr2=0x7f643c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:57.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f643c0a2c00 0x7f643c0a50c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6448005fd0 tx=0x7f6448005850 comp rx=0 tx=0).stop 2024-09-11T22:01:57.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 -- 172.21.15.152:0/85772543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6454102db0 msgr2=0x7f6454198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:01:57.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6454102db0 0x7f6454198570 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f644402ae00 tx=0x7f6444003ba0 comp rx=0 tx=0).stop 2024-09-11T22:01:57.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 -- 172.21.15.152:0/85772543 shutdown_connections 2024-09-11T22:01:57.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64541082e0 0x7f645419ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:57.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f643c0a2c00 0x7f643c0a50c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:57.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6454103760 0x7f6454198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:57.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 --2- 172.21.15.152:0/85772543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6454102db0 0x7f6454198570 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:01:57.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 -- 172.21.15.152:0/85772543 >> 172.21.15.152:0/85772543 conn(0x7f64540fc7d0 msgr2=0x7f6454106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:01:57.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 -- 172.21.15.152:0/85772543 shutdown_connections 2024-09-11T22:01:57.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:01:57.807+0000 7f645c380640 1 -- 172.21.15.152:0/85772543 wait complete. 2024-09-11T22:01:58.282 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:58 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/85772543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:01:58.371 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:58 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/85772543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:01:58.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:58 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/85772543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:01:58.548 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 11 22:01:58 smithi193 podman[65799]: 2024-09-11 22:01:58.52442647 +0000 UTC m=+0.356387154 container start 02bd6f43374bdc5de02f2e1dd24e90861a32d842fe33d5eadb3ed3e713519928 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-l, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T22:01:58.548 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 11 22:01:58 smithi193 ceph-mds[65818]: -- 172.21.15.193:0/2667429145 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e799a3d860 con 0x55e799a1b000 2024-09-11T22:01:58.826 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 11 22:01:58 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-l[65814]: starting mds.l at 2024-09-11T22:01:58.826 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 11 22:01:58 smithi193 bash[65799]: 02bd6f43374bdc5de02f2e1dd24e90861a32d842fe33d5eadb3ed3e713519928 2024-09-11T22:01:58.826 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 11 22:01:58 smithi193 systemd[1]: Started Ceph mds.l for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:01:59.409 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:59 smithi179 ceph-mon[35603]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:59.410 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:59 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.193:6832/1533120685,v1:172.21.15.193:6833/1533120685] up:boot 2024-09-11T22:01:59.410 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:59 smithi179 ceph-mon[35603]: fsmap 1 up:standby 2024-09-11T22:01:59.410 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:59 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:01:59.410 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:59 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:59.410 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:59 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:59.410 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:59 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:59.410 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:59 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:01:59.410 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:59 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:01:59.410 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:01:59 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:59.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:59 smithi152 ceph-mon[31188]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:59.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:59 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.193:6832/1533120685,v1:172.21.15.193:6833/1533120685] up:boot 2024-09-11T22:01:59.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:59 smithi152 ceph-mon[31188]: fsmap 1 up:standby 2024-09-11T22:01:59.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:59 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:01:59.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:59 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:59.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:59 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:59.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:59 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:59.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:59 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:01:59.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:59 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:01:59.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:01:59 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:01:59.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:59 smithi193 ceph-mon[35545]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:01:59.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:59 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.193:6832/1533120685,v1:172.21.15.193:6833/1533120685] up:boot 2024-09-11T22:01:59.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:59 smithi193 ceph-mon[35545]: fsmap 1 up:standby 2024-09-11T22:01:59.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:59 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:01:59.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:59 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:59.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:59 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:59.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:59 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:01:59.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:59 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:01:59.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:59 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:01:59.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:01:59 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:00.373 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:02:00.400 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:00 smithi152 ceph-mon[31188]: Deploying daemon mds.k on smithi179 2024-09-11T22:02:00.407 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:00 smithi179 ceph-mon[35603]: Deploying daemon mds.k on smithi179 2024-09-11T22:02:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:00 smithi193 ceph-mon[35545]: Deploying daemon mds.k on smithi179 2024-09-11T22:02:00.631 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:00.796 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:02:00 smithi179 systemd[1]: Starting Ceph mds.k for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:02:01.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.092+0000 7f6857c3e640 1 -- 172.21.15.152:0/995566488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6850106a80 msgr2=0x7f6850106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:01.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.092+0000 7f6857c3e640 1 --2- 172.21.15.152:0/995566488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6850106a80 0x7f6850106e60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6848009930 tx=0x7f684802a420 comp rx=0 tx=0).stop 2024-09-11T22:02:01.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.093+0000 7f6857c3e640 1 -- 172.21.15.152:0/995566488 shutdown_connections 2024-09-11T22:02:01.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.093+0000 7f6857c3e640 1 --2- 172.21.15.152:0/995566488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6850101420 0x7f685010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:01.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.093+0000 7f6857c3e640 1 --2- 172.21.15.152:0/995566488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6850100a80 0x7f6850100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.093+0000 7f6857c3e640 1 --2- 172.21.15.152:0/995566488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6850106a80 0x7f6850106e60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.093+0000 7f6857c3e640 1 -- 172.21.15.152:0/995566488 >> 172.21.15.152:0/995566488 conn(0x7f68500fc7a0 msgr2=0x7f68500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.093+0000 7f6857c3e640 1 -- 172.21.15.152:0/995566488 shutdown_connections 2024-09-11T22:02:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.093+0000 7f6857c3e640 1 -- 172.21.15.152:0/995566488 wait complete. 2024-09-11T22:02:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.093+0000 7f6857c3e640 1 Processor -- start 2024-09-11T22:02:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.093+0000 7f6857c3e640 1 -- start start 2024-09-11T22:02:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f6857c3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6850100a80 0x7f6850197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f6857c3e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6850101420 0x7f6850197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f6857c3e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6850106a80 0x7f685019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f6857c3e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6850110e80 con 0x7f6850106a80 2024-09-11T22:02:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f6857c3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6850110d00 con 0x7f6850100a80 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f6857c3e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6850111000 con 0x7f6850101420 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f68561db640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6850106a80 0x7f685019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f68561db640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6850106a80 0x7f685019bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34986/0 (socket says 172.21.15.152:34986) 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f68561db640 1 -- 172.21.15.152:0/2429598107 learned_addr learned my addr 172.21.15.152:0/2429598107 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f68551d9640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6850101420 0x7f6850197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f68559da640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6850100a80 0x7f6850197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f68561db640 1 -- 172.21.15.152:0/2429598107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6850101420 msgr2=0x7f6850197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f68561db640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6850101420 0x7f6850197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f68561db640 1 -- 172.21.15.152:0/2429598107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6850100a80 msgr2=0x7f6850197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f68561db640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6850100a80 0x7f6850197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f68561db640 1 -- 172.21.15.152:0/2429598107 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685019c2b0 con 0x7f6850106a80 2024-09-11T22:02:01.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f68561db640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6850106a80 0x7f685019bbd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f684000cce0 tx=0x7f684000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f684effd640 1 -- 172.21.15.152:0/2429598107 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684000f450 con 0x7f6850106a80 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f684effd640 1 -- 172.21.15.152:0/2429598107 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f684000fad0 con 0x7f6850106a80 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f6857c3e640 1 -- 172.21.15.152:0/2429598107 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685019c5a0 con 0x7f6850106a80 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.094+0000 7f684effd640 1 -- 172.21.15.152:0/2429598107 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6840018c10 con 0x7f6850106a80 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.095+0000 7f6857c3e640 1 -- 172.21.15.152:0/2429598107 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68501a3e80 con 0x7f6850106a80 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.096+0000 7f6857c3e640 1 -- 172.21.15.152:0/2429598107 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6850100ee0 con 0x7f6850106a80 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.097+0000 7f684effd640 1 -- 172.21.15.152:0/2429598107 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f684000f5f0 con 0x7f6850106a80 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.098+0000 7f684effd640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f68380a2c00 0x7f68380a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.098+0000 7f68559da640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f68380a2c00 0x7f68380a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.098+0000 7f684effd640 1 -- 172.21.15.152:0/2429598107 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f68400cf0c0 con 0x7f6850106a80 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.098+0000 7f68559da640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f68380a2c00 0x7f68380a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6848009900 tx=0x7f68480058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:01.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.102+0000 7f684effd640 1 -- 172.21.15.152:0/2429598107 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6840014030 con 0x7f6850106a80 2024-09-11T22:02:01.129 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:02:00 smithi179 podman[64964]: 2024-09-11 22:02:00.7103163 +0000 UTC m=+0.015867761 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:02:01.129 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:02:00 smithi179 podman[64964]: 2024-09-11 22:02:00.825528211 +0000 UTC m=+0.131079662 container create e46abef58b78925693846486f496cd60a712963eda2aca7e345530aa78d5f6f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD) 2024-09-11T22:02:01.129 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:02:01 smithi179 podman[64964]: 2024-09-11 22:02:01.028378784 +0000 UTC m=+0.333930248 container init e46abef58b78925693846486f496cd60a712963eda2aca7e345530aa78d5f6f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-11T22:02:01.129 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:02:01 smithi179 podman[64964]: 2024-09-11 22:02:01.031150916 +0000 UTC m=+0.336702378 container start e46abef58b78925693846486f496cd60a712963eda2aca7e345530aa78d5f6f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:02:01.129 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:02:01 smithi179 ceph-mds[64983]: -- 172.21.15.179:0/3803666295 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55da0c709860 con 0x55da0c6e7000 2024-09-11T22:02:01.129 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:02:01 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-k[64979]: starting mds.k at 2024-09-11T22:02:01.129 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:02:01 smithi179 bash[64964]: e46abef58b78925693846486f496cd60a712963eda2aca7e345530aa78d5f6f8 2024-09-11T22:02:01.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.313+0000 7f6857c3e640 1 -- 172.21.15.152:0/2429598107 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f685002d7c0 con 0x7f6850106a80 2024-09-11T22:02:01.315 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:01 smithi152 ceph-mon[31188]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:01.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.314+0000 7f684effd640 1 -- 172.21.15.152:0/2429598107 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f684009c4a0 con 0x7f6850106a80 2024-09-11T22:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":3,"btime":"2024-09-11T22:02:01:128944+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T22:02:01.316 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 3 2024-09-11T22:02:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.316+0000 7f6857c3e640 1 -- 172.21.15.152:0/2429598107 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f68380a2c00 msgr2=0x7f68380a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.316+0000 7f6857c3e640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f68380a2c00 0x7f68380a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6848009900 tx=0x7f68480058d0 comp rx=0 tx=0).stop 2024-09-11T22:02:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.316+0000 7f6857c3e640 1 -- 172.21.15.152:0/2429598107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6850106a80 msgr2=0x7f685019bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.316+0000 7f6857c3e640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6850106a80 0x7f685019bbd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f684000cce0 tx=0x7f684000a620 comp rx=0 tx=0).stop 2024-09-11T22:02:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.317+0000 7f6857c3e640 1 -- 172.21.15.152:0/2429598107 shutdown_connections 2024-09-11T22:02:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.317+0000 7f6857c3e640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6850106a80 0x7f685019bbd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.317+0000 7f6857c3e640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f68380a2c00 0x7f68380a50c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.317+0000 7f6857c3e640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6850101420 0x7f6850197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.317+0000 7f6857c3e640 1 --2- 172.21.15.152:0/2429598107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6850100a80 0x7f6850197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.317+0000 7f6857c3e640 1 -- 172.21.15.152:0/2429598107 >> 172.21.15.152:0/2429598107 conn(0x7f68500fc7a0 msgr2=0x7f68500fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.317+0000 7f6857c3e640 1 -- 172.21.15.152:0/2429598107 shutdown_connections 2024-09-11T22:02:01.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:01.317+0000 7f6857c3e640 1 -- 172.21.15.152:0/2429598107 wait complete. 2024-09-11T22:02:01.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:01 smithi179 ceph-mon[35603]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:01.546 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:02:01 smithi179 systemd[1]: Started Ceph mds.k for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:02:01.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:01 smithi193 ceph-mon[35545]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:02.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:02 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.179:6832/2338711359,v1:172.21.15.179:6833/2338711359] up:boot 2024-09-11T22:02:02.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:02 smithi152 ceph-mon[31188]: fsmap 2 up:standby 2024-09-11T22:02:02.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:02:02.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:02.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:02.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:02.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:02.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:02.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:02 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:02.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:02 smithi152 ceph-mon[31188]: Deploying daemon mds.j on smithi152 2024-09-11T22:02:02.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:02 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2429598107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:02.449 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:02 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.179:6832/2338711359,v1:172.21.15.179:6833/2338711359] up:boot 2024-09-11T22:02:02.449 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:02 smithi179 ceph-mon[35603]: fsmap 2 up:standby 2024-09-11T22:02:02.449 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:02:02.449 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:02.449 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:02.449 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:02.449 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:02.449 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:02.450 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:02 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:02.450 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:02 smithi179 ceph-mon[35603]: Deploying daemon mds.j on smithi152 2024-09-11T22:02:02.450 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:02 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2429598107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:02.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:02 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.179:6832/2338711359,v1:172.21.15.179:6833/2338711359] up:boot 2024-09-11T22:02:02.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:02 smithi193 ceph-mon[35545]: fsmap 2 up:standby 2024-09-11T22:02:02.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:02:02.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:02.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:02.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:02.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:02.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:02.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:02 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:02.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:02 smithi193 ceph-mon[35545]: Deploying daemon mds.j on smithi152 2024-09-11T22:02:02.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:02 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2429598107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:03.401 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:03 smithi179 ceph-mon[35603]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:03.423 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:03 smithi152 ceph-mon[31188]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:03.478 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:03 smithi193 ceph-mon[35545]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:03.730 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:02:03 smithi152 systemd[1]: Starting Ceph mds.j for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:02:03.997 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:02:04.067 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:02:03 smithi152 podman[70038]: 2024-09-11 22:02:03.715217584 +0000 UTC m=+0.016090099 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:02:04.067 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:02:03 smithi152 podman[70038]: 2024-09-11 22:02:03.82045741 +0000 UTC m=+0.121329980 container create 9332532f2cac758cf29f4c0b574d64a380198b634ce2ce446994e03344837f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-j, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:02:04.067 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:02:04 smithi152 podman[70038]: 2024-09-11 22:02:04.039519463 +0000 UTC m=+0.340391978 container init 9332532f2cac758cf29f4c0b574d64a380198b634ce2ce446994e03344837f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-j, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-11T22:02:04.067 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:02:04 smithi152 podman[70038]: 2024-09-11 22:02:04.042698038 +0000 UTC m=+0.343570561 container start 9332532f2cac758cf29f4c0b574d64a380198b634ce2ce446994e03344837f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-j, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-11T22:02:04.272 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:04.398 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:02:04 smithi152 ceph-mds[70075]: -- 172.21.15.152:0/3314924579 <== mon.0 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560300b27c20 con 0x560300b04800 2024-09-11T22:02:04.398 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:02:04 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-j[70053]: starting mds.j at 2024-09-11T22:02:04.398 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:02:04 smithi152 bash[70038]: 9332532f2cac758cf29f4c0b574d64a380198b634ce2ce446994e03344837f0e 2024-09-11T22:02:04.398 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:02:04 smithi152 systemd[1]: Started Ceph mds.j for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:02:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.724+0000 7fde1426f640 1 -- 172.21.15.152:0/2202128847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde0c100a60 msgr2=0x7fde0c100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.724+0000 7fde1426f640 1 --2- 172.21.15.152:0/2202128847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde0c100a60 0x7fde0c100ec0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fde00009930 tx=0x7fde0002a420 comp rx=0 tx=0).stop 2024-09-11T22:02:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.724+0000 7fde1426f640 1 -- 172.21.15.152:0/2202128847 shutdown_connections 2024-09-11T22:02:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.724+0000 7fde1426f640 1 --2- 172.21.15.152:0/2202128847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde0c101400 0x7fde0c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.724+0000 7fde1426f640 1 --2- 172.21.15.152:0/2202128847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde0c100a60 0x7fde0c100ec0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.724+0000 7fde1426f640 1 --2- 172.21.15.152:0/2202128847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde0c106a60 0x7fde0c106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.724+0000 7fde1426f640 1 -- 172.21.15.152:0/2202128847 >> 172.21.15.152:0/2202128847 conn(0x7fde0c0fc780 msgr2=0x7fde0c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.724+0000 7fde1426f640 1 -- 172.21.15.152:0/2202128847 shutdown_connections 2024-09-11T22:02:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.724+0000 7fde1426f640 1 -- 172.21.15.152:0/2202128847 wait complete. 2024-09-11T22:02:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1426f640 1 Processor -- start 2024-09-11T22:02:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1426f640 1 -- start start 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1426f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde0c100a60 0x7fde0c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1426f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde0c101400 0x7fde0c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1426f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde0c106a60 0x7fde0c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1426f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c110e60 con 0x7fde0c100a60 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1426f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c110ce0 con 0x7fde0c106a60 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1426f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c110fe0 con 0x7fde0c101400 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1200b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde0c100a60 0x7fde0c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1200b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde0c100a60 0x7fde0c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39730/0 (socket says 172.21.15.152:39730) 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1200b640 1 -- 172.21.15.152:0/3571640644 learned_addr learned my addr 172.21.15.152:0/3571640644 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1180a640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde0c101400 0x7fde0c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1280c640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde0c106a60 0x7fde0c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1200b640 1 -- 172.21.15.152:0/3571640644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde0c101400 msgr2=0x7fde0c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1200b640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde0c101400 0x7fde0c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1200b640 1 -- 172.21.15.152:0/3571640644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde0c106a60 msgr2=0x7fde0c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1200b640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde0c106a60 0x7fde0c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1200b640 1 -- 172.21.15.152:0/3571640644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c19d420 con 0x7fde0c100a60 2024-09-11T22:02:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.725+0000 7fde1280c640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde0c106a60 0x7fde0c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:02:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.726+0000 7fde1200b640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde0c100a60 0x7fde0c198470 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde0800d950 tx=0x7fde0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.726+0000 7fddff7fe640 1 -- 172.21.15.152:0/3571640644 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08017030 con 0x7fde0c100a60 2024-09-11T22:02:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.726+0000 7fddff7fe640 1 -- 172.21.15.152:0/3571640644 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde08004020 con 0x7fde0c100a60 2024-09-11T22:02:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.726+0000 7fde1426f640 1 -- 172.21.15.152:0/3571640644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0c19d710 con 0x7fde0c100a60 2024-09-11T22:02:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.726+0000 7fddff7fe640 1 -- 172.21.15.152:0/3571640644 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde080047a0 con 0x7fde0c100a60 2024-09-11T22:02:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.726+0000 7fde1426f640 1 -- 172.21.15.152:0/3571640644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0c1a4ff0 con 0x7fde0c100a60 2024-09-11T22:02:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.727+0000 7fde1426f640 1 -- 172.21.15.152:0/3571640644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0c100ec0 con 0x7fde0c100a60 2024-09-11T22:02:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.728+0000 7fddff7fe640 1 -- 172.21.15.152:0/3571640644 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fde080041d0 con 0x7fde0c100a60 2024-09-11T22:02:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.729+0000 7fddff7fe640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fddf80a2c00 0x7fddf80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.729+0000 7fde1180a640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fddf80a2c00 0x7fddf80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.729+0000 7fddff7fe640 1 -- 172.21.15.152:0/3571640644 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fde080ceae0 con 0x7fde0c100a60 2024-09-11T22:02:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.729+0000 7fde1180a640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fddf80a2c00 0x7fddf80a50c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde00009900 tx=0x7fde000058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:04.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.732+0000 7fddff7fe640 1 -- 172.21.15.152:0/3571640644 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde0809bf60 con 0x7fde0c100a60 2024-09-11T22:02:04.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.953+0000 7fde1426f640 1 -- 172.21.15.152:0/3571640644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde0c1997d0 con 0x7fde0c100a60 2024-09-11T22:02:04.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.953+0000 7fddff7fe640 1 -- 172.21.15.152:0/3571640644 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3094 (secure 0 0 0) 0x7fde0809b860 con 0x7fde0c100a60 2024-09-11T22:02:04.954 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:04.955 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":4,"btime":"2024-09-11T22:02:04:140257+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T22:02:04.955 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 4 2024-09-11T22:02:04.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 -- 172.21.15.152:0/3571640644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fddf80a2c00 msgr2=0x7fddf80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:04.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fddf80a2c00 0x7fddf80a50c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde00009900 tx=0x7fde000058d0 comp rx=0 tx=0).stop 2024-09-11T22:02:04.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 -- 172.21.15.152:0/3571640644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde0c100a60 msgr2=0x7fde0c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:04.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde0c100a60 0x7fde0c198470 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde0800d950 tx=0x7fde0800de10 comp rx=0 tx=0).stop 2024-09-11T22:02:04.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 -- 172.21.15.152:0/3571640644 shutdown_connections 2024-09-11T22:02:04.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde0c106a60 0x7fde0c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:04.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fddf80a2c00 0x7fddf80a50c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:04.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde0c101400 0x7fde0c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:04.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 --2- 172.21.15.152:0/3571640644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde0c100a60 0x7fde0c198470 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:04.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 -- 172.21.15.152:0/3571640644 >> 172.21.15.152:0/3571640644 conn(0x7fde0c0fc780 msgr2=0x7fde0c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:04.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 -- 172.21.15.152:0/3571640644 shutdown_connections 2024-09-11T22:02:04.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:04.955+0000 7fde1426f640 1 -- 172.21.15.152:0/3571640644 wait complete. 2024-09-11T22:02:05.306 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.152:6834/1074313081,v1:172.21.15.152:6835/1074313081] up:boot 2024-09-11T22:02:05.306 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: fsmap 3 up:standby 2024-09-11T22:02:05.306 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:02:05.307 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:05.307 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:05.307 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:05.307 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:05.307 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:05.307 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:05.307 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: Deploying daemon mds.d on smithi152 2024-09-11T22:02:05.307 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:05.307 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:05 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3571640644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:05.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.152:6834/1074313081,v1:172.21.15.152:6835/1074313081] up:boot 2024-09-11T22:02:05.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: fsmap 3 up:standby 2024-09-11T22:02:05.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:02:05.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:05.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:05.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:05.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:05.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:05.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:05.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: Deploying daemon mds.d on smithi152 2024-09-11T22:02:05.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:05.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:05 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3571640644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:05.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.152:6834/1074313081,v1:172.21.15.152:6835/1074313081] up:boot 2024-09-11T22:02:05.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: fsmap 3 up:standby 2024-09-11T22:02:05.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:02:05.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:05.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:05.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:05.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:05.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:05.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:05.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: Deploying daemon mds.d on smithi152 2024-09-11T22:02:05.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:05.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:05 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3571640644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:06.730 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:02:06 smithi152 podman[70456]: 2024-09-11 22:02:06.578692351 +0000 UTC m=+0.015673837 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:02:07.230 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:02:06 smithi152 podman[70456]: 2024-09-11 22:02:06.876744992 +0000 UTC m=+0.313726474 container init c016c6646b4b125093e49a5101de54c837725c41bd3e0e3ddc72e1e37b4c3442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-d, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-11T22:02:07.230 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:02:06 smithi152 podman[70456]: 2024-09-11 22:02:06.879609249 +0000 UTC m=+0.316590741 container start c016c6646b4b125093e49a5101de54c837725c41bd3e0e3ddc72e1e37b4c3442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:02:07.230 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:02:06 smithi152 ceph-mds[70476]: -- 172.21.15.152:0/1869969791 <== mon.0 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559e8f52f860 con 0x559e8f50d400 2024-09-11T22:02:07.231 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:02:06 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-d[70472]: starting mds.d at 2024-09-11T22:02:07.231 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:02:06 smithi152 bash[70456]: c016c6646b4b125093e49a5101de54c837725c41bd3e0e3ddc72e1e37b4c3442 2024-09-11T22:02:07.231 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:02:06 smithi152 systemd[1]: Started Ceph mds.d for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:02:07.624 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:07 smithi179 ceph-mon[35603]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:07.624 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:07.624 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:07.624 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:07.624 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:07.624 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:07.624 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:07 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:07 smithi152 ceph-mon[31188]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:07 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:07 smithi193 ceph-mon[35545]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:07.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:07.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:07 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:08.419 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:02:08.596 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:08 smithi179 ceph-mon[35603]: Deploying daemon mds.e on smithi179 2024-09-11T22:02:08.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:08 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.152:6836/1959199383,v1:172.21.15.152:6837/1959199383] up:boot 2024-09-11T22:02:08.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:08 smithi179 ceph-mon[35603]: fsmap 4 up:standby 2024-09-11T22:02:08.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:08 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:02:08.684 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:08.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:08 smithi152 ceph-mon[31188]: Deploying daemon mds.e on smithi179 2024-09-11T22:02:08.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:08 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.152:6836/1959199383,v1:172.21.15.152:6837/1959199383] up:boot 2024-09-11T22:02:08.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:08 smithi152 ceph-mon[31188]: fsmap 4 up:standby 2024-09-11T22:02:08.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:08 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:02:08.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:08 smithi193 ceph-mon[35545]: Deploying daemon mds.e on smithi179 2024-09-11T22:02:08.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:08 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.152:6836/1959199383,v1:172.21.15.152:6837/1959199383] up:boot 2024-09-11T22:02:08.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:08 smithi193 ceph-mon[35545]: fsmap 4 up:standby 2024-09-11T22:02:08.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:08 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:02:09.031 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:02:08 smithi179 systemd[1]: Starting Ceph mds.e for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:02:09.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.112+0000 7fa2847fb640 1 -- 172.21.15.152:0/3864330705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa27c102ef0 msgr2=0x7fa27c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:09.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.112+0000 7fa2847fb640 1 --2- 172.21.15.152:0/3864330705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa27c102ef0 0x7fa27c10da40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa274009900 tx=0x7fa27402a480 comp rx=0 tx=0).stop 2024-09-11T22:02:09.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.112+0000 7fa2847fb640 1 -- 172.21.15.152:0/3864330705 shutdown_connections 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.112+0000 7fa2847fb640 1 --2- 172.21.15.152:0/3864330705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa27c102ef0 0x7fa27c10da40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.112+0000 7fa2847fb640 1 --2- 172.21.15.152:0/3864330705 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa27c102570 0x7fa27c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.112+0000 7fa2847fb640 1 --2- 172.21.15.152:0/3864330705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa27c100e20 0x7fa27c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.112+0000 7fa2847fb640 1 -- 172.21.15.152:0/3864330705 >> 172.21.15.152:0/3864330705 conn(0x7fa27c0fc7d0 msgr2=0x7fa27c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.112+0000 7fa2847fb640 1 -- 172.21.15.152:0/3864330705 shutdown_connections 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.112+0000 7fa2847fb640 1 -- 172.21.15.152:0/3864330705 wait complete. 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa2847fb640 1 Processor -- start 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa2847fb640 1 -- start start 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa2847fb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa27c100e20 0x7fa27c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa2847fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa27c102570 0x7fa27c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa2847fb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa27c102ef0 0x7fa27c1a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa2847fb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c110f80 con 0x7fa27c102570 2024-09-11T22:02:09.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa2847fb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c110e00 con 0x7fa27c102ef0 2024-09-11T22:02:09.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa2847fb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c111100 con 0x7fa27c100e20 2024-09-11T22:02:09.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa281d96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa27c102570 0x7fa27c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:09.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa281d96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa27c102570 0x7fa27c1998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39770/0 (socket says 172.21.15.152:39770) 2024-09-11T22:02:09.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa281d96640 1 -- 172.21.15.152:0/2475767188 learned_addr learned my addr 172.21.15.152:0/2475767188 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:09.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa282d98640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa27c102ef0 0x7fa27c1a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:09.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa282597640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa27c100e20 0x7fa27c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:09.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa281d96640 1 -- 172.21.15.152:0/2475767188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa27c100e20 msgr2=0x7fa27c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:09.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa281d96640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa27c100e20 0x7fa27c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:09.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa281d96640 1 -- 172.21.15.152:0/2475767188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa27c102ef0 msgr2=0x7fa27c1a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:09.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa281d96640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa27c102ef0 0x7fa27c1a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:09.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa281d96640 1 -- 172.21.15.152:0/2475767188 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c1a4930 con 0x7fa27c102570 2024-09-11T22:02:09.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.113+0000 7fa281d96640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa27c102570 0x7fa27c1998b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00c970 tx=0x7fa26c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:09.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.114+0000 7fa2737fe640 1 -- 172.21.15.152:0/2475767188 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c007bb0 con 0x7fa27c102570 2024-09-11T22:02:09.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.114+0000 7fa2737fe640 1 -- 172.21.15.152:0/2475767188 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa26c007d50 con 0x7fa27c102570 2024-09-11T22:02:09.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.114+0000 7fa2737fe640 1 -- 172.21.15.152:0/2475767188 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00f450 con 0x7fa27c102570 2024-09-11T22:02:09.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.114+0000 7fa2847fb640 1 -- 172.21.15.152:0/2475767188 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27c1a4b00 con 0x7fa27c102570 2024-09-11T22:02:09.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.114+0000 7fa2847fb640 1 -- 172.21.15.152:0/2475767188 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27c1a4fc0 con 0x7fa27c102570 2024-09-11T22:02:09.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.115+0000 7fa2847fb640 1 -- 172.21.15.152:0/2475767188 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa27c101200 con 0x7fa27c102570 2024-09-11T22:02:09.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.116+0000 7fa2737fe640 1 -- 172.21.15.152:0/2475767188 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa26c005020 con 0x7fa27c102570 2024-09-11T22:02:09.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.116+0000 7fa2737fe640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa2680a2b80 0x7fa2680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:09.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.117+0000 7fa282597640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa2680a2b80 0x7fa2680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:09.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.117+0000 7fa2737fe640 1 -- 172.21.15.152:0/2475767188 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fa26c0ce910 con 0x7fa27c102570 2024-09-11T22:02:09.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.117+0000 7fa282597640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa2680a2b80 0x7fa2680a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa278005c40 tx=0x7fa27800a780 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:09.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.121+0000 7fa2737fe640 1 -- 172.21.15.152:0/2475767188 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa26c014030 con 0x7fa27c102570 2024-09-11T22:02:09.285 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:02:09 smithi179 podman[65277]: 2024-09-11 22:02:08.93326666 +0000 UTC m=+0.016210141 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:02:09.285 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:02:09 smithi179 podman[65277]: 2024-09-11 22:02:09.030918115 +0000 UTC m=+0.113861634 container create f274f0b373cf82d47351f2cdc29c968e704e517be0af11022b85c4d9b4fa1cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T22:02:09.285 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:02:09 smithi179 podman[65277]: 2024-09-11 22:02:09.258750553 +0000 UTC m=+0.341694027 container init f274f0b373cf82d47351f2cdc29c968e704e517be0af11022b85c4d9b4fa1cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T22:02:09.285 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:02:09 smithi179 podman[65277]: 2024-09-11 22:02:09.26151775 +0000 UTC m=+0.344461225 container start f274f0b373cf82d47351f2cdc29c968e704e517be0af11022b85c4d9b4fa1cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:02:09.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.322+0000 7fa2847fb640 1 -- 172.21.15.152:0/2475767188 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa27c06a560 con 0x7fa27c102570 2024-09-11T22:02:09.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.322+0000 7fa2737fe640 1 -- 172.21.15.152:0/2475767188 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3922 (secure 0 0 0) 0x7fa26c09bd10 con 0x7fa27c102570 2024-09-11T22:02:09.323 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:09.323 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":5,"btime":"2024-09-11T22:02:07:319605+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T22:02:09.324 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 5 2024-09-11T22:02:09.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.324+0000 7fa2847fb640 1 -- 172.21.15.152:0/2475767188 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa2680a2b80 msgr2=0x7fa2680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:09.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.324+0000 7fa2847fb640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa2680a2b80 0x7fa2680a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa278005c40 tx=0x7fa27800a780 comp rx=0 tx=0).stop 2024-09-11T22:02:09.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.324+0000 7fa2847fb640 1 -- 172.21.15.152:0/2475767188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa27c102570 msgr2=0x7fa27c1998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:09.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.324+0000 7fa2847fb640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa27c102570 0x7fa27c1998b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00c970 tx=0x7fa26c00ce30 comp rx=0 tx=0).stop 2024-09-11T22:02:09.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.324+0000 7fa2847fb640 1 -- 172.21.15.152:0/2475767188 shutdown_connections 2024-09-11T22:02:09.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.324+0000 7fa2847fb640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa27c102ef0 0x7fa27c1a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:09.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.324+0000 7fa2847fb640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa27c102570 0x7fa27c1998b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:09.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.324+0000 7fa2847fb640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa2680a2b80 0x7fa2680a5040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:09.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.324+0000 7fa2847fb640 1 --2- 172.21.15.152:0/2475767188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa27c100e20 0x7fa27c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:09.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.324+0000 7fa2847fb640 1 -- 172.21.15.152:0/2475767188 >> 172.21.15.152:0/2475767188 conn(0x7fa27c0fc7d0 msgr2=0x7fa27c106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:09.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.325+0000 7fa2847fb640 1 -- 172.21.15.152:0/2475767188 shutdown_connections 2024-09-11T22:02:09.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:09.325+0000 7fa2847fb640 1 -- 172.21.15.152:0/2475767188 wait complete. 2024-09-11T22:02:09.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:09 smithi152 ceph-mon[31188]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:09.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:09 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2475767188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:09.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:09 smithi179 ceph-mon[35603]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:09.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:09 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2475767188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:09.547 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:02:09 smithi179 ceph-mds[65296]: -- 172.21.15.179:0/3216817288 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a44c9b3860 con 0x55a44c991400 2024-09-11T22:02:09.547 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:02:09 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e[65292]: starting mds.e at 2024-09-11T22:02:09.547 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:02:09 smithi179 bash[65277]: f274f0b373cf82d47351f2cdc29c968e704e517be0af11022b85c4d9b4fa1cb4 2024-09-11T22:02:09.547 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:02:09 smithi179 systemd[1]: Started Ceph mds.e for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:02:09.811 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:09 smithi193 ceph-mon[35545]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:09.811 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:09 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2475767188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:10.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:10 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.179:6834/161011948,v1:172.21.15.179:6835/161011948] up:boot 2024-09-11T22:02:10.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:10 smithi193 ceph-mon[35545]: fsmap 5 up:standby 2024-09-11T22:02:10.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:10 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:02:10.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:10 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:10.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:10 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:10.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:10 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:10.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:10 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:10.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:10 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:10.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:10 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:10.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:10 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.179:6834/161011948,v1:172.21.15.179:6835/161011948] up:boot 2024-09-11T22:02:10.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:10 smithi152 ceph-mon[31188]: fsmap 5 up:standby 2024-09-11T22:02:10.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:10 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:02:10.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:10 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:10.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:10 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:10.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:10 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:10.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:10 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:10.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:10 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:10.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:10 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:10.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:10 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.179:6834/161011948,v1:172.21.15.179:6835/161011948] up:boot 2024-09-11T22:02:10.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:10 smithi179 ceph-mon[35603]: fsmap 5 up:standby 2024-09-11T22:02:10.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:10 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:02:10.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:10 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:10.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:10 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:10.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:10 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:10.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:10 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:10.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:10 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:10.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:10 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:11.319 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:02:11 smithi193 systemd[1]: Starting Ceph mds.f for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:02:11.573 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:11 smithi193 ceph-mon[35545]: Deploying daemon mds.f on smithi193 2024-09-11T22:02:11.574 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:11 smithi193 ceph-mon[35545]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:11.574 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:02:11 smithi193 podman[66101]: 2024-09-11 22:02:11.221351207 +0000 UTC m=+0.016149368 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:02:11.574 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:02:11 smithi193 podman[66101]: 2024-09-11 22:02:11.338066014 +0000 UTC m=+0.132864161 container create caf2fc941a9df7e546bf89f4a1bf5c7dfd5777b7c051e33303433e11e54d49bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:02:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:11 smithi152 ceph-mon[31188]: Deploying daemon mds.f on smithi193 2024-09-11T22:02:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:11 smithi152 ceph-mon[31188]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:11 smithi179 ceph-mon[35603]: Deploying daemon mds.f on smithi193 2024-09-11T22:02:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:11 smithi179 ceph-mon[35603]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:11.826 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:02:11 smithi193 podman[66101]: 2024-09-11 22:02:11.573814235 +0000 UTC m=+0.368612382 container init caf2fc941a9df7e546bf89f4a1bf5c7dfd5777b7c051e33303433e11e54d49bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:02:11.826 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:02:11 smithi193 podman[66101]: 2024-09-11 22:02:11.576861482 +0000 UTC m=+0.371659629 container start caf2fc941a9df7e546bf89f4a1bf5c7dfd5777b7c051e33303433e11e54d49bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-11T22:02:11.826 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:02:11 smithi193 ceph-mds[66120]: -- 172.21.15.193:0/2849049919 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563c47f91860 con 0x563c47f6f400 2024-09-11T22:02:11.826 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:02:11 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f[66116]: starting mds.f at 2024-09-11T22:02:11.827 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:02:11 smithi193 bash[66101]: caf2fc941a9df7e546bf89f4a1bf5c7dfd5777b7c051e33303433e11e54d49bf 2024-09-11T22:02:11.827 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:02:11 smithi193 systemd[1]: Started Ceph mds.f for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:02:11.996 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:02:12.264 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.691+0000 7fd437b9f640 1 -- 172.21.15.152:0/825210611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd430101de0 msgr2=0x7fd4301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.691+0000 7fd437b9f640 1 --2- 172.21.15.152:0/825210611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd430101de0 0x7fd4301021c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009900 tx=0x7fd42c02a410 comp rx=0 tx=0).stop 2024-09-11T22:02:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.691+0000 7fd437b9f640 1 -- 172.21.15.152:0/825210611 shutdown_connections 2024-09-11T22:02:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.691+0000 7fd437b9f640 1 --2- 172.21.15.152:0/825210611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd430106f10 0x7fd43010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.691+0000 7fd437b9f640 1 --2- 172.21.15.152:0/825210611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd430102790 0x7fd4301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.691+0000 7fd437b9f640 1 --2- 172.21.15.152:0/825210611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd430101de0 0x7fd4301021c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.691+0000 7fd437b9f640 1 -- 172.21.15.152:0/825210611 >> 172.21.15.152:0/825210611 conn(0x7fd4300fd8c0 msgr2=0x7fd4300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.691+0000 7fd437b9f640 1 -- 172.21.15.152:0/825210611 shutdown_connections 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.691+0000 7fd437b9f640 1 -- 172.21.15.152:0/825210611 wait complete. 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd437b9f640 1 Processor -- start 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd437b9f640 1 -- start start 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd437b9f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd430101de0 0x7fd4300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd437b9f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd430102790 0x7fd430074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd437b9f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd430106f10 0x7fd430074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd437b9f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd430111f90 con 0x7fd430106f10 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd437b9f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd430111e10 con 0x7fd430102790 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd437b9f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd430112110 con 0x7fd430101de0 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd43613c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd430106f10 0x7fd430074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd43613c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd430106f10 0x7fd430074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39790/0 (socket says 172.21.15.152:39790) 2024-09-11T22:02:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd43613c640 1 -- 172.21.15.152:0/101709148 learned_addr learned my addr 172.21.15.152:0/101709148 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd43593b640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd430101de0 0x7fd4300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd43513a640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd430102790 0x7fd430074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd43613c640 1 -- 172.21.15.152:0/101709148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd430101de0 msgr2=0x7fd4300744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd43613c640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd430101de0 0x7fd4300744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd43613c640 1 -- 172.21.15.152:0/101709148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd430102790 msgr2=0x7fd430074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd43613c640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd430102790 0x7fd430074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd43613c640 1 -- 172.21.15.152:0/101709148 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4301a6940 con 0x7fd430106f10 2024-09-11T22:02:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.692+0000 7fd43513a640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd430102790 0x7fd430074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:02:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.693+0000 7fd43613c640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd430106f10 0x7fd430074f70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd42800b970 tx=0x7fd42800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.693+0000 7fd426ffd640 1 -- 172.21.15.152:0/101709148 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428019070 con 0x7fd430106f10 2024-09-11T22:02:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.693+0000 7fd426ffd640 1 -- 172.21.15.152:0/101709148 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd42800cb40 con 0x7fd430106f10 2024-09-11T22:02:12.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.693+0000 7fd426ffd640 1 -- 172.21.15.152:0/101709148 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428007650 con 0x7fd430106f10 2024-09-11T22:02:12.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.693+0000 7fd437b9f640 1 -- 172.21.15.152:0/101709148 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4301a6c30 con 0x7fd430106f10 2024-09-11T22:02:12.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.693+0000 7fd437b9f640 1 -- 172.21.15.152:0/101709148 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4301a7120 con 0x7fd430106f10 2024-09-11T22:02:12.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.694+0000 7fd437b9f640 1 -- 172.21.15.152:0/101709148 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4301021c0 con 0x7fd430106f10 2024-09-11T22:02:12.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.695+0000 7fd426ffd640 1 -- 172.21.15.152:0/101709148 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd42801c070 con 0x7fd430106f10 2024-09-11T22:02:12.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.695+0000 7fd426ffd640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd41c0a2c00 0x7fd41c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:12.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.695+0000 7fd43593b640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd41c0a2c00 0x7fd41c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:12.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.696+0000 7fd426ffd640 1 -- 172.21.15.152:0/101709148 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fd4280ce160 con 0x7fd430106f10 2024-09-11T22:02:12.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.696+0000 7fd43593b640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd41c0a2c00 0x7fd41c0a50c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd42c005ab0 tx=0x7fd42c005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:12.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.699+0000 7fd426ffd640 1 -- 172.21.15.152:0/101709148 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd42809b560 con 0x7fd430106f10 2024-09-11T22:02:12.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.900+0000 7fd437b9f640 1 -- 172.21.15.152:0/101709148 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd430109b60 con 0x7fd430106f10 2024-09-11T22:02:12.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.900+0000 7fd426ffd640 1 -- 172.21.15.152:0/101709148 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5572 (secure 0 0 0) 0x7fd42809ae60 con 0x7fd430106f10 2024-09-11T22:02:12.902 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:12.902 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":7,"btime":"2024-09-11T22:02:12:345628+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-11T22:02:12.904 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 7 2024-09-11T22:02:12.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 -- 172.21.15.152:0/101709148 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd41c0a2c00 msgr2=0x7fd41c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:12.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd41c0a2c00 0x7fd41c0a50c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd42c005ab0 tx=0x7fd42c005a20 comp rx=0 tx=0).stop 2024-09-11T22:02:12.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 -- 172.21.15.152:0/101709148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd430106f10 msgr2=0x7fd430074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:12.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd430106f10 0x7fd430074f70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd42800b970 tx=0x7fd42800be30 comp rx=0 tx=0).stop 2024-09-11T22:02:12.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 -- 172.21.15.152:0/101709148 shutdown_connections 2024-09-11T22:02:12.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd430106f10 0x7fd430074f70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:12.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd430102790 0x7fd430074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:12.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd41c0a2c00 0x7fd41c0a50c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:12.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 --2- 172.21.15.152:0/101709148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd430101de0 0x7fd4300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:12.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 -- 172.21.15.152:0/101709148 >> 172.21.15.152:0/101709148 conn(0x7fd4300fd8c0 msgr2=0x7fd4300fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:12.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 -- 172.21.15.152:0/101709148 shutdown_connections 2024-09-11T22:02:12.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:12.903+0000 7fd437b9f640 1 -- 172.21.15.152:0/101709148 wait complete. 2024-09-11T22:02:12.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:12.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:12.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:12.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:12.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:12.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:12.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:12 smithi152 ceph-mon[31188]: Deploying daemon mds.c on smithi193 2024-09-11T22:02:12.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:12 smithi152 ceph-mon[31188]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:12.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:12 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.193:6834/714804093,v1:172.21.15.193:6835/714804093] up:boot 2024-09-11T22:02:12.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:12 smithi152 ceph-mon[31188]: fsmap 6 up:standby 2024-09-11T22:02:12.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:12 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:02:13.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:12 smithi179 ceph-mon[35603]: Deploying daemon mds.c on smithi193 2024-09-11T22:02:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:12 smithi179 ceph-mon[35603]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:12 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.193:6834/714804093,v1:172.21.15.193:6835/714804093] up:boot 2024-09-11T22:02:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:12 smithi179 ceph-mon[35603]: fsmap 6 up:standby 2024-09-11T22:02:13.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:12 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:02:13.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:13.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:13.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:12 smithi193 ceph-mon[35545]: Deploying daemon mds.c on smithi193 2024-09-11T22:02:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:12 smithi193 ceph-mon[35545]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:12 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.193:6834/714804093,v1:172.21.15.193:6835/714804093] up:boot 2024-09-11T22:02:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:12 smithi193 ceph-mon[35545]: fsmap 6 up:standby 2024-09-11T22:02:13.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:12 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:02:13.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:13 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/101709148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:13.992 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:13 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/101709148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:14.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:13 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/101709148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:14.326 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 11 22:02:14 smithi193 systemd[1]: Started Ceph mds.c for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:02:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:15 smithi152 ceph-mon[31188]: Deploying daemon mds.h on smithi179 2024-09-11T22:02:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:15 smithi152 ceph-mon[31188]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:15.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:15 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] up:boot 2024-09-11T22:02:15.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:15 smithi152 ceph-mon[31188]: fsmap 7 up:standby 2024-09-11T22:02:15.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:15 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:02:15.501 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:15.501 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:15.501 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:15.501 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:15.501 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:15.501 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:15.501 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:15 smithi179 ceph-mon[35603]: Deploying daemon mds.h on smithi179 2024-09-11T22:02:15.501 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:15 smithi179 ceph-mon[35603]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:15.501 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:15 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] up:boot 2024-09-11T22:02:15.501 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:15 smithi179 ceph-mon[35603]: fsmap 7 up:standby 2024-09-11T22:02:15.501 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:15 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:02:15.544 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:02:15.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:15.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:15.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:15.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:15.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:15.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:15.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:15 smithi193 ceph-mon[35545]: Deploying daemon mds.h on smithi179 2024-09-11T22:02:15.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:15 smithi193 ceph-mon[35545]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:15.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:15 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] up:boot 2024-09-11T22:02:15.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:15 smithi193 ceph-mon[35545]: fsmap 7 up:standby 2024-09-11T22:02:15.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:15 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:02:15.805 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:16.220 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:02:16 smithi179 systemd[1]: Starting Ceph mds.h for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:02:16.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.284+0000 7ff6e1406640 1 -- 172.21.15.152:0/2263006929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc102de0 msgr2=0x7ff6dc1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:16.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.284+0000 7ff6e1406640 1 --2- 172.21.15.152:0/2263006929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc102de0 0x7ff6dc1031c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009900 tx=0x7ff6cc02a480 comp rx=0 tx=0).stop 2024-09-11T22:02:16.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.284+0000 7ff6e1406640 1 -- 172.21.15.152:0/2263006929 shutdown_connections 2024-09-11T22:02:16.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.284+0000 7ff6e1406640 1 --2- 172.21.15.152:0/2263006929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6dc10c180 0x7ff6dc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:16.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.284+0000 7ff6e1406640 1 --2- 172.21.15.152:0/2263006929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6dc103700 0x7ff6dc10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.284+0000 7ff6e1406640 1 --2- 172.21.15.152:0/2263006929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc102de0 0x7ff6dc1031c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.284+0000 7ff6e1406640 1 -- 172.21.15.152:0/2263006929 >> 172.21.15.152:0/2263006929 conn(0x7ff6dc0fc7a0 msgr2=0x7ff6dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.284+0000 7ff6e1406640 1 -- 172.21.15.152:0/2263006929 shutdown_connections 2024-09-11T22:02:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.284+0000 7ff6e1406640 1 -- 172.21.15.152:0/2263006929 wait complete. 2024-09-11T22:02:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6e1406640 1 Processor -- start 2024-09-11T22:02:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6e1406640 1 -- start start 2024-09-11T22:02:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6e1406640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6dc102de0 0x7ff6dc19f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6e1406640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6dc103700 0x7ff6dc19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6e1406640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10c180 0x7ff6dc10af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6e1406640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc111fd0 con 0x7ff6dc10c180 2024-09-11T22:02:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6e1406640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc111e50 con 0x7ff6dc103700 2024-09-11T22:02:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6e1406640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc112150 con 0x7ff6dc102de0 2024-09-11T22:02:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6db7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10c180 0x7ff6dc10af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6db7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10c180 0x7ff6dc10af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56518/0 (socket says 172.21.15.152:56518) 2024-09-11T22:02:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6db7fe640 1 -- 172.21.15.152:0/2969020385 learned_addr learned my addr 172.21.15.152:0/2969020385 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6d3fff640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6dc103700 0x7ff6dc19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.285+0000 7ff6daffd640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6dc102de0 0x7ff6dc19f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.286+0000 7ff6db7fe640 1 -- 172.21.15.152:0/2969020385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6dc102de0 msgr2=0x7ff6dc19f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.286+0000 7ff6db7fe640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6dc102de0 0x7ff6dc19f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.286+0000 7ff6db7fe640 1 -- 172.21.15.152:0/2969020385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6dc103700 msgr2=0x7ff6dc19f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.286+0000 7ff6db7fe640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6dc103700 0x7ff6dc19f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.286+0000 7ff6db7fe640 1 -- 172.21.15.152:0/2969020385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc10b840 con 0x7ff6dc10c180 2024-09-11T22:02:16.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.286+0000 7ff6db7fe640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10c180 0x7ff6dc10af80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400b970 tx=0x7ff6d400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:16.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.286+0000 7ff6d8ff9640 1 -- 172.21.15.152:0/2969020385 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4019070 con 0x7ff6dc10c180 2024-09-11T22:02:16.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.286+0000 7ff6d8ff9640 1 -- 172.21.15.152:0/2969020385 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6d400cb40 con 0x7ff6dc10c180 2024-09-11T22:02:16.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.286+0000 7ff6d8ff9640 1 -- 172.21.15.152:0/2969020385 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4007650 con 0x7ff6dc10c180 2024-09-11T22:02:16.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.286+0000 7ff6e1406640 1 -- 172.21.15.152:0/2969020385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc10bb30 con 0x7ff6dc10c180 2024-09-11T22:02:16.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.286+0000 7ff6e1406640 1 -- 172.21.15.152:0/2969020385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc19ad20 con 0x7ff6dc10c180 2024-09-11T22:02:16.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.287+0000 7ff6e1406640 1 -- 172.21.15.152:0/2969020385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6dc1031c0 con 0x7ff6dc10c180 2024-09-11T22:02:16.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.288+0000 7ff6d8ff9640 1 -- 172.21.15.152:0/2969020385 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff6d401c070 con 0x7ff6dc10c180 2024-09-11T22:02:16.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.289+0000 7ff6d8ff9640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6c80a2b80 0x7ff6c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:16.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.289+0000 7ff6daffd640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6c80a2b80 0x7ff6c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:16.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.289+0000 7ff6d8ff9640 1 -- 172.21.15.152:0/2969020385 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff6d40ce640 con 0x7ff6dc10c180 2024-09-11T22:02:16.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.290+0000 7ff6daffd640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6c80a2b80 0x7ff6c80a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009230 tx=0x7ff6cc0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:16.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.292+0000 7ff6d8ff9640 1 -- 172.21.15.152:0/2969020385 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6d409b3f0 con 0x7ff6dc10c180 2024-09-11T22:02:16.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.501+0000 7ff6e1406640 1 -- 172.21.15.152:0/2969020385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6dc197650 con 0x7ff6dc10c180 2024-09-11T22:02:16.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.502+0000 7ff6d8ff9640 1 -- 172.21.15.152:0/2969020385 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6400 (secure 0 0 0) 0x7ff6d409f6f0 con 0x7ff6dc10c180 2024-09-11T22:02:16.503 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:16.503 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":8,"btime":"2024-09-11T22:02:14:732188+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-11T22:02:16.503 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 8 2024-09-11T22:02:16.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 -- 172.21.15.152:0/2969020385 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6c80a2b80 msgr2=0x7ff6c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:16.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6c80a2b80 0x7ff6c80a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009230 tx=0x7ff6cc0058d0 comp rx=0 tx=0).stop 2024-09-11T22:02:16.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 -- 172.21.15.152:0/2969020385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10c180 msgr2=0x7ff6dc10af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:16.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10c180 0x7ff6dc10af80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400b970 tx=0x7ff6d400be30 comp rx=0 tx=0).stop 2024-09-11T22:02:16.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 -- 172.21.15.152:0/2969020385 shutdown_connections 2024-09-11T22:02:16.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10c180 0x7ff6dc10af80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:16.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6dc103700 0x7ff6dc19f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:16.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6c80a2b80 0x7ff6c80a5040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:16.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 --2- 172.21.15.152:0/2969020385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6dc102de0 0x7ff6dc19f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:16.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 -- 172.21.15.152:0/2969020385 >> 172.21.15.152:0/2969020385 conn(0x7ff6dc0fc7a0 msgr2=0x7ff6dc1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:16.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 -- 172.21.15.152:0/2969020385 shutdown_connections 2024-09-11T22:02:16.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:16.504+0000 7ff6e1406640 1 -- 172.21.15.152:0/2969020385 wait complete. 2024-09-11T22:02:16.506 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:02:16 smithi179 podman[65577]: 2024-09-11 22:02:16.219971925 +0000 UTC m=+0.109923553 container create 94f6f814d27f5843842a3e68c407dfacbcd9090975062de2cf538972866659f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-11T22:02:16.507 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:02:16 smithi179 podman[65577]: 2024-09-11 22:02:16.125903167 +0000 UTC m=+0.015854815 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:02:16.507 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:02:16 smithi179 podman[65577]: 2024-09-11 22:02:16.406177399 +0000 UTC m=+0.296129036 container init 94f6f814d27f5843842a3e68c407dfacbcd9090975062de2cf538972866659f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-11T22:02:16.507 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:02:16 smithi179 podman[65577]: 2024-09-11 22:02:16.40894631 +0000 UTC m=+0.298897946 container start 94f6f814d27f5843842a3e68c407dfacbcd9090975062de2cf538972866659f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True) 2024-09-11T22:02:16.507 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:02:16 smithi179 ceph-mds[65596]: -- 172.21.15.179:0/2669976117 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aa30c37860 con 0x55aa30c15000 2024-09-11T22:02:16.507 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:02:16 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h[65592]: starting mds.h at 2024-09-11T22:02:16.507 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:02:16 smithi179 bash[65577]: 94f6f814d27f5843842a3e68c407dfacbcd9090975062de2cf538972866659f5 2024-09-11T22:02:16.796 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:02:16 smithi179 systemd[1]: Started Ceph mds.h for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:02:17.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:17 smithi193 ceph-mon[35545]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:17 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2969020385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:17 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:17 smithi152 ceph-mon[31188]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:17 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2969020385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:17 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:17 smithi179 ceph-mon[35603]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:17 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2969020385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:17.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:17 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:18.549 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:18 smithi193 ceph-mon[35545]: Deploying daemon mds.i on smithi193 2024-09-11T22:02:18.550 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:18 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.179:6836/4020116810,v1:172.21.15.179:6837/4020116810] up:boot 2024-09-11T22:02:18.550 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:18 smithi193 ceph-mon[35545]: fsmap 8 up:standby 2024-09-11T22:02:18.550 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:18 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:02:18.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:18 smithi152 ceph-mon[31188]: Deploying daemon mds.i on smithi193 2024-09-11T22:02:18.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:18 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.179:6836/4020116810,v1:172.21.15.179:6837/4020116810] up:boot 2024-09-11T22:02:18.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:18 smithi152 ceph-mon[31188]: fsmap 8 up:standby 2024-09-11T22:02:18.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:18 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:02:18.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:18 smithi179 ceph-mon[35603]: Deploying daemon mds.i on smithi193 2024-09-11T22:02:18.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:18 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.179:6836/4020116810,v1:172.21.15.179:6837/4020116810] up:boot 2024-09-11T22:02:18.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:18 smithi179 ceph-mon[35603]: fsmap 8 up:standby 2024-09-11T22:02:18.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:18 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:02:18.826 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:02:18 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-i[66721]: starting mds.i at 2024-09-11T22:02:19.326 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:02:18 smithi193 bash[66706]: 889c170855d81085567cf12aaef731f3069646b1ad2d7166e41263a9b239b97e 2024-09-11T22:02:19.326 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:02:18 smithi193 systemd[1]: Started Ceph mds.i for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:02:19.462 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:02:19.588 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:19 smithi152 ceph-mon[31188]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:19.588 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:19 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:19.588 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:19 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:19.588 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:19 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:19.588 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:19 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:19.588 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:19 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:19.588 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:19 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:19.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:19 smithi179 ceph-mon[35603]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:19.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:19 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:19.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:19 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:19.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:19 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:19.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:19 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:19.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:19 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:19.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:19 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:19 smithi193 ceph-mon[35545]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:19 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:19 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:19 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:19 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:19 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:19.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:19 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:20.325 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:20.454 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:20 smithi152 ceph-mon[31188]: Deploying daemon mds.g on smithi152 2024-09-11T22:02:20.455 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:20 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] up:boot 2024-09-11T22:02:20.455 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:20 smithi152 ceph-mon[31188]: fsmap 9 up:standby 2024-09-11T22:02:20.455 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:20 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:02:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:20 smithi179 ceph-mon[35603]: Deploying daemon mds.g on smithi152 2024-09-11T22:02:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:20 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] up:boot 2024-09-11T22:02:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:20 smithi179 ceph-mon[35603]: fsmap 9 up:standby 2024-09-11T22:02:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:20 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:02:20.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:20 smithi193 ceph-mon[35545]: Deploying daemon mds.g on smithi152 2024-09-11T22:02:20.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:20 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] up:boot 2024-09-11T22:02:20.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:20 smithi193 ceph-mon[35545]: fsmap 9 up:standby 2024-09-11T22:02:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:20 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:02:20.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.872+0000 7f3f29512640 1 -- 172.21.15.152:0/1925701575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f24102d30 msgr2=0x7f3f24103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:20.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.872+0000 7f3f29512640 1 --2- 172.21.15.152:0/1925701575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f24102d30 0x7f3f24103110 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009930 tx=0x7f3f1402a420 comp rx=0 tx=0).stop 2024-09-11T22:02:20.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.872+0000 7f3f29512640 1 -- 172.21.15.152:0/1925701575 shutdown_connections 2024-09-11T22:02:20.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.872+0000 7f3f29512640 1 --2- 172.21.15.152:0/1925701575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f241082a0 0x7f3f2410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:20.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.872+0000 7f3f29512640 1 --2- 172.21.15.152:0/1925701575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f241036e0 0x7f3f24107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:20.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.872+0000 7f3f29512640 1 --2- 172.21.15.152:0/1925701575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f24102d30 0x7f3f24103110 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:20.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.872+0000 7f3f29512640 1 -- 172.21.15.152:0/1925701575 >> 172.21.15.152:0/1925701575 conn(0x7f3f240fc7d0 msgr2=0x7f3f240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.872+0000 7f3f29512640 1 -- 172.21.15.152:0/1925701575 shutdown_connections 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.872+0000 7f3f29512640 1 -- 172.21.15.152:0/1925701575 wait complete. 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.872+0000 7f3f29512640 1 Processor -- start 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f29512640 1 -- start start 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f29512640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f24102d30 0x7f3f24100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f29512640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f241036e0 0x7f3f24100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f29512640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f241082a0 0x7f3f24101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f29512640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f241120a0 con 0x7f3f241082a0 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f29512640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f24111f20 con 0x7f3f241036e0 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f29512640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f24112220 con 0x7f3f24102d30 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f237fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f241082a0 0x7f3f24101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:20.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f237fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f241082a0 0x7f3f24101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56522/0 (socket says 172.21.15.152:56522) 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f237fe640 1 -- 172.21.15.152:0/3163897811 learned_addr learned my addr 172.21.15.152:0/3163897811 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f22ffd640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f24102d30 0x7f3f24100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.873+0000 7f3f227fc640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f241036e0 0x7f3f24100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.874+0000 7f3f237fe640 1 -- 172.21.15.152:0/3163897811 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f24102d30 msgr2=0x7f3f24100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.874+0000 7f3f237fe640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f24102d30 0x7f3f24100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.874+0000 7f3f237fe640 1 -- 172.21.15.152:0/3163897811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f241036e0 msgr2=0x7f3f24100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.874+0000 7f3f237fe640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f241036e0 0x7f3f24100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.874+0000 7f3f237fe640 1 -- 172.21.15.152:0/3163897811 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f241a6a80 con 0x7f3f241082a0 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.874+0000 7f3f237fe640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f241082a0 0x7f3f24101410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00eaa0 tx=0x7f3f1c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.874+0000 7f3f0bfff640 1 -- 172.21.15.152:0/3163897811 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c00cdb0 con 0x7f3f241082a0 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.874+0000 7f3f0bfff640 1 -- 172.21.15.152:0/3163897811 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f1c005020 con 0x7f3f241082a0 2024-09-11T22:02:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.874+0000 7f3f29512640 1 -- 172.21.15.152:0/3163897811 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f241a6d70 con 0x7f3f241082a0 2024-09-11T22:02:20.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.874+0000 7f3f0bfff640 1 -- 172.21.15.152:0/3163897811 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0116b0 con 0x7f3f241082a0 2024-09-11T22:02:20.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.874+0000 7f3f29512640 1 -- 172.21.15.152:0/3163897811 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f241a72b0 con 0x7f3f241082a0 2024-09-11T22:02:20.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.875+0000 7f3f29512640 1 -- 172.21.15.152:0/3163897811 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f2406a850 con 0x7f3f241082a0 2024-09-11T22:02:20.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.876+0000 7f3f0bfff640 1 -- 172.21.15.152:0/3163897811 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3f1c005560 con 0x7f3f241082a0 2024-09-11T22:02:20.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.877+0000 7f3f0bfff640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3f0c0a2b80 0x7f3f0c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:20.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.877+0000 7f3f22ffd640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3f0c0a2b80 0x7f3f0c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:20.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.877+0000 7f3f0bfff640 1 -- 172.21.15.152:0/3163897811 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f3f1c0cecd0 con 0x7f3f241082a0 2024-09-11T22:02:20.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.877+0000 7f3f22ffd640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3f0c0a2b80 0x7f3f0c0a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009900 tx=0x7f3f140058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:20.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:20.881+0000 7f3f0bfff640 1 -- 172.21.15.152:0/3163897811 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f1c016030 con 0x7f3f241082a0 2024-09-11T22:02:21.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.103+0000 7f3f29512640 1 -- 172.21.15.152:0/3163897811 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f2410a2b0 con 0x7f3f241082a0 2024-09-11T22:02:21.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.104+0000 7f3f0bfff640 1 -- 172.21.15.152:0/3163897811 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8058 (secure 0 0 0) 0x7f3f1c09ba80 con 0x7f3f241082a0 2024-09-11T22:02:21.105 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:21.105 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":10,"btime":"2024-09-11T22:02:19:334935+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T22:02:21.106 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 10 2024-09-11T22:02:21.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 -- 172.21.15.152:0/3163897811 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3f0c0a2b80 msgr2=0x7f3f0c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:21.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3f0c0a2b80 0x7f3f0c0a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009900 tx=0x7f3f140058d0 comp rx=0 tx=0).stop 2024-09-11T22:02:21.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 -- 172.21.15.152:0/3163897811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f241082a0 msgr2=0x7f3f24101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:21.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f241082a0 0x7f3f24101410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00eaa0 tx=0x7f3f1c00ef60 comp rx=0 tx=0).stop 2024-09-11T22:02:21.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 -- 172.21.15.152:0/3163897811 shutdown_connections 2024-09-11T22:02:21.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f241082a0 0x7f3f24101410 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:21.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f241036e0 0x7f3f24100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:21.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3f0c0a2b80 0x7f3f0c0a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:21.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 --2- 172.21.15.152:0/3163897811 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f24102d30 0x7f3f24100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:21.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 -- 172.21.15.152:0/3163897811 >> 172.21.15.152:0/3163897811 conn(0x7f3f240fc7d0 msgr2=0x7f3f24105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:21.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 -- 172.21.15.152:0/3163897811 shutdown_connections 2024-09-11T22:02:21.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:21.106+0000 7f3f29512640 1 -- 172.21.15.152:0/3163897811 wait complete. 2024-09-11T22:02:21.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:21 smithi152 ceph-mon[31188]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:21.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:21 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3163897811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:21 smithi179 ceph-mon[35603]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:21 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3163897811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:21 smithi193 ceph-mon[35545]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:21 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3163897811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:23.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:23.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:23.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:23.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:23.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:23.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:23.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:22 smithi152 ceph-mon[31188]: Deploying daemon mds.a on smithi152 2024-09-11T22:02:23.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:22 smithi152 ceph-mon[31188]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:23.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:22 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.152:6838/2282340650,v1:172.21.15.152:6839/2282340650] up:boot 2024-09-11T22:02:23.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:22 smithi152 ceph-mon[31188]: fsmap 10 up:standby 2024-09-11T22:02:23.231 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:22 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:02:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:22 smithi179 ceph-mon[35603]: Deploying daemon mds.a on smithi152 2024-09-11T22:02:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:22 smithi179 ceph-mon[35603]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:22 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.152:6838/2282340650,v1:172.21.15.152:6839/2282340650] up:boot 2024-09-11T22:02:23.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:22 smithi179 ceph-mon[35603]: fsmap 10 up:standby 2024-09-11T22:02:23.298 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:22 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:02:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:22 smithi193 ceph-mon[35545]: Deploying daemon mds.a on smithi152 2024-09-11T22:02:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:22 smithi193 ceph-mon[35545]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:22 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.152:6838/2282340650,v1:172.21.15.152:6839/2282340650] up:boot 2024-09-11T22:02:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:22 smithi193 ceph-mon[35545]: fsmap 10 up:standby 2024-09-11T22:02:23.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:22 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:02:23.980 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:02:23 smithi152 systemd[1]: Starting Ceph mds.a for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:02:24.021 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:02:24.317 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:02:24 smithi152 podman[71534]: 2024-09-11 22:02:23.936383327 +0000 UTC m=+0.016282398 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:02:24.317 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:02:24 smithi152 podman[71534]: 2024-09-11 22:02:24.0527297 +0000 UTC m=+0.132628762 container create c77ce75b8c2129c7f8d7360765616921c6217c4ede32dcd9609188fee695e161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-a, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-11T22:02:24.317 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:02:24 smithi152 podman[71534]: 2024-09-11 22:02:24.317081217 +0000 UTC m=+0.396980284 container init c77ce75b8c2129c7f8d7360765616921c6217c4ede32dcd9609188fee695e161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-11T22:02:24.493 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:24.615 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:02:24 smithi152 podman[71534]: 2024-09-11 22:02:24.3203738 +0000 UTC m=+0.400272863 container start c77ce75b8c2129c7f8d7360765616921c6217c4ede32dcd9609188fee695e161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T22:02:24.616 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:02:24 smithi152 ceph-mds[71584]: -- 172.21.15.152:0/1521741886 <== mon.0 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c6f693860 con 0x556c6f671400 2024-09-11T22:02:24.616 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:02:24 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-a[71567]: starting mds.a at 2024-09-11T22:02:24.616 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:02:24 smithi152 bash[71534]: c77ce75b8c2129c7f8d7360765616921c6217c4ede32dcd9609188fee695e161 2024-09-11T22:02:24.616 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:02:24 smithi152 systemd[1]: Started Ceph mds.a for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:02:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.967+0000 7f80f9725640 1 -- 172.21.15.152:0/2403971910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80f4102ef0 msgr2=0x7f80f410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.967+0000 7f80f9725640 1 --2- 172.21.15.152:0/2403971910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80f4102ef0 0x7f80f410da40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009ca0 tx=0x7f80ec02a950 comp rx=0 tx=0).stop 2024-09-11T22:02:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.967+0000 7f80f9725640 1 -- 172.21.15.152:0/2403971910 shutdown_connections 2024-09-11T22:02:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.967+0000 7f80f9725640 1 --2- 172.21.15.152:0/2403971910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80f4102ef0 0x7f80f410da40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.967+0000 7f80f9725640 1 --2- 172.21.15.152:0/2403971910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80f4102570 0x7f80f41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.967+0000 7f80f9725640 1 --2- 172.21.15.152:0/2403971910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80f4100e20 0x7f80f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.967+0000 7f80f9725640 1 -- 172.21.15.152:0/2403971910 >> 172.21.15.152:0/2403971910 conn(0x7f80f40fc7d0 msgr2=0x7f80f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.967+0000 7f80f9725640 1 -- 172.21.15.152:0/2403971910 shutdown_connections 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.967+0000 7f80f9725640 1 -- 172.21.15.152:0/2403971910 wait complete. 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.967+0000 7f80f9725640 1 Processor -- start 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.967+0000 7f80f9725640 1 -- start start 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f9725640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80f4100e20 0x7f80f41971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f9725640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80f4102570 0x7f80f41976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f9725640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80f4102ef0 0x7f80f4197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f9725640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f80f4110f80 con 0x7f80f4102ef0 2024-09-11T22:02:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f9725640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f80f4110e00 con 0x7f80f4102570 2024-09-11T22:02:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f9725640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f80f4111100 con 0x7f80f4100e20 2024-09-11T22:02:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80f4102ef0 0x7f80f4197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80f4102ef0 0x7f80f4197c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48468/0 (socket says 172.21.15.152:48468) 2024-09-11T22:02:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f37fe640 1 -- 172.21.15.152:0/2822055870 learned_addr learned my addr 172.21.15.152:0/2822055870 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f2ffd640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80f4100e20 0x7f80f41971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80ea7fc640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80f4102570 0x7f80f41976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f37fe640 1 -- 172.21.15.152:0/2822055870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80f4100e20 msgr2=0x7f80f41971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f37fe640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80f4100e20 0x7f80f41971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f37fe640 1 -- 172.21.15.152:0/2822055870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80f4102570 msgr2=0x7f80f41976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f37fe640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80f4102570 0x7f80f41976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f37fe640 1 -- 172.21.15.152:0/2822055870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f41a6a10 con 0x7f80f4102ef0 2024-09-11T22:02:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80ea7fc640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80f4102570 0x7f80f41976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:02:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f37fe640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80f4102ef0 0x7f80f4197c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f80ec006010 tx=0x7f80ec02f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.968+0000 7f80f0ff9640 1 -- 172.21.15.152:0/2822055870 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec034040 con 0x7f80f4102ef0 2024-09-11T22:02:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.969+0000 7f80f0ff9640 1 -- 172.21.15.152:0/2822055870 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80ec003e00 con 0x7f80f4102ef0 2024-09-11T22:02:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.969+0000 7f80f9725640 1 -- 172.21.15.152:0/2822055870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f41a6ca0 con 0x7f80f4102ef0 2024-09-11T22:02:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.969+0000 7f80f0ff9640 1 -- 172.21.15.152:0/2822055870 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec045480 con 0x7f80f4102ef0 2024-09-11T22:02:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.969+0000 7f80f9725640 1 -- 172.21.15.152:0/2822055870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f41a7180 con 0x7f80f4102ef0 2024-09-11T22:02:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.970+0000 7f80f9725640 1 -- 172.21.15.152:0/2822055870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f4101200 con 0x7f80f4102ef0 2024-09-11T22:02:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.971+0000 7f80f0ff9640 1 -- 172.21.15.152:0/2822055870 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f80ec037020 con 0x7f80f4102ef0 2024-09-11T22:02:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.971+0000 7f80f0ff9640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80e00a2b80 0x7f80e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.972+0000 7f80f2ffd640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80e00a2b80 0x7f80e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.972+0000 7f80f0ff9640 1 -- 172.21.15.152:0/2822055870 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f80ec0efdc0 con 0x7f80f4102ef0 2024-09-11T22:02:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.972+0000 7f80f2ffd640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80e00a2b80 0x7f80e00a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f80e40058c0 tx=0x7f80e400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:24.976+0000 7f80f0ff9640 1 -- 172.21.15.152:0/2822055870 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80ec0bd120 con 0x7f80f4102ef0 2024-09-11T22:02:25.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.176+0000 7f80f9725640 1 -- 172.21.15.152:0/2822055870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80f41090c0 con 0x7f80f4102ef0 2024-09-11T22:02:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.177+0000 7f80f0ff9640 1 -- 172.21.15.152:0/2822055870 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8887 (secure 0 0 0) 0x7f80ec0bca20 con 0x7f80f4102ef0 2024-09-11T22:02:25.222 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:25.222 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":11,"btime":"2024-09-11T22:02:22:347639+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T22:02:25.222 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 -- 172.21.15.152:0/2822055870 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80e00a2b80 msgr2=0x7f80e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80e00a2b80 0x7f80e00a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f80e40058c0 tx=0x7f80e400a2d0 comp rx=0 tx=0).stop 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 -- 172.21.15.152:0/2822055870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80f4102ef0 msgr2=0x7f80f4197c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80f4102ef0 0x7f80f4197c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f80ec006010 tx=0x7f80ec02f6f0 comp rx=0 tx=0).stop 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 -- 172.21.15.152:0/2822055870 shutdown_connections 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80f4102ef0 0x7f80f4197c20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80f4102570 0x7f80f41976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80e00a2b80 0x7f80e00a5040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 --2- 172.21.15.152:0/2822055870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80f4100e20 0x7f80f41971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 -- 172.21.15.152:0/2822055870 >> 172.21.15.152:0/2822055870 conn(0x7f80f40fc7d0 msgr2=0x7f80f41068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 -- 172.21.15.152:0/2822055870 shutdown_connections 2024-09-11T22:02:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:25.179+0000 7f80f9725640 1 -- 172.21.15.152:0/2822055870 wait complete. 2024-09-11T22:02:25.465 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:25 smithi152 ceph-mon[31188]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:25.466 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:25.466 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:25.466 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:25.466 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:25.466 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:25.466 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:25 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:25.466 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:25 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2822055870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:25.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:25 smithi179 ceph-mon[35603]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:25.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:25.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:25.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:25.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:25.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:25.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:25 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:25.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:25 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2822055870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:25 smithi193 ceph-mon[35545]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:25.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:02:25.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:02:25.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:25 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:25.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:25 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2822055870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:26.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:26 smithi179 ceph-mon[35603]: Deploying daemon mds.b on smithi179 2024-09-11T22:02:26.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:26 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.152:6840/1149066093,v1:172.21.15.152:6841/1149066093] up:boot 2024-09-11T22:02:26.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:26 smithi179 ceph-mon[35603]: fsmap 11 up:standby 2024-09-11T22:02:26.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:26 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:02:26.547 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:02:26 smithi179 systemd[1]: Starting Ceph mds.b for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:02:26.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:26 smithi152 ceph-mon[31188]: Deploying daemon mds.b on smithi179 2024-09-11T22:02:26.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:26 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.152:6840/1149066093,v1:172.21.15.152:6841/1149066093] up:boot 2024-09-11T22:02:26.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:26 smithi152 ceph-mon[31188]: fsmap 11 up:standby 2024-09-11T22:02:26.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:26 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:02:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:26 smithi193 ceph-mon[35545]: Deploying daemon mds.b on smithi179 2024-09-11T22:02:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:26 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.152:6840/1149066093,v1:172.21.15.152:6841/1149066093] up:boot 2024-09-11T22:02:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:26 smithi193 ceph-mon[35545]: fsmap 11 up:standby 2024-09-11T22:02:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:26 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:02:26.846 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:02:26 smithi179 podman[65879]: 2024-09-11 22:02:26.495550335 +0000 UTC m=+0.015983582 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:02:26.847 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:02:26 smithi179 podman[65879]: 2024-09-11 22:02:26.617675343 +0000 UTC m=+0.138108583 container create 4f2170899399d5c1a823a3f93213d3894b23b7d796abeced7fbedf21f67cd4e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T22:02:26.847 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:02:26 smithi179 podman[65879]: 2024-09-11 22:02:26.820201955 +0000 UTC m=+0.340635194 container init 4f2170899399d5c1a823a3f93213d3894b23b7d796abeced7fbedf21f67cd4e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T22:02:26.847 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:02:26 smithi179 podman[65879]: 2024-09-11 22:02:26.823345765 +0000 UTC m=+0.343779005 container start 4f2170899399d5c1a823a3f93213d3894b23b7d796abeced7fbedf21f67cd4e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T22:02:26.847 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:02:26 smithi179 ceph-mds[65898]: -- 172.21.15.179:0/1306964396 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f146309860 con 0x55f1462e6800 2024-09-11T22:02:27.296 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:02:26 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b[65894]: starting mds.b at 2024-09-11T22:02:27.296 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:02:27 smithi179 bash[65879]: 4f2170899399d5c1a823a3f93213d3894b23b7d796abeced7fbedf21f67cd4e3 2024-09-11T22:02:27.296 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:02:27 smithi179 systemd[1]: Started Ceph mds.b for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:02:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:27 smithi152 ceph-mon[31188]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:27 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:02:27.734 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:27 smithi179 ceph-mon[35603]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:27.734 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.734 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.735 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.735 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.735 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.735 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:27 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:02:27.786 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:02:27.815 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:27 smithi193 ceph-mon[35545]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:27.815 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.816 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.816 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.816 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.816 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:27.816 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:27 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:02:28.378 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:28.632 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:28 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] up:boot 2024-09-11T22:02:28.632 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:28 smithi152 ceph-mon[31188]: fsmap 12 up:standby 2024-09-11T22:02:28.632 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:28 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:02:28.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:28 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] up:boot 2024-09-11T22:02:28.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:28 smithi179 ceph-mon[35603]: fsmap 12 up:standby 2024-09-11T22:02:28.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:28 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:02:28.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:28 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] up:boot 2024-09-11T22:02:28.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:28 smithi193 ceph-mon[35545]: fsmap 12 up:standby 2024-09-11T22:02:28.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:28 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:02:28.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.824+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2301270296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51f81002f0 msgr2=0x7f51f81006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:28.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.824+0000 7f51fe3ef640 1 --2- 172.21.15.152:0/2301270296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51f81002f0 0x7f51f81006d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009930 tx=0x7f51e802a420 comp rx=0 tx=0).stop 2024-09-11T22:02:28.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.824+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2301270296 shutdown_connections 2024-09-11T22:02:28.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.824+0000 7f51fe3ef640 1 --2- 172.21.15.152:0/2301270296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51f8106f50 0x7f51f810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:28.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.824+0000 7f51fe3ef640 1 --2- 172.21.15.152:0/2301270296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f8100ca0 0x7f51f8106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:28.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.824+0000 7f51fe3ef640 1 --2- 172.21.15.152:0/2301270296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51f81002f0 0x7f51f81006d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:28.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.824+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2301270296 >> 172.21.15.152:0/2301270296 conn(0x7f51f8077210 msgr2=0x7f51f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:28.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.824+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2301270296 shutdown_connections 2024-09-11T22:02:28.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.824+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2301270296 wait complete. 2024-09-11T22:02:28.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51fe3ef640 1 Processor -- start 2024-09-11T22:02:28.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51fe3ef640 1 -- start start 2024-09-11T22:02:28.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51fe3ef640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f81002f0 0x7f51f8101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:28.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51fe3ef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51f8100ca0 0x7f51f81017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:28.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51fe3ef640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51f8106f50 0x7f51f8101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:28.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51fe3ef640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8112000 con 0x7f51f8100ca0 2024-09-11T22:02:28.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51fe3ef640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8111e80 con 0x7f51f81002f0 2024-09-11T22:02:28.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51fe3ef640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8112180 con 0x7f51f8106f50 2024-09-11T22:02:28.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51f77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51f8100ca0 0x7f51f81017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:28.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51f77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51f8100ca0 0x7f51f81017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48484/0 (socket says 172.21.15.152:48484) 2024-09-11T22:02:28.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51f77fe640 1 -- 172.21.15.152:0/2529096285 learned_addr learned my addr 172.21.15.152:0/2529096285 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:28.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.825+0000 7f51fc98c640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51f8106f50 0x7f51f8101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:28.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51f7fff640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f81002f0 0x7f51f8101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:28.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51f77fe640 1 -- 172.21.15.152:0/2529096285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51f8106f50 msgr2=0x7f51f8101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:28.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51f77fe640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51f8106f50 0x7f51f8101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:28.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51f77fe640 1 -- 172.21.15.152:0/2529096285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f81002f0 msgr2=0x7f51f8101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:28.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51f77fe640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f81002f0 0x7f51f8101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:28.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51f77fe640 1 -- 172.21.15.152:0/2529096285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f81a6ad0 con 0x7f51f8100ca0 2024-09-11T22:02:28.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51f77fe640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51f8100ca0 0x7f51f81017b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00b450 tx=0x7f51ec00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:28.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51f57fa640 1 -- 172.21.15.152:0/2529096285 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec015020 con 0x7f51f8100ca0 2024-09-11T22:02:28.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51f57fa640 1 -- 172.21.15.152:0/2529096285 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51ec011d70 con 0x7f51f8100ca0 2024-09-11T22:02:28.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2529096285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f81a6dc0 con 0x7f51f8100ca0 2024-09-11T22:02:28.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51f57fa640 1 -- 172.21.15.152:0/2529096285 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00f340 con 0x7f51f8100ca0 2024-09-11T22:02:28.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.826+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2529096285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f81a7270 con 0x7f51f8100ca0 2024-09-11T22:02:28.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.827+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2529096285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f81006d0 con 0x7f51f8100ca0 2024-09-11T22:02:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.829+0000 7f51f57fa640 1 -- 172.21.15.152:0/2529096285 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f51ec018020 con 0x7f51f8100ca0 2024-09-11T22:02:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.830+0000 7f51f57fa640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51e00a2b80 0x7f51e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.830+0000 7f51f57fa640 1 -- 172.21.15.152:0/2529096285 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f51ec0cea50 con 0x7f51f8100ca0 2024-09-11T22:02:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.830+0000 7f51f7fff640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51e00a2b80 0x7f51e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.830+0000 7f51f7fff640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51e00a2b80 0x7f51e00a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009900 tx=0x7f51e80058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:28.833+0000 7f51f57fa640 1 -- 172.21.15.152:0/2529096285 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51ec01f020 con 0x7f51f8100ca0 2024-09-11T22:02:29.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.044+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2529096285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51f81027a0 con 0x7f51f8100ca0 2024-09-11T22:02:29.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.045+0000 7f51f57fa640 1 -- 172.21.15.152:0/2529096285 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10536 (secure 0 0 0) 0x7f51ec00d040 con 0x7f51f8100ca0 2024-09-11T22:02:29.047 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:29.047 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":13,"btime":"2024-09-11T22:02:27:334085+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T22:02:29.047 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 13 2024-09-11T22:02:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.047+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2529096285 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51e00a2b80 msgr2=0x7f51e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.047+0000 7f51fe3ef640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51e00a2b80 0x7f51e00a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009900 tx=0x7f51e80058d0 comp rx=0 tx=0).stop 2024-09-11T22:02:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.047+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2529096285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51f8100ca0 msgr2=0x7f51f81017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.047+0000 7f51fe3ef640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51f8100ca0 0x7f51f81017b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00b450 tx=0x7f51ec00b910 comp rx=0 tx=0).stop 2024-09-11T22:02:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.047+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2529096285 shutdown_connections 2024-09-11T22:02:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.047+0000 7f51fe3ef640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f51e00a2b80 0x7f51e00a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:29.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.047+0000 7f51fe3ef640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51f8106f50 0x7f51f8101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:29.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.047+0000 7f51fe3ef640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51f8100ca0 0x7f51f81017b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:29.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.047+0000 7f51fe3ef640 1 --2- 172.21.15.152:0/2529096285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f81002f0 0x7f51f8101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:29.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.047+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2529096285 >> 172.21.15.152:0/2529096285 conn(0x7f51f8077210 msgr2=0x7f51f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:29.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.047+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2529096285 shutdown_connections 2024-09-11T22:02:29.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:29.048+0000 7f51fe3ef640 1 -- 172.21.15.152:0/2529096285 wait complete. 2024-09-11T22:02:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2529096285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:29.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:29.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:02:29.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:02:29.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:29 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.760 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:29.760 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.760 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.760 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.760 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.760 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2529096285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:29.761 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.761 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.761 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:29.761 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:02:29.761 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.761 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:02:29.761 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:29 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.763 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-11T22:02:29.781 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:29.781 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.781 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.781 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.781 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.781 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2529096285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:29.781 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:29.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:02:29.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:29.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:02:29.782 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:29 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:30.664 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:31.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.035+0000 7f7452bfb640 1 -- 172.21.15.152:0/659564566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f744c100a80 msgr2=0x7f744c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:31.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.035+0000 7f7452bfb640 1 --2- 172.21.15.152:0/659564566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f744c100a80 0x7f744c100ee0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7438009930 tx=0x7f743802a420 comp rx=0 tx=0).stop 2024-09-11T22:02:31.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.035+0000 7f7452bfb640 1 -- 172.21.15.152:0/659564566 shutdown_connections 2024-09-11T22:02:31.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.035+0000 7f7452bfb640 1 --2- 172.21.15.152:0/659564566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f744c101420 0x7f744c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:31.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.035+0000 7f7452bfb640 1 --2- 172.21.15.152:0/659564566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f744c100a80 0x7f744c100ee0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.035+0000 7f7452bfb640 1 --2- 172.21.15.152:0/659564566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744c106a80 0x7f744c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.035+0000 7f7452bfb640 1 -- 172.21.15.152:0/659564566 >> 172.21.15.152:0/659564566 conn(0x7f744c0fc7a0 msgr2=0x7f744c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.035+0000 7f7452bfb640 1 -- 172.21.15.152:0/659564566 shutdown_connections 2024-09-11T22:02:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.035+0000 7f7452bfb640 1 -- 172.21.15.152:0/659564566 wait complete. 2024-09-11T22:02:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.036+0000 7f7452bfb640 1 Processor -- start 2024-09-11T22:02:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.036+0000 7f7452bfb640 1 -- start start 2024-09-11T22:02:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.036+0000 7f7452bfb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f744c100a80 0x7f744c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.036+0000 7f7452bfb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f744c101420 0x7f744c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.036+0000 7f7452bfb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744c106a80 0x7f744c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.036+0000 7f7452bfb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f744c110e40 con 0x7f744c101420 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.036+0000 7f7452bfb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f744c110cc0 con 0x7f744c106a80 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.036+0000 7f7452bfb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f744c110fc0 con 0x7f744c100a80 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f7450997640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f744c100a80 0x7f744c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f744bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f744c101420 0x7f744c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f7450997640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f744c100a80 0x7f744c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:35916/0 (socket says 172.21.15.152:35916) 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f744bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f744c101420 0x7f744c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48506/0 (socket says 172.21.15.152:48506) 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f7450997640 1 -- 172.21.15.152:0/467119527 learned_addr learned my addr 172.21.15.152:0/467119527 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f7451198640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744c106a80 0x7f744c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f744bfff640 1 -- 172.21.15.152:0/467119527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f744c100a80 msgr2=0x7f744c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f744bfff640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f744c100a80 0x7f744c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:31.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f744bfff640 1 -- 172.21.15.152:0/467119527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744c106a80 msgr2=0x7f744c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:31.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f744bfff640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744c106a80 0x7f744c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:31.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f744bfff640 1 -- 172.21.15.152:0/467119527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744c19d3e0 con 0x7f744c101420 2024-09-11T22:02:31.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f744bfff640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f744c101420 0x7f744c198970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7438005940 tx=0x7f74380040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:31.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f7449ffb640 1 -- 172.21.15.152:0/467119527 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743803f070 con 0x7f744c101420 2024-09-11T22:02:31.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f7449ffb640 1 -- 172.21.15.152:0/467119527 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74380044c0 con 0x7f744c101420 2024-09-11T22:02:31.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f7452bfb640 1 -- 172.21.15.152:0/467119527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744c19d670 con 0x7f744c101420 2024-09-11T22:02:31.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.037+0000 7f7449ffb640 1 -- 172.21.15.152:0/467119527 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7438035070 con 0x7f744c101420 2024-09-11T22:02:31.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.038+0000 7f7452bfb640 1 -- 172.21.15.152:0/467119527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744c1a4fb0 con 0x7f744c101420 2024-09-11T22:02:31.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.039+0000 7f7452bfb640 1 -- 172.21.15.152:0/467119527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f744c1021c0 con 0x7f744c101420 2024-09-11T22:02:31.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.040+0000 7f7449ffb640 1 -- 172.21.15.152:0/467119527 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f743803b460 con 0x7f744c101420 2024-09-11T22:02:31.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.040+0000 7f7449ffb640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f743c0a2b80 0x7f743c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:31.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.041+0000 7f7450997640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f743c0a2b80 0x7f743c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:31.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.041+0000 7f7449ffb640 1 -- 172.21.15.152:0/467119527 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f74380ef090 con 0x7f744c101420 2024-09-11T22:02:31.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.041+0000 7f7450997640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f743c0a2b80 0x7f743c0a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7440005fd0 tx=0x7f744000b480 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:31.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.045+0000 7f7449ffb640 1 -- 172.21.15.152:0/467119527 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f74380bbda0 con 0x7f744c101420 2024-09-11T22:02:31.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.236+0000 7f7452bfb640 1 -- 172.21.15.152:0/467119527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f744c10a050 con 0x7f744c101420 2024-09-11T22:02:31.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.237+0000 7f7449ffb640 1 -- 172.21.15.152:0/467119527 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7f74380c00a0 con 0x7f744c101420 2024-09-11T22:02:31.239 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:31.239 INFO:teuthology.orchestra.run.smithi152.stdout:[ 2024-09-11T22:02:31.239 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:02:31.239 INFO:teuthology.orchestra.run.smithi152.stdout: "poolnum": 1, 2024-09-11T22:02:31.239 INFO:teuthology.orchestra.run.smithi152.stdout: "poolname": ".mgr" 2024-09-11T22:02:31.239 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:02:31.239 INFO:teuthology.orchestra.run.smithi152.stdout:] 2024-09-11T22:02:31.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 -- 172.21.15.152:0/467119527 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f743c0a2b80 msgr2=0x7f743c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:31.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f743c0a2b80 0x7f743c0a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7440005fd0 tx=0x7f744000b480 comp rx=0 tx=0).stop 2024-09-11T22:02:31.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 -- 172.21.15.152:0/467119527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f744c101420 msgr2=0x7f744c198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:31.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f744c101420 0x7f744c198970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7438005940 tx=0x7f74380040c0 comp rx=0 tx=0).stop 2024-09-11T22:02:31.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 -- 172.21.15.152:0/467119527 shutdown_connections 2024-09-11T22:02:31.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744c106a80 0x7f744c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:31.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f744c101420 0x7f744c198970 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:31.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f743c0a2b80 0x7f743c0a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:31.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 --2- 172.21.15.152:0/467119527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f744c100a80 0x7f744c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:31.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 -- 172.21.15.152:0/467119527 >> 172.21.15.152:0/467119527 conn(0x7f744c0fc7a0 msgr2=0x7f744c06aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:31.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 -- 172.21.15.152:0/467119527 shutdown_connections 2024-09-11T22:02:31.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:31.240+0000 7f7452bfb640 1 -- 172.21.15.152:0/467119527 wait complete. 2024-09-11T22:02:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:31 smithi152 ceph-mon[31188]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:31 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:31 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/467119527' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T22:02:31.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:31 smithi179 ceph-mon[35603]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:31.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:31 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:31 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/467119527' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T22:02:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:31 smithi193 ceph-mon[35545]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:31 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:31.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:31 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/467119527' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T22:02:31.890 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:02:31.890 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:02:32.150 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.605+0000 7f23c0b6d640 1 -- 172.21.15.152:0/2784624455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23bc101de0 msgr2=0x7f23bc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.605+0000 7f23c0b6d640 1 --2- 172.21.15.152:0/2784624455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23bc101de0 0x7f23bc1021c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009900 tx=0x7f23ac02a410 comp rx=0 tx=0).stop 2024-09-11T22:02:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.605+0000 7f23c0b6d640 1 -- 172.21.15.152:0/2784624455 shutdown_connections 2024-09-11T22:02:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.605+0000 7f23c0b6d640 1 --2- 172.21.15.152:0/2784624455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23bc106f10 0x7f23bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.605+0000 7f23c0b6d640 1 --2- 172.21.15.152:0/2784624455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23bc102790 0x7f23bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.605+0000 7f23c0b6d640 1 --2- 172.21.15.152:0/2784624455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23bc101de0 0x7f23bc1021c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.605+0000 7f23c0b6d640 1 -- 172.21.15.152:0/2784624455 >> 172.21.15.152:0/2784624455 conn(0x7f23bc0fd8c0 msgr2=0x7f23bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.605+0000 7f23c0b6d640 1 -- 172.21.15.152:0/2784624455 shutdown_connections 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.605+0000 7f23c0b6d640 1 -- 172.21.15.152:0/2784624455 wait complete. 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.606+0000 7f23c0b6d640 1 Processor -- start 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.606+0000 7f23c0b6d640 1 -- start start 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.606+0000 7f23c0b6d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23bc101de0 0x7f23bc19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.606+0000 7f23c0b6d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23bc102790 0x7f23bc19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.606+0000 7f23c0b6d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23bc106f10 0x7f23bc19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.606+0000 7f23c0b6d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc111f70 con 0x7f23bc101de0 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.606+0000 7f23c0b6d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc111df0 con 0x7f23bc102790 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.606+0000 7f23c0b6d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1120f0 con 0x7f23bc106f10 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.606+0000 7f23ba59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23bc101de0 0x7f23bc19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.606+0000 7f23ba59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23bc101de0 0x7f23bc19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48514/0 (socket says 172.21.15.152:48514) 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.606+0000 7f23ba59c640 1 -- 172.21.15.152:0/1843785288 learned_addr learned my addr 172.21.15.152:0/1843785288 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23b3fff640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23bc102790 0x7f23bc19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23bad9d640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23bc106f10 0x7f23bc19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23ba59c640 1 -- 172.21.15.152:0/1843785288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23bc106f10 msgr2=0x7f23bc19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23ba59c640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23bc106f10 0x7f23bc19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23ba59c640 1 -- 172.21.15.152:0/1843785288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23bc102790 msgr2=0x7f23bc19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23ba59c640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23bc102790 0x7f23bc19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23ba59c640 1 -- 172.21.15.152:0/1843785288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc19f660 con 0x7f23bc101de0 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23b3fff640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23bc102790 0x7f23bc19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23ba59c640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23bc101de0 0x7f23bc19a6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f23ac006010 tx=0x7f23ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23b37fe640 1 -- 172.21.15.152:0/1843785288 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac03f030 con 0x7f23bc101de0 2024-09-11T22:02:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23b37fe640 1 -- 172.21.15.152:0/1843785288 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23ac003ce0 con 0x7f23bc101de0 2024-09-11T22:02:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23c0b6d640 1 -- 172.21.15.152:0/1843785288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23bc19f8f0 con 0x7f23bc101de0 2024-09-11T22:02:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23b37fe640 1 -- 172.21.15.152:0/1843785288 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac035070 con 0x7f23bc101de0 2024-09-11T22:02:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.607+0000 7f23c0b6d640 1 -- 172.21.15.152:0/1843785288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23bc1a7230 con 0x7f23bc101de0 2024-09-11T22:02:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.608+0000 7f23c0b6d640 1 -- 172.21.15.152:0/1843785288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23bc1032c0 con 0x7f23bc101de0 2024-09-11T22:02:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.609+0000 7f23b37fe640 1 -- 172.21.15.152:0/1843785288 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f23ac042030 con 0x7f23bc101de0 2024-09-11T22:02:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.610+0000 7f23b37fe640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f23a80a2b80 0x7f23a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.610+0000 7f23b3fff640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f23a80a2b80 0x7f23a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.610+0000 7f23b37fe640 1 -- 172.21.15.152:0/1843785288 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f23ac0ef310 con 0x7f23bc101de0 2024-09-11T22:02:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.611+0000 7f23b3fff640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f23a80a2b80 0x7f23a80a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0fdf80 tx=0x7f23a400b5f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.614+0000 7f23b37fe640 1 -- 172.21.15.152:0/1843785288 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23ac0bc7d0 con 0x7f23bc101de0 2024-09-11T22:02:32.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:32.780+0000 7f23c0b6d640 1 -- 172.21.15.152:0/1843785288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f23bc1a7400 con 0x7f23bc101de0 2024-09-11T22:02:33.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.065+0000 7f23b37fe640 1 -- 172.21.15.152:0/1843785288 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f23ac0bc0d0 con 0x7f23bc101de0 2024-09-11T22:02:33.067 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' created 2024-09-11T22:02:33.067 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:33.067 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:33.067 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:33.067 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:02:33.067 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:33 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:33.068 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:33 smithi152 ceph-mon[31188]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:33.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.067+0000 7f23c0b6d640 1 -- 172.21.15.152:0/1843785288 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f23a80a2b80 msgr2=0x7f23a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:33.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.067+0000 7f23c0b6d640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f23a80a2b80 0x7f23a80a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0fdf80 tx=0x7f23a400b5f0 comp rx=0 tx=0).stop 2024-09-11T22:02:33.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.067+0000 7f23c0b6d640 1 -- 172.21.15.152:0/1843785288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23bc101de0 msgr2=0x7f23bc19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:33.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.067+0000 7f23c0b6d640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23bc101de0 0x7f23bc19a6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f23ac006010 tx=0x7f23ac0042f0 comp rx=0 tx=0).stop 2024-09-11T22:02:33.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.068+0000 7f23c0b6d640 1 -- 172.21.15.152:0/1843785288 shutdown_connections 2024-09-11T22:02:33.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.068+0000 7f23c0b6d640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f23a80a2b80 0x7f23a80a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:33.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.068+0000 7f23c0b6d640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23bc106f10 0x7f23bc19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:33.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.068+0000 7f23c0b6d640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23bc102790 0x7f23bc19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:33.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.068+0000 7f23c0b6d640 1 --2- 172.21.15.152:0/1843785288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23bc101de0 0x7f23bc19a6b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:33.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.068+0000 7f23c0b6d640 1 -- 172.21.15.152:0/1843785288 >> 172.21.15.152:0/1843785288 conn(0x7f23bc0fd8c0 msgr2=0x7f23bc0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:33.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.068+0000 7f23c0b6d640 1 -- 172.21.15.152:0/1843785288 shutdown_connections 2024-09-11T22:02:33.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:33.068+0000 7f23c0b6d640 1 -- 172.21.15.152:0/1843785288 wait complete. 2024-09-11T22:02:33.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:33.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:33.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:33.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:02:33.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:33 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:33.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:33 smithi179 ceph-mon[35603]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:33.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:33.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:33.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:02:33.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:02:33.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:33 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:02:33.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:33 smithi193 ceph-mon[35545]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:33.720 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:02:33.969 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:34.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:34 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1843785288' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:02:34.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:34 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1843785288' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T22:02:34.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:34 smithi179 ceph-mon[35603]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T22:02:34.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:34 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1843785288' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:02:34.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:34 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1843785288' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T22:02:34.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:34 smithi193 ceph-mon[35545]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T22:02:34.346 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:34 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1843785288' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:02:34.346 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:34 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1843785288' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T22:02:34.346 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:34 smithi152 ceph-mon[31188]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T22:02:34.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.432+0000 7f2ec551c640 1 -- 172.21.15.152:0/1820716787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec0100a80 msgr2=0x7f2ec0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:34.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.432+0000 7f2ec551c640 1 --2- 172.21.15.152:0/1820716787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec0100a80 0x7f2ec0100ee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009930 tx=0x7f2ea802a420 comp rx=0 tx=0).stop 2024-09-11T22:02:34.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.432+0000 7f2ec551c640 1 -- 172.21.15.152:0/1820716787 shutdown_connections 2024-09-11T22:02:34.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.432+0000 7f2ec551c640 1 --2- 172.21.15.152:0/1820716787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ec0101420 0x7f2ec010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:34.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.432+0000 7f2ec551c640 1 --2- 172.21.15.152:0/1820716787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec0100a80 0x7f2ec0100ee0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:34.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.432+0000 7f2ec551c640 1 --2- 172.21.15.152:0/1820716787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ec0106a80 0x7f2ec0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:34.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.432+0000 7f2ec551c640 1 -- 172.21.15.152:0/1820716787 >> 172.21.15.152:0/1820716787 conn(0x7f2ec00fc7a0 msgr2=0x7f2ec00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:34.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.432+0000 7f2ec551c640 1 -- 172.21.15.152:0/1820716787 shutdown_connections 2024-09-11T22:02:34.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.432+0000 7f2ec551c640 1 -- 172.21.15.152:0/1820716787 wait complete. 2024-09-11T22:02:34.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ec551c640 1 Processor -- start 2024-09-11T22:02:34.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ec551c640 1 -- start start 2024-09-11T22:02:34.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ec551c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ec0100a80 0x7f2ec0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ec551c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ec0101420 0x7f2ec0199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ec551c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec0106a80 0x7f2ec01a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ec551c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0110ed0 con 0x7f2ec0106a80 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ec551c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0110d50 con 0x7f2ec0100a80 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ec551c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0111050 con 0x7f2ec0101420 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ebf7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec0106a80 0x7f2ec01a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ebf7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec0106a80 0x7f2ec01a43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38662/0 (socket says 172.21.15.152:38662) 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ebf7fe640 1 -- 172.21.15.152:0/2529313619 learned_addr learned my addr 172.21.15.152:0/2529313619 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2eb7fff640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ec0101420 0x7f2ec0199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ebeffd640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ec0100a80 0x7f2ec0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ebf7fe640 1 -- 172.21.15.152:0/2529313619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ec0101420 msgr2=0x7f2ec0199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ebf7fe640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ec0101420 0x7f2ec0199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ebf7fe640 1 -- 172.21.15.152:0/2529313619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ec0100a80 msgr2=0x7f2ec0199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ebf7fe640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ec0100a80 0x7f2ec0199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ebf7fe640 1 -- 172.21.15.152:0/2529313619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec01a48e0 con 0x7f2ec0106a80 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ebf7fe640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec0106a80 0x7f2ec01a43a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009fd0 tx=0x7f2eb800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.433+0000 7f2ebcff9640 1 -- 172.21.15.152:0/2529313619 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8017070 con 0x7f2ec0106a80 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.434+0000 7f2ebcff9640 1 -- 172.21.15.152:0/2529313619 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2eb8003e50 con 0x7f2ec0106a80 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.434+0000 7f2ebcff9640 1 -- 172.21.15.152:0/2529313619 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80106c0 con 0x7f2ec0106a80 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.434+0000 7f2ec551c640 1 -- 172.21.15.152:0/2529313619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec01a4ab0 con 0x7f2ec0106a80 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.434+0000 7f2ec551c640 1 -- 172.21.15.152:0/2529313619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec01a4f70 con 0x7f2ec0106a80 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.435+0000 7f2ec551c640 1 -- 172.21.15.152:0/2529313619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec0100ee0 con 0x7f2ec0106a80 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.436+0000 7f2ebcff9640 1 -- 172.21.15.152:0/2529313619 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2eb8003970 con 0x7f2ec0106a80 2024-09-11T22:02:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.436+0000 7f2ebcff9640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f2eac0a2c00 0x7f2eac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:34.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.436+0000 7f2ebeffd640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f2eac0a2c00 0x7f2eac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:34.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.436+0000 7f2ebcff9640 1 -- 172.21.15.152:0/2529313619 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7f2eb80ce980 con 0x7f2ec0106a80 2024-09-11T22:02:34.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.437+0000 7f2ebeffd640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f2eac0a2c00 0x7f2eac0a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009b50 tx=0x7f2eb0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:34.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.440+0000 7f2ebcff9640 1 -- 172.21.15.152:0/2529313619 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2eb809b640 con 0x7f2ec0106a80 2024-09-11T22:02:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:34.604+0000 7f2ec551c640 1 -- 172.21.15.152:0/2529313619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2ec0108ff0 con 0x7f2ec0106a80 2024-09-11T22:02:35.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.073+0000 7f2ebcff9640 1 -- 172.21.15.152:0/2529313619 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) ==== 170+0+0 (secure 0 0 0) 0x7f2eb8097030 con 0x7f2ec0106a80 2024-09-11T22:02:35.074 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' created 2024-09-11T22:02:35.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 -- 172.21.15.152:0/2529313619 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f2eac0a2c00 msgr2=0x7f2eac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:35.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f2eac0a2c00 0x7f2eac0a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009b50 tx=0x7f2eb0005f90 comp rx=0 tx=0).stop 2024-09-11T22:02:35.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 -- 172.21.15.152:0/2529313619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec0106a80 msgr2=0x7f2ec01a43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:35.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec0106a80 0x7f2ec01a43a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009fd0 tx=0x7f2eb800b260 comp rx=0 tx=0).stop 2024-09-11T22:02:35.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 -- 172.21.15.152:0/2529313619 shutdown_connections 2024-09-11T22:02:35.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec0106a80 0x7f2ec01a43a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:35.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f2eac0a2c00 0x7f2eac0a50c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:35.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ec0101420 0x7f2ec0199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:35.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 --2- 172.21.15.152:0/2529313619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ec0100a80 0x7f2ec0199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:35.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 -- 172.21.15.152:0/2529313619 >> 172.21.15.152:0/2529313619 conn(0x7f2ec00fc7a0 msgr2=0x7f2ec00fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:35.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 -- 172.21.15.152:0/2529313619 shutdown_connections 2024-09-11T22:02:35.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:35.076+0000 7f2ec551c640 1 -- 172.21.15.152:0/2529313619 wait complete. 2024-09-11T22:02:35.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:35 smithi193 ceph-mon[35545]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T22:02:35.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:35 smithi193 ceph-mon[35545]: pgmap v269: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:35.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:35 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2529313619' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:02:35.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:35 smithi152 ceph-mon[31188]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T22:02:35.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:35 smithi152 ceph-mon[31188]: pgmap v269: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:35.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:35 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2529313619' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:02:35.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:35 smithi179 ceph-mon[35603]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T22:02:35.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:35 smithi179 ceph-mon[35603]: pgmap v269: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:35.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:35 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2529313619' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:02:35.637 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:02:35.886 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:36.310 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:36 smithi152 ceph-mon[31188]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:02:36.310 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:36 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2529313619' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T22:02:36.310 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:36 smithi152 ceph-mon[31188]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T22:02:36.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:36 smithi193 ceph-mon[35545]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:02:36.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:36 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2529313619' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T22:02:36.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:36 smithi193 ceph-mon[35545]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T22:02:36.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.326+0000 7f3b9b447640 1 -- 172.21.15.152:0/1791553925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b94105560 msgr2=0x7f3b9410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:36.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.326+0000 7f3b9b447640 1 --2- 172.21.15.152:0/1791553925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b94105560 0x7f3b9410d0e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009900 tx=0x7f3b8c02a410 comp rx=0 tx=0).stop 2024-09-11T22:02:36.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.326+0000 7f3b9b447640 1 -- 172.21.15.152:0/1791553925 shutdown_connections 2024-09-11T22:02:36.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.326+0000 7f3b9b447640 1 --2- 172.21.15.152:0/1791553925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b94105560 0x7f3b9410d0e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:36.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.326+0000 7f3b9b447640 1 --2- 172.21.15.152:0/1791553925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b94100de0 0x7f3b94104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:36.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.326+0000 7f3b9b447640 1 --2- 172.21.15.152:0/1791553925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b94100430 0x7f3b94100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:36.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.326+0000 7f3b9b447640 1 -- 172.21.15.152:0/1791553925 >> 172.21.15.152:0/1791553925 conn(0x7f3b94077230 msgr2=0x7f3b940fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:36.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.326+0000 7f3b9b447640 1 -- 172.21.15.152:0/1791553925 shutdown_connections 2024-09-11T22:02:36.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.326+0000 7f3b9b447640 1 -- 172.21.15.152:0/1791553925 wait complete. 2024-09-11T22:02:36.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.326+0000 7f3b9b447640 1 Processor -- start 2024-09-11T22:02:36.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.326+0000 7f3b9b447640 1 -- start start 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b9b447640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b94100430 0x7f3b940fc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b9b447640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b94100de0 0x7f3b940fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b9b447640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b94105560 0x7f3b940fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b9b447640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94110e80 con 0x7f3b94105560 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b9b447640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94110d00 con 0x7f3b94100430 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b9b447640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94111000 con 0x7f3b94100de0 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b999e4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b94105560 0x7f3b940fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b989e2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b94100de0 0x7f3b940fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b999e4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b94105560 0x7f3b940fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38686/0 (socket says 172.21.15.152:38686) 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b999e4640 1 -- 172.21.15.152:0/2043061794 learned_addr learned my addr 172.21.15.152:0/2043061794 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b991e3640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b94100430 0x7f3b940fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b999e4640 1 -- 172.21.15.152:0/2043061794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b94100de0 msgr2=0x7f3b940fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:36.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b999e4640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b94100de0 0x7f3b940fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:36.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b999e4640 1 -- 172.21.15.152:0/2043061794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b94100430 msgr2=0x7f3b940fc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:36.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b999e4640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b94100430 0x7f3b940fc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:36.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b999e4640 1 -- 172.21.15.152:0/2043061794 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b941a6980 con 0x7f3b94105560 2024-09-11T22:02:36.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b999e4640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b94105560 0x7f3b940fd180 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c005ab0 tx=0x7f3b8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:36.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.327+0000 7f3b927fc640 1 -- 172.21.15.152:0/2043061794 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c03f030 con 0x7f3b94105560 2024-09-11T22:02:36.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.328+0000 7f3b927fc640 1 -- 172.21.15.152:0/2043061794 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b8c003ce0 con 0x7f3b94105560 2024-09-11T22:02:36.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.328+0000 7f3b9b447640 1 -- 172.21.15.152:0/2043061794 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b941a6c10 con 0x7f3b94105560 2024-09-11T22:02:36.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.328+0000 7f3b927fc640 1 -- 172.21.15.152:0/2043061794 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c035070 con 0x7f3b94105560 2024-09-11T22:02:36.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.328+0000 7f3b9b447640 1 -- 172.21.15.152:0/2043061794 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b941a70f0 con 0x7f3b94105560 2024-09-11T22:02:36.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.329+0000 7f3b9b447640 1 -- 172.21.15.152:0/2043061794 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b94100810 con 0x7f3b94105560 2024-09-11T22:02:36.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.330+0000 7f3b927fc640 1 -- 172.21.15.152:0/2043061794 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3b8c042030 con 0x7f3b94105560 2024-09-11T22:02:36.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.331+0000 7f3b927fc640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3b7c0a2b80 0x7f3b7c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:36.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.331+0000 7f3b991e3640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3b7c0a2b80 0x7f3b7c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:36.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.331+0000 7f3b927fc640 1 -- 172.21.15.152:0/2043061794 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7879+0+0 (secure 0 0 0) 0x7f3b8c0ef870 con 0x7f3b94105560 2024-09-11T22:02:36.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.332+0000 7f3b991e3640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3b7c0a2b80 0x7f3b7c0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3b84005fd0 tx=0x7f3b84009680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:36.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.335+0000 7f3b927fc640 1 -- 172.21.15.152:0/2043061794 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b8c0bc920 con 0x7f3b94105560 2024-09-11T22:02:36.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:36.535+0000 7f3b9b447640 1 -- 172.21.15.152:0/2043061794 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3b940fdc30 con 0x7f3b94105560 2024-09-11T22:02:36.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:36 smithi179 ceph-mon[35603]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:02:36.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:36 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2529313619' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T22:02:36.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:36 smithi179 ceph-mon[35603]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T22:02:37.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.084+0000 7f3b927fc640 1 -- 172.21.15.152:0/2043061794 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f3b940fdc30 con 0x7f3b94105560 2024-09-11T22:02:37.085 INFO:teuthology.orchestra.run.smithi152.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T22:02:37.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 -- 172.21.15.152:0/2043061794 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3b7c0a2b80 msgr2=0x7f3b7c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:37.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3b7c0a2b80 0x7f3b7c0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3b84005fd0 tx=0x7f3b84009680 comp rx=0 tx=0).stop 2024-09-11T22:02:37.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 -- 172.21.15.152:0/2043061794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b94105560 msgr2=0x7f3b940fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:37.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b94105560 0x7f3b940fd180 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c005ab0 tx=0x7f3b8c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:02:37.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 -- 172.21.15.152:0/2043061794 shutdown_connections 2024-09-11T22:02:37.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b94105560 0x7f3b940fd180 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:37.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3b7c0a2b80 0x7f3b7c0a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:37.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b94100de0 0x7f3b940fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:37.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 --2- 172.21.15.152:0/2043061794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b94100430 0x7f3b940fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:37.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 -- 172.21.15.152:0/2043061794 >> 172.21.15.152:0/2043061794 conn(0x7f3b94077230 msgr2=0x7f3b940fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:37.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 -- 172.21.15.152:0/2043061794 shutdown_connections 2024-09-11T22:02:37.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:37.087+0000 7f3b9b447640 1 -- 172.21.15.152:0/2043061794 wait complete. 2024-09-11T22:02:37.413 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:37 smithi152 ceph-mon[31188]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T22:02:37.413 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:37 smithi152 ceph-mon[31188]: pgmap v272: 97 pgs: 17 creating+peering, 13 active+clean, 67 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:37.413 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:37 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2043061794' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T22:02:37.414 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:37 smithi152 ceph-mon[31188]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-11T22:02:37.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:37 smithi179 ceph-mon[35603]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T22:02:37.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:37 smithi179 ceph-mon[35603]: pgmap v272: 97 pgs: 17 creating+peering, 13 active+clean, 67 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:37.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:37 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2043061794' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T22:02:37.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:37 smithi179 ceph-mon[35603]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-11T22:02:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:37 smithi193 ceph-mon[35545]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T22:02:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:37 smithi193 ceph-mon[35545]: pgmap v272: 97 pgs: 17 creating+peering, 13 active+clean, 67 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:02:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:37 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2043061794' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T22:02:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:37 smithi193 ceph-mon[35545]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-11T22:02:37.698 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:02:37.942 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:38.380 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:38 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2043061794' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T22:02:38.380 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:38 smithi152 ceph-mon[31188]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T22:02:38.380 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:38 smithi152 ceph-mon[31188]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-11T22:02:38.381 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:38 smithi152 ceph-mon[31188]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-11T22:02:38.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.379+0000 7ff025a7c640 1 -- 172.21.15.152:0/3663180941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff020101de0 msgr2=0x7ff0201021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:38.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.379+0000 7ff025a7c640 1 --2- 172.21.15.152:0/3663180941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff020101de0 0x7ff0201021c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff010009ca0 tx=0x7ff01002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:02:38.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.379+0000 7ff025a7c640 1 -- 172.21.15.152:0/3663180941 shutdown_connections 2024-09-11T22:02:38.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.379+0000 7ff025a7c640 1 --2- 172.21.15.152:0/3663180941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff020106f10 0x7ff02010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:38.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.379+0000 7ff025a7c640 1 --2- 172.21.15.152:0/3663180941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff020102790 0x7ff0201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.379+0000 7ff025a7c640 1 --2- 172.21.15.152:0/3663180941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff020101de0 0x7ff0201021c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.379+0000 7ff025a7c640 1 -- 172.21.15.152:0/3663180941 >> 172.21.15.152:0/3663180941 conn(0x7ff0200fd8c0 msgr2=0x7ff0200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.379+0000 7ff025a7c640 1 -- 172.21.15.152:0/3663180941 shutdown_connections 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.379+0000 7ff025a7c640 1 -- 172.21.15.152:0/3663180941 wait complete. 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.380+0000 7ff025a7c640 1 Processor -- start 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.380+0000 7ff025a7c640 1 -- start start 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.380+0000 7ff025a7c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff020101de0 0x7ff0201984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.380+0000 7ff025a7c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff020102790 0x7ff0201989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.380+0000 7ff025a7c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff020106f10 0x7ff02019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.380+0000 7ff025a7c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff020111f90 con 0x7ff020101de0 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.380+0000 7ff025a7c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff020111e10 con 0x7ff020106f10 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.380+0000 7ff025a7c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff020112110 con 0x7ff020102790 2024-09-11T22:02:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff020101de0 0x7ff0201984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff020101de0 0x7ff0201984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38712/0 (socket says 172.21.15.152:38712) 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01f7fe640 1 -- 172.21.15.152:0/2032403223 learned_addr learned my addr 172.21.15.152:0/2032403223 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01effd640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff020102790 0x7ff0201989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01ffff640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff020106f10 0x7ff02019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01f7fe640 1 -- 172.21.15.152:0/2032403223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff020102790 msgr2=0x7ff0201989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01f7fe640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff020102790 0x7ff0201989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01f7fe640 1 -- 172.21.15.152:0/2032403223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff020106f10 msgr2=0x7ff02019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01f7fe640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff020106f10 0x7ff02019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01f7fe640 1 -- 172.21.15.152:0/2032403223 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02019d460 con 0x7ff020101de0 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01effd640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff020102790 0x7ff0201989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01ffff640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff020106f10 0x7ff02019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:02:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01f7fe640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff020101de0 0x7ff0201984b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff0100097b0 tx=0x7ff010031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01cff9640 1 -- 172.21.15.152:0/2032403223 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01002fba0 con 0x7ff020101de0 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01cff9640 1 -- 172.21.15.152:0/2032403223 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff01002fd40 con 0x7ff020101de0 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff025a7c640 1 -- 172.21.15.152:0/2032403223 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff02019d6f0 con 0x7ff020101de0 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff01cff9640 1 -- 172.21.15.152:0/2032403223 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01003b930 con 0x7ff020101de0 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.381+0000 7ff025a7c640 1 -- 172.21.15.152:0/2032403223 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0201a5030 con 0x7ff020101de0 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.383+0000 7ff025a7c640 1 -- 172.21.15.152:0/2032403223 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0201021c0 con 0x7ff020101de0 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.384+0000 7ff01cff9640 1 -- 172.21.15.152:0/2032403223 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff010030cc0 con 0x7ff020101de0 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.384+0000 7ff01cff9640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff0080a2b80 0x7ff0080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.385+0000 7ff01effd640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff0080a2b80 0x7ff0080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.385+0000 7ff01cff9640 1 -- 172.21.15.152:0/2032403223 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7ff0100f06c0 con 0x7ff020101de0 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.385+0000 7ff01effd640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff0080a2b80 0x7ff0080a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0201087d0 tx=0x7ff014008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.389+0000 7ff01cff9640 1 -- 172.21.15.152:0/2032403223 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff010044380 con 0x7ff020101de0 2024-09-11T22:02:38.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:38 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2043061794' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T22:02:38.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:38 smithi179 ceph-mon[35603]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T22:02:38.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:38 smithi179 ceph-mon[35603]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-11T22:02:38.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:38 smithi179 ceph-mon[35603]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-11T22:02:38.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.558+0000 7ff025a7c640 1 -- 172.21.15.152:0/2032403223 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff02010a0f0 con 0x7ff020101de0 2024-09-11T22:02:38.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.559+0000 7ff01cff9640 1 -- 172.21.15.152:0/2032403223 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22350 (secure 0 0 0) 0x7ff0100bd770 con 0x7ff020101de0 2024-09-11T22:02:38.560 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:38.560 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":82,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:02:36.537080+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:02:38.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.561+0000 7ff025a7c640 1 -- 172.21.15.152:0/2032403223 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff0080a2b80 msgr2=0x7ff0080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:38.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.561+0000 7ff025a7c640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff0080a2b80 0x7ff0080a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0201087d0 tx=0x7ff014008040 comp rx=0 tx=0).stop 2024-09-11T22:02:38.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.562+0000 7ff025a7c640 1 -- 172.21.15.152:0/2032403223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff020101de0 msgr2=0x7ff0201984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:38.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.562+0000 7ff025a7c640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff020101de0 0x7ff0201984b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff0100097b0 tx=0x7ff010031b10 comp rx=0 tx=0).stop 2024-09-11T22:02:38.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.562+0000 7ff025a7c640 1 -- 172.21.15.152:0/2032403223 shutdown_connections 2024-09-11T22:02:38.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.562+0000 7ff025a7c640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff020106f10 0x7ff02019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:38.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.562+0000 7ff025a7c640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff0080a2b80 0x7ff0080a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:38.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.562+0000 7ff025a7c640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff020102790 0x7ff0201989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:38.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.562+0000 7ff025a7c640 1 --2- 172.21.15.152:0/2032403223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff020101de0 0x7ff0201984b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:38.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.562+0000 7ff025a7c640 1 -- 172.21.15.152:0/2032403223 >> 172.21.15.152:0/2032403223 conn(0x7ff0200fd8c0 msgr2=0x7ff0200feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:38.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.562+0000 7ff025a7c640 1 -- 172.21.15.152:0/2032403223 shutdown_connections 2024-09-11T22:02:38.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:38.562+0000 7ff025a7c640 1 -- 172.21.15.152:0/2032403223 wait complete. 2024-09-11T22:02:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:38 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2043061794' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T22:02:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:38 smithi193 ceph-mon[35545]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T22:02:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:38 smithi193 ceph-mon[35545]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-11T22:02:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:38 smithi193 ceph-mon[35545]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-11T22:02:39.189 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:02:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:39 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] up:active 2024-09-11T22:02:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:39 smithi152 ceph-mon[31188]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T22:02:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:39 smithi152 ceph-mon[31188]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T22:02:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:39 smithi152 ceph-mon[31188]: pgmap v274: 97 pgs: 17 creating+peering, 38 active+clean, 42 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s wr, 6 op/s 2024-09-11T22:02:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:39 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2032403223' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:02:39.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:39 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] up:active 2024-09-11T22:02:39.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:39 smithi179 ceph-mon[35603]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T22:02:39.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:39 smithi179 ceph-mon[35603]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T22:02:39.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:39 smithi179 ceph-mon[35603]: pgmap v274: 97 pgs: 17 creating+peering, 38 active+clean, 42 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s wr, 6 op/s 2024-09-11T22:02:39.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:39 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2032403223' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:02:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:39 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] up:active 2024-09-11T22:02:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:39 smithi193 ceph-mon[35545]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T22:02:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:39 smithi193 ceph-mon[35545]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T22:02:39.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:39 smithi193 ceph-mon[35545]: pgmap v274: 97 pgs: 17 creating+peering, 38 active+clean, 42 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s wr, 6 op/s 2024-09-11T22:02:39.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:39 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2032403223' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:02:39.577 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:02:39 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-i[66721]: 2024-09-11T22:02:39.347+0000 7f565b51e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:02:39.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.851+0000 7f181748a640 1 -- 172.21.15.152:0/1946500757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1810102570 msgr2=0x7f18101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:39.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.851+0000 7f181748a640 1 --2- 172.21.15.152:0/1946500757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1810102570 0x7f18101029b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1804009ca0 tx=0x7f180402a950 comp rx=0 tx=0).stop 2024-09-11T22:02:39.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.851+0000 7f181748a640 1 -- 172.21.15.152:0/1946500757 shutdown_connections 2024-09-11T22:02:39.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.851+0000 7f181748a640 1 --2- 172.21.15.152:0/1946500757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1810102ef0 0x7f181010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:39.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.851+0000 7f181748a640 1 --2- 172.21.15.152:0/1946500757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1810102570 0x7f18101029b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:39.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.851+0000 7f181748a640 1 --2- 172.21.15.152:0/1946500757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1810100e20 0x7f1810101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:39.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.851+0000 7f181748a640 1 -- 172.21.15.152:0/1946500757 >> 172.21.15.152:0/1946500757 conn(0x7f18100fc7d0 msgr2=0x7f18100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:39.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.851+0000 7f181748a640 1 -- 172.21.15.152:0/1946500757 shutdown_connections 2024-09-11T22:02:39.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.851+0000 7f181748a640 1 -- 172.21.15.152:0/1946500757 wait complete. 2024-09-11T22:02:39.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.852+0000 7f181748a640 1 Processor -- start 2024-09-11T22:02:39.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.852+0000 7f181748a640 1 -- start start 2024-09-11T22:02:39.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.852+0000 7f181748a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1810100e20 0x7f18101973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:39.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.852+0000 7f181748a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1810102570 0x7f1810197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:39.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.852+0000 7f181748a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1810102ef0 0x7f181019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:39.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.852+0000 7f181748a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1810110f80 con 0x7f1810102ef0 2024-09-11T22:02:39.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.852+0000 7f181748a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1810110e00 con 0x7f1810102570 2024-09-11T22:02:39.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.852+0000 7f181748a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1810111100 con 0x7f1810100e20 2024-09-11T22:02:39.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.852+0000 7f1815a27640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1810102ef0 0x7f181019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:39.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.852+0000 7f1815a27640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1810102ef0 0x7f181019bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38730/0 (socket says 172.21.15.152:38730) 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.852+0000 7f1815a27640 1 -- 172.21.15.152:0/1767361627 learned_addr learned my addr 172.21.15.152:0/1767361627 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f1815226640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1810100e20 0x7f18101973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f1814a25640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1810102570 0x7f1810197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f1815a27640 1 -- 172.21.15.152:0/1767361627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1810100e20 msgr2=0x7f18101973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f1815a27640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1810100e20 0x7f18101973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f1815a27640 1 -- 172.21.15.152:0/1767361627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1810102570 msgr2=0x7f1810197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f1815a27640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1810102570 0x7f1810197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f1815a27640 1 -- 172.21.15.152:0/1767361627 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181019c390 con 0x7f1810102ef0 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f1814a25640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1810102570 0x7f1810197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f1815a27640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1810102ef0 0x7f181019bcb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f180800d750 tx=0x7f180800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f180e7fc640 1 -- 172.21.15.152:0/1767361627 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808017070 con 0x7f1810102ef0 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f180e7fc640 1 -- 172.21.15.152:0/1767361627 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1808005500 con 0x7f1810102ef0 2024-09-11T22:02:39.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f180e7fc640 1 -- 172.21.15.152:0/1767361627 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808004d90 con 0x7f1810102ef0 2024-09-11T22:02:39.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f181748a640 1 -- 172.21.15.152:0/1767361627 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181019c680 con 0x7f1810102ef0 2024-09-11T22:02:39.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.853+0000 7f181748a640 1 -- 172.21.15.152:0/1767361627 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18101a3f60 con 0x7f1810102ef0 2024-09-11T22:02:39.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.854+0000 7f181748a640 1 -- 172.21.15.152:0/1767361627 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1810101200 con 0x7f1810102ef0 2024-09-11T22:02:39.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.855+0000 7f180e7fc640 1 -- 172.21.15.152:0/1767361627 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f1808004f30 con 0x7f1810102ef0 2024-09-11T22:02:39.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.856+0000 7f180e7fc640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17f80a2c00 0x7f17f80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:39.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.856+0000 7f1815226640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17f80a2c00 0x7f17f80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:39.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.857+0000 7f180e7fc640 1 -- 172.21.15.152:0/1767361627 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f18080cec30 con 0x7f1810102ef0 2024-09-11T22:02:39.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.857+0000 7f1815226640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17f80a2c00 0x7f17f80a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f18000058c0 tx=0x7f180000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:39.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:39.860+0000 7f180e7fc640 1 -- 172.21.15.152:0/1767361627 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f180809bd60 con 0x7f1810102ef0 2024-09-11T22:02:40.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.026+0000 7f181748a640 1 -- 172.21.15.152:0/1767361627 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1810198740 con 0x7f1810102ef0 2024-09-11T22:02:40.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.027+0000 7f180e7fc640 1 -- 172.21.15.152:0/1767361627 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22350 (secure 0 0 0) 0x7f1810198740 con 0x7f1810102ef0 2024-09-11T22:02:40.028 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:40.029 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":82,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:02:36.537080+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:02:40.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 -- 172.21.15.152:0/1767361627 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17f80a2c00 msgr2=0x7f17f80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:40.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17f80a2c00 0x7f17f80a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f18000058c0 tx=0x7f180000a2d0 comp rx=0 tx=0).stop 2024-09-11T22:02:40.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 -- 172.21.15.152:0/1767361627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1810102ef0 msgr2=0x7f181019bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:40.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1810102ef0 0x7f181019bcb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f180800d750 tx=0x7f180800dc10 comp rx=0 tx=0).stop 2024-09-11T22:02:40.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 -- 172.21.15.152:0/1767361627 shutdown_connections 2024-09-11T22:02:40.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1810102ef0 0x7f181019bcb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:40.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1810102570 0x7f1810197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:40.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f17f80a2c00 0x7f17f80a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:40.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 --2- 172.21.15.152:0/1767361627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1810100e20 0x7f18101973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:40.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 -- 172.21.15.152:0/1767361627 >> 172.21.15.152:0/1767361627 conn(0x7f18100fc7d0 msgr2=0x7f18101068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:40.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 -- 172.21.15.152:0/1767361627 shutdown_connections 2024-09-11T22:02:40.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:40.030+0000 7f181748a640 1 -- 172.21.15.152:0/1767361627 wait complete. 2024-09-11T22:02:40.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:40 smithi152 ceph-mon[31188]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T22:02:40.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:40 smithi152 ceph-mon[31188]: Cluster is now healthy 2024-09-11T22:02:40.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:40 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1767361627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:02:40.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:40 smithi179 ceph-mon[35603]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T22:02:40.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:40 smithi179 ceph-mon[35603]: Cluster is now healthy 2024-09-11T22:02:40.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:40 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1767361627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:02:40.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:40 smithi193 ceph-mon[35545]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T22:02:40.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:40 smithi193 ceph-mon[35545]: Cluster is now healthy 2024-09-11T22:02:40.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:40 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1767361627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:02:40.698 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:02:40.943 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:41.380 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:41 smithi152 ceph-mon[31188]: pgmap v275: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-11T22:02:41.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.386+0000 7f406960f640 1 -- 172.21.15.152:0/1227016977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4064101dd0 msgr2=0x7f40641021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:41.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.386+0000 7f406960f640 1 --2- 172.21.15.152:0/1227016977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4064101dd0 0x7f40641021b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f405c009900 tx=0x7f405c02a410 comp rx=0 tx=0).stop 2024-09-11T22:02:41.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.386+0000 7f406960f640 1 -- 172.21.15.152:0/1227016977 shutdown_connections 2024-09-11T22:02:41.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.386+0000 7f406960f640 1 --2- 172.21.15.152:0/1227016977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4064106f00 0x7f406410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:41.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.386+0000 7f406960f640 1 --2- 172.21.15.152:0/1227016977 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4064102780 0x7f40641067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:41.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.386+0000 7f406960f640 1 --2- 172.21.15.152:0/1227016977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4064101dd0 0x7f40641021b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:41.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.386+0000 7f406960f640 1 -- 172.21.15.152:0/1227016977 >> 172.21.15.152:0/1227016977 conn(0x7f40640fd8b0 msgr2=0x7f40640ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:41.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.386+0000 7f406960f640 1 -- 172.21.15.152:0/1227016977 shutdown_connections 2024-09-11T22:02:41.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.386+0000 7f406960f640 1 -- 172.21.15.152:0/1227016977 wait complete. 2024-09-11T22:02:41.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.387+0000 7f406960f640 1 Processor -- start 2024-09-11T22:02:41.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.387+0000 7f406960f640 1 -- start start 2024-09-11T22:02:41.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.387+0000 7f406960f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4064101dd0 0x7f40641985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.387+0000 7f406960f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4064102780 0x7f4064198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.387+0000 7f406960f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4064106f00 0x7f406419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.387+0000 7f406960f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4064112000 con 0x7f4064101dd0 2024-09-11T22:02:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.387+0000 7f406960f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4064111e80 con 0x7f4064106f00 2024-09-11T22:02:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.387+0000 7f406960f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4064112180 con 0x7f4064102780 2024-09-11T22:02:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f4062ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4064101dd0 0x7f40641985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f4062ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4064101dd0 0x7f40641985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38746/0 (socket says 172.21.15.152:38746) 2024-09-11T22:02:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f4062ffd640 1 -- 172.21.15.152:0/646774379 learned_addr learned my addr 172.21.15.152:0/646774379 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f40627fc640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4064102780 0x7f4064198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f40637fe640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4064106f00 0x7f406419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f4062ffd640 1 -- 172.21.15.152:0/646774379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4064102780 msgr2=0x7f4064198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:41.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f4062ffd640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4064102780 0x7f4064198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:41.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f4062ffd640 1 -- 172.21.15.152:0/646774379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4064106f00 msgr2=0x7f406419ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:41.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f4062ffd640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4064106f00 0x7f406419ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:41.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f4062ffd640 1 -- 172.21.15.152:0/646774379 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406419d550 con 0x7f4064101dd0 2024-09-11T22:02:41.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f4062ffd640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4064101dd0 0x7f40641985a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f405c005ab0 tx=0x7f405c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:41.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f404bfff640 1 -- 172.21.15.152:0/646774379 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c03f030 con 0x7f4064101dd0 2024-09-11T22:02:41.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f406960f640 1 -- 172.21.15.152:0/646774379 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f406419d7e0 con 0x7f4064101dd0 2024-09-11T22:02:41.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f404bfff640 1 -- 172.21.15.152:0/646774379 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f405c003ce0 con 0x7f4064101dd0 2024-09-11T22:02:41.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f404bfff640 1 -- 172.21.15.152:0/646774379 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c035070 con 0x7f4064101dd0 2024-09-11T22:02:41.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.388+0000 7f406960f640 1 -- 172.21.15.152:0/646774379 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40641a5120 con 0x7f4064101dd0 2024-09-11T22:02:41.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.390+0000 7f406960f640 1 -- 172.21.15.152:0/646774379 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40641032b0 con 0x7f4064101dd0 2024-09-11T22:02:41.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.391+0000 7f404bfff640 1 -- 172.21.15.152:0/646774379 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f405c042030 con 0x7f4064101dd0 2024-09-11T22:02:41.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.391+0000 7f404bfff640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f404c0a2b80 0x7f404c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:41.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.391+0000 7f40627fc640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f404c0a2b80 0x7f404c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:41.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.391+0000 7f404bfff640 1 -- 172.21.15.152:0/646774379 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f405c0ef7c0 con 0x7f4064101dd0 2024-09-11T22:02:41.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.392+0000 7f40627fc640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f404c0a2b80 0x7f404c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f40640fddb0 tx=0x7f4058009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:41.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.395+0000 7f404bfff640 1 -- 172.21.15.152:0/646774379 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f405c0bc870 con 0x7f4064101dd0 2024-09-11T22:02:41.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:41 smithi179 ceph-mon[35603]: pgmap v275: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-11T22:02:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:41 smithi193 ceph-mon[35545]: pgmap v275: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-11T22:02:41.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:41.598+0000 7f406960f640 1 -- 172.21.15.152:0/646774379 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f406410a0e0 con 0x7f4064101dd0 2024-09-11T22:02:42.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.115+0000 7f404bfff640 1 -- 172.21.15.152:0/646774379 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f405c0bc170 con 0x7f4064101dd0 2024-09-11T22:02:42.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.117+0000 7f406960f640 1 -- 172.21.15.152:0/646774379 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f404c0a2b80 msgr2=0x7f404c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:42.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.117+0000 7f406960f640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f404c0a2b80 0x7f404c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f40640fddb0 tx=0x7f4058009110 comp rx=0 tx=0).stop 2024-09-11T22:02:42.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.117+0000 7f406960f640 1 -- 172.21.15.152:0/646774379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4064101dd0 msgr2=0x7f40641985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:42.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.117+0000 7f406960f640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4064101dd0 0x7f40641985a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f405c005ab0 tx=0x7f405c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:02:42.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.117+0000 7f406960f640 1 -- 172.21.15.152:0/646774379 shutdown_connections 2024-09-11T22:02:42.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.117+0000 7f406960f640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4064106f00 0x7f406419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:42.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.117+0000 7f406960f640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f404c0a2b80 0x7f404c0a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:42.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.117+0000 7f406960f640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4064102780 0x7f4064198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:42.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.117+0000 7f406960f640 1 --2- 172.21.15.152:0/646774379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4064101dd0 0x7f40641985a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:42.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.117+0000 7f406960f640 1 -- 172.21.15.152:0/646774379 >> 172.21.15.152:0/646774379 conn(0x7f40640fd8b0 msgr2=0x7f40640fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:42.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.118+0000 7f406960f640 1 -- 172.21.15.152:0/646774379 shutdown_connections 2024-09-11T22:02:42.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:42.118+0000 7f406960f640 1 -- 172.21.15.152:0/646774379 wait complete. 2024-09-11T22:02:42.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:42 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/646774379' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:02:42.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:42 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/646774379' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:02:42.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:42 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/646774379' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:02:42.662 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-11T22:02:42.662 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-11T22:02:42.910 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:43.319 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:43 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/646774379' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T22:02:43.319 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:43 smithi152 ceph-mon[31188]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T22:02:43.319 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:43 smithi152 ceph-mon[31188]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-11T22:02:43.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.334+0000 7f682b7a4640 1 -- 172.21.15.152:0/4145791046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6824100d00 msgr2=0x7f6824106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:43.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.334+0000 7f682b7a4640 1 --2- 172.21.15.152:0/4145791046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6824100d00 0x7f6824106840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6818009cd0 tx=0x7f681802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:02:43.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.334+0000 7f682b7a4640 1 -- 172.21.15.152:0/4145791046 shutdown_connections 2024-09-11T22:02:43.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.334+0000 7f682b7a4640 1 --2- 172.21.15.152:0/4145791046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6824106f50 0x7f682410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:43.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.334+0000 7f682b7a4640 1 --2- 172.21.15.152:0/4145791046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6824100d00 0x7f6824106840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:43.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.334+0000 7f682b7a4640 1 --2- 172.21.15.152:0/4145791046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6824100350 0x7f6824100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:43.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.334+0000 7f682b7a4640 1 -- 172.21.15.152:0/4145791046 >> 172.21.15.152:0/4145791046 conn(0x7f6824077210 msgr2=0x7f68240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:43.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.334+0000 7f682b7a4640 1 -- 172.21.15.152:0/4145791046 shutdown_connections 2024-09-11T22:02:43.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.334+0000 7f682b7a4640 1 -- 172.21.15.152:0/4145791046 wait complete. 2024-09-11T22:02:43.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f682b7a4640 1 Processor -- start 2024-09-11T22:02:43.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f682b7a4640 1 -- start start 2024-09-11T22:02:43.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f682b7a4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6824100350 0x7f6824198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:43.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f682b7a4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6824100d00 0x7f6824198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:43.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f682b7a4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6824106f50 0x7f682419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:43.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f682b7a4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6824111fe0 con 0x7f6824100d00 2024-09-11T22:02:43.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f682b7a4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6824111e60 con 0x7f6824106f50 2024-09-11T22:02:43.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f682b7a4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6824112160 con 0x7f6824100350 2024-09-11T22:02:43.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f6828d3f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6824100d00 0x7f6824198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:43.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f6828d3f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6824100d00 0x7f6824198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38772/0 (socket says 172.21.15.152:38772) 2024-09-11T22:02:43.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f6828d3f640 1 -- 172.21.15.152:0/3815813371 learned_addr learned my addr 172.21.15.152:0/3815813371 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:43.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f6829540640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6824100350 0x7f6824198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:43.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f6829d41640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6824106f50 0x7f682419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:43.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f6828d3f640 1 -- 172.21.15.152:0/3815813371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6824100350 msgr2=0x7f6824198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:43.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f6828d3f640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6824100350 0x7f6824198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:43.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f6828d3f640 1 -- 172.21.15.152:0/3815813371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6824106f50 msgr2=0x7f682419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:43.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f6828d3f640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6824106f50 0x7f682419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:43.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f6828d3f640 1 -- 172.21.15.152:0/3815813371 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682419d4f0 con 0x7f6824100d00 2024-09-11T22:02:43.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.335+0000 7f6829d41640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6824106f50 0x7f682419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:02:43.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.336+0000 7f6828d3f640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6824100d00 0x7f6824198a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f681802ae00 tx=0x7f6818003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:43.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.336+0000 7f68227fc640 1 -- 172.21.15.152:0/3815813371 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818004040 con 0x7f6824100d00 2024-09-11T22:02:43.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.336+0000 7f68227fc640 1 -- 172.21.15.152:0/3815813371 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68180046c0 con 0x7f6824100d00 2024-09-11T22:02:43.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.336+0000 7f682b7a4640 1 -- 172.21.15.152:0/3815813371 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682419d780 con 0x7f6824100d00 2024-09-11T22:02:43.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.336+0000 7f68227fc640 1 -- 172.21.15.152:0/3815813371 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818046480 con 0x7f6824100d00 2024-09-11T22:02:43.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.336+0000 7f682b7a4640 1 -- 172.21.15.152:0/3815813371 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68241a50c0 con 0x7f6824100d00 2024-09-11T22:02:43.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.337+0000 7f682b7a4640 1 -- 172.21.15.152:0/3815813371 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6824100730 con 0x7f6824100d00 2024-09-11T22:02:43.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.338+0000 7f68227fc640 1 -- 172.21.15.152:0/3815813371 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f68180305a0 con 0x7f6824100d00 2024-09-11T22:02:43.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.339+0000 7f68227fc640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f680c0a2b80 0x7f680c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:43.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.339+0000 7f6829540640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f680c0a2b80 0x7f680c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:43.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.339+0000 7f68227fc640 1 -- 172.21.15.152:0/3815813371 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f681802e030 con 0x7f6824100d00 2024-09-11T22:02:43.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.339+0000 7f6829540640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f680c0a2b80 0x7f680c0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f681c00bbe0 tx=0x7f681c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:43.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.343+0000 7f68227fc640 1 -- 172.21.15.152:0/3815813371 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f681804b060 con 0x7f6824100d00 2024-09-11T22:02:43.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.542+0000 7f682b7a4640 1 -- 172.21.15.152:0/3815813371 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f682410a120 con 0x7f6824100d00 2024-09-11T22:02:43.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:43 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/646774379' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T22:02:43.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:43 smithi179 ceph-mon[35603]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T22:02:43.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:43 smithi179 ceph-mon[35603]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-11T22:02:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:43 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/646774379' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T22:02:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:43 smithi193 ceph-mon[35545]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T22:02:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:43 smithi193 ceph-mon[35545]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-11T22:02:43.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.822+0000 7f68227fc640 1 -- 172.21.15.152:0/3815813371 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f6818030890 con 0x7f6824100d00 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 -- 172.21.15.152:0/3815813371 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f680c0a2b80 msgr2=0x7f680c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f680c0a2b80 0x7f680c0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f681c00bbe0 tx=0x7f681c00b390 comp rx=0 tx=0).stop 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 -- 172.21.15.152:0/3815813371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6824100d00 msgr2=0x7f6824198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6824100d00 0x7f6824198a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f681802ae00 tx=0x7f6818003970 comp rx=0 tx=0).stop 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 -- 172.21.15.152:0/3815813371 shutdown_connections 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6824106f50 0x7f682419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6824100d00 0x7f6824198a80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f680c0a2b80 0x7f680c0a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 --2- 172.21.15.152:0/3815813371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6824100350 0x7f6824198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 -- 172.21.15.152:0/3815813371 >> 172.21.15.152:0/3815813371 conn(0x7f6824077210 msgr2=0x7f68240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 -- 172.21.15.152:0/3815813371 shutdown_connections 2024-09-11T22:02:43.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:43.824+0000 7f682b7a4640 1 -- 172.21.15.152:0/3815813371 wait complete. 2024-09-11T22:02:44.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:44 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3815813371' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-11T22:02:44.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:44 smithi179 ceph-mon[35603]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T22:02:44.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:44 smithi179 ceph-mon[35603]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T22:02:44.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:44 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3815813371' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T22:02:44.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:44 smithi179 ceph-mon[35603]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-11T22:02:44.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:44 smithi179 ceph-mon[35603]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-11T22:02:44.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:44 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3815813371' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-11T22:02:44.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:44 smithi193 ceph-mon[35545]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T22:02:44.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:44 smithi193 ceph-mon[35545]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T22:02:44.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:44 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3815813371' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T22:02:44.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:44 smithi193 ceph-mon[35545]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-11T22:02:44.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:44 smithi193 ceph-mon[35545]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-11T22:02:44.456 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:44 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3815813371' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-11T22:02:44.456 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:44 smithi152 ceph-mon[31188]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T22:02:44.456 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:44 smithi152 ceph-mon[31188]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T22:02:44.456 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:44 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3815813371' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T22:02:44.456 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:44 smithi152 ceph-mon[31188]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-11T22:02:44.456 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:44 smithi152 ceph-mon[31188]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-11T22:02:44.486 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-11T22:02:44.737 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:45.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.134+0000 7fe28c0be640 1 -- 172.21.15.152:0/3426068713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2841036e0 msgr2=0x7fe284107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:45.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.134+0000 7fe28c0be640 1 --2- 172.21.15.152:0/3426068713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2841036e0 0x7fe284107b90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe274009930 tx=0x7fe27402a420 comp rx=0 tx=0).stop 2024-09-11T22:02:45.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.134+0000 7fe28c0be640 1 -- 172.21.15.152:0/3426068713 shutdown_connections 2024-09-11T22:02:45.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.134+0000 7fe28c0be640 1 --2- 172.21.15.152:0/3426068713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2841082a0 0x7fe28410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:45.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.134+0000 7fe28c0be640 1 --2- 172.21.15.152:0/3426068713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2841036e0 0x7fe284107b90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:45.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.134+0000 7fe28c0be640 1 --2- 172.21.15.152:0/3426068713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe284102d30 0x7fe284103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:45.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.134+0000 7fe28c0be640 1 -- 172.21.15.152:0/3426068713 >> 172.21.15.152:0/3426068713 conn(0x7fe2840fc7d0 msgr2=0x7fe2840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:45.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.134+0000 7fe28c0be640 1 -- 172.21.15.152:0/3426068713 shutdown_connections 2024-09-11T22:02:45.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.134+0000 7fe28c0be640 1 -- 172.21.15.152:0/3426068713 wait complete. 2024-09-11T22:02:45.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe28c0be640 1 Processor -- start 2024-09-11T22:02:45.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe28c0be640 1 -- start start 2024-09-11T22:02:45.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe28c0be640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe284102d30 0x7fe2841985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:45.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe28c0be640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2841036e0 0x7fe284198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:45.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe28c0be640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2841082a0 0x7fe28419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:45.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe28c0be640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe2841120b0 con 0x7fe284102d30 2024-09-11T22:02:45.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe28c0be640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe284111f30 con 0x7fe2841082a0 2024-09-11T22:02:45.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe28c0be640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe284112230 con 0x7fe2841036e0 2024-09-11T22:02:45.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe289e5a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe284102d30 0x7fe2841985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:45.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe289e5a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe284102d30 0x7fe2841985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35210/0 (socket says 172.21.15.152:35210) 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe289e5a640 1 -- 172.21.15.152:0/1511496171 learned_addr learned my addr 172.21.15.152:0/1511496171 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe289659640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2841036e0 0x7fe284198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe28a65b640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2841082a0 0x7fe28419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe289e5a640 1 -- 172.21.15.152:0/1511496171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2841036e0 msgr2=0x7fe284198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe289e5a640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2841036e0 0x7fe284198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe289e5a640 1 -- 172.21.15.152:0/1511496171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2841082a0 msgr2=0x7fe28419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe289e5a640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2841082a0 0x7fe28419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe289e5a640 1 -- 172.21.15.152:0/1511496171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28419d570 con 0x7fe284102d30 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe28a65b640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2841082a0 0x7fe28419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe289659640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2841036e0 0x7fe284198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.135+0000 7fe289e5a640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe284102d30 0x7fe2841985c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe28000d950 tx=0x7fe28000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:45.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.136+0000 7fe27affd640 1 -- 172.21.15.152:0/1511496171 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280017070 con 0x7fe284102d30 2024-09-11T22:02:45.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.136+0000 7fe28c0be640 1 -- 172.21.15.152:0/1511496171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28419d860 con 0x7fe284102d30 2024-09-11T22:02:45.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.136+0000 7fe27affd640 1 -- 172.21.15.152:0/1511496171 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe280009c30 con 0x7fe284102d30 2024-09-11T22:02:45.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.136+0000 7fe27affd640 1 -- 172.21.15.152:0/1511496171 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28000f6b0 con 0x7fe284102d30 2024-09-11T22:02:45.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.136+0000 7fe28c0be640 1 -- 172.21.15.152:0/1511496171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2841a5140 con 0x7fe284102d30 2024-09-11T22:02:45.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.137+0000 7fe28c0be640 1 -- 172.21.15.152:0/1511496171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe284103110 con 0x7fe284102d30 2024-09-11T22:02:45.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.139+0000 7fe27affd640 1 -- 172.21.15.152:0/1511496171 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe2800109d0 con 0x7fe284102d30 2024-09-11T22:02:45.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.139+0000 7fe27affd640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe2700a2b80 0x7fe2700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:45.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.139+0000 7fe289659640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe2700a2b80 0x7fe2700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:45.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.139+0000 7fe27affd640 1 -- 172.21.15.152:0/1511496171 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fe2800cebd0 con 0x7fe284102d30 2024-09-11T22:02:45.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.140+0000 7fe289659640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe2700a2b80 0x7fe2700a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe27402a940 tx=0x7fe274005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:45.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.143+0000 7fe27affd640 1 -- 172.21.15.152:0/1511496171 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe280009de0 con 0x7fe284102d30 2024-09-11T22:02:45.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.345+0000 7fe28c0be640 1 -- 172.21.15.152:0/1511496171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fe28410a2b0 con 0x7fe284102d30 2024-09-11T22:02:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:45 smithi152 ceph-mon[31188]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-11T22:02:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:45 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] up:active 2024-09-11T22:02:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:45 smithi152 ceph-mon[31188]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T22:02:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:45 smithi152 ceph-mon[31188]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T22:02:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:45 smithi152 ceph-mon[31188]: Cluster is now healthy 2024-09-11T22:02:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:45 smithi152 ceph-mon[31188]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-11T22:02:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:45 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-11T22:02:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:45 smithi152 ceph-mon[31188]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T22:02:45.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:45 smithi179 ceph-mon[35603]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-11T22:02:45.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:45 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] up:active 2024-09-11T22:02:45.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:45 smithi179 ceph-mon[35603]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T22:02:45.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:45 smithi179 ceph-mon[35603]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T22:02:45.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:45 smithi179 ceph-mon[35603]: Cluster is now healthy 2024-09-11T22:02:45.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:45 smithi179 ceph-mon[35603]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-11T22:02:45.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:45 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-11T22:02:45.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:45 smithi179 ceph-mon[35603]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T22:02:45.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:45 smithi193 ceph-mon[35545]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-11T22:02:45.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:45 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] up:active 2024-09-11T22:02:45.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:45 smithi193 ceph-mon[35545]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T22:02:45.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:45 smithi193 ceph-mon[35545]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T22:02:45.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:45 smithi193 ceph-mon[35545]: Cluster is now healthy 2024-09-11T22:02:45.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:45 smithi193 ceph-mon[35545]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-11T22:02:45.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:45 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-11T22:02:45.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:45 smithi193 ceph-mon[35545]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T22:02:45.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.830+0000 7fe27affd640 1 -- 172.21.15.152:0/1511496171 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fe28009bc80 con 0x7fe284102d30 2024-09-11T22:02:45.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.832+0000 7fe28c0be640 1 -- 172.21.15.152:0/1511496171 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe2700a2b80 msgr2=0x7fe2700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:45.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.832+0000 7fe28c0be640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe2700a2b80 0x7fe2700a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe27402a940 tx=0x7fe274005a20 comp rx=0 tx=0).stop 2024-09-11T22:02:45.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.832+0000 7fe28c0be640 1 -- 172.21.15.152:0/1511496171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe284102d30 msgr2=0x7fe2841985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:45.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.832+0000 7fe28c0be640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe284102d30 0x7fe2841985c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe28000d950 tx=0x7fe28000de10 comp rx=0 tx=0).stop 2024-09-11T22:02:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.832+0000 7fe28c0be640 1 -- 172.21.15.152:0/1511496171 shutdown_connections 2024-09-11T22:02:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.832+0000 7fe28c0be640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2841082a0 0x7fe28419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.832+0000 7fe28c0be640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe2700a2b80 0x7fe2700a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.832+0000 7fe28c0be640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2841036e0 0x7fe284198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.832+0000 7fe28c0be640 1 --2- 172.21.15.152:0/1511496171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe284102d30 0x7fe2841985c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.832+0000 7fe28c0be640 1 -- 172.21.15.152:0/1511496171 >> 172.21.15.152:0/1511496171 conn(0x7fe2840fc7d0 msgr2=0x7fe284105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.833+0000 7fe28c0be640 1 -- 172.21.15.152:0/1511496171 shutdown_connections 2024-09-11T22:02:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:45.833+0000 7fe28c0be640 1 -- 172.21.15.152:0/1511496171 wait complete. 2024-09-11T22:02:46.429 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:46 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1511496171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T22:02:46.429 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:46 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1511496171' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T22:02:46.429 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:46 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] up:active 2024-09-11T22:02:46.429 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:46 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-11T22:02:46.429 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:46 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:02:46.464 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-11T22:02:46.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:46 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1511496171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T22:02:46.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:46 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1511496171' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T22:02:46.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:46 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] up:active 2024-09-11T22:02:46.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:46 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-11T22:02:46.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:46 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:02:46.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:46 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1511496171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T22:02:46.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:46 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1511496171' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T22:02:46.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:46 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] up:active 2024-09-11T22:02:46.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:46 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-11T22:02:46.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:46 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:02:46.716 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:47.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.121+0000 7efe3bd2e640 1 -- 172.21.15.152:0/2306405974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe34100a80 msgr2=0x7efe34100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:47.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.121+0000 7efe3bd2e640 1 --2- 172.21.15.152:0/2306405974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe34100a80 0x7efe34100ee0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efe24009930 tx=0x7efe2402a420 comp rx=0 tx=0).stop 2024-09-11T22:02:47.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.121+0000 7efe3bd2e640 1 -- 172.21.15.152:0/2306405974 shutdown_connections 2024-09-11T22:02:47.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.121+0000 7efe3bd2e640 1 --2- 172.21.15.152:0/2306405974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe34101420 0x7efe3410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:47.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.121+0000 7efe3bd2e640 1 --2- 172.21.15.152:0/2306405974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe34100a80 0x7efe34100ee0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:47.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.121+0000 7efe3bd2e640 1 --2- 172.21.15.152:0/2306405974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe34106a80 0x7efe34106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:47.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.121+0000 7efe3bd2e640 1 -- 172.21.15.152:0/2306405974 >> 172.21.15.152:0/2306405974 conn(0x7efe340fc7a0 msgr2=0x7efe340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:47.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.122+0000 7efe3bd2e640 1 -- 172.21.15.152:0/2306405974 shutdown_connections 2024-09-11T22:02:47.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.122+0000 7efe3bd2e640 1 -- 172.21.15.152:0/2306405974 wait complete. 2024-09-11T22:02:47.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.122+0000 7efe3bd2e640 1 Processor -- start 2024-09-11T22:02:47.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.122+0000 7efe3bd2e640 1 -- start start 2024-09-11T22:02:47.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe3bd2e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe34100a80 0x7efe34198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:47.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe3bd2e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe34101420 0x7efe34198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:47.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe3bd2e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe34106a80 0x7efe3419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:47.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe3bd2e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efe34110e80 con 0x7efe34100a80 2024-09-11T22:02:47.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe3bd2e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efe34110d00 con 0x7efe34106a80 2024-09-11T22:02:47.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe3bd2e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efe34111000 con 0x7efe34101420 2024-09-11T22:02:47.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe39aca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe34100a80 0x7efe34198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:47.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe39aca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe34100a80 0x7efe34198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35220/0 (socket says 172.21.15.152:35220) 2024-09-11T22:02:47.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe39aca640 1 -- 172.21.15.152:0/1161286599 learned_addr learned my addr 172.21.15.152:0/1161286599 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:47.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe3a2cb640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe34106a80 0x7efe3419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:47.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe392c9640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe34101420 0x7efe34198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:47.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe39aca640 1 -- 172.21.15.152:0/1161286599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe34101420 msgr2=0x7efe34198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:47.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe39aca640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe34101420 0x7efe34198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe39aca640 1 -- 172.21.15.152:0/1161286599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe34106a80 msgr2=0x7efe3419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe39aca640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe34106a80 0x7efe3419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe39aca640 1 -- 172.21.15.152:0/1161286599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3419d3e0 con 0x7efe34100a80 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe39aca640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe34100a80 0x7efe34198430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efe3000d950 tx=0x7efe3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.123+0000 7efe2affd640 1 -- 172.21.15.152:0/1161286599 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe30017070 con 0x7efe34100a80 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.124+0000 7efe2affd640 1 -- 172.21.15.152:0/1161286599 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe30009c30 con 0x7efe34100a80 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.124+0000 7efe3bd2e640 1 -- 172.21.15.152:0/1161286599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3419d6d0 con 0x7efe34100a80 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.124+0000 7efe2affd640 1 -- 172.21.15.152:0/1161286599 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3000f6b0 con 0x7efe34100a80 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.124+0000 7efe3bd2e640 1 -- 172.21.15.152:0/1161286599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe340fccd0 con 0x7efe34100a80 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.125+0000 7efe3bd2e640 1 -- 172.21.15.152:0/1161286599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe34100ee0 con 0x7efe34100a80 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.126+0000 7efe2affd640 1 -- 172.21.15.152:0/1161286599 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7efe300109d0 con 0x7efe34100a80 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.127+0000 7efe2affd640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efe200a2c00 0x7efe200a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:47.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.127+0000 7efe392c9640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efe200a2c00 0x7efe200a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:47.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.127+0000 7efe2affd640 1 -- 172.21.15.152:0/1161286599 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7efe300ce9d0 con 0x7efe34100a80 2024-09-11T22:02:47.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.128+0000 7efe392c9640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efe200a2c00 0x7efe200a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efe24009900 tx=0x7efe2403c040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:47.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.130+0000 7efe2affd640 1 -- 172.21.15.152:0/1161286599 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe30009de0 con 0x7efe34100a80 2024-09-11T22:02:47.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:47.340+0000 7efe3bd2e640 1 -- 172.21.15.152:0/1161286599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7efe3410a020 con 0x7efe34100a80 2024-09-11T22:02:47.389 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:47 smithi152 ceph-mon[31188]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-11T22:02:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:47 smithi179 ceph-mon[35603]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-11T22:02:47.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:47 smithi193 ceph-mon[35545]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-11T22:02:48.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.147+0000 7efe2affd640 1 -- 172.21.15.152:0/1161286599 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7efe3009b410 con 0x7efe34100a80 2024-09-11T22:02:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 -- 172.21.15.152:0/1161286599 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efe200a2c00 msgr2=0x7efe200a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efe200a2c00 0x7efe200a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efe24009900 tx=0x7efe2403c040 comp rx=0 tx=0).stop 2024-09-11T22:02:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 -- 172.21.15.152:0/1161286599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe34100a80 msgr2=0x7efe34198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe34100a80 0x7efe34198430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efe3000d950 tx=0x7efe3000de10 comp rx=0 tx=0).stop 2024-09-11T22:02:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 -- 172.21.15.152:0/1161286599 shutdown_connections 2024-09-11T22:02:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe34106a80 0x7efe3419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efe200a2c00 0x7efe200a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe34101420 0x7efe34198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 --2- 172.21.15.152:0/1161286599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe34100a80 0x7efe34198430 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 -- 172.21.15.152:0/1161286599 >> 172.21.15.152:0/1161286599 conn(0x7efe340fc7a0 msgr2=0x7efe3406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:48.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 -- 172.21.15.152:0/1161286599 shutdown_connections 2024-09-11T22:02:48.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:48.150+0000 7efe3bd2e640 1 -- 172.21.15.152:0/1161286599 wait complete. 2024-09-11T22:02:48.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:48 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1161286599' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T22:02:48.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:48 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1161286599' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T22:02:48.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:48 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1161286599' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T22:02:48.947 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-11T22:02:48.947 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-11T22:02:49.198 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:49.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:49 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1161286599' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T22:02:49.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:49 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:02:49.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:49 smithi152 ceph-mon[31188]: pgmap v279: 97 pgs: 97 active+clean; 580 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 915 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-09-11T22:02:49.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:49 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1161286599' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T22:02:49.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:49 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:02:49.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:49 smithi179 ceph-mon[35603]: pgmap v279: 97 pgs: 97 active+clean; 580 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 915 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-09-11T22:02:49.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:49 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1161286599' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T22:02:49.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:49 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:02:49.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:49 smithi193 ceph-mon[35545]: pgmap v279: 97 pgs: 97 active+clean; 580 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 915 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-09-11T22:02:49.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.629+0000 7f7abce9c640 1 -- 172.21.15.152:0/151529365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ab8102570 msgr2=0x7f7ab81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:49.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.629+0000 7f7abce9c640 1 --2- 172.21.15.152:0/151529365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ab8102570 0x7f7ab81029b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009900 tx=0x7f7aa002a480 comp rx=0 tx=0).stop 2024-09-11T22:02:49.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.629+0000 7f7abce9c640 1 -- 172.21.15.152:0/151529365 shutdown_connections 2024-09-11T22:02:49.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.629+0000 7f7abce9c640 1 --2- 172.21.15.152:0/151529365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab8102ef0 0x7f7ab810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:49.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.629+0000 7f7abce9c640 1 --2- 172.21.15.152:0/151529365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ab8102570 0x7f7ab81029b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:49.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.629+0000 7f7abce9c640 1 --2- 172.21.15.152:0/151529365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ab8100e20 0x7f7ab8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:49.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.629+0000 7f7abce9c640 1 -- 172.21.15.152:0/151529365 >> 172.21.15.152:0/151529365 conn(0x7f7ab80fc7d0 msgr2=0x7f7ab80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:49.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.629+0000 7f7abce9c640 1 -- 172.21.15.152:0/151529365 shutdown_connections 2024-09-11T22:02:49.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.629+0000 7f7abce9c640 1 -- 172.21.15.152:0/151529365 wait complete. 2024-09-11T22:02:49.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7abce9c640 1 Processor -- start 2024-09-11T22:02:49.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7abce9c640 1 -- start start 2024-09-11T22:02:49.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7abce9c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ab8100e20 0x7f7ab8199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:49.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7abce9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab8102570 0x7f7ab8199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7abce9c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ab8102ef0 0x7f7ab81a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7abce9c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab8110fa0 con 0x7f7ab8100e20 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7abce9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab8110e20 con 0x7f7ab8102570 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7abce9c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab8111120 con 0x7f7ab8102ef0 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7ab659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ab8100e20 0x7f7ab8199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7ab659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ab8100e20 0x7f7ab8199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35250/0 (socket says 172.21.15.152:35250) 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7ab659c640 1 -- 172.21.15.152:0/2328643836 learned_addr learned my addr 172.21.15.152:0/2328643836 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7ab6d9d640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ab8102ef0 0x7f7ab81a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7ab5d9b640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab8102570 0x7f7ab8199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7ab659c640 1 -- 172.21.15.152:0/2328643836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ab8102ef0 msgr2=0x7f7ab81a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7ab659c640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ab8102ef0 0x7f7ab81a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7ab659c640 1 -- 172.21.15.152:0/2328643836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab8102570 msgr2=0x7f7ab8199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:49.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7ab659c640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab8102570 0x7f7ab8199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:49.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7ab659c640 1 -- 172.21.15.152:0/2328643836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab81a49f0 con 0x7f7ab8100e20 2024-09-11T22:02:49.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.630+0000 7f7ab659c640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ab8100e20 0x7f7ab8199430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000ba50 tx=0x7f7ab000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:49.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.631+0000 7f7aaf7fe640 1 -- 172.21.15.152:0/2328643836 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0019070 con 0x7f7ab8100e20 2024-09-11T22:02:49.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.631+0000 7f7abce9c640 1 -- 172.21.15.152:0/2328643836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab81a4bc0 con 0x7f7ab8100e20 2024-09-11T22:02:49.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.631+0000 7f7aaf7fe640 1 -- 172.21.15.152:0/2328643836 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ab000cbe0 con 0x7f7ab8100e20 2024-09-11T22:02:49.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.631+0000 7f7aaf7fe640 1 -- 172.21.15.152:0/2328643836 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00076e0 con 0x7f7ab8100e20 2024-09-11T22:02:49.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.631+0000 7f7abce9c640 1 -- 172.21.15.152:0/2328643836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab81a50d0 con 0x7f7ab8100e20 2024-09-11T22:02:49.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.632+0000 7f7abce9c640 1 -- 172.21.15.152:0/2328643836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab81021b0 con 0x7f7ab8100e20 2024-09-11T22:02:49.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.633+0000 7f7aaf7fe640 1 -- 172.21.15.152:0/2328643836 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7ab001c070 con 0x7f7ab8100e20 2024-09-11T22:02:49.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.634+0000 7f7aaf7fe640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7aa40a2b80 0x7f7aa40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:49.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.634+0000 7f7ab5d9b640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7aa40a2b80 0x7f7aa40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:49.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.634+0000 7f7aaf7fe640 1 -- 172.21.15.152:0/2328643836 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f7ab00cea30 con 0x7f7ab8100e20 2024-09-11T22:02:49.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.634+0000 7f7ab5d9b640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7aa40a2b80 0x7f7aa40a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00096c0 tx=0x7f7aa0000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:49.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.637+0000 7f7aaf7fe640 1 -- 172.21.15.152:0/2328643836 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ab009bae0 con 0x7f7ab8100e20 2024-09-11T22:02:49.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.823+0000 7f7abce9c640 1 -- 172.21.15.152:0/2328643836 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7ab8062630 con 0x7f7aa40a2b80 2024-09-11T22:02:49.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.851+0000 7f7aaf7fe640 1 -- 172.21.15.152:0/2328643836 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7ab8062630 con 0x7f7aa40a2b80 2024-09-11T22:02:49.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.853+0000 7f7abce9c640 1 -- 172.21.15.152:0/2328643836 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7aa40a2b80 msgr2=0x7f7aa40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:49.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.853+0000 7f7abce9c640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7aa40a2b80 0x7f7aa40a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00096c0 tx=0x7f7aa0000bc0 comp rx=0 tx=0).stop 2024-09-11T22:02:49.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.853+0000 7f7abce9c640 1 -- 172.21.15.152:0/2328643836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ab8100e20 msgr2=0x7f7ab8199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:49.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.853+0000 7f7abce9c640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ab8100e20 0x7f7ab8199430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000ba50 tx=0x7f7ab000bf10 comp rx=0 tx=0).stop 2024-09-11T22:02:49.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.853+0000 7f7abce9c640 1 -- 172.21.15.152:0/2328643836 shutdown_connections 2024-09-11T22:02:49.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.853+0000 7f7abce9c640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7aa40a2b80 0x7f7aa40a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:49.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.853+0000 7f7abce9c640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ab8102ef0 0x7f7ab81a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:49.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.853+0000 7f7abce9c640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab8102570 0x7f7ab8199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:49.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.854+0000 7f7abce9c640 1 --2- 172.21.15.152:0/2328643836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ab8100e20 0x7f7ab8199430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:49.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.854+0000 7f7abce9c640 1 -- 172.21.15.152:0/2328643836 >> 172.21.15.152:0/2328643836 conn(0x7f7ab80fc7d0 msgr2=0x7f7ab80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:49.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.854+0000 7f7abce9c640 1 -- 172.21.15.152:0/2328643836 shutdown_connections 2024-09-11T22:02:49.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:49.854+0000 7f7abce9c640 1 -- 172.21.15.152:0/2328643836 wait complete. 2024-09-11T22:02:49.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:02:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:02:49.828+0000 7fe299388640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:02:49.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:02:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:02:49.828+0000 7fe299388640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:02:49.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:02:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:02:49.828+0000 7fe299388640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:02:49.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:02:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:02:49.828+0000 7fe299388640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:02:49.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:02:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:02:49.828+0000 7fe299388640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:02:50.571 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-11T22:02:50.818 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:51.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.244+0000 7fc45fd5d640 1 -- 172.21.15.152:0/4215107459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc458102570 msgr2=0x7fc4581029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:51.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.244+0000 7fc45fd5d640 1 --2- 172.21.15.152:0/4215107459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc458102570 0x7fc4581029b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc448009900 tx=0x7fc44802a480 comp rx=0 tx=0).stop 2024-09-11T22:02:51.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.244+0000 7fc45fd5d640 1 -- 172.21.15.152:0/4215107459 shutdown_connections 2024-09-11T22:02:51.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.244+0000 7fc45fd5d640 1 --2- 172.21.15.152:0/4215107459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc458102ef0 0x7fc45810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:51.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.244+0000 7fc45fd5d640 1 --2- 172.21.15.152:0/4215107459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc458102570 0x7fc4581029b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:51.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.244+0000 7fc45fd5d640 1 --2- 172.21.15.152:0/4215107459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc458100e20 0x7fc458101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:51.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.244+0000 7fc45fd5d640 1 -- 172.21.15.152:0/4215107459 >> 172.21.15.152:0/4215107459 conn(0x7fc4580fc7d0 msgr2=0x7fc4580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:51.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.244+0000 7fc45fd5d640 1 -- 172.21.15.152:0/4215107459 shutdown_connections 2024-09-11T22:02:51.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.244+0000 7fc45fd5d640 1 -- 172.21.15.152:0/4215107459 wait complete. 2024-09-11T22:02:51.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45fd5d640 1 Processor -- start 2024-09-11T22:02:51.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45fd5d640 1 -- start start 2024-09-11T22:02:51.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45fd5d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc458100e20 0x7fc458199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:51.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45fd5d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc458102570 0x7fc458199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:51.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45fd5d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc458102ef0 0x7fc4581a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:51.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45fd5d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc458110fc0 con 0x7fc458100e20 2024-09-11T22:02:51.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45fd5d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc458110e40 con 0x7fc458102ef0 2024-09-11T22:02:51.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45fd5d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc458111140 con 0x7fc458102570 2024-09-11T22:02:51.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45daf9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc458100e20 0x7fc458199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:51.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45daf9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc458100e20 0x7fc458199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35302/0 (socket says 172.21.15.152:35302) 2024-09-11T22:02:51.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45daf9640 1 -- 172.21.15.152:0/714519932 learned_addr learned my addr 172.21.15.152:0/714519932 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:51.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.245+0000 7fc45d2f8640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc458102570 0x7fc458199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:51.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.246+0000 7fc45daf9640 1 -- 172.21.15.152:0/714519932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc458102570 msgr2=0x7fc458199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:51.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.246+0000 7fc45daf9640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc458102570 0x7fc458199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:51.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.246+0000 7fc45daf9640 1 -- 172.21.15.152:0/714519932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc458102ef0 msgr2=0x7fc4581a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:51.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.246+0000 7fc45daf9640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc458102ef0 0x7fc4581a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:51.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.246+0000 7fc45daf9640 1 -- 172.21.15.152:0/714519932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4581a4a10 con 0x7fc458100e20 2024-09-11T22:02:51.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.246+0000 7fc45daf9640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc458100e20 0x7fc458199450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc45400d770 tx=0x7fc45400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:51.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.246+0000 7fc44effd640 1 -- 172.21.15.152:0/714519932 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454017070 con 0x7fc458100e20 2024-09-11T22:02:51.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.246+0000 7fc45fd5d640 1 -- 172.21.15.152:0/714519932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4581a4be0 con 0x7fc458100e20 2024-09-11T22:02:51.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.246+0000 7fc44effd640 1 -- 172.21.15.152:0/714519932 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc454005500 con 0x7fc458100e20 2024-09-11T22:02:51.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.246+0000 7fc44effd640 1 -- 172.21.15.152:0/714519932 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454004e00 con 0x7fc458100e20 2024-09-11T22:02:51.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.246+0000 7fc45fd5d640 1 -- 172.21.15.152:0/714519932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4581a50a0 con 0x7fc458100e20 2024-09-11T22:02:51.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.247+0000 7fc45fd5d640 1 -- 172.21.15.152:0/714519932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc458101200 con 0x7fc458100e20 2024-09-11T22:02:51.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.248+0000 7fc44effd640 1 -- 172.21.15.152:0/714519932 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc454004fa0 con 0x7fc458100e20 2024-09-11T22:02:51.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.249+0000 7fc44effd640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc4440a2c90 0x7fc4440a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:51.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.249+0000 7fc45d2f8640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc4440a2c90 0x7fc4440a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:51.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.249+0000 7fc44effd640 1 -- 172.21.15.152:0/714519932 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fc4540ceba0 con 0x7fc458100e20 2024-09-11T22:02:51.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.249+0000 7fc45d2f8640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc4440a2c90 0x7fc4440a5150 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc448009230 tx=0x7fc4480058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:51.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.253+0000 7fc44effd640 1 -- 172.21.15.152:0/714519932 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc45409ba50 con 0x7fc458100e20 2024-09-11T22:02:51.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.444+0000 7fc45fd5d640 1 -- 172.21.15.152:0/714519932 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc458062630 con 0x7fc4440a2c90 2024-09-11T22:02:51.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.468+0000 7fc44effd640 1 -- 172.21.15.152:0/714519932 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc458062630 con 0x7fc4440a2c90 2024-09-11T22:02:51.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 -- 172.21.15.152:0/714519932 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc4440a2c90 msgr2=0x7fc4440a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:51.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc4440a2c90 0x7fc4440a5150 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc448009230 tx=0x7fc4480058d0 comp rx=0 tx=0).stop 2024-09-11T22:02:51.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 -- 172.21.15.152:0/714519932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc458100e20 msgr2=0x7fc458199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:51.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc458100e20 0x7fc458199450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc45400d770 tx=0x7fc45400dc30 comp rx=0 tx=0).stop 2024-09-11T22:02:51.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 -- 172.21.15.152:0/714519932 shutdown_connections 2024-09-11T22:02:51.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc458102ef0 0x7fc4581a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:51.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc4440a2c90 0x7fc4440a5150 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:51.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc458102570 0x7fc458199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:51.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 --2- 172.21.15.152:0/714519932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc458100e20 0x7fc458199450 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:51.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 -- 172.21.15.152:0/714519932 >> 172.21.15.152:0/714519932 conn(0x7fc4580fc7d0 msgr2=0x7fc4580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:51.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 -- 172.21.15.152:0/714519932 shutdown_connections 2024-09-11T22:02:51.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:51.470+0000 7fc45fd5d640 1 -- 172.21.15.152:0/714519932 wait complete. 2024-09-11T22:02:51.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:51 smithi152 ceph-mon[31188]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:51.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:51 smithi152 ceph-mon[31188]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-11T22:02:51.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:51 smithi152 ceph-mon[31188]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-11T22:02:51.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:51 smithi179 ceph-mon[35603]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:51.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:51 smithi179 ceph-mon[35603]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-11T22:02:51.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:51 smithi179 ceph-mon[35603]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-11T22:02:51.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:51 smithi193 ceph-mon[35545]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:51.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:51 smithi193 ceph-mon[35545]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-11T22:02:51.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:51 smithi193 ceph-mon[35545]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-11T22:02:52.050 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-11T22:02:52.300 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:52.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.769+0000 7ff708e3d640 1 -- 172.21.15.152:0/3427637520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff704102d40 msgr2=0x7ff704103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:52.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.769+0000 7ff708e3d640 1 --2- 172.21.15.152:0/3427637520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff704102d40 0x7ff704103120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009900 tx=0x7ff6f402a480 comp rx=0 tx=0).stop 2024-09-11T22:02:52.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.769+0000 7ff708e3d640 1 -- 172.21.15.152:0/3427637520 shutdown_connections 2024-09-11T22:02:52.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.770+0000 7ff708e3d640 1 --2- 172.21.15.152:0/3427637520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff70410c170 0x7ff70410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:52.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.770+0000 7ff708e3d640 1 --2- 172.21.15.152:0/3427637520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff704103660 0x7ff70410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:52.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.770+0000 7ff708e3d640 1 --2- 172.21.15.152:0/3427637520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff704102d40 0x7ff704103120 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:52.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.770+0000 7ff708e3d640 1 -- 172.21.15.152:0/3427637520 >> 172.21.15.152:0/3427637520 conn(0x7ff7040fc7a0 msgr2=0x7ff7040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.770+0000 7ff708e3d640 1 -- 172.21.15.152:0/3427637520 shutdown_connections 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.770+0000 7ff708e3d640 1 -- 172.21.15.152:0/3427637520 wait complete. 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.770+0000 7ff708e3d640 1 Processor -- start 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.770+0000 7ff708e3d640 1 -- start start 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.770+0000 7ff708e3d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff704102d40 0x7ff7041985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.770+0000 7ff708e3d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff704103660 0x7ff704198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff708e3d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70410c170 0x7ff70419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff708e3d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff704112030 con 0x7ff70410c170 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff708e3d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff704111eb0 con 0x7ff704103660 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff708e3d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7041121b0 con 0x7ff704102d40 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff702d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70410c170 0x7ff70419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff702d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70410c170 0x7ff70419ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35318/0 (socket says 172.21.15.152:35318) 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff702d9d640 1 -- 172.21.15.152:0/2386566073 learned_addr learned my addr 172.21.15.152:0/2386566073 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff70259c640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff704102d40 0x7ff7041985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff701d9b640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff704103660 0x7ff704198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff702d9d640 1 -- 172.21.15.152:0/2386566073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff704102d40 msgr2=0x7ff7041985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff702d9d640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff704102d40 0x7ff7041985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff702d9d640 1 -- 172.21.15.152:0/2386566073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff704103660 msgr2=0x7ff704198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff702d9d640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff704103660 0x7ff704198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff702d9d640 1 -- 172.21.15.152:0/2386566073 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70419d500 con 0x7ff70410c170 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff702d9d640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70410c170 0x7ff70419ce20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00b970 tx=0x7ff6fc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff6f37fe640 1 -- 172.21.15.152:0/2386566073 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc019070 con 0x7ff70410c170 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff6f37fe640 1 -- 172.21.15.152:0/2386566073 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6fc00cb40 con 0x7ff70410c170 2024-09-11T22:02:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff708e3d640 1 -- 172.21.15.152:0/2386566073 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff70419d7f0 con 0x7ff70410c170 2024-09-11T22:02:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff6f37fe640 1 -- 172.21.15.152:0/2386566073 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc007650 con 0x7ff70410c170 2024-09-11T22:02:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.771+0000 7ff708e3d640 1 -- 172.21.15.152:0/2386566073 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7041a50d0 con 0x7ff70410c170 2024-09-11T22:02:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.772+0000 7ff708e3d640 1 -- 172.21.15.152:0/2386566073 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7041031a0 con 0x7ff70410c170 2024-09-11T22:02:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.774+0000 7ff6f37fe640 1 -- 172.21.15.152:0/2386566073 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff6fc01c070 con 0x7ff70410c170 2024-09-11T22:02:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.774+0000 7ff6f37fe640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6ec0a2c10 0x7ff6ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.774+0000 7ff70259c640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6ec0a2c10 0x7ff6ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.774+0000 7ff6f37fe640 1 -- 172.21.15.152:0/2386566073 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7ff6fc0ce470 con 0x7ff70410c170 2024-09-11T22:02:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.775+0000 7ff70259c640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6ec0a2c10 0x7ff6ec0a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4000c00 tx=0x7ff6f40058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.778+0000 7ff6f37fe640 1 -- 172.21.15.152:0/2386566073 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6fc09aee0 con 0x7ff70410c170 2024-09-11T22:02:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.972+0000 7ff708e3d640 1 -- 172.21.15.152:0/2386566073 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7ff704062630 con 0x7ff6ec0a2c10 2024-09-11T22:02:52.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.977+0000 7ff6f37fe640 1 -- 172.21.15.152:0/2386566073 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ff704062630 con 0x7ff6ec0a2c10 2024-09-11T22:02:52.978 INFO:teuthology.orchestra.run.smithi152.stdout:/volumes/qa/sv_0/bd16534a-829f-41a9-aef5-ccee4f5a0ad9 2024-09-11T22:02:52.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 -- 172.21.15.152:0/2386566073 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6ec0a2c10 msgr2=0x7ff6ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:52.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6ec0a2c10 0x7ff6ec0a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4000c00 tx=0x7ff6f40058d0 comp rx=0 tx=0).stop 2024-09-11T22:02:52.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 -- 172.21.15.152:0/2386566073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70410c170 msgr2=0x7ff70419ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:52.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70410c170 0x7ff70419ce20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00b970 tx=0x7ff6fc00be30 comp rx=0 tx=0).stop 2024-09-11T22:02:52.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 -- 172.21.15.152:0/2386566073 shutdown_connections 2024-09-11T22:02:52.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70410c170 0x7ff70419ce20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:52.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff704103660 0x7ff704198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:52.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff6ec0a2c10 0x7ff6ec0a50d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:52.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 --2- 172.21.15.152:0/2386566073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff704102d40 0x7ff7041985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:52.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 -- 172.21.15.152:0/2386566073 >> 172.21.15.152:0/2386566073 conn(0x7ff7040fc7a0 msgr2=0x7ff7040fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:52.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 -- 172.21.15.152:0/2386566073 shutdown_connections 2024-09-11T22:02:52.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:52.979+0000 7ff708e3d640 1 -- 172.21.15.152:0/2386566073 wait complete. 2024-09-11T22:02:53.647 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:53 smithi152 ceph-mon[31188]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:53.647 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:53 smithi152 ceph-mon[31188]: pgmap v281: 97 pgs: 97 active+clean; 588 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-11T22:02:53.676 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-11T22:02:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:53 smithi179 ceph-mon[35603]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:53 smithi179 ceph-mon[35603]: pgmap v281: 97 pgs: 97 active+clean; 588 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-11T22:02:53.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:53 smithi193 ceph-mon[35545]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:53.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:53 smithi193 ceph-mon[35545]: pgmap v281: 97 pgs: 97 active+clean; 588 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-11T22:02:53.925 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:54.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.356+0000 7f3d5ae97640 1 -- 172.21.15.152:0/1385608153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d54100ca0 msgr2=0x7f3d54106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:54.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.356+0000 7f3d5ae97640 1 --2- 172.21.15.152:0/1385608153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d54100ca0 0x7f3d54106840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009930 tx=0x7f3d4402a420 comp rx=0 tx=0).stop 2024-09-11T22:02:54.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 -- 172.21.15.152:0/1385608153 shutdown_connections 2024-09-11T22:02:54.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 --2- 172.21.15.152:0/1385608153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d54106f50 0x7f3d5410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:54.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 --2- 172.21.15.152:0/1385608153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d54100ca0 0x7f3d54106840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 --2- 172.21.15.152:0/1385608153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d541002f0 0x7f3d541006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 -- 172.21.15.152:0/1385608153 >> 172.21.15.152:0/1385608153 conn(0x7f3d54077210 msgr2=0x7f3d540fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 -- 172.21.15.152:0/1385608153 shutdown_connections 2024-09-11T22:02:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 -- 172.21.15.152:0/1385608153 wait complete. 2024-09-11T22:02:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 Processor -- start 2024-09-11T22:02:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 -- start start 2024-09-11T22:02:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d541002f0 0x7f3d54198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d54100ca0 0x7f3d54198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d54106f50 0x7f3d5419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3d54112000 con 0x7f3d54106f50 2024-09-11T22:02:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3d54111e80 con 0x7f3d541002f0 2024-09-11T22:02:54.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.357+0000 7f3d5ae97640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3d54112180 con 0x7f3d54100ca0 2024-09-11T22:02:54.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d59434640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d54106f50 0x7f3d5419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:54.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d59434640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d54106f50 0x7f3d5419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53052/0 (socket says 172.21.15.152:53052) 2024-09-11T22:02:54.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d59434640 1 -- 172.21.15.152:0/2802799853 learned_addr learned my addr 172.21.15.152:0/2802799853 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:54.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d58c33640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d541002f0 0x7f3d54198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:54.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d4bfff640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d54100ca0 0x7f3d54198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:54.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d59434640 1 -- 172.21.15.152:0/2802799853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d54100ca0 msgr2=0x7f3d54198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:54.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d59434640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d54100ca0 0x7f3d54198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:54.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d59434640 1 -- 172.21.15.152:0/2802799853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d541002f0 msgr2=0x7f3d54198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:54.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d59434640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d541002f0 0x7f3d54198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:54.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d59434640 1 -- 172.21.15.152:0/2802799853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5419d4e0 con 0x7f3d54106f50 2024-09-11T22:02:54.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d4bfff640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d54100ca0 0x7f3d54198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:02:54.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d59434640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d54106f50 0x7f3d5419ce00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00eaa0 tx=0x7f3d4c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:54.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d49ffb640 1 -- 172.21.15.152:0/2802799853 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c004d20 con 0x7f3d54106f50 2024-09-11T22:02:54.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d5ae97640 1 -- 172.21.15.152:0/2802799853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5419d7d0 con 0x7f3d54106f50 2024-09-11T22:02:54.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d49ffb640 1 -- 172.21.15.152:0/2802799853 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d4c005020 con 0x7f3d54106f50 2024-09-11T22:02:54.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.358+0000 7f3d49ffb640 1 -- 172.21.15.152:0/2802799853 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0116d0 con 0x7f3d54106f50 2024-09-11T22:02:54.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.359+0000 7f3d5ae97640 1 -- 172.21.15.152:0/2802799853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d541a50b0 con 0x7f3d54106f50 2024-09-11T22:02:54.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.360+0000 7f3d5ae97640 1 -- 172.21.15.152:0/2802799853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d541006d0 con 0x7f3d54106f50 2024-09-11T22:02:54.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.360+0000 7f3d49ffb640 1 -- 172.21.15.152:0/2802799853 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3d4c0051d0 con 0x7f3d54106f50 2024-09-11T22:02:54.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.361+0000 7f3d49ffb640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3d3c0a2c10 0x7f3d3c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:54.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.361+0000 7f3d49ffb640 1 -- 172.21.15.152:0/2802799853 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f3d4c0cf410 con 0x7f3d54106f50 2024-09-11T22:02:54.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.361+0000 7f3d58c33640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3d3c0a2c10 0x7f3d3c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:54.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.362+0000 7f3d58c33640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3d3c0a2c10 0x7f3d3c0a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009990 tx=0x7f3d50009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:54.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.365+0000 7f3d49ffb640 1 -- 172.21.15.152:0/2802799853 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d4c016030 con 0x7f3d54106f50 2024-09-11T22:02:54.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.556+0000 7f3d5ae97640 1 -- 172.21.15.152:0/2802799853 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3d5410a150 con 0x7f3d3c0a2c10 2024-09-11T22:02:54.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.579+0000 7f3d49ffb640 1 -- 172.21.15.152:0/2802799853 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3d5410a150 con 0x7f3d3c0a2c10 2024-09-11T22:02:54.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 -- 172.21.15.152:0/2802799853 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3d3c0a2c10 msgr2=0x7f3d3c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:54.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3d3c0a2c10 0x7f3d3c0a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009990 tx=0x7f3d50009110 comp rx=0 tx=0).stop 2024-09-11T22:02:54.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 -- 172.21.15.152:0/2802799853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d54106f50 msgr2=0x7f3d5419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:54.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d54106f50 0x7f3d5419ce00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00eaa0 tx=0x7f3d4c00eea0 comp rx=0 tx=0).stop 2024-09-11T22:02:54.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 -- 172.21.15.152:0/2802799853 shutdown_connections 2024-09-11T22:02:54.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d54106f50 0x7f3d5419ce00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:54.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f3d3c0a2c10 0x7f3d3c0a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:54.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d54100ca0 0x7f3d54198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:54.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 --2- 172.21.15.152:0/2802799853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d541002f0 0x7f3d54198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:54.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 -- 172.21.15.152:0/2802799853 >> 172.21.15.152:0/2802799853 conn(0x7f3d54077210 msgr2=0x7f3d541052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:54.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 -- 172.21.15.152:0/2802799853 shutdown_connections 2024-09-11T22:02:54.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:54.581+0000 7f3d5ae97640 1 -- 172.21.15.152:0/2802799853 wait complete. 2024-09-11T22:02:54.593 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:54 smithi152 ceph-mon[31188]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:54.593 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-11T22:02:54.593 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-11T22:02:54.593 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-11T22:02:54.593 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-11T22:02:54.593 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]: dispatch 2024-09-11T22:02:54.594 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-11T22:02:54.594 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-11T22:02:54.594 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-11T22:02:54.594 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-11T22:02:54.594 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:54 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-11T22:02:54.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:54 smithi179 ceph-mon[35603]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:54.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-11T22:02:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-11T22:02:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-11T22:02:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-11T22:02:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]: dispatch 2024-09-11T22:02:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-11T22:02:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-11T22:02:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-11T22:02:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-11T22:02:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:54 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-11T22:02:54.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:54 smithi193 ceph-mon[35545]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:54.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-11T22:02:54.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-11T22:02:54.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-11T22:02:54.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-11T22:02:54.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]: dispatch 2024-09-11T22:02:54.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-11T22:02:54.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-11T22:02:54.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-11T22:02:54.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-11T22:02:54.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:54 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-11T22:02:55.205 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-11T22:02:55.460 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: pgmap v282: 97 pgs: 97 active+clean; 588 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-11T22:02:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-11T22:02:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-11T22:02:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-11T22:02:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-11T22:02:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-09-11T22:02:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-11T22:02:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-11T22:02:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-11T22:02:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-11T22:02:55.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-11T22:02:55.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:55 smithi152 ceph-mon[31188]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T22:02:55.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: pgmap v282: 97 pgs: 97 active+clean; 588 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-11T22:02:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-11T22:02:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-11T22:02:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-11T22:02:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-11T22:02:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-09-11T22:02:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-11T22:02:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-11T22:02:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-11T22:02:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-11T22:02:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-11T22:02:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:55 smithi179 ceph-mon[35603]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T22:02:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: pgmap v282: 97 pgs: 97 active+clean; 588 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-11T22:02:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-11T22:02:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-11T22:02:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-11T22:02:55.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-11T22:02:55.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-09-11T22:02:55.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-11T22:02:55.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-11T22:02:55.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-11T22:02:55.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-11T22:02:55.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-11T22:02:55.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:55 smithi193 ceph-mon[35545]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T22:02:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.839+0000 7f0f1abaf640 1 -- 172.21.15.152:0/464464791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f141002f0 msgr2=0x7f0f141006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.839+0000 7f0f1abaf640 1 --2- 172.21.15.152:0/464464791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f141002f0 0x7f0f141006d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009930 tx=0x7f0f0402a420 comp rx=0 tx=0).stop 2024-09-11T22:02:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.839+0000 7f0f1abaf640 1 -- 172.21.15.152:0/464464791 shutdown_connections 2024-09-11T22:02:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.839+0000 7f0f1abaf640 1 --2- 172.21.15.152:0/464464791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f14106f50 0x7f0f1410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.839+0000 7f0f1abaf640 1 --2- 172.21.15.152:0/464464791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f14100ca0 0x7f0f14106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.839+0000 7f0f1abaf640 1 --2- 172.21.15.152:0/464464791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f141002f0 0x7f0f141006d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.839+0000 7f0f1abaf640 1 -- 172.21.15.152:0/464464791 >> 172.21.15.152:0/464464791 conn(0x7f0f14077210 msgr2=0x7f0f140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:55.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.839+0000 7f0f1abaf640 1 -- 172.21.15.152:0/464464791 shutdown_connections 2024-09-11T22:02:55.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.839+0000 7f0f1abaf640 1 -- 172.21.15.152:0/464464791 wait complete. 2024-09-11T22:02:55.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.840+0000 7f0f1abaf640 1 Processor -- start 2024-09-11T22:02:55.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.840+0000 7f0f1abaf640 1 -- start start 2024-09-11T22:02:55.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.840+0000 7f0f1abaf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f141002f0 0x7f0f14198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:55.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.840+0000 7f0f1abaf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f14100ca0 0x7f0f14198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:55.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.840+0000 7f0f1abaf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f14106f50 0x7f0f1419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:55.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.840+0000 7f0f1abaf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0f14111fa0 con 0x7f0f14100ca0 2024-09-11T22:02:55.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.840+0000 7f0f1abaf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0f14111e20 con 0x7f0f14106f50 2024-09-11T22:02:55.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.840+0000 7f0f1abaf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0f14112120 con 0x7f0f141002f0 2024-09-11T22:02:55.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f13fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f14100ca0 0x7f0f14198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:55.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f13fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f14100ca0 0x7f0f14198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53074/0 (socket says 172.21.15.152:53074) 2024-09-11T22:02:55.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f13fff640 1 -- 172.21.15.152:0/491633271 learned_addr learned my addr 172.21.15.152:0/491633271 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:55.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f1894b640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f141002f0 0x7f0f14198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:55.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f1914c640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f14106f50 0x7f0f1419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:55.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f13fff640 1 -- 172.21.15.152:0/491633271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f141002f0 msgr2=0x7f0f14198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:55.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f13fff640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f141002f0 0x7f0f14198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:55.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f13fff640 1 -- 172.21.15.152:0/491633271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f14106f50 msgr2=0x7f0f1419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:55.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f13fff640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f14106f50 0x7f0f1419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:55.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f13fff640 1 -- 172.21.15.152:0/491633271 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1419d4d0 con 0x7f0f14100ca0 2024-09-11T22:02:55.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f1894b640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f141002f0 0x7f0f14198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:02:55.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f1914c640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f14106f50 0x7f0f1419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:02:55.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f13fff640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f14100ca0 0x7f0f14198a60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800dbf0 tx=0x7f0f0800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:55.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f11ffb640 1 -- 172.21.15.152:0/491633271 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08017070 con 0x7f0f14100ca0 2024-09-11T22:02:55.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f1abaf640 1 -- 172.21.15.152:0/491633271 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1419d7c0 con 0x7f0f14100ca0 2024-09-11T22:02:55.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f11ffb640 1 -- 172.21.15.152:0/491633271 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f08003e50 con 0x7f0f14100ca0 2024-09-11T22:02:55.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.841+0000 7f0f11ffb640 1 -- 172.21.15.152:0/491633271 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f080106c0 con 0x7f0f14100ca0 2024-09-11T22:02:55.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.842+0000 7f0f1abaf640 1 -- 172.21.15.152:0/491633271 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f141a50a0 con 0x7f0f14100ca0 2024-09-11T22:02:55.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.843+0000 7f0f1abaf640 1 -- 172.21.15.152:0/491633271 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f141006d0 con 0x7f0f14100ca0 2024-09-11T22:02:55.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.844+0000 7f0f11ffb640 1 -- 172.21.15.152:0/491633271 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0f08003970 con 0x7f0f14100ca0 2024-09-11T22:02:55.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.844+0000 7f0f11ffb640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0efc0a2c90 0x7f0efc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:55.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.844+0000 7f0f1894b640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0efc0a2c90 0x7f0efc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:55.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.844+0000 7f0f11ffb640 1 -- 172.21.15.152:0/491633271 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f0f080cefe0 con 0x7f0f14100ca0 2024-09-11T22:02:55.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.845+0000 7f0f1894b640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0efc0a2c90 0x7f0efc0a5150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0f04000c00 tx=0x7f0f04005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:55.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:55.849+0000 7f0f11ffb640 1 -- 172.21.15.152:0/491633271 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f0809bdc0 con 0x7f0f14100ca0 2024-09-11T22:02:56.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.039+0000 7f0f1abaf640 1 -- 172.21.15.152:0/491633271 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f0f14062630 con 0x7f0efc0a2c90 2024-09-11T22:02:56.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.044+0000 7f0f11ffb640 1 -- 172.21.15.152:0/491633271 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0f14062630 con 0x7f0efc0a2c90 2024-09-11T22:02:56.045 INFO:teuthology.orchestra.run.smithi152.stdout:/volumes/qa/sv_1/0374fba9-eccf-4301-9e16-9053a3555c98 2024-09-11T22:02:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.046+0000 7f0f1abaf640 1 -- 172.21.15.152:0/491633271 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0efc0a2c90 msgr2=0x7f0efc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.046+0000 7f0f1abaf640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0efc0a2c90 0x7f0efc0a5150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0f04000c00 tx=0x7f0f04005a20 comp rx=0 tx=0).stop 2024-09-11T22:02:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.046+0000 7f0f1abaf640 1 -- 172.21.15.152:0/491633271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f14100ca0 msgr2=0x7f0f14198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.046+0000 7f0f1abaf640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f14100ca0 0x7f0f14198a60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800dbf0 tx=0x7f0f0800b630 comp rx=0 tx=0).stop 2024-09-11T22:02:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.047+0000 7f0f1abaf640 1 -- 172.21.15.152:0/491633271 shutdown_connections 2024-09-11T22:02:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.047+0000 7f0f1abaf640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f14106f50 0x7f0f1419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.047+0000 7f0f1abaf640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f14100ca0 0x7f0f14198a60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.047+0000 7f0f1abaf640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f0efc0a2c90 0x7f0efc0a5150 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.047+0000 7f0f1abaf640 1 --2- 172.21.15.152:0/491633271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f141002f0 0x7f0f14198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.047+0000 7f0f1abaf640 1 -- 172.21.15.152:0/491633271 >> 172.21.15.152:0/491633271 conn(0x7f0f14077210 msgr2=0x7f0f140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.047+0000 7f0f1abaf640 1 -- 172.21.15.152:0/491633271 shutdown_connections 2024-09-11T22:02:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:56.047+0000 7f0f1abaf640 1 -- 172.21.15.152:0/491633271 wait complete. 2024-09-11T22:02:56.642 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:56 smithi152 ceph-mon[31188]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:56.643 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:56 smithi152 ceph-mon[31188]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T22:02:56.670 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:02:56.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:56 smithi179 ceph-mon[35603]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:56.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:56 smithi179 ceph-mon[35603]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T22:02:56.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:56 smithi193 ceph-mon[35545]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:56.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:56 smithi193 ceph-mon[35545]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T22:02:56.916 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:57.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.341+0000 7f80451e8640 1 -- 172.21.15.152:0/2890348555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8040101e20 msgr2=0x7f80401056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:57.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.341+0000 7f80451e8640 1 --2- 172.21.15.152:0/2890348555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8040101e20 0x7f80401056b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8034009900 tx=0x7f803402a410 comp rx=0 tx=0).stop 2024-09-11T22:02:57.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.341+0000 7f80451e8640 1 -- 172.21.15.152:0/2890348555 shutdown_connections 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.341+0000 7f80451e8640 1 --2- 172.21.15.152:0/2890348555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8040105de0 0x7f804010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.341+0000 7f80451e8640 1 --2- 172.21.15.152:0/2890348555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8040101e20 0x7f80401056b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.341+0000 7f80451e8640 1 --2- 172.21.15.152:0/2890348555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8040101470 0x7f8040101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.341+0000 7f80451e8640 1 -- 172.21.15.152:0/2890348555 >> 172.21.15.152:0/2890348555 conn(0x7f8040077230 msgr2=0x7f80400fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.341+0000 7f80451e8640 1 -- 172.21.15.152:0/2890348555 shutdown_connections 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.342+0000 7f80451e8640 1 -- 172.21.15.152:0/2890348555 wait complete. 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.342+0000 7f80451e8640 1 Processor -- start 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f80451e8640 1 -- start start 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f80451e8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8040101470 0x7f80401985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f80451e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8040101e20 0x7f8040198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f80451e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8040105de0 0x7f804019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:57.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f80451e8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8040110ee0 con 0x7f8040105de0 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f80451e8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8040110d60 con 0x7f8040101470 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f80451e8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8040111060 con 0x7f8040101e20 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f803f59e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8040105de0 0x7f804019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f803f59e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8040105de0 0x7f804019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53094/0 (socket says 172.21.15.152:53094) 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f803f59e640 1 -- 172.21.15.152:0/2387746565 learned_addr learned my addr 172.21.15.152:0/2387746565 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f803e59c640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8040101e20 0x7f8040198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f803ed9d640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8040101470 0x7f80401985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f803f59e640 1 -- 172.21.15.152:0/2387746565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8040101e20 msgr2=0x7f8040198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f803f59e640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8040101e20 0x7f8040198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f803f59e640 1 -- 172.21.15.152:0/2387746565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8040101470 msgr2=0x7f80401985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f803f59e640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8040101470 0x7f80401985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:57.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f803f59e640 1 -- 172.21.15.152:0/2387746565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f804019d560 con 0x7f8040105de0 2024-09-11T22:02:57.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.343+0000 7f803f59e640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8040105de0 0x7f804019ce80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f803800b970 tx=0x7f803800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:57.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.344+0000 7f8027fff640 1 -- 172.21.15.152:0/2387746565 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038019070 con 0x7f8040105de0 2024-09-11T22:02:57.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.344+0000 7f8027fff640 1 -- 172.21.15.152:0/2387746565 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f803800cb40 con 0x7f8040105de0 2024-09-11T22:02:57.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.344+0000 7f80451e8640 1 -- 172.21.15.152:0/2387746565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f804019d850 con 0x7f8040105de0 2024-09-11T22:02:57.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.344+0000 7f8027fff640 1 -- 172.21.15.152:0/2387746565 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038007650 con 0x7f8040105de0 2024-09-11T22:02:57.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.344+0000 7f80451e8640 1 -- 172.21.15.152:0/2387746565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80401a5130 con 0x7f8040105de0 2024-09-11T22:02:57.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.345+0000 7f80451e8640 1 -- 172.21.15.152:0/2387746565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80401018d0 con 0x7f8040105de0 2024-09-11T22:02:57.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.346+0000 7f8027fff640 1 -- 172.21.15.152:0/2387746565 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f803801c070 con 0x7f8040105de0 2024-09-11T22:02:57.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.347+0000 7f8027fff640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80280a2c10 0x7f80280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:57.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.347+0000 7f803ed9d640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80280a2c10 0x7f80280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:57.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.347+0000 7f8027fff640 1 -- 172.21.15.152:0/2387746565 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f80380ce760 con 0x7f8040105de0 2024-09-11T22:02:57.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.347+0000 7f803ed9d640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80280a2c10 0x7f80280a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8030009890 tx=0x7f8030008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:57.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.351+0000 7f8027fff640 1 -- 172.21.15.152:0/2387746565 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f803809b650 con 0x7f8040105de0 2024-09-11T22:02:57.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.550+0000 7f80451e8640 1 -- 172.21.15.152:0/2387746565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80401a5420 con 0x7f8040105de0 2024-09-11T22:02:57.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.551+0000 7f8027fff640 1 -- 172.21.15.152:0/2387746565 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11923 (secure 0 0 0) 0x7f803809af50 con 0x7f8040105de0 2024-09-11T22:02:57.552 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:57.552 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":23,"btime":"2024-09-11T22:02:48:141067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:02:47.341860+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:02:57.552 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 23 2024-09-11T22:02:57.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 -- 172.21.15.152:0/2387746565 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80280a2c10 msgr2=0x7f80280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:57.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80280a2c10 0x7f80280a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8030009890 tx=0x7f8030008040 comp rx=0 tx=0).stop 2024-09-11T22:02:57.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 -- 172.21.15.152:0/2387746565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8040105de0 msgr2=0x7f804019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:57.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8040105de0 0x7f804019ce80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f803800b970 tx=0x7f803800be30 comp rx=0 tx=0).stop 2024-09-11T22:02:57.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 -- 172.21.15.152:0/2387746565 shutdown_connections 2024-09-11T22:02:57.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8040105de0 0x7f804019ce80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:57.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f80280a2c10 0x7f80280a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:57.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8040101e20 0x7f8040198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:57.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 --2- 172.21.15.152:0/2387746565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8040101470 0x7f80401985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:57.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 -- 172.21.15.152:0/2387746565 >> 172.21.15.152:0/2387746565 conn(0x7f8040077230 msgr2=0x7f8040100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:57.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 -- 172.21.15.152:0/2387746565 shutdown_connections 2024-09-11T22:02:57.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:57.553+0000 7f80451e8640 1 -- 172.21.15.152:0/2387746565 wait complete. 2024-09-11T22:02:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:57 smithi152 ceph-mon[31188]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:57 smithi152 ceph-mon[31188]: pgmap v285: 97 pgs: 3 peering, 94 active+clean; 621 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 13 op/s 2024-09-11T22:02:57.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:57 smithi179 ceph-mon[35603]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:57.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:57 smithi179 ceph-mon[35603]: pgmap v285: 97 pgs: 3 peering, 94 active+clean; 621 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 13 op/s 2024-09-11T22:02:57.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:57 smithi193 ceph-mon[35545]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:02:57.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:57 smithi193 ceph-mon[35545]: pgmap v285: 97 pgs: 3 peering, 94 active+clean; 621 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 13 op/s 2024-09-11T22:02:58.085 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:02:58.331 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:58.668 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:58 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2387746565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.746+0000 7f1ba4642640 1 -- 172.21.15.152:0/1017617782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b9c100460 msgr2=0x7f1b9c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.746+0000 7f1ba4642640 1 --2- 172.21.15.152:0/1017617782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b9c100460 0x7f1b9c100840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009900 tx=0x7f1b9802a410 comp rx=0 tx=0).stop 2024-09-11T22:02:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.747+0000 7f1ba4642640 1 -- 172.21.15.152:0/1017617782 shutdown_connections 2024-09-11T22:02:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.747+0000 7f1ba4642640 1 --2- 172.21.15.152:0/1017617782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b9c105590 0x7f1b9c10d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.747+0000 7f1ba4642640 1 --2- 172.21.15.152:0/1017617782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c100e10 0x7f1b9c104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.747+0000 7f1ba4642640 1 --2- 172.21.15.152:0/1017617782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b9c100460 0x7f1b9c100840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.747+0000 7f1ba4642640 1 -- 172.21.15.152:0/1017617782 >> 172.21.15.152:0/1017617782 conn(0x7f1b9c0fbee0 msgr2=0x7f1b9c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.747+0000 7f1ba4642640 1 -- 172.21.15.152:0/1017617782 shutdown_connections 2024-09-11T22:02:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.747+0000 7f1ba4642640 1 -- 172.21.15.152:0/1017617782 wait complete. 2024-09-11T22:02:58.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.747+0000 7f1ba4642640 1 Processor -- start 2024-09-11T22:02:58.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba4642640 1 -- start start 2024-09-11T22:02:58.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba4642640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b9c100460 0x7f1b9c199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:58.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba4642640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c100e10 0x7f1b9c199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:58.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba4642640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b9c105590 0x7f1b9c1a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:58.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba4642640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c110e70 con 0x7f1b9c105590 2024-09-11T22:02:58.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba4642640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c110cf0 con 0x7f1b9c100e10 2024-09-11T22:02:58.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba4642640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c110ff0 con 0x7f1b9c100460 2024-09-11T22:02:58.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba2bdf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b9c105590 0x7f1b9c1a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:58.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba2bdf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b9c105590 0x7f1b9c1a4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53104/0 (socket says 172.21.15.152:53104) 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba2bdf640 1 -- 172.21.15.152:0/1514889201 learned_addr learned my addr 172.21.15.152:0/1514889201 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba23de640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b9c100460 0x7f1b9c199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba1bdd640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c100e10 0x7f1b9c199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba2bdf640 1 -- 172.21.15.152:0/1514889201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b9c100460 msgr2=0x7f1b9c199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba2bdf640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b9c100460 0x7f1b9c199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba2bdf640 1 -- 172.21.15.152:0/1514889201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c100e10 msgr2=0x7f1b9c199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba2bdf640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c100e10 0x7f1b9c199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba2bdf640 1 -- 172.21.15.152:0/1514889201 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9c1a47d0 con 0x7f1b9c105590 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba23de640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b9c100460 0x7f1b9c199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba1bdd640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c100e10 0x7f1b9c199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1ba2bdf640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b9c105590 0x7f1b9c1a4290 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400cce0 tx=0x7f1b9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:58.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.748+0000 7f1b937fe640 1 -- 172.21.15.152:0/1514889201 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9400f450 con 0x7f1b9c105590 2024-09-11T22:02:58.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.749+0000 7f1ba4642640 1 -- 172.21.15.152:0/1514889201 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b9c1a49a0 con 0x7f1b9c105590 2024-09-11T22:02:58.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.749+0000 7f1b937fe640 1 -- 172.21.15.152:0/1514889201 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b9400fad0 con 0x7f1b9c105590 2024-09-11T22:02:58.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.749+0000 7f1b937fe640 1 -- 172.21.15.152:0/1514889201 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94018c10 con 0x7f1b9c105590 2024-09-11T22:02:58.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.749+0000 7f1ba4642640 1 -- 172.21.15.152:0/1514889201 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b9c1a4e60 con 0x7f1b9c105590 2024-09-11T22:02:58.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.750+0000 7f1ba4642640 1 -- 172.21.15.152:0/1514889201 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9c100840 con 0x7f1b9c105590 2024-09-11T22:02:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.751+0000 7f1b937fe640 1 -- 172.21.15.152:0/1514889201 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f1b9400f5f0 con 0x7f1b9c105590 2024-09-11T22:02:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.751+0000 7f1b937fe640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1b880a2c10 0x7f1b880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:02:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.751+0000 7f1ba23de640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1b880a2c10 0x7f1b880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:02:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.751+0000 7f1b937fe640 1 -- 172.21.15.152:0/1514889201 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f1b940cf8e0 con 0x7f1b9c105590 2024-09-11T22:02:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.752+0000 7f1ba23de640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1b880a2c10 0x7f1b880a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b98005ab0 tx=0x7f1b98005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:02:58.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.755+0000 7f1b937fe640 1 -- 172.21.15.152:0/1514889201 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b94014030 con 0x7f1b9c105590 2024-09-11T22:02:58.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:58 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2387746565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:58.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:58 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2387746565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:02:58.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.925+0000 7f1ba4642640 1 -- 172.21.15.152:0/1514889201 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b9c108770 con 0x7f1b9c105590 2024-09-11T22:02:58.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.927+0000 7f1b937fe640 1 -- 172.21.15.152:0/1514889201 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22820 (secure 0 0 0) 0x7f1b9409c6c0 con 0x7f1b9c105590 2024-09-11T22:02:58.928 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:02:58.928 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":84,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:02:55.337928+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:02:58.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 -- 172.21.15.152:0/1514889201 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1b880a2c10 msgr2=0x7f1b880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:58.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1b880a2c10 0x7f1b880a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b98005ab0 tx=0x7f1b98005a20 comp rx=0 tx=0).stop 2024-09-11T22:02:58.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 -- 172.21.15.152:0/1514889201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b9c105590 msgr2=0x7f1b9c1a4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:02:58.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b9c105590 0x7f1b9c1a4290 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400cce0 tx=0x7f1b9400a620 comp rx=0 tx=0).stop 2024-09-11T22:02:58.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 -- 172.21.15.152:0/1514889201 shutdown_connections 2024-09-11T22:02:58.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b9c105590 0x7f1b9c1a4290 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:58.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c100e10 0x7f1b9c199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:58.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f1b880a2c10 0x7f1b880a50d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:58.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 --2- 172.21.15.152:0/1514889201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b9c100460 0x7f1b9c199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:02:58.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 -- 172.21.15.152:0/1514889201 >> 172.21.15.152:0/1514889201 conn(0x7f1b9c0fbee0 msgr2=0x7f1b9c0fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:02:58.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 -- 172.21.15.152:0/1514889201 shutdown_connections 2024-09-11T22:02:58.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:02:58.929+0000 7f1ba4642640 1 -- 172.21.15.152:0/1514889201 wait complete. 2024-09-11T22:02:59.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:59 smithi152 ceph-mon[31188]: pgmap v286: 97 pgs: 3 peering, 94 active+clean; 621 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.1 KiB/s wr, 10 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-11T22:02:59.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:02:59 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1514889201' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:02:59.550 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T22:02:59.550 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:02:59.795 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:02:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:59 smithi179 ceph-mon[35603]: pgmap v286: 97 pgs: 3 peering, 94 active+clean; 621 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.1 KiB/s wr, 10 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-11T22:02:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:02:59 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1514889201' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:02:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:59 smithi193 ceph-mon[35545]: pgmap v286: 97 pgs: 3 peering, 94 active+clean; 621 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.1 KiB/s wr, 10 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-11T22:02:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:02:59 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1514889201' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:03:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.270+0000 7fd9e5467640 1 -- 172.21.15.152:0/829488526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9e0106a60 msgr2=0x7fd9e0106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.270+0000 7fd9e5467640 1 --2- 172.21.15.152:0/829488526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9e0106a60 0x7fd9e0106e40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009930 tx=0x7fd9d002a420 comp rx=0 tx=0).stop 2024-09-11T22:03:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.270+0000 7fd9e5467640 1 -- 172.21.15.152:0/829488526 shutdown_connections 2024-09-11T22:03:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.270+0000 7fd9e5467640 1 --2- 172.21.15.152:0/829488526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9e0101400 0x7fd9e010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:00.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.270+0000 7fd9e5467640 1 --2- 172.21.15.152:0/829488526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e0100a60 0x7fd9e0100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:00.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.270+0000 7fd9e5467640 1 --2- 172.21.15.152:0/829488526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9e0106a60 0x7fd9e0106e40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:00.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.270+0000 7fd9e5467640 1 -- 172.21.15.152:0/829488526 >> 172.21.15.152:0/829488526 conn(0x7fd9e00fc780 msgr2=0x7fd9e00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:00.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.270+0000 7fd9e5467640 1 -- 172.21.15.152:0/829488526 shutdown_connections 2024-09-11T22:03:00.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.270+0000 7fd9e5467640 1 -- 172.21.15.152:0/829488526 wait complete. 2024-09-11T22:03:00.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.270+0000 7fd9e5467640 1 Processor -- start 2024-09-11T22:03:00.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9e5467640 1 -- start start 2024-09-11T22:03:00.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9e5467640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9e0100a60 0x7fd9e01985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:00.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9e5467640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e0101400 0x7fd9e0198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:00.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9e5467640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9e0106a60 0x7fd9e019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:00.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9e5467640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e0110f00 con 0x7fd9e0100a60 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9e5467640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e0110d80 con 0x7fd9e0101400 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9e5467640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e0111080 con 0x7fd9e0106a60 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9deffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9e0100a60 0x7fd9e01985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9deffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9e0100a60 0x7fd9e01985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53122/0 (socket says 172.21.15.152:53122) 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9deffd640 1 -- 172.21.15.152:0/787780084 learned_addr learned my addr 172.21.15.152:0/787780084 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9de7fc640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e0101400 0x7fd9e0198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9deffd640 1 -- 172.21.15.152:0/787780084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9e0106a60 msgr2=0x7fd9e019ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9deffd640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9e0106a60 0x7fd9e019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9deffd640 1 -- 172.21.15.152:0/787780084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e0101400 msgr2=0x7fd9e0198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9deffd640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e0101400 0x7fd9e0198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9deffd640 1 -- 172.21.15.152:0/787780084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e019d590 con 0x7fd9e0100a60 2024-09-11T22:03:00.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9de7fc640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e0101400 0x7fd9e0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:00.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.271+0000 7fd9deffd640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9e0100a60 0x7fd9e01985e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009a50 tx=0x7fd9d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:00.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.272+0000 7fd9d7fff640 1 -- 172.21.15.152:0/787780084 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d003f030 con 0x7fd9e0100a60 2024-09-11T22:03:00.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.272+0000 7fd9e5467640 1 -- 172.21.15.152:0/787780084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e019d820 con 0x7fd9e0100a60 2024-09-11T22:03:00.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.272+0000 7fd9d7fff640 1 -- 172.21.15.152:0/787780084 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9d0003ce0 con 0x7fd9e0100a60 2024-09-11T22:03:00.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.272+0000 7fd9d7fff640 1 -- 172.21.15.152:0/787780084 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0035070 con 0x7fd9e0100a60 2024-09-11T22:03:00.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.272+0000 7fd9e5467640 1 -- 172.21.15.152:0/787780084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e01a5160 con 0x7fd9e0100a60 2024-09-11T22:03:00.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.273+0000 7fd9e5467640 1 -- 172.21.15.152:0/787780084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e0100f40 con 0x7fd9e0100a60 2024-09-11T22:03:00.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.274+0000 7fd9d7fff640 1 -- 172.21.15.152:0/787780084 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd9d0042030 con 0x7fd9e0100a60 2024-09-11T22:03:00.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.275+0000 7fd9d7fff640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd9cc0a2c10 0x7fd9cc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:00.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.275+0000 7fd9de7fc640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd9cc0a2c10 0x7fd9cc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:00.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.275+0000 7fd9d7fff640 1 -- 172.21.15.152:0/787780084 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fd9d00ef840 con 0x7fd9e0100a60 2024-09-11T22:03:00.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.275+0000 7fd9de7fc640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd9cc0a2c10 0x7fd9cc0a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8006fd0 tx=0x7fd9c8008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:00.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.279+0000 7fd9d7fff640 1 -- 172.21.15.152:0/787780084 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd9d00bc620 con 0x7fd9e0100a60 2024-09-11T22:03:00.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.449+0000 7fd9e5467640 1 -- 172.21.15.152:0/787780084 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd9e0062630 con 0x7fd9cc0a2c10 2024-09-11T22:03:00.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.456+0000 7fd9d7fff640 1 -- 172.21.15.152:0/787780084 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258710 (secure 0 0 0) 0x7fd9e0062630 con 0x7fd9cc0a2c10 2024-09-11T22:03:00.459 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:00.460 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-09-11T22:03:00.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 -- 172.21.15.152:0/787780084 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd9cc0a2c10 msgr2=0x7fd9cc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:00.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd9cc0a2c10 0x7fd9cc0a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8006fd0 tx=0x7fd9c8008040 comp rx=0 tx=0).stop 2024-09-11T22:03:00.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 -- 172.21.15.152:0/787780084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9e0100a60 msgr2=0x7fd9e01985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:00.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9e0100a60 0x7fd9e01985e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009a50 tx=0x7fd9d0004270 comp rx=0 tx=0).stop 2024-09-11T22:03:00.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 -- 172.21.15.152:0/787780084 shutdown_connections 2024-09-11T22:03:00.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd9cc0a2c10 0x7fd9cc0a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9e0106a60 0x7fd9e019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e0101400 0x7fd9e0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 --2- 172.21.15.152:0/787780084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9e0100a60 0x7fd9e01985e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 -- 172.21.15.152:0/787780084 >> 172.21.15.152:0/787780084 conn(0x7fd9e00fc780 msgr2=0x7fd9e006ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 -- 172.21.15.152:0/787780084 shutdown_connections 2024-09-11T22:03:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:00.459+0000 7fd9e5467640 1 -- 172.21.15.152:0/787780084 wait complete. 2024-09-11T22:03:01.166 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-11T22:03:00.279030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636063,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":232,"num_read_kb":214,"num_write":333,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":288,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366328,"kb_used_data":12860,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575496,"statfs":{"total":1151940427776,"available":1151565307904,"internally_reserved":0,"allocated":13168640,"data_stored":7220683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33871,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":55,"num_write":24,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001644"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344542+0000","last_change":"2024-09-11T22:02:36.105689+0000","last_active":"2024-09-11T22:02:55.344542+0000","last_peered":"2024-09-11T22:02:55.344542+0000","last_clean":"2024-09-11T22:02:55.344542+0000","last_became_active":"2024-09-11T22:02:36.105128+0000","last_became_peered":"2024-09-11T22:02:36.105128+0000","last_unstale":"2024-09-11T22:02:55.344542+0000","last_undegraded":"2024-09-11T22:02:55.344542+0000","last_fullsized":"2024-09-11T22:02:55.344542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:18.018731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344016+0000","last_change":"2024-09-11T22:02:36.096961+0000","last_active":"2024-09-11T22:02:55.344016+0000","last_peered":"2024-09-11T22:02:55.344016+0000","last_clean":"2024-09-11T22:02:55.344016+0000","last_became_active":"2024-09-11T22:02:36.096540+0000","last_became_peered":"2024-09-11T22:02:36.096540+0000","last_unstale":"2024-09-11T22:02:55.344016+0000","last_undegraded":"2024-09-11T22:02:55.344016+0000","last_fullsized":"2024-09-11T22:02:55.344016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:48.517125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343560+0000","last_change":"2024-09-11T22:02:36.108119+0000","last_active":"2024-09-11T22:02:55.343560+0000","last_peered":"2024-09-11T22:02:55.343560+0000","last_clean":"2024-09-11T22:02:55.343560+0000","last_became_active":"2024-09-11T22:02:36.107737+0000","last_became_peered":"2024-09-11T22:02:36.107737+0000","last_unstale":"2024-09-11T22:02:55.343560+0000","last_undegraded":"2024-09-11T22:02:55.343560+0000","last_fullsized":"2024-09-11T22:02:55.343560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:54.225935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543552+0000","last_change":"2024-09-11T22:02:36.107710+0000","last_active":"2024-09-11T22:02:55.543552+0000","last_peered":"2024-09-11T22:02:55.543552+0000","last_clean":"2024-09-11T22:02:55.543552+0000","last_became_active":"2024-09-11T22:02:36.107327+0000","last_became_peered":"2024-09-11T22:02:36.107327+0000","last_unstale":"2024-09-11T22:02:55.543552+0000","last_undegraded":"2024-09-11T22:02:55.543552+0000","last_fullsized":"2024-09-11T22:02:55.543552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.358535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347186+0000","last_change":"2024-09-11T22:02:36.100531+0000","last_active":"2024-09-11T22:02:55.347186+0000","last_peered":"2024-09-11T22:02:55.347186+0000","last_clean":"2024-09-11T22:02:55.347186+0000","last_became_active":"2024-09-11T22:02:36.100187+0000","last_became_peered":"2024-09-11T22:02:36.100187+0000","last_unstale":"2024-09-11T22:02:55.347186+0000","last_undegraded":"2024-09-11T22:02:55.347186+0000","last_fullsized":"2024-09-11T22:02:55.347186+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.156080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359096+0000","last_change":"2024-09-11T22:02:36.101316+0000","last_active":"2024-09-11T22:02:54.359096+0000","last_peered":"2024-09-11T22:02:54.359096+0000","last_clean":"2024-09-11T22:02:54.359096+0000","last_became_active":"2024-09-11T22:02:36.100985+0000","last_became_peered":"2024-09-11T22:02:36.100985+0000","last_unstale":"2024-09-11T22:02:54.359096+0000","last_undegraded":"2024-09-11T22:02:54.359096+0000","last_fullsized":"2024-09-11T22:02:54.359096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:55.972974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343776+0000","last_change":"2024-09-11T22:02:36.109146+0000","last_active":"2024-09-11T22:02:55.343776+0000","last_peered":"2024-09-11T22:02:55.343776+0000","last_clean":"2024-09-11T22:02:55.343776+0000","last_became_active":"2024-09-11T22:02:36.108817+0000","last_became_peered":"2024-09-11T22:02:36.108817+0000","last_unstale":"2024-09-11T22:02:55.343776+0000","last_undegraded":"2024-09-11T22:02:55.343776+0000","last_fullsized":"2024-09-11T22:02:55.343776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.222383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.345959+0000","last_change":"2024-09-11T22:02:36.100362+0000","last_active":"2024-09-11T22:02:55.345959+0000","last_peered":"2024-09-11T22:02:55.345959+0000","last_clean":"2024-09-11T22:02:55.345959+0000","last_became_active":"2024-09-11T22:02:36.100088+0000","last_became_peered":"2024-09-11T22:02:36.100088+0000","last_unstale":"2024-09-11T22:02:55.345959+0000","last_undegraded":"2024-09-11T22:02:55.345959+0000","last_fullsized":"2024-09-11T22:02:55.345959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.478879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342352+0000","last_change":"2024-09-11T22:02:36.106360+0000","last_active":"2024-09-11T22:02:55.342352+0000","last_peered":"2024-09-11T22:02:55.342352+0000","last_clean":"2024-09-11T22:02:55.342352+0000","last_became_active":"2024-09-11T22:02:36.105994+0000","last_became_peered":"2024-09-11T22:02:36.105994+0000","last_unstale":"2024-09-11T22:02:55.342352+0000","last_undegraded":"2024-09-11T22:02:55.342352+0000","last_fullsized":"2024-09-11T22:02:55.342352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:33.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359536+0000","last_change":"2024-09-11T22:02:36.109477+0000","last_active":"2024-09-11T22:02:54.359536+0000","last_peered":"2024-09-11T22:02:54.359536+0000","last_clean":"2024-09-11T22:02:54.359536+0000","last_became_active":"2024-09-11T22:02:36.109077+0000","last_became_peered":"2024-09-11T22:02:36.109077+0000","last_unstale":"2024-09-11T22:02:54.359536+0000","last_undegraded":"2024-09-11T22:02:54.359536+0000","last_fullsized":"2024-09-11T22:02:54.359536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.862359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343838+0000","last_change":"2024-09-11T22:02:36.112998+0000","last_active":"2024-09-11T22:02:55.343838+0000","last_peered":"2024-09-11T22:02:55.343838+0000","last_clean":"2024-09-11T22:02:55.343838+0000","last_became_active":"2024-09-11T22:02:36.112649+0000","last_became_peered":"2024-09-11T22:02:36.112649+0000","last_unstale":"2024-09-11T22:02:55.343838+0000","last_undegraded":"2024-09-11T22:02:55.343838+0000","last_fullsized":"2024-09-11T22:02:55.343838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:01.582572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543593+0000","last_change":"2024-09-11T22:02:36.099591+0000","last_active":"2024-09-11T22:02:55.543593+0000","last_peered":"2024-09-11T22:02:55.543593+0000","last_clean":"2024-09-11T22:02:55.543593+0000","last_became_active":"2024-09-11T22:02:36.099269+0000","last_became_peered":"2024-09-11T22:02:36.099269+0000","last_unstale":"2024-09-11T22:02:55.543593+0000","last_undegraded":"2024-09-11T22:02:55.543593+0000","last_fullsized":"2024-09-11T22:02:55.543593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:10.918188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340976+0000","last_change":"2024-09-11T22:02:36.100056+0000","last_active":"2024-09-11T22:02:55.340976+0000","last_peered":"2024-09-11T22:02:55.340976+0000","last_clean":"2024-09-11T22:02:55.340976+0000","last_became_active":"2024-09-11T22:02:36.099717+0000","last_became_peered":"2024-09-11T22:02:36.099717+0000","last_unstale":"2024-09-11T22:02:55.340976+0000","last_undegraded":"2024-09-11T22:02:55.340976+0000","last_fullsized":"2024-09-11T22:02:55.340976+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.486256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343551+0000","last_change":"2024-09-11T22:02:36.097281+0000","last_active":"2024-09-11T22:02:55.343551+0000","last_peered":"2024-09-11T22:02:55.343551+0000","last_clean":"2024-09-11T22:02:55.343551+0000","last_became_active":"2024-09-11T22:02:36.096768+0000","last_became_peered":"2024-09-11T22:02:36.096768+0000","last_unstale":"2024-09-11T22:02:55.343551+0000","last_undegraded":"2024-09-11T22:02:55.343551+0000","last_fullsized":"2024-09-11T22:02:55.343551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:31.232578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.351065+0000","last_change":"2024-09-11T22:02:55.351065+0000","last_active":"2024-09-11T22:02:55.351065+0000","last_peered":"2024-09-11T22:02:55.351065+0000","last_clean":"2024-09-11T22:02:55.351065+0000","last_became_active":"2024-09-11T22:02:55.350669+0000","last_became_peered":"2024-09-11T22:02:55.350669+0000","last_unstale":"2024-09-11T22:02:55.351065+0000","last_undegraded":"2024-09-11T22:02:55.351065+0000","last_fullsized":"2024-09-11T22:02:55.351065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:51.799060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341690+0000","last_change":"2024-09-11T22:02:36.109573+0000","last_active":"2024-09-11T22:02:55.341690+0000","last_peered":"2024-09-11T22:02:55.341690+0000","last_clean":"2024-09-11T22:02:55.341690+0000","last_became_active":"2024-09-11T22:02:36.109019+0000","last_became_peered":"2024-09-11T22:02:36.109019+0000","last_unstale":"2024-09-11T22:02:55.341690+0000","last_undegraded":"2024-09-11T22:02:55.341690+0000","last_fullsized":"2024-09-11T22:02:55.341690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:39.699762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344337+0000","last_change":"2024-09-11T22:02:36.105427+0000","last_active":"2024-09-11T22:02:55.344337+0000","last_peered":"2024-09-11T22:02:55.344337+0000","last_clean":"2024-09-11T22:02:55.344337+0000","last_became_active":"2024-09-11T22:02:36.104712+0000","last_became_peered":"2024-09-11T22:02:36.104712+0000","last_unstale":"2024-09-11T22:02:55.344337+0000","last_undegraded":"2024-09-11T22:02:55.344337+0000","last_fullsized":"2024-09-11T22:02:55.344337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:45.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344194+0000","last_change":"2024-09-11T22:02:36.097925+0000","last_active":"2024-09-11T22:02:55.344194+0000","last_peered":"2024-09-11T22:02:55.344194+0000","last_clean":"2024-09-11T22:02:55.344194+0000","last_became_active":"2024-09-11T22:02:36.097649+0000","last_became_peered":"2024-09-11T22:02:36.097649+0000","last_unstale":"2024-09-11T22:02:55.344194+0000","last_undegraded":"2024-09-11T22:02:55.344194+0000","last_fullsized":"2024-09-11T22:02:55.344194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.272197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347308+0000","last_change":"2024-09-11T22:02:36.107266+0000","last_active":"2024-09-11T22:02:55.347308+0000","last_peered":"2024-09-11T22:02:55.347308+0000","last_clean":"2024-09-11T22:02:55.347308+0000","last_became_active":"2024-09-11T22:02:36.106865+0000","last_became_peered":"2024-09-11T22:02:36.106865+0000","last_unstale":"2024-09-11T22:02:55.347308+0000","last_undegraded":"2024-09-11T22:02:55.347308+0000","last_fullsized":"2024-09-11T22:02:55.347308+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:53.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.349854+0000","last_change":"2024-09-11T22:02:55.349854+0000","last_active":"2024-09-11T22:02:55.349854+0000","last_peered":"2024-09-11T22:02:55.349854+0000","last_clean":"2024-09-11T22:02:55.349854+0000","last_became_active":"2024-09-11T22:02:55.349521+0000","last_became_peered":"2024-09-11T22:02:55.349521+0000","last_unstale":"2024-09-11T22:02:55.349854+0000","last_undegraded":"2024-09-11T22:02:55.349854+0000","last_fullsized":"2024-09-11T22:02:55.349854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341046+0000","last_change":"2024-09-11T22:02:36.110460+0000","last_active":"2024-09-11T22:02:55.341046+0000","last_peered":"2024-09-11T22:02:55.341046+0000","last_clean":"2024-09-11T22:02:55.341046+0000","last_became_active":"2024-09-11T22:02:36.110136+0000","last_became_peered":"2024-09-11T22:02:36.110136+0000","last_unstale":"2024-09-11T22:02:55.341046+0000","last_undegraded":"2024-09-11T22:02:55.341046+0000","last_fullsized":"2024-09-11T22:02:55.341046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:30.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341898+0000","last_change":"2024-09-11T22:02:36.111403+0000","last_active":"2024-09-11T22:02:55.341898+0000","last_peered":"2024-09-11T22:02:55.341898+0000","last_clean":"2024-09-11T22:02:55.341898+0000","last_became_active":"2024-09-11T22:02:36.110976+0000","last_became_peered":"2024-09-11T22:02:36.110976+0000","last_unstale":"2024-09-11T22:02:55.341898+0000","last_undegraded":"2024-09-11T22:02:55.341898+0000","last_fullsized":"2024-09-11T22:02:55.341898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:03.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346312+0000","last_change":"2024-09-11T22:02:36.110002+0000","last_active":"2024-09-11T22:02:55.346312+0000","last_peered":"2024-09-11T22:02:55.346312+0000","last_clean":"2024-09-11T22:02:55.346312+0000","last_became_active":"2024-09-11T22:02:36.109694+0000","last_became_peered":"2024-09-11T22:02:36.109694+0000","last_unstale":"2024-09-11T22:02:55.346312+0000","last_undegraded":"2024-09-11T22:02:55.346312+0000","last_fullsized":"2024-09-11T22:02:55.346312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:00.338509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341649+0000","last_change":"2024-09-11T22:02:36.101638+0000","last_active":"2024-09-11T22:02:55.341649+0000","last_peered":"2024-09-11T22:02:55.341649+0000","last_clean":"2024-09-11T22:02:55.341649+0000","last_became_active":"2024-09-11T22:02:36.101363+0000","last_became_peered":"2024-09-11T22:02:36.101363+0000","last_unstale":"2024-09-11T22:02:55.341649+0000","last_undegraded":"2024-09-11T22:02:55.341649+0000","last_fullsized":"2024-09-11T22:02:55.341649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:35.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346849+0000","last_change":"2024-09-11T22:02:36.109250+0000","last_active":"2024-09-11T22:02:55.346849+0000","last_peered":"2024-09-11T22:02:55.346849+0000","last_clean":"2024-09-11T22:02:55.346849+0000","last_became_active":"2024-09-11T22:02:36.108931+0000","last_became_peered":"2024-09-11T22:02:36.108931+0000","last_unstale":"2024-09-11T22:02:55.346849+0000","last_undegraded":"2024-09-11T22:02:55.346849+0000","last_fullsized":"2024-09-11T22:02:55.346849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:09.616621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347177+0000","last_change":"2024-09-11T22:02:36.113064+0000","last_active":"2024-09-11T22:02:55.347177+0000","last_peered":"2024-09-11T22:02:55.347177+0000","last_clean":"2024-09-11T22:02:55.347177+0000","last_became_active":"2024-09-11T22:02:36.112674+0000","last_became_peered":"2024-09-11T22:02:36.112674+0000","last_unstale":"2024-09-11T22:02:55.347177+0000","last_undegraded":"2024-09-11T22:02:55.347177+0000","last_fullsized":"2024-09-11T22:02:55.347177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:17.923053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344175+0000","last_change":"2024-09-11T22:02:36.101799+0000","last_active":"2024-09-11T22:02:55.344175+0000","last_peered":"2024-09-11T22:02:55.344175+0000","last_clean":"2024-09-11T22:02:55.344175+0000","last_became_active":"2024-09-11T22:02:36.101429+0000","last_became_peered":"2024-09-11T22:02:36.101429+0000","last_unstale":"2024-09-11T22:02:55.344175+0000","last_undegraded":"2024-09-11T22:02:55.344175+0000","last_fullsized":"2024-09-11T22:02:55.344175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.597619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340909+0000","last_change":"2024-09-11T22:02:36.100993+0000","last_active":"2024-09-11T22:02:55.340909+0000","last_peered":"2024-09-11T22:02:55.340909+0000","last_clean":"2024-09-11T22:02:55.340909+0000","last_became_active":"2024-09-11T22:02:36.100678+0000","last_became_peered":"2024-09-11T22:02:36.100678+0000","last_unstale":"2024-09-11T22:02:55.340909+0000","last_undegraded":"2024-09-11T22:02:55.340909+0000","last_fullsized":"2024-09-11T22:02:55.340909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:18.808422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344166+0000","last_change":"2024-09-11T22:02:36.103507+0000","last_active":"2024-09-11T22:02:55.344166+0000","last_peered":"2024-09-11T22:02:55.344166+0000","last_clean":"2024-09-11T22:02:55.344166+0000","last_became_active":"2024-09-11T22:02:36.103228+0000","last_became_peered":"2024-09-11T22:02:36.103228+0000","last_unstale":"2024-09-11T22:02:55.344166+0000","last_undegraded":"2024-09-11T22:02:55.344166+0000","last_fullsized":"2024-09-11T22:02:55.344166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.898635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347429+0000","last_change":"2024-09-11T22:02:36.104734+0000","last_active":"2024-09-11T22:02:55.347429+0000","last_peered":"2024-09-11T22:02:55.347429+0000","last_clean":"2024-09-11T22:02:55.347429+0000","last_became_active":"2024-09-11T22:02:36.103974+0000","last_became_peered":"2024-09-11T22:02:36.103974+0000","last_unstale":"2024-09-11T22:02:55.347429+0000","last_undegraded":"2024-09-11T22:02:55.347429+0000","last_fullsized":"2024-09-11T22:02:55.347429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:54.142031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347545+0000","last_change":"2024-09-11T22:02:36.106103+0000","last_active":"2024-09-11T22:02:55.347545+0000","last_peered":"2024-09-11T22:02:55.347545+0000","last_clean":"2024-09-11T22:02:55.347545+0000","last_became_active":"2024-09-11T22:02:36.105792+0000","last_became_peered":"2024-09-11T22:02:36.105792+0000","last_unstale":"2024-09-11T22:02:55.347545+0000","last_undegraded":"2024-09-11T22:02:55.347545+0000","last_fullsized":"2024-09-11T22:02:55.347545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:06.607094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343742+0000","last_change":"2024-09-11T22:02:36.104147+0000","last_active":"2024-09-11T22:02:55.343742+0000","last_peered":"2024-09-11T22:02:55.343742+0000","last_clean":"2024-09-11T22:02:55.343742+0000","last_became_active":"2024-09-11T22:02:36.103782+0000","last_became_peered":"2024-09-11T22:02:36.103782+0000","last_unstale":"2024-09-11T22:02:55.343742+0000","last_undegraded":"2024-09-11T22:02:55.343742+0000","last_fullsized":"2024-09-11T22:02:55.343742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.127609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348453+0000","last_change":"2024-09-11T22:02:36.101259+0000","last_active":"2024-09-11T22:02:55.348453+0000","last_peered":"2024-09-11T22:02:55.348453+0000","last_clean":"2024-09-11T22:02:55.348453+0000","last_became_active":"2024-09-11T22:02:36.100761+0000","last_became_peered":"2024-09-11T22:02:36.100761+0000","last_unstale":"2024-09-11T22:02:55.348453+0000","last_undegraded":"2024-09-11T22:02:55.348453+0000","last_fullsized":"2024-09-11T22:02:55.348453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:47.045252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:56.860569+0000","last_change":"2024-09-11T22:02:34.084522+0000","last_active":"2024-09-11T22:02:56.860569+0000","last_peered":"2024-09-11T22:02:56.860569+0000","last_clean":"2024-09-11T22:02:56.860569+0000","last_became_active":"2024-09-11T22:02:34.084211+0000","last_became_peered":"2024-09-11T22:02:34.084211+0000","last_unstale":"2024-09-11T22:02:56.860569+0000","last_undegraded":"2024-09-11T22:02:56.860569+0000","last_fullsized":"2024-09-11T22:02:56.860569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:18.963998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341673+0000","last_change":"2024-09-11T22:02:36.106890+0000","last_active":"2024-09-11T22:02:55.341673+0000","last_peered":"2024-09-11T22:02:55.341673+0000","last_clean":"2024-09-11T22:02:55.341673+0000","last_became_active":"2024-09-11T22:02:36.105255+0000","last_became_peered":"2024-09-11T22:02:36.105255+0000","last_unstale":"2024-09-11T22:02:55.341673+0000","last_undegraded":"2024-09-11T22:02:55.341673+0000","last_fullsized":"2024-09-11T22:02:55.341673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.995542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359141+0000","last_change":"2024-09-11T22:02:34.079967+0000","last_active":"2024-09-11T22:02:54.359141+0000","last_peered":"2024-09-11T22:02:54.359141+0000","last_clean":"2024-09-11T22:02:54.359141+0000","last_became_active":"2024-09-11T22:02:34.079649+0000","last_became_peered":"2024-09-11T22:02:34.079649+0000","last_unstale":"2024-09-11T22:02:54.359141+0000","last_undegraded":"2024-09-11T22:02:54.359141+0000","last_fullsized":"2024-09-11T22:02:54.359141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.661256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340684+0000","last_change":"2024-09-11T22:02:34.079850+0000","last_active":"2024-09-11T22:02:55.340684+0000","last_peered":"2024-09-11T22:02:55.340684+0000","last_clean":"2024-09-11T22:02:55.340684+0000","last_became_active":"2024-09-11T22:02:34.079514+0000","last_became_peered":"2024-09-11T22:02:34.079514+0000","last_unstale":"2024-09-11T22:02:55.340684+0000","last_undegraded":"2024-09-11T22:02:55.340684+0000","last_fullsized":"2024-09-11T22:02:55.340684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.359482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346279+0000","last_change":"2024-09-11T22:02:36.099310+0000","last_active":"2024-09-11T22:02:55.346279+0000","last_peered":"2024-09-11T22:02:55.346279+0000","last_clean":"2024-09-11T22:02:55.346279+0000","last_became_active":"2024-09-11T22:02:36.099026+0000","last_became_peered":"2024-09-11T22:02:36.099026+0000","last_unstale":"2024-09-11T22:02:55.346279+0000","last_undegraded":"2024-09-11T22:02:55.346279+0000","last_fullsized":"2024-09-11T22:02:55.346279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:57.570147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341975+0000","last_change":"2024-09-11T22:02:34.083757+0000","last_active":"2024-09-11T22:02:55.341975+0000","last_peered":"2024-09-11T22:02:55.341975+0000","last_clean":"2024-09-11T22:02:55.341975+0000","last_became_active":"2024-09-11T22:02:34.083467+0000","last_became_peered":"2024-09-11T22:02:34.083467+0000","last_unstale":"2024-09-11T22:02:55.341975+0000","last_undegraded":"2024-09-11T22:02:55.341975+0000","last_fullsized":"2024-09-11T22:02:55.341975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.546772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343509+0000","last_change":"2024-09-11T22:02:36.098939+0000","last_active":"2024-09-11T22:02:55.343509+0000","last_peered":"2024-09-11T22:02:55.343509+0000","last_clean":"2024-09-11T22:02:55.343509+0000","last_became_active":"2024-09-11T22:02:36.098631+0000","last_became_peered":"2024-09-11T22:02:36.098631+0000","last_unstale":"2024-09-11T22:02:55.343509+0000","last_undegraded":"2024-09-11T22:02:55.343509+0000","last_fullsized":"2024-09-11T22:02:55.343509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:07.663332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359557+0000","last_change":"2024-09-11T22:02:34.085325+0000","last_active":"2024-09-11T22:02:54.359557+0000","last_peered":"2024-09-11T22:02:54.359557+0000","last_clean":"2024-09-11T22:02:54.359557+0000","last_became_active":"2024-09-11T22:02:34.084967+0000","last_became_peered":"2024-09-11T22:02:34.084967+0000","last_unstale":"2024-09-11T22:02:54.359557+0000","last_undegraded":"2024-09-11T22:02:54.359557+0000","last_fullsized":"2024-09-11T22:02:54.359557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:35.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342150+0000","last_change":"2024-09-11T22:02:36.104454+0000","last_active":"2024-09-11T22:02:55.342150+0000","last_peered":"2024-09-11T22:02:55.342150+0000","last_clean":"2024-09-11T22:02:55.342150+0000","last_became_active":"2024-09-11T22:02:36.103988+0000","last_became_peered":"2024-09-11T22:02:36.103988+0000","last_unstale":"2024-09-11T22:02:55.342150+0000","last_undegraded":"2024-09-11T22:02:55.342150+0000","last_fullsized":"2024-09-11T22:02:55.342150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:32.748524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.548642+0000","last_change":"2024-09-11T22:02:55.548642+0000","last_active":"2024-09-11T22:02:55.548642+0000","last_peered":"2024-09-11T22:02:55.548642+0000","last_clean":"2024-09-11T22:02:55.548642+0000","last_became_active":"2024-09-11T22:02:55.545771+0000","last_became_peered":"2024-09-11T22:02:55.545771+0000","last_unstale":"2024-09-11T22:02:55.548642+0000","last_undegraded":"2024-09-11T22:02:55.548642+0000","last_fullsized":"2024-09-11T22:02:55.548642+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:03.431986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.349125+0000","last_change":"2024-09-11T22:02:55.349125+0000","last_active":"2024-09-11T22:02:55.349125+0000","last_peered":"2024-09-11T22:02:55.349125+0000","last_clean":"2024-09-11T22:02:55.349125+0000","last_became_active":"2024-09-11T22:02:55.348746+0000","last_became_peered":"2024-09-11T22:02:55.348746+0000","last_unstale":"2024-09-11T22:02:55.349125+0000","last_undegraded":"2024-09-11T22:02:55.349125+0000","last_fullsized":"2024-09-11T22:02:55.349125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342094+0000","last_change":"2024-09-11T22:02:34.089793+0000","last_active":"2024-09-11T22:02:55.342094+0000","last_peered":"2024-09-11T22:02:55.342094+0000","last_clean":"2024-09-11T22:02:55.342094+0000","last_became_active":"2024-09-11T22:02:34.089468+0000","last_became_peered":"2024-09-11T22:02:34.089468+0000","last_unstale":"2024-09-11T22:02:55.342094+0000","last_undegraded":"2024-09-11T22:02:55.342094+0000","last_fullsized":"2024-09-11T22:02:55.342094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:10:21.034822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341941+0000","last_change":"2024-09-11T22:02:36.106224+0000","last_active":"2024-09-11T22:02:55.341941+0000","last_peered":"2024-09-11T22:02:55.341941+0000","last_clean":"2024-09-11T22:02:55.341941+0000","last_became_active":"2024-09-11T22:02:36.105903+0000","last_became_peered":"2024-09-11T22:02:36.105903+0000","last_unstale":"2024-09-11T22:02:55.341941+0000","last_undegraded":"2024-09-11T22:02:55.341941+0000","last_fullsized":"2024-09-11T22:02:55.341941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.354653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'21","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.860216+0000","last_change":"2024-09-11T22:02:34.082150+0000","last_active":"2024-09-11T22:02:54.860216+0000","last_peered":"2024-09-11T22:02:54.860216+0000","last_clean":"2024-09-11T22:02:54.860216+0000","last_became_active":"2024-09-11T22:02:34.081822+0000","last_became_peered":"2024-09-11T22:02:34.081822+0000","last_unstale":"2024-09-11T22:02:54.860216+0000","last_undegraded":"2024-09-11T22:02:54.860216+0000","last_fullsized":"2024-09-11T22:02:54.860216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:39.320410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41065,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":52,"num_write":22,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348665+0000","last_change":"2024-09-11T22:02:36.112124+0000","last_active":"2024-09-11T22:02:55.348665+0000","last_peered":"2024-09-11T22:02:55.348665+0000","last_clean":"2024-09-11T22:02:55.348665+0000","last_became_active":"2024-09-11T22:02:36.111739+0000","last_became_peered":"2024-09-11T22:02:36.111739+0000","last_unstale":"2024-09-11T22:02:55.348665+0000","last_undegraded":"2024-09-11T22:02:55.348665+0000","last_fullsized":"2024-09-11T22:02:55.348665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:52.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346805+0000","last_change":"2024-09-11T22:02:34.083047+0000","last_active":"2024-09-11T22:02:55.346805+0000","last_peered":"2024-09-11T22:02:55.346805+0000","last_clean":"2024-09-11T22:02:55.346805+0000","last_became_active":"2024-09-11T22:02:34.082406+0000","last_became_peered":"2024-09-11T22:02:34.082406+0000","last_unstale":"2024-09-11T22:02:55.346805+0000","last_undegraded":"2024-09-11T22:02:55.346805+0000","last_fullsized":"2024-09-11T22:02:55.346805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:33.249337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340763+0000","last_change":"2024-09-11T22:02:36.108859+0000","last_active":"2024-09-11T22:02:55.340763+0000","last_peered":"2024-09-11T22:02:55.340763+0000","last_clean":"2024-09-11T22:02:55.340763+0000","last_became_active":"2024-09-11T22:02:36.108558+0000","last_became_peered":"2024-09-11T22:02:36.108558+0000","last_unstale":"2024-09-11T22:02:55.340763+0000","last_undegraded":"2024-09-11T22:02:55.340763+0000","last_fullsized":"2024-09-11T22:02:55.340763+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.430672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341741+0000","last_change":"2024-09-11T22:02:34.080560+0000","last_active":"2024-09-11T22:02:55.341741+0000","last_peered":"2024-09-11T22:02:55.341741+0000","last_clean":"2024-09-11T22:02:55.341741+0000","last_became_active":"2024-09-11T22:02:34.080262+0000","last_became_peered":"2024-09-11T22:02:34.080262+0000","last_unstale":"2024-09-11T22:02:55.341741+0000","last_undegraded":"2024-09-11T22:02:55.341741+0000","last_fullsized":"2024-09-11T22:02:55.341741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:44.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343837+0000","last_change":"2024-09-11T22:02:36.107722+0000","last_active":"2024-09-11T22:02:55.343837+0000","last_peered":"2024-09-11T22:02:55.343837+0000","last_clean":"2024-09-11T22:02:55.343837+0000","last_became_active":"2024-09-11T22:02:36.107219+0000","last_became_peered":"2024-09-11T22:02:36.107219+0000","last_unstale":"2024-09-11T22:02:55.343837+0000","last_undegraded":"2024-09-11T22:02:55.343837+0000","last_fullsized":"2024-09-11T22:02:55.343837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.576045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:57.861563+0000","last_change":"2024-09-11T22:02:34.083573+0000","last_active":"2024-09-11T22:02:57.861563+0000","last_peered":"2024-09-11T22:02:57.861563+0000","last_clean":"2024-09-11T22:02:57.861563+0000","last_became_active":"2024-09-11T22:02:34.083277+0000","last_became_peered":"2024-09-11T22:02:34.083277+0000","last_unstale":"2024-09-11T22:02:57.861563+0000","last_undegraded":"2024-09-11T22:02:57.861563+0000","last_fullsized":"2024-09-11T22:02:57.861563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:31.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343635+0000","last_change":"2024-09-11T22:02:36.105075+0000","last_active":"2024-09-11T22:02:55.343635+0000","last_peered":"2024-09-11T22:02:55.343635+0000","last_clean":"2024-09-11T22:02:55.343635+0000","last_became_active":"2024-09-11T22:02:36.104022+0000","last_became_peered":"2024-09-11T22:02:36.104022+0000","last_unstale":"2024-09-11T22:02:55.343635+0000","last_undegraded":"2024-09-11T22:02:55.343635+0000","last_fullsized":"2024-09-11T22:02:55.343635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.693146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347063+0000","last_change":"2024-09-11T22:02:34.088727+0000","last_active":"2024-09-11T22:02:55.347063+0000","last_peered":"2024-09-11T22:02:55.347063+0000","last_clean":"2024-09-11T22:02:55.347063+0000","last_became_active":"2024-09-11T22:02:34.088394+0000","last_became_peered":"2024-09-11T22:02:34.088394+0000","last_unstale":"2024-09-11T22:02:55.347063+0000","last_undegraded":"2024-09-11T22:02:55.347063+0000","last_fullsized":"2024-09-11T22:02:55.347063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:11.809765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341774+0000","last_change":"2024-09-11T22:02:36.104522+0000","last_active":"2024-09-11T22:02:55.341774+0000","last_peered":"2024-09-11T22:02:55.341774+0000","last_clean":"2024-09-11T22:02:55.341774+0000","last_became_active":"2024-09-11T22:02:36.104181+0000","last_became_peered":"2024-09-11T22:02:36.104181+0000","last_unstale":"2024-09-11T22:02:55.341774+0000","last_undegraded":"2024-09-11T22:02:55.341774+0000","last_fullsized":"2024-09-11T22:02:55.341774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:08.139180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347551+0000","last_change":"2024-09-11T22:02:34.080341+0000","last_active":"2024-09-11T22:02:55.347551+0000","last_peered":"2024-09-11T22:02:55.347551+0000","last_clean":"2024-09-11T22:02:55.347551+0000","last_became_active":"2024-09-11T22:02:34.078761+0000","last_became_peered":"2024-09-11T22:02:34.078761+0000","last_unstale":"2024-09-11T22:02:55.347551+0000","last_undegraded":"2024-09-11T22:02:55.347551+0000","last_fullsized":"2024-09-11T22:02:55.347551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.545135+0000","last_change":"2024-09-11T22:02:55.545135+0000","last_active":"2024-09-11T22:02:55.545135+0000","last_peered":"2024-09-11T22:02:55.545135+0000","last_clean":"2024-09-11T22:02:55.545135+0000","last_became_active":"2024-09-11T22:02:55.544785+0000","last_became_peered":"2024-09-11T22:02:55.544785+0000","last_unstale":"2024-09-11T22:02:55.545135+0000","last_undegraded":"2024-09-11T22:02:55.545135+0000","last_fullsized":"2024-09-11T22:02:55.545135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:05.815828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341028+0000","last_change":"2024-09-11T22:02:34.082364+0000","last_active":"2024-09-11T22:02:55.341028+0000","last_peered":"2024-09-11T22:02:55.341028+0000","last_clean":"2024-09-11T22:02:55.341028+0000","last_became_active":"2024-09-11T22:02:34.081906+0000","last_became_peered":"2024-09-11T22:02:34.081906+0000","last_unstale":"2024-09-11T22:02:55.341028+0000","last_undegraded":"2024-09-11T22:02:55.341028+0000","last_fullsized":"2024-09-11T22:02:55.341028+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:58.603942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344193+0000","last_change":"2024-09-11T22:02:36.110725+0000","last_active":"2024-09-11T22:02:55.344193+0000","last_peered":"2024-09-11T22:02:55.344193+0000","last_clean":"2024-09-11T22:02:55.344193+0000","last_became_active":"2024-09-11T22:02:36.110401+0000","last_became_peered":"2024-09-11T22:02:36.110401+0000","last_unstale":"2024-09-11T22:02:55.344193+0000","last_undegraded":"2024-09-11T22:02:55.344193+0000","last_fullsized":"2024-09-11T22:02:55.344193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:41.789134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342240+0000","last_change":"2024-09-11T22:02:34.082983+0000","last_active":"2024-09-11T22:02:55.342240+0000","last_peered":"2024-09-11T22:02:55.342240+0000","last_clean":"2024-09-11T22:02:55.342240+0000","last_became_active":"2024-09-11T22:02:34.082618+0000","last_became_peered":"2024-09-11T22:02:34.082618+0000","last_unstale":"2024-09-11T22:02:55.342240+0000","last_undegraded":"2024-09-11T22:02:55.342240+0000","last_fullsized":"2024-09-11T22:02:55.342240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.481228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343871+0000","last_change":"2024-09-11T22:02:36.108222+0000","last_active":"2024-09-11T22:02:55.343871+0000","last_peered":"2024-09-11T22:02:55.343871+0000","last_clean":"2024-09-11T22:02:55.343871+0000","last_became_active":"2024-09-11T22:02:36.107739+0000","last_became_peered":"2024-09-11T22:02:36.107739+0000","last_unstale":"2024-09-11T22:02:55.343871+0000","last_undegraded":"2024-09-11T22:02:55.343871+0000","last_fullsized":"2024-09-11T22:02:55.343871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:11.353217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347043+0000","last_change":"2024-09-11T22:02:34.090068+0000","last_active":"2024-09-11T22:02:55.347043+0000","last_peered":"2024-09-11T22:02:55.347043+0000","last_clean":"2024-09-11T22:02:55.347043+0000","last_became_active":"2024-09-11T22:02:34.089735+0000","last_became_peered":"2024-09-11T22:02:34.089735+0000","last_unstale":"2024-09-11T22:02:55.347043+0000","last_undegraded":"2024-09-11T22:02:55.347043+0000","last_fullsized":"2024-09-11T22:02:55.347043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:32.917459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343993+0000","last_change":"2024-09-11T22:02:36.108017+0000","last_active":"2024-09-11T22:02:55.343993+0000","last_peered":"2024-09-11T22:02:55.343993+0000","last_clean":"2024-09-11T22:02:55.343993+0000","last_became_active":"2024-09-11T22:02:36.107339+0000","last_became_peered":"2024-09-11T22:02:36.107339+0000","last_unstale":"2024-09-11T22:02:55.343993+0000","last_undegraded":"2024-09-11T22:02:55.343993+0000","last_fullsized":"2024-09-11T22:02:55.343993+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:19.240354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343956+0000","last_change":"2024-09-11T22:01:28.522567+0000","last_active":"2024-09-11T22:02:55.343956+0000","last_peered":"2024-09-11T22:02:55.343956+0000","last_clean":"2024-09-11T22:02:55.343956+0000","last_became_active":"2024-09-11T22:01:28.522079+0000","last_became_peered":"2024-09-11T22:01:28.522079+0000","last_unstale":"2024-09-11T22:02:55.343956+0000","last_undegraded":"2024-09-11T22:02:55.343956+0000","last_fullsized":"2024-09-11T22:02:55.343956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_clean_scrub_stamp":"2024-09-11T21:58:11.245706+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:48.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543596+0000","last_change":"2024-09-11T22:02:34.080535+0000","last_active":"2024-09-11T22:02:55.543596+0000","last_peered":"2024-09-11T22:02:55.543596+0000","last_clean":"2024-09-11T22:02:55.543596+0000","last_became_active":"2024-09-11T22:02:34.079351+0000","last_became_peered":"2024-09-11T22:02:34.079351+0000","last_unstale":"2024-09-11T22:02:55.543596+0000","last_undegraded":"2024-09-11T22:02:55.543596+0000","last_fullsized":"2024-09-11T22:02:55.543596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:29.737198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346582+0000","last_change":"2024-09-11T22:02:36.104476+0000","last_active":"2024-09-11T22:02:55.346582+0000","last_peered":"2024-09-11T22:02:55.346582+0000","last_clean":"2024-09-11T22:02:55.346582+0000","last_became_active":"2024-09-11T22:02:36.104163+0000","last_became_peered":"2024-09-11T22:02:36.104163+0000","last_unstale":"2024-09-11T22:02:55.346582+0000","last_undegraded":"2024-09-11T22:02:55.346582+0000","last_fullsized":"2024-09-11T22:02:55.346582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.570125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343951+0000","last_change":"2024-09-11T22:02:34.079652+0000","last_active":"2024-09-11T22:02:55.343951+0000","last_peered":"2024-09-11T22:02:55.343951+0000","last_clean":"2024-09-11T22:02:55.343951+0000","last_became_active":"2024-09-11T22:02:34.079365+0000","last_became_peered":"2024-09-11T22:02:34.079365+0000","last_unstale":"2024-09-11T22:02:55.343951+0000","last_undegraded":"2024-09-11T22:02:55.343951+0000","last_fullsized":"2024-09-11T22:02:55.343951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:15.371852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340660+0000","last_change":"2024-09-11T22:02:36.107209+0000","last_active":"2024-09-11T22:02:55.340660+0000","last_peered":"2024-09-11T22:02:55.340660+0000","last_clean":"2024-09-11T22:02:55.340660+0000","last_became_active":"2024-09-11T22:02:36.106896+0000","last_became_peered":"2024-09-11T22:02:36.106896+0000","last_unstale":"2024-09-11T22:02:55.340660+0000","last_undegraded":"2024-09-11T22:02:55.340660+0000","last_fullsized":"2024-09-11T22:02:55.340660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:04.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:56.859783+0000","last_change":"2024-09-11T22:02:34.088531+0000","last_active":"2024-09-11T22:02:56.859783+0000","last_peered":"2024-09-11T22:02:56.859783+0000","last_clean":"2024-09-11T22:02:56.859783+0000","last_became_active":"2024-09-11T22:02:34.088252+0000","last_became_peered":"2024-09-11T22:02:34.088252+0000","last_unstale":"2024-09-11T22:02:56.859783+0000","last_undegraded":"2024-09-11T22:02:56.859783+0000","last_fullsized":"2024-09-11T22:02:56.859783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:43.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341771+0000","last_change":"2024-09-11T22:02:36.108963+0000","last_active":"2024-09-11T22:02:55.341771+0000","last_peered":"2024-09-11T22:02:55.341771+0000","last_clean":"2024-09-11T22:02:55.341771+0000","last_became_active":"2024-09-11T22:02:36.108435+0000","last_became_peered":"2024-09-11T22:02:36.108435+0000","last_unstale":"2024-09-11T22:02:55.341771+0000","last_undegraded":"2024-09-11T22:02:55.341771+0000","last_fullsized":"2024-09-11T22:02:55.341771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:11.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344233+0000","last_change":"2024-09-11T22:02:34.084283+0000","last_active":"2024-09-11T22:02:55.344233+0000","last_peered":"2024-09-11T22:02:55.344233+0000","last_clean":"2024-09-11T22:02:55.344233+0000","last_became_active":"2024-09-11T22:02:34.083948+0000","last_became_peered":"2024-09-11T22:02:34.083948+0000","last_unstale":"2024-09-11T22:02:55.344233+0000","last_undegraded":"2024-09-11T22:02:55.344233+0000","last_fullsized":"2024-09-11T22:02:55.344233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:48.763643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359256+0000","last_change":"2024-09-11T22:02:36.102147+0000","last_active":"2024-09-11T22:02:54.359256+0000","last_peered":"2024-09-11T22:02:54.359256+0000","last_clean":"2024-09-11T22:02:54.359256+0000","last_became_active":"2024-09-11T22:02:36.101641+0000","last_became_peered":"2024-09-11T22:02:36.101641+0000","last_unstale":"2024-09-11T22:02:54.359256+0000","last_undegraded":"2024-09-11T22:02:54.359256+0000","last_fullsized":"2024-09-11T22:02:54.359256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:58.145304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343756+0000","last_change":"2024-09-11T22:02:34.090538+0000","last_active":"2024-09-11T22:02:55.343756+0000","last_peered":"2024-09-11T22:02:55.343756+0000","last_clean":"2024-09-11T22:02:55.343756+0000","last_became_active":"2024-09-11T22:02:34.090238+0000","last_became_peered":"2024-09-11T22:02:34.090238+0000","last_unstale":"2024-09-11T22:02:55.343756+0000","last_undegraded":"2024-09-11T22:02:55.343756+0000","last_fullsized":"2024-09-11T22:02:55.343756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:47.037999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359323+0000","last_change":"2024-09-11T22:02:36.095664+0000","last_active":"2024-09-11T22:02:54.359323+0000","last_peered":"2024-09-11T22:02:54.359323+0000","last_clean":"2024-09-11T22:02:54.359323+0000","last_became_active":"2024-09-11T22:02:36.095304+0000","last_became_peered":"2024-09-11T22:02:36.095304+0000","last_unstale":"2024-09-11T22:02:54.359323+0000","last_undegraded":"2024-09-11T22:02:54.359323+0000","last_fullsized":"2024-09-11T22:02:54.359323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.484809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348688+0000","last_change":"2024-09-11T22:02:34.089781+0000","last_active":"2024-09-11T22:02:55.348688+0000","last_peered":"2024-09-11T22:02:55.348688+0000","last_clean":"2024-09-11T22:02:55.348688+0000","last_became_active":"2024-09-11T22:02:34.089439+0000","last_became_peered":"2024-09-11T22:02:34.089439+0000","last_unstale":"2024-09-11T22:02:55.348688+0000","last_undegraded":"2024-09-11T22:02:55.348688+0000","last_fullsized":"2024-09-11T22:02:55.348688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:38.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340944+0000","last_change":"2024-09-11T22:02:36.107159+0000","last_active":"2024-09-11T22:02:55.340944+0000","last_peered":"2024-09-11T22:02:55.340944+0000","last_clean":"2024-09-11T22:02:55.340944+0000","last_became_active":"2024-09-11T22:02:36.106846+0000","last_became_peered":"2024-09-11T22:02:36.106846+0000","last_unstale":"2024-09-11T22:02:55.340944+0000","last_undegraded":"2024-09-11T22:02:55.340944+0000","last_fullsized":"2024-09-11T22:02:55.340944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.972944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.353307+0000","last_change":"2024-09-11T22:02:55.352887+0000","last_active":"2024-09-11T22:02:55.353307+0000","last_peered":"2024-09-11T22:02:55.353307+0000","last_clean":"2024-09-11T22:02:55.353307+0000","last_became_active":"2024-09-11T22:02:55.348619+0000","last_became_peered":"2024-09-11T22:02:55.348619+0000","last_unstale":"2024-09-11T22:02:55.353307+0000","last_undegraded":"2024-09-11T22:02:55.353307+0000","last_fullsized":"2024-09-11T22:02:55.353307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:51.259114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346932+0000","last_change":"2024-09-11T22:02:36.108560+0000","last_active":"2024-09-11T22:02:55.346932+0000","last_peered":"2024-09-11T22:02:55.346932+0000","last_clean":"2024-09-11T22:02:55.346932+0000","last_became_active":"2024-09-11T22:02:36.107593+0000","last_became_peered":"2024-09-11T22:02:36.107593+0000","last_unstale":"2024-09-11T22:02:55.346932+0000","last_undegraded":"2024-09-11T22:02:55.346932+0000","last_fullsized":"2024-09-11T22:02:55.346932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.479991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.544133+0000","last_change":"2024-09-11T22:02:34.087394+0000","last_active":"2024-09-11T22:02:55.544133+0000","last_peered":"2024-09-11T22:02:55.544133+0000","last_clean":"2024-09-11T22:02:55.544133+0000","last_became_active":"2024-09-11T22:02:34.087146+0000","last_became_peered":"2024-09-11T22:02:34.087146+0000","last_unstale":"2024-09-11T22:02:55.544133+0000","last_undegraded":"2024-09-11T22:02:55.544133+0000","last_fullsized":"2024-09-11T22:02:55.544133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:30.772437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.545065+0000","last_change":"2024-09-11T22:02:55.545065+0000","last_active":"2024-09-11T22:02:55.545065+0000","last_peered":"2024-09-11T22:02:55.545065+0000","last_clean":"2024-09-11T22:02:55.545065+0000","last_became_active":"2024-09-11T22:02:55.544736+0000","last_became_peered":"2024-09-11T22:02:55.544736+0000","last_unstale":"2024-09-11T22:02:55.545065+0000","last_undegraded":"2024-09-11T22:02:55.545065+0000","last_fullsized":"2024-09-11T22:02:55.545065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:23.706253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341812+0000","last_change":"2024-09-11T22:02:34.088717+0000","last_active":"2024-09-11T22:02:55.341812+0000","last_peered":"2024-09-11T22:02:55.341812+0000","last_clean":"2024-09-11T22:02:55.341812+0000","last_became_active":"2024-09-11T22:02:34.088412+0000","last_became_peered":"2024-09-11T22:02:34.088412+0000","last_unstale":"2024-09-11T22:02:55.341812+0000","last_undegraded":"2024-09-11T22:02:55.341812+0000","last_fullsized":"2024-09-11T22:02:55.341812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348372+0000","last_change":"2024-09-11T22:02:36.103781+0000","last_active":"2024-09-11T22:02:55.348372+0000","last_peered":"2024-09-11T22:02:55.348372+0000","last_clean":"2024-09-11T22:02:55.348372+0000","last_became_active":"2024-09-11T22:02:36.103426+0000","last_became_peered":"2024-09-11T22:02:36.103426+0000","last_unstale":"2024-09-11T22:02:55.348372+0000","last_undegraded":"2024-09-11T22:02:55.348372+0000","last_fullsized":"2024-09-11T22:02:55.348372+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:34.962793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346446+0000","last_change":"2024-09-11T22:02:34.080333+0000","last_active":"2024-09-11T22:02:55.346446+0000","last_peered":"2024-09-11T22:02:55.346446+0000","last_clean":"2024-09-11T22:02:55.346446+0000","last_became_active":"2024-09-11T22:02:34.079384+0000","last_became_peered":"2024-09-11T22:02:34.079384+0000","last_unstale":"2024-09-11T22:02:55.346446+0000","last_undegraded":"2024-09-11T22:02:55.346446+0000","last_fullsized":"2024-09-11T22:02:55.346446+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:38.313516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343953+0000","last_change":"2024-09-11T22:02:36.103306+0000","last_active":"2024-09-11T22:02:55.343953+0000","last_peered":"2024-09-11T22:02:55.343953+0000","last_clean":"2024-09-11T22:02:55.343953+0000","last_became_active":"2024-09-11T22:02:36.102967+0000","last_became_peered":"2024-09-11T22:02:36.102967+0000","last_unstale":"2024-09-11T22:02:55.343953+0000","last_undegraded":"2024-09-11T22:02:55.343953+0000","last_fullsized":"2024-09-11T22:02:55.343953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:34.138931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.355119+0000","last_change":"2024-09-11T22:02:55.355119+0000","last_active":"2024-09-11T22:02:55.355119+0000","last_peered":"2024-09-11T22:02:55.355119+0000","last_clean":"2024-09-11T22:02:55.355119+0000","last_became_active":"2024-09-11T22:02:55.350440+0000","last_became_peered":"2024-09-11T22:02:55.350440+0000","last_unstale":"2024-09-11T22:02:55.355119+0000","last_undegraded":"2024-09-11T22:02:55.355119+0000","last_fullsized":"2024-09-11T22:02:55.355119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:47.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346553+0000","last_change":"2024-09-11T22:02:36.102491+0000","last_active":"2024-09-11T22:02:55.346553+0000","last_peered":"2024-09-11T22:02:55.346553+0000","last_clean":"2024-09-11T22:02:55.346553+0000","last_became_active":"2024-09-11T22:02:36.102112+0000","last_became_peered":"2024-09-11T22:02:36.102112+0000","last_unstale":"2024-09-11T22:02:55.346553+0000","last_undegraded":"2024-09-11T22:02:55.346553+0000","last_fullsized":"2024-09-11T22:02:55.346553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:47.588539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347284+0000","last_change":"2024-09-11T22:02:34.082590+0000","last_active":"2024-09-11T22:02:55.347284+0000","last_peered":"2024-09-11T22:02:55.347284+0000","last_clean":"2024-09-11T22:02:55.347284+0000","last_became_active":"2024-09-11T22:02:34.082288+0000","last_became_peered":"2024-09-11T22:02:34.082288+0000","last_unstale":"2024-09-11T22:02:55.347284+0000","last_undegraded":"2024-09-11T22:02:55.347284+0000","last_fullsized":"2024-09-11T22:02:55.347284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:57.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344015+0000","last_change":"2024-09-11T22:02:36.105247+0000","last_active":"2024-09-11T22:02:55.344015+0000","last_peered":"2024-09-11T22:02:55.344015+0000","last_clean":"2024-09-11T22:02:55.344015+0000","last_became_active":"2024-09-11T22:02:36.104912+0000","last_became_peered":"2024-09-11T22:02:36.104912+0000","last_unstale":"2024-09-11T22:02:55.344015+0000","last_undegraded":"2024-09-11T22:02:55.344015+0000","last_fullsized":"2024-09-11T22:02:55.344015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:05.396671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.544869+0000","last_change":"2024-09-11T22:02:55.544428+0000","last_active":"2024-09-11T22:02:55.544869+0000","last_peered":"2024-09-11T22:02:55.544869+0000","last_clean":"2024-09-11T22:02:55.544869+0000","last_became_active":"2024-09-11T22:02:55.544151+0000","last_became_peered":"2024-09-11T22:02:55.544151+0000","last_unstale":"2024-09-11T22:02:55.544869+0000","last_undegraded":"2024-09-11T22:02:55.544869+0000","last_fullsized":"2024-09-11T22:02:55.544869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.100131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348353+0000","last_change":"2024-09-11T22:02:34.079017+0000","last_active":"2024-09-11T22:02:55.348353+0000","last_peered":"2024-09-11T22:02:55.348353+0000","last_clean":"2024-09-11T22:02:55.348353+0000","last_became_active":"2024-09-11T22:02:34.078663+0000","last_became_peered":"2024-09-11T22:02:34.078663+0000","last_unstale":"2024-09-11T22:02:55.348353+0000","last_undegraded":"2024-09-11T22:02:55.348353+0000","last_fullsized":"2024-09-11T22:02:55.348353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:05.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341769+0000","last_change":"2024-09-11T22:02:36.097768+0000","last_active":"2024-09-11T22:02:55.341769+0000","last_peered":"2024-09-11T22:02:55.341769+0000","last_clean":"2024-09-11T22:02:55.341769+0000","last_became_active":"2024-09-11T22:02:36.097396+0000","last_became_peered":"2024-09-11T22:02:36.097396+0000","last_unstale":"2024-09-11T22:02:55.341769+0000","last_undegraded":"2024-09-11T22:02:55.341769+0000","last_fullsized":"2024-09-11T22:02:55.341769+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:35.673268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.355229+0000","last_change":"2024-09-11T22:02:55.355229+0000","last_active":"2024-09-11T22:02:55.355229+0000","last_peered":"2024-09-11T22:02:55.355229+0000","last_clean":"2024-09-11T22:02:55.355229+0000","last_became_active":"2024-09-11T22:02:55.350492+0000","last_became_peered":"2024-09-11T22:02:55.350492+0000","last_unstale":"2024-09-11T22:02:55.355229+0000","last_undegraded":"2024-09-11T22:02:55.355229+0000","last_fullsized":"2024-09-11T22:02:55.355229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:03:31.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343902+0000","last_change":"2024-09-11T22:02:36.108992+0000","last_active":"2024-09-11T22:02:55.343902+0000","last_peered":"2024-09-11T22:02:55.343902+0000","last_clean":"2024-09-11T22:02:55.343902+0000","last_became_active":"2024-09-11T22:02:36.108674+0000","last_became_peered":"2024-09-11T22:02:36.108674+0000","last_unstale":"2024-09-11T22:02:55.343902+0000","last_undegraded":"2024-09-11T22:02:55.343902+0000","last_fullsized":"2024-09-11T22:02:55.343902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:57.083127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347109+0000","last_change":"2024-09-11T22:02:34.088833+0000","last_active":"2024-09-11T22:02:55.347109+0000","last_peered":"2024-09-11T22:02:55.347109+0000","last_clean":"2024-09-11T22:02:55.347109+0000","last_became_active":"2024-09-11T22:02:34.088275+0000","last_became_peered":"2024-09-11T22:02:34.088275+0000","last_unstale":"2024-09-11T22:02:55.347109+0000","last_undegraded":"2024-09-11T22:02:55.347109+0000","last_fullsized":"2024-09-11T22:02:55.347109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:31.167486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347003+0000","last_change":"2024-09-11T22:02:36.108154+0000","last_active":"2024-09-11T22:02:55.347003+0000","last_peered":"2024-09-11T22:02:55.347003+0000","last_clean":"2024-09-11T22:02:55.347003+0000","last_became_active":"2024-09-11T22:02:36.107817+0000","last_became_peered":"2024-09-11T22:02:36.107817+0000","last_unstale":"2024-09-11T22:02:55.347003+0000","last_undegraded":"2024-09-11T22:02:55.347003+0000","last_fullsized":"2024-09-11T22:02:55.347003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.168339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344005+0000","last_change":"2024-09-11T22:02:34.082193+0000","last_active":"2024-09-11T22:02:55.344005+0000","last_peered":"2024-09-11T22:02:55.344005+0000","last_clean":"2024-09-11T22:02:55.344005+0000","last_became_active":"2024-09-11T22:02:34.081852+0000","last_became_peered":"2024-09-11T22:02:34.081852+0000","last_unstale":"2024-09-11T22:02:55.344005+0000","last_undegraded":"2024-09-11T22:02:55.344005+0000","last_fullsized":"2024-09-11T22:02:55.344005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:08.319444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45461,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":96,"num_read_kb":95,"num_write":150,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":154477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514513,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":443245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743444,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1581056,"data_stored":1067675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906970,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":443481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":937984,"data_stored":443401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397540,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1531904,"data_stored":1035726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528361,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":925696,"data_stored":442870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1544192,"data_stored":1035017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953523,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":443700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":443181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":494518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":483728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":444141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:03:01.171 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:03:01.417 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:01.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:01 smithi152 ceph-mon[31188]: pgmap v287: 97 pgs: 97 active+clean; 621 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.2 KiB/s wr, 9 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-11T22:03:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:01 smithi179 ceph-mon[35603]: pgmap v287: 97 pgs: 97 active+clean; 621 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.2 KiB/s wr, 9 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-11T22:03:01.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:01 smithi193 ceph-mon[35545]: pgmap v287: 97 pgs: 97 active+clean; 621 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.2 KiB/s wr, 9 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-11T22:03:01.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.852+0000 7f487e10f640 1 -- 172.21.15.152:0/3585614520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4878106f10 msgr2=0x7f487810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:01.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.852+0000 7f487e10f640 1 --2- 172.21.15.152:0/3585614520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4878106f10 0x7f487810ea90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4870009ca0 tx=0x7f487002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:03:01.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.852+0000 7f487e10f640 1 -- 172.21.15.152:0/3585614520 shutdown_connections 2024-09-11T22:03:01.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.852+0000 7f487e10f640 1 --2- 172.21.15.152:0/3585614520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4878106f10 0x7f487810ea90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:01.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.852+0000 7f487e10f640 1 --2- 172.21.15.152:0/3585614520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4878102790 0x7f48781067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:01.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.852+0000 7f487e10f640 1 --2- 172.21.15.152:0/3585614520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4878101de0 0x7f48781021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:01.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.852+0000 7f487e10f640 1 -- 172.21.15.152:0/3585614520 >> 172.21.15.152:0/3585614520 conn(0x7f48780fd8c0 msgr2=0x7f48780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:01.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.852+0000 7f487e10f640 1 -- 172.21.15.152:0/3585614520 shutdown_connections 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f487e10f640 1 -- 172.21.15.152:0/3585614520 wait complete. 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f487e10f640 1 Processor -- start 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f487e10f640 1 -- start start 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f487e10f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4878101de0 0x7f48780744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f487e10f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4878102790 0x7f4878074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f487e10f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4878106f10 0x7f4878074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f487e10f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4878111fc0 con 0x7f4878102790 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f487e10f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4878111e40 con 0x7f4878101de0 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f487e10f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4878112140 con 0x7f4878106f10 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f486ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4878102790 0x7f4878074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f486ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4878102790 0x7f4878074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53140/0 (socket says 172.21.15.152:53140) 2024-09-11T22:03:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f486ffff640 1 -- 172.21.15.152:0/2974207830 learned_addr learned my addr 172.21.15.152:0/2974207830 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.853+0000 7f4877fff640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4878106f10 0x7f4878074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f48777fe640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4878101de0 0x7f48780744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f486ffff640 1 -- 172.21.15.152:0/2974207830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4878106f10 msgr2=0x7f4878074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f486ffff640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4878106f10 0x7f4878074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f486ffff640 1 -- 172.21.15.152:0/2974207830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4878101de0 msgr2=0x7f48780744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f486ffff640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4878101de0 0x7f48780744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f486ffff640 1 -- 172.21.15.152:0/2974207830 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48781a6830 con 0x7f4878102790 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f486ffff640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4878102790 0x7f4878074a30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f486000d770 tx=0x7f486000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f48757fa640 1 -- 172.21.15.152:0/2974207830 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860017070 con 0x7f4878102790 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f48757fa640 1 -- 172.21.15.152:0/2974207830 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4860005500 con 0x7f4878102790 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f48757fa640 1 -- 172.21.15.152:0/2974207830 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860004e00 con 0x7f4878102790 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f487e10f640 1 -- 172.21.15.152:0/2974207830 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48781a6b20 con 0x7f4878102790 2024-09-11T22:03:01.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.854+0000 7f487e10f640 1 -- 172.21.15.152:0/2974207830 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48781a7010 con 0x7f4878102790 2024-09-11T22:03:01.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.855+0000 7f487e10f640 1 -- 172.21.15.152:0/2974207830 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48781021c0 con 0x7f4878102790 2024-09-11T22:03:01.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.856+0000 7f48757fa640 1 -- 172.21.15.152:0/2974207830 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4860004fa0 con 0x7f4878102790 2024-09-11T22:03:01.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.857+0000 7f48757fa640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f48640a2c10 0x7f48640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:01.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.857+0000 7f48777fe640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f48640a2c10 0x7f48640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:01.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.857+0000 7f48757fa640 1 -- 172.21.15.152:0/2974207830 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f48600ceb10 con 0x7f4878102790 2024-09-11T22:03:01.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.857+0000 7f48777fe640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f48640a2c10 0x7f48640a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4868009bd0 tx=0x7f4868005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:01.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:01.861+0000 7f48757fa640 1 -- 172.21.15.152:0/2974207830 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f486009b2a0 con 0x7f4878102790 2024-09-11T22:03:02.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.026+0000 7f487e10f640 1 -- 172.21.15.152:0/2974207830 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f487810a1c0 con 0x7f48640a2c10 2024-09-11T22:03:02.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.032+0000 7f48757fa640 1 -- 172.21.15.152:0/2974207830 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258710 (secure 0 0 0) 0x7f486801b3f0 con 0x7f48640a2c10 2024-09-11T22:03:02.035 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:02.036 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-09-11T22:03:02.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 -- 172.21.15.152:0/2974207830 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f48640a2c10 msgr2=0x7f48640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:02.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f48640a2c10 0x7f48640a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4868009bd0 tx=0x7f4868005f90 comp rx=0 tx=0).stop 2024-09-11T22:03:02.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 -- 172.21.15.152:0/2974207830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4878102790 msgr2=0x7f4878074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4878102790 0x7f4878074a30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f486000d770 tx=0x7f486000dc30 comp rx=0 tx=0).stop 2024-09-11T22:03:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 -- 172.21.15.152:0/2974207830 shutdown_connections 2024-09-11T22:03:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f48640a2c10 0x7f48640a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4878106f10 0x7f4878074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4878102790 0x7f4878074a30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 --2- 172.21.15.152:0/2974207830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4878101de0 0x7f48780744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 -- 172.21.15.152:0/2974207830 >> 172.21.15.152:0/2974207830 conn(0x7f48780fd8c0 msgr2=0x7f48780febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 -- 172.21.15.152:0/2974207830 shutdown_connections 2024-09-11T22:03:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:02.036+0000 7f487e10f640 1 -- 172.21.15.152:0/2974207830 wait complete. 2024-09-11T22:03:02.573 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:02 smithi152 ceph-mon[31188]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:02.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:02 smithi179 ceph-mon[35603]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:02.812 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-11T22:03:00.279030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636063,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":232,"num_read_kb":214,"num_write":333,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":288,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366328,"kb_used_data":12860,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575496,"statfs":{"total":1151940427776,"available":1151565307904,"internally_reserved":0,"allocated":13168640,"data_stored":7220683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33871,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":55,"num_write":24,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001644"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344542+0000","last_change":"2024-09-11T22:02:36.105689+0000","last_active":"2024-09-11T22:02:55.344542+0000","last_peered":"2024-09-11T22:02:55.344542+0000","last_clean":"2024-09-11T22:02:55.344542+0000","last_became_active":"2024-09-11T22:02:36.105128+0000","last_became_peered":"2024-09-11T22:02:36.105128+0000","last_unstale":"2024-09-11T22:02:55.344542+0000","last_undegraded":"2024-09-11T22:02:55.344542+0000","last_fullsized":"2024-09-11T22:02:55.344542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:18.018731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344016+0000","last_change":"2024-09-11T22:02:36.096961+0000","last_active":"2024-09-11T22:02:55.344016+0000","last_peered":"2024-09-11T22:02:55.344016+0000","last_clean":"2024-09-11T22:02:55.344016+0000","last_became_active":"2024-09-11T22:02:36.096540+0000","last_became_peered":"2024-09-11T22:02:36.096540+0000","last_unstale":"2024-09-11T22:02:55.344016+0000","last_undegraded":"2024-09-11T22:02:55.344016+0000","last_fullsized":"2024-09-11T22:02:55.344016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:48.517125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343560+0000","last_change":"2024-09-11T22:02:36.108119+0000","last_active":"2024-09-11T22:02:55.343560+0000","last_peered":"2024-09-11T22:02:55.343560+0000","last_clean":"2024-09-11T22:02:55.343560+0000","last_became_active":"2024-09-11T22:02:36.107737+0000","last_became_peered":"2024-09-11T22:02:36.107737+0000","last_unstale":"2024-09-11T22:02:55.343560+0000","last_undegraded":"2024-09-11T22:02:55.343560+0000","last_fullsized":"2024-09-11T22:02:55.343560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:54.225935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543552+0000","last_change":"2024-09-11T22:02:36.107710+0000","last_active":"2024-09-11T22:02:55.543552+0000","last_peered":"2024-09-11T22:02:55.543552+0000","last_clean":"2024-09-11T22:02:55.543552+0000","last_became_active":"2024-09-11T22:02:36.107327+0000","last_became_peered":"2024-09-11T22:02:36.107327+0000","last_unstale":"2024-09-11T22:02:55.543552+0000","last_undegraded":"2024-09-11T22:02:55.543552+0000","last_fullsized":"2024-09-11T22:02:55.543552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.358535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347186+0000","last_change":"2024-09-11T22:02:36.100531+0000","last_active":"2024-09-11T22:02:55.347186+0000","last_peered":"2024-09-11T22:02:55.347186+0000","last_clean":"2024-09-11T22:02:55.347186+0000","last_became_active":"2024-09-11T22:02:36.100187+0000","last_became_peered":"2024-09-11T22:02:36.100187+0000","last_unstale":"2024-09-11T22:02:55.347186+0000","last_undegraded":"2024-09-11T22:02:55.347186+0000","last_fullsized":"2024-09-11T22:02:55.347186+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.156080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359096+0000","last_change":"2024-09-11T22:02:36.101316+0000","last_active":"2024-09-11T22:02:54.359096+0000","last_peered":"2024-09-11T22:02:54.359096+0000","last_clean":"2024-09-11T22:02:54.359096+0000","last_became_active":"2024-09-11T22:02:36.100985+0000","last_became_peered":"2024-09-11T22:02:36.100985+0000","last_unstale":"2024-09-11T22:02:54.359096+0000","last_undegraded":"2024-09-11T22:02:54.359096+0000","last_fullsized":"2024-09-11T22:02:54.359096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:55.972974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343776+0000","last_change":"2024-09-11T22:02:36.109146+0000","last_active":"2024-09-11T22:02:55.343776+0000","last_peered":"2024-09-11T22:02:55.343776+0000","last_clean":"2024-09-11T22:02:55.343776+0000","last_became_active":"2024-09-11T22:02:36.108817+0000","last_became_peered":"2024-09-11T22:02:36.108817+0000","last_unstale":"2024-09-11T22:02:55.343776+0000","last_undegraded":"2024-09-11T22:02:55.343776+0000","last_fullsized":"2024-09-11T22:02:55.343776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.222383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.345959+0000","last_change":"2024-09-11T22:02:36.100362+0000","last_active":"2024-09-11T22:02:55.345959+0000","last_peered":"2024-09-11T22:02:55.345959+0000","last_clean":"2024-09-11T22:02:55.345959+0000","last_became_active":"2024-09-11T22:02:36.100088+0000","last_became_peered":"2024-09-11T22:02:36.100088+0000","last_unstale":"2024-09-11T22:02:55.345959+0000","last_undegraded":"2024-09-11T22:02:55.345959+0000","last_fullsized":"2024-09-11T22:02:55.345959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.478879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342352+0000","last_change":"2024-09-11T22:02:36.106360+0000","last_active":"2024-09-11T22:02:55.342352+0000","last_peered":"2024-09-11T22:02:55.342352+0000","last_clean":"2024-09-11T22:02:55.342352+0000","last_became_active":"2024-09-11T22:02:36.105994+0000","last_became_peered":"2024-09-11T22:02:36.105994+0000","last_unstale":"2024-09-11T22:02:55.342352+0000","last_undegraded":"2024-09-11T22:02:55.342352+0000","last_fullsized":"2024-09-11T22:02:55.342352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:33.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359536+0000","last_change":"2024-09-11T22:02:36.109477+0000","last_active":"2024-09-11T22:02:54.359536+0000","last_peered":"2024-09-11T22:02:54.359536+0000","last_clean":"2024-09-11T22:02:54.359536+0000","last_became_active":"2024-09-11T22:02:36.109077+0000","last_became_peered":"2024-09-11T22:02:36.109077+0000","last_unstale":"2024-09-11T22:02:54.359536+0000","last_undegraded":"2024-09-11T22:02:54.359536+0000","last_fullsized":"2024-09-11T22:02:54.359536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.862359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343838+0000","last_change":"2024-09-11T22:02:36.112998+0000","last_active":"2024-09-11T22:02:55.343838+0000","last_peered":"2024-09-11T22:02:55.343838+0000","last_clean":"2024-09-11T22:02:55.343838+0000","last_became_active":"2024-09-11T22:02:36.112649+0000","last_became_peered":"2024-09-11T22:02:36.112649+0000","last_unstale":"2024-09-11T22:02:55.343838+0000","last_undegraded":"2024-09-11T22:02:55.343838+0000","last_fullsized":"2024-09-11T22:02:55.343838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:01.582572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543593+0000","last_change":"2024-09-11T22:02:36.099591+0000","last_active":"2024-09-11T22:02:55.543593+0000","last_peered":"2024-09-11T22:02:55.543593+0000","last_clean":"2024-09-11T22:02:55.543593+0000","last_became_active":"2024-09-11T22:02:36.099269+0000","last_became_peered":"2024-09-11T22:02:36.099269+0000","last_unstale":"2024-09-11T22:02:55.543593+0000","last_undegraded":"2024-09-11T22:02:55.543593+0000","last_fullsized":"2024-09-11T22:02:55.543593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:10.918188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340976+0000","last_change":"2024-09-11T22:02:36.100056+0000","last_active":"2024-09-11T22:02:55.340976+0000","last_peered":"2024-09-11T22:02:55.340976+0000","last_clean":"2024-09-11T22:02:55.340976+0000","last_became_active":"2024-09-11T22:02:36.099717+0000","last_became_peered":"2024-09-11T22:02:36.099717+0000","last_unstale":"2024-09-11T22:02:55.340976+0000","last_undegraded":"2024-09-11T22:02:55.340976+0000","last_fullsized":"2024-09-11T22:02:55.340976+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.486256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343551+0000","last_change":"2024-09-11T22:02:36.097281+0000","last_active":"2024-09-11T22:02:55.343551+0000","last_peered":"2024-09-11T22:02:55.343551+0000","last_clean":"2024-09-11T22:02:55.343551+0000","last_became_active":"2024-09-11T22:02:36.096768+0000","last_became_peered":"2024-09-11T22:02:36.096768+0000","last_unstale":"2024-09-11T22:02:55.343551+0000","last_undegraded":"2024-09-11T22:02:55.343551+0000","last_fullsized":"2024-09-11T22:02:55.343551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:31.232578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.351065+0000","last_change":"2024-09-11T22:02:55.351065+0000","last_active":"2024-09-11T22:02:55.351065+0000","last_peered":"2024-09-11T22:02:55.351065+0000","last_clean":"2024-09-11T22:02:55.351065+0000","last_became_active":"2024-09-11T22:02:55.350669+0000","last_became_peered":"2024-09-11T22:02:55.350669+0000","last_unstale":"2024-09-11T22:02:55.351065+0000","last_undegraded":"2024-09-11T22:02:55.351065+0000","last_fullsized":"2024-09-11T22:02:55.351065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:51.799060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341690+0000","last_change":"2024-09-11T22:02:36.109573+0000","last_active":"2024-09-11T22:02:55.341690+0000","last_peered":"2024-09-11T22:02:55.341690+0000","last_clean":"2024-09-11T22:02:55.341690+0000","last_became_active":"2024-09-11T22:02:36.109019+0000","last_became_peered":"2024-09-11T22:02:36.109019+0000","last_unstale":"2024-09-11T22:02:55.341690+0000","last_undegraded":"2024-09-11T22:02:55.341690+0000","last_fullsized":"2024-09-11T22:02:55.341690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:39.699762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344337+0000","last_change":"2024-09-11T22:02:36.105427+0000","last_active":"2024-09-11T22:02:55.344337+0000","last_peered":"2024-09-11T22:02:55.344337+0000","last_clean":"2024-09-11T22:02:55.344337+0000","last_became_active":"2024-09-11T22:02:36.104712+0000","last_became_peered":"2024-09-11T22:02:36.104712+0000","last_unstale":"2024-09-11T22:02:55.344337+0000","last_undegraded":"2024-09-11T22:02:55.344337+0000","last_fullsized":"2024-09-11T22:02:55.344337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:45.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344194+0000","last_change":"2024-09-11T22:02:36.097925+0000","last_active":"2024-09-11T22:02:55.344194+0000","last_peered":"2024-09-11T22:02:55.344194+0000","last_clean":"2024-09-11T22:02:55.344194+0000","last_became_active":"2024-09-11T22:02:36.097649+0000","last_became_peered":"2024-09-11T22:02:36.097649+0000","last_unstale":"2024-09-11T22:02:55.344194+0000","last_undegraded":"2024-09-11T22:02:55.344194+0000","last_fullsized":"2024-09-11T22:02:55.344194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.272197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347308+0000","last_change":"2024-09-11T22:02:36.107266+0000","last_active":"2024-09-11T22:02:55.347308+0000","last_peered":"2024-09-11T22:02:55.347308+0000","last_clean":"2024-09-11T22:02:55.347308+0000","last_became_active":"2024-09-11T22:02:36.106865+0000","last_became_peered":"2024-09-11T22:02:36.106865+0000","last_unstale":"2024-09-11T22:02:55.347308+0000","last_undegraded":"2024-09-11T22:02:55.347308+0000","last_fullsized":"2024-09-11T22:02:55.347308+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:53.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.349854+0000","last_change":"2024-09-11T22:02:55.349854+0000","last_active":"2024-09-11T22:02:55.349854+0000","last_peered":"2024-09-11T22:02:55.349854+0000","last_clean":"2024-09-11T22:02:55.349854+0000","last_became_active":"2024-09-11T22:02:55.349521+0000","last_became_peered":"2024-09-11T22:02:55.349521+0000","last_unstale":"2024-09-11T22:02:55.349854+0000","last_undegraded":"2024-09-11T22:02:55.349854+0000","last_fullsized":"2024-09-11T22:02:55.349854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341046+0000","last_change":"2024-09-11T22:02:36.110460+0000","last_active":"2024-09-11T22:02:55.341046+0000","last_peered":"2024-09-11T22:02:55.341046+0000","last_clean":"2024-09-11T22:02:55.341046+0000","last_became_active":"2024-09-11T22:02:36.110136+0000","last_became_peered":"2024-09-11T22:02:36.110136+0000","last_unstale":"2024-09-11T22:02:55.341046+0000","last_undegraded":"2024-09-11T22:02:55.341046+0000","last_fullsized":"2024-09-11T22:02:55.341046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:30.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341898+0000","last_change":"2024-09-11T22:02:36.111403+0000","last_active":"2024-09-11T22:02:55.341898+0000","last_peered":"2024-09-11T22:02:55.341898+0000","last_clean":"2024-09-11T22:02:55.341898+0000","last_became_active":"2024-09-11T22:02:36.110976+0000","last_became_peered":"2024-09-11T22:02:36.110976+0000","last_unstale":"2024-09-11T22:02:55.341898+0000","last_undegraded":"2024-09-11T22:02:55.341898+0000","last_fullsized":"2024-09-11T22:02:55.341898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:03.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346312+0000","last_change":"2024-09-11T22:02:36.110002+0000","last_active":"2024-09-11T22:02:55.346312+0000","last_peered":"2024-09-11T22:02:55.346312+0000","last_clean":"2024-09-11T22:02:55.346312+0000","last_became_active":"2024-09-11T22:02:36.109694+0000","last_became_peered":"2024-09-11T22:02:36.109694+0000","last_unstale":"2024-09-11T22:02:55.346312+0000","last_undegraded":"2024-09-11T22:02:55.346312+0000","last_fullsized":"2024-09-11T22:02:55.346312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:00.338509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341649+0000","last_change":"2024-09-11T22:02:36.101638+0000","last_active":"2024-09-11T22:02:55.341649+0000","last_peered":"2024-09-11T22:02:55.341649+0000","last_clean":"2024-09-11T22:02:55.341649+0000","last_became_active":"2024-09-11T22:02:36.101363+0000","last_became_peered":"2024-09-11T22:02:36.101363+0000","last_unstale":"2024-09-11T22:02:55.341649+0000","last_undegraded":"2024-09-11T22:02:55.341649+0000","last_fullsized":"2024-09-11T22:02:55.341649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:35.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346849+0000","last_change":"2024-09-11T22:02:36.109250+0000","last_active":"2024-09-11T22:02:55.346849+0000","last_peered":"2024-09-11T22:02:55.346849+0000","last_clean":"2024-09-11T22:02:55.346849+0000","last_became_active":"2024-09-11T22:02:36.108931+0000","last_became_peered":"2024-09-11T22:02:36.108931+0000","last_unstale":"2024-09-11T22:02:55.346849+0000","last_undegraded":"2024-09-11T22:02:55.346849+0000","last_fullsized":"2024-09-11T22:02:55.346849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:09.616621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347177+0000","last_change":"2024-09-11T22:02:36.113064+0000","last_active":"2024-09-11T22:02:55.347177+0000","last_peered":"2024-09-11T22:02:55.347177+0000","last_clean":"2024-09-11T22:02:55.347177+0000","last_became_active":"2024-09-11T22:02:36.112674+0000","last_became_peered":"2024-09-11T22:02:36.112674+0000","last_unstale":"2024-09-11T22:02:55.347177+0000","last_undegraded":"2024-09-11T22:02:55.347177+0000","last_fullsized":"2024-09-11T22:02:55.347177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:17.923053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344175+0000","last_change":"2024-09-11T22:02:36.101799+0000","last_active":"2024-09-11T22:02:55.344175+0000","last_peered":"2024-09-11T22:02:55.344175+0000","last_clean":"2024-09-11T22:02:55.344175+0000","last_became_active":"2024-09-11T22:02:36.101429+0000","last_became_peered":"2024-09-11T22:02:36.101429+0000","last_unstale":"2024-09-11T22:02:55.344175+0000","last_undegraded":"2024-09-11T22:02:55.344175+0000","last_fullsized":"2024-09-11T22:02:55.344175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.597619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340909+0000","last_change":"2024-09-11T22:02:36.100993+0000","last_active":"2024-09-11T22:02:55.340909+0000","last_peered":"2024-09-11T22:02:55.340909+0000","last_clean":"2024-09-11T22:02:55.340909+0000","last_became_active":"2024-09-11T22:02:36.100678+0000","last_became_peered":"2024-09-11T22:02:36.100678+0000","last_unstale":"2024-09-11T22:02:55.340909+0000","last_undegraded":"2024-09-11T22:02:55.340909+0000","last_fullsized":"2024-09-11T22:02:55.340909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:18.808422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344166+0000","last_change":"2024-09-11T22:02:36.103507+0000","last_active":"2024-09-11T22:02:55.344166+0000","last_peered":"2024-09-11T22:02:55.344166+0000","last_clean":"2024-09-11T22:02:55.344166+0000","last_became_active":"2024-09-11T22:02:36.103228+0000","last_became_peered":"2024-09-11T22:02:36.103228+0000","last_unstale":"2024-09-11T22:02:55.344166+0000","last_undegraded":"2024-09-11T22:02:55.344166+0000","last_fullsized":"2024-09-11T22:02:55.344166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.898635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347429+0000","last_change":"2024-09-11T22:02:36.104734+0000","last_active":"2024-09-11T22:02:55.347429+0000","last_peered":"2024-09-11T22:02:55.347429+0000","last_clean":"2024-09-11T22:02:55.347429+0000","last_became_active":"2024-09-11T22:02:36.103974+0000","last_became_peered":"2024-09-11T22:02:36.103974+0000","last_unstale":"2024-09-11T22:02:55.347429+0000","last_undegraded":"2024-09-11T22:02:55.347429+0000","last_fullsized":"2024-09-11T22:02:55.347429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:54.142031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347545+0000","last_change":"2024-09-11T22:02:36.106103+0000","last_active":"2024-09-11T22:02:55.347545+0000","last_peered":"2024-09-11T22:02:55.347545+0000","last_clean":"2024-09-11T22:02:55.347545+0000","last_became_active":"2024-09-11T22:02:36.105792+0000","last_became_peered":"2024-09-11T22:02:36.105792+0000","last_unstale":"2024-09-11T22:02:55.347545+0000","last_undegraded":"2024-09-11T22:02:55.347545+0000","last_fullsized":"2024-09-11T22:02:55.347545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:06.607094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343742+0000","last_change":"2024-09-11T22:02:36.104147+0000","last_active":"2024-09-11T22:02:55.343742+0000","last_peered":"2024-09-11T22:02:55.343742+0000","last_clean":"2024-09-11T22:02:55.343742+0000","last_became_active":"2024-09-11T22:02:36.103782+0000","last_became_peered":"2024-09-11T22:02:36.103782+0000","last_unstale":"2024-09-11T22:02:55.343742+0000","last_undegraded":"2024-09-11T22:02:55.343742+0000","last_fullsized":"2024-09-11T22:02:55.343742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.127609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348453+0000","last_change":"2024-09-11T22:02:36.101259+0000","last_active":"2024-09-11T22:02:55.348453+0000","last_peered":"2024-09-11T22:02:55.348453+0000","last_clean":"2024-09-11T22:02:55.348453+0000","last_became_active":"2024-09-11T22:02:36.100761+0000","last_became_peered":"2024-09-11T22:02:36.100761+0000","last_unstale":"2024-09-11T22:02:55.348453+0000","last_undegraded":"2024-09-11T22:02:55.348453+0000","last_fullsized":"2024-09-11T22:02:55.348453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:47.045252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:56.860569+0000","last_change":"2024-09-11T22:02:34.084522+0000","last_active":"2024-09-11T22:02:56.860569+0000","last_peered":"2024-09-11T22:02:56.860569+0000","last_clean":"2024-09-11T22:02:56.860569+0000","last_became_active":"2024-09-11T22:02:34.084211+0000","last_became_peered":"2024-09-11T22:02:34.084211+0000","last_unstale":"2024-09-11T22:02:56.860569+0000","last_undegraded":"2024-09-11T22:02:56.860569+0000","last_fullsized":"2024-09-11T22:02:56.860569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:18.963998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341673+0000","last_change":"2024-09-11T22:02:36.106890+0000","last_active":"2024-09-11T22:02:55.341673+0000","last_peered":"2024-09-11T22:02:55.341673+0000","last_clean":"2024-09-11T22:02:55.341673+0000","last_became_active":"2024-09-11T22:02:36.105255+0000","last_became_peered":"2024-09-11T22:02:36.105255+0000","last_unstale":"2024-09-11T22:02:55.341673+0000","last_undegraded":"2024-09-11T22:02:55.341673+0000","last_fullsized":"2024-09-11T22:02:55.341673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.995542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359141+0000","last_change":"2024-09-11T22:02:34.079967+0000","last_active":"2024-09-11T22:02:54.359141+0000","last_peered":"2024-09-11T22:02:54.359141+0000","last_clean":"2024-09-11T22:02:54.359141+0000","last_became_active":"2024-09-11T22:02:34.079649+0000","last_became_peered":"2024-09-11T22:02:34.079649+0000","last_unstale":"2024-09-11T22:02:54.359141+0000","last_undegraded":"2024-09-11T22:02:54.359141+0000","last_fullsized":"2024-09-11T22:02:54.359141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.661256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340684+0000","last_change":"2024-09-11T22:02:34.079850+0000","last_active":"2024-09-11T22:02:55.340684+0000","last_peered":"2024-09-11T22:02:55.340684+0000","last_clean":"2024-09-11T22:02:55.340684+0000","last_became_active":"2024-09-11T22:02:34.079514+0000","last_became_peered":"2024-09-11T22:02:34.079514+0000","last_unstale":"2024-09-11T22:02:55.340684+0000","last_undegraded":"2024-09-11T22:02:55.340684+0000","last_fullsized":"2024-09-11T22:02:55.340684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.359482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346279+0000","last_change":"2024-09-11T22:02:36.099310+0000","last_active":"2024-09-11T22:02:55.346279+0000","last_peered":"2024-09-11T22:02:55.346279+0000","last_clean":"2024-09-11T22:02:55.346279+0000","last_became_active":"2024-09-11T22:02:36.099026+0000","last_became_peered":"2024-09-11T22:02:36.099026+0000","last_unstale":"2024-09-11T22:02:55.346279+0000","last_undegraded":"2024-09-11T22:02:55.346279+0000","last_fullsized":"2024-09-11T22:02:55.346279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:57.570147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341975+0000","last_change":"2024-09-11T22:02:34.083757+0000","last_active":"2024-09-11T22:02:55.341975+0000","last_peered":"2024-09-11T22:02:55.341975+0000","last_clean":"2024-09-11T22:02:55.341975+0000","last_became_active":"2024-09-11T22:02:34.083467+0000","last_became_peered":"2024-09-11T22:02:34.083467+0000","last_unstale":"2024-09-11T22:02:55.341975+0000","last_undegraded":"2024-09-11T22:02:55.341975+0000","last_fullsized":"2024-09-11T22:02:55.341975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.546772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343509+0000","last_change":"2024-09-11T22:02:36.098939+0000","last_active":"2024-09-11T22:02:55.343509+0000","last_peered":"2024-09-11T22:02:55.343509+0000","last_clean":"2024-09-11T22:02:55.343509+0000","last_became_active":"2024-09-11T22:02:36.098631+0000","last_became_peered":"2024-09-11T22:02:36.098631+0000","last_unstale":"2024-09-11T22:02:55.343509+0000","last_undegraded":"2024-09-11T22:02:55.343509+0000","last_fullsized":"2024-09-11T22:02:55.343509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:07.663332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359557+0000","last_change":"2024-09-11T22:02:34.085325+0000","last_active":"2024-09-11T22:02:54.359557+0000","last_peered":"2024-09-11T22:02:54.359557+0000","last_clean":"2024-09-11T22:02:54.359557+0000","last_became_active":"2024-09-11T22:02:34.084967+0000","last_became_peered":"2024-09-11T22:02:34.084967+0000","last_unstale":"2024-09-11T22:02:54.359557+0000","last_undegraded":"2024-09-11T22:02:54.359557+0000","last_fullsized":"2024-09-11T22:02:54.359557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:35.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342150+0000","last_change":"2024-09-11T22:02:36.104454+0000","last_active":"2024-09-11T22:02:55.342150+0000","last_peered":"2024-09-11T22:02:55.342150+0000","last_clean":"2024-09-11T22:02:55.342150+0000","last_became_active":"2024-09-11T22:02:36.103988+0000","last_became_peered":"2024-09-11T22:02:36.103988+0000","last_unstale":"2024-09-11T22:02:55.342150+0000","last_undegraded":"2024-09-11T22:02:55.342150+0000","last_fullsized":"2024-09-11T22:02:55.342150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:32.748524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.548642+0000","last_change":"2024-09-11T22:02:55.548642+0000","last_active":"2024-09-11T22:02:55.548642+0000","last_peered":"2024-09-11T22:02:55.548642+0000","last_clean":"2024-09-11T22:02:55.548642+0000","last_became_active":"2024-09-11T22:02:55.545771+0000","last_became_peered":"2024-09-11T22:02:55.545771+0000","last_unstale":"2024-09-11T22:02:55.548642+0000","last_undegraded":"2024-09-11T22:02:55.548642+0000","last_fullsized":"2024-09-11T22:02:55.548642+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:03.431986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.349125+0000","last_change":"2024-09-11T22:02:55.349125+0000","last_active":"2024-09-11T22:02:55.349125+0000","last_peered":"2024-09-11T22:02:55.349125+0000","last_clean":"2024-09-11T22:02:55.349125+0000","last_became_active":"2024-09-11T22:02:55.348746+0000","last_became_peered":"2024-09-11T22:02:55.348746+0000","last_unstale":"2024-09-11T22:02:55.349125+0000","last_undegraded":"2024-09-11T22:02:55.349125+0000","last_fullsized":"2024-09-11T22:02:55.349125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342094+0000","last_change":"2024-09-11T22:02:34.089793+0000","last_active":"2024-09-11T22:02:55.342094+0000","last_peered":"2024-09-11T22:02:55.342094+0000","last_clean":"2024-09-11T22:02:55.342094+0000","last_became_active":"2024-09-11T22:02:34.089468+0000","last_became_peered":"2024-09-11T22:02:34.089468+0000","last_unstale":"2024-09-11T22:02:55.342094+0000","last_undegraded":"2024-09-11T22:02:55.342094+0000","last_fullsized":"2024-09-11T22:02:55.342094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:10:21.034822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341941+0000","last_change":"2024-09-11T22:02:36.106224+0000","last_active":"2024-09-11T22:02:55.341941+0000","last_peered":"2024-09-11T22:02:55.341941+0000","last_clean":"2024-09-11T22:02:55.341941+0000","last_became_active":"2024-09-11T22:02:36.105903+0000","last_became_peered":"2024-09-11T22:02:36.105903+0000","last_unstale":"2024-09-11T22:02:55.341941+0000","last_undegraded":"2024-09-11T22:02:55.341941+0000","last_fullsized":"2024-09-11T22:02:55.341941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.354653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'21","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.860216+0000","last_change":"2024-09-11T22:02:34.082150+0000","last_active":"2024-09-11T22:02:54.860216+0000","last_peered":"2024-09-11T22:02:54.860216+0000","last_clean":"2024-09-11T22:02:54.860216+0000","last_became_active":"2024-09-11T22:02:34.081822+0000","last_became_peered":"2024-09-11T22:02:34.081822+0000","last_unstale":"2024-09-11T22:02:54.860216+0000","last_undegraded":"2024-09-11T22:02:54.860216+0000","last_fullsized":"2024-09-11T22:02:54.860216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:39.320410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41065,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":52,"num_write":22,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348665+0000","last_change":"2024-09-11T22:02:36.112124+0000","last_active":"2024-09-11T22:02:55.348665+0000","last_peered":"2024-09-11T22:02:55.348665+0000","last_clean":"2024-09-11T22:02:55.348665+0000","last_became_active":"2024-09-11T22:02:36.111739+0000","last_became_peered":"2024-09-11T22:02:36.111739+0000","last_unstale":"2024-09-11T22:02:55.348665+0000","last_undegraded":"2024-09-11T22:02:55.348665+0000","last_fullsized":"2024-09-11T22:02:55.348665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:52.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346805+0000","last_change":"2024-09-11T22:02:34.083047+0000","last_active":"2024-09-11T22:02:55.346805+0000","last_peered":"2024-09-11T22:02:55.346805+0000","last_clean":"2024-09-11T22:02:55.346805+0000","last_became_active":"2024-09-11T22:02:34.082406+0000","last_became_peered":"2024-09-11T22:02:34.082406+0000","last_unstale":"2024-09-11T22:02:55.346805+0000","last_undegraded":"2024-09-11T22:02:55.346805+0000","last_fullsized":"2024-09-11T22:02:55.346805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:33.249337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340763+0000","last_change":"2024-09-11T22:02:36.108859+0000","last_active":"2024-09-11T22:02:55.340763+0000","last_peered":"2024-09-11T22:02:55.340763+0000","last_clean":"2024-09-11T22:02:55.340763+0000","last_became_active":"2024-09-11T22:02:36.108558+0000","last_became_peered":"2024-09-11T22:02:36.108558+0000","last_unstale":"2024-09-11T22:02:55.340763+0000","last_undegraded":"2024-09-11T22:02:55.340763+0000","last_fullsized":"2024-09-11T22:02:55.340763+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.430672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341741+0000","last_change":"2024-09-11T22:02:34.080560+0000","last_active":"2024-09-11T22:02:55.341741+0000","last_peered":"2024-09-11T22:02:55.341741+0000","last_clean":"2024-09-11T22:02:55.341741+0000","last_became_active":"2024-09-11T22:02:34.080262+0000","last_became_peered":"2024-09-11T22:02:34.080262+0000","last_unstale":"2024-09-11T22:02:55.341741+0000","last_undegraded":"2024-09-11T22:02:55.341741+0000","last_fullsized":"2024-09-11T22:02:55.341741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:44.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343837+0000","last_change":"2024-09-11T22:02:36.107722+0000","last_active":"2024-09-11T22:02:55.343837+0000","last_peered":"2024-09-11T22:02:55.343837+0000","last_clean":"2024-09-11T22:02:55.343837+0000","last_became_active":"2024-09-11T22:02:36.107219+0000","last_became_peered":"2024-09-11T22:02:36.107219+0000","last_unstale":"2024-09-11T22:02:55.343837+0000","last_undegraded":"2024-09-11T22:02:55.343837+0000","last_fullsized":"2024-09-11T22:02:55.343837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.576045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:57.861563+0000","last_change":"2024-09-11T22:02:34.083573+0000","last_active":"2024-09-11T22:02:57.861563+0000","last_peered":"2024-09-11T22:02:57.861563+0000","last_clean":"2024-09-11T22:02:57.861563+0000","last_became_active":"2024-09-11T22:02:34.083277+0000","last_became_peered":"2024-09-11T22:02:34.083277+0000","last_unstale":"2024-09-11T22:02:57.861563+0000","last_undegraded":"2024-09-11T22:02:57.861563+0000","last_fullsized":"2024-09-11T22:02:57.861563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:31.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343635+0000","last_change":"2024-09-11T22:02:36.105075+0000","last_active":"2024-09-11T22:02:55.343635+0000","last_peered":"2024-09-11T22:02:55.343635+0000","last_clean":"2024-09-11T22:02:55.343635+0000","last_became_active":"2024-09-11T22:02:36.104022+0000","last_became_peered":"2024-09-11T22:02:36.104022+0000","last_unstale":"2024-09-11T22:02:55.343635+0000","last_undegraded":"2024-09-11T22:02:55.343635+0000","last_fullsized":"2024-09-11T22:02:55.343635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.693146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347063+0000","last_change":"2024-09-11T22:02:34.088727+0000","last_active":"2024-09-11T22:02:55.347063+0000","last_peered":"2024-09-11T22:02:55.347063+0000","last_clean":"2024-09-11T22:02:55.347063+0000","last_became_active":"2024-09-11T22:02:34.088394+0000","last_became_peered":"2024-09-11T22:02:34.088394+0000","last_unstale":"2024-09-11T22:02:55.347063+0000","last_undegraded":"2024-09-11T22:02:55.347063+0000","last_fullsized":"2024-09-11T22:02:55.347063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:11.809765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341774+0000","last_change":"2024-09-11T22:02:36.104522+0000","last_active":"2024-09-11T22:02:55.341774+0000","last_peered":"2024-09-11T22:02:55.341774+0000","last_clean":"2024-09-11T22:02:55.341774+0000","last_became_active":"2024-09-11T22:02:36.104181+0000","last_became_peered":"2024-09-11T22:02:36.104181+0000","last_unstale":"2024-09-11T22:02:55.341774+0000","last_undegraded":"2024-09-11T22:02:55.341774+0000","last_fullsized":"2024-09-11T22:02:55.341774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:08.139180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347551+0000","last_change":"2024-09-11T22:02:34.080341+0000","last_active":"2024-09-11T22:02:55.347551+0000","last_peered":"2024-09-11T22:02:55.347551+0000","last_clean":"2024-09-11T22:02:55.347551+0000","last_became_active":"2024-09-11T22:02:34.078761+0000","last_became_peered":"2024-09-11T22:02:34.078761+0000","last_unstale":"2024-09-11T22:02:55.347551+0000","last_undegraded":"2024-09-11T22:02:55.347551+0000","last_fullsized":"2024-09-11T22:02:55.347551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.545135+0000","last_change":"2024-09-11T22:02:55.545135+0000","last_active":"2024-09-11T22:02:55.545135+0000","last_peered":"2024-09-11T22:02:55.545135+0000","last_clean":"2024-09-11T22:02:55.545135+0000","last_became_active":"2024-09-11T22:02:55.544785+0000","last_became_peered":"2024-09-11T22:02:55.544785+0000","last_unstale":"2024-09-11T22:02:55.545135+0000","last_undegraded":"2024-09-11T22:02:55.545135+0000","last_fullsized":"2024-09-11T22:02:55.545135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:05.815828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341028+0000","last_change":"2024-09-11T22:02:34.082364+0000","last_active":"2024-09-11T22:02:55.341028+0000","last_peered":"2024-09-11T22:02:55.341028+0000","last_clean":"2024-09-11T22:02:55.341028+0000","last_became_active":"2024-09-11T22:02:34.081906+0000","last_became_peered":"2024-09-11T22:02:34.081906+0000","last_unstale":"2024-09-11T22:02:55.341028+0000","last_undegraded":"2024-09-11T22:02:55.341028+0000","last_fullsized":"2024-09-11T22:02:55.341028+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:58.603942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344193+0000","last_change":"2024-09-11T22:02:36.110725+0000","last_active":"2024-09-11T22:02:55.344193+0000","last_peered":"2024-09-11T22:02:55.344193+0000","last_clean":"2024-09-11T22:02:55.344193+0000","last_became_active":"2024-09-11T22:02:36.110401+0000","last_became_peered":"2024-09-11T22:02:36.110401+0000","last_unstale":"2024-09-11T22:02:55.344193+0000","last_undegraded":"2024-09-11T22:02:55.344193+0000","last_fullsized":"2024-09-11T22:02:55.344193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:41.789134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342240+0000","last_change":"2024-09-11T22:02:34.082983+0000","last_active":"2024-09-11T22:02:55.342240+0000","last_peered":"2024-09-11T22:02:55.342240+0000","last_clean":"2024-09-11T22:02:55.342240+0000","last_became_active":"2024-09-11T22:02:34.082618+0000","last_became_peered":"2024-09-11T22:02:34.082618+0000","last_unstale":"2024-09-11T22:02:55.342240+0000","last_undegraded":"2024-09-11T22:02:55.342240+0000","last_fullsized":"2024-09-11T22:02:55.342240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.481228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343871+0000","last_change":"2024-09-11T22:02:36.108222+0000","last_active":"2024-09-11T22:02:55.343871+0000","last_peered":"2024-09-11T22:02:55.343871+0000","last_clean":"2024-09-11T22:02:55.343871+0000","last_became_active":"2024-09-11T22:02:36.107739+0000","last_became_peered":"2024-09-11T22:02:36.107739+0000","last_unstale":"2024-09-11T22:02:55.343871+0000","last_undegraded":"2024-09-11T22:02:55.343871+0000","last_fullsized":"2024-09-11T22:02:55.343871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:11.353217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347043+0000","last_change":"2024-09-11T22:02:34.090068+0000","last_active":"2024-09-11T22:02:55.347043+0000","last_peered":"2024-09-11T22:02:55.347043+0000","last_clean":"2024-09-11T22:02:55.347043+0000","last_became_active":"2024-09-11T22:02:34.089735+0000","last_became_peered":"2024-09-11T22:02:34.089735+0000","last_unstale":"2024-09-11T22:02:55.347043+0000","last_undegraded":"2024-09-11T22:02:55.347043+0000","last_fullsized":"2024-09-11T22:02:55.347043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:32.917459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343993+0000","last_change":"2024-09-11T22:02:36.108017+0000","last_active":"2024-09-11T22:02:55.343993+0000","last_peered":"2024-09-11T22:02:55.343993+0000","last_clean":"2024-09-11T22:02:55.343993+0000","last_became_active":"2024-09-11T22:02:36.107339+0000","last_became_peered":"2024-09-11T22:02:36.107339+0000","last_unstale":"2024-09-11T22:02:55.343993+0000","last_undegraded":"2024-09-11T22:02:55.343993+0000","last_fullsized":"2024-09-11T22:02:55.343993+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:19.240354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343956+0000","last_change":"2024-09-11T22:01:28.522567+0000","last_active":"2024-09-11T22:02:55.343956+0000","last_peered":"2024-09-11T22:02:55.343956+0000","last_clean":"2024-09-11T22:02:55.343956+0000","last_became_active":"2024-09-11T22:01:28.522079+0000","last_became_peered":"2024-09-11T22:01:28.522079+0000","last_unstale":"2024-09-11T22:02:55.343956+0000","last_undegraded":"2024-09-11T22:02:55.343956+0000","last_fullsized":"2024-09-11T22:02:55.343956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_clean_scrub_stamp":"2024-09-11T21:58:11.245706+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:48.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543596+0000","last_change":"2024-09-11T22:02:34.080535+0000","last_active":"2024-09-11T22:02:55.543596+0000","last_peered":"2024-09-11T22:02:55.543596+0000","last_clean":"2024-09-11T22:02:55.543596+0000","last_became_active":"2024-09-11T22:02:34.079351+0000","last_became_peered":"2024-09-11T22:02:34.079351+0000","last_unstale":"2024-09-11T22:02:55.543596+0000","last_undegraded":"2024-09-11T22:02:55.543596+0000","last_fullsized":"2024-09-11T22:02:55.543596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:29.737198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346582+0000","last_change":"2024-09-11T22:02:36.104476+0000","last_active":"2024-09-11T22:02:55.346582+0000","last_peered":"2024-09-11T22:02:55.346582+0000","last_clean":"2024-09-11T22:02:55.346582+0000","last_became_active":"2024-09-11T22:02:36.104163+0000","last_became_peered":"2024-09-11T22:02:36.104163+0000","last_unstale":"2024-09-11T22:02:55.346582+0000","last_undegraded":"2024-09-11T22:02:55.346582+0000","last_fullsized":"2024-09-11T22:02:55.346582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.570125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343951+0000","last_change":"2024-09-11T22:02:34.079652+0000","last_active":"2024-09-11T22:02:55.343951+0000","last_peered":"2024-09-11T22:02:55.343951+0000","last_clean":"2024-09-11T22:02:55.343951+0000","last_became_active":"2024-09-11T22:02:34.079365+0000","last_became_peered":"2024-09-11T22:02:34.079365+0000","last_unstale":"2024-09-11T22:02:55.343951+0000","last_undegraded":"2024-09-11T22:02:55.343951+0000","last_fullsized":"2024-09-11T22:02:55.343951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:15.371852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340660+0000","last_change":"2024-09-11T22:02:36.107209+0000","last_active":"2024-09-11T22:02:55.340660+0000","last_peered":"2024-09-11T22:02:55.340660+0000","last_clean":"2024-09-11T22:02:55.340660+0000","last_became_active":"2024-09-11T22:02:36.106896+0000","last_became_peered":"2024-09-11T22:02:36.106896+0000","last_unstale":"2024-09-11T22:02:55.340660+0000","last_undegraded":"2024-09-11T22:02:55.340660+0000","last_fullsized":"2024-09-11T22:02:55.340660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:04.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:56.859783+0000","last_change":"2024-09-11T22:02:34.088531+0000","last_active":"2024-09-11T22:02:56.859783+0000","last_peered":"2024-09-11T22:02:56.859783+0000","last_clean":"2024-09-11T22:02:56.859783+0000","last_became_active":"2024-09-11T22:02:34.088252+0000","last_became_peered":"2024-09-11T22:02:34.088252+0000","last_unstale":"2024-09-11T22:02:56.859783+0000","last_undegraded":"2024-09-11T22:02:56.859783+0000","last_fullsized":"2024-09-11T22:02:56.859783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:43.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341771+0000","last_change":"2024-09-11T22:02:36.108963+0000","last_active":"2024-09-11T22:02:55.341771+0000","last_peered":"2024-09-11T22:02:55.341771+0000","last_clean":"2024-09-11T22:02:55.341771+0000","last_became_active":"2024-09-11T22:02:36.108435+0000","last_became_peered":"2024-09-11T22:02:36.108435+0000","last_unstale":"2024-09-11T22:02:55.341771+0000","last_undegraded":"2024-09-11T22:02:55.341771+0000","last_fullsized":"2024-09-11T22:02:55.341771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:11.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344233+0000","last_change":"2024-09-11T22:02:34.084283+0000","last_active":"2024-09-11T22:02:55.344233+0000","last_peered":"2024-09-11T22:02:55.344233+0000","last_clean":"2024-09-11T22:02:55.344233+0000","last_became_active":"2024-09-11T22:02:34.083948+0000","last_became_peered":"2024-09-11T22:02:34.083948+0000","last_unstale":"2024-09-11T22:02:55.344233+0000","last_undegraded":"2024-09-11T22:02:55.344233+0000","last_fullsized":"2024-09-11T22:02:55.344233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:48.763643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359256+0000","last_change":"2024-09-11T22:02:36.102147+0000","last_active":"2024-09-11T22:02:54.359256+0000","last_peered":"2024-09-11T22:02:54.359256+0000","last_clean":"2024-09-11T22:02:54.359256+0000","last_became_active":"2024-09-11T22:02:36.101641+0000","last_became_peered":"2024-09-11T22:02:36.101641+0000","last_unstale":"2024-09-11T22:02:54.359256+0000","last_undegraded":"2024-09-11T22:02:54.359256+0000","last_fullsized":"2024-09-11T22:02:54.359256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:58.145304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343756+0000","last_change":"2024-09-11T22:02:34.090538+0000","last_active":"2024-09-11T22:02:55.343756+0000","last_peered":"2024-09-11T22:02:55.343756+0000","last_clean":"2024-09-11T22:02:55.343756+0000","last_became_active":"2024-09-11T22:02:34.090238+0000","last_became_peered":"2024-09-11T22:02:34.090238+0000","last_unstale":"2024-09-11T22:02:55.343756+0000","last_undegraded":"2024-09-11T22:02:55.343756+0000","last_fullsized":"2024-09-11T22:02:55.343756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:47.037999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:02:54.359323+0000","last_change":"2024-09-11T22:02:36.095664+0000","last_active":"2024-09-11T22:02:54.359323+0000","last_peered":"2024-09-11T22:02:54.359323+0000","last_clean":"2024-09-11T22:02:54.359323+0000","last_became_active":"2024-09-11T22:02:36.095304+0000","last_became_peered":"2024-09-11T22:02:36.095304+0000","last_unstale":"2024-09-11T22:02:54.359323+0000","last_undegraded":"2024-09-11T22:02:54.359323+0000","last_fullsized":"2024-09-11T22:02:54.359323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.484809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348688+0000","last_change":"2024-09-11T22:02:34.089781+0000","last_active":"2024-09-11T22:02:55.348688+0000","last_peered":"2024-09-11T22:02:55.348688+0000","last_clean":"2024-09-11T22:02:55.348688+0000","last_became_active":"2024-09-11T22:02:34.089439+0000","last_became_peered":"2024-09-11T22:02:34.089439+0000","last_unstale":"2024-09-11T22:02:55.348688+0000","last_undegraded":"2024-09-11T22:02:55.348688+0000","last_fullsized":"2024-09-11T22:02:55.348688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:38.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340944+0000","last_change":"2024-09-11T22:02:36.107159+0000","last_active":"2024-09-11T22:02:55.340944+0000","last_peered":"2024-09-11T22:02:55.340944+0000","last_clean":"2024-09-11T22:02:55.340944+0000","last_became_active":"2024-09-11T22:02:36.106846+0000","last_became_peered":"2024-09-11T22:02:36.106846+0000","last_unstale":"2024-09-11T22:02:55.340944+0000","last_undegraded":"2024-09-11T22:02:55.340944+0000","last_fullsized":"2024-09-11T22:02:55.340944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.972944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.353307+0000","last_change":"2024-09-11T22:02:55.352887+0000","last_active":"2024-09-11T22:02:55.353307+0000","last_peered":"2024-09-11T22:02:55.353307+0000","last_clean":"2024-09-11T22:02:55.353307+0000","last_became_active":"2024-09-11T22:02:55.348619+0000","last_became_peered":"2024-09-11T22:02:55.348619+0000","last_unstale":"2024-09-11T22:02:55.353307+0000","last_undegraded":"2024-09-11T22:02:55.353307+0000","last_fullsized":"2024-09-11T22:02:55.353307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:51.259114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346932+0000","last_change":"2024-09-11T22:02:36.108560+0000","last_active":"2024-09-11T22:02:55.346932+0000","last_peered":"2024-09-11T22:02:55.346932+0000","last_clean":"2024-09-11T22:02:55.346932+0000","last_became_active":"2024-09-11T22:02:36.107593+0000","last_became_peered":"2024-09-11T22:02:36.107593+0000","last_unstale":"2024-09-11T22:02:55.346932+0000","last_undegraded":"2024-09-11T22:02:55.346932+0000","last_fullsized":"2024-09-11T22:02:55.346932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.479991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.544133+0000","last_change":"2024-09-11T22:02:34.087394+0000","last_active":"2024-09-11T22:02:55.544133+0000","last_peered":"2024-09-11T22:02:55.544133+0000","last_clean":"2024-09-11T22:02:55.544133+0000","last_became_active":"2024-09-11T22:02:34.087146+0000","last_became_peered":"2024-09-11T22:02:34.087146+0000","last_unstale":"2024-09-11T22:02:55.544133+0000","last_undegraded":"2024-09-11T22:02:55.544133+0000","last_fullsized":"2024-09-11T22:02:55.544133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:30.772437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.545065+0000","last_change":"2024-09-11T22:02:55.545065+0000","last_active":"2024-09-11T22:02:55.545065+0000","last_peered":"2024-09-11T22:02:55.545065+0000","last_clean":"2024-09-11T22:02:55.545065+0000","last_became_active":"2024-09-11T22:02:55.544736+0000","last_became_peered":"2024-09-11T22:02:55.544736+0000","last_unstale":"2024-09-11T22:02:55.545065+0000","last_undegraded":"2024-09-11T22:02:55.545065+0000","last_fullsized":"2024-09-11T22:02:55.545065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:23.706253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341812+0000","last_change":"2024-09-11T22:02:34.088717+0000","last_active":"2024-09-11T22:02:55.341812+0000","last_peered":"2024-09-11T22:02:55.341812+0000","last_clean":"2024-09-11T22:02:55.341812+0000","last_became_active":"2024-09-11T22:02:34.088412+0000","last_became_peered":"2024-09-11T22:02:34.088412+0000","last_unstale":"2024-09-11T22:02:55.341812+0000","last_undegraded":"2024-09-11T22:02:55.341812+0000","last_fullsized":"2024-09-11T22:02:55.341812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348372+0000","last_change":"2024-09-11T22:02:36.103781+0000","last_active":"2024-09-11T22:02:55.348372+0000","last_peered":"2024-09-11T22:02:55.348372+0000","last_clean":"2024-09-11T22:02:55.348372+0000","last_became_active":"2024-09-11T22:02:36.103426+0000","last_became_peered":"2024-09-11T22:02:36.103426+0000","last_unstale":"2024-09-11T22:02:55.348372+0000","last_undegraded":"2024-09-11T22:02:55.348372+0000","last_fullsized":"2024-09-11T22:02:55.348372+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:34.962793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346446+0000","last_change":"2024-09-11T22:02:34.080333+0000","last_active":"2024-09-11T22:02:55.346446+0000","last_peered":"2024-09-11T22:02:55.346446+0000","last_clean":"2024-09-11T22:02:55.346446+0000","last_became_active":"2024-09-11T22:02:34.079384+0000","last_became_peered":"2024-09-11T22:02:34.079384+0000","last_unstale":"2024-09-11T22:02:55.346446+0000","last_undegraded":"2024-09-11T22:02:55.346446+0000","last_fullsized":"2024-09-11T22:02:55.346446+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:38.313516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343953+0000","last_change":"2024-09-11T22:02:36.103306+0000","last_active":"2024-09-11T22:02:55.343953+0000","last_peered":"2024-09-11T22:02:55.343953+0000","last_clean":"2024-09-11T22:02:55.343953+0000","last_became_active":"2024-09-11T22:02:36.102967+0000","last_became_peered":"2024-09-11T22:02:36.102967+0000","last_unstale":"2024-09-11T22:02:55.343953+0000","last_undegraded":"2024-09-11T22:02:55.343953+0000","last_fullsized":"2024-09-11T22:02:55.343953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:34.138931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.355119+0000","last_change":"2024-09-11T22:02:55.355119+0000","last_active":"2024-09-11T22:02:55.355119+0000","last_peered":"2024-09-11T22:02:55.355119+0000","last_clean":"2024-09-11T22:02:55.355119+0000","last_became_active":"2024-09-11T22:02:55.350440+0000","last_became_peered":"2024-09-11T22:02:55.350440+0000","last_unstale":"2024-09-11T22:02:55.355119+0000","last_undegraded":"2024-09-11T22:02:55.355119+0000","last_fullsized":"2024-09-11T22:02:55.355119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:47.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346553+0000","last_change":"2024-09-11T22:02:36.102491+0000","last_active":"2024-09-11T22:02:55.346553+0000","last_peered":"2024-09-11T22:02:55.346553+0000","last_clean":"2024-09-11T22:02:55.346553+0000","last_became_active":"2024-09-11T22:02:36.102112+0000","last_became_peered":"2024-09-11T22:02:36.102112+0000","last_unstale":"2024-09-11T22:02:55.346553+0000","last_undegraded":"2024-09-11T22:02:55.346553+0000","last_fullsized":"2024-09-11T22:02:55.346553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:47.588539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347284+0000","last_change":"2024-09-11T22:02:34.082590+0000","last_active":"2024-09-11T22:02:55.347284+0000","last_peered":"2024-09-11T22:02:55.347284+0000","last_clean":"2024-09-11T22:02:55.347284+0000","last_became_active":"2024-09-11T22:02:34.082288+0000","last_became_peered":"2024-09-11T22:02:34.082288+0000","last_unstale":"2024-09-11T22:02:55.347284+0000","last_undegraded":"2024-09-11T22:02:55.347284+0000","last_fullsized":"2024-09-11T22:02:55.347284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:57.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344015+0000","last_change":"2024-09-11T22:02:36.105247+0000","last_active":"2024-09-11T22:02:55.344015+0000","last_peered":"2024-09-11T22:02:55.344015+0000","last_clean":"2024-09-11T22:02:55.344015+0000","last_became_active":"2024-09-11T22:02:36.104912+0000","last_became_peered":"2024-09-11T22:02:36.104912+0000","last_unstale":"2024-09-11T22:02:55.344015+0000","last_undegraded":"2024-09-11T22:02:55.344015+0000","last_fullsized":"2024-09-11T22:02:55.344015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:05.396671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.544869+0000","last_change":"2024-09-11T22:02:55.544428+0000","last_active":"2024-09-11T22:02:55.544869+0000","last_peered":"2024-09-11T22:02:55.544869+0000","last_clean":"2024-09-11T22:02:55.544869+0000","last_became_active":"2024-09-11T22:02:55.544151+0000","last_became_peered":"2024-09-11T22:02:55.544151+0000","last_unstale":"2024-09-11T22:02:55.544869+0000","last_undegraded":"2024-09-11T22:02:55.544869+0000","last_fullsized":"2024-09-11T22:02:55.544869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.100131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348353+0000","last_change":"2024-09-11T22:02:34.079017+0000","last_active":"2024-09-11T22:02:55.348353+0000","last_peered":"2024-09-11T22:02:55.348353+0000","last_clean":"2024-09-11T22:02:55.348353+0000","last_became_active":"2024-09-11T22:02:34.078663+0000","last_became_peered":"2024-09-11T22:02:34.078663+0000","last_unstale":"2024-09-11T22:02:55.348353+0000","last_undegraded":"2024-09-11T22:02:55.348353+0000","last_fullsized":"2024-09-11T22:02:55.348353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:05.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341769+0000","last_change":"2024-09-11T22:02:36.097768+0000","last_active":"2024-09-11T22:02:55.341769+0000","last_peered":"2024-09-11T22:02:55.341769+0000","last_clean":"2024-09-11T22:02:55.341769+0000","last_became_active":"2024-09-11T22:02:36.097396+0000","last_became_peered":"2024-09-11T22:02:36.097396+0000","last_unstale":"2024-09-11T22:02:55.341769+0000","last_undegraded":"2024-09-11T22:02:55.341769+0000","last_fullsized":"2024-09-11T22:02:55.341769+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:35.673268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.355229+0000","last_change":"2024-09-11T22:02:55.355229+0000","last_active":"2024-09-11T22:02:55.355229+0000","last_peered":"2024-09-11T22:02:55.355229+0000","last_clean":"2024-09-11T22:02:55.355229+0000","last_became_active":"2024-09-11T22:02:55.350492+0000","last_became_peered":"2024-09-11T22:02:55.350492+0000","last_unstale":"2024-09-11T22:02:55.355229+0000","last_undegraded":"2024-09-11T22:02:55.355229+0000","last_fullsized":"2024-09-11T22:02:55.355229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:03:31.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343902+0000","last_change":"2024-09-11T22:02:36.108992+0000","last_active":"2024-09-11T22:02:55.343902+0000","last_peered":"2024-09-11T22:02:55.343902+0000","last_clean":"2024-09-11T22:02:55.343902+0000","last_became_active":"2024-09-11T22:02:36.108674+0000","last_became_peered":"2024-09-11T22:02:36.108674+0000","last_unstale":"2024-09-11T22:02:55.343902+0000","last_undegraded":"2024-09-11T22:02:55.343902+0000","last_fullsized":"2024-09-11T22:02:55.343902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:57.083127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347109+0000","last_change":"2024-09-11T22:02:34.088833+0000","last_active":"2024-09-11T22:02:55.347109+0000","last_peered":"2024-09-11T22:02:55.347109+0000","last_clean":"2024-09-11T22:02:55.347109+0000","last_became_active":"2024-09-11T22:02:34.088275+0000","last_became_peered":"2024-09-11T22:02:34.088275+0000","last_unstale":"2024-09-11T22:02:55.347109+0000","last_undegraded":"2024-09-11T22:02:55.347109+0000","last_fullsized":"2024-09-11T22:02:55.347109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:31.167486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347003+0000","last_change":"2024-09-11T22:02:36.108154+0000","last_active":"2024-09-11T22:02:55.347003+0000","last_peered":"2024-09-11T22:02:55.347003+0000","last_clean":"2024-09-11T22:02:55.347003+0000","last_became_active":"2024-09-11T22:02:36.107817+0000","last_became_peered":"2024-09-11T22:02:36.107817+0000","last_unstale":"2024-09-11T22:02:55.347003+0000","last_undegraded":"2024-09-11T22:02:55.347003+0000","last_fullsized":"2024-09-11T22:02:55.347003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.168339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344005+0000","last_change":"2024-09-11T22:02:34.082193+0000","last_active":"2024-09-11T22:02:55.344005+0000","last_peered":"2024-09-11T22:02:55.344005+0000","last_clean":"2024-09-11T22:02:55.344005+0000","last_became_active":"2024-09-11T22:02:34.081852+0000","last_became_peered":"2024-09-11T22:02:34.081852+0000","last_unstale":"2024-09-11T22:02:55.344005+0000","last_undegraded":"2024-09-11T22:02:55.344005+0000","last_fullsized":"2024-09-11T22:02:55.344005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:08.319444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45461,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":96,"num_read_kb":95,"num_write":150,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":154477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514513,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":443245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743444,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1581056,"data_stored":1067675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906970,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":443481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":937984,"data_stored":443401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397540,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1531904,"data_stored":1035726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528361,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":925696,"data_stored":442870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1544192,"data_stored":1035017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953523,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":443700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":443181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":494518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":483728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":444141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:03:02.817 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T22:03:02.817 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T22:03:02.818 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T22:03:02.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:02 smithi193 ceph-mon[35545]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:03.064 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:03.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:03 smithi152 ceph-mon[31188]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:03.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:03 smithi152 ceph-mon[31188]: pgmap v288: 97 pgs: 97 active+clean; 630 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 9 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-11T22:03:03.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.502+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/979125230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a54101cd0 msgr2=0x7f5a54102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:03.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.502+0000 7f5a5c1d0640 1 --2- 172.21.15.152:0/979125230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a54101cd0 0x7f5a54102150 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009900 tx=0x7f5a4402a410 comp rx=0 tx=0).stop 2024-09-11T22:03:03.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.502+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/979125230 shutdown_connections 2024-09-11T22:03:03.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.502+0000 7f5a5c1d0640 1 --2- 172.21.15.152:0/979125230 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a54102690 0x7f5a54108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:03.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.502+0000 7f5a5c1d0640 1 --2- 172.21.15.152:0/979125230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a54101cd0 0x7f5a54102150 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:03.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.502+0000 7f5a5c1d0640 1 --2- 172.21.15.152:0/979125230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a54100ad0 0x7f5a54100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.502+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/979125230 >> 172.21.15.152:0/979125230 conn(0x7f5a540fc280 msgr2=0x7f5a540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.502+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/979125230 shutdown_connections 2024-09-11T22:03:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.502+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/979125230 wait complete. 2024-09-11T22:03:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.502+0000 7f5a5c1d0640 1 Processor -- start 2024-09-11T22:03:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.502+0000 7f5a5c1d0640 1 -- start start 2024-09-11T22:03:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a5c1d0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a54100ad0 0x7f5a54197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a5c1d0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a54101cd0 0x7f5a54198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a5c1d0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a54102690 0x7f5a5419f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a5c1d0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5410d8c0 con 0x7f5a54100ad0 2024-09-11T22:03:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a5c1d0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5410d740 con 0x7f5a54102690 2024-09-11T22:03:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a5c1d0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5410da40 con 0x7f5a54101cd0 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a59f6c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a54100ad0 0x7f5a54197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a59f6c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a54100ad0 0x7f5a54197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52088/0 (socket says 172.21.15.152:52088) 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a59f6c640 1 -- 172.21.15.152:0/3307087071 learned_addr learned my addr 172.21.15.152:0/3307087071 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a5a76d640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a54102690 0x7f5a5419f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a5976b640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a54101cd0 0x7f5a54198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a59f6c640 1 -- 172.21.15.152:0/3307087071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a54101cd0 msgr2=0x7f5a54198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a59f6c640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a54101cd0 0x7f5a54198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a59f6c640 1 -- 172.21.15.152:0/3307087071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a54102690 msgr2=0x7f5a5419f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a59f6c640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a54102690 0x7f5a5419f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a59f6c640 1 -- 172.21.15.152:0/3307087071 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5419fb10 con 0x7f5a54100ad0 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a59f6c640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a54100ad0 0x7f5a54197ee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000c970 tx=0x7f5a5000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:03.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a4affd640 1 -- 172.21.15.152:0/3307087071 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50007c10 con 0x7f5a54100ad0 2024-09-11T22:03:03.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/3307087071 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5419fe00 con 0x7f5a54100ad0 2024-09-11T22:03:03.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a4affd640 1 -- 172.21.15.152:0/3307087071 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a50007db0 con 0x7f5a54100ad0 2024-09-11T22:03:03.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.503+0000 7f5a4affd640 1 -- 172.21.15.152:0/3307087071 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000f940 con 0x7f5a54100ad0 2024-09-11T22:03:03.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.504+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/3307087071 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a541a02e0 con 0x7f5a54100ad0 2024-09-11T22:03:03.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.504+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/3307087071 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a54107ea0 con 0x7f5a54100ad0 2024-09-11T22:03:03.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.505+0000 7f5a4affd640 1 -- 172.21.15.152:0/3307087071 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5a5000fb40 con 0x7f5a54100ad0 2024-09-11T22:03:03.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.506+0000 7f5a4affd640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5a400a2cc0 0x7f5a400a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:03.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.506+0000 7f5a5976b640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5a400a2cc0 0x7f5a400a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:03.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.506+0000 7f5a4affd640 1 -- 172.21.15.152:0/3307087071 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f5a500cf460 con 0x7f5a54100ad0 2024-09-11T22:03:03.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.507+0000 7f5a5976b640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5a400a2cc0 0x7f5a400a5180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a44000c00 tx=0x7f5a44031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:03.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.510+0000 7f5a4affd640 1 -- 172.21.15.152:0/3307087071 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a5009c2d0 con 0x7f5a54100ad0 2024-09-11T22:03:03.698 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:03 smithi179 ceph-mon[35603]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:03.698 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:03 smithi179 ceph-mon[35603]: pgmap v288: 97 pgs: 97 active+clean; 630 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 9 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-11T22:03:03.727 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:03 smithi193 ceph-mon[35545]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:03.728 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:03 smithi193 ceph-mon[35545]: pgmap v288: 97 pgs: 97 active+clean; 630 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 9 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-11T22:03:03.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.738+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/3307087071 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f5a5402d9f0 con 0x7f5a54100ad0 2024-09-11T22:03:03.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.742+0000 7f5a4affd640 1 -- 172.21.15.152:0/3307087071 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7f5a5009bbd0 con 0x7f5a54100ad0 2024-09-11T22:03:03.743 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2024-09-11T22:03:03.743 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCXE+JmOKkXLBAAPHyfbx/mxfZeq5PEibOl9A== 2024-09-11T22:03:03.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/3307087071 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5a400a2cc0 msgr2=0x7f5a400a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:03.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5a400a2cc0 0x7f5a400a5180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a44000c00 tx=0x7f5a44031400 comp rx=0 tx=0).stop 2024-09-11T22:03:03.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/3307087071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a54100ad0 msgr2=0x7f5a54197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:03.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a54100ad0 0x7f5a54197ee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000c970 tx=0x7f5a5000ce30 comp rx=0 tx=0).stop 2024-09-11T22:03:03.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/3307087071 shutdown_connections 2024-09-11T22:03:03.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a54102690 0x7f5a5419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:03.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5a400a2cc0 0x7f5a400a5180 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:03.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a54101cd0 0x7f5a54198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:03.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 --2- 172.21.15.152:0/3307087071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a54100ad0 0x7f5a54197ee0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:03.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/3307087071 >> 172.21.15.152:0/3307087071 conn(0x7f5a540fc280 msgr2=0x7f5a54105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:03.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/3307087071 shutdown_connections 2024-09-11T22:03:03.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:03.744+0000 7f5a5c1d0640 1 -- 172.21.15.152:0/3307087071 wait complete. 2024-09-11T22:03:04.419 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T22:03:04.419 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T22:03:04.419 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T22:03:04.456 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T22:03:04.456 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T22:03:04.457 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T22:03:04.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:04 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3307087071' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T22:03:05.095 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:04 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3307087071' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T22:03:05.096 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:04 smithi152 ceph-mon[31188]: pgmap v289: 97 pgs: 97 active+clean; 630 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-11T22:03:05.097 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:04 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3307087071' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T22:03:05.097 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:04 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3307087071' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T22:03:05.097 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:04 smithi193 ceph-mon[35545]: pgmap v289: 97 pgs: 97 active+clean; 630 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-11T22:03:05.097 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:04 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3307087071' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T22:03:05.097 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:04 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3307087071' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T22:03:05.097 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:04 smithi179 ceph-mon[35603]: pgmap v289: 97 pgs: 97 active+clean; 630 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-11T22:03:05.097 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:05.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.156+0000 7fd88d76e640 1 -- 172.21.15.152:0/3785554068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd888101df0 msgr2=0x7fd8881021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:05.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.156+0000 7fd88d76e640 1 --2- 172.21.15.152:0/3785554068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd888101df0 0x7fd8881021d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd878009900 tx=0x7fd87802a410 comp rx=0 tx=0).stop 2024-09-11T22:03:05.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.156+0000 7fd88d76e640 1 -- 172.21.15.152:0/3785554068 shutdown_connections 2024-09-11T22:03:05.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.156+0000 7fd88d76e640 1 --2- 172.21.15.152:0/3785554068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd888106f20 0x7fd88810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:05.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.156+0000 7fd88d76e640 1 --2- 172.21.15.152:0/3785554068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8881027a0 0x7fd8881067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:05.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.156+0000 7fd88d76e640 1 --2- 172.21.15.152:0/3785554068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd888101df0 0x7fd8881021d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:05.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.156+0000 7fd88d76e640 1 -- 172.21.15.152:0/3785554068 >> 172.21.15.152:0/3785554068 conn(0x7fd8880fd8f0 msgr2=0x7fd8880ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.156+0000 7fd88d76e640 1 -- 172.21.15.152:0/3785554068 shutdown_connections 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.156+0000 7fd88d76e640 1 -- 172.21.15.152:0/3785554068 wait complete. 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.156+0000 7fd88d76e640 1 Processor -- start 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd88d76e640 1 -- start start 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd88d76e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd888101df0 0x7fd888198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd88d76e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8881027a0 0x7fd888198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd88d76e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd888106f20 0x7fd88819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd88d76e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd888111fa0 con 0x7fd8881027a0 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd88d76e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd888111e20 con 0x7fd888106f20 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd88d76e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd888112120 con 0x7fd888101df0 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd87ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8881027a0 0x7fd888198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:05.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd87ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8881027a0 0x7fd888198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52098/0 (socket says 172.21.15.152:52098) 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd87ffff640 1 -- 172.21.15.152:0/1988999751 learned_addr learned my addr 172.21.15.152:0/1988999751 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd886ffd640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd888101df0 0x7fd888198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd8877fe640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd888106f20 0x7fd88819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd87ffff640 1 -- 172.21.15.152:0/1988999751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd888101df0 msgr2=0x7fd888198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd87ffff640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd888101df0 0x7fd888198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd87ffff640 1 -- 172.21.15.152:0/1988999751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd888106f20 msgr2=0x7fd88819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd87ffff640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd888106f20 0x7fd88819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd87ffff640 1 -- 172.21.15.152:0/1988999751 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88819d3b0 con 0x7fd8881027a0 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.157+0000 7fd87ffff640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8881027a0 0x7fd888198940 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd87000c920 tx=0x7fd87000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.158+0000 7fd884ff9640 1 -- 172.21.15.152:0/1988999751 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870007c70 con 0x7fd8881027a0 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.158+0000 7fd884ff9640 1 -- 172.21.15.152:0/1988999751 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd870007e10 con 0x7fd8881027a0 2024-09-11T22:03:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.158+0000 7fd88d76e640 1 -- 172.21.15.152:0/1988999751 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88819d6a0 con 0x7fd8881027a0 2024-09-11T22:03:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.158+0000 7fd884ff9640 1 -- 172.21.15.152:0/1988999751 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870018890 con 0x7fd8881027a0 2024-09-11T22:03:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.158+0000 7fd88d76e640 1 -- 172.21.15.152:0/1988999751 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8881a4f80 con 0x7fd8881027a0 2024-09-11T22:03:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.159+0000 7fd88d76e640 1 -- 172.21.15.152:0/1988999751 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8881021d0 con 0x7fd8881027a0 2024-09-11T22:03:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.160+0000 7fd884ff9640 1 -- 172.21.15.152:0/1988999751 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd870018a70 con 0x7fd8881027a0 2024-09-11T22:03:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.161+0000 7fd884ff9640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd8740a2c90 0x7fd8740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.161+0000 7fd886ffd640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd8740a2c90 0x7fd8740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.161+0000 7fd884ff9640 1 -- 172.21.15.152:0/1988999751 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fd8700cf230 con 0x7fd8881027a0 2024-09-11T22:03:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.161+0000 7fd886ffd640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd8740a2c90 0x7fd8740a5150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd878000c00 tx=0x7fd8780058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.165+0000 7fd884ff9640 1 -- 172.21.15.152:0/1988999751 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd870014030 con 0x7fd8881027a0 2024-09-11T22:03:05.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.377+0000 7fd88d76e640 1 -- 172.21.15.152:0/1988999751 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd888109b70 con 0x7fd8881027a0 2024-09-11T22:03:05.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.381+0000 7fd884ff9640 1 -- 172.21.15.152:0/1988999751 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263209 (secure 0 0 0) 0x7fd87009c010 con 0x7fd8881027a0 2024-09-11T22:03:05.385 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:05.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 -- 172.21.15.152:0/1988999751 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd8740a2c90 msgr2=0x7fd8740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:05.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd8740a2c90 0x7fd8740a5150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd878000c00 tx=0x7fd8780058d0 comp rx=0 tx=0).stop 2024-09-11T22:03:05.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 -- 172.21.15.152:0/1988999751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8881027a0 msgr2=0x7fd888198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:05.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8881027a0 0x7fd888198940 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd87000c920 tx=0x7fd87000cde0 comp rx=0 tx=0).stop 2024-09-11T22:03:05.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 -- 172.21.15.152:0/1988999751 shutdown_connections 2024-09-11T22:03:05.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd888106f20 0x7fd88819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:05.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8881027a0 0x7fd888198940 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:05.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd8740a2c90 0x7fd8740a5150 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:05.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 --2- 172.21.15.152:0/1988999751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd888101df0 0x7fd888198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:05.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 -- 172.21.15.152:0/1988999751 >> 172.21.15.152:0/1988999751 conn(0x7fd8880fd8f0 msgr2=0x7fd8880fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:05.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 -- 172.21.15.152:0/1988999751 shutdown_connections 2024-09-11T22:03:05.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:05.384+0000 7fd88d76e640 1 -- 172.21.15.152:0/1988999751 wait complete. 2024-09-11T22:03:06.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:05 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1988999751' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T22:03:06.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:05 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1988999751' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T22:03:06.108 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:05 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1988999751' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T22:03:06.137 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":17,"flags":0,"active_gid":14148,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3828412393},{"type":"v1","addr":"172.21.15.152:6801","nonce":3828412393}]},"active_addr":"172.21.15.152:6801/3828412393","active_change":"2024-09-11T21:55:54.195398+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.152:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":1096456467}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":1809855628}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":321546578}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":2394077400}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":2661528324}]}]} 2024-09-11T22:03:06.143 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T22:03:06.143 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T22:03:06.143 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:03:06.388 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:06.777 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:06 smithi152 ceph-mon[31188]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.2 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-11T22:03:06.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.856+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/3838406353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e8102790 msgr2=0x7fe4e81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:06.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.856+0000 7fe4ef3bb640 1 --2- 172.21.15.152:0/3838406353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e8102790 0x7fe4e81067e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009900 tx=0x7fe4e402a410 comp rx=0 tx=0).stop 2024-09-11T22:03:06.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.856+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/3838406353 shutdown_connections 2024-09-11T22:03:06.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.856+0000 7fe4ef3bb640 1 --2- 172.21.15.152:0/3838406353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4e8106f10 0x7fe4e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:06.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.856+0000 7fe4ef3bb640 1 --2- 172.21.15.152:0/3838406353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e8102790 0x7fe4e81067e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:06.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.856+0000 7fe4ef3bb640 1 --2- 172.21.15.152:0/3838406353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4e8101de0 0x7fe4e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:06.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.856+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/3838406353 >> 172.21.15.152:0/3838406353 conn(0x7fe4e80fd8c0 msgr2=0x7fe4e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:06.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.856+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/3838406353 shutdown_connections 2024-09-11T22:03:06.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.856+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/3838406353 wait complete. 2024-09-11T22:03:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.856+0000 7fe4ef3bb640 1 Processor -- start 2024-09-11T22:03:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.856+0000 7fe4ef3bb640 1 -- start start 2024-09-11T22:03:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ef3bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4e8101de0 0x7fe4e8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ef3bb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4e8102790 0x7fe4e81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ef3bb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e8106f10 0x7fe4e819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ef3bb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8111f70 con 0x7fe4e8106f10 2024-09-11T22:03:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ef3bb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8111df0 con 0x7fe4e8102790 2024-09-11T22:03:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ef3bb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e81120f0 con 0x7fe4e8101de0 2024-09-11T22:03:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ed958640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e8106f10 0x7fe4e819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ed958640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e8106f10 0x7fe4e819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52118/0 (socket says 172.21.15.152:52118) 2024-09-11T22:03:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ed958640 1 -- 172.21.15.152:0/332490396 learned_addr learned my addr 172.21.15.152:0/332490396 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ec956640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4e8102790 0x7fe4e81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ed157640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4e8101de0 0x7fe4e8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ed958640 1 -- 172.21.15.152:0/332490396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4e8101de0 msgr2=0x7fe4e8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ed958640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4e8101de0 0x7fe4e8198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ed958640 1 -- 172.21.15.152:0/332490396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4e8102790 msgr2=0x7fe4e81989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ed958640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4e8102790 0x7fe4e81989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ed958640 1 -- 172.21.15.152:0/332490396 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e819d440 con 0x7fe4e8106f10 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ed958640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e8106f10 0x7fe4e819cd60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000eb10 tx=0x7fe4e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4da7fc640 1 -- 172.21.15.152:0/332490396 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0004b20 con 0x7fe4e8106f10 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4da7fc640 1 -- 172.21.15.152:0/332490396 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4e0004cc0 con 0x7fe4e8106f10 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/332490396 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e819d730 con 0x7fe4e8106f10 2024-09-11T22:03:06.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.857+0000 7fe4da7fc640 1 -- 172.21.15.152:0/332490396 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0010760 con 0x7fe4e8106f10 2024-09-11T22:03:06.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.858+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/332490396 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e81a5010 con 0x7fe4e8106f10 2024-09-11T22:03:06.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.859+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/332490396 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e81021c0 con 0x7fe4e8106f10 2024-09-11T22:03:06.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.860+0000 7fe4da7fc640 1 -- 172.21.15.152:0/332490396 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe4e0005020 con 0x7fe4e8106f10 2024-09-11T22:03:06.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.861+0000 7fe4da7fc640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe4d40a2c10 0x7fe4d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:06.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.861+0000 7fe4ed157640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe4d40a2c10 0x7fe4d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:06.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.861+0000 7fe4da7fc640 1 -- 172.21.15.152:0/332490396 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fe4e00cf8e0 con 0x7fe4e8106f10 2024-09-11T22:03:06.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.861+0000 7fe4ed157640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe4d40a2c10 0x7fe4d40a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc005fd0 tx=0x7fe4dc00b590 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:06.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:06.865+0000 7fe4da7fc640 1 -- 172.21.15.152:0/332490396 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4e009c6c0 con 0x7fe4e8106f10 2024-09-11T22:03:07.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.035+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/332490396 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4e810a150 con 0x7fe4e8106f10 2024-09-11T22:03:07.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.036+0000 7fe4da7fc640 1 -- 172.21.15.152:0/332490396 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22820 (secure 0 0 0) 0x7fe4e009bfc0 con 0x7fe4e8106f10 2024-09-11T22:03:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:07.037 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":84,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:02:55.337928+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:03:07.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/332490396 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe4d40a2c10 msgr2=0x7fe4d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:07.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe4d40a2c10 0x7fe4d40a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc005fd0 tx=0x7fe4dc00b590 comp rx=0 tx=0).stop 2024-09-11T22:03:07.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/332490396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e8106f10 msgr2=0x7fe4e819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:07.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e8106f10 0x7fe4e819cd60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000eb10 tx=0x7fe4e000c2d0 comp rx=0 tx=0).stop 2024-09-11T22:03:07.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/332490396 shutdown_connections 2024-09-11T22:03:07.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e8106f10 0x7fe4e819cd60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:07.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4e8102790 0x7fe4e81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:07.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fe4d40a2c10 0x7fe4d40a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:07.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 --2- 172.21.15.152:0/332490396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4e8101de0 0x7fe4e8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:07.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/332490396 >> 172.21.15.152:0/332490396 conn(0x7fe4e80fd8c0 msgr2=0x7fe4e80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:07.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/332490396 shutdown_connections 2024-09-11T22:03:07.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:07.039+0000 7fe4ef3bb640 1 -- 172.21.15.152:0/332490396 wait complete. 2024-09-11T22:03:07.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:06 smithi179 ceph-mon[35603]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.2 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-11T22:03:07.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:06 smithi193 ceph-mon[35545]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.2 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-11T22:03:07.674 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T22:03:07.675 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:03:07.923 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:07.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:07 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/332490396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:03:08.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:07 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/332490396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:03:08.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:07 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/332490396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:03:08.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.454+0000 7fc1cdb31640 1 -- 172.21.15.152:0/908851116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c810c170 msgr2=0x7fc1c810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:08.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.454+0000 7fc1cdb31640 1 --2- 172.21.15.152:0/908851116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c810c170 0x7fc1c810e610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009ca0 tx=0x7fc1c002a950 comp rx=0 tx=0).stop 2024-09-11T22:03:08.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.454+0000 7fc1cdb31640 1 -- 172.21.15.152:0/908851116 shutdown_connections 2024-09-11T22:03:08.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.454+0000 7fc1cdb31640 1 --2- 172.21.15.152:0/908851116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c810c170 0x7fc1c810e610 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:08.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.454+0000 7fc1cdb31640 1 --2- 172.21.15.152:0/908851116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c8103660 0x7fc1c810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:08.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.454+0000 7fc1cdb31640 1 --2- 172.21.15.152:0/908851116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c8102d40 0x7fc1c8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:08.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.454+0000 7fc1cdb31640 1 -- 172.21.15.152:0/908851116 >> 172.21.15.152:0/908851116 conn(0x7fc1c80fc7a0 msgr2=0x7fc1c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:08.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.454+0000 7fc1cdb31640 1 -- 172.21.15.152:0/908851116 shutdown_connections 2024-09-11T22:03:08.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.454+0000 7fc1cdb31640 1 -- 172.21.15.152:0/908851116 wait complete. 2024-09-11T22:03:08.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.455+0000 7fc1cdb31640 1 Processor -- start 2024-09-11T22:03:08.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.455+0000 7fc1cdb31640 1 -- start start 2024-09-11T22:03:08.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.455+0000 7fc1cdb31640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c8102d40 0x7fc1c81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:08.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.455+0000 7fc1cdb31640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c8103660 0x7fc1c8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:08.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.455+0000 7fc1cdb31640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c810c170 0x7fc1c8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:08.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.455+0000 7fc1cdb31640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8111f30 con 0x7fc1c8102d40 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.455+0000 7fc1cdb31640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8111db0 con 0x7fc1c8103660 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.455+0000 7fc1cdb31640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c81120b0 con 0x7fc1c810c170 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c8102d40 0x7fc1c81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c8102d40 0x7fc1c81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52146/0 (socket says 172.21.15.152:52146) 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c77fe640 1 -- 172.21.15.152:0/4214682715 learned_addr learned my addr 172.21.15.152:0/4214682715 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c7fff640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c810c170 0x7fc1c8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c6ffd640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c8103660 0x7fc1c8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c77fe640 1 -- 172.21.15.152:0/4214682715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c810c170 msgr2=0x7fc1c8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c77fe640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c810c170 0x7fc1c8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c77fe640 1 -- 172.21.15.152:0/4214682715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c8103660 msgr2=0x7fc1c8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c77fe640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c8103660 0x7fc1c8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:08.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c77fe640 1 -- 172.21.15.152:0/4214682715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c81a6890 con 0x7fc1c8102d40 2024-09-11T22:03:08.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c7fff640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c810c170 0x7fc1c8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:08.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c6ffd640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c8103660 0x7fc1c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:08.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c77fe640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c8102d40 0x7fc1c81009a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800c920 tx=0x7fc1b800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:08.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c4ff9640 1 -- 172.21.15.152:0/4214682715 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8007c70 con 0x7fc1c8102d40 2024-09-11T22:03:08.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c4ff9640 1 -- 172.21.15.152:0/4214682715 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b8007e10 con 0x7fc1c8102d40 2024-09-11T22:03:08.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1cdb31640 1 -- 172.21.15.152:0/4214682715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c81a6b80 con 0x7fc1c8102d40 2024-09-11T22:03:08.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1c4ff9640 1 -- 172.21.15.152:0/4214682715 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8018890 con 0x7fc1c8102d40 2024-09-11T22:03:08.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.456+0000 7fc1cdb31640 1 -- 172.21.15.152:0/4214682715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c81a70c0 con 0x7fc1c8102d40 2024-09-11T22:03:08.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.457+0000 7fc1cdb31640 1 -- 172.21.15.152:0/4214682715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c8103120 con 0x7fc1c8102d40 2024-09-11T22:03:08.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.458+0000 7fc1c4ff9640 1 -- 172.21.15.152:0/4214682715 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc1b8018a70 con 0x7fc1c8102d40 2024-09-11T22:03:08.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.459+0000 7fc1c4ff9640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1b40a2c10 0x7fc1b40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:08.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.459+0000 7fc1c6ffd640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1b40a2c10 0x7fc1b40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:08.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.459+0000 7fc1c4ff9640 1 -- 172.21.15.152:0/4214682715 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fc1b80cf3f0 con 0x7fc1c8102d40 2024-09-11T22:03:08.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.460+0000 7fc1c6ffd640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1b40a2c10 0x7fc1b40a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0005fd0 tx=0x7fc1b0005f60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:08.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.463+0000 7fc1c4ff9640 1 -- 172.21.15.152:0/4214682715 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1b8014030 con 0x7fc1c8102d40 2024-09-11T22:03:08.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.631+0000 7fc1cdb31640 1 -- 172.21.15.152:0/4214682715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1c8107210 con 0x7fc1c8102d40 2024-09-11T22:03:08.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.633+0000 7fc1c4ff9640 1 -- 172.21.15.152:0/4214682715 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22820 (secure 0 0 0) 0x7fc1b800de20 con 0x7fc1c8102d40 2024-09-11T22:03:08.634 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:08.634 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":84,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:02:55.337928+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:03:08.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 -- 172.21.15.152:0/4214682715 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1b40a2c10 msgr2=0x7fc1b40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1b40a2c10 0x7fc1b40a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0005fd0 tx=0x7fc1b0005f60 comp rx=0 tx=0).stop 2024-09-11T22:03:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 -- 172.21.15.152:0/4214682715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c8102d40 msgr2=0x7fc1c81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c8102d40 0x7fc1c81009a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800c920 tx=0x7fc1b800cde0 comp rx=0 tx=0).stop 2024-09-11T22:03:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 -- 172.21.15.152:0/4214682715 shutdown_connections 2024-09-11T22:03:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc1b40a2c10 0x7fc1b40a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c810c170 0x7fc1c8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c8103660 0x7fc1c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 --2- 172.21.15.152:0/4214682715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c8102d40 0x7fc1c81009a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 -- 172.21.15.152:0/4214682715 >> 172.21.15.152:0/4214682715 conn(0x7fc1c80fc7a0 msgr2=0x7fc1c80fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 -- 172.21.15.152:0/4214682715 shutdown_connections 2024-09-11T22:03:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:08.635+0000 7fc1cdb31640 1 -- 172.21.15.152:0/4214682715 wait complete. 2024-09-11T22:03:08.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:08 smithi152 ceph-mon[31188]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-11T22:03:08.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:08 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/4214682715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:03:09.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:08 smithi179 ceph-mon[35603]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-11T22:03:09.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:08 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/4214682715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:03:09.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:08 smithi193 ceph-mon[35545]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-11T22:03:09.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:08 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/4214682715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:03:09.323 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T22:03:09.324 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T22:03:09.324 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T22:03:09.324 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T22:03:09.325 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T22:03:09.325 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T22:03:09.326 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-11T22:03:09.326 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-11T22:03:09.327 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-11T22:03:09.327 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-11T22:03:09.327 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-11T22:03:09.328 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-11T22:03:09.937 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:10.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.486+0000 7f2d1bb32640 1 -- 172.21.15.152:0/3828355249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d14102790 msgr2=0x7f2d141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:10.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.486+0000 7f2d1bb32640 1 --2- 172.21.15.152:0/3828355249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d14102790 0x7f2d141067e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009900 tx=0x7f2d0802a410 comp rx=0 tx=0).stop 2024-09-11T22:03:10.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.486+0000 7f2d1bb32640 1 -- 172.21.15.152:0/3828355249 shutdown_connections 2024-09-11T22:03:10.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.486+0000 7f2d1bb32640 1 --2- 172.21.15.152:0/3828355249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d14106f10 0x7f2d1410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:10.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.486+0000 7f2d1bb32640 1 --2- 172.21.15.152:0/3828355249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d14102790 0x7f2d141067e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:10.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.486+0000 7f2d1bb32640 1 --2- 172.21.15.152:0/3828355249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d14101de0 0x7f2d141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.486+0000 7f2d1bb32640 1 -- 172.21.15.152:0/3828355249 >> 172.21.15.152:0/3828355249 conn(0x7f2d140fd8c0 msgr2=0x7f2d140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.486+0000 7f2d1bb32640 1 -- 172.21.15.152:0/3828355249 shutdown_connections 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.486+0000 7f2d1bb32640 1 -- 172.21.15.152:0/3828355249 wait complete. 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d1bb32640 1 Processor -- start 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d1bb32640 1 -- start start 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d1bb32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d14101de0 0x7f2d141985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d1bb32640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d14102790 0x7f2d14198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d1bb32640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d14106f10 0x7f2d1419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d1bb32640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2d14112010 con 0x7f2d14102790 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d1bb32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2d14111e90 con 0x7f2d14101de0 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d1bb32640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2d14112190 con 0x7f2d14106f10 2024-09-11T22:03:10.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d190cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d14102790 0x7f2d14198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:10.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d190cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d14102790 0x7f2d14198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52156/0 (socket says 172.21.15.152:52156) 2024-09-11T22:03:10.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d190cd640 1 -- 172.21.15.152:0/2332238358 learned_addr learned my addr 172.21.15.152:0/2332238358 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:10.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d190cd640 1 -- 172.21.15.152:0/2332238358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d14106f10 msgr2=0x7f2d1419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:10.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d1a0cf640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d14106f10 0x7f2d1419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:10.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d198ce640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d14101de0 0x7f2d141985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:10.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d190cd640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d14106f10 0x7f2d1419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:10.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d190cd640 1 -- 172.21.15.152:0/2332238358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d14101de0 msgr2=0x7f2d141985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:10.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d190cd640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d14101de0 0x7f2d141985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:10.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d190cd640 1 -- 172.21.15.152:0/2332238358 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1419d560 con 0x7f2d14102790 2024-09-11T22:03:10.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.487+0000 7f2d190cd640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d14102790 0x7f2d14198af0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2d08005ab0 tx=0x7f2d080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:10.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.488+0000 7f2d12ffd640 1 -- 172.21.15.152:0/2332238358 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0803f030 con 0x7f2d14102790 2024-09-11T22:03:10.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.488+0000 7f2d1bb32640 1 -- 172.21.15.152:0/2332238358 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1419d7f0 con 0x7f2d14102790 2024-09-11T22:03:10.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.488+0000 7f2d12ffd640 1 -- 172.21.15.152:0/2332238358 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d08003ce0 con 0x7f2d14102790 2024-09-11T22:03:10.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.488+0000 7f2d12ffd640 1 -- 172.21.15.152:0/2332238358 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08035070 con 0x7f2d14102790 2024-09-11T22:03:10.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.488+0000 7f2d1bb32640 1 -- 172.21.15.152:0/2332238358 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d141a5130 con 0x7f2d14102790 2024-09-11T22:03:10.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.488+0000 7f2d1bb32640 1 -- 172.21.15.152:0/2332238358 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d14062980 con 0x7f2d14102790 2024-09-11T22:03:10.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.490+0000 7f2d12ffd640 1 -- 172.21.15.152:0/2332238358 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2d08042030 con 0x7f2d14102790 2024-09-11T22:03:10.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.490+0000 7f2d12ffd640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f2cfc0a2c10 0x7f2cfc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:10.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.491+0000 7f2d198ce640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f2cfc0a2c10 0x7f2cfc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.491+0000 7f2d12ffd640 1 -- 172.21.15.152:0/2332238358 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f2d080efe30 con 0x7f2d14102790 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.491+0000 7f2d12ffd640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024] conn(0x7f2cfc0ac8c0 0x7f2cfc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.491+0000 7f2d12ffd640 1 -- 172.21.15.152:0/2332238358 --> [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d08001d30 con 0x7f2cfc0ac8c0 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.491+0000 7f2d12ffd640 1 -- 172.21.15.152:0/2332238358 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f2d080f0280 con 0x7f2d14102790 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.491+0000 7f2d198ce640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f2cfc0a2c10 0x7f2cfc0a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d04007dc0 tx=0x7f2d040072f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.491+0000 7f2d1a0cf640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024] conn(0x7f2cfc0ac8c0 0x7f2cfc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.491+0000 7f2d1a0cf640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024] conn(0x7f2cfc0ac8c0 0x7f2cfc0aed60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.492+0000 7f2d12ffd640 1 -- 172.21.15.152:0/2332238358 <== osd.4 v2:172.21.15.179:6808/2976574024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d08001d30 con 0x7f2cfc0ac8c0 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1bb32640 1 -- 172.21.15.152:0/2332238358 --> [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d14062e00 con 0x7f2cfc0ac8c0 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d12ffd640 1 -- 172.21.15.152:0/2332238358 <== osd.4 v2:172.21.15.179:6808/2976574024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2d14062e00 con 0x7f2cfc0ac8c0 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1bb32640 1 -- 172.21.15.152:0/2332238358 >> [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024] conn(0x7f2cfc0ac8c0 msgr2=0x7f2cfc0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:10.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1bb32640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024] conn(0x7f2cfc0ac8c0 0x7f2cfc0aed60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:10.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1bb32640 1 -- 172.21.15.152:0/2332238358 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f2cfc0a2c10 msgr2=0x7f2cfc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:10.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1bb32640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f2cfc0a2c10 0x7f2cfc0a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d04007dc0 tx=0x7f2d040072f0 comp rx=0 tx=0).stop 2024-09-11T22:03:10.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1bb32640 1 -- 172.21.15.152:0/2332238358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d14102790 msgr2=0x7f2d14198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:10.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1bb32640 1 --2- 172.21.15.152:0/2332238358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d14102790 0x7f2d14198af0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2d08005ab0 tx=0x7f2d080042f0 comp rx=0 tx=0).stop 2024-09-11T22:03:10.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1a0cf640 1 -- 172.21.15.152:0/2332238358 reap_dead start 2024-09-11T22:03:10.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1bb32640 1 -- 172.21.15.152:0/2332238358 shutdown_connections 2024-09-11T22:03:10.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1bb32640 1 -- 172.21.15.152:0/2332238358 >> 172.21.15.152:0/2332238358 conn(0x7f2d140fd8c0 msgr2=0x7f2d140fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:10.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1bb32640 1 -- 172.21.15.152:0/2332238358 shutdown_connections 2024-09-11T22:03:10.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:10.506+0000 7f2d1bb32640 1 -- 172.21.15.152:0/2332238358 wait complete. 2024-09-11T22:03:11.193 INFO:teuthology.orchestra.run.smithi152.stdout:137438953526 2024-09-11T22:03:11.193 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T22:03:11.225 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:11.230 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:11.231 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:11.231 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:11.238 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:11.238 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:11.240 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:11.249 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:11.253 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:11.257 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:11.311 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:11.411 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:11 smithi152 ceph-mon[31188]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:03:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:11 smithi179 ceph-mon[35603]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:03:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:11 smithi193 ceph-mon[35545]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:03:11.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.827+0000 7f695716b640 1 -- 172.21.15.152:0/749733499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6950102ef0 msgr2=0x7f695010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:11.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.827+0000 7f695716b640 1 --2- 172.21.15.152:0/749733499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6950102ef0 0x7f695010da40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6940009ca0 tx=0x7f694002a950 comp rx=0 tx=0).stop 2024-09-11T22:03:11.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.827+0000 7f695716b640 1 -- 172.21.15.152:0/749733499 shutdown_connections 2024-09-11T22:03:11.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.827+0000 7f695716b640 1 --2- 172.21.15.152:0/749733499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6950102ef0 0x7f695010da40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:11.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.827+0000 7f695716b640 1 --2- 172.21.15.152:0/749733499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6950102570 0x7f69501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:11.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.827+0000 7f695716b640 1 --2- 172.21.15.152:0/749733499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6950100e20 0x7f6950101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:11.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.827+0000 7f695716b640 1 -- 172.21.15.152:0/749733499 >> 172.21.15.152:0/749733499 conn(0x7f69500fc7d0 msgr2=0x7f69500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.827+0000 7f695716b640 1 -- 172.21.15.152:0/749733499 shutdown_connections 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.827+0000 7f695716b640 1 -- 172.21.15.152:0/749733499 wait complete. 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.828+0000 7f695716b640 1 Processor -- start 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.828+0000 7f695716b640 1 -- start start 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.828+0000 7f695716b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6950100e20 0x7f69501984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.828+0000 7f695716b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6950102570 0x7f6950198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.828+0000 7f695716b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6950102ef0 0x7f695019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.828+0000 7f695716b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6950110f80 con 0x7f6950102ef0 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.828+0000 7f695716b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6950110e00 con 0x7f6950102570 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.828+0000 7f695716b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6950111100 con 0x7f6950100e20 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.828+0000 7f6955708640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6950102ef0 0x7f695019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.828+0000 7f6955708640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6950102ef0 0x7f695019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52166/0 (socket says 172.21.15.152:52166) 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.828+0000 7f6955708640 1 -- 172.21.15.152:0/1204940152 learned_addr learned my addr 172.21.15.152:0/1204940152 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f6954f07640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6950100e20 0x7f69501984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f6955708640 1 -- 172.21.15.152:0/1204940152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6950100e20 msgr2=0x7f69501984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f6955708640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6950100e20 0x7f69501984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f6955708640 1 -- 172.21.15.152:0/1204940152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6950102570 msgr2=0x7f6950198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f694ffff640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6950102570 0x7f6950198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f6955708640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6950102570 0x7f6950198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f6955708640 1 -- 172.21.15.152:0/1204940152 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695019d490 con 0x7f6950102ef0 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f6954f07640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6950100e20 0x7f69501984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f6955708640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6950102ef0 0x7f695019cdb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6940004af0 tx=0x7f694002f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f694dffb640 1 -- 172.21.15.152:0/1204940152 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940034040 con 0x7f6950102ef0 2024-09-11T22:03:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f694dffb640 1 -- 172.21.15.152:0/1204940152 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6940030920 con 0x7f6950102ef0 2024-09-11T22:03:11.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f695716b640 1 -- 172.21.15.152:0/1204940152 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695019d720 con 0x7f6950102ef0 2024-09-11T22:03:11.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f694dffb640 1 -- 172.21.15.152:0/1204940152 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940004820 con 0x7f6950102ef0 2024-09-11T22:03:11.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.829+0000 7f695716b640 1 -- 172.21.15.152:0/1204940152 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69501a5060 con 0x7f6950102ef0 2024-09-11T22:03:11.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.830+0000 7f695716b640 1 -- 172.21.15.152:0/1204940152 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6950062980 con 0x7f6950102ef0 2024-09-11T22:03:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.832+0000 7f694dffb640 1 -- 172.21.15.152:0/1204940152 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6940037020 con 0x7f6950102ef0 2024-09-11T22:03:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.832+0000 7f694dffb640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f693c0a2c90 0x7f693c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.832+0000 7f6954f07640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f693c0a2c90 0x7f693c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.832+0000 7f694dffb640 1 -- 172.21.15.152:0/1204940152 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f69400f0220 con 0x7f6950102ef0 2024-09-11T22:03:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.832+0000 7f694dffb640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699] conn(0x7f693c0ac940 0x7f693c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.832+0000 7f694dffb640 1 -- 172.21.15.152:0/1204940152 --> [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f694002c030 con 0x7f693c0ac940 2024-09-11T22:03:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.832+0000 7f694dffb640 1 -- 172.21.15.152:0/1204940152 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f69400f0670 con 0x7f6950102ef0 2024-09-11T22:03:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.833+0000 7f6954f07640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f693c0a2c90 0x7f693c0a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6948009b50 tx=0x7f6948005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:11.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.833+0000 7f694ffff640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699] conn(0x7f693c0ac940 0x7f693c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:11.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.833+0000 7f694ffff640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699] conn(0x7f693c0ac940 0x7f693c0aede0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:11.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.834+0000 7f694dffb640 1 -- 172.21.15.152:0/1204940152 <== osd.7 v2:172.21.15.179:6816/2484200699 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f694002c030 con 0x7f693c0ac940 2024-09-11T22:03:11.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.849+0000 7f695716b640 1 -- 172.21.15.152:0/1204940152 --> [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6950062db0 con 0x7f693c0ac940 2024-09-11T22:03:11.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.849+0000 7f694dffb640 1 -- 172.21.15.152:0/1204940152 <== osd.7 v2:172.21.15.179:6816/2484200699 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6950062db0 con 0x7f693c0ac940 2024-09-11T22:03:11.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.850+0000 7f695716b640 1 -- 172.21.15.152:0/1204940152 >> [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699] conn(0x7f693c0ac940 msgr2=0x7f693c0aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:11.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.850+0000 7f695716b640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699] conn(0x7f693c0ac940 0x7f693c0aede0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:11.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.850+0000 7f695716b640 1 -- 172.21.15.152:0/1204940152 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f693c0a2c90 msgr2=0x7f693c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:11.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.850+0000 7f695716b640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f693c0a2c90 0x7f693c0a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6948009b50 tx=0x7f6948005f90 comp rx=0 tx=0).stop 2024-09-11T22:03:11.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.850+0000 7f695716b640 1 -- 172.21.15.152:0/1204940152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6950102ef0 msgr2=0x7f695019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:11.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.850+0000 7f695716b640 1 --2- 172.21.15.152:0/1204940152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6950102ef0 0x7f695019cdb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6940004af0 tx=0x7f694002f5b0 comp rx=0 tx=0).stop 2024-09-11T22:03:11.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.850+0000 7f6955708640 1 -- 172.21.15.152:0/1204940152 reap_dead start 2024-09-11T22:03:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.850+0000 7f695716b640 1 -- 172.21.15.152:0/1204940152 shutdown_connections 2024-09-11T22:03:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.850+0000 7f695716b640 1 -- 172.21.15.152:0/1204940152 >> 172.21.15.152:0/1204940152 conn(0x7f69500fc7d0 msgr2=0x7f695006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.850+0000 7f695716b640 1 -- 172.21.15.152:0/1204940152 shutdown_connections 2024-09-11T22:03:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:11.850+0000 7f695716b640 1 -- 172.21.15.152:0/1204940152 wait complete. 2024-09-11T22:03:12.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.388+0000 7fdfe923b640 1 -- 172.21.15.152:0/1379668870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfe4100de0 msgr2=0x7fdfe4104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:12.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.388+0000 7fdfe923b640 1 --2- 172.21.15.152:0/1379668870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfe4100de0 0x7fdfe4104e30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009900 tx=0x7fdfcc02a410 comp rx=0 tx=0).stop 2024-09-11T22:03:12.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.388+0000 7fdfe923b640 1 -- 172.21.15.152:0/1379668870 shutdown_connections 2024-09-11T22:03:12.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.388+0000 7fdfe923b640 1 --2- 172.21.15.152:0/1379668870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfe4105560 0x7fdfe410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:12.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.388+0000 7fdfe923b640 1 --2- 172.21.15.152:0/1379668870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfe4100de0 0x7fdfe4104e30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:12.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.388+0000 7fdfe923b640 1 --2- 172.21.15.152:0/1379668870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfe4100430 0x7fdfe4100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:12.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.388+0000 7fdfe923b640 1 -- 172.21.15.152:0/1379668870 >> 172.21.15.152:0/1379668870 conn(0x7fdfe4077230 msgr2=0x7fdfe40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:12.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.388+0000 7fdfe923b640 1 -- 172.21.15.152:0/1379668870 shutdown_connections 2024-09-11T22:03:12.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.389+0000 7fdfe923b640 1 -- 172.21.15.152:0/1379668870 wait complete. 2024-09-11T22:03:12.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.389+0000 7fdfe923b640 1 Processor -- start 2024-09-11T22:03:12.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.389+0000 7fdfe923b640 1 -- start start 2024-09-11T22:03:12.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe923b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfe4100430 0x7fdfe419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:12.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe923b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfe4100de0 0x7fdfe419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:12.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe923b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfe4105560 0x7fdfe419ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:12.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe923b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe410fd10 con 0x7fdfe4100430 2024-09-11T22:03:12.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe923b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe410fb90 con 0x7fdfe4105560 2024-09-11T22:03:12.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe923b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe410fe90 con 0x7fdfe4100de0 2024-09-11T22:03:12.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe2d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfe4100430 0x7fdfe419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:12.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe2d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfe4100430 0x7fdfe419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52176/0 (socket says 172.21.15.152:52176) 2024-09-11T22:03:12.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe2d9d640 1 -- 172.21.15.152:0/988557381 learned_addr learned my addr 172.21.15.152:0/988557381 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfdbfff640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfe4100de0 0x7fdfe419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe359e640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfe4105560 0x7fdfe419ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe2d9d640 1 -- 172.21.15.152:0/988557381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfe4100de0 msgr2=0x7fdfe419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe2d9d640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfe4100de0 0x7fdfe419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe2d9d640 1 -- 172.21.15.152:0/988557381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfe4105560 msgr2=0x7fdfe419ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe2d9d640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfe4105560 0x7fdfe419ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe2d9d640 1 -- 172.21.15.152:0/988557381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe419f550 con 0x7fdfe4100430 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.390+0000 7fdfe2d9d640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfe4100430 0x7fdfe419a5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c920 tx=0x7fdfd400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.391+0000 7fdfe0d99640 1 -- 172.21.15.152:0/988557381 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4007c70 con 0x7fdfe4100430 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.391+0000 7fdfe923b640 1 -- 172.21.15.152:0/988557381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe419f840 con 0x7fdfe4100430 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.391+0000 7fdfe0d99640 1 -- 172.21.15.152:0/988557381 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfd4007e10 con 0x7fdfe4100430 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.391+0000 7fdfe0d99640 1 -- 172.21.15.152:0/988557381 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4018890 con 0x7fdfe4100430 2024-09-11T22:03:12.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.391+0000 7fdfe923b640 1 -- 172.21.15.152:0/988557381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe41a7120 con 0x7fdfe4100430 2024-09-11T22:03:12.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.392+0000 7fdfe923b640 1 -- 172.21.15.152:0/988557381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdfe4062900 con 0x7fdfe4100430 2024-09-11T22:03:12.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.393+0000 7fdfe0d99640 1 -- 172.21.15.152:0/988557381 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fdfd4018a30 con 0x7fdfe4100430 2024-09-11T22:03:12.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.394+0000 7fdfe0d99640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdfd00a2c00 0x7fdfd00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:12.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.394+0000 7fdfdbfff640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdfd00a2c00 0x7fdfd00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:12.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.394+0000 7fdfe0d99640 1 -- 172.21.15.152:0/988557381 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fdfd40cf780 con 0x7fdfe4100430 2024-09-11T22:03:12.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.394+0000 7fdfe0d99640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769] conn(0x7fdfd00ac8b0 0x7fdfd00aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:12.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.394+0000 7fdfe0d99640 1 -- 172.21.15.152:0/988557381 --> [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdfd00af420 con 0x7fdfd00ac8b0 2024-09-11T22:03:12.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.394+0000 7fdfe0d99640 1 -- 172.21.15.152:0/988557381 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fdfd40cfbd0 con 0x7fdfe4100430 2024-09-11T22:03:12.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.394+0000 7fdfe359e640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769] conn(0x7fdfd00ac8b0 0x7fdfd00aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:12.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.394+0000 7fdfdbfff640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdfd00a2c00 0x7fdfd00a50c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc005940 tx=0x7fdfcc005bb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:12.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.395+0000 7fdfe359e640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769] conn(0x7fdfd00ac8b0 0x7fdfd00aed50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:12.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.395+0000 7fdfe0d99640 1 -- 172.21.15.152:0/988557381 <== osd.9 v2:172.21.15.152:6826/863570769 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdfd00af420 con 0x7fdfd00ac8b0 2024-09-11T22:03:12.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.408+0000 7fdfe923b640 1 -- 172.21.15.152:0/988557381 --> [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdfe4062d80 con 0x7fdfd00ac8b0 2024-09-11T22:03:12.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe0d99640 1 -- 172.21.15.152:0/988557381 <== osd.9 v2:172.21.15.152:6826/863570769 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdfe4062d80 con 0x7fdfd00ac8b0 2024-09-11T22:03:12.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe923b640 1 -- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769] conn(0x7fdfd00ac8b0 msgr2=0x7fdfd00aed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:12.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe923b640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769] conn(0x7fdfd00ac8b0 0x7fdfd00aed50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:12.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe923b640 1 -- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdfd00a2c00 msgr2=0x7fdfd00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:12.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe923b640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fdfd00a2c00 0x7fdfd00a50c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc005940 tx=0x7fdfcc005bb0 comp rx=0 tx=0).stop 2024-09-11T22:03:12.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe923b640 1 -- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfe4100430 msgr2=0x7fdfe419a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:12.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe923b640 1 --2- 172.21.15.152:0/988557381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfe4100430 0x7fdfe419a5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c920 tx=0x7fdfd400cde0 comp rx=0 tx=0).stop 2024-09-11T22:03:12.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe359e640 1 -- 172.21.15.152:0/988557381 reap_dead start 2024-09-11T22:03:12.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe923b640 1 -- 172.21.15.152:0/988557381 shutdown_connections 2024-09-11T22:03:12.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe923b640 1 -- 172.21.15.152:0/988557381 >> 172.21.15.152:0/988557381 conn(0x7fdfe4077230 msgr2=0x7fdfe4103de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:12.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe923b640 1 -- 172.21.15.152:0/988557381 shutdown_connections 2024-09-11T22:03:12.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:12.409+0000 7fdfe923b640 1 -- 172.21.15.152:0/988557381 wait complete. 2024-09-11T22:03:12.954 INFO:teuthology.orchestra.run.smithi152.stdout:210453397543 2024-09-11T22:03:12.955 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-11T22:03:13.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:13 smithi152 ceph-mon[31188]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T22:03:13.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.717+0000 7f93e212e640 1 -- 172.21.15.152:0/94149840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93dc102790 msgr2=0x7f93dc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.717+0000 7f93e212e640 1 --2- 172.21.15.152:0/94149840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93dc102790 0x7f93dc1067e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009900 tx=0x7f93d002a410 comp rx=0 tx=0).stop 2024-09-11T22:03:13.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.717+0000 7f93e212e640 1 -- 172.21.15.152:0/94149840 shutdown_connections 2024-09-11T22:03:13.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.717+0000 7f93e212e640 1 --2- 172.21.15.152:0/94149840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93dc106f10 0x7f93dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.717+0000 7f93e212e640 1 --2- 172.21.15.152:0/94149840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93dc102790 0x7f93dc1067e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.717+0000 7f93e212e640 1 --2- 172.21.15.152:0/94149840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93dc101de0 0x7f93dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.717+0000 7f93e212e640 1 -- 172.21.15.152:0/94149840 >> 172.21.15.152:0/94149840 conn(0x7f93dc0fd8c0 msgr2=0x7f93dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:13.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.717+0000 7f93e212e640 1 -- 172.21.15.152:0/94149840 shutdown_connections 2024-09-11T22:03:13.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.717+0000 7f93e212e640 1 -- 172.21.15.152:0/94149840 wait complete. 2024-09-11T22:03:13.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.718+0000 7f93e212e640 1 Processor -- start 2024-09-11T22:03:13.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.718+0000 7f93e212e640 1 -- start start 2024-09-11T22:03:13.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.718+0000 7f93e212e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93dc101de0 0x7f93dc198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:13.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.718+0000 7f93e212e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93dc102790 0x7f93dc198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:13.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.718+0000 7f93e212e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93dc106f10 0x7f93dc19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.718+0000 7f93e212e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc111f70 con 0x7f93dc102790 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.718+0000 7f93e212e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc111df0 con 0x7f93dc106f10 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.718+0000 7f93e212e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1120f0 con 0x7f93dc101de0 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93daffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93dc102790 0x7f93dc198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93daffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93dc102790 0x7f93dc198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37198/0 (socket says 172.21.15.152:37198) 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93daffd640 1 -- 172.21.15.152:0/783706215 learned_addr learned my addr 172.21.15.152:0/783706215 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93dbfff640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93dc106f10 0x7f93dc19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93db7fe640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93dc101de0 0x7f93dc198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93daffd640 1 -- 172.21.15.152:0/783706215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93dc101de0 msgr2=0x7f93dc198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93daffd640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93dc101de0 0x7f93dc198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93daffd640 1 -- 172.21.15.152:0/783706215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93dc106f10 msgr2=0x7f93dc19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93daffd640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93dc106f10 0x7f93dc19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93daffd640 1 -- 172.21.15.152:0/783706215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93dc19d3e0 con 0x7f93dc102790 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93daffd640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93dc102790 0x7f93dc198970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f93d0006010 tx=0x7f93d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93d8ff9640 1 -- 172.21.15.152:0/783706215 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d003f030 con 0x7f93dc102790 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93d8ff9640 1 -- 172.21.15.152:0/783706215 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d0003ce0 con 0x7f93dc102790 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93e212e640 1 -- 172.21.15.152:0/783706215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93dc19d670 con 0x7f93dc102790 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93d8ff9640 1 -- 172.21.15.152:0/783706215 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0035070 con 0x7f93dc102790 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.719+0000 7f93e212e640 1 -- 172.21.15.152:0/783706215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93dc1a4fb0 con 0x7f93dc102790 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.720+0000 7f93e212e640 1 -- 172.21.15.152:0/783706215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93dc062940 con 0x7f93dc102790 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.721+0000 7f93d8ff9640 1 -- 172.21.15.152:0/783706215 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f93d0042030 con 0x7f93dc102790 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.722+0000 7f93d8ff9640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f93c40a2c10 0x7f93c40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.722+0000 7f93db7fe640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f93c40a2c10 0x7f93c40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.722+0000 7f93d8ff9640 1 -- 172.21.15.152:0/783706215 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f93d00efea0 con 0x7f93dc102790 2024-09-11T22:03:13.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.722+0000 7f93d8ff9640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713] conn(0x7f93c40ac8c0 0x7f93c40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:13.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.722+0000 7f93d8ff9640 1 -- 172.21.15.152:0/783706215 --> [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93d0040e70 con 0x7f93c40ac8c0 2024-09-11T22:03:13.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.722+0000 7f93d8ff9640 1 -- 172.21.15.152:0/783706215 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f93d00f02f0 con 0x7f93dc102790 2024-09-11T22:03:13.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.723+0000 7f93db7fe640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f93c40a2c10 0x7f93c40a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0058c0 tx=0x7f93cc00a4c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:13.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.723+0000 7f93dbfff640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713] conn(0x7f93c40ac8c0 0x7f93c40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:13.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.723+0000 7f93dbfff640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713] conn(0x7f93c40ac8c0 0x7f93c40aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:13.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.724+0000 7f93d8ff9640 1 -- 172.21.15.152:0/783706215 <== osd.5 v2:172.21.15.193:6808/2237502713 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93d0040e70 con 0x7f93c40ac8c0 2024-09-11T22:03:13.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.737+0000 7f93e212e640 1 -- 172.21.15.152:0/783706215 --> [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f93dc062dc0 con 0x7f93c40ac8c0 2024-09-11T22:03:13.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93d8ff9640 1 -- 172.21.15.152:0/783706215 <== osd.5 v2:172.21.15.193:6808/2237502713 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f93dc062dc0 con 0x7f93c40ac8c0 2024-09-11T22:03:13.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93e212e640 1 -- 172.21.15.152:0/783706215 >> [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713] conn(0x7f93c40ac8c0 msgr2=0x7f93c40aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93e212e640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713] conn(0x7f93c40ac8c0 0x7f93c40aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93e212e640 1 -- 172.21.15.152:0/783706215 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f93c40a2c10 msgr2=0x7f93c40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93e212e640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f93c40a2c10 0x7f93c40a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0058c0 tx=0x7f93cc00a4c0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93e212e640 1 -- 172.21.15.152:0/783706215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93dc102790 msgr2=0x7f93dc198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93e212e640 1 --2- 172.21.15.152:0/783706215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93dc102790 0x7f93dc198970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f93d0006010 tx=0x7f93d00042f0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93dbfff640 1 -- 172.21.15.152:0/783706215 reap_dead start 2024-09-11T22:03:13.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93e212e640 1 -- 172.21.15.152:0/783706215 shutdown_connections 2024-09-11T22:03:13.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93e212e640 1 -- 172.21.15.152:0/783706215 >> 172.21.15.152:0/783706215 conn(0x7f93dc0fd8c0 msgr2=0x7f93dc0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:13.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93e212e640 1 -- 172.21.15.152:0/783706215 shutdown_connections 2024-09-11T22:03:13.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.738+0000 7f93e212e640 1 -- 172.21.15.152:0/783706215 wait complete. 2024-09-11T22:03:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:13 smithi179 ceph-mon[35603]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T22:03:13.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:13 smithi193 ceph-mon[35545]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T22:03:13.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.927+0000 7f532609d640 1 -- 172.21.15.152:0/1419110638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5320102790 msgr2=0x7f53201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.927+0000 7f532609d640 1 --2- 172.21.15.152:0/1419110638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5320102790 0x7f53201067e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5308009900 tx=0x7f530802a410 comp rx=0 tx=0).stop 2024-09-11T22:03:13.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.927+0000 7f532609d640 1 -- 172.21.15.152:0/1419110638 shutdown_connections 2024-09-11T22:03:13.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.927+0000 7f532609d640 1 --2- 172.21.15.152:0/1419110638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5320106f10 0x7f532010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.927+0000 7f532609d640 1 --2- 172.21.15.152:0/1419110638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5320102790 0x7f53201067e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.927+0000 7f532609d640 1 --2- 172.21.15.152:0/1419110638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5320101de0 0x7f53201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.927+0000 7f532609d640 1 -- 172.21.15.152:0/1419110638 >> 172.21.15.152:0/1419110638 conn(0x7f53200fd8c0 msgr2=0x7f53200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.927+0000 7f532609d640 1 -- 172.21.15.152:0/1419110638 shutdown_connections 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.927+0000 7f532609d640 1 -- 172.21.15.152:0/1419110638 wait complete. 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.927+0000 7f532609d640 1 Processor -- start 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.927+0000 7f532609d640 1 -- start start 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f532609d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5320101de0 0x7f53200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f532609d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5320102790 0x7f5320074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f532609d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5320106f10 0x7f5320074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f532609d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5320111fb0 con 0x7f5320106f10 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f532609d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5320111e30 con 0x7f5320102790 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f532609d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5320112130 con 0x7f5320101de0 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5320106f10 0x7f5320074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:13.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5320106f10 0x7f5320074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37208/0 (socket says 172.21.15.152:37208) 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531ffff640 1 -- 172.21.15.152:0/2744300826 learned_addr learned my addr 172.21.15.152:0/2744300826 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f5316ffd640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5320102790 0x7f5320074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531f7fe640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5320101de0 0x7f53200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531ffff640 1 -- 172.21.15.152:0/2744300826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5320101de0 msgr2=0x7f53200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531ffff640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5320101de0 0x7f53200744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531ffff640 1 -- 172.21.15.152:0/2744300826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5320102790 msgr2=0x7f5320074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531ffff640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5320102790 0x7f5320074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531ffff640 1 -- 172.21.15.152:0/2744300826 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53201a6990 con 0x7f5320106f10 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531f7fe640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5320101de0 0x7f53200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531ffff640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5320106f10 0x7f5320074f70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f531800cad0 tx=0x7f531800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531d7fa640 1 -- 172.21.15.152:0/2744300826 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531800ae20 con 0x7f5320106f10 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f532609d640 1 -- 172.21.15.152:0/2744300826 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53201a6c80 con 0x7f5320106f10 2024-09-11T22:03:13.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531d7fa640 1 -- 172.21.15.152:0/2744300826 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5318005020 con 0x7f5320106f10 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f531d7fa640 1 -- 172.21.15.152:0/2744300826 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531800f6b0 con 0x7f5320106f10 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.928+0000 7f532609d640 1 -- 172.21.15.152:0/2744300826 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53201a71e0 con 0x7f5320106f10 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.929+0000 7f532609d640 1 -- 172.21.15.152:0/2744300826 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5320062880 con 0x7f5320106f10 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.931+0000 7f531d7fa640 1 -- 172.21.15.152:0/2744300826 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f53180051d0 con 0x7f5320106f10 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.931+0000 7f531d7fa640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f530c0a2c10 0x7f530c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.932+0000 7f531f7fe640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f530c0a2c10 0x7f530c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.932+0000 7f531d7fa640 1 -- 172.21.15.152:0/2744300826 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f53180cf6c0 con 0x7f5320106f10 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.932+0000 7f531d7fa640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273] conn(0x7f530c0ac8c0 0x7f530c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.932+0000 7f531d7fa640 1 -- 172.21.15.152:0/2744300826 --> [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5318012ec0 con 0x7f530c0ac8c0 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.932+0000 7f531d7fa640 1 -- 172.21.15.152:0/2744300826 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f53180cfb10 con 0x7f5320106f10 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.932+0000 7f531f7fe640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f530c0a2c10 0x7f530c0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5310009930 tx=0x7f5310008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.932+0000 7f5316ffd640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273] conn(0x7f530c0ac8c0 0x7f530c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:13.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.933+0000 7f5316ffd640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273] conn(0x7f530c0ac8c0 0x7f530c0aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:13.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.933+0000 7f531d7fa640 1 -- 172.21.15.152:0/2744300826 <== osd.1 v2:172.21.15.179:6800/1697561273 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5318012ec0 con 0x7f530c0ac8c0 2024-09-11T22:03:13.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.947+0000 7f532609d640 1 -- 172.21.15.152:0/2744300826 --> [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5320062d00 con 0x7f530c0ac8c0 2024-09-11T22:03:13.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f531d7fa640 1 -- 172.21.15.152:0/2744300826 <== osd.1 v2:172.21.15.179:6800/1697561273 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5320062d00 con 0x7f530c0ac8c0 2024-09-11T22:03:13.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f532609d640 1 -- 172.21.15.152:0/2744300826 >> [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273] conn(0x7f530c0ac8c0 msgr2=0x7f530c0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f532609d640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273] conn(0x7f530c0ac8c0 0x7f530c0aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:13.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f532609d640 1 -- 172.21.15.152:0/2744300826 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f530c0a2c10 msgr2=0x7f530c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f532609d640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f530c0a2c10 0x7f530c0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5310009930 tx=0x7f5310008040 comp rx=0 tx=0).stop 2024-09-11T22:03:13.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f532609d640 1 -- 172.21.15.152:0/2744300826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5320106f10 msgr2=0x7f5320074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:13.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f532609d640 1 --2- 172.21.15.152:0/2744300826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5320106f10 0x7f5320074f70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f531800cad0 tx=0x7f531800cf90 comp rx=0 tx=0).stop 2024-09-11T22:03:13.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f531ffff640 1 -- 172.21.15.152:0/2744300826 reap_dead start 2024-09-11T22:03:13.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f532609d640 1 -- 172.21.15.152:0/2744300826 shutdown_connections 2024-09-11T22:03:13.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f532609d640 1 -- 172.21.15.152:0/2744300826 >> 172.21.15.152:0/2744300826 conn(0x7f53200fd8c0 msgr2=0x7f53200fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:13.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f532609d640 1 -- 172.21.15.152:0/2744300826 shutdown_connections 2024-09-11T22:03:13.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:13.948+0000 7f532609d640 1 -- 172.21.15.152:0/2744300826 wait complete. 2024-09-11T22:03:14.597 INFO:teuthology.orchestra.run.smithi152.stdout:55834574916 2024-09-11T22:03:14.598 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T22:03:14.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.770+0000 7f943acaa640 1 -- 172.21.15.152:0/60235028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9434102dd0 msgr2=0x7f94341031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:14.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.770+0000 7f943acaa640 1 --2- 172.21.15.152:0/60235028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9434102dd0 0x7f94341031b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9428009900 tx=0x7f942802a480 comp rx=0 tx=0).stop 2024-09-11T22:03:14.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.770+0000 7f943acaa640 1 -- 172.21.15.152:0/60235028 shutdown_connections 2024-09-11T22:03:14.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.770+0000 7f943acaa640 1 --2- 172.21.15.152:0/60235028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f943410c1b0 0x7f943410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:14.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.770+0000 7f943acaa640 1 --2- 172.21.15.152:0/60235028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94341036f0 0x7f943410bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.770+0000 7f943acaa640 1 --2- 172.21.15.152:0/60235028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9434102dd0 0x7f94341031b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.771+0000 7f943acaa640 1 -- 172.21.15.152:0/60235028 >> 172.21.15.152:0/60235028 conn(0x7f94340fc7d0 msgr2=0x7f94340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.771+0000 7f943acaa640 1 -- 172.21.15.152:0/60235028 shutdown_connections 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.771+0000 7f943acaa640 1 -- 172.21.15.152:0/60235028 wait complete. 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.771+0000 7f943acaa640 1 Processor -- start 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.771+0000 7f943acaa640 1 -- start start 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.771+0000 7f943acaa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9434102dd0 0x7f9434198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.771+0000 7f943acaa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94341036f0 0x7f94341989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.771+0000 7f943acaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f943410c1b0 0x7f943419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.771+0000 7f943acaa640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9434111f80 con 0x7f9434102dd0 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.771+0000 7f943acaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9434111e00 con 0x7f943410c1b0 2024-09-11T22:03:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.771+0000 7f943acaa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9434112100 con 0x7f94341036f0 2024-09-11T22:03:14.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9438a46640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9434102dd0 0x7f9434198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:14.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9438a46640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9434102dd0 0x7f9434198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37224/0 (socket says 172.21.15.152:37224) 2024-09-11T22:03:14.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9438a46640 1 -- 172.21.15.152:0/1434732809 learned_addr learned my addr 172.21.15.152:0/1434732809 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:14.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9439247640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f943410c1b0 0x7f943419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:14.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9433fff640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94341036f0 0x7f94341989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:14.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9438a46640 1 -- 172.21.15.152:0/1434732809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94341036f0 msgr2=0x7f94341989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:14.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9438a46640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94341036f0 0x7f94341989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9438a46640 1 -- 172.21.15.152:0/1434732809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f943410c1b0 msgr2=0x7f943419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9438a46640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f943410c1b0 0x7f943419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9438a46640 1 -- 172.21.15.152:0/1434732809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943419d410 con 0x7f9434102dd0 2024-09-11T22:03:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9438a46640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9434102dd0 0x7f9434198460 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9428005ab0 tx=0x7f94280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.772+0000 7f9431ffb640 1 -- 172.21.15.152:0/1434732809 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942803f030 con 0x7f9434102dd0 2024-09-11T22:03:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.773+0000 7f943acaa640 1 -- 172.21.15.152:0/1434732809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f943419d6a0 con 0x7f9434102dd0 2024-09-11T22:03:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.773+0000 7f9431ffb640 1 -- 172.21.15.152:0/1434732809 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9428003ce0 con 0x7f9434102dd0 2024-09-11T22:03:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.773+0000 7f9431ffb640 1 -- 172.21.15.152:0/1434732809 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9428035070 con 0x7f9434102dd0 2024-09-11T22:03:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.773+0000 7f943acaa640 1 -- 172.21.15.152:0/1434732809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94341a4fe0 con 0x7f9434102dd0 2024-09-11T22:03:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.774+0000 7f943acaa640 1 -- 172.21.15.152:0/1434732809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9434062900 con 0x7f9434102dd0 2024-09-11T22:03:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.775+0000 7f9431ffb640 1 -- 172.21.15.152:0/1434732809 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9428042030 con 0x7f9434102dd0 2024-09-11T22:03:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.776+0000 7f9431ffb640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f94240a2c10 0x7f94240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.776+0000 7f9433fff640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f94240a2c10 0x7f94240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.776+0000 7f9431ffb640 1 -- 172.21.15.152:0/1434732809 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f94280efd70 con 0x7f9434102dd0 2024-09-11T22:03:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.776+0000 7f9431ffb640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047] conn(0x7f94240ac790 0x7f94240aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.776+0000 7f9431ffb640 1 -- 172.21.15.152:0/1434732809 --> [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9428041e80 con 0x7f94240ac790 2024-09-11T22:03:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.776+0000 7f9431ffb640 1 -- 172.21.15.152:0/1434732809 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f94280f01c0 con 0x7f9434102dd0 2024-09-11T22:03:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.776+0000 7f9433fff640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f94240a2c10 0x7f94240a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f943410d570 tx=0x7f942000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:14.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.776+0000 7f9439247640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047] conn(0x7f94240ac790 0x7f94240aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:14.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.777+0000 7f9439247640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047] conn(0x7f94240ac790 0x7f94240aec30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:14.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.778+0000 7f9431ffb640 1 -- 172.21.15.152:0/1434732809 <== osd.10 v2:172.21.15.179:6824/1793292047 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9428041e80 con 0x7f94240ac790 2024-09-11T22:03:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.796+0000 7f943acaa640 1 -- 172.21.15.152:0/1434732809 --> [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9434062d00 con 0x7f94240ac790 2024-09-11T22:03:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.796+0000 7f9431ffb640 1 -- 172.21.15.152:0/1434732809 <== osd.10 v2:172.21.15.179:6824/1793292047 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9434062d00 con 0x7f94240ac790 2024-09-11T22:03:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.797+0000 7f943acaa640 1 -- 172.21.15.152:0/1434732809 >> [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047] conn(0x7f94240ac790 msgr2=0x7f94240aec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.797+0000 7f943acaa640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047] conn(0x7f94240ac790 0x7f94240aec30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.797+0000 7f943acaa640 1 -- 172.21.15.152:0/1434732809 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f94240a2c10 msgr2=0x7f94240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.797+0000 7f943acaa640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f94240a2c10 0x7f94240a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f943410d570 tx=0x7f942000a2d0 comp rx=0 tx=0).stop 2024-09-11T22:03:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.797+0000 7f943acaa640 1 -- 172.21.15.152:0/1434732809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9434102dd0 msgr2=0x7f9434198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.797+0000 7f943acaa640 1 --2- 172.21.15.152:0/1434732809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9434102dd0 0x7f9434198460 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9428005ab0 tx=0x7f94280042f0 comp rx=0 tx=0).stop 2024-09-11T22:03:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.797+0000 7f9439247640 1 -- 172.21.15.152:0/1434732809 reap_dead start 2024-09-11T22:03:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.797+0000 7f943acaa640 1 -- 172.21.15.152:0/1434732809 shutdown_connections 2024-09-11T22:03:14.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.797+0000 7f943acaa640 1 -- 172.21.15.152:0/1434732809 >> 172.21.15.152:0/1434732809 conn(0x7f94340fc7d0 msgr2=0x7f94340fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:14.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.797+0000 7f943acaa640 1 -- 172.21.15.152:0/1434732809 shutdown_connections 2024-09-11T22:03:14.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:14.797+0000 7f943acaa640 1 -- 172.21.15.152:0/1434732809 wait complete. 2024-09-11T22:03:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:15 smithi152 ceph-mon[31188]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-11T22:03:15.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.702+0000 7f92f33e5640 1 -- 172.21.15.152:0/1326459220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92ec103660 msgr2=0x7f92ec10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.702+0000 7f92f33e5640 1 --2- 172.21.15.152:0/1326459220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92ec103660 0x7f92ec10bb50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009900 tx=0x7f92dc02a480 comp rx=0 tx=0).stop 2024-09-11T22:03:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.702+0000 7f92f33e5640 1 -- 172.21.15.152:0/1326459220 shutdown_connections 2024-09-11T22:03:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.702+0000 7f92f33e5640 1 --2- 172.21.15.152:0/1326459220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92ec10c170 0x7f92ec10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.702+0000 7f92f33e5640 1 --2- 172.21.15.152:0/1326459220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92ec103660 0x7f92ec10bb50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.702+0000 7f92f33e5640 1 --2- 172.21.15.152:0/1326459220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ec102d40 0x7f92ec103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.702+0000 7f92f33e5640 1 -- 172.21.15.152:0/1326459220 >> 172.21.15.152:0/1326459220 conn(0x7f92ec0fc7a0 msgr2=0x7f92ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.702+0000 7f92f33e5640 1 -- 172.21.15.152:0/1326459220 shutdown_connections 2024-09-11T22:03:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.702+0000 7f92f33e5640 1 -- 172.21.15.152:0/1326459220 wait complete. 2024-09-11T22:03:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f33e5640 1 Processor -- start 2024-09-11T22:03:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f33e5640 1 -- start start 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f33e5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92ec102d40 0x7f92ec198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f33e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ec103660 0x7f92ec198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f33e5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92ec10c170 0x7f92ec19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f33e5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec111f70 con 0x7f92ec10c170 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f33e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec111df0 con 0x7f92ec103660 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f33e5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec1120f0 con 0x7f92ec102d40 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f1982640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92ec10c170 0x7f92ec19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f1982640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92ec10c170 0x7f92ec19cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37272/0 (socket says 172.21.15.152:37272) 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f1982640 1 -- 172.21.15.152:0/3711276852 learned_addr learned my addr 172.21.15.152:0/3711276852 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f0980640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ec103660 0x7f92ec198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f1181640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92ec102d40 0x7f92ec198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f1982640 1 -- 172.21.15.152:0/3711276852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92ec102d40 msgr2=0x7f92ec198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f1982640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92ec102d40 0x7f92ec198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f1982640 1 -- 172.21.15.152:0/3711276852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ec103660 msgr2=0x7f92ec198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f1982640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ec103660 0x7f92ec198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f1982640 1 -- 172.21.15.152:0/3711276852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ec19d3e0 con 0x7f92ec10c170 2024-09-11T22:03:15.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.703+0000 7f92f1181640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92ec102d40 0x7f92ec198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:15.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.704+0000 7f92f1982640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92ec10c170 0x7f92ec19cd00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f92e400eaa0 tx=0x7f92e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:15.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.704+0000 7f92e27fc640 1 -- 172.21.15.152:0/3711276852 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e400cdb0 con 0x7f92ec10c170 2024-09-11T22:03:15.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.704+0000 7f92e27fc640 1 -- 172.21.15.152:0/3711276852 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e4005020 con 0x7f92ec10c170 2024-09-11T22:03:15.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.704+0000 7f92f33e5640 1 -- 172.21.15.152:0/3711276852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92ec19d6d0 con 0x7f92ec10c170 2024-09-11T22:03:15.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.704+0000 7f92e27fc640 1 -- 172.21.15.152:0/3711276852 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e40116b0 con 0x7f92ec10c170 2024-09-11T22:03:15.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.704+0000 7f92f33e5640 1 -- 172.21.15.152:0/3711276852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92ec1a4fb0 con 0x7f92ec10c170 2024-09-11T22:03:15.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.705+0000 7f92f33e5640 1 -- 172.21.15.152:0/3711276852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92ec062980 con 0x7f92ec10c170 2024-09-11T22:03:15.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.706+0000 7f92e27fc640 1 -- 172.21.15.152:0/3711276852 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f92e4005560 con 0x7f92ec10c170 2024-09-11T22:03:15.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.707+0000 7f92e27fc640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f92d80a2c10 0x7f92d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:15.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.707+0000 7f92f1181640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f92d80a2c10 0x7f92d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:15.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.707+0000 7f92e27fc640 1 -- 172.21.15.152:0/3711276852 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f92e40cf740 con 0x7f92ec10c170 2024-09-11T22:03:15.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.707+0000 7f92e27fc640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263] conn(0x7f92d80ac8c0 0x7f92d80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:15.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.707+0000 7f92e27fc640 1 -- 172.21.15.152:0/3711276852 --> [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92e4014ec0 con 0x7f92d80ac8c0 2024-09-11T22:03:15.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.707+0000 7f92e27fc640 1 -- 172.21.15.152:0/3711276852 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f92e40cfb90 con 0x7f92ec10c170 2024-09-11T22:03:15.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.707+0000 7f92f1181640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f92d80a2c10 0x7f92d80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f92e80058c0 tx=0x7f92e8005ec0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:15.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.707+0000 7f92f0980640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263] conn(0x7f92d80ac8c0 0x7f92d80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:15.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.708+0000 7f92f0980640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263] conn(0x7f92d80ac8c0 0x7f92d80aed60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:15.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.709+0000 7f92e27fc640 1 -- 172.21.15.152:0/3711276852 <== osd.2 v2:172.21.15.193:6800/885545263 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f92e4014ec0 con 0x7f92d80ac8c0 2024-09-11T22:03:15.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.722+0000 7f92f33e5640 1 -- 172.21.15.152:0/3711276852 --> [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f92ec062e00 con 0x7f92d80ac8c0 2024-09-11T22:03:15.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92e27fc640 1 -- 172.21.15.152:0/3711276852 <== osd.2 v2:172.21.15.193:6800/885545263 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f92ec062e00 con 0x7f92d80ac8c0 2024-09-11T22:03:15.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92f33e5640 1 -- 172.21.15.152:0/3711276852 >> [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263] conn(0x7f92d80ac8c0 msgr2=0x7f92d80aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92f33e5640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263] conn(0x7f92d80ac8c0 0x7f92d80aed60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92f33e5640 1 -- 172.21.15.152:0/3711276852 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f92d80a2c10 msgr2=0x7f92d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92f33e5640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f92d80a2c10 0x7f92d80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f92e80058c0 tx=0x7f92e8005ec0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92f33e5640 1 -- 172.21.15.152:0/3711276852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92ec10c170 msgr2=0x7f92ec19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92f33e5640 1 --2- 172.21.15.152:0/3711276852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92ec10c170 0x7f92ec19cd00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f92e400eaa0 tx=0x7f92e400ef60 comp rx=0 tx=0).stop 2024-09-11T22:03:15.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92f1982640 1 -- 172.21.15.152:0/3711276852 reap_dead start 2024-09-11T22:03:15.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92f33e5640 1 -- 172.21.15.152:0/3711276852 shutdown_connections 2024-09-11T22:03:15.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92f33e5640 1 -- 172.21.15.152:0/3711276852 >> 172.21.15.152:0/3711276852 conn(0x7f92ec0fc7a0 msgr2=0x7f92ec0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:15.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92f33e5640 1 -- 172.21.15.152:0/3711276852 shutdown_connections 2024-09-11T22:03:15.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.723+0000 7f92f33e5640 1 -- 172.21.15.152:0/3711276852 wait complete. 2024-09-11T22:03:15.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:15 smithi179 ceph-mon[35603]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-11T22:03:15.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:15 smithi193 ceph-mon[35545]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-11T22:03:15.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.607+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1691000901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb01082a0 msgr2=0x7f5eb010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.607+0000 7f5eb83a3640 1 --2- 172.21.15.152:0/1691000901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb01082a0 0x7f5eb010ec40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009cd0 tx=0x7f5ea802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.607+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1691000901 shutdown_connections 2024-09-11T22:03:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.607+0000 7f5eb83a3640 1 --2- 172.21.15.152:0/1691000901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb01082a0 0x7f5eb010ec40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.607+0000 7f5eb83a3640 1 --2- 172.21.15.152:0/1691000901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eb01036e0 0x7f5eb0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.607+0000 7f5eb83a3640 1 --2- 172.21.15.152:0/1691000901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5eb0102d30 0x7f5eb0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.607+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1691000901 >> 172.21.15.152:0/1691000901 conn(0x7f5eb00fc7d0 msgr2=0x7f5eb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.607+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1691000901 shutdown_connections 2024-09-11T22:03:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.607+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1691000901 wait complete. 2024-09-11T22:03:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb83a3640 1 Processor -- start 2024-09-11T22:03:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb83a3640 1 -- start start 2024-09-11T22:03:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb83a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5eb0102d30 0x7f5eb0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb83a3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb01036e0 0x7f5eb0198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb83a3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eb01082a0 0x7f5eb019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb83a3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb01120a0 con 0x7f5eb01036e0 2024-09-11T22:03:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb83a3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb0111f20 con 0x7f5eb01082a0 2024-09-11T22:03:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb83a3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb0112220 con 0x7f5eb0102d30 2024-09-11T22:03:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb593e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb01036e0 0x7f5eb0198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb613f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5eb0102d30 0x7f5eb0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb593e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb01036e0 0x7f5eb0198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37250/0 (socket says 172.21.15.152:37250) 2024-09-11T22:03:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.608+0000 7f5eb593e640 1 -- 172.21.15.152:0/1909021382 learned_addr learned my addr 172.21.15.152:0/1909021382 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5eb593e640 1 -- 172.21.15.152:0/1909021382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5eb0102d30 msgr2=0x7f5eb0198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5eb6940640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eb01082a0 0x7f5eb019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5eb593e640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5eb0102d30 0x7f5eb0198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5eb593e640 1 -- 172.21.15.152:0/1909021382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eb01082a0 msgr2=0x7f5eb019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5eb593e640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eb01082a0 0x7f5eb019ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5eb593e640 1 -- 172.21.15.152:0/1909021382 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb019d4e0 con 0x7f5eb01036e0 2024-09-11T22:03:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5eb593e640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb01036e0 0x7f5eb0198a70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000d740 tx=0x7f5ea000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5ea77fe640 1 -- 172.21.15.152:0/1909021382 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0017070 con 0x7f5eb01036e0 2024-09-11T22:03:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5ea77fe640 1 -- 172.21.15.152:0/1909021382 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea000de50 con 0x7f5eb01036e0 2024-09-11T22:03:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1909021382 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb019d7d0 con 0x7f5eb01036e0 2024-09-11T22:03:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5ea77fe640 1 -- 172.21.15.152:0/1909021382 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000f6b0 con 0x7f5eb01036e0 2024-09-11T22:03:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.609+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1909021382 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb01008c0 con 0x7f5eb01036e0 2024-09-11T22:03:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.610+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1909021382 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5eb0062980 con 0x7f5eb01036e0 2024-09-11T22:03:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.611+0000 7f5ea77fe640 1 -- 172.21.15.152:0/1909021382 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5ea001a070 con 0x7f5eb01036e0 2024-09-11T22:03:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.612+0000 7f5ea77fe640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5e9c0a2c10 0x7f5e9c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.612+0000 7f5eb613f640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5e9c0a2c10 0x7f5e9c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.612+0000 7f5ea77fe640 1 -- 172.21.15.152:0/1909021382 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f5ea00cef50 con 0x7f5eb01036e0 2024-09-11T22:03:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.612+0000 7f5ea77fe640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450] conn(0x7f5e9c0ac8c0 0x7f5e9c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.612+0000 7f5ea77fe640 1 -- 172.21.15.152:0/1909021382 --> [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ea0016ec0 con 0x7f5e9c0ac8c0 2024-09-11T22:03:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.612+0000 7f5ea77fe640 1 -- 172.21.15.152:0/1909021382 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f5ea00cf3a0 con 0x7f5eb01036e0 2024-09-11T22:03:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.612+0000 7f5eb6940640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450] conn(0x7f5e9c0ac8c0 0x7f5e9c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.612+0000 7f5eb613f640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5e9c0a2c10 0x7f5e9c0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0092a0 tx=0x7f5eac00f7a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.612+0000 7f5eb6940640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450] conn(0x7f5e9c0ac8c0 0x7f5e9c0aed60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.613+0000 7f5ea77fe640 1 -- 172.21.15.152:0/1909021382 <== osd.3 v2:172.21.15.152:6810/1387225450 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ea0016ec0 con 0x7f5e9c0ac8c0 2024-09-11T22:03:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.641+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1909021382 --> [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5eb0062e00 con 0x7f5e9c0ac8c0 2024-09-11T22:03:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.641+0000 7f5ea77fe640 1 -- 172.21.15.152:0/1909021382 <== osd.3 v2:172.21.15.152:6810/1387225450 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5eb0062e00 con 0x7f5e9c0ac8c0 2024-09-11T22:03:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.642+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450] conn(0x7f5e9c0ac8c0 msgr2=0x7f5e9c0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.642+0000 7f5eb83a3640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450] conn(0x7f5e9c0ac8c0 0x7f5e9c0aed60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.642+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5e9c0a2c10 msgr2=0x7f5e9c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.642+0000 7f5eb83a3640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5e9c0a2c10 0x7f5e9c0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0092a0 tx=0x7f5eac00f7a0 comp rx=0 tx=0).stop 2024-09-11T22:03:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.642+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb01036e0 msgr2=0x7f5eb0198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.642+0000 7f5eb83a3640 1 --2- 172.21.15.152:0/1909021382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb01036e0 0x7f5eb0198a70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000d740 tx=0x7f5ea000dc00 comp rx=0 tx=0).stop 2024-09-11T22:03:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.642+0000 7f5eb6940640 1 -- 172.21.15.152:0/1909021382 reap_dead start 2024-09-11T22:03:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.642+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1909021382 shutdown_connections 2024-09-11T22:03:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.642+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1909021382 >> 172.21.15.152:0/1909021382 conn(0x7f5eb00fc7d0 msgr2=0x7f5eb0105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.642+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1909021382 shutdown_connections 2024-09-11T22:03:15.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:15.642+0000 7f5eb83a3640 1 -- 172.21.15.152:0/1909021382 wait complete. 2024-09-11T22:03:16.519 INFO:teuthology.orchestra.run.smithi152.stdout:107374182460 2024-09-11T22:03:16.519 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T22:03:17.139 INFO:teuthology.orchestra.run.smithi152.stdout:296352743448 2024-09-11T22:03:17.140 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-11T22:03:17.380 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:17 smithi152 ceph-mon[31188]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T22:03:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:17 smithi179 ceph-mon[35603]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T22:03:17.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:17 smithi193 ceph-mon[35545]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T22:03:18.048 INFO:teuthology.orchestra.run.smithi152.stdout:158913790002 2024-09-11T22:03:18.049 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T22:03:18.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.231+0000 7f5357d90640 1 -- 172.21.15.152:0/4066714951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5350106a90 msgr2=0x7f5350106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:18.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.231+0000 7f5357d90640 1 --2- 172.21.15.152:0/4066714951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5350106a90 0x7f5350106e70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f534c009930 tx=0x7f534c02a420 comp rx=0 tx=0).stop 2024-09-11T22:03:18.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.231+0000 7f5357d90640 1 -- 172.21.15.152:0/4066714951 shutdown_connections 2024-09-11T22:03:18.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.231+0000 7f5357d90640 1 --2- 172.21.15.152:0/4066714951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5350101430 0x7f535010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:18.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.231+0000 7f5357d90640 1 --2- 172.21.15.152:0/4066714951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5350100a90 0x7f5350100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:18.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.231+0000 7f5357d90640 1 --2- 172.21.15.152:0/4066714951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5350106a90 0x7f5350106e70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:18.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.231+0000 7f5357d90640 1 -- 172.21.15.152:0/4066714951 >> 172.21.15.152:0/4066714951 conn(0x7f53500fc7d0 msgr2=0x7f53500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:18.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.231+0000 7f5357d90640 1 -- 172.21.15.152:0/4066714951 shutdown_connections 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.231+0000 7f5357d90640 1 -- 172.21.15.152:0/4066714951 wait complete. 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.232+0000 7f5357d90640 1 Processor -- start 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.232+0000 7f5357d90640 1 -- start start 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.232+0000 7f5357d90640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5350100a90 0x7f5350199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.232+0000 7f5357d90640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5350101430 0x7f5350199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.232+0000 7f5357d90640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5350106a90 0x7f53501a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f5355b2c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5350100a90 0x7f5350199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f5357d90640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5350110eb0 con 0x7f5350100a90 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f5357d90640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5350110d30 con 0x7f5350101430 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f5355b2c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5350100a90 0x7f5350199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37284/0 (socket says 172.21.15.152:37284) 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f5355b2c640 1 -- 172.21.15.152:0/3347707535 learned_addr learned my addr 172.21.15.152:0/3347707535 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:18.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f535532b640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5350101430 0x7f5350199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:18.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5350111030 con 0x7f5350106a90 2024-09-11T22:03:18.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f535632d640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5350106a90 0x7f53501a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:18.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f535532b640 1 -- 172.21.15.152:0/3347707535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5350106a90 msgr2=0x7f53501a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:18.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f535532b640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5350106a90 0x7f53501a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:18.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f535532b640 1 -- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5350100a90 msgr2=0x7f5350199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:18.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f535532b640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5350100a90 0x7f5350199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:18.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f535532b640 1 -- 172.21.15.152:0/3347707535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53501a48c0 con 0x7f5350101430 2024-09-11T22:03:18.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f535632d640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5350106a90 0x7f53501a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:18.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.233+0000 7f535532b640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5350101430 0x7f5350199840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f534000b3f0 tx=0x7f534000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:18.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.234+0000 7f5346ffd640 1 -- 172.21.15.152:0/3347707535 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5340015020 con 0x7f5350101430 2024-09-11T22:03:18.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.234+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53501a4a90 con 0x7f5350101430 2024-09-11T22:03:18.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.234+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53501a5020 con 0x7f5350101430 2024-09-11T22:03:18.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.234+0000 7f5346ffd640 1 -- 172.21.15.152:0/3347707535 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5340011d10 con 0x7f5350101430 2024-09-11T22:03:18.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.234+0000 7f5346ffd640 1 -- 172.21.15.152:0/3347707535 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534000f2e0 con 0x7f5350101430 2024-09-11T22:03:18.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.235+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5350062900 con 0x7f5350101430 2024-09-11T22:03:18.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.236+0000 7f5346ffd640 1 -- 172.21.15.152:0/3347707535 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5340018020 con 0x7f5350101430 2024-09-11T22:03:18.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.237+0000 7f5346ffd640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f533c0a2c90 0x7f533c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:18.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.237+0000 7f5355b2c640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f533c0a2c90 0x7f533c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:18.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.237+0000 7f5346ffd640 1 -- 172.21.15.152:0/3347707535 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f53400cefa0 con 0x7f5350101430 2024-09-11T22:03:18.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.237+0000 7f5346ffd640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293] conn(0x7f533c0ac940 0x7f533c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:18.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.237+0000 7f5346ffd640 1 -- 172.21.15.152:0/3347707535 --> [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5340021e70 con 0x7f533c0ac940 2024-09-11T22:03:18.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.237+0000 7f5346ffd640 1 -- 172.21.15.152:0/3347707535 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f53400cf350 con 0x7f5350101430 2024-09-11T22:03:18.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.238+0000 7f535632d640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293] conn(0x7f533c0ac940 0x7f533c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:18.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.238+0000 7f5355b2c640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f533c0a2c90 0x7f533c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f534c000c00 tx=0x7f534c009560 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:18.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.239+0000 7f535632d640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293] conn(0x7f533c0ac940 0x7f533c0aede0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.240+0000 7f5346ffd640 1 -- 172.21.15.152:0/3347707535 <== osd.0 v2:172.21.15.152:6802/1398794293 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5340021e70 con 0x7f533c0ac940 2024-09-11T22:03:18.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.261+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 --> [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5350062b80 con 0x7f533c0ac940 2024-09-11T22:03:18.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.262+0000 7f5346ffd640 1 -- 172.21.15.152:0/3347707535 <== osd.0 v2:172.21.15.152:6802/1398794293 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5350062b80 con 0x7f533c0ac940 2024-09-11T22:03:18.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.262+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293] conn(0x7f533c0ac940 msgr2=0x7f533c0aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:18.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.262+0000 7f5357d90640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293] conn(0x7f533c0ac940 0x7f533c0aede0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:18.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.262+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f533c0a2c90 msgr2=0x7f533c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:18.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.262+0000 7f5357d90640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f533c0a2c90 0x7f533c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f534c000c00 tx=0x7f534c009560 comp rx=0 tx=0).stop 2024-09-11T22:03:18.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.262+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5350101430 msgr2=0x7f5350199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:18.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.262+0000 7f5357d90640 1 --2- 172.21.15.152:0/3347707535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5350101430 0x7f5350199840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f534000b3f0 tx=0x7f534000b8b0 comp rx=0 tx=0).stop 2024-09-11T22:03:18.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.262+0000 7f535632d640 1 -- 172.21.15.152:0/3347707535 reap_dead start 2024-09-11T22:03:18.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.263+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 shutdown_connections 2024-09-11T22:03:18.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.263+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 >> 172.21.15.152:0/3347707535 conn(0x7f53500fc7d0 msgr2=0x7f53500fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:18.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.263+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 shutdown_connections 2024-09-11T22:03:18.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:18.263+0000 7f5357d90640 1 -- 172.21.15.152:0/3347707535 wait complete. 2024-09-11T22:03:18.273 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:19.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.270+0000 7fd18086d640 1 -- 172.21.15.152:0/1917764762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd17c106f10 msgr2=0x7fd17c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:19.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.270+0000 7fd18086d640 1 --2- 172.21.15.152:0/1917764762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd17c106f10 0x7fd17c10ea90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd16c009900 tx=0x7fd16c02a410 comp rx=0 tx=0).stop 2024-09-11T22:03:19.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.270+0000 7fd18086d640 1 -- 172.21.15.152:0/1917764762 shutdown_connections 2024-09-11T22:03:19.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.270+0000 7fd18086d640 1 --2- 172.21.15.152:0/1917764762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd17c106f10 0x7fd17c10ea90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:19.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.270+0000 7fd18086d640 1 --2- 172.21.15.152:0/1917764762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd17c102790 0x7fd17c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:19.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.270+0000 7fd18086d640 1 --2- 172.21.15.152:0/1917764762 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd17c101de0 0x7fd17c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:19.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.270+0000 7fd18086d640 1 -- 172.21.15.152:0/1917764762 >> 172.21.15.152:0/1917764762 conn(0x7fd17c0fd8c0 msgr2=0x7fd17c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:19.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.270+0000 7fd18086d640 1 -- 172.21.15.152:0/1917764762 shutdown_connections 2024-09-11T22:03:19.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.271+0000 7fd18086d640 1 -- 172.21.15.152:0/1917764762 wait complete. 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.271+0000 7fd18086d640 1 Processor -- start 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.271+0000 7fd18086d640 1 -- start start 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd18086d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd17c101de0 0x7fd17c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd18086d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd17c102790 0x7fd17c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd18086d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd17c106f10 0x7fd17c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd18086d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c111f70 con 0x7fd17c106f10 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd18086d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c111df0 con 0x7fd17c101de0 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd18086d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c1120f0 con 0x7fd17c102790 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd17ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd17c106f10 0x7fd17c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd17ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd17c106f10 0x7fd17c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37292/0 (socket says 172.21.15.152:37292) 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd17ad9d640 1 -- 172.21.15.152:0/1133389346 learned_addr learned my addr 172.21.15.152:0/1133389346 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:19.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd17a59c640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd17c101de0 0x7fd17c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd179d9b640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd17c102790 0x7fd17c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd17ad9d640 1 -- 172.21.15.152:0/1133389346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd17c102790 msgr2=0x7fd17c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd17ad9d640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd17c102790 0x7fd17c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd17ad9d640 1 -- 172.21.15.152:0/1133389346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd17c101de0 msgr2=0x7fd17c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd17ad9d640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd17c101de0 0x7fd17c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd17ad9d640 1 -- 172.21.15.152:0/1133389346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c19d380 con 0x7fd17c106f10 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd17ad9d640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd17c106f10 0x7fd17c19cca0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd16c005ab0 tx=0x7fd16c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd1737fe640 1 -- 172.21.15.152:0/1133389346 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c03f030 con 0x7fd17c106f10 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd1737fe640 1 -- 172.21.15.152:0/1133389346 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd16c003ad0 con 0x7fd17c106f10 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd18086d640 1 -- 172.21.15.152:0/1133389346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17c19d610 con 0x7fd17c106f10 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd1737fe640 1 -- 172.21.15.152:0/1133389346 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c035070 con 0x7fd17c106f10 2024-09-11T22:03:19.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.272+0000 7fd18086d640 1 -- 172.21.15.152:0/1133389346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17c1a4f50 con 0x7fd17c106f10 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.273+0000 7fd18086d640 1 -- 172.21.15.152:0/1133389346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd17c062980 con 0x7fd17c106f10 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.275+0000 7fd1737fe640 1 -- 172.21.15.152:0/1133389346 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd16c042030 con 0x7fd17c106f10 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.275+0000 7fd1737fe640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1680a2c10 0x7fd1680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.275+0000 7fd17a59c640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1680a2c10 0x7fd1680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.275+0000 7fd1737fe640 1 -- 172.21.15.152:0/1133389346 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fd16c0efdc0 con 0x7fd17c106f10 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.275+0000 7fd1737fe640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713] conn(0x7fd1680ac8c0 0x7fd1680aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.275+0000 7fd1737fe640 1 -- 172.21.15.152:0/1133389346 --> [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd16c001d30 con 0x7fd1680ac8c0 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.275+0000 7fd1737fe640 1 -- 172.21.15.152:0/1133389346 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fd16c0f0210 con 0x7fd17c106f10 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.276+0000 7fd17a59c640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1680a2c10 0x7fd1680a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd174009bd0 tx=0x7fd174005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.276+0000 7fd179d9b640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713] conn(0x7fd1680ac8c0 0x7fd1680aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.276+0000 7fd179d9b640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713] conn(0x7fd1680ac8c0 0x7fd1680aed60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:19.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.277+0000 7fd1737fe640 1 -- 172.21.15.152:0/1133389346 <== osd.8 v2:172.21.15.193:6816/207210713 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd16c001d30 con 0x7fd1680ac8c0 2024-09-11T22:03:19.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.290+0000 7fd18086d640 1 -- 172.21.15.152:0/1133389346 --> [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd17c062e00 con 0x7fd1680ac8c0 2024-09-11T22:03:19.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.291+0000 7fd1737fe640 1 -- 172.21.15.152:0/1133389346 <== osd.8 v2:172.21.15.193:6816/207210713 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd17c062e00 con 0x7fd1680ac8c0 2024-09-11T22:03:19.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.291+0000 7fd18086d640 1 -- 172.21.15.152:0/1133389346 >> [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713] conn(0x7fd1680ac8c0 msgr2=0x7fd1680aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:19.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.291+0000 7fd18086d640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713] conn(0x7fd1680ac8c0 0x7fd1680aed60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:19.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.291+0000 7fd18086d640 1 -- 172.21.15.152:0/1133389346 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1680a2c10 msgr2=0x7fd1680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:19.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.291+0000 7fd18086d640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1680a2c10 0x7fd1680a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd174009bd0 tx=0x7fd174005f90 comp rx=0 tx=0).stop 2024-09-11T22:03:19.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.291+0000 7fd18086d640 1 -- 172.21.15.152:0/1133389346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd17c106f10 msgr2=0x7fd17c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:19.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.291+0000 7fd18086d640 1 --2- 172.21.15.152:0/1133389346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd17c106f10 0x7fd17c19cca0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd16c005ab0 tx=0x7fd16c004270 comp rx=0 tx=0).stop 2024-09-11T22:03:19.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.292+0000 7fd17ad9d640 1 -- 172.21.15.152:0/1133389346 reap_dead start 2024-09-11T22:03:19.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.292+0000 7fd18086d640 1 -- 172.21.15.152:0/1133389346 shutdown_connections 2024-09-11T22:03:19.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.292+0000 7fd18086d640 1 -- 172.21.15.152:0/1133389346 >> 172.21.15.152:0/1133389346 conn(0x7fd17c0fd8c0 msgr2=0x7fd17c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:19.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.292+0000 7fd18086d640 1 -- 172.21.15.152:0/1133389346 shutdown_connections 2024-09-11T22:03:19.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:19.292+0000 7fd18086d640 1 -- 172.21.15.152:0/1133389346 wait complete. 2024-09-11T22:03:19.593 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:19 smithi152 ceph-mon[31188]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T22:03:19.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:19 smithi179 ceph-mon[35603]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T22:03:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:19 smithi193 ceph-mon[35545]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T22:03:19.998 INFO:teuthology.orchestra.run.smithi152.stdout:244813135908 2024-09-11T22:03:19.998 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-11T22:03:20.487 INFO:teuthology.orchestra.run.smithi152.stdout:274877906974 2024-09-11T22:03:20.487 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-11T22:03:21.094 INFO:teuthology.orchestra.run.smithi152.stdout:34359738442 2024-09-11T22:03:21.094 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T22:03:21.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.520+0000 7fb60fdfc640 1 -- 172.21.15.152:0/3166827211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb608102570 msgr2=0x7fb6081029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:21.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.520+0000 7fb60fdfc640 1 --2- 172.21.15.152:0/3166827211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb608102570 0x7fb6081029b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb604009900 tx=0x7fb60402a480 comp rx=0 tx=0).stop 2024-09-11T22:03:21.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.520+0000 7fb60fdfc640 1 -- 172.21.15.152:0/3166827211 shutdown_connections 2024-09-11T22:03:21.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.520+0000 7fb60fdfc640 1 --2- 172.21.15.152:0/3166827211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb608102ef0 0x7fb60810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:21.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.520+0000 7fb60fdfc640 1 --2- 172.21.15.152:0/3166827211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb608102570 0x7fb6081029b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:21.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.520+0000 7fb60fdfc640 1 --2- 172.21.15.152:0/3166827211 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb608100e20 0x7fb608101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:21.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.520+0000 7fb60fdfc640 1 -- 172.21.15.152:0/3166827211 >> 172.21.15.152:0/3166827211 conn(0x7fb6080fc7d0 msgr2=0x7fb6080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:21.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.521+0000 7fb60fdfc640 1 -- 172.21.15.152:0/3166827211 shutdown_connections 2024-09-11T22:03:21.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.521+0000 7fb60fdfc640 1 -- 172.21.15.152:0/3166827211 wait complete. 2024-09-11T22:03:21.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.521+0000 7fb60fdfc640 1 Processor -- start 2024-09-11T22:03:21.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.521+0000 7fb60fdfc640 1 -- start start 2024-09-11T22:03:21.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.521+0000 7fb60fdfc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb608100e20 0x7fb6081993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:21.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.521+0000 7fb60fdfc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb608102570 0x7fb608199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:21.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.521+0000 7fb60fdfc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb608102ef0 0x7fb6081a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:21.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.521+0000 7fb60fdfc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb608110f80 con 0x7fb608100e20 2024-09-11T22:03:21.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.521+0000 7fb60fdfc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb608110e00 con 0x7fb608102570 2024-09-11T22:03:21.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.521+0000 7fb60fdfc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb608111100 con 0x7fb608102ef0 2024-09-11T22:03:21.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60db98640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb608100e20 0x7fb6081993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:21.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60db98640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb608100e20 0x7fb6081993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37312/0 (socket says 172.21.15.152:37312) 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60db98640 1 -- 172.21.15.152:0/1700796165 learned_addr learned my addr 172.21.15.152:0/1700796165 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60e399640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb608102ef0 0x7fb6081a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60d397640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb608102570 0x7fb608199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60db98640 1 -- 172.21.15.152:0/1700796165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb608102ef0 msgr2=0x7fb6081a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60db98640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb608102ef0 0x7fb6081a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60db98640 1 -- 172.21.15.152:0/1700796165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb608102570 msgr2=0x7fb608199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60db98640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb608102570 0x7fb608199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60db98640 1 -- 172.21.15.152:0/1700796165 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6081a49a0 con 0x7fb608100e20 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60db98640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb608100e20 0x7fb6081993e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00d770 tx=0x7fb5fc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb5faffd640 1 -- 172.21.15.152:0/1700796165 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc017070 con 0x7fb608100e20 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb5faffd640 1 -- 172.21.15.152:0/1700796165 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5fc005500 con 0x7fb608100e20 2024-09-11T22:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60fdfc640 1 -- 172.21.15.152:0/1700796165 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6081a4b70 con 0x7fb608100e20 2024-09-11T22:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb5faffd640 1 -- 172.21.15.152:0/1700796165 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc004e00 con 0x7fb608100e20 2024-09-11T22:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.522+0000 7fb60fdfc640 1 -- 172.21.15.152:0/1700796165 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6081a5030 con 0x7fb608100e20 2024-09-11T22:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.523+0000 7fb60fdfc640 1 -- 172.21.15.152:0/1700796165 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb6080628c0 con 0x7fb608100e20 2024-09-11T22:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.524+0000 7fb5faffd640 1 -- 172.21.15.152:0/1700796165 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb5fc004fa0 con 0x7fb608100e20 2024-09-11T22:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.525+0000 7fb5faffd640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb5f40a2c10 0x7fb5f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.525+0000 7fb60d397640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb5f40a2c10 0x7fb5f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.525+0000 7fb5faffd640 1 -- 172.21.15.152:0/1700796165 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fb5fc0cefd0 con 0x7fb608100e20 2024-09-11T22:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.525+0000 7fb5faffd640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290] conn(0x7fb5f40ac8c0 0x7fb5f40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.525+0000 7fb5faffd640 1 -- 172.21.15.152:0/1700796165 --> [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5fc00fec0 con 0x7fb5f40ac8c0 2024-09-11T22:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.525+0000 7fb5faffd640 1 -- 172.21.15.152:0/1700796165 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fb5fc0cf4b0 con 0x7fb608100e20 2024-09-11T22:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.525+0000 7fb60e399640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290] conn(0x7fb5f40ac8c0 0x7fb5f40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.526+0000 7fb60d397640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb5f40a2c10 0x7fb5f40a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb60806aac0 tx=0x7fb604005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:21.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.526+0000 7fb60e399640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290] conn(0x7fb5f40ac8c0 0x7fb5f40aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:21.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.526+0000 7fb5faffd640 1 -- 172.21.15.152:0/1700796165 <== osd.6 v2:172.21.15.152:6818/3410412290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5fc00fec0 con 0x7fb5f40ac8c0 2024-09-11T22:03:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60fdfc640 1 -- 172.21.15.152:0/1700796165 --> [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb608062d40 con 0x7fb5f40ac8c0 2024-09-11T22:03:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb5faffd640 1 -- 172.21.15.152:0/1700796165 <== osd.6 v2:172.21.15.152:6818/3410412290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb608062d40 con 0x7fb5f40ac8c0 2024-09-11T22:03:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60fdfc640 1 -- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290] conn(0x7fb5f40ac8c0 msgr2=0x7fb5f40aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60fdfc640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290] conn(0x7fb5f40ac8c0 0x7fb5f40aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60fdfc640 1 -- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb5f40a2c10 msgr2=0x7fb5f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60fdfc640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb5f40a2c10 0x7fb5f40a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb60806aac0 tx=0x7fb604005a20 comp rx=0 tx=0).stop 2024-09-11T22:03:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60fdfc640 1 -- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb608100e20 msgr2=0x7fb6081993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60fdfc640 1 --2- 172.21.15.152:0/1700796165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb608100e20 0x7fb6081993e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00d770 tx=0x7fb5fc00dc30 comp rx=0 tx=0).stop 2024-09-11T22:03:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60e399640 1 -- 172.21.15.152:0/1700796165 reap_dead start 2024-09-11T22:03:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60fdfc640 1 -- 172.21.15.152:0/1700796165 shutdown_connections 2024-09-11T22:03:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60fdfc640 1 -- 172.21.15.152:0/1700796165 >> 172.21.15.152:0/1700796165 conn(0x7fb6080fc7d0 msgr2=0x7fb6080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60fdfc640 1 -- 172.21.15.152:0/1700796165 shutdown_connections 2024-09-11T22:03:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:21.540+0000 7fb60fdfc640 1 -- 172.21.15.152:0/1700796165 wait complete. 2024-09-11T22:03:21.710 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:21 smithi152 ceph-mon[31188]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T22:03:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:21 smithi179 ceph-mon[35603]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T22:03:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:21 smithi193 ceph-mon[35545]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T22:03:21.958 INFO:teuthology.orchestra.run.smithi152.stdout:77309411392 2024-09-11T22:03:21.959 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T22:03:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.222+0000 7fb58b748640 1 -- 172.21.15.152:0/2784021451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584105560 msgr2=0x7fb58410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.222+0000 7fb58b748640 1 --2- 172.21.15.152:0/2784021451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584105560 0x7fb58410d0e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009ca0 tx=0x7fb57c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.222+0000 7fb58b748640 1 -- 172.21.15.152:0/2784021451 shutdown_connections 2024-09-11T22:03:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.222+0000 7fb58b748640 1 --2- 172.21.15.152:0/2784021451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584105560 0x7fb58410d0e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.222+0000 7fb58b748640 1 --2- 172.21.15.152:0/2784021451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb584100de0 0x7fb584104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.222+0000 7fb58b748640 1 --2- 172.21.15.152:0/2784021451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb584100430 0x7fb584100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.222+0000 7fb58b748640 1 -- 172.21.15.152:0/2784021451 >> 172.21.15.152:0/2784021451 conn(0x7fb584077230 msgr2=0x7fb5840fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.222+0000 7fb58b748640 1 -- 172.21.15.152:0/2784021451 shutdown_connections 2024-09-11T22:03:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.222+0000 7fb58b748640 1 -- 172.21.15.152:0/2784021451 wait complete. 2024-09-11T22:03:22.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.223+0000 7fb58b748640 1 Processor -- start 2024-09-11T22:03:22.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.223+0000 7fb58b748640 1 -- start start 2024-09-11T22:03:22.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.223+0000 7fb58b748640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb584100430 0x7fb5840fc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:22.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.223+0000 7fb58b748640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb584100de0 0x7fb5840fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:22.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.223+0000 7fb58b748640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584105560 0x7fb5840fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:22.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.223+0000 7fb58b748640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb584110660 con 0x7fb584105560 2024-09-11T22:03:22.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.223+0000 7fb58b748640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb5841104e0 con 0x7fb584100de0 2024-09-11T22:03:22.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.223+0000 7fb58b748640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb5841107e0 con 0x7fb584100430 2024-09-11T22:03:22.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.223+0000 7fb589ce5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584105560 0x7fb5840fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:22.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.223+0000 7fb589ce5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584105560 0x7fb5840fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37328/0 (socket says 172.21.15.152:37328) 2024-09-11T22:03:22.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.223+0000 7fb589ce5640 1 -- 172.21.15.152:0/363097326 learned_addr learned my addr 172.21.15.152:0/363097326 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:22.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb5894e4640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb584100430 0x7fb5840fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:22.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb588ce3640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb584100de0 0x7fb5840fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:22.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb589ce5640 1 -- 172.21.15.152:0/363097326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb584100430 msgr2=0x7fb5840fc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:22.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb589ce5640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb584100430 0x7fb5840fc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb589ce5640 1 -- 172.21.15.152:0/363097326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb584100de0 msgr2=0x7fb5840fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:22.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb589ce5640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb584100de0 0x7fb5840fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb589ce5640 1 -- 172.21.15.152:0/363097326 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5841a69f0 con 0x7fb584105560 2024-09-11T22:03:22.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb589ce5640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584105560 0x7fb5840fd180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb57c031a60 tx=0x7fb57c031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:22.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb57a7fc640 1 -- 172.21.15.152:0/363097326 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c003b70 con 0x7fb584105560 2024-09-11T22:03:22.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb58b748640 1 -- 172.21.15.152:0/363097326 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5841a6c80 con 0x7fb584105560 2024-09-11T22:03:22.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb57a7fc640 1 -- 172.21.15.152:0/363097326 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb57c003d10 con 0x7fb584105560 2024-09-11T22:03:22.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb57a7fc640 1 -- 172.21.15.152:0/363097326 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c004770 con 0x7fb584105560 2024-09-11T22:03:22.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.224+0000 7fb58b748640 1 -- 172.21.15.152:0/363097326 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5841a7210 con 0x7fb584105560 2024-09-11T22:03:22.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.225+0000 7fb58b748640 1 -- 172.21.15.152:0/363097326 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5840628c0 con 0x7fb584105560 2024-09-11T22:03:22.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.227+0000 7fb57a7fc640 1 -- 172.21.15.152:0/363097326 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb57c02f790 con 0x7fb584105560 2024-09-11T22:03:22.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.228+0000 7fb57a7fc640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb5700a2c90 0x7fb5700a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:22.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.228+0000 7fb5894e4640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb5700a2c90 0x7fb5700a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:22.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.228+0000 7fb57a7fc640 1 -- 172.21.15.152:0/363097326 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fb57c0f0570 con 0x7fb584105560 2024-09-11T22:03:22.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.228+0000 7fb57a7fc640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791] conn(0x7fb5700ac810 0x7fb5700aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:22.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.228+0000 7fb57a7fc640 1 -- 172.21.15.152:0/363097326 --> [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5700af380 con 0x7fb5700ac810 2024-09-11T22:03:22.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.228+0000 7fb57a7fc640 1 -- 172.21.15.152:0/363097326 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fb57c0f09c0 con 0x7fb584105560 2024-09-11T22:03:22.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.228+0000 7fb5894e4640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb5700a2c90 0x7fb5700a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb580009990 tx=0x7fb580009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:22.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.228+0000 7fb588ce3640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791] conn(0x7fb5700ac810 0x7fb5700aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:22.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.229+0000 7fb588ce3640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791] conn(0x7fb5700ac810 0x7fb5700aecb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:22.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.230+0000 7fb57a7fc640 1 -- 172.21.15.152:0/363097326 <== osd.11 v2:172.21.15.193:6824/4019851791 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5700af380 con 0x7fb5700ac810 2024-09-11T22:03:22.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.244+0000 7fb58b748640 1 -- 172.21.15.152:0/363097326 --> [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb584062cc0 con 0x7fb5700ac810 2024-09-11T22:03:22.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.244+0000 7fb57a7fc640 1 -- 172.21.15.152:0/363097326 <== osd.11 v2:172.21.15.193:6824/4019851791 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb584062cc0 con 0x7fb5700ac810 2024-09-11T22:03:22.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.245+0000 7fb58b748640 1 -- 172.21.15.152:0/363097326 >> [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791] conn(0x7fb5700ac810 msgr2=0x7fb5700aecb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:22.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.245+0000 7fb58b748640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791] conn(0x7fb5700ac810 0x7fb5700aecb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.245+0000 7fb58b748640 1 -- 172.21.15.152:0/363097326 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb5700a2c90 msgr2=0x7fb5700a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:22.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.245+0000 7fb58b748640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb5700a2c90 0x7fb5700a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb580009990 tx=0x7fb580009110 comp rx=0 tx=0).stop 2024-09-11T22:03:22.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.245+0000 7fb58b748640 1 -- 172.21.15.152:0/363097326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584105560 msgr2=0x7fb5840fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:22.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.245+0000 7fb58b748640 1 --2- 172.21.15.152:0/363097326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584105560 0x7fb5840fd180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb57c031a60 tx=0x7fb57c031a90 comp rx=0 tx=0).stop 2024-09-11T22:03:22.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.245+0000 7fb589ce5640 1 -- 172.21.15.152:0/363097326 reap_dead start 2024-09-11T22:03:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.245+0000 7fb58b748640 1 -- 172.21.15.152:0/363097326 shutdown_connections 2024-09-11T22:03:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.245+0000 7fb58b748640 1 -- 172.21.15.152:0/363097326 >> 172.21.15.152:0/363097326 conn(0x7fb584077230 msgr2=0x7fb5840fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.245+0000 7fb58b748640 1 -- 172.21.15.152:0/363097326 shutdown_connections 2024-09-11T22:03:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.245+0000 7fb58b748640 1 -- 172.21.15.152:0/363097326 wait complete. 2024-09-11T22:03:22.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.437+0000 7fa657bbb640 1 -- 172.21.15.152:0/4204038235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa65010c170 msgr2=0x7fa65010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:22.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.437+0000 7fa657bbb640 1 --2- 172.21.15.152:0/4204038235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa65010c170 0x7fa65010e610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa648009ca0 tx=0x7fa64802a950 comp rx=0 tx=0).stop 2024-09-11T22:03:22.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.437+0000 7fa657bbb640 1 -- 172.21.15.152:0/4204038235 shutdown_connections 2024-09-11T22:03:22.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.437+0000 7fa657bbb640 1 --2- 172.21.15.152:0/4204038235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa65010c170 0x7fa65010e610 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.437+0000 7fa657bbb640 1 --2- 172.21.15.152:0/4204038235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa650103660 0x7fa65010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.437+0000 7fa657bbb640 1 --2- 172.21.15.152:0/4204038235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa650102d40 0x7fa650103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.437+0000 7fa657bbb640 1 -- 172.21.15.152:0/4204038235 >> 172.21.15.152:0/4204038235 conn(0x7fa6500fc7a0 msgr2=0x7fa6500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.437+0000 7fa657bbb640 1 -- 172.21.15.152:0/4204038235 shutdown_connections 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.437+0000 7fa657bbb640 1 -- 172.21.15.152:0/4204038235 wait complete. 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa657bbb640 1 Processor -- start 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa657bbb640 1 -- start start 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa657bbb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa650102d40 0x7fa6501984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa657bbb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa650103660 0x7fa650198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa657bbb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa65010c170 0x7fa65019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa657bbb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa650111fb0 con 0x7fa65010c170 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa657bbb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa650111e30 con 0x7fa650103660 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa657bbb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa650112130 con 0x7fa650102d40 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa656158640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa65010c170 0x7fa65019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa656158640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa65010c170 0x7fa65019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37342/0 (socket says 172.21.15.152:37342) 2024-09-11T22:03:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa656158640 1 -- 172.21.15.152:0/3791930577 learned_addr learned my addr 172.21.15.152:0/3791930577 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa655957640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa650102d40 0x7fa6501984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa655156640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa650103660 0x7fa650198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:22.639 INFO:teuthology.orchestra.run.smithi152.stdout:296352743450 2024-09-11T22:03:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa656158640 1 -- 172.21.15.152:0/3791930577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa650102d40 msgr2=0x7fa6501984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa656158640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa650102d40 0x7fa6501984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa656158640 1 -- 172.21.15.152:0/3791930577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa650103660 msgr2=0x7fa650198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa656158640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa650103660 0x7fa650198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa656158640 1 -- 172.21.15.152:0/3791930577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65019d490 con 0x7fa65010c170 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa655156640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa650103660 0x7fa650198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.438+0000 7fa656158640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa65010c170 0x7fa65019cdb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa64802ae70 tx=0x7fa64802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.439+0000 7fa646ffd640 1 -- 172.21.15.152:0/3791930577 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648034040 con 0x7fa65010c170 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.439+0000 7fa646ffd640 1 -- 172.21.15.152:0/3791930577 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa648030920 con 0x7fa65010c170 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.439+0000 7fa657bbb640 1 -- 172.21.15.152:0/3791930577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65019d720 con 0x7fa65010c170 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.439+0000 7fa646ffd640 1 -- 172.21.15.152:0/3791930577 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648045480 con 0x7fa65010c170 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.439+0000 7fa657bbb640 1 -- 172.21.15.152:0/3791930577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6501a5060 con 0x7fa65010c170 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.440+0000 7fa657bbb640 1 -- 172.21.15.152:0/3791930577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa650103120 con 0x7fa65010c170 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.441+0000 7fa646ffd640 1 -- 172.21.15.152:0/3791930577 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa648037020 con 0x7fa65010c170 2024-09-11T22:03:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.441+0000 7fa646ffd640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa63c0a2c90 0x7fa63c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.442+0000 7fa655957640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa63c0a2c90 0x7fa63c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.442+0000 7fa646ffd640 1 -- 172.21.15.152:0/3791930577 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fa6480f00d0 con 0x7fa65010c170 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.442+0000 7fa655957640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa63c0a2c90 0x7fa63c0a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa64c005fd0 tx=0x7fa64c005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.446+0000 7fa646ffd640 1 -- 172.21.15.152:0/3791930577 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6480bcfc0 con 0x7fa65010c170 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.615+0000 7fa657bbb640 1 -- 172.21.15.152:0/3791930577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa650107210 con 0x7fa65010c170 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.615+0000 7fa646ffd640 1 -- 172.21.15.152:0/3791930577 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa6480bc8c0 con 0x7fa65010c170 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 -- 172.21.15.152:0/3791930577 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa63c0a2c90 msgr2=0x7fa63c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa63c0a2c90 0x7fa63c0a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa64c005fd0 tx=0x7fa64c005850 comp rx=0 tx=0).stop 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 -- 172.21.15.152:0/3791930577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa65010c170 msgr2=0x7fa65019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa65010c170 0x7fa65019cdb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa64802ae70 tx=0x7fa64802f5b0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 -- 172.21.15.152:0/3791930577 shutdown_connections 2024-09-11T22:03:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa65010c170 0x7fa65019cdb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa650103660 0x7fa650198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa63c0a2c90 0x7fa63c0a5150 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 --2- 172.21.15.152:0/3791930577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa650102d40 0x7fa6501984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 -- 172.21.15.152:0/3791930577 >> 172.21.15.152:0/3791930577 conn(0x7fa6500fc7a0 msgr2=0x7fa6500fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 -- 172.21.15.152:0/3791930577 shutdown_connections 2024-09-11T22:03:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:22.618+0000 7fa657bbb640 1 -- 172.21.15.152:0/3791930577 wait complete. 2024-09-11T22:03:23.162 INFO:teuthology.orchestra.run.smithi152.stdout:326417514518 2024-09-11T22:03:23.162 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-11T22:03:23.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:23 smithi152 ceph-mon[31188]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T22:03:23.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:23 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3791930577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T22:03:23.750 INFO:teuthology.orchestra.run.smithi152.stdout:193273528366 2024-09-11T22:03:23.751 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-11T22:03:23.789 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:23.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:23 smithi179 ceph-mon[35603]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T22:03:23.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:23 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3791930577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T22:03:23.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:23 smithi193 ceph-mon[35545]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T22:03:23.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:23 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3791930577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T22:03:24.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.256+0000 7f9f13ea9640 1 -- 172.21.15.152:0/1717642280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c102da0 msgr2=0x7f9f0c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:24.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.256+0000 7f9f13ea9640 1 --2- 172.21.15.152:0/1717642280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c102da0 0x7f9f0c103180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009900 tx=0x7f9f0802a480 comp rx=0 tx=0).stop 2024-09-11T22:03:24.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.256+0000 7f9f13ea9640 1 -- 172.21.15.152:0/1717642280 shutdown_connections 2024-09-11T22:03:24.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.256+0000 7f9f13ea9640 1 --2- 172.21.15.152:0/1717642280 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c10c180 0x7f9f0c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:24.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.256+0000 7f9f13ea9640 1 --2- 172.21.15.152:0/1717642280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c1036c0 0x7f9f0c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.256+0000 7f9f13ea9640 1 --2- 172.21.15.152:0/1717642280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c102da0 0x7f9f0c103180 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.256+0000 7f9f13ea9640 1 -- 172.21.15.152:0/1717642280 >> 172.21.15.152:0/1717642280 conn(0x7f9f0c0fc7a0 msgr2=0x7f9f0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.256+0000 7f9f13ea9640 1 -- 172.21.15.152:0/1717642280 shutdown_connections 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.256+0000 7f9f13ea9640 1 -- 172.21.15.152:0/1717642280 wait complete. 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.257+0000 7f9f13ea9640 1 Processor -- start 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.257+0000 7f9f13ea9640 1 -- start start 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.257+0000 7f9f13ea9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c102da0 0x7f9f0c100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.257+0000 7f9f13ea9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c1036c0 0x7f9f0c100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.257+0000 7f9f13ea9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c10c180 0x7f9f0c101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.257+0000 7f9f13ea9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c111fc0 con 0x7f9f0c10c180 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.257+0000 7f9f13ea9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c111e40 con 0x7f9f0c1036c0 2024-09-11T22:03:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.257+0000 7f9f13ea9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c112140 con 0x7f9f0c102da0 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.257+0000 7f9f12446640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c10c180 0x7f9f0c101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.257+0000 7f9f12446640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c10c180 0x7f9f0c101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49054/0 (socket says 172.21.15.152:49054) 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.257+0000 7f9f12446640 1 -- 172.21.15.152:0/3997711644 learned_addr learned my addr 172.21.15.152:0/3997711644 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f11444640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c1036c0 0x7f9f0c100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f11c45640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c102da0 0x7f9f0c100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f12446640 1 -- 172.21.15.152:0/3997711644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c102da0 msgr2=0x7f9f0c100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f12446640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c102da0 0x7f9f0c100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f12446640 1 -- 172.21.15.152:0/3997711644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c1036c0 msgr2=0x7f9f0c100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f12446640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c1036c0 0x7f9f0c100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f12446640 1 -- 172.21.15.152:0/3997711644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0c1a69a0 con 0x7f9f0c10c180 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f12446640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c10c180 0x7f9f0c101480 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400cad0 tx=0x7f9f0400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f02ffd640 1 -- 172.21.15.152:0/3997711644 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400ad60 con 0x7f9f0c10c180 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f02ffd640 1 -- 172.21.15.152:0/3997711644 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f04005020 con 0x7f9f0c10c180 2024-09-11T22:03:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f13ea9640 1 -- 172.21.15.152:0/3997711644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0c1a6c90 con 0x7f9f0c10c180 2024-09-11T22:03:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f02ffd640 1 -- 172.21.15.152:0/3997711644 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400f6b0 con 0x7f9f0c10c180 2024-09-11T22:03:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.258+0000 7f9f13ea9640 1 -- 172.21.15.152:0/3997711644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0c1a71d0 con 0x7f9f0c10c180 2024-09-11T22:03:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.259+0000 7f9f13ea9640 1 -- 172.21.15.152:0/3997711644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f0c103180 con 0x7f9f0c10c180 2024-09-11T22:03:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.260+0000 7f9f02ffd640 1 -- 172.21.15.152:0/3997711644 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9f04005560 con 0x7f9f0c10c180 2024-09-11T22:03:24.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.261+0000 7f9f02ffd640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9ef80a2c10 0x7f9ef80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:24.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.261+0000 7f9f11c45640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9ef80a2c10 0x7f9ef80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:24.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.261+0000 7f9f02ffd640 1 -- 172.21.15.152:0/3997711644 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f9f040cf140 con 0x7f9f0c10c180 2024-09-11T22:03:24.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.262+0000 7f9f11c45640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9ef80a2c10 0x7f9ef80a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9f08000c00 tx=0x7f9f080058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:24.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.265+0000 7f9f02ffd640 1 -- 172.21.15.152:0/3997711644 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9f04014030 con 0x7f9f0c10c180 2024-09-11T22:03:24.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.437+0000 7f9f13ea9640 1 -- 172.21.15.152:0/3997711644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9f0c107260 con 0x7f9f0c10c180 2024-09-11T22:03:24.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.437+0000 7f9f02ffd640 1 -- 172.21.15.152:0/3997711644 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f0409bf20 con 0x7f9f0c10c180 2024-09-11T22:03:24.438 INFO:teuthology.orchestra.run.smithi152.stdout:55834574918 2024-09-11T22:03:24.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 -- 172.21.15.152:0/3997711644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9ef80a2c10 msgr2=0x7f9ef80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:24.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9ef80a2c10 0x7f9ef80a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9f08000c00 tx=0x7f9f080058d0 comp rx=0 tx=0).stop 2024-09-11T22:03:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 -- 172.21.15.152:0/3997711644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c10c180 msgr2=0x7f9f0c101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c10c180 0x7f9f0c101480 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400cad0 tx=0x7f9f0400ced0 comp rx=0 tx=0).stop 2024-09-11T22:03:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 -- 172.21.15.152:0/3997711644 shutdown_connections 2024-09-11T22:03:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c10c180 0x7f9f0c101480 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c1036c0 0x7f9f0c100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f9ef80a2c10 0x7f9ef80a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 --2- 172.21.15.152:0/3997711644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c102da0 0x7f9f0c100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 -- 172.21.15.152:0/3997711644 >> 172.21.15.152:0/3997711644 conn(0x7f9f0c0fc7a0 msgr2=0x7f9f0c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 -- 172.21.15.152:0/3997711644 shutdown_connections 2024-09-11T22:03:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:24.439+0000 7f9f13ea9640 1 -- 172.21.15.152:0/3997711644 wait complete. 2024-09-11T22:03:24.730 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:24.732 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:24.777 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743448 got 296352743450 for osd.10 2024-09-11T22:03:24.777 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:25.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:25 smithi152 ceph-mon[31188]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:25.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:25 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3997711644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T22:03:25.552 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:25.558 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:25.565 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:25.565 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:25.597 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574916 got 55834574918 for osd.1 2024-09-11T22:03:25.597 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:25 smithi179 ceph-mon[35603]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:25 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3997711644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T22:03:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:25 smithi193 ceph-mon[35545]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:25 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3997711644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T22:03:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.733+0000 7fd53a9fd640 1 -- 172.21.15.152:0/3379500039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd534102790 msgr2=0x7fd5341067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.733+0000 7fd53a9fd640 1 --2- 172.21.15.152:0/3379500039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd534102790 0x7fd5341067e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009900 tx=0x7fd51c02a410 comp rx=0 tx=0).stop 2024-09-11T22:03:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.733+0000 7fd53a9fd640 1 -- 172.21.15.152:0/3379500039 shutdown_connections 2024-09-11T22:03:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.733+0000 7fd53a9fd640 1 --2- 172.21.15.152:0/3379500039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd534106f10 0x7fd53410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.733+0000 7fd53a9fd640 1 --2- 172.21.15.152:0/3379500039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd534102790 0x7fd5341067e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.733+0000 7fd53a9fd640 1 --2- 172.21.15.152:0/3379500039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd534101de0 0x7fd5341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.733+0000 7fd53a9fd640 1 -- 172.21.15.152:0/3379500039 >> 172.21.15.152:0/3379500039 conn(0x7fd5340fd8e0 msgr2=0x7fd5340ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.733+0000 7fd53a9fd640 1 -- 172.21.15.152:0/3379500039 shutdown_connections 2024-09-11T22:03:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.733+0000 7fd53a9fd640 1 -- 172.21.15.152:0/3379500039 wait complete. 2024-09-11T22:03:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd53a9fd640 1 Processor -- start 2024-09-11T22:03:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd53a9fd640 1 -- start start 2024-09-11T22:03:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd53a9fd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd534101de0 0x7fd534198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd53a9fd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd534102790 0x7fd534198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd53a9fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd534106f10 0x7fd53419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd53a9fd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd534111f70 con 0x7fd534102790 2024-09-11T22:03:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd53a9fd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd534111df0 con 0x7fd534101de0 2024-09-11T22:03:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd53a9fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd5341120f0 con 0x7fd534106f10 2024-09-11T22:03:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd52bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd534102790 0x7fd534198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd52bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd534102790 0x7fd534198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49076/0 (socket says 172.21.15.152:49076) 2024-09-11T22:03:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd52bfff640 1 -- 172.21.15.152:0/2680591843 learned_addr learned my addr 172.21.15.152:0/2680591843 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.734+0000 7fd538f9a640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd534106f10 0x7fd53419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd533fff640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd534101de0 0x7fd534198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd52bfff640 1 -- 172.21.15.152:0/2680591843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd534106f10 msgr2=0x7fd53419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd52bfff640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd534106f10 0x7fd53419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd52bfff640 1 -- 172.21.15.152:0/2680591843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd534101de0 msgr2=0x7fd534198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd52bfff640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd534101de0 0x7fd534198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd52bfff640 1 -- 172.21.15.152:0/2680591843 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53419d400 con 0x7fd534102790 2024-09-11T22:03:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd533fff640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd534101de0 0x7fd534198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd52bfff640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd534102790 0x7fd534198990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd51c006010 tx=0x7fd51c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd531ffb640 1 -- 172.21.15.152:0/2680591843 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c03f030 con 0x7fd534102790 2024-09-11T22:03:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd531ffb640 1 -- 172.21.15.152:0/2680591843 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd51c003ce0 con 0x7fd534102790 2024-09-11T22:03:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd53a9fd640 1 -- 172.21.15.152:0/2680591843 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53419d690 con 0x7fd534102790 2024-09-11T22:03:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd531ffb640 1 -- 172.21.15.152:0/2680591843 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c035070 con 0x7fd534102790 2024-09-11T22:03:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.735+0000 7fd53a9fd640 1 -- 172.21.15.152:0/2680591843 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5341a4fd0 con 0x7fd534102790 2024-09-11T22:03:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.736+0000 7fd53a9fd640 1 -- 172.21.15.152:0/2680591843 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5341032c0 con 0x7fd534102790 2024-09-11T22:03:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.737+0000 7fd531ffb640 1 -- 172.21.15.152:0/2680591843 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd51c042030 con 0x7fd534102790 2024-09-11T22:03:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.738+0000 7fd531ffb640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5200a2c10 0x7fd5200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.738+0000 7fd533fff640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5200a2c10 0x7fd5200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.738+0000 7fd531ffb640 1 -- 172.21.15.152:0/2680591843 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fd51c0ef8b0 con 0x7fd534102790 2024-09-11T22:03:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.739+0000 7fd533fff640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5200a2c10 0x7fd5200a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd5240058c0 tx=0x7fd524005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:26.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.742+0000 7fd531ffb640 1 -- 172.21.15.152:0/2680591843 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd51c0bc750 con 0x7fd534102790 2024-09-11T22:03:26.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.916+0000 7fd53a9fd640 1 -- 172.21.15.152:0/2680591843 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd53410a150 con 0x7fd534102790 2024-09-11T22:03:26.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.917+0000 7fd531ffb640 1 -- 172.21.15.152:0/2680591843 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd51c0bc050 con 0x7fd534102790 2024-09-11T22:03:26.918 INFO:teuthology.orchestra.run.smithi152.stdout:210453397546 2024-09-11T22:03:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 -- 172.21.15.152:0/2680591843 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5200a2c10 msgr2=0x7fd5200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5200a2c10 0x7fd5200a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd5240058c0 tx=0x7fd524005850 comp rx=0 tx=0).stop 2024-09-11T22:03:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 -- 172.21.15.152:0/2680591843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd534102790 msgr2=0x7fd534198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd534102790 0x7fd534198990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd51c006010 tx=0x7fd51c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:03:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 -- 172.21.15.152:0/2680591843 shutdown_connections 2024-09-11T22:03:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5200a2c10 0x7fd5200a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd534106f10 0x7fd53419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd534102790 0x7fd534198990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 --2- 172.21.15.152:0/2680591843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd534101de0 0x7fd534198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 -- 172.21.15.152:0/2680591843 >> 172.21.15.152:0/2680591843 conn(0x7fd5340fd8e0 msgr2=0x7fd5340feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 -- 172.21.15.152:0/2680591843 shutdown_connections 2024-09-11T22:03:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:26.919+0000 7fd53a9fd640 1 -- 172.21.15.152:0/2680591843 wait complete. 2024-09-11T22:03:27.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.303+0000 7fb774fc8640 1 -- 172.21.15.152:0/2449089821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770100a80 msgr2=0x7fb770100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:27.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.303+0000 7fb774fc8640 1 --2- 172.21.15.152:0/2449089821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770100a80 0x7fb770100ee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb764009930 tx=0x7fb76402a420 comp rx=0 tx=0).stop 2024-09-11T22:03:27.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.303+0000 7fb774fc8640 1 -- 172.21.15.152:0/2449089821 shutdown_connections 2024-09-11T22:03:27.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.303+0000 7fb774fc8640 1 --2- 172.21.15.152:0/2449089821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770101420 0x7fb77010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.303+0000 7fb774fc8640 1 --2- 172.21.15.152:0/2449089821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770100a80 0x7fb770100ee0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.303+0000 7fb774fc8640 1 --2- 172.21.15.152:0/2449089821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770106a80 0x7fb770106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.303+0000 7fb774fc8640 1 -- 172.21.15.152:0/2449089821 >> 172.21.15.152:0/2449089821 conn(0x7fb7700fc7a0 msgr2=0x7fb7700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:27.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.303+0000 7fb774fc8640 1 -- 172.21.15.152:0/2449089821 shutdown_connections 2024-09-11T22:03:27.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.303+0000 7fb774fc8640 1 -- 172.21.15.152:0/2449089821 wait complete. 2024-09-11T22:03:27.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb774fc8640 1 Processor -- start 2024-09-11T22:03:27.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb774fc8640 1 -- start start 2024-09-11T22:03:27.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb774fc8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770100a80 0x7fb77019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:27.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb774fc8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770101420 0x7fb77019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:27.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb774fc8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770106a80 0x7fb77019ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:27.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb774fc8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb770110e80 con 0x7fb770106a80 2024-09-11T22:03:27.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb774fc8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb770110d00 con 0x7fb770100a80 2024-09-11T22:03:27.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb774fc8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb770111000 con 0x7fb770101420 2024-09-11T22:03:27.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb76ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770106a80 0x7fb77019ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb76ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770106a80 0x7fb77019ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49092/0 (socket says 172.21.15.152:49092) 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb76ed9d640 1 -- 172.21.15.152:0/1605564691 learned_addr learned my addr 172.21.15.152:0/1605564691 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.304+0000 7fb76dd9b640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770101420 0x7fb77019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb76e59c640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770100a80 0x7fb77019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb76ed9d640 1 -- 172.21.15.152:0/1605564691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770101420 msgr2=0x7fb77019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb76ed9d640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770101420 0x7fb77019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb76ed9d640 1 -- 172.21.15.152:0/1605564691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770100a80 msgr2=0x7fb77019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb76ed9d640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770100a80 0x7fb77019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb76ed9d640 1 -- 172.21.15.152:0/1605564691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77019f550 con 0x7fb770106a80 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb76dd9b640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770101420 0x7fb77019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb76e59c640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770100a80 0x7fb77019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb76ed9d640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770106a80 0x7fb77019ee70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb76800cce0 tx=0x7fb76800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:27.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb75f7fe640 1 -- 172.21.15.152:0/1605564691 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76800f450 con 0x7fb770106a80 2024-09-11T22:03:27.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb75f7fe640 1 -- 172.21.15.152:0/1605564691 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb76800fad0 con 0x7fb770106a80 2024-09-11T22:03:27.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb774fc8640 1 -- 172.21.15.152:0/1605564691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77019f840 con 0x7fb770106a80 2024-09-11T22:03:27.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb75f7fe640 1 -- 172.21.15.152:0/1605564691 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768018c10 con 0x7fb770106a80 2024-09-11T22:03:27.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.305+0000 7fb774fc8640 1 -- 172.21.15.152:0/1605564691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7701a7120 con 0x7fb770106a80 2024-09-11T22:03:27.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.306+0000 7fb774fc8640 1 -- 172.21.15.152:0/1605564691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb770100ee0 con 0x7fb770106a80 2024-09-11T22:03:27.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.307+0000 7fb75f7fe640 1 -- 172.21.15.152:0/1605564691 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb76800f5f0 con 0x7fb770106a80 2024-09-11T22:03:27.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.308+0000 7fb75f7fe640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb7580a2c90 0x7fb7580a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:27.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.308+0000 7fb76e59c640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb7580a2c90 0x7fb7580a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:27.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.308+0000 7fb75f7fe640 1 -- 172.21.15.152:0/1605564691 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fb7680cf8e0 con 0x7fb770106a80 2024-09-11T22:03:27.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.308+0000 7fb76e59c640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb7580a2c90 0x7fb7580a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb760005fd0 tx=0x7fb7600094d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:27.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.312+0000 7fb75f7fe640 1 -- 172.21.15.152:0/1605564691 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb768014030 con 0x7fb770106a80 2024-09-11T22:03:27.468 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:27.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:27 smithi152 ceph-mon[31188]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:27.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:27 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2680591843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T22:03:27.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.482+0000 7f7b45a47640 1 -- 172.21.15.152:0/399120868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b40102df0 msgr2=0x7f7b401031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:27.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.482+0000 7f7b45a47640 1 --2- 172.21.15.152:0/399120868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b40102df0 0x7f7b401031d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009900 tx=0x7f7b3002a480 comp rx=0 tx=0).stop 2024-09-11T22:03:27.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.482+0000 7f7b45a47640 1 -- 172.21.15.152:0/399120868 shutdown_connections 2024-09-11T22:03:27.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.482+0000 7f7b45a47640 1 --2- 172.21.15.152:0/399120868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b4010c190 0x7f7b4010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.482+0000 7f7b45a47640 1 --2- 172.21.15.152:0/399120868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b40103710 0x7f7b4010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.482+0000 7f7b45a47640 1 --2- 172.21.15.152:0/399120868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b40102df0 0x7f7b401031d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.482+0000 7f7b45a47640 1 -- 172.21.15.152:0/399120868 >> 172.21.15.152:0/399120868 conn(0x7f7b400fc7d0 msgr2=0x7f7b400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:27.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.482+0000 7f7b45a47640 1 -- 172.21.15.152:0/399120868 shutdown_connections 2024-09-11T22:03:27.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.482+0000 7f7b45a47640 1 -- 172.21.15.152:0/399120868 wait complete. 2024-09-11T22:03:27.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.483+0000 7f7b45a47640 1 Processor -- start 2024-09-11T22:03:27.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.483+0000 7f7b45a47640 1 -- start start 2024-09-11T22:03:27.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b45a47640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b40102df0 0x7f7b40198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:27.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b45a47640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b40103710 0x7f7b40198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:27.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b45a47640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b4010c190 0x7f7b4019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:27.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b45a47640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7b40111f80 con 0x7f7b40103710 2024-09-11T22:03:27.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b45a47640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7b40111e00 con 0x7f7b4010c190 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b45a47640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7b40112100 con 0x7f7b40102df0 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b3e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b40103710 0x7f7b40198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b3e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b40103710 0x7f7b40198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49114/0 (socket says 172.21.15.152:49114) 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b3e7fc640 1 -- 172.21.15.152:0/3277638567 learned_addr learned my addr 172.21.15.152:0/3277638567 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b3effd640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b40102df0 0x7f7b40198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b3f7fe640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b4010c190 0x7f7b4019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b3e7fc640 1 -- 172.21.15.152:0/3277638567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b40102df0 msgr2=0x7f7b40198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b3e7fc640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b40102df0 0x7f7b40198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b3e7fc640 1 -- 172.21.15.152:0/3277638567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b4010c190 msgr2=0x7f7b4019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b3e7fc640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b4010c190 0x7f7b4019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.484+0000 7f7b3e7fc640 1 -- 172.21.15.152:0/3277638567 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4019d3f0 con 0x7f7b40103710 2024-09-11T22:03:27.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.485+0000 7f7b3e7fc640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b40103710 0x7f7b40198980 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400d950 tx=0x7f7b3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:27.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.485+0000 7f7b44a45640 1 -- 172.21.15.152:0/3277638567 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34017070 con 0x7f7b40103710 2024-09-11T22:03:27.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.485+0000 7f7b45a47640 1 -- 172.21.15.152:0/3277638567 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4019d6e0 con 0x7f7b40103710 2024-09-11T22:03:27.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.485+0000 7f7b44a45640 1 -- 172.21.15.152:0/3277638567 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b34009c30 con 0x7f7b40103710 2024-09-11T22:03:27.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.485+0000 7f7b44a45640 1 -- 172.21.15.152:0/3277638567 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3400f6b0 con 0x7f7b40103710 2024-09-11T22:03:27.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.485+0000 7f7b45a47640 1 -- 172.21.15.152:0/3277638567 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b401a4fc0 con 0x7f7b40103710 2024-09-11T22:03:27.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.486+0000 7f7b45a47640 1 -- 172.21.15.152:0/3277638567 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b401031d0 con 0x7f7b40103710 2024-09-11T22:03:27.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.489+0000 7f7b44a45640 1 -- 172.21.15.152:0/3277638567 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7b340109d0 con 0x7f7b40103710 2024-09-11T22:03:27.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.490+0000 7f7b44a45640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7b280a2c10 0x7f7b280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:27.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.490+0000 7f7b3effd640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7b280a2c10 0x7f7b280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:27.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.490+0000 7f7b44a45640 1 -- 172.21.15.152:0/3277638567 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f7b340cee30 con 0x7f7b40103710 2024-09-11T22:03:27.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.491+0000 7f7b3effd640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7b280a2c10 0x7f7b280a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009230 tx=0x7f7b300058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:27.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.492+0000 7f7b44a45640 1 -- 172.21.15.152:0/3277638567 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b34009de0 con 0x7f7b40103710 2024-09-11T22:03:27.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.494+0000 7fb774fc8640 1 -- 172.21.15.152:0/1605564691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb7701a7420 con 0x7fb770106a80 2024-09-11T22:03:27.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.495+0000 7fb75f7fe640 1 -- 172.21.15.152:0/1605564691 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb76809c6c0 con 0x7fb770106a80 2024-09-11T22:03:27.496 INFO:teuthology.orchestra.run.smithi152.stdout:158913790004 2024-09-11T22:03:27.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 -- 172.21.15.152:0/1605564691 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb7580a2c90 msgr2=0x7fb7580a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:27.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb7580a2c90 0x7fb7580a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb760005fd0 tx=0x7fb7600094d0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 -- 172.21.15.152:0/1605564691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770106a80 msgr2=0x7fb77019ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:27.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770106a80 0x7fb77019ee70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb76800cce0 tx=0x7fb76800a620 comp rx=0 tx=0).stop 2024-09-11T22:03:27.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 -- 172.21.15.152:0/1605564691 shutdown_connections 2024-09-11T22:03:27.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770106a80 0x7fb77019ee70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb7580a2c90 0x7fb7580a5150 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770101420 0x7fb77019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 --2- 172.21.15.152:0/1605564691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770100a80 0x7fb77019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 -- 172.21.15.152:0/1605564691 >> 172.21.15.152:0/1605564691 conn(0x7fb7700fc7a0 msgr2=0x7fb77006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:27.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 -- 172.21.15.152:0/1605564691 shutdown_connections 2024-09-11T22:03:27.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.497+0000 7fb774fc8640 1 -- 172.21.15.152:0/1605564691 wait complete. 2024-09-11T22:03:27.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.669+0000 7f7b45a47640 1 -- 172.21.15.152:0/3277638567 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f7b401072d0 con 0x7f7b40103710 2024-09-11T22:03:27.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.669+0000 7f7b44a45640 1 -- 172.21.15.152:0/3277638567 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f7b3409bc10 con 0x7f7b40103710 2024-09-11T22:03:27.670 INFO:teuthology.orchestra.run.smithi152.stdout:326417514519 2024-09-11T22:03:27.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 -- 172.21.15.152:0/3277638567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7b280a2c10 msgr2=0x7f7b280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:27.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7b280a2c10 0x7f7b280a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009230 tx=0x7f7b300058d0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 -- 172.21.15.152:0/3277638567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b40103710 msgr2=0x7f7b40198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:27.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b40103710 0x7f7b40198980 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400d950 tx=0x7f7b3400de10 comp rx=0 tx=0).stop 2024-09-11T22:03:27.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 -- 172.21.15.152:0/3277638567 shutdown_connections 2024-09-11T22:03:27.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b4010c190 0x7f7b4019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b40103710 0x7f7b40198980 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f7b280a2c10 0x7f7b280a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 --2- 172.21.15.152:0/3277638567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b40102df0 0x7f7b40198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:27.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 -- 172.21.15.152:0/3277638567 >> 172.21.15.152:0/3277638567 conn(0x7f7b400fc7d0 msgr2=0x7f7b400fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:27.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 -- 172.21.15.152:0/3277638567 shutdown_connections 2024-09-11T22:03:27.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:27.671+0000 7f7b45a47640 1 -- 172.21.15.152:0/3277638567 wait complete. 2024-09-11T22:03:27.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:27 smithi179 ceph-mon[35603]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:27.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:27 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2680591843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T22:03:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:27 smithi193 ceph-mon[35545]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:27 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2680591843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T22:03:28.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514518 got 326417514519 for osd.11 2024-09-11T22:03:28.418 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:28.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.570+0000 7fc84fd37640 1 -- 172.21.15.152:0/983700239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8481055b0 msgr2=0x7fc84810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:28.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.570+0000 7fc84fd37640 1 --2- 172.21.15.152:0/983700239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8481055b0 0x7fc84810d130 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc840009ca0 tx=0x7fc84002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 -- 172.21.15.152:0/983700239 shutdown_connections 2024-09-11T22:03:28.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 --2- 172.21.15.152:0/983700239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8481055b0 0x7fc84810d130 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 --2- 172.21.15.152:0/983700239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc848100e30 0x7fc848104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 --2- 172.21.15.152:0/983700239 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc848100480 0x7fc848100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 -- 172.21.15.152:0/983700239 >> 172.21.15.152:0/983700239 conn(0x7fc848077210 msgr2=0x7fc8480fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:28.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 -- 172.21.15.152:0/983700239 shutdown_connections 2024-09-11T22:03:28.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 -- 172.21.15.152:0/983700239 wait complete. 2024-09-11T22:03:28.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 Processor -- start 2024-09-11T22:03:28.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 -- start start 2024-09-11T22:03:28.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc848100480 0x7fc848197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:28.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc848100e30 0x7fc848197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:28.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8481055b0 0x7fc84819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc848110650 con 0x7fc848100480 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc8481104d0 con 0x7fc848100e30 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.571+0000 7fc84fd37640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8481107d0 con 0x7fc8481055b0 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84dad3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc848100480 0x7fc848197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84dad3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc848100480 0x7fc848197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49136/0 (socket says 172.21.15.152:49136) 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84dad3640 1 -- 172.21.15.152:0/1120375605 learned_addr learned my addr 172.21.15.152:0/1120375605 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84e2d4640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8481055b0 0x7fc84819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84d2d2640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc848100e30 0x7fc848197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84dad3640 1 -- 172.21.15.152:0/1120375605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8481055b0 msgr2=0x7fc84819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84dad3640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8481055b0 0x7fc84819bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84dad3640 1 -- 172.21.15.152:0/1120375605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc848100e30 msgr2=0x7fc848197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84dad3640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc848100e30 0x7fc848197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84dad3640 1 -- 172.21.15.152:0/1120375605 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84819c300 con 0x7fc848100480 2024-09-11T22:03:28.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84e2d4640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8481055b0 0x7fc84819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:28.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84d2d2640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc848100e30 0x7fc848197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:28.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84dad3640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc848100480 0x7fc848197350 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc8440078f0 tx=0x7fc844007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:28.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc83effd640 1 -- 172.21.15.152:0/1120375605 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844019020 con 0x7fc848100480 2024-09-11T22:03:28.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc83effd640 1 -- 172.21.15.152:0/1120375605 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc844005500 con 0x7fc848100480 2024-09-11T22:03:28.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84fd37640 1 -- 172.21.15.152:0/1120375605 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84819c5f0 con 0x7fc848100480 2024-09-11T22:03:28.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc83effd640 1 -- 172.21.15.152:0/1120375605 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84400e890 con 0x7fc848100480 2024-09-11T22:03:28.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.572+0000 7fc84fd37640 1 -- 172.21.15.152:0/1120375605 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8481034b0 con 0x7fc848100480 2024-09-11T22:03:28.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.574+0000 7fc84fd37640 1 -- 172.21.15.152:0/1120375605 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc848100860 con 0x7fc848100480 2024-09-11T22:03:28.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.574+0000 7fc83effd640 1 -- 172.21.15.152:0/1120375605 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc8440046c0 con 0x7fc848100480 2024-09-11T22:03:28.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.575+0000 7fc83effd640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc8340a2c90 0x7fc8340a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:28.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.575+0000 7fc84d2d2640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc8340a2c90 0x7fc8340a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:28.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.575+0000 7fc83effd640 1 -- 172.21.15.152:0/1120375605 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fc8440d0870 con 0x7fc848100480 2024-09-11T22:03:28.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.576+0000 7fc84d2d2640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc8340a2c90 0x7fc8340a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc84806a260 tx=0x7fc838008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:28.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.580+0000 7fc83effd640 1 -- 172.21.15.152:0/1120375605 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc844023020 con 0x7fc848100480 2024-09-11T22:03:28.664 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:28 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1605564691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T22:03:28.664 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:28 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3277638567' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T22:03:28.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.754+0000 7fc84fd37640 1 -- 172.21.15.152:0/1120375605 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc848103710 con 0x7fc848100480 2024-09-11T22:03:28.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.754+0000 7fc83effd640 1 -- 172.21.15.152:0/1120375605 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc84409d6e0 con 0x7fc848100480 2024-09-11T22:03:28.755 INFO:teuthology.orchestra.run.smithi152.stdout:137438953529 2024-09-11T22:03:28.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.756+0000 7fc84fd37640 1 -- 172.21.15.152:0/1120375605 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc8340a2c90 msgr2=0x7fc8340a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:28.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.756+0000 7fc84fd37640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc8340a2c90 0x7fc8340a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc84806a260 tx=0x7fc838008040 comp rx=0 tx=0).stop 2024-09-11T22:03:28.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.757+0000 7fc84fd37640 1 -- 172.21.15.152:0/1120375605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc848100480 msgr2=0x7fc848197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:28.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.757+0000 7fc84fd37640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc848100480 0x7fc848197350 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc8440078f0 tx=0x7fc844007db0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.757+0000 7fc84fd37640 1 -- 172.21.15.152:0/1120375605 shutdown_connections 2024-09-11T22:03:28.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.757+0000 7fc84fd37640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc8340a2c90 0x7fc8340a5150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.757+0000 7fc84fd37640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8481055b0 0x7fc84819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.757+0000 7fc84fd37640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc848100e30 0x7fc848197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.757+0000 7fc84fd37640 1 --2- 172.21.15.152:0/1120375605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc848100480 0x7fc848197350 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.757+0000 7fc84fd37640 1 -- 172.21.15.152:0/1120375605 >> 172.21.15.152:0/1120375605 conn(0x7fc848077210 msgr2=0x7fc8480fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:28.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.757+0000 7fc84fd37640 1 -- 172.21.15.152:0/1120375605 shutdown_connections 2024-09-11T22:03:28.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.757+0000 7fc84fd37640 1 -- 172.21.15.152:0/1120375605 wait complete. 2024-09-11T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:28 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1605564691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:28 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3277638567' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T22:03:28.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.743+0000 7fb3750bc640 1 -- 172.21.15.152:0/2166910476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb370102ef0 msgr2=0x7fb37010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:28.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.743+0000 7fb3750bc640 1 --2- 172.21.15.152:0/2166910476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb370102ef0 0x7fb37010da40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb368009ca0 tx=0x7fb36802a950 comp rx=0 tx=0).stop 2024-09-11T22:03:28.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.743+0000 7fb3750bc640 1 -- 172.21.15.152:0/2166910476 shutdown_connections 2024-09-11T22:03:28.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.743+0000 7fb3750bc640 1 --2- 172.21.15.152:0/2166910476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb370102ef0 0x7fb37010da40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.744+0000 7fb3750bc640 1 --2- 172.21.15.152:0/2166910476 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb370102570 0x7fb3701029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.744+0000 7fb3750bc640 1 --2- 172.21.15.152:0/2166910476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb370100e20 0x7fb370101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.744+0000 7fb3750bc640 1 -- 172.21.15.152:0/2166910476 >> 172.21.15.152:0/2166910476 conn(0x7fb3700fc7d0 msgr2=0x7fb3700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:28.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.744+0000 7fb3750bc640 1 -- 172.21.15.152:0/2166910476 shutdown_connections 2024-09-11T22:03:28.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.744+0000 7fb3750bc640 1 -- 172.21.15.152:0/2166910476 wait complete. 2024-09-11T22:03:28.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.744+0000 7fb3750bc640 1 Processor -- start 2024-09-11T22:03:28.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.744+0000 7fb3750bc640 1 -- start start 2024-09-11T22:03:28.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb3750bc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb370100e20 0x7fb37010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb3750bc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb370102570 0x7fb37010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb3750bc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb370102ef0 0x7fb37010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb3750bc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb3701120a0 con 0x7fb370102ef0 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb3750bc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb370111f20 con 0x7fb370102570 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb3750bc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb370112220 con 0x7fb370100e20 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb36f59e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb370102ef0 0x7fb37010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb36f59e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb370102ef0 0x7fb37010ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49152/0 (socket says 172.21.15.152:49152) 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb36f59e640 1 -- 172.21.15.152:0/207308537 learned_addr learned my addr 172.21.15.152:0/207308537 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb36ed9d640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb370100e20 0x7fb37010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb36e59c640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb370102570 0x7fb37010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb36f59e640 1 -- 172.21.15.152:0/207308537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb370100e20 msgr2=0x7fb37010e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb36f59e640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb370100e20 0x7fb37010e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb36f59e640 1 -- 172.21.15.152:0/207308537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb370102570 msgr2=0x7fb37010ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:28.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb36f59e640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb370102570 0x7fb37010ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb36f59e640 1 -- 172.21.15.152:0/207308537 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3701a6960 con 0x7fb370102ef0 2024-09-11T22:03:28.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb36f59e640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb370102ef0 0x7fb37010ef50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb36802ae70 tx=0x7fb36802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:28.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.745+0000 7fb357fff640 1 -- 172.21.15.152:0/207308537 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb368034040 con 0x7fb370102ef0 2024-09-11T22:03:28.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.746+0000 7fb3750bc640 1 -- 172.21.15.152:0/207308537 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3701a6bf0 con 0x7fb370102ef0 2024-09-11T22:03:28.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.746+0000 7fb357fff640 1 -- 172.21.15.152:0/207308537 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb368030920 con 0x7fb370102ef0 2024-09-11T22:03:28.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.746+0000 7fb357fff640 1 -- 172.21.15.152:0/207308537 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3680047f0 con 0x7fb370102ef0 2024-09-11T22:03:28.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.746+0000 7fb3750bc640 1 -- 172.21.15.152:0/207308537 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3701a7120 con 0x7fb370102ef0 2024-09-11T22:03:28.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.747+0000 7fb3750bc640 1 -- 172.21.15.152:0/207308537 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb370101200 con 0x7fb370102ef0 2024-09-11T22:03:28.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.748+0000 7fb357fff640 1 -- 172.21.15.152:0/207308537 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb368037020 con 0x7fb370102ef0 2024-09-11T22:03:28.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.748+0000 7fb357fff640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb3580a2c10 0x7fb3580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:28.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.749+0000 7fb357fff640 1 -- 172.21.15.152:0/207308537 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fb3680efff0 con 0x7fb370102ef0 2024-09-11T22:03:28.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.749+0000 7fb36ed9d640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb3580a2c10 0x7fb3580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:28.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.749+0000 7fb36ed9d640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb3580a2c10 0x7fb3580a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb36000abe0 tx=0x7fb36000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:28.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.752+0000 7fb357fff640 1 -- 172.21.15.152:0/207308537 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3680bcf80 con 0x7fb370102ef0 2024-09-11T22:03:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:28 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1605564691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T22:03:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:28 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3277638567' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T22:03:28.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.933+0000 7fb3750bc640 1 -- 172.21.15.152:0/207308537 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb37010fa00 con 0x7fb370102ef0 2024-09-11T22:03:28.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.933+0000 7fb357fff640 1 -- 172.21.15.152:0/207308537 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb37010fa00 con 0x7fb370102ef0 2024-09-11T22:03:28.934 INFO:teuthology.orchestra.run.smithi152.stdout:107374182462 2024-09-11T22:03:28.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 -- 172.21.15.152:0/207308537 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb3580a2c10 msgr2=0x7fb3580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:28.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb3580a2c10 0x7fb3580a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb36000abe0 tx=0x7fb36000a2d0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 -- 172.21.15.152:0/207308537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb370102ef0 msgr2=0x7fb37010ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:28.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb370102ef0 0x7fb37010ef50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb36802ae70 tx=0x7fb36802f5d0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 -- 172.21.15.152:0/207308537 shutdown_connections 2024-09-11T22:03:28.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb370102ef0 0x7fb37010ef50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb370102570 0x7fb37010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fb3580a2c10 0x7fb3580a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 --2- 172.21.15.152:0/207308537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb370100e20 0x7fb37010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:28.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 -- 172.21.15.152:0/207308537 >> 172.21.15.152:0/207308537 conn(0x7fb3700fc7d0 msgr2=0x7fb370106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:28.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 -- 172.21.15.152:0/207308537 shutdown_connections 2024-09-11T22:03:28.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:28.936+0000 7fb3750bc640 1 -- 172.21.15.152:0/207308537 wait complete. 2024-09-11T22:03:29.578 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953526 got 137438953529 for osd.4 2024-09-11T22:03:29.578 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:29 smithi152 ceph-mon[31188]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:03:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:29 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1120375605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T22:03:29.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:29 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/207308537' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T22:03:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:29 smithi179 ceph-mon[35603]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:03:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:29 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1120375605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T22:03:29.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:29 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/207308537' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T22:03:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:29 smithi193 ceph-mon[35545]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:03:29.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:29 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1120375605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T22:03:29.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:29 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/207308537' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T22:03:30.329 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397543 got 210453397546 for osd.7 2024-09-11T22:03:30.329 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:30.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:30 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1164362296' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T22:03:30.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:30 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1164362296' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T22:03:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:30 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1164362296' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T22:03:31.094 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790002 got 158913790004 for osd.5 2024-09-11T22:03:31.094 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:31.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.030+0000 7f79aa05f640 1 -- 172.21.15.152:0/3357622837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102790 msgr2=0x7f79a41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:31.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.030+0000 7f79aa05f640 1 --2- 172.21.15.152:0/3357622837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102790 0x7f79a41067e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7998009900 tx=0x7f799802a410 comp rx=0 tx=0).stop 2024-09-11T22:03:31.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.030+0000 7f79aa05f640 1 -- 172.21.15.152:0/3357622837 shutdown_connections 2024-09-11T22:03:31.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.030+0000 7f79aa05f640 1 --2- 172.21.15.152:0/3357622837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4106f10 0x7f79a410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:31.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.030+0000 7f79aa05f640 1 --2- 172.21.15.152:0/3357622837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102790 0x7f79a41067e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.030+0000 7f79aa05f640 1 --2- 172.21.15.152:0/3357622837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4101de0 0x7f79a41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.030+0000 7f79aa05f640 1 -- 172.21.15.152:0/3357622837 >> 172.21.15.152:0/3357622837 conn(0x7f79a40fd880 msgr2=0x7f79a40ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.030+0000 7f79aa05f640 1 -- 172.21.15.152:0/3357622837 shutdown_connections 2024-09-11T22:03:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.030+0000 7f79aa05f640 1 -- 172.21.15.152:0/3357622837 wait complete. 2024-09-11T22:03:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79aa05f640 1 Processor -- start 2024-09-11T22:03:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79aa05f640 1 -- start start 2024-09-11T22:03:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79aa05f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4101de0 0x7f79a40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79aa05f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4102790 0x7f79a4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79aa05f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4106f10 0x7f79a4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79aa05f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79a4111f70 con 0x7f79a4106f10 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79aa05f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79a4111df0 con 0x7f79a4101de0 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79aa05f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41120f0 con 0x7f79a4102790 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4106f10 0x7f79a4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4106f10 0x7f79a4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49180/0 (socket says 172.21.15.152:49180) 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79a3fff640 1 -- 172.21.15.152:0/1164362296 learned_addr learned my addr 172.21.15.152:0/1164362296 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.031+0000 7f79a2ffd640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4102790 0x7f79a4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79a37fe640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4101de0 0x7f79a40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79a3fff640 1 -- 172.21.15.152:0/1164362296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4102790 msgr2=0x7f79a4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79a3fff640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4102790 0x7f79a4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79a3fff640 1 -- 172.21.15.152:0/1164362296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4101de0 msgr2=0x7f79a40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79a3fff640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4101de0 0x7f79a40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79a3fff640 1 -- 172.21.15.152:0/1164362296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a41a68d0 con 0x7f79a4106f10 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79a37fe640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4101de0 0x7f79a40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79a3fff640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4106f10 0x7f79a4074f70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f799c00eaa0 tx=0x7f799c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79a0ff9640 1 -- 172.21.15.152:0/1164362296 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c00cdb0 con 0x7f79a4106f10 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79a0ff9640 1 -- 172.21.15.152:0/1164362296 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f799c005020 con 0x7f79a4106f10 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79a0ff9640 1 -- 172.21.15.152:0/1164362296 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c0116b0 con 0x7f79a4106f10 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79aa05f640 1 -- 172.21.15.152:0/1164362296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a41a6bc0 con 0x7f79a4106f10 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.032+0000 7f79aa05f640 1 -- 172.21.15.152:0/1164362296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a41a70b0 con 0x7f79a4106f10 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.033+0000 7f79aa05f640 1 -- 172.21.15.152:0/1164362296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a41021c0 con 0x7f79a4106f10 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.034+0000 7f79a0ff9640 1 -- 172.21.15.152:0/1164362296 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f799c005560 con 0x7f79a4106f10 2024-09-11T22:03:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.035+0000 7f79a0ff9640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f798c0a2c10 0x7f798c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:31.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.035+0000 7f79a37fe640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f798c0a2c10 0x7f798c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:31.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.035+0000 7f79a0ff9640 1 -- 172.21.15.152:0/1164362296 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f799c0cf4b0 con 0x7f79a4106f10 2024-09-11T22:03:31.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.036+0000 7f79a37fe640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f798c0a2c10 0x7f798c0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7994009b40 tx=0x7f7994005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:31.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.040+0000 7f79a0ff9640 1 -- 172.21.15.152:0/1164362296 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f799c016030 con 0x7f79a4106f10 2024-09-11T22:03:31.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.213+0000 7f79aa05f640 1 -- 172.21.15.152:0/1164362296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f79a402d7c0 con 0x7f79a4106f10 2024-09-11T22:03:31.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.213+0000 7f79a0ff9640 1 -- 172.21.15.152:0/1164362296 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f799c09c290 con 0x7f79a4106f10 2024-09-11T22:03:31.180 INFO:teuthology.orchestra.run.smithi152.stdout:244813135910 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 -- 172.21.15.152:0/1164362296 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f798c0a2c10 msgr2=0x7f798c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f798c0a2c10 0x7f798c0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7994009b40 tx=0x7f7994005e50 comp rx=0 tx=0).stop 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 -- 172.21.15.152:0/1164362296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4106f10 msgr2=0x7f79a4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4106f10 0x7f79a4074f70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f799c00eaa0 tx=0x7f799c00ef60 comp rx=0 tx=0).stop 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 -- 172.21.15.152:0/1164362296 shutdown_connections 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4106f10 0x7f79a4074f70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f798c0a2c10 0x7f798c0a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4102790 0x7f79a4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 --2- 172.21.15.152:0/1164362296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4101de0 0x7f79a40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 -- 172.21.15.152:0/1164362296 >> 172.21.15.152:0/1164362296 conn(0x7f79a40fd880 msgr2=0x7f79a40fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 -- 172.21.15.152:0/1164362296 shutdown_connections 2024-09-11T22:03:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:30.215+0000 7f79aa05f640 1 -- 172.21.15.152:0/1164362296 wait complete. 2024-09-11T22:03:31.350 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:31.351 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:31.446 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:31 smithi152 ceph-mon[31188]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:31.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:31 smithi179 ceph-mon[35603]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:31 smithi193 ceph-mon[35545]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:31.850 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135908 got 244813135910 for osd.8 2024-09-11T22:03:31.850 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:31.905 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:32.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.085+0000 7f40c0cc6640 1 -- 172.21.15.152:0/1615107758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40bc103780 msgr2=0x7f40bc107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:32.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.085+0000 7f40c0cc6640 1 --2- 172.21.15.152:0/1615107758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40bc103780 0x7f40bc107bc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009930 tx=0x7f40b002a420 comp rx=0 tx=0).stop 2024-09-11T22:03:32.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.085+0000 7f40c0cc6640 1 -- 172.21.15.152:0/1615107758 shutdown_connections 2024-09-11T22:03:32.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.085+0000 7f40c0cc6640 1 --2- 172.21.15.152:0/1615107758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc108300 0x7f40bc10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:32.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.085+0000 7f40c0cc6640 1 --2- 172.21.15.152:0/1615107758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40bc103780 0x7f40bc107bc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:32.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.085+0000 7f40c0cc6640 1 --2- 172.21.15.152:0/1615107758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc102dd0 0x7f40bc1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:32.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.085+0000 7f40c0cc6640 1 -- 172.21.15.152:0/1615107758 >> 172.21.15.152:0/1615107758 conn(0x7f40bc0fc7d0 msgr2=0x7f40bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:32.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.085+0000 7f40c0cc6640 1 -- 172.21.15.152:0/1615107758 shutdown_connections 2024-09-11T22:03:32.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.085+0000 7f40c0cc6640 1 -- 172.21.15.152:0/1615107758 wait complete. 2024-09-11T22:03:32.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.086+0000 7f40c0cc6640 1 Processor -- start 2024-09-11T22:03:32.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.086+0000 7f40c0cc6640 1 -- start start 2024-09-11T22:03:32.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.086+0000 7f40c0cc6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc102dd0 0x7f40bc198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:32.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.086+0000 7f40c0cc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc103780 0x7f40bc198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:32.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.086+0000 7f40c0cc6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40bc108300 0x7f40bc19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:32.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.086+0000 7f40c0cc6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc1120d0 con 0x7f40bc108300 2024-09-11T22:03:32.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.086+0000 7f40c0cc6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc111f50 con 0x7f40bc102dd0 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.086+0000 7f40c0cc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc112250 con 0x7f40bc103780 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.086+0000 7f40bad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40bc108300 0x7f40bc19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.086+0000 7f40bad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40bc108300 0x7f40bc19cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49198/0 (socket says 172.21.15.152:49198) 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.086+0000 7f40bad9d640 1 -- 172.21.15.152:0/611631789 learned_addr learned my addr 172.21.15.152:0/611631789 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40ba59c640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc102dd0 0x7f40bc198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40b9d9b640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc103780 0x7f40bc198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40bad9d640 1 -- 172.21.15.152:0/611631789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc103780 msgr2=0x7f40bc198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40bad9d640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc103780 0x7f40bc198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40bad9d640 1 -- 172.21.15.152:0/611631789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc102dd0 msgr2=0x7f40bc198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40bad9d640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc102dd0 0x7f40bc198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40bad9d640 1 -- 172.21.15.152:0/611631789 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc19d600 con 0x7f40bc108300 2024-09-11T22:03:32.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40bad9d640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40bc108300 0x7f40bc19cf20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f40b400eaa0 tx=0x7f40b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:32.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40ab7fe640 1 -- 172.21.15.152:0/611631789 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b400cdb0 con 0x7f40bc108300 2024-09-11T22:03:32.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40ab7fe640 1 -- 172.21.15.152:0/611631789 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40b4005020 con 0x7f40bc108300 2024-09-11T22:03:32.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40c0cc6640 1 -- 172.21.15.152:0/611631789 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc19d8f0 con 0x7f40bc108300 2024-09-11T22:03:32.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40c0cc6640 1 -- 172.21.15.152:0/611631789 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40bc1a51d0 con 0x7f40bc108300 2024-09-11T22:03:32.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.087+0000 7f40ab7fe640 1 -- 172.21.15.152:0/611631789 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b40116b0 con 0x7f40bc108300 2024-09-11T22:03:32.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.088+0000 7f40c0cc6640 1 -- 172.21.15.152:0/611631789 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40bc1031b0 con 0x7f40bc108300 2024-09-11T22:03:32.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.090+0000 7f40ab7fe640 1 -- 172.21.15.152:0/611631789 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f40b4005560 con 0x7f40bc108300 2024-09-11T22:03:32.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.090+0000 7f40ab7fe640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f40a40a2c90 0x7f40a40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:32.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.091+0000 7f40ba59c640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f40a40a2c90 0x7f40a40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:32.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.091+0000 7f40ab7fe640 1 -- 172.21.15.152:0/611631789 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f40b40cf860 con 0x7f40bc108300 2024-09-11T22:03:32.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.091+0000 7f40ba59c640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f40a40a2c90 0x7f40a40a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009890 tx=0x7f40ac008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:32.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.094+0000 7f40ab7fe640 1 -- 172.21.15.152:0/611631789 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40b4016030 con 0x7f40bc108300 2024-09-11T22:03:32.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.279+0000 7f40c0cc6640 1 -- 172.21.15.152:0/611631789 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f40bc10a290 con 0x7f40bc108300 2024-09-11T22:03:32.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.280+0000 7f40ab7fe640 1 -- 172.21.15.152:0/611631789 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f40b409c6c0 con 0x7f40bc108300 2024-09-11T22:03:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:34359738445 2024-09-11T22:03:32.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 -- 172.21.15.152:0/611631789 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f40a40a2c90 msgr2=0x7f40a40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f40a40a2c90 0x7f40a40a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009890 tx=0x7f40ac008040 comp rx=0 tx=0).stop 2024-09-11T22:03:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 -- 172.21.15.152:0/611631789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40bc108300 msgr2=0x7f40bc19cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40bc108300 0x7f40bc19cf20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f40b400eaa0 tx=0x7f40b400ef60 comp rx=0 tx=0).stop 2024-09-11T22:03:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 -- 172.21.15.152:0/611631789 shutdown_connections 2024-09-11T22:03:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40bc108300 0x7f40bc19cf20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f40a40a2c90 0x7f40a40a5150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc103780 0x7f40bc198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 --2- 172.21.15.152:0/611631789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc102dd0 0x7f40bc198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 -- 172.21.15.152:0/611631789 >> 172.21.15.152:0/611631789 conn(0x7f40bc0fc7d0 msgr2=0x7f40bc105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 -- 172.21.15.152:0/611631789 shutdown_connections 2024-09-11T22:03:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:32.282+0000 7f40c0cc6640 1 -- 172.21.15.152:0/611631789 wait complete. 2024-09-11T22:03:32.528 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182460 got 107374182462 for osd.3 2024-09-11T22:03:32.528 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:32.716 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:32 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:03:32.717 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:32 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/611631789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T22:03:32.717 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:32 smithi179 ceph-mon[35603]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:32 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:03:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:32 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/611631789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T22:03:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:32 smithi152 ceph-mon[31188]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:32.732 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:32 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:03:32.732 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:32 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/611631789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T22:03:32.732 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:32 smithi193 ceph-mon[35545]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:33.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.144+0000 7fa1b3813640 1 -- 172.21.15.152:0/2853852456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1ac105f40 msgr2=0x7fa1ac1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:33.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.144+0000 7fa1b3813640 1 --2- 172.21.15.152:0/2853852456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1ac105f40 0x7fa1ac1063d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009ca0 tx=0x7fa1a402a940 comp rx=0 tx=0).stop 2024-09-11T22:03:33.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.144+0000 7fa1b3813640 1 -- 172.21.15.152:0/2853852456 shutdown_connections 2024-09-11T22:03:33.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.144+0000 7fa1b3813640 1 --2- 172.21.15.152:0/2853852456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1ac105f40 0x7fa1ac1063d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.144+0000 7fa1b3813640 1 --2- 172.21.15.152:0/2853852456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1ac101450 0x7fa1ac105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.144+0000 7fa1b3813640 1 --2- 172.21.15.152:0/2853852456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac100b30 0x7fa1ac100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.144+0000 7fa1b3813640 1 -- 172.21.15.152:0/2853852456 >> 172.21.15.152:0/2853852456 conn(0x7fa1ac0fc7a0 msgr2=0x7fa1ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:33.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.144+0000 7fa1b3813640 1 -- 172.21.15.152:0/2853852456 shutdown_connections 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.144+0000 7fa1b3813640 1 -- 172.21.15.152:0/2853852456 wait complete. 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.145+0000 7fa1b3813640 1 Processor -- start 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.145+0000 7fa1b3813640 1 -- start start 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b3813640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac100b30 0x7fa1ac1a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b3813640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1ac101450 0x7fa1ac1a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b3813640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1ac105f40 0x7fa1ac19e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b3813640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac118580 con 0x7fa1ac105f40 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b3813640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac118400 con 0x7fa1ac100b30 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b3813640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac118700 con 0x7fa1ac101450 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b1db0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1ac105f40 0x7fa1ac19e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b15af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac100b30 0x7fa1ac1a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b1db0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1ac105f40 0x7fa1ac19e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49214/0 (socket says 172.21.15.152:49214) 2024-09-11T22:03:33.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b15af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac100b30 0x7fa1ac1a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:50382/0 (socket says 172.21.15.152:50382) 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b1db0640 1 -- 172.21.15.152:0/2627939373 learned_addr learned my addr 172.21.15.152:0/2627939373 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b0dae640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1ac101450 0x7fa1ac1a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b1db0640 1 -- 172.21.15.152:0/2627939373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1ac101450 msgr2=0x7fa1ac1a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b1db0640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1ac101450 0x7fa1ac1a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b1db0640 1 -- 172.21.15.152:0/2627939373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac100b30 msgr2=0x7fa1ac1a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b1db0640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac100b30 0x7fa1ac1a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b1db0640 1 -- 172.21.15.152:0/2627939373 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac19efa0 con 0x7fa1ac105f40 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b1db0640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1ac105f40 0x7fa1ac19e870 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4006010 tx=0x7fa1a402f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1a27fc640 1 -- 172.21.15.152:0/2627939373 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4034040 con 0x7fa1ac105f40 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b3813640 1 -- 172.21.15.152:0/2627939373 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ac19f230 con 0x7fa1ac105f40 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1a27fc640 1 -- 172.21.15.152:0/2627939373 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a4003e50 con 0x7fa1ac105f40 2024-09-11T22:03:33.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1a27fc640 1 -- 172.21.15.152:0/2627939373 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4004800 con 0x7fa1ac105f40 2024-09-11T22:03:33.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.146+0000 7fa1b3813640 1 -- 172.21.15.152:0/2627939373 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ac1ab580 con 0x7fa1ac105f40 2024-09-11T22:03:33.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.147+0000 7fa1b3813640 1 -- 172.21.15.152:0/2627939373 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1ac105920 con 0x7fa1ac105f40 2024-09-11T22:03:33.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.148+0000 7fa1a27fc640 1 -- 172.21.15.152:0/2627939373 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa1a4037020 con 0x7fa1ac105f40 2024-09-11T22:03:33.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.149+0000 7fa1a27fc640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa1980a2c10 0x7fa1980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:33.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.149+0000 7fa1b15af640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa1980a2c10 0x7fa1980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:33.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.149+0000 7fa1a27fc640 1 -- 172.21.15.152:0/2627939373 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fa1a40f0170 con 0x7fa1ac105f40 2024-09-11T22:03:33.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.150+0000 7fa1b15af640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa1980a2c10 0x7fa1980a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac19f9b0 tx=0x7fa1a800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:33.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.152+0000 7fa1a27fc640 1 -- 172.21.15.152:0/2627939373 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1a40098b0 con 0x7fa1ac105f40 2024-09-11T22:03:33.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.321+0000 7fa1b3813640 1 -- 172.21.15.152:0/2627939373 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa1ac1ab7b0 con 0x7fa1ac105f40 2024-09-11T22:03:33.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.322+0000 7fa1a27fc640 1 -- 172.21.15.152:0/2627939373 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa1a40bd0f0 con 0x7fa1ac105f40 2024-09-11T22:03:33.323 INFO:teuthology.orchestra.run.smithi152.stdout:77309411395 2024-09-11T22:03:33.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.324+0000 7fa1b3813640 1 -- 172.21.15.152:0/2627939373 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa1980a2c10 msgr2=0x7fa1980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:33.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.324+0000 7fa1b3813640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa1980a2c10 0x7fa1980a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac19f9b0 tx=0x7fa1a800b410 comp rx=0 tx=0).stop 2024-09-11T22:03:33.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.324+0000 7fa1b3813640 1 -- 172.21.15.152:0/2627939373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1ac105f40 msgr2=0x7fa1ac19e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:33.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.324+0000 7fa1b3813640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1ac105f40 0x7fa1ac19e870 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4006010 tx=0x7fa1a402f700 comp rx=0 tx=0).stop 2024-09-11T22:03:33.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.324+0000 7fa1b3813640 1 -- 172.21.15.152:0/2627939373 shutdown_connections 2024-09-11T22:03:33.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.324+0000 7fa1b3813640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1ac105f40 0x7fa1ac19e870 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.324+0000 7fa1b3813640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa1980a2c10 0x7fa1980a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.324+0000 7fa1b3813640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1ac101450 0x7fa1ac1a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.324+0000 7fa1b3813640 1 --2- 172.21.15.152:0/2627939373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac100b30 0x7fa1ac1a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.324+0000 7fa1b3813640 1 -- 172.21.15.152:0/2627939373 >> 172.21.15.152:0/2627939373 conn(0x7fa1ac0fc7a0 msgr2=0x7fa1ac1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:33.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.325+0000 7fa1b3813640 1 -- 172.21.15.152:0/2627939373 shutdown_connections 2024-09-11T22:03:33.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.325+0000 7fa1b3813640 1 -- 172.21.15.152:0/2627939373 wait complete. 2024-09-11T22:03:33.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.358+0000 7faf5ee46640 1 -- 172.21.15.152:0/3722405228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf58100a80 msgr2=0x7faf58100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:33.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.358+0000 7faf5ee46640 1 --2- 172.21.15.152:0/3722405228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf58100a80 0x7faf58100ee0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faf44009930 tx=0x7faf4402a420 comp rx=0 tx=0).stop 2024-09-11T22:03:33.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.358+0000 7faf5ee46640 1 -- 172.21.15.152:0/3722405228 shutdown_connections 2024-09-11T22:03:33.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.358+0000 7faf5ee46640 1 --2- 172.21.15.152:0/3722405228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf58101420 0x7faf5810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.358+0000 7faf5ee46640 1 --2- 172.21.15.152:0/3722405228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf58100a80 0x7faf58100ee0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.358+0000 7faf5ee46640 1 --2- 172.21.15.152:0/3722405228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58106a80 0x7faf58106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.358+0000 7faf5ee46640 1 -- 172.21.15.152:0/3722405228 >> 172.21.15.152:0/3722405228 conn(0x7faf580fc7a0 msgr2=0x7faf580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:33.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.358+0000 7faf5ee46640 1 -- 172.21.15.152:0/3722405228 shutdown_connections 2024-09-11T22:03:33.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.358+0000 7faf5ee46640 1 -- 172.21.15.152:0/3722405228 wait complete. 2024-09-11T22:03:33.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5ee46640 1 Processor -- start 2024-09-11T22:03:33.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5ee46640 1 -- start start 2024-09-11T22:03:33.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5ee46640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58100a80 0x7faf5819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:33.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5ee46640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf58101420 0x7faf5819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:33.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5ee46640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf58106a80 0x7faf5819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:33.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5ee46640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf58114180 con 0x7faf58101420 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5ee46640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faf58114000 con 0x7faf58100a80 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5ee46640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faf58114300 con 0x7faf58106a80 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5cbe2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58100a80 0x7faf5819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf57fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf58101420 0x7faf5819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5cbe2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58100a80 0x7faf5819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:51362/0 (socket says 172.21.15.152:51362) 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5cbe2640 1 -- 172.21.15.152:0/2286944703 learned_addr learned my addr 172.21.15.152:0/2286944703 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.359+0000 7faf5d3e3640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf58106a80 0x7faf5819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.360+0000 7faf57fff640 1 -- 172.21.15.152:0/2286944703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf58106a80 msgr2=0x7faf5819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.360+0000 7faf57fff640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf58106a80 0x7faf5819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.360+0000 7faf57fff640 1 -- 172.21.15.152:0/2286944703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58100a80 msgr2=0x7faf5819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.360+0000 7faf57fff640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58100a80 0x7faf5819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.360+0000 7faf57fff640 1 -- 172.21.15.152:0/2286944703 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5819f660 con 0x7faf58101420 2024-09-11T22:03:33.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.360+0000 7faf57fff640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf58101420 0x7faf5819abf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faf44005940 tx=0x7faf440040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:33.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.360+0000 7faf55ffb640 1 -- 172.21.15.152:0/2286944703 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4403f070 con 0x7faf58101420 2024-09-11T22:03:33.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.360+0000 7faf5ee46640 1 -- 172.21.15.152:0/2286944703 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5819f8f0 con 0x7faf58101420 2024-09-11T22:03:33.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.360+0000 7faf55ffb640 1 -- 172.21.15.152:0/2286944703 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf440044c0 con 0x7faf58101420 2024-09-11T22:03:33.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.360+0000 7faf55ffb640 1 -- 172.21.15.152:0/2286944703 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf44035070 con 0x7faf58101420 2024-09-11T22:03:33.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.360+0000 7faf5ee46640 1 -- 172.21.15.152:0/2286944703 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf581a7230 con 0x7faf58101420 2024-09-11T22:03:33.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.362+0000 7faf5ee46640 1 -- 172.21.15.152:0/2286944703 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf58100ee0 con 0x7faf58101420 2024-09-11T22:03:33.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.362+0000 7faf55ffb640 1 -- 172.21.15.152:0/2286944703 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7faf44043420 con 0x7faf58101420 2024-09-11T22:03:33.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.363+0000 7faf55ffb640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faf480a2c00 0x7faf480a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:33.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.364+0000 7faf5cbe2640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faf480a2c00 0x7faf480a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:33.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.364+0000 7faf55ffb640 1 -- 172.21.15.152:0/2286944703 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7faf440ef620 con 0x7faf58101420 2024-09-11T22:03:33.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.364+0000 7faf5cbe2640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faf480a2c00 0x7faf480a50c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009c10 tx=0x7faf4c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:33.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.368+0000 7faf55ffb640 1 -- 172.21.15.152:0/2286944703 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf440bbdb0 con 0x7faf58101420 2024-09-11T22:03:33.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.538+0000 7faf5ee46640 1 -- 172.21.15.152:0/2286944703 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7faf58109020 con 0x7faf58101420 2024-09-11T22:03:33.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.538+0000 7faf55ffb640 1 -- 172.21.15.152:0/2286944703 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faf440c00b0 con 0x7faf58101420 2024-09-11T22:03:33.539 INFO:teuthology.orchestra.run.smithi152.stdout:193273528368 2024-09-11T22:03:33.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.540+0000 7faf5ee46640 1 -- 172.21.15.152:0/2286944703 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faf480a2c00 msgr2=0x7faf480a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:33.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.540+0000 7faf5ee46640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faf480a2c00 0x7faf480a50c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009c10 tx=0x7faf4c005f90 comp rx=0 tx=0).stop 2024-09-11T22:03:33.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.540+0000 7faf5ee46640 1 -- 172.21.15.152:0/2286944703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf58101420 msgr2=0x7faf5819abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:33.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.540+0000 7faf5ee46640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf58101420 0x7faf5819abf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faf44005940 tx=0x7faf440040c0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.540+0000 7faf5ee46640 1 -- 172.21.15.152:0/2286944703 shutdown_connections 2024-09-11T22:03:33.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.540+0000 7faf5ee46640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7faf480a2c00 0x7faf480a50c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.540+0000 7faf5ee46640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf58106a80 0x7faf5819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.540+0000 7faf5ee46640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf58101420 0x7faf5819abf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.540+0000 7faf5ee46640 1 --2- 172.21.15.152:0/2286944703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58100a80 0x7faf5819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:33.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.540+0000 7faf5ee46640 1 -- 172.21.15.152:0/2286944703 >> 172.21.15.152:0/2286944703 conn(0x7faf580fc7a0 msgr2=0x7faf580fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:33.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.541+0000 7faf5ee46640 1 -- 172.21.15.152:0/2286944703 shutdown_connections 2024-09-11T22:03:33.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:33.541+0000 7faf5ee46640 1 -- 172.21.15.152:0/2286944703 wait complete. 2024-09-11T22:03:33.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:33 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2627939373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T22:03:33.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:33 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2627939373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T22:03:33.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:33 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2627939373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T22:03:33.894 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411392 got 77309411395 for osd.2 2024-09-11T22:03:33.895 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:34.424 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:34 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2286944703' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T22:03:34.424 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:34 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.424 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:34 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.424 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:34 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.424 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:34 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.424 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:34 smithi152 ceph-mon[31188]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T22:03:34.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:34 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2286944703' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T22:03:34.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:34 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:34 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:34 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:34 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:34 smithi179 ceph-mon[35603]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T22:03:34.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:34 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2286944703' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T22:03:34.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:34 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:34 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:34 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:34 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:34.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:34 smithi193 ceph-mon[35545]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T22:03:34.992 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738442 got 34359738445 for osd.0 2024-09-11T22:03:34.993 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:35.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.510+0000 7f6d73062640 1 -- 172.21.15.152:0/1714368208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d6c112640 msgr2=0x7f6d6c112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:35.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.510+0000 7f6d73062640 1 --2- 172.21.15.152:0/1714368208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d6c112640 0x7f6d6c112a20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009900 tx=0x7f6d6002a3f0 comp rx=0 tx=0).stop 2024-09-11T22:03:35.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.510+0000 7f6d73062640 1 -- 172.21.15.152:0/1714368208 shutdown_connections 2024-09-11T22:03:35.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.510+0000 7f6d73062640 1 --2- 172.21.15.152:0/1714368208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d6c10cf30 0x7f6d6c119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:35.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.510+0000 7f6d73062640 1 --2- 172.21.15.152:0/1714368208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6c10c590 0x7f6d6c10c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:35.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.510+0000 7f6d73062640 1 --2- 172.21.15.152:0/1714368208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d6c112640 0x7f6d6c112a20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:35.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.510+0000 7f6d73062640 1 -- 172.21.15.152:0/1714368208 >> 172.21.15.152:0/1714368208 conn(0x7f6d6c06cdc0 msgr2=0x7f6d6c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:35.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.510+0000 7f6d73062640 1 -- 172.21.15.152:0/1714368208 shutdown_connections 2024-09-11T22:03:35.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.510+0000 7f6d73062640 1 -- 172.21.15.152:0/1714368208 wait complete. 2024-09-11T22:03:35.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d73062640 1 Processor -- start 2024-09-11T22:03:35.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d73062640 1 -- start start 2024-09-11T22:03:35.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d73062640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d6c10c590 0x7f6d6c1a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:35.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d73062640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6c10cf30 0x7f6d6c1a3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:35.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d73062640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d6c112640 0x7f6d6c1a7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:35.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d73062640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6c11c960 con 0x7f6d6c112640 2024-09-11T22:03:35.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d73062640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6c11c7e0 con 0x7f6d6c10cf30 2024-09-11T22:03:35.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d73062640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6c11cae0 con 0x7f6d6c10c590 2024-09-11T22:03:35.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d715ff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d6c112640 0x7f6d6c1a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:35.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d715ff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d6c112640 0x7f6d6c1a7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38132/0 (socket says 172.21.15.152:38132) 2024-09-11T22:03:35.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d715ff640 1 -- 172.21.15.152:0/1932618846 learned_addr learned my addr 172.21.15.152:0/1932618846 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:35.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d70dfe640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d6c10c590 0x7f6d6c1a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:35.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d6bfff640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6c10cf30 0x7f6d6c1a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:35.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d715ff640 1 -- 172.21.15.152:0/1932618846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d6c10c590 msgr2=0x7f6d6c1a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:35.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d715ff640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d6c10c590 0x7f6d6c1a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d715ff640 1 -- 172.21.15.152:0/1932618846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6c10cf30 msgr2=0x7f6d6c1a3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d715ff640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6c10cf30 0x7f6d6c1a3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.511+0000 7f6d715ff640 1 -- 172.21.15.152:0/1932618846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6c1a7ce0 con 0x7f6d6c112640 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.512+0000 7f6d6bfff640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6c10cf30 0x7f6d6c1a3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.512+0000 7f6d715ff640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d6c112640 0x7f6d6c1a7600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400cce0 tx=0x7f6d6400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.512+0000 7f6d69ffb640 1 -- 172.21.15.152:0/1932618846 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400f450 con 0x7f6d6c112640 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.512+0000 7f6d73062640 1 -- 172.21.15.152:0/1932618846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d6c1a7fd0 con 0x7f6d6c112640 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.512+0000 7f6d69ffb640 1 -- 172.21.15.152:0/1932618846 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d6400fad0 con 0x7f6d6c112640 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.512+0000 7f6d69ffb640 1 -- 172.21.15.152:0/1932618846 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64018c10 con 0x7f6d6c112640 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.512+0000 7f6d73062640 1 -- 172.21.15.152:0/1932618846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d6c1af8b0 con 0x7f6d6c112640 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.513+0000 7f6d73062640 1 -- 172.21.15.152:0/1932618846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d6c10c9f0 con 0x7f6d6c112640 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.514+0000 7f6d69ffb640 1 -- 172.21.15.152:0/1932618846 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6d6400f5f0 con 0x7f6d6c112640 2024-09-11T22:03:35.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.515+0000 7f6d69ffb640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6d5c0a2c10 0x7f6d5c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:35.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.515+0000 7f6d70dfe640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6d5c0a2c10 0x7f6d5c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:35.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.515+0000 7f6d69ffb640 1 -- 172.21.15.152:0/1932618846 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f6d640cf820 con 0x7f6d6c112640 2024-09-11T22:03:35.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.515+0000 7f6d70dfe640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6d5c0a2c10 0x7f6d5c0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d60000c00 tx=0x7f6d600058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:35.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.519+0000 7f6d69ffb640 1 -- 172.21.15.152:0/1932618846 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d64014030 con 0x7f6d6c112640 2024-09-11T22:03:35.676 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528366 got 193273528368 for osd.6 2024-09-11T22:03:35.676 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:35.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.697+0000 7f6d73062640 1 -- 172.21.15.152:0/1932618846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f6d6c1afb90 con 0x7f6d6c112640 2024-09-11T22:03:35.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.698+0000 7f6d69ffb640 1 -- 172.21.15.152:0/1932618846 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6d6409c600 con 0x7f6d6c112640 2024-09-11T22:03:35.701 INFO:teuthology.orchestra.run.smithi152.stdout:274877906978 2024-09-11T22:03:35.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 -- 172.21.15.152:0/1932618846 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6d5c0a2c10 msgr2=0x7f6d5c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:35.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6d5c0a2c10 0x7f6d5c0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d60000c00 tx=0x7f6d600058d0 comp rx=0 tx=0).stop 2024-09-11T22:03:35.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 -- 172.21.15.152:0/1932618846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d6c112640 msgr2=0x7f6d6c1a7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:35.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d6c112640 0x7f6d6c1a7600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400cce0 tx=0x7f6d6400a620 comp rx=0 tx=0).stop 2024-09-11T22:03:35.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 -- 172.21.15.152:0/1932618846 shutdown_connections 2024-09-11T22:03:35.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d6c112640 0x7f6d6c1a7600 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:35.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6c10cf30 0x7f6d6c1a3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:35.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6d5c0a2c10 0x7f6d5c0a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:35.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 --2- 172.21.15.152:0/1932618846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d6c10c590 0x7f6d6c1a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:35.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 -- 172.21.15.152:0/1932618846 >> 172.21.15.152:0/1932618846 conn(0x7f6d6c06cdc0 msgr2=0x7f6d6c10adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:35.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 -- 172.21.15.152:0/1932618846 shutdown_connections 2024-09-11T22:03:35.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:35.700+0000 7f6d73062640 1 -- 172.21.15.152:0/1932618846 wait complete. 2024-09-11T22:03:35.975 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:35 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1932618846' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T22:03:36.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:35 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1932618846' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T22:03:36.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:35 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1932618846' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T22:03:36.230 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906974 got 274877906978 for osd.9 2024-09-11T22:03:36.247 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:36.247 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T22:03:36.247 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:03:36.905 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:37.016 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:36 smithi152 ceph-mon[31188]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:37.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:36 smithi179 ceph-mon[35603]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:37.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:36 smithi193 ceph-mon[35545]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:37.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 -- 172.21.15.152:0/528805041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5481082a0 msgr2=0x7fd54810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:37.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 --2- 172.21.15.152:0/528805041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5481082a0 0x7fd54810ec40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd540009cd0 tx=0x7fd54002a910 comp rx=0 tx=0).stop 2024-09-11T22:03:37.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 -- 172.21.15.152:0/528805041 shutdown_connections 2024-09-11T22:03:37.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 --2- 172.21.15.152:0/528805041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5481082a0 0x7fd54810ec40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:37.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 --2- 172.21.15.152:0/528805041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5481036e0 0x7fd548107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:37.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 --2- 172.21.15.152:0/528805041 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd548102d30 0x7fd548103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:37.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 -- 172.21.15.152:0/528805041 >> 172.21.15.152:0/528805041 conn(0x7fd5480fc7d0 msgr2=0x7fd5480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:37.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 -- 172.21.15.152:0/528805041 shutdown_connections 2024-09-11T22:03:37.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 -- 172.21.15.152:0/528805041 wait complete. 2024-09-11T22:03:37.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 Processor -- start 2024-09-11T22:03:37.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 -- start start 2024-09-11T22:03:37.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd548102d30 0x7fd5481985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5481036e0 0x7fd548198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5481082a0 0x7fd54819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd548112100 con 0x7fd5481082a0 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd548111f80 con 0x7fd548102d30 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.264+0000 7fd54f634640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd548112280 con 0x7fd5481036e0 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd54dbd1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5481082a0 0x7fd54819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd54dbd1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5481082a0 0x7fd54819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38160/0 (socket says 172.21.15.152:38160) 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd54dbd1640 1 -- 172.21.15.152:0/1776204205 learned_addr learned my addr 172.21.15.152:0/1776204205 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd54d3d0640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd548102d30 0x7fd5481985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd54cbcf640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5481036e0 0x7fd548198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd54dbd1640 1 -- 172.21.15.152:0/1776204205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5481036e0 msgr2=0x7fd548198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:37.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd54dbd1640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5481036e0 0x7fd548198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:37.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd54dbd1640 1 -- 172.21.15.152:0/1776204205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd548102d30 msgr2=0x7fd5481985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:37.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd54dbd1640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd548102d30 0x7fd5481985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:37.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd54dbd1640 1 -- 172.21.15.152:0/1776204205 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54819d550 con 0x7fd5481082a0 2024-09-11T22:03:37.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd54dbd1640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5481082a0 0x7fd54819ce70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd540005cc0 tx=0x7fd540003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:37.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.265+0000 7fd53e7fc640 1 -- 172.21.15.152:0/1776204205 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd540031660 con 0x7fd5481082a0 2024-09-11T22:03:37.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.266+0000 7fd53e7fc640 1 -- 172.21.15.152:0/1776204205 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd540031800 con 0x7fd5481082a0 2024-09-11T22:03:37.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.266+0000 7fd54f634640 1 -- 172.21.15.152:0/1776204205 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54819d7e0 con 0x7fd5481082a0 2024-09-11T22:03:37.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.266+0000 7fd54f634640 1 -- 172.21.15.152:0/1776204205 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5481a5120 con 0x7fd5481082a0 2024-09-11T22:03:37.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.266+0000 7fd53e7fc640 1 -- 172.21.15.152:0/1776204205 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54002fb00 con 0x7fd5481082a0 2024-09-11T22:03:37.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.267+0000 7fd54f634640 1 -- 172.21.15.152:0/1776204205 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd548103110 con 0x7fd5481082a0 2024-09-11T22:03:37.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.268+0000 7fd53e7fc640 1 -- 172.21.15.152:0/1776204205 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd54002fd80 con 0x7fd5481082a0 2024-09-11T22:03:37.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.268+0000 7fd53e7fc640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5340a2c10 0x7fd5340a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:37.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.268+0000 7fd54d3d0640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5340a2c10 0x7fd5340a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:37.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.269+0000 7fd53e7fc640 1 -- 172.21.15.152:0/1776204205 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fd5400f05e0 con 0x7fd5481082a0 2024-09-11T22:03:37.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.269+0000 7fd54d3d0640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5340a2c10 0x7fd5340a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd538005fd0 tx=0x7fd53800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:37.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.273+0000 7fd53e7fc640 1 -- 172.21.15.152:0/1776204205 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5400bd4d0 con 0x7fd5481082a0 2024-09-11T22:03:37.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.452+0000 7fd54f634640 1 -- 172.21.15.152:0/1776204205 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd548107420 con 0x7fd5340a2c10 2024-09-11T22:03:37.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.458+0000 7fd53e7fc640 1 -- 172.21.15.152:0/1776204205 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258715 (secure 0 0 0) 0x7fd548107420 con 0x7fd5340a2c10 2024-09-11T22:03:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:37.463 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-09-11T22:03:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 -- 172.21.15.152:0/1776204205 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5340a2c10 msgr2=0x7fd5340a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5340a2c10 0x7fd5340a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd538005fd0 tx=0x7fd53800b390 comp rx=0 tx=0).stop 2024-09-11T22:03:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 -- 172.21.15.152:0/1776204205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5481082a0 msgr2=0x7fd54819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5481082a0 0x7fd54819ce70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd540005cc0 tx=0x7fd540003f90 comp rx=0 tx=0).stop 2024-09-11T22:03:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 -- 172.21.15.152:0/1776204205 shutdown_connections 2024-09-11T22:03:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5481082a0 0x7fd54819ce70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd5340a2c10 0x7fd5340a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5481036e0 0x7fd548198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 --2- 172.21.15.152:0/1776204205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd548102d30 0x7fd5481985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 -- 172.21.15.152:0/1776204205 >> 172.21.15.152:0/1776204205 conn(0x7fd5480fc7d0 msgr2=0x7fd548105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 -- 172.21.15.152:0/1776204205 shutdown_connections 2024-09-11T22:03:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:37.463+0000 7fd54f634640 1 -- 172.21.15.152:0/1776204205 wait complete. 2024-09-11T22:03:38.176 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-09-11T22:03:36.288199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":460,"num_read_kb":349,"num_write":347,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366368,"kb_used_data":12924,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575456,"statfs":{"total":1151940427776,"available":1151565266944,"internally_reserved":0,"allocated":13234176,"data_stored":7276242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002687"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344542+0000","last_change":"2024-09-11T22:02:36.105689+0000","last_active":"2024-09-11T22:02:55.344542+0000","last_peered":"2024-09-11T22:02:55.344542+0000","last_clean":"2024-09-11T22:02:55.344542+0000","last_became_active":"2024-09-11T22:02:36.105128+0000","last_became_peered":"2024-09-11T22:02:36.105128+0000","last_unstale":"2024-09-11T22:02:55.344542+0000","last_undegraded":"2024-09-11T22:02:55.344542+0000","last_fullsized":"2024-09-11T22:02:55.344542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:18.018731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344016+0000","last_change":"2024-09-11T22:02:36.096961+0000","last_active":"2024-09-11T22:02:55.344016+0000","last_peered":"2024-09-11T22:02:55.344016+0000","last_clean":"2024-09-11T22:02:55.344016+0000","last_became_active":"2024-09-11T22:02:36.096540+0000","last_became_peered":"2024-09-11T22:02:36.096540+0000","last_unstale":"2024-09-11T22:02:55.344016+0000","last_undegraded":"2024-09-11T22:02:55.344016+0000","last_fullsized":"2024-09-11T22:02:55.344016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:48.517125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343560+0000","last_change":"2024-09-11T22:02:36.108119+0000","last_active":"2024-09-11T22:02:55.343560+0000","last_peered":"2024-09-11T22:02:55.343560+0000","last_clean":"2024-09-11T22:02:55.343560+0000","last_became_active":"2024-09-11T22:02:36.107737+0000","last_became_peered":"2024-09-11T22:02:36.107737+0000","last_unstale":"2024-09-11T22:02:55.343560+0000","last_undegraded":"2024-09-11T22:02:55.343560+0000","last_fullsized":"2024-09-11T22:02:55.343560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:54.225935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543552+0000","last_change":"2024-09-11T22:02:36.107710+0000","last_active":"2024-09-11T22:02:55.543552+0000","last_peered":"2024-09-11T22:02:55.543552+0000","last_clean":"2024-09-11T22:02:55.543552+0000","last_became_active":"2024-09-11T22:02:36.107327+0000","last_became_peered":"2024-09-11T22:02:36.107327+0000","last_unstale":"2024-09-11T22:02:55.543552+0000","last_undegraded":"2024-09-11T22:02:55.543552+0000","last_fullsized":"2024-09-11T22:02:55.543552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.358535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347186+0000","last_change":"2024-09-11T22:02:36.100531+0000","last_active":"2024-09-11T22:02:55.347186+0000","last_peered":"2024-09-11T22:02:55.347186+0000","last_clean":"2024-09-11T22:02:55.347186+0000","last_became_active":"2024-09-11T22:02:36.100187+0000","last_became_peered":"2024-09-11T22:02:36.100187+0000","last_unstale":"2024-09-11T22:02:55.347186+0000","last_undegraded":"2024-09-11T22:02:55.347186+0000","last_fullsized":"2024-09-11T22:02:55.347186+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.156080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.848619+0000","last_change":"2024-09-11T22:02:36.101316+0000","last_active":"2024-09-11T22:02:55.848619+0000","last_peered":"2024-09-11T22:02:55.848619+0000","last_clean":"2024-09-11T22:02:55.848619+0000","last_became_active":"2024-09-11T22:02:36.100985+0000","last_became_peered":"2024-09-11T22:02:36.100985+0000","last_unstale":"2024-09-11T22:02:55.848619+0000","last_undegraded":"2024-09-11T22:02:55.848619+0000","last_fullsized":"2024-09-11T22:02:55.848619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:55.972974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343776+0000","last_change":"2024-09-11T22:02:36.109146+0000","last_active":"2024-09-11T22:02:55.343776+0000","last_peered":"2024-09-11T22:02:55.343776+0000","last_clean":"2024-09-11T22:02:55.343776+0000","last_became_active":"2024-09-11T22:02:36.108817+0000","last_became_peered":"2024-09-11T22:02:36.108817+0000","last_unstale":"2024-09-11T22:02:55.343776+0000","last_undegraded":"2024-09-11T22:02:55.343776+0000","last_fullsized":"2024-09-11T22:02:55.343776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.222383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.345959+0000","last_change":"2024-09-11T22:02:36.100362+0000","last_active":"2024-09-11T22:02:55.345959+0000","last_peered":"2024-09-11T22:02:55.345959+0000","last_clean":"2024-09-11T22:02:55.345959+0000","last_became_active":"2024-09-11T22:02:36.100088+0000","last_became_peered":"2024-09-11T22:02:36.100088+0000","last_unstale":"2024-09-11T22:02:55.345959+0000","last_undegraded":"2024-09-11T22:02:55.345959+0000","last_fullsized":"2024-09-11T22:02:55.345959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.478879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342352+0000","last_change":"2024-09-11T22:02:36.106360+0000","last_active":"2024-09-11T22:02:55.342352+0000","last_peered":"2024-09-11T22:02:55.342352+0000","last_clean":"2024-09-11T22:02:55.342352+0000","last_became_active":"2024-09-11T22:02:36.105994+0000","last_became_peered":"2024-09-11T22:02:36.105994+0000","last_unstale":"2024-09-11T22:02:55.342352+0000","last_undegraded":"2024-09-11T22:02:55.342352+0000","last_fullsized":"2024-09-11T22:02:55.342352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:33.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.849028+0000","last_change":"2024-09-11T22:02:36.109477+0000","last_active":"2024-09-11T22:02:55.849028+0000","last_peered":"2024-09-11T22:02:55.849028+0000","last_clean":"2024-09-11T22:02:55.849028+0000","last_became_active":"2024-09-11T22:02:36.109077+0000","last_became_peered":"2024-09-11T22:02:36.109077+0000","last_unstale":"2024-09-11T22:02:55.849028+0000","last_undegraded":"2024-09-11T22:02:55.849028+0000","last_fullsized":"2024-09-11T22:02:55.849028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.862359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343838+0000","last_change":"2024-09-11T22:02:36.112998+0000","last_active":"2024-09-11T22:02:55.343838+0000","last_peered":"2024-09-11T22:02:55.343838+0000","last_clean":"2024-09-11T22:02:55.343838+0000","last_became_active":"2024-09-11T22:02:36.112649+0000","last_became_peered":"2024-09-11T22:02:36.112649+0000","last_unstale":"2024-09-11T22:02:55.343838+0000","last_undegraded":"2024-09-11T22:02:55.343838+0000","last_fullsized":"2024-09-11T22:02:55.343838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:01.582572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543593+0000","last_change":"2024-09-11T22:02:36.099591+0000","last_active":"2024-09-11T22:02:55.543593+0000","last_peered":"2024-09-11T22:02:55.543593+0000","last_clean":"2024-09-11T22:02:55.543593+0000","last_became_active":"2024-09-11T22:02:36.099269+0000","last_became_peered":"2024-09-11T22:02:36.099269+0000","last_unstale":"2024-09-11T22:02:55.543593+0000","last_undegraded":"2024-09-11T22:02:55.543593+0000","last_fullsized":"2024-09-11T22:02:55.543593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:10.918188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340976+0000","last_change":"2024-09-11T22:02:36.100056+0000","last_active":"2024-09-11T22:02:55.340976+0000","last_peered":"2024-09-11T22:02:55.340976+0000","last_clean":"2024-09-11T22:02:55.340976+0000","last_became_active":"2024-09-11T22:02:36.099717+0000","last_became_peered":"2024-09-11T22:02:36.099717+0000","last_unstale":"2024-09-11T22:02:55.340976+0000","last_undegraded":"2024-09-11T22:02:55.340976+0000","last_fullsized":"2024-09-11T22:02:55.340976+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.486256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343551+0000","last_change":"2024-09-11T22:02:36.097281+0000","last_active":"2024-09-11T22:02:55.343551+0000","last_peered":"2024-09-11T22:02:55.343551+0000","last_clean":"2024-09-11T22:02:55.343551+0000","last_became_active":"2024-09-11T22:02:36.096768+0000","last_became_peered":"2024-09-11T22:02:36.096768+0000","last_unstale":"2024-09-11T22:02:55.343551+0000","last_undegraded":"2024-09-11T22:02:55.343551+0000","last_fullsized":"2024-09-11T22:02:55.343551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:31.232578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.351065+0000","last_change":"2024-09-11T22:02:55.351065+0000","last_active":"2024-09-11T22:02:55.351065+0000","last_peered":"2024-09-11T22:02:55.351065+0000","last_clean":"2024-09-11T22:02:55.351065+0000","last_became_active":"2024-09-11T22:02:55.350669+0000","last_became_peered":"2024-09-11T22:02:55.350669+0000","last_unstale":"2024-09-11T22:02:55.351065+0000","last_undegraded":"2024-09-11T22:02:55.351065+0000","last_fullsized":"2024-09-11T22:02:55.351065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:51.799060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341690+0000","last_change":"2024-09-11T22:02:36.109573+0000","last_active":"2024-09-11T22:02:55.341690+0000","last_peered":"2024-09-11T22:02:55.341690+0000","last_clean":"2024-09-11T22:02:55.341690+0000","last_became_active":"2024-09-11T22:02:36.109019+0000","last_became_peered":"2024-09-11T22:02:36.109019+0000","last_unstale":"2024-09-11T22:02:55.341690+0000","last_undegraded":"2024-09-11T22:02:55.341690+0000","last_fullsized":"2024-09-11T22:02:55.341690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:39.699762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344337+0000","last_change":"2024-09-11T22:02:36.105427+0000","last_active":"2024-09-11T22:02:55.344337+0000","last_peered":"2024-09-11T22:02:55.344337+0000","last_clean":"2024-09-11T22:02:55.344337+0000","last_became_active":"2024-09-11T22:02:36.104712+0000","last_became_peered":"2024-09-11T22:02:36.104712+0000","last_unstale":"2024-09-11T22:02:55.344337+0000","last_undegraded":"2024-09-11T22:02:55.344337+0000","last_fullsized":"2024-09-11T22:02:55.344337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:45.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344194+0000","last_change":"2024-09-11T22:02:36.097925+0000","last_active":"2024-09-11T22:02:55.344194+0000","last_peered":"2024-09-11T22:02:55.344194+0000","last_clean":"2024-09-11T22:02:55.344194+0000","last_became_active":"2024-09-11T22:02:36.097649+0000","last_became_peered":"2024-09-11T22:02:36.097649+0000","last_unstale":"2024-09-11T22:02:55.344194+0000","last_undegraded":"2024-09-11T22:02:55.344194+0000","last_fullsized":"2024-09-11T22:02:55.344194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.272197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347308+0000","last_change":"2024-09-11T22:02:36.107266+0000","last_active":"2024-09-11T22:02:55.347308+0000","last_peered":"2024-09-11T22:02:55.347308+0000","last_clean":"2024-09-11T22:02:55.347308+0000","last_became_active":"2024-09-11T22:02:36.106865+0000","last_became_peered":"2024-09-11T22:02:36.106865+0000","last_unstale":"2024-09-11T22:02:55.347308+0000","last_undegraded":"2024-09-11T22:02:55.347308+0000","last_fullsized":"2024-09-11T22:02:55.347308+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:53.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.349854+0000","last_change":"2024-09-11T22:02:55.349854+0000","last_active":"2024-09-11T22:02:55.349854+0000","last_peered":"2024-09-11T22:02:55.349854+0000","last_clean":"2024-09-11T22:02:55.349854+0000","last_became_active":"2024-09-11T22:02:55.349521+0000","last_became_peered":"2024-09-11T22:02:55.349521+0000","last_unstale":"2024-09-11T22:02:55.349854+0000","last_undegraded":"2024-09-11T22:02:55.349854+0000","last_fullsized":"2024-09-11T22:02:55.349854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341046+0000","last_change":"2024-09-11T22:02:36.110460+0000","last_active":"2024-09-11T22:02:55.341046+0000","last_peered":"2024-09-11T22:02:55.341046+0000","last_clean":"2024-09-11T22:02:55.341046+0000","last_became_active":"2024-09-11T22:02:36.110136+0000","last_became_peered":"2024-09-11T22:02:36.110136+0000","last_unstale":"2024-09-11T22:02:55.341046+0000","last_undegraded":"2024-09-11T22:02:55.341046+0000","last_fullsized":"2024-09-11T22:02:55.341046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:30.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341898+0000","last_change":"2024-09-11T22:02:36.111403+0000","last_active":"2024-09-11T22:02:55.341898+0000","last_peered":"2024-09-11T22:02:55.341898+0000","last_clean":"2024-09-11T22:02:55.341898+0000","last_became_active":"2024-09-11T22:02:36.110976+0000","last_became_peered":"2024-09-11T22:02:36.110976+0000","last_unstale":"2024-09-11T22:02:55.341898+0000","last_undegraded":"2024-09-11T22:02:55.341898+0000","last_fullsized":"2024-09-11T22:02:55.341898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:03.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346312+0000","last_change":"2024-09-11T22:02:36.110002+0000","last_active":"2024-09-11T22:02:55.346312+0000","last_peered":"2024-09-11T22:02:55.346312+0000","last_clean":"2024-09-11T22:02:55.346312+0000","last_became_active":"2024-09-11T22:02:36.109694+0000","last_became_peered":"2024-09-11T22:02:36.109694+0000","last_unstale":"2024-09-11T22:02:55.346312+0000","last_undegraded":"2024-09-11T22:02:55.346312+0000","last_fullsized":"2024-09-11T22:02:55.346312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:00.338509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341649+0000","last_change":"2024-09-11T22:02:36.101638+0000","last_active":"2024-09-11T22:02:55.341649+0000","last_peered":"2024-09-11T22:02:55.341649+0000","last_clean":"2024-09-11T22:02:55.341649+0000","last_became_active":"2024-09-11T22:02:36.101363+0000","last_became_peered":"2024-09-11T22:02:36.101363+0000","last_unstale":"2024-09-11T22:02:55.341649+0000","last_undegraded":"2024-09-11T22:02:55.341649+0000","last_fullsized":"2024-09-11T22:02:55.341649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:35.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346849+0000","last_change":"2024-09-11T22:02:36.109250+0000","last_active":"2024-09-11T22:02:55.346849+0000","last_peered":"2024-09-11T22:02:55.346849+0000","last_clean":"2024-09-11T22:02:55.346849+0000","last_became_active":"2024-09-11T22:02:36.108931+0000","last_became_peered":"2024-09-11T22:02:36.108931+0000","last_unstale":"2024-09-11T22:02:55.346849+0000","last_undegraded":"2024-09-11T22:02:55.346849+0000","last_fullsized":"2024-09-11T22:02:55.346849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:09.616621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347177+0000","last_change":"2024-09-11T22:02:36.113064+0000","last_active":"2024-09-11T22:02:55.347177+0000","last_peered":"2024-09-11T22:02:55.347177+0000","last_clean":"2024-09-11T22:02:55.347177+0000","last_became_active":"2024-09-11T22:02:36.112674+0000","last_became_peered":"2024-09-11T22:02:36.112674+0000","last_unstale":"2024-09-11T22:02:55.347177+0000","last_undegraded":"2024-09-11T22:02:55.347177+0000","last_fullsized":"2024-09-11T22:02:55.347177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:17.923053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344175+0000","last_change":"2024-09-11T22:02:36.101799+0000","last_active":"2024-09-11T22:02:55.344175+0000","last_peered":"2024-09-11T22:02:55.344175+0000","last_clean":"2024-09-11T22:02:55.344175+0000","last_became_active":"2024-09-11T22:02:36.101429+0000","last_became_peered":"2024-09-11T22:02:36.101429+0000","last_unstale":"2024-09-11T22:02:55.344175+0000","last_undegraded":"2024-09-11T22:02:55.344175+0000","last_fullsized":"2024-09-11T22:02:55.344175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.597619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340909+0000","last_change":"2024-09-11T22:02:36.100993+0000","last_active":"2024-09-11T22:02:55.340909+0000","last_peered":"2024-09-11T22:02:55.340909+0000","last_clean":"2024-09-11T22:02:55.340909+0000","last_became_active":"2024-09-11T22:02:36.100678+0000","last_became_peered":"2024-09-11T22:02:36.100678+0000","last_unstale":"2024-09-11T22:02:55.340909+0000","last_undegraded":"2024-09-11T22:02:55.340909+0000","last_fullsized":"2024-09-11T22:02:55.340909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:18.808422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344166+0000","last_change":"2024-09-11T22:02:36.103507+0000","last_active":"2024-09-11T22:02:55.344166+0000","last_peered":"2024-09-11T22:02:55.344166+0000","last_clean":"2024-09-11T22:02:55.344166+0000","last_became_active":"2024-09-11T22:02:36.103228+0000","last_became_peered":"2024-09-11T22:02:36.103228+0000","last_unstale":"2024-09-11T22:02:55.344166+0000","last_undegraded":"2024-09-11T22:02:55.344166+0000","last_fullsized":"2024-09-11T22:02:55.344166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.898635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347429+0000","last_change":"2024-09-11T22:02:36.104734+0000","last_active":"2024-09-11T22:02:55.347429+0000","last_peered":"2024-09-11T22:02:55.347429+0000","last_clean":"2024-09-11T22:02:55.347429+0000","last_became_active":"2024-09-11T22:02:36.103974+0000","last_became_peered":"2024-09-11T22:02:36.103974+0000","last_unstale":"2024-09-11T22:02:55.347429+0000","last_undegraded":"2024-09-11T22:02:55.347429+0000","last_fullsized":"2024-09-11T22:02:55.347429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:54.142031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347545+0000","last_change":"2024-09-11T22:02:36.106103+0000","last_active":"2024-09-11T22:02:55.347545+0000","last_peered":"2024-09-11T22:02:55.347545+0000","last_clean":"2024-09-11T22:02:55.347545+0000","last_became_active":"2024-09-11T22:02:36.105792+0000","last_became_peered":"2024-09-11T22:02:36.105792+0000","last_unstale":"2024-09-11T22:02:55.347545+0000","last_undegraded":"2024-09-11T22:02:55.347545+0000","last_fullsized":"2024-09-11T22:02:55.347545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:06.607094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343742+0000","last_change":"2024-09-11T22:02:36.104147+0000","last_active":"2024-09-11T22:02:55.343742+0000","last_peered":"2024-09-11T22:02:55.343742+0000","last_clean":"2024-09-11T22:02:55.343742+0000","last_became_active":"2024-09-11T22:02:36.103782+0000","last_became_peered":"2024-09-11T22:02:36.103782+0000","last_unstale":"2024-09-11T22:02:55.343742+0000","last_undegraded":"2024-09-11T22:02:55.343742+0000","last_fullsized":"2024-09-11T22:02:55.343742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.127609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348453+0000","last_change":"2024-09-11T22:02:36.101259+0000","last_active":"2024-09-11T22:02:55.348453+0000","last_peered":"2024-09-11T22:02:55.348453+0000","last_clean":"2024-09-11T22:02:55.348453+0000","last_became_active":"2024-09-11T22:02:36.100761+0000","last_became_peered":"2024-09-11T22:02:36.100761+0000","last_unstale":"2024-09-11T22:02:55.348453+0000","last_undegraded":"2024-09-11T22:02:55.348453+0000","last_fullsized":"2024-09-11T22:02:55.348453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:47.045252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":79,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:31.910055+0000","last_change":"2024-09-11T22:02:34.084522+0000","last_active":"2024-09-11T22:03:31.910055+0000","last_peered":"2024-09-11T22:03:31.910055+0000","last_clean":"2024-09-11T22:03:31.910055+0000","last_became_active":"2024-09-11T22:02:34.084211+0000","last_became_peered":"2024-09-11T22:02:34.084211+0000","last_unstale":"2024-09-11T22:03:31.910055+0000","last_undegraded":"2024-09-11T22:03:31.910055+0000","last_fullsized":"2024-09-11T22:03:31.910055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:18.963998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341673+0000","last_change":"2024-09-11T22:02:36.106890+0000","last_active":"2024-09-11T22:02:55.341673+0000","last_peered":"2024-09-11T22:02:55.341673+0000","last_clean":"2024-09-11T22:02:55.341673+0000","last_became_active":"2024-09-11T22:02:36.105255+0000","last_became_peered":"2024-09-11T22:02:36.105255+0000","last_unstale":"2024-09-11T22:02:55.341673+0000","last_undegraded":"2024-09-11T22:02:55.341673+0000","last_fullsized":"2024-09-11T22:02:55.341673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.995542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.848667+0000","last_change":"2024-09-11T22:02:34.079967+0000","last_active":"2024-09-11T22:02:55.848667+0000","last_peered":"2024-09-11T22:02:55.848667+0000","last_clean":"2024-09-11T22:02:55.848667+0000","last_became_active":"2024-09-11T22:02:34.079649+0000","last_became_peered":"2024-09-11T22:02:34.079649+0000","last_unstale":"2024-09-11T22:02:55.848667+0000","last_undegraded":"2024-09-11T22:02:55.848667+0000","last_fullsized":"2024-09-11T22:02:55.848667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.661256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340684+0000","last_change":"2024-09-11T22:02:34.079850+0000","last_active":"2024-09-11T22:02:55.340684+0000","last_peered":"2024-09-11T22:02:55.340684+0000","last_clean":"2024-09-11T22:02:55.340684+0000","last_became_active":"2024-09-11T22:02:34.079514+0000","last_became_peered":"2024-09-11T22:02:34.079514+0000","last_unstale":"2024-09-11T22:02:55.340684+0000","last_undegraded":"2024-09-11T22:02:55.340684+0000","last_fullsized":"2024-09-11T22:02:55.340684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.359482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346279+0000","last_change":"2024-09-11T22:02:36.099310+0000","last_active":"2024-09-11T22:02:55.346279+0000","last_peered":"2024-09-11T22:02:55.346279+0000","last_clean":"2024-09-11T22:02:55.346279+0000","last_became_active":"2024-09-11T22:02:36.099026+0000","last_became_peered":"2024-09-11T22:02:36.099026+0000","last_unstale":"2024-09-11T22:02:55.346279+0000","last_undegraded":"2024-09-11T22:02:55.346279+0000","last_fullsized":"2024-09-11T22:02:55.346279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:57.570147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341975+0000","last_change":"2024-09-11T22:02:34.083757+0000","last_active":"2024-09-11T22:02:55.341975+0000","last_peered":"2024-09-11T22:02:55.341975+0000","last_clean":"2024-09-11T22:02:55.341975+0000","last_became_active":"2024-09-11T22:02:34.083467+0000","last_became_peered":"2024-09-11T22:02:34.083467+0000","last_unstale":"2024-09-11T22:02:55.341975+0000","last_undegraded":"2024-09-11T22:02:55.341975+0000","last_fullsized":"2024-09-11T22:02:55.341975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.546772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343509+0000","last_change":"2024-09-11T22:02:36.098939+0000","last_active":"2024-09-11T22:02:55.343509+0000","last_peered":"2024-09-11T22:02:55.343509+0000","last_clean":"2024-09-11T22:02:55.343509+0000","last_became_active":"2024-09-11T22:02:36.098631+0000","last_became_peered":"2024-09-11T22:02:36.098631+0000","last_unstale":"2024-09-11T22:02:55.343509+0000","last_undegraded":"2024-09-11T22:02:55.343509+0000","last_fullsized":"2024-09-11T22:02:55.343509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:07.663332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":75,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:33.912057+0000","last_change":"2024-09-11T22:02:34.085325+0000","last_active":"2024-09-11T22:03:33.912057+0000","last_peered":"2024-09-11T22:03:33.912057+0000","last_clean":"2024-09-11T22:03:33.912057+0000","last_became_active":"2024-09-11T22:02:34.084967+0000","last_became_peered":"2024-09-11T22:02:34.084967+0000","last_unstale":"2024-09-11T22:03:33.912057+0000","last_undegraded":"2024-09-11T22:03:33.912057+0000","last_fullsized":"2024-09-11T22:03:33.912057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:35.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342150+0000","last_change":"2024-09-11T22:02:36.104454+0000","last_active":"2024-09-11T22:02:55.342150+0000","last_peered":"2024-09-11T22:02:55.342150+0000","last_clean":"2024-09-11T22:02:55.342150+0000","last_became_active":"2024-09-11T22:02:36.103988+0000","last_became_peered":"2024-09-11T22:02:36.103988+0000","last_unstale":"2024-09-11T22:02:55.342150+0000","last_undegraded":"2024-09-11T22:02:55.342150+0000","last_fullsized":"2024-09-11T22:02:55.342150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:32.748524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.548642+0000","last_change":"2024-09-11T22:02:55.548642+0000","last_active":"2024-09-11T22:02:55.548642+0000","last_peered":"2024-09-11T22:02:55.548642+0000","last_clean":"2024-09-11T22:02:55.548642+0000","last_became_active":"2024-09-11T22:02:55.545771+0000","last_became_peered":"2024-09-11T22:02:55.545771+0000","last_unstale":"2024-09-11T22:02:55.548642+0000","last_undegraded":"2024-09-11T22:02:55.548642+0000","last_fullsized":"2024-09-11T22:02:55.548642+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:03.431986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.349125+0000","last_change":"2024-09-11T22:02:55.349125+0000","last_active":"2024-09-11T22:02:55.349125+0000","last_peered":"2024-09-11T22:02:55.349125+0000","last_clean":"2024-09-11T22:02:55.349125+0000","last_became_active":"2024-09-11T22:02:55.348746+0000","last_became_peered":"2024-09-11T22:02:55.348746+0000","last_unstale":"2024-09-11T22:02:55.349125+0000","last_undegraded":"2024-09-11T22:02:55.349125+0000","last_fullsized":"2024-09-11T22:02:55.349125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342094+0000","last_change":"2024-09-11T22:02:34.089793+0000","last_active":"2024-09-11T22:02:55.342094+0000","last_peered":"2024-09-11T22:02:55.342094+0000","last_clean":"2024-09-11T22:02:55.342094+0000","last_became_active":"2024-09-11T22:02:34.089468+0000","last_became_peered":"2024-09-11T22:02:34.089468+0000","last_unstale":"2024-09-11T22:02:55.342094+0000","last_undegraded":"2024-09-11T22:02:55.342094+0000","last_fullsized":"2024-09-11T22:02:55.342094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:10:21.034822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341941+0000","last_change":"2024-09-11T22:02:36.106224+0000","last_active":"2024-09-11T22:02:55.341941+0000","last_peered":"2024-09-11T22:02:55.341941+0000","last_clean":"2024-09-11T22:02:55.341941+0000","last_became_active":"2024-09-11T22:02:36.105903+0000","last_became_peered":"2024-09-11T22:02:36.105903+0000","last_unstale":"2024-09-11T22:02:55.341941+0000","last_undegraded":"2024-09-11T22:02:55.341941+0000","last_fullsized":"2024-09-11T22:02:55.341941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.354653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'28","reported_seq":159,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:34.918520+0000","last_change":"2024-09-11T22:02:34.082150+0000","last_active":"2024-09-11T22:03:34.918520+0000","last_peered":"2024-09-11T22:03:34.918520+0000","last_clean":"2024-09-11T22:03:34.918520+0000","last_became_active":"2024-09-11T22:02:34.081822+0000","last_became_peered":"2024-09-11T22:02:34.081822+0000","last_unstale":"2024-09-11T22:03:34.918520+0000","last_undegraded":"2024-09-11T22:03:34.918520+0000","last_fullsized":"2024-09-11T22:03:34.918520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:39.320410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348665+0000","last_change":"2024-09-11T22:02:36.112124+0000","last_active":"2024-09-11T22:02:55.348665+0000","last_peered":"2024-09-11T22:02:55.348665+0000","last_clean":"2024-09-11T22:02:55.348665+0000","last_became_active":"2024-09-11T22:02:36.111739+0000","last_became_peered":"2024-09-11T22:02:36.111739+0000","last_unstale":"2024-09-11T22:02:55.348665+0000","last_undegraded":"2024-09-11T22:02:55.348665+0000","last_fullsized":"2024-09-11T22:02:55.348665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:52.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346805+0000","last_change":"2024-09-11T22:02:34.083047+0000","last_active":"2024-09-11T22:02:55.346805+0000","last_peered":"2024-09-11T22:02:55.346805+0000","last_clean":"2024-09-11T22:02:55.346805+0000","last_became_active":"2024-09-11T22:02:34.082406+0000","last_became_peered":"2024-09-11T22:02:34.082406+0000","last_unstale":"2024-09-11T22:02:55.346805+0000","last_undegraded":"2024-09-11T22:02:55.346805+0000","last_fullsized":"2024-09-11T22:02:55.346805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:33.249337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340763+0000","last_change":"2024-09-11T22:02:36.108859+0000","last_active":"2024-09-11T22:02:55.340763+0000","last_peered":"2024-09-11T22:02:55.340763+0000","last_clean":"2024-09-11T22:02:55.340763+0000","last_became_active":"2024-09-11T22:02:36.108558+0000","last_became_peered":"2024-09-11T22:02:36.108558+0000","last_unstale":"2024-09-11T22:02:55.340763+0000","last_undegraded":"2024-09-11T22:02:55.340763+0000","last_fullsized":"2024-09-11T22:02:55.340763+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.430672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341741+0000","last_change":"2024-09-11T22:02:34.080560+0000","last_active":"2024-09-11T22:02:55.341741+0000","last_peered":"2024-09-11T22:02:55.341741+0000","last_clean":"2024-09-11T22:02:55.341741+0000","last_became_active":"2024-09-11T22:02:34.080262+0000","last_became_peered":"2024-09-11T22:02:34.080262+0000","last_unstale":"2024-09-11T22:02:55.341741+0000","last_undegraded":"2024-09-11T22:02:55.341741+0000","last_fullsized":"2024-09-11T22:02:55.341741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:44.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343837+0000","last_change":"2024-09-11T22:02:36.107722+0000","last_active":"2024-09-11T22:02:55.343837+0000","last_peered":"2024-09-11T22:02:55.343837+0000","last_clean":"2024-09-11T22:02:55.343837+0000","last_became_active":"2024-09-11T22:02:36.107219+0000","last_became_peered":"2024-09-11T22:02:36.107219+0000","last_unstale":"2024-09-11T22:02:55.343837+0000","last_undegraded":"2024-09-11T22:02:55.343837+0000","last_fullsized":"2024-09-11T22:02:55.343837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.576045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":78,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:32.910961+0000","last_change":"2024-09-11T22:02:34.083573+0000","last_active":"2024-09-11T22:03:32.910961+0000","last_peered":"2024-09-11T22:03:32.910961+0000","last_clean":"2024-09-11T22:03:32.910961+0000","last_became_active":"2024-09-11T22:02:34.083277+0000","last_became_peered":"2024-09-11T22:02:34.083277+0000","last_unstale":"2024-09-11T22:03:32.910961+0000","last_undegraded":"2024-09-11T22:03:32.910961+0000","last_fullsized":"2024-09-11T22:03:32.910961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:31.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343635+0000","last_change":"2024-09-11T22:02:36.105075+0000","last_active":"2024-09-11T22:02:55.343635+0000","last_peered":"2024-09-11T22:02:55.343635+0000","last_clean":"2024-09-11T22:02:55.343635+0000","last_became_active":"2024-09-11T22:02:36.104022+0000","last_became_peered":"2024-09-11T22:02:36.104022+0000","last_unstale":"2024-09-11T22:02:55.343635+0000","last_undegraded":"2024-09-11T22:02:55.343635+0000","last_fullsized":"2024-09-11T22:02:55.343635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.693146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347063+0000","last_change":"2024-09-11T22:02:34.088727+0000","last_active":"2024-09-11T22:02:55.347063+0000","last_peered":"2024-09-11T22:02:55.347063+0000","last_clean":"2024-09-11T22:02:55.347063+0000","last_became_active":"2024-09-11T22:02:34.088394+0000","last_became_peered":"2024-09-11T22:02:34.088394+0000","last_unstale":"2024-09-11T22:02:55.347063+0000","last_undegraded":"2024-09-11T22:02:55.347063+0000","last_fullsized":"2024-09-11T22:02:55.347063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:11.809765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341774+0000","last_change":"2024-09-11T22:02:36.104522+0000","last_active":"2024-09-11T22:02:55.341774+0000","last_peered":"2024-09-11T22:02:55.341774+0000","last_clean":"2024-09-11T22:02:55.341774+0000","last_became_active":"2024-09-11T22:02:36.104181+0000","last_became_peered":"2024-09-11T22:02:36.104181+0000","last_unstale":"2024-09-11T22:02:55.341774+0000","last_undegraded":"2024-09-11T22:02:55.341774+0000","last_fullsized":"2024-09-11T22:02:55.341774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:08.139180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347551+0000","last_change":"2024-09-11T22:02:34.080341+0000","last_active":"2024-09-11T22:02:55.347551+0000","last_peered":"2024-09-11T22:02:55.347551+0000","last_clean":"2024-09-11T22:02:55.347551+0000","last_became_active":"2024-09-11T22:02:34.078761+0000","last_became_peered":"2024-09-11T22:02:34.078761+0000","last_unstale":"2024-09-11T22:02:55.347551+0000","last_undegraded":"2024-09-11T22:02:55.347551+0000","last_fullsized":"2024-09-11T22:02:55.347551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.545135+0000","last_change":"2024-09-11T22:02:55.545135+0000","last_active":"2024-09-11T22:02:55.545135+0000","last_peered":"2024-09-11T22:02:55.545135+0000","last_clean":"2024-09-11T22:02:55.545135+0000","last_became_active":"2024-09-11T22:02:55.544785+0000","last_became_peered":"2024-09-11T22:02:55.544785+0000","last_unstale":"2024-09-11T22:02:55.545135+0000","last_undegraded":"2024-09-11T22:02:55.545135+0000","last_fullsized":"2024-09-11T22:02:55.545135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:05.815828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341028+0000","last_change":"2024-09-11T22:02:34.082364+0000","last_active":"2024-09-11T22:02:55.341028+0000","last_peered":"2024-09-11T22:02:55.341028+0000","last_clean":"2024-09-11T22:02:55.341028+0000","last_became_active":"2024-09-11T22:02:34.081906+0000","last_became_peered":"2024-09-11T22:02:34.081906+0000","last_unstale":"2024-09-11T22:02:55.341028+0000","last_undegraded":"2024-09-11T22:02:55.341028+0000","last_fullsized":"2024-09-11T22:02:55.341028+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:58.603942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344193+0000","last_change":"2024-09-11T22:02:36.110725+0000","last_active":"2024-09-11T22:02:55.344193+0000","last_peered":"2024-09-11T22:02:55.344193+0000","last_clean":"2024-09-11T22:02:55.344193+0000","last_became_active":"2024-09-11T22:02:36.110401+0000","last_became_peered":"2024-09-11T22:02:36.110401+0000","last_unstale":"2024-09-11T22:02:55.344193+0000","last_undegraded":"2024-09-11T22:02:55.344193+0000","last_fullsized":"2024-09-11T22:02:55.344193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:41.789134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342240+0000","last_change":"2024-09-11T22:02:34.082983+0000","last_active":"2024-09-11T22:02:55.342240+0000","last_peered":"2024-09-11T22:02:55.342240+0000","last_clean":"2024-09-11T22:02:55.342240+0000","last_became_active":"2024-09-11T22:02:34.082618+0000","last_became_peered":"2024-09-11T22:02:34.082618+0000","last_unstale":"2024-09-11T22:02:55.342240+0000","last_undegraded":"2024-09-11T22:02:55.342240+0000","last_fullsized":"2024-09-11T22:02:55.342240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.481228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343871+0000","last_change":"2024-09-11T22:02:36.108222+0000","last_active":"2024-09-11T22:02:55.343871+0000","last_peered":"2024-09-11T22:02:55.343871+0000","last_clean":"2024-09-11T22:02:55.343871+0000","last_became_active":"2024-09-11T22:02:36.107739+0000","last_became_peered":"2024-09-11T22:02:36.107739+0000","last_unstale":"2024-09-11T22:02:55.343871+0000","last_undegraded":"2024-09-11T22:02:55.343871+0000","last_fullsized":"2024-09-11T22:02:55.343871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:11.353217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347043+0000","last_change":"2024-09-11T22:02:34.090068+0000","last_active":"2024-09-11T22:02:55.347043+0000","last_peered":"2024-09-11T22:02:55.347043+0000","last_clean":"2024-09-11T22:02:55.347043+0000","last_became_active":"2024-09-11T22:02:34.089735+0000","last_became_peered":"2024-09-11T22:02:34.089735+0000","last_unstale":"2024-09-11T22:02:55.347043+0000","last_undegraded":"2024-09-11T22:02:55.347043+0000","last_fullsized":"2024-09-11T22:02:55.347043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:32.917459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343993+0000","last_change":"2024-09-11T22:02:36.108017+0000","last_active":"2024-09-11T22:02:55.343993+0000","last_peered":"2024-09-11T22:02:55.343993+0000","last_clean":"2024-09-11T22:02:55.343993+0000","last_became_active":"2024-09-11T22:02:36.107339+0000","last_became_peered":"2024-09-11T22:02:36.107339+0000","last_unstale":"2024-09-11T22:02:55.343993+0000","last_undegraded":"2024-09-11T22:02:55.343993+0000","last_fullsized":"2024-09-11T22:02:55.343993+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:19.240354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343956+0000","last_change":"2024-09-11T22:01:28.522567+0000","last_active":"2024-09-11T22:02:55.343956+0000","last_peered":"2024-09-11T22:02:55.343956+0000","last_clean":"2024-09-11T22:02:55.343956+0000","last_became_active":"2024-09-11T22:01:28.522079+0000","last_became_peered":"2024-09-11T22:01:28.522079+0000","last_unstale":"2024-09-11T22:02:55.343956+0000","last_undegraded":"2024-09-11T22:02:55.343956+0000","last_fullsized":"2024-09-11T22:02:55.343956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_clean_scrub_stamp":"2024-09-11T21:58:11.245706+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:48.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543596+0000","last_change":"2024-09-11T22:02:34.080535+0000","last_active":"2024-09-11T22:02:55.543596+0000","last_peered":"2024-09-11T22:02:55.543596+0000","last_clean":"2024-09-11T22:02:55.543596+0000","last_became_active":"2024-09-11T22:02:34.079351+0000","last_became_peered":"2024-09-11T22:02:34.079351+0000","last_unstale":"2024-09-11T22:02:55.543596+0000","last_undegraded":"2024-09-11T22:02:55.543596+0000","last_fullsized":"2024-09-11T22:02:55.543596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:29.737198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346582+0000","last_change":"2024-09-11T22:02:36.104476+0000","last_active":"2024-09-11T22:02:55.346582+0000","last_peered":"2024-09-11T22:02:55.346582+0000","last_clean":"2024-09-11T22:02:55.346582+0000","last_became_active":"2024-09-11T22:02:36.104163+0000","last_became_peered":"2024-09-11T22:02:36.104163+0000","last_unstale":"2024-09-11T22:02:55.346582+0000","last_undegraded":"2024-09-11T22:02:55.346582+0000","last_fullsized":"2024-09-11T22:02:55.346582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.570125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343951+0000","last_change":"2024-09-11T22:02:34.079652+0000","last_active":"2024-09-11T22:02:55.343951+0000","last_peered":"2024-09-11T22:02:55.343951+0000","last_clean":"2024-09-11T22:02:55.343951+0000","last_became_active":"2024-09-11T22:02:34.079365+0000","last_became_peered":"2024-09-11T22:02:34.079365+0000","last_unstale":"2024-09-11T22:02:55.343951+0000","last_undegraded":"2024-09-11T22:02:55.343951+0000","last_fullsized":"2024-09-11T22:02:55.343951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:15.371852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340660+0000","last_change":"2024-09-11T22:02:36.107209+0000","last_active":"2024-09-11T22:02:55.340660+0000","last_peered":"2024-09-11T22:02:55.340660+0000","last_clean":"2024-09-11T22:02:55.340660+0000","last_became_active":"2024-09-11T22:02:36.106896+0000","last_became_peered":"2024-09-11T22:02:36.106896+0000","last_unstale":"2024-09-11T22:02:55.340660+0000","last_undegraded":"2024-09-11T22:02:55.340660+0000","last_fullsized":"2024-09-11T22:02:55.340660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:04.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":74,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:31.909416+0000","last_change":"2024-09-11T22:02:34.088531+0000","last_active":"2024-09-11T22:03:31.909416+0000","last_peered":"2024-09-11T22:03:31.909416+0000","last_clean":"2024-09-11T22:03:31.909416+0000","last_became_active":"2024-09-11T22:02:34.088252+0000","last_became_peered":"2024-09-11T22:02:34.088252+0000","last_unstale":"2024-09-11T22:03:31.909416+0000","last_undegraded":"2024-09-11T22:03:31.909416+0000","last_fullsized":"2024-09-11T22:03:31.909416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:43.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341771+0000","last_change":"2024-09-11T22:02:36.108963+0000","last_active":"2024-09-11T22:02:55.341771+0000","last_peered":"2024-09-11T22:02:55.341771+0000","last_clean":"2024-09-11T22:02:55.341771+0000","last_became_active":"2024-09-11T22:02:36.108435+0000","last_became_peered":"2024-09-11T22:02:36.108435+0000","last_unstale":"2024-09-11T22:02:55.341771+0000","last_undegraded":"2024-09-11T22:02:55.341771+0000","last_fullsized":"2024-09-11T22:02:55.341771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:11.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344233+0000","last_change":"2024-09-11T22:02:34.084283+0000","last_active":"2024-09-11T22:02:55.344233+0000","last_peered":"2024-09-11T22:02:55.344233+0000","last_clean":"2024-09-11T22:02:55.344233+0000","last_became_active":"2024-09-11T22:02:34.083948+0000","last_became_peered":"2024-09-11T22:02:34.083948+0000","last_unstale":"2024-09-11T22:02:55.344233+0000","last_undegraded":"2024-09-11T22:02:55.344233+0000","last_fullsized":"2024-09-11T22:02:55.344233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:48.763643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.848758+0000","last_change":"2024-09-11T22:02:36.102147+0000","last_active":"2024-09-11T22:02:55.848758+0000","last_peered":"2024-09-11T22:02:55.848758+0000","last_clean":"2024-09-11T22:02:55.848758+0000","last_became_active":"2024-09-11T22:02:36.101641+0000","last_became_peered":"2024-09-11T22:02:36.101641+0000","last_unstale":"2024-09-11T22:02:55.848758+0000","last_undegraded":"2024-09-11T22:02:55.848758+0000","last_fullsized":"2024-09-11T22:02:55.848758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:58.145304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343756+0000","last_change":"2024-09-11T22:02:34.090538+0000","last_active":"2024-09-11T22:02:55.343756+0000","last_peered":"2024-09-11T22:02:55.343756+0000","last_clean":"2024-09-11T22:02:55.343756+0000","last_became_active":"2024-09-11T22:02:34.090238+0000","last_became_peered":"2024-09-11T22:02:34.090238+0000","last_unstale":"2024-09-11T22:02:55.343756+0000","last_undegraded":"2024-09-11T22:02:55.343756+0000","last_fullsized":"2024-09-11T22:02:55.343756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:47.037999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.848877+0000","last_change":"2024-09-11T22:02:36.095664+0000","last_active":"2024-09-11T22:02:55.848877+0000","last_peered":"2024-09-11T22:02:55.848877+0000","last_clean":"2024-09-11T22:02:55.848877+0000","last_became_active":"2024-09-11T22:02:36.095304+0000","last_became_peered":"2024-09-11T22:02:36.095304+0000","last_unstale":"2024-09-11T22:02:55.848877+0000","last_undegraded":"2024-09-11T22:02:55.848877+0000","last_fullsized":"2024-09-11T22:02:55.848877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.484809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348688+0000","last_change":"2024-09-11T22:02:34.089781+0000","last_active":"2024-09-11T22:02:55.348688+0000","last_peered":"2024-09-11T22:02:55.348688+0000","last_clean":"2024-09-11T22:02:55.348688+0000","last_became_active":"2024-09-11T22:02:34.089439+0000","last_became_peered":"2024-09-11T22:02:34.089439+0000","last_unstale":"2024-09-11T22:02:55.348688+0000","last_undegraded":"2024-09-11T22:02:55.348688+0000","last_fullsized":"2024-09-11T22:02:55.348688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:38.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340944+0000","last_change":"2024-09-11T22:02:36.107159+0000","last_active":"2024-09-11T22:02:55.340944+0000","last_peered":"2024-09-11T22:02:55.340944+0000","last_clean":"2024-09-11T22:02:55.340944+0000","last_became_active":"2024-09-11T22:02:36.106846+0000","last_became_peered":"2024-09-11T22:02:36.106846+0000","last_unstale":"2024-09-11T22:02:55.340944+0000","last_undegraded":"2024-09-11T22:02:55.340944+0000","last_fullsized":"2024-09-11T22:02:55.340944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.972944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:00.095651+0000","last_change":"2024-09-11T22:02:55.352887+0000","last_active":"2024-09-11T22:03:00.095651+0000","last_peered":"2024-09-11T22:03:00.095651+0000","last_clean":"2024-09-11T22:03:00.095651+0000","last_became_active":"2024-09-11T22:02:55.348619+0000","last_became_peered":"2024-09-11T22:02:55.348619+0000","last_unstale":"2024-09-11T22:03:00.095651+0000","last_undegraded":"2024-09-11T22:03:00.095651+0000","last_fullsized":"2024-09-11T22:03:00.095651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:51.259114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346932+0000","last_change":"2024-09-11T22:02:36.108560+0000","last_active":"2024-09-11T22:02:55.346932+0000","last_peered":"2024-09-11T22:02:55.346932+0000","last_clean":"2024-09-11T22:02:55.346932+0000","last_became_active":"2024-09-11T22:02:36.107593+0000","last_became_peered":"2024-09-11T22:02:36.107593+0000","last_unstale":"2024-09-11T22:02:55.346932+0000","last_undegraded":"2024-09-11T22:02:55.346932+0000","last_fullsized":"2024-09-11T22:02:55.346932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.479991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.544133+0000","last_change":"2024-09-11T22:02:34.087394+0000","last_active":"2024-09-11T22:02:55.544133+0000","last_peered":"2024-09-11T22:02:55.544133+0000","last_clean":"2024-09-11T22:02:55.544133+0000","last_became_active":"2024-09-11T22:02:34.087146+0000","last_became_peered":"2024-09-11T22:02:34.087146+0000","last_unstale":"2024-09-11T22:02:55.544133+0000","last_undegraded":"2024-09-11T22:02:55.544133+0000","last_fullsized":"2024-09-11T22:02:55.544133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:30.772437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.545065+0000","last_change":"2024-09-11T22:02:55.545065+0000","last_active":"2024-09-11T22:02:55.545065+0000","last_peered":"2024-09-11T22:02:55.545065+0000","last_clean":"2024-09-11T22:02:55.545065+0000","last_became_active":"2024-09-11T22:02:55.544736+0000","last_became_peered":"2024-09-11T22:02:55.544736+0000","last_unstale":"2024-09-11T22:02:55.545065+0000","last_undegraded":"2024-09-11T22:02:55.545065+0000","last_fullsized":"2024-09-11T22:02:55.545065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:23.706253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341812+0000","last_change":"2024-09-11T22:02:34.088717+0000","last_active":"2024-09-11T22:02:55.341812+0000","last_peered":"2024-09-11T22:02:55.341812+0000","last_clean":"2024-09-11T22:02:55.341812+0000","last_became_active":"2024-09-11T22:02:34.088412+0000","last_became_peered":"2024-09-11T22:02:34.088412+0000","last_unstale":"2024-09-11T22:02:55.341812+0000","last_undegraded":"2024-09-11T22:02:55.341812+0000","last_fullsized":"2024-09-11T22:02:55.341812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348372+0000","last_change":"2024-09-11T22:02:36.103781+0000","last_active":"2024-09-11T22:02:55.348372+0000","last_peered":"2024-09-11T22:02:55.348372+0000","last_clean":"2024-09-11T22:02:55.348372+0000","last_became_active":"2024-09-11T22:02:36.103426+0000","last_became_peered":"2024-09-11T22:02:36.103426+0000","last_unstale":"2024-09-11T22:02:55.348372+0000","last_undegraded":"2024-09-11T22:02:55.348372+0000","last_fullsized":"2024-09-11T22:02:55.348372+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:34.962793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346446+0000","last_change":"2024-09-11T22:02:34.080333+0000","last_active":"2024-09-11T22:02:55.346446+0000","last_peered":"2024-09-11T22:02:55.346446+0000","last_clean":"2024-09-11T22:02:55.346446+0000","last_became_active":"2024-09-11T22:02:34.079384+0000","last_became_peered":"2024-09-11T22:02:34.079384+0000","last_unstale":"2024-09-11T22:02:55.346446+0000","last_undegraded":"2024-09-11T22:02:55.346446+0000","last_fullsized":"2024-09-11T22:02:55.346446+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:38.313516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343953+0000","last_change":"2024-09-11T22:02:36.103306+0000","last_active":"2024-09-11T22:02:55.343953+0000","last_peered":"2024-09-11T22:02:55.343953+0000","last_clean":"2024-09-11T22:02:55.343953+0000","last_became_active":"2024-09-11T22:02:36.102967+0000","last_became_peered":"2024-09-11T22:02:36.102967+0000","last_unstale":"2024-09-11T22:02:55.343953+0000","last_undegraded":"2024-09-11T22:02:55.343953+0000","last_fullsized":"2024-09-11T22:02:55.343953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:34.138931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.355119+0000","last_change":"2024-09-11T22:02:55.355119+0000","last_active":"2024-09-11T22:02:55.355119+0000","last_peered":"2024-09-11T22:02:55.355119+0000","last_clean":"2024-09-11T22:02:55.355119+0000","last_became_active":"2024-09-11T22:02:55.350440+0000","last_became_peered":"2024-09-11T22:02:55.350440+0000","last_unstale":"2024-09-11T22:02:55.355119+0000","last_undegraded":"2024-09-11T22:02:55.355119+0000","last_fullsized":"2024-09-11T22:02:55.355119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:47.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346553+0000","last_change":"2024-09-11T22:02:36.102491+0000","last_active":"2024-09-11T22:02:55.346553+0000","last_peered":"2024-09-11T22:02:55.346553+0000","last_clean":"2024-09-11T22:02:55.346553+0000","last_became_active":"2024-09-11T22:02:36.102112+0000","last_became_peered":"2024-09-11T22:02:36.102112+0000","last_unstale":"2024-09-11T22:02:55.346553+0000","last_undegraded":"2024-09-11T22:02:55.346553+0000","last_fullsized":"2024-09-11T22:02:55.346553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:47.588539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347284+0000","last_change":"2024-09-11T22:02:34.082590+0000","last_active":"2024-09-11T22:02:55.347284+0000","last_peered":"2024-09-11T22:02:55.347284+0000","last_clean":"2024-09-11T22:02:55.347284+0000","last_became_active":"2024-09-11T22:02:34.082288+0000","last_became_peered":"2024-09-11T22:02:34.082288+0000","last_unstale":"2024-09-11T22:02:55.347284+0000","last_undegraded":"2024-09-11T22:02:55.347284+0000","last_fullsized":"2024-09-11T22:02:55.347284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:57.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344015+0000","last_change":"2024-09-11T22:02:36.105247+0000","last_active":"2024-09-11T22:02:55.344015+0000","last_peered":"2024-09-11T22:02:55.344015+0000","last_clean":"2024-09-11T22:02:55.344015+0000","last_became_active":"2024-09-11T22:02:36.104912+0000","last_became_peered":"2024-09-11T22:02:36.104912+0000","last_unstale":"2024-09-11T22:02:55.344015+0000","last_undegraded":"2024-09-11T22:02:55.344015+0000","last_fullsized":"2024-09-11T22:02:55.344015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:05.396671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.544869+0000","last_change":"2024-09-11T22:02:55.544428+0000","last_active":"2024-09-11T22:02:55.544869+0000","last_peered":"2024-09-11T22:02:55.544869+0000","last_clean":"2024-09-11T22:02:55.544869+0000","last_became_active":"2024-09-11T22:02:55.544151+0000","last_became_peered":"2024-09-11T22:02:55.544151+0000","last_unstale":"2024-09-11T22:02:55.544869+0000","last_undegraded":"2024-09-11T22:02:55.544869+0000","last_fullsized":"2024-09-11T22:02:55.544869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.100131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348353+0000","last_change":"2024-09-11T22:02:34.079017+0000","last_active":"2024-09-11T22:02:55.348353+0000","last_peered":"2024-09-11T22:02:55.348353+0000","last_clean":"2024-09-11T22:02:55.348353+0000","last_became_active":"2024-09-11T22:02:34.078663+0000","last_became_peered":"2024-09-11T22:02:34.078663+0000","last_unstale":"2024-09-11T22:02:55.348353+0000","last_undegraded":"2024-09-11T22:02:55.348353+0000","last_fullsized":"2024-09-11T22:02:55.348353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:05.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341769+0000","last_change":"2024-09-11T22:02:36.097768+0000","last_active":"2024-09-11T22:02:55.341769+0000","last_peered":"2024-09-11T22:02:55.341769+0000","last_clean":"2024-09-11T22:02:55.341769+0000","last_became_active":"2024-09-11T22:02:36.097396+0000","last_became_peered":"2024-09-11T22:02:36.097396+0000","last_unstale":"2024-09-11T22:02:55.341769+0000","last_undegraded":"2024-09-11T22:02:55.341769+0000","last_fullsized":"2024-09-11T22:02:55.341769+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:35.673268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.355229+0000","last_change":"2024-09-11T22:02:55.355229+0000","last_active":"2024-09-11T22:02:55.355229+0000","last_peered":"2024-09-11T22:02:55.355229+0000","last_clean":"2024-09-11T22:02:55.355229+0000","last_became_active":"2024-09-11T22:02:55.350492+0000","last_became_peered":"2024-09-11T22:02:55.350492+0000","last_unstale":"2024-09-11T22:02:55.355229+0000","last_undegraded":"2024-09-11T22:02:55.355229+0000","last_fullsized":"2024-09-11T22:02:55.355229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:03:31.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343902+0000","last_change":"2024-09-11T22:02:36.108992+0000","last_active":"2024-09-11T22:02:55.343902+0000","last_peered":"2024-09-11T22:02:55.343902+0000","last_clean":"2024-09-11T22:02:55.343902+0000","last_became_active":"2024-09-11T22:02:36.108674+0000","last_became_peered":"2024-09-11T22:02:36.108674+0000","last_unstale":"2024-09-11T22:02:55.343902+0000","last_undegraded":"2024-09-11T22:02:55.343902+0000","last_fullsized":"2024-09-11T22:02:55.343902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:57.083127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347109+0000","last_change":"2024-09-11T22:02:34.088833+0000","last_active":"2024-09-11T22:02:55.347109+0000","last_peered":"2024-09-11T22:02:55.347109+0000","last_clean":"2024-09-11T22:02:55.347109+0000","last_became_active":"2024-09-11T22:02:34.088275+0000","last_became_peered":"2024-09-11T22:02:34.088275+0000","last_unstale":"2024-09-11T22:02:55.347109+0000","last_undegraded":"2024-09-11T22:02:55.347109+0000","last_fullsized":"2024-09-11T22:02:55.347109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:31.167486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347003+0000","last_change":"2024-09-11T22:02:36.108154+0000","last_active":"2024-09-11T22:02:55.347003+0000","last_peered":"2024-09-11T22:02:55.347003+0000","last_clean":"2024-09-11T22:02:55.347003+0000","last_became_active":"2024-09-11T22:02:36.107817+0000","last_became_peered":"2024-09-11T22:02:36.107817+0000","last_unstale":"2024-09-11T22:02:55.347003+0000","last_undegraded":"2024-09-11T22:02:55.347003+0000","last_fullsized":"2024-09-11T22:02:55.347003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.168339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344005+0000","last_change":"2024-09-11T22:02:34.082193+0000","last_active":"2024-09-11T22:02:55.344005+0000","last_peered":"2024-09-11T22:02:55.344005+0000","last_clean":"2024-09-11T22:02:55.344005+0000","last_became_active":"2024-09-11T22:02:34.081852+0000","last_became_peered":"2024-09-11T22:02:34.081852+0000","last_unstale":"2024-09-11T22:02:55.344005+0000","last_undegraded":"2024-09-11T22:02:55.344005+0000","last_fullsized":"2024-09-11T22:02:55.344005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:08.319444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":324,"num_read_kb":230,"num_write":164,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514521,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":443245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743453,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1617920,"data_stored":1094883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906978,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":443481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":937984,"data_stored":443401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397548,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1531904,"data_stored":1035726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528369,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":925696,"data_stored":442870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790006,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1544192,"data_stored":1035017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953531,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":443700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":443181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":504170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":502427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":444141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:03:38.181 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:03:38.439 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:38.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.912+0000 7fc271e78640 1 -- 172.21.15.152:0/3837063512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc26c103660 msgr2=0x7fc26c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:38.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.912+0000 7fc271e78640 1 --2- 172.21.15.152:0/3837063512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc26c103660 0x7fc26c10bb50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc260009900 tx=0x7fc26002a480 comp rx=0 tx=0).stop 2024-09-11T22:03:38.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.913+0000 7fc271e78640 1 -- 172.21.15.152:0/3837063512 shutdown_connections 2024-09-11T22:03:38.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.913+0000 7fc271e78640 1 --2- 172.21.15.152:0/3837063512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc26c10c170 0x7fc26c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.913+0000 7fc271e78640 1 --2- 172.21.15.152:0/3837063512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc26c103660 0x7fc26c10bb50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.913+0000 7fc271e78640 1 --2- 172.21.15.152:0/3837063512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c102d40 0x7fc26c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.913+0000 7fc271e78640 1 -- 172.21.15.152:0/3837063512 >> 172.21.15.152:0/3837063512 conn(0x7fc26c0fc7a0 msgr2=0x7fc26c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.913+0000 7fc271e78640 1 -- 172.21.15.152:0/3837063512 shutdown_connections 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.913+0000 7fc271e78640 1 -- 172.21.15.152:0/3837063512 wait complete. 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.913+0000 7fc271e78640 1 Processor -- start 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.913+0000 7fc271e78640 1 -- start start 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.913+0000 7fc271e78640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c102d40 0x7fc26c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.913+0000 7fc271e78640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc26c103660 0x7fc26c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc271e78640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc26c10c170 0x7fc26c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc271e78640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c112000 con 0x7fc26c103660 2024-09-11T22:03:38.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc271e78640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c111e80 con 0x7fc26c102d40 2024-09-11T22:03:38.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc271e78640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c112180 con 0x7fc26c10c170 2024-09-11T22:03:38.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc26c103660 0x7fc26c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:38.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc26c103660 0x7fc26c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38166/0 (socket says 172.21.15.152:38166) 2024-09-11T22:03:38.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26affd640 1 -- 172.21.15.152:0/430145016 learned_addr learned my addr 172.21.15.152:0/430145016 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:38.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26b7fe640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c102d40 0x7fc26c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:38.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26bfff640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc26c10c170 0x7fc26c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:38.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26affd640 1 -- 172.21.15.152:0/430145016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc26c10c170 msgr2=0x7fc26c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:38.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26affd640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc26c10c170 0x7fc26c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:38.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26affd640 1 -- 172.21.15.152:0/430145016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c102d40 msgr2=0x7fc26c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:38.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26affd640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c102d40 0x7fc26c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:38.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26affd640 1 -- 172.21.15.152:0/430145016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c19f620 con 0x7fc26c103660 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26b7fe640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c102d40 0x7fc26c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc26affd640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc26c103660 0x7fc26c19abb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc260006010 tx=0x7fc260003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc268ff9640 1 -- 172.21.15.152:0/430145016 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26003f070 con 0x7fc26c103660 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc271e78640 1 -- 172.21.15.152:0/430145016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26c19f8b0 con 0x7fc26c103660 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc268ff9640 1 -- 172.21.15.152:0/430145016 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc260031ca0 con 0x7fc26c103660 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc268ff9640 1 -- 172.21.15.152:0/430145016 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260035030 con 0x7fc26c103660 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.914+0000 7fc271e78640 1 -- 172.21.15.152:0/430145016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc26c1a71f0 con 0x7fc26c103660 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.915+0000 7fc271e78640 1 -- 172.21.15.152:0/430145016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc26c103120 con 0x7fc26c103660 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.916+0000 7fc268ff9640 1 -- 172.21.15.152:0/430145016 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc260042070 con 0x7fc26c103660 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.917+0000 7fc268ff9640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc2540a2c10 0x7fc2540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.917+0000 7fc26b7fe640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc2540a2c10 0x7fc2540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.917+0000 7fc268ff9640 1 -- 172.21.15.152:0/430145016 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fc2600f0050 con 0x7fc26c103660 2024-09-11T22:03:38.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.918+0000 7fc26b7fe640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc2540a2c10 0x7fc2540a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc25c005c40 tx=0x7fc25c00a430 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:38.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:38.920+0000 7fc268ff9640 1 -- 172.21.15.152:0/430145016 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc26003be20 con 0x7fc26c103660 2024-09-11T22:03:39.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.084+0000 7fc271e78640 1 -- 172.21.15.152:0/430145016 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc26c102100 con 0x7fc2540a2c10 2024-09-11T22:03:39.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.090+0000 7fc268ff9640 1 -- 172.21.15.152:0/430145016 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258715 (secure 0 0 0) 0x7fc26c102100 con 0x7fc2540a2c10 2024-09-11T22:03:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:39.094 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-09-11T22:03:39.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 -- 172.21.15.152:0/430145016 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc2540a2c10 msgr2=0x7fc2540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:39.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc2540a2c10 0x7fc2540a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc25c005c40 tx=0x7fc25c00a430 comp rx=0 tx=0).stop 2024-09-11T22:03:39.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 -- 172.21.15.152:0/430145016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc26c103660 msgr2=0x7fc26c19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:39.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc26c103660 0x7fc26c19abb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc260006010 tx=0x7fc260003c10 comp rx=0 tx=0).stop 2024-09-11T22:03:39.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 -- 172.21.15.152:0/430145016 shutdown_connections 2024-09-11T22:03:39.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fc2540a2c10 0x7fc2540a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc26c10c170 0x7fc26c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc26c103660 0x7fc26c19abb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 --2- 172.21.15.152:0/430145016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c102d40 0x7fc26c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 -- 172.21.15.152:0/430145016 >> 172.21.15.152:0/430145016 conn(0x7fc26c0fc7a0 msgr2=0x7fc26c10d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 -- 172.21.15.152:0/430145016 shutdown_connections 2024-09-11T22:03:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:39.093+0000 7fc271e78640 1 -- 172.21.15.152:0/430145016 wait complete. 2024-09-11T22:03:39.438 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:39 smithi152 ceph-mon[31188]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:39.438 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:39.438 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:39.439 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:39 smithi152 ceph-mon[31188]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:03:39.439 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:03:39.439 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:03:39.439 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:39 smithi152 ceph-mon[31188]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:39.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:39 smithi179 ceph-mon[35603]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:39.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:39.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:39.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:39 smithi179 ceph-mon[35603]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:03:39.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:03:39.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:03:39.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:39 smithi179 ceph-mon[35603]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:39 smithi193 ceph-mon[35545]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:39.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:39 smithi193 ceph-mon[35545]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:03:39.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:03:39.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:03:39.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:39 smithi193 ceph-mon[35545]: from='mgr.14148 172.21.15.152:0/2103212983' entity='mgr.x' 2024-09-11T22:03:39.768 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-11T22:03:38.288799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":465,"num_read_kb":349,"num_write":347,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366368,"kb_used_data":12924,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575456,"statfs":{"total":1151940427776,"available":1151565266944,"internally_reserved":0,"allocated":13234176,"data_stored":7276242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002853"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344542+0000","last_change":"2024-09-11T22:02:36.105689+0000","last_active":"2024-09-11T22:02:55.344542+0000","last_peered":"2024-09-11T22:02:55.344542+0000","last_clean":"2024-09-11T22:02:55.344542+0000","last_became_active":"2024-09-11T22:02:36.105128+0000","last_became_peered":"2024-09-11T22:02:36.105128+0000","last_unstale":"2024-09-11T22:02:55.344542+0000","last_undegraded":"2024-09-11T22:02:55.344542+0000","last_fullsized":"2024-09-11T22:02:55.344542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:18.018731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344016+0000","last_change":"2024-09-11T22:02:36.096961+0000","last_active":"2024-09-11T22:02:55.344016+0000","last_peered":"2024-09-11T22:02:55.344016+0000","last_clean":"2024-09-11T22:02:55.344016+0000","last_became_active":"2024-09-11T22:02:36.096540+0000","last_became_peered":"2024-09-11T22:02:36.096540+0000","last_unstale":"2024-09-11T22:02:55.344016+0000","last_undegraded":"2024-09-11T22:02:55.344016+0000","last_fullsized":"2024-09-11T22:02:55.344016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:48.517125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343560+0000","last_change":"2024-09-11T22:02:36.108119+0000","last_active":"2024-09-11T22:02:55.343560+0000","last_peered":"2024-09-11T22:02:55.343560+0000","last_clean":"2024-09-11T22:02:55.343560+0000","last_became_active":"2024-09-11T22:02:36.107737+0000","last_became_peered":"2024-09-11T22:02:36.107737+0000","last_unstale":"2024-09-11T22:02:55.343560+0000","last_undegraded":"2024-09-11T22:02:55.343560+0000","last_fullsized":"2024-09-11T22:02:55.343560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:54.225935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543552+0000","last_change":"2024-09-11T22:02:36.107710+0000","last_active":"2024-09-11T22:02:55.543552+0000","last_peered":"2024-09-11T22:02:55.543552+0000","last_clean":"2024-09-11T22:02:55.543552+0000","last_became_active":"2024-09-11T22:02:36.107327+0000","last_became_peered":"2024-09-11T22:02:36.107327+0000","last_unstale":"2024-09-11T22:02:55.543552+0000","last_undegraded":"2024-09-11T22:02:55.543552+0000","last_fullsized":"2024-09-11T22:02:55.543552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.358535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347186+0000","last_change":"2024-09-11T22:02:36.100531+0000","last_active":"2024-09-11T22:02:55.347186+0000","last_peered":"2024-09-11T22:02:55.347186+0000","last_clean":"2024-09-11T22:02:55.347186+0000","last_became_active":"2024-09-11T22:02:36.100187+0000","last_became_peered":"2024-09-11T22:02:36.100187+0000","last_unstale":"2024-09-11T22:02:55.347186+0000","last_undegraded":"2024-09-11T22:02:55.347186+0000","last_fullsized":"2024-09-11T22:02:55.347186+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.156080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.848619+0000","last_change":"2024-09-11T22:02:36.101316+0000","last_active":"2024-09-11T22:02:55.848619+0000","last_peered":"2024-09-11T22:02:55.848619+0000","last_clean":"2024-09-11T22:02:55.848619+0000","last_became_active":"2024-09-11T22:02:36.100985+0000","last_became_peered":"2024-09-11T22:02:36.100985+0000","last_unstale":"2024-09-11T22:02:55.848619+0000","last_undegraded":"2024-09-11T22:02:55.848619+0000","last_fullsized":"2024-09-11T22:02:55.848619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:55.972974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343776+0000","last_change":"2024-09-11T22:02:36.109146+0000","last_active":"2024-09-11T22:02:55.343776+0000","last_peered":"2024-09-11T22:02:55.343776+0000","last_clean":"2024-09-11T22:02:55.343776+0000","last_became_active":"2024-09-11T22:02:36.108817+0000","last_became_peered":"2024-09-11T22:02:36.108817+0000","last_unstale":"2024-09-11T22:02:55.343776+0000","last_undegraded":"2024-09-11T22:02:55.343776+0000","last_fullsized":"2024-09-11T22:02:55.343776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.222383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.345959+0000","last_change":"2024-09-11T22:02:36.100362+0000","last_active":"2024-09-11T22:02:55.345959+0000","last_peered":"2024-09-11T22:02:55.345959+0000","last_clean":"2024-09-11T22:02:55.345959+0000","last_became_active":"2024-09-11T22:02:36.100088+0000","last_became_peered":"2024-09-11T22:02:36.100088+0000","last_unstale":"2024-09-11T22:02:55.345959+0000","last_undegraded":"2024-09-11T22:02:55.345959+0000","last_fullsized":"2024-09-11T22:02:55.345959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.478879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342352+0000","last_change":"2024-09-11T22:02:36.106360+0000","last_active":"2024-09-11T22:02:55.342352+0000","last_peered":"2024-09-11T22:02:55.342352+0000","last_clean":"2024-09-11T22:02:55.342352+0000","last_became_active":"2024-09-11T22:02:36.105994+0000","last_became_peered":"2024-09-11T22:02:36.105994+0000","last_unstale":"2024-09-11T22:02:55.342352+0000","last_undegraded":"2024-09-11T22:02:55.342352+0000","last_fullsized":"2024-09-11T22:02:55.342352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:33.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.849028+0000","last_change":"2024-09-11T22:02:36.109477+0000","last_active":"2024-09-11T22:02:55.849028+0000","last_peered":"2024-09-11T22:02:55.849028+0000","last_clean":"2024-09-11T22:02:55.849028+0000","last_became_active":"2024-09-11T22:02:36.109077+0000","last_became_peered":"2024-09-11T22:02:36.109077+0000","last_unstale":"2024-09-11T22:02:55.849028+0000","last_undegraded":"2024-09-11T22:02:55.849028+0000","last_fullsized":"2024-09-11T22:02:55.849028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.862359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343838+0000","last_change":"2024-09-11T22:02:36.112998+0000","last_active":"2024-09-11T22:02:55.343838+0000","last_peered":"2024-09-11T22:02:55.343838+0000","last_clean":"2024-09-11T22:02:55.343838+0000","last_became_active":"2024-09-11T22:02:36.112649+0000","last_became_peered":"2024-09-11T22:02:36.112649+0000","last_unstale":"2024-09-11T22:02:55.343838+0000","last_undegraded":"2024-09-11T22:02:55.343838+0000","last_fullsized":"2024-09-11T22:02:55.343838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:01.582572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543593+0000","last_change":"2024-09-11T22:02:36.099591+0000","last_active":"2024-09-11T22:02:55.543593+0000","last_peered":"2024-09-11T22:02:55.543593+0000","last_clean":"2024-09-11T22:02:55.543593+0000","last_became_active":"2024-09-11T22:02:36.099269+0000","last_became_peered":"2024-09-11T22:02:36.099269+0000","last_unstale":"2024-09-11T22:02:55.543593+0000","last_undegraded":"2024-09-11T22:02:55.543593+0000","last_fullsized":"2024-09-11T22:02:55.543593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:10.918188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340976+0000","last_change":"2024-09-11T22:02:36.100056+0000","last_active":"2024-09-11T22:02:55.340976+0000","last_peered":"2024-09-11T22:02:55.340976+0000","last_clean":"2024-09-11T22:02:55.340976+0000","last_became_active":"2024-09-11T22:02:36.099717+0000","last_became_peered":"2024-09-11T22:02:36.099717+0000","last_unstale":"2024-09-11T22:02:55.340976+0000","last_undegraded":"2024-09-11T22:02:55.340976+0000","last_fullsized":"2024-09-11T22:02:55.340976+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.486256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343551+0000","last_change":"2024-09-11T22:02:36.097281+0000","last_active":"2024-09-11T22:02:55.343551+0000","last_peered":"2024-09-11T22:02:55.343551+0000","last_clean":"2024-09-11T22:02:55.343551+0000","last_became_active":"2024-09-11T22:02:36.096768+0000","last_became_peered":"2024-09-11T22:02:36.096768+0000","last_unstale":"2024-09-11T22:02:55.343551+0000","last_undegraded":"2024-09-11T22:02:55.343551+0000","last_fullsized":"2024-09-11T22:02:55.343551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:31.232578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.351065+0000","last_change":"2024-09-11T22:02:55.351065+0000","last_active":"2024-09-11T22:02:55.351065+0000","last_peered":"2024-09-11T22:02:55.351065+0000","last_clean":"2024-09-11T22:02:55.351065+0000","last_became_active":"2024-09-11T22:02:55.350669+0000","last_became_peered":"2024-09-11T22:02:55.350669+0000","last_unstale":"2024-09-11T22:02:55.351065+0000","last_undegraded":"2024-09-11T22:02:55.351065+0000","last_fullsized":"2024-09-11T22:02:55.351065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:51.799060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341690+0000","last_change":"2024-09-11T22:02:36.109573+0000","last_active":"2024-09-11T22:02:55.341690+0000","last_peered":"2024-09-11T22:02:55.341690+0000","last_clean":"2024-09-11T22:02:55.341690+0000","last_became_active":"2024-09-11T22:02:36.109019+0000","last_became_peered":"2024-09-11T22:02:36.109019+0000","last_unstale":"2024-09-11T22:02:55.341690+0000","last_undegraded":"2024-09-11T22:02:55.341690+0000","last_fullsized":"2024-09-11T22:02:55.341690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:39.699762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344337+0000","last_change":"2024-09-11T22:02:36.105427+0000","last_active":"2024-09-11T22:02:55.344337+0000","last_peered":"2024-09-11T22:02:55.344337+0000","last_clean":"2024-09-11T22:02:55.344337+0000","last_became_active":"2024-09-11T22:02:36.104712+0000","last_became_peered":"2024-09-11T22:02:36.104712+0000","last_unstale":"2024-09-11T22:02:55.344337+0000","last_undegraded":"2024-09-11T22:02:55.344337+0000","last_fullsized":"2024-09-11T22:02:55.344337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:45.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344194+0000","last_change":"2024-09-11T22:02:36.097925+0000","last_active":"2024-09-11T22:02:55.344194+0000","last_peered":"2024-09-11T22:02:55.344194+0000","last_clean":"2024-09-11T22:02:55.344194+0000","last_became_active":"2024-09-11T22:02:36.097649+0000","last_became_peered":"2024-09-11T22:02:36.097649+0000","last_unstale":"2024-09-11T22:02:55.344194+0000","last_undegraded":"2024-09-11T22:02:55.344194+0000","last_fullsized":"2024-09-11T22:02:55.344194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.272197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347308+0000","last_change":"2024-09-11T22:02:36.107266+0000","last_active":"2024-09-11T22:02:55.347308+0000","last_peered":"2024-09-11T22:02:55.347308+0000","last_clean":"2024-09-11T22:02:55.347308+0000","last_became_active":"2024-09-11T22:02:36.106865+0000","last_became_peered":"2024-09-11T22:02:36.106865+0000","last_unstale":"2024-09-11T22:02:55.347308+0000","last_undegraded":"2024-09-11T22:02:55.347308+0000","last_fullsized":"2024-09-11T22:02:55.347308+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:53.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.349854+0000","last_change":"2024-09-11T22:02:55.349854+0000","last_active":"2024-09-11T22:02:55.349854+0000","last_peered":"2024-09-11T22:02:55.349854+0000","last_clean":"2024-09-11T22:02:55.349854+0000","last_became_active":"2024-09-11T22:02:55.349521+0000","last_became_peered":"2024-09-11T22:02:55.349521+0000","last_unstale":"2024-09-11T22:02:55.349854+0000","last_undegraded":"2024-09-11T22:02:55.349854+0000","last_fullsized":"2024-09-11T22:02:55.349854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341046+0000","last_change":"2024-09-11T22:02:36.110460+0000","last_active":"2024-09-11T22:02:55.341046+0000","last_peered":"2024-09-11T22:02:55.341046+0000","last_clean":"2024-09-11T22:02:55.341046+0000","last_became_active":"2024-09-11T22:02:36.110136+0000","last_became_peered":"2024-09-11T22:02:36.110136+0000","last_unstale":"2024-09-11T22:02:55.341046+0000","last_undegraded":"2024-09-11T22:02:55.341046+0000","last_fullsized":"2024-09-11T22:02:55.341046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:30.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341898+0000","last_change":"2024-09-11T22:02:36.111403+0000","last_active":"2024-09-11T22:02:55.341898+0000","last_peered":"2024-09-11T22:02:55.341898+0000","last_clean":"2024-09-11T22:02:55.341898+0000","last_became_active":"2024-09-11T22:02:36.110976+0000","last_became_peered":"2024-09-11T22:02:36.110976+0000","last_unstale":"2024-09-11T22:02:55.341898+0000","last_undegraded":"2024-09-11T22:02:55.341898+0000","last_fullsized":"2024-09-11T22:02:55.341898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:03.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346312+0000","last_change":"2024-09-11T22:02:36.110002+0000","last_active":"2024-09-11T22:02:55.346312+0000","last_peered":"2024-09-11T22:02:55.346312+0000","last_clean":"2024-09-11T22:02:55.346312+0000","last_became_active":"2024-09-11T22:02:36.109694+0000","last_became_peered":"2024-09-11T22:02:36.109694+0000","last_unstale":"2024-09-11T22:02:55.346312+0000","last_undegraded":"2024-09-11T22:02:55.346312+0000","last_fullsized":"2024-09-11T22:02:55.346312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:00.338509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341649+0000","last_change":"2024-09-11T22:02:36.101638+0000","last_active":"2024-09-11T22:02:55.341649+0000","last_peered":"2024-09-11T22:02:55.341649+0000","last_clean":"2024-09-11T22:02:55.341649+0000","last_became_active":"2024-09-11T22:02:36.101363+0000","last_became_peered":"2024-09-11T22:02:36.101363+0000","last_unstale":"2024-09-11T22:02:55.341649+0000","last_undegraded":"2024-09-11T22:02:55.341649+0000","last_fullsized":"2024-09-11T22:02:55.341649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:35.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346849+0000","last_change":"2024-09-11T22:02:36.109250+0000","last_active":"2024-09-11T22:02:55.346849+0000","last_peered":"2024-09-11T22:02:55.346849+0000","last_clean":"2024-09-11T22:02:55.346849+0000","last_became_active":"2024-09-11T22:02:36.108931+0000","last_became_peered":"2024-09-11T22:02:36.108931+0000","last_unstale":"2024-09-11T22:02:55.346849+0000","last_undegraded":"2024-09-11T22:02:55.346849+0000","last_fullsized":"2024-09-11T22:02:55.346849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:09.616621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347177+0000","last_change":"2024-09-11T22:02:36.113064+0000","last_active":"2024-09-11T22:02:55.347177+0000","last_peered":"2024-09-11T22:02:55.347177+0000","last_clean":"2024-09-11T22:02:55.347177+0000","last_became_active":"2024-09-11T22:02:36.112674+0000","last_became_peered":"2024-09-11T22:02:36.112674+0000","last_unstale":"2024-09-11T22:02:55.347177+0000","last_undegraded":"2024-09-11T22:02:55.347177+0000","last_fullsized":"2024-09-11T22:02:55.347177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:17.923053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344175+0000","last_change":"2024-09-11T22:02:36.101799+0000","last_active":"2024-09-11T22:02:55.344175+0000","last_peered":"2024-09-11T22:02:55.344175+0000","last_clean":"2024-09-11T22:02:55.344175+0000","last_became_active":"2024-09-11T22:02:36.101429+0000","last_became_peered":"2024-09-11T22:02:36.101429+0000","last_unstale":"2024-09-11T22:02:55.344175+0000","last_undegraded":"2024-09-11T22:02:55.344175+0000","last_fullsized":"2024-09-11T22:02:55.344175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.597619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340909+0000","last_change":"2024-09-11T22:02:36.100993+0000","last_active":"2024-09-11T22:02:55.340909+0000","last_peered":"2024-09-11T22:02:55.340909+0000","last_clean":"2024-09-11T22:02:55.340909+0000","last_became_active":"2024-09-11T22:02:36.100678+0000","last_became_peered":"2024-09-11T22:02:36.100678+0000","last_unstale":"2024-09-11T22:02:55.340909+0000","last_undegraded":"2024-09-11T22:02:55.340909+0000","last_fullsized":"2024-09-11T22:02:55.340909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:18.808422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344166+0000","last_change":"2024-09-11T22:02:36.103507+0000","last_active":"2024-09-11T22:02:55.344166+0000","last_peered":"2024-09-11T22:02:55.344166+0000","last_clean":"2024-09-11T22:02:55.344166+0000","last_became_active":"2024-09-11T22:02:36.103228+0000","last_became_peered":"2024-09-11T22:02:36.103228+0000","last_unstale":"2024-09-11T22:02:55.344166+0000","last_undegraded":"2024-09-11T22:02:55.344166+0000","last_fullsized":"2024-09-11T22:02:55.344166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.898635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347429+0000","last_change":"2024-09-11T22:02:36.104734+0000","last_active":"2024-09-11T22:02:55.347429+0000","last_peered":"2024-09-11T22:02:55.347429+0000","last_clean":"2024-09-11T22:02:55.347429+0000","last_became_active":"2024-09-11T22:02:36.103974+0000","last_became_peered":"2024-09-11T22:02:36.103974+0000","last_unstale":"2024-09-11T22:02:55.347429+0000","last_undegraded":"2024-09-11T22:02:55.347429+0000","last_fullsized":"2024-09-11T22:02:55.347429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:54.142031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347545+0000","last_change":"2024-09-11T22:02:36.106103+0000","last_active":"2024-09-11T22:02:55.347545+0000","last_peered":"2024-09-11T22:02:55.347545+0000","last_clean":"2024-09-11T22:02:55.347545+0000","last_became_active":"2024-09-11T22:02:36.105792+0000","last_became_peered":"2024-09-11T22:02:36.105792+0000","last_unstale":"2024-09-11T22:02:55.347545+0000","last_undegraded":"2024-09-11T22:02:55.347545+0000","last_fullsized":"2024-09-11T22:02:55.347545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:06.607094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343742+0000","last_change":"2024-09-11T22:02:36.104147+0000","last_active":"2024-09-11T22:02:55.343742+0000","last_peered":"2024-09-11T22:02:55.343742+0000","last_clean":"2024-09-11T22:02:55.343742+0000","last_became_active":"2024-09-11T22:02:36.103782+0000","last_became_peered":"2024-09-11T22:02:36.103782+0000","last_unstale":"2024-09-11T22:02:55.343742+0000","last_undegraded":"2024-09-11T22:02:55.343742+0000","last_fullsized":"2024-09-11T22:02:55.343742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.127609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348453+0000","last_change":"2024-09-11T22:02:36.101259+0000","last_active":"2024-09-11T22:02:55.348453+0000","last_peered":"2024-09-11T22:02:55.348453+0000","last_clean":"2024-09-11T22:02:55.348453+0000","last_became_active":"2024-09-11T22:02:36.100761+0000","last_became_peered":"2024-09-11T22:02:36.100761+0000","last_unstale":"2024-09-11T22:02:55.348453+0000","last_undegraded":"2024-09-11T22:02:55.348453+0000","last_fullsized":"2024-09-11T22:02:55.348453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:47.045252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":84,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:36.916812+0000","last_change":"2024-09-11T22:02:34.084522+0000","last_active":"2024-09-11T22:03:36.916812+0000","last_peered":"2024-09-11T22:03:36.916812+0000","last_clean":"2024-09-11T22:03:36.916812+0000","last_became_active":"2024-09-11T22:02:34.084211+0000","last_became_peered":"2024-09-11T22:02:34.084211+0000","last_unstale":"2024-09-11T22:03:36.916812+0000","last_undegraded":"2024-09-11T22:03:36.916812+0000","last_fullsized":"2024-09-11T22:03:36.916812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:18.963998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341673+0000","last_change":"2024-09-11T22:02:36.106890+0000","last_active":"2024-09-11T22:02:55.341673+0000","last_peered":"2024-09-11T22:02:55.341673+0000","last_clean":"2024-09-11T22:02:55.341673+0000","last_became_active":"2024-09-11T22:02:36.105255+0000","last_became_peered":"2024-09-11T22:02:36.105255+0000","last_unstale":"2024-09-11T22:02:55.341673+0000","last_undegraded":"2024-09-11T22:02:55.341673+0000","last_fullsized":"2024-09-11T22:02:55.341673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.995542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.848667+0000","last_change":"2024-09-11T22:02:34.079967+0000","last_active":"2024-09-11T22:02:55.848667+0000","last_peered":"2024-09-11T22:02:55.848667+0000","last_clean":"2024-09-11T22:02:55.848667+0000","last_became_active":"2024-09-11T22:02:34.079649+0000","last_became_peered":"2024-09-11T22:02:34.079649+0000","last_unstale":"2024-09-11T22:02:55.848667+0000","last_undegraded":"2024-09-11T22:02:55.848667+0000","last_fullsized":"2024-09-11T22:02:55.848667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.661256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340684+0000","last_change":"2024-09-11T22:02:34.079850+0000","last_active":"2024-09-11T22:02:55.340684+0000","last_peered":"2024-09-11T22:02:55.340684+0000","last_clean":"2024-09-11T22:02:55.340684+0000","last_became_active":"2024-09-11T22:02:34.079514+0000","last_became_peered":"2024-09-11T22:02:34.079514+0000","last_unstale":"2024-09-11T22:02:55.340684+0000","last_undegraded":"2024-09-11T22:02:55.340684+0000","last_fullsized":"2024-09-11T22:02:55.340684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.359482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346279+0000","last_change":"2024-09-11T22:02:36.099310+0000","last_active":"2024-09-11T22:02:55.346279+0000","last_peered":"2024-09-11T22:02:55.346279+0000","last_clean":"2024-09-11T22:02:55.346279+0000","last_became_active":"2024-09-11T22:02:36.099026+0000","last_became_peered":"2024-09-11T22:02:36.099026+0000","last_unstale":"2024-09-11T22:02:55.346279+0000","last_undegraded":"2024-09-11T22:02:55.346279+0000","last_fullsized":"2024-09-11T22:02:55.346279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:57.570147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341975+0000","last_change":"2024-09-11T22:02:34.083757+0000","last_active":"2024-09-11T22:02:55.341975+0000","last_peered":"2024-09-11T22:02:55.341975+0000","last_clean":"2024-09-11T22:02:55.341975+0000","last_became_active":"2024-09-11T22:02:34.083467+0000","last_became_peered":"2024-09-11T22:02:34.083467+0000","last_unstale":"2024-09-11T22:02:55.341975+0000","last_undegraded":"2024-09-11T22:02:55.341975+0000","last_fullsized":"2024-09-11T22:02:55.341975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.546772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343509+0000","last_change":"2024-09-11T22:02:36.098939+0000","last_active":"2024-09-11T22:02:55.343509+0000","last_peered":"2024-09-11T22:02:55.343509+0000","last_clean":"2024-09-11T22:02:55.343509+0000","last_became_active":"2024-09-11T22:02:36.098631+0000","last_became_peered":"2024-09-11T22:02:36.098631+0000","last_unstale":"2024-09-11T22:02:55.343509+0000","last_undegraded":"2024-09-11T22:02:55.343509+0000","last_fullsized":"2024-09-11T22:02:55.343509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:07.663332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":75,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:33.912057+0000","last_change":"2024-09-11T22:02:34.085325+0000","last_active":"2024-09-11T22:03:33.912057+0000","last_peered":"2024-09-11T22:03:33.912057+0000","last_clean":"2024-09-11T22:03:33.912057+0000","last_became_active":"2024-09-11T22:02:34.084967+0000","last_became_peered":"2024-09-11T22:02:34.084967+0000","last_unstale":"2024-09-11T22:03:33.912057+0000","last_undegraded":"2024-09-11T22:03:33.912057+0000","last_fullsized":"2024-09-11T22:03:33.912057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:35.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342150+0000","last_change":"2024-09-11T22:02:36.104454+0000","last_active":"2024-09-11T22:02:55.342150+0000","last_peered":"2024-09-11T22:02:55.342150+0000","last_clean":"2024-09-11T22:02:55.342150+0000","last_became_active":"2024-09-11T22:02:36.103988+0000","last_became_peered":"2024-09-11T22:02:36.103988+0000","last_unstale":"2024-09-11T22:02:55.342150+0000","last_undegraded":"2024-09-11T22:02:55.342150+0000","last_fullsized":"2024-09-11T22:02:55.342150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:32.748524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.548642+0000","last_change":"2024-09-11T22:02:55.548642+0000","last_active":"2024-09-11T22:02:55.548642+0000","last_peered":"2024-09-11T22:02:55.548642+0000","last_clean":"2024-09-11T22:02:55.548642+0000","last_became_active":"2024-09-11T22:02:55.545771+0000","last_became_peered":"2024-09-11T22:02:55.545771+0000","last_unstale":"2024-09-11T22:02:55.548642+0000","last_undegraded":"2024-09-11T22:02:55.548642+0000","last_fullsized":"2024-09-11T22:02:55.548642+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:03.431986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.349125+0000","last_change":"2024-09-11T22:02:55.349125+0000","last_active":"2024-09-11T22:02:55.349125+0000","last_peered":"2024-09-11T22:02:55.349125+0000","last_clean":"2024-09-11T22:02:55.349125+0000","last_became_active":"2024-09-11T22:02:55.348746+0000","last_became_peered":"2024-09-11T22:02:55.348746+0000","last_unstale":"2024-09-11T22:02:55.349125+0000","last_undegraded":"2024-09-11T22:02:55.349125+0000","last_fullsized":"2024-09-11T22:02:55.349125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342094+0000","last_change":"2024-09-11T22:02:34.089793+0000","last_active":"2024-09-11T22:02:55.342094+0000","last_peered":"2024-09-11T22:02:55.342094+0000","last_clean":"2024-09-11T22:02:55.342094+0000","last_became_active":"2024-09-11T22:02:34.089468+0000","last_became_peered":"2024-09-11T22:02:34.089468+0000","last_unstale":"2024-09-11T22:02:55.342094+0000","last_undegraded":"2024-09-11T22:02:55.342094+0000","last_fullsized":"2024-09-11T22:02:55.342094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:10:21.034822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341941+0000","last_change":"2024-09-11T22:02:36.106224+0000","last_active":"2024-09-11T22:02:55.341941+0000","last_peered":"2024-09-11T22:02:55.341941+0000","last_clean":"2024-09-11T22:02:55.341941+0000","last_became_active":"2024-09-11T22:02:36.105903+0000","last_became_peered":"2024-09-11T22:02:36.105903+0000","last_unstale":"2024-09-11T22:02:55.341941+0000","last_undegraded":"2024-09-11T22:02:55.341941+0000","last_fullsized":"2024-09-11T22:02:55.341941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.354653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'28","reported_seq":159,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:34.918520+0000","last_change":"2024-09-11T22:02:34.082150+0000","last_active":"2024-09-11T22:03:34.918520+0000","last_peered":"2024-09-11T22:03:34.918520+0000","last_clean":"2024-09-11T22:03:34.918520+0000","last_became_active":"2024-09-11T22:02:34.081822+0000","last_became_peered":"2024-09-11T22:02:34.081822+0000","last_unstale":"2024-09-11T22:03:34.918520+0000","last_undegraded":"2024-09-11T22:03:34.918520+0000","last_fullsized":"2024-09-11T22:03:34.918520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:39.320410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348665+0000","last_change":"2024-09-11T22:02:36.112124+0000","last_active":"2024-09-11T22:02:55.348665+0000","last_peered":"2024-09-11T22:02:55.348665+0000","last_clean":"2024-09-11T22:02:55.348665+0000","last_became_active":"2024-09-11T22:02:36.111739+0000","last_became_peered":"2024-09-11T22:02:36.111739+0000","last_unstale":"2024-09-11T22:02:55.348665+0000","last_undegraded":"2024-09-11T22:02:55.348665+0000","last_fullsized":"2024-09-11T22:02:55.348665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:52.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346805+0000","last_change":"2024-09-11T22:02:34.083047+0000","last_active":"2024-09-11T22:02:55.346805+0000","last_peered":"2024-09-11T22:02:55.346805+0000","last_clean":"2024-09-11T22:02:55.346805+0000","last_became_active":"2024-09-11T22:02:34.082406+0000","last_became_peered":"2024-09-11T22:02:34.082406+0000","last_unstale":"2024-09-11T22:02:55.346805+0000","last_undegraded":"2024-09-11T22:02:55.346805+0000","last_fullsized":"2024-09-11T22:02:55.346805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:33.249337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340763+0000","last_change":"2024-09-11T22:02:36.108859+0000","last_active":"2024-09-11T22:02:55.340763+0000","last_peered":"2024-09-11T22:02:55.340763+0000","last_clean":"2024-09-11T22:02:55.340763+0000","last_became_active":"2024-09-11T22:02:36.108558+0000","last_became_peered":"2024-09-11T22:02:36.108558+0000","last_unstale":"2024-09-11T22:02:55.340763+0000","last_undegraded":"2024-09-11T22:02:55.340763+0000","last_fullsized":"2024-09-11T22:02:55.340763+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.430672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341741+0000","last_change":"2024-09-11T22:02:34.080560+0000","last_active":"2024-09-11T22:02:55.341741+0000","last_peered":"2024-09-11T22:02:55.341741+0000","last_clean":"2024-09-11T22:02:55.341741+0000","last_became_active":"2024-09-11T22:02:34.080262+0000","last_became_peered":"2024-09-11T22:02:34.080262+0000","last_unstale":"2024-09-11T22:02:55.341741+0000","last_undegraded":"2024-09-11T22:02:55.341741+0000","last_fullsized":"2024-09-11T22:02:55.341741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:44.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343837+0000","last_change":"2024-09-11T22:02:36.107722+0000","last_active":"2024-09-11T22:02:55.343837+0000","last_peered":"2024-09-11T22:02:55.343837+0000","last_clean":"2024-09-11T22:02:55.343837+0000","last_became_active":"2024-09-11T22:02:36.107219+0000","last_became_peered":"2024-09-11T22:02:36.107219+0000","last_unstale":"2024-09-11T22:02:55.343837+0000","last_undegraded":"2024-09-11T22:02:55.343837+0000","last_fullsized":"2024-09-11T22:02:55.343837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.576045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":78,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:32.910961+0000","last_change":"2024-09-11T22:02:34.083573+0000","last_active":"2024-09-11T22:03:32.910961+0000","last_peered":"2024-09-11T22:03:32.910961+0000","last_clean":"2024-09-11T22:03:32.910961+0000","last_became_active":"2024-09-11T22:02:34.083277+0000","last_became_peered":"2024-09-11T22:02:34.083277+0000","last_unstale":"2024-09-11T22:03:32.910961+0000","last_undegraded":"2024-09-11T22:03:32.910961+0000","last_fullsized":"2024-09-11T22:03:32.910961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:31.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343635+0000","last_change":"2024-09-11T22:02:36.105075+0000","last_active":"2024-09-11T22:02:55.343635+0000","last_peered":"2024-09-11T22:02:55.343635+0000","last_clean":"2024-09-11T22:02:55.343635+0000","last_became_active":"2024-09-11T22:02:36.104022+0000","last_became_peered":"2024-09-11T22:02:36.104022+0000","last_unstale":"2024-09-11T22:02:55.343635+0000","last_undegraded":"2024-09-11T22:02:55.343635+0000","last_fullsized":"2024-09-11T22:02:55.343635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.693146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347063+0000","last_change":"2024-09-11T22:02:34.088727+0000","last_active":"2024-09-11T22:02:55.347063+0000","last_peered":"2024-09-11T22:02:55.347063+0000","last_clean":"2024-09-11T22:02:55.347063+0000","last_became_active":"2024-09-11T22:02:34.088394+0000","last_became_peered":"2024-09-11T22:02:34.088394+0000","last_unstale":"2024-09-11T22:02:55.347063+0000","last_undegraded":"2024-09-11T22:02:55.347063+0000","last_fullsized":"2024-09-11T22:02:55.347063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:11.809765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341774+0000","last_change":"2024-09-11T22:02:36.104522+0000","last_active":"2024-09-11T22:02:55.341774+0000","last_peered":"2024-09-11T22:02:55.341774+0000","last_clean":"2024-09-11T22:02:55.341774+0000","last_became_active":"2024-09-11T22:02:36.104181+0000","last_became_peered":"2024-09-11T22:02:36.104181+0000","last_unstale":"2024-09-11T22:02:55.341774+0000","last_undegraded":"2024-09-11T22:02:55.341774+0000","last_fullsized":"2024-09-11T22:02:55.341774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:08.139180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347551+0000","last_change":"2024-09-11T22:02:34.080341+0000","last_active":"2024-09-11T22:02:55.347551+0000","last_peered":"2024-09-11T22:02:55.347551+0000","last_clean":"2024-09-11T22:02:55.347551+0000","last_became_active":"2024-09-11T22:02:34.078761+0000","last_became_peered":"2024-09-11T22:02:34.078761+0000","last_unstale":"2024-09-11T22:02:55.347551+0000","last_undegraded":"2024-09-11T22:02:55.347551+0000","last_fullsized":"2024-09-11T22:02:55.347551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.545135+0000","last_change":"2024-09-11T22:02:55.545135+0000","last_active":"2024-09-11T22:02:55.545135+0000","last_peered":"2024-09-11T22:02:55.545135+0000","last_clean":"2024-09-11T22:02:55.545135+0000","last_became_active":"2024-09-11T22:02:55.544785+0000","last_became_peered":"2024-09-11T22:02:55.544785+0000","last_unstale":"2024-09-11T22:02:55.545135+0000","last_undegraded":"2024-09-11T22:02:55.545135+0000","last_fullsized":"2024-09-11T22:02:55.545135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:05.815828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341028+0000","last_change":"2024-09-11T22:02:34.082364+0000","last_active":"2024-09-11T22:02:55.341028+0000","last_peered":"2024-09-11T22:02:55.341028+0000","last_clean":"2024-09-11T22:02:55.341028+0000","last_became_active":"2024-09-11T22:02:34.081906+0000","last_became_peered":"2024-09-11T22:02:34.081906+0000","last_unstale":"2024-09-11T22:02:55.341028+0000","last_undegraded":"2024-09-11T22:02:55.341028+0000","last_fullsized":"2024-09-11T22:02:55.341028+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:58.603942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344193+0000","last_change":"2024-09-11T22:02:36.110725+0000","last_active":"2024-09-11T22:02:55.344193+0000","last_peered":"2024-09-11T22:02:55.344193+0000","last_clean":"2024-09-11T22:02:55.344193+0000","last_became_active":"2024-09-11T22:02:36.110401+0000","last_became_peered":"2024-09-11T22:02:36.110401+0000","last_unstale":"2024-09-11T22:02:55.344193+0000","last_undegraded":"2024-09-11T22:02:55.344193+0000","last_fullsized":"2024-09-11T22:02:55.344193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:41.789134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.342240+0000","last_change":"2024-09-11T22:02:34.082983+0000","last_active":"2024-09-11T22:02:55.342240+0000","last_peered":"2024-09-11T22:02:55.342240+0000","last_clean":"2024-09-11T22:02:55.342240+0000","last_became_active":"2024-09-11T22:02:34.082618+0000","last_became_peered":"2024-09-11T22:02:34.082618+0000","last_unstale":"2024-09-11T22:02:55.342240+0000","last_undegraded":"2024-09-11T22:02:55.342240+0000","last_fullsized":"2024-09-11T22:02:55.342240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.481228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343871+0000","last_change":"2024-09-11T22:02:36.108222+0000","last_active":"2024-09-11T22:02:55.343871+0000","last_peered":"2024-09-11T22:02:55.343871+0000","last_clean":"2024-09-11T22:02:55.343871+0000","last_became_active":"2024-09-11T22:02:36.107739+0000","last_became_peered":"2024-09-11T22:02:36.107739+0000","last_unstale":"2024-09-11T22:02:55.343871+0000","last_undegraded":"2024-09-11T22:02:55.343871+0000","last_fullsized":"2024-09-11T22:02:55.343871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:11.353217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347043+0000","last_change":"2024-09-11T22:02:34.090068+0000","last_active":"2024-09-11T22:02:55.347043+0000","last_peered":"2024-09-11T22:02:55.347043+0000","last_clean":"2024-09-11T22:02:55.347043+0000","last_became_active":"2024-09-11T22:02:34.089735+0000","last_became_peered":"2024-09-11T22:02:34.089735+0000","last_unstale":"2024-09-11T22:02:55.347043+0000","last_undegraded":"2024-09-11T22:02:55.347043+0000","last_fullsized":"2024-09-11T22:02:55.347043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:32.917459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343993+0000","last_change":"2024-09-11T22:02:36.108017+0000","last_active":"2024-09-11T22:02:55.343993+0000","last_peered":"2024-09-11T22:02:55.343993+0000","last_clean":"2024-09-11T22:02:55.343993+0000","last_became_active":"2024-09-11T22:02:36.107339+0000","last_became_peered":"2024-09-11T22:02:36.107339+0000","last_unstale":"2024-09-11T22:02:55.343993+0000","last_undegraded":"2024-09-11T22:02:55.343993+0000","last_fullsized":"2024-09-11T22:02:55.343993+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:19.240354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343956+0000","last_change":"2024-09-11T22:01:28.522567+0000","last_active":"2024-09-11T22:02:55.343956+0000","last_peered":"2024-09-11T22:02:55.343956+0000","last_clean":"2024-09-11T22:02:55.343956+0000","last_became_active":"2024-09-11T22:01:28.522079+0000","last_became_peered":"2024-09-11T22:01:28.522079+0000","last_unstale":"2024-09-11T22:02:55.343956+0000","last_undegraded":"2024-09-11T22:02:55.343956+0000","last_fullsized":"2024-09-11T22:02:55.343956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_clean_scrub_stamp":"2024-09-11T21:58:11.245706+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:48.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.543596+0000","last_change":"2024-09-11T22:02:34.080535+0000","last_active":"2024-09-11T22:02:55.543596+0000","last_peered":"2024-09-11T22:02:55.543596+0000","last_clean":"2024-09-11T22:02:55.543596+0000","last_became_active":"2024-09-11T22:02:34.079351+0000","last_became_peered":"2024-09-11T22:02:34.079351+0000","last_unstale":"2024-09-11T22:02:55.543596+0000","last_undegraded":"2024-09-11T22:02:55.543596+0000","last_fullsized":"2024-09-11T22:02:55.543596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:29.737198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346582+0000","last_change":"2024-09-11T22:02:36.104476+0000","last_active":"2024-09-11T22:02:55.346582+0000","last_peered":"2024-09-11T22:02:55.346582+0000","last_clean":"2024-09-11T22:02:55.346582+0000","last_became_active":"2024-09-11T22:02:36.104163+0000","last_became_peered":"2024-09-11T22:02:36.104163+0000","last_unstale":"2024-09-11T22:02:55.346582+0000","last_undegraded":"2024-09-11T22:02:55.346582+0000","last_fullsized":"2024-09-11T22:02:55.346582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.570125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343951+0000","last_change":"2024-09-11T22:02:34.079652+0000","last_active":"2024-09-11T22:02:55.343951+0000","last_peered":"2024-09-11T22:02:55.343951+0000","last_clean":"2024-09-11T22:02:55.343951+0000","last_became_active":"2024-09-11T22:02:34.079365+0000","last_became_peered":"2024-09-11T22:02:34.079365+0000","last_unstale":"2024-09-11T22:02:55.343951+0000","last_undegraded":"2024-09-11T22:02:55.343951+0000","last_fullsized":"2024-09-11T22:02:55.343951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:15.371852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340660+0000","last_change":"2024-09-11T22:02:36.107209+0000","last_active":"2024-09-11T22:02:55.340660+0000","last_peered":"2024-09-11T22:02:55.340660+0000","last_clean":"2024-09-11T22:02:55.340660+0000","last_became_active":"2024-09-11T22:02:36.106896+0000","last_became_peered":"2024-09-11T22:02:36.106896+0000","last_unstale":"2024-09-11T22:02:55.340660+0000","last_undegraded":"2024-09-11T22:02:55.340660+0000","last_fullsized":"2024-09-11T22:02:55.340660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:04.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":74,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:31.909416+0000","last_change":"2024-09-11T22:02:34.088531+0000","last_active":"2024-09-11T22:03:31.909416+0000","last_peered":"2024-09-11T22:03:31.909416+0000","last_clean":"2024-09-11T22:03:31.909416+0000","last_became_active":"2024-09-11T22:02:34.088252+0000","last_became_peered":"2024-09-11T22:02:34.088252+0000","last_unstale":"2024-09-11T22:03:31.909416+0000","last_undegraded":"2024-09-11T22:03:31.909416+0000","last_fullsized":"2024-09-11T22:03:31.909416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:43.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341771+0000","last_change":"2024-09-11T22:02:36.108963+0000","last_active":"2024-09-11T22:02:55.341771+0000","last_peered":"2024-09-11T22:02:55.341771+0000","last_clean":"2024-09-11T22:02:55.341771+0000","last_became_active":"2024-09-11T22:02:36.108435+0000","last_became_peered":"2024-09-11T22:02:36.108435+0000","last_unstale":"2024-09-11T22:02:55.341771+0000","last_undegraded":"2024-09-11T22:02:55.341771+0000","last_fullsized":"2024-09-11T22:02:55.341771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:11.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344233+0000","last_change":"2024-09-11T22:02:34.084283+0000","last_active":"2024-09-11T22:02:55.344233+0000","last_peered":"2024-09-11T22:02:55.344233+0000","last_clean":"2024-09-11T22:02:55.344233+0000","last_became_active":"2024-09-11T22:02:34.083948+0000","last_became_peered":"2024-09-11T22:02:34.083948+0000","last_unstale":"2024-09-11T22:02:55.344233+0000","last_undegraded":"2024-09-11T22:02:55.344233+0000","last_fullsized":"2024-09-11T22:02:55.344233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:48.763643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.848758+0000","last_change":"2024-09-11T22:02:36.102147+0000","last_active":"2024-09-11T22:02:55.848758+0000","last_peered":"2024-09-11T22:02:55.848758+0000","last_clean":"2024-09-11T22:02:55.848758+0000","last_became_active":"2024-09-11T22:02:36.101641+0000","last_became_peered":"2024-09-11T22:02:36.101641+0000","last_unstale":"2024-09-11T22:02:55.848758+0000","last_undegraded":"2024-09-11T22:02:55.848758+0000","last_fullsized":"2024-09-11T22:02:55.848758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:58.145304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343756+0000","last_change":"2024-09-11T22:02:34.090538+0000","last_active":"2024-09-11T22:02:55.343756+0000","last_peered":"2024-09-11T22:02:55.343756+0000","last_clean":"2024-09-11T22:02:55.343756+0000","last_became_active":"2024-09-11T22:02:34.090238+0000","last_became_peered":"2024-09-11T22:02:34.090238+0000","last_unstale":"2024-09-11T22:02:55.343756+0000","last_undegraded":"2024-09-11T22:02:55.343756+0000","last_fullsized":"2024-09-11T22:02:55.343756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:47.037999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.848877+0000","last_change":"2024-09-11T22:02:36.095664+0000","last_active":"2024-09-11T22:02:55.848877+0000","last_peered":"2024-09-11T22:02:55.848877+0000","last_clean":"2024-09-11T22:02:55.848877+0000","last_became_active":"2024-09-11T22:02:36.095304+0000","last_became_peered":"2024-09-11T22:02:36.095304+0000","last_unstale":"2024-09-11T22:02:55.848877+0000","last_undegraded":"2024-09-11T22:02:55.848877+0000","last_fullsized":"2024-09-11T22:02:55.848877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.484809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348688+0000","last_change":"2024-09-11T22:02:34.089781+0000","last_active":"2024-09-11T22:02:55.348688+0000","last_peered":"2024-09-11T22:02:55.348688+0000","last_clean":"2024-09-11T22:02:55.348688+0000","last_became_active":"2024-09-11T22:02:34.089439+0000","last_became_peered":"2024-09-11T22:02:34.089439+0000","last_unstale":"2024-09-11T22:02:55.348688+0000","last_undegraded":"2024-09-11T22:02:55.348688+0000","last_fullsized":"2024-09-11T22:02:55.348688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:38.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.340944+0000","last_change":"2024-09-11T22:02:36.107159+0000","last_active":"2024-09-11T22:02:55.340944+0000","last_peered":"2024-09-11T22:02:55.340944+0000","last_clean":"2024-09-11T22:02:55.340944+0000","last_became_active":"2024-09-11T22:02:36.106846+0000","last_became_peered":"2024-09-11T22:02:36.106846+0000","last_unstale":"2024-09-11T22:02:55.340944+0000","last_undegraded":"2024-09-11T22:02:55.340944+0000","last_fullsized":"2024-09-11T22:02:55.340944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.972944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:03:00.095651+0000","last_change":"2024-09-11T22:02:55.352887+0000","last_active":"2024-09-11T22:03:00.095651+0000","last_peered":"2024-09-11T22:03:00.095651+0000","last_clean":"2024-09-11T22:03:00.095651+0000","last_became_active":"2024-09-11T22:02:55.348619+0000","last_became_peered":"2024-09-11T22:02:55.348619+0000","last_unstale":"2024-09-11T22:03:00.095651+0000","last_undegraded":"2024-09-11T22:03:00.095651+0000","last_fullsized":"2024-09-11T22:03:00.095651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:51.259114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346932+0000","last_change":"2024-09-11T22:02:36.108560+0000","last_active":"2024-09-11T22:02:55.346932+0000","last_peered":"2024-09-11T22:02:55.346932+0000","last_clean":"2024-09-11T22:02:55.346932+0000","last_became_active":"2024-09-11T22:02:36.107593+0000","last_became_peered":"2024-09-11T22:02:36.107593+0000","last_unstale":"2024-09-11T22:02:55.346932+0000","last_undegraded":"2024-09-11T22:02:55.346932+0000","last_fullsized":"2024-09-11T22:02:55.346932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.479991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.544133+0000","last_change":"2024-09-11T22:02:34.087394+0000","last_active":"2024-09-11T22:02:55.544133+0000","last_peered":"2024-09-11T22:02:55.544133+0000","last_clean":"2024-09-11T22:02:55.544133+0000","last_became_active":"2024-09-11T22:02:34.087146+0000","last_became_peered":"2024-09-11T22:02:34.087146+0000","last_unstale":"2024-09-11T22:02:55.544133+0000","last_undegraded":"2024-09-11T22:02:55.544133+0000","last_fullsized":"2024-09-11T22:02:55.544133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:30.772437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.545065+0000","last_change":"2024-09-11T22:02:55.545065+0000","last_active":"2024-09-11T22:02:55.545065+0000","last_peered":"2024-09-11T22:02:55.545065+0000","last_clean":"2024-09-11T22:02:55.545065+0000","last_became_active":"2024-09-11T22:02:55.544736+0000","last_became_peered":"2024-09-11T22:02:55.544736+0000","last_unstale":"2024-09-11T22:02:55.545065+0000","last_undegraded":"2024-09-11T22:02:55.545065+0000","last_fullsized":"2024-09-11T22:02:55.545065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:23.706253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341812+0000","last_change":"2024-09-11T22:02:34.088717+0000","last_active":"2024-09-11T22:02:55.341812+0000","last_peered":"2024-09-11T22:02:55.341812+0000","last_clean":"2024-09-11T22:02:55.341812+0000","last_became_active":"2024-09-11T22:02:34.088412+0000","last_became_peered":"2024-09-11T22:02:34.088412+0000","last_unstale":"2024-09-11T22:02:55.341812+0000","last_undegraded":"2024-09-11T22:02:55.341812+0000","last_fullsized":"2024-09-11T22:02:55.341812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348372+0000","last_change":"2024-09-11T22:02:36.103781+0000","last_active":"2024-09-11T22:02:55.348372+0000","last_peered":"2024-09-11T22:02:55.348372+0000","last_clean":"2024-09-11T22:02:55.348372+0000","last_became_active":"2024-09-11T22:02:36.103426+0000","last_became_peered":"2024-09-11T22:02:36.103426+0000","last_unstale":"2024-09-11T22:02:55.348372+0000","last_undegraded":"2024-09-11T22:02:55.348372+0000","last_fullsized":"2024-09-11T22:02:55.348372+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:34.962793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346446+0000","last_change":"2024-09-11T22:02:34.080333+0000","last_active":"2024-09-11T22:02:55.346446+0000","last_peered":"2024-09-11T22:02:55.346446+0000","last_clean":"2024-09-11T22:02:55.346446+0000","last_became_active":"2024-09-11T22:02:34.079384+0000","last_became_peered":"2024-09-11T22:02:34.079384+0000","last_unstale":"2024-09-11T22:02:55.346446+0000","last_undegraded":"2024-09-11T22:02:55.346446+0000","last_fullsized":"2024-09-11T22:02:55.346446+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:38.313516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343953+0000","last_change":"2024-09-11T22:02:36.103306+0000","last_active":"2024-09-11T22:02:55.343953+0000","last_peered":"2024-09-11T22:02:55.343953+0000","last_clean":"2024-09-11T22:02:55.343953+0000","last_became_active":"2024-09-11T22:02:36.102967+0000","last_became_peered":"2024-09-11T22:02:36.102967+0000","last_unstale":"2024-09-11T22:02:55.343953+0000","last_undegraded":"2024-09-11T22:02:55.343953+0000","last_fullsized":"2024-09-11T22:02:55.343953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:34.138931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.355119+0000","last_change":"2024-09-11T22:02:55.355119+0000","last_active":"2024-09-11T22:02:55.355119+0000","last_peered":"2024-09-11T22:02:55.355119+0000","last_clean":"2024-09-11T22:02:55.355119+0000","last_became_active":"2024-09-11T22:02:55.350440+0000","last_became_peered":"2024-09-11T22:02:55.350440+0000","last_unstale":"2024-09-11T22:02:55.355119+0000","last_undegraded":"2024-09-11T22:02:55.355119+0000","last_fullsized":"2024-09-11T22:02:55.355119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:47.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.346553+0000","last_change":"2024-09-11T22:02:36.102491+0000","last_active":"2024-09-11T22:02:55.346553+0000","last_peered":"2024-09-11T22:02:55.346553+0000","last_clean":"2024-09-11T22:02:55.346553+0000","last_became_active":"2024-09-11T22:02:36.102112+0000","last_became_peered":"2024-09-11T22:02:36.102112+0000","last_unstale":"2024-09-11T22:02:55.346553+0000","last_undegraded":"2024-09-11T22:02:55.346553+0000","last_fullsized":"2024-09-11T22:02:55.346553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:47.588539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347284+0000","last_change":"2024-09-11T22:02:34.082590+0000","last_active":"2024-09-11T22:02:55.347284+0000","last_peered":"2024-09-11T22:02:55.347284+0000","last_clean":"2024-09-11T22:02:55.347284+0000","last_became_active":"2024-09-11T22:02:34.082288+0000","last_became_peered":"2024-09-11T22:02:34.082288+0000","last_unstale":"2024-09-11T22:02:55.347284+0000","last_undegraded":"2024-09-11T22:02:55.347284+0000","last_fullsized":"2024-09-11T22:02:55.347284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:57.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344015+0000","last_change":"2024-09-11T22:02:36.105247+0000","last_active":"2024-09-11T22:02:55.344015+0000","last_peered":"2024-09-11T22:02:55.344015+0000","last_clean":"2024-09-11T22:02:55.344015+0000","last_became_active":"2024-09-11T22:02:36.104912+0000","last_became_peered":"2024-09-11T22:02:36.104912+0000","last_unstale":"2024-09-11T22:02:55.344015+0000","last_undegraded":"2024-09-11T22:02:55.344015+0000","last_fullsized":"2024-09-11T22:02:55.344015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:05.396671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.544869+0000","last_change":"2024-09-11T22:02:55.544428+0000","last_active":"2024-09-11T22:02:55.544869+0000","last_peered":"2024-09-11T22:02:55.544869+0000","last_clean":"2024-09-11T22:02:55.544869+0000","last_became_active":"2024-09-11T22:02:55.544151+0000","last_became_peered":"2024-09-11T22:02:55.544151+0000","last_unstale":"2024-09-11T22:02:55.544869+0000","last_undegraded":"2024-09-11T22:02:55.544869+0000","last_fullsized":"2024-09-11T22:02:55.544869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.100131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.348353+0000","last_change":"2024-09-11T22:02:34.079017+0000","last_active":"2024-09-11T22:02:55.348353+0000","last_peered":"2024-09-11T22:02:55.348353+0000","last_clean":"2024-09-11T22:02:55.348353+0000","last_became_active":"2024-09-11T22:02:34.078663+0000","last_became_peered":"2024-09-11T22:02:34.078663+0000","last_unstale":"2024-09-11T22:02:55.348353+0000","last_undegraded":"2024-09-11T22:02:55.348353+0000","last_fullsized":"2024-09-11T22:02:55.348353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:05.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.341769+0000","last_change":"2024-09-11T22:02:36.097768+0000","last_active":"2024-09-11T22:02:55.341769+0000","last_peered":"2024-09-11T22:02:55.341769+0000","last_clean":"2024-09-11T22:02:55.341769+0000","last_became_active":"2024-09-11T22:02:36.097396+0000","last_became_peered":"2024-09-11T22:02:36.097396+0000","last_unstale":"2024-09-11T22:02:55.341769+0000","last_undegraded":"2024-09-11T22:02:55.341769+0000","last_fullsized":"2024-09-11T22:02:55.341769+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:35.673268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.355229+0000","last_change":"2024-09-11T22:02:55.355229+0000","last_active":"2024-09-11T22:02:55.355229+0000","last_peered":"2024-09-11T22:02:55.355229+0000","last_clean":"2024-09-11T22:02:55.355229+0000","last_became_active":"2024-09-11T22:02:55.350492+0000","last_became_peered":"2024-09-11T22:02:55.350492+0000","last_unstale":"2024-09-11T22:02:55.355229+0000","last_undegraded":"2024-09-11T22:02:55.355229+0000","last_fullsized":"2024-09-11T22:02:55.355229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:03:31.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.343902+0000","last_change":"2024-09-11T22:02:36.108992+0000","last_active":"2024-09-11T22:02:55.343902+0000","last_peered":"2024-09-11T22:02:55.343902+0000","last_clean":"2024-09-11T22:02:55.343902+0000","last_became_active":"2024-09-11T22:02:36.108674+0000","last_became_peered":"2024-09-11T22:02:36.108674+0000","last_unstale":"2024-09-11T22:02:55.343902+0000","last_undegraded":"2024-09-11T22:02:55.343902+0000","last_fullsized":"2024-09-11T22:02:55.343902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:57.083127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347109+0000","last_change":"2024-09-11T22:02:34.088833+0000","last_active":"2024-09-11T22:02:55.347109+0000","last_peered":"2024-09-11T22:02:55.347109+0000","last_clean":"2024-09-11T22:02:55.347109+0000","last_became_active":"2024-09-11T22:02:34.088275+0000","last_became_peered":"2024-09-11T22:02:34.088275+0000","last_unstale":"2024-09-11T22:02:55.347109+0000","last_undegraded":"2024-09-11T22:02:55.347109+0000","last_fullsized":"2024-09-11T22:02:55.347109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:31.167486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.347003+0000","last_change":"2024-09-11T22:02:36.108154+0000","last_active":"2024-09-11T22:02:55.347003+0000","last_peered":"2024-09-11T22:02:55.347003+0000","last_clean":"2024-09-11T22:02:55.347003+0000","last_became_active":"2024-09-11T22:02:36.107817+0000","last_became_peered":"2024-09-11T22:02:36.107817+0000","last_unstale":"2024-09-11T22:02:55.347003+0000","last_undegraded":"2024-09-11T22:02:55.347003+0000","last_fullsized":"2024-09-11T22:02:55.347003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.168339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T22:02:55.344005+0000","last_change":"2024-09-11T22:02:34.082193+0000","last_active":"2024-09-11T22:02:55.344005+0000","last_peered":"2024-09-11T22:02:55.344005+0000","last_clean":"2024-09-11T22:02:55.344005+0000","last_became_active":"2024-09-11T22:02:34.081852+0000","last_became_peered":"2024-09-11T22:02:34.081852+0000","last_unstale":"2024-09-11T22:02:55.344005+0000","last_undegraded":"2024-09-11T22:02:55.344005+0000","last_fullsized":"2024-09-11T22:02:55.344005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:08.319444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":329,"num_read_kb":230,"num_write":164,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514521,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":443245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743453,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1617920,"data_stored":1094883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906979,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":443481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":937984,"data_stored":443401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397548,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1531904,"data_stored":1035726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528369,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":925696,"data_stored":442870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1544192,"data_stored":1035017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953531,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":443700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":443181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":504170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":502427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":444141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:03:39.773 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T22:03:39.773 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T22:03:39.773 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T22:03:39.773 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T22:03:40.020 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:40.397 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:40 smithi152 ceph-mon[31188]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:40.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.396+0000 7f00e7efd640 1 -- 172.21.15.152:0/2583485120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e0103780 msgr2=0x7f00e0107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:40.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.396+0000 7f00e7efd640 1 --2- 172.21.15.152:0/2583485120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e0103780 0x7f00e0107bc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009930 tx=0x7f00d402a420 comp rx=0 tx=0).stop 2024-09-11T22:03:40.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.397+0000 7f00e7efd640 1 -- 172.21.15.152:0/2583485120 shutdown_connections 2024-09-11T22:03:40.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.397+0000 7f00e7efd640 1 --2- 172.21.15.152:0/2583485120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00e0108300 0x7f00e010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.397+0000 7f00e7efd640 1 --2- 172.21.15.152:0/2583485120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e0103780 0x7f00e0107bc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.397+0000 7f00e7efd640 1 --2- 172.21.15.152:0/2583485120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e0102dd0 0x7f00e01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.397+0000 7f00e7efd640 1 -- 172.21.15.152:0/2583485120 >> 172.21.15.152:0/2583485120 conn(0x7f00e00fc7d0 msgr2=0x7f00e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.397+0000 7f00e7efd640 1 -- 172.21.15.152:0/2583485120 shutdown_connections 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.397+0000 7f00e7efd640 1 -- 172.21.15.152:0/2583485120 wait complete. 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.397+0000 7f00e7efd640 1 Processor -- start 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.397+0000 7f00e7efd640 1 -- start start 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e7efd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00e0102dd0 0x7f00e01985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e7efd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e0103780 0x7f00e0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e7efd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e0108300 0x7f00e019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e7efd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0112070 con 0x7f00e0103780 2024-09-11T22:03:40.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e7efd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0111ef0 con 0x7f00e0108300 2024-09-11T22:03:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e7efd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f00e01121f0 con 0x7f00e0102dd0 2024-09-11T22:03:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e5498640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e0103780 0x7f00e0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e5498640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e0103780 0x7f00e0198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38170/0 (socket says 172.21.15.152:38170) 2024-09-11T22:03:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e5498640 1 -- 172.21.15.152:0/417549904 learned_addr learned my addr 172.21.15.152:0/417549904 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e5c99640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00e0102dd0 0x7f00e01985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e649a640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e0108300 0x7f00e019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e5498640 1 -- 172.21.15.152:0/417549904 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00e0102dd0 msgr2=0x7f00e01985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e5498640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00e0102dd0 0x7f00e01985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e5498640 1 -- 172.21.15.152:0/417549904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e0108300 msgr2=0x7f00e019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e5498640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e0108300 0x7f00e019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e5498640 1 -- 172.21.15.152:0/417549904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e019d5a0 con 0x7f00e0103780 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e649a640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e0108300 0x7f00e019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e5498640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e0103780 0x7f00e0198b30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f00d4005940 tx=0x7f00d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00deffd640 1 -- 172.21.15.152:0/417549904 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d403f030 con 0x7f00e0103780 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00e7efd640 1 -- 172.21.15.152:0/417549904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e019d830 con 0x7f00e0103780 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00deffd640 1 -- 172.21.15.152:0/417549904 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00d4003ce0 con 0x7f00e0103780 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.398+0000 7f00deffd640 1 -- 172.21.15.152:0/417549904 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4035070 con 0x7f00e0103780 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.399+0000 7f00e7efd640 1 -- 172.21.15.152:0/417549904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e01a5170 con 0x7f00e0103780 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.399+0000 7f00e7efd640 1 -- 172.21.15.152:0/417549904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e01031b0 con 0x7f00e0103780 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.401+0000 7f00deffd640 1 -- 172.21.15.152:0/417549904 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f00d4042030 con 0x7f00e0103780 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.401+0000 7f00deffd640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f00c80a2c10 0x7f00c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.401+0000 7f00e5c99640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f00c80a2c10 0x7f00c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.402+0000 7f00deffd640 1 -- 172.21.15.152:0/417549904 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f00d40ef910 con 0x7f00e0103780 2024-09-11T22:03:40.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.402+0000 7f00e5c99640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f00c80a2c10 0x7f00c80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f00d8005d00 tx=0x7f00d800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:40.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.404+0000 7f00deffd640 1 -- 172.21.15.152:0/417549904 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00d40bc6f0 con 0x7f00e0103780 2024-09-11T22:03:40.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:40 smithi179 ceph-mon[35603]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:40.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:40 smithi193 ceph-mon[35545]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:03:40.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.609+0000 7f00e7efd640 1 -- 172.21.15.152:0/417549904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f00e0199950 con 0x7f00e0103780 2024-09-11T22:03:40.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.610+0000 7f00deffd640 1 -- 172.21.15.152:0/417549904 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f00e0199950 con 0x7f00e0103780 2024-09-11T22:03:40.611 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:40.611 INFO:teuthology.orchestra.run.smithi152.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T22:03:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 -- 172.21.15.152:0/417549904 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f00c80a2c10 msgr2=0x7f00c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f00c80a2c10 0x7f00c80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f00d8005d00 tx=0x7f00d800b410 comp rx=0 tx=0).stop 2024-09-11T22:03:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 -- 172.21.15.152:0/417549904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e0103780 msgr2=0x7f00e0198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e0103780 0x7f00e0198b30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f00d4005940 tx=0x7f00d40042f0 comp rx=0 tx=0).stop 2024-09-11T22:03:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 -- 172.21.15.152:0/417549904 shutdown_connections 2024-09-11T22:03:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e0108300 0x7f00e019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e0103780 0x7f00e0198b30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f00c80a2c10 0x7f00c80a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 --2- 172.21.15.152:0/417549904 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00e0102dd0 0x7f00e01985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 -- 172.21.15.152:0/417549904 >> 172.21.15.152:0/417549904 conn(0x7f00e00fc7d0 msgr2=0x7f00e0105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:40.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 -- 172.21.15.152:0/417549904 shutdown_connections 2024-09-11T22:03:40.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:40.612+0000 7f00e7efd640 1 -- 172.21.15.152:0/417549904 wait complete. 2024-09-11T22:03:41.243 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T22:03:41.244 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:03:41.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:41 smithi152 ceph-mon[31188]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:41.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:41 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/417549904' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T22:03:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:41.586 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:41 smithi193 ceph-mon[35545]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:41.586 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:41 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/417549904' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T22:03:41.755 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:41 smithi179 ceph-mon[35603]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:41.755 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:41 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/417549904' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T22:03:41.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.897+0000 7f09f3add640 1 -- 172.21.15.152:0/3674474162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09ec103660 msgr2=0x7f09ec10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:41.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.897+0000 7f09f3add640 1 --2- 172.21.15.152:0/3674474162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09ec103660 0x7f09ec10bb50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009900 tx=0x7f09e002a480 comp rx=0 tx=0).stop 2024-09-11T22:03:41.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.897+0000 7f09f3add640 1 -- 172.21.15.152:0/3674474162 shutdown_connections 2024-09-11T22:03:41.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.897+0000 7f09f3add640 1 --2- 172.21.15.152:0/3674474162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09ec10c170 0x7f09ec10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:41.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.897+0000 7f09f3add640 1 --2- 172.21.15.152:0/3674474162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09ec103660 0x7f09ec10bb50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.897+0000 7f09f3add640 1 --2- 172.21.15.152:0/3674474162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09ec102d40 0x7f09ec103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.897+0000 7f09f3add640 1 -- 172.21.15.152:0/3674474162 >> 172.21.15.152:0/3674474162 conn(0x7f09ec0fc7a0 msgr2=0x7f09ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.897+0000 7f09f3add640 1 -- 172.21.15.152:0/3674474162 shutdown_connections 2024-09-11T22:03:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.897+0000 7f09f3add640 1 -- 172.21.15.152:0/3674474162 wait complete. 2024-09-11T22:03:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f3add640 1 Processor -- start 2024-09-11T22:03:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f3add640 1 -- start start 2024-09-11T22:03:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f3add640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09ec102d40 0x7f09ec1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f3add640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09ec103660 0x7f09ec1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f3add640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09ec10c170 0x7f09ec19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f3add640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec111f70 con 0x7f09ec102d40 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f3add640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec111df0 con 0x7f09ec10c170 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f3add640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec1120f0 con 0x7f09ec103660 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f1879640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09ec102d40 0x7f09ec1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f1879640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09ec102d40 0x7f09ec1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38182/0 (socket says 172.21.15.152:38182) 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f1879640 1 -- 172.21.15.152:0/1688131452 learned_addr learned my addr 172.21.15.152:0/1688131452 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.898+0000 7f09f207a640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09ec10c170 0x7f09ec19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09f1078640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09ec103660 0x7f09ec1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09f1879640 1 -- 172.21.15.152:0/1688131452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09ec103660 msgr2=0x7f09ec1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09f1879640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09ec103660 0x7f09ec1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09f1879640 1 -- 172.21.15.152:0/1688131452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09ec10c170 msgr2=0x7f09ec19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09f1879640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09ec10c170 0x7f09ec19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09f1879640 1 -- 172.21.15.152:0/1688131452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec19d460 con 0x7f09ec102d40 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09f1879640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09ec102d40 0x7f09ec1984b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f09e800d770 tx=0x7f09e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09deffd640 1 -- 172.21.15.152:0/1688131452 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8017070 con 0x7f09ec102d40 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09deffd640 1 -- 172.21.15.152:0/1688131452 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09e8005500 con 0x7f09ec102d40 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09f3add640 1 -- 172.21.15.152:0/1688131452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ec19d750 con 0x7f09ec102d40 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09deffd640 1 -- 172.21.15.152:0/1688131452 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8004e00 con 0x7f09ec102d40 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.899+0000 7f09f3add640 1 -- 172.21.15.152:0/1688131452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ec1a5030 con 0x7f09ec102d40 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.900+0000 7f09f3add640 1 -- 172.21.15.152:0/1688131452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09ec103120 con 0x7f09ec102d40 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.901+0000 7f09deffd640 1 -- 172.21.15.152:0/1688131452 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f09e8004fa0 con 0x7f09ec102d40 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.902+0000 7f09deffd640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f09d80a2c90 0x7f09d80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.902+0000 7f09f1078640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f09d80a2c90 0x7f09d80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.902+0000 7f09deffd640 1 -- 172.21.15.152:0/1688131452 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f09e80cef80 con 0x7f09ec102d40 2024-09-11T22:03:41.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.902+0000 7f09f1078640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f09d80a2c90 0x7f09d80a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009230 tx=0x7f09e00058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:41.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:41.905+0000 7f09deffd640 1 -- 172.21.15.152:0/1688131452 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09e809b790 con 0x7f09ec102d40 2024-09-11T22:03:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.105+0000 7f09f3add640 1 -- 172.21.15.152:0/1688131452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09ec199810 con 0x7f09ec102d40 2024-09-11T22:03:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.105+0000 7f09deffd640 1 -- 172.21.15.152:0/1688131452 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11923 (secure 0 0 0) 0x7f09ec199810 con 0x7f09ec102d40 2024-09-11T22:03:42.106 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:42.107 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":23,"btime":"2024-09-11T22:02:48:141067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:02:47.341860+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:03:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 23 2024-09-11T22:03:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 -- 172.21.15.152:0/1688131452 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f09d80a2c90 msgr2=0x7f09d80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f09d80a2c90 0x7f09d80a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009230 tx=0x7f09e00058d0 comp rx=0 tx=0).stop 2024-09-11T22:03:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 -- 172.21.15.152:0/1688131452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09ec102d40 msgr2=0x7f09ec1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09ec102d40 0x7f09ec1984b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f09e800d770 tx=0x7f09e800dc30 comp rx=0 tx=0).stop 2024-09-11T22:03:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 -- 172.21.15.152:0/1688131452 shutdown_connections 2024-09-11T22:03:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09ec10c170 0x7f09ec19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f09d80a2c90 0x7f09d80a5150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09ec103660 0x7f09ec1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 --2- 172.21.15.152:0/1688131452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09ec102d40 0x7f09ec1984b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 -- 172.21.15.152:0/1688131452 >> 172.21.15.152:0/1688131452 conn(0x7f09ec0fc7a0 msgr2=0x7f09ec0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 -- 172.21.15.152:0/1688131452 shutdown_connections 2024-09-11T22:03:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:42.108+0000 7f09f3add640 1 -- 172.21.15.152:0/1688131452 wait complete. 2024-09-11T22:03:42.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:42 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1688131452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:03:42.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:42 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1688131452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:03:42.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:42 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1688131452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:03:42.760 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:03:43.007 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:43.433 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:43 smithi152 ceph-mon[31188]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:43.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.432+0000 7fd19c64b640 1 -- 172.21.15.152:0/3938484520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd194102ef0 msgr2=0x7fd19410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:43.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.432+0000 7fd19c64b640 1 --2- 172.21.15.152:0/3938484520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd194102ef0 0x7fd19410da40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009ca0 tx=0x7fd18c02a950 comp rx=0 tx=0).stop 2024-09-11T22:03:43.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.432+0000 7fd19c64b640 1 -- 172.21.15.152:0/3938484520 shutdown_connections 2024-09-11T22:03:43.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.432+0000 7fd19c64b640 1 --2- 172.21.15.152:0/3938484520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd194102ef0 0x7fd19410da40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:43.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.432+0000 7fd19c64b640 1 --2- 172.21.15.152:0/3938484520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd194102570 0x7fd1941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:43.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.432+0000 7fd19c64b640 1 --2- 172.21.15.152:0/3938484520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194100e20 0x7fd194101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:43.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.432+0000 7fd19c64b640 1 -- 172.21.15.152:0/3938484520 >> 172.21.15.152:0/3938484520 conn(0x7fd1940fc7d0 msgr2=0x7fd1940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:43.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.432+0000 7fd19c64b640 1 -- 172.21.15.152:0/3938484520 shutdown_connections 2024-09-11T22:03:43.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.432+0000 7fd19c64b640 1 -- 172.21.15.152:0/3938484520 wait complete. 2024-09-11T22:03:43.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.433+0000 7fd19c64b640 1 Processor -- start 2024-09-11T22:03:43.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.433+0000 7fd19c64b640 1 -- start start 2024-09-11T22:03:43.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.433+0000 7fd19c64b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194100e20 0x7fd194198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:43.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.433+0000 7fd19c64b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd194102570 0x7fd194198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:43.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.433+0000 7fd19c64b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd194102ef0 0x7fd19419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:43.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.433+0000 7fd19c64b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd194110f80 con 0x7fd194102570 2024-09-11T22:03:43.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.433+0000 7fd19c64b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd194110e00 con 0x7fd194102ef0 2024-09-11T22:03:43.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.433+0000 7fd19c64b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd194111100 con 0x7fd194100e20 2024-09-11T22:03:43.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.433+0000 7fd199be6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd194102570 0x7fd194198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:43.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.433+0000 7fd199be6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd194102570 0x7fd194198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39202/0 (socket says 172.21.15.152:39202) 2024-09-11T22:03:43.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.433+0000 7fd199be6640 1 -- 172.21.15.152:0/1299368550 learned_addr learned my addr 172.21.15.152:0/1299368550 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:43.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd19abe8640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd194102ef0 0x7fd19419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:43.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd19a3e7640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194100e20 0x7fd194198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:43.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd199be6640 1 -- 172.21.15.152:0/1299368550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194100e20 msgr2=0x7fd194198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd199be6640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194100e20 0x7fd194198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd199be6640 1 -- 172.21.15.152:0/1299368550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd194102ef0 msgr2=0x7fd19419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd199be6640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd194102ef0 0x7fd19419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd199be6640 1 -- 172.21.15.152:0/1299368550 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19419d4b0 con 0x7fd194102570 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd19a3e7640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194100e20 0x7fd194198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd199be6640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd194102570 0x7fd194198a40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd19000d950 tx=0x7fd19000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd18b7fe640 1 -- 172.21.15.152:0/1299368550 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd190017070 con 0x7fd194102570 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd19c64b640 1 -- 172.21.15.152:0/1299368550 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd19419d7a0 con 0x7fd194102570 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd18b7fe640 1 -- 172.21.15.152:0/1299368550 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd190009c30 con 0x7fd194102570 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd18b7fe640 1 -- 172.21.15.152:0/1299368550 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19000f6b0 con 0x7fd194102570 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.434+0000 7fd19c64b640 1 -- 172.21.15.152:0/1299368550 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1941a5080 con 0x7fd194102570 2024-09-11T22:03:43.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.435+0000 7fd19c64b640 1 -- 172.21.15.152:0/1299368550 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd194101200 con 0x7fd194102570 2024-09-11T22:03:43.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.436+0000 7fd18b7fe640 1 -- 172.21.15.152:0/1299368550 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd1900109d0 con 0x7fd194102570 2024-09-11T22:03:43.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.437+0000 7fd18b7fe640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1800a2c10 0x7fd1800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:43.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.437+0000 7fd19a3e7640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1800a2c10 0x7fd1800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:43.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.437+0000 7fd18b7fe640 1 -- 172.21.15.152:0/1299368550 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fd1900cedf0 con 0x7fd194102570 2024-09-11T22:03:43.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.437+0000 7fd19a3e7640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1800a2c10 0x7fd1800a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd184009c20 tx=0x7fd184005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:43.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.441+0000 7fd18b7fe640 1 -- 172.21.15.152:0/1299368550 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd190009de0 con 0x7fd194102570 2024-09-11T22:03:43.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:43 smithi179 ceph-mon[35603]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:43 smithi193 ceph-mon[35545]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:43.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.643+0000 7fd19c64b640 1 -- 172.21.15.152:0/1299368550 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd19410a0d0 con 0x7fd194102570 2024-09-11T22:03:43.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.644+0000 7fd18b7fe640 1 -- 172.21.15.152:0/1299368550 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11923 (secure 0 0 0) 0x7fd19009bbd0 con 0x7fd194102570 2024-09-11T22:03:43.644 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:43.645 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":23,"btime":"2024-09-11T22:02:48:141067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:02:47.341860+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:03:43.645 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 23 2024-09-11T22:03:43.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 -- 172.21.15.152:0/1299368550 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1800a2c10 msgr2=0x7fd1800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:43.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1800a2c10 0x7fd1800a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd184009c20 tx=0x7fd184005f90 comp rx=0 tx=0).stop 2024-09-11T22:03:43.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 -- 172.21.15.152:0/1299368550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd194102570 msgr2=0x7fd194198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:43.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd194102570 0x7fd194198a40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd19000d950 tx=0x7fd19000de10 comp rx=0 tx=0).stop 2024-09-11T22:03:43.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 -- 172.21.15.152:0/1299368550 shutdown_connections 2024-09-11T22:03:43.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd194102ef0 0x7fd19419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:43.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd194102570 0x7fd194198a40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:43.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fd1800a2c10 0x7fd1800a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:43.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 --2- 172.21.15.152:0/1299368550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194100e20 0x7fd194198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:43.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 -- 172.21.15.152:0/1299368550 >> 172.21.15.152:0/1299368550 conn(0x7fd1940fc7d0 msgr2=0x7fd19406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:43.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 -- 172.21.15.152:0/1299368550 shutdown_connections 2024-09-11T22:03:43.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:43.646+0000 7fd19c64b640 1 -- 172.21.15.152:0/1299368550 wait complete. 2024-09-11T22:03:44.227 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:03:44.476 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:44.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:44 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1299368550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:03:44.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:44 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1299368550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:03:44.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:44 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1299368550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:03:44.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.872+0000 7efddd53e640 1 -- 172.21.15.152:0/2694288730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd8102790 msgr2=0x7efdd81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:44.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.872+0000 7efddd53e640 1 --2- 172.21.15.152:0/2694288730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd8102790 0x7efdd81067e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009900 tx=0x7efdc002a410 comp rx=0 tx=0).stop 2024-09-11T22:03:44.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.872+0000 7efddd53e640 1 -- 172.21.15.152:0/2694288730 shutdown_connections 2024-09-11T22:03:44.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.872+0000 7efddd53e640 1 --2- 172.21.15.152:0/2694288730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdd8106f10 0x7efdd810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:44.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.872+0000 7efddd53e640 1 --2- 172.21.15.152:0/2694288730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd8102790 0x7efdd81067e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:44.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.872+0000 7efddd53e640 1 --2- 172.21.15.152:0/2694288730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd8101de0 0x7efdd81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:44.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.872+0000 7efddd53e640 1 -- 172.21.15.152:0/2694288730 >> 172.21.15.152:0/2694288730 conn(0x7efdd80fd8c0 msgr2=0x7efdd80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:44.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.872+0000 7efddd53e640 1 -- 172.21.15.152:0/2694288730 shutdown_connections 2024-09-11T22:03:44.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.872+0000 7efddd53e640 1 -- 172.21.15.152:0/2694288730 wait complete. 2024-09-11T22:03:44.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.873+0000 7efddd53e640 1 Processor -- start 2024-09-11T22:03:44.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.873+0000 7efddd53e640 1 -- start start 2024-09-11T22:03:44.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.873+0000 7efddd53e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd8101de0 0x7efdd81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:44.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.873+0000 7efddd53e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdd8102790 0x7efdd81988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:44.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.873+0000 7efddd53e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd8106f10 0x7efdd819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:44.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.873+0000 7efddd53e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efdd8111f70 con 0x7efdd8106f10 2024-09-11T22:03:44.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.873+0000 7efddd53e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efdd8111df0 con 0x7efdd8101de0 2024-09-11T22:03:44.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.873+0000 7efddd53e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efdd81120f0 con 0x7efdd8102790 2024-09-11T22:03:44.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.873+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd8106f10 0x7efdd819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:44.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.873+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd8106f10 0x7efdd819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39212/0 (socket says 172.21.15.152:39212) 2024-09-11T22:03:44.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.873+0000 7efdd77fe640 1 -- 172.21.15.152:0/2924966502 learned_addr learned my addr 172.21.15.152:0/2924966502 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:44.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efdce7fc640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdd8102790 0x7efdd81988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:44.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efdd6ffd640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd8101de0 0x7efdd81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:44.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efdd77fe640 1 -- 172.21.15.152:0/2924966502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdd8102790 msgr2=0x7efdd81988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:44.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efdd77fe640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdd8102790 0x7efdd81988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:44.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efdd77fe640 1 -- 172.21.15.152:0/2924966502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd8101de0 msgr2=0x7efdd81983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:44.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efdd77fe640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd8101de0 0x7efdd81983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:44.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efdd77fe640 1 -- 172.21.15.152:0/2924966502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd819d360 con 0x7efdd8106f10 2024-09-11T22:03:44.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efdd77fe640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd8106f10 0x7efdd819cc80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efdd000cce0 tx=0x7efdd000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:44.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efdd4ff9640 1 -- 172.21.15.152:0/2924966502 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd000f450 con 0x7efdd8106f10 2024-09-11T22:03:44.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efddd53e640 1 -- 172.21.15.152:0/2924966502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd819d650 con 0x7efdd8106f10 2024-09-11T22:03:44.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efdd4ff9640 1 -- 172.21.15.152:0/2924966502 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdd000fad0 con 0x7efdd8106f10 2024-09-11T22:03:44.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efdd4ff9640 1 -- 172.21.15.152:0/2924966502 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0018c10 con 0x7efdd8106f10 2024-09-11T22:03:44.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.874+0000 7efddd53e640 1 -- 172.21.15.152:0/2924966502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd81a4f30 con 0x7efdd8106f10 2024-09-11T22:03:44.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.875+0000 7efddd53e640 1 -- 172.21.15.152:0/2924966502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd81021c0 con 0x7efdd8106f10 2024-09-11T22:03:44.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.876+0000 7efdd4ff9640 1 -- 172.21.15.152:0/2924966502 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7efdd000f5f0 con 0x7efdd8106f10 2024-09-11T22:03:44.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.877+0000 7efdd4ff9640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efdc40a2c10 0x7efdc40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:44.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.877+0000 7efdd6ffd640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efdc40a2c10 0x7efdc40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:44.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.877+0000 7efdd4ff9640 1 -- 172.21.15.152:0/2924966502 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7efdd00cf7c0 con 0x7efdd8106f10 2024-09-11T22:03:44.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.877+0000 7efdd6ffd640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efdc40a2c10 0x7efdc40a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efdc800bbe0 tx=0x7efdc800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:44.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:44.881+0000 7efdd4ff9640 1 -- 172.21.15.152:0/2924966502 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efdd0014030 con 0x7efdd8106f10 2024-09-11T22:03:45.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.048+0000 7efddd53e640 1 -- 172.21.15.152:0/2924966502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdd8109bc0 con 0x7efdd8106f10 2024-09-11T22:03:45.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.049+0000 7efdd4ff9640 1 -- 172.21.15.152:0/2924966502 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22820 (secure 0 0 0) 0x7efdd009c5a0 con 0x7efdd8106f10 2024-09-11T22:03:45.050 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:45.051 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":84,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:02:55.337928+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:03:45.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.051+0000 7efddd53e640 1 -- 172.21.15.152:0/2924966502 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efdc40a2c10 msgr2=0x7efdc40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.051+0000 7efddd53e640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efdc40a2c10 0x7efdc40a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efdc800bbe0 tx=0x7efdc800b390 comp rx=0 tx=0).stop 2024-09-11T22:03:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.051+0000 7efddd53e640 1 -- 172.21.15.152:0/2924966502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd8106f10 msgr2=0x7efdd819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.051+0000 7efddd53e640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd8106f10 0x7efdd819cc80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efdd000cce0 tx=0x7efdd000a620 comp rx=0 tx=0).stop 2024-09-11T22:03:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.052+0000 7efddd53e640 1 -- 172.21.15.152:0/2924966502 shutdown_connections 2024-09-11T22:03:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.052+0000 7efddd53e640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd8106f10 0x7efdd819cc80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.052+0000 7efddd53e640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7efdc40a2c10 0x7efdc40a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.052+0000 7efddd53e640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdd8102790 0x7efdd81988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.052+0000 7efddd53e640 1 --2- 172.21.15.152:0/2924966502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd8101de0 0x7efdd81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.052+0000 7efddd53e640 1 -- 172.21.15.152:0/2924966502 >> 172.21.15.152:0/2924966502 conn(0x7efdd80fd8c0 msgr2=0x7efdd80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.052+0000 7efddd53e640 1 -- 172.21.15.152:0/2924966502 shutdown_connections 2024-09-11T22:03:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:45.052+0000 7efddd53e640 1 -- 172.21.15.152:0/2924966502 wait complete. 2024-09-11T22:03:45.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:45 smithi179 ceph-mon[35603]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:45.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:45 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2924966502' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:03:45.569 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:45 smithi152 ceph-mon[31188]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:45.569 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:45 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2924966502' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:03:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:45 smithi193 ceph-mon[35545]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:45 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2924966502' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:03:45.801 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:03:46.048 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:46.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.506+0000 7f7724310640 1 -- 172.21.15.152:0/4290326495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f771c108300 msgr2=0x7f771c10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:46.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.506+0000 7f7724310640 1 --2- 172.21.15.152:0/4290326495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f771c108300 0x7f771c10ec70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7714009cd0 tx=0x7f771402a8f0 comp rx=0 tx=0).stop 2024-09-11T22:03:46.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.506+0000 7f7724310640 1 -- 172.21.15.152:0/4290326495 shutdown_connections 2024-09-11T22:03:46.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.506+0000 7f7724310640 1 --2- 172.21.15.152:0/4290326495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f771c108300 0x7f771c10ec70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:46.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.506+0000 7f7724310640 1 --2- 172.21.15.152:0/4290326495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c103780 0x7f771c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:46.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.506+0000 7f7724310640 1 --2- 172.21.15.152:0/4290326495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f771c102dd0 0x7f771c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:46.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.506+0000 7f7724310640 1 -- 172.21.15.152:0/4290326495 >> 172.21.15.152:0/4290326495 conn(0x7f771c0fc7d0 msgr2=0x7f771c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:46.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.506+0000 7f7724310640 1 -- 172.21.15.152:0/4290326495 shutdown_connections 2024-09-11T22:03:46.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.506+0000 7f7724310640 1 -- 172.21.15.152:0/4290326495 wait complete. 2024-09-11T22:03:46.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.506+0000 7f7724310640 1 Processor -- start 2024-09-11T22:03:46.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.506+0000 7f7724310640 1 -- start start 2024-09-11T22:03:46.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f7724310640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f771c102dd0 0x7f771c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:46.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f7724310640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f771c103780 0x7f771c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:46.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f7724310640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c108300 0x7f771c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:46.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f7724310640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1120f0 con 0x7f771c102dd0 2024-09-11T22:03:46.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f7724310640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f771c111f70 con 0x7f771c108300 2024-09-11T22:03:46.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f7724310640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f771c112270 con 0x7f771c103780 2024-09-11T22:03:46.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77220ac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f771c102dd0 0x7f771c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:46.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77220ac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f771c102dd0 0x7f771c1985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39230/0 (socket says 172.21.15.152:39230) 2024-09-11T22:03:46.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77220ac640 1 -- 172.21.15.152:0/2812230013 learned_addr learned my addr 172.21.15.152:0/2812230013 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:46.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77218ab640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f771c103780 0x7f771c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:46.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77228ad640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c108300 0x7f771c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:46.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77220ac640 1 -- 172.21.15.152:0/2812230013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f771c103780 msgr2=0x7f771c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:46.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77220ac640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f771c103780 0x7f771c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:46.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77220ac640 1 -- 172.21.15.152:0/2812230013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c108300 msgr2=0x7f771c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:46.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77220ac640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c108300 0x7f771c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:46.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77220ac640 1 -- 172.21.15.152:0/2812230013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c19d570 con 0x7f771c102dd0 2024-09-11T22:03:46.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77228ad640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c108300 0x7f771c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:46.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f77220ac640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f771c102dd0 0x7f771c1985c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f771000d950 tx=0x7f771000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:46.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f770f7fe640 1 -- 172.21.15.152:0/2812230013 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710017070 con 0x7f771c102dd0 2024-09-11T22:03:46.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f770f7fe640 1 -- 172.21.15.152:0/2812230013 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f771000de80 con 0x7f771c102dd0 2024-09-11T22:03:46.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f7724310640 1 -- 172.21.15.152:0/2812230013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c19d860 con 0x7f771c102dd0 2024-09-11T22:03:46.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f770f7fe640 1 -- 172.21.15.152:0/2812230013 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771000f620 con 0x7f771c102dd0 2024-09-11T22:03:46.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.507+0000 7f7724310640 1 -- 172.21.15.152:0/2812230013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c1a5140 con 0x7f771c102dd0 2024-09-11T22:03:46.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.508+0000 7f7724310640 1 -- 172.21.15.152:0/2812230013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771c1031b0 con 0x7f771c102dd0 2024-09-11T22:03:46.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.509+0000 7f770f7fe640 1 -- 172.21.15.152:0/2812230013 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7710009c30 con 0x7f771c102dd0 2024-09-11T22:03:46.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.510+0000 7f770f7fe640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77080a2c10 0x7f77080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:46.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.510+0000 7f77218ab640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77080a2c10 0x7f77080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:46.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.510+0000 7f770f7fe640 1 -- 172.21.15.152:0/2812230013 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f77100cef40 con 0x7f771c102dd0 2024-09-11T22:03:46.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.511+0000 7f77218ab640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77080a2c10 0x7f77080a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f771c0fee60 tx=0x7f7718009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:46.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.513+0000 7f770f7fe640 1 -- 172.21.15.152:0/2812230013 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f771009bcc0 con 0x7f771c102dd0 2024-09-11T22:03:46.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.714+0000 7f7724310640 1 -- 172.21.15.152:0/2812230013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f771c10a290 con 0x7f771c102dd0 2024-09-11T22:03:46.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.715+0000 7f770f7fe640 1 -- 172.21.15.152:0/2812230013 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11923 (secure 0 0 0) 0x7f771009b5c0 con 0x7f771c102dd0 2024-09-11T22:03:46.717 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:03:46.717 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":23,"btime":"2024-09-11T22:02:48:141067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:02:47.341860+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:03:46.717 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 23 2024-09-11T22:03:46.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 -- 172.21.15.152:0/2812230013 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77080a2c10 msgr2=0x7f77080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:46.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77080a2c10 0x7f77080a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f771c0fee60 tx=0x7f7718009110 comp rx=0 tx=0).stop 2024-09-11T22:03:46.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 -- 172.21.15.152:0/2812230013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f771c102dd0 msgr2=0x7f771c1985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:46.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f771c102dd0 0x7f771c1985c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f771000d950 tx=0x7f771000dd50 comp rx=0 tx=0).stop 2024-09-11T22:03:46.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 -- 172.21.15.152:0/2812230013 shutdown_connections 2024-09-11T22:03:46.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c108300 0x7f771c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:46.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77080a2c10 0x7f77080a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:46.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f771c103780 0x7f771c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:46.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 --2- 172.21.15.152:0/2812230013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f771c102dd0 0x7f771c1985c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:46.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 -- 172.21.15.152:0/2812230013 >> 172.21.15.152:0/2812230013 conn(0x7f771c0fc7d0 msgr2=0x7f771c105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:46.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 -- 172.21.15.152:0/2812230013 shutdown_connections 2024-09-11T22:03:46.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:46.717+0000 7f7724310640 1 -- 172.21.15.152:0/2812230013 wait complete. 2024-09-11T22:03:47.356 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:47 smithi152 ceph-mon[31188]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:47.357 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:47 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2812230013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:03:47.383 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T22:02:36.537273+0000', 'modified': '2024-09-11T22:02:47.341860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24472, 'mds_1': 24470, 'mds_2': 24457}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24431': {'gid': 24431, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6835/161011948', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 161011948}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 161011948}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6837/4020116810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 4020116810}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 4020116810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6835/714804093', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 714804093}, {'type': 'v1', 'addr': '172.21.15.193:6835', 'nonce': 714804093}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.193:6837/3273726370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6836', 'nonce': 3273726370}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 3273726370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'b', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.179:6839/7269368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6838', 'nonce': 7269368}, {'type': 'v1', 'addr': '172.21.15.179:6839', 'nonce': 7269368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.193:6839/1925980452', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6838', 'nonce': 1925980452}, {'type': 'v1', 'addr': '172.21.15.193:6839', 'nonce': 1925980452}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24472, 'qdb_cluster': [24457, 24470, 24472]} 2024-09-11T22:03:47.383 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T22:03:47.383 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T22:03:47.629 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:47 smithi179 ceph-mon[35603]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:47 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2812230013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:03:47.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:47 smithi193 ceph-mon[35545]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:47.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:47 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2812230013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:03:48.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.021+0000 7fbc152a7640 1 -- 172.21.15.152:0/3021051891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc10100930 msgr2=0x7fbc10100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:48.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.021+0000 7fbc152a7640 1 --2- 172.21.15.152:0/3021051891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc10100930 0x7fbc10100d10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009900 tx=0x7fbc0002a410 comp rx=0 tx=0).stop 2024-09-11T22:03:48.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.021+0000 7fbc152a7640 1 -- 172.21.15.152:0/3021051891 shutdown_connections 2024-09-11T22:03:48.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.021+0000 7fbc152a7640 1 --2- 172.21.15.152:0/3021051891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc1010e4e0 0x7fbc101108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.021+0000 7fbc152a7640 1 --2- 172.21.15.152:0/3021051891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc101012e0 0x7fbc1010dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.021+0000 7fbc152a7640 1 --2- 172.21.15.152:0/3021051891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc10100930 0x7fbc10100d10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.021+0000 7fbc152a7640 1 -- 172.21.15.152:0/3021051891 >> 172.21.15.152:0/3021051891 conn(0x7fbc100fc7a0 msgr2=0x7fbc100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.021+0000 7fbc152a7640 1 -- 172.21.15.152:0/3021051891 shutdown_connections 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.021+0000 7fbc152a7640 1 -- 172.21.15.152:0/3021051891 wait complete. 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.022+0000 7fbc152a7640 1 Processor -- start 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.022+0000 7fbc152a7640 1 -- start start 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.022+0000 7fbc152a7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc10100930 0x7fbc1019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.022+0000 7fbc152a7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc101012e0 0x7fbc1019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.022+0000 7fbc152a7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc1010e4e0 0x7fbc1019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.022+0000 7fbc152a7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbc101141e0 con 0x7fbc101012e0 2024-09-11T22:03:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc152a7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbc10114060 con 0x7fbc10100930 2024-09-11T22:03:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc152a7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbc10114360 con 0x7fbc1010e4e0 2024-09-11T22:03:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc0e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc101012e0 0x7fbc1019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc0e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc101012e0 0x7fbc1019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39256/0 (socket says 172.21.15.152:39256) 2024-09-11T22:03:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc0e7fc640 1 -- 172.21.15.152:0/3053994105 learned_addr learned my addr 172.21.15.152:0/3053994105 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc0effd640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc10100930 0x7fbc1019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc1010e4e0 0x7fbc1019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc0e7fc640 1 -- 172.21.15.152:0/3053994105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc1010e4e0 msgr2=0x7fbc1019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc0e7fc640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc1010e4e0 0x7fbc1019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc0e7fc640 1 -- 172.21.15.152:0/3053994105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc10100930 msgr2=0x7fbc1019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc0e7fc640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc10100930 0x7fbc1019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc0e7fc640 1 -- 172.21.15.152:0/3053994105 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1019f670 con 0x7fbc101012e0 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc0e7fc640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc101012e0 0x7fbc1019ac00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400d950 tx=0x7fbc0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbbf7fff640 1 -- 172.21.15.152:0/3053994105 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04017070 con 0x7fbc101012e0 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbbf7fff640 1 -- 172.21.15.152:0/3053994105 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc04009c30 con 0x7fbc101012e0 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc152a7640 1 -- 172.21.15.152:0/3053994105 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc1019f960 con 0x7fbc101012e0 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbbf7fff640 1 -- 172.21.15.152:0/3053994105 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400f6b0 con 0x7fbc101012e0 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.023+0000 7fbc152a7640 1 -- 172.21.15.152:0/3053994105 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc101a7240 con 0x7fbc101012e0 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbbf7fff640 1 -- 172.21.15.152:0/3053994105 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fbc040109d0 con 0x7fbc101012e0 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbc17680740 1 Processor -- start 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbc17680740 1 -- start start 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbc17680740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06889d0 0x5625d0688db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbc17680740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06892f0 0x5625d0693670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbc17680740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d0693bb0 0x5625d0695fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbc17680740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5625d05ef090 con 0x5625d06892f0 2024-09-11T22:03:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbc17680740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5625d0596a70 con 0x5625d06889d0 2024-09-11T22:03:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbc17680740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5625d05eb050 con 0x5625d0693bb0 2024-09-11T22:03:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbbf7fff640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fbbf80a2c10 0x7fbbf80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbc0effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06892f0 0x5625d0693670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbc0effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06892f0 0x5625d0693670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39270/0 (socket says 172.21.15.152:39270) 2024-09-11T22:03:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.026+0000 7fbc0effd640 1 -- 172.21.15.152:0/1035630639 learned_addr learned my addr 172.21.15.152:0/1035630639 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbc0e7fc640 1 --2- 172.21.15.152:0/1035630639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d0693bb0 0x5625d0695fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fbbf80a2c10 0x7fbbf80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/1035630639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06889d0 0x5625d0688db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbbf7fff640 1 -- 172.21.15.152:0/3053994105 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fbc040cedd0 con 0x7fbc101012e0 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbc0effd640 1 -- 172.21.15.152:0/1035630639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d0693bb0 msgr2=0x5625d0695fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbc0effd640 1 --2- 172.21.15.152:0/1035630639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d0693bb0 0x5625d0695fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbc0effd640 1 -- 172.21.15.152:0/1035630639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06889d0 msgr2=0x5625d0688db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbc0effd640 1 --2- 172.21.15.152:0/1035630639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06889d0 0x5625d0688db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbc0effd640 1 -- 172.21.15.152:0/1035630639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625d05a3130 con 0x5625d06892f0 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/1035630639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06889d0 0x5625d0688db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fbbf80a2c10 0x7fbbf80a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009fd0 tx=0x7fbc08009390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbc0effd640 1 --2- 172.21.15.152:0/1035630639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06892f0 0x5625d0693670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009900 tx=0x7fbc00031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98fb3f36ca2ccf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbbf57fa640 1 -- 172.21.15.152:0/1035630639 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00035040 con 0x5625d06892f0 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbbf57fa640 1 -- 172.21.15.152:0/1035630639 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc00043be0 con 0x5625d06892f0 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.027+0000 7fbbf57fa640 1 -- 172.21.15.152:0/1035630639 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc000047a0 con 0x5625d06892f0 2024-09-11T22:03:48.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.028+0000 7fbc17680740 1 -- 172.21.15.152:0/1035630639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06892f0 msgr2=0x5625d0693670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.028+0000 7fbc17680740 1 --2- 172.21.15.152:0/1035630639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06892f0 0x5625d0693670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009900 tx=0x7fbc00031630 comp rx=0 tx=0).stop 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.028+0000 7fbc17680740 1 -- 172.21.15.152:0/1035630639 shutdown_connections 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.028+0000 7fbc17680740 1 --2- 172.21.15.152:0/1035630639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d0693bb0 0x5625d0695fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.028+0000 7fbc17680740 1 --2- 172.21.15.152:0/1035630639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06892f0 0x5625d0693670 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.028+0000 7fbc17680740 1 --2- 172.21.15.152:0/1035630639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06889d0 0x5625d0688db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.028+0000 7fbc17680740 1 -- 172.21.15.152:0/1035630639 >> 172.21.15.152:0/1035630639 conn(0x5625d0684f60 msgr2=0x5625d0685340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.028+0000 7fbc17680740 1 -- 172.21.15.152:0/1035630639 shutdown_connections 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.028+0000 7fbc17680740 1 -- 172.21.15.152:0/1035630639 wait complete. 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.028+0000 7fbc17680740 1 -- start start 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc17680740 1 Processor -- start 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc17680740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06889d0 0x5625d0693470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc17680740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06892f0 0x5625d06907c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc17680740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d0693bb0 0x5625d0690d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc17680740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5625d0696780 con 0x5625d06889d0 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc17680740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5625d05a9f20 con 0x5625d06892f0 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc17680740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5625d0696900 con 0x5625d0693bb0 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc17680740 10 client.0 _ll_register_callbacks cb 0x5625d0573030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06889d0 0x5625d0693470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06889d0 0x5625d0693470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39274/0 (socket says 172.21.15.152:39274) 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0effd640 1 -- 172.21.15.152:0/2277810555 learned_addr learned my addr 172.21.15.152:0/2277810555 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d0693bb0 0x5625d0690d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0effd640 1 -- 172.21.15.152:0/2277810555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d0693bb0 msgr2=0x5625d0690d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0effd640 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d0693bb0 0x5625d0690d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0e7fc640 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06892f0 0x5625d06907c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0effd640 1 -- 172.21.15.152:0/2277810555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06892f0 msgr2=0x5625d06907c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0effd640 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06892f0 0x5625d06907c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0effd640 1 -- 172.21.15.152:0/2277810555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625d03602b0 con 0x5625d06889d0 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0e7fc640 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06892f0 0x5625d06907c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbc0effd640 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06889d0 0x5625d0693470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbc00005060 tx=0x7fbc000050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3f78d5ef2fd61b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.029+0000 7fbbf2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2277810555 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00053070 con 0x5625d06889d0 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2277810555 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fbc00004040 con 0x5625d06889d0 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbc17680740 1 -- 172.21.15.152:0/2277810555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc00043be0 con 0x5625d06889d0 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2277810555 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fbc0005f050 con 0x5625d06889d0 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbc17680740 10 client.14949 fetch_fsmap learned FSMap version 23 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbc17680740 1 -- 172.21.15.152:0/2277810555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5625d06a20d0 con 0x5625d06889d0 2024-09-11T22:03:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2277810555 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc00043be0 con 0x5625d06889d0 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2277810555 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fbc000035f0 con 0x5625d06889d0 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbc17680740 10 client.14949 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbc17680740 10 client.14949 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbc17680740 20 client.14949 populate_metadata read hostname 'smithi152' 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbc17680740 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5625d06a4330 0x5625d06a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbc17680740 4 client.14949 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbc17680740 1 -- 172.21.15.152:0/2277810555 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625d05fc600 con 0x5625d06a4330 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.030+0000 7fbc0e7fc640 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5625d06a4330 0x5625d06a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.031+0000 7fbc0e7fc640 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5625d06a4330 0x5625d06a57a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b26c5d6a072302d9 server_cookie=6724bf5a1e8c100f in_seq=0 out_seq=0 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.031+0000 7fbbf2ff5640 10 client.14949 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2277810555 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625d05fc600 con 0x5625d06a4330 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbbf2ff5640 10 client.14949 handle_command_reply: tid=0 2024-09-11T22:03:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 1 client.14949 shutdown 2024-09-11T22:03:48.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 1 -- 172.21.15.152:0/2277810555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06889d0 msgr2=0x5625d0693470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:48.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06889d0 0x5625d0693470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbc00005060 tx=0x7fbc000050c0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 1 -- 172.21.15.152:0/2277810555 shutdown_connections 2024-09-11T22:03:48.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5625d06a4330 0x5625d06a57a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbbf2ff5640 0 client.14949 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:03:48.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d0693bb0 0x5625d0690d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06892f0 0x5625d06907c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 1 --2- 172.21.15.152:0/2277810555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d06889d0 0x5625d0693470 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 1 -- 172.21.15.152:0/2277810555 >> 172.21.15.152:0/2277810555 conn(0x5625d0684f60 msgr2=0x5625d068ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:48.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 1 -- 172.21.15.152:0/2277810555 shutdown_connections 2024-09-11T22:03:48.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 1 -- 172.21.15.152:0/2277810555 wait complete. 2024-09-11T22:03:48.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.032+0000 7fbc17680740 20 client.14949 trim_cache size 0 max 16384 2024-09-11T22:03:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc17680740 1 Processor -- start 2024-09-11T22:03:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc17680740 1 -- start start 2024-09-11T22:03:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc17680740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d06889d0 0x5625d06a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc17680740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06892f0 0x5625d06a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc17680740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0692620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc17680740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5625d06a3ae0 con 0x5625d0693bb0 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc17680740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5625d06a41b0 con 0x5625d06892f0 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc17680740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5625d06a4880 con 0x5625d06889d0 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc0f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0692620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc0f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0692620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39286/0 (socket says 172.21.15.152:39286) 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc0f7fe640 1 -- 172.21.15.152:0/2192119527 learned_addr learned my addr 172.21.15.152:0/2192119527 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc0effd640 1 --2- 172.21.15.152:0/2192119527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d06889d0 0x5625d06a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc0f7fe640 1 -- 172.21.15.152:0/2192119527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d06889d0 msgr2=0x5625d06a3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/2192119527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d06889d0 0x5625d06a3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc0f7fe640 1 -- 172.21.15.152:0/2192119527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06892f0 msgr2=0x5625d06a4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:48.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/2192119527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06892f0 0x5625d06a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.052+0000 7fbc0f7fe640 1 -- 172.21.15.152:0/2192119527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625d0693090 con 0x5625d0693bb0 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/2192119527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0692620 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc080087e0 tx=0x7fbc08009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8075817cc33c72cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbbf4ff9640 1 -- 172.21.15.152:0/2192119527 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08014040 con 0x5625d0693bb0 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbbf4ff9640 1 -- 172.21.15.152:0/2192119527 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc08029070 con 0x5625d0693bb0 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbbf4ff9640 1 -- 172.21.15.152:0/2192119527 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc080223b0 con 0x5625d0693bb0 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbc17680740 1 -- 172.21.15.152:0/2192119527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 msgr2=0x5625d0692620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbc17680740 1 --2- 172.21.15.152:0/2192119527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0692620 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc080087e0 tx=0x7fbc08009650 comp rx=0 tx=0).stop 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbc17680740 1 -- 172.21.15.152:0/2192119527 shutdown_connections 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbc17680740 1 --2- 172.21.15.152:0/2192119527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0692620 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbc17680740 1 --2- 172.21.15.152:0/2192119527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06892f0 0x5625d06a4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbc17680740 1 --2- 172.21.15.152:0/2192119527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d06889d0 0x5625d06a3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbc17680740 1 -- 172.21.15.152:0/2192119527 >> 172.21.15.152:0/2192119527 conn(0x5625d0684f60 msgr2=0x5625d0691f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:48.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbc17680740 1 -- 172.21.15.152:0/2192119527 shutdown_connections 2024-09-11T22:03:48.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.053+0000 7fbc17680740 1 -- 172.21.15.152:0/2192119527 wait complete. 2024-09-11T22:03:48.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc17680740 1 -- start start 2024-09-11T22:03:48.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc17680740 1 Processor -- start 2024-09-11T22:03:48.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc17680740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06889d0 0x5625d06a9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc17680740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d06892f0 0x5625d06a9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc17680740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0706a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc17680740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5625d06a5620 con 0x5625d0693bb0 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc17680740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5625d06a4f50 con 0x5625d06889d0 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc17680740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5625d06a5cf0 con 0x5625d06892f0 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc17680740 10 client.0 _ll_register_callbacks cb 0x7fbc0400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc0f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0706a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc0f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0706a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39298/0 (socket says 172.21.15.152:39298) 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc0f7fe640 1 -- 172.21.15.152:0/2576167749 learned_addr learned my addr 172.21.15.152:0/2576167749 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc0effd640 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06889d0 0x5625d06a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.054+0000 7fbc0e7fc640 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d06892f0 0x5625d06a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbc0f7fe640 1 -- 172.21.15.152:0/2576167749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d06892f0 msgr2=0x5625d06a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d06892f0 0x5625d06a9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbc0f7fe640 1 -- 172.21.15.152:0/2576167749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06889d0 msgr2=0x5625d06a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06889d0 0x5625d06a9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbc0f7fe640 1 -- 172.21.15.152:0/2576167749 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625d07070e0 con 0x5625d0693bb0 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbc0e7fc640 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d06892f0 0x5625d06a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbc0f7fe640 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0706a70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbc08004b90 tx=0x7fbc08024630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1134c1667837ae6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbbf2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2576167749 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08033070 con 0x5625d0693bb0 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2576167749 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fbc08019d10 con 0x5625d0693bb0 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbc17680740 1 -- 172.21.15.152:0/2576167749 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc08029070 con 0x5625d0693bb0 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2576167749 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fbc0803f050 con 0x5625d0693bb0 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbc17680740 10 client.14955 fetch_fsmap learned FSMap version 23 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbc17680740 1 -- 172.21.15.152:0/2576167749 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5625d070e460 con 0x5625d0693bb0 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2576167749 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc08029070 con 0x5625d0693bb0 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.055+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2576167749 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fbc0802d410 con 0x5625d0693bb0 2024-09-11T22:03:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.056+0000 7fbc17680740 10 client.14955 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.056+0000 7fbc17680740 10 client.14955 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.056+0000 7fbc17680740 20 client.14955 populate_metadata read hostname 'smithi152' 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.056+0000 7fbc17680740 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5625d06a4330 0x5625d0711b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.056+0000 7fbc17680740 4 client.14955 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.056+0000 7fbc17680740 1 -- 172.21.15.152:0/2576167749 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "status"}) -- 0x5625d05f6b10 con 0x5625d06a4330 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.056+0000 7fbc0effd640 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5625d06a4330 0x5625d0711b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.056+0000 7fbc0effd640 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5625d06a4330 0x5625d0711b60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=68befe54035c33f8 server_cookie=4f1c621064642204 in_seq=0 out_seq=0 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.056+0000 7fbbf2ff5640 10 client.14955 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbbf2ff5640 1 -- 172.21.15.152:0/2576167749 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5625d05f6b10 con 0x5625d06a4330 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbbf2ff5640 10 client.14955 handle_command_reply: tid=0 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 1 client.14955 shutdown 2024-09-11T22:03:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 1 -- 172.21.15.152:0/2576167749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 msgr2=0x5625d0706a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0706a70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbc08004b90 tx=0x7fbc08024630 comp rx=0 tx=0).stop 2024-09-11T22:03:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 1 -- 172.21.15.152:0/2576167749 shutdown_connections 2024-09-11T22:03:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5625d06a4330 0x5625d0711b60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625d0693bb0 0x5625d0706a70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625d06892f0 0x5625d06a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbbf2ff5640 0 client.14955 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:03:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 1 --2- 172.21.15.152:0/2576167749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625d06889d0 0x5625d06a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 1 -- 172.21.15.152:0/2576167749 >> 172.21.15.152:0/2576167749 conn(0x5625d0684f60 msgr2=0x5625d0683f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 1 -- 172.21.15.152:0/2576167749 shutdown_connections 2024-09-11T22:03:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 1 -- 172.21.15.152:0/2576167749 wait complete. 2024-09-11T22:03:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc17680740 20 client.14955 trim_cache size 0 max 16384 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "5c140ed8-7088-11ef-bcea-c7b262605968", 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 2, 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 24457, 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 63.228796373999998, 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 23, 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 84, 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T22:03:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 94.036935623000005 2024-09-11T22:03:48.067 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:03:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc152a7640 1 -- 172.21.15.152:0/3053994105 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fbbf80a2c10 msgr2=0x7fbbf80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc152a7640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fbbf80a2c10 0x7fbbf80a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009fd0 tx=0x7fbc08009390 comp rx=0 tx=0).stop 2024-09-11T22:03:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc152a7640 1 -- 172.21.15.152:0/3053994105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc101012e0 msgr2=0x7fbc1019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.057+0000 7fbc152a7640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc101012e0 0x7fbc1019ac00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400d950 tx=0x7fbc0400de10 comp rx=0 tx=0).stop 2024-09-11T22:03:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.058+0000 7fbc152a7640 1 -- 172.21.15.152:0/3053994105 shutdown_connections 2024-09-11T22:03:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.058+0000 7fbc152a7640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fbbf80a2c10 0x7fbbf80a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.058+0000 7fbc152a7640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc1010e4e0 0x7fbc1019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.058+0000 7fbc152a7640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc101012e0 0x7fbc1019ac00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.058+0000 7fbc152a7640 1 --2- 172.21.15.152:0/3053994105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc10100930 0x7fbc1019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.058+0000 7fbc152a7640 1 -- 172.21.15.152:0/3053994105 >> 172.21.15.152:0/3053994105 conn(0x7fbc100fc7a0 msgr2=0x7fbc100feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.058+0000 7fbc152a7640 1 -- 172.21.15.152:0/3053994105 shutdown_connections 2024-09-11T22:03:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:48.058+0000 7fbc152a7640 1 -- 172.21.15.152:0/3053994105 wait complete. 2024-09-11T22:03:48.759 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T22:03:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:49.409 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:49 smithi152 ceph-mon[31188]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:03:49.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.490+0000 7f02474e6640 1 -- 172.21.15.152:0/541865582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0240100100 msgr2=0x7f0240100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:49.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.490+0000 7f02474e6640 1 --2- 172.21.15.152:0/541865582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0240100100 0x7f0240100560 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0230009900 tx=0x7f023002a410 comp rx=0 tx=0).stop 2024-09-11T22:03:49.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.490+0000 7f02474e6640 1 -- 172.21.15.152:0/541865582 shutdown_connections 2024-09-11T22:03:49.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.490+0000 7f02474e6640 1 --2- 172.21.15.152:0/541865582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0240100aa0 0x7f024010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.490+0000 7f02474e6640 1 --2- 172.21.15.152:0/541865582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0240100100 0x7f0240100560 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.490+0000 7f02474e6640 1 --2- 172.21.15.152:0/541865582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0240106b80 0x7f0240106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.490+0000 7f02474e6640 1 -- 172.21.15.152:0/541865582 >> 172.21.15.152:0/541865582 conn(0x7f0240077230 msgr2=0x7f02400fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.490+0000 7f02474e6640 1 -- 172.21.15.152:0/541865582 shutdown_connections 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.490+0000 7f02474e6640 1 -- 172.21.15.152:0/541865582 wait complete. 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f02474e6640 1 Processor -- start 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f02474e6640 1 -- start start 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f02474e6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0240100100 0x7f024019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f02474e6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0240100aa0 0x7f024019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f02474e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0240106b80 0x7f024019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f02474e6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0240112010 con 0x7f0240100100 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f02474e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0240111e90 con 0x7f0240106b80 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f02474e6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0240112190 con 0x7f0240100aa0 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f0245282640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0240100100 0x7f024019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f0245282640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0240100100 0x7f024019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39314/0 (socket says 172.21.15.152:39314) 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f0245282640 1 -- 172.21.15.152:0/1370330823 learned_addr learned my addr 172.21.15.152:0/1370330823 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f0244a81640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0240100aa0 0x7f024019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f0245282640 1 -- 172.21.15.152:0/1370330823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0240100aa0 msgr2=0x7f024019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f0245282640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0240100aa0 0x7f024019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f0245282640 1 -- 172.21.15.152:0/1370330823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0240106b80 msgr2=0x7f024019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f0245282640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0240106b80 0x7f024019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f0245282640 1 -- 172.21.15.152:0/1370330823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024019f680 con 0x7f0240100100 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.491+0000 7f0244a81640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0240100aa0 0x7f024019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.492+0000 7f0245282640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0240100100 0x7f024019a6d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f023c00c890 tx=0x7f023c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.492+0000 7f02367fc640 1 -- 172.21.15.152:0/1370330823 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c004220 con 0x7f0240100100 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.492+0000 7f02367fc640 1 -- 172.21.15.152:0/1370330823 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f023c0043c0 con 0x7f0240100100 2024-09-11T22:03:49.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.492+0000 7f02474e6640 1 -- 172.21.15.152:0/1370330823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024019f970 con 0x7f0240100100 2024-09-11T22:03:49.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.492+0000 7f02367fc640 1 -- 172.21.15.152:0/1370330823 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c0049e0 con 0x7f0240100100 2024-09-11T22:03:49.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.492+0000 7f02474e6640 1 -- 172.21.15.152:0/1370330823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02401a7250 con 0x7f0240100100 2024-09-11T22:03:49.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.494+0000 7f02367fc640 1 -- 172.21.15.152:0/1370330823 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f023c0079b0 con 0x7f0240100100 2024-09-11T22:03:49.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f02498bf740 1 Processor -- start 2024-09-11T22:03:49.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f02498bf740 1 -- start start 2024-09-11T22:03:49.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f02498bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d5bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f02498bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d5c2f0 0x564e70d66670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f02498bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d66bb0 0x564e70d68fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f02498bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564e70cc2090 con 0x564e70d5b9d0 2024-09-11T22:03:49.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f02498bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e70c69a70 con 0x564e70d5c2f0 2024-09-11T22:03:49.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f02498bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564e70cbe050 con 0x564e70d66bb0 2024-09-11T22:03:49.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f0245a83640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d5bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f02367fc640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f022c0a2c90 0x7f022c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f0245a83640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d5bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39318/0 (socket says 172.21.15.152:39318) 2024-09-11T22:03:49.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f0245a83640 1 -- 172.21.15.152:0/3396461308 learned_addr learned my addr 172.21.15.152:0/3396461308 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:49.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f0244a81640 1 --2- 172.21.15.152:0/3396461308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d66bb0 0x564e70d68fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f0245282640 1 --2- 172.21.15.152:0/3396461308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d5c2f0 0x564e70d66670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.495+0000 7f0245a83640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f022c0a2c90 0x7f022c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.496+0000 7f02367fc640 1 -- 172.21.15.152:0/1370330823 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f023c0cf2c0 con 0x7f0240100100 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.496+0000 7f0245a83640 1 -- 172.21.15.152:0/3396461308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d66bb0 msgr2=0x564e70d68fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.496+0000 7f0245a83640 1 --2- 172.21.15.152:0/3396461308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d66bb0 0x564e70d68fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.496+0000 7f0245a83640 1 -- 172.21.15.152:0/3396461308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d5c2f0 msgr2=0x564e70d66670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.496+0000 7f0245a83640 1 --2- 172.21.15.152:0/3396461308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d5c2f0 0x564e70d66670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.496+0000 7f0245a83640 1 -- 172.21.15.152:0/3396461308 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e70c76130 con 0x564e70d5b9d0 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.496+0000 7f0245282640 1 --2- 172.21.15.152:0/3396461308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d5c2f0 0x564e70d66670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.496+0000 7f0245a83640 1 --2- 172.21.15.152:0/3396461308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d5bdb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f02380137d0 tx=0x7f0238013c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3d9ced1b1f6266 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.496+0000 7f022b7fe640 1 -- 172.21.15.152:0/3396461308 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238020070 con 0x564e70d5b9d0 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.496+0000 7f022b7fe640 1 -- 172.21.15.152:0/3396461308 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f023801a390 con 0x564e70d5b9d0 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.496+0000 7f022b7fe640 1 -- 172.21.15.152:0/3396461308 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238007de0 con 0x564e70d5b9d0 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f02498bf740 1 -- 172.21.15.152:0/3396461308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 msgr2=0x564e70d5bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:49.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f0245a83640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f022c0a2c90 0x7f022c0a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f023801d000 tx=0x7f023801b000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f02498bf740 1 --2- 172.21.15.152:0/3396461308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d5bdb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f02380137d0 tx=0x7f0238013c90 comp rx=0 tx=0).stop 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f02498bf740 1 -- 172.21.15.152:0/3396461308 shutdown_connections 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f02498bf740 1 --2- 172.21.15.152:0/3396461308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d66bb0 0x564e70d68fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f02498bf740 1 --2- 172.21.15.152:0/3396461308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d5c2f0 0x564e70d66670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f02498bf740 1 --2- 172.21.15.152:0/3396461308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d5bdb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f02498bf740 1 -- 172.21.15.152:0/3396461308 >> 172.21.15.152:0/3396461308 conn(0x564e70d57f60 msgr2=0x564e70d58340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f02498bf740 1 -- 172.21.15.152:0/3396461308 shutdown_connections 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f02498bf740 1 -- 172.21.15.152:0/3396461308 wait complete. 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f02498bf740 1 -- start start 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.497+0000 7f02498bf740 1 Processor -- start 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f02498bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d66420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f02498bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 0x564e70d63770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f02498bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d63cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f02498bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564e70d69780 con 0x564e70d5b9d0 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f02498bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e70c7cf20 con 0x564e70d66bb0 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f02498bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564e70d69900 con 0x564e70d5c2f0 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f02498bf740 10 client.0 _ll_register_callbacks cb 0x564e70c46030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0245282640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d66420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0245282640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d66420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39332/0 (socket says 172.21.15.152:39332) 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0245282640 1 -- 172.21.15.152:0/668108255 learned_addr learned my addr 172.21.15.152:0/668108255 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0244a81640 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 0x564e70d63770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0245a83640 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d63cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0245282640 1 -- 172.21.15.152:0/668108255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 msgr2=0x564e70d63770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:49.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0245282640 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 0x564e70d63770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0245282640 1 -- 172.21.15.152:0/668108255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 msgr2=0x564e70d63cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:49.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0245282640 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d63cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0245282640 1 -- 172.21.15.152:0/668108255 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e70a332b0 con 0x564e70d5b9d0 2024-09-11T22:03:49.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0245282640 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d66420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f023c005fd0 tx=0x7f023c066a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ff527025008d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:49.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0228ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:03:49.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0228ff9640 1 -- 172.21.15.152:0/668108255 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c01d040 con 0x564e70d5b9d0 2024-09-11T22:03:49.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f0228ff9640 1 -- 172.21.15.152:0/668108255 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f023c0665e0 con 0x564e70d5b9d0 2024-09-11T22:03:49.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.498+0000 7f02498bf740 1 -- 172.21.15.152:0/668108255 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f023801a390 con 0x564e70d5b9d0 2024-09-11T22:03:49.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f0228ff9640 1 -- 172.21.15.152:0/668108255 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f023c09c0a0 con 0x564e70d5b9d0 2024-09-11T22:03:49.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f02498bf740 10 client.14967 fetch_fsmap learned FSMap version 23 2024-09-11T22:03:49.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f02498bf740 1 -- 172.21.15.152:0/668108255 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x564e70d750d0 con 0x564e70d5b9d0 2024-09-11T22:03:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f0228ff9640 1 -- 172.21.15.152:0/668108255 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f023801a390 con 0x564e70d5b9d0 2024-09-11T22:03:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f0228ff9640 1 -- 172.21.15.152:0/668108255 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f023c09bc00 con 0x564e70d5b9d0 2024-09-11T22:03:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f02498bf740 10 client.14967 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:03:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f02498bf740 10 client.14967 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:03:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f02498bf740 20 client.14967 populate_metadata read hostname 'smithi152' 2024-09-11T22:03:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f02498bf740 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564e70d77630 0x564e70d78aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f02498bf740 4 client.14967 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:03:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f02498bf740 1 -- 172.21.15.152:0/668108255 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e70ccf600 con 0x564e70d77630 2024-09-11T22:03:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.499+0000 7f0244a81640 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564e70d77630 0x564e70d78aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.500+0000 7f0244a81640 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564e70d77630 0x564e70d78aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=254494db5dffc1d4 server_cookie=602c107c592de2bc in_seq=0 out_seq=0 2024-09-11T22:03:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.500+0000 7f0228ff9640 10 client.14967 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:03:49.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.500+0000 7f0228ff9640 1 -- 172.21.15.152:0/668108255 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e70ccf600 con 0x564e70d77630 2024-09-11T22:03:49.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.500+0000 7f0228ff9640 10 client.14967 handle_command_reply: tid=0 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.500+0000 7f02498bf740 1 client.14967 shutdown 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f02498bf740 1 -- 172.21.15.152:0/668108255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 msgr2=0x564e70d66420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f02498bf740 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d66420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f023c005fd0 tx=0x7f023c066a10 comp rx=0 tx=0).stop 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f02498bf740 1 -- 172.21.15.152:0/668108255 shutdown_connections 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f02498bf740 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564e70d77630 0x564e70d78aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f02498bf740 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d63cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f02498bf740 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 0x564e70d63770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f02498bf740 1 --2- 172.21.15.152:0/668108255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d66420 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f02498bf740 1 -- 172.21.15.152:0/668108255 >> 172.21.15.152:0/668108255 conn(0x564e70d57f60 msgr2=0x564e70d5dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f0228ff9640 0 client.14967 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f02498bf740 1 -- 172.21.15.152:0/668108255 shutdown_connections 2024-09-11T22:03:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f02498bf740 1 -- 172.21.15.152:0/668108255 wait complete. 2024-09-11T22:03:49.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.501+0000 7f02498bf740 20 client.14967 trim_cache size 0 max 16384 2024-09-11T22:03:49.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.518+0000 7f02498bf740 1 Processor -- start 2024-09-11T22:03:49.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.518+0000 7f02498bf740 1 -- start start 2024-09-11T22:03:49.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f02498bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d76f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f02498bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 0x564e70d78aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f02498bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d58340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f02498bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564e70d76de0 con 0x564e70d5b9d0 2024-09-11T22:03:49.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f02498bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e70d774b0 con 0x564e70d66bb0 2024-09-11T22:03:49.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f02498bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564e70d77b80 con 0x564e70d5c2f0 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f0245282640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d76f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f0245282640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d76f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39338/0 (socket says 172.21.15.152:39338) 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f0245282640 1 -- 172.21.15.152:0/982618160 learned_addr learned my addr 172.21.15.152:0/982618160 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f0245a83640 1 --2- 172.21.15.152:0/982618160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d58340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f0245282640 1 -- 172.21.15.152:0/982618160 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 msgr2=0x564e70d78aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f0245282640 1 --2- 172.21.15.152:0/982618160 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 0x564e70d78aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f0245282640 1 -- 172.21.15.152:0/982618160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 msgr2=0x564e70d58340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f0245282640 1 --2- 172.21.15.152:0/982618160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d58340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f0245282640 1 -- 172.21.15.152:0/982618160 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e70d5c120 con 0x564e70d5b9d0 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f0245a83640 1 --2- 172.21.15.152:0/982618160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d58340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f0245282640 1 --2- 172.21.15.152:0/982618160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d76f60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f023c0058c0 tx=0x7f023c0054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332005beaa32dc4e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f022affd640 1 -- 172.21.15.152:0/982618160 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c01d070 con 0x564e70d5b9d0 2024-09-11T22:03:49.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f022affd640 1 -- 172.21.15.152:0/982618160 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f023c09b9a0 con 0x564e70d5b9d0 2024-09-11T22:03:49.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.519+0000 7f022affd640 1 -- 172.21.15.152:0/982618160 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c0860c0 con 0x564e70d5b9d0 2024-09-11T22:03:49.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.520+0000 7f02498bf740 1 -- 172.21.15.152:0/982618160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 msgr2=0x564e70d76f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:49.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.520+0000 7f02498bf740 1 --2- 172.21.15.152:0/982618160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d76f60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f023c0058c0 tx=0x7f023c0054a0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.520+0000 7f02498bf740 1 -- 172.21.15.152:0/982618160 shutdown_connections 2024-09-11T22:03:49.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.520+0000 7f02498bf740 1 --2- 172.21.15.152:0/982618160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d58340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.520+0000 7f02498bf740 1 --2- 172.21.15.152:0/982618160 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 0x564e70d78aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.520+0000 7f02498bf740 1 --2- 172.21.15.152:0/982618160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d76f60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.520+0000 7f02498bf740 1 -- 172.21.15.152:0/982618160 >> 172.21.15.152:0/982618160 conn(0x564e70d57f60 msgr2=0x564e70d63730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:49.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.520+0000 7f02498bf740 1 -- 172.21.15.152:0/982618160 shutdown_connections 2024-09-11T22:03:49.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.520+0000 7f02498bf740 1 -- 172.21.15.152:0/982618160 wait complete. 2024-09-11T22:03:49.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.520+0000 7f02498bf740 1 -- start start 2024-09-11T22:03:49.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.520+0000 7f02498bf740 1 Processor -- start 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f02498bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d7bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f02498bf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 0x564e70d7c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f02498bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d7c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f02498bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564e70d78920 con 0x564e70d5b9d0 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f02498bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e70d78250 con 0x564e70d66bb0 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f02498bf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564e70d78ff0 con 0x564e70d5c2f0 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f02498bf740 10 client.0 _ll_register_callbacks cb 0x7f023c09b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0245282640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d7bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0245282640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d7bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39350/0 (socket says 172.21.15.152:39350) 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0245282640 1 -- 172.21.15.152:0/3312966671 learned_addr learned my addr 172.21.15.152:0/3312966671 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0245a83640 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d7c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0244a81640 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 0x564e70d7c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0245282640 1 -- 172.21.15.152:0/3312966671 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 msgr2=0x564e70d7c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0245282640 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 0x564e70d7c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0245282640 1 -- 172.21.15.152:0/3312966671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 msgr2=0x564e70d7c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0245282640 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d7c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0245282640 1 -- 172.21.15.152:0/3312966671 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e70ddfe30 con 0x564e70d5b9d0 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0245282640 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d7bbc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f023c0cd1d0 tx=0x7f023c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5984eb9ae535b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.521+0000 7f0228ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f0228ff9640 1 -- 172.21.15.152:0/3312966671 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c01d070 con 0x564e70d5b9d0 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f0228ff9640 1 -- 172.21.15.152:0/3312966671 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f023c0860b0 con 0x564e70d5b9d0 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f02498bf740 1 -- 172.21.15.152:0/3312966671 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f023c09b9a0 con 0x564e70d5b9d0 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f0228ff9640 1 -- 172.21.15.152:0/3312966671 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f023c09fd50 con 0x564e70d5b9d0 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f02498bf740 10 client.14973 fetch_fsmap learned FSMap version 23 2024-09-11T22:03:49.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f02498bf740 1 -- 172.21.15.152:0/3312966671 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x564e70de1110 con 0x564e70d5b9d0 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f0228ff9640 1 -- 172.21.15.152:0/3312966671 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f023c09b9a0 con 0x564e70d5b9d0 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f0228ff9640 1 -- 172.21.15.152:0/3312966671 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f023c09a9d0 con 0x564e70d5b9d0 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f02498bf740 10 client.14973 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f02498bf740 10 client.14973 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f02498bf740 20 client.14973 populate_metadata read hostname 'smithi152' 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f02498bf740 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564e70de5880 0x564e70de4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f02498bf740 4 client.14973 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f02498bf740 1 -- 172.21.15.152:0/3312966671 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "status"}) -- 0x564e70cc9b10 con 0x564e70de5880 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.522+0000 7f0244a81640 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564e70de5880 0x564e70de4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f0228ff9640 10 client.14973 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f0244a81640 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564e70de5880 0x564e70de4590 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4d6031e49757af84 server_cookie=238786769efc297f in_seq=0 out_seq=0 2024-09-11T22:03:49.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f0228ff9640 1 -- 172.21.15.152:0/3312966671 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564e70cc9b10 con 0x564e70de5880 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f0228ff9640 10 client.14973 handle_command_reply: tid=0 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f02498bf740 1 client.14973 shutdown 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f02498bf740 1 -- 172.21.15.152:0/3312966671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 msgr2=0x564e70d7bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f02498bf740 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d7bbc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f023c0cd1d0 tx=0x7f023c007f90 comp rx=0 tx=0).stop 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f02498bf740 1 -- 172.21.15.152:0/3312966671 shutdown_connections 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f02498bf740 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564e70de5880 0x564e70de4590 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f02498bf740 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e70d66bb0 0x564e70d7c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f02498bf740 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e70d5c2f0 0x564e70d7c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f02498bf740 1 --2- 172.21.15.152:0/3312966671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e70d5b9d0 0x564e70d7bbc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f0228ff9640 0 client.14973 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f02498bf740 1 -- 172.21.15.152:0/3312966671 >> 172.21.15.152:0/3312966671 conn(0x564e70d57f60 msgr2=0x564e70d58340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f02498bf740 1 -- 172.21.15.152:0/3312966671 shutdown_connections 2024-09-11T22:03:49.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.523+0000 7f02498bf740 1 -- 172.21.15.152:0/3312966671 wait complete. 2024-09-11T22:03:49.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02498bf740 20 client.14973 trim_cache size 0 max 16384 2024-09-11T22:03:49.531 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:03:49.531 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "5c140ed8-7088-11ef-bcea-c7b262605968", 2024-09-11T22:03:49.531 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 1, 2024-09-11T22:03:49.531 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 24470, 2024-09-11T22:03:49.531 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-09-11T22:03:49.531 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-09-11T22:03:49.531 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-09-11T22:03:49.531 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 65.700510261999995, 2024-09-11T22:03:49.532 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 23, 2024-09-11T22:03:49.532 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 84, 2024-09-11T22:03:49.532 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T22:03:49.532 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 82.675696639999998 2024-09-11T22:03:49.532 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:03:49.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 -- 172.21.15.152:0/1370330823 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f022c0a2c90 msgr2=0x7f022c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:49.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f022c0a2c90 0x7f022c0a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f023801d000 tx=0x7f023801b000 comp rx=0 tx=0).stop 2024-09-11T22:03:49.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 -- 172.21.15.152:0/1370330823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0240100100 msgr2=0x7f024019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:49.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0240100100 0x7f024019a6d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f023c00c890 tx=0x7f023c00cd50 comp rx=0 tx=0).stop 2024-09-11T22:03:49.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 -- 172.21.15.152:0/1370330823 shutdown_connections 2024-09-11T22:03:49.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0240106b80 0x7f024019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f022c0a2c90 0x7f022c0a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0240100aa0 0x7f024019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 --2- 172.21.15.152:0/1370330823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0240100100 0x7f024019a6d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:49.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 -- 172.21.15.152:0/1370330823 >> 172.21.15.152:0/1370330823 conn(0x7f0240077230 msgr2=0x7f0240104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:49.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 -- 172.21.15.152:0/1370330823 shutdown_connections 2024-09-11T22:03:49.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:49.524+0000 7f02474e6640 1 -- 172.21.15.152:0/1370330823 wait complete. 2024-09-11T22:03:49.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:49 smithi179 ceph-mon[35603]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:03:49.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:49 smithi193 ceph-mon[35545]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:03:50.183 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T22:03:50.432 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:50.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.878+0000 7f5d30c2c640 1 -- 172.21.15.152:0/773011215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d2c101420 msgr2=0x7f5d2c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:50.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.878+0000 7f5d30c2c640 1 --2- 172.21.15.152:0/773011215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d2c101420 0x7f5d2c10d950 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009cd0 tx=0x7f5d2402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.878+0000 7f5d30c2c640 1 -- 172.21.15.152:0/773011215 shutdown_connections 2024-09-11T22:03:50.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.878+0000 7f5d30c2c640 1 --2- 172.21.15.152:0/773011215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d2c101420 0x7f5d2c10d950 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.878+0000 7f5d30c2c640 1 --2- 172.21.15.152:0/773011215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d2c100a80 0x7f5d2c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.878+0000 7f5d30c2c640 1 --2- 172.21.15.152:0/773011215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c106a80 0x7f5d2c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.878+0000 7f5d30c2c640 1 -- 172.21.15.152:0/773011215 >> 172.21.15.152:0/773011215 conn(0x7f5d2c0fc7a0 msgr2=0x7f5d2c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:50.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.878+0000 7f5d30c2c640 1 -- 172.21.15.152:0/773011215 shutdown_connections 2024-09-11T22:03:50.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.878+0000 7f5d30c2c640 1 -- 172.21.15.152:0/773011215 wait complete. 2024-09-11T22:03:50.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d30c2c640 1 Processor -- start 2024-09-11T22:03:50.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d30c2c640 1 -- start start 2024-09-11T22:03:50.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d30c2c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d2c100a80 0x7f5d2c10e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d30c2c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d2c101420 0x7f5d2c10e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d30c2c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c106a80 0x7f5d2c10ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d30c2c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c111fa0 con 0x7f5d2c100a80 2024-09-11T22:03:50.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d30c2c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c111e20 con 0x7f5d2c106a80 2024-09-11T22:03:50.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d30c2c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c112120 con 0x7f5d2c101420 2024-09-11T22:03:50.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d2a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d2c100a80 0x7f5d2c10e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d2a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d2c100a80 0x7f5d2c10e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39364/0 (socket says 172.21.15.152:39364) 2024-09-11T22:03:50.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d2a59c640 1 -- 172.21.15.152:0/3418739408 learned_addr learned my addr 172.21.15.152:0/3418739408 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:50.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.879+0000 7f5d23fff640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d2c101420 0x7f5d2c10e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d2ad9d640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c106a80 0x7f5d2c10ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d2a59c640 1 -- 172.21.15.152:0/3418739408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d2c101420 msgr2=0x7f5d2c10e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:50.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d2a59c640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d2c101420 0x7f5d2c10e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d2a59c640 1 -- 172.21.15.152:0/3418739408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c106a80 msgr2=0x7f5d2c10ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:50.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d2a59c640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c106a80 0x7f5d2c10ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d2a59c640 1 -- 172.21.15.152:0/3418739408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c1a68a0 con 0x7f5d2c100a80 2024-09-11T22:03:50.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d2ad9d640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c106a80 0x7f5d2c10ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:50.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d2a59c640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d2c100a80 0x7f5d2c10e3e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00d950 tx=0x7f5d1c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:50.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d237fe640 1 -- 172.21.15.152:0/3418739408 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c017030 con 0x7f5d2c100a80 2024-09-11T22:03:50.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d237fe640 1 -- 172.21.15.152:0/3418739408 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d1c004020 con 0x7f5d2c100a80 2024-09-11T22:03:50.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d30c2c640 1 -- 172.21.15.152:0/3418739408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2c1a6b90 con 0x7f5d2c100a80 2024-09-11T22:03:50.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d237fe640 1 -- 172.21.15.152:0/3418739408 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c005650 con 0x7f5d2c100a80 2024-09-11T22:03:50.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.880+0000 7f5d30c2c640 1 -- 172.21.15.152:0/3418739408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d2c1a70d0 con 0x7f5d2c100a80 2024-09-11T22:03:50.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d237fe640 1 -- 172.21.15.152:0/3418739408 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5d1c0041d0 con 0x7f5d2c100a80 2024-09-11T22:03:50.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d33005740 1 Processor -- start 2024-09-11T22:03:50.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d33005740 1 -- start start 2024-09-11T22:03:50.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d33005740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d69d0 0x56514b8d6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d33005740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d72f0 0x56514b8e1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d33005740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d33005740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56514b83d090 con 0x56514b8e1bb0 2024-09-11T22:03:50.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d33005740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56514b7e4a70 con 0x56514b8d69d0 2024-09-11T22:03:50.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d33005740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56514b839050 con 0x56514b8d72f0 2024-09-11T22:03:50.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d23fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d2a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d72f0 0x56514b8e1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d23fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8e3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39376/0 (socket says 172.21.15.152:39376) 2024-09-11T22:03:50.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.883+0000 7f5d23fff640 1 -- 172.21.15.152:0/3199172096 learned_addr learned my addr 172.21.15.152:0/3199172096 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:50.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d2ad9d640 1 --2- 172.21.15.152:0/3199172096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d69d0 0x56514b8d6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d23fff640 1 -- 172.21.15.152:0/3199172096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d72f0 msgr2=0x56514b8e1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:50.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d23fff640 1 --2- 172.21.15.152:0/3199172096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d72f0 0x56514b8e1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d23fff640 1 -- 172.21.15.152:0/3199172096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d69d0 msgr2=0x56514b8d6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:50.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d23fff640 1 --2- 172.21.15.152:0/3199172096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d69d0 0x56514b8d6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d23fff640 1 -- 172.21.15.152:0/3199172096 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514b7f1130 con 0x56514b8e1bb0 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d237fe640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5d180a2c10 0x7f5d180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d2ad9d640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5d180a2c10 0x7f5d180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d23fff640 1 --2- 172.21.15.152:0/3199172096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8e3fa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400aca0 tx=0x7f5d1400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38054fc0e9950c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d237fe640 1 -- 172.21.15.152:0/3418739408 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f5d1c0cec20 con 0x7f5d2c100a80 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d20ff9640 1 -- 172.21.15.152:0/3199172096 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1401d070 con 0x56514b8e1bb0 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d20ff9640 1 -- 172.21.15.152:0/3199172096 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d14018b20 con 0x56514b8e1bb0 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.884+0000 7f5d20ff9640 1 -- 172.21.15.152:0/3199172096 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14010c70 con 0x56514b8e1bb0 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.885+0000 7f5d2ad9d640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5d180a2c10 0x7f5d180a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5d24005cc0 tx=0x7f5d24005f80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.885+0000 7f5d33005740 1 -- 172.21.15.152:0/3199172096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 msgr2=0x56514b8e3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.885+0000 7f5d33005740 1 --2- 172.21.15.152:0/3199172096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8e3fa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400aca0 tx=0x7f5d1400f790 comp rx=0 tx=0).stop 2024-09-11T22:03:50.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.885+0000 7f5d33005740 1 -- 172.21.15.152:0/3199172096 shutdown_connections 2024-09-11T22:03:50.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.885+0000 7f5d33005740 1 --2- 172.21.15.152:0/3199172096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8e3fa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.885+0000 7f5d33005740 1 --2- 172.21.15.152:0/3199172096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d72f0 0x56514b8e1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.885+0000 7f5d33005740 1 --2- 172.21.15.152:0/3199172096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d69d0 0x56514b8d6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.885+0000 7f5d33005740 1 -- 172.21.15.152:0/3199172096 >> 172.21.15.152:0/3199172096 conn(0x56514b8d2f60 msgr2=0x56514b8d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:50.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.885+0000 7f5d33005740 1 -- 172.21.15.152:0/3199172096 shutdown_connections 2024-09-11T22:03:50.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.885+0000 7f5d33005740 1 -- 172.21.15.152:0/3199172096 wait complete. 2024-09-11T22:03:50.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.885+0000 7f5d33005740 1 -- start start 2024-09-11T22:03:50.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d33005740 1 Processor -- start 2024-09-11T22:03:50.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d33005740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d69d0 0x56514b8e13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d33005740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d72f0 0x56514b8de700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d33005740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8dec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d33005740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56514b8e4780 con 0x56514b8e1bb0 2024-09-11T22:03:50.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d33005740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56514b7f7f20 con 0x56514b8d72f0 2024-09-11T22:03:50.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d33005740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56514b8e4900 con 0x56514b8d69d0 2024-09-11T22:03:50.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d33005740 10 client.0 _ll_register_callbacks cb 0x56514b7c1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:03:50.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d2ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d2ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8dec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39392/0 (socket says 172.21.15.152:39392) 2024-09-11T22:03:50.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d2ad9d640 1 -- 172.21.15.152:0/2715163755 learned_addr learned my addr 172.21.15.152:0/2715163755 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:50.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d2a59c640 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d69d0 0x56514b8e13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d23fff640 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d72f0 0x56514b8de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d2ad9d640 1 -- 172.21.15.152:0/2715163755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d69d0 msgr2=0x56514b8e13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:50.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d2ad9d640 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d69d0 0x56514b8e13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d2ad9d640 1 -- 172.21.15.152:0/2715163755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d72f0 msgr2=0x56514b8de700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:50.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d2ad9d640 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d72f0 0x56514b8de700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d2ad9d640 1 -- 172.21.15.152:0/2715163755 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56514b5ae2b0 con 0x56514b8e1bb0 2024-09-11T22:03:50.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d23fff640 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d72f0 0x56514b8de700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:50.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d2a59c640 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d69d0 0x56514b8e13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:50.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d2ad9d640 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8dec40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5d24031d10 tx=0x7f5d240095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f4cd2ebfc3b847 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:50.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.886+0000 7f5d11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:03:50.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2715163755 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24041070 con 0x56514b8e1bb0 2024-09-11T22:03:50.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2715163755 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f5d240045c0 con 0x56514b8e1bb0 2024-09-11T22:03:50.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d33005740 1 -- 172.21.15.152:0/2715163755 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d14018b20 con 0x56514b8e1bb0 2024-09-11T22:03:50.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2715163755 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5d240047c0 con 0x56514b8e1bb0 2024-09-11T22:03:50.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d33005740 10 client.14985 fetch_fsmap learned FSMap version 23 2024-09-11T22:03:50.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d33005740 1 -- 172.21.15.152:0/2715163755 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56514b8f0040 con 0x56514b8e1bb0 2024-09-11T22:03:50.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2715163755 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d14018b20 con 0x56514b8e1bb0 2024-09-11T22:03:50.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2715163755 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f5d24030070 con 0x56514b8e1bb0 2024-09-11T22:03:50.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d33005740 10 client.14985 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:03:50.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d33005740 10 client.14985 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T22:03:50.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d33005740 20 client.14985 populate_metadata read hostname 'smithi152' 2024-09-11T22:03:50.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d33005740 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56514b8f2750 0x56514b8f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d33005740 4 client.14985 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:03:50.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.887+0000 7f5d33005740 1 -- 172.21.15.152:0/2715163755 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56514b84a600 con 0x56514b8f2750 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.888+0000 7f5d2a59c640 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56514b8f2750 0x56514b8f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.888+0000 7f5d2a59c640 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56514b8f2750 0x56514b8f3bc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7d0cebdfc29c6a9 server_cookie=7f3c6aed32303be9 in_seq=0 out_seq=0 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.888+0000 7f5d11ffb640 10 client.14985 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2715163755 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56514b84a600 con 0x56514b8f2750 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d11ffb640 10 client.14985 handle_command_reply: tid=0 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 1 client.14985 shutdown 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 1 -- 172.21.15.152:0/2715163755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 msgr2=0x56514b8dec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8dec40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5d24031d10 tx=0x7f5d240095c0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 1 -- 172.21.15.152:0/2715163755 shutdown_connections 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56514b8f2750 0x56514b8f3bc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8e1bb0 0x56514b8dec40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d72f0 0x56514b8de700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 1 --2- 172.21.15.152:0/2715163755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d69d0 0x56514b8e13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 1 -- 172.21.15.152:0/2715163755 >> 172.21.15.152:0/2715163755 conn(0x56514b8d2f60 msgr2=0x56514b8d8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:50.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d11ffb640 0 client.14985 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:03:50.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 1 -- 172.21.15.152:0/2715163755 shutdown_connections 2024-09-11T22:03:50.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 1 -- 172.21.15.152:0/2715163755 wait complete. 2024-09-11T22:03:50.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.889+0000 7f5d33005740 20 client.14985 trim_cache size 0 max 16384 2024-09-11T22:03:50.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.906+0000 7f5d33005740 1 Processor -- start 2024-09-11T22:03:50.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d33005740 1 -- start start 2024-09-11T22:03:50.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d33005740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d69d0 0x56514b8f2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d33005740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d72f0 0x56514b8dcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d33005740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8e1bb0 0x56514b8dd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d33005740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56514b8f1f00 con 0x56514b8d72f0 2024-09-11T22:03:50.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d33005740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56514b8f25d0 con 0x56514b8d69d0 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d33005740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56514b8f2ca0 con 0x56514b8e1bb0 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d23fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d72f0 0x56514b8dcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d23fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d72f0 0x56514b8dcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39406/0 (socket says 172.21.15.152:39406) 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d23fff640 1 -- 172.21.15.152:0/2953690525 learned_addr learned my addr 172.21.15.152:0/2953690525 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d2ad9d640 1 --2- 172.21.15.152:0/2953690525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8e1bb0 0x56514b8dd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d2a59c640 1 --2- 172.21.15.152:0/2953690525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d69d0 0x56514b8f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d23fff640 1 -- 172.21.15.152:0/2953690525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8e1bb0 msgr2=0x56514b8dd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d23fff640 1 --2- 172.21.15.152:0/2953690525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8e1bb0 0x56514b8dd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d23fff640 1 -- 172.21.15.152:0/2953690525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d69d0 msgr2=0x56514b8f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d23fff640 1 --2- 172.21.15.152:0/2953690525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d69d0 0x56514b8f2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d23fff640 1 -- 172.21.15.152:0/2953690525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514b8d40d0 con 0x56514b8d72f0 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d23fff640 1 --2- 172.21.15.152:0/2953690525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d72f0 0x56514b8dcfd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5d1401b040 tx=0x7f5d14005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ffccf8b9d61619 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:50.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d13fff640 1 -- 172.21.15.152:0/2953690525 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1401d040 con 0x56514b8d72f0 2024-09-11T22:03:50.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d13fff640 1 -- 172.21.15.152:0/2953690525 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d14005520 con 0x56514b8d72f0 2024-09-11T22:03:50.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.907+0000 7f5d13fff640 1 -- 172.21.15.152:0/2953690525 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d140236d0 con 0x56514b8d72f0 2024-09-11T22:03:50.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.908+0000 7f5d33005740 1 -- 172.21.15.152:0/2953690525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d72f0 msgr2=0x56514b8dcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:50.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.908+0000 7f5d33005740 1 --2- 172.21.15.152:0/2953690525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d72f0 0x56514b8dcfd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5d1401b040 tx=0x7f5d14005e40 comp rx=0 tx=0).stop 2024-09-11T22:03:50.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.908+0000 7f5d33005740 1 -- 172.21.15.152:0/2953690525 shutdown_connections 2024-09-11T22:03:50.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.908+0000 7f5d33005740 1 --2- 172.21.15.152:0/2953690525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8e1bb0 0x56514b8dd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.908+0000 7f5d33005740 1 --2- 172.21.15.152:0/2953690525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d72f0 0x56514b8dcfd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.908+0000 7f5d33005740 1 --2- 172.21.15.152:0/2953690525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8d69d0 0x56514b8f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.908+0000 7f5d33005740 1 -- 172.21.15.152:0/2953690525 >> 172.21.15.152:0/2953690525 conn(0x56514b8d2f60 msgr2=0x56514b8cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.908+0000 7f5d33005740 1 -- 172.21.15.152:0/2953690525 shutdown_connections 2024-09-11T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.908+0000 7f5d33005740 1 -- 172.21.15.152:0/2953690525 wait complete. 2024-09-11T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.908+0000 7f5d33005740 1 -- start start 2024-09-11T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.908+0000 7f5d33005740 1 Processor -- start 2024-09-11T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d33005740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d69d0 0x56514b8faab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d33005740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d72f0 0x56514b8faff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d33005740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8e1bb0 0x56514b95ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d33005740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56514b8f3a40 con 0x56514b8d69d0 2024-09-11T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d33005740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56514b8f3370 con 0x56514b8e1bb0 2024-09-11T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d33005740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56514b8f4110 con 0x56514b8d72f0 2024-09-11T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d33005740 10 client.0 _ll_register_callbacks cb 0x7f5d24009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d2a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d69d0 0x56514b8faab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d2a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d69d0 0x56514b8faab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39422/0 (socket says 172.21.15.152:39422) 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d2a59c640 1 -- 172.21.15.152:0/2638328276 learned_addr learned my addr 172.21.15.152:0/2638328276 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d2ad9d640 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8e1bb0 0x56514b95ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d23fff640 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d72f0 0x56514b8faff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d2a59c640 1 -- 172.21.15.152:0/2638328276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d72f0 msgr2=0x56514b8faff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d2a59c640 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d72f0 0x56514b8faff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d2a59c640 1 -- 172.21.15.152:0/2638328276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8e1bb0 msgr2=0x56514b95ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d2a59c640 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8e1bb0 0x56514b95ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d2a59c640 1 -- 172.21.15.152:0/2638328276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56514b95b390 con 0x56514b8d69d0 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d2a59c640 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d69d0 0x56514b8faab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009610 tx=0x7f5d1c00d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fe40c002a2a650 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:03:50.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2638328276 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0d21c0 con 0x56514b8d69d0 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2638328276 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f5d1c0cc7a0 con 0x56514b8d69d0 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.909+0000 7f5d33005740 1 -- 172.21.15.152:0/2638328276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d14005520 con 0x56514b8d69d0 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2638328276 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5d1c00e350 con 0x56514b8d69d0 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d33005740 10 client.14991 fetch_fsmap learned FSMap version 23 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d33005740 1 -- 172.21.15.152:0/2638328276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56514b95c550 con 0x56514b8d69d0 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2638328276 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d14005520 con 0x56514b8d69d0 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2638328276 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f5d1c09f160 con 0x56514b8d69d0 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d33005740 10 client.14991 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d33005740 10 client.14991 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d33005740 20 client.14991 populate_metadata read hostname 'smithi152' 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d33005740 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56514b961180 0x56514b95fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:50.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d33005740 4 client.14991 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d33005740 1 -- 172.21.15.152:0/2638328276 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "status"}) -- 0x56514b844b10 con 0x56514b961180 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.910+0000 7f5d23fff640 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56514b961180 0x56514b95fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d11ffb640 10 client.14991 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d23fff640 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56514b961180 0x56514b95fe90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6106de898fde5c04 server_cookie=c3c3c9d046e11f6b in_seq=0 out_seq=0 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d11ffb640 1 -- 172.21.15.152:0/2638328276 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56514b844b10 con 0x56514b961180 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d11ffb640 10 client.14991 handle_command_reply: tid=0 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 1 client.14991 shutdown 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 1 -- 172.21.15.152:0/2638328276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d69d0 msgr2=0x56514b8faab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d69d0 0x56514b8faab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009610 tx=0x7f5d1c00d8d0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 1 -- 172.21.15.152:0/2638328276 shutdown_connections 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56514b961180 0x56514b95fe90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56514b8e1bb0 0x56514b95ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56514b8d72f0 0x56514b8faff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 1 --2- 172.21.15.152:0/2638328276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56514b8d69d0 0x56514b8faab0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 1 -- 172.21.15.152:0/2638328276 >> 172.21.15.152:0/2638328276 conn(0x56514b8d2f60 msgr2=0x56514b8dcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:50.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d11ffb640 0 client.14991 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:03:50.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 1 -- 172.21.15.152:0/2638328276 shutdown_connections 2024-09-11T22:03:50.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 1 -- 172.21.15.152:0/2638328276 wait complete. 2024-09-11T22:03:50.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.911+0000 7f5d33005740 20 client.14991 trim_cache size 0 max 16384 2024-09-11T22:03:50.919 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:03:50.919 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "5c140ed8-7088-11ef-bcea-c7b262605968", 2024-09-11T22:03:50.919 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 0, 2024-09-11T22:03:50.920 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 24472, 2024-09-11T22:03:50.920 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-09-11T22:03:50.920 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-09-11T22:03:50.920 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-09-11T22:03:50.920 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 73.825927625000006, 2024-09-11T22:03:50.920 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 23, 2024-09-11T22:03:50.920 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 84, 2024-09-11T22:03:50.920 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T22:03:50.920 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 92.115083257999999 2024-09-11T22:03:50.920 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:03:50.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 -- 172.21.15.152:0/3418739408 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5d180a2c10 msgr2=0x7f5d180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:50.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5d180a2c10 0x7f5d180a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5d24005cc0 tx=0x7f5d24005f80 comp rx=0 tx=0).stop 2024-09-11T22:03:50.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 -- 172.21.15.152:0/3418739408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d2c100a80 msgr2=0x7f5d2c10e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:50.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d2c100a80 0x7f5d2c10e3e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00d950 tx=0x7f5d1c00dd50 comp rx=0 tx=0).stop 2024-09-11T22:03:50.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 -- 172.21.15.152:0/3418739408 shutdown_connections 2024-09-11T22:03:50.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c106a80 0x7f5d2c10ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5d180a2c10 0x7f5d180a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d2c101420 0x7f5d2c10e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 --2- 172.21.15.152:0/3418739408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d2c100a80 0x7f5d2c10e3e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:50.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 -- 172.21.15.152:0/3418739408 >> 172.21.15.152:0/3418739408 conn(0x7f5d2c0fc7a0 msgr2=0x7f5d2c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:50.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 -- 172.21.15.152:0/3418739408 shutdown_connections 2024-09-11T22:03:50.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:50.912+0000 7f5d30c2c640 1 -- 172.21.15.152:0/3418739408 wait complete. 2024-09-11T22:03:51.688 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:51 smithi152 ceph-mon[31188]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:51.717 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T22:03:51.717 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T22:03:51.730 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T22:03:51.730 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-11T22:03:51.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:51 smithi179 ceph-mon[35603]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:51.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:51 smithi193 ceph-mon[35545]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:51.978 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.436+0000 7f774eee8640 1 -- 172.21.15.152:0/2200871259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77481078c0 msgr2=0x7f7748109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.436+0000 7f774eee8640 1 --2- 172.21.15.152:0/2200871259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77481078c0 0x7f7748109d10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7738009ca0 tx=0x7f773802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:03:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.436+0000 7f774eee8640 1 -- 172.21.15.152:0/2200871259 shutdown_connections 2024-09-11T22:03:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.436+0000 7f774eee8640 1 --2- 172.21.15.152:0/2200871259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77481078c0 0x7f7748109d10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.436+0000 7f774eee8640 1 --2- 172.21.15.152:0/2200871259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7748104f90 0x7f7748107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.436+0000 7f774eee8640 1 --2- 172.21.15.152:0/2200871259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7748102660 0x7f7748104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.436+0000 7f774eee8640 1 -- 172.21.15.152:0/2200871259 >> 172.21.15.152:0/2200871259 conn(0x7f77480fc280 msgr2=0x7f77480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.436+0000 7f774eee8640 1 -- 172.21.15.152:0/2200871259 shutdown_connections 2024-09-11T22:03:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.436+0000 7f774eee8640 1 -- 172.21.15.152:0/2200871259 wait complete. 2024-09-11T22:03:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.436+0000 7f774eee8640 1 Processor -- start 2024-09-11T22:03:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.436+0000 7f774eee8640 1 -- start start 2024-09-11T22:03:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774eee8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7748102660 0x7f7748101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774eee8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7748104f90 0x7f7748100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774eee8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77481078c0 0x7f7748100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774eee8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f774810d8d0 con 0x7f77481078c0 2024-09-11T22:03:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774eee8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f774810d750 con 0x7f7748104f90 2024-09-11T22:03:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774eee8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f774810da50 con 0x7f7748102660 2024-09-11T22:03:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774d485640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77481078c0 0x7f7748100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774d485640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77481078c0 0x7f7748100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39436/0 (socket says 172.21.15.152:39436) 2024-09-11T22:03:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774d485640 1 -- 172.21.15.152:0/2551229724 learned_addr learned my addr 172.21.15.152:0/2551229724 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774cc84640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7748102660 0x7f7748101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f7747fff640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7748104f90 0x7f7748100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774d485640 1 -- 172.21.15.152:0/2551229724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7748102660 msgr2=0x7f7748101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774d485640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7748102660 0x7f7748101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774d485640 1 -- 172.21.15.152:0/2551229724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7748104f90 msgr2=0x7f7748100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774d485640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7748104f90 0x7f7748100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774d485640 1 -- 172.21.15.152:0/2551229724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7748101410 con 0x7f77481078c0 2024-09-11T22:03:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f774d485640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77481078c0 0x7f7748100b50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f77380098d0 tx=0x7f773802f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:52.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f7745ffb640 1 -- 172.21.15.152:0/2551229724 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773802fc30 con 0x7f77481078c0 2024-09-11T22:03:52.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.437+0000 7f7745ffb640 1 -- 172.21.15.152:0/2551229724 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7738003e50 con 0x7f77481078c0 2024-09-11T22:03:52.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.438+0000 7f774eee8640 1 -- 172.21.15.152:0/2551229724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77481a1fc0 con 0x7f77481078c0 2024-09-11T22:03:52.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.438+0000 7f7745ffb640 1 -- 172.21.15.152:0/2551229724 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738004810 con 0x7f77481078c0 2024-09-11T22:03:52.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.438+0000 7f774eee8640 1 -- 172.21.15.152:0/2551229724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77481a2540 con 0x7f77481078c0 2024-09-11T22:03:52.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.439+0000 7f774eee8640 1 -- 172.21.15.152:0/2551229724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77480fdd70 con 0x7f77481078c0 2024-09-11T22:03:52.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.440+0000 7f7745ffb640 1 -- 172.21.15.152:0/2551229724 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7738003970 con 0x7f77481078c0 2024-09-11T22:03:52.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.441+0000 7f7745ffb640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77340a2c90 0x7f77340a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:52.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.441+0000 7f774cc84640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77340a2c90 0x7f77340a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:52.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.441+0000 7f7745ffb640 1 -- 172.21.15.152:0/2551229724 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f77380f0590 con 0x7f77481078c0 2024-09-11T22:03:52.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.441+0000 7f774cc84640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77340a2c90 0x7f77340a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f774000abe0 tx=0x7f774000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:52.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.445+0000 7f7745ffb640 1 -- 172.21.15.152:0/2551229724 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77380bd480 con 0x7f77481078c0 2024-09-11T22:03:52.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.627+0000 7f774eee8640 1 -- 172.21.15.152:0/2551229724 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f7748062630 con 0x7f77340a2c90 2024-09-11T22:03:52.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.628+0000 7f7745ffb640 1 -- 172.21.15.152:0/2551229724 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f7748062630 con 0x7f77340a2c90 2024-09-11T22:03:52.630 INFO:teuthology.orchestra.run.smithi152.stdout:Backend: cephadm 2024-09-11T22:03:52.630 INFO:teuthology.orchestra.run.smithi152.stdout:Available: Yes 2024-09-11T22:03:52.630 INFO:teuthology.orchestra.run.smithi152.stdout:Paused: No 2024-09-11T22:03:52.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 -- 172.21.15.152:0/2551229724 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77340a2c90 msgr2=0x7f77340a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:52.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77340a2c90 0x7f77340a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f774000abe0 tx=0x7f774000a2d0 comp rx=0 tx=0).stop 2024-09-11T22:03:52.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 -- 172.21.15.152:0/2551229724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77481078c0 msgr2=0x7f7748100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:52.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77481078c0 0x7f7748100b50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f77380098d0 tx=0x7f773802f840 comp rx=0 tx=0).stop 2024-09-11T22:03:52.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 -- 172.21.15.152:0/2551229724 shutdown_connections 2024-09-11T22:03:52.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77481078c0 0x7f7748100b50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:52.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7748104f90 0x7f7748100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:52.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f77340a2c90 0x7f77340a5150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:52.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 --2- 172.21.15.152:0/2551229724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7748102660 0x7f7748101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:52.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 -- 172.21.15.152:0/2551229724 >> 172.21.15.152:0/2551229724 conn(0x7f77480fc280 msgr2=0x7f7748102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:52.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 -- 172.21.15.152:0/2551229724 shutdown_connections 2024-09-11T22:03:52.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:52.630+0000 7f774eee8640 1 -- 172.21.15.152:0/2551229724 wait complete. 2024-09-11T22:03:53.308 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-11T22:03:53.558 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:53.679 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:53 smithi152 ceph-mon[31188]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:53 smithi179 ceph-mon[35603]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:53.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:53 smithi193 ceph-mon[35545]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.953+0000 7f5bba7ec640 1 -- 172.21.15.152:0/17616757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bb4101d10 msgr2=0x7f5bb4102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.953+0000 7f5bba7ec640 1 --2- 172.21.15.152:0/17616757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bb4101d10 0x7f5bb4102190 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009900 tx=0x7f5ba802a410 comp rx=0 tx=0).stop 2024-09-11T22:03:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.953+0000 7f5bba7ec640 1 -- 172.21.15.152:0/17616757 shutdown_connections 2024-09-11T22:03:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.953+0000 7f5bba7ec640 1 --2- 172.21.15.152:0/17616757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb41026d0 0x7f5bb4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.953+0000 7f5bba7ec640 1 --2- 172.21.15.152:0/17616757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bb4101d10 0x7f5bb4102190 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.953+0000 7f5bba7ec640 1 --2- 172.21.15.152:0/17616757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4100b10 0x7f5bb4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.953+0000 7f5bba7ec640 1 -- 172.21.15.152:0/17616757 >> 172.21.15.152:0/17616757 conn(0x7f5bb40fc2a0 msgr2=0x7f5bb40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.953+0000 7f5bba7ec640 1 -- 172.21.15.152:0/17616757 shutdown_connections 2024-09-11T22:03:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.953+0000 7f5bba7ec640 1 -- 172.21.15.152:0/17616757 wait complete. 2024-09-11T22:03:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.953+0000 7f5bba7ec640 1 Processor -- start 2024-09-11T22:03:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bba7ec640 1 -- start start 2024-09-11T22:03:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bba7ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4100b10 0x7f5bb406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bba7ec640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bb4101d10 0x7f5bb419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bba7ec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb41026d0 0x7f5bb419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bba7ec640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb410c810 con 0x7f5bb4101d10 2024-09-11T22:03:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bba7ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb410c690 con 0x7f5bb4100b10 2024-09-11T22:03:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bba7ec640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb410c990 con 0x7f5bb41026d0 2024-09-11T22:03:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bb4101d10 0x7f5bb419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bb4101d10 0x7f5bb419ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56596/0 (socket says 172.21.15.152:56596) 2024-09-11T22:03:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb37fe640 1 -- 172.21.15.152:0/3850359556 learned_addr learned my addr 172.21.15.152:0/3850359556 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb3fff640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4100b10 0x7f5bb406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb8d89640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb41026d0 0x7f5bb419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb37fe640 1 -- 172.21.15.152:0/3850359556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb41026d0 msgr2=0x7f5bb419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb37fe640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb41026d0 0x7f5bb419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb37fe640 1 -- 172.21.15.152:0/3850359556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4100b10 msgr2=0x7f5bb406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb37fe640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4100b10 0x7f5bb406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb37fe640 1 -- 172.21.15.152:0/3850359556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb419fc20 con 0x7f5bb4101d10 2024-09-11T22:03:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb3fff640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4100b10 0x7f5bb406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb8d89640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb41026d0 0x7f5bb419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.954+0000 7f5bb37fe640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bb4101d10 0x7f5bb419ccf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009230 tx=0x7f5ba8004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.955+0000 7f5bb17fa640 1 -- 172.21.15.152:0/3850359556 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba803f030 con 0x7f5bb4101d10 2024-09-11T22:03:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.955+0000 7f5bb17fa640 1 -- 172.21.15.152:0/3850359556 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ba8003ce0 con 0x7f5bb4101d10 2024-09-11T22:03:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.955+0000 7f5bba7ec640 1 -- 172.21.15.152:0/3850359556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb419fe50 con 0x7f5bb4101d10 2024-09-11T22:03:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.955+0000 7f5bb17fa640 1 -- 172.21.15.152:0/3850359556 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8035070 con 0x7f5bb4101d10 2024-09-11T22:03:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.955+0000 7f5bba7ec640 1 -- 172.21.15.152:0/3850359556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb41a0320 con 0x7f5bb4101d10 2024-09-11T22:03:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.956+0000 7f5bba7ec640 1 -- 172.21.15.152:0/3850359556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb4107f30 con 0x7f5bb4101d10 2024-09-11T22:03:53.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.957+0000 7f5bb17fa640 1 -- 172.21.15.152:0/3850359556 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5ba8042030 con 0x7f5bb4101d10 2024-09-11T22:03:53.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.957+0000 7f5bb17fa640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5b9c0a2c10 0x7f5b9c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:53.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.958+0000 7f5bb3fff640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5b9c0a2c10 0x7f5b9c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:53.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.958+0000 7f5bb17fa640 1 -- 172.21.15.152:0/3850359556 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f5ba80efc90 con 0x7f5bb4101d10 2024-09-11T22:03:53.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.958+0000 7f5bb3fff640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5b9c0a2c10 0x7f5b9c0a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4006fd0 tx=0x7f5ba4008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:53.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:53.962+0000 7f5bb17fa640 1 -- 172.21.15.152:0/3850359556 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ba80f5020 con 0x7f5bb4101d10 2024-09-11T22:03:54.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.137+0000 7f5bba7ec640 1 -- 172.21.15.152:0/3850359556 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5bb4062630 con 0x7f5b9c0a2c10 2024-09-11T22:03:54.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.149+0000 7f5bb17fa640 1 -- 172.21.15.152:0/3850359556 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f5bb4062630 con 0x7f5b9c0a2c10 2024-09-11T22:03:54.151 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T22:03:54.151 INFO:teuthology.orchestra.run.smithi152.stdout:mds.a smithi152 running (90s) 15s ago 89s 15.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 c77ce75b8c21 2024-09-11T22:03:54.151 INFO:teuthology.orchestra.run.smithi152.stdout:mds.b smithi179 running (87s) 20s ago 87s 17.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 4f2170899399 2024-09-11T22:03:54.151 INFO:teuthology.orchestra.run.smithi152.stdout:mds.c smithi193 running (100s) 20s ago 100s 17.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 36a37c05aaa9 2024-09-11T22:03:54.151 INFO:teuthology.orchestra.run.smithi152.stdout:mds.d smithi152 running (107s) 15s ago 107s 14.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 c016c6646b4b 2024-09-11T22:03:54.151 INFO:teuthology.orchestra.run.smithi152.stdout:mds.e smithi179 running (105s) 20s ago 104s 17.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 f274f0b373cf 2024-09-11T22:03:54.151 INFO:teuthology.orchestra.run.smithi152.stdout:mds.f smithi193 running (102s) 20s ago 102s 18.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 caf2fc941a9d 2024-09-11T22:03:54.151 INFO:teuthology.orchestra.run.smithi152.stdout:mds.g smithi152 running (93s) 15s ago 92s 14.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 00a6db86fd27 2024-09-11T22:03:54.151 INFO:teuthology.orchestra.run.smithi152.stdout:mds.h smithi179 running (98s) 20s ago 97s 16.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 94f6f814d27f 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:mds.i smithi193 running (95s) 20s ago 95s 25.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 889c170855d8 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:mds.j smithi152 running (110s) 15s ago 110s 15.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 9332532f2cac 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:mds.k smithi179 running (113s) 20s ago 113s 13.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 e46abef58b78 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:mds.l smithi193 running (115s) 20s ago 115s 14.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 02bd6f43374b 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.x smithi152 *:9283,8765 running (8m) 15s ago 8m 508M - 19.1.1-298-gb53b6d3e 54467abc55f8 9a399836b4ff 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.y smithi179 *:8443,8765 running (7m) 20s ago 7m 444M - 19.1.1-298-gb53b6d3e 54467abc55f8 ad81e25ae915 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.z smithi193 *:8443,8765 running (7m) 20s ago 7m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 1e1903b35b26 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:mon.a smithi152 running (8m) 15s ago 8m 50.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 0cc5c0da4320 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:mon.b smithi179 running (7m) 20s ago 7m 43.3M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 cbe9b448ac45 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:mon.c smithi193 running (7m) 20s ago 7m 42.2M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 842f227654d0 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (6m) 15s ago 6m 49.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 e1aa02447d19 2024-09-11T22:03:54.152 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi179 running (6m) 20s ago 6m 48.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 d9f80a2c9803 2024-09-11T22:03:54.153 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi193 running (5m) 20s ago 5m 57.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 b06f2e13fa83 2024-09-11T22:03:54.153 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi152 running (5m) 15s ago 5m 46.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 b7b798a48717 2024-09-11T22:03:54.153 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi179 running (5m) 20s ago 5m 52.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 69c23a4875fc 2024-09-11T22:03:54.153 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi193 running (4m) 20s ago 4m 45.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 60ec5612dc7a 2024-09-11T22:03:54.153 INFO:teuthology.orchestra.run.smithi152.stdout:osd.6 smithi152 running (4m) 15s ago 4m 51.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 e4e6a223e6ef 2024-09-11T22:03:54.153 INFO:teuthology.orchestra.run.smithi152.stdout:osd.7 smithi179 running (3m) 20s ago 3m 56.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 12e2f035b75f 2024-09-11T22:03:54.153 INFO:teuthology.orchestra.run.smithi152.stdout:osd.8 smithi193 running (3m) 20s ago 3m 53.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 d6d66cf5e93b 2024-09-11T22:03:54.153 INFO:teuthology.orchestra.run.smithi152.stdout:osd.9 smithi152 running (3m) 15s ago 3m 46.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 17187ca77725 2024-09-11T22:03:54.153 INFO:teuthology.orchestra.run.smithi152.stdout:osd.10 smithi179 running (2m) 20s ago 2m 46.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 a2e130a1df0d 2024-09-11T22:03:54.153 INFO:teuthology.orchestra.run.smithi152.stdout:osd.11 smithi193 running (2m) 20s ago 2m 50.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 a3045b9e6e22 2024-09-11T22:03:54.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 -- 172.21.15.152:0/3850359556 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5b9c0a2c10 msgr2=0x7f5b9c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:54.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5b9c0a2c10 0x7f5b9c0a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4006fd0 tx=0x7f5ba4008040 comp rx=0 tx=0).stop 2024-09-11T22:03:54.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 -- 172.21.15.152:0/3850359556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bb4101d10 msgr2=0x7f5bb419ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:54.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bb4101d10 0x7f5bb419ccf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009230 tx=0x7f5ba8004360 comp rx=0 tx=0).stop 2024-09-11T22:03:54.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 -- 172.21.15.152:0/3850359556 shutdown_connections 2024-09-11T22:03:54.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f5b9c0a2c10 0x7f5b9c0a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:54.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb41026d0 0x7f5bb419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:54.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bb4101d10 0x7f5bb419ccf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:54.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 --2- 172.21.15.152:0/3850359556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4100b10 0x7f5bb406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:54.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 -- 172.21.15.152:0/3850359556 >> 172.21.15.152:0/3850359556 conn(0x7f5bb40fc2a0 msgr2=0x7f5bb4105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:54.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 -- 172.21.15.152:0/3850359556 shutdown_connections 2024-09-11T22:03:54.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:54.151+0000 7f5bba7ec640 1 -- 172.21.15.152:0/3850359556 wait complete. 2024-09-11T22:03:54.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:54 smithi152 ceph-mon[31188]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:54.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:54 smithi179 ceph-mon[35603]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:54.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:54 smithi193 ceph-mon[35545]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:54.838 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-11T22:03:55.085 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:55 smithi152 ceph-mon[31188]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:55 smithi152 ceph-mon[31188]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:55.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.560+0000 7f6a2d899640 1 -- 172.21.15.152:0/2148149443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a28102ef0 msgr2=0x7f6a28103370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:55.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.560+0000 7f6a2d899640 1 --2- 172.21.15.152:0/2148149443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a28102ef0 0x7f6a28103370 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009930 tx=0x7f6a1c02a420 comp rx=0 tx=0).stop 2024-09-11T22:03:55.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.561+0000 7f6a2d899640 1 -- 172.21.15.152:0/2148149443 shutdown_connections 2024-09-11T22:03:55.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.561+0000 7f6a2d899640 1 --2- 172.21.15.152:0/2148149443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a281038b0 0x7f6a2810a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.561+0000 7f6a2d899640 1 --2- 172.21.15.152:0/2148149443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a28102ef0 0x7f6a28103370 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.561+0000 7f6a2d899640 1 --2- 172.21.15.152:0/2148149443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a280fff10 0x7f6a28100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.561+0000 7f6a2d899640 1 -- 172.21.15.152:0/2148149443 >> 172.21.15.152:0/2148149443 conn(0x7f6a280fba80 msgr2=0x7f6a280fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.561+0000 7f6a2d899640 1 -- 172.21.15.152:0/2148149443 shutdown_connections 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.561+0000 7f6a2d899640 1 -- 172.21.15.152:0/2148149443 wait complete. 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.561+0000 7f6a2d899640 1 Processor -- start 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.561+0000 7f6a2d899640 1 -- start start 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a2d899640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a280fff10 0x7f6a28197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a2d899640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a28102ef0 0x7f6a28198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a2d899640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a281038b0 0x7f6a2819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a2d899640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2810d860 con 0x7f6a281038b0 2024-09-11T22:03:55.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a2d899640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2810d6e0 con 0x7f6a28102ef0 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a2d899640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2810d9e0 con 0x7f6a280fff10 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a277fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a281038b0 0x7f6a2819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a277fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a281038b0 0x7f6a2819f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56628/0 (socket says 172.21.15.152:56628) 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a277fe640 1 -- 172.21.15.152:0/1692184543 learned_addr learned my addr 172.21.15.152:0/1692184543 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a26ffd640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a280fff10 0x7f6a28197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a267fc640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a28102ef0 0x7f6a28198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a277fe640 1 -- 172.21.15.152:0/1692184543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a280fff10 msgr2=0x7f6a28197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a277fe640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a280fff10 0x7f6a28197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a277fe640 1 -- 172.21.15.152:0/1692184543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a28102ef0 msgr2=0x7f6a28198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a277fe640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a28102ef0 0x7f6a28198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a277fe640 1 -- 172.21.15.152:0/1692184543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2819fa60 con 0x7f6a281038b0 2024-09-11T22:03:55.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a267fc640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a28102ef0 0x7f6a28198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:03:55.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a277fe640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a281038b0 0x7f6a2819f3f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c970 tx=0x7f6a2000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:55.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a2c897640 1 -- 172.21.15.152:0/1692184543 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20007bb0 con 0x7f6a281038b0 2024-09-11T22:03:55.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a2d899640 1 -- 172.21.15.152:0/1692184543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2819fd50 con 0x7f6a281038b0 2024-09-11T22:03:55.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a2c897640 1 -- 172.21.15.152:0/1692184543 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a20007d50 con 0x7f6a281038b0 2024-09-11T22:03:55.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a2c897640 1 -- 172.21.15.152:0/1692184543 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20018800 con 0x7f6a281038b0 2024-09-11T22:03:55.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.562+0000 7f6a2d899640 1 -- 172.21.15.152:0/1692184543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a281a01b0 con 0x7f6a281038b0 2024-09-11T22:03:55.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.564+0000 7f6a2d899640 1 -- 172.21.15.152:0/1692184543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a28109020 con 0x7f6a281038b0 2024-09-11T22:03:55.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.565+0000 7f6a2c897640 1 -- 172.21.15.152:0/1692184543 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6a2000fa50 con 0x7f6a281038b0 2024-09-11T22:03:55.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.565+0000 7f6a2c897640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6a100a2c40 0x7f6a100a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:55.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.566+0000 7f6a26ffd640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6a100a2c40 0x7f6a100a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:55.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.566+0000 7f6a2c897640 1 -- 172.21.15.152:0/1692184543 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f6a200cf1e0 con 0x7f6a281038b0 2024-09-11T22:03:55.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.566+0000 7f6a26ffd640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6a100a2c40 0x7f6a100a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6a28069d70 tx=0x7f6a18007600 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:55.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.571+0000 7f6a2c897640 1 -- 172.21.15.152:0/1692184543 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a20014030 con 0x7f6a281038b0 2024-09-11T22:03:55.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.744+0000 7f6a2d899640 1 -- 172.21.15.152:0/1692184543 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f6a28062630 con 0x7f6a100a2c40 2024-09-11T22:03:55.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.752+0000 7f6a2c897640 1 -- 172.21.15.152:0/1692184543 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f6a28062630 con 0x7f6a100a2c40 2024-09-11T22:03:55.753 INFO:teuthology.orchestra.run.smithi152.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-11T22:03:55.753 INFO:teuthology.orchestra.run.smithi152.stdout:mds.all 12/12 22s ago 2m smithi152=a;smithi152=d;smithi152=g;smithi152=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-11T22:03:55.753 INFO:teuthology.orchestra.run.smithi152.stdout:mgr 3/3 22s ago 7m smithi152=x;smithi179=y;smithi193=z;count:3 2024-09-11T22:03:55.753 INFO:teuthology.orchestra.run.smithi152.stdout:mon 3/3 22s ago 7m smithi152:172.21.15.152=a;smithi179:172.21.15.179=b;smithi193:172.21.15.193=c;count:3 2024-09-11T22:03:55.753 INFO:teuthology.orchestra.run.smithi152.stdout:osd 12 22s ago - 2024-09-11T22:03:55.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 -- 172.21.15.152:0/1692184543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6a100a2c40 msgr2=0x7f6a100a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:55.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6a100a2c40 0x7f6a100a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6a28069d70 tx=0x7f6a18007600 comp rx=0 tx=0).stop 2024-09-11T22:03:55.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 -- 172.21.15.152:0/1692184543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a281038b0 msgr2=0x7f6a2819f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:55.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a281038b0 0x7f6a2819f3f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c970 tx=0x7f6a2000ce30 comp rx=0 tx=0).stop 2024-09-11T22:03:55.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 -- 172.21.15.152:0/1692184543 shutdown_connections 2024-09-11T22:03:55.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a281038b0 0x7f6a2819f3f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:55.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a28102ef0 0x7f6a28198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:55.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f6a100a2c40 0x7f6a100a5100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:55.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 --2- 172.21.15.152:0/1692184543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a280fff10 0x7f6a28197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:55.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 -- 172.21.15.152:0/1692184543 >> 172.21.15.152:0/1692184543 conn(0x7f6a280fba80 msgr2=0x7f6a281061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:55.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 -- 172.21.15.152:0/1692184543 shutdown_connections 2024-09-11T22:03:55.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:55.754+0000 7f6a2d899640 1 -- 172.21.15.152:0/1692184543 wait complete. 2024-09-11T22:03:55.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:55 smithi179 ceph-mon[35603]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:55.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:55 smithi179 ceph-mon[35603]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:55 smithi193 ceph-mon[35545]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:55 smithi193 ceph-mon[35545]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:03:56.364 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-11T22:03:56.610 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:57.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.253+0000 7fefe7115640 1 -- 172.21.15.152:0/2543015264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe0102700 msgr2=0x7fefe0104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:57.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.253+0000 7fefe7115640 1 --2- 172.21.15.152:0/2543015264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe0102700 0x7fefe0104af0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009ca0 tx=0x7fefc802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:03:57.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.253+0000 7fefe7115640 1 -- 172.21.15.152:0/2543015264 shutdown_connections 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.253+0000 7fefe7115640 1 --2- 172.21.15.152:0/2543015264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefe0107960 0x7fefe0109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.253+0000 7fefe7115640 1 --2- 172.21.15.152:0/2543015264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefe0105030 0x7fefe0107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.253+0000 7fefe7115640 1 --2- 172.21.15.152:0/2543015264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe0102700 0x7fefe0104af0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.253+0000 7fefe7115640 1 -- 172.21.15.152:0/2543015264 >> 172.21.15.152:0/2543015264 conn(0x7fefe00fc280 msgr2=0x7fefe00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.254+0000 7fefe7115640 1 -- 172.21.15.152:0/2543015264 shutdown_connections 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.254+0000 7fefe7115640 1 -- 172.21.15.152:0/2543015264 wait complete. 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.254+0000 7fefe7115640 1 Processor -- start 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.254+0000 7fefe7115640 1 -- start start 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe7115640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefe0102700 0x7fefe0198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe7115640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefe0105030 0x7fefe01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe7115640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe0107960 0x7fefe019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe7115640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fefe010d950 con 0x7fefe0107960 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe7115640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fefe010d7d0 con 0x7fefe0105030 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe7115640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fefe010dad0 con 0x7fefe0102700 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe56b2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe0107960 0x7fefe019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe56b2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe0107960 0x7fefe019f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56650/0 (socket says 172.21.15.152:56650) 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe56b2640 1 -- 172.21.15.152:0/838370835 learned_addr learned my addr 172.21.15.152:0/838370835 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe4eb1640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefe0102700 0x7fefe0198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefdffff640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefe0105030 0x7fefe01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe56b2640 1 -- 172.21.15.152:0/838370835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefe0102700 msgr2=0x7fefe0198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe56b2640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefe0102700 0x7fefe0198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe56b2640 1 -- 172.21.15.152:0/838370835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefe0105030 msgr2=0x7fefe01985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe56b2640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefe0105030 0x7fefe01985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe56b2640 1 -- 172.21.15.152:0/838370835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe019fc90 con 0x7fefe0107960 2024-09-11T22:03:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefe56b2640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe0107960 0x7fefe019f620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009fd0 tx=0x7fefd800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.255+0000 7fefddffb640 1 -- 172.21.15.152:0/838370835 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8015020 con 0x7fefe0107960 2024-09-11T22:03:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.256+0000 7fefddffb640 1 -- 172.21.15.152:0/838370835 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd8011d10 con 0x7fefe0107960 2024-09-11T22:03:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.256+0000 7fefe7115640 1 -- 172.21.15.152:0/838370835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe019ff80 con 0x7fefe0107960 2024-09-11T22:03:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.256+0000 7fefddffb640 1 -- 172.21.15.152:0/838370835 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd800f2e0 con 0x7fefe0107960 2024-09-11T22:03:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.256+0000 7fefe7115640 1 -- 172.21.15.152:0/838370835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe01a04b0 con 0x7fefe0107960 2024-09-11T22:03:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.257+0000 7fefe7115640 1 -- 172.21.15.152:0/838370835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe00fdd70 con 0x7fefe0107960 2024-09-11T22:03:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.258+0000 7fefddffb640 1 -- 172.21.15.152:0/838370835 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fefd8018020 con 0x7fefe0107960 2024-09-11T22:03:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.258+0000 7fefddffb640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fefcc0a2c40 0x7fefcc0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.258+0000 7fefe4eb1640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fefcc0a2c40 0x7fefcc0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.258+0000 7fefddffb640 1 -- 172.21.15.152:0/838370835 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fefd80ce8b0 con 0x7fefe0107960 2024-09-11T22:03:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.259+0000 7fefe4eb1640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fefcc0a2c40 0x7fefcc0a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fefc8006010 tx=0x7fefc8000f40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:57.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.262+0000 7fefddffb640 1 -- 172.21.15.152:0/838370835 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fefd801f020 con 0x7fefe0107960 2024-09-11T22:03:57.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.438+0000 7fefe7115640 1 -- 172.21.15.152:0/838370835 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fefe0062630 con 0x7fefcc0a2c40 2024-09-11T22:03:57.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.439+0000 7fefddffb640 1 -- 172.21.15.152:0/838370835 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fefe0062630 con 0x7fefcc0a2c40 2024-09-11T22:03:57.440 INFO:teuthology.orchestra.run.smithi152.stdout:HOST ADDR LABELS STATUS 2024-09-11T22:03:57.440 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152 172.21.15.152 2024-09-11T22:03:57.440 INFO:teuthology.orchestra.run.smithi152.stdout:smithi179 172.21.15.179 2024-09-11T22:03:57.440 INFO:teuthology.orchestra.run.smithi152.stdout:smithi193 172.21.15.193 2024-09-11T22:03:57.440 INFO:teuthology.orchestra.run.smithi152.stdout:3 hosts in cluster 2024-09-11T22:03:57.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.441+0000 7fefe7115640 1 -- 172.21.15.152:0/838370835 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fefcc0a2c40 msgr2=0x7fefcc0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:57.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.441+0000 7fefe7115640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fefcc0a2c40 0x7fefcc0a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fefc8006010 tx=0x7fefc8000f40 comp rx=0 tx=0).stop 2024-09-11T22:03:57.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.441+0000 7fefe7115640 1 -- 172.21.15.152:0/838370835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe0107960 msgr2=0x7fefe019f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:57.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.441+0000 7fefe7115640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe0107960 0x7fefe019f620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009fd0 tx=0x7fefd800b820 comp rx=0 tx=0).stop 2024-09-11T22:03:57.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.441+0000 7fefe7115640 1 -- 172.21.15.152:0/838370835 shutdown_connections 2024-09-11T22:03:57.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.441+0000 7fefe7115640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe0107960 0x7fefe019f620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:57.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.441+0000 7fefe7115640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefe0105030 0x7fefe01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:57.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.441+0000 7fefe7115640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fefcc0a2c40 0x7fefcc0a5100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:57.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.441+0000 7fefe7115640 1 --2- 172.21.15.152:0/838370835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefe0102700 0x7fefe0198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:57.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.441+0000 7fefe7115640 1 -- 172.21.15.152:0/838370835 >> 172.21.15.152:0/838370835 conn(0x7fefe00fc280 msgr2=0x7fefe0103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:57.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.442+0000 7fefe7115640 1 -- 172.21.15.152:0/838370835 shutdown_connections 2024-09-11T22:03:57.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:57.442+0000 7fefe7115640 1 -- 172.21.15.152:0/838370835 wait complete. 2024-09-11T22:03:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:57 smithi152 ceph-mon[31188]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:57 smithi152 ceph-mon[31188]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:57.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:57 smithi179 ceph-mon[35603]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:57.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:57 smithi179 ceph-mon[35603]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:57.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:57 smithi193 ceph-mon[35545]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:57.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:57 smithi193 ceph-mon[35545]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:03:58.029 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-11T22:03:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.711+0000 7f86bd27f640 1 -- 172.21.15.152:0/1888466084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b81037c0 msgr2=0x7f86b810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.711+0000 7f86bd27f640 1 --2- 172.21.15.152:0/1888466084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b81037c0 0x7f86b810a050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009ca0 tx=0x7f86b002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:03:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.711+0000 7f86bd27f640 1 -- 172.21.15.152:0/1888466084 shutdown_connections 2024-09-11T22:03:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.711+0000 7f86bd27f640 1 --2- 172.21.15.152:0/1888466084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b81037c0 0x7f86b810a050 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.711+0000 7f86bd27f640 1 --2- 172.21.15.152:0/1888466084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86b8102e00 0x7f86b8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.711+0000 7f86bd27f640 1 --2- 172.21.15.152:0/1888466084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b8101c00 0x7f86b8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.711+0000 7f86bd27f640 1 -- 172.21.15.152:0/1888466084 >> 172.21.15.152:0/1888466084 conn(0x7f86b80fd390 msgr2=0x7f86b80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.711+0000 7f86bd27f640 1 -- 172.21.15.152:0/1888466084 shutdown_connections 2024-09-11T22:03:58.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.711+0000 7f86bd27f640 1 -- 172.21.15.152:0/1888466084 wait complete. 2024-09-11T22:03:58.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86bd27f640 1 Processor -- start 2024-09-11T22:03:58.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86bd27f640 1 -- start start 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86bd27f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b8101c00 0x7f86b8197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86bd27f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86b8102e00 0x7f86b8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86bd27f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b81037c0 0x7f86b819f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86bd27f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f86b810d980 con 0x7f86b8101c00 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86bd27f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f86b810d800 con 0x7f86b81037c0 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86bd27f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f86b810db00 con 0x7f86b8102e00 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86b6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b8101c00 0x7f86b8197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86b6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b8101c00 0x7f86b8197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56662/0 (socket says 172.21.15.152:56662) 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86b6ffd640 1 -- 172.21.15.152:0/2789923708 learned_addr learned my addr 172.21.15.152:0/2789923708 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86affff640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86b8102e00 0x7f86b8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86b6ffd640 1 -- 172.21.15.152:0/2789923708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86b8102e00 msgr2=0x7f86b8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86b6ffd640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86b8102e00 0x7f86b8198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86b6ffd640 1 -- 172.21.15.152:0/2789923708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b81037c0 msgr2=0x7f86b819f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86b77fe640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b81037c0 0x7f86b819f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86b6ffd640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b81037c0 0x7f86b819f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86b6ffd640 1 -- 172.21.15.152:0/2789923708 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b819fb80 con 0x7f86b8101c00 2024-09-11T22:03:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.712+0000 7f86b77fe640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b81037c0 0x7f86b819f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:03:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.713+0000 7f86b6ffd640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b8101c00 0x7f86b8197f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f86a800b450 tx=0x7f86a800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.713+0000 7f86b4ff9640 1 -- 172.21.15.152:0/2789923708 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8015020 con 0x7f86b8101c00 2024-09-11T22:03:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.713+0000 7f86bd27f640 1 -- 172.21.15.152:0/2789923708 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b819fe70 con 0x7f86b8101c00 2024-09-11T22:03:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.713+0000 7f86b4ff9640 1 -- 172.21.15.152:0/2789923708 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a8011d70 con 0x7f86b8101c00 2024-09-11T22:03:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.713+0000 7f86b4ff9640 1 -- 172.21.15.152:0/2789923708 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a800f340 con 0x7f86b8101c00 2024-09-11T22:03:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.713+0000 7f86bd27f640 1 -- 172.21.15.152:0/2789923708 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b81a03a0 con 0x7f86b8101c00 2024-09-11T22:03:58.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.714+0000 7f86bd27f640 1 -- 172.21.15.152:0/2789923708 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b8108ed0 con 0x7f86b8101c00 2024-09-11T22:03:58.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.715+0000 7f86b4ff9640 1 -- 172.21.15.152:0/2789923708 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f86a8018020 con 0x7f86b8101c00 2024-09-11T22:03:58.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.716+0000 7f86b4ff9640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f86a40a2c40 0x7f86a40a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:03:58.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.716+0000 7f86affff640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f86a40a2c40 0x7f86a40a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:03:58.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.716+0000 7f86b4ff9640 1 -- 172.21.15.152:0/2789923708 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f86a80ceb40 con 0x7f86b8101c00 2024-09-11T22:03:58.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.716+0000 7f86affff640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f86a40a2c40 0x7f86a40a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f86b8199470 tx=0x7f86a000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:03:58.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.720+0000 7f86b4ff9640 1 -- 172.21.15.152:0/2789923708 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86a801f020 con 0x7f86b8101c00 2024-09-11T22:03:58.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.893+0000 7f86bd27f640 1 -- 172.21.15.152:0/2789923708 --> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f86b8062630 con 0x7f86a40a2c40 2024-09-11T22:03:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.895+0000 7f86b4ff9640 1 -- 172.21.15.152:0/2789923708 <== mgr.14148 v2:172.21.15.152:6800/3828412393 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f86b8062630 con 0x7f86a40a2c40 2024-09-11T22:03:58.895 INFO:teuthology.orchestra.run.smithi152.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-11T22:03:58.896 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JT400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-11T22:03:58.896 INFO:teuthology.orchestra.run.smithi152.stdout:smithi179 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303009J400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-11T22:03:58.896 INFO:teuthology.orchestra.run.smithi152.stdout:smithi193 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500HB400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-11T22:03:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 -- 172.21.15.152:0/2789923708 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f86a40a2c40 msgr2=0x7f86a40a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f86a40a2c40 0x7f86a40a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f86b8199470 tx=0x7f86a000b390 comp rx=0 tx=0).stop 2024-09-11T22:03:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 -- 172.21.15.152:0/2789923708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b8101c00 msgr2=0x7f86b8197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:03:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b8101c00 0x7f86b8197f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f86a800b450 tx=0x7f86a800b910 comp rx=0 tx=0).stop 2024-09-11T22:03:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 -- 172.21.15.152:0/2789923708 shutdown_connections 2024-09-11T22:03:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b81037c0 0x7f86b819f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f86a40a2c40 0x7f86a40a5100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86b8102e00 0x7f86b8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 --2- 172.21.15.152:0/2789923708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b8101c00 0x7f86b8197f50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:03:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 -- 172.21.15.152:0/2789923708 >> 172.21.15.152:0/2789923708 conn(0x7f86b80fd390 msgr2=0x7f86b81060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:03:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 -- 172.21.15.152:0/2789923708 shutdown_connections 2024-09-11T22:03:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:03:58.897+0000 7f86bd27f640 1 -- 172.21.15.152:0/2789923708 wait complete. 2024-09-11T22:03:59.542 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:59 smithi152 ceph-mon[31188]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:59.542 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:03:59 smithi152 ceph-mon[31188]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:03:59.569 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T22:03:59.578 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T22:03:59.578 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T22:03:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:59 smithi179 ceph-mon[35603]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:03:59 smithi179 ceph-mon[35603]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:03:59.822 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:03:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:59 smithi193 ceph-mon[35545]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:03:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:03:59 smithi193 ceph-mon[35545]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:04:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.291+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/3519238342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf08103210 msgr2=0x7fcf08103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.291+0000 7fcf0ff5b640 1 --2- 172.21.15.152:0/3519238342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf08103210 0x7fcf08103610 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009900 tx=0x7fcef802a410 comp rx=0 tx=0).stop 2024-09-11T22:04:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.291+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/3519238342 shutdown_connections 2024-09-11T22:04:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.291+0000 7fcf0ff5b640 1 --2- 172.21.15.152:0/3519238342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf08100350 0x7fcf0810a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.291+0000 7fcf0ff5b640 1 --2- 172.21.15.152:0/3519238342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf08103be0 0x7fcf080ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.291+0000 7fcf0ff5b640 1 --2- 172.21.15.152:0/3519238342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf08103210 0x7fcf08103610 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.291+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/3519238342 >> 172.21.15.152:0/3519238342 conn(0x7fcf080fba40 msgr2=0x7fcf080fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.291+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/3519238342 shutdown_connections 2024-09-11T22:04:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.291+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/3519238342 wait complete. 2024-09-11T22:04:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.291+0000 7fcf0ff5b640 1 Processor -- start 2024-09-11T22:04:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.291+0000 7fcf0ff5b640 1 -- start start 2024-09-11T22:04:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0ff5b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf08100350 0x7fcf08197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0ff5b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf08103210 0x7fcf081984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0ff5b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf08103be0 0x7fcf0819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0ff5b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0810d920 con 0x7fcf08100350 2024-09-11T22:04:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0ff5b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0810d7a0 con 0x7fcf08103210 2024-09-11T22:04:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0ff5b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0810daa0 con 0x7fcf08103be0 2024-09-11T22:04:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0dcf7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf08100350 0x7fcf08197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0dcf7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf08100350 0x7fcf08197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56676/0 (socket says 172.21.15.152:56676) 2024-09-11T22:04:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0dcf7640 1 -- 172.21.15.152:0/570378639 learned_addr learned my addr 172.21.15.152:0/570378639 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0e4f8640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf08103be0 0x7fcf0819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0d4f6640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf08103210 0x7fcf081984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0dcf7640 1 -- 172.21.15.152:0/570378639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf08103be0 msgr2=0x7fcf0819f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0dcf7640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf08103be0 0x7fcf0819f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0dcf7640 1 -- 172.21.15.152:0/570378639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf08103210 msgr2=0x7fcf081984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0dcf7640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf08103210 0x7fcf081984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0dcf7640 1 -- 172.21.15.152:0/570378639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0819fbe0 con 0x7fcf08100350 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0dcf7640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf08100350 0x7fcf08197fb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcef8005ab0 tx=0x7fcef8004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcefeffd640 1 -- 172.21.15.152:0/570378639 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef803f030 con 0x7fcf08100350 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcefeffd640 1 -- 172.21.15.152:0/570378639 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcef8003ce0 con 0x7fcf08100350 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/570378639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf0819fe70 con 0x7fcf08100350 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcefeffd640 1 -- 172.21.15.152:0/570378639 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef8035070 con 0x7fcf08100350 2024-09-11T22:04:00.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.292+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/570378639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf081a02f0 con 0x7fcf08100350 2024-09-11T22:04:00.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.293+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/570378639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf08109200 con 0x7fcf08100350 2024-09-11T22:04:00.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.294+0000 7fcefeffd640 1 -- 172.21.15.152:0/570378639 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fcef8042030 con 0x7fcf08100350 2024-09-11T22:04:00.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.295+0000 7fcefeffd640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fcef40a2c40 0x7fcef40a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:00.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.295+0000 7fcf0d4f6640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fcef40a2c40 0x7fcef40a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:00.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.295+0000 7fcefeffd640 1 -- 172.21.15.152:0/570378639 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fcef80ef8c0 con 0x7fcf08100350 2024-09-11T22:04:00.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.296+0000 7fcf0d4f6640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fcef40a2c40 0x7fcef40a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf081994d0 tx=0x7fcf04008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:00.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.299+0000 7fcefeffd640 1 -- 172.21.15.152:0/570378639 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcef80bc6a0 con 0x7fcf08100350 2024-09-11T22:04:00.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:00 smithi152 ceph-mon[31188]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:00.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.505+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/570378639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fcf0802da10 con 0x7fcf08100350 2024-09-11T22:04:00.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.506+0000 7fcefeffd640 1 -- 172.21.15.152:0/570378639 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3094 (secure 0 0 0) 0x7fcef80bbfa0 con 0x7fcf08100350 2024-09-11T22:04:00.507 INFO:teuthology.orchestra.run.smithi152.stdout:e23 2024-09-11T22:04:00.507 INFO:teuthology.orchestra.run.smithi152.stdout:btime 2024-09-11T22:02:48:141067+0000 2024-09-11T22:04:00.507 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T22:04:00.507 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T22:04:00.507 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-09-11T22:04:00.507 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:00.507 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-09-11T22:04:00.507 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 23 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-09-11T22:02:36.537273+0000 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-09-11T22:02:47.341860+0000 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 300 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-09-11T22:04:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-09-11T22:04:00.509 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-09-11T22:04:00.509 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T22:04:00.509 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 3 2024-09-11T22:04:00.509 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1,2 2024-09-11T22:04:00.509 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=24472,1=24470,2=24457} 2024-09-11T22:04:00.509 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-09-11T22:04:00.509 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-09-11T22:04:00.509 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-09-11T22:04:00.509 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-09-11T22:04:00.509 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-09-11T22:04:00.509 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 0 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout:qdb_cluster leader: 24472 members: 24457,24470,24472 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.i{0:24472} state up:active seq 6 addr [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.f{0:24448} state up:standby-replay seq 1 addr [v2:172.21.15.193:6834/714804093,v1:172.21.15.193:6835/714804093] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b{1:24470} state up:active seq 6 addr [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.h{1:24446} state up:standby-replay seq 1 addr [v2:172.21.15.179:6836/4020116810,v1:172.21.15.179:6837/4020116810] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c{2:24457} state up:active seq 9 addr [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.e{2:24431} state up:standby-replay seq 1 addr [v2:172.21.15.179:6834/161011948,v1:172.21.15.179:6835/161011948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:00.511 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-09-11T22:04:00.511 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:00.511 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.152:6834/1074313081,v1:172.21.15.152:6835/1074313081] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.511 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d{-1:14541} state up:standby seq 1 addr [v2:172.21.15.152:6836/1959199383,v1:172.21.15.152:6837/1959199383] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.511 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.g{-1:14586} state up:standby seq 1 addr [v2:172.21.15.152:6838/2282340650,v1:172.21.15.152:6839/2282340650] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.511 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a{-1:14592} state up:standby seq 1 addr [v2:172.21.15.152:6840/1149066093,v1:172.21.15.152:6841/1149066093] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.511 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.k{-1:24410} state up:standby seq 1 addr [v2:172.21.15.179:6832/2338711359,v1:172.21.15.179:6833/2338711359] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.511 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.l{-1:24415} state up:standby seq 1 addr [v2:172.21.15.193:6832/1533120685,v1:172.21.15.193:6833/1533120685] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:04:00.512 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 23 2024-09-11T22:04:00.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.508+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/570378639 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fcef40a2c40 msgr2=0x7fcef40a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:00.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.508+0000 7fcf0ff5b640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fcef40a2c40 0x7fcef40a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf081994d0 tx=0x7fcf04008040 comp rx=0 tx=0).stop 2024-09-11T22:04:00.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.508+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/570378639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf08100350 msgr2=0x7fcf08197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:00.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.508+0000 7fcf0ff5b640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf08100350 0x7fcf08197fb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcef8005ab0 tx=0x7fcef8004360 comp rx=0 tx=0).stop 2024-09-11T22:04:00.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.508+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/570378639 shutdown_connections 2024-09-11T22:04:00.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.508+0000 7fcf0ff5b640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fcef40a2c40 0x7fcef40a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:00.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.508+0000 7fcf0ff5b640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf08103be0 0x7fcf0819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:00.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.508+0000 7fcf0ff5b640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf08103210 0x7fcf081984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:00.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.508+0000 7fcf0ff5b640 1 --2- 172.21.15.152:0/570378639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf08100350 0x7fcf08197fb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:00.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.508+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/570378639 >> 172.21.15.152:0/570378639 conn(0x7fcf080fba40 msgr2=0x7fcf081063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:00.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.509+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/570378639 shutdown_connections 2024-09-11T22:04:00.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:00.509+0000 7fcf0ff5b640 1 -- 172.21.15.152:0/570378639 wait complete. 2024-09-11T22:04:00.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:00 smithi179 ceph-mon[35603]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:00.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:00 smithi193 ceph-mon[35545]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:01.196 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-11T22:04:01.446 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:01.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:01 smithi152 ceph-mon[31188]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:04:01.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:01 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/570378639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T22:04:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:01 smithi179 ceph-mon[35603]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:04:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:01 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/570378639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T22:04:01.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:01 smithi193 ceph-mon[35545]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:04:01.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:01 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/570378639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T22:04:01.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.940+0000 7f87f75dd640 1 -- 172.21.15.152:0/2006261985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f0101c00 msgr2=0x7f87f0102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:01.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.940+0000 7f87f75dd640 1 --2- 172.21.15.152:0/2006261985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f0101c00 0x7f87f0102000 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009900 tx=0x7f87ec02a410 comp rx=0 tx=0).stop 2024-09-11T22:04:01.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.940+0000 7f87f75dd640 1 -- 172.21.15.152:0/2006261985 shutdown_connections 2024-09-11T22:04:01.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.940+0000 7f87f75dd640 1 --2- 172.21.15.152:0/2006261985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87f01037c0 0x7f87f010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:01.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.940+0000 7f87f75dd640 1 --2- 172.21.15.152:0/2006261985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f0102e00 0x7f87f0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:01.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.940+0000 7f87f75dd640 1 --2- 172.21.15.152:0/2006261985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f0101c00 0x7f87f0102000 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:01.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.940+0000 7f87f75dd640 1 -- 172.21.15.152:0/2006261985 >> 172.21.15.152:0/2006261985 conn(0x7f87f00fd390 msgr2=0x7f87f00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:01.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.940+0000 7f87f75dd640 1 -- 172.21.15.152:0/2006261985 shutdown_connections 2024-09-11T22:04:01.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.940+0000 7f87f75dd640 1 -- 172.21.15.152:0/2006261985 wait complete. 2024-09-11T22:04:01.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f75dd640 1 Processor -- start 2024-09-11T22:04:01.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f75dd640 1 -- start start 2024-09-11T22:04:01.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f75dd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87f0101c00 0x7f87f0197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:01.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f75dd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f0102e00 0x7f87f01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:01.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f75dd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f01037c0 0x7f87f019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:01.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f75dd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f87f010d900 con 0x7f87f01037c0 2024-09-11T22:04:01.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f75dd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f87f010d780 con 0x7f87f0102e00 2024-09-11T22:04:01.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f75dd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f87f010da80 con 0x7f87f0101c00 2024-09-11T22:04:01.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f5b7a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f01037c0 0x7f87f019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:01.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f5b7a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f01037c0 0x7f87f019f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56690/0 (socket says 172.21.15.152:56690) 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f5b7a640 1 -- 172.21.15.152:0/107245310 learned_addr learned my addr 172.21.15.152:0/107245310 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f5379640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87f0101c00 0x7f87f0197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f4b78640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f0102e00 0x7f87f01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f5b7a640 1 -- 172.21.15.152:0/107245310 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87f0101c00 msgr2=0x7f87f0197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f5b7a640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87f0101c00 0x7f87f0197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f5b7a640 1 -- 172.21.15.152:0/107245310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f0102e00 msgr2=0x7f87f01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f5b7a640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f0102e00 0x7f87f01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f5b7a640 1 -- 172.21.15.152:0/107245310 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f019fba0 con 0x7f87f01037c0 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.941+0000 7f87f4b78640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f0102e00 0x7f87f01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.942+0000 7f87f5b7a640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f01037c0 0x7f87f019f530 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f87e800eaa0 tx=0x7f87e800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.942+0000 7f87e67fc640 1 -- 172.21.15.152:0/107245310 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e800cdb0 con 0x7f87f01037c0 2024-09-11T22:04:01.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.942+0000 7f87e67fc640 1 -- 172.21.15.152:0/107245310 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87e8005020 con 0x7f87f01037c0 2024-09-11T22:04:01.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.942+0000 7f87f75dd640 1 -- 172.21.15.152:0/107245310 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f019fe90 con 0x7f87f01037c0 2024-09-11T22:04:01.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.942+0000 7f87e67fc640 1 -- 172.21.15.152:0/107245310 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e80116b0 con 0x7f87f01037c0 2024-09-11T22:04:01.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.942+0000 7f87f75dd640 1 -- 172.21.15.152:0/107245310 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f01a03c0 con 0x7f87f01037c0 2024-09-11T22:04:01.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.943+0000 7f87f75dd640 1 -- 172.21.15.152:0/107245310 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f0109000 con 0x7f87f01037c0 2024-09-11T22:04:01.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.944+0000 7f87e67fc640 1 -- 172.21.15.152:0/107245310 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f87e8005560 con 0x7f87f01037c0 2024-09-11T22:04:01.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.944+0000 7f87e67fc640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f87dc0a2c40 0x7f87dc0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:01.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.945+0000 7f87f5379640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f87dc0a2c40 0x7f87dc0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:01.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.945+0000 7f87e67fc640 1 -- 172.21.15.152:0/107245310 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f87e80cf420 con 0x7f87f01037c0 2024-09-11T22:04:01.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.945+0000 7f87f5379640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f87dc0a2c40 0x7f87dc0a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f87ec005ab0 tx=0x7f87ec000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:01.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:01.949+0000 7f87e67fc640 1 -- 172.21.15.152:0/107245310 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87e8016030 con 0x7f87f01037c0 2024-09-11T22:04:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.117+0000 7f87f75dd640 1 -- 172.21.15.152:0/107245310 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f87f002da10 con 0x7f87f01037c0 2024-09-11T22:04:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.118+0000 7f87e67fc640 1 -- 172.21.15.152:0/107245310 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+5361 (secure 0 0 0) 0x7f87e809c200 con 0x7f87f01037c0 2024-09-11T22:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 84 2024-09-11T22:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout:fsid 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T22:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-09-11T21:55:03.865078+0000 2024-09-11T22:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-09-11T22:02:55.337928+0000 2024-09-11T22:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:crush_version 26 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:full_ratio 0.95 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:backfillfull_ratio 0.9 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:nearfull_ratio 0.85 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:require_min_compat_client luminous 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:min_compat_client luminous 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:require_osd_release squid 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:stretch_mode_enabled false 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-11T22:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:max_osd 12 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6802/1398794293,v1:172.21.15.152:6803/1398794293] [v2:172.21.15.152:6804/1398794293,v1:172.21.15.152:6805/1398794293] exists,up 90c6f283-df62-405d-921a-5a8144b114f3 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 up in weight 1 up_from 13 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6800/1697561273,v1:172.21.15.179:6801/1697561273] [v2:172.21.15.179:6802/1697561273,v1:172.21.15.179:6803/1697561273] exists,up 36bae9c7-4c9c-499c-a480-3c2a5817269c 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6800/885545263,v1:172.21.15.193:6801/885545263] [v2:172.21.15.193:6802/885545263,v1:172.21.15.193:6803/885545263] exists,up 707f080b-8903-43a4-ae5a-75a4b32e1842 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 up in weight 1 up_from 25 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6810/1387225450,v1:172.21.15.152:6811/1387225450] [v2:172.21.15.152:6812/1387225450,v1:172.21.15.152:6813/1387225450] exists,up 8e9e11a6-41be-4ea6-824b-295fdf0430b6 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 up in weight 1 up_from 32 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6808/2976574024,v1:172.21.15.179:6809/2976574024] [v2:172.21.15.179:6810/2976574024,v1:172.21.15.179:6811/2976574024] exists,up cb5c9ac5-985a-42db-8bd3-805d3122d3a8 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 up in weight 1 up_from 37 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6808/2237502713,v1:172.21.15.193:6809/2237502713] [v2:172.21.15.193:6810/2237502713,v1:172.21.15.193:6811/2237502713] exists,up 8500e2aa-d805-460a-9a18-f74bef94f647 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.6 up in weight 1 up_from 45 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6818/3410412290,v1:172.21.15.152:6819/3410412290] [v2:172.21.15.152:6820/3410412290,v1:172.21.15.152:6821/3410412290] exists,up 7efd5367-8d24-4036-81b2-b58b801435dd 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.7 up in weight 1 up_from 49 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6816/2484200699,v1:172.21.15.179:6817/2484200699] [v2:172.21.15.179:6818/2484200699,v1:172.21.15.179:6819/2484200699] exists,up a3a68129-77a1-49ce-a517-862c73892209 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.8 up in weight 1 up_from 57 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6816/207210713,v1:172.21.15.193:6817/207210713] [v2:172.21.15.193:6818/207210713,v1:172.21.15.193:6819/207210713] exists,up 7d9b684e-3bb8-4aee-abc2-1e654068425d 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.9 up in weight 1 up_from 64 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6826/863570769,v1:172.21.15.152:6827/863570769] [v2:172.21.15.152:6828/863570769,v1:172.21.15.152:6829/863570769] exists,up 8e04aa14-c831-4546-bae0-c4fa460b8d9f 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.10 up in weight 1 up_from 69 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6824/1793292047,v1:172.21.15.179:6825/1793292047] [v2:172.21.15.179:6826/1793292047,v1:172.21.15.179:6827/1793292047] exists,up ded37595-f1a3-4d43-a4be-d84ead52418e 2024-09-11T22:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.11 up in weight 1 up_from 76 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6824/4019851791,v1:172.21.15.193:6825/4019851791] [v2:172.21.15.193:6826/4019851791,v1:172.21.15.193:6827/4019851791] exists,up 98e6a47b-2ec0-43d7-aa2e-76a751b4579d 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:pg_upmap_items 2.6 [8,11] 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:pg_upmap_items 2.a [2,11] 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:pg_upmap_items 2.16 [2,4] 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:pg_upmap_items 2.1d [2,1] 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:pg_upmap_items 3.6 [3,7] 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:pg_upmap_items 3.e [5,9] 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:pg_upmap_items 3.17 [4,6] 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:pg_upmap_items 3.1d [5,9] 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:pg_upmap_items 3.2c [4,9] 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:pg_upmap_items 3.31 [4,8] 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:blocklist 172.21.15.152:0/2046084258 expires 2024-09-12T21:55:54.195284+0000 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:blocklist 172.21.15.152:0/3449685640 expires 2024-09-12T21:55:54.195284+0000 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:blocklist 172.21.15.152:0/3392108712 expires 2024-09-12T21:55:54.195284+0000 2024-09-11T22:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:blocklist 172.21.15.152:6801/1144560416 expires 2024-09-12T21:55:54.195284+0000 2024-09-11T22:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout:blocklist 172.21.15.152:0/4115778297 expires 2024-09-12T21:55:30.179334+0000 2024-09-11T22:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout:blocklist 172.21.15.152:0/567593116 expires 2024-09-12T21:55:30.179334+0000 2024-09-11T22:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout:blocklist 172.21.15.152:6801/1349026414 expires 2024-09-12T21:55:30.179334+0000 2024-09-11T22:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout:blocklist 172.21.15.152:6800/1349026414 expires 2024-09-12T21:55:30.179334+0000 2024-09-11T22:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout:blocklist 172.21.15.152:6800/1144560416 expires 2024-09-12T21:55:54.195284+0000 2024-09-11T22:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout:blocklist 172.21.15.152:0/1558176271 expires 2024-09-12T21:55:30.179334+0000 2024-09-11T22:04:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.120+0000 7f87f75dd640 1 -- 172.21.15.152:0/107245310 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f87dc0a2c40 msgr2=0x7f87dc0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.120+0000 7f87f75dd640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f87dc0a2c40 0x7f87dc0a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f87ec005ab0 tx=0x7f87ec000bc0 comp rx=0 tx=0).stop 2024-09-11T22:04:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.120+0000 7f87f75dd640 1 -- 172.21.15.152:0/107245310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f01037c0 msgr2=0x7f87f019f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.120+0000 7f87f75dd640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f01037c0 0x7f87f019f530 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f87e800eaa0 tx=0x7f87e800ef60 comp rx=0 tx=0).stop 2024-09-11T22:04:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.120+0000 7f87f75dd640 1 -- 172.21.15.152:0/107245310 shutdown_connections 2024-09-11T22:04:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.120+0000 7f87f75dd640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f01037c0 0x7f87f019f530 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.120+0000 7f87f75dd640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f0102e00 0x7f87f01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.120+0000 7f87f75dd640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f87dc0a2c40 0x7f87dc0a5100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.120+0000 7f87f75dd640 1 --2- 172.21.15.152:0/107245310 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87f0101c00 0x7f87f0197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.120+0000 7f87f75dd640 1 -- 172.21.15.152:0/107245310 >> 172.21.15.152:0/107245310 conn(0x7f87f00fd390 msgr2=0x7f87f01061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:02.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.121+0000 7f87f75dd640 1 -- 172.21.15.152:0/107245310 shutdown_connections 2024-09-11T22:04:02.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:02.121+0000 7f87f75dd640 1 -- 172.21.15.152:0/107245310 wait complete. 2024-09-11T22:04:02.715 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:02 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/107245310' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T22:04:02.744 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-11T22:04:02.759 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:04:02.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:02 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/107245310' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T22:04:02.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:02 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/107245310' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T22:04:03.007 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:03.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.398+0000 7fa68a0a6640 1 -- 172.21.15.152:0/729232060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa684106f10 msgr2=0x7fa68410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:03.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.398+0000 7fa68a0a6640 1 --2- 172.21.15.152:0/729232060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa684106f10 0x7fa68410ea90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009ca0 tx=0x7fa67c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:04:03.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.398+0000 7fa68a0a6640 1 -- 172.21.15.152:0/729232060 shutdown_connections 2024-09-11T22:04:03.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.398+0000 7fa68a0a6640 1 --2- 172.21.15.152:0/729232060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa684106f10 0x7fa68410ea90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:03.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.398+0000 7fa68a0a6640 1 --2- 172.21.15.152:0/729232060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa684102790 0x7fa6841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:03.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.398+0000 7fa68a0a6640 1 --2- 172.21.15.152:0/729232060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa684101de0 0x7fa6841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:03.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.398+0000 7fa68a0a6640 1 -- 172.21.15.152:0/729232060 >> 172.21.15.152:0/729232060 conn(0x7fa6840fd8c0 msgr2=0x7fa6840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:03.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.398+0000 7fa68a0a6640 1 -- 172.21.15.152:0/729232060 shutdown_connections 2024-09-11T22:04:03.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.398+0000 7fa68a0a6640 1 -- 172.21.15.152:0/729232060 wait complete. 2024-09-11T22:04:03.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa68a0a6640 1 Processor -- start 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa68a0a6640 1 -- start start 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa68a0a6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa684101de0 0x7fa6841a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa68a0a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa684102790 0x7fa6841a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa68a0a6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa684106f10 0x7fa68419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa68a0a6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa684112010 con 0x7fa684102790 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa68a0a6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa684111e90 con 0x7fa684101de0 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa68a0a6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa684112190 con 0x7fa684106f10 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa682ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa684102790 0x7fa6841a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa682ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa684102790 0x7fa6841a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33468/0 (socket says 172.21.15.152:33468) 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa682ffd640 1 -- 172.21.15.152:0/156279459 learned_addr learned my addr 172.21.15.152:0/156279459 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa683fff640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa684106f10 0x7fa68419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.399+0000 7fa6837fe640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa684101de0 0x7fa6841a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.400+0000 7fa682ffd640 1 -- 172.21.15.152:0/156279459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa684106f10 msgr2=0x7fa68419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.400+0000 7fa682ffd640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa684106f10 0x7fa68419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.400+0000 7fa682ffd640 1 -- 172.21.15.152:0/156279459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa684101de0 msgr2=0x7fa6841a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.400+0000 7fa682ffd640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa684101de0 0x7fa6841a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.400+0000 7fa682ffd640 1 -- 172.21.15.152:0/156279459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68419ae90 con 0x7fa684102790 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.400+0000 7fa682ffd640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa684102790 0x7fa6841a0a40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa67800b4a0 tx=0x7fa67800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.400+0000 7fa680ff9640 1 -- 172.21.15.152:0/156279459 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678014070 con 0x7fa684102790 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.400+0000 7fa68a0a6640 1 -- 172.21.15.152:0/156279459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68419b180 con 0x7fa684102790 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.400+0000 7fa680ff9640 1 -- 172.21.15.152:0/156279459 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa678010af0 con 0x7fa684102790 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.400+0000 7fa680ff9640 1 -- 172.21.15.152:0/156279459 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678017d10 con 0x7fa684102790 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.400+0000 7fa68a0a6640 1 -- 172.21.15.152:0/156279459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6841a7320 con 0x7fa684102790 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.401+0000 7fa68a0a6640 1 -- 172.21.15.152:0/156279459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa684102240 con 0x7fa684102790 2024-09-11T22:04:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.402+0000 7fa680ff9640 1 -- 172.21.15.152:0/156279459 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa678017070 con 0x7fa684102790 2024-09-11T22:04:03.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.403+0000 7fa680ff9640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa66c0a2c10 0x7fa66c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:03.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.403+0000 7fa6837fe640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa66c0a2c10 0x7fa66c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:03.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.403+0000 7fa680ff9640 1 -- 172.21.15.152:0/156279459 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fa6780ce970 con 0x7fa684102790 2024-09-11T22:04:03.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.403+0000 7fa6837fe640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa66c0a2c10 0x7fa66c0a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa674009890 tx=0x7fa674008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:03.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.406+0000 7fa680ff9640 1 -- 172.21.15.152:0/156279459 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa67809b860 con 0x7fa684102790 2024-09-11T22:04:03.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.604+0000 7fa68a0a6640 1 -- 172.21.15.152:0/156279459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa68419bb70 con 0x7fa684102790 2024-09-11T22:04:03.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.605+0000 7fa680ff9640 1 -- 172.21.15.152:0/156279459 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11923 (secure 0 0 0) 0x7fa67809b160 con 0x7fa684102790 2024-09-11T22:04:03.606 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:03.606 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":23,"btime":"2024-09-11T22:02:48:141067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:02:47.341860+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:04:03.606 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 23 2024-09-11T22:04:03.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 -- 172.21.15.152:0/156279459 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa66c0a2c10 msgr2=0x7fa66c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:03.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa66c0a2c10 0x7fa66c0a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa674009890 tx=0x7fa674008040 comp rx=0 tx=0).stop 2024-09-11T22:04:03.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 -- 172.21.15.152:0/156279459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa684102790 msgr2=0x7fa6841a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:03.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa684102790 0x7fa6841a0a40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa67800b4a0 tx=0x7fa67800b960 comp rx=0 tx=0).stop 2024-09-11T22:04:03.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 -- 172.21.15.152:0/156279459 shutdown_connections 2024-09-11T22:04:03.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7fa66c0a2c10 0x7fa66c0a50d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:03.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa684106f10 0x7fa68419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:03.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa684102790 0x7fa6841a0a40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:03.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 --2- 172.21.15.152:0/156279459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa684101de0 0x7fa6841a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:03.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 -- 172.21.15.152:0/156279459 >> 172.21.15.152:0/156279459 conn(0x7fa6840fd8c0 msgr2=0x7fa6840fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:03.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 -- 172.21.15.152:0/156279459 shutdown_connections 2024-09-11T22:04:03.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:03.607+0000 7fa68a0a6640 1 -- 172.21.15.152:0/156279459 wait complete. 2024-09-11T22:04:03.698 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:03 smithi179 ceph-mon[35603]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:04:03.727 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:03 smithi193 ceph-mon[35545]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:04:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:03 smithi152 ceph-mon[31188]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:04:04.317 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:04:04.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:04 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/156279459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:04.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:04 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/156279459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:04.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:04 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/156279459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:05.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.996+0000 7f06fa03c640 1 -- 172.21.15.152:0/305715882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06f4102d40 msgr2=0x7f06f4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:05.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.996+0000 7f06fa03c640 1 --2- 172.21.15.152:0/305715882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06f4102d40 0x7f06f4103120 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009ca0 tx=0x7f06e402a950 comp rx=0 tx=0).stop 2024-09-11T22:04:05.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.996+0000 7f06fa03c640 1 -- 172.21.15.152:0/305715882 shutdown_connections 2024-09-11T22:04:05.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.996+0000 7f06fa03c640 1 --2- 172.21.15.152:0/305715882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f410c170 0x7f06f410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:05.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.996+0000 7f06fa03c640 1 --2- 172.21.15.152:0/305715882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f4103660 0x7f06f410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:05.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.996+0000 7f06fa03c640 1 --2- 172.21.15.152:0/305715882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06f4102d40 0x7f06f4103120 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:05.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.996+0000 7f06fa03c640 1 -- 172.21.15.152:0/305715882 >> 172.21.15.152:0/305715882 conn(0x7f06f40fc7a0 msgr2=0x7f06f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:05.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.996+0000 7f06fa03c640 1 -- 172.21.15.152:0/305715882 shutdown_connections 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.996+0000 7f06fa03c640 1 -- 172.21.15.152:0/305715882 wait complete. 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.997+0000 7f06fa03c640 1 Processor -- start 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.997+0000 7f06fa03c640 1 -- start start 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.997+0000 7f06fa03c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f4102d40 0x7f06f4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.997+0000 7f06fa03c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f4103660 0x7f06f4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.997+0000 7f06fa03c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06f410c170 0x7f06f419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.997+0000 7f06fa03c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4111fc0 con 0x7f06f410c170 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.997+0000 7f06fa03c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4111e40 con 0x7f06f4103660 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.997+0000 7f06fa03c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4112140 con 0x7f06f4102d40 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.997+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06f410c170 0x7f06f419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06f410c170 0x7f06f419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33482/0 (socket says 172.21.15.152:33482) 2024-09-11T22:04:05.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f3fff640 1 -- 172.21.15.152:0/2765664744 learned_addr learned my addr 172.21.15.152:0/2765664744 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f37fe640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f4102d40 0x7f06f4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f2ffd640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f4103660 0x7f06f4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f3fff640 1 -- 172.21.15.152:0/2765664744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f4102d40 msgr2=0x7f06f4198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f3fff640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f4102d40 0x7f06f4198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f3fff640 1 -- 172.21.15.152:0/2765664744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f4103660 msgr2=0x7f06f4198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f3fff640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f4103660 0x7f06f4198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f3fff640 1 -- 172.21.15.152:0/2765664744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f419d400 con 0x7f06f410c170 2024-09-11T22:04:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f3fff640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06f410c170 0x7f06f419cd20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c970 tx=0x7f06ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f0ff9640 1 -- 172.21.15.152:0/2765664744 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec007bb0 con 0x7f06f410c170 2024-09-11T22:04:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06fa03c640 1 -- 172.21.15.152:0/2765664744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f419d6f0 con 0x7f06f410c170 2024-09-11T22:04:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f0ff9640 1 -- 172.21.15.152:0/2765664744 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06ec007d50 con 0x7f06f410c170 2024-09-11T22:04:05.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06f0ff9640 1 -- 172.21.15.152:0/2765664744 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00f450 con 0x7f06f410c170 2024-09-11T22:04:05.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.998+0000 7f06fa03c640 1 -- 172.21.15.152:0/2765664744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f41a4fd0 con 0x7f06f410c170 2024-09-11T22:04:05.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:04.999+0000 7f06fa03c640 1 -- 172.21.15.152:0/2765664744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f4103120 con 0x7f06f410c170 2024-09-11T22:04:05.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.000+0000 7f06f0ff9640 1 -- 172.21.15.152:0/2765664744 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f06ec004f00 con 0x7f06f410c170 2024-09-11T22:04:05.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.001+0000 7f06f0ff9640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f06dc0a2c10 0x7f06dc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:05.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.001+0000 7f06f37fe640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f06dc0a2c10 0x7f06dc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:05.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.001+0000 7f06f0ff9640 1 -- 172.21.15.152:0/2765664744 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f06ec0cf250 con 0x7f06f410c170 2024-09-11T22:04:05.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.001+0000 7f06f37fe640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f06dc0a2c10 0x7f06dc0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06e4000f80 tx=0x7f06e4009800 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:05.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.004+0000 7f06f0ff9640 1 -- 172.21.15.152:0/2765664744 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06ec014030 con 0x7f06f410c170 2024-09-11T22:04:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.205+0000 7f06fa03c640 1 -- 172.21.15.152:0/2765664744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06f41997b0 con 0x7f06f410c170 2024-09-11T22:04:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.206+0000 7f06f0ff9640 1 -- 172.21.15.152:0/2765664744 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11923 (secure 0 0 0) 0x7f06ec09c030 con 0x7f06f410c170 2024-09-11T22:04:05.207 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:05.207 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":23,"btime":"2024-09-11T22:02:48:141067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:02:47.341860+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:04:05.207 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 23 2024-09-11T22:04:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 -- 172.21.15.152:0/2765664744 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f06dc0a2c10 msgr2=0x7f06dc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f06dc0a2c10 0x7f06dc0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06e4000f80 tx=0x7f06e4009800 comp rx=0 tx=0).stop 2024-09-11T22:04:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 -- 172.21.15.152:0/2765664744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06f410c170 msgr2=0x7f06f419cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06f410c170 0x7f06f419cd20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c970 tx=0x7f06ec00ce30 comp rx=0 tx=0).stop 2024-09-11T22:04:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 -- 172.21.15.152:0/2765664744 shutdown_connections 2024-09-11T22:04:05.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06f410c170 0x7f06f419cd20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:05.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f4103660 0x7f06f4198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:05.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f06dc0a2c10 0x7f06dc0a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:05.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 --2- 172.21.15.152:0/2765664744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f4102d40 0x7f06f4198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:05.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 -- 172.21.15.152:0/2765664744 >> 172.21.15.152:0/2765664744 conn(0x7f06f40fc7a0 msgr2=0x7f06f40fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:05.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 -- 172.21.15.152:0/2765664744 shutdown_connections 2024-09-11T22:04:05.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:05.208+0000 7f06fa03c640 1 -- 172.21.15.152:0/2765664744 wait complete. 2024-09-11T22:04:05.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:05 smithi152 ceph-mon[31188]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:04:05.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:05 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2765664744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:05.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:05 smithi179 ceph-mon[35603]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:04:05.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:05 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2765664744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:05.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:04:05.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:05 smithi193 ceph-mon[35545]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:04:05.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:05 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2765664744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:06.069 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:06.471 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:06 smithi152 ceph-mon[31188]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:04:06.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.470+0000 7ff7ce588640 1 -- 172.21.15.152:0/4161444464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c8102d40 msgr2=0x7ff7c8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:06.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.470+0000 7ff7ce588640 1 --2- 172.21.15.152:0/4161444464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c8102d40 0x7ff7c8103120 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009900 tx=0x7ff7b802a480 comp rx=0 tx=0).stop 2024-09-11T22:04:06.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.470+0000 7ff7ce588640 1 -- 172.21.15.152:0/4161444464 shutdown_connections 2024-09-11T22:04:06.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.470+0000 7ff7ce588640 1 --2- 172.21.15.152:0/4161444464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c810c170 0x7ff7c810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:06.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.470+0000 7ff7ce588640 1 --2- 172.21.15.152:0/4161444464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c8103660 0x7ff7c810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:06.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.470+0000 7ff7ce588640 1 --2- 172.21.15.152:0/4161444464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c8102d40 0x7ff7c8103120 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:06.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.470+0000 7ff7ce588640 1 -- 172.21.15.152:0/4161444464 >> 172.21.15.152:0/4161444464 conn(0x7ff7c80fc7a0 msgr2=0x7ff7c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:06.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.470+0000 7ff7ce588640 1 -- 172.21.15.152:0/4161444464 shutdown_connections 2024-09-11T22:04:06.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.470+0000 7ff7ce588640 1 -- 172.21.15.152:0/4161444464 wait complete. 2024-09-11T22:04:06.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.471+0000 7ff7ce588640 1 Processor -- start 2024-09-11T22:04:06.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.471+0000 7ff7ce588640 1 -- start start 2024-09-11T22:04:06.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.471+0000 7ff7ce588640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c8102d40 0x7ff7c819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:06.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.471+0000 7ff7ce588640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c8103660 0x7ff7c819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:06.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.471+0000 7ff7ce588640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c810c170 0x7ff7c819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:06.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.471+0000 7ff7ce588640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c8111fb0 con 0x7ff7c8103660 2024-09-11T22:04:06.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.471+0000 7ff7ce588640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c8111e30 con 0x7ff7c810c170 2024-09-11T22:04:06.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.471+0000 7ff7ce588640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c8112130 con 0x7ff7c8102d40 2024-09-11T22:04:06.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c8103660 0x7ff7c819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:06.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c8102d40 0x7ff7c819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c8102d40 0x7ff7c819a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:33008/0 (socket says 172.21.15.152:33008) 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c8103660 0x7ff7c819ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33492/0 (socket says 172.21.15.152:33492) 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c7fff640 1 -- 172.21.15.152:0/2088674329 learned_addr learned my addr 172.21.15.152:0/2088674329 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7ccb25640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c810c170 0x7ff7c819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c77fe640 1 -- 172.21.15.152:0/2088674329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c8102d40 msgr2=0x7ff7c819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c77fe640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c8102d40 0x7ff7c819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c77fe640 1 -- 172.21.15.152:0/2088674329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c810c170 msgr2=0x7ff7c819efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c77fe640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c810c170 0x7ff7c819efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c77fe640 1 -- 172.21.15.152:0/2088674329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c819f680 con 0x7ff7c8103660 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c77fe640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c8103660 0x7ff7c819ac10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00b490 tx=0x7ff7bc00b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c57fa640 1 -- 172.21.15.152:0/2088674329 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc015020 con 0x7ff7c8103660 2024-09-11T22:04:06.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7ce588640 1 -- 172.21.15.152:0/2088674329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c819f970 con 0x7ff7c8103660 2024-09-11T22:04:06.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c57fa640 1 -- 172.21.15.152:0/2088674329 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7bc011d10 con 0x7ff7c8103660 2024-09-11T22:04:06.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7c57fa640 1 -- 172.21.15.152:0/2088674329 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc010e60 con 0x7ff7c8103660 2024-09-11T22:04:06.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.472+0000 7ff7ce588640 1 -- 172.21.15.152:0/2088674329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c81a7250 con 0x7ff7c8103660 2024-09-11T22:04:06.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.473+0000 7ff7ce588640 1 -- 172.21.15.152:0/2088674329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c8103120 con 0x7ff7c8103660 2024-09-11T22:04:06.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.475+0000 7ff7c57fa640 1 -- 172.21.15.152:0/2088674329 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff7bc018020 con 0x7ff7c8103660 2024-09-11T22:04:06.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.475+0000 7ff7c57fa640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff7b00a2c10 0x7ff7b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:06.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.475+0000 7ff7c7fff640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff7b00a2c10 0x7ff7b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:06.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.475+0000 7ff7c57fa640 1 -- 172.21.15.152:0/2088674329 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7ff7bc0ced60 con 0x7ff7c8103660 2024-09-11T22:04:06.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.476+0000 7ff7c7fff640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff7b00a2c10 0x7ff7b00a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80096c0 tx=0x7ff7b8005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:06.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.478+0000 7ff7c57fa640 1 -- 172.21.15.152:0/2088674329 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7bc01f020 con 0x7ff7c8103660 2024-09-11T22:04:06.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.646+0000 7ff7ce588640 1 -- 172.21.15.152:0/2088674329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7c819ba30 con 0x7ff7c8103660 2024-09-11T22:04:06.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.647+0000 7ff7c57fa640 1 -- 172.21.15.152:0/2088674329 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22820 (secure 0 0 0) 0x7ff7c819ba30 con 0x7ff7c8103660 2024-09-11T22:04:06.648 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:06.649 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":84,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:02:55.337928+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:04:06.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 -- 172.21.15.152:0/2088674329 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff7b00a2c10 msgr2=0x7ff7b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:06.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff7b00a2c10 0x7ff7b00a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80096c0 tx=0x7ff7b8005a20 comp rx=0 tx=0).stop 2024-09-11T22:04:06.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 -- 172.21.15.152:0/2088674329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c8103660 msgr2=0x7ff7c819ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:06.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c8103660 0x7ff7c819ac10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00b490 tx=0x7ff7bc00b950 comp rx=0 tx=0).stop 2024-09-11T22:04:06.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 -- 172.21.15.152:0/2088674329 shutdown_connections 2024-09-11T22:04:06.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c810c170 0x7ff7c819efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:06.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c8103660 0x7ff7c819ac10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:06.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7ff7b00a2c10 0x7ff7b00a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:06.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 --2- 172.21.15.152:0/2088674329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c8102d40 0x7ff7c819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:06.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 -- 172.21.15.152:0/2088674329 >> 172.21.15.152:0/2088674329 conn(0x7ff7c80fc7a0 msgr2=0x7ff7c8101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:06.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 -- 172.21.15.152:0/2088674329 shutdown_connections 2024-09-11T22:04:06.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:06.650+0000 7ff7ce588640 1 -- 172.21.15.152:0/2088674329 wait complete. 2024-09-11T22:04:06.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:06 smithi179 ceph-mon[35603]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:04:06.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:06 smithi193 ceph-mon[35545]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:04:07.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T22:02:36.537273+0000', 'modified': '2024-09-11T22:02:47.341860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24472, 'mds_1': 24470, 'mds_2': 24457}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24431': {'gid': 24431, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6835/161011948', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 161011948}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 161011948}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6837/4020116810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 4020116810}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 4020116810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6835/714804093', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 714804093}, {'type': 'v1', 'addr': '172.21.15.193:6835', 'nonce': 714804093}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.193:6837/3273726370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6836', 'nonce': 3273726370}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 3273726370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'b', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.179:6839/7269368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6838', 'nonce': 7269368}, {'type': 'v1', 'addr': '172.21.15.179:6839', 'nonce': 7269368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.193:6839/1925980452', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6838', 'nonce': 1925980452}, {'type': 'v1', 'addr': '172.21.15.193:6839', 'nonce': 1925980452}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24472, 'qdb_cluster': [24457, 24470, 24472]} 2024-09-11T22:04:07.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T22:04:07.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T22:04:07.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:07 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2088674329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:07.513 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:07.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:07 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2088674329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:07 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2088674329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:07.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.987+0000 7f0562e36640 1 -- 172.21.15.152:0/3126787860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c101420 msgr2=0x7f055c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:07.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.987+0000 7f0562e36640 1 --2- 172.21.15.152:0/3126787860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c101420 0x7f055c10d950 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0554009cd0 tx=0x7f055402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:04:07.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.987+0000 7f0562e36640 1 -- 172.21.15.152:0/3126787860 shutdown_connections 2024-09-11T22:04:07.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.987+0000 7f0562e36640 1 --2- 172.21.15.152:0/3126787860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c101420 0x7f055c10d950 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:07.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.987+0000 7f0562e36640 1 --2- 172.21.15.152:0/3126787860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f055c100a80 0x7f055c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:07.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.987+0000 7f0562e36640 1 --2- 172.21.15.152:0/3126787860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f055c106a80 0x7f055c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:07.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.987+0000 7f0562e36640 1 -- 172.21.15.152:0/3126787860 >> 172.21.15.152:0/3126787860 conn(0x7f055c0fc7a0 msgr2=0x7f055c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:07.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.987+0000 7f0562e36640 1 -- 172.21.15.152:0/3126787860 shutdown_connections 2024-09-11T22:04:07.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.987+0000 7f0562e36640 1 -- 172.21.15.152:0/3126787860 wait complete. 2024-09-11T22:04:07.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.987+0000 7f0562e36640 1 Processor -- start 2024-09-11T22:04:07.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f0562e36640 1 -- start start 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f0562e36640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f055c100a80 0x7f055c0fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f0562e36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c101420 0x7f055c0fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f0562e36640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f055c106a80 0x7f055c0fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f0562e36640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f055c110e80 con 0x7f055c101420 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f0562e36640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f055c110d00 con 0x7f055c100a80 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f0562e36640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f055c111000 con 0x7f055c106a80 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f055bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c101420 0x7f055c0fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f055bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c101420 0x7f055c0fd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33498/0 (socket says 172.21.15.152:33498) 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f055bfff640 1 -- 172.21.15.152:0/1033921993 learned_addr learned my addr 172.21.15.152:0/1033921993 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f0560bd2640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f055c100a80 0x7f055c0fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f05613d3640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f055c106a80 0x7f055c0fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f055bfff640 1 -- 172.21.15.152:0/1033921993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f055c106a80 msgr2=0x7f055c0fd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:07.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f055bfff640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f055c106a80 0x7f055c0fd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:07.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f055bfff640 1 -- 172.21.15.152:0/1033921993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f055c100a80 msgr2=0x7f055c0fcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:07.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f055bfff640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f055c100a80 0x7f055c0fcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:07.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f055bfff640 1 -- 172.21.15.152:0/1033921993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c1a6840 con 0x7f055c101420 2024-09-11T22:04:07.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f055bfff640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c101420 0x7f055c0fd270 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f054800d770 tx=0x7f054800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:07.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.988+0000 7f0559ffb640 1 -- 172.21.15.152:0/1033921993 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548017070 con 0x7f055c101420 2024-09-11T22:04:07.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.989+0000 7f0559ffb640 1 -- 172.21.15.152:0/1033921993 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0548005500 con 0x7f055c101420 2024-09-11T22:04:07.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.989+0000 7f0562e36640 1 -- 172.21.15.152:0/1033921993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055c1a6b30 con 0x7f055c101420 2024-09-11T22:04:07.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.989+0000 7f0559ffb640 1 -- 172.21.15.152:0/1033921993 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548004e00 con 0x7f055c101420 2024-09-11T22:04:07.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.989+0000 7f0562e36640 1 -- 172.21.15.152:0/1033921993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f055c1a7070 con 0x7f055c101420 2024-09-11T22:04:07.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.991+0000 7f0559ffb640 1 -- 172.21.15.152:0/1033921993 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0548004fa0 con 0x7f055c101420 2024-09-11T22:04:07.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.991+0000 7f056520f740 1 Processor -- start 2024-09-11T22:04:07.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.991+0000 7f0559ffb640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f054c0a2c90 0x7f054c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:07.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.991+0000 7f056520f740 1 -- start start 2024-09-11T22:04:07.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.991+0000 7f05613d3640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f054c0a2c90 0x7f054c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:07.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.991+0000 7f056520f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa11db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:07.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.991+0000 7f056520f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa122f0 0x55c19fa1c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:07.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f0559ffb640 1 -- 172.21.15.152:0/1033921993 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f05480cecb0 con 0x7f055c101420 2024-09-11T22:04:07.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f056520f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 0x55c19fa1efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f056520f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c19f978090 con 0x55c19fa119d0 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f056520f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c19f91fa70 con 0x55c19fa1cbb0 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f056520f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c19f974050 con 0x55c19fa122f0 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f0560bd2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa11db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f0560bd2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa11db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33512/0 (socket says 172.21.15.152:33512) 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f0560bd2640 1 -- 172.21.15.152:0/927160686 learned_addr learned my addr 172.21.15.152:0/927160686 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f05613d3640 1 --2- 172.21.15.152:0/927160686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 0x55c19fa1efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f055bfff640 1 --2- 172.21.15.152:0/927160686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa122f0 0x55c19fa1c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f05613d3640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f054c0a2c90 0x7f054c0a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0554006010 tx=0x7f0554031770 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f055bfff640 1 -- 172.21.15.152:0/927160686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 msgr2=0x55c19fa1efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f055bfff640 1 --2- 172.21.15.152:0/927160686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 0x55c19fa1efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f055bfff640 1 -- 172.21.15.152:0/927160686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 msgr2=0x55c19fa11db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f055bfff640 1 --2- 172.21.15.152:0/927160686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa11db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f055bfff640 1 -- 172.21.15.152:0/927160686 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c19f92c130 con 0x55c19fa122f0 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f0560bd2640 1 --2- 172.21.15.152:0/927160686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa11db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f05613d3640 1 --2- 172.21.15.152:0/927160686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 0x55c19fa1efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.992+0000 7f055bfff640 1 --2- 172.21.15.152:0/927160686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa122f0 0x55c19fa1c670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f05480cc640 tx=0x7f05480976b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dee77b8163206d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f0546ffd640 1 -- 172.21.15.152:0/927160686 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548020070 con 0x55c19fa122f0 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f0546ffd640 1 -- 172.21.15.152:0/927160686 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f054809f740 con 0x55c19fa122f0 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f0546ffd640 1 -- 172.21.15.152:0/927160686 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548097a00 con 0x55c19fa122f0 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f056520f740 1 -- 172.21.15.152:0/927160686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa122f0 msgr2=0x55c19fa1c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f056520f740 1 --2- 172.21.15.152:0/927160686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa122f0 0x55c19fa1c670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f05480cc640 tx=0x7f05480976b0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f056520f740 1 -- 172.21.15.152:0/927160686 shutdown_connections 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f056520f740 1 --2- 172.21.15.152:0/927160686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 0x55c19fa1efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f056520f740 1 --2- 172.21.15.152:0/927160686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa122f0 0x55c19fa1c670 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f056520f740 1 --2- 172.21.15.152:0/927160686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa11db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f056520f740 1 -- 172.21.15.152:0/927160686 >> 172.21.15.152:0/927160686 conn(0x55c19fa0df60 msgr2=0x55c19fa0e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f056520f740 1 -- 172.21.15.152:0/927160686 shutdown_connections 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.993+0000 7f056520f740 1 -- 172.21.15.152:0/927160686 wait complete. 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f056520f740 1 -- start start 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f056520f740 1 Processor -- start 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f056520f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa1c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f056520f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa122f0 0x55c19fa19740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f056520f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa1cbb0 0x55c19fa19c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f056520f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c19fa1f720 con 0x55c19fa119d0 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f056520f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c19f932f20 con 0x55c19fa122f0 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f056520f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c19fa1f8a0 con 0x55c19fa1cbb0 2024-09-11T22:04:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f0560bd2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa1c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f056520f740 10 client.0 _ll_register_callbacks cb 0x55c19f8fc030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f0560bd2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa1c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33524/0 (socket says 172.21.15.152:33524) 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f0560bd2640 1 -- 172.21.15.152:0/2873260329 learned_addr learned my addr 172.21.15.152:0/2873260329 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f05613d3640 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa1cbb0 0x55c19fa19c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.994+0000 7f055bfff640 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa122f0 0x55c19fa19740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f0560bd2640 1 -- 172.21.15.152:0/2873260329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa1cbb0 msgr2=0x55c19fa19c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f0560bd2640 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa1cbb0 0x55c19fa19c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f0560bd2640 1 -- 172.21.15.152:0/2873260329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa122f0 msgr2=0x55c19fa19740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f0560bd2640 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa122f0 0x55c19fa19740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f0560bd2640 1 -- 172.21.15.152:0/2873260329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c19f6e92b0 con 0x55c19fa119d0 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f05613d3640 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa1cbb0 0x55c19fa19c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f0560bd2640 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa1c3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f055000cee0 tx=0x7f05500039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2361918da7b022fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f053bfff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f053bfff640 1 -- 172.21.15.152:0/2873260329 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05500119f0 con 0x55c19fa119d0 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f053bfff640 1 -- 172.21.15.152:0/2873260329 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f0550011b90 con 0x55c19fa119d0 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f056520f740 1 -- 172.21.15.152:0/2873260329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f054809f740 con 0x55c19fa119d0 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f053bfff640 1 -- 172.21.15.152:0/2873260329 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0550011d90 con 0x55c19fa119d0 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f056520f740 10 client.15063 fetch_fsmap learned FSMap version 23 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f056520f740 1 -- 172.21.15.152:0/2873260329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55c19fa2b090 con 0x55c19fa119d0 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f053bfff640 1 -- 172.21.15.152:0/2873260329 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f054809f740 con 0x55c19fa119d0 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f053bfff640 1 -- 172.21.15.152:0/2873260329 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0550018070 con 0x55c19fa119d0 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f056520f740 10 client.15063 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f056520f740 10 client.15063 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f056520f740 20 client.15063 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f056520f740 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c19fa2d6b0 0x55c19fa2eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f056520f740 4 client.15063 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:04:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.995+0000 7f056520f740 1 -- 172.21.15.152:0/2873260329 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c19f985600 con 0x55c19fa2d6b0 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.996+0000 7f055bfff640 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c19fa2d6b0 0x55c19fa2eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.996+0000 7f053bfff640 10 client.15063 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.996+0000 7f055bfff640 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c19fa2d6b0 0x55c19fa2eb20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ec90b99470e4eb2 server_cookie=67f3dea2576cf3b3 in_seq=0 out_seq=0 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f053bfff640 1 -- 172.21.15.152:0/2873260329 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c19f985600 con 0x55c19fa2d6b0 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f053bfff640 10 client.15063 handle_command_reply: tid=0 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 1 client.15063 shutdown 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 1 -- 172.21.15.152:0/2873260329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 msgr2=0x55c19fa1c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa1c3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f055000cee0 tx=0x7f05500039c0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 1 -- 172.21.15.152:0/2873260329 shutdown_connections 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c19fa2d6b0 0x55c19fa2eb20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa1cbb0 0x55c19fa19c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa122f0 0x55c19fa19740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 1 --2- 172.21.15.152:0/2873260329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa119d0 0x55c19fa1c3f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 1 -- 172.21.15.152:0/2873260329 >> 172.21.15.152:0/2873260329 conn(0x55c19fa0df60 msgr2=0x55c19fa13c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:08.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f053bfff640 0 client.15063 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:04:08.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 1 -- 172.21.15.152:0/2873260329 shutdown_connections 2024-09-11T22:04:08.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 1 -- 172.21.15.152:0/2873260329 wait complete. 2024-09-11T22:04:08.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:07.997+0000 7f056520f740 20 client.15063 trim_cache size 0 max 16384 2024-09-11T22:04:08.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.014+0000 7f056520f740 1 Processor -- start 2024-09-11T22:04:08.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.014+0000 7f056520f740 1 -- start start 2024-09-11T22:04:08.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f056520f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa119d0 0x55c19fa2cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:08.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f056520f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa122f0 0x55c19fa2e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:08.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f056520f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 0x55c19fa36e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:08.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f056520f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c19fa2ce60 con 0x55c19fa122f0 2024-09-11T22:04:08.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f056520f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c19fa2d530 con 0x55c19fa1cbb0 2024-09-11T22:04:08.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f056520f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c19fa2dc00 con 0x55c19fa119d0 2024-09-11T22:04:08.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f055bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa122f0 0x55c19fa2e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:08.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f055bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa122f0 0x55c19fa2e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33528/0 (socket says 172.21.15.152:33528) 2024-09-11T22:04:08.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f055bfff640 1 -- 172.21.15.152:0/189405813 learned_addr learned my addr 172.21.15.152:0/189405813 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:08.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f0560bd2640 1 --2- 172.21.15.152:0/189405813 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa119d0 0x55c19fa2cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:08.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f055bfff640 1 -- 172.21.15.152:0/189405813 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa119d0 msgr2=0x55c19fa2cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:08.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f055bfff640 1 --2- 172.21.15.152:0/189405813 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa119d0 0x55c19fa2cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f05613d3640 1 --2- 172.21.15.152:0/189405813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 0x55c19fa36e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:08.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f055bfff640 1 -- 172.21.15.152:0/189405813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 msgr2=0x55c19fa36e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:08.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f055bfff640 1 --2- 172.21.15.152:0/189405813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 0x55c19fa36e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f055bfff640 1 -- 172.21.15.152:0/189405813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c19fa12120 con 0x55c19fa122f0 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f05613d3640 1 --2- 172.21.15.152:0/189405813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 0x55c19fa36e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f055bfff640 1 --2- 172.21.15.152:0/189405813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa122f0 0x55c19fa2e450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f05480b9fd0 tx=0x7f05480ccac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d598a724dbc02f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f05467fc640 1 -- 172.21.15.152:0/189405813 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548020040 con 0x55c19fa122f0 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f05467fc640 1 -- 172.21.15.152:0/189405813 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0548099690 con 0x55c19fa122f0 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.015+0000 7f05467fc640 1 -- 172.21.15.152:0/189405813 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054809a7e0 con 0x55c19fa122f0 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.016+0000 7f056520f740 1 -- 172.21.15.152:0/189405813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa122f0 msgr2=0x55c19fa2e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.016+0000 7f056520f740 1 --2- 172.21.15.152:0/189405813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa122f0 0x55c19fa2e450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f05480b9fd0 tx=0x7f05480ccac0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.016+0000 7f056520f740 1 -- 172.21.15.152:0/189405813 shutdown_connections 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.016+0000 7f056520f740 1 --2- 172.21.15.152:0/189405813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa1cbb0 0x55c19fa36e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.016+0000 7f056520f740 1 --2- 172.21.15.152:0/189405813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa122f0 0x55c19fa2e450 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.016+0000 7f056520f740 1 --2- 172.21.15.152:0/189405813 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa119d0 0x55c19fa2cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.016+0000 7f056520f740 1 -- 172.21.15.152:0/189405813 >> 172.21.15.152:0/189405813 conn(0x55c19fa0df60 msgr2=0x55c19fa18010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:08.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.016+0000 7f056520f740 1 -- 172.21.15.152:0/189405813 shutdown_connections 2024-09-11T22:04:08.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.016+0000 7f056520f740 1 -- 172.21.15.152:0/189405813 wait complete. 2024-09-11T22:04:08.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.016+0000 7f056520f740 1 -- start start 2024-09-11T22:04:08.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.016+0000 7f056520f740 1 Processor -- start 2024-09-11T22:04:08.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f056520f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa119d0 0x55c19fa2fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:08.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f056520f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa122f0 0x55c19fa30090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:08.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f056520f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa1cbb0 0x55c19fa305d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:08.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f056520f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c19fa2e9a0 con 0x55c19fa1cbb0 2024-09-11T22:04:08.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f056520f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c19fa2e2d0 con 0x55c19fa122f0 2024-09-11T22:04:08.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f056520f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c19fa2f070 con 0x55c19fa119d0 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f056520f740 10 client.0 _ll_register_callbacks cb 0x7f055000caf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f05613d3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa1cbb0 0x55c19fa305d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f05613d3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa1cbb0 0x55c19fa305d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33540/0 (socket says 172.21.15.152:33540) 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f05613d3640 1 -- 172.21.15.152:0/3343694995 learned_addr learned my addr 172.21.15.152:0/3343694995 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f055bfff640 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa122f0 0x55c19fa30090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f0560bd2640 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa119d0 0x55c19fa2fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f05613d3640 1 -- 172.21.15.152:0/3343694995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa119d0 msgr2=0x55c19fa2fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f05613d3640 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa119d0 0x55c19fa2fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f05613d3640 1 -- 172.21.15.152:0/3343694995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa122f0 msgr2=0x55c19fa30090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f05613d3640 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa122f0 0x55c19fa30090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f05613d3640 1 -- 172.21.15.152:0/3343694995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c19fa95e30 con 0x55c19fa1cbb0 2024-09-11T22:04:08.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f05613d3640 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa1cbb0 0x55c19fa305d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0554035000 tx=0x7f0554044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1326d34fe75b5a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.017+0000 7f053bfff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f053bfff640 1 -- 172.21.15.152:0/3343694995 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055404a9e0 con 0x55c19fa1cbb0 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f053bfff640 1 -- 172.21.15.152:0/3343694995 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f055404ab80 con 0x55c19fa1cbb0 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f056520f740 1 -- 172.21.15.152:0/3343694995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0548099690 con 0x55c19fa1cbb0 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f053bfff640 1 -- 172.21.15.152:0/3343694995 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0554059070 con 0x55c19fa1cbb0 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f056520f740 10 client.15069 fetch_fsmap learned FSMap version 23 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f056520f740 1 -- 172.21.15.152:0/3343694995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55c19fa970a0 con 0x55c19fa1cbb0 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f053bfff640 1 -- 172.21.15.152:0/3343694995 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0548099690 con 0x55c19fa1cbb0 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f053bfff640 1 -- 172.21.15.152:0/3343694995 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0554030070 con 0x55c19fa1cbb0 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f056520f740 10 client.15069 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f056520f740 10 client.15069 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:04:08.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f056520f740 20 client.15069 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f056520f740 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c19fa9bcc0 0x55c19fa9a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f056520f740 4 client.15069 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f056520f740 1 -- 172.21.15.152:0/3343694995 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "status"}) -- 0x55c19f97fb10 con 0x55c19fa9bcc0 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.018+0000 7f0560bd2640 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c19fa9bcc0 0x55c19fa9a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f053bfff640 10 client.15069 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f0560bd2640 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c19fa9bcc0 0x55c19fa9a9d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=23199239bb38586c server_cookie=5d71d171c1154767 in_seq=0 out_seq=0 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f053bfff640 1 -- 172.21.15.152:0/3343694995 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c19f97fb10 con 0x55c19fa9bcc0 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f053bfff640 10 client.15069 handle_command_reply: tid=0 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 1 client.15069 shutdown 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 1 -- 172.21.15.152:0/3343694995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa1cbb0 msgr2=0x55c19fa305d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa1cbb0 0x55c19fa305d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0554035000 tx=0x7f0554044000 comp rx=0 tx=0).stop 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 1 -- 172.21.15.152:0/3343694995 shutdown_connections 2024-09-11T22:04:08.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c19fa9bcc0 0x55c19fa9a9d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c19fa1cbb0 0x55c19fa305d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f053bfff640 0 client.15069 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:04:08.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c19fa122f0 0x55c19fa30090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 1 --2- 172.21.15.152:0/3343694995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c19fa119d0 0x55c19fa2fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 1 -- 172.21.15.152:0/3343694995 >> 172.21.15.152:0/3343694995 conn(0x55c19fa0df60 msgr2=0x55c19fa17bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:08.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 1 -- 172.21.15.152:0/3343694995 shutdown_connections 2024-09-11T22:04:08.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 1 -- 172.21.15.152:0/3343694995 wait complete. 2024-09-11T22:04:08.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.019+0000 7f056520f740 20 client.15069 trim_cache size 0 max 16384 2024-09-11T22:04:08.027 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "5c140ed8-7088-11ef-bcea-c7b262605968", 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 2, 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 24457, 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 83.190264001000003, 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 23, 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 84, 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 113.998402842 2024-09-11T22:04:08.028 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:04:08.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 -- 172.21.15.152:0/1033921993 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f054c0a2c90 msgr2=0x7f054c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:08.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f054c0a2c90 0x7f054c0a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0554006010 tx=0x7f0554031770 comp rx=0 tx=0).stop 2024-09-11T22:04:08.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 -- 172.21.15.152:0/1033921993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c101420 msgr2=0x7f055c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:08.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c101420 0x7f055c0fd270 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f054800d770 tx=0x7f054800dc30 comp rx=0 tx=0).stop 2024-09-11T22:04:08.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 -- 172.21.15.152:0/1033921993 shutdown_connections 2024-09-11T22:04:08.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f054c0a2c90 0x7f054c0a5150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f055c106a80 0x7f055c0fd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c101420 0x7f055c0fd270 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 --2- 172.21.15.152:0/1033921993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f055c100a80 0x7f055c0fcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:08.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 -- 172.21.15.152:0/1033921993 >> 172.21.15.152:0/1033921993 conn(0x7f055c0fc7a0 msgr2=0x7f055c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:08.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 -- 172.21.15.152:0/1033921993 shutdown_connections 2024-09-11T22:04:08.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:08.020+0000 7f0562e36640 1 -- 172.21.15.152:0/1033921993 wait complete. 2024-09-11T22:04:08.662 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:08 smithi152 ceph-mon[31188]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:04:08.688 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T22:04:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:08 smithi179 ceph-mon[35603]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:04:08.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:08 smithi193 ceph-mon[35545]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:04:08.934 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:09.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.379+0000 7f850669d640 1 -- 172.21.15.152:0/670362049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8500102d40 msgr2=0x7f8500103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:09.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.379+0000 7f850669d640 1 --2- 172.21.15.152:0/670362049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8500102d40 0x7f8500103120 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009900 tx=0x7f84f002a480 comp rx=0 tx=0).stop 2024-09-11T22:04:09.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.379+0000 7f850669d640 1 -- 172.21.15.152:0/670362049 shutdown_connections 2024-09-11T22:04:09.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.379+0000 7f850669d640 1 --2- 172.21.15.152:0/670362049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f850010c170 0x7f850010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.379+0000 7f850669d640 1 --2- 172.21.15.152:0/670362049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8500103660 0x7f850010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.379+0000 7f850669d640 1 --2- 172.21.15.152:0/670362049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8500102d40 0x7f8500103120 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.379+0000 7f850669d640 1 -- 172.21.15.152:0/670362049 >> 172.21.15.152:0/670362049 conn(0x7f85000fc7a0 msgr2=0x7f85000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:09.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.379+0000 7f850669d640 1 -- 172.21.15.152:0/670362049 shutdown_connections 2024-09-11T22:04:09.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.379+0000 7f850669d640 1 -- 172.21.15.152:0/670362049 wait complete. 2024-09-11T22:04:09.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f850669d640 1 Processor -- start 2024-09-11T22:04:09.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f850669d640 1 -- start start 2024-09-11T22:04:09.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f850669d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8500102d40 0x7f85001983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f850669d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8500103660 0x7f85001988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f850669d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f850010c170 0x7f850019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f850669d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8500111f70 con 0x7f850010c170 2024-09-11T22:04:09.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f850669d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8500111df0 con 0x7f8500102d40 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f850669d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f85001120f0 con 0x7f8500103660 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f8504c3a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f850010c170 0x7f850019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f84ff7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8500103660 0x7f85001988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f8504c3a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f850010c170 0x7f850019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33560/0 (socket says 172.21.15.152:33560) 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.380+0000 7f8504c3a640 1 -- 172.21.15.152:0/3769159546 learned_addr learned my addr 172.21.15.152:0/3769159546 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f84fffff640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8500102d40 0x7f85001983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f8504c3a640 1 -- 172.21.15.152:0/3769159546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8500103660 msgr2=0x7f85001988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f8504c3a640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8500103660 0x7f85001988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f8504c3a640 1 -- 172.21.15.152:0/3769159546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8500102d40 msgr2=0x7f85001983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f8504c3a640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8500102d40 0x7f85001983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f8504c3a640 1 -- 172.21.15.152:0/3769159546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850019d350 con 0x7f850010c170 2024-09-11T22:04:09.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f8504c3a640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f850010c170 0x7f850019cc70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f84f800cce0 tx=0x7f84f800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f84fd7fa640 1 -- 172.21.15.152:0/3769159546 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f800f450 con 0x7f850010c170 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f84fd7fa640 1 -- 172.21.15.152:0/3769159546 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84f800fad0 con 0x7f850010c170 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f84fd7fa640 1 -- 172.21.15.152:0/3769159546 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8018c10 con 0x7f850010c170 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f850669d640 1 -- 172.21.15.152:0/3769159546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850019d640 con 0x7f850010c170 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.381+0000 7f850669d640 1 -- 172.21.15.152:0/3769159546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85001a4f20 con 0x7f850010c170 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.383+0000 7f84fd7fa640 1 -- 172.21.15.152:0/3769159546 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f84f800f5f0 con 0x7f850010c170 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f8508a76740 1 Processor -- start 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f8508a76740 1 -- start start 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f8508a76740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67c890 0x55ec5f67cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f8508a76740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67d1b0 0x55ec5f68ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f8508a76740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f68bfc0 0x55ec5f68e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f8508a76740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f5e3090 con 0x55ec5f67c890 2024-09-11T22:04:09.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f8508a76740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f58aa70 con 0x55ec5f68bfc0 2024-09-11T22:04:09.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f8508a76740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f5df050 con 0x55ec5f67d1b0 2024-09-11T22:04:09.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67c890 0x55ec5f67cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84fd7fa640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f84ec0a2c10 0x7f84ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67c890 0x55ec5f67cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33568/0 (socket says 172.21.15.152:33568) 2024-09-11T22:04:09.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84ff7fe640 1 -- 172.21.15.152:0/1530792745 learned_addr learned my addr 172.21.15.152:0/1530792745 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:09.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/1530792745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f68bfc0 0x55ec5f68e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f8504c3a640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f84ec0a2c10 0x7f84ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84fffff640 1 --2- 172.21.15.152:0/1530792745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67d1b0 0x55ec5f68ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84ff7fe640 1 -- 172.21.15.152:0/1530792745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67d1b0 msgr2=0x55ec5f68ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:09.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/1530792745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67d1b0 0x55ec5f68ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84ff7fe640 1 -- 172.21.15.152:0/1530792745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f68bfc0 msgr2=0x55ec5f68e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/1530792745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f68bfc0 0x55ec5f68e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84ff7fe640 1 -- 172.21.15.152:0/1530792745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec5f597130 con 0x55ec5f67c890 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.384+0000 7f84fd7fa640 1 -- 172.21.15.152:0/3769159546 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f84f80cf870 con 0x7f850010c170 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.385+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/1530792745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67c890 0x55ec5f67cc70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f84e80125b0 tx=0x7f84e800b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83f0d9b86334ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.385+0000 7f8504c3a640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f84ec0a2c10 0x7f84ec0a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84f80a4690 tx=0x7f84f806f010 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.385+0000 7f84f67fc640 1 -- 172.21.15.152:0/1530792745 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8004030 con 0x55ec5f67c890 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.385+0000 7f84f67fc640 1 -- 172.21.15.152:0/1530792745 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84e80041d0 con 0x55ec5f67c890 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.385+0000 7f84f67fc640 1 -- 172.21.15.152:0/1530792745 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e80106c0 con 0x55ec5f67c890 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.385+0000 7f8508a76740 1 -- 172.21.15.152:0/1530792745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67c890 msgr2=0x55ec5f67cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.385+0000 7f8508a76740 1 --2- 172.21.15.152:0/1530792745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67c890 0x55ec5f67cc70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f84e80125b0 tx=0x7f84e800b830 comp rx=0 tx=0).stop 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 -- 172.21.15.152:0/1530792745 shutdown_connections 2024-09-11T22:04:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 --2- 172.21.15.152:0/1530792745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f68bfc0 0x55ec5f68e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 --2- 172.21.15.152:0/1530792745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67d1b0 0x55ec5f68ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 --2- 172.21.15.152:0/1530792745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67c890 0x55ec5f67cc70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 -- 172.21.15.152:0/1530792745 >> 172.21.15.152:0/1530792745 conn(0x55ec5f678f60 msgr2=0x55ec5f679340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 -- 172.21.15.152:0/1530792745 shutdown_connections 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 -- 172.21.15.152:0/1530792745 wait complete. 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 -- start start 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 Processor -- start 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f67c890 0x55ec5f68b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f688c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f68bfc0 0x55ec5f689150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f68eb90 con 0x55ec5f67d1b0 2024-09-11T22:04:09.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f59df20 con 0x55ec5f67c890 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f68ed10 con 0x55ec5f68bfc0 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.386+0000 7f8508a76740 10 client.0 _ll_register_callbacks cb 0x55ec5f567030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84fffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f688c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84fffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f688c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33578/0 (socket says 172.21.15.152:33578) 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84fffff640 1 -- 172.21.15.152:0/70283655 learned_addr learned my addr 172.21.15.152:0/70283655 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f67c890 0x55ec5f68b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f68bfc0 0x55ec5f689150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84fffff640 1 -- 172.21.15.152:0/70283655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f68bfc0 msgr2=0x55ec5f689150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84fffff640 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f68bfc0 0x55ec5f689150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84fffff640 1 -- 172.21.15.152:0/70283655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f67c890 msgr2=0x55ec5f68b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84fffff640 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f67c890 0x55ec5f68b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84fffff640 1 -- 172.21.15.152:0/70283655 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec5f3542b0 con 0x55ec5f67d1b0 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f68bfc0 0x55ec5f689150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84fffff640 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f688c10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f84f0031550 tx=0x7f84f0031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78df46cd31c7643 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84df7fe640 1 -- 172.21.15.152:0/70283655 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0035070 con 0x55ec5f67d1b0 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84df7fe640 1 -- 172.21.15.152:0/70283655 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f84f0004240 con 0x55ec5f67d1b0 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f8508a76740 1 -- 172.21.15.152:0/70283655 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84e80041d0 con 0x55ec5f67d1b0 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f84df7fe640 1 -- 172.21.15.152:0/70283655 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f84f004a070 con 0x55ec5f67d1b0 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f8508a76740 10 client.15081 fetch_fsmap learned FSMap version 23 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.387+0000 7f8508a76740 1 -- 172.21.15.152:0/70283655 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55ec5f69a540 con 0x55ec5f67d1b0 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.388+0000 7f84df7fe640 1 -- 172.21.15.152:0/70283655 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84e80041d0 con 0x55ec5f67d1b0 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.388+0000 7f84df7fe640 1 -- 172.21.15.152:0/70283655 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f84f00049b0 con 0x55ec5f67d1b0 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.388+0000 7f8508a76740 10 client.15081 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:04:09.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.388+0000 7f8508a76740 10 client.15081 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:04:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.388+0000 7f8508a76740 20 client.15081 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.388+0000 7f8508a76740 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ec5f69cb60 0x55ec5f69dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.388+0000 7f8508a76740 4 client.15081 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:04:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.388+0000 7f8508a76740 1 -- 172.21.15.152:0/70283655 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec5f5f0600 con 0x55ec5f69cb60 2024-09-11T22:04:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.388+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ec5f69cb60 0x55ec5f69dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.389+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ec5f69cb60 0x55ec5f69dfd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32124c9dd67fb655 server_cookie=367e65e06eac0f97 in_seq=0 out_seq=0 2024-09-11T22:04:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.389+0000 7f84df7fe640 10 client.15081 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:04:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f84df7fe640 1 -- 172.21.15.152:0/70283655 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec5f5f0600 con 0x55ec5f69cb60 2024-09-11T22:04:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f84df7fe640 10 client.15081 handle_command_reply: tid=0 2024-09-11T22:04:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 1 client.15081 shutdown 2024-09-11T22:04:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 1 -- 172.21.15.152:0/70283655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 msgr2=0x55ec5f688c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f688c10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f84f0031550 tx=0x7f84f0031860 comp rx=0 tx=0).stop 2024-09-11T22:04:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 1 -- 172.21.15.152:0/70283655 shutdown_connections 2024-09-11T22:04:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ec5f69cb60 0x55ec5f69dfd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f68bfc0 0x55ec5f689150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f688c10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 1 --2- 172.21.15.152:0/70283655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f67c890 0x55ec5f68b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 1 -- 172.21.15.152:0/70283655 >> 172.21.15.152:0/70283655 conn(0x55ec5f678f60 msgr2=0x55ec5f67ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f84df7fe640 0 client.15081 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:04:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 1 -- 172.21.15.152:0/70283655 shutdown_connections 2024-09-11T22:04:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 1 -- 172.21.15.152:0/70283655 wait complete. 2024-09-11T22:04:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.390+0000 7f8508a76740 20 client.15081 trim_cache size 0 max 16384 2024-09-11T22:04:09.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f8508a76740 1 Processor -- start 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f8508a76740 1 -- start start 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f8508a76740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f67c890 0x55ec5f69d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f8508a76740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67d1b0 0x55ec5f685e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f8508a76740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f68bfc0 0x55ec5f6863d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f8508a76740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f69c310 con 0x55ec5f68bfc0 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f8508a76740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f69c9e0 con 0x55ec5f67c890 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f8508a76740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f69d0b0 con 0x55ec5f67d1b0 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f84ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f68bfc0 0x55ec5f6863d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f84ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f68bfc0 0x55ec5f6863d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33590/0 (socket says 172.21.15.152:33590) 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f84ff7fe640 1 -- 172.21.15.152:0/483755779 learned_addr learned my addr 172.21.15.152:0/483755779 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f84fffff640 1 --2- 172.21.15.152:0/483755779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67d1b0 0x55ec5f685e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f84ff7fe640 1 -- 172.21.15.152:0/483755779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67d1b0 msgr2=0x55ec5f685e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/483755779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67d1b0 0x55ec5f685e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f84ff7fe640 1 -- 172.21.15.152:0/483755779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f67c890 msgr2=0x55ec5f69d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/483755779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f67c890 0x55ec5f69d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f84ff7fe640 1 -- 172.21.15.152:0/483755779 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec5f69dc30 con 0x55ec5f68bfc0 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.408+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/483755779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f68bfc0 0x55ec5f6863d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f84e8012f00 tx=0x7f84e8005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3bf16a89ddfb02 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f84f5ffb640 1 -- 172.21.15.152:0/483755779 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8027040 con 0x55ec5f68bfc0 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f84f5ffb640 1 -- 172.21.15.152:0/483755779 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84e800bd10 con 0x55ec5f68bfc0 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f84f5ffb640 1 -- 172.21.15.152:0/483755779 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e801e8b0 con 0x55ec5f68bfc0 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f8508a76740 1 -- 172.21.15.152:0/483755779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f68bfc0 msgr2=0x55ec5f6863d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f8508a76740 1 --2- 172.21.15.152:0/483755779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f68bfc0 0x55ec5f6863d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f84e8012f00 tx=0x7f84e8005ca0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f8508a76740 1 -- 172.21.15.152:0/483755779 shutdown_connections 2024-09-11T22:04:09.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f8508a76740 1 --2- 172.21.15.152:0/483755779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f68bfc0 0x55ec5f6863d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f8508a76740 1 --2- 172.21.15.152:0/483755779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67d1b0 0x55ec5f685e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f8508a76740 1 --2- 172.21.15.152:0/483755779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f67c890 0x55ec5f69d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f8508a76740 1 -- 172.21.15.152:0/483755779 >> 172.21.15.152:0/483755779 conn(0x55ec5f678f60 msgr2=0x55ec5f687d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f8508a76740 1 -- 172.21.15.152:0/483755779 shutdown_connections 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.409+0000 7f8508a76740 1 -- 172.21.15.152:0/483755779 wait complete. 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f8508a76740 1 -- start start 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f8508a76740 1 Processor -- start 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f8508a76740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67c890 0x55ec5f685240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f8508a76740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f685780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f8508a76740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f68bfc0 0x55ec5f6a5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f8508a76740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f69de50 con 0x55ec5f67d1b0 2024-09-11T22:04:09.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f8508a76740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f69d780 con 0x55ec5f68bfc0 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f8508a76740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ec5f69e520 con 0x55ec5f67c890 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f84fffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f685780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f8508a76740 10 client.0 _ll_register_callbacks cb 0x7f84f0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f84fffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f685780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33594/0 (socket says 172.21.15.152:33594) 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.410+0000 7f84fffff640 1 -- 172.21.15.152:0/1639385679 learned_addr learned my addr 172.21.15.152:0/1639385679 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67c890 0x55ec5f685240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84fffff640 1 -- 172.21.15.152:0/1639385679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67c890 msgr2=0x55ec5f685240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84fffff640 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67c890 0x55ec5f685240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84fffff640 1 -- 172.21.15.152:0/1639385679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f68bfc0 msgr2=0x55ec5f6a5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84fffff640 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f68bfc0 0x55ec5f6a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84fffff640 1 -- 172.21.15.152:0/1639385679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec5f686070 con 0x55ec5f67d1b0 2024-09-11T22:04:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84fffff640 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f685780 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f84f0004f70 tx=0x7f84f0005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71413c2d9ea86a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84df7fe640 1 -- 172.21.15.152:0/1639385679 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0035070 con 0x55ec5f67d1b0 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84df7fe640 1 -- 172.21.15.152:0/1639385679 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f84f00046c0 con 0x55ec5f67d1b0 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f8508a76740 1 -- 172.21.15.152:0/1639385679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84e800bd10 con 0x55ec5f67d1b0 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84df7fe640 1 -- 172.21.15.152:0/1639385679 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f84f00048c0 con 0x55ec5f67d1b0 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f8508a76740 10 client.15087 fetch_fsmap learned FSMap version 23 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f8508a76740 1 -- 172.21.15.152:0/1639385679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55ec5f6a6890 con 0x55ec5f67d1b0 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.411+0000 7f84df7fe640 1 -- 172.21.15.152:0/1639385679 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84e800bd10 con 0x55ec5f67d1b0 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.412+0000 7f84df7fe640 1 -- 172.21.15.152:0/1639385679 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f84f004f750 con 0x55ec5f67d1b0 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.412+0000 7f8508a76740 10 client.15087 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.412+0000 7f8508a76740 10 client.15087 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:04:09.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.412+0000 7f8508a76740 20 client.15087 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.412+0000 7f8508a76740 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ec5f70b530 0x55ec5f70a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.412+0000 7f8508a76740 4 client.15087 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.412+0000 7f8508a76740 1 -- 172.21.15.152:0/1639385679 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "status"}) -- 0x55ec5f5eab10 con 0x55ec5f70b530 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.412+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ec5f70b530 0x55ec5f70a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.412+0000 7f84df7fe640 10 client.15087 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.412+0000 7f84ff7fe640 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ec5f70b530 0x55ec5f70a240 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fdcbab4a958abb26 server_cookie=4a35bfa3749b627b in_seq=0 out_seq=0 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f84df7fe640 1 -- 172.21.15.152:0/1639385679 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ec5f5eab10 con 0x55ec5f70b530 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f84df7fe640 10 client.15087 handle_command_reply: tid=0 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 1 client.15087 shutdown 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 1 -- 172.21.15.152:0/1639385679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 msgr2=0x55ec5f685780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f685780 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f84f0004f70 tx=0x7f84f0005dc0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 1 -- 172.21.15.152:0/1639385679 shutdown_connections 2024-09-11T22:04:09.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ec5f70b530 0x55ec5f70a240 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec5f68bfc0 0x55ec5f6a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ec5f67d1b0 0x55ec5f685780 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f84df7fe640 0 client.15087 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:04:09.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 1 --2- 172.21.15.152:0/1639385679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ec5f67c890 0x55ec5f685240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 1 -- 172.21.15.152:0/1639385679 >> 172.21.15.152:0/1639385679 conn(0x55ec5f678f60 msgr2=0x55ec5f683a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:09.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 1 -- 172.21.15.152:0/1639385679 shutdown_connections 2024-09-11T22:04:09.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 1 -- 172.21.15.152:0/1639385679 wait complete. 2024-09-11T22:04:09.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.413+0000 7f8508a76740 20 client.15087 trim_cache size 0 max 16384 2024-09-11T22:04:09.422 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:04:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "5c140ed8-7088-11ef-bcea-c7b262605968", 2024-09-11T22:04:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 1, 2024-09-11T22:04:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 24470, 2024-09-11T22:04:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-09-11T22:04:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-09-11T22:04:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-09-11T22:04:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 85.589022178999997, 2024-09-11T22:04:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 23, 2024-09-11T22:04:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 84, 2024-09-11T22:04:09.423 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T22:04:09.423 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 102.564207405 2024-09-11T22:04:09.423 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:04:09.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 -- 172.21.15.152:0/3769159546 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f84ec0a2c10 msgr2=0x7f84ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:09.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f84ec0a2c10 0x7f84ec0a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84f80a4690 tx=0x7f84f806f010 comp rx=0 tx=0).stop 2024-09-11T22:04:09.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 -- 172.21.15.152:0/3769159546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f850010c170 msgr2=0x7f850019cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:09.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f850010c170 0x7f850019cc70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f84f800cce0 tx=0x7f84f800a620 comp rx=0 tx=0).stop 2024-09-11T22:04:09.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 -- 172.21.15.152:0/3769159546 shutdown_connections 2024-09-11T22:04:09.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f850010c170 0x7f850019cc70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f84ec0a2c10 0x7f84ec0a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8500103660 0x7f85001988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 --2- 172.21.15.152:0/3769159546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8500102d40 0x7f85001983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:09.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 -- 172.21.15.152:0/3769159546 >> 172.21.15.152:0/3769159546 conn(0x7f85000fc7a0 msgr2=0x7f85000fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:09.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 -- 172.21.15.152:0/3769159546 shutdown_connections 2024-09-11T22:04:09.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:09.414+0000 7f850669d640 1 -- 172.21.15.152:0/3769159546 wait complete. 2024-09-11T22:04:10.113 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T22:04:10.361 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:10.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.794+0000 7f9378eda640 1 -- 172.21.15.152:0/477989765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93741082a0 msgr2=0x7f937410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.794+0000 7f9378eda640 1 --2- 172.21.15.152:0/477989765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93741082a0 0x7f937410ec40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f936c009cd0 tx=0x7f936c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.794+0000 7f9378eda640 1 -- 172.21.15.152:0/477989765 shutdown_connections 2024-09-11T22:04:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.794+0000 7f9378eda640 1 --2- 172.21.15.152:0/477989765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93741082a0 0x7f937410ec40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.794+0000 7f9378eda640 1 --2- 172.21.15.152:0/477989765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93741036e0 0x7f9374107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.794+0000 7f9378eda640 1 --2- 172.21.15.152:0/477989765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9374102d30 0x7f9374103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.794+0000 7f9378eda640 1 -- 172.21.15.152:0/477989765 >> 172.21.15.152:0/477989765 conn(0x7f93740fc7d0 msgr2=0x7f93740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.794+0000 7f9378eda640 1 -- 172.21.15.152:0/477989765 shutdown_connections 2024-09-11T22:04:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.794+0000 7f9378eda640 1 -- 172.21.15.152:0/477989765 wait complete. 2024-09-11T22:04:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.794+0000 7f9378eda640 1 Processor -- start 2024-09-11T22:04:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.794+0000 7f9378eda640 1 -- start start 2024-09-11T22:04:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9378eda640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9374102d30 0x7f9374198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9378eda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93741036e0 0x7f9374198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9378eda640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93741082a0 0x7f937419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9378eda640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f93741120a0 con 0x7f93741082a0 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9378eda640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9374111f20 con 0x7f93741036e0 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9378eda640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9374112220 con 0x7f9374102d30 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9372d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93741082a0 0x7f937419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9372d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93741082a0 0x7f937419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33604/0 (socket says 172.21.15.152:33604) 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9372d9d640 1 -- 172.21.15.152:0/1311525401 learned_addr learned my addr 172.21.15.152:0/1311525401 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f937259c640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9374102d30 0x7f9374198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9371d9b640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93741036e0 0x7f9374198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9372d9d640 1 -- 172.21.15.152:0/1311525401 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9374102d30 msgr2=0x7f9374198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9372d9d640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9374102d30 0x7f9374198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9372d9d640 1 -- 172.21.15.152:0/1311525401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93741036e0 msgr2=0x7f9374198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:10.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9372d9d640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93741036e0 0x7f9374198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9372d9d640 1 -- 172.21.15.152:0/1311525401 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937419d4e0 con 0x7f93741082a0 2024-09-11T22:04:10.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f9372d9d640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93741082a0 0x7f937419ce00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f936c006010 tx=0x7f936c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:10.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.795+0000 7f93637fe640 1 -- 172.21.15.152:0/1311525401 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c004450 con 0x7f93741082a0 2024-09-11T22:04:10.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.796+0000 7f9378eda640 1 -- 172.21.15.152:0/1311525401 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f937419d770 con 0x7f93741082a0 2024-09-11T22:04:10.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.796+0000 7f93637fe640 1 -- 172.21.15.152:0/1311525401 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f936c003e10 con 0x7f93741082a0 2024-09-11T22:04:10.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.796+0000 7f93637fe640 1 -- 172.21.15.152:0/1311525401 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c0466e0 con 0x7f93741082a0 2024-09-11T22:04:10.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.796+0000 7f9378eda640 1 -- 172.21.15.152:0/1311525401 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93741a50b0 con 0x7f93741082a0 2024-09-11T22:04:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.798+0000 7f93637fe640 1 -- 172.21.15.152:0/1311525401 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f936c0305a0 con 0x7f93741082a0 2024-09-11T22:04:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.798+0000 7f937b2b3740 1 Processor -- start 2024-09-11T22:04:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.798+0000 7f937b2b3740 1 -- start start 2024-09-11T22:04:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.798+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59dc9d0 0x5591a59dcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.798+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dd2f0 0x5591a59e7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.798+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f937b2b3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5591a5943090 con 0x5591a59e7bb0 2024-09-11T22:04:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f937b2b3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5591a58eaa70 con 0x5591a59dd2f0 2024-09-11T22:04:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f937b2b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5591a593f050 con 0x5591a59dc9d0 2024-09-11T22:04:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f93637fe640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f935c0a2c10 0x7f935c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9371d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9371d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33612/0 (socket says 172.21.15.152:33612) 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9371d9b640 1 -- 172.21.15.152:0/2760081854 learned_addr learned my addr 172.21.15.152:0/2760081854 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9372d9d640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f935c0a2c10 0x7f935c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9371d9b640 1 --2- 172.21.15.152:0/2760081854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59dc9d0 0x5591a59dcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f937259c640 1 --2- 172.21.15.152:0/2760081854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dd2f0 0x5591a59e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f93637fe640 1 -- 172.21.15.152:0/1311525401 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f936c02e030 con 0x7f93741082a0 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9371d9b640 1 -- 172.21.15.152:0/2760081854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59dc9d0 msgr2=0x5591a59dcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9371d9b640 1 --2- 172.21.15.152:0/2760081854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59dc9d0 0x5591a59dcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9371d9b640 1 -- 172.21.15.152:0/2760081854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dd2f0 msgr2=0x5591a59e7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9371d9b640 1 --2- 172.21.15.152:0/2760081854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dd2f0 0x5591a59e7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9371d9b640 1 -- 172.21.15.152:0/2760081854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a58f7130 con 0x5591a59e7bb0 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9372d9d640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f935c0a2c10 0x7f935c0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f936c0b9700 tx=0x7f936c08c220 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9371d9b640 1 --2- 172.21.15.152:0/2760081854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e9fa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9368013890 tx=0x7f936800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5db31b63bd29dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.799+0000 7f9360ff9640 1 -- 172.21.15.152:0/2760081854 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368004020 con 0x5591a59e7bb0 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.800+0000 7f9360ff9640 1 -- 172.21.15.152:0/2760081854 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9368005500 con 0x5591a59e7bb0 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.800+0000 7f9360ff9640 1 -- 172.21.15.152:0/2760081854 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368004a90 con 0x5591a59e7bb0 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.800+0000 7f937b2b3740 1 -- 172.21.15.152:0/2760081854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 msgr2=0x5591a59e9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.800+0000 7f937b2b3740 1 --2- 172.21.15.152:0/2760081854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e9fa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9368013890 tx=0x7f936800ef90 comp rx=0 tx=0).stop 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.800+0000 7f937b2b3740 1 -- 172.21.15.152:0/2760081854 shutdown_connections 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.800+0000 7f937b2b3740 1 --2- 172.21.15.152:0/2760081854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e9fa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.800+0000 7f937b2b3740 1 --2- 172.21.15.152:0/2760081854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dd2f0 0x5591a59e7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.800+0000 7f937b2b3740 1 --2- 172.21.15.152:0/2760081854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59dc9d0 0x5591a59dcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.800+0000 7f937b2b3740 1 -- 172.21.15.152:0/2760081854 >> 172.21.15.152:0/2760081854 conn(0x5591a59d8f60 msgr2=0x5591a59d9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.800+0000 7f937b2b3740 1 -- 172.21.15.152:0/2760081854 shutdown_connections 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.800+0000 7f937b2b3740 1 -- 172.21.15.152:0/2760081854 wait complete. 2024-09-11T22:04:10.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937b2b3740 1 -- start start 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937b2b3740 1 Processor -- start 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dc9d0 0x5591a59e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dd2f0 0x5591a59e4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59e7bb0 0x5591a59e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937b2b3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5591a59ea780 con 0x5591a59dd2f0 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937b2b3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5591a58fdf20 con 0x5591a59dc9d0 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937b2b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5591a59ea900 con 0x5591a59e7bb0 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937b2b3740 10 client.0 _ll_register_callbacks cb 0x5591a58c7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dd2f0 0x5591a59e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dd2f0 0x5591a59e4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33626/0 (socket says 172.21.15.152:33626) 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937259c640 1 -- 172.21.15.152:0/520238292 learned_addr learned my addr 172.21.15.152:0/520238292 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937259c640 1 -- 172.21.15.152:0/520238292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59e7bb0 msgr2=0x5591a59e4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f9371d9b640 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59e7bb0 0x5591a59e4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937259c640 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59e7bb0 0x5591a59e4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937259c640 1 -- 172.21.15.152:0/520238292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dc9d0 msgr2=0x5591a59e74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937259c640 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dc9d0 0x5591a59e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f937259c640 1 -- 172.21.15.152:0/520238292 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a56b42b0 con 0x5591a59dd2f0 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.801+0000 7f9371d9b640 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59e7bb0 0x5591a59e4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f937259c640 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dd2f0 0x5591a59e4800 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9364010820 tx=0x7f9364010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc8e357fe6914cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f9359ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f9359ffb640 1 -- 172.21.15.152:0/520238292 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936400fb90 con 0x5591a59dd2f0 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f9359ffb640 1 -- 172.21.15.152:0/520238292 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f936400fd30 con 0x5591a59dd2f0 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f937b2b3740 1 -- 172.21.15.152:0/520238292 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9368005500 con 0x5591a59dd2f0 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f9359ffb640 1 -- 172.21.15.152:0/520238292 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9364005020 con 0x5591a59dd2f0 2024-09-11T22:04:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f937b2b3740 10 client.15099 fetch_fsmap learned FSMap version 23 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f937b2b3740 1 -- 172.21.15.152:0/520238292 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5591a59f6150 con 0x5591a59dd2f0 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f9359ffb640 1 -- 172.21.15.152:0/520238292 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9368005500 con 0x5591a59dd2f0 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f9359ffb640 1 -- 172.21.15.152:0/520238292 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f9364019410 con 0x5591a59dd2f0 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f937b2b3740 10 client.15099 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f937b2b3740 10 client.15099 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f937b2b3740 20 client.15099 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f937b2b3740 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591a59f8840 0x5591a59f9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f937b2b3740 4 client.15099 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.802+0000 7f937b2b3740 1 -- 172.21.15.152:0/520238292 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591a5950600 con 0x5591a59f8840 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.803+0000 7f9371d9b640 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591a59f8840 0x5591a59f9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.803+0000 7f9371d9b640 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591a59f8840 0x5591a59f9cb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf63f5c099a9f05d server_cookie=37bff331d6ef9ef0 in_seq=0 out_seq=0 2024-09-11T22:04:10.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.803+0000 7f9359ffb640 10 client.15099 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:10.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f9359ffb640 1 -- 172.21.15.152:0/520238292 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591a5950600 con 0x5591a59f8840 2024-09-11T22:04:10.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f9359ffb640 10 client.15099 handle_command_reply: tid=0 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 1 client.15099 shutdown 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 1 -- 172.21.15.152:0/520238292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dd2f0 msgr2=0x5591a59e4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dd2f0 0x5591a59e4800 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9364010820 tx=0x7f9364010ce0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 1 -- 172.21.15.152:0/520238292 shutdown_connections 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591a59f8840 0x5591a59f9cb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f9359ffb640 0 client.15099 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59e7bb0 0x5591a59e4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dd2f0 0x5591a59e4800 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 1 --2- 172.21.15.152:0/520238292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dc9d0 0x5591a59e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 1 -- 172.21.15.152:0/520238292 >> 172.21.15.152:0/520238292 conn(0x5591a59d8f60 msgr2=0x5591a59dec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 1 -- 172.21.15.152:0/520238292 shutdown_connections 2024-09-11T22:04:10.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 1 -- 172.21.15.152:0/520238292 wait complete. 2024-09-11T22:04:10.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.804+0000 7f937b2b3740 20 client.15099 trim_cache size 0 max 16384 2024-09-11T22:04:10.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f937b2b3740 1 Processor -- start 2024-09-11T22:04:10.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f937b2b3740 1 -- start start 2024-09-11T22:04:10.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dc9d0 0x5591a59f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59dd2f0 0x5591a59e6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f937b2b3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5591a59f7ff0 con 0x5591a59e7bb0 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f937b2b3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5591a59f86c0 con 0x5591a59dc9d0 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f937b2b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5591a59f8d90 con 0x5591a59dd2f0 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f9371d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f9371d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33642/0 (socket says 172.21.15.152:33642) 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f9371d9b640 1 -- 172.21.15.152:0/1431038579 learned_addr learned my addr 172.21.15.152:0/1431038579 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f9371d9b640 1 -- 172.21.15.152:0/1431038579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59dd2f0 msgr2=0x5591a59e6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f9371d9b640 1 --2- 172.21.15.152:0/1431038579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59dd2f0 0x5591a59e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f9371d9b640 1 -- 172.21.15.152:0/1431038579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dc9d0 msgr2=0x5591a59f95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f9371d9b640 1 --2- 172.21.15.152:0/1431038579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dc9d0 0x5591a59f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f9371d9b640 1 -- 172.21.15.152:0/1431038579 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a59d8a00 con 0x5591a59e7bb0 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.822+0000 7f9371d9b640 1 --2- 172.21.15.152:0/1431038579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e1a60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f93680045a0 tx=0x7f93680045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88478d9882264eea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f935bfff640 1 -- 172.21.15.152:0/1431038579 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368013500 con 0x5591a59e7bb0 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f935bfff640 1 -- 172.21.15.152:0/1431038579 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9368005500 con 0x5591a59e7bb0 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f935bfff640 1 -- 172.21.15.152:0/1431038579 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936800b8f0 con 0x5591a59e7bb0 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f937b2b3740 1 -- 172.21.15.152:0/1431038579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 msgr2=0x5591a59e1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f937b2b3740 1 --2- 172.21.15.152:0/1431038579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e1a60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f93680045a0 tx=0x7f93680045d0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f937b2b3740 1 -- 172.21.15.152:0/1431038579 shutdown_connections 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f937b2b3740 1 --2- 172.21.15.152:0/1431038579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59e7bb0 0x5591a59e1a60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f937b2b3740 1 --2- 172.21.15.152:0/1431038579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59dd2f0 0x5591a59e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f937b2b3740 1 --2- 172.21.15.152:0/1431038579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dc9d0 0x5591a59f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f937b2b3740 1 -- 172.21.15.152:0/1431038579 >> 172.21.15.152:0/1431038579 conn(0x5591a59d8f60 msgr2=0x5591a59e5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f937b2b3740 1 -- 172.21.15.152:0/1431038579 shutdown_connections 2024-09-11T22:04:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.823+0000 7f937b2b3740 1 -- 172.21.15.152:0/1431038579 wait complete. 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f937b2b3740 1 -- start start 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f937b2b3740 1 Processor -- start 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dc9d0 0x5591a5a02230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dd2f0 0x5591a5a02770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f937b2b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59e7bb0 0x5591a59fd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f937b2b3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5591a59f9b30 con 0x5591a59dc9d0 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f937b2b3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5591a59f9460 con 0x5591a59dd2f0 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f937b2b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5591a59fa200 con 0x5591a59e7bb0 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f937b2b3740 10 client.0 _ll_register_callbacks cb 0x7f936400a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f9371d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dc9d0 0x5591a5a02230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f9371d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dc9d0 0x5591a5a02230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33648/0 (socket says 172.21.15.152:33648) 2024-09-11T22:04:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f9371d9b640 1 -- 172.21.15.152:0/102234975 learned_addr learned my addr 172.21.15.152:0/102234975 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f9371d9b640 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59e7bb0 0x5591a59fd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f9371d9b640 1 -- 172.21.15.152:0/102234975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59e7bb0 msgr2=0x5591a59fd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f9371d9b640 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59e7bb0 0x5591a59fd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f9371d9b640 1 -- 172.21.15.152:0/102234975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dd2f0 msgr2=0x5591a5a02770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f937259c640 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dd2f0 0x5591a5a02770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f9371d9b640 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dd2f0 0x5591a5a02770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f9371d9b640 1 -- 172.21.15.152:0/102234975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a59fde20 con 0x5591a59dc9d0 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f9371d9b640 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dc9d0 0x5591a5a02230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9368013890 tx=0x7f9368004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac08ea8f4a9db7fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.824+0000 7f9359ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f9359ffb640 1 -- 172.21.15.152:0/102234975 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368005260 con 0x5591a59dc9d0 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f9359ffb640 1 -- 172.21.15.152:0/102234975 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f9368004660 con 0x5591a59dc9d0 2024-09-11T22:04:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f937b2b3740 1 -- 172.21.15.152:0/102234975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9368005500 con 0x5591a59dc9d0 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f9359ffb640 1 -- 172.21.15.152:0/102234975 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9368004a70 con 0x5591a59dc9d0 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f937b2b3740 10 client.15105 fetch_fsmap learned FSMap version 23 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f937b2b3740 1 -- 172.21.15.152:0/102234975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5591a5a62ab0 con 0x5591a59dc9d0 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f9359ffb640 1 -- 172.21.15.152:0/102234975 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9368005500 con 0x5591a59dc9d0 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f9359ffb640 1 -- 172.21.15.152:0/102234975 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f936801d040 con 0x5591a59dc9d0 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f937b2b3740 10 client.15105 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f937b2b3740 10 client.15105 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f937b2b3740 20 client.15105 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f937b2b3740 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591a59f8840 0x5591a5a65c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f937b2b3740 4 client.15105 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.825+0000 7f937b2b3740 1 -- 172.21.15.152:0/102234975 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "status"}) -- 0x5591a594ab10 con 0x5591a59f8840 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f937259c640 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591a59f8840 0x5591a5a65c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f9359ffb640 10 client.15105 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f937259c640 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591a59f8840 0x5591a5a65c30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6408b2595e2b83 server_cookie=7779e8216b0800fb in_seq=0 out_seq=0 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f9359ffb640 1 -- 172.21.15.152:0/102234975 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5591a594ab10 con 0x5591a59f8840 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f9359ffb640 10 client.15105 handle_command_reply: tid=0 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f937b2b3740 1 client.15105 shutdown 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f937b2b3740 1 -- 172.21.15.152:0/102234975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dc9d0 msgr2=0x5591a5a02230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f937b2b3740 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dc9d0 0x5591a5a02230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9368013890 tx=0x7f9368004e10 comp rx=0 tx=0).stop 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f937b2b3740 1 -- 172.21.15.152:0/102234975 shutdown_connections 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f937b2b3740 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591a59f8840 0x5591a5a65c30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f937b2b3740 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591a59e7bb0 0x5591a59fd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f937b2b3740 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591a59dd2f0 0x5591a5a02770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f937b2b3740 1 --2- 172.21.15.152:0/102234975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591a59dc9d0 0x5591a5a02230 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.826+0000 7f937b2b3740 1 -- 172.21.15.152:0/102234975 >> 172.21.15.152:0/102234975 conn(0x5591a59d8f60 msgr2=0x5591a59e48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9359ffb640 0 client.15105 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:10.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f937b2b3740 1 -- 172.21.15.152:0/102234975 shutdown_connections 2024-09-11T22:04:10.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f937b2b3740 1 -- 172.21.15.152:0/102234975 wait complete. 2024-09-11T22:04:10.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f937b2b3740 20 client.15105 trim_cache size 0 max 16384 2024-09-11T22:04:10.836 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:04:10.836 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "5c140ed8-7088-11ef-bcea-c7b262605968", 2024-09-11T22:04:10.836 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 0, 2024-09-11T22:04:10.836 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 24472, 2024-09-11T22:04:10.836 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-09-11T22:04:10.836 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-09-11T22:04:10.837 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-09-11T22:04:10.837 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 93.740417437999994, 2024-09-11T22:04:10.837 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 23, 2024-09-11T22:04:10.837 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 84, 2024-09-11T22:04:10.837 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T22:04:10.837 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 112.029581776 2024-09-11T22:04:10.837 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:04:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 -- 172.21.15.152:0/1311525401 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f935c0a2c10 msgr2=0x7f935c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f935c0a2c10 0x7f935c0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f936c0b9700 tx=0x7f936c08c220 comp rx=0 tx=0).stop 2024-09-11T22:04:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 -- 172.21.15.152:0/1311525401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93741082a0 msgr2=0x7f937419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93741082a0 0x7f937419ce00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f936c006010 tx=0x7f936c003c20 comp rx=0 tx=0).stop 2024-09-11T22:04:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 -- 172.21.15.152:0/1311525401 shutdown_connections 2024-09-11T22:04:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93741082a0 0x7f937419ce00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93741036e0 0x7f9374198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f935c0a2c10 0x7f935c0a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 --2- 172.21.15.152:0/1311525401 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9374102d30 0x7f9374198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:10.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 -- 172.21.15.152:0/1311525401 >> 172.21.15.152:0/1311525401 conn(0x7f93740fc7d0 msgr2=0x7f9374105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:10.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 -- 172.21.15.152:0/1311525401 shutdown_connections 2024-09-11T22:04:10.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:10.827+0000 7f9378eda640 1 -- 172.21.15.152:0/1311525401 wait complete. 2024-09-11T22:04:11.469 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:11 smithi152 ceph-mon[31188]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:04:11.496 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T22:04:11.509 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T22:04:11.509 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T22:04:11.509 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T22:04:11.510 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-11T22:04:11.510 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T22:04:11.511 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T22:04:11.511 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-11T22:04:11.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.611+0000 7f781cc47640 1 -- 172.21.15.152:0/3738977356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7818104f90 msgr2=0x7f7818107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:11.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.611+0000 7f781cc47640 1 --2- 172.21.15.152:0/3738977356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7818104f90 0x7f7818107380 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f780c009900 tx=0x7f780c02a410 comp rx=0 tx=0).stop 2024-09-11T22:04:11.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.611+0000 7f781cc47640 1 -- 172.21.15.152:0/3738977356 shutdown_connections 2024-09-11T22:04:11.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.611+0000 7f781cc47640 1 --2- 172.21.15.152:0/3738977356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78181078c0 0x7f7818109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:11.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.611+0000 7f781cc47640 1 --2- 172.21.15.152:0/3738977356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7818104f90 0x7f7818107380 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:11.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.611+0000 7f781cc47640 1 --2- 172.21.15.152:0/3738977356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7818102660 0x7f7818104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:11.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.611+0000 7f781cc47640 1 -- 172.21.15.152:0/3738977356 >> 172.21.15.152:0/3738977356 conn(0x7f78180fc1e0 msgr2=0x7f78180fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:11.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.611+0000 7f781cc47640 1 -- 172.21.15.152:0/3738977356 shutdown_connections 2024-09-11T22:04:11.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.611+0000 7f781cc47640 1 -- 172.21.15.152:0/3738977356 wait complete. 2024-09-11T22:04:11.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.611+0000 7f781cc47640 1 Processor -- start 2024-09-11T22:04:11.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781cc47640 1 -- start start 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781cc47640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7818102660 0x7f7818197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781cc47640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7818104f90 0x7f7818198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781cc47640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78181078c0 0x7f781819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781cc47640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f781810d830 con 0x7f7818102660 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781cc47640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f781810d6b0 con 0x7f7818104f90 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781cc47640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f781810d9b0 con 0x7f78181078c0 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7818102660 0x7f7818197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7818102660 0x7f7818197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33654/0 (socket says 172.21.15.152:33654) 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781659c640 1 -- 172.21.15.152:0/3207261442 learned_addr learned my addr 172.21.15.152:0/3207261442 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f7815d9b640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7818104f90 0x7f7818198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f7816d9d640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78181078c0 0x7f781819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781659c640 1 -- 172.21.15.152:0/3207261442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78181078c0 msgr2=0x7f781819f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:11.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781659c640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78181078c0 0x7f781819f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:11.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781659c640 1 -- 172.21.15.152:0/3207261442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7818104f90 msgr2=0x7f7818198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:11.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781659c640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7818104f90 0x7f7818198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:11.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781659c640 1 -- 172.21.15.152:0/3207261442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781819fa50 con 0x7f7818102660 2024-09-11T22:04:11.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f7815d9b640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7818104f90 0x7f7818198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:11.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781659c640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7818102660 0x7f7818197e30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f780800b4a0 tx=0x7f780800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:11.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f78077fe640 1 -- 172.21.15.152:0/3207261442 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808014070 con 0x7f7818102660 2024-09-11T22:04:11.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781cc47640 1 -- 172.21.15.152:0/3207261442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781819fd40 con 0x7f7818102660 2024-09-11T22:04:11.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f78077fe640 1 -- 172.21.15.152:0/3207261442 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7808010af0 con 0x7f7818102660 2024-09-11T22:04:11.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f78077fe640 1 -- 172.21.15.152:0/3207261442 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808017d10 con 0x7f7818102660 2024-09-11T22:04:11.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.612+0000 7f781cc47640 1 -- 172.21.15.152:0/3207261442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78181a0270 con 0x7f7818102660 2024-09-11T22:04:11.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.613+0000 7f781cc47640 1 -- 172.21.15.152:0/3207261442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78180fdcd0 con 0x7f7818102660 2024-09-11T22:04:11.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.614+0000 7f78077fe640 1 -- 172.21.15.152:0/3207261442 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7808017070 con 0x7f7818102660 2024-09-11T22:04:11.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.615+0000 7f78077fe640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f78000a2cd0 0x7f78000a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:11.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.615+0000 7f78077fe640 1 -- 172.21.15.152:0/3207261442 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f78080ce500 con 0x7f7818102660 2024-09-11T22:04:11.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.615+0000 7f7815d9b640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f78000a2cd0 0x7f78000a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:11.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.616+0000 7f7815d9b640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f78000a2cd0 0x7f78000a5190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f780c006010 tx=0x7f780c000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:11.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.619+0000 7f78077fe640 1 -- 172.21.15.152:0/3207261442 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f780809b3f0 con 0x7f7818102660 2024-09-11T22:04:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:11 smithi179 ceph-mon[35603]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:04:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:11 smithi193 ceph-mon[35545]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:04:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:11.831+0000 7f781cc47640 1 -- 172.21.15.152:0/3207261442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f7818062e90 con 0x7f7818102660 2024-09-11T22:04:12.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.356+0000 7f78077fe640 1 -- 172.21.15.152:0/3207261442 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7f780809acf0 con 0x7f7818102660 2024-09-11T22:04:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.358+0000 7f781cc47640 1 -- 172.21.15.152:0/3207261442 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f78000a2cd0 msgr2=0x7f78000a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.358+0000 7f781cc47640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f78000a2cd0 0x7f78000a5190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f780c006010 tx=0x7f780c000bc0 comp rx=0 tx=0).stop 2024-09-11T22:04:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.358+0000 7f781cc47640 1 -- 172.21.15.152:0/3207261442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7818102660 msgr2=0x7f7818197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.358+0000 7f781cc47640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7818102660 0x7f7818197e30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f780800b4a0 tx=0x7f780800b960 comp rx=0 tx=0).stop 2024-09-11T22:04:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.358+0000 7f781cc47640 1 -- 172.21.15.152:0/3207261442 shutdown_connections 2024-09-11T22:04:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.358+0000 7f781cc47640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f78000a2cd0 0x7f78000a5190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.358+0000 7f781cc47640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78181078c0 0x7f781819f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.358+0000 7f781cc47640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7818104f90 0x7f7818198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.358+0000 7f781cc47640 1 --2- 172.21.15.152:0/3207261442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7818102660 0x7f7818197e30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.358+0000 7f781cc47640 1 -- 172.21.15.152:0/3207261442 >> 172.21.15.152:0/3207261442 conn(0x7f78180fc1e0 msgr2=0x7f7818103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:12.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.359+0000 7f781cc47640 1 -- 172.21.15.152:0/3207261442 shutdown_connections 2024-09-11T22:04:12.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:12.359+0000 7f781cc47640 1 -- 172.21.15.152:0/3207261442 wait complete. 2024-09-11T22:04:12.376 INFO:teuthology.run_tasks:Running task kclient... 2024-09-11T22:04:12.406 INFO:tasks.kclient:Mounting kernel clients... 2024-09-11T22:04:12.406 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-11T22:04:12.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:04:12.406 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-09-11T22:04:12.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:04:12.424 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-09-11T22:04:12.491 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2024-09-11T22:04:12.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:04:12.493 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-09-11T22:04:12.493 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T22:04:12.493 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-11T22:04:12.494 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-11T22:04:12.494 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T22:04:12.713 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:12 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3207261442' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-11T22:04:12.714 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: ignoring --setuser ceph since I am not root 2024-09-11T22:04:12.714 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: ignoring --setgroup ceph since I am not root 2024-09-11T22:04:12.714 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:12 smithi193 ceph-mgr[37361]: -- 172.21.15.193:0/1405504830 <== mon.0 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5600307f50e0 con 0x5600307d2800 2024-09-11T22:04:12.714 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:12.510+0000 7f8397fa6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:04:12.714 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:12.566+0000 7f8397fa6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:04:12.714 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:12.712+0000 7f8397fa6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:04:12.716 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:12 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3207261442' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-11T22:04:12.716 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:12 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: ignoring --setuser ceph since I am not root 2024-09-11T22:04:12.716 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:12 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: ignoring --setgroup ceph since I am not root 2024-09-11T22:04:12.716 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:12 smithi179 ceph-mgr[36976]: -- 172.21.15.179:0/2835591694 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5591990290e0 con 0x559199007000 2024-09-11T22:04:12.716 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:12 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:12.510+0000 7f6122ed2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:04:12.716 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:12 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:12.567+0000 7f6122ed2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:04:12.717 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:12 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:12.715+0000 7f6122ed2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:04:12.726 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:12 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3207261442' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-11T22:04:12.727 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:12 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: ignoring --setuser ceph since I am not root 2024-09-11T22:04:12.727 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:12 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: ignoring --setgroup ceph since I am not root 2024-09-11T22:04:12.727 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:12 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:12.513+0000 7f7a72b7a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:04:12.727 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:12 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:12.573+0000 7f7a72b7a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:04:12.727 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:12 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:12.725+0000 7f7a72b7a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:04:12.790 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:12.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:12 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:12.803+0000 7f7a72b7a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:04:12.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:12 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:12.954+0000 7f7a72b7a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:04:13.046 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:12 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:12.781+0000 7f6122ed2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:04:13.046 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:12 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:12.928+0000 7f6122ed2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:04:13.065 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:12.778+0000 7f8397fa6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:04:13.065 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:12.923+0000 7f8397fa6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:04:13.065 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:13 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:13.064+0000 7f8397fa6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:04:13.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.305+0000 7f35c780b640 1 -- 172.21.15.152:0/1449744800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35c0102570 msgr2=0x7f35c01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:13.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.305+0000 7f35c780b640 1 --2- 172.21.15.152:0/1449744800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35c0102570 0x7f35c01029b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009900 tx=0x7f35b002a480 comp rx=0 tx=0).stop 2024-09-11T22:04:13.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.305+0000 7f35c780b640 1 -- 172.21.15.152:0/1449744800 shutdown_connections 2024-09-11T22:04:13.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.305+0000 7f35c780b640 1 --2- 172.21.15.152:0/1449744800 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35c0102ef0 0x7f35c010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:13.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.305+0000 7f35c780b640 1 --2- 172.21.15.152:0/1449744800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35c0102570 0x7f35c01029b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:13.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.305+0000 7f35c780b640 1 --2- 172.21.15.152:0/1449744800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c0100e20 0x7f35c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.305+0000 7f35c780b640 1 -- 172.21.15.152:0/1449744800 >> 172.21.15.152:0/1449744800 conn(0x7f35c00fc7d0 msgr2=0x7f35c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.306+0000 7f35c780b640 1 -- 172.21.15.152:0/1449744800 shutdown_connections 2024-09-11T22:04:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.306+0000 7f35c780b640 1 -- 172.21.15.152:0/1449744800 wait complete. 2024-09-11T22:04:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.306+0000 7f35c780b640 1 Processor -- start 2024-09-11T22:04:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.306+0000 7f35c780b640 1 -- start start 2024-09-11T22:04:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c780b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c0100e20 0x7f35c01973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c780b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35c0102570 0x7f35c0197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c780b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35c0102ef0 0x7f35c019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c780b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f35c0110f80 con 0x7f35c0102570 2024-09-11T22:04:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c780b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f35c0110e00 con 0x7f35c0100e20 2024-09-11T22:04:13.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c780b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f35c0111100 con 0x7f35c0102ef0 2024-09-11T22:04:13.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c55a7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c0100e20 0x7f35c01973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:13.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c4da6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35c0102570 0x7f35c0197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:13.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c4da6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35c0102570 0x7f35c0197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33670/0 (socket says 172.21.15.152:33670) 2024-09-11T22:04:13.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c4da6640 1 -- 172.21.15.152:0/122727023 learned_addr learned my addr 172.21.15.152:0/122727023 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:13.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c5da8640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35c0102ef0 0x7f35c019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:13.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c55a7640 1 -- 172.21.15.152:0/122727023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35c0102ef0 msgr2=0x7f35c019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:13.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c55a7640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35c0102ef0 0x7f35c019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:13.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c55a7640 1 -- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35c0102570 msgr2=0x7f35c0197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:13.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c55a7640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35c0102570 0x7f35c0197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:13.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c55a7640 1 -- 172.21.15.152:0/122727023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c019c390 con 0x7f35c0100e20 2024-09-11T22:04:13.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c4da6640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35c0102570 0x7f35c0197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:13.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.307+0000 7f35c55a7640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c0100e20 0x7f35c01973e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00e9f0 tx=0x7f35bc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:13.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.308+0000 7f35b67fc640 1 -- 172.21.15.152:0/122727023 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc00ccc0 con 0x7f35c0100e20 2024-09-11T22:04:13.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.308+0000 7f35c780b640 1 -- 172.21.15.152:0/122727023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c019c680 con 0x7f35c0100e20 2024-09-11T22:04:13.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.308+0000 7f35b67fc640 1 -- 172.21.15.152:0/122727023 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35bc010910 con 0x7f35c0100e20 2024-09-11T22:04:13.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.308+0000 7f35b67fc640 1 -- 172.21.15.152:0/122727023 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc018960 con 0x7f35c0100e20 2024-09-11T22:04:13.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.308+0000 7f35c780b640 1 -- 172.21.15.152:0/122727023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c01a3f60 con 0x7f35c0100e20 2024-09-11T22:04:13.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.309+0000 7f35c780b640 1 -- 172.21.15.152:0/122727023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c0101200 con 0x7f35c0100e20 2024-09-11T22:04:13.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.310+0000 7f35b67fc640 1 -- 172.21.15.152:0/122727023 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 18) ==== 137902+0+0 (secure 0 0 0) 0x7f35bc010ac0 con 0x7f35c0100e20 2024-09-11T22:04:13.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.310+0000 7f35b67fc640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f35ac0a2c60 0x7f35ac0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:13.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.310+0000 7f35c4da6640 1 -- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f35ac0a2c60 msgr2=0x7f35ac0a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3828412393 2024-09-11T22:04:13.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.310+0000 7f35b67fc640 1 -- 172.21.15.152:0/122727023 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f35bc0cf5e0 con 0x7f35c0100e20 2024-09-11T22:04:13.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.310+0000 7f35c4da6640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f35ac0a2c60 0x7f35ac0a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:04:13.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.314+0000 7f35b67fc640 1 -- 172.21.15.152:0/122727023 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35bc09bd70 con 0x7f35c0100e20 2024-09-11T22:04:13.358 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:13 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:13.070+0000 7f6122ed2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:04:13.358 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:13 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:13.098+0000 7f7a72b7a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:04:13.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.511+0000 7f35c4da6640 1 -- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f35ac0a2c60 msgr2=0x7f35ac0a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3828412393 2024-09-11T22:04:13.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.511+0000 7f35c4da6640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f35ac0a2c60 0x7f35ac0a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:04:13.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.525+0000 7f35c780b640 1 -- 172.21.15.152:0/122727023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f35c0198740 con 0x7f35c0100e20 2024-09-11T22:04:13.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.526+0000 7f35b67fc640 1 -- 172.21.15.152:0/122727023 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7f35bc0a0070 con 0x7f35c0100e20 2024-09-11T22:04:13.527 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:04:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 -- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f35ac0a2c60 msgr2=0x7f35ac0a5120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:04:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f35ac0a2c60 0x7f35ac0a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 -- 172.21.15.152:0/122727023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c0100e20 msgr2=0x7f35c01973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c0100e20 0x7f35c01973e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00e9f0 tx=0x7f35bc00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:04:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 -- 172.21.15.152:0/122727023 shutdown_connections 2024-09-11T22:04:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:6800/3828412393,v1:172.21.15.152:6801/3828412393] conn(0x7f35ac0a2c60 0x7f35ac0a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35c0102ef0 0x7f35c019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35c0102570 0x7f35c0197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 --2- 172.21.15.152:0/122727023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c0100e20 0x7f35c01973e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 -- 172.21.15.152:0/122727023 >> 172.21.15.152:0/122727023 conn(0x7f35c00fc7d0 msgr2=0x7f35c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 -- 172.21.15.152:0/122727023 shutdown_connections 2024-09-11T22:04:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:13.528+0000 7f35c780b640 1 -- 172.21.15.152:0/122727023 wait complete. 2024-09-11T22:04:13.618 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:13 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3207261442' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T22:04:13.618 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:13 smithi193 ceph-mon[35545]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-11T22:04:13.618 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:13 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:13.375+0000 7f8397fa6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:04:13.618 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:13 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:13.435+0000 7f8397fa6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:04:13.625 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:13 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3207261442' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T22:04:13.626 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:13 smithi179 ceph-mon[35603]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-11T22:04:13.626 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:13 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:13.381+0000 7f6122ed2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:04:13.626 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:13 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:13.441+0000 7f6122ed2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:04:13.626 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:13 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:13.624+0000 7f6122ed2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:04:13.687 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:13 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3207261442' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T22:04:13.688 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:13 smithi152 ceph-mon[31188]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-11T22:04:13.688 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:13 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:13.429+0000 7f7a72b7a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:04:13.688 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:13 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:13.492+0000 7f7a72b7a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:04:13.688 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:13 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:13.687+0000 7f7a72b7a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:04:14.076 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:13 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:13.617+0000 7f8397fa6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:04:14.163 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T22:04:14.163 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:04:14.164 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-09-11T22:04:14.164 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:04:14.164 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-11T22:04:14.164 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T22:04:14.164 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T22:04:14.164 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:04:14.164 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-11T22:04:14.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:04:14.164 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-09-11T22:04:14.180 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:04:14.180 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:04:14.180 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:04:14.180 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:04:14.180 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-09-11T22:04:14.180 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T22:04:14.181 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42194sec preferred_lft 42194sec 2024-09-11T22:04:14.182 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link noprefixroute 2024-09-11T22:04:14.182 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:04:14.182 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T22:04:14.182 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:04:14.182 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-11T22:04:14.182 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2024-09-11T22:04:14.182 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2024-09-11T22:04:14.183 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2024-09-11T22:04:14.183 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T22:04:14.183 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-11T22:04:14.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:04:14.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:04:14.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:04:14.386 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:04:14.411 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-09-11T22:04:14.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:04:14.412 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-09-11T22:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-09-11T22:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T22:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T22:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:04:14.498 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:04:14.499 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-11T22:04:14.499 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T22:04:14.499 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T22:04:14.499 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T22:04:14.499 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-11T22:04:14.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:04:14.595 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:14 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/122727023' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:04:14.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:14 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/122727023' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:04:14.797 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:14 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:14.505+0000 7f6122ed2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:04:14.797 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:14 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:14.572+0000 7f6122ed2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:04:14.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:14 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/122727023' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:04:14.826 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:14 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:14.492+0000 7f8397fa6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:04:14.826 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:14 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:14.558+0000 7f8397fa6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:04:14.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:04:14.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:04:14.835 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-09-11T22:04:14.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:04:14.851 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2024-09-11T22:04:14.907 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:04:14.907 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-11T22:04:14.907 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-11T22:04:14.907 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-11T22:04:14.908 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-11T22:04:14.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:14.615+0000 7f7a72b7a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:04:14.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:14.685+0000 7f7a72b7a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:04:14.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:04:15.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:04:15.028 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-11T22:04:15.028 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:04:15.028 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-11T22:04:15.028 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-11T22:04:15.028 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T22:04:15.028 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-11T22:04:15.028 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-11T22:04:15.028 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-11T22:04:15.029 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-11T22:04:15.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:04:15.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:04:15.209 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:04:15.209 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-11T22:04:15.209 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2024-09-11T22:04:15.210 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T22:04:15.210 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-11T22:04:15.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:04:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:04:15.289 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:04:15.289 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /tmp/cephfs 2024-09-11T22:04:15.305 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-11T22:04:15.305 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:04:15.305 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /tmp/cephfs 2024-09-11T22:04:15.361 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-11T22:04:15.361 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-11T22:04:15.362 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/0374fba9-eccf-4301-9e16-9053a3555c98 2024-09-11T22:04:15.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:04:15.362 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/0374fba9-eccf-4301-9e16-9053a3555c98 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2024-09-11T22:04:15.461 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-09-11T22:04:15.461 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-11T22:04:15.521 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:15 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:15.261+0000 7f8397fa6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:04:15.521 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:15 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:15.376+0000 7f8397fa6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:04:15.528 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:15 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:15.446+0000 7f7a72b7a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:04:15.534 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:15 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:15.276+0000 7f6122ed2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:04:15.535 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:15 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:15.390+0000 7f6122ed2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:04:15.585 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-09-11T22:04:15.585 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-11T22:04:15.585 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.179:3300,172.21.15.193:3300" 2024-09-11T22:04:15.585 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with new device syntax: 0@5c140ed8-7088-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/0374fba9-eccf-4301-9e16-9053a3555c98 2024-09-11T22:04:15.585 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.152:3300/172.21.15.179:3300/172.21.15.193:3300" will pass to kernel 2024-09-11T22:04:15.588 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:04:15.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:04:15.588 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /tmp/cephfs 2024-09-11T22:04:15.796 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:15 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:15.533+0000 7f6122ed2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:04:15.796 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:15 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:15.596+0000 7f6122ed2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:04:15.796 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:15 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:15.745+0000 7f6122ed2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:04:15.798 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:15 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:15.519+0000 7f8397fa6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:04:15.798 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:15 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:15.580+0000 7f8397fa6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:04:15.798 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:15 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:15.729+0000 7f8397fa6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:04:15.798 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:15 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:15.796+0000 7f8397fa6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:04:15.926 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:15 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:15.569+0000 7f7a72b7a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:04:15.926 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:15 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:15.715+0000 7f7a72b7a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:04:15.926 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:15 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:15.776+0000 7f7a72b7a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:04:15.926 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:15 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:15.925+0000 7f7a72b7a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:04:16.076 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:15 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:15.856+0000 7f8397fa6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:04:16.076 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:16 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:16.016+0000 7f8397fa6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:04:16.099 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:15 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:15.813+0000 7f6122ed2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:04:16.099 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:15 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:15.873+0000 7f6122ed2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:04:16.099 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:16 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:16.032+0000 7f6122ed2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:04:16.100 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:16 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:16.097+0000 7f6122ed2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:04:16.214 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:15 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:15.993+0000 7f7a72b7a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:04:16.215 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:16.054+0000 7f7a72b7a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:04:16.215 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:16.213+0000 7f7a72b7a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:04:16.348 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:16 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:16.081+0000 7f8397fa6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:04:16.348 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:16 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:16.147+0000 7f8397fa6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:04:16.348 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:16 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:16.228+0000 7f8397fa6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:04:16.348 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:16 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:16.286+0000 7f8397fa6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:04:16.348 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:16 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:16.346+0000 7f8397fa6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:04:16.363 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:16 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:16.163+0000 7f6122ed2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:04:16.363 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:16 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:16.245+0000 7f6122ed2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:04:16.363 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:16 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:16.303+0000 7f6122ed2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:04:16.363 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:16 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:16.361+0000 7f6122ed2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:04:16.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:16.279+0000 7f7a72b7a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:04:16.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:16.346+0000 7f7a72b7a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:04:16.480 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:16.428+0000 7f7a72b7a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:04:16.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:16.488+0000 7f7a72b7a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:04:16.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:16.546+0000 7f7a72b7a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:04:17.375 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:04:17.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:04:17.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:04:17.451 INFO:teuthology.orchestra.run.smithi152.stdout:client15138 2024-09-11T22:04:17.451 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T22:04:17.451 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:04:17.478 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:04:17.486 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:17.344+0000 7f7a72b7a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:04:17.487 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: Standby manager daemon z restarted 2024-09-11T22:04:17.487 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: Standby manager daemon z started 2024-09-11T22:04:17.487 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:04:17.487 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:04:17.487 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:04:17.487 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:04:17.487 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: Standby manager daemon y restarted 2024-09-11T22:04:17.487 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: Standby manager daemon y started 2024-09-11T22:04:17.487 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:04:17.488 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:04:17.488 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:04:17.488 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-mon[31188]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:04:17.547 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y[36972]: 2024-09-11T22:04:17.146+0000 7f6122ed2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:04:17.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: Standby manager daemon z restarted 2024-09-11T22:04:17.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: Standby manager daemon z started 2024-09-11T22:04:17.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:04:17.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:04:17.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:04:17.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:04:17.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: Standby manager daemon y restarted 2024-09-11T22:04:17.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: Standby manager daemon y started 2024-09-11T22:04:17.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:04:17.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:04:17.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:04:17.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:17 smithi179 ceph-mon[35603]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:04:17.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:04:17.575 INFO:teuthology.orchestra.run.smithi152.stdout:client15138 2024-09-11T22:04:17.576 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:04:17.576 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z[37357]: 2024-09-11T22:04:17.133+0000 7f8397fa6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:04:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: Standby manager daemon z restarted 2024-09-11T22:04:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: Standby manager daemon z started 2024-09-11T22:04:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:04:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:04:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:04:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.193:0/779047327' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:04:17.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: Standby manager daemon y restarted 2024-09-11T22:04:17.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: Standby manager daemon y started 2024-09-11T22:04:17.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:04:17.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:04:17.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:04:17.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:17 smithi193 ceph-mon[35545]: from='mgr.? 172.21.15.179:0/53253588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:04:17.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:04:17.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:04:17.698 INFO:teuthology.orchestra.run.smithi152.stdout:client15138 2024-09-11T22:04:17.698 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5c140ed8-7088-11ef-bcea-c7b262605968.client15138/status') 2024-09-11T22:04:17.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:04:17.776 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.15138 (3)192.168.0.1:0/742991014 2024-09-11T22:04:17.776 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2024-09-11T22:04:17.776 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2024-09-11T22:04:17.777 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2024-09-11T22:04:17.777 INFO:teuthology.orchestra.run.smithi152.stderr:69 bytes copied, 2.9513e-05 s, 2.3 MB/s 2024-09-11T22:04:17.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:04:17.784 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T22:04:18.380 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T22:04:18.380 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T22:04:18.380 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-11T22:04:18.381 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:17.646+0000 7f79dd452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:18.381 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:17.646+0000 7f79dd452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:18.382 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:17.646+0000 7f79dd452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:18.382 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:17.646+0000 7f79dd452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:18.382 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:17.646+0000 7f79dd452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:18.382 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:17.647+0000 7f79da44c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:18.382 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:17.647+0000 7f79da44c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:18.382 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:17.647+0000 7f79da44c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:18.382 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:17.647+0000 7f79da44c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:18.382 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:17.647+0000 7f79da44c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:18.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-11T22:04:18.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: Active manager daemon x restarted 2024-09-11T22:04:18.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: Activating manager daemon x 2024-09-11T22:04:18.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T22:04:18.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: mgrmap e20: x(active, starting, since 0.0128587s), standbys: y, z 2024-09-11T22:04:18.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:04:18.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:04:18.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:04:18.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:04:18.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:04:18.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:04:18.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:04:18.482 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:04:18.483 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:04:18.483 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:04:18.483 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:04:18.483 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:04:18.483 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:04:18.483 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:04:18.483 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:04:18.483 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:04:18.483 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:04:18.483 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:04:18.484 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:04:18.484 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:04:18.484 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:04:18.484 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:04:18.484 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: Manager daemon x is now available 2024-09-11T22:04:18.484 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:18.484 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:04:18.484 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:18 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:04:18.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.485+0000 7f009d96f640 1 -- 172.21.15.152:0/854848716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0098103710 msgr2=0x7f0098109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:18.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.485+0000 7f009d96f640 1 --2- 172.21.15.152:0/854848716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0098103710 0x7f0098109fa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0090009ca0 tx=0x7f009002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:04:18.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.485+0000 7f009d96f640 1 -- 172.21.15.152:0/854848716 shutdown_connections 2024-09-11T22:04:18.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.485+0000 7f009d96f640 1 --2- 172.21.15.152:0/854848716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0098103710 0x7f0098109fa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:18.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.485+0000 7f009d96f640 1 --2- 172.21.15.152:0/854848716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0098102d50 0x7f00981031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:18.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.485+0000 7f009d96f640 1 --2- 172.21.15.152:0/854848716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0098101b60 0x7f0098101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:18.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.485+0000 7f009d96f640 1 -- 172.21.15.152:0/854848716 >> 172.21.15.152:0/854848716 conn(0x7f00980fd2e0 msgr2=0x7f00980ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:18.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.485+0000 7f009d96f640 1 -- 172.21.15.152:0/854848716 shutdown_connections 2024-09-11T22:04:18.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.485+0000 7f009d96f640 1 -- 172.21.15.152:0/854848716 wait complete. 2024-09-11T22:04:18.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f009d96f640 1 Processor -- start 2024-09-11T22:04:18.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f009d96f640 1 -- start start 2024-09-11T22:04:18.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f009d96f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0098101b60 0x7f0098197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:18.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f009d96f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0098102d50 0x7f00981982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:18.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f009d96f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0098103710 0x7f009819f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:18.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f009d96f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f009810d7e0 con 0x7f0098101b60 2024-09-11T22:04:18.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f009d96f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f009810d660 con 0x7f0098103710 2024-09-11T22:04:18.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f009d96f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f009810d960 con 0x7f0098102d50 2024-09-11T22:04:18.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f0096ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0098101b60 0x7f0098197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f0096ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0098101b60 0x7f0098197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52322/0 (socket says 172.21.15.152:52322) 2024-09-11T22:04:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f00967fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0098102d50 0x7f00981982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f0096ffd640 1 -- 172.21.15.152:0/4182350083 learned_addr learned my addr 172.21.15.152:0/4182350083 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.486+0000 7f00977fe640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0098103710 0x7f009819f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f0096ffd640 1 -- 172.21.15.152:0/4182350083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0098102d50 msgr2=0x7f00981982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f0096ffd640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0098102d50 0x7f00981982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f0096ffd640 1 -- 172.21.15.152:0/4182350083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0098103710 msgr2=0x7f009819f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f0096ffd640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0098103710 0x7f009819f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f0096ffd640 1 -- 172.21.15.152:0/4182350083 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009819f9d0 con 0x7f0098101b60 2024-09-11T22:04:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f00977fe640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0098103710 0x7f009819f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f00967fc640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0098102d50 0x7f00981982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f0096ffd640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0098101b60 0x7f0098197db0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f008800e9c0 tx=0x7f008800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f009c96d640 1 -- 172.21.15.152:0/4182350083 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008800cd80 con 0x7f0098101b60 2024-09-11T22:04:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f009c96d640 1 -- 172.21.15.152:0/4182350083 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00880035f0 con 0x7f0098101b60 2024-09-11T22:04:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f009d96f640 1 -- 172.21.15.152:0/4182350083 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f009819fcc0 con 0x7f0098101b60 2024-09-11T22:04:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f009c96d640 1 -- 172.21.15.152:0/4182350083 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088010690 con 0x7f0098101b60 2024-09-11T22:04:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.487+0000 7f009d96f640 1 -- 172.21.15.152:0/4182350083 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00981a01c0 con 0x7f0098101b60 2024-09-11T22:04:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.488+0000 7f009d96f640 1 -- 172.21.15.152:0/4182350083 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0098108e80 con 0x7f0098101b60 2024-09-11T22:04:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.489+0000 7f009c96d640 1 -- 172.21.15.152:0/4182350083 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f00880037a0 con 0x7f0098101b60 2024-09-11T22:04:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.490+0000 7f009c96d640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00800a2ac0 0x7f00800a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.490+0000 7f00967fc640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00800a2ac0 0x7f00800a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.490+0000 7f009c96d640 1 -- 172.21.15.152:0/4182350083 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f00880cf140 con 0x7f0098101b60 2024-09-11T22:04:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.491+0000 7f00967fc640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00800a2ac0 0x7f00800a4f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f00981992c0 tx=0x7f008c00b410 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.495+0000 7f009c96d640 1 -- 172.21.15.152:0/4182350083 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f008809c240 con 0x7f0098101b60 2024-09-11T22:04:18.526 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-11T22:04:18.526 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: Active manager daemon x restarted 2024-09-11T22:04:18.526 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: Activating manager daemon x 2024-09-11T22:04:18.526 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T22:04:18.526 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: mgrmap e20: x(active, starting, since 0.0128587s), standbys: y, z 2024-09-11T22:04:18.526 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:04:18.526 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:04:18.526 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:04:18.526 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:04:18.526 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:04:18.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:04:18.528 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:04:18.528 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:04:18.528 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:04:18.528 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:04:18.528 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:04:18.528 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:04:18.528 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:04:18.528 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:04:18.528 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:04:18.529 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:04:18.529 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:04:18.529 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:04:18.529 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:04:18.529 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:04:18.529 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:04:18.529 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:04:18.529 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: Manager daemon x is now available 2024-09-11T22:04:18.529 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:18.529 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:04:18.529 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:18 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:04:18.530 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-11T22:04:18.530 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: Active manager daemon x restarted 2024-09-11T22:04:18.530 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: Activating manager daemon x 2024-09-11T22:04:18.530 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T22:04:18.530 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: mgrmap e20: x(active, starting, since 0.0128587s), standbys: y, z 2024-09-11T22:04:18.530 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:04:18.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:04:18.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:04:18.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:04:18.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:04:18.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:04:18.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:04:18.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:04:18.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:04:18.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:04:18.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:04:18.532 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:04:18.532 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:04:18.532 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:04:18.532 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:04:18.532 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:04:18.532 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:04:18.532 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:04:18.532 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:04:18.532 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:04:18.533 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:04:18.534 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: Manager daemon x is now available 2024-09-11T22:04:18.534 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:18.534 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:04:18.534 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:18 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:04:18.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:18.707+0000 7f009d96f640 1 -- 172.21.15.152:0/4182350083 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f0098062e90 con 0x7f0098101b60 2024-09-11T22:04:19.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.360+0000 7f009c96d640 1 -- 172.21.15.152:0/4182350083 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f008809bb40 con 0x7f0098101b60 2024-09-11T22:04:19.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.362+0000 7f009d96f640 1 -- 172.21.15.152:0/4182350083 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00800a2ac0 msgr2=0x7f00800a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:19.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.362+0000 7f009d96f640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00800a2ac0 0x7f00800a4f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f00981992c0 tx=0x7f008c00b410 comp rx=0 tx=0).stop 2024-09-11T22:04:19.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.362+0000 7f009d96f640 1 -- 172.21.15.152:0/4182350083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0098101b60 msgr2=0x7f0098197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:19.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.362+0000 7f009d96f640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0098101b60 0x7f0098197db0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f008800e9c0 tx=0x7f008800ee80 comp rx=0 tx=0).stop 2024-09-11T22:04:19.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.362+0000 7f009d96f640 1 -- 172.21.15.152:0/4182350083 shutdown_connections 2024-09-11T22:04:19.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.362+0000 7f009d96f640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00800a2ac0 0x7f00800a4f80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.362+0000 7f009d96f640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0098103710 0x7f009819f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.362+0000 7f009d96f640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0098102d50 0x7f00981982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.362+0000 7f009d96f640 1 --2- 172.21.15.152:0/4182350083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0098101b60 0x7f0098197db0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.362+0000 7f009d96f640 1 -- 172.21.15.152:0/4182350083 >> 172.21.15.152:0/4182350083 conn(0x7f00980fd2e0 msgr2=0x7f0098106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:19.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.363+0000 7f009d96f640 1 -- 172.21.15.152:0/4182350083 shutdown_connections 2024-09-11T22:04:19.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.363+0000 7f009d96f640 1 -- 172.21.15.152:0/4182350083 wait complete. 2024-09-11T22:04:19.381 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-11T22:04:19.406 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-mon[31188]: mgrmap e21: x(active, since 1.02006s), standbys: y, z 2024-09-11T22:04:19.406 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-mon[31188]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:04:19.406 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/4182350083' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T22:04:19.407 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:19.129+0000 7f79c0b9a640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:22:04:19] ENGINE Error in HTTPServer.serve 2024-09-11T22:04:19.407 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: Traceback (most recent call last): 2024-09-11T22:04:19.407 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:04:19.407 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self._connections.run(self.expiration_interval) 2024-09-11T22:04:19.407 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:04:19.407 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self._run(expiration_interval) 2024-09-11T22:04:19.407 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:04:19.407 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:04:19.408 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:04:19.408 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:04:19.408 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:04:19.408 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: s = self.context.wrap_socket( 2024-09-11T22:04:19.408 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:04:19.408 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: return self.sslsocket_class._create( 2024-09-11T22:04:19.408 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:04:19.408 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self.do_handshake() 2024-09-11T22:04:19.408 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:04:19.409 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: self._sslobj.do_handshake() 2024-09-11T22:04:19.409 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:04:19.409 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:19.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.494+0000 7fd39569b640 1 -- 172.21.15.152:0/4262248990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd390102600 msgr2=0x7fd390108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:19.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.494+0000 7fd39569b640 1 --2- 172.21.15.152:0/4262248990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd390102600 0x7fd390108e90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd388009ca0 tx=0x7fd38802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.494+0000 7fd39569b640 1 -- 172.21.15.152:0/4262248990 shutdown_connections 2024-09-11T22:04:19.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.494+0000 7fd39569b640 1 --2- 172.21.15.152:0/4262248990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd390102600 0x7fd390108e90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.494+0000 7fd39569b640 1 --2- 172.21.15.152:0/4262248990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd390101c40 0x7fd3901020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.494+0000 7fd39569b640 1 --2- 172.21.15.152:0/4262248990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390100a50 0x7fd390100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.494+0000 7fd39569b640 1 -- 172.21.15.152:0/4262248990 >> 172.21.15.152:0/4262248990 conn(0x7fd3900fc1b0 msgr2=0x7fd3900fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:19.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.494+0000 7fd39569b640 1 -- 172.21.15.152:0/4262248990 shutdown_connections 2024-09-11T22:04:19.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.494+0000 7fd39569b640 1 -- 172.21.15.152:0/4262248990 wait complete. 2024-09-11T22:04:19.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.495+0000 7fd39569b640 1 Processor -- start 2024-09-11T22:04:19.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.495+0000 7fd39569b640 1 -- start start 2024-09-11T22:04:19.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.495+0000 7fd39569b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd390100a50 0x7fd39006aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:19.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.495+0000 7fd39569b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101c40 0x7fd39019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:19.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.495+0000 7fd39569b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd390102600 0x7fd39019f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:19.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.495+0000 7fd39569b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd39010c6d0 con 0x7fd390100a50 2024-09-11T22:04:19.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.495+0000 7fd39569b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd39010c550 con 0x7fd390101c40 2024-09-11T22:04:19.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.495+0000 7fd39569b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd39010c850 con 0x7fd390102600 2024-09-11T22:04:19.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.495+0000 7fd38effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd390100a50 0x7fd39006aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:19.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.495+0000 7fd38effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd390100a50 0x7fd39006aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52370/0 (socket says 172.21.15.152:52370) 2024-09-11T22:04:19.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.495+0000 7fd38effd640 1 -- 172.21.15.152:0/638105637 learned_addr learned my addr 172.21.15.152:0/638105637 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:19.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd38e7fc640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101c40 0x7fd39019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:19.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd38f7fe640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd390102600 0x7fd39019f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:19.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd38effd640 1 -- 172.21.15.152:0/638105637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd390102600 msgr2=0x7fd39019f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:19.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd38effd640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd390102600 0x7fd39019f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd38effd640 1 -- 172.21.15.152:0/638105637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101c40 msgr2=0x7fd39019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:19.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd38effd640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101c40 0x7fd39019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd38effd640 1 -- 172.21.15.152:0/638105637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39019fa10 con 0x7fd390100a50 2024-09-11T22:04:19.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd38f7fe640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd390102600 0x7fd39019f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:19.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd38effd640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd390100a50 0x7fd39006aeb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd38000e9c0 tx=0x7fd38000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:19.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd377fff640 1 -- 172.21.15.152:0/638105637 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38000cde0 con 0x7fd390100a50 2024-09-11T22:04:19.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd39569b640 1 -- 172.21.15.152:0/638105637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39019fca0 con 0x7fd390100a50 2024-09-11T22:04:19.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd39569b640 1 -- 172.21.15.152:0/638105637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3901a0190 con 0x7fd390100a50 2024-09-11T22:04:19.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd377fff640 1 -- 172.21.15.152:0/638105637 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd380010910 con 0x7fd390100a50 2024-09-11T22:04:19.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.496+0000 7fd377fff640 1 -- 172.21.15.152:0/638105637 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380018980 con 0x7fd390100a50 2024-09-11T22:04:19.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.497+0000 7fd39569b640 1 -- 172.21.15.152:0/638105637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd390107d70 con 0x7fd390100a50 2024-09-11T22:04:19.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.499+0000 7fd377fff640 1 -- 172.21.15.152:0/638105637 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7fd38001f020 con 0x7fd390100a50 2024-09-11T22:04:19.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.500+0000 7fd377fff640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd3780a2da0 0x7fd3780a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:19.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.500+0000 7fd377fff640 1 -- 172.21.15.152:0/638105637 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd3800cfaa0 con 0x7fd390100a50 2024-09-11T22:04:19.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.500+0000 7fd38e7fc640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd3780a2da0 0x7fd3780a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:19.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.500+0000 7fd38e7fc640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd3780a2da0 0x7fd3780a5260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd39006ac20 tx=0x7fd384005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:19.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.502+0000 7fd377fff640 1 -- 172.21.15.152:0/638105637 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd38009c690 con 0x7fd390100a50 2024-09-11T22:04:19.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.707+0000 7fd39569b640 1 -- 172.21.15.152:0/638105637 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fd390062790 con 0x7fd3780a2da0 2024-09-11T22:04:19.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.763+0000 7fd377fff640 1 -- 172.21.15.152:0/638105637 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fd390062790 con 0x7fd3780a2da0 2024-09-11T22:04:19.764 INFO:teuthology.orchestra.run.smithi152.stdout:{} 2024-09-11T22:04:19.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 -- 172.21.15.152:0/638105637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd3780a2da0 msgr2=0x7fd3780a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:19.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd3780a2da0 0x7fd3780a5260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd39006ac20 tx=0x7fd384005f90 comp rx=0 tx=0).stop 2024-09-11T22:04:19.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 -- 172.21.15.152:0/638105637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd390100a50 msgr2=0x7fd39006aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:19.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd390100a50 0x7fd39006aeb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd38000e9c0 tx=0x7fd38000ee80 comp rx=0 tx=0).stop 2024-09-11T22:04:19.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 -- 172.21.15.152:0/638105637 shutdown_connections 2024-09-11T22:04:19.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd3780a2da0 0x7fd3780a5260 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd390102600 0x7fd39019f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101c40 0x7fd39019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 --2- 172.21.15.152:0/638105637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd390100a50 0x7fd39006aeb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 -- 172.21.15.152:0/638105637 >> 172.21.15.152:0/638105637 conn(0x7fd3900fc1b0 msgr2=0x7fd390104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:19.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 -- 172.21.15.152:0/638105637 shutdown_connections 2024-09-11T22:04:19.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.765+0000 7fd39569b640 1 -- 172.21.15.152:0/638105637 wait complete. 2024-09-11T22:04:19.777 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-11T22:04:19.788 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-11T22:04:19.811 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:04:19.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:19 smithi179 ceph-mon[35603]: mgrmap e21: x(active, since 1.02006s), standbys: y, z 2024-09-11T22:04:19.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:19 smithi179 ceph-mon[35603]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:04:19.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:19 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/4182350083' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T22:04:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:19 smithi193 ceph-mon[35545]: mgrmap e21: x(active, since 1.02006s), standbys: y, z 2024-09-11T22:04:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:19 smithi193 ceph-mon[35545]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:04:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:19 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/4182350083' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-11T22:04:19.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.921+0000 7f82e67e8640 1 -- 172.21.15.152:0/1612583174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e01025e0 msgr2=0x7f82e0108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:19.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.921+0000 7f82e67e8640 1 --2- 172.21.15.152:0/1612583174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e01025e0 0x7f82e0108e70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009ca0 tx=0x7f82d802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.921+0000 7f82e67e8640 1 -- 172.21.15.152:0/1612583174 shutdown_connections 2024-09-11T22:04:19.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.921+0000 7f82e67e8640 1 --2- 172.21.15.152:0/1612583174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e01025e0 0x7f82e0108e70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.921+0000 7f82e67e8640 1 --2- 172.21.15.152:0/1612583174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e0101c20 0x7f82e01020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.921+0000 7f82e67e8640 1 --2- 172.21.15.152:0/1612583174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82e0100a30 0x7f82e0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.921+0000 7f82e67e8640 1 -- 172.21.15.152:0/1612583174 >> 172.21.15.152:0/1612583174 conn(0x7f82e00fc190 msgr2=0x7f82e00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:19.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.921+0000 7f82e67e8640 1 -- 172.21.15.152:0/1612583174 shutdown_connections 2024-09-11T22:04:19.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.921+0000 7f82e67e8640 1 -- 172.21.15.152:0/1612583174 wait complete. 2024-09-11T22:04:19.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82e67e8640 1 Processor -- start 2024-09-11T22:04:19.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82e67e8640 1 -- start start 2024-09-11T22:04:19.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82e67e8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e0100a30 0x7f82e006af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:19.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82e67e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0101c20 0x7f82e019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82e67e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82e01025e0 0x7f82e019f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82e67e8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f82e010c690 con 0x7f82e0101c20 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82e67e8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f82e010c510 con 0x7f82e0100a30 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82e67e8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f82e010c810 con 0x7f82e01025e0 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82df7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0101c20 0x7f82e019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82df7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0101c20 0x7f82e019cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52402/0 (socket says 172.21.15.152:52402) 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82df7fe640 1 -- 172.21.15.152:0/1003566516 learned_addr learned my addr 172.21.15.152:0/1003566516 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82dffff640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e0100a30 0x7f82e006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.922+0000 7f82e4d85640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82e01025e0 0x7f82e019f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82df7fe640 1 -- 172.21.15.152:0/1003566516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82e01025e0 msgr2=0x7f82e019f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82df7fe640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82e01025e0 0x7f82e019f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82df7fe640 1 -- 172.21.15.152:0/1003566516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e0100a30 msgr2=0x7f82e006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:19.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82df7fe640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e0100a30 0x7f82e006af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:19.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82df7fe640 1 -- 172.21.15.152:0/1003566516 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e019faf0 con 0x7f82e0101c20 2024-09-11T22:04:19.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82dffff640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e0100a30 0x7f82e006af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:19.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82df7fe640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0101c20 0x7f82e019cbc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f82d400d950 tx=0x7f82d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:19.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82dd7fa640 1 -- 172.21.15.152:0/1003566516 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4017030 con 0x7f82e0101c20 2024-09-11T22:04:19.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82e67e8640 1 -- 172.21.15.152:0/1003566516 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e019fd80 con 0x7f82e0101c20 2024-09-11T22:04:19.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82dd7fa640 1 -- 172.21.15.152:0/1003566516 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82d4004020 con 0x7f82e0101c20 2024-09-11T22:04:19.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82dd7fa640 1 -- 172.21.15.152:0/1003566516 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d40047a0 con 0x7f82e0101c20 2024-09-11T22:04:19.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.923+0000 7f82e67e8640 1 -- 172.21.15.152:0/1003566516 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e01a0270 con 0x7f82e0101c20 2024-09-11T22:04:19.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.924+0000 7f82e67e8640 1 -- 172.21.15.152:0/1003566516 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e0107e20 con 0x7f82e0101c20 2024-09-11T22:04:19.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.926+0000 7f82dd7fa640 1 -- 172.21.15.152:0/1003566516 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7f82d40041d0 con 0x7f82e0101c20 2024-09-11T22:04:19.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.927+0000 7f82dd7fa640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f82c80a2d00 0x7f82c80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:19.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.927+0000 7f82dd7fa640 1 -- 172.21.15.152:0/1003566516 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f82d40ced10 con 0x7f82e0101c20 2024-09-11T22:04:19.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.927+0000 7f82dffff640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f82c80a2d00 0x7f82c80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:19.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.927+0000 7f82dffff640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f82c80a2d00 0x7f82c80a51c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82d0005fd0 tx=0x7f82d000b410 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:19.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:19.931+0000 7f82dd7fa640 1 -- 172.21.15.152:0/1003566516 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82d409b900 con 0x7f82e0101c20 2024-09-11T22:04:19.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:19.711+0000 7f79d7406640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:19.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:19.711+0000 7f79d7406640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:19.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:19.711+0000 7f79d7406640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:19.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:19.711+0000 7f79d7406640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:19.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:04:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:04:19.711+0000 7f79d7406640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:04:20.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.111+0000 7f82e67e8640 1 -- 172.21.15.152:0/1003566516 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82e002da10 con 0x7f82e0101c20 2024-09-11T22:04:20.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.115+0000 7f82dd7fa640 1 -- 172.21.15.152:0/1003566516 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23266 (secure 0 0 0) 0x7f82d409b200 con 0x7f82e0101c20 2024-09-11T22:04:20.116 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:20.117 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":85,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:04:17.346575+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2394077400":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/1809855628":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6801/3828412393":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6800/3828412393":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/2661528324":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/321546578":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/1096456467":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 -- 172.21.15.152:0/1003566516 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f82c80a2d00 msgr2=0x7f82c80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f82c80a2d00 0x7f82c80a51c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82d0005fd0 tx=0x7f82d000b410 comp rx=0 tx=0).stop 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 -- 172.21.15.152:0/1003566516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0101c20 msgr2=0x7f82e019cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0101c20 0x7f82e019cbc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f82d400d950 tx=0x7f82d400de10 comp rx=0 tx=0).stop 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 -- 172.21.15.152:0/1003566516 shutdown_connections 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f82c80a2d00 0x7f82c80a51c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82e01025e0 0x7f82e019f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0101c20 0x7f82e019cbc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 --2- 172.21.15.152:0/1003566516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e0100a30 0x7f82e006af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 -- 172.21.15.152:0/1003566516 >> 172.21.15.152:0/1003566516 conn(0x7f82e00fc190 msgr2=0x7f82e0104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 -- 172.21.15.152:0/1003566516 shutdown_connections 2024-09-11T22:04:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.118+0000 7f82e67e8640 1 -- 172.21.15.152:0/1003566516 wait complete. 2024-09-11T22:04:20.132 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T21:58:10.500177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T22:02:33.014997+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T22:02:34.841069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:04:20.133 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:04:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.240+0000 7f058abe8640 1 -- 172.21.15.152:0/4145712243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05841025e0 msgr2=0x7f05841049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.240+0000 7f058abe8640 1 --2- 172.21.15.152:0/4145712243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05841025e0 0x7f05841049d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0578009900 tx=0x7f057802a410 comp rx=0 tx=0).stop 2024-09-11T22:04:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.240+0000 7f058abe8640 1 -- 172.21.15.152:0/4145712243 shutdown_connections 2024-09-11T22:04:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.240+0000 7f058abe8640 1 --2- 172.21.15.152:0/4145712243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0584107840 0x7f0584109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.240+0000 7f058abe8640 1 --2- 172.21.15.152:0/4145712243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0584104f10 0x7f0584107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.240+0000 7f058abe8640 1 --2- 172.21.15.152:0/4145712243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05841025e0 0x7f05841049d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.240+0000 7f058abe8640 1 -- 172.21.15.152:0/4145712243 >> 172.21.15.152:0/4145712243 conn(0x7f05840fc140 msgr2=0x7f05840fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.240+0000 7f058abe8640 1 -- 172.21.15.152:0/4145712243 shutdown_connections 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.240+0000 7f058abe8640 1 -- 172.21.15.152:0/4145712243 wait complete. 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.240+0000 7f058abe8640 1 Processor -- start 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.240+0000 7f058abe8640 1 -- start start 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f058abe8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05841025e0 0x7f058419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f058abe8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0584104f10 0x7f058419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f058abe8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0584107840 0x7f05841a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f058abe8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f058410d7e0 con 0x7f0584104f10 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f058abe8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f058410d660 con 0x7f0584107840 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f058abe8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f058410d960 con 0x7f05841025e0 2024-09-11T22:04:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0583fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0584104f10 0x7f058419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0588984640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05841025e0 0x7f058419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0583fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0584104f10 0x7f058419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52416/0 (socket says 172.21.15.152:52416) 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0588984640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05841025e0 0x7f058419a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:32830/0 (socket says 172.21.15.152:32830) 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0583fff640 1 -- 172.21.15.152:0/3792089014 learned_addr learned my addr 172.21.15.152:0/3792089014 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0589185640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0584107840 0x7f05841a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0583fff640 1 -- 172.21.15.152:0/3792089014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05841025e0 msgr2=0x7f058419a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0583fff640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05841025e0 0x7f058419a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0583fff640 1 -- 172.21.15.152:0/3792089014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0584107840 msgr2=0x7f05841a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0583fff640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0584107840 0x7f05841a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0583fff640 1 -- 172.21.15.152:0/3792089014 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05841a1ce0 con 0x7f0584104f10 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0589185640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0584107840 0x7f05841a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0588984640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05841025e0 0x7f058419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0583fff640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0584104f10 0x7f058419a600 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f057000e9a0 tx=0x7f057000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0581ffb640 1 -- 172.21.15.152:0/3792089014 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057000cd80 con 0x7f0584104f10 2024-09-11T22:04:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0581ffb640 1 -- 172.21.15.152:0/3792089014 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05700035f0 con 0x7f0584104f10 2024-09-11T22:04:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f0581ffb640 1 -- 172.21.15.152:0/3792089014 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570010670 con 0x7f0584104f10 2024-09-11T22:04:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.241+0000 7f058abe8640 1 -- 172.21.15.152:0/3792089014 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05841a1fd0 con 0x7f0584104f10 2024-09-11T22:04:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.242+0000 7f058abe8640 1 -- 172.21.15.152:0/3792089014 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05841a24e0 con 0x7f0584104f10 2024-09-11T22:04:20.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.243+0000 7f058abe8640 1 -- 172.21.15.152:0/3792089014 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0584109330 con 0x7f0584104f10 2024-09-11T22:04:20.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.244+0000 7f0581ffb640 1 -- 172.21.15.152:0/3792089014 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7f05700037a0 con 0x7f0584104f10 2024-09-11T22:04:20.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.245+0000 7f0581ffb640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05740a2d80 0x7f05740a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.245+0000 7f0588984640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05740a2d80 0x7f05740a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.245+0000 7f0581ffb640 1 -- 172.21.15.152:0/3792089014 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f05700cf670 con 0x7f0584104f10 2024-09-11T22:04:20.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.245+0000 7f0588984640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05740a2d80 0x7f05740a5240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f05780314e0 tx=0x7f0578000bc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.249+0000 7f0581ffb640 1 -- 172.21.15.152:0/3792089014 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f057009c260 con 0x7f0584104f10 2024-09-11T22:04:20.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.424+0000 7f058abe8640 1 -- 172.21.15.152:0/3792089014 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f058402da10 con 0x7f0584104f10 2024-09-11T22:04:20.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.425+0000 7f0581ffb640 1 -- 172.21.15.152:0/3792089014 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7f057009bb60 con 0x7f0584104f10 2024-09-11T22:04:20.426 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-09-11T22:04:20.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 -- 172.21.15.152:0/3792089014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05740a2d80 msgr2=0x7f05740a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05740a2d80 0x7f05740a5240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f05780314e0 tx=0x7f0578000bc0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 -- 172.21.15.152:0/3792089014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0584104f10 msgr2=0x7f058419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0584104f10 0x7f058419a600 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f057000e9a0 tx=0x7f057000ee60 comp rx=0 tx=0).stop 2024-09-11T22:04:20.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 -- 172.21.15.152:0/3792089014 shutdown_connections 2024-09-11T22:04:20.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05740a2d80 0x7f05740a5240 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0584107840 0x7f05841a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0584104f10 0x7f058419a600 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 --2- 172.21.15.152:0/3792089014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05841025e0 0x7f058419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 -- 172.21.15.152:0/3792089014 >> 172.21.15.152:0/3792089014 conn(0x7f05840fc140 msgr2=0x7f0584101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:20.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 -- 172.21.15.152:0/3792089014 shutdown_connections 2024-09-11T22:04:20.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.427+0000 7f058abe8640 1 -- 172.21.15.152:0/3792089014 wait complete. 2024-09-11T22:04:20.438 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: [11/Sep/2024:22:04:18] ENGINE Bus STARTING 2024-09-11T22:04:20.438 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: [11/Sep/2024:22:04:19] ENGINE Serving on http://172.21.15.152:8765 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: [11/Sep/2024:22:04:19] ENGINE Serving on https://172.21.15.152:7150 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: [11/Sep/2024:22:04:19] ENGINE Bus STARTED 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: [11/Sep/2024:22:04:19] ENGINE Error in HTTPServer.serve 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout: Traceback (most recent call last): 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout: self._connections.run(self.expiration_interval) 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout: self._run(expiration_interval) 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:04:20.439 INFO:journalctl@ceph.mon.a.smithi152.stdout: s = self.context.wrap_socket( 2024-09-11T22:04:20.440 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:04:20.440 INFO:journalctl@ceph.mon.a.smithi152.stdout: return self.sslsocket_class._create( 2024-09-11T22:04:20.440 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:04:20.440 INFO:journalctl@ceph.mon.a.smithi152.stdout: self.do_handshake() 2024-09-11T22:04:20.440 INFO:journalctl@ceph.mon.a.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:04:20.440 INFO:journalctl@ceph.mon.a.smithi152.stdout: self._sslobj.do_handshake() 2024-09-11T22:04:20.440 INFO:journalctl@ceph.mon.a.smithi152.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:04:20.440 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/4182350083' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T22:04:20.440 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:04:20.441 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:20.441 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-11T22:04:20.441 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.441 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.441 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.441 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.441 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.441 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.441 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.442 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1003566516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:20.442 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.442 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.442 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.445 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T22:04:20.446 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.446 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.446 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.446 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.447 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.447 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.447 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.447 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.447 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.447 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.447 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.447 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.448 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.448 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.448 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:20.448 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:20 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:20.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.553+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/2450639736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a08100a00 msgr2=0x7f3a08100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.553+0000 7f3a0c8e4640 1 --2- 172.21.15.152:0/2450639736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a08100a00 0x7f3a08100e00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009900 tx=0x7f39f802a410 comp rx=0 tx=0).stop 2024-09-11T22:04:20.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.554+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/2450639736 shutdown_connections 2024-09-11T22:04:20.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.554+0000 7f3a0c8e4640 1 --2- 172.21.15.152:0/2450639736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a081025b0 0x7f3a08108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.554+0000 7f3a0c8e4640 1 --2- 172.21.15.152:0/2450639736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a08101bf0 0x7f3a08102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.554+0000 7f3a0c8e4640 1 --2- 172.21.15.152:0/2450639736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a08100a00 0x7f3a08100e00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.554+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/2450639736 >> 172.21.15.152:0/2450639736 conn(0x7f3a080fc140 msgr2=0x7f3a080fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.554+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/2450639736 shutdown_connections 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.554+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/2450639736 wait complete. 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.554+0000 7f3a0c8e4640 1 Processor -- start 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.554+0000 7f3a0c8e4640 1 -- start start 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a0c8e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a08100a00 0x7f3a08197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a0c8e4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a08101bf0 0x7f3a08198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a0c8e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a081025b0 0x7f3a0819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a0c8e4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0810d7d0 con 0x7f3a08101bf0 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a0c8e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0810d650 con 0x7f3a08100a00 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a0c8e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0810d950 con 0x7f3a081025b0 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a05d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a08101bf0 0x7f3a08198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a05d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a08101bf0 0x7f3a08198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52436/0 (socket says 172.21.15.152:52436) 2024-09-11T22:04:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a05d9b640 1 -- 172.21.15.152:0/3754183559 learned_addr learned my addr 172.21.15.152:0/3754183559 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a06d9d640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a081025b0 0x7f3a0819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a0659c640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a08100a00 0x7f3a08197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a05d9b640 1 -- 172.21.15.152:0/3754183559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a081025b0 msgr2=0x7f3a0819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a05d9b640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a081025b0 0x7f3a0819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a05d9b640 1 -- 172.21.15.152:0/3754183559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a08100a00 msgr2=0x7f3a08197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a05d9b640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a08100a00 0x7f3a08197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a05d9b640 1 -- 172.21.15.152:0/3754183559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0819faf0 con 0x7f3a08101bf0 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a06d9d640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a081025b0 0x7f3a0819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a05d9b640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a08101bf0 0x7f3a08198410 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00e9f0 tx=0x7f39fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f39f77fe640 1 -- 172.21.15.152:0/3754183559 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc00cd80 con 0x7f3a08101bf0 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f39f77fe640 1 -- 172.21.15.152:0/3754183559 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39fc005500 con 0x7f3a08101bf0 2024-09-11T22:04:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/3754183559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0819fde0 con 0x7f3a08101bf0 2024-09-11T22:04:20.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.555+0000 7f39f77fe640 1 -- 172.21.15.152:0/3754183559 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc010690 con 0x7f3a08101bf0 2024-09-11T22:04:20.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.556+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/3754183559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a081a0250 con 0x7f3a08101bf0 2024-09-11T22:04:20.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.557+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/3754183559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a08107e90 con 0x7f3a08101bf0 2024-09-11T22:04:20.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.559+0000 7f39f77fe640 1 -- 172.21.15.152:0/3754183559 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7f39fc0046c0 con 0x7f3a08101bf0 2024-09-11T22:04:20.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.559+0000 7f39f77fe640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f39f00a2d00 0x7f39f00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.559+0000 7f3a0659c640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f39f00a2d00 0x7f39f00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.559+0000 7f39f77fe640 1 -- 172.21.15.152:0/3754183559 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f39fc0cfa30 con 0x7f3a08101bf0 2024-09-11T22:04:20.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.560+0000 7f3a0659c640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f39f00a2d00 0x7f39f00a51c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f39f8005ab0 tx=0x7f39f8000bc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:20.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.562+0000 7f39f77fe640 1 -- 172.21.15.152:0/3754183559 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39fc0541b0 con 0x7f3a08101bf0 2024-09-11T22:04:20.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.764+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/3754183559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3a0802da10 con 0x7f3a08101bf0 2024-09-11T22:04:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.764+0000 7f39f77fe640 1 -- 172.21.15.152:0/3754183559 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7f39fc09c620 con 0x7f3a08101bf0 2024-09-11T22:04:20.765 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-09-11T22:04:20.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/3754183559 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f39f00a2d00 msgr2=0x7f39f00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f39f00a2d00 0x7f39f00a51c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f39f8005ab0 tx=0x7f39f8000bc0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/3754183559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a08101bf0 msgr2=0x7f3a08198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a08101bf0 0x7f3a08198410 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00e9f0 tx=0x7f39fc00edf0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/3754183559 shutdown_connections 2024-09-11T22:04:20.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f39f00a2d00 0x7f39f00a51c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a081025b0 0x7f3a0819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a08101bf0 0x7f3a08198410 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 --2- 172.21.15.152:0/3754183559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a08100a00 0x7f3a08197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/3754183559 >> 172.21.15.152:0/3754183559 conn(0x7f3a080fc140 msgr2=0x7f3a08105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:20.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/3754183559 shutdown_connections 2024-09-11T22:04:20.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.766+0000 7f3a0c8e4640 1 -- 172.21.15.152:0/3754183559 wait complete. 2024-09-11T22:04:20.778 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T22:04:20.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: [11/Sep/2024:22:04:18] ENGINE Bus STARTING 2024-09-11T22:04:20.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: [11/Sep/2024:22:04:19] ENGINE Serving on http://172.21.15.152:8765 2024-09-11T22:04:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: [11/Sep/2024:22:04:19] ENGINE Serving on https://172.21.15.152:7150 2024-09-11T22:04:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: [11/Sep/2024:22:04:19] ENGINE Bus STARTED 2024-09-11T22:04:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: [11/Sep/2024:22:04:19] ENGINE Error in HTTPServer.serve 2024-09-11T22:04:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout: Traceback (most recent call last): 2024-09-11T22:04:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:04:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout: self._connections.run(self.expiration_interval) 2024-09-11T22:04:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:04:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout: self._run(expiration_interval) 2024-09-11T22:04:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:04:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:04:20.797 INFO:journalctl@ceph.mon.b.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:04:20.798 INFO:journalctl@ceph.mon.b.smithi179.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:04:20.798 INFO:journalctl@ceph.mon.b.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:04:20.798 INFO:journalctl@ceph.mon.b.smithi179.stdout: s = self.context.wrap_socket( 2024-09-11T22:04:20.798 INFO:journalctl@ceph.mon.b.smithi179.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:04:20.798 INFO:journalctl@ceph.mon.b.smithi179.stdout: return self.sslsocket_class._create( 2024-09-11T22:04:20.798 INFO:journalctl@ceph.mon.b.smithi179.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:04:20.798 INFO:journalctl@ceph.mon.b.smithi179.stdout: self.do_handshake() 2024-09-11T22:04:20.798 INFO:journalctl@ceph.mon.b.smithi179.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:04:20.798 INFO:journalctl@ceph.mon.b.smithi179.stdout: self._sslobj.do_handshake() 2024-09-11T22:04:20.798 INFO:journalctl@ceph.mon.b.smithi179.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:04:20.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/4182350083' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1003566516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:20.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:20 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:20.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: [11/Sep/2024:22:04:18] ENGINE Bus STARTING 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: [11/Sep/2024:22:04:19] ENGINE Serving on http://172.21.15.152:8765 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: [11/Sep/2024:22:04:19] ENGINE Serving on https://172.21.15.152:7150 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: [11/Sep/2024:22:04:19] ENGINE Bus STARTED 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: [11/Sep/2024:22:04:19] ENGINE Error in HTTPServer.serve 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout: Traceback (most recent call last): 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout: self._connections.run(self.expiration_interval) 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout: self._run(expiration_interval) 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:04:20.827 INFO:journalctl@ceph.mon.c.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout: s = self.context.wrap_socket( 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout: return self.sslsocket_class._create( 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout: self.do_handshake() 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout: self._sslobj.do_handshake() 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/4182350083' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:20.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1003566516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:04:20.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:20.831 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:20 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:20.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.887+0000 7f166fa47640 1 -- 172.21.15.152:0/2688925076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1668104eb0 msgr2=0x7f16681072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.887+0000 7f166fa47640 1 --2- 172.21.15.152:0/2688925076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1668104eb0 0x7f16681072a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1658009900 tx=0x7f165802a410 comp rx=0 tx=0).stop 2024-09-11T22:04:20.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.887+0000 7f166fa47640 1 -- 172.21.15.152:0/2688925076 shutdown_connections 2024-09-11T22:04:20.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.887+0000 7f166fa47640 1 --2- 172.21.15.152:0/2688925076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16681077e0 0x7f1668109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.887+0000 7f166fa47640 1 --2- 172.21.15.152:0/2688925076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1668104eb0 0x7f16681072a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.887+0000 7f166fa47640 1 --2- 172.21.15.152:0/2688925076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1668102580 0x7f1668104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.887+0000 7f166fa47640 1 -- 172.21.15.152:0/2688925076 >> 172.21.15.152:0/2688925076 conn(0x7f16680fc140 msgr2=0x7f16680fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:20.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.887+0000 7f166fa47640 1 -- 172.21.15.152:0/2688925076 shutdown_connections 2024-09-11T22:04:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.887+0000 7f166fa47640 1 -- 172.21.15.152:0/2688925076 wait complete. 2024-09-11T22:04:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.887+0000 7f166fa47640 1 Processor -- start 2024-09-11T22:04:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.887+0000 7f166fa47640 1 -- start start 2024-09-11T22:04:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166fa47640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1668102580 0x7f1668101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166fa47640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1668104eb0 0x7f1668100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166fa47640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16681077e0 0x7f1668100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166fa47640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f166810d7c0 con 0x7f1668104eb0 2024-09-11T22:04:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166fa47640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f166810d640 con 0x7f16681077e0 2024-09-11T22:04:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166fa47640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f166810d940 con 0x7f1668102580 2024-09-11T22:04:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166cfe2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1668104eb0 0x7f1668100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166d7e3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1668102580 0x7f1668101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166d7e3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1668102580 0x7f1668101ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:32848/0 (socket says 172.21.15.152:32848) 2024-09-11T22:04:20.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166d7e3640 1 -- 172.21.15.152:0/4076081941 learned_addr learned my addr 172.21.15.152:0/4076081941 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:20.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166cfe2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1668104eb0 0x7f1668100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52458/0 (socket says 172.21.15.152:52458) 2024-09-11T22:04:20.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166dfe4640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16681077e0 0x7f1668100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166d7e3640 1 -- 172.21.15.152:0/4076081941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16681077e0 msgr2=0x7f1668100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166d7e3640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16681077e0 0x7f1668100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166d7e3640 1 -- 172.21.15.152:0/4076081941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1668104eb0 msgr2=0x7f1668100530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:20.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166d7e3640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1668104eb0 0x7f1668100530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:20.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166d7e3640 1 -- 172.21.15.152:0/4076081941 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1668101300 con 0x7f1668102580 2024-09-11T22:04:20.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.888+0000 7f166d7e3640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1668102580 0x7f1668101ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f166400e9f0 tx=0x7f166400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:20.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.889+0000 7f165e7fc640 1 -- 172.21.15.152:0/4076081941 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166400cd80 con 0x7f1668102580 2024-09-11T22:04:20.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.889+0000 7f165e7fc640 1 -- 172.21.15.152:0/4076081941 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1664010910 con 0x7f1668102580 2024-09-11T22:04:20.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.889+0000 7f166fa47640 1 -- 172.21.15.152:0/4076081941 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16681a1fc0 con 0x7f1668102580 2024-09-11T22:04:20.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.889+0000 7f165e7fc640 1 -- 172.21.15.152:0/4076081941 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664018990 con 0x7f1668102580 2024-09-11T22:04:20.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.889+0000 7f166fa47640 1 -- 172.21.15.152:0/4076081941 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16681a2420 con 0x7f1668102580 2024-09-11T22:04:20.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.890+0000 7f166fa47640 1 -- 172.21.15.152:0/4076081941 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16680fdc30 con 0x7f1668102580 2024-09-11T22:04:20.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.891+0000 7f165e7fc640 1 -- 172.21.15.152:0/4076081941 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7f1664010ac0 con 0x7f1668102580 2024-09-11T22:04:20.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.892+0000 7f165e7fc640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16540a2d00 0x7f16540a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:20.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.892+0000 7f166cfe2640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16540a2d00 0x7f16540a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:20.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.892+0000 7f165e7fc640 1 -- 172.21.15.152:0/4076081941 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f16640cfce0 con 0x7f1668102580 2024-09-11T22:04:20.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.892+0000 7f166cfe2640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16540a2d00 0x7f16540a51c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1658005ab0 tx=0x7f1658000bc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:20.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:20.895+0000 7f165e7fc640 1 -- 172.21.15.152:0/4076081941 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f166409c220 con 0x7f1668102580 2024-09-11T22:04:21.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.075+0000 7f166fa47640 1 -- 172.21.15.152:0/4076081941 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f166802da10 con 0x7f1668102580 2024-09-11T22:04:21.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.076+0000 7f165e7fc640 1 -- 172.21.15.152:0/4076081941 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7f16640a0520 con 0x7f1668102580 2024-09-11T22:04:21.077 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-09-11T22:04:21.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 -- 172.21.15.152:0/4076081941 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16540a2d00 msgr2=0x7f16540a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:21.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16540a2d00 0x7f16540a51c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1658005ab0 tx=0x7f1658000bc0 comp rx=0 tx=0).stop 2024-09-11T22:04:21.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 -- 172.21.15.152:0/4076081941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1668102580 msgr2=0x7f1668101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:21.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1668102580 0x7f1668101ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f166400e9f0 tx=0x7f166400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:04:21.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 -- 172.21.15.152:0/4076081941 shutdown_connections 2024-09-11T22:04:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16540a2d00 0x7f16540a51c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16681077e0 0x7f1668100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1668104eb0 0x7f1668100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 --2- 172.21.15.152:0/4076081941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1668102580 0x7f1668101ef0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 -- 172.21.15.152:0/4076081941 >> 172.21.15.152:0/4076081941 conn(0x7f16680fc140 msgr2=0x7f1668102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 -- 172.21.15.152:0/4076081941 shutdown_connections 2024-09-11T22:04:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.078+0000 7f166fa47640 1 -- 172.21.15.152:0/4076081941 wait complete. 2024-09-11T22:04:21.090 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-11T22:04:21.090 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:04:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:21.619 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:21.619 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-11T22:04:21.619 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-11T22:04:21.619 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: Unable to set osd_memory_target on smithi193 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-11T22:04:21.619 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: Unable to set osd_memory_target on smithi179 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-11T22:04:21.619 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-11T22:04:21.619 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: Unable to set osd_memory_target on smithi152 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-11T22:04:21.619 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-11T22:04:21.619 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-11T22:04:21.619 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3792089014' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3754183559' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/4076081941' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:21.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:21.621 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:21 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:21.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-11T22:04:21.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-11T22:04:21.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: Unable to set osd_memory_target on smithi193 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-11T22:04:21.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: Unable to set osd_memory_target on smithi179 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-11T22:04:21.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-11T22:04:21.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: Unable to set osd_memory_target on smithi152 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-11T22:04:21.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-11T22:04:21.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-11T22:04:21.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-11T22:04:21.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3792089014' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3754183559' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/4076081941' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:21.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:21 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: Unable to set osd_memory_target on smithi193 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: Unable to set osd_memory_target on smithi179 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: Unable to set osd_memory_target on smithi152 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3792089014' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3754183559' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/4076081941' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:21.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:21.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:21.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:21 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:21.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.850+0000 7fb5e62d1640 1 -- 172.21.15.152:0/2551594959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5e01036e0 msgr2=0x7fb5e0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:21.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.850+0000 7fb5e62d1640 1 --2- 172.21.15.152:0/2551594959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5e01036e0 0x7fb5e0107b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009930 tx=0x7fb5d402a420 comp rx=0 tx=0).stop 2024-09-11T22:04:21.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.850+0000 7fb5e62d1640 1 -- 172.21.15.152:0/2551594959 shutdown_connections 2024-09-11T22:04:21.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.850+0000 7fb5e62d1640 1 --2- 172.21.15.152:0/2551594959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e01082a0 0x7fb5e010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:21.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.850+0000 7fb5e62d1640 1 --2- 172.21.15.152:0/2551594959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5e01036e0 0x7fb5e0107b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:21.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.850+0000 7fb5e62d1640 1 --2- 172.21.15.152:0/2551594959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e0102d30 0x7fb5e0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:21.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.850+0000 7fb5e62d1640 1 -- 172.21.15.152:0/2551594959 >> 172.21.15.152:0/2551594959 conn(0x7fb5e00fc7d0 msgr2=0x7fb5e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:21.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.850+0000 7fb5e62d1640 1 -- 172.21.15.152:0/2551594959 shutdown_connections 2024-09-11T22:04:21.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.850+0000 7fb5e62d1640 1 -- 172.21.15.152:0/2551594959 wait complete. 2024-09-11T22:04:21.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.851+0000 7fb5e62d1640 1 Processor -- start 2024-09-11T22:04:21.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.851+0000 7fb5e62d1640 1 -- start start 2024-09-11T22:04:21.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.851+0000 7fb5e62d1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e0102d30 0x7fb5e0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:21.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.851+0000 7fb5e62d1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5e01036e0 0x7fb5e0198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:21.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.851+0000 7fb5e62d1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e01082a0 0x7fb5e019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:21.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.851+0000 7fb5e62d1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e0112060 con 0x7fb5e01036e0 2024-09-11T22:04:21.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.851+0000 7fb5e62d1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e0111ee0 con 0x7fb5e01082a0 2024-09-11T22:04:21.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5e62d1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e01121e0 con 0x7fb5e0102d30 2024-09-11T22:04:21.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5df7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5e01036e0 0x7fb5e0198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:21.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5df7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5e01036e0 0x7fb5e0198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52484/0 (socket says 172.21.15.152:52484) 2024-09-11T22:04:21.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5df7fe640 1 -- 172.21.15.152:0/1803030783 learned_addr learned my addr 172.21.15.152:0/1803030783 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:21.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5e486e640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e01082a0 0x7fb5e019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:21.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5dffff640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e0102d30 0x7fb5e0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:21.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5df7fe640 1 -- 172.21.15.152:0/1803030783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e0102d30 msgr2=0x7fb5e0198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:21.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5df7fe640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e0102d30 0x7fb5e0198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:21.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5df7fe640 1 -- 172.21.15.152:0/1803030783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e01082a0 msgr2=0x7fb5e019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5df7fe640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e01082a0 0x7fb5e019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5df7fe640 1 -- 172.21.15.152:0/1803030783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e019d4f0 con 0x7fb5e01036e0 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5df7fe640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5e01036e0 0x7fb5e0198a80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4005940 tx=0x7fb5d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5dd7fa640 1 -- 172.21.15.152:0/1803030783 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d403f030 con 0x7fb5e01036e0 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5dd7fa640 1 -- 172.21.15.152:0/1803030783 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5d4003ce0 con 0x7fb5e01036e0 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5e62d1640 1 -- 172.21.15.152:0/1803030783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e019d780 con 0x7fb5e01036e0 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5dd7fa640 1 -- 172.21.15.152:0/1803030783 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4035070 con 0x7fb5e01036e0 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.852+0000 7fb5e62d1640 1 -- 172.21.15.152:0/1803030783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e01a50c0 con 0x7fb5e01036e0 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.854+0000 7fb5e62d1640 1 -- 172.21.15.152:0/1803030783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e006a850 con 0x7fb5e01036e0 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.855+0000 7fb5dd7fa640 1 -- 172.21.15.152:0/1803030783 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7fb5d4042030 con 0x7fb5e01036e0 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.855+0000 7fb5dd7fa640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb5c80a2cf0 0x7fb5c80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.855+0000 7fb5dd7fa640 1 -- 172.21.15.152:0/1803030783 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb5d40ef930 con 0x7fb5e01036e0 2024-09-11T22:04:21.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.855+0000 7fb5dffff640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb5c80a2cf0 0x7fb5c80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:21.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.856+0000 7fb5dffff640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb5c80a2cf0 0x7fb5c80a51b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0005e10 tx=0x7fb5d0005da0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:21.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:21.859+0000 7fb5dd7fa640 1 -- 172.21.15.152:0/1803030783 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5d40bc520 con 0x7fb5e01036e0 2024-09-11T22:04:22.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.069+0000 7fb5e62d1640 1 -- 172.21.15.152:0/1803030783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5e010a2b0 con 0x7fb5e01036e0 2024-09-11T22:04:22.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.069+0000 7fb5dd7fa640 1 -- 172.21.15.152:0/1803030783 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11923 (secure 0 0 0) 0x7fb5d40bbe20 con 0x7fb5e01036e0 2024-09-11T22:04:22.070 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:22.071 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"btime":"2024-09-11T22:04:19:354379+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:18.708640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:04:22.071 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 24 2024-09-11T22:04:22.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 -- 172.21.15.152:0/1803030783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb5c80a2cf0 msgr2=0x7fb5c80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:22.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb5c80a2cf0 0x7fb5c80a51b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0005e10 tx=0x7fb5d0005da0 comp rx=0 tx=0).stop 2024-09-11T22:04:22.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 -- 172.21.15.152:0/1803030783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5e01036e0 msgr2=0x7fb5e0198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:22.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5e01036e0 0x7fb5e0198a80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4005940 tx=0x7fb5d40042f0 comp rx=0 tx=0).stop 2024-09-11T22:04:22.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 -- 172.21.15.152:0/1803030783 shutdown_connections 2024-09-11T22:04:22.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb5c80a2cf0 0x7fb5c80a51b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:22.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e01082a0 0x7fb5e019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:22.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5e01036e0 0x7fb5e0198a80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:22.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 --2- 172.21.15.152:0/1803030783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e0102d30 0x7fb5e0198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:22.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 -- 172.21.15.152:0/1803030783 >> 172.21.15.152:0/1803030783 conn(0x7fb5e00fc7d0 msgr2=0x7fb5e0105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:22.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 -- 172.21.15.152:0/1803030783 shutdown_connections 2024-09-11T22:04:22.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:22.072+0000 7fb5e62d1640 1 -- 172.21.15.152:0/1803030783 wait complete. 2024-09-11T22:04:22.613 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: Updating smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:04:22.613 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: Updating smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:04:22.613 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:04:22.614 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:04:22.614 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:04:22.614 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:04:22.614 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:04:22.614 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: Updating smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:04:22.614 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: Updating smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:04:22.614 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:04:22.614 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1803030783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:22.614 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:22 smithi152 ceph-mon[31188]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-09-11T22:04:22.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: Updating smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:04:22.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: Updating smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:04:22.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:04:22.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:04:22.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:04:22.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:04:22.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:04:22.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: Updating smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:04:22.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: Updating smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:04:22.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:04:22.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1803030783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:22.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:22 smithi179 ceph-mon[35603]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-09-11T22:04:22.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: Updating smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:04:22.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: Updating smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:04:22.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:04:22.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:04:22.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:04:22.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:04:22.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: Updating smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:04:22.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: Updating smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:04:22.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: Updating smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:04:22.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:04:22.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1803030783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:22.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:22 smithi193 ceph-mon[35545]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-09-11T22:04:22.975 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-11T22:04:22.975 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-11T22:04:22.975 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:04:23.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.077+0000 7f7c79a53640 1 -- 172.21.15.152:0/1004414442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c7410c0c0 msgr2=0x7f7c7410e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.077+0000 7f7c79a53640 1 --2- 172.21.15.152:0/1004414442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c7410c0c0 0x7f7c7410e560 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009900 tx=0x7f7c6c02a480 comp rx=0 tx=0).stop 2024-09-11T22:04:23.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.077+0000 7f7c79a53640 1 -- 172.21.15.152:0/1004414442 shutdown_connections 2024-09-11T22:04:23.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.077+0000 7f7c79a53640 1 --2- 172.21.15.152:0/1004414442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c7410c0c0 0x7f7c7410e560 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.077+0000 7f7c79a53640 1 --2- 172.21.15.152:0/1004414442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c74103610 0x7f7c7410baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.077+0000 7f7c79a53640 1 --2- 172.21.15.152:0/1004414442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c74102cf0 0x7f7c741030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.077+0000 7f7c79a53640 1 -- 172.21.15.152:0/1004414442 >> 172.21.15.152:0/1004414442 conn(0x7f7c740fc6a0 msgr2=0x7f7c740feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.077+0000 7f7c79a53640 1 -- 172.21.15.152:0/1004414442 shutdown_connections 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.077+0000 7f7c79a53640 1 -- 172.21.15.152:0/1004414442 wait complete. 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c79a53640 1 Processor -- start 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c79a53640 1 -- start start 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c79a53640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c74102cf0 0x7f7c74198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c79a53640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c74103610 0x7f7c74198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c79a53640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c7410c0c0 0x7f7c7419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c79a53640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74111ec0 con 0x7f7c74103610 2024-09-11T22:04:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c79a53640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74111d40 con 0x7f7c7410c0c0 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c79a53640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74112040 con 0x7f7c74102cf0 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c727fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c74103610 0x7f7c74198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c727fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c74103610 0x7f7c74198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52490/0 (socket says 172.21.15.152:52490) 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c727fc640 1 -- 172.21.15.152:0/3812894289 learned_addr learned my addr 172.21.15.152:0/3812894289 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.078+0000 7f7c737fe640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c7410c0c0 0x7f7c7419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c72ffd640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c74102cf0 0x7f7c74198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c727fc640 1 -- 172.21.15.152:0/3812894289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c74102cf0 msgr2=0x7f7c74198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c727fc640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c74102cf0 0x7f7c74198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c727fc640 1 -- 172.21.15.152:0/3812894289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c7410c0c0 msgr2=0x7f7c7419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c727fc640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c7410c0c0 0x7f7c7419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c727fc640 1 -- 172.21.15.152:0/3812894289 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7419d340 con 0x7f7c74103610 2024-09-11T22:04:23.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c737fe640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c7410c0c0 0x7f7c7419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:23.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c72ffd640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c74102cf0 0x7f7c74198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:23.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c727fc640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c74103610 0x7f7c74198890 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c920 tx=0x7f7c6400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:23.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c78a51640 1 -- 172.21.15.152:0/3812894289 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64007c70 con 0x7f7c74103610 2024-09-11T22:04:23.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c78a51640 1 -- 172.21.15.152:0/3812894289 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c64007e10 con 0x7f7c74103610 2024-09-11T22:04:23.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c78a51640 1 -- 172.21.15.152:0/3812894289 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64018890 con 0x7f7c74103610 2024-09-11T22:04:23.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c79a53640 1 -- 172.21.15.152:0/3812894289 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7419d630 con 0x7f7c74103610 2024-09-11T22:04:23.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.079+0000 7f7c79a53640 1 -- 172.21.15.152:0/3812894289 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c741a4ec0 con 0x7f7c74103610 2024-09-11T22:04:23.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.080+0000 7f7c79a53640 1 -- 172.21.15.152:0/3812894289 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c741030d0 con 0x7f7c74103610 2024-09-11T22:04:23.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.081+0000 7f7c78a51640 1 -- 172.21.15.152:0/3812894289 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f7c64018a70 con 0x7f7c74103610 2024-09-11T22:04:23.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.082+0000 7f7c78a51640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c5c0a2ea0 0x7f7c5c0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.082+0000 7f7c72ffd640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c5c0a2ea0 0x7f7c5c0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.082+0000 7f7c78a51640 1 -- 172.21.15.152:0/3812894289 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f7c640cf830 con 0x7f7c74103610 2024-09-11T22:04:23.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.082+0000 7f7c72ffd640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c5c0a2ea0 0x7f7c5c0a5360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7c68005c40 tx=0x7f7c6800a410 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:23.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.086+0000 7f7c78a51640 1 -- 172.21.15.152:0/3812894289 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c64014030 con 0x7f7c74103610 2024-09-11T22:04:23.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.251+0000 7f7c79a53640 1 -- 172.21.15.152:0/3812894289 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c740fe380 con 0x7f7c5c0a2ea0 2024-09-11T22:04:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.257+0000 7f7c78a51640 1 -- 172.21.15.152:0/3812894289 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257866 (secure 0 0 0) 0x7f7c740fe380 con 0x7f7c5c0a2ea0 2024-09-11T22:04:23.261 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:23.263 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-09-11T22:04:23.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.260+0000 7f7c79a53640 1 -- 172.21.15.152:0/3812894289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c5c0a2ea0 msgr2=0x7f7c5c0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.260+0000 7f7c79a53640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c5c0a2ea0 0x7f7c5c0a5360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7c68005c40 tx=0x7f7c6800a410 comp rx=0 tx=0).stop 2024-09-11T22:04:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.260+0000 7f7c79a53640 1 -- 172.21.15.152:0/3812894289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c74103610 msgr2=0x7f7c74198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.260+0000 7f7c79a53640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c74103610 0x7f7c74198890 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c920 tx=0x7f7c6400cde0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.261+0000 7f7c79a53640 1 -- 172.21.15.152:0/3812894289 shutdown_connections 2024-09-11T22:04:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.261+0000 7f7c79a53640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c5c0a2ea0 0x7f7c5c0a5360 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.261+0000 7f7c79a53640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c7410c0c0 0x7f7c7419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.261+0000 7f7c79a53640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c74103610 0x7f7c74198890 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.261+0000 7f7c79a53640 1 --2- 172.21.15.152:0/3812894289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c74102cf0 0x7f7c74198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.261+0000 7f7c79a53640 1 -- 172.21.15.152:0/3812894289 >> 172.21.15.152:0/3812894289 conn(0x7f7c740fc6a0 msgr2=0x7f7c740fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.261+0000 7f7c79a53640 1 -- 172.21.15.152:0/3812894289 shutdown_connections 2024-09-11T22:04:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.261+0000 7f7c79a53640 1 -- 172.21.15.152:0/3812894289 wait complete. 2024-09-11T22:04:23.272 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-11T22:04:21.370895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188148,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":819,"num_read_kb":569,"num_write":474,"num_write_kb":4377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368184,"kb_used_data":14684,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124573640,"statfs":{"total":1151940427776,"available":1151563407360,"internally_reserved":0,"allocated":15036416,"data_stored":8982108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.999580"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414391+0000","last_change":"2024-09-11T22:02:36.105689+0000","last_active":"2024-09-11T22:04:17.414391+0000","last_peered":"2024-09-11T22:04:17.414391+0000","last_clean":"2024-09-11T22:04:17.414391+0000","last_became_active":"2024-09-11T22:02:36.105128+0000","last_became_peered":"2024-09-11T22:02:36.105128+0000","last_unstale":"2024-09-11T22:04:17.414391+0000","last_undegraded":"2024-09-11T22:04:17.414391+0000","last_fullsized":"2024-09-11T22:04:17.414391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:18.018731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.410505+0000","last_change":"2024-09-11T22:02:36.096961+0000","last_active":"2024-09-11T22:04:17.410505+0000","last_peered":"2024-09-11T22:04:17.410505+0000","last_clean":"2024-09-11T22:04:17.410505+0000","last_became_active":"2024-09-11T22:02:36.096540+0000","last_became_peered":"2024-09-11T22:02:36.096540+0000","last_unstale":"2024-09-11T22:04:17.410505+0000","last_undegraded":"2024-09-11T22:04:17.410505+0000","last_fullsized":"2024-09-11T22:04:17.410505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:48.517125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413305+0000","last_change":"2024-09-11T22:02:36.108119+0000","last_active":"2024-09-11T22:04:17.413305+0000","last_peered":"2024-09-11T22:04:17.413305+0000","last_clean":"2024-09-11T22:04:17.413305+0000","last_became_active":"2024-09-11T22:02:36.107737+0000","last_became_peered":"2024-09-11T22:02:36.107737+0000","last_unstale":"2024-09-11T22:04:17.413305+0000","last_undegraded":"2024-09-11T22:04:17.413305+0000","last_fullsized":"2024-09-11T22:04:17.413305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:54.225935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395071+0000","last_change":"2024-09-11T22:02:36.107710+0000","last_active":"2024-09-11T22:04:17.395071+0000","last_peered":"2024-09-11T22:04:17.395071+0000","last_clean":"2024-09-11T22:04:17.395071+0000","last_became_active":"2024-09-11T22:02:36.107327+0000","last_became_peered":"2024-09-11T22:02:36.107327+0000","last_unstale":"2024-09-11T22:04:17.395071+0000","last_undegraded":"2024-09-11T22:04:17.395071+0000","last_fullsized":"2024-09-11T22:04:17.395071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.358535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396846+0000","last_change":"2024-09-11T22:02:36.100531+0000","last_active":"2024-09-11T22:04:17.396846+0000","last_peered":"2024-09-11T22:04:17.396846+0000","last_clean":"2024-09-11T22:04:17.396846+0000","last_became_active":"2024-09-11T22:02:36.100187+0000","last_became_peered":"2024-09-11T22:02:36.100187+0000","last_unstale":"2024-09-11T22:04:17.396846+0000","last_undegraded":"2024-09-11T22:04:17.396846+0000","last_fullsized":"2024-09-11T22:04:17.396846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.156080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397927+0000","last_change":"2024-09-11T22:02:36.101316+0000","last_active":"2024-09-11T22:04:17.397927+0000","last_peered":"2024-09-11T22:04:17.397927+0000","last_clean":"2024-09-11T22:04:17.397927+0000","last_became_active":"2024-09-11T22:02:36.100985+0000","last_became_peered":"2024-09-11T22:02:36.100985+0000","last_unstale":"2024-09-11T22:04:17.397927+0000","last_undegraded":"2024-09-11T22:04:17.397927+0000","last_fullsized":"2024-09-11T22:04:17.397927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:55.972974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.385307+0000","last_change":"2024-09-11T22:02:36.109146+0000","last_active":"2024-09-11T22:04:17.385307+0000","last_peered":"2024-09-11T22:04:17.385307+0000","last_clean":"2024-09-11T22:04:17.385307+0000","last_became_active":"2024-09-11T22:02:36.108817+0000","last_became_peered":"2024-09-11T22:02:36.108817+0000","last_unstale":"2024-09-11T22:04:17.385307+0000","last_undegraded":"2024-09-11T22:04:17.385307+0000","last_fullsized":"2024-09-11T22:04:17.385307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.222383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398948+0000","last_change":"2024-09-11T22:02:36.100362+0000","last_active":"2024-09-11T22:04:17.398948+0000","last_peered":"2024-09-11T22:04:17.398948+0000","last_clean":"2024-09-11T22:04:17.398948+0000","last_became_active":"2024-09-11T22:02:36.100088+0000","last_became_peered":"2024-09-11T22:02:36.100088+0000","last_unstale":"2024-09-11T22:04:17.398948+0000","last_undegraded":"2024-09-11T22:04:17.398948+0000","last_fullsized":"2024-09-11T22:04:17.398948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.478879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401808+0000","last_change":"2024-09-11T22:02:36.106360+0000","last_active":"2024-09-11T22:04:17.401808+0000","last_peered":"2024-09-11T22:04:17.401808+0000","last_clean":"2024-09-11T22:04:17.401808+0000","last_became_active":"2024-09-11T22:02:36.105994+0000","last_became_peered":"2024-09-11T22:02:36.105994+0000","last_unstale":"2024-09-11T22:04:17.401808+0000","last_undegraded":"2024-09-11T22:04:17.401808+0000","last_fullsized":"2024-09-11T22:04:17.401808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:33.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.394089+0000","last_change":"2024-09-11T22:02:36.109477+0000","last_active":"2024-09-11T22:04:17.394089+0000","last_peered":"2024-09-11T22:04:17.394089+0000","last_clean":"2024-09-11T22:04:17.394089+0000","last_became_active":"2024-09-11T22:02:36.109077+0000","last_became_peered":"2024-09-11T22:02:36.109077+0000","last_unstale":"2024-09-11T22:04:17.394089+0000","last_undegraded":"2024-09-11T22:04:17.394089+0000","last_fullsized":"2024-09-11T22:04:17.394089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.862359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399588+0000","last_change":"2024-09-11T22:02:36.112998+0000","last_active":"2024-09-11T22:04:17.399588+0000","last_peered":"2024-09-11T22:04:17.399588+0000","last_clean":"2024-09-11T22:04:17.399588+0000","last_became_active":"2024-09-11T22:02:36.112649+0000","last_became_peered":"2024-09-11T22:02:36.112649+0000","last_unstale":"2024-09-11T22:04:17.399588+0000","last_undegraded":"2024-09-11T22:04:17.399588+0000","last_fullsized":"2024-09-11T22:04:17.399588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:01.582572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398221+0000","last_change":"2024-09-11T22:02:36.099591+0000","last_active":"2024-09-11T22:04:17.398221+0000","last_peered":"2024-09-11T22:04:17.398221+0000","last_clean":"2024-09-11T22:04:17.398221+0000","last_became_active":"2024-09-11T22:02:36.099269+0000","last_became_peered":"2024-09-11T22:02:36.099269+0000","last_unstale":"2024-09-11T22:04:17.398221+0000","last_undegraded":"2024-09-11T22:04:17.398221+0000","last_fullsized":"2024-09-11T22:04:17.398221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:10.918188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403970+0000","last_change":"2024-09-11T22:02:36.100056+0000","last_active":"2024-09-11T22:04:17.403970+0000","last_peered":"2024-09-11T22:04:17.403970+0000","last_clean":"2024-09-11T22:04:17.403970+0000","last_became_active":"2024-09-11T22:02:36.099717+0000","last_became_peered":"2024-09-11T22:02:36.099717+0000","last_unstale":"2024-09-11T22:04:17.403970+0000","last_undegraded":"2024-09-11T22:04:17.403970+0000","last_fullsized":"2024-09-11T22:04:17.403970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.486256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411675+0000","last_change":"2024-09-11T22:02:36.097281+0000","last_active":"2024-09-11T22:04:17.411675+0000","last_peered":"2024-09-11T22:04:17.411675+0000","last_clean":"2024-09-11T22:04:17.411675+0000","last_became_active":"2024-09-11T22:02:36.096768+0000","last_became_peered":"2024-09-11T22:02:36.096768+0000","last_unstale":"2024-09-11T22:04:17.411675+0000","last_undegraded":"2024-09-11T22:04:17.411675+0000","last_fullsized":"2024-09-11T22:04:17.411675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:31.232578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412627+0000","last_change":"2024-09-11T22:02:55.351065+0000","last_active":"2024-09-11T22:04:17.412627+0000","last_peered":"2024-09-11T22:04:17.412627+0000","last_clean":"2024-09-11T22:04:17.412627+0000","last_became_active":"2024-09-11T22:02:55.350669+0000","last_became_peered":"2024-09-11T22:02:55.350669+0000","last_unstale":"2024-09-11T22:04:17.412627+0000","last_undegraded":"2024-09-11T22:04:17.412627+0000","last_fullsized":"2024-09-11T22:04:17.412627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:51.799060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414040+0000","last_change":"2024-09-11T22:02:36.109573+0000","last_active":"2024-09-11T22:04:17.414040+0000","last_peered":"2024-09-11T22:04:17.414040+0000","last_clean":"2024-09-11T22:04:17.414040+0000","last_became_active":"2024-09-11T22:02:36.109019+0000","last_became_peered":"2024-09-11T22:02:36.109019+0000","last_unstale":"2024-09-11T22:04:17.414040+0000","last_undegraded":"2024-09-11T22:04:17.414040+0000","last_fullsized":"2024-09-11T22:04:17.414040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:39.699762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414508+0000","last_change":"2024-09-11T22:02:36.105427+0000","last_active":"2024-09-11T22:04:17.414508+0000","last_peered":"2024-09-11T22:04:17.414508+0000","last_clean":"2024-09-11T22:04:17.414508+0000","last_became_active":"2024-09-11T22:02:36.104712+0000","last_became_peered":"2024-09-11T22:02:36.104712+0000","last_unstale":"2024-09-11T22:04:17.414508+0000","last_undegraded":"2024-09-11T22:04:17.414508+0000","last_fullsized":"2024-09-11T22:04:17.414508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:45.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399613+0000","last_change":"2024-09-11T22:02:36.097925+0000","last_active":"2024-09-11T22:04:17.399613+0000","last_peered":"2024-09-11T22:04:17.399613+0000","last_clean":"2024-09-11T22:04:17.399613+0000","last_became_active":"2024-09-11T22:02:36.097649+0000","last_became_peered":"2024-09-11T22:02:36.097649+0000","last_unstale":"2024-09-11T22:04:17.399613+0000","last_undegraded":"2024-09-11T22:04:17.399613+0000","last_fullsized":"2024-09-11T22:04:17.399613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.272197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400978+0000","last_change":"2024-09-11T22:02:36.107266+0000","last_active":"2024-09-11T22:04:17.400978+0000","last_peered":"2024-09-11T22:04:17.400978+0000","last_clean":"2024-09-11T22:04:17.400978+0000","last_became_active":"2024-09-11T22:02:36.106865+0000","last_became_peered":"2024-09-11T22:02:36.106865+0000","last_unstale":"2024-09-11T22:04:17.400978+0000","last_undegraded":"2024-09-11T22:04:17.400978+0000","last_fullsized":"2024-09-11T22:04:17.400978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:53.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396320+0000","last_change":"2024-09-11T22:02:55.349854+0000","last_active":"2024-09-11T22:04:17.396320+0000","last_peered":"2024-09-11T22:04:17.396320+0000","last_clean":"2024-09-11T22:04:17.396320+0000","last_became_active":"2024-09-11T22:02:55.349521+0000","last_became_peered":"2024-09-11T22:02:55.349521+0000","last_unstale":"2024-09-11T22:04:17.396320+0000","last_undegraded":"2024-09-11T22:04:17.396320+0000","last_fullsized":"2024-09-11T22:04:17.396320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406936+0000","last_change":"2024-09-11T22:02:36.110460+0000","last_active":"2024-09-11T22:04:17.406936+0000","last_peered":"2024-09-11T22:04:17.406936+0000","last_clean":"2024-09-11T22:04:17.406936+0000","last_became_active":"2024-09-11T22:02:36.110136+0000","last_became_peered":"2024-09-11T22:02:36.110136+0000","last_unstale":"2024-09-11T22:04:17.406936+0000","last_undegraded":"2024-09-11T22:04:17.406936+0000","last_fullsized":"2024-09-11T22:04:17.406936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:30.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403836+0000","last_change":"2024-09-11T22:02:36.111403+0000","last_active":"2024-09-11T22:04:17.403836+0000","last_peered":"2024-09-11T22:04:17.403836+0000","last_clean":"2024-09-11T22:04:17.403836+0000","last_became_active":"2024-09-11T22:02:36.110976+0000","last_became_peered":"2024-09-11T22:02:36.110976+0000","last_unstale":"2024-09-11T22:04:17.403836+0000","last_undegraded":"2024-09-11T22:04:17.403836+0000","last_fullsized":"2024-09-11T22:04:17.403836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:03.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.405071+0000","last_change":"2024-09-11T22:02:36.110002+0000","last_active":"2024-09-11T22:04:17.405071+0000","last_peered":"2024-09-11T22:04:17.405071+0000","last_clean":"2024-09-11T22:04:17.405071+0000","last_became_active":"2024-09-11T22:02:36.109694+0000","last_became_peered":"2024-09-11T22:02:36.109694+0000","last_unstale":"2024-09-11T22:04:17.405071+0000","last_undegraded":"2024-09-11T22:04:17.405071+0000","last_fullsized":"2024-09-11T22:04:17.405071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:00.338509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406553+0000","last_change":"2024-09-11T22:02:36.101638+0000","last_active":"2024-09-11T22:04:17.406553+0000","last_peered":"2024-09-11T22:04:17.406553+0000","last_clean":"2024-09-11T22:04:17.406553+0000","last_became_active":"2024-09-11T22:02:36.101363+0000","last_became_peered":"2024-09-11T22:02:36.101363+0000","last_unstale":"2024-09-11T22:04:17.406553+0000","last_undegraded":"2024-09-11T22:04:17.406553+0000","last_fullsized":"2024-09-11T22:04:17.406553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:35.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399143+0000","last_change":"2024-09-11T22:02:36.109250+0000","last_active":"2024-09-11T22:04:17.399143+0000","last_peered":"2024-09-11T22:04:17.399143+0000","last_clean":"2024-09-11T22:04:17.399143+0000","last_became_active":"2024-09-11T22:02:36.108931+0000","last_became_peered":"2024-09-11T22:02:36.108931+0000","last_unstale":"2024-09-11T22:04:17.399143+0000","last_undegraded":"2024-09-11T22:04:17.399143+0000","last_fullsized":"2024-09-11T22:04:17.399143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:09.616621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400102+0000","last_change":"2024-09-11T22:02:36.113064+0000","last_active":"2024-09-11T22:04:17.400102+0000","last_peered":"2024-09-11T22:04:17.400102+0000","last_clean":"2024-09-11T22:04:17.400102+0000","last_became_active":"2024-09-11T22:02:36.112674+0000","last_became_peered":"2024-09-11T22:02:36.112674+0000","last_unstale":"2024-09-11T22:04:17.400102+0000","last_undegraded":"2024-09-11T22:04:17.400102+0000","last_fullsized":"2024-09-11T22:04:17.400102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:17.923053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395397+0000","last_change":"2024-09-11T22:02:36.101799+0000","last_active":"2024-09-11T22:04:17.395397+0000","last_peered":"2024-09-11T22:04:17.395397+0000","last_clean":"2024-09-11T22:04:17.395397+0000","last_became_active":"2024-09-11T22:02:36.101429+0000","last_became_peered":"2024-09-11T22:02:36.101429+0000","last_unstale":"2024-09-11T22:04:17.395397+0000","last_undegraded":"2024-09-11T22:04:17.395397+0000","last_fullsized":"2024-09-11T22:04:17.395397+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.597619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402304+0000","last_change":"2024-09-11T22:02:36.100993+0000","last_active":"2024-09-11T22:04:17.402304+0000","last_peered":"2024-09-11T22:04:17.402304+0000","last_clean":"2024-09-11T22:04:17.402304+0000","last_became_active":"2024-09-11T22:02:36.100678+0000","last_became_peered":"2024-09-11T22:02:36.100678+0000","last_unstale":"2024-09-11T22:04:17.402304+0000","last_undegraded":"2024-09-11T22:04:17.402304+0000","last_fullsized":"2024-09-11T22:04:17.402304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:18.808422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.408677+0000","last_change":"2024-09-11T22:02:36.103507+0000","last_active":"2024-09-11T22:04:17.408677+0000","last_peered":"2024-09-11T22:04:17.408677+0000","last_clean":"2024-09-11T22:04:17.408677+0000","last_became_active":"2024-09-11T22:02:36.103228+0000","last_became_peered":"2024-09-11T22:02:36.103228+0000","last_unstale":"2024-09-11T22:04:17.408677+0000","last_undegraded":"2024-09-11T22:04:17.408677+0000","last_fullsized":"2024-09-11T22:04:17.408677+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.898635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413675+0000","last_change":"2024-09-11T22:02:36.104734+0000","last_active":"2024-09-11T22:04:17.413675+0000","last_peered":"2024-09-11T22:04:17.413675+0000","last_clean":"2024-09-11T22:04:17.413675+0000","last_became_active":"2024-09-11T22:02:36.103974+0000","last_became_peered":"2024-09-11T22:02:36.103974+0000","last_unstale":"2024-09-11T22:04:17.413675+0000","last_undegraded":"2024-09-11T22:04:17.413675+0000","last_fullsized":"2024-09-11T22:04:17.413675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:54.142031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397564+0000","last_change":"2024-09-11T22:02:36.106103+0000","last_active":"2024-09-11T22:04:17.397564+0000","last_peered":"2024-09-11T22:04:17.397564+0000","last_clean":"2024-09-11T22:04:17.397564+0000","last_became_active":"2024-09-11T22:02:36.105792+0000","last_became_peered":"2024-09-11T22:02:36.105792+0000","last_unstale":"2024-09-11T22:04:17.397564+0000","last_undegraded":"2024-09-11T22:04:17.397564+0000","last_fullsized":"2024-09-11T22:04:17.397564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:06.607094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397456+0000","last_change":"2024-09-11T22:02:36.104147+0000","last_active":"2024-09-11T22:04:17.397456+0000","last_peered":"2024-09-11T22:04:17.397456+0000","last_clean":"2024-09-11T22:04:17.397456+0000","last_became_active":"2024-09-11T22:02:36.103782+0000","last_became_peered":"2024-09-11T22:02:36.103782+0000","last_unstale":"2024-09-11T22:04:17.397456+0000","last_undegraded":"2024-09-11T22:04:17.397456+0000","last_fullsized":"2024-09-11T22:04:17.397456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.127609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.392542+0000","last_change":"2024-09-11T22:02:36.101259+0000","last_active":"2024-09-11T22:04:17.392542+0000","last_peered":"2024-09-11T22:04:17.392542+0000","last_clean":"2024-09-11T22:04:17.392542+0000","last_became_active":"2024-09-11T22:02:36.100761+0000","last_became_peered":"2024-09-11T22:02:36.100761+0000","last_unstale":"2024-09-11T22:04:17.392542+0000","last_undegraded":"2024-09-11T22:04:17.392542+0000","last_fullsized":"2024-09-11T22:04:17.392542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:47.045252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":130,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.972324+0000","last_change":"2024-09-11T22:02:34.084522+0000","last_active":"2024-09-11T22:04:17.972324+0000","last_peered":"2024-09-11T22:04:17.972324+0000","last_clean":"2024-09-11T22:04:17.972324+0000","last_became_active":"2024-09-11T22:02:34.084211+0000","last_became_peered":"2024-09-11T22:02:34.084211+0000","last_unstale":"2024-09-11T22:04:17.972324+0000","last_undegraded":"2024-09-11T22:04:17.972324+0000","last_fullsized":"2024-09-11T22:04:17.972324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:18.963998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406451+0000","last_change":"2024-09-11T22:02:36.106890+0000","last_active":"2024-09-11T22:04:17.406451+0000","last_peered":"2024-09-11T22:04:17.406451+0000","last_clean":"2024-09-11T22:04:17.406451+0000","last_became_active":"2024-09-11T22:02:36.105255+0000","last_became_peered":"2024-09-11T22:02:36.105255+0000","last_unstale":"2024-09-11T22:04:17.406451+0000","last_undegraded":"2024-09-11T22:04:17.406451+0000","last_fullsized":"2024-09-11T22:04:17.406451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.995542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.355903+0000","last_change":"2024-09-11T22:02:34.079967+0000","last_active":"2024-09-11T22:04:17.355903+0000","last_peered":"2024-09-11T22:04:17.355903+0000","last_clean":"2024-09-11T22:04:17.355903+0000","last_became_active":"2024-09-11T22:02:34.079649+0000","last_became_peered":"2024-09-11T22:02:34.079649+0000","last_unstale":"2024-09-11T22:04:17.355903+0000","last_undegraded":"2024-09-11T22:04:17.355903+0000","last_fullsized":"2024-09-11T22:04:17.355903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.661256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.351613+0000","last_change":"2024-09-11T22:02:34.079850+0000","last_active":"2024-09-11T22:04:17.351613+0000","last_peered":"2024-09-11T22:04:17.351613+0000","last_clean":"2024-09-11T22:04:17.351613+0000","last_became_active":"2024-09-11T22:02:34.079514+0000","last_became_peered":"2024-09-11T22:02:34.079514+0000","last_unstale":"2024-09-11T22:04:17.351613+0000","last_undegraded":"2024-09-11T22:04:17.351613+0000","last_fullsized":"2024-09-11T22:04:17.351613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.359482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407046+0000","last_change":"2024-09-11T22:02:36.099310+0000","last_active":"2024-09-11T22:04:17.407046+0000","last_peered":"2024-09-11T22:04:17.407046+0000","last_clean":"2024-09-11T22:04:17.407046+0000","last_became_active":"2024-09-11T22:02:36.099026+0000","last_became_peered":"2024-09-11T22:02:36.099026+0000","last_unstale":"2024-09-11T22:04:17.407046+0000","last_undegraded":"2024-09-11T22:04:17.407046+0000","last_fullsized":"2024-09-11T22:04:17.407046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:57.570147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358629+0000","last_change":"2024-09-11T22:02:34.083757+0000","last_active":"2024-09-11T22:04:17.358629+0000","last_peered":"2024-09-11T22:04:17.358629+0000","last_clean":"2024-09-11T22:04:17.358629+0000","last_became_active":"2024-09-11T22:02:34.083467+0000","last_became_peered":"2024-09-11T22:02:34.083467+0000","last_unstale":"2024-09-11T22:04:17.358629+0000","last_undegraded":"2024-09-11T22:04:17.358629+0000","last_fullsized":"2024-09-11T22:04:17.358629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.546772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407844+0000","last_change":"2024-09-11T22:02:36.098939+0000","last_active":"2024-09-11T22:04:17.407844+0000","last_peered":"2024-09-11T22:04:17.407844+0000","last_clean":"2024-09-11T22:04:17.407844+0000","last_became_active":"2024-09-11T22:02:36.098631+0000","last_became_peered":"2024-09-11T22:02:36.098631+0000","last_unstale":"2024-09-11T22:04:17.407844+0000","last_undegraded":"2024-09-11T22:04:17.407844+0000","last_fullsized":"2024-09-11T22:04:17.407844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:07.663332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":121,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.361402+0000","last_change":"2024-09-11T22:02:34.085325+0000","last_active":"2024-09-11T22:04:17.361402+0000","last_peered":"2024-09-11T22:04:17.361402+0000","last_clean":"2024-09-11T22:04:17.361402+0000","last_became_active":"2024-09-11T22:02:34.084967+0000","last_became_peered":"2024-09-11T22:02:34.084967+0000","last_unstale":"2024-09-11T22:04:17.361402+0000","last_undegraded":"2024-09-11T22:04:17.361402+0000","last_fullsized":"2024-09-11T22:04:17.361402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:35.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396449+0000","last_change":"2024-09-11T22:02:36.104454+0000","last_active":"2024-09-11T22:04:17.396449+0000","last_peered":"2024-09-11T22:04:17.396449+0000","last_clean":"2024-09-11T22:04:17.396449+0000","last_became_active":"2024-09-11T22:02:36.103988+0000","last_became_peered":"2024-09-11T22:02:36.103988+0000","last_unstale":"2024-09-11T22:04:17.396449+0000","last_undegraded":"2024-09-11T22:04:17.396449+0000","last_fullsized":"2024-09-11T22:04:17.396449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:32.748524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362192+0000","last_change":"2024-09-11T22:02:55.548642+0000","last_active":"2024-09-11T22:04:17.362192+0000","last_peered":"2024-09-11T22:04:17.362192+0000","last_clean":"2024-09-11T22:04:17.362192+0000","last_became_active":"2024-09-11T22:02:55.545771+0000","last_became_peered":"2024-09-11T22:02:55.545771+0000","last_unstale":"2024-09-11T22:04:17.362192+0000","last_undegraded":"2024-09-11T22:04:17.362192+0000","last_fullsized":"2024-09-11T22:04:17.362192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:03.431986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411866+0000","last_change":"2024-09-11T22:02:55.349125+0000","last_active":"2024-09-11T22:04:17.411866+0000","last_peered":"2024-09-11T22:04:17.411866+0000","last_clean":"2024-09-11T22:04:17.411866+0000","last_became_active":"2024-09-11T22:02:55.348746+0000","last_became_peered":"2024-09-11T22:02:55.348746+0000","last_unstale":"2024-09-11T22:04:17.411866+0000","last_undegraded":"2024-09-11T22:04:17.411866+0000","last_fullsized":"2024-09-11T22:04:17.411866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358974+0000","last_change":"2024-09-11T22:02:34.089793+0000","last_active":"2024-09-11T22:04:17.358974+0000","last_peered":"2024-09-11T22:04:17.358974+0000","last_clean":"2024-09-11T22:04:17.358974+0000","last_became_active":"2024-09-11T22:02:34.089468+0000","last_became_peered":"2024-09-11T22:02:34.089468+0000","last_unstale":"2024-09-11T22:04:17.358974+0000","last_undegraded":"2024-09-11T22:04:17.358974+0000","last_fullsized":"2024-09-11T22:04:17.358974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:10:21.034822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401964+0000","last_change":"2024-09-11T22:02:36.106224+0000","last_active":"2024-09-11T22:04:17.401964+0000","last_peered":"2024-09-11T22:04:17.401964+0000","last_clean":"2024-09-11T22:04:17.401964+0000","last_became_active":"2024-09-11T22:02:36.105903+0000","last_became_peered":"2024-09-11T22:02:36.105903+0000","last_unstale":"2024-09-11T22:04:17.401964+0000","last_undegraded":"2024-09-11T22:04:17.401964+0000","last_fullsized":"2024-09-11T22:04:17.401964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.354653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":255,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.975937+0000","last_change":"2024-09-11T22:02:34.082150+0000","last_active":"2024-09-11T22:04:17.975937+0000","last_peered":"2024-09-11T22:04:17.975937+0000","last_clean":"2024-09-11T22:04:17.975937+0000","last_became_active":"2024-09-11T22:02:34.081822+0000","last_became_peered":"2024-09-11T22:02:34.081822+0000","last_unstale":"2024-09-11T22:04:17.975937+0000","last_undegraded":"2024-09-11T22:04:17.975937+0000","last_fullsized":"2024-09-11T22:04:17.975937+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:39.320410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":163,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.386796+0000","last_change":"2024-09-11T22:02:36.112124+0000","last_active":"2024-09-11T22:04:17.386796+0000","last_peered":"2024-09-11T22:04:17.386796+0000","last_clean":"2024-09-11T22:04:17.386796+0000","last_became_active":"2024-09-11T22:02:36.111739+0000","last_became_peered":"2024-09-11T22:02:36.111739+0000","last_unstale":"2024-09-11T22:04:17.386796+0000","last_undegraded":"2024-09-11T22:04:17.386796+0000","last_fullsized":"2024-09-11T22:04:17.386796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:52.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352659+0000","last_change":"2024-09-11T22:02:34.083047+0000","last_active":"2024-09-11T22:04:17.352659+0000","last_peered":"2024-09-11T22:04:17.352659+0000","last_clean":"2024-09-11T22:04:17.352659+0000","last_became_active":"2024-09-11T22:02:34.082406+0000","last_became_peered":"2024-09-11T22:02:34.082406+0000","last_unstale":"2024-09-11T22:04:17.352659+0000","last_undegraded":"2024-09-11T22:04:17.352659+0000","last_fullsized":"2024-09-11T22:04:17.352659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:33.249337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407254+0000","last_change":"2024-09-11T22:02:36.108859+0000","last_active":"2024-09-11T22:04:17.407254+0000","last_peered":"2024-09-11T22:04:17.407254+0000","last_clean":"2024-09-11T22:04:17.407254+0000","last_became_active":"2024-09-11T22:02:36.108558+0000","last_became_peered":"2024-09-11T22:02:36.108558+0000","last_unstale":"2024-09-11T22:04:17.407254+0000","last_undegraded":"2024-09-11T22:04:17.407254+0000","last_fullsized":"2024-09-11T22:04:17.407254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.430672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358635+0000","last_change":"2024-09-11T22:02:34.080560+0000","last_active":"2024-09-11T22:04:17.358635+0000","last_peered":"2024-09-11T22:04:17.358635+0000","last_clean":"2024-09-11T22:04:17.358635+0000","last_became_active":"2024-09-11T22:02:34.080262+0000","last_became_peered":"2024-09-11T22:02:34.080262+0000","last_unstale":"2024-09-11T22:04:17.358635+0000","last_undegraded":"2024-09-11T22:04:17.358635+0000","last_fullsized":"2024-09-11T22:04:17.358635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:44.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403367+0000","last_change":"2024-09-11T22:02:36.107722+0000","last_active":"2024-09-11T22:04:17.403367+0000","last_peered":"2024-09-11T22:04:17.403367+0000","last_clean":"2024-09-11T22:04:17.403367+0000","last_became_active":"2024-09-11T22:02:36.107219+0000","last_became_peered":"2024-09-11T22:02:36.107219+0000","last_unstale":"2024-09-11T22:04:17.403367+0000","last_undegraded":"2024-09-11T22:04:17.403367+0000","last_fullsized":"2024-09-11T22:04:17.403367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.576045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'7","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.972083+0000","last_change":"2024-09-11T22:02:34.083573+0000","last_active":"2024-09-11T22:04:17.972083+0000","last_peered":"2024-09-11T22:04:17.972083+0000","last_clean":"2024-09-11T22:04:17.972083+0000","last_became_active":"2024-09-11T22:02:34.083277+0000","last_became_peered":"2024-09-11T22:02:34.083277+0000","last_unstale":"2024-09-11T22:04:17.972083+0000","last_undegraded":"2024-09-11T22:04:17.972083+0000","last_fullsized":"2024-09-11T22:04:17.972083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:31.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":5,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.382984+0000","last_change":"2024-09-11T22:02:36.105075+0000","last_active":"2024-09-11T22:04:17.382984+0000","last_peered":"2024-09-11T22:04:17.382984+0000","last_clean":"2024-09-11T22:04:17.382984+0000","last_became_active":"2024-09-11T22:02:36.104022+0000","last_became_peered":"2024-09-11T22:02:36.104022+0000","last_unstale":"2024-09-11T22:04:17.382984+0000","last_undegraded":"2024-09-11T22:04:17.382984+0000","last_fullsized":"2024-09-11T22:04:17.382984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.693146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.366650+0000","last_change":"2024-09-11T22:02:34.088727+0000","last_active":"2024-09-11T22:04:17.366650+0000","last_peered":"2024-09-11T22:04:17.366650+0000","last_clean":"2024-09-11T22:04:17.366650+0000","last_became_active":"2024-09-11T22:02:34.088394+0000","last_became_peered":"2024-09-11T22:02:34.088394+0000","last_unstale":"2024-09-11T22:04:17.366650+0000","last_undegraded":"2024-09-11T22:04:17.366650+0000","last_fullsized":"2024-09-11T22:04:17.366650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:11.809765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399053+0000","last_change":"2024-09-11T22:02:36.104522+0000","last_active":"2024-09-11T22:04:17.399053+0000","last_peered":"2024-09-11T22:04:17.399053+0000","last_clean":"2024-09-11T22:04:17.399053+0000","last_became_active":"2024-09-11T22:02:36.104181+0000","last_became_peered":"2024-09-11T22:02:36.104181+0000","last_unstale":"2024-09-11T22:04:17.399053+0000","last_undegraded":"2024-09-11T22:04:17.399053+0000","last_fullsized":"2024-09-11T22:04:17.399053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:08.139180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368060+0000","last_change":"2024-09-11T22:02:34.080341+0000","last_active":"2024-09-11T22:04:17.368060+0000","last_peered":"2024-09-11T22:04:17.368060+0000","last_clean":"2024-09-11T22:04:17.368060+0000","last_became_active":"2024-09-11T22:02:34.078761+0000","last_became_peered":"2024-09-11T22:02:34.078761+0000","last_unstale":"2024-09-11T22:04:17.368060+0000","last_undegraded":"2024-09-11T22:04:17.368060+0000","last_fullsized":"2024-09-11T22:04:17.368060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393697+0000","last_change":"2024-09-11T22:02:55.545135+0000","last_active":"2024-09-11T22:04:17.393697+0000","last_peered":"2024-09-11T22:04:17.393697+0000","last_clean":"2024-09-11T22:04:17.393697+0000","last_became_active":"2024-09-11T22:02:55.544785+0000","last_became_peered":"2024-09-11T22:02:55.544785+0000","last_unstale":"2024-09-11T22:04:17.393697+0000","last_undegraded":"2024-09-11T22:04:17.393697+0000","last_fullsized":"2024-09-11T22:04:17.393697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:05.815828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352013+0000","last_change":"2024-09-11T22:02:34.082364+0000","last_active":"2024-09-11T22:04:17.352013+0000","last_peered":"2024-09-11T22:04:17.352013+0000","last_clean":"2024-09-11T22:04:17.352013+0000","last_became_active":"2024-09-11T22:02:34.081906+0000","last_became_peered":"2024-09-11T22:02:34.081906+0000","last_unstale":"2024-09-11T22:04:17.352013+0000","last_undegraded":"2024-09-11T22:04:17.352013+0000","last_fullsized":"2024-09-11T22:04:17.352013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:58.603942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.390768+0000","last_change":"2024-09-11T22:02:36.110725+0000","last_active":"2024-09-11T22:04:17.390768+0000","last_peered":"2024-09-11T22:04:17.390768+0000","last_clean":"2024-09-11T22:04:17.390768+0000","last_became_active":"2024-09-11T22:02:36.110401+0000","last_became_peered":"2024-09-11T22:02:36.110401+0000","last_unstale":"2024-09-11T22:04:17.390768+0000","last_undegraded":"2024-09-11T22:04:17.390768+0000","last_fullsized":"2024-09-11T22:04:17.390768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:41.789134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'39","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.608522+0000","last_change":"2024-09-11T22:02:34.082983+0000","last_active":"2024-09-11T22:04:17.608522+0000","last_peered":"2024-09-11T22:04:17.608522+0000","last_clean":"2024-09-11T22:04:17.608522+0000","last_became_active":"2024-09-11T22:02:34.082618+0000","last_became_peered":"2024-09-11T22:02:34.082618+0000","last_unstale":"2024-09-11T22:04:17.608522+0000","last_undegraded":"2024-09-11T22:04:17.608522+0000","last_fullsized":"2024-09-11T22:04:17.608522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.481228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393689+0000","last_change":"2024-09-11T22:02:36.108222+0000","last_active":"2024-09-11T22:04:17.393689+0000","last_peered":"2024-09-11T22:04:17.393689+0000","last_clean":"2024-09-11T22:04:17.393689+0000","last_became_active":"2024-09-11T22:02:36.107739+0000","last_became_peered":"2024-09-11T22:02:36.107739+0000","last_unstale":"2024-09-11T22:04:17.393689+0000","last_undegraded":"2024-09-11T22:04:17.393689+0000","last_fullsized":"2024-09-11T22:04:17.393689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:11.353217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352780+0000","last_change":"2024-09-11T22:02:34.090068+0000","last_active":"2024-09-11T22:04:17.352780+0000","last_peered":"2024-09-11T22:04:17.352780+0000","last_clean":"2024-09-11T22:04:17.352780+0000","last_became_active":"2024-09-11T22:02:34.089735+0000","last_became_peered":"2024-09-11T22:02:34.089735+0000","last_unstale":"2024-09-11T22:04:17.352780+0000","last_undegraded":"2024-09-11T22:04:17.352780+0000","last_fullsized":"2024-09-11T22:04:17.352780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:32.917459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401828+0000","last_change":"2024-09-11T22:02:36.108017+0000","last_active":"2024-09-11T22:04:17.401828+0000","last_peered":"2024-09-11T22:04:17.401828+0000","last_clean":"2024-09-11T22:04:17.401828+0000","last_became_active":"2024-09-11T22:02:36.107339+0000","last_became_peered":"2024-09-11T22:02:36.107339+0000","last_unstale":"2024-09-11T22:04:17.401828+0000","last_undegraded":"2024-09-11T22:04:17.401828+0000","last_fullsized":"2024-09-11T22:04:17.401828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:19.240354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":347,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.361518+0000","last_change":"2024-09-11T22:01:28.522567+0000","last_active":"2024-09-11T22:04:17.361518+0000","last_peered":"2024-09-11T22:04:17.361518+0000","last_clean":"2024-09-11T22:04:17.361518+0000","last_became_active":"2024-09-11T22:01:28.522079+0000","last_became_peered":"2024-09-11T22:01:28.522079+0000","last_unstale":"2024-09-11T22:04:17.361518+0000","last_undegraded":"2024-09-11T22:04:17.361518+0000","last_fullsized":"2024-09-11T22:04:17.361518+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_clean_scrub_stamp":"2024-09-11T21:58:11.245706+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:48.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365565+0000","last_change":"2024-09-11T22:02:34.080535+0000","last_active":"2024-09-11T22:04:17.365565+0000","last_peered":"2024-09-11T22:04:17.365565+0000","last_clean":"2024-09-11T22:04:17.365565+0000","last_became_active":"2024-09-11T22:02:34.079351+0000","last_became_peered":"2024-09-11T22:02:34.079351+0000","last_unstale":"2024-09-11T22:04:17.365565+0000","last_undegraded":"2024-09-11T22:04:17.365565+0000","last_fullsized":"2024-09-11T22:04:17.365565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:29.737198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400866+0000","last_change":"2024-09-11T22:02:36.104476+0000","last_active":"2024-09-11T22:04:17.400866+0000","last_peered":"2024-09-11T22:04:17.400866+0000","last_clean":"2024-09-11T22:04:17.400866+0000","last_became_active":"2024-09-11T22:02:36.104163+0000","last_became_peered":"2024-09-11T22:02:36.104163+0000","last_unstale":"2024-09-11T22:04:17.400866+0000","last_undegraded":"2024-09-11T22:04:17.400866+0000","last_fullsized":"2024-09-11T22:04:17.400866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.570125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362393+0000","last_change":"2024-09-11T22:02:34.079652+0000","last_active":"2024-09-11T22:04:17.362393+0000","last_peered":"2024-09-11T22:04:17.362393+0000","last_clean":"2024-09-11T22:04:17.362393+0000","last_became_active":"2024-09-11T22:02:34.079365+0000","last_became_peered":"2024-09-11T22:02:34.079365+0000","last_unstale":"2024-09-11T22:04:17.362393+0000","last_undegraded":"2024-09-11T22:04:17.362393+0000","last_fullsized":"2024-09-11T22:04:17.362393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:15.371852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399253+0000","last_change":"2024-09-11T22:02:36.107209+0000","last_active":"2024-09-11T22:04:17.399253+0000","last_peered":"2024-09-11T22:04:17.399253+0000","last_clean":"2024-09-11T22:04:17.399253+0000","last_became_active":"2024-09-11T22:02:36.106896+0000","last_became_peered":"2024-09-11T22:02:36.106896+0000","last_unstale":"2024-09-11T22:04:17.399253+0000","last_undegraded":"2024-09-11T22:04:17.399253+0000","last_fullsized":"2024-09-11T22:04:17.399253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:04.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":122,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.355619+0000","last_change":"2024-09-11T22:02:34.088531+0000","last_active":"2024-09-11T22:04:17.355619+0000","last_peered":"2024-09-11T22:04:17.355619+0000","last_clean":"2024-09-11T22:04:17.355619+0000","last_became_active":"2024-09-11T22:02:34.088252+0000","last_became_peered":"2024-09-11T22:02:34.088252+0000","last_unstale":"2024-09-11T22:04:17.355619+0000","last_undegraded":"2024-09-11T22:04:17.355619+0000","last_fullsized":"2024-09-11T22:04:17.355619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:43.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.389359+0000","last_change":"2024-09-11T22:02:36.108963+0000","last_active":"2024-09-11T22:04:17.389359+0000","last_peered":"2024-09-11T22:04:17.389359+0000","last_clean":"2024-09-11T22:04:17.389359+0000","last_became_active":"2024-09-11T22:02:36.108435+0000","last_became_peered":"2024-09-11T22:02:36.108435+0000","last_unstale":"2024-09-11T22:04:17.389359+0000","last_undegraded":"2024-09-11T22:04:17.389359+0000","last_fullsized":"2024-09-11T22:04:17.389359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:11.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.361831+0000","last_change":"2024-09-11T22:02:34.084283+0000","last_active":"2024-09-11T22:04:17.361831+0000","last_peered":"2024-09-11T22:04:17.361831+0000","last_clean":"2024-09-11T22:04:17.361831+0000","last_became_active":"2024-09-11T22:02:34.083948+0000","last_became_peered":"2024-09-11T22:02:34.083948+0000","last_unstale":"2024-09-11T22:04:17.361831+0000","last_undegraded":"2024-09-11T22:04:17.361831+0000","last_fullsized":"2024-09-11T22:04:17.361831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:48.763643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.391536+0000","last_change":"2024-09-11T22:02:36.102147+0000","last_active":"2024-09-11T22:04:17.391536+0000","last_peered":"2024-09-11T22:04:17.391536+0000","last_clean":"2024-09-11T22:04:17.391536+0000","last_became_active":"2024-09-11T22:02:36.101641+0000","last_became_peered":"2024-09-11T22:02:36.101641+0000","last_unstale":"2024-09-11T22:04:17.391536+0000","last_undegraded":"2024-09-11T22:04:17.391536+0000","last_fullsized":"2024-09-11T22:04:17.391536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:58.145304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358234+0000","last_change":"2024-09-11T22:02:34.090538+0000","last_active":"2024-09-11T22:04:17.358234+0000","last_peered":"2024-09-11T22:04:17.358234+0000","last_clean":"2024-09-11T22:04:17.358234+0000","last_became_active":"2024-09-11T22:02:34.090238+0000","last_became_peered":"2024-09-11T22:02:34.090238+0000","last_unstale":"2024-09-11T22:04:17.358234+0000","last_undegraded":"2024-09-11T22:04:17.358234+0000","last_fullsized":"2024-09-11T22:04:17.358234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:47.037999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397510+0000","last_change":"2024-09-11T22:02:36.095664+0000","last_active":"2024-09-11T22:04:17.397510+0000","last_peered":"2024-09-11T22:04:17.397510+0000","last_clean":"2024-09-11T22:04:17.397510+0000","last_became_active":"2024-09-11T22:02:36.095304+0000","last_became_peered":"2024-09-11T22:02:36.095304+0000","last_unstale":"2024-09-11T22:04:17.397510+0000","last_undegraded":"2024-09-11T22:04:17.397510+0000","last_fullsized":"2024-09-11T22:04:17.397510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.484809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368818+0000","last_change":"2024-09-11T22:02:34.089781+0000","last_active":"2024-09-11T22:04:17.368818+0000","last_peered":"2024-09-11T22:04:17.368818+0000","last_clean":"2024-09-11T22:04:17.368818+0000","last_became_active":"2024-09-11T22:02:34.089439+0000","last_became_peered":"2024-09-11T22:02:34.089439+0000","last_unstale":"2024-09-11T22:04:17.368818+0000","last_undegraded":"2024-09-11T22:04:17.368818+0000","last_fullsized":"2024-09-11T22:04:17.368818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:38.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400049+0000","last_change":"2024-09-11T22:02:36.107159+0000","last_active":"2024-09-11T22:04:17.400049+0000","last_peered":"2024-09-11T22:04:17.400049+0000","last_clean":"2024-09-11T22:04:17.400049+0000","last_became_active":"2024-09-11T22:02:36.106846+0000","last_became_peered":"2024-09-11T22:02:36.106846+0000","last_unstale":"2024-09-11T22:04:17.400049+0000","last_undegraded":"2024-09-11T22:04:17.400049+0000","last_fullsized":"2024-09-11T22:04:17.400049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.972944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'46","reported_seq":105,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.614392+0000","last_change":"2024-09-11T22:02:55.352887+0000","last_active":"2024-09-11T22:04:17.614392+0000","last_peered":"2024-09-11T22:04:17.614392+0000","last_clean":"2024-09-11T22:04:17.614392+0000","last_became_active":"2024-09-11T22:02:55.348619+0000","last_became_peered":"2024-09-11T22:02:55.348619+0000","last_unstale":"2024-09-11T22:04:17.614392+0000","last_undegraded":"2024-09-11T22:04:17.614392+0000","last_fullsized":"2024-09-11T22:04:17.614392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:51.259114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":84,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399780+0000","last_change":"2024-09-11T22:02:36.108560+0000","last_active":"2024-09-11T22:04:17.399780+0000","last_peered":"2024-09-11T22:04:17.399780+0000","last_clean":"2024-09-11T22:04:17.399780+0000","last_became_active":"2024-09-11T22:02:36.107593+0000","last_became_peered":"2024-09-11T22:02:36.107593+0000","last_unstale":"2024-09-11T22:04:17.399780+0000","last_undegraded":"2024-09-11T22:04:17.399780+0000","last_fullsized":"2024-09-11T22:04:17.399780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.479991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365257+0000","last_change":"2024-09-11T22:02:34.087394+0000","last_active":"2024-09-11T22:04:17.365257+0000","last_peered":"2024-09-11T22:04:17.365257+0000","last_clean":"2024-09-11T22:04:17.365257+0000","last_became_active":"2024-09-11T22:02:34.087146+0000","last_became_peered":"2024-09-11T22:02:34.087146+0000","last_unstale":"2024-09-11T22:04:17.365257+0000","last_undegraded":"2024-09-11T22:04:17.365257+0000","last_fullsized":"2024-09-11T22:04:17.365257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:30.772437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412826+0000","last_change":"2024-09-11T22:02:55.545065+0000","last_active":"2024-09-11T22:04:17.412826+0000","last_peered":"2024-09-11T22:04:17.412826+0000","last_clean":"2024-09-11T22:04:17.412826+0000","last_became_active":"2024-09-11T22:02:55.544736+0000","last_became_peered":"2024-09-11T22:02:55.544736+0000","last_unstale":"2024-09-11T22:04:17.412826+0000","last_undegraded":"2024-09-11T22:04:17.412826+0000","last_fullsized":"2024-09-11T22:04:17.412826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:23.706253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358626+0000","last_change":"2024-09-11T22:02:34.088717+0000","last_active":"2024-09-11T22:04:17.358626+0000","last_peered":"2024-09-11T22:04:17.358626+0000","last_clean":"2024-09-11T22:04:17.358626+0000","last_became_active":"2024-09-11T22:02:34.088412+0000","last_became_peered":"2024-09-11T22:02:34.088412+0000","last_unstale":"2024-09-11T22:04:17.358626+0000","last_undegraded":"2024-09-11T22:04:17.358626+0000","last_fullsized":"2024-09-11T22:04:17.358626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.376778+0000","last_change":"2024-09-11T22:02:36.103781+0000","last_active":"2024-09-11T22:04:17.376778+0000","last_peered":"2024-09-11T22:04:17.376778+0000","last_clean":"2024-09-11T22:04:17.376778+0000","last_became_active":"2024-09-11T22:02:36.103426+0000","last_became_peered":"2024-09-11T22:02:36.103426+0000","last_unstale":"2024-09-11T22:04:17.376778+0000","last_undegraded":"2024-09-11T22:04:17.376778+0000","last_fullsized":"2024-09-11T22:04:17.376778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:34.962793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.357294+0000","last_change":"2024-09-11T22:02:34.080333+0000","last_active":"2024-09-11T22:04:17.357294+0000","last_peered":"2024-09-11T22:04:17.357294+0000","last_clean":"2024-09-11T22:04:17.357294+0000","last_became_active":"2024-09-11T22:02:34.079384+0000","last_became_peered":"2024-09-11T22:02:34.079384+0000","last_unstale":"2024-09-11T22:04:17.357294+0000","last_undegraded":"2024-09-11T22:04:17.357294+0000","last_fullsized":"2024-09-11T22:04:17.357294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:38.313516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414236+0000","last_change":"2024-09-11T22:02:36.103306+0000","last_active":"2024-09-11T22:04:17.414236+0000","last_peered":"2024-09-11T22:04:17.414236+0000","last_clean":"2024-09-11T22:04:17.414236+0000","last_became_active":"2024-09-11T22:02:36.102967+0000","last_became_peered":"2024-09-11T22:02:36.102967+0000","last_unstale":"2024-09-11T22:04:17.414236+0000","last_undegraded":"2024-09-11T22:04:17.414236+0000","last_fullsized":"2024-09-11T22:04:17.414236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:34.138931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365503+0000","last_change":"2024-09-11T22:02:55.355119+0000","last_active":"2024-09-11T22:04:17.365503+0000","last_peered":"2024-09-11T22:04:17.365503+0000","last_clean":"2024-09-11T22:04:17.365503+0000","last_became_active":"2024-09-11T22:02:55.350440+0000","last_became_peered":"2024-09-11T22:02:55.350440+0000","last_unstale":"2024-09-11T22:04:17.365503+0000","last_undegraded":"2024-09-11T22:04:17.365503+0000","last_fullsized":"2024-09-11T22:04:17.365503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:47.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398642+0000","last_change":"2024-09-11T22:02:36.102491+0000","last_active":"2024-09-11T22:04:17.398642+0000","last_peered":"2024-09-11T22:04:17.398642+0000","last_clean":"2024-09-11T22:04:17.398642+0000","last_became_active":"2024-09-11T22:02:36.102112+0000","last_became_peered":"2024-09-11T22:02:36.102112+0000","last_unstale":"2024-09-11T22:04:17.398642+0000","last_undegraded":"2024-09-11T22:04:17.398642+0000","last_fullsized":"2024-09-11T22:04:17.398642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:47.588539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.367510+0000","last_change":"2024-09-11T22:02:34.082590+0000","last_active":"2024-09-11T22:04:17.367510+0000","last_peered":"2024-09-11T22:04:17.367510+0000","last_clean":"2024-09-11T22:04:17.367510+0000","last_became_active":"2024-09-11T22:02:34.082288+0000","last_became_peered":"2024-09-11T22:02:34.082288+0000","last_unstale":"2024-09-11T22:04:17.367510+0000","last_undegraded":"2024-09-11T22:04:17.367510+0000","last_fullsized":"2024-09-11T22:04:17.367510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:57.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402698+0000","last_change":"2024-09-11T22:02:36.105247+0000","last_active":"2024-09-11T22:04:17.402698+0000","last_peered":"2024-09-11T22:04:17.402698+0000","last_clean":"2024-09-11T22:04:17.402698+0000","last_became_active":"2024-09-11T22:02:36.104912+0000","last_became_peered":"2024-09-11T22:02:36.104912+0000","last_unstale":"2024-09-11T22:04:17.402698+0000","last_undegraded":"2024-09-11T22:04:17.402698+0000","last_fullsized":"2024-09-11T22:04:17.402698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:05.396671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398828+0000","last_change":"2024-09-11T22:02:55.544428+0000","last_active":"2024-09-11T22:04:17.398828+0000","last_peered":"2024-09-11T22:04:17.398828+0000","last_clean":"2024-09-11T22:04:17.398828+0000","last_became_active":"2024-09-11T22:02:55.544151+0000","last_became_peered":"2024-09-11T22:02:55.544151+0000","last_unstale":"2024-09-11T22:04:17.398828+0000","last_undegraded":"2024-09-11T22:04:17.398828+0000","last_fullsized":"2024-09-11T22:04:17.398828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.100131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368511+0000","last_change":"2024-09-11T22:02:34.079017+0000","last_active":"2024-09-11T22:04:17.368511+0000","last_peered":"2024-09-11T22:04:17.368511+0000","last_clean":"2024-09-11T22:04:17.368511+0000","last_became_active":"2024-09-11T22:02:34.078663+0000","last_became_peered":"2024-09-11T22:02:34.078663+0000","last_unstale":"2024-09-11T22:04:17.368511+0000","last_undegraded":"2024-09-11T22:04:17.368511+0000","last_fullsized":"2024-09-11T22:04:17.368511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:05.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406599+0000","last_change":"2024-09-11T22:02:36.097768+0000","last_active":"2024-09-11T22:04:17.406599+0000","last_peered":"2024-09-11T22:04:17.406599+0000","last_clean":"2024-09-11T22:04:17.406599+0000","last_became_active":"2024-09-11T22:02:36.097396+0000","last_became_peered":"2024-09-11T22:02:36.097396+0000","last_unstale":"2024-09-11T22:04:17.406599+0000","last_undegraded":"2024-09-11T22:04:17.406599+0000","last_fullsized":"2024-09-11T22:04:17.406599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:35.673268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368326+0000","last_change":"2024-09-11T22:02:55.355229+0000","last_active":"2024-09-11T22:04:17.368326+0000","last_peered":"2024-09-11T22:04:17.368326+0000","last_clean":"2024-09-11T22:04:17.368326+0000","last_became_active":"2024-09-11T22:02:55.350492+0000","last_became_peered":"2024-09-11T22:02:55.350492+0000","last_unstale":"2024-09-11T22:04:17.368326+0000","last_undegraded":"2024-09-11T22:04:17.368326+0000","last_fullsized":"2024-09-11T22:04:17.368326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:03:31.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412937+0000","last_change":"2024-09-11T22:02:36.108992+0000","last_active":"2024-09-11T22:04:17.412937+0000","last_peered":"2024-09-11T22:04:17.412937+0000","last_clean":"2024-09-11T22:04:17.412937+0000","last_became_active":"2024-09-11T22:02:36.108674+0000","last_became_peered":"2024-09-11T22:02:36.108674+0000","last_unstale":"2024-09-11T22:04:17.412937+0000","last_undegraded":"2024-09-11T22:04:17.412937+0000","last_fullsized":"2024-09-11T22:04:17.412937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:57.083127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358697+0000","last_change":"2024-09-11T22:02:34.088833+0000","last_active":"2024-09-11T22:04:17.358697+0000","last_peered":"2024-09-11T22:04:17.358697+0000","last_clean":"2024-09-11T22:04:17.358697+0000","last_became_active":"2024-09-11T22:02:34.088275+0000","last_became_peered":"2024-09-11T22:02:34.088275+0000","last_unstale":"2024-09-11T22:04:17.358697+0000","last_undegraded":"2024-09-11T22:04:17.358697+0000","last_fullsized":"2024-09-11T22:04:17.358697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:31.167486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403337+0000","last_change":"2024-09-11T22:02:36.108154+0000","last_active":"2024-09-11T22:04:17.403337+0000","last_peered":"2024-09-11T22:04:17.403337+0000","last_clean":"2024-09-11T22:04:17.403337+0000","last_became_active":"2024-09-11T22:02:36.107817+0000","last_became_peered":"2024-09-11T22:02:36.107817+0000","last_unstale":"2024-09-11T22:04:17.403337+0000","last_undegraded":"2024-09-11T22:04:17.403337+0000","last_fullsized":"2024-09-11T22:04:17.403337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.168339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358805+0000","last_change":"2024-09-11T22:02:34.082193+0000","last_active":"2024-09-11T22:04:17.358805+0000","last_peered":"2024-09-11T22:04:17.358805+0000","last_clean":"2024-09-11T22:04:17.358805+0000","last_became_active":"2024-09-11T22:02:34.081852+0000","last_became_peered":"2024-09-11T22:02:34.081852+0000","last_unstale":"2024-09-11T22:04:17.358805+0000","last_undegraded":"2024-09-11T22:04:17.358805+0000","last_fullsized":"2024-09-11T22:04:17.358805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:08.319444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597546,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":683,"num_read_kb":450,"num_write":291,"num_write_kb":1437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1792638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514529,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32488,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712664,"statfs":{"total":95995035648,"available":95961767936,"internally_reserved":0,"allocated":1331200,"data_stored":845532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743461,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28760,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716392,"statfs":{"total":95995035648,"available":95965585408,"internally_reserved":0,"allocated":1777664,"data_stored":1243197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906987,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28340,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716812,"statfs":{"total":95995035648,"available":95966015488,"internally_reserved":0,"allocated":1347584,"data_stored":845768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":452472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397556,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32700,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712452,"statfs":{"total":95995035648,"available":95961550848,"internally_reserved":0,"allocated":1548288,"data_stored":1045079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528377,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":451941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790014,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28740,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716412,"statfs":{"total":95995035648,"available":95965605888,"internally_reserved":0,"allocated":1695744,"data_stored":1176615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953539,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":453698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182472,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":977068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1032192,"data_stored":519312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":518214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":453212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:04:23.277 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:04:23.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.416+0000 7f872756d640 1 -- 172.21.15.152:0/3814504014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87201069a0 msgr2=0x7f8720106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.416+0000 7f872756d640 1 --2- 172.21.15.152:0/3814504014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87201069a0 0x7f8720106d80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f871c009930 tx=0x7f871c02a420 comp rx=0 tx=0).stop 2024-09-11T22:04:23.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.416+0000 7f872756d640 1 -- 172.21.15.152:0/3814504014 shutdown_connections 2024-09-11T22:04:23.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.416+0000 7f872756d640 1 --2- 172.21.15.152:0/3814504014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8720101330 0x7f872010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.416+0000 7f872756d640 1 --2- 172.21.15.152:0/3814504014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8720100990 0x7f8720100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.416+0000 7f872756d640 1 --2- 172.21.15.152:0/3814504014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87201069a0 0x7f8720106d80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.416+0000 7f872756d640 1 -- 172.21.15.152:0/3814504014 >> 172.21.15.152:0/3814504014 conn(0x7f87200fc6d0 msgr2=0x7f87200feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:23.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.416+0000 7f872756d640 1 -- 172.21.15.152:0/3814504014 shutdown_connections 2024-09-11T22:04:23.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.416+0000 7f872756d640 1 -- 172.21.15.152:0/3814504014 wait complete. 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f872756d640 1 Processor -- start 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f872756d640 1 -- start start 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f872756d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8720100990 0x7f87200fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f872756d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8720101330 0x7f87200fd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f872756d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87201069a0 0x7f87200fd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f872756d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8720110db0 con 0x7f87201069a0 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f872756d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8720110c30 con 0x7f8720100990 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f872756d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8720110f30 con 0x7f8720101330 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8725b0a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87201069a0 0x7f87200fd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8725b0a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87201069a0 0x7f87200fd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58896/0 (socket says 172.21.15.152:58896) 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8725b0a640 1 -- 172.21.15.152:0/3232696289 learned_addr learned my addr 172.21.15.152:0/3232696289 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8725309640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8720100990 0x7f87200fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8725b0a640 1 -- 172.21.15.152:0/3232696289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8720101330 msgr2=0x7f87200fd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8724b08640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8720101330 0x7f87200fd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8725b0a640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8720101330 0x7f87200fd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8725b0a640 1 -- 172.21.15.152:0/3232696289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8720100990 msgr2=0x7f87200fcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8725b0a640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8720100990 0x7f87200fcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8725b0a640 1 -- 172.21.15.152:0/3232696289 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87201a68b0 con 0x7f87201069a0 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8724b08640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8720101330 0x7f87200fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.417+0000 7f8725309640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8720100990 0x7f87200fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.418+0000 7f8725b0a640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87201069a0 0x7f87200fd850 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f871800cad0 tx=0x7f871800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.418+0000 7f87167fc640 1 -- 172.21.15.152:0/3232696289 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871800ae20 con 0x7f87201069a0 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.418+0000 7f87167fc640 1 -- 172.21.15.152:0/3232696289 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8718005020 con 0x7f87201069a0 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.418+0000 7f87167fc640 1 -- 172.21.15.152:0/3232696289 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871800f6f0 con 0x7f87201069a0 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.418+0000 7f872756d640 1 -- 172.21.15.152:0/3232696289 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87201a6ba0 con 0x7f87201069a0 2024-09-11T22:04:23.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.418+0000 7f872756d640 1 -- 172.21.15.152:0/3232696289 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87201a70a0 con 0x7f87201069a0 2024-09-11T22:04:23.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.419+0000 7f872756d640 1 -- 172.21.15.152:0/3232696289 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8720100df0 con 0x7f87201069a0 2024-09-11T22:04:23.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.420+0000 7f87167fc640 1 -- 172.21.15.152:0/3232696289 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f87180051d0 con 0x7f87201069a0 2024-09-11T22:04:23.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.421+0000 7f87167fc640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f870c0a2e20 0x7f870c0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.421+0000 7f8725309640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f870c0a2e20 0x7f870c0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.421+0000 7f87167fc640 1 -- 172.21.15.152:0/3232696289 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f87180cfb90 con 0x7f87201069a0 2024-09-11T22:04:23.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.421+0000 7f8725309640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f870c0a2e20 0x7f870c0a52e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f871c000c00 tx=0x7f871c005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:23.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.424+0000 7f87167fc640 1 -- 172.21.15.152:0/3232696289 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8718014030 con 0x7f87201069a0 2024-09-11T22:04:23.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.586+0000 7f872756d640 1 -- 172.21.15.152:0/3232696289 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8720062630 con 0x7f870c0a2e20 2024-09-11T22:04:23.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.592+0000 7f87167fc640 1 -- 172.21.15.152:0/3232696289 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257737 (secure 0 0 0) 0x7f8720062630 con 0x7f870c0a2e20 2024-09-11T22:04:23.596 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:23.597 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-09-11T22:04:23.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.595+0000 7f872756d640 1 -- 172.21.15.152:0/3232696289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f870c0a2e20 msgr2=0x7f870c0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.595+0000 7f872756d640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f870c0a2e20 0x7f870c0a52e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f871c000c00 tx=0x7f871c005a20 comp rx=0 tx=0).stop 2024-09-11T22:04:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.595+0000 7f872756d640 1 -- 172.21.15.152:0/3232696289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87201069a0 msgr2=0x7f87200fd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.595+0000 7f872756d640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87201069a0 0x7f87200fd850 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f871800cad0 tx=0x7f871800cf90 comp rx=0 tx=0).stop 2024-09-11T22:04:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.596+0000 7f872756d640 1 -- 172.21.15.152:0/3232696289 shutdown_connections 2024-09-11T22:04:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.596+0000 7f872756d640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f870c0a2e20 0x7f870c0a52e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.596+0000 7f872756d640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87201069a0 0x7f87200fd850 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.596+0000 7f872756d640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8720101330 0x7f87200fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.596+0000 7f872756d640 1 --2- 172.21.15.152:0/3232696289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8720100990 0x7f87200fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.596+0000 7f872756d640 1 -- 172.21.15.152:0/3232696289 >> 172.21.15.152:0/3232696289 conn(0x7f87200fc6d0 msgr2=0x7f872006a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.596+0000 7f872756d640 1 -- 172.21.15.152:0/3232696289 shutdown_connections 2024-09-11T22:04:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.596+0000 7f872756d640 1 -- 172.21.15.152:0/3232696289 wait complete. 2024-09-11T22:04:23.607 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-09-11T22:04:23.371212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188934,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":952,"num_read_kb":797,"num_write":500,"num_write_kb":4381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":881,"ondisk_log_size":881,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368184,"kb_used_data":14688,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124573640,"statfs":{"total":1151940427776,"available":1151563407360,"internally_reserved":0,"allocated":15040512,"data_stored":8987610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":786,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":228,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.999897"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414391+0000","last_change":"2024-09-11T22:02:36.105689+0000","last_active":"2024-09-11T22:04:17.414391+0000","last_peered":"2024-09-11T22:04:17.414391+0000","last_clean":"2024-09-11T22:04:17.414391+0000","last_became_active":"2024-09-11T22:02:36.105128+0000","last_became_peered":"2024-09-11T22:02:36.105128+0000","last_unstale":"2024-09-11T22:04:17.414391+0000","last_undegraded":"2024-09-11T22:04:17.414391+0000","last_fullsized":"2024-09-11T22:04:17.414391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:18.018731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.410505+0000","last_change":"2024-09-11T22:02:36.096961+0000","last_active":"2024-09-11T22:04:17.410505+0000","last_peered":"2024-09-11T22:04:17.410505+0000","last_clean":"2024-09-11T22:04:17.410505+0000","last_became_active":"2024-09-11T22:02:36.096540+0000","last_became_peered":"2024-09-11T22:02:36.096540+0000","last_unstale":"2024-09-11T22:04:17.410505+0000","last_undegraded":"2024-09-11T22:04:17.410505+0000","last_fullsized":"2024-09-11T22:04:17.410505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:48.517125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413305+0000","last_change":"2024-09-11T22:02:36.108119+0000","last_active":"2024-09-11T22:04:17.413305+0000","last_peered":"2024-09-11T22:04:17.413305+0000","last_clean":"2024-09-11T22:04:17.413305+0000","last_became_active":"2024-09-11T22:02:36.107737+0000","last_became_peered":"2024-09-11T22:02:36.107737+0000","last_unstale":"2024-09-11T22:04:17.413305+0000","last_undegraded":"2024-09-11T22:04:17.413305+0000","last_fullsized":"2024-09-11T22:04:17.413305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:54.225935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395071+0000","last_change":"2024-09-11T22:02:36.107710+0000","last_active":"2024-09-11T22:04:17.395071+0000","last_peered":"2024-09-11T22:04:17.395071+0000","last_clean":"2024-09-11T22:04:17.395071+0000","last_became_active":"2024-09-11T22:02:36.107327+0000","last_became_peered":"2024-09-11T22:02:36.107327+0000","last_unstale":"2024-09-11T22:04:17.395071+0000","last_undegraded":"2024-09-11T22:04:17.395071+0000","last_fullsized":"2024-09-11T22:04:17.395071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.358535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396846+0000","last_change":"2024-09-11T22:02:36.100531+0000","last_active":"2024-09-11T22:04:17.396846+0000","last_peered":"2024-09-11T22:04:17.396846+0000","last_clean":"2024-09-11T22:04:17.396846+0000","last_became_active":"2024-09-11T22:02:36.100187+0000","last_became_peered":"2024-09-11T22:02:36.100187+0000","last_unstale":"2024-09-11T22:04:17.396846+0000","last_undegraded":"2024-09-11T22:04:17.396846+0000","last_fullsized":"2024-09-11T22:04:17.396846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.156080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397927+0000","last_change":"2024-09-11T22:02:36.101316+0000","last_active":"2024-09-11T22:04:17.397927+0000","last_peered":"2024-09-11T22:04:17.397927+0000","last_clean":"2024-09-11T22:04:17.397927+0000","last_became_active":"2024-09-11T22:02:36.100985+0000","last_became_peered":"2024-09-11T22:02:36.100985+0000","last_unstale":"2024-09-11T22:04:17.397927+0000","last_undegraded":"2024-09-11T22:04:17.397927+0000","last_fullsized":"2024-09-11T22:04:17.397927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:55.972974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.385307+0000","last_change":"2024-09-11T22:02:36.109146+0000","last_active":"2024-09-11T22:04:17.385307+0000","last_peered":"2024-09-11T22:04:17.385307+0000","last_clean":"2024-09-11T22:04:17.385307+0000","last_became_active":"2024-09-11T22:02:36.108817+0000","last_became_peered":"2024-09-11T22:02:36.108817+0000","last_unstale":"2024-09-11T22:04:17.385307+0000","last_undegraded":"2024-09-11T22:04:17.385307+0000","last_fullsized":"2024-09-11T22:04:17.385307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.222383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398948+0000","last_change":"2024-09-11T22:02:36.100362+0000","last_active":"2024-09-11T22:04:17.398948+0000","last_peered":"2024-09-11T22:04:17.398948+0000","last_clean":"2024-09-11T22:04:17.398948+0000","last_became_active":"2024-09-11T22:02:36.100088+0000","last_became_peered":"2024-09-11T22:02:36.100088+0000","last_unstale":"2024-09-11T22:04:17.398948+0000","last_undegraded":"2024-09-11T22:04:17.398948+0000","last_fullsized":"2024-09-11T22:04:17.398948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.478879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401808+0000","last_change":"2024-09-11T22:02:36.106360+0000","last_active":"2024-09-11T22:04:17.401808+0000","last_peered":"2024-09-11T22:04:17.401808+0000","last_clean":"2024-09-11T22:04:17.401808+0000","last_became_active":"2024-09-11T22:02:36.105994+0000","last_became_peered":"2024-09-11T22:02:36.105994+0000","last_unstale":"2024-09-11T22:04:17.401808+0000","last_undegraded":"2024-09-11T22:04:17.401808+0000","last_fullsized":"2024-09-11T22:04:17.401808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:33.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.394089+0000","last_change":"2024-09-11T22:02:36.109477+0000","last_active":"2024-09-11T22:04:17.394089+0000","last_peered":"2024-09-11T22:04:17.394089+0000","last_clean":"2024-09-11T22:04:17.394089+0000","last_became_active":"2024-09-11T22:02:36.109077+0000","last_became_peered":"2024-09-11T22:02:36.109077+0000","last_unstale":"2024-09-11T22:04:17.394089+0000","last_undegraded":"2024-09-11T22:04:17.394089+0000","last_fullsized":"2024-09-11T22:04:17.394089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.862359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399588+0000","last_change":"2024-09-11T22:02:36.112998+0000","last_active":"2024-09-11T22:04:17.399588+0000","last_peered":"2024-09-11T22:04:17.399588+0000","last_clean":"2024-09-11T22:04:17.399588+0000","last_became_active":"2024-09-11T22:02:36.112649+0000","last_became_peered":"2024-09-11T22:02:36.112649+0000","last_unstale":"2024-09-11T22:04:17.399588+0000","last_undegraded":"2024-09-11T22:04:17.399588+0000","last_fullsized":"2024-09-11T22:04:17.399588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:01.582572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398221+0000","last_change":"2024-09-11T22:02:36.099591+0000","last_active":"2024-09-11T22:04:17.398221+0000","last_peered":"2024-09-11T22:04:17.398221+0000","last_clean":"2024-09-11T22:04:17.398221+0000","last_became_active":"2024-09-11T22:02:36.099269+0000","last_became_peered":"2024-09-11T22:02:36.099269+0000","last_unstale":"2024-09-11T22:04:17.398221+0000","last_undegraded":"2024-09-11T22:04:17.398221+0000","last_fullsized":"2024-09-11T22:04:17.398221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:10.918188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403970+0000","last_change":"2024-09-11T22:02:36.100056+0000","last_active":"2024-09-11T22:04:17.403970+0000","last_peered":"2024-09-11T22:04:17.403970+0000","last_clean":"2024-09-11T22:04:17.403970+0000","last_became_active":"2024-09-11T22:02:36.099717+0000","last_became_peered":"2024-09-11T22:02:36.099717+0000","last_unstale":"2024-09-11T22:04:17.403970+0000","last_undegraded":"2024-09-11T22:04:17.403970+0000","last_fullsized":"2024-09-11T22:04:17.403970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.486256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411675+0000","last_change":"2024-09-11T22:02:36.097281+0000","last_active":"2024-09-11T22:04:17.411675+0000","last_peered":"2024-09-11T22:04:17.411675+0000","last_clean":"2024-09-11T22:04:17.411675+0000","last_became_active":"2024-09-11T22:02:36.096768+0000","last_became_peered":"2024-09-11T22:02:36.096768+0000","last_unstale":"2024-09-11T22:04:17.411675+0000","last_undegraded":"2024-09-11T22:04:17.411675+0000","last_fullsized":"2024-09-11T22:04:17.411675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:31.232578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412627+0000","last_change":"2024-09-11T22:02:55.351065+0000","last_active":"2024-09-11T22:04:17.412627+0000","last_peered":"2024-09-11T22:04:17.412627+0000","last_clean":"2024-09-11T22:04:17.412627+0000","last_became_active":"2024-09-11T22:02:55.350669+0000","last_became_peered":"2024-09-11T22:02:55.350669+0000","last_unstale":"2024-09-11T22:04:17.412627+0000","last_undegraded":"2024-09-11T22:04:17.412627+0000","last_fullsized":"2024-09-11T22:04:17.412627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:51.799060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414040+0000","last_change":"2024-09-11T22:02:36.109573+0000","last_active":"2024-09-11T22:04:17.414040+0000","last_peered":"2024-09-11T22:04:17.414040+0000","last_clean":"2024-09-11T22:04:17.414040+0000","last_became_active":"2024-09-11T22:02:36.109019+0000","last_became_peered":"2024-09-11T22:02:36.109019+0000","last_unstale":"2024-09-11T22:04:17.414040+0000","last_undegraded":"2024-09-11T22:04:17.414040+0000","last_fullsized":"2024-09-11T22:04:17.414040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:39.699762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414508+0000","last_change":"2024-09-11T22:02:36.105427+0000","last_active":"2024-09-11T22:04:17.414508+0000","last_peered":"2024-09-11T22:04:17.414508+0000","last_clean":"2024-09-11T22:04:17.414508+0000","last_became_active":"2024-09-11T22:02:36.104712+0000","last_became_peered":"2024-09-11T22:02:36.104712+0000","last_unstale":"2024-09-11T22:04:17.414508+0000","last_undegraded":"2024-09-11T22:04:17.414508+0000","last_fullsized":"2024-09-11T22:04:17.414508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:45.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399613+0000","last_change":"2024-09-11T22:02:36.097925+0000","last_active":"2024-09-11T22:04:17.399613+0000","last_peered":"2024-09-11T22:04:17.399613+0000","last_clean":"2024-09-11T22:04:17.399613+0000","last_became_active":"2024-09-11T22:02:36.097649+0000","last_became_peered":"2024-09-11T22:02:36.097649+0000","last_unstale":"2024-09-11T22:04:17.399613+0000","last_undegraded":"2024-09-11T22:04:17.399613+0000","last_fullsized":"2024-09-11T22:04:17.399613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.272197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400978+0000","last_change":"2024-09-11T22:02:36.107266+0000","last_active":"2024-09-11T22:04:17.400978+0000","last_peered":"2024-09-11T22:04:17.400978+0000","last_clean":"2024-09-11T22:04:17.400978+0000","last_became_active":"2024-09-11T22:02:36.106865+0000","last_became_peered":"2024-09-11T22:02:36.106865+0000","last_unstale":"2024-09-11T22:04:17.400978+0000","last_undegraded":"2024-09-11T22:04:17.400978+0000","last_fullsized":"2024-09-11T22:04:17.400978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:53.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396320+0000","last_change":"2024-09-11T22:02:55.349854+0000","last_active":"2024-09-11T22:04:17.396320+0000","last_peered":"2024-09-11T22:04:17.396320+0000","last_clean":"2024-09-11T22:04:17.396320+0000","last_became_active":"2024-09-11T22:02:55.349521+0000","last_became_peered":"2024-09-11T22:02:55.349521+0000","last_unstale":"2024-09-11T22:04:17.396320+0000","last_undegraded":"2024-09-11T22:04:17.396320+0000","last_fullsized":"2024-09-11T22:04:17.396320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406936+0000","last_change":"2024-09-11T22:02:36.110460+0000","last_active":"2024-09-11T22:04:17.406936+0000","last_peered":"2024-09-11T22:04:17.406936+0000","last_clean":"2024-09-11T22:04:17.406936+0000","last_became_active":"2024-09-11T22:02:36.110136+0000","last_became_peered":"2024-09-11T22:02:36.110136+0000","last_unstale":"2024-09-11T22:04:17.406936+0000","last_undegraded":"2024-09-11T22:04:17.406936+0000","last_fullsized":"2024-09-11T22:04:17.406936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:30.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403836+0000","last_change":"2024-09-11T22:02:36.111403+0000","last_active":"2024-09-11T22:04:17.403836+0000","last_peered":"2024-09-11T22:04:17.403836+0000","last_clean":"2024-09-11T22:04:17.403836+0000","last_became_active":"2024-09-11T22:02:36.110976+0000","last_became_peered":"2024-09-11T22:02:36.110976+0000","last_unstale":"2024-09-11T22:04:17.403836+0000","last_undegraded":"2024-09-11T22:04:17.403836+0000","last_fullsized":"2024-09-11T22:04:17.403836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:03.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.405071+0000","last_change":"2024-09-11T22:02:36.110002+0000","last_active":"2024-09-11T22:04:17.405071+0000","last_peered":"2024-09-11T22:04:17.405071+0000","last_clean":"2024-09-11T22:04:17.405071+0000","last_became_active":"2024-09-11T22:02:36.109694+0000","last_became_peered":"2024-09-11T22:02:36.109694+0000","last_unstale":"2024-09-11T22:04:17.405071+0000","last_undegraded":"2024-09-11T22:04:17.405071+0000","last_fullsized":"2024-09-11T22:04:17.405071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:00.338509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406553+0000","last_change":"2024-09-11T22:02:36.101638+0000","last_active":"2024-09-11T22:04:17.406553+0000","last_peered":"2024-09-11T22:04:17.406553+0000","last_clean":"2024-09-11T22:04:17.406553+0000","last_became_active":"2024-09-11T22:02:36.101363+0000","last_became_peered":"2024-09-11T22:02:36.101363+0000","last_unstale":"2024-09-11T22:04:17.406553+0000","last_undegraded":"2024-09-11T22:04:17.406553+0000","last_fullsized":"2024-09-11T22:04:17.406553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:35.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399143+0000","last_change":"2024-09-11T22:02:36.109250+0000","last_active":"2024-09-11T22:04:17.399143+0000","last_peered":"2024-09-11T22:04:17.399143+0000","last_clean":"2024-09-11T22:04:17.399143+0000","last_became_active":"2024-09-11T22:02:36.108931+0000","last_became_peered":"2024-09-11T22:02:36.108931+0000","last_unstale":"2024-09-11T22:04:17.399143+0000","last_undegraded":"2024-09-11T22:04:17.399143+0000","last_fullsized":"2024-09-11T22:04:17.399143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:09.616621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400102+0000","last_change":"2024-09-11T22:02:36.113064+0000","last_active":"2024-09-11T22:04:17.400102+0000","last_peered":"2024-09-11T22:04:17.400102+0000","last_clean":"2024-09-11T22:04:17.400102+0000","last_became_active":"2024-09-11T22:02:36.112674+0000","last_became_peered":"2024-09-11T22:02:36.112674+0000","last_unstale":"2024-09-11T22:04:17.400102+0000","last_undegraded":"2024-09-11T22:04:17.400102+0000","last_fullsized":"2024-09-11T22:04:17.400102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:17.923053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395397+0000","last_change":"2024-09-11T22:02:36.101799+0000","last_active":"2024-09-11T22:04:17.395397+0000","last_peered":"2024-09-11T22:04:17.395397+0000","last_clean":"2024-09-11T22:04:17.395397+0000","last_became_active":"2024-09-11T22:02:36.101429+0000","last_became_peered":"2024-09-11T22:02:36.101429+0000","last_unstale":"2024-09-11T22:04:17.395397+0000","last_undegraded":"2024-09-11T22:04:17.395397+0000","last_fullsized":"2024-09-11T22:04:17.395397+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.597619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402304+0000","last_change":"2024-09-11T22:02:36.100993+0000","last_active":"2024-09-11T22:04:17.402304+0000","last_peered":"2024-09-11T22:04:17.402304+0000","last_clean":"2024-09-11T22:04:17.402304+0000","last_became_active":"2024-09-11T22:02:36.100678+0000","last_became_peered":"2024-09-11T22:02:36.100678+0000","last_unstale":"2024-09-11T22:04:17.402304+0000","last_undegraded":"2024-09-11T22:04:17.402304+0000","last_fullsized":"2024-09-11T22:04:17.402304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:18.808422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.408677+0000","last_change":"2024-09-11T22:02:36.103507+0000","last_active":"2024-09-11T22:04:17.408677+0000","last_peered":"2024-09-11T22:04:17.408677+0000","last_clean":"2024-09-11T22:04:17.408677+0000","last_became_active":"2024-09-11T22:02:36.103228+0000","last_became_peered":"2024-09-11T22:02:36.103228+0000","last_unstale":"2024-09-11T22:04:17.408677+0000","last_undegraded":"2024-09-11T22:04:17.408677+0000","last_fullsized":"2024-09-11T22:04:17.408677+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.898635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413675+0000","last_change":"2024-09-11T22:02:36.104734+0000","last_active":"2024-09-11T22:04:17.413675+0000","last_peered":"2024-09-11T22:04:17.413675+0000","last_clean":"2024-09-11T22:04:17.413675+0000","last_became_active":"2024-09-11T22:02:36.103974+0000","last_became_peered":"2024-09-11T22:02:36.103974+0000","last_unstale":"2024-09-11T22:04:17.413675+0000","last_undegraded":"2024-09-11T22:04:17.413675+0000","last_fullsized":"2024-09-11T22:04:17.413675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:54.142031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397564+0000","last_change":"2024-09-11T22:02:36.106103+0000","last_active":"2024-09-11T22:04:17.397564+0000","last_peered":"2024-09-11T22:04:17.397564+0000","last_clean":"2024-09-11T22:04:17.397564+0000","last_became_active":"2024-09-11T22:02:36.105792+0000","last_became_peered":"2024-09-11T22:02:36.105792+0000","last_unstale":"2024-09-11T22:04:17.397564+0000","last_undegraded":"2024-09-11T22:04:17.397564+0000","last_fullsized":"2024-09-11T22:04:17.397564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:06.607094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397456+0000","last_change":"2024-09-11T22:02:36.104147+0000","last_active":"2024-09-11T22:04:17.397456+0000","last_peered":"2024-09-11T22:04:17.397456+0000","last_clean":"2024-09-11T22:04:17.397456+0000","last_became_active":"2024-09-11T22:02:36.103782+0000","last_became_peered":"2024-09-11T22:02:36.103782+0000","last_unstale":"2024-09-11T22:04:17.397456+0000","last_undegraded":"2024-09-11T22:04:17.397456+0000","last_fullsized":"2024-09-11T22:04:17.397456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.127609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.392542+0000","last_change":"2024-09-11T22:02:36.101259+0000","last_active":"2024-09-11T22:04:17.392542+0000","last_peered":"2024-09-11T22:04:17.392542+0000","last_clean":"2024-09-11T22:04:17.392542+0000","last_became_active":"2024-09-11T22:02:36.100761+0000","last_became_peered":"2024-09-11T22:02:36.100761+0000","last_unstale":"2024-09-11T22:04:17.392542+0000","last_undegraded":"2024-09-11T22:04:17.392542+0000","last_fullsized":"2024-09-11T22:04:17.392542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:47.045252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:21.977912+0000","last_change":"2024-09-11T22:02:34.084522+0000","last_active":"2024-09-11T22:04:21.977912+0000","last_peered":"2024-09-11T22:04:21.977912+0000","last_clean":"2024-09-11T22:04:21.977912+0000","last_became_active":"2024-09-11T22:02:34.084211+0000","last_became_peered":"2024-09-11T22:02:34.084211+0000","last_unstale":"2024-09-11T22:04:21.977912+0000","last_undegraded":"2024-09-11T22:04:21.977912+0000","last_fullsized":"2024-09-11T22:04:21.977912+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:18.963998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406451+0000","last_change":"2024-09-11T22:02:36.106890+0000","last_active":"2024-09-11T22:04:17.406451+0000","last_peered":"2024-09-11T22:04:17.406451+0000","last_clean":"2024-09-11T22:04:17.406451+0000","last_became_active":"2024-09-11T22:02:36.105255+0000","last_became_peered":"2024-09-11T22:02:36.105255+0000","last_unstale":"2024-09-11T22:04:17.406451+0000","last_undegraded":"2024-09-11T22:04:17.406451+0000","last_fullsized":"2024-09-11T22:04:17.406451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.995542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.355903+0000","last_change":"2024-09-11T22:02:34.079967+0000","last_active":"2024-09-11T22:04:17.355903+0000","last_peered":"2024-09-11T22:04:17.355903+0000","last_clean":"2024-09-11T22:04:17.355903+0000","last_became_active":"2024-09-11T22:02:34.079649+0000","last_became_peered":"2024-09-11T22:02:34.079649+0000","last_unstale":"2024-09-11T22:04:17.355903+0000","last_undegraded":"2024-09-11T22:04:17.355903+0000","last_fullsized":"2024-09-11T22:04:17.355903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.661256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.351613+0000","last_change":"2024-09-11T22:02:34.079850+0000","last_active":"2024-09-11T22:04:17.351613+0000","last_peered":"2024-09-11T22:04:17.351613+0000","last_clean":"2024-09-11T22:04:17.351613+0000","last_became_active":"2024-09-11T22:02:34.079514+0000","last_became_peered":"2024-09-11T22:02:34.079514+0000","last_unstale":"2024-09-11T22:04:17.351613+0000","last_undegraded":"2024-09-11T22:04:17.351613+0000","last_fullsized":"2024-09-11T22:04:17.351613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.359482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407046+0000","last_change":"2024-09-11T22:02:36.099310+0000","last_active":"2024-09-11T22:04:17.407046+0000","last_peered":"2024-09-11T22:04:17.407046+0000","last_clean":"2024-09-11T22:04:17.407046+0000","last_became_active":"2024-09-11T22:02:36.099026+0000","last_became_peered":"2024-09-11T22:02:36.099026+0000","last_unstale":"2024-09-11T22:04:17.407046+0000","last_undegraded":"2024-09-11T22:04:17.407046+0000","last_fullsized":"2024-09-11T22:04:17.407046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:57.570147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358629+0000","last_change":"2024-09-11T22:02:34.083757+0000","last_active":"2024-09-11T22:04:17.358629+0000","last_peered":"2024-09-11T22:04:17.358629+0000","last_clean":"2024-09-11T22:04:17.358629+0000","last_became_active":"2024-09-11T22:02:34.083467+0000","last_became_peered":"2024-09-11T22:02:34.083467+0000","last_unstale":"2024-09-11T22:04:17.358629+0000","last_undegraded":"2024-09-11T22:04:17.358629+0000","last_fullsized":"2024-09-11T22:04:17.358629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.546772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407844+0000","last_change":"2024-09-11T22:02:36.098939+0000","last_active":"2024-09-11T22:04:17.407844+0000","last_peered":"2024-09-11T22:04:17.407844+0000","last_clean":"2024-09-11T22:04:17.407844+0000","last_became_active":"2024-09-11T22:02:36.098631+0000","last_became_peered":"2024-09-11T22:02:36.098631+0000","last_unstale":"2024-09-11T22:04:17.407844+0000","last_undegraded":"2024-09-11T22:04:17.407844+0000","last_fullsized":"2024-09-11T22:04:17.407844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:07.663332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":126,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:21.977208+0000","last_change":"2024-09-11T22:02:34.085325+0000","last_active":"2024-09-11T22:04:21.977208+0000","last_peered":"2024-09-11T22:04:21.977208+0000","last_clean":"2024-09-11T22:04:21.977208+0000","last_became_active":"2024-09-11T22:02:34.084967+0000","last_became_peered":"2024-09-11T22:02:34.084967+0000","last_unstale":"2024-09-11T22:04:21.977208+0000","last_undegraded":"2024-09-11T22:04:21.977208+0000","last_fullsized":"2024-09-11T22:04:21.977208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:35.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396449+0000","last_change":"2024-09-11T22:02:36.104454+0000","last_active":"2024-09-11T22:04:17.396449+0000","last_peered":"2024-09-11T22:04:17.396449+0000","last_clean":"2024-09-11T22:04:17.396449+0000","last_became_active":"2024-09-11T22:02:36.103988+0000","last_became_peered":"2024-09-11T22:02:36.103988+0000","last_unstale":"2024-09-11T22:04:17.396449+0000","last_undegraded":"2024-09-11T22:04:17.396449+0000","last_fullsized":"2024-09-11T22:04:17.396449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:32.748524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362192+0000","last_change":"2024-09-11T22:02:55.548642+0000","last_active":"2024-09-11T22:04:17.362192+0000","last_peered":"2024-09-11T22:04:17.362192+0000","last_clean":"2024-09-11T22:04:17.362192+0000","last_became_active":"2024-09-11T22:02:55.545771+0000","last_became_peered":"2024-09-11T22:02:55.545771+0000","last_unstale":"2024-09-11T22:04:17.362192+0000","last_undegraded":"2024-09-11T22:04:17.362192+0000","last_fullsized":"2024-09-11T22:04:17.362192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:03.431986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411866+0000","last_change":"2024-09-11T22:02:55.349125+0000","last_active":"2024-09-11T22:04:17.411866+0000","last_peered":"2024-09-11T22:04:17.411866+0000","last_clean":"2024-09-11T22:04:17.411866+0000","last_became_active":"2024-09-11T22:02:55.348746+0000","last_became_peered":"2024-09-11T22:02:55.348746+0000","last_unstale":"2024-09-11T22:04:17.411866+0000","last_undegraded":"2024-09-11T22:04:17.411866+0000","last_fullsized":"2024-09-11T22:04:17.411866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358974+0000","last_change":"2024-09-11T22:02:34.089793+0000","last_active":"2024-09-11T22:04:17.358974+0000","last_peered":"2024-09-11T22:04:17.358974+0000","last_clean":"2024-09-11T22:04:17.358974+0000","last_became_active":"2024-09-11T22:02:34.089468+0000","last_became_peered":"2024-09-11T22:02:34.089468+0000","last_unstale":"2024-09-11T22:04:17.358974+0000","last_undegraded":"2024-09-11T22:04:17.358974+0000","last_fullsized":"2024-09-11T22:04:17.358974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:10:21.034822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401964+0000","last_change":"2024-09-11T22:02:36.106224+0000","last_active":"2024-09-11T22:04:17.401964+0000","last_peered":"2024-09-11T22:04:17.401964+0000","last_clean":"2024-09-11T22:04:17.401964+0000","last_became_active":"2024-09-11T22:02:36.105903+0000","last_became_peered":"2024-09-11T22:02:36.105903+0000","last_unstale":"2024-09-11T22:04:17.401964+0000","last_undegraded":"2024-09-11T22:04:17.401964+0000","last_fullsized":"2024-09-11T22:04:17.401964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.354653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'35","reported_seq":267,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:22.981933+0000","last_change":"2024-09-11T22:02:34.082150+0000","last_active":"2024-09-11T22:04:22.981933+0000","last_peered":"2024-09-11T22:04:22.981933+0000","last_clean":"2024-09-11T22:04:22.981933+0000","last_became_active":"2024-09-11T22:02:34.081822+0000","last_became_peered":"2024-09-11T22:02:34.081822+0000","last_unstale":"2024-09-11T22:04:22.981933+0000","last_undegraded":"2024-09-11T22:04:22.981933+0000","last_fullsized":"2024-09-11T22:04:22.981933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:39.320410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66873,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":169,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.386796+0000","last_change":"2024-09-11T22:02:36.112124+0000","last_active":"2024-09-11T22:04:17.386796+0000","last_peered":"2024-09-11T22:04:17.386796+0000","last_clean":"2024-09-11T22:04:17.386796+0000","last_became_active":"2024-09-11T22:02:36.111739+0000","last_became_peered":"2024-09-11T22:02:36.111739+0000","last_unstale":"2024-09-11T22:04:17.386796+0000","last_undegraded":"2024-09-11T22:04:17.386796+0000","last_fullsized":"2024-09-11T22:04:17.386796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:52.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352659+0000","last_change":"2024-09-11T22:02:34.083047+0000","last_active":"2024-09-11T22:04:17.352659+0000","last_peered":"2024-09-11T22:04:17.352659+0000","last_clean":"2024-09-11T22:04:17.352659+0000","last_became_active":"2024-09-11T22:02:34.082406+0000","last_became_peered":"2024-09-11T22:02:34.082406+0000","last_unstale":"2024-09-11T22:04:17.352659+0000","last_undegraded":"2024-09-11T22:04:17.352659+0000","last_fullsized":"2024-09-11T22:04:17.352659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:33.249337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407254+0000","last_change":"2024-09-11T22:02:36.108859+0000","last_active":"2024-09-11T22:04:17.407254+0000","last_peered":"2024-09-11T22:04:17.407254+0000","last_clean":"2024-09-11T22:04:17.407254+0000","last_became_active":"2024-09-11T22:02:36.108558+0000","last_became_peered":"2024-09-11T22:02:36.108558+0000","last_unstale":"2024-09-11T22:04:17.407254+0000","last_undegraded":"2024-09-11T22:04:17.407254+0000","last_fullsized":"2024-09-11T22:04:17.407254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.430672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358635+0000","last_change":"2024-09-11T22:02:34.080560+0000","last_active":"2024-09-11T22:04:17.358635+0000","last_peered":"2024-09-11T22:04:17.358635+0000","last_clean":"2024-09-11T22:04:17.358635+0000","last_became_active":"2024-09-11T22:02:34.080262+0000","last_became_peered":"2024-09-11T22:02:34.080262+0000","last_unstale":"2024-09-11T22:04:17.358635+0000","last_undegraded":"2024-09-11T22:04:17.358635+0000","last_fullsized":"2024-09-11T22:04:17.358635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:44.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403367+0000","last_change":"2024-09-11T22:02:36.107722+0000","last_active":"2024-09-11T22:04:17.403367+0000","last_peered":"2024-09-11T22:04:17.403367+0000","last_clean":"2024-09-11T22:04:17.403367+0000","last_became_active":"2024-09-11T22:02:36.107219+0000","last_became_peered":"2024-09-11T22:02:36.107219+0000","last_unstale":"2024-09-11T22:04:17.403367+0000","last_undegraded":"2024-09-11T22:04:17.403367+0000","last_fullsized":"2024-09-11T22:04:17.403367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.576045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'8","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:21.977799+0000","last_change":"2024-09-11T22:02:34.083573+0000","last_active":"2024-09-11T22:04:21.977799+0000","last_peered":"2024-09-11T22:04:21.977799+0000","last_clean":"2024-09-11T22:04:21.977799+0000","last_became_active":"2024-09-11T22:02:34.083277+0000","last_became_peered":"2024-09-11T22:02:34.083277+0000","last_unstale":"2024-09-11T22:04:21.977799+0000","last_undegraded":"2024-09-11T22:04:21.977799+0000","last_fullsized":"2024-09-11T22:04:21.977799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:31.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2301,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":6,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.382984+0000","last_change":"2024-09-11T22:02:36.105075+0000","last_active":"2024-09-11T22:04:17.382984+0000","last_peered":"2024-09-11T22:04:17.382984+0000","last_clean":"2024-09-11T22:04:17.382984+0000","last_became_active":"2024-09-11T22:02:36.104022+0000","last_became_peered":"2024-09-11T22:02:36.104022+0000","last_unstale":"2024-09-11T22:04:17.382984+0000","last_undegraded":"2024-09-11T22:04:17.382984+0000","last_fullsized":"2024-09-11T22:04:17.382984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.693146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.366650+0000","last_change":"2024-09-11T22:02:34.088727+0000","last_active":"2024-09-11T22:04:17.366650+0000","last_peered":"2024-09-11T22:04:17.366650+0000","last_clean":"2024-09-11T22:04:17.366650+0000","last_became_active":"2024-09-11T22:02:34.088394+0000","last_became_peered":"2024-09-11T22:02:34.088394+0000","last_unstale":"2024-09-11T22:04:17.366650+0000","last_undegraded":"2024-09-11T22:04:17.366650+0000","last_fullsized":"2024-09-11T22:04:17.366650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:11.809765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399053+0000","last_change":"2024-09-11T22:02:36.104522+0000","last_active":"2024-09-11T22:04:17.399053+0000","last_peered":"2024-09-11T22:04:17.399053+0000","last_clean":"2024-09-11T22:04:17.399053+0000","last_became_active":"2024-09-11T22:02:36.104181+0000","last_became_peered":"2024-09-11T22:02:36.104181+0000","last_unstale":"2024-09-11T22:04:17.399053+0000","last_undegraded":"2024-09-11T22:04:17.399053+0000","last_fullsized":"2024-09-11T22:04:17.399053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:08.139180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368106+0000","last_change":"2024-09-11T22:02:34.080341+0000","last_active":"2024-09-11T22:04:17.368106+0000","last_peered":"2024-09-11T22:04:17.368106+0000","last_clean":"2024-09-11T22:04:17.368106+0000","last_became_active":"2024-09-11T22:02:34.078761+0000","last_became_peered":"2024-09-11T22:02:34.078761+0000","last_unstale":"2024-09-11T22:04:17.368106+0000","last_undegraded":"2024-09-11T22:04:17.368106+0000","last_fullsized":"2024-09-11T22:04:17.368106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393697+0000","last_change":"2024-09-11T22:02:55.545135+0000","last_active":"2024-09-11T22:04:17.393697+0000","last_peered":"2024-09-11T22:04:17.393697+0000","last_clean":"2024-09-11T22:04:17.393697+0000","last_became_active":"2024-09-11T22:02:55.544785+0000","last_became_peered":"2024-09-11T22:02:55.544785+0000","last_unstale":"2024-09-11T22:04:17.393697+0000","last_undegraded":"2024-09-11T22:04:17.393697+0000","last_fullsized":"2024-09-11T22:04:17.393697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:05.815828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352013+0000","last_change":"2024-09-11T22:02:34.082364+0000","last_active":"2024-09-11T22:04:17.352013+0000","last_peered":"2024-09-11T22:04:17.352013+0000","last_clean":"2024-09-11T22:04:17.352013+0000","last_became_active":"2024-09-11T22:02:34.081906+0000","last_became_peered":"2024-09-11T22:02:34.081906+0000","last_unstale":"2024-09-11T22:04:17.352013+0000","last_undegraded":"2024-09-11T22:04:17.352013+0000","last_fullsized":"2024-09-11T22:04:17.352013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:58.603942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.390768+0000","last_change":"2024-09-11T22:02:36.110725+0000","last_active":"2024-09-11T22:04:17.390768+0000","last_peered":"2024-09-11T22:04:17.390768+0000","last_clean":"2024-09-11T22:04:17.390768+0000","last_became_active":"2024-09-11T22:02:36.110401+0000","last_became_peered":"2024-09-11T22:02:36.110401+0000","last_unstale":"2024-09-11T22:04:17.390768+0000","last_undegraded":"2024-09-11T22:04:17.390768+0000","last_fullsized":"2024-09-11T22:04:17.390768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:41.789134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'39","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.608522+0000","last_change":"2024-09-11T22:02:34.082983+0000","last_active":"2024-09-11T22:04:17.608522+0000","last_peered":"2024-09-11T22:04:17.608522+0000","last_clean":"2024-09-11T22:04:17.608522+0000","last_became_active":"2024-09-11T22:02:34.082618+0000","last_became_peered":"2024-09-11T22:02:34.082618+0000","last_unstale":"2024-09-11T22:04:17.608522+0000","last_undegraded":"2024-09-11T22:04:17.608522+0000","last_fullsized":"2024-09-11T22:04:17.608522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.481228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393689+0000","last_change":"2024-09-11T22:02:36.108222+0000","last_active":"2024-09-11T22:04:17.393689+0000","last_peered":"2024-09-11T22:04:17.393689+0000","last_clean":"2024-09-11T22:04:17.393689+0000","last_became_active":"2024-09-11T22:02:36.107739+0000","last_became_peered":"2024-09-11T22:02:36.107739+0000","last_unstale":"2024-09-11T22:04:17.393689+0000","last_undegraded":"2024-09-11T22:04:17.393689+0000","last_fullsized":"2024-09-11T22:04:17.393689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:11.353217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352780+0000","last_change":"2024-09-11T22:02:34.090068+0000","last_active":"2024-09-11T22:04:17.352780+0000","last_peered":"2024-09-11T22:04:17.352780+0000","last_clean":"2024-09-11T22:04:17.352780+0000","last_became_active":"2024-09-11T22:02:34.089735+0000","last_became_peered":"2024-09-11T22:02:34.089735+0000","last_unstale":"2024-09-11T22:04:17.352780+0000","last_undegraded":"2024-09-11T22:04:17.352780+0000","last_fullsized":"2024-09-11T22:04:17.352780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:32.917459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401828+0000","last_change":"2024-09-11T22:02:36.108017+0000","last_active":"2024-09-11T22:04:17.401828+0000","last_peered":"2024-09-11T22:04:17.401828+0000","last_clean":"2024-09-11T22:04:17.401828+0000","last_became_active":"2024-09-11T22:02:36.107339+0000","last_became_peered":"2024-09-11T22:02:36.107339+0000","last_unstale":"2024-09-11T22:04:17.401828+0000","last_undegraded":"2024-09-11T22:04:17.401828+0000","last_fullsized":"2024-09-11T22:04:17.401828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:19.240354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"85'148","reported_seq":391,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:19.483724+0000","last_change":"2024-09-11T22:01:28.522567+0000","last_active":"2024-09-11T22:04:19.483724+0000","last_peered":"2024-09-11T22:04:19.483724+0000","last_clean":"2024-09-11T22:04:19.483724+0000","last_became_active":"2024-09-11T22:01:28.522079+0000","last_became_peered":"2024-09-11T22:01:28.522079+0000","last_unstale":"2024-09-11T22:04:19.483724+0000","last_undegraded":"2024-09-11T22:04:19.483724+0000","last_fullsized":"2024-09-11T22:04:19.483724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_clean_scrub_stamp":"2024-09-11T21:58:11.245706+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:48.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365565+0000","last_change":"2024-09-11T22:02:34.080535+0000","last_active":"2024-09-11T22:04:17.365565+0000","last_peered":"2024-09-11T22:04:17.365565+0000","last_clean":"2024-09-11T22:04:17.365565+0000","last_became_active":"2024-09-11T22:02:34.079351+0000","last_became_peered":"2024-09-11T22:02:34.079351+0000","last_unstale":"2024-09-11T22:04:17.365565+0000","last_undegraded":"2024-09-11T22:04:17.365565+0000","last_fullsized":"2024-09-11T22:04:17.365565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:29.737198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400866+0000","last_change":"2024-09-11T22:02:36.104476+0000","last_active":"2024-09-11T22:04:17.400866+0000","last_peered":"2024-09-11T22:04:17.400866+0000","last_clean":"2024-09-11T22:04:17.400866+0000","last_became_active":"2024-09-11T22:02:36.104163+0000","last_became_peered":"2024-09-11T22:02:36.104163+0000","last_unstale":"2024-09-11T22:04:17.400866+0000","last_undegraded":"2024-09-11T22:04:17.400866+0000","last_fullsized":"2024-09-11T22:04:17.400866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.570125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362393+0000","last_change":"2024-09-11T22:02:34.079652+0000","last_active":"2024-09-11T22:04:17.362393+0000","last_peered":"2024-09-11T22:04:17.362393+0000","last_clean":"2024-09-11T22:04:17.362393+0000","last_became_active":"2024-09-11T22:02:34.079365+0000","last_became_peered":"2024-09-11T22:02:34.079365+0000","last_unstale":"2024-09-11T22:04:17.362393+0000","last_undegraded":"2024-09-11T22:04:17.362393+0000","last_fullsized":"2024-09-11T22:04:17.362393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:15.371852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399253+0000","last_change":"2024-09-11T22:02:36.107209+0000","last_active":"2024-09-11T22:04:17.399253+0000","last_peered":"2024-09-11T22:04:17.399253+0000","last_clean":"2024-09-11T22:04:17.399253+0000","last_became_active":"2024-09-11T22:02:36.106896+0000","last_became_peered":"2024-09-11T22:02:36.106896+0000","last_unstale":"2024-09-11T22:04:17.399253+0000","last_undegraded":"2024-09-11T22:04:17.399253+0000","last_fullsized":"2024-09-11T22:04:17.399253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:04.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:21.977419+0000","last_change":"2024-09-11T22:02:34.088531+0000","last_active":"2024-09-11T22:04:21.977419+0000","last_peered":"2024-09-11T22:04:21.977419+0000","last_clean":"2024-09-11T22:04:21.977419+0000","last_became_active":"2024-09-11T22:02:34.088252+0000","last_became_peered":"2024-09-11T22:02:34.088252+0000","last_unstale":"2024-09-11T22:04:21.977419+0000","last_undegraded":"2024-09-11T22:04:21.977419+0000","last_fullsized":"2024-09-11T22:04:21.977419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:43.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.389359+0000","last_change":"2024-09-11T22:02:36.108963+0000","last_active":"2024-09-11T22:04:17.389359+0000","last_peered":"2024-09-11T22:04:17.389359+0000","last_clean":"2024-09-11T22:04:17.389359+0000","last_became_active":"2024-09-11T22:02:36.108435+0000","last_became_peered":"2024-09-11T22:02:36.108435+0000","last_unstale":"2024-09-11T22:04:17.389359+0000","last_undegraded":"2024-09-11T22:04:17.389359+0000","last_fullsized":"2024-09-11T22:04:17.389359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:11.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.361831+0000","last_change":"2024-09-11T22:02:34.084283+0000","last_active":"2024-09-11T22:04:17.361831+0000","last_peered":"2024-09-11T22:04:17.361831+0000","last_clean":"2024-09-11T22:04:17.361831+0000","last_became_active":"2024-09-11T22:02:34.083948+0000","last_became_peered":"2024-09-11T22:02:34.083948+0000","last_unstale":"2024-09-11T22:04:17.361831+0000","last_undegraded":"2024-09-11T22:04:17.361831+0000","last_fullsized":"2024-09-11T22:04:17.361831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:48.763643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.391536+0000","last_change":"2024-09-11T22:02:36.102147+0000","last_active":"2024-09-11T22:04:17.391536+0000","last_peered":"2024-09-11T22:04:17.391536+0000","last_clean":"2024-09-11T22:04:17.391536+0000","last_became_active":"2024-09-11T22:02:36.101641+0000","last_became_peered":"2024-09-11T22:02:36.101641+0000","last_unstale":"2024-09-11T22:04:17.391536+0000","last_undegraded":"2024-09-11T22:04:17.391536+0000","last_fullsized":"2024-09-11T22:04:17.391536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:58.145304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358234+0000","last_change":"2024-09-11T22:02:34.090538+0000","last_active":"2024-09-11T22:04:17.358234+0000","last_peered":"2024-09-11T22:04:17.358234+0000","last_clean":"2024-09-11T22:04:17.358234+0000","last_became_active":"2024-09-11T22:02:34.090238+0000","last_became_peered":"2024-09-11T22:02:34.090238+0000","last_unstale":"2024-09-11T22:04:17.358234+0000","last_undegraded":"2024-09-11T22:04:17.358234+0000","last_fullsized":"2024-09-11T22:04:17.358234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:47.037999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397510+0000","last_change":"2024-09-11T22:02:36.095664+0000","last_active":"2024-09-11T22:04:17.397510+0000","last_peered":"2024-09-11T22:04:17.397510+0000","last_clean":"2024-09-11T22:04:17.397510+0000","last_became_active":"2024-09-11T22:02:36.095304+0000","last_became_peered":"2024-09-11T22:02:36.095304+0000","last_unstale":"2024-09-11T22:04:17.397510+0000","last_undegraded":"2024-09-11T22:04:17.397510+0000","last_fullsized":"2024-09-11T22:04:17.397510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.484809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368818+0000","last_change":"2024-09-11T22:02:34.089781+0000","last_active":"2024-09-11T22:04:17.368818+0000","last_peered":"2024-09-11T22:04:17.368818+0000","last_clean":"2024-09-11T22:04:17.368818+0000","last_became_active":"2024-09-11T22:02:34.089439+0000","last_became_peered":"2024-09-11T22:02:34.089439+0000","last_unstale":"2024-09-11T22:04:17.368818+0000","last_undegraded":"2024-09-11T22:04:17.368818+0000","last_fullsized":"2024-09-11T22:04:17.368818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:38.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400049+0000","last_change":"2024-09-11T22:02:36.107159+0000","last_active":"2024-09-11T22:04:17.400049+0000","last_peered":"2024-09-11T22:04:17.400049+0000","last_clean":"2024-09-11T22:04:17.400049+0000","last_became_active":"2024-09-11T22:02:36.106846+0000","last_became_peered":"2024-09-11T22:02:36.106846+0000","last_unstale":"2024-09-11T22:04:17.400049+0000","last_undegraded":"2024-09-11T22:04:17.400049+0000","last_fullsized":"2024-09-11T22:04:17.400049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.972944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'47","reported_seq":106,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:18.105639+0000","last_change":"2024-09-11T22:02:55.352887+0000","last_active":"2024-09-11T22:04:18.105639+0000","last_peered":"2024-09-11T22:04:18.105639+0000","last_clean":"2024-09-11T22:04:18.105639+0000","last_became_active":"2024-09-11T22:02:55.348619+0000","last_became_peered":"2024-09-11T22:02:55.348619+0000","last_unstale":"2024-09-11T22:04:18.105639+0000","last_undegraded":"2024-09-11T22:04:18.105639+0000","last_fullsized":"2024-09-11T22:04:18.105639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:51.259114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399780+0000","last_change":"2024-09-11T22:02:36.108560+0000","last_active":"2024-09-11T22:04:17.399780+0000","last_peered":"2024-09-11T22:04:17.399780+0000","last_clean":"2024-09-11T22:04:17.399780+0000","last_became_active":"2024-09-11T22:02:36.107593+0000","last_became_peered":"2024-09-11T22:02:36.107593+0000","last_unstale":"2024-09-11T22:04:17.399780+0000","last_undegraded":"2024-09-11T22:04:17.399780+0000","last_fullsized":"2024-09-11T22:04:17.399780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.479991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365257+0000","last_change":"2024-09-11T22:02:34.087394+0000","last_active":"2024-09-11T22:04:17.365257+0000","last_peered":"2024-09-11T22:04:17.365257+0000","last_clean":"2024-09-11T22:04:17.365257+0000","last_became_active":"2024-09-11T22:02:34.087146+0000","last_became_peered":"2024-09-11T22:02:34.087146+0000","last_unstale":"2024-09-11T22:04:17.365257+0000","last_undegraded":"2024-09-11T22:04:17.365257+0000","last_fullsized":"2024-09-11T22:04:17.365257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:30.772437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412826+0000","last_change":"2024-09-11T22:02:55.545065+0000","last_active":"2024-09-11T22:04:17.412826+0000","last_peered":"2024-09-11T22:04:17.412826+0000","last_clean":"2024-09-11T22:04:17.412826+0000","last_became_active":"2024-09-11T22:02:55.544736+0000","last_became_peered":"2024-09-11T22:02:55.544736+0000","last_unstale":"2024-09-11T22:04:17.412826+0000","last_undegraded":"2024-09-11T22:04:17.412826+0000","last_fullsized":"2024-09-11T22:04:17.412826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:23.706253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358626+0000","last_change":"2024-09-11T22:02:34.088717+0000","last_active":"2024-09-11T22:04:17.358626+0000","last_peered":"2024-09-11T22:04:17.358626+0000","last_clean":"2024-09-11T22:04:17.358626+0000","last_became_active":"2024-09-11T22:02:34.088412+0000","last_became_peered":"2024-09-11T22:02:34.088412+0000","last_unstale":"2024-09-11T22:04:17.358626+0000","last_undegraded":"2024-09-11T22:04:17.358626+0000","last_fullsized":"2024-09-11T22:04:17.358626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.376778+0000","last_change":"2024-09-11T22:02:36.103781+0000","last_active":"2024-09-11T22:04:17.376778+0000","last_peered":"2024-09-11T22:04:17.376778+0000","last_clean":"2024-09-11T22:04:17.376778+0000","last_became_active":"2024-09-11T22:02:36.103426+0000","last_became_peered":"2024-09-11T22:02:36.103426+0000","last_unstale":"2024-09-11T22:04:17.376778+0000","last_undegraded":"2024-09-11T22:04:17.376778+0000","last_fullsized":"2024-09-11T22:04:17.376778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:34.962793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.357294+0000","last_change":"2024-09-11T22:02:34.080333+0000","last_active":"2024-09-11T22:04:17.357294+0000","last_peered":"2024-09-11T22:04:17.357294+0000","last_clean":"2024-09-11T22:04:17.357294+0000","last_became_active":"2024-09-11T22:02:34.079384+0000","last_became_peered":"2024-09-11T22:02:34.079384+0000","last_unstale":"2024-09-11T22:04:17.357294+0000","last_undegraded":"2024-09-11T22:04:17.357294+0000","last_fullsized":"2024-09-11T22:04:17.357294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:38.313516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414236+0000","last_change":"2024-09-11T22:02:36.103306+0000","last_active":"2024-09-11T22:04:17.414236+0000","last_peered":"2024-09-11T22:04:17.414236+0000","last_clean":"2024-09-11T22:04:17.414236+0000","last_became_active":"2024-09-11T22:02:36.102967+0000","last_became_peered":"2024-09-11T22:02:36.102967+0000","last_unstale":"2024-09-11T22:04:17.414236+0000","last_undegraded":"2024-09-11T22:04:17.414236+0000","last_fullsized":"2024-09-11T22:04:17.414236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:34.138931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365503+0000","last_change":"2024-09-11T22:02:55.355119+0000","last_active":"2024-09-11T22:04:17.365503+0000","last_peered":"2024-09-11T22:04:17.365503+0000","last_clean":"2024-09-11T22:04:17.365503+0000","last_became_active":"2024-09-11T22:02:55.350440+0000","last_became_peered":"2024-09-11T22:02:55.350440+0000","last_unstale":"2024-09-11T22:04:17.365503+0000","last_undegraded":"2024-09-11T22:04:17.365503+0000","last_fullsized":"2024-09-11T22:04:17.365503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:47.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398642+0000","last_change":"2024-09-11T22:02:36.102491+0000","last_active":"2024-09-11T22:04:17.398642+0000","last_peered":"2024-09-11T22:04:17.398642+0000","last_clean":"2024-09-11T22:04:17.398642+0000","last_became_active":"2024-09-11T22:02:36.102112+0000","last_became_peered":"2024-09-11T22:02:36.102112+0000","last_unstale":"2024-09-11T22:04:17.398642+0000","last_undegraded":"2024-09-11T22:04:17.398642+0000","last_fullsized":"2024-09-11T22:04:17.398642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:47.588539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.367510+0000","last_change":"2024-09-11T22:02:34.082590+0000","last_active":"2024-09-11T22:04:17.367510+0000","last_peered":"2024-09-11T22:04:17.367510+0000","last_clean":"2024-09-11T22:04:17.367510+0000","last_became_active":"2024-09-11T22:02:34.082288+0000","last_became_peered":"2024-09-11T22:02:34.082288+0000","last_unstale":"2024-09-11T22:04:17.367510+0000","last_undegraded":"2024-09-11T22:04:17.367510+0000","last_fullsized":"2024-09-11T22:04:17.367510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:57.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402698+0000","last_change":"2024-09-11T22:02:36.105247+0000","last_active":"2024-09-11T22:04:17.402698+0000","last_peered":"2024-09-11T22:04:17.402698+0000","last_clean":"2024-09-11T22:04:17.402698+0000","last_became_active":"2024-09-11T22:02:36.104912+0000","last_became_peered":"2024-09-11T22:02:36.104912+0000","last_unstale":"2024-09-11T22:04:17.402698+0000","last_undegraded":"2024-09-11T22:04:17.402698+0000","last_fullsized":"2024-09-11T22:04:17.402698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:05.396671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398828+0000","last_change":"2024-09-11T22:02:55.544428+0000","last_active":"2024-09-11T22:04:17.398828+0000","last_peered":"2024-09-11T22:04:17.398828+0000","last_clean":"2024-09-11T22:04:17.398828+0000","last_became_active":"2024-09-11T22:02:55.544151+0000","last_became_peered":"2024-09-11T22:02:55.544151+0000","last_unstale":"2024-09-11T22:04:17.398828+0000","last_undegraded":"2024-09-11T22:04:17.398828+0000","last_fullsized":"2024-09-11T22:04:17.398828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.100131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368511+0000","last_change":"2024-09-11T22:02:34.079017+0000","last_active":"2024-09-11T22:04:17.368511+0000","last_peered":"2024-09-11T22:04:17.368511+0000","last_clean":"2024-09-11T22:04:17.368511+0000","last_became_active":"2024-09-11T22:02:34.078663+0000","last_became_peered":"2024-09-11T22:02:34.078663+0000","last_unstale":"2024-09-11T22:04:17.368511+0000","last_undegraded":"2024-09-11T22:04:17.368511+0000","last_fullsized":"2024-09-11T22:04:17.368511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:05.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406599+0000","last_change":"2024-09-11T22:02:36.097768+0000","last_active":"2024-09-11T22:04:17.406599+0000","last_peered":"2024-09-11T22:04:17.406599+0000","last_clean":"2024-09-11T22:04:17.406599+0000","last_became_active":"2024-09-11T22:02:36.097396+0000","last_became_peered":"2024-09-11T22:02:36.097396+0000","last_unstale":"2024-09-11T22:04:17.406599+0000","last_undegraded":"2024-09-11T22:04:17.406599+0000","last_fullsized":"2024-09-11T22:04:17.406599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:35.673268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368326+0000","last_change":"2024-09-11T22:02:55.355229+0000","last_active":"2024-09-11T22:04:17.368326+0000","last_peered":"2024-09-11T22:04:17.368326+0000","last_clean":"2024-09-11T22:04:17.368326+0000","last_became_active":"2024-09-11T22:02:55.350492+0000","last_became_peered":"2024-09-11T22:02:55.350492+0000","last_unstale":"2024-09-11T22:04:17.368326+0000","last_undegraded":"2024-09-11T22:04:17.368326+0000","last_fullsized":"2024-09-11T22:04:17.368326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:03:31.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412937+0000","last_change":"2024-09-11T22:02:36.108992+0000","last_active":"2024-09-11T22:04:17.412937+0000","last_peered":"2024-09-11T22:04:17.412937+0000","last_clean":"2024-09-11T22:04:17.412937+0000","last_became_active":"2024-09-11T22:02:36.108674+0000","last_became_peered":"2024-09-11T22:02:36.108674+0000","last_unstale":"2024-09-11T22:04:17.412937+0000","last_undegraded":"2024-09-11T22:04:17.412937+0000","last_fullsized":"2024-09-11T22:04:17.412937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:57.083127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358697+0000","last_change":"2024-09-11T22:02:34.088833+0000","last_active":"2024-09-11T22:04:17.358697+0000","last_peered":"2024-09-11T22:04:17.358697+0000","last_clean":"2024-09-11T22:04:17.358697+0000","last_became_active":"2024-09-11T22:02:34.088275+0000","last_became_peered":"2024-09-11T22:02:34.088275+0000","last_unstale":"2024-09-11T22:04:17.358697+0000","last_undegraded":"2024-09-11T22:04:17.358697+0000","last_fullsized":"2024-09-11T22:04:17.358697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:31.167486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403337+0000","last_change":"2024-09-11T22:02:36.108154+0000","last_active":"2024-09-11T22:04:17.403337+0000","last_peered":"2024-09-11T22:04:17.403337+0000","last_clean":"2024-09-11T22:04:17.403337+0000","last_became_active":"2024-09-11T22:02:36.107817+0000","last_became_peered":"2024-09-11T22:02:36.107817+0000","last_unstale":"2024-09-11T22:04:17.403337+0000","last_undegraded":"2024-09-11T22:04:17.403337+0000","last_fullsized":"2024-09-11T22:04:17.403337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.168339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358805+0000","last_change":"2024-09-11T22:02:34.082193+0000","last_active":"2024-09-11T22:04:17.358805+0000","last_peered":"2024-09-11T22:04:17.358805+0000","last_clean":"2024-09-11T22:04:17.358805+0000","last_became_active":"2024-09-11T22:02:34.081852+0000","last_became_peered":"2024-09-11T22:02:34.081852+0000","last_unstale":"2024-09-11T22:04:17.358805+0000","last_undegraded":"2024-09-11T22:04:17.358805+0000","last_fullsized":"2024-09-11T22:04:17.358805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:08.319444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":598332,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":715,"num_read_kb":467,"num_write":297,"num_write_kb":1441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1794996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514530,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32488,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712664,"statfs":{"total":95995035648,"available":95961767936,"internally_reserved":0,"allocated":1331200,"data_stored":845532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743462,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28760,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716392,"statfs":{"total":95995035648,"available":95965585408,"internally_reserved":0,"allocated":1777664,"data_stored":1243983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906988,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28340,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716812,"statfs":{"total":95995035648,"available":95966015488,"internally_reserved":0,"allocated":1347584,"data_stored":845768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":452472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1047044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528378,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":451941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790015,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28740,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716412,"statfs":{"total":95995035648,"available":95965605888,"internally_reserved":0,"allocated":1695744,"data_stored":1176615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":454091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":977068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1036288,"data_stored":521277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":518607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":453212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":201764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:04:23.611 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-11T22:04:23.611 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:04:23.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.747+0000 7ff3958af640 1 -- 172.21.15.152:0/3203111688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390102340 msgr2=0x7ff3901067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.747+0000 7ff3958af640 1 --2- 172.21.15.152:0/3203111688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390102340 0x7ff3901067e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff384009900 tx=0x7ff38402a410 comp rx=0 tx=0).stop 2024-09-11T22:04:23.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.747+0000 7ff3958af640 1 -- 172.21.15.152:0/3203111688 shutdown_connections 2024-09-11T22:04:23.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.747+0000 7ff3958af640 1 --2- 172.21.15.152:0/3203111688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff390106f40 0x7ff39010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.747+0000 7ff3958af640 1 --2- 172.21.15.152:0/3203111688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390102340 0x7ff3901067e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.747+0000 7ff3958af640 1 --2- 172.21.15.152:0/3203111688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff390101990 0x7ff390101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.747+0000 7ff3958af640 1 -- 172.21.15.152:0/3203111688 >> 172.21.15.152:0/3203111688 conn(0x7ff390075f60 msgr2=0x7ff390076370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.747+0000 7ff3958af640 1 -- 172.21.15.152:0/3203111688 shutdown_connections 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.747+0000 7ff3958af640 1 -- 172.21.15.152:0/3203111688 wait complete. 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.748+0000 7ff3958af640 1 Processor -- start 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.748+0000 7ff3958af640 1 -- start start 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.748+0000 7ff3958af640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff390101990 0x7ff390199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.748+0000 7ff3958af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff390106f40 0x7ff3901997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.748+0000 7ff3958af640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390199d40 0x7ff3901a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.748+0000 7ff3958af640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff390110de0 con 0x7ff390199d40 2024-09-11T22:04:23.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.748+0000 7ff3958af640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff390110c60 con 0x7ff390106f40 2024-09-11T22:04:23.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.748+0000 7ff3958af640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff390110f60 con 0x7ff390101990 2024-09-11T22:04:23.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.748+0000 7ff38f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390199d40 0x7ff3901a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.748+0000 7ff38f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390199d40 0x7ff3901a42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58908/0 (socket says 172.21.15.152:58908) 2024-09-11T22:04:23.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff38f7fe640 1 -- 172.21.15.152:0/33276246 learned_addr learned my addr 172.21.15.152:0/33276246 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:23.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff38e7fc640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff390106f40 0x7ff3901997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff38effd640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff390101990 0x7ff390199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff38f7fe640 1 -- 172.21.15.152:0/33276246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff390101990 msgr2=0x7ff390199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff38f7fe640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff390101990 0x7ff390199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff38f7fe640 1 -- 172.21.15.152:0/33276246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff390106f40 msgr2=0x7ff3901997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff38f7fe640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff390106f40 0x7ff3901997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff38f7fe640 1 -- 172.21.15.152:0/33276246 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3901a4ac0 con 0x7ff390199d40 2024-09-11T22:04:23.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff38f7fe640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390199d40 0x7ff3901a42f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff38800d750 tx=0x7ff38800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:23.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff3948ad640 1 -- 172.21.15.152:0/33276246 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388017070 con 0x7ff390199d40 2024-09-11T22:04:23.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff3948ad640 1 -- 172.21.15.152:0/33276246 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff388005500 con 0x7ff390199d40 2024-09-11T22:04:23.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff3958af640 1 -- 172.21.15.152:0/33276246 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3901a4db0 con 0x7ff390199d40 2024-09-11T22:04:23.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff3948ad640 1 -- 172.21.15.152:0/33276246 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388004d90 con 0x7ff390199d40 2024-09-11T22:04:23.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.749+0000 7ff3958af640 1 -- 172.21.15.152:0/33276246 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3901a5280 con 0x7ff390199d40 2024-09-11T22:04:23.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.750+0000 7ff3958af640 1 -- 172.21.15.152:0/33276246 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff390101d70 con 0x7ff390199d40 2024-09-11T22:04:23.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.751+0000 7ff3948ad640 1 -- 172.21.15.152:0/33276246 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7ff388004f30 con 0x7ff390199d40 2024-09-11T22:04:23.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.752+0000 7ff3948ad640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3780a2e20 0x7ff3780a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:23.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.752+0000 7ff38effd640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3780a2e20 0x7ff3780a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:23.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.752+0000 7ff3948ad640 1 -- 172.21.15.152:0/33276246 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff3880cf470 con 0x7ff390199d40 2024-09-11T22:04:23.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.753+0000 7ff38effd640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3780a2e20 0x7ff3780a52e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff380005c40 tx=0x7ff380005bd0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:23.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.755+0000 7ff3948ad640 1 -- 172.21.15.152:0/33276246 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff38809be10 con 0x7ff390199d40 2024-09-11T22:04:23.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.923+0000 7ff3958af640 1 -- 172.21.15.152:0/33276246 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff390102450 con 0x7ff3780a2e20 2024-09-11T22:04:23.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.929+0000 7ff3948ad640 1 -- 172.21.15.152:0/33276246 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257737 (secure 0 0 0) 0x7ff390102450 con 0x7ff3780a2e20 2024-09-11T22:04:23.932 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:23.934 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-09-11T22:04:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 -- 172.21.15.152:0/33276246 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3780a2e20 msgr2=0x7ff3780a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3780a2e20 0x7ff3780a52e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff380005c40 tx=0x7ff380005bd0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 -- 172.21.15.152:0/33276246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390199d40 msgr2=0x7ff3901a42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390199d40 0x7ff3901a42f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff38800d750 tx=0x7ff38800dc10 comp rx=0 tx=0).stop 2024-09-11T22:04:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 -- 172.21.15.152:0/33276246 shutdown_connections 2024-09-11T22:04:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3780a2e20 0x7ff3780a52e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390199d40 0x7ff3901a42f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff390106f40 0x7ff3901997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 --2- 172.21.15.152:0/33276246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff390101990 0x7ff390199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:23.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 -- 172.21.15.152:0/33276246 >> 172.21.15.152:0/33276246 conn(0x7ff390075f60 msgr2=0x7ff390104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:23.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 -- 172.21.15.152:0/33276246 shutdown_connections 2024-09-11T22:04:23.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:23.932+0000 7ff3958af640 1 -- 172.21.15.152:0/33276246 wait complete. 2024-09-11T22:04:23.944 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-09-11T22:04:23.371212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188934,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":952,"num_read_kb":797,"num_write":500,"num_write_kb":4381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":881,"ondisk_log_size":881,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368184,"kb_used_data":14688,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124573640,"statfs":{"total":1151940427776,"available":1151563407360,"internally_reserved":0,"allocated":15040512,"data_stored":8987610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":786,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":228,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.999897"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414391+0000","last_change":"2024-09-11T22:02:36.105689+0000","last_active":"2024-09-11T22:04:17.414391+0000","last_peered":"2024-09-11T22:04:17.414391+0000","last_clean":"2024-09-11T22:04:17.414391+0000","last_became_active":"2024-09-11T22:02:36.105128+0000","last_became_peered":"2024-09-11T22:02:36.105128+0000","last_unstale":"2024-09-11T22:04:17.414391+0000","last_undegraded":"2024-09-11T22:04:17.414391+0000","last_fullsized":"2024-09-11T22:04:17.414391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:18.018731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.410505+0000","last_change":"2024-09-11T22:02:36.096961+0000","last_active":"2024-09-11T22:04:17.410505+0000","last_peered":"2024-09-11T22:04:17.410505+0000","last_clean":"2024-09-11T22:04:17.410505+0000","last_became_active":"2024-09-11T22:02:36.096540+0000","last_became_peered":"2024-09-11T22:02:36.096540+0000","last_unstale":"2024-09-11T22:04:17.410505+0000","last_undegraded":"2024-09-11T22:04:17.410505+0000","last_fullsized":"2024-09-11T22:04:17.410505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:48.517125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413305+0000","last_change":"2024-09-11T22:02:36.108119+0000","last_active":"2024-09-11T22:04:17.413305+0000","last_peered":"2024-09-11T22:04:17.413305+0000","last_clean":"2024-09-11T22:04:17.413305+0000","last_became_active":"2024-09-11T22:02:36.107737+0000","last_became_peered":"2024-09-11T22:02:36.107737+0000","last_unstale":"2024-09-11T22:04:17.413305+0000","last_undegraded":"2024-09-11T22:04:17.413305+0000","last_fullsized":"2024-09-11T22:04:17.413305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:54.225935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395071+0000","last_change":"2024-09-11T22:02:36.107710+0000","last_active":"2024-09-11T22:04:17.395071+0000","last_peered":"2024-09-11T22:04:17.395071+0000","last_clean":"2024-09-11T22:04:17.395071+0000","last_became_active":"2024-09-11T22:02:36.107327+0000","last_became_peered":"2024-09-11T22:02:36.107327+0000","last_unstale":"2024-09-11T22:04:17.395071+0000","last_undegraded":"2024-09-11T22:04:17.395071+0000","last_fullsized":"2024-09-11T22:04:17.395071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.358535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396846+0000","last_change":"2024-09-11T22:02:36.100531+0000","last_active":"2024-09-11T22:04:17.396846+0000","last_peered":"2024-09-11T22:04:17.396846+0000","last_clean":"2024-09-11T22:04:17.396846+0000","last_became_active":"2024-09-11T22:02:36.100187+0000","last_became_peered":"2024-09-11T22:02:36.100187+0000","last_unstale":"2024-09-11T22:04:17.396846+0000","last_undegraded":"2024-09-11T22:04:17.396846+0000","last_fullsized":"2024-09-11T22:04:17.396846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.156080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397927+0000","last_change":"2024-09-11T22:02:36.101316+0000","last_active":"2024-09-11T22:04:17.397927+0000","last_peered":"2024-09-11T22:04:17.397927+0000","last_clean":"2024-09-11T22:04:17.397927+0000","last_became_active":"2024-09-11T22:02:36.100985+0000","last_became_peered":"2024-09-11T22:02:36.100985+0000","last_unstale":"2024-09-11T22:04:17.397927+0000","last_undegraded":"2024-09-11T22:04:17.397927+0000","last_fullsized":"2024-09-11T22:04:17.397927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:55.972974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.385307+0000","last_change":"2024-09-11T22:02:36.109146+0000","last_active":"2024-09-11T22:04:17.385307+0000","last_peered":"2024-09-11T22:04:17.385307+0000","last_clean":"2024-09-11T22:04:17.385307+0000","last_became_active":"2024-09-11T22:02:36.108817+0000","last_became_peered":"2024-09-11T22:02:36.108817+0000","last_unstale":"2024-09-11T22:04:17.385307+0000","last_undegraded":"2024-09-11T22:04:17.385307+0000","last_fullsized":"2024-09-11T22:04:17.385307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.222383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398948+0000","last_change":"2024-09-11T22:02:36.100362+0000","last_active":"2024-09-11T22:04:17.398948+0000","last_peered":"2024-09-11T22:04:17.398948+0000","last_clean":"2024-09-11T22:04:17.398948+0000","last_became_active":"2024-09-11T22:02:36.100088+0000","last_became_peered":"2024-09-11T22:02:36.100088+0000","last_unstale":"2024-09-11T22:04:17.398948+0000","last_undegraded":"2024-09-11T22:04:17.398948+0000","last_fullsized":"2024-09-11T22:04:17.398948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.478879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401808+0000","last_change":"2024-09-11T22:02:36.106360+0000","last_active":"2024-09-11T22:04:17.401808+0000","last_peered":"2024-09-11T22:04:17.401808+0000","last_clean":"2024-09-11T22:04:17.401808+0000","last_became_active":"2024-09-11T22:02:36.105994+0000","last_became_peered":"2024-09-11T22:02:36.105994+0000","last_unstale":"2024-09-11T22:04:17.401808+0000","last_undegraded":"2024-09-11T22:04:17.401808+0000","last_fullsized":"2024-09-11T22:04:17.401808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:33.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.394089+0000","last_change":"2024-09-11T22:02:36.109477+0000","last_active":"2024-09-11T22:04:17.394089+0000","last_peered":"2024-09-11T22:04:17.394089+0000","last_clean":"2024-09-11T22:04:17.394089+0000","last_became_active":"2024-09-11T22:02:36.109077+0000","last_became_peered":"2024-09-11T22:02:36.109077+0000","last_unstale":"2024-09-11T22:04:17.394089+0000","last_undegraded":"2024-09-11T22:04:17.394089+0000","last_fullsized":"2024-09-11T22:04:17.394089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.862359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399588+0000","last_change":"2024-09-11T22:02:36.112998+0000","last_active":"2024-09-11T22:04:17.399588+0000","last_peered":"2024-09-11T22:04:17.399588+0000","last_clean":"2024-09-11T22:04:17.399588+0000","last_became_active":"2024-09-11T22:02:36.112649+0000","last_became_peered":"2024-09-11T22:02:36.112649+0000","last_unstale":"2024-09-11T22:04:17.399588+0000","last_undegraded":"2024-09-11T22:04:17.399588+0000","last_fullsized":"2024-09-11T22:04:17.399588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:01.582572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398221+0000","last_change":"2024-09-11T22:02:36.099591+0000","last_active":"2024-09-11T22:04:17.398221+0000","last_peered":"2024-09-11T22:04:17.398221+0000","last_clean":"2024-09-11T22:04:17.398221+0000","last_became_active":"2024-09-11T22:02:36.099269+0000","last_became_peered":"2024-09-11T22:02:36.099269+0000","last_unstale":"2024-09-11T22:04:17.398221+0000","last_undegraded":"2024-09-11T22:04:17.398221+0000","last_fullsized":"2024-09-11T22:04:17.398221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:10.918188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403970+0000","last_change":"2024-09-11T22:02:36.100056+0000","last_active":"2024-09-11T22:04:17.403970+0000","last_peered":"2024-09-11T22:04:17.403970+0000","last_clean":"2024-09-11T22:04:17.403970+0000","last_became_active":"2024-09-11T22:02:36.099717+0000","last_became_peered":"2024-09-11T22:02:36.099717+0000","last_unstale":"2024-09-11T22:04:17.403970+0000","last_undegraded":"2024-09-11T22:04:17.403970+0000","last_fullsized":"2024-09-11T22:04:17.403970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.486256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411675+0000","last_change":"2024-09-11T22:02:36.097281+0000","last_active":"2024-09-11T22:04:17.411675+0000","last_peered":"2024-09-11T22:04:17.411675+0000","last_clean":"2024-09-11T22:04:17.411675+0000","last_became_active":"2024-09-11T22:02:36.096768+0000","last_became_peered":"2024-09-11T22:02:36.096768+0000","last_unstale":"2024-09-11T22:04:17.411675+0000","last_undegraded":"2024-09-11T22:04:17.411675+0000","last_fullsized":"2024-09-11T22:04:17.411675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:31.232578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412627+0000","last_change":"2024-09-11T22:02:55.351065+0000","last_active":"2024-09-11T22:04:17.412627+0000","last_peered":"2024-09-11T22:04:17.412627+0000","last_clean":"2024-09-11T22:04:17.412627+0000","last_became_active":"2024-09-11T22:02:55.350669+0000","last_became_peered":"2024-09-11T22:02:55.350669+0000","last_unstale":"2024-09-11T22:04:17.412627+0000","last_undegraded":"2024-09-11T22:04:17.412627+0000","last_fullsized":"2024-09-11T22:04:17.412627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:51.799060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414040+0000","last_change":"2024-09-11T22:02:36.109573+0000","last_active":"2024-09-11T22:04:17.414040+0000","last_peered":"2024-09-11T22:04:17.414040+0000","last_clean":"2024-09-11T22:04:17.414040+0000","last_became_active":"2024-09-11T22:02:36.109019+0000","last_became_peered":"2024-09-11T22:02:36.109019+0000","last_unstale":"2024-09-11T22:04:17.414040+0000","last_undegraded":"2024-09-11T22:04:17.414040+0000","last_fullsized":"2024-09-11T22:04:17.414040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:39.699762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414508+0000","last_change":"2024-09-11T22:02:36.105427+0000","last_active":"2024-09-11T22:04:17.414508+0000","last_peered":"2024-09-11T22:04:17.414508+0000","last_clean":"2024-09-11T22:04:17.414508+0000","last_became_active":"2024-09-11T22:02:36.104712+0000","last_became_peered":"2024-09-11T22:02:36.104712+0000","last_unstale":"2024-09-11T22:04:17.414508+0000","last_undegraded":"2024-09-11T22:04:17.414508+0000","last_fullsized":"2024-09-11T22:04:17.414508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:45.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399613+0000","last_change":"2024-09-11T22:02:36.097925+0000","last_active":"2024-09-11T22:04:17.399613+0000","last_peered":"2024-09-11T22:04:17.399613+0000","last_clean":"2024-09-11T22:04:17.399613+0000","last_became_active":"2024-09-11T22:02:36.097649+0000","last_became_peered":"2024-09-11T22:02:36.097649+0000","last_unstale":"2024-09-11T22:04:17.399613+0000","last_undegraded":"2024-09-11T22:04:17.399613+0000","last_fullsized":"2024-09-11T22:04:17.399613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.272197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400978+0000","last_change":"2024-09-11T22:02:36.107266+0000","last_active":"2024-09-11T22:04:17.400978+0000","last_peered":"2024-09-11T22:04:17.400978+0000","last_clean":"2024-09-11T22:04:17.400978+0000","last_became_active":"2024-09-11T22:02:36.106865+0000","last_became_peered":"2024-09-11T22:02:36.106865+0000","last_unstale":"2024-09-11T22:04:17.400978+0000","last_undegraded":"2024-09-11T22:04:17.400978+0000","last_fullsized":"2024-09-11T22:04:17.400978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:53.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396320+0000","last_change":"2024-09-11T22:02:55.349854+0000","last_active":"2024-09-11T22:04:17.396320+0000","last_peered":"2024-09-11T22:04:17.396320+0000","last_clean":"2024-09-11T22:04:17.396320+0000","last_became_active":"2024-09-11T22:02:55.349521+0000","last_became_peered":"2024-09-11T22:02:55.349521+0000","last_unstale":"2024-09-11T22:04:17.396320+0000","last_undegraded":"2024-09-11T22:04:17.396320+0000","last_fullsized":"2024-09-11T22:04:17.396320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406936+0000","last_change":"2024-09-11T22:02:36.110460+0000","last_active":"2024-09-11T22:04:17.406936+0000","last_peered":"2024-09-11T22:04:17.406936+0000","last_clean":"2024-09-11T22:04:17.406936+0000","last_became_active":"2024-09-11T22:02:36.110136+0000","last_became_peered":"2024-09-11T22:02:36.110136+0000","last_unstale":"2024-09-11T22:04:17.406936+0000","last_undegraded":"2024-09-11T22:04:17.406936+0000","last_fullsized":"2024-09-11T22:04:17.406936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:30.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403836+0000","last_change":"2024-09-11T22:02:36.111403+0000","last_active":"2024-09-11T22:04:17.403836+0000","last_peered":"2024-09-11T22:04:17.403836+0000","last_clean":"2024-09-11T22:04:17.403836+0000","last_became_active":"2024-09-11T22:02:36.110976+0000","last_became_peered":"2024-09-11T22:02:36.110976+0000","last_unstale":"2024-09-11T22:04:17.403836+0000","last_undegraded":"2024-09-11T22:04:17.403836+0000","last_fullsized":"2024-09-11T22:04:17.403836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:03.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.405071+0000","last_change":"2024-09-11T22:02:36.110002+0000","last_active":"2024-09-11T22:04:17.405071+0000","last_peered":"2024-09-11T22:04:17.405071+0000","last_clean":"2024-09-11T22:04:17.405071+0000","last_became_active":"2024-09-11T22:02:36.109694+0000","last_became_peered":"2024-09-11T22:02:36.109694+0000","last_unstale":"2024-09-11T22:04:17.405071+0000","last_undegraded":"2024-09-11T22:04:17.405071+0000","last_fullsized":"2024-09-11T22:04:17.405071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:00.338509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406553+0000","last_change":"2024-09-11T22:02:36.101638+0000","last_active":"2024-09-11T22:04:17.406553+0000","last_peered":"2024-09-11T22:04:17.406553+0000","last_clean":"2024-09-11T22:04:17.406553+0000","last_became_active":"2024-09-11T22:02:36.101363+0000","last_became_peered":"2024-09-11T22:02:36.101363+0000","last_unstale":"2024-09-11T22:04:17.406553+0000","last_undegraded":"2024-09-11T22:04:17.406553+0000","last_fullsized":"2024-09-11T22:04:17.406553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:35.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399143+0000","last_change":"2024-09-11T22:02:36.109250+0000","last_active":"2024-09-11T22:04:17.399143+0000","last_peered":"2024-09-11T22:04:17.399143+0000","last_clean":"2024-09-11T22:04:17.399143+0000","last_became_active":"2024-09-11T22:02:36.108931+0000","last_became_peered":"2024-09-11T22:02:36.108931+0000","last_unstale":"2024-09-11T22:04:17.399143+0000","last_undegraded":"2024-09-11T22:04:17.399143+0000","last_fullsized":"2024-09-11T22:04:17.399143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:09.616621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400102+0000","last_change":"2024-09-11T22:02:36.113064+0000","last_active":"2024-09-11T22:04:17.400102+0000","last_peered":"2024-09-11T22:04:17.400102+0000","last_clean":"2024-09-11T22:04:17.400102+0000","last_became_active":"2024-09-11T22:02:36.112674+0000","last_became_peered":"2024-09-11T22:02:36.112674+0000","last_unstale":"2024-09-11T22:04:17.400102+0000","last_undegraded":"2024-09-11T22:04:17.400102+0000","last_fullsized":"2024-09-11T22:04:17.400102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:17.923053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395397+0000","last_change":"2024-09-11T22:02:36.101799+0000","last_active":"2024-09-11T22:04:17.395397+0000","last_peered":"2024-09-11T22:04:17.395397+0000","last_clean":"2024-09-11T22:04:17.395397+0000","last_became_active":"2024-09-11T22:02:36.101429+0000","last_became_peered":"2024-09-11T22:02:36.101429+0000","last_unstale":"2024-09-11T22:04:17.395397+0000","last_undegraded":"2024-09-11T22:04:17.395397+0000","last_fullsized":"2024-09-11T22:04:17.395397+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.597619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402304+0000","last_change":"2024-09-11T22:02:36.100993+0000","last_active":"2024-09-11T22:04:17.402304+0000","last_peered":"2024-09-11T22:04:17.402304+0000","last_clean":"2024-09-11T22:04:17.402304+0000","last_became_active":"2024-09-11T22:02:36.100678+0000","last_became_peered":"2024-09-11T22:02:36.100678+0000","last_unstale":"2024-09-11T22:04:17.402304+0000","last_undegraded":"2024-09-11T22:04:17.402304+0000","last_fullsized":"2024-09-11T22:04:17.402304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:18.808422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.408677+0000","last_change":"2024-09-11T22:02:36.103507+0000","last_active":"2024-09-11T22:04:17.408677+0000","last_peered":"2024-09-11T22:04:17.408677+0000","last_clean":"2024-09-11T22:04:17.408677+0000","last_became_active":"2024-09-11T22:02:36.103228+0000","last_became_peered":"2024-09-11T22:02:36.103228+0000","last_unstale":"2024-09-11T22:04:17.408677+0000","last_undegraded":"2024-09-11T22:04:17.408677+0000","last_fullsized":"2024-09-11T22:04:17.408677+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.898635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413675+0000","last_change":"2024-09-11T22:02:36.104734+0000","last_active":"2024-09-11T22:04:17.413675+0000","last_peered":"2024-09-11T22:04:17.413675+0000","last_clean":"2024-09-11T22:04:17.413675+0000","last_became_active":"2024-09-11T22:02:36.103974+0000","last_became_peered":"2024-09-11T22:02:36.103974+0000","last_unstale":"2024-09-11T22:04:17.413675+0000","last_undegraded":"2024-09-11T22:04:17.413675+0000","last_fullsized":"2024-09-11T22:04:17.413675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:54.142031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397564+0000","last_change":"2024-09-11T22:02:36.106103+0000","last_active":"2024-09-11T22:04:17.397564+0000","last_peered":"2024-09-11T22:04:17.397564+0000","last_clean":"2024-09-11T22:04:17.397564+0000","last_became_active":"2024-09-11T22:02:36.105792+0000","last_became_peered":"2024-09-11T22:02:36.105792+0000","last_unstale":"2024-09-11T22:04:17.397564+0000","last_undegraded":"2024-09-11T22:04:17.397564+0000","last_fullsized":"2024-09-11T22:04:17.397564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:06.607094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397456+0000","last_change":"2024-09-11T22:02:36.104147+0000","last_active":"2024-09-11T22:04:17.397456+0000","last_peered":"2024-09-11T22:04:17.397456+0000","last_clean":"2024-09-11T22:04:17.397456+0000","last_became_active":"2024-09-11T22:02:36.103782+0000","last_became_peered":"2024-09-11T22:02:36.103782+0000","last_unstale":"2024-09-11T22:04:17.397456+0000","last_undegraded":"2024-09-11T22:04:17.397456+0000","last_fullsized":"2024-09-11T22:04:17.397456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.127609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.392542+0000","last_change":"2024-09-11T22:02:36.101259+0000","last_active":"2024-09-11T22:04:17.392542+0000","last_peered":"2024-09-11T22:04:17.392542+0000","last_clean":"2024-09-11T22:04:17.392542+0000","last_became_active":"2024-09-11T22:02:36.100761+0000","last_became_peered":"2024-09-11T22:02:36.100761+0000","last_unstale":"2024-09-11T22:04:17.392542+0000","last_undegraded":"2024-09-11T22:04:17.392542+0000","last_fullsized":"2024-09-11T22:04:17.392542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:47.045252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:21.977912+0000","last_change":"2024-09-11T22:02:34.084522+0000","last_active":"2024-09-11T22:04:21.977912+0000","last_peered":"2024-09-11T22:04:21.977912+0000","last_clean":"2024-09-11T22:04:21.977912+0000","last_became_active":"2024-09-11T22:02:34.084211+0000","last_became_peered":"2024-09-11T22:02:34.084211+0000","last_unstale":"2024-09-11T22:04:21.977912+0000","last_undegraded":"2024-09-11T22:04:21.977912+0000","last_fullsized":"2024-09-11T22:04:21.977912+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:18.963998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406451+0000","last_change":"2024-09-11T22:02:36.106890+0000","last_active":"2024-09-11T22:04:17.406451+0000","last_peered":"2024-09-11T22:04:17.406451+0000","last_clean":"2024-09-11T22:04:17.406451+0000","last_became_active":"2024-09-11T22:02:36.105255+0000","last_became_peered":"2024-09-11T22:02:36.105255+0000","last_unstale":"2024-09-11T22:04:17.406451+0000","last_undegraded":"2024-09-11T22:04:17.406451+0000","last_fullsized":"2024-09-11T22:04:17.406451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.995542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.355903+0000","last_change":"2024-09-11T22:02:34.079967+0000","last_active":"2024-09-11T22:04:17.355903+0000","last_peered":"2024-09-11T22:04:17.355903+0000","last_clean":"2024-09-11T22:04:17.355903+0000","last_became_active":"2024-09-11T22:02:34.079649+0000","last_became_peered":"2024-09-11T22:02:34.079649+0000","last_unstale":"2024-09-11T22:04:17.355903+0000","last_undegraded":"2024-09-11T22:04:17.355903+0000","last_fullsized":"2024-09-11T22:04:17.355903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.661256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.351613+0000","last_change":"2024-09-11T22:02:34.079850+0000","last_active":"2024-09-11T22:04:17.351613+0000","last_peered":"2024-09-11T22:04:17.351613+0000","last_clean":"2024-09-11T22:04:17.351613+0000","last_became_active":"2024-09-11T22:02:34.079514+0000","last_became_peered":"2024-09-11T22:02:34.079514+0000","last_unstale":"2024-09-11T22:04:17.351613+0000","last_undegraded":"2024-09-11T22:04:17.351613+0000","last_fullsized":"2024-09-11T22:04:17.351613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.359482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407046+0000","last_change":"2024-09-11T22:02:36.099310+0000","last_active":"2024-09-11T22:04:17.407046+0000","last_peered":"2024-09-11T22:04:17.407046+0000","last_clean":"2024-09-11T22:04:17.407046+0000","last_became_active":"2024-09-11T22:02:36.099026+0000","last_became_peered":"2024-09-11T22:02:36.099026+0000","last_unstale":"2024-09-11T22:04:17.407046+0000","last_undegraded":"2024-09-11T22:04:17.407046+0000","last_fullsized":"2024-09-11T22:04:17.407046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:57.570147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358629+0000","last_change":"2024-09-11T22:02:34.083757+0000","last_active":"2024-09-11T22:04:17.358629+0000","last_peered":"2024-09-11T22:04:17.358629+0000","last_clean":"2024-09-11T22:04:17.358629+0000","last_became_active":"2024-09-11T22:02:34.083467+0000","last_became_peered":"2024-09-11T22:02:34.083467+0000","last_unstale":"2024-09-11T22:04:17.358629+0000","last_undegraded":"2024-09-11T22:04:17.358629+0000","last_fullsized":"2024-09-11T22:04:17.358629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.546772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407844+0000","last_change":"2024-09-11T22:02:36.098939+0000","last_active":"2024-09-11T22:04:17.407844+0000","last_peered":"2024-09-11T22:04:17.407844+0000","last_clean":"2024-09-11T22:04:17.407844+0000","last_became_active":"2024-09-11T22:02:36.098631+0000","last_became_peered":"2024-09-11T22:02:36.098631+0000","last_unstale":"2024-09-11T22:04:17.407844+0000","last_undegraded":"2024-09-11T22:04:17.407844+0000","last_fullsized":"2024-09-11T22:04:17.407844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:07.663332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":126,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:21.977208+0000","last_change":"2024-09-11T22:02:34.085325+0000","last_active":"2024-09-11T22:04:21.977208+0000","last_peered":"2024-09-11T22:04:21.977208+0000","last_clean":"2024-09-11T22:04:21.977208+0000","last_became_active":"2024-09-11T22:02:34.084967+0000","last_became_peered":"2024-09-11T22:02:34.084967+0000","last_unstale":"2024-09-11T22:04:21.977208+0000","last_undegraded":"2024-09-11T22:04:21.977208+0000","last_fullsized":"2024-09-11T22:04:21.977208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:35.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396449+0000","last_change":"2024-09-11T22:02:36.104454+0000","last_active":"2024-09-11T22:04:17.396449+0000","last_peered":"2024-09-11T22:04:17.396449+0000","last_clean":"2024-09-11T22:04:17.396449+0000","last_became_active":"2024-09-11T22:02:36.103988+0000","last_became_peered":"2024-09-11T22:02:36.103988+0000","last_unstale":"2024-09-11T22:04:17.396449+0000","last_undegraded":"2024-09-11T22:04:17.396449+0000","last_fullsized":"2024-09-11T22:04:17.396449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:32.748524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362192+0000","last_change":"2024-09-11T22:02:55.548642+0000","last_active":"2024-09-11T22:04:17.362192+0000","last_peered":"2024-09-11T22:04:17.362192+0000","last_clean":"2024-09-11T22:04:17.362192+0000","last_became_active":"2024-09-11T22:02:55.545771+0000","last_became_peered":"2024-09-11T22:02:55.545771+0000","last_unstale":"2024-09-11T22:04:17.362192+0000","last_undegraded":"2024-09-11T22:04:17.362192+0000","last_fullsized":"2024-09-11T22:04:17.362192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:03.431986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411866+0000","last_change":"2024-09-11T22:02:55.349125+0000","last_active":"2024-09-11T22:04:17.411866+0000","last_peered":"2024-09-11T22:04:17.411866+0000","last_clean":"2024-09-11T22:04:17.411866+0000","last_became_active":"2024-09-11T22:02:55.348746+0000","last_became_peered":"2024-09-11T22:02:55.348746+0000","last_unstale":"2024-09-11T22:04:17.411866+0000","last_undegraded":"2024-09-11T22:04:17.411866+0000","last_fullsized":"2024-09-11T22:04:17.411866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358974+0000","last_change":"2024-09-11T22:02:34.089793+0000","last_active":"2024-09-11T22:04:17.358974+0000","last_peered":"2024-09-11T22:04:17.358974+0000","last_clean":"2024-09-11T22:04:17.358974+0000","last_became_active":"2024-09-11T22:02:34.089468+0000","last_became_peered":"2024-09-11T22:02:34.089468+0000","last_unstale":"2024-09-11T22:04:17.358974+0000","last_undegraded":"2024-09-11T22:04:17.358974+0000","last_fullsized":"2024-09-11T22:04:17.358974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:10:21.034822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401964+0000","last_change":"2024-09-11T22:02:36.106224+0000","last_active":"2024-09-11T22:04:17.401964+0000","last_peered":"2024-09-11T22:04:17.401964+0000","last_clean":"2024-09-11T22:04:17.401964+0000","last_became_active":"2024-09-11T22:02:36.105903+0000","last_became_peered":"2024-09-11T22:02:36.105903+0000","last_unstale":"2024-09-11T22:04:17.401964+0000","last_undegraded":"2024-09-11T22:04:17.401964+0000","last_fullsized":"2024-09-11T22:04:17.401964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.354653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'35","reported_seq":267,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:22.981933+0000","last_change":"2024-09-11T22:02:34.082150+0000","last_active":"2024-09-11T22:04:22.981933+0000","last_peered":"2024-09-11T22:04:22.981933+0000","last_clean":"2024-09-11T22:04:22.981933+0000","last_became_active":"2024-09-11T22:02:34.081822+0000","last_became_peered":"2024-09-11T22:02:34.081822+0000","last_unstale":"2024-09-11T22:04:22.981933+0000","last_undegraded":"2024-09-11T22:04:22.981933+0000","last_fullsized":"2024-09-11T22:04:22.981933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:39.320410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66873,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":169,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.386796+0000","last_change":"2024-09-11T22:02:36.112124+0000","last_active":"2024-09-11T22:04:17.386796+0000","last_peered":"2024-09-11T22:04:17.386796+0000","last_clean":"2024-09-11T22:04:17.386796+0000","last_became_active":"2024-09-11T22:02:36.111739+0000","last_became_peered":"2024-09-11T22:02:36.111739+0000","last_unstale":"2024-09-11T22:04:17.386796+0000","last_undegraded":"2024-09-11T22:04:17.386796+0000","last_fullsized":"2024-09-11T22:04:17.386796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:52.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352659+0000","last_change":"2024-09-11T22:02:34.083047+0000","last_active":"2024-09-11T22:04:17.352659+0000","last_peered":"2024-09-11T22:04:17.352659+0000","last_clean":"2024-09-11T22:04:17.352659+0000","last_became_active":"2024-09-11T22:02:34.082406+0000","last_became_peered":"2024-09-11T22:02:34.082406+0000","last_unstale":"2024-09-11T22:04:17.352659+0000","last_undegraded":"2024-09-11T22:04:17.352659+0000","last_fullsized":"2024-09-11T22:04:17.352659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:33.249337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407254+0000","last_change":"2024-09-11T22:02:36.108859+0000","last_active":"2024-09-11T22:04:17.407254+0000","last_peered":"2024-09-11T22:04:17.407254+0000","last_clean":"2024-09-11T22:04:17.407254+0000","last_became_active":"2024-09-11T22:02:36.108558+0000","last_became_peered":"2024-09-11T22:02:36.108558+0000","last_unstale":"2024-09-11T22:04:17.407254+0000","last_undegraded":"2024-09-11T22:04:17.407254+0000","last_fullsized":"2024-09-11T22:04:17.407254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.430672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358635+0000","last_change":"2024-09-11T22:02:34.080560+0000","last_active":"2024-09-11T22:04:17.358635+0000","last_peered":"2024-09-11T22:04:17.358635+0000","last_clean":"2024-09-11T22:04:17.358635+0000","last_became_active":"2024-09-11T22:02:34.080262+0000","last_became_peered":"2024-09-11T22:02:34.080262+0000","last_unstale":"2024-09-11T22:04:17.358635+0000","last_undegraded":"2024-09-11T22:04:17.358635+0000","last_fullsized":"2024-09-11T22:04:17.358635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:44.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403367+0000","last_change":"2024-09-11T22:02:36.107722+0000","last_active":"2024-09-11T22:04:17.403367+0000","last_peered":"2024-09-11T22:04:17.403367+0000","last_clean":"2024-09-11T22:04:17.403367+0000","last_became_active":"2024-09-11T22:02:36.107219+0000","last_became_peered":"2024-09-11T22:02:36.107219+0000","last_unstale":"2024-09-11T22:04:17.403367+0000","last_undegraded":"2024-09-11T22:04:17.403367+0000","last_fullsized":"2024-09-11T22:04:17.403367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.576045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'8","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:21.977799+0000","last_change":"2024-09-11T22:02:34.083573+0000","last_active":"2024-09-11T22:04:21.977799+0000","last_peered":"2024-09-11T22:04:21.977799+0000","last_clean":"2024-09-11T22:04:21.977799+0000","last_became_active":"2024-09-11T22:02:34.083277+0000","last_became_peered":"2024-09-11T22:02:34.083277+0000","last_unstale":"2024-09-11T22:04:21.977799+0000","last_undegraded":"2024-09-11T22:04:21.977799+0000","last_fullsized":"2024-09-11T22:04:21.977799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:31.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2301,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":6,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.382984+0000","last_change":"2024-09-11T22:02:36.105075+0000","last_active":"2024-09-11T22:04:17.382984+0000","last_peered":"2024-09-11T22:04:17.382984+0000","last_clean":"2024-09-11T22:04:17.382984+0000","last_became_active":"2024-09-11T22:02:36.104022+0000","last_became_peered":"2024-09-11T22:02:36.104022+0000","last_unstale":"2024-09-11T22:04:17.382984+0000","last_undegraded":"2024-09-11T22:04:17.382984+0000","last_fullsized":"2024-09-11T22:04:17.382984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.693146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.366650+0000","last_change":"2024-09-11T22:02:34.088727+0000","last_active":"2024-09-11T22:04:17.366650+0000","last_peered":"2024-09-11T22:04:17.366650+0000","last_clean":"2024-09-11T22:04:17.366650+0000","last_became_active":"2024-09-11T22:02:34.088394+0000","last_became_peered":"2024-09-11T22:02:34.088394+0000","last_unstale":"2024-09-11T22:04:17.366650+0000","last_undegraded":"2024-09-11T22:04:17.366650+0000","last_fullsized":"2024-09-11T22:04:17.366650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:11.809765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399053+0000","last_change":"2024-09-11T22:02:36.104522+0000","last_active":"2024-09-11T22:04:17.399053+0000","last_peered":"2024-09-11T22:04:17.399053+0000","last_clean":"2024-09-11T22:04:17.399053+0000","last_became_active":"2024-09-11T22:02:36.104181+0000","last_became_peered":"2024-09-11T22:02:36.104181+0000","last_unstale":"2024-09-11T22:04:17.399053+0000","last_undegraded":"2024-09-11T22:04:17.399053+0000","last_fullsized":"2024-09-11T22:04:17.399053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:08.139180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368106+0000","last_change":"2024-09-11T22:02:34.080341+0000","last_active":"2024-09-11T22:04:17.368106+0000","last_peered":"2024-09-11T22:04:17.368106+0000","last_clean":"2024-09-11T22:04:17.368106+0000","last_became_active":"2024-09-11T22:02:34.078761+0000","last_became_peered":"2024-09-11T22:02:34.078761+0000","last_unstale":"2024-09-11T22:04:17.368106+0000","last_undegraded":"2024-09-11T22:04:17.368106+0000","last_fullsized":"2024-09-11T22:04:17.368106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393697+0000","last_change":"2024-09-11T22:02:55.545135+0000","last_active":"2024-09-11T22:04:17.393697+0000","last_peered":"2024-09-11T22:04:17.393697+0000","last_clean":"2024-09-11T22:04:17.393697+0000","last_became_active":"2024-09-11T22:02:55.544785+0000","last_became_peered":"2024-09-11T22:02:55.544785+0000","last_unstale":"2024-09-11T22:04:17.393697+0000","last_undegraded":"2024-09-11T22:04:17.393697+0000","last_fullsized":"2024-09-11T22:04:17.393697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:05.815828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352013+0000","last_change":"2024-09-11T22:02:34.082364+0000","last_active":"2024-09-11T22:04:17.352013+0000","last_peered":"2024-09-11T22:04:17.352013+0000","last_clean":"2024-09-11T22:04:17.352013+0000","last_became_active":"2024-09-11T22:02:34.081906+0000","last_became_peered":"2024-09-11T22:02:34.081906+0000","last_unstale":"2024-09-11T22:04:17.352013+0000","last_undegraded":"2024-09-11T22:04:17.352013+0000","last_fullsized":"2024-09-11T22:04:17.352013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:58.603942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.390768+0000","last_change":"2024-09-11T22:02:36.110725+0000","last_active":"2024-09-11T22:04:17.390768+0000","last_peered":"2024-09-11T22:04:17.390768+0000","last_clean":"2024-09-11T22:04:17.390768+0000","last_became_active":"2024-09-11T22:02:36.110401+0000","last_became_peered":"2024-09-11T22:02:36.110401+0000","last_unstale":"2024-09-11T22:04:17.390768+0000","last_undegraded":"2024-09-11T22:04:17.390768+0000","last_fullsized":"2024-09-11T22:04:17.390768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:41.789134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'39","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.608522+0000","last_change":"2024-09-11T22:02:34.082983+0000","last_active":"2024-09-11T22:04:17.608522+0000","last_peered":"2024-09-11T22:04:17.608522+0000","last_clean":"2024-09-11T22:04:17.608522+0000","last_became_active":"2024-09-11T22:02:34.082618+0000","last_became_peered":"2024-09-11T22:02:34.082618+0000","last_unstale":"2024-09-11T22:04:17.608522+0000","last_undegraded":"2024-09-11T22:04:17.608522+0000","last_fullsized":"2024-09-11T22:04:17.608522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.481228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393689+0000","last_change":"2024-09-11T22:02:36.108222+0000","last_active":"2024-09-11T22:04:17.393689+0000","last_peered":"2024-09-11T22:04:17.393689+0000","last_clean":"2024-09-11T22:04:17.393689+0000","last_became_active":"2024-09-11T22:02:36.107739+0000","last_became_peered":"2024-09-11T22:02:36.107739+0000","last_unstale":"2024-09-11T22:04:17.393689+0000","last_undegraded":"2024-09-11T22:04:17.393689+0000","last_fullsized":"2024-09-11T22:04:17.393689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:11.353217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352780+0000","last_change":"2024-09-11T22:02:34.090068+0000","last_active":"2024-09-11T22:04:17.352780+0000","last_peered":"2024-09-11T22:04:17.352780+0000","last_clean":"2024-09-11T22:04:17.352780+0000","last_became_active":"2024-09-11T22:02:34.089735+0000","last_became_peered":"2024-09-11T22:02:34.089735+0000","last_unstale":"2024-09-11T22:04:17.352780+0000","last_undegraded":"2024-09-11T22:04:17.352780+0000","last_fullsized":"2024-09-11T22:04:17.352780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:32.917459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401828+0000","last_change":"2024-09-11T22:02:36.108017+0000","last_active":"2024-09-11T22:04:17.401828+0000","last_peered":"2024-09-11T22:04:17.401828+0000","last_clean":"2024-09-11T22:04:17.401828+0000","last_became_active":"2024-09-11T22:02:36.107339+0000","last_became_peered":"2024-09-11T22:02:36.107339+0000","last_unstale":"2024-09-11T22:04:17.401828+0000","last_undegraded":"2024-09-11T22:04:17.401828+0000","last_fullsized":"2024-09-11T22:04:17.401828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:19.240354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"85'148","reported_seq":391,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:19.483724+0000","last_change":"2024-09-11T22:01:28.522567+0000","last_active":"2024-09-11T22:04:19.483724+0000","last_peered":"2024-09-11T22:04:19.483724+0000","last_clean":"2024-09-11T22:04:19.483724+0000","last_became_active":"2024-09-11T22:01:28.522079+0000","last_became_peered":"2024-09-11T22:01:28.522079+0000","last_unstale":"2024-09-11T22:04:19.483724+0000","last_undegraded":"2024-09-11T22:04:19.483724+0000","last_fullsized":"2024-09-11T22:04:19.483724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_clean_scrub_stamp":"2024-09-11T21:58:11.245706+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:48.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365565+0000","last_change":"2024-09-11T22:02:34.080535+0000","last_active":"2024-09-11T22:04:17.365565+0000","last_peered":"2024-09-11T22:04:17.365565+0000","last_clean":"2024-09-11T22:04:17.365565+0000","last_became_active":"2024-09-11T22:02:34.079351+0000","last_became_peered":"2024-09-11T22:02:34.079351+0000","last_unstale":"2024-09-11T22:04:17.365565+0000","last_undegraded":"2024-09-11T22:04:17.365565+0000","last_fullsized":"2024-09-11T22:04:17.365565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:29.737198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400866+0000","last_change":"2024-09-11T22:02:36.104476+0000","last_active":"2024-09-11T22:04:17.400866+0000","last_peered":"2024-09-11T22:04:17.400866+0000","last_clean":"2024-09-11T22:04:17.400866+0000","last_became_active":"2024-09-11T22:02:36.104163+0000","last_became_peered":"2024-09-11T22:02:36.104163+0000","last_unstale":"2024-09-11T22:04:17.400866+0000","last_undegraded":"2024-09-11T22:04:17.400866+0000","last_fullsized":"2024-09-11T22:04:17.400866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.570125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362393+0000","last_change":"2024-09-11T22:02:34.079652+0000","last_active":"2024-09-11T22:04:17.362393+0000","last_peered":"2024-09-11T22:04:17.362393+0000","last_clean":"2024-09-11T22:04:17.362393+0000","last_became_active":"2024-09-11T22:02:34.079365+0000","last_became_peered":"2024-09-11T22:02:34.079365+0000","last_unstale":"2024-09-11T22:04:17.362393+0000","last_undegraded":"2024-09-11T22:04:17.362393+0000","last_fullsized":"2024-09-11T22:04:17.362393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:15.371852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399253+0000","last_change":"2024-09-11T22:02:36.107209+0000","last_active":"2024-09-11T22:04:17.399253+0000","last_peered":"2024-09-11T22:04:17.399253+0000","last_clean":"2024-09-11T22:04:17.399253+0000","last_became_active":"2024-09-11T22:02:36.106896+0000","last_became_peered":"2024-09-11T22:02:36.106896+0000","last_unstale":"2024-09-11T22:04:17.399253+0000","last_undegraded":"2024-09-11T22:04:17.399253+0000","last_fullsized":"2024-09-11T22:04:17.399253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:04.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:21.977419+0000","last_change":"2024-09-11T22:02:34.088531+0000","last_active":"2024-09-11T22:04:21.977419+0000","last_peered":"2024-09-11T22:04:21.977419+0000","last_clean":"2024-09-11T22:04:21.977419+0000","last_became_active":"2024-09-11T22:02:34.088252+0000","last_became_peered":"2024-09-11T22:02:34.088252+0000","last_unstale":"2024-09-11T22:04:21.977419+0000","last_undegraded":"2024-09-11T22:04:21.977419+0000","last_fullsized":"2024-09-11T22:04:21.977419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:43.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.389359+0000","last_change":"2024-09-11T22:02:36.108963+0000","last_active":"2024-09-11T22:04:17.389359+0000","last_peered":"2024-09-11T22:04:17.389359+0000","last_clean":"2024-09-11T22:04:17.389359+0000","last_became_active":"2024-09-11T22:02:36.108435+0000","last_became_peered":"2024-09-11T22:02:36.108435+0000","last_unstale":"2024-09-11T22:04:17.389359+0000","last_undegraded":"2024-09-11T22:04:17.389359+0000","last_fullsized":"2024-09-11T22:04:17.389359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:11.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.361831+0000","last_change":"2024-09-11T22:02:34.084283+0000","last_active":"2024-09-11T22:04:17.361831+0000","last_peered":"2024-09-11T22:04:17.361831+0000","last_clean":"2024-09-11T22:04:17.361831+0000","last_became_active":"2024-09-11T22:02:34.083948+0000","last_became_peered":"2024-09-11T22:02:34.083948+0000","last_unstale":"2024-09-11T22:04:17.361831+0000","last_undegraded":"2024-09-11T22:04:17.361831+0000","last_fullsized":"2024-09-11T22:04:17.361831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:48.763643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.391536+0000","last_change":"2024-09-11T22:02:36.102147+0000","last_active":"2024-09-11T22:04:17.391536+0000","last_peered":"2024-09-11T22:04:17.391536+0000","last_clean":"2024-09-11T22:04:17.391536+0000","last_became_active":"2024-09-11T22:02:36.101641+0000","last_became_peered":"2024-09-11T22:02:36.101641+0000","last_unstale":"2024-09-11T22:04:17.391536+0000","last_undegraded":"2024-09-11T22:04:17.391536+0000","last_fullsized":"2024-09-11T22:04:17.391536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:58.145304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358234+0000","last_change":"2024-09-11T22:02:34.090538+0000","last_active":"2024-09-11T22:04:17.358234+0000","last_peered":"2024-09-11T22:04:17.358234+0000","last_clean":"2024-09-11T22:04:17.358234+0000","last_became_active":"2024-09-11T22:02:34.090238+0000","last_became_peered":"2024-09-11T22:02:34.090238+0000","last_unstale":"2024-09-11T22:04:17.358234+0000","last_undegraded":"2024-09-11T22:04:17.358234+0000","last_fullsized":"2024-09-11T22:04:17.358234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:47.037999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397510+0000","last_change":"2024-09-11T22:02:36.095664+0000","last_active":"2024-09-11T22:04:17.397510+0000","last_peered":"2024-09-11T22:04:17.397510+0000","last_clean":"2024-09-11T22:04:17.397510+0000","last_became_active":"2024-09-11T22:02:36.095304+0000","last_became_peered":"2024-09-11T22:02:36.095304+0000","last_unstale":"2024-09-11T22:04:17.397510+0000","last_undegraded":"2024-09-11T22:04:17.397510+0000","last_fullsized":"2024-09-11T22:04:17.397510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.484809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368818+0000","last_change":"2024-09-11T22:02:34.089781+0000","last_active":"2024-09-11T22:04:17.368818+0000","last_peered":"2024-09-11T22:04:17.368818+0000","last_clean":"2024-09-11T22:04:17.368818+0000","last_became_active":"2024-09-11T22:02:34.089439+0000","last_became_peered":"2024-09-11T22:02:34.089439+0000","last_unstale":"2024-09-11T22:04:17.368818+0000","last_undegraded":"2024-09-11T22:04:17.368818+0000","last_fullsized":"2024-09-11T22:04:17.368818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:38.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400049+0000","last_change":"2024-09-11T22:02:36.107159+0000","last_active":"2024-09-11T22:04:17.400049+0000","last_peered":"2024-09-11T22:04:17.400049+0000","last_clean":"2024-09-11T22:04:17.400049+0000","last_became_active":"2024-09-11T22:02:36.106846+0000","last_became_peered":"2024-09-11T22:02:36.106846+0000","last_unstale":"2024-09-11T22:04:17.400049+0000","last_undegraded":"2024-09-11T22:04:17.400049+0000","last_fullsized":"2024-09-11T22:04:17.400049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.972944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'47","reported_seq":106,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:18.105639+0000","last_change":"2024-09-11T22:02:55.352887+0000","last_active":"2024-09-11T22:04:18.105639+0000","last_peered":"2024-09-11T22:04:18.105639+0000","last_clean":"2024-09-11T22:04:18.105639+0000","last_became_active":"2024-09-11T22:02:55.348619+0000","last_became_peered":"2024-09-11T22:02:55.348619+0000","last_unstale":"2024-09-11T22:04:18.105639+0000","last_undegraded":"2024-09-11T22:04:18.105639+0000","last_fullsized":"2024-09-11T22:04:18.105639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:51.259114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399780+0000","last_change":"2024-09-11T22:02:36.108560+0000","last_active":"2024-09-11T22:04:17.399780+0000","last_peered":"2024-09-11T22:04:17.399780+0000","last_clean":"2024-09-11T22:04:17.399780+0000","last_became_active":"2024-09-11T22:02:36.107593+0000","last_became_peered":"2024-09-11T22:02:36.107593+0000","last_unstale":"2024-09-11T22:04:17.399780+0000","last_undegraded":"2024-09-11T22:04:17.399780+0000","last_fullsized":"2024-09-11T22:04:17.399780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.479991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365257+0000","last_change":"2024-09-11T22:02:34.087394+0000","last_active":"2024-09-11T22:04:17.365257+0000","last_peered":"2024-09-11T22:04:17.365257+0000","last_clean":"2024-09-11T22:04:17.365257+0000","last_became_active":"2024-09-11T22:02:34.087146+0000","last_became_peered":"2024-09-11T22:02:34.087146+0000","last_unstale":"2024-09-11T22:04:17.365257+0000","last_undegraded":"2024-09-11T22:04:17.365257+0000","last_fullsized":"2024-09-11T22:04:17.365257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:30.772437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412826+0000","last_change":"2024-09-11T22:02:55.545065+0000","last_active":"2024-09-11T22:04:17.412826+0000","last_peered":"2024-09-11T22:04:17.412826+0000","last_clean":"2024-09-11T22:04:17.412826+0000","last_became_active":"2024-09-11T22:02:55.544736+0000","last_became_peered":"2024-09-11T22:02:55.544736+0000","last_unstale":"2024-09-11T22:04:17.412826+0000","last_undegraded":"2024-09-11T22:04:17.412826+0000","last_fullsized":"2024-09-11T22:04:17.412826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:23.706253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358626+0000","last_change":"2024-09-11T22:02:34.088717+0000","last_active":"2024-09-11T22:04:17.358626+0000","last_peered":"2024-09-11T22:04:17.358626+0000","last_clean":"2024-09-11T22:04:17.358626+0000","last_became_active":"2024-09-11T22:02:34.088412+0000","last_became_peered":"2024-09-11T22:02:34.088412+0000","last_unstale":"2024-09-11T22:04:17.358626+0000","last_undegraded":"2024-09-11T22:04:17.358626+0000","last_fullsized":"2024-09-11T22:04:17.358626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.376778+0000","last_change":"2024-09-11T22:02:36.103781+0000","last_active":"2024-09-11T22:04:17.376778+0000","last_peered":"2024-09-11T22:04:17.376778+0000","last_clean":"2024-09-11T22:04:17.376778+0000","last_became_active":"2024-09-11T22:02:36.103426+0000","last_became_peered":"2024-09-11T22:02:36.103426+0000","last_unstale":"2024-09-11T22:04:17.376778+0000","last_undegraded":"2024-09-11T22:04:17.376778+0000","last_fullsized":"2024-09-11T22:04:17.376778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:34.962793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.357294+0000","last_change":"2024-09-11T22:02:34.080333+0000","last_active":"2024-09-11T22:04:17.357294+0000","last_peered":"2024-09-11T22:04:17.357294+0000","last_clean":"2024-09-11T22:04:17.357294+0000","last_became_active":"2024-09-11T22:02:34.079384+0000","last_became_peered":"2024-09-11T22:02:34.079384+0000","last_unstale":"2024-09-11T22:04:17.357294+0000","last_undegraded":"2024-09-11T22:04:17.357294+0000","last_fullsized":"2024-09-11T22:04:17.357294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:38.313516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414236+0000","last_change":"2024-09-11T22:02:36.103306+0000","last_active":"2024-09-11T22:04:17.414236+0000","last_peered":"2024-09-11T22:04:17.414236+0000","last_clean":"2024-09-11T22:04:17.414236+0000","last_became_active":"2024-09-11T22:02:36.102967+0000","last_became_peered":"2024-09-11T22:02:36.102967+0000","last_unstale":"2024-09-11T22:04:17.414236+0000","last_undegraded":"2024-09-11T22:04:17.414236+0000","last_fullsized":"2024-09-11T22:04:17.414236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:34.138931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365503+0000","last_change":"2024-09-11T22:02:55.355119+0000","last_active":"2024-09-11T22:04:17.365503+0000","last_peered":"2024-09-11T22:04:17.365503+0000","last_clean":"2024-09-11T22:04:17.365503+0000","last_became_active":"2024-09-11T22:02:55.350440+0000","last_became_peered":"2024-09-11T22:02:55.350440+0000","last_unstale":"2024-09-11T22:04:17.365503+0000","last_undegraded":"2024-09-11T22:04:17.365503+0000","last_fullsized":"2024-09-11T22:04:17.365503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:47.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398642+0000","last_change":"2024-09-11T22:02:36.102491+0000","last_active":"2024-09-11T22:04:17.398642+0000","last_peered":"2024-09-11T22:04:17.398642+0000","last_clean":"2024-09-11T22:04:17.398642+0000","last_became_active":"2024-09-11T22:02:36.102112+0000","last_became_peered":"2024-09-11T22:02:36.102112+0000","last_unstale":"2024-09-11T22:04:17.398642+0000","last_undegraded":"2024-09-11T22:04:17.398642+0000","last_fullsized":"2024-09-11T22:04:17.398642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:47.588539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.367510+0000","last_change":"2024-09-11T22:02:34.082590+0000","last_active":"2024-09-11T22:04:17.367510+0000","last_peered":"2024-09-11T22:04:17.367510+0000","last_clean":"2024-09-11T22:04:17.367510+0000","last_became_active":"2024-09-11T22:02:34.082288+0000","last_became_peered":"2024-09-11T22:02:34.082288+0000","last_unstale":"2024-09-11T22:04:17.367510+0000","last_undegraded":"2024-09-11T22:04:17.367510+0000","last_fullsized":"2024-09-11T22:04:17.367510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:57.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402698+0000","last_change":"2024-09-11T22:02:36.105247+0000","last_active":"2024-09-11T22:04:17.402698+0000","last_peered":"2024-09-11T22:04:17.402698+0000","last_clean":"2024-09-11T22:04:17.402698+0000","last_became_active":"2024-09-11T22:02:36.104912+0000","last_became_peered":"2024-09-11T22:02:36.104912+0000","last_unstale":"2024-09-11T22:04:17.402698+0000","last_undegraded":"2024-09-11T22:04:17.402698+0000","last_fullsized":"2024-09-11T22:04:17.402698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:05.396671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398828+0000","last_change":"2024-09-11T22:02:55.544428+0000","last_active":"2024-09-11T22:04:17.398828+0000","last_peered":"2024-09-11T22:04:17.398828+0000","last_clean":"2024-09-11T22:04:17.398828+0000","last_became_active":"2024-09-11T22:02:55.544151+0000","last_became_peered":"2024-09-11T22:02:55.544151+0000","last_unstale":"2024-09-11T22:04:17.398828+0000","last_undegraded":"2024-09-11T22:04:17.398828+0000","last_fullsized":"2024-09-11T22:04:17.398828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.100131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368511+0000","last_change":"2024-09-11T22:02:34.079017+0000","last_active":"2024-09-11T22:04:17.368511+0000","last_peered":"2024-09-11T22:04:17.368511+0000","last_clean":"2024-09-11T22:04:17.368511+0000","last_became_active":"2024-09-11T22:02:34.078663+0000","last_became_peered":"2024-09-11T22:02:34.078663+0000","last_unstale":"2024-09-11T22:04:17.368511+0000","last_undegraded":"2024-09-11T22:04:17.368511+0000","last_fullsized":"2024-09-11T22:04:17.368511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:05.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406599+0000","last_change":"2024-09-11T22:02:36.097768+0000","last_active":"2024-09-11T22:04:17.406599+0000","last_peered":"2024-09-11T22:04:17.406599+0000","last_clean":"2024-09-11T22:04:17.406599+0000","last_became_active":"2024-09-11T22:02:36.097396+0000","last_became_peered":"2024-09-11T22:02:36.097396+0000","last_unstale":"2024-09-11T22:04:17.406599+0000","last_undegraded":"2024-09-11T22:04:17.406599+0000","last_fullsized":"2024-09-11T22:04:17.406599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:35.673268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368326+0000","last_change":"2024-09-11T22:02:55.355229+0000","last_active":"2024-09-11T22:04:17.368326+0000","last_peered":"2024-09-11T22:04:17.368326+0000","last_clean":"2024-09-11T22:04:17.368326+0000","last_became_active":"2024-09-11T22:02:55.350492+0000","last_became_peered":"2024-09-11T22:02:55.350492+0000","last_unstale":"2024-09-11T22:04:17.368326+0000","last_undegraded":"2024-09-11T22:04:17.368326+0000","last_fullsized":"2024-09-11T22:04:17.368326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:03:31.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412937+0000","last_change":"2024-09-11T22:02:36.108992+0000","last_active":"2024-09-11T22:04:17.412937+0000","last_peered":"2024-09-11T22:04:17.412937+0000","last_clean":"2024-09-11T22:04:17.412937+0000","last_became_active":"2024-09-11T22:02:36.108674+0000","last_became_peered":"2024-09-11T22:02:36.108674+0000","last_unstale":"2024-09-11T22:04:17.412937+0000","last_undegraded":"2024-09-11T22:04:17.412937+0000","last_fullsized":"2024-09-11T22:04:17.412937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:57.083127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358697+0000","last_change":"2024-09-11T22:02:34.088833+0000","last_active":"2024-09-11T22:04:17.358697+0000","last_peered":"2024-09-11T22:04:17.358697+0000","last_clean":"2024-09-11T22:04:17.358697+0000","last_became_active":"2024-09-11T22:02:34.088275+0000","last_became_peered":"2024-09-11T22:02:34.088275+0000","last_unstale":"2024-09-11T22:04:17.358697+0000","last_undegraded":"2024-09-11T22:04:17.358697+0000","last_fullsized":"2024-09-11T22:04:17.358697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:31.167486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403337+0000","last_change":"2024-09-11T22:02:36.108154+0000","last_active":"2024-09-11T22:04:17.403337+0000","last_peered":"2024-09-11T22:04:17.403337+0000","last_clean":"2024-09-11T22:04:17.403337+0000","last_became_active":"2024-09-11T22:02:36.107817+0000","last_became_peered":"2024-09-11T22:02:36.107817+0000","last_unstale":"2024-09-11T22:04:17.403337+0000","last_undegraded":"2024-09-11T22:04:17.403337+0000","last_fullsized":"2024-09-11T22:04:17.403337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.168339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358805+0000","last_change":"2024-09-11T22:02:34.082193+0000","last_active":"2024-09-11T22:04:17.358805+0000","last_peered":"2024-09-11T22:04:17.358805+0000","last_clean":"2024-09-11T22:04:17.358805+0000","last_became_active":"2024-09-11T22:02:34.081852+0000","last_became_peered":"2024-09-11T22:02:34.081852+0000","last_unstale":"2024-09-11T22:04:17.358805+0000","last_undegraded":"2024-09-11T22:04:17.358805+0000","last_fullsized":"2024-09-11T22:04:17.358805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:08.319444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":598332,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":715,"num_read_kb":467,"num_write":297,"num_write_kb":1441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1794996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514530,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32488,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712664,"statfs":{"total":95995035648,"available":95961767936,"internally_reserved":0,"allocated":1331200,"data_stored":845532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743462,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28760,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716392,"statfs":{"total":95995035648,"available":95965585408,"internally_reserved":0,"allocated":1777664,"data_stored":1243983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906988,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28340,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716812,"statfs":{"total":95995035648,"available":95966015488,"internally_reserved":0,"allocated":1347584,"data_stored":845768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":452472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1047044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528378,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":451941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790015,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28740,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716412,"statfs":{"total":95995035648,"available":95965605888,"internally_reserved":0,"allocated":1695744,"data_stored":1176615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":454091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":977068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1036288,"data_stored":521277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":518607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":453212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":201764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:04:23.949 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:04:24.232 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:24.642 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:24 smithi152 ceph-mon[31188]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:24.642 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:24 smithi152 ceph-mon[31188]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 819 B/s wr, 31 op/s 2024-09-11T22:04:24.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.641+0000 7ff516307640 1 -- 172.21.15.152:0/192353791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff510102d40 msgr2=0x7ff510103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:24.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.641+0000 7ff516307640 1 --2- 172.21.15.152:0/192353791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff510102d40 0x7ff510103120 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff500009900 tx=0x7ff50002a480 comp rx=0 tx=0).stop 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.641+0000 7ff516307640 1 -- 172.21.15.152:0/192353791 shutdown_connections 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.641+0000 7ff516307640 1 --2- 172.21.15.152:0/192353791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff51010c170 0x7ff51010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.641+0000 7ff516307640 1 --2- 172.21.15.152:0/192353791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff510103660 0x7ff51010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.641+0000 7ff516307640 1 --2- 172.21.15.152:0/192353791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff510102d40 0x7ff510103120 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.641+0000 7ff516307640 1 -- 172.21.15.152:0/192353791 >> 172.21.15.152:0/192353791 conn(0x7ff5100fc7a0 msgr2=0x7ff5100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.641+0000 7ff516307640 1 -- 172.21.15.152:0/192353791 shutdown_connections 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.641+0000 7ff516307640 1 -- 172.21.15.152:0/192353791 wait complete. 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.641+0000 7ff516307640 1 Processor -- start 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff516307640 1 -- start start 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff516307640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff510102d40 0x7ff510198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff516307640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff510103660 0x7ff510198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff516307640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff51010c170 0x7ff51019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff516307640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff510111f70 con 0x7ff510103660 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff516307640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff510111df0 con 0x7ff51010c170 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff516307640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff5101120f0 con 0x7ff510102d40 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff507fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff510103660 0x7ff510198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff507fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff510103660 0x7ff510198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58920/0 (socket says 172.21.15.152:58920) 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff507fff640 1 -- 172.21.15.152:0/1005850770 learned_addr learned my addr 172.21.15.152:0/1005850770 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff50ffff640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff510102d40 0x7ff510198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff5148a4640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff51010c170 0x7ff51019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff507fff640 1 -- 172.21.15.152:0/1005850770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff510102d40 msgr2=0x7ff510198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff507fff640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff510102d40 0x7ff510198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff507fff640 1 -- 172.21.15.152:0/1005850770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff51010c170 msgr2=0x7ff51019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff507fff640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff51010c170 0x7ff51019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff507fff640 1 -- 172.21.15.152:0/1005850770 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51019d3e0 con 0x7ff510103660 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.642+0000 7ff5148a4640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff51010c170 0x7ff51019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.643+0000 7ff507fff640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff510103660 0x7ff510198970 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800d950 tx=0x7ff4f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.643+0000 7ff50dffb640 1 -- 172.21.15.152:0/1005850770 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8017030 con 0x7ff510103660 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.643+0000 7ff50dffb640 1 -- 172.21.15.152:0/1005850770 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4f8004020 con 0x7ff510103660 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.643+0000 7ff516307640 1 -- 172.21.15.152:0/1005850770 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51019d6d0 con 0x7ff510103660 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.643+0000 7ff50dffb640 1 -- 172.21.15.152:0/1005850770 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80047a0 con 0x7ff510103660 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.643+0000 7ff516307640 1 -- 172.21.15.152:0/1005850770 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5101a4fb0 con 0x7ff510103660 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.644+0000 7ff516307640 1 -- 172.21.15.152:0/1005850770 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff510103120 con 0x7ff510103660 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.645+0000 7ff50dffb640 1 -- 172.21.15.152:0/1005850770 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7ff4f80041d0 con 0x7ff510103660 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.645+0000 7ff50dffb640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4fc0a2e10 0x7ff4fc0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.646+0000 7ff50ffff640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4fc0a2e10 0x7ff4fc0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.646+0000 7ff50dffb640 1 -- 172.21.15.152:0/1005850770 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff4f80cf0b0 con 0x7ff510103660 2024-09-11T22:04:24.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.646+0000 7ff50ffff640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4fc0a2e10 0x7ff4fc0a52d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff500009230 tx=0x7ff5000058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:24.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.650+0000 7ff50dffb640 1 -- 172.21.15.152:0/1005850770 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff4f809ba50 con 0x7ff510103660 2024-09-11T22:04:24.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:24 smithi179 ceph-mon[35603]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:24.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:24 smithi179 ceph-mon[35603]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 819 B/s wr, 31 op/s 2024-09-11T22:04:24.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:24 smithi193 ceph-mon[35545]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:24.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:24 smithi193 ceph-mon[35545]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 819 B/s wr, 31 op/s 2024-09-11T22:04:24.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.849+0000 7ff516307640 1 -- 172.21.15.152:0/1005850770 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff510107210 con 0x7ff510103660 2024-09-11T22:04:24.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.850+0000 7ff50dffb640 1 -- 172.21.15.152:0/1005850770 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11923 (secure 0 0 0) 0x7ff4f809b350 con 0x7ff510103660 2024-09-11T22:04:24.851 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:24.851 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"btime":"2024-09-11T22:04:19:354379+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:18.708640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:04:24.851 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 24 2024-09-11T22:04:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 -- 172.21.15.152:0/1005850770 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4fc0a2e10 msgr2=0x7ff4fc0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4fc0a2e10 0x7ff4fc0a52d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff500009230 tx=0x7ff5000058d0 comp rx=0 tx=0).stop 2024-09-11T22:04:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 -- 172.21.15.152:0/1005850770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff510103660 msgr2=0x7ff510198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff510103660 0x7ff510198970 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800d950 tx=0x7ff4f800de10 comp rx=0 tx=0).stop 2024-09-11T22:04:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 -- 172.21.15.152:0/1005850770 shutdown_connections 2024-09-11T22:04:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4fc0a2e10 0x7ff4fc0a52d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff51010c170 0x7ff51019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:24.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff510103660 0x7ff510198970 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:24.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 --2- 172.21.15.152:0/1005850770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff510102d40 0x7ff510198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:24.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 -- 172.21.15.152:0/1005850770 >> 172.21.15.152:0/1005850770 conn(0x7ff5100fc7a0 msgr2=0x7ff5100fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:24.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 -- 172.21.15.152:0/1005850770 shutdown_connections 2024-09-11T22:04:24.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:24.852+0000 7ff516307640 1 -- 172.21.15.152:0/1005850770 wait complete. 2024-09-11T22:04:25.543 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:04:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:25 smithi152 ceph-mon[31188]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:25 smithi152 ceph-mon[31188]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:25 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1005850770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:25.793 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:25 smithi179 ceph-mon[35603]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:25 smithi179 ceph-mon[35603]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:25 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1005850770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:25 smithi193 ceph-mon[35545]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:25 smithi193 ceph-mon[35545]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:25 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1005850770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.255+0000 7f027a3f7640 1 -- 172.21.15.152:0/1754637549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0274102ef0 msgr2=0x7f027410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.255+0000 7f027a3f7640 1 --2- 172.21.15.152:0/1754637549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0274102ef0 0x7f027410da40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f026c009ca0 tx=0x7f026c02a950 comp rx=0 tx=0).stop 2024-09-11T22:04:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.255+0000 7f027a3f7640 1 -- 172.21.15.152:0/1754637549 shutdown_connections 2024-09-11T22:04:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.255+0000 7f027a3f7640 1 --2- 172.21.15.152:0/1754637549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0274102ef0 0x7f027410da40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.255+0000 7f027a3f7640 1 --2- 172.21.15.152:0/1754637549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0274102570 0x7f02741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.255+0000 7f027a3f7640 1 --2- 172.21.15.152:0/1754637549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0274100e20 0x7f0274101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.255+0000 7f027a3f7640 1 -- 172.21.15.152:0/1754637549 >> 172.21.15.152:0/1754637549 conn(0x7f02740fc7d0 msgr2=0x7f02740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.255+0000 7f027a3f7640 1 -- 172.21.15.152:0/1754637549 shutdown_connections 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.255+0000 7f027a3f7640 1 -- 172.21.15.152:0/1754637549 wait complete. 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f027a3f7640 1 Processor -- start 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f027a3f7640 1 -- start start 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f027a3f7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0274100e20 0x7f0274199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f027a3f7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0274102570 0x7f0274199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f027a3f7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0274102ef0 0x7f02741a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f027a3f7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0274110f80 con 0x7f0274102570 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f027a3f7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0274110e00 con 0x7f0274100e20 2024-09-11T22:04:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f027a3f7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0274111100 con 0x7f0274102ef0 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f026bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0274102570 0x7f0274199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f026bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0274102570 0x7f0274199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58942/0 (socket says 172.21.15.152:58942) 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f026bfff640 1 -- 172.21.15.152:0/506784361 learned_addr learned my addr 172.21.15.152:0/506784361 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f0278994640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0274102ef0 0x7f02741a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f026bfff640 1 -- 172.21.15.152:0/506784361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0274102ef0 msgr2=0x7f02741a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f0273fff640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0274100e20 0x7f0274199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f026bfff640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0274102ef0 0x7f02741a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f026bfff640 1 -- 172.21.15.152:0/506784361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0274100e20 msgr2=0x7f0274199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f026bfff640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0274100e20 0x7f0274199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f026bfff640 1 -- 172.21.15.152:0/506784361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02741a48f0 con 0x7f0274102570 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.256+0000 7f026bfff640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0274102570 0x7f0274199870 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f025c00d770 tx=0x7f025c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.257+0000 7f0271ffb640 1 -- 172.21.15.152:0/506784361 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c017070 con 0x7f0274102570 2024-09-11T22:04:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.257+0000 7f0271ffb640 1 -- 172.21.15.152:0/506784361 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f025c005500 con 0x7f0274102570 2024-09-11T22:04:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.257+0000 7f027a3f7640 1 -- 172.21.15.152:0/506784361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02741a4ac0 con 0x7f0274102570 2024-09-11T22:04:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.257+0000 7f0271ffb640 1 -- 172.21.15.152:0/506784361 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c004e00 con 0x7f0274102570 2024-09-11T22:04:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.257+0000 7f027a3f7640 1 -- 172.21.15.152:0/506784361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02741a4fb0 con 0x7f0274102570 2024-09-11T22:04:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.258+0000 7f027a3f7640 1 -- 172.21.15.152:0/506784361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0274101200 con 0x7f0274102570 2024-09-11T22:04:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.259+0000 7f0271ffb640 1 -- 172.21.15.152:0/506784361 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f025c004fa0 con 0x7f0274102570 2024-09-11T22:04:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.260+0000 7f0271ffb640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02600a2e10 0x7f02600a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.260+0000 7f0273fff640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02600a2e10 0x7f02600a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.260+0000 7f0271ffb640 1 -- 172.21.15.152:0/506784361 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f025c0cf590 con 0x7f0274102570 2024-09-11T22:04:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.260+0000 7f0273fff640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02600a2e10 0x7f02600a52d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02640058c0 tx=0x7f0264005c60 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.263+0000 7f0271ffb640 1 -- 172.21.15.152:0/506784361 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f025c09bed0 con 0x7f0274102570 2024-09-11T22:04:26.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.432+0000 7f027a3f7640 1 -- 172.21.15.152:0/506784361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f027406a5a0 con 0x7f0274102570 2024-09-11T22:04:26.433 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:26 smithi152 ceph-mon[31188]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 585 B/s wr, 22 op/s 2024-09-11T22:04:26.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.433+0000 7f0271ffb640 1 -- 172.21.15.152:0/506784361 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23266 (secure 0 0 0) 0x7f027406a5a0 con 0x7f0274102570 2024-09-11T22:04:26.434 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:26.434 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":85,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:04:17.346575+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2394077400":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/1809855628":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6801/3828412393":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6800/3828412393":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/2661528324":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/321546578":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/1096456467":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:04:26.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.435+0000 7f027a3f7640 1 -- 172.21.15.152:0/506784361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02600a2e10 msgr2=0x7f02600a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:26.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.435+0000 7f027a3f7640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02600a2e10 0x7f02600a52d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02640058c0 tx=0x7f0264005c60 comp rx=0 tx=0).stop 2024-09-11T22:04:26.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.435+0000 7f027a3f7640 1 -- 172.21.15.152:0/506784361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0274102570 msgr2=0x7f0274199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:26.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.435+0000 7f027a3f7640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0274102570 0x7f0274199870 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f025c00d770 tx=0x7f025c00dc30 comp rx=0 tx=0).stop 2024-09-11T22:04:26.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.436+0000 7f027a3f7640 1 -- 172.21.15.152:0/506784361 shutdown_connections 2024-09-11T22:04:26.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.436+0000 7f027a3f7640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02600a2e10 0x7f02600a52d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:26.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.436+0000 7f027a3f7640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0274102ef0 0x7f02741a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:26.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.436+0000 7f027a3f7640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0274102570 0x7f0274199870 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:26.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.436+0000 7f027a3f7640 1 --2- 172.21.15.152:0/506784361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0274100e20 0x7f0274199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:26.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.436+0000 7f027a3f7640 1 -- 172.21.15.152:0/506784361 >> 172.21.15.152:0/506784361 conn(0x7f02740fc7d0 msgr2=0x7f0274106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:26.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.436+0000 7f027a3f7640 1 -- 172.21.15.152:0/506784361 shutdown_connections 2024-09-11T22:04:26.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:26.436+0000 7f027a3f7640 1 -- 172.21.15.152:0/506784361 wait complete. 2024-09-11T22:04:26.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:26 smithi179 ceph-mon[35603]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 585 B/s wr, 22 op/s 2024-09-11T22:04:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:26 smithi193 ceph-mon[35545]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 585 B/s wr, 22 op/s 2024-09-11T22:04:26.984 DEBUG:tasks.fwd_scrub:Yielding 2024-09-11T22:04:26.984 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T22:04:26.994 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T22:04:26.994 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T22:04:26.994 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-11T22:04:26.994 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-11T22:04:26.995 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:04:26.995 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:04:27.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.098+0000 7f373c60e640 1 -- 172.21.15.152:0/3137892056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3734102d40 msgr2=0x7f3734103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.098+0000 7f373c60e640 1 --2- 172.21.15.152:0/3137892056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3734102d40 0x7f3734103120 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3724009900 tx=0x7f372402a480 comp rx=0 tx=0).stop 2024-09-11T22:04:27.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.098+0000 7f373c60e640 1 -- 172.21.15.152:0/3137892056 shutdown_connections 2024-09-11T22:04:27.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.098+0000 7f373c60e640 1 --2- 172.21.15.152:0/3137892056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f373410c110 0x7f373410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.098+0000 7f373c60e640 1 --2- 172.21.15.152:0/3137892056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3734103660 0x7f373410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.098+0000 7f373c60e640 1 --2- 172.21.15.152:0/3137892056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3734102d40 0x7f3734103120 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.098+0000 7f373c60e640 1 -- 172.21.15.152:0/3137892056 >> 172.21.15.152:0/3137892056 conn(0x7f3734077990 msgr2=0x7f37340fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.098+0000 7f373c60e640 1 -- 172.21.15.152:0/3137892056 shutdown_connections 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.098+0000 7f373c60e640 1 -- 172.21.15.152:0/3137892056 wait complete. 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.099+0000 7f373c60e640 1 Processor -- start 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.099+0000 7f373c60e640 1 -- start start 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.099+0000 7f373c60e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3734102d40 0x7f373419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.099+0000 7f373c60e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3734103660 0x7f373419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.099+0000 7f373c60e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373410c110 0x7f373419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.099+0000 7f373c60e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3734111eb0 con 0x7f373410c110 2024-09-11T22:04:27.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.099+0000 7f373c60e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3734111d30 con 0x7f3734102d40 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.099+0000 7f373c60e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3734112030 con 0x7f3734103660 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.099+0000 7f373abab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373410c110 0x7f373419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.099+0000 7f373abab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373410c110 0x7f373419edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58964/0 (socket says 172.21.15.152:58964) 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.099+0000 7f373abab640 1 -- 172.21.15.152:0/3646165234 learned_addr learned my addr 172.21.15.152:0/3646165234 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f373a3aa640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3734102d40 0x7f373419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f3739ba9640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3734103660 0x7f373419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f373abab640 1 -- 172.21.15.152:0/3646165234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3734103660 msgr2=0x7f373419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f373abab640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3734103660 0x7f373419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f373abab640 1 -- 172.21.15.152:0/3646165234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3734102d40 msgr2=0x7f373419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f373abab640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3734102d40 0x7f373419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f373abab640 1 -- 172.21.15.152:0/3646165234 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373419f500 con 0x7f373410c110 2024-09-11T22:04:27.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f373a3aa640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3734102d40 0x7f373419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:27.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f373abab640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373410c110 0x7f373419edd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f372c00cce0 tx=0x7f372c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f372b7fe640 1 -- 172.21.15.152:0/3646165234 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c00f450 con 0x7f373410c110 2024-09-11T22:04:27.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f373c60e640 1 -- 172.21.15.152:0/3646165234 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373419f7f0 con 0x7f373410c110 2024-09-11T22:04:27.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f372b7fe640 1 -- 172.21.15.152:0/3646165234 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f372c00fad0 con 0x7f373410c110 2024-09-11T22:04:27.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f372b7fe640 1 -- 172.21.15.152:0/3646165234 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c018c10 con 0x7f373410c110 2024-09-11T22:04:27.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.100+0000 7f373c60e640 1 -- 172.21.15.152:0/3646165234 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37341a7080 con 0x7f373410c110 2024-09-11T22:04:27.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.101+0000 7f373c60e640 1 -- 172.21.15.152:0/3646165234 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3734103120 con 0x7f373410c110 2024-09-11T22:04:27.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.102+0000 7f372b7fe640 1 -- 172.21.15.152:0/3646165234 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f372c00f5f0 con 0x7f373410c110 2024-09-11T22:04:27.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.103+0000 7f372b7fe640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37200a2ec0 0x7f37200a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.103+0000 7f373a3aa640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37200a2ec0 0x7f37200a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.103+0000 7f372b7fe640 1 -- 172.21.15.152:0/3646165234 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f372c0cfe70 con 0x7f373410c110 2024-09-11T22:04:27.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.103+0000 7f373a3aa640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37200a2ec0 0x7f37200a5380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3724005ab0 tx=0x7f3724005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.110+0000 7f372b7fe640 1 -- 172.21.15.152:0/3646165234 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f372c014030 con 0x7f373410c110 2024-09-11T22:04:27.257 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:27.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.301+0000 7f373c60e640 1 -- 172.21.15.152:0/3646165234 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f37341a73b0 con 0x7f373410c110 2024-09-11T22:04:27.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.305+0000 7f372b7fe640 1 -- 172.21.15.152:0/3646165234 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v29)=0 v29) ==== 129+0+0 (secure 0 0 0) 0x7f372c09c8a0 con 0x7f373410c110 2024-09-11T22:04:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 -- 172.21.15.152:0/3646165234 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37200a2ec0 msgr2=0x7f37200a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37200a2ec0 0x7f37200a5380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3724005ab0 tx=0x7f3724005a20 comp rx=0 tx=0).stop 2024-09-11T22:04:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 -- 172.21.15.152:0/3646165234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373410c110 msgr2=0x7f373419edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373410c110 0x7f373419edd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f372c00cce0 tx=0x7f372c00a620 comp rx=0 tx=0).stop 2024-09-11T22:04:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 -- 172.21.15.152:0/3646165234 shutdown_connections 2024-09-11T22:04:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37200a2ec0 0x7f37200a5380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373410c110 0x7f373419edd0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3734103660 0x7f373419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 --2- 172.21.15.152:0/3646165234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3734102d40 0x7f373419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 -- 172.21.15.152:0/3646165234 >> 172.21.15.152:0/3646165234 conn(0x7f3734077990 msgr2=0x7f3734100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 -- 172.21.15.152:0/3646165234 shutdown_connections 2024-09-11T22:04:27.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.307+0000 7f373c60e640 1 -- 172.21.15.152:0/3646165234 wait complete. 2024-09-11T22:04:27.320 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-11T22:04:27.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 -- 172.21.15.152:0/3412773154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43041069c0 msgr2=0x7f4304106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 --2- 172.21.15.152:0/3412773154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43041069c0 0x7f4304106da0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009930 tx=0x7f42fc02a420 comp rx=0 tx=0).stop 2024-09-11T22:04:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 -- 172.21.15.152:0/3412773154 shutdown_connections 2024-09-11T22:04:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 --2- 172.21.15.152:0/3412773154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4304101350 0x7f430410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 --2- 172.21.15.152:0/3412773154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43041009b0 0x7f4304100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 --2- 172.21.15.152:0/3412773154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43041069c0 0x7f4304106da0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 -- 172.21.15.152:0/3412773154 >> 172.21.15.152:0/3412773154 conn(0x7f4304077990 msgr2=0x7f43040fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 -- 172.21.15.152:0/3412773154 shutdown_connections 2024-09-11T22:04:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 -- 172.21.15.152:0/3412773154 wait complete. 2024-09-11T22:04:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 Processor -- start 2024-09-11T22:04:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 -- start start 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.424+0000 7f430b6ac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43041009b0 0x7f4304198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f430b6ac640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4304101350 0x7f43041988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f430b6ac640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43041069c0 0x7f430419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f430b6ac640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4304111ef0 con 0x7f43041009b0 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f430b6ac640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4304111d70 con 0x7f43041069c0 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f430b6ac640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4304112070 con 0x7f4304101350 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4309448640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43041009b0 0x7f4304198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4309448640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43041009b0 0x7f4304198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58978/0 (socket says 172.21.15.152:58978) 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4309448640 1 -- 172.21.15.152:0/681809942 learned_addr learned my addr 172.21.15.152:0/681809942 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4308c47640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4304101350 0x7f43041988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4309c49640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43041069c0 0x7f430419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4309448640 1 -- 172.21.15.152:0/681809942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4304101350 msgr2=0x7f43041988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4309448640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4304101350 0x7f43041988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4309448640 1 -- 172.21.15.152:0/681809942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43041069c0 msgr2=0x7f430419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4309448640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43041069c0 0x7f430419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4309448640 1 -- 172.21.15.152:0/681809942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430419d370 con 0x7f43041009b0 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4309c49640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43041069c0 0x7f430419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4308c47640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4304101350 0x7f43041988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f4309448640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43041009b0 0x7f4304198380 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009230 tx=0x7f42fc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f43027fc640 1 -- 172.21.15.152:0/681809942 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc03f030 con 0x7f43041009b0 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f43027fc640 1 -- 172.21.15.152:0/681809942 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42fc004440 con 0x7f43041009b0 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f430b6ac640 1 -- 172.21.15.152:0/681809942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430419d600 con 0x7f43041009b0 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f43027fc640 1 -- 172.21.15.152:0/681809942 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc035070 con 0x7f43041009b0 2024-09-11T22:04:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.425+0000 7f430b6ac640 1 -- 172.21.15.152:0/681809942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43041a4ef0 con 0x7f43041009b0 2024-09-11T22:04:27.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.426+0000 7f430b6ac640 1 -- 172.21.15.152:0/681809942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43041020f0 con 0x7f43041009b0 2024-09-11T22:04:27.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.427+0000 7f43027fc640 1 -- 172.21.15.152:0/681809942 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f42fc042030 con 0x7f43041009b0 2024-09-11T22:04:27.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.428+0000 7f43027fc640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f42ec0a2ec0 0x7f42ec0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.428+0000 7f4308c47640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f42ec0a2ec0 0x7f42ec0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.428+0000 7f43027fc640 1 -- 172.21.15.152:0/681809942 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f42fc0efab0 con 0x7f43041009b0 2024-09-11T22:04:27.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.428+0000 7f4308c47640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f42ec0a2ec0 0x7f42ec0a5380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4304105f90 tx=0x7f42f8005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.432+0000 7f43027fc640 1 -- 172.21.15.152:0/681809942 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42fc0bc520 con 0x7f43041009b0 2024-09-11T22:04:27.575 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:27 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/506784361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:27.576 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:27 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3646165234' entity='client.admin' 2024-09-11T22:04:27.576 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:27 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:27.576 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:27 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:27.576 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:27 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:27.576 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:27 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:27.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.607+0000 7f430b6ac640 1 -- 172.21.15.152:0/681809942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f4304108f20 con 0x7f43041009b0 2024-09-11T22:04:27.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.611+0000 7f43027fc640 1 -- 172.21.15.152:0/681809942 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) ==== 138+0+0 (secure 0 0 0) 0x7f42fc0bbe20 con 0x7f43041009b0 2024-09-11T22:04:27.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 -- 172.21.15.152:0/681809942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f42ec0a2ec0 msgr2=0x7f42ec0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f42ec0a2ec0 0x7f42ec0a5380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4304105f90 tx=0x7f42f8005f90 comp rx=0 tx=0).stop 2024-09-11T22:04:27.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 -- 172.21.15.152:0/681809942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43041009b0 msgr2=0x7f4304198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43041009b0 0x7f4304198380 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009230 tx=0x7f42fc004040 comp rx=0 tx=0).stop 2024-09-11T22:04:27.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 -- 172.21.15.152:0/681809942 shutdown_connections 2024-09-11T22:04:27.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f42ec0a2ec0 0x7f42ec0a5380 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43041069c0 0x7f430419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4304101350 0x7f43041988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 --2- 172.21.15.152:0/681809942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43041009b0 0x7f4304198380 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 -- 172.21.15.152:0/681809942 >> 172.21.15.152:0/681809942 conn(0x7f4304077990 msgr2=0x7f43040ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 -- 172.21.15.152:0/681809942 shutdown_connections 2024-09-11T22:04:27.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.614+0000 7f430b6ac640 1 -- 172.21.15.152:0/681809942 wait complete. 2024-09-11T22:04:27.626 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-11T22:04:27.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.734+0000 7f051f3fd640 1 -- 172.21.15.152:0/2362719306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0518103670 msgr2=0x7f051810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.734+0000 7f051f3fd640 1 --2- 172.21.15.152:0/2362719306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0518103670 0x7f051810bb50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0508009900 tx=0x7f050802a480 comp rx=0 tx=0).stop 2024-09-11T22:04:27.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.734+0000 7f051f3fd640 1 -- 172.21.15.152:0/2362719306 shutdown_connections 2024-09-11T22:04:27.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.734+0000 7f051f3fd640 1 --2- 172.21.15.152:0/2362719306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f051810c120 0x7f051810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.734+0000 7f051f3fd640 1 --2- 172.21.15.152:0/2362719306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0518103670 0x7f051810bb50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.734+0000 7f051f3fd640 1 --2- 172.21.15.152:0/2362719306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0518102d50 0x7f0518103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.734+0000 7f051f3fd640 1 -- 172.21.15.152:0/2362719306 >> 172.21.15.152:0/2362719306 conn(0x7f05180fc6a0 msgr2=0x7f05180feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.734+0000 7f051f3fd640 1 -- 172.21.15.152:0/2362719306 shutdown_connections 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.734+0000 7f051f3fd640 1 -- 172.21.15.152:0/2362719306 wait complete. 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051f3fd640 1 Processor -- start 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051f3fd640 1 -- start start 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051f3fd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0518102d50 0x7f05181009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051f3fd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0518103670 0x7f0518100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051f3fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f051810c120 0x7f0518101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051f3fd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0518111f50 con 0x7f0518103670 2024-09-11T22:04:27.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051f3fd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0518111dd0 con 0x7f0518102d50 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051f3fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05181120d0 con 0x7f051810c120 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051c998640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0518103670 0x7f0518100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051c998640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0518103670 0x7f0518100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59006/0 (socket says 172.21.15.152:59006) 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051c998640 1 -- 172.21.15.152:0/1907138982 learned_addr learned my addr 172.21.15.152:0/1907138982 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.735+0000 7f051d99a640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f051810c120 0x7f0518101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f051d199640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0518102d50 0x7f05181009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f051c998640 1 -- 172.21.15.152:0/1907138982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f051810c120 msgr2=0x7f0518101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f051c998640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f051810c120 0x7f0518101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f051c998640 1 -- 172.21.15.152:0/1907138982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0518102d50 msgr2=0x7f05181009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f051c998640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0518102d50 0x7f05181009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f051c998640 1 -- 172.21.15.152:0/1907138982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05181a68d0 con 0x7f0518103670 2024-09-11T22:04:27.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f051c998640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0518103670 0x7f0518100ee0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0508006010 tx=0x7f0508004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f050e7fc640 1 -- 172.21.15.152:0/1907138982 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050803f030 con 0x7f0518103670 2024-09-11T22:04:27.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f051f3fd640 1 -- 172.21.15.152:0/1907138982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05181a6b60 con 0x7f0518103670 2024-09-11T22:04:27.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f050e7fc640 1 -- 172.21.15.152:0/1907138982 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0508003ad0 con 0x7f0518103670 2024-09-11T22:04:27.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f050e7fc640 1 -- 172.21.15.152:0/1907138982 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508035070 con 0x7f0518103670 2024-09-11T22:04:27.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.736+0000 7f051f3fd640 1 -- 172.21.15.152:0/1907138982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05181a70a0 con 0x7f0518103670 2024-09-11T22:04:27.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.737+0000 7f051f3fd640 1 -- 172.21.15.152:0/1907138982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0518103130 con 0x7f0518103670 2024-09-11T22:04:27.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.739+0000 7f050e7fc640 1 -- 172.21.15.152:0/1907138982 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f0508042030 con 0x7f0518103670 2024-09-11T22:04:27.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.740+0000 7f050e7fc640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05040a2ec0 0x7f05040a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.740+0000 7f051d199640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05040a2ec0 0x7f05040a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.740+0000 7f050e7fc640 1 -- 172.21.15.152:0/1907138982 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f05080eff60 con 0x7f0518103670 2024-09-11T22:04:27.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.740+0000 7f051d199640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05040a2ec0 0x7f05040a5380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0514009890 tx=0x7f0514008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.743+0000 7f050e7fc640 1 -- 172.21.15.152:0/1907138982 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05080bc9d0 con 0x7f0518103670 2024-09-11T22:04:27.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.788+0000 7f07ca612640 1 -- 172.21.15.152:0/2027778984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c4102570 msgr2=0x7f07c41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.788+0000 7f07ca612640 1 --2- 172.21.15.152:0/2027778984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c4102570 0x7f07c41029b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009900 tx=0x7f07b802a480 comp rx=0 tx=0).stop 2024-09-11T22:04:27.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.788+0000 7f07ca612640 1 -- 172.21.15.152:0/2027778984 shutdown_connections 2024-09-11T22:04:27.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.788+0000 7f07ca612640 1 --2- 172.21.15.152:0/2027778984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07c4102ef0 0x7f07c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.788+0000 7f07ca612640 1 --2- 172.21.15.152:0/2027778984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c4102570 0x7f07c41029b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.788+0000 7f07ca612640 1 --2- 172.21.15.152:0/2027778984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c4100e20 0x7f07c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.788+0000 7f07ca612640 1 -- 172.21.15.152:0/2027778984 >> 172.21.15.152:0/2027778984 conn(0x7f07c40fc7d0 msgr2=0x7f07c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.788+0000 7f07ca612640 1 -- 172.21.15.152:0/2027778984 shutdown_connections 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.788+0000 7f07ca612640 1 -- 172.21.15.152:0/2027778984 wait complete. 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.789+0000 7f07ca612640 1 Processor -- start 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.789+0000 7f07ca612640 1 -- start start 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07ca612640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07c4100e20 0x7f07c4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07ca612640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c4102570 0x7f07c4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07ca612640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c4102ef0 0x7f07c41a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07ca612640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4110f80 con 0x7f07c4102ef0 2024-09-11T22:04:27.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07ca612640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4110e00 con 0x7f07c4102570 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07ca612640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4111100 con 0x7f07c4100e20 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c8baf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c4102ef0 0x7f07c41a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c8baf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c4102ef0 0x7f07c41a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59022/0 (socket says 172.21.15.152:59022) 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07c4100e20 0x7f07c4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c8baf640 1 -- 172.21.15.152:0/692779988 learned_addr learned my addr 172.21.15.152:0/692779988 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c37fe640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c4102570 0x7f07c4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c8baf640 1 -- 172.21.15.152:0/692779988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07c4100e20 msgr2=0x7f07c4199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c8baf640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07c4100e20 0x7f07c4199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c8baf640 1 -- 172.21.15.152:0/692779988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c4102570 msgr2=0x7f07c4199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c8baf640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c4102570 0x7f07c4199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c8baf640 1 -- 172.21.15.152:0/692779988 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c41a4910 con 0x7f07c4102ef0 2024-09-11T22:04:27.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c3fff640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07c4100e20 0x7f07c4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:27.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c8baf640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c4102ef0 0x7f07c41a43d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00eb10 tx=0x7f07bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c17fa640 1 -- 172.21.15.152:0/692779988 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc004b20 con 0x7f07c4102ef0 2024-09-11T22:04:27.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07ca612640 1 -- 172.21.15.152:0/692779988 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c41a4ae0 con 0x7f07c4102ef0 2024-09-11T22:04:27.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c17fa640 1 -- 172.21.15.152:0/692779988 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07bc004cc0 con 0x7f07c4102ef0 2024-09-11T22:04:27.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.790+0000 7f07c17fa640 1 -- 172.21.15.152:0/692779988 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc010760 con 0x7f07c4102ef0 2024-09-11T22:04:27.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.791+0000 7f07ca612640 1 -- 172.21.15.152:0/692779988 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c41a4ff0 con 0x7f07c4102ef0 2024-09-11T22:04:27.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.793+0000 7f07c17fa640 1 -- 172.21.15.152:0/692779988 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f07bc005020 con 0x7f07c4102ef0 2024-09-11T22:04:27.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.793+0000 7f07cc9eb740 1 Processor -- start 2024-09-11T22:04:27.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.793+0000 7f07cc9eb740 1 -- start start 2024-09-11T22:04:27.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.793+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c76231b60 0x560c76231f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.793+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c7623c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 0x560c7623f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560c76197280 con 0x560c76232480 2024-09-11T22:04:27.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560c7613eb10 con 0x560c76231b60 2024-09-11T22:04:27.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560c76193240 con 0x560c7623cd40 2024-09-11T22:04:27.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c7623c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c7623c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59026/0 (socket says 172.21.15.152:59026) 2024-09-11T22:04:27.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c17fa640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07ac0a2e10 0x7f07ac0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c3fff640 1 -- 172.21.15.152:0/982509992 learned_addr learned my addr 172.21.15.152:0/982509992 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:27.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c37fe640 1 --2- 172.21.15.152:0/982509992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c76231b60 0x560c76231f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c37fe640 1 --2- 172.21.15.152:0/982509992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 0x560c7623f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c8baf640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07ac0a2e10 0x7f07ac0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c17fa640 1 -- 172.21.15.152:0/692779988 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f07bc0cfd60 con 0x7f07c4102ef0 2024-09-11T22:04:27.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c3fff640 1 -- 172.21.15.152:0/982509992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 msgr2=0x560c7623f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:27.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c3fff640 1 --2- 172.21.15.152:0/982509992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 0x560c7623f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c3fff640 1 -- 172.21.15.152:0/982509992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c76231b60 msgr2=0x560c76231f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:27.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c3fff640 1 --2- 172.21.15.152:0/982509992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c76231b60 0x560c76231f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c3fff640 1 -- 172.21.15.152:0/982509992 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c7614b1f0 con 0x560c76232480 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c37fe640 1 --2- 172.21.15.152:0/982509992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 0x560c7623f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c8baf640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07ac0a2e10 0x7f07ac0a52d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0cd360 tx=0x7f07bc06f070 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.794+0000 7f07c3fff640 1 --2- 172.21.15.152:0/982509992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c7623c800 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009f60 tx=0x7f07b4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd470e8732fcab13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.795+0000 7f07aa7fc640 1 -- 172.21.15.152:0/982509992 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4027070 con 0x560c76232480 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.795+0000 7f07aa7fc640 1 -- 172.21.15.152:0/982509992 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07b401ab70 con 0x560c76232480 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.795+0000 7f07aa7fc640 1 -- 172.21.15.152:0/982509992 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b40226a0 con 0x560c76232480 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.795+0000 7f07cc9eb740 1 -- 172.21.15.152:0/982509992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 msgr2=0x560c7623c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.795+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/982509992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c7623c800 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009f60 tx=0x7f07b4009f90 comp rx=0 tx=0).stop 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.796+0000 7f07cc9eb740 1 -- 172.21.15.152:0/982509992 shutdown_connections 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.796+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/982509992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 0x560c7623f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.796+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/982509992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c7623c800 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.796+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/982509992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c76231b60 0x560c76231f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.796+0000 7f07cc9eb740 1 -- 172.21.15.152:0/982509992 >> 172.21.15.152:0/982509992 conn(0x560c7622e0f0 msgr2=0x560c7622e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.796+0000 7f07cc9eb740 1 -- 172.21.15.152:0/982509992 shutdown_connections 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.796+0000 7f07cc9eb740 1 -- 172.21.15.152:0/982509992 wait complete. 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.796+0000 7f07cc9eb740 1 -- start start 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.796+0000 7f07cc9eb740 1 Processor -- start 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76239b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c76232480 0x560c7623a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c7623cd40 0x560c7623a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560c7623f910 con 0x560c76231b60 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560c76151f10 con 0x560c7623cd40 2024-09-11T22:04:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560c7623fa90 con 0x560c76232480 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07cc9eb740 10 client.0 _ll_register_callbacks cb 0x560c7611aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76239b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76239b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59036/0 (socket says 172.21.15.152:59036) 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c37fe640 1 -- 172.21.15.152:0/2085397884 learned_addr learned my addr 172.21.15.152:0/2085397884 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c3fff640 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c76232480 0x560c7623a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c37fe640 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c7623cd40 0x560c7623a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c37fe640 1 -- 172.21.15.152:0/2085397884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c76232480 msgr2=0x560c7623a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c37fe640 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c76232480 0x560c7623a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c37fe640 1 -- 172.21.15.152:0/2085397884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c7623cd40 msgr2=0x560c7623a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c37fe640 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c7623cd40 0x560c7623a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c37fe640 1 -- 172.21.15.152:0/2085397884 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c75f086a0 con 0x560c76231b60 2024-09-11T22:04:27.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c3fff640 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c76232480 0x560c7623a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07c37fe640 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76239b80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f07b802a9a0 tx=0x7f07b802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43235b9a80429bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07a37fe640 1 -- 172.21.15.152:0/2085397884 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b8035040 con 0x560c76231b60 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07a37fe640 1 -- 172.21.15.152:0/2085397884 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f07b8003ab0 con 0x560c76231b60 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.797+0000 7f07cc9eb740 1 -- 172.21.15.152:0/2085397884 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07b401ab70 con 0x560c76231b60 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07a37fe640 1 -- 172.21.15.152:0/2085397884 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f07b8003cb0 con 0x560c76231b60 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07cc9eb740 10 client.15288 fetch_fsmap learned FSMap version 24 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07cc9eb740 1 -- 172.21.15.152:0/2085397884 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560c7624b480 con 0x560c76231b60 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07a37fe640 1 -- 172.21.15.152:0/2085397884 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07b8003e50 con 0x560c76231b60 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07a37fe640 1 -- 172.21.15.152:0/2085397884 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f07b803c4d0 con 0x560c76231b60 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07cc9eb740 10 client.15288 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07cc9eb740 10 client.15288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07cc9eb740 20 client.15288 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c7624c890 0x560c7624ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07cc9eb740 4 client.15288 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:04:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07cc9eb740 1 -- 172.21.15.152:0/2085397884 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f07b401ab70 con 0x560c7624c890 2024-09-11T22:04:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.798+0000 7f07c3fff640 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c7624c890 0x560c7624ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.799+0000 7f07c3fff640 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c7624c890 0x560c7624ec80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8031405c422dfda1 server_cookie=aef2537f12c8e05a in_seq=0 out_seq=0 2024-09-11T22:04:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.799+0000 7f07a37fe640 10 client.15288 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:27.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:27 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/506784361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:27.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:27 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3646165234' entity='client.admin' 2024-09-11T22:04:27.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:27 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:27.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:27 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:27.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:27 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:27.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:27 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07a37fe640 1 -- 172.21.15.152:0/2085397884 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f07b401ab70 con 0x560c7624c890 2024-09-11T22:04:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07a37fe640 10 client.15288 handle_command_reply: tid=0 2024-09-11T22:04:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 1 client.15288 shutdown 2024-09-11T22:04:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 1 -- 172.21.15.152:0/2085397884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 msgr2=0x560c76239b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76239b80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f07b802a9a0 tx=0x7f07b802a480 comp rx=0 tx=0).stop 2024-09-11T22:04:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 1 -- 172.21.15.152:0/2085397884 shutdown_connections 2024-09-11T22:04:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c7624c890 0x560c7624ec80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c7623cd40 0x560c7623a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c76232480 0x560c7623a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/2085397884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76239b80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07a37fe640 0 client.15288 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:27.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 1 -- 172.21.15.152:0/2085397884 >> 172.21.15.152:0/2085397884 conn(0x560c7622e0f0 msgr2=0x560c7622d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 1 -- 172.21.15.152:0/2085397884 shutdown_connections 2024-09-11T22:04:27.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 1 -- 172.21.15.152:0/2085397884 wait complete. 2024-09-11T22:04:27.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.800+0000 7f07cc9eb740 20 client.15288 trim_cache size 0 max 16384 2024-09-11T22:04:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.817+0000 7f07cc9eb740 1 Processor -- start 2024-09-11T22:04:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.817+0000 7f07cc9eb740 1 -- start start 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.817+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c76231b60 0x560c76238a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.817+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c76254550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.817+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 0x560c76254a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.817+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f07c41ae070 con 0x560c76232480 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.817+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f07c41ab940 con 0x560c76231b60 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.817+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f07c41a9790 con 0x560c7623cd40 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.817+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c76254550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.817+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c76254550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59044/0 (socket says 172.21.15.152:59044) 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07c3fff640 1 -- 172.21.15.152:0/3148610497 learned_addr learned my addr 172.21.15.152:0/3148610497 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07c37fe640 1 --2- 172.21.15.152:0/3148610497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 0x560c76254a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07c37fe640 1 --2- 172.21.15.152:0/3148610497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c76231b60 0x560c76238a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07c3fff640 1 -- 172.21.15.152:0/3148610497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 msgr2=0x560c76254a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07c3fff640 1 --2- 172.21.15.152:0/3148610497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 0x560c76254a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07c3fff640 1 -- 172.21.15.152:0/3148610497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c76231b60 msgr2=0x560c76238a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07c3fff640 1 --2- 172.21.15.152:0/3148610497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c76231b60 0x560c76238a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07c3fff640 1 -- 172.21.15.152:0/3148610497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c762322b0 con 0x560c76232480 2024-09-11T22:04:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07c37fe640 1 --2- 172.21.15.152:0/3148610497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 0x560c76254a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07c3fff640 1 --2- 172.21.15.152:0/3148610497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c76254550 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f07b4011f10 tx=0x7f07b400fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279a411ae1e84eba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07a9ffb640 1 -- 172.21.15.152:0/3148610497 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4027040 con 0x560c76232480 2024-09-11T22:04:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07a9ffb640 1 -- 172.21.15.152:0/3148610497 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07b40050c0 con 0x560c76232480 2024-09-11T22:04:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.818+0000 7f07a9ffb640 1 -- 172.21.15.152:0/3148610497 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b40037f0 con 0x560c76232480 2024-09-11T22:04:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.819+0000 7f07cc9eb740 1 -- 172.21.15.152:0/3148610497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 msgr2=0x560c76254550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.819+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/3148610497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c76254550 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f07b4011f10 tx=0x7f07b400fde0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.819+0000 7f07cc9eb740 1 -- 172.21.15.152:0/3148610497 shutdown_connections 2024-09-11T22:04:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.819+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/3148610497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c7623cd40 0x560c76254a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.819+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/3148610497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76232480 0x560c76254550 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.819+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/3148610497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c76231b60 0x560c76238a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.819+0000 7f07cc9eb740 1 -- 172.21.15.152:0/3148610497 >> 172.21.15.152:0/3148610497 conn(0x560c7622e0f0 msgr2=0x560c76238320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.819+0000 7f07cc9eb740 1 -- 172.21.15.152:0/3148610497 shutdown_connections 2024-09-11T22:04:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.819+0000 7f07cc9eb740 1 -- 172.21.15.152:0/3148610497 wait complete. 2024-09-11T22:04:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07cc9eb740 1 -- start start 2024-09-11T22:04:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07cc9eb740 1 Processor -- start 2024-09-11T22:04:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76241350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c76232480 0x560c76241890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07cc9eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c7623cd40 0x560c762b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f07c41a9e00 con 0x560c76231b60 2024-09-11T22:04:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f07c41ab270 con 0x560c7623cd40 2024-09-11T22:04:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07cc9eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f07c41aa4d0 con 0x560c76232480 2024-09-11T22:04:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07cc9eb740 10 client.0 _ll_register_callbacks cb 0x7f07b8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07c37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76241350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07c37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76241350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59046/0 (socket says 172.21.15.152:59046) 2024-09-11T22:04:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.820+0000 7f07c37fe640 1 -- 172.21.15.152:0/1686918715 learned_addr learned my addr 172.21.15.152:0/1686918715 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07c3fff640 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c76232480 0x560c76241890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07c37fe640 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c7623cd40 0x560c762b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07c37fe640 1 -- 172.21.15.152:0/1686918715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c76232480 msgr2=0x560c76241890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07c37fe640 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c76232480 0x560c76241890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07c37fe640 1 -- 172.21.15.152:0/1686918715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c7623cd40 msgr2=0x560c762b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07c37fe640 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c7623cd40 0x560c762b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07c37fe640 1 -- 172.21.15.152:0/1686918715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c762b0c00 con 0x560c76231b60 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07c37fe640 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76241350 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f07b8005770 tx=0x7f07b8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b0063fb617fd42 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07a37fe640 1 -- 172.21.15.152:0/1686918715 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b805f060 con 0x560c76231b60 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07a37fe640 1 -- 172.21.15.152:0/1686918715 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f07b803cd20 con 0x560c76231b60 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07cc9eb740 1 -- 172.21.15.152:0/1686918715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07b40050c0 con 0x560c76231b60 2024-09-11T22:04:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07a37fe640 1 -- 172.21.15.152:0/1686918715 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f07b8035040 con 0x560c76231b60 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07cc9eb740 10 client.15294 fetch_fsmap learned FSMap version 24 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.821+0000 7f07cc9eb740 1 -- 172.21.15.152:0/1686918715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560c762b8030 con 0x560c76231b60 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.822+0000 7f07a37fe640 1 -- 172.21.15.152:0/1686918715 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07b40050c0 con 0x560c76231b60 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.822+0000 7f07a37fe640 1 -- 172.21.15.152:0/1686918715 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f07b8004ad0 con 0x560c76231b60 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.822+0000 7f07cc9eb740 10 client.15294 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.822+0000 7f07cc9eb740 10 client.15294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.822+0000 7f07cc9eb740 20 client.15294 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.822+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c762b8750 0x560c762bab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.822+0000 7f07cc9eb740 4 client.15294 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.822+0000 7f07cc9eb740 1 -- 172.21.15.152:0/1686918715 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560c761a47f0 con 0x560c762b8750 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.822+0000 7f07c3fff640 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c762b8750 0x560c762bab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:27.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.822+0000 7f07c3fff640 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c762b8750 0x560c762bab40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de70858de0e1b9b4 server_cookie=f25a975869a5d3d0 in_seq=0 out_seq=0 2024-09-11T22:04:27.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.822+0000 7f07a37fe640 10 client.15294 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:27.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:27 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/506784361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:27.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:27 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3646165234' entity='client.admin' 2024-09-11T22:04:27.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:27 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:27.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:27 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:27.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:27 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:27.829 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:27 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:27.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.823+0000 7f07a37fe640 1 -- 172.21.15.152:0/1686918715 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560c761a47f0 con 0x560c762b8750 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.823+0000 7f07a37fe640 10 client.15294 handle_command_reply: tid=0 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.823+0000 7f07cc9eb740 1 client.15294 shutdown 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07cc9eb740 1 -- 172.21.15.152:0/1686918715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 msgr2=0x560c76241350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76241350 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f07b8005770 tx=0x7f07b8001e70 comp rx=0 tx=0).stop 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07cc9eb740 1 -- 172.21.15.152:0/1686918715 shutdown_connections 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c762b8750 0x560c762bab40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c7623cd40 0x560c762b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c76232480 0x560c76241890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07cc9eb740 1 --2- 172.21.15.152:0/1686918715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c76231b60 0x560c76241350 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07cc9eb740 1 -- 172.21.15.152:0/1686918715 >> 172.21.15.152:0/1686918715 conn(0x560c7622e0f0 msgr2=0x560c76238b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07a37fe640 0 client.15294 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07cc9eb740 1 -- 172.21.15.152:0/1686918715 shutdown_connections 2024-09-11T22:04:27.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07cc9eb740 1 -- 172.21.15.152:0/1686918715 wait complete. 2024-09-11T22:04:27.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.824+0000 7f07cc9eb740 20 client.15294 trim_cache size 0 max 16384 2024-09-11T22:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "4a985efc-17fd-4653-93c9-1f9c08164cf0", 2024-09-11T22:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:04:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 -- 172.21.15.152:0/692779988 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07ac0a2e10 msgr2=0x7f07ac0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07ac0a2e10 0x7f07ac0a52d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0cd360 tx=0x7f07bc06f070 comp rx=0 tx=0).stop 2024-09-11T22:04:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 -- 172.21.15.152:0/692779988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c4102ef0 msgr2=0x7f07c41a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c4102ef0 0x7f07c41a43d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00eb10 tx=0x7f07bc00c2d0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 -- 172.21.15.152:0/692779988 shutdown_connections 2024-09-11T22:04:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07ac0a2e10 0x7f07ac0a52d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c4102ef0 0x7f07c41a43d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c4102570 0x7f07c4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 --2- 172.21.15.152:0/692779988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07c4100e20 0x7f07c4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 -- 172.21.15.152:0/692779988 >> 172.21.15.152:0/692779988 conn(0x7f07c40fc7d0 msgr2=0x7f07c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 -- 172.21.15.152:0/692779988 shutdown_connections 2024-09-11T22:04:27.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.825+0000 7f07ca612640 1 -- 172.21.15.152:0/692779988 wait complete. 2024-09-11T22:04:27.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.927+0000 7f051f3fd640 1 -- 172.21.15.152:0/1907138982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f0518106be0 con 0x7f0518103670 2024-09-11T22:04:27.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.931+0000 7f050e7fc640 1 -- 172.21.15.152:0/1907138982 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7f05080bc2d0 con 0x7f0518103670 2024-09-11T22:04:27.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 -- 172.21.15.152:0/1907138982 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05040a2ec0 msgr2=0x7f05040a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05040a2ec0 0x7f05040a5380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0514009890 tx=0x7f0514008040 comp rx=0 tx=0).stop 2024-09-11T22:04:27.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 -- 172.21.15.152:0/1907138982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0518103670 msgr2=0x7f0518100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:27.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0518103670 0x7f0518100ee0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0508006010 tx=0x7f0508004270 comp rx=0 tx=0).stop 2024-09-11T22:04:27.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 -- 172.21.15.152:0/1907138982 shutdown_connections 2024-09-11T22:04:27.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05040a2ec0 0x7f05040a5380 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f051810c120 0x7f0518101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0518103670 0x7f0518100ee0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 --2- 172.21.15.152:0/1907138982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0518102d50 0x7f05181009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:27.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 -- 172.21.15.152:0/1907138982 >> 172.21.15.152:0/1907138982 conn(0x7f05180fc6a0 msgr2=0x7f05180fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:27.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 -- 172.21.15.152:0/1907138982 shutdown_connections 2024-09-11T22:04:27.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:27.933+0000 7f051f3fd640 1 -- 172.21.15.152:0/1907138982 wait complete. 2024-09-11T22:04:27.946 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-11T22:04:28.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.051+0000 7f5e5b52a640 1 -- 172.21.15.152:0/1008533708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e541013b0 msgr2=0x7f5e54105870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.051+0000 7f5e5b52a640 1 --2- 172.21.15.152:0/1008533708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e541013b0 0x7f5e54105870 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009930 tx=0x7f5e4402a4d0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.051+0000 7f5e5b52a640 1 -- 172.21.15.152:0/1008533708 shutdown_connections 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.051+0000 7f5e5b52a640 1 --2- 172.21.15.152:0/1008533708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e54105ec0 0x7f5e54106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.051+0000 7f5e5b52a640 1 --2- 172.21.15.152:0/1008533708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e541013b0 0x7f5e54105870 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.051+0000 7f5e5b52a640 1 --2- 172.21.15.152:0/1008533708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e54100a90 0x7f5e54100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.051+0000 7f5e5b52a640 1 -- 172.21.15.152:0/1008533708 >> 172.21.15.152:0/1008533708 conn(0x7f5e540fc6f0 msgr2=0x7f5e540feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.051+0000 7f5e5b52a640 1 -- 172.21.15.152:0/1008533708 shutdown_connections 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.051+0000 7f5e5b52a640 1 -- 172.21.15.152:0/1008533708 wait complete. 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e5b52a640 1 Processor -- start 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e5b52a640 1 -- start start 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e5b52a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e54100a90 0x7f5e541a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e5b52a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e541013b0 0x7f5e541a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e5b52a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e54105ec0 0x7f5e5419e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e5b52a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e541184d0 con 0x7f5e541013b0 2024-09-11T22:04:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e5b52a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e54118350 con 0x7f5e54105ec0 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e5b52a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5e54118650 con 0x7f5e54100a90 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e58ac5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e541013b0 0x7f5e541a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e58ac5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e541013b0 0x7f5e541a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59060/0 (socket says 172.21.15.152:59060) 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e58ac5640 1 -- 172.21.15.152:0/2337867326 learned_addr learned my addr 172.21.15.152:0/2337867326 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e592c6640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e54100a90 0x7f5e541a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e59ac7640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e54105ec0 0x7f5e5419e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e58ac5640 1 -- 172.21.15.152:0/2337867326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e54100a90 msgr2=0x7f5e541a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e58ac5640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e54100a90 0x7f5e541a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e58ac5640 1 -- 172.21.15.152:0/2337867326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e54105ec0 msgr2=0x7f5e5419e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e58ac5640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e54105ec0 0x7f5e5419e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e58ac5640 1 -- 172.21.15.152:0/2337867326 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5419ef90 con 0x7f5e541013b0 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e592c6640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e54100a90 0x7f5e541a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.052+0000 7f5e59ac7640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e54105ec0 0x7f5e5419e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.053+0000 7f5e58ac5640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e541013b0 0x7f5e541a4b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009230 tx=0x7f5e44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.053+0000 7f5e4a7fc640 1 -- 172.21.15.152:0/2337867326 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4403f030 con 0x7f5e541013b0 2024-09-11T22:04:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.053+0000 7f5e4a7fc640 1 -- 172.21.15.152:0/2337867326 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e44003ad0 con 0x7f5e541013b0 2024-09-11T22:04:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.053+0000 7f5e4a7fc640 1 -- 172.21.15.152:0/2337867326 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44035070 con 0x7f5e541013b0 2024-09-11T22:04:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.053+0000 7f5e5b52a640 1 -- 172.21.15.152:0/2337867326 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5419f220 con 0x7f5e541013b0 2024-09-11T22:04:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.053+0000 7f5e5b52a640 1 -- 172.21.15.152:0/2337867326 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e541ab4a0 con 0x7f5e541013b0 2024-09-11T22:04:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.054+0000 7f5e5b52a640 1 -- 172.21.15.152:0/2337867326 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e5406abe0 con 0x7f5e541013b0 2024-09-11T22:04:28.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.055+0000 7f5e4a7fc640 1 -- 172.21.15.152:0/2337867326 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f5e44042030 con 0x7f5e541013b0 2024-09-11T22:04:28.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.055+0000 7f5e4a7fc640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e400a2ec0 0x7f5e400a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.056+0000 7f5e592c6640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e400a2ec0 0x7f5e400a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.056+0000 7f5e4a7fc640 1 -- 172.21.15.152:0/2337867326 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f5e440f0150 con 0x7f5e541013b0 2024-09-11T22:04:28.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.056+0000 7f5e592c6640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e400a2ec0 0x7f5e400a5380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000abe0 tx=0x7f5e5000a5c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:28.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.059+0000 7f5e4a7fc640 1 -- 172.21.15.152:0/2337867326 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e440bcbc0 con 0x7f5e541013b0 2024-09-11T22:04:28.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.252+0000 7f5e5b52a640 1 -- 172.21.15.152:0/2337867326 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f5e54104f60 con 0x7f5e400a2ec0 2024-09-11T22:04:28.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.320+0000 7f5e4a7fc640 1 -- 172.21.15.152:0/2337867326 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5e54104f60 con 0x7f5e400a2ec0 2024-09-11T22:04:28.321 INFO:teuthology.orchestra.run.smithi152.stdout:Schedule set for path / 2024-09-11T22:04:28.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.322+0000 7f5e5b52a640 1 -- 172.21.15.152:0/2337867326 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e400a2ec0 msgr2=0x7f5e400a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.322+0000 7f5e5b52a640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e400a2ec0 0x7f5e400a5380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000abe0 tx=0x7f5e5000a5c0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.322+0000 7f5e5b52a640 1 -- 172.21.15.152:0/2337867326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e541013b0 msgr2=0x7f5e541a4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.322+0000 7f5e5b52a640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e541013b0 0x7f5e541a4b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009230 tx=0x7f5e44004270 comp rx=0 tx=0).stop 2024-09-11T22:04:28.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.322+0000 7f5e5b52a640 1 -- 172.21.15.152:0/2337867326 shutdown_connections 2024-09-11T22:04:28.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.322+0000 7f5e5b52a640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e400a2ec0 0x7f5e400a5380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.322+0000 7f5e5b52a640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e54105ec0 0x7f5e5419e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.322+0000 7f5e5b52a640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e541013b0 0x7f5e541a4b90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.322+0000 7f5e5b52a640 1 --2- 172.21.15.152:0/2337867326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e54100a90 0x7f5e541a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.322+0000 7f5e5b52a640 1 -- 172.21.15.152:0/2337867326 >> 172.21.15.152:0/2337867326 conn(0x7f5e540fc6f0 msgr2=0x7f5e54103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:28.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.323+0000 7f5e5b52a640 1 -- 172.21.15.152:0/2337867326 shutdown_connections 2024-09-11T22:04:28.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.323+0000 7f5e5b52a640 1 -- 172.21.15.152:0/2337867326 wait complete. 2024-09-11T22:04:28.334 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-11T22:04:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.442+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/4207906151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9e41035c0 msgr2=0x7ff9e410baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.442+0000 7ff9ea3a6640 1 --2- 172.21.15.152:0/4207906151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9e41035c0 0x7ff9e410baa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009900 tx=0x7ff9cc02a410 comp rx=0 tx=0).stop 2024-09-11T22:04:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.442+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/4207906151 shutdown_connections 2024-09-11T22:04:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.442+0000 7ff9ea3a6640 1 --2- 172.21.15.152:0/4207906151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e410c0d0 0x7ff9e410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.442+0000 7ff9ea3a6640 1 --2- 172.21.15.152:0/4207906151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9e41035c0 0x7ff9e410baa0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.442+0000 7ff9ea3a6640 1 --2- 172.21.15.152:0/4207906151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e4102ca0 0x7ff9e4103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.442+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/4207906151 >> 172.21.15.152:0/4207906151 conn(0x7ff9e40fc6b0 msgr2=0x7ff9e40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.442+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/4207906151 shutdown_connections 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.442+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/4207906151 wait complete. 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9ea3a6640 1 Processor -- start 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9ea3a6640 1 -- start start 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9ea3a6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e4102ca0 0x7ff9e41008f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9ea3a6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e41035c0 0x7ff9e4100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9ea3a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9e410c0d0 0x7ff9e4101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9ea3a6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e4111ed0 con 0x7ff9e410c0d0 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9ea3a6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e4111d50 con 0x7ff9e41035c0 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9ea3a6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e4112050 con 0x7ff9e4102ca0 2024-09-11T22:04:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9dbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e41035c0 0x7ff9e4100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9e8943640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9e410c0d0 0x7ff9e4101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9dbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e41035c0 0x7ff9e4100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33246/0 (socket says 172.21.15.152:33246) 2024-09-11T22:04:28.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9dbfff640 1 -- 172.21.15.152:0/3658409943 learned_addr learned my addr 172.21.15.152:0/3658409943 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:28.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.443+0000 7ff9e3fff640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e4102ca0 0x7ff9e41008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9e8943640 1 -- 172.21.15.152:0/3658409943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e4102ca0 msgr2=0x7ff9e41008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9e8943640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e4102ca0 0x7ff9e41008f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9e8943640 1 -- 172.21.15.152:0/3658409943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e41035c0 msgr2=0x7ff9e4100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9e8943640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e41035c0 0x7ff9e4100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9e8943640 1 -- 172.21.15.152:0/3658409943 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e41a68a0 con 0x7ff9e410c0d0 2024-09-11T22:04:28.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9e3fff640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e4102ca0 0x7ff9e41008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:28.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9dbfff640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e41035c0 0x7ff9e4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9e8943640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9e410c0d0 0x7ff9e4101370 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00ca30 tx=0x7ff9dc00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9e1ffb640 1 -- 172.21.15.152:0/3658409943 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc007d90 con 0x7ff9e410c0d0 2024-09-11T22:04:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9e1ffb640 1 -- 172.21.15.152:0/3658409943 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9dc005020 con 0x7ff9e410c0d0 2024-09-11T22:04:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9e1ffb640 1 -- 172.21.15.152:0/3658409943 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc00f780 con 0x7ff9e410c0d0 2024-09-11T22:04:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/3658409943 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e41a6b90 con 0x7ff9e410c0d0 2024-09-11T22:04:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.444+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/3658409943 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e41a70e0 con 0x7ff9e410c0d0 2024-09-11T22:04:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.445+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/3658409943 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e4103080 con 0x7ff9e410c0d0 2024-09-11T22:04:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.447+0000 7ff9e1ffb640 1 -- 172.21.15.152:0/3658409943 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7ff9dc0051d0 con 0x7ff9e410c0d0 2024-09-11T22:04:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.447+0000 7ff9e1ffb640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff9d00a2f40 0x7ff9d00a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.447+0000 7ff9e1ffb640 1 -- 172.21.15.152:0/3658409943 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff9dc0cfc30 con 0x7ff9e410c0d0 2024-09-11T22:04:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.447+0000 7ff9e3fff640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff9d00a2f40 0x7ff9d00a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.448+0000 7ff9e3fff640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff9d00a2f40 0x7ff9d00a5400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4009fc0 tx=0x7ff9d4005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:28.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.455+0000 7ff9e1ffb640 1 -- 172.21.15.152:0/3658409943 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9dc014070 con 0x7ff9e410c0d0 2024-09-11T22:04:28.466 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:04:28.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.651+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/3658409943 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7ff9e4062630 con 0x7ff9d00a2f40 2024-09-11T22:04:28.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.712+0000 7ff9e1ffb640 1 -- 172.21.15.152:0/3658409943 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7ff9e4062630 con 0x7ff9d00a2f40 2024-09-11T22:04:28.713 INFO:teuthology.orchestra.run.smithi152.stdout:Retention added to path / 2024-09-11T22:04:28.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/3658409943 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff9d00a2f40 msgr2=0x7ff9d00a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff9d00a2f40 0x7ff9d00a5400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4009fc0 tx=0x7ff9d4005f90 comp rx=0 tx=0).stop 2024-09-11T22:04:28.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/3658409943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9e410c0d0 msgr2=0x7ff9e4101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9e410c0d0 0x7ff9e4101370 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00ca30 tx=0x7ff9dc00cef0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/3658409943 shutdown_connections 2024-09-11T22:04:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff9d00a2f40 0x7ff9d00a5400 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9e410c0d0 0x7ff9e4101370 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e41035c0 0x7ff9e4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 --2- 172.21.15.152:0/3658409943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e4102ca0 0x7ff9e41008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/3658409943 >> 172.21.15.152:0/3658409943 conn(0x7ff9e40fc6b0 msgr2=0x7ff9e40fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/3658409943 shutdown_connections 2024-09-11T22:04:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.715+0000 7ff9ea3a6640 1 -- 172.21.15.152:0/3658409943 wait complete. 2024-09-11T22:04:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:28.728 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:28 smithi152 ceph-mon[31188]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 455 B/s wr, 17 op/s 2024-09-11T22:04:28.728 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:28 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/681809942' entity='client.admin' 2024-09-11T22:04:28.728 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:28 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:28.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:28 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:28.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:28 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:28.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:28 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:28.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:28 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1907138982' entity='client.admin' 2024-09-11T22:04:28.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:28 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:28.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:28 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:28.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:28 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:28.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:28 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:28.730 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-11T22:04:28.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:28 smithi179 ceph-mon[35603]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 455 B/s wr, 17 op/s 2024-09-11T22:04:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:28 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/681809942' entity='client.admin' 2024-09-11T22:04:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:28 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:28 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:28 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:28 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:28 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1907138982' entity='client.admin' 2024-09-11T22:04:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:28 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:28 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:28 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:28.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:28 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:28 smithi193 ceph-mon[35545]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 455 B/s wr, 17 op/s 2024-09-11T22:04:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:28 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/681809942' entity='client.admin' 2024-09-11T22:04:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:28 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:28 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:28 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:28.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:28 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:28.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:28 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1907138982' entity='client.admin' 2024-09-11T22:04:28.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:28 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:04:28.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:28 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:04:28.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:28 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:04:28.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:28 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:04:28.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.833+0000 7f752b7f1640 1 -- 172.21.15.152:0/387055267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75241009d0 msgr2=0x7f7524100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.833+0000 7f752b7f1640 1 --2- 172.21.15.152:0/387055267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75241009d0 0x7f7524100e30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7514009930 tx=0x7f751402a420 comp rx=0 tx=0).stop 2024-09-11T22:04:28.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.833+0000 7f752b7f1640 1 -- 172.21.15.152:0/387055267 shutdown_connections 2024-09-11T22:04:28.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.833+0000 7f752b7f1640 1 --2- 172.21.15.152:0/387055267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7524101370 0x7f752410d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.833+0000 7f752b7f1640 1 --2- 172.21.15.152:0/387055267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75241009d0 0x7f7524100e30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.833+0000 7f752b7f1640 1 --2- 172.21.15.152:0/387055267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75241069e0 0x7f7524106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.833+0000 7f752b7f1640 1 -- 172.21.15.152:0/387055267 >> 172.21.15.152:0/387055267 conn(0x7f75240fc6f0 msgr2=0x7f75240feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:28.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.833+0000 7f752b7f1640 1 -- 172.21.15.152:0/387055267 shutdown_connections 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.833+0000 7f752b7f1640 1 -- 172.21.15.152:0/387055267 wait complete. 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f752b7f1640 1 Processor -- start 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f752b7f1640 1 -- start start 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f752b7f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75241009d0 0x7f7524199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f752b7f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7524101370 0x7f75241996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f752b7f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75241069e0 0x7f75241a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f752b7f1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7524110e20 con 0x7f7524101370 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f752b7f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7524110ca0 con 0x7f75241069e0 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f752b7f1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7524110fa0 con 0x7f75241009d0 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f7528d8c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7524101370 0x7f75241996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f7528d8c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7524101370 0x7f75241996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59082/0 (socket says 172.21.15.152:59082) 2024-09-11T22:04:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f7528d8c640 1 -- 172.21.15.152:0/847697226 learned_addr learned my addr 172.21.15.152:0/847697226 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f7529d8e640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75241069e0 0x7f75241a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f752958d640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75241009d0 0x7f7524199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f7528d8c640 1 -- 172.21.15.152:0/847697226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75241009d0 msgr2=0x7f7524199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f7528d8c640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75241009d0 0x7f7524199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f7528d8c640 1 -- 172.21.15.152:0/847697226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75241069e0 msgr2=0x7f75241a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f7528d8c640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75241069e0 0x7f75241a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f7528d8c640 1 -- 172.21.15.152:0/847697226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75241a4750 con 0x7f7524101370 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f752958d640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75241009d0 0x7f7524199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.834+0000 7f7529d8e640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75241069e0 0x7f75241a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.835+0000 7f7528d8c640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7524101370 0x7f75241996d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7514009a50 tx=0x7f7514004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.835+0000 7f751a7fc640 1 -- 172.21.15.152:0/847697226 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751403f030 con 0x7f7524101370 2024-09-11T22:04:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.835+0000 7f751a7fc640 1 -- 172.21.15.152:0/847697226 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7514003ce0 con 0x7f7524101370 2024-09-11T22:04:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.835+0000 7f751a7fc640 1 -- 172.21.15.152:0/847697226 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514035070 con 0x7f7524101370 2024-09-11T22:04:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.835+0000 7f752b7f1640 1 -- 172.21.15.152:0/847697226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75241a4920 con 0x7f7524101370 2024-09-11T22:04:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.835+0000 7f752b7f1640 1 -- 172.21.15.152:0/847697226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75241a4d30 con 0x7f7524101370 2024-09-11T22:04:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.836+0000 7f752b7f1640 1 -- 172.21.15.152:0/847697226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7524102110 con 0x7f7524101370 2024-09-11T22:04:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.837+0000 7f751a7fc640 1 -- 172.21.15.152:0/847697226 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f7514042030 con 0x7f7524101370 2024-09-11T22:04:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.838+0000 7f751a7fc640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f75100a2f40 0x7f75100a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.838+0000 7f752958d640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f75100a2f40 0x7f75100a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.838+0000 7f751a7fc640 1 -- 172.21.15.152:0/847697226 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f75140f0080 con 0x7f7524101370 2024-09-11T22:04:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.838+0000 7f752958d640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f75100a2f40 0x7f75100a5400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7520005d70 tx=0x7f7520005d00 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:28.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:28.841+0000 7f751a7fc640 1 -- 172.21.15.152:0/847697226 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75140bcaf0 con 0x7f7524101370 2024-09-11T22:04:29.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.035+0000 7f752b7f1640 1 -- 172.21.15.152:0/847697226 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f75240fd460 con 0x7f75100a2f40 2024-09-11T22:04:29.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.042+0000 7f751a7fc640 1 -- 172.21.15.152:0/847697226 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f75240fd460 con 0x7f75100a2f40 2024-09-11T22:04:29.043 INFO:teuthology.orchestra.run.smithi152.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-11T00:00:00", "created": "2024-09-11T22:04:28", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-11T22:04:29.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 -- 172.21.15.152:0/847697226 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f75100a2f40 msgr2=0x7f75100a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f75100a2f40 0x7f75100a5400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7520005d70 tx=0x7f7520005d00 comp rx=0 tx=0).stop 2024-09-11T22:04:29.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 -- 172.21.15.152:0/847697226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7524101370 msgr2=0x7f75241996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7524101370 0x7f75241996d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7514009a50 tx=0x7f7514004270 comp rx=0 tx=0).stop 2024-09-11T22:04:29.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 -- 172.21.15.152:0/847697226 shutdown_connections 2024-09-11T22:04:29.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f75100a2f40 0x7f75100a5400 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75241069e0 0x7f75241a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7524101370 0x7f75241996d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 --2- 172.21.15.152:0/847697226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75241009d0 0x7f7524199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 -- 172.21.15.152:0/847697226 >> 172.21.15.152:0/847697226 conn(0x7f75240fc6f0 msgr2=0x7f75240fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:29.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 -- 172.21.15.152:0/847697226 shutdown_connections 2024-09-11T22:04:29.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.044+0000 7f752b7f1640 1 -- 172.21.15.152:0/847697226 wait complete. 2024-09-11T22:04:29.055 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-11T22:04:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.161+0000 7f7a507a1640 1 -- 172.21.15.152:0/3997524733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a48102c80 msgr2=0x7f7a48103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.161+0000 7f7a507a1640 1 --2- 172.21.15.152:0/3997524733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a48102c80 0x7f7a48103060 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009900 tx=0x7f7a4402a480 comp rx=0 tx=0).stop 2024-09-11T22:04:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.161+0000 7f7a507a1640 1 -- 172.21.15.152:0/3997524733 shutdown_connections 2024-09-11T22:04:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.161+0000 7f7a507a1640 1 --2- 172.21.15.152:0/3997524733 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4810c0d0 0x7f7a4810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.161+0000 7f7a507a1640 1 --2- 172.21.15.152:0/3997524733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a481035a0 0x7f7a4810ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.161+0000 7f7a507a1640 1 --2- 172.21.15.152:0/3997524733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a48102c80 0x7f7a48103060 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.161+0000 7f7a507a1640 1 -- 172.21.15.152:0/3997524733 >> 172.21.15.152:0/3997524733 conn(0x7f7a48077990 msgr2=0x7f7a480fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:29.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.161+0000 7f7a507a1640 1 -- 172.21.15.152:0/3997524733 shutdown_connections 2024-09-11T22:04:29.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.161+0000 7f7a507a1640 1 -- 172.21.15.152:0/3997524733 wait complete. 2024-09-11T22:04:29.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.161+0000 7f7a507a1640 1 Processor -- start 2024-09-11T22:04:29.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a507a1640 1 -- start start 2024-09-11T22:04:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a507a1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a48102c80 0x7f7a48198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a507a1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a481035a0 0x7f7a481988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a507a1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4810c0d0 0x7f7a4819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a507a1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7a48111eb0 con 0x7f7a481035a0 2024-09-11T22:04:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a507a1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7a48111d30 con 0x7f7a48102c80 2024-09-11T22:04:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a507a1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7a48112030 con 0x7f7a4810c0d0 2024-09-11T22:04:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a4dd3c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a481035a0 0x7f7a481988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a4dd3c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a481035a0 0x7f7a481988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59100/0 (socket says 172.21.15.152:59100) 2024-09-11T22:04:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a4dd3c640 1 -- 172.21.15.152:0/3804039695 learned_addr learned my addr 172.21.15.152:0/3804039695 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a4ed3e640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4810c0d0 0x7f7a4819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a4e53d640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a48102c80 0x7f7a48198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a4dd3c640 1 -- 172.21.15.152:0/3804039695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4810c0d0 msgr2=0x7f7a4819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a4dd3c640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4810c0d0 0x7f7a4819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a4dd3c640 1 -- 172.21.15.152:0/3804039695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a48102c80 msgr2=0x7f7a48198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a4dd3c640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a48102c80 0x7f7a48198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a4dd3c640 1 -- 172.21.15.152:0/3804039695 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4819d370 con 0x7f7a481035a0 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.162+0000 7f7a4dd3c640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a481035a0 0x7f7a481988c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800d950 tx=0x7f7a3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.163+0000 7f7a3f7fe640 1 -- 172.21.15.152:0/3804039695 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a38017030 con 0x7f7a481035a0 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.163+0000 7f7a3f7fe640 1 -- 172.21.15.152:0/3804039695 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a38004020 con 0x7f7a481035a0 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.163+0000 7f7a3f7fe640 1 -- 172.21.15.152:0/3804039695 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a380047a0 con 0x7f7a481035a0 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.163+0000 7f7a507a1640 1 -- 172.21.15.152:0/3804039695 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4819d660 con 0x7f7a481035a0 2024-09-11T22:04:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.163+0000 7f7a507a1640 1 -- 172.21.15.152:0/3804039695 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a481a4ef0 con 0x7f7a481035a0 2024-09-11T22:04:29.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.164+0000 7f7a507a1640 1 -- 172.21.15.152:0/3804039695 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a48103060 con 0x7f7a481035a0 2024-09-11T22:04:29.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.165+0000 7f7a3f7fe640 1 -- 172.21.15.152:0/3804039695 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f7a380041d0 con 0x7f7a481035a0 2024-09-11T22:04:29.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.166+0000 7f7a3f7fe640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a340a2f40 0x7f7a340a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.166+0000 7f7a4e53d640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a340a2f40 0x7f7a340a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.166+0000 7f7a3f7fe640 1 -- 172.21.15.152:0/3804039695 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f7a380cefb0 con 0x7f7a481035a0 2024-09-11T22:04:29.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.167+0000 7f7a4e53d640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a340a2f40 0x7f7a340a5400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009230 tx=0x7f7a440058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.170+0000 7f7a3f7fe640 1 -- 172.21.15.152:0/3804039695 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a3809b8f0 con 0x7f7a481035a0 2024-09-11T22:04:29.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.182+0000 7fcd8a96d640 1 -- 172.21.15.152:0/2566746284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd84108300 msgr2=0x7fcd8410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.182+0000 7fcd8a96d640 1 --2- 172.21.15.152:0/2566746284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd84108300 0x7fcd8410ec70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009cd0 tx=0x7fcd7c02a8d0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.182+0000 7fcd8a96d640 1 -- 172.21.15.152:0/2566746284 shutdown_connections 2024-09-11T22:04:29.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.182+0000 7fcd8a96d640 1 --2- 172.21.15.152:0/2566746284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd84108300 0x7fcd8410ec70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.182+0000 7fcd8a96d640 1 --2- 172.21.15.152:0/2566746284 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd84103780 0x7fcd84107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.182+0000 7fcd8a96d640 1 --2- 172.21.15.152:0/2566746284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84102dd0 0x7fcd841031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.182+0000 7fcd8a96d640 1 -- 172.21.15.152:0/2566746284 >> 172.21.15.152:0/2566746284 conn(0x7fcd840fc7d0 msgr2=0x7fcd840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.182+0000 7fcd8a96d640 1 -- 172.21.15.152:0/2566746284 shutdown_connections 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.182+0000 7fcd8a96d640 1 -- 172.21.15.152:0/2566746284 wait complete. 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.183+0000 7fcd8a96d640 1 Processor -- start 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.183+0000 7fcd8a96d640 1 -- start start 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.183+0000 7fcd8a96d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd84102dd0 0x7fcd84198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.183+0000 7fcd8a96d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd84103780 0x7fcd84198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.183+0000 7fcd8a96d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84108300 0x7fcd8419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.183+0000 7fcd8a96d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841120d0 con 0x7fcd84103780 2024-09-11T22:04:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.183+0000 7fcd8a96d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84111f50 con 0x7fcd84108300 2024-09-11T22:04:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.183+0000 7fcd8a96d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84112250 con 0x7fcd84102dd0 2024-09-11T22:04:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd84103780 0x7fcd84198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd84103780 0x7fcd84198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59124/0 (socket says 172.21.15.152:59124) 2024-09-11T22:04:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd837fe640 1 -- 172.21.15.152:0/1434578560 learned_addr learned my addr 172.21.15.152:0/1434578560 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd83fff640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd84102dd0 0x7fcd84198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd88f0a640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84108300 0x7fcd8419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd837fe640 1 -- 172.21.15.152:0/1434578560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd84102dd0 msgr2=0x7fcd84198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd837fe640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd84102dd0 0x7fcd84198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd837fe640 1 -- 172.21.15.152:0/1434578560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84108300 msgr2=0x7fcd8419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd837fe640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84108300 0x7fcd8419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd837fe640 1 -- 172.21.15.152:0/1434578560 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8419d540 con 0x7fcd84103780 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd837fe640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd84103780 0x7fcd84198ad0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800d750 tx=0x7fcd7800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd817fa640 1 -- 172.21.15.152:0/1434578560 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78017070 con 0x7fcd84103780 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd8a96d640 1 -- 172.21.15.152:0/1434578560 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8419d830 con 0x7fcd84103780 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd817fa640 1 -- 172.21.15.152:0/1434578560 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd78005500 con 0x7fcd84103780 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd817fa640 1 -- 172.21.15.152:0/1434578560 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78004e00 con 0x7fcd84103780 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.184+0000 7fcd8a96d640 1 -- 172.21.15.152:0/1434578560 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd841a5110 con 0x7fcd84103780 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.188+0000 7fcd817fa640 1 -- 172.21.15.152:0/1434578560 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7fcd78004fa0 con 0x7fcd84103780 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.188+0000 7fcd8cd46740 1 Processor -- start 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.188+0000 7fcd8cd46740 1 -- start start 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.188+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a5d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.188+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a6c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.188+0000 7fcd817fa640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd6c0a2e10 0x7fcd6c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.188+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a6ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.188+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559a589c32e0 con 0x559a58a5dc80 2024-09-11T22:04:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.188+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559a5896ace0 con 0x559a58a5d360 2024-09-11T22:04:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.188+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559a589bf2a0 con 0x559a58a6ca90 2024-09-11T22:04:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a6c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a6c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59132/0 (socket says 172.21.15.152:59132) 2024-09-11T22:04:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd837fe640 1 -- 172.21.15.152:0/3840166560 learned_addr learned my addr 172.21.15.152:0/3840166560 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd88f0a640 1 --2- 172.21.15.152:0/3840166560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a6ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd817fa640 1 -- 172.21.15.152:0/1434578560 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcd780ced20 con 0x7fcd84103780 2024-09-11T22:04:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd88f0a640 1 --2- 172.21.15.152:0/3840166560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a5d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd837fe640 1 -- 172.21.15.152:0/3840166560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 msgr2=0x559a58a6ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd837fe640 1 --2- 172.21.15.152:0/3840166560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a6ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd837fe640 1 -- 172.21.15.152:0/3840166560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 msgr2=0x559a58a5d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd837fe640 1 --2- 172.21.15.152:0/3840166560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a5d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd837fe640 1 -- 172.21.15.152:0/3840166560 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5894f440 con 0x559a58a5dc80 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd88f0a640 1 --2- 172.21.15.152:0/3840166560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a5d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd83fff640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd6c0a2e10 0x7fcd6c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd837fe640 1 --2- 172.21.15.152:0/3840166560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a6c550 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcd7809acc0 tx=0x7fcd7809aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f7993cc0fefa78 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd6a7fc640 1 -- 172.21.15.152:0/3840166560 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78020030 con 0x559a58a5dc80 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd6a7fc640 1 -- 172.21.15.152:0/3840166560 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd780046c0 con 0x559a58a5dc80 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.189+0000 7fcd6a7fc640 1 -- 172.21.15.152:0/3840166560 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78009cc0 con 0x559a58a5dc80 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.190+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3840166560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 msgr2=0x559a58a6c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.190+0000 7fcd83fff640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd6c0a2e10 0x7fcd6c0a52d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400bbe0 tx=0x7fcd7400b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.190+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/3840166560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a6c550 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcd7809acc0 tx=0x7fcd7809aec0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.190+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3840166560 shutdown_connections 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.190+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/3840166560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a6ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.190+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/3840166560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a6c550 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.190+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/3840166560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a5d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.190+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3840166560 >> 172.21.15.152:0/3840166560 conn(0x559a58a59a30 msgr2=0x559a58a59e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.190+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3840166560 shutdown_connections 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.190+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3840166560 wait complete. 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd8cd46740 1 -- start start 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd8cd46740 1 Processor -- start 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5d360 0x559a58a6c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5dc80 0x559a58a69790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a69f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559a58a6f600 con 0x559a58a5d360 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559a5897e050 con 0x559a58a5dc80 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559a58a6f780 con 0x559a58a6ca90 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd8cd46740 10 client.0 _ll_register_callbacks cb 0x559a589be160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5d360 0x559a58a6c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5d360 0x559a58a6c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59134/0 (socket says 172.21.15.152:59134) 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd83fff640 1 -- 172.21.15.152:0/3831386856 learned_addr learned my addr 172.21.15.152:0/3831386856 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.191+0000 7fcd837fe640 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5dc80 0x559a58a69790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd88f0a640 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a69f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd83fff640 1 -- 172.21.15.152:0/3831386856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 msgr2=0x559a58a69f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd83fff640 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a69f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd83fff640 1 -- 172.21.15.152:0/3831386856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5dc80 msgr2=0x559a58a69790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd83fff640 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5dc80 0x559a58a69790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd83fff640 1 -- 172.21.15.152:0/3831386856 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a587343c0 con 0x559a58a5d360 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd88f0a640 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a69f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd83fff640 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5d360 0x559a58a6c4e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcd740116c0 tx=0x7fcd74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3024bc02b708e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd637fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd637fe640 1 -- 172.21.15.152:0/3831386856 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7401e8f0 con 0x559a58a5d360 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd637fe640 1 -- 172.21.15.152:0/3831386856 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcd7401ea90 con 0x559a58a5d360 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3831386856 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559a589d0850 con 0x559a58a5d360 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd637fe640 1 -- 172.21.15.152:0/3831386856 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcd7401ec90 con 0x559a58a5d360 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd8cd46740 10 client.15330 fetch_fsmap learned FSMap version 24 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.192+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3831386856 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559a58a7b130 con 0x559a58a5d360 2024-09-11T22:04:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.193+0000 7fcd637fe640 1 -- 172.21.15.152:0/3831386856 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559a589d0850 con 0x559a58a5d360 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.193+0000 7fcd637fe640 1 -- 172.21.15.152:0/3831386856 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcd7402d070 con 0x559a58a5d360 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.193+0000 7fcd8cd46740 10 client.15330 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.193+0000 7fcd8cd46740 10 client.15330 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.193+0000 7fcd8cd46740 20 client.15330 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.193+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559a58a7c5f0 0x559a58a7e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.193+0000 7fcd8cd46740 4 client.15330 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.193+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3831386856 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a589cad60 con 0x559a58a7c5f0 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.193+0000 7fcd837fe640 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559a58a7c5f0 0x559a58a7e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.194+0000 7fcd837fe640 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559a58a7c5f0 0x559a58a7e9e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c3acf98c13db906 server_cookie=6515247f09ce8f2 in_seq=0 out_seq=0 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.194+0000 7fcd637fe640 10 client.15330 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.194+0000 7fcd637fe640 1 -- 172.21.15.152:0/3831386856 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a589cad60 con 0x559a58a7c5f0 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.194+0000 7fcd637fe640 10 client.15330 handle_command_reply: tid=0 2024-09-11T22:04:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.194+0000 7fcd8cd46740 1 client.15330 shutdown 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.194+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3831386856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5d360 msgr2=0x559a58a6c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.194+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5d360 0x559a58a6c4e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcd740116c0 tx=0x7fcd74004730 comp rx=0 tx=0).stop 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.195+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3831386856 shutdown_connections 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.195+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559a58a7c5f0 0x559a58a7e9e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.195+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a69f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.195+0000 7fcd637fe640 0 client.15330 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.195+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5dc80 0x559a58a69790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.195+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/3831386856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5d360 0x559a58a6c4e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.195+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3831386856 >> 172.21.15.152:0/3831386856 conn(0x559a58a59a30 msgr2=0x559a58a5f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.195+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3831386856 shutdown_connections 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.195+0000 7fcd8cd46740 1 -- 172.21.15.152:0/3831386856 wait complete. 2024-09-11T22:04:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.195+0000 7fcd8cd46740 20 client.15330 trim_cache size 0 max 16384 2024-09-11T22:04:29.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.230+0000 7fcd8cd46740 1 Processor -- start 2024-09-11T22:04:29.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.230+0000 7fcd8cd46740 1 -- start start 2024-09-11T22:04:29.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.230+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a84290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.230+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a847d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.230+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.230+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841ae050 con 0x559a58a5dc80 2024-09-11T22:04:29.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.230+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841ab920 con 0x559a58a5d360 2024-09-11T22:04:29.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.230+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841a9770 con 0x559a58a6ca90 2024-09-11T22:04:29.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a847d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a847d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59150/0 (socket says 172.21.15.152:59150) 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd837fe640 1 -- 172.21.15.152:0/1534229993 learned_addr learned my addr 172.21.15.152:0/1534229993 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd83fff640 1 --2- 172.21.15.152:0/1534229993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a84290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd88f0a640 1 --2- 172.21.15.152:0/1534229993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd837fe640 1 -- 172.21.15.152:0/1534229993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 msgr2=0x559a58a644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd837fe640 1 --2- 172.21.15.152:0/1534229993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd837fe640 1 -- 172.21.15.152:0/1534229993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 msgr2=0x559a58a84290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd837fe640 1 --2- 172.21.15.152:0/1534229993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a84290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd837fe640 1 -- 172.21.15.152:0/1534229993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a58a6a290 con 0x559a58a5dc80 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd837fe640 1 --2- 172.21.15.152:0/1534229993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a847d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcd7809af50 tx=0x7fcd7801d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db2785fe940f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.231+0000 7fcd69ffb640 1 -- 172.21.15.152:0/1534229993 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd780b3020 con 0x559a58a5dc80 2024-09-11T22:04:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.232+0000 7fcd69ffb640 1 -- 172.21.15.152:0/1534229993 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd78079070 con 0x559a58a5dc80 2024-09-11T22:04:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.232+0000 7fcd69ffb640 1 -- 172.21.15.152:0/1534229993 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78020040 con 0x559a58a5dc80 2024-09-11T22:04:29.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.233+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1534229993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 msgr2=0x559a58a847d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.233+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/1534229993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a847d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcd7809af50 tx=0x7fcd7801d040 comp rx=0 tx=0).stop 2024-09-11T22:04:29.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.233+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1534229993 shutdown_connections 2024-09-11T22:04:29.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.233+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/1534229993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a6ca90 0x559a58a644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.233+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/1534229993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a5dc80 0x559a58a847d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.233+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/1534229993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a84290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.233+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1534229993 >> 172.21.15.152:0/1534229993 conn(0x559a58a59a30 msgr2=0x559a58a68880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.233+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1534229993 shutdown_connections 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.233+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1534229993 wait complete. 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.233+0000 7fcd8cd46740 1 -- start start 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.233+0000 7fcd8cd46740 1 Processor -- start 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a74ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a5dc80 0x559a58a75220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd8cd46740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a6ca90 0x559a58a70110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841a9de0 con 0x559a58a6ca90 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841ab250 con 0x559a58a5d360 2024-09-11T22:04:29.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd8cd46740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841aa4b0 con 0x559a58a5dc80 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd88f0a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a6ca90 0x559a58a70110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd88f0a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a6ca90 0x559a58a70110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59154/0 (socket says 172.21.15.152:59154) 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd8cd46740 10 client.0 _ll_register_callbacks cb 0x7fcd7400b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd88f0a640 1 -- 172.21.15.152:0/1869148355 learned_addr learned my addr 172.21.15.152:0/1869148355 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd83fff640 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a74ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd837fe640 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a5dc80 0x559a58a75220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd88f0a640 1 -- 172.21.15.152:0/1869148355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a5dc80 msgr2=0x559a58a75220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd88f0a640 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a5dc80 0x559a58a75220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd88f0a640 1 -- 172.21.15.152:0/1869148355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 msgr2=0x559a58a74ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd88f0a640 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a74ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.234+0000 7fcd88f0a640 1 -- 172.21.15.152:0/1869148355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a58a5dab0 con 0x559a58a6ca90 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd88f0a640 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a6ca90 0x559a58a70110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c02adf0 tx=0x7fcd7c031ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e37162bec454d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd637fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:29.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd637fe640 1 -- 172.21.15.152:0/1869148355 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c031420 con 0x559a58a6ca90 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd637fe640 1 -- 172.21.15.152:0/1869148355 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcd7c0315c0 con 0x559a58a6ca90 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1869148355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd78079070 con 0x559a58a6ca90 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd637fe640 1 -- 172.21.15.152:0/1869148355 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcd7c031800 con 0x559a58a6ca90 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd8cd46740 10 client.15336 fetch_fsmap learned FSMap version 24 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1869148355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559a58ae6c30 con 0x559a58a6ca90 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd637fe640 1 -- 172.21.15.152:0/1869148355 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd78079070 con 0x559a58a6ca90 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd637fe640 1 -- 172.21.15.152:0/1869148355 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcd7c0043c0 con 0x559a58a6ca90 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd8cd46740 10 client.15336 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd8cd46740 10 client.15336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd8cd46740 20 client.15336 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559a58a7c5f0 0x559a58ae9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd8cd46740 4 client.15336 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:04:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.235+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1869148355 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a58947210 con 0x559a58a7c5f0 2024-09-11T22:04:29.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.236+0000 7fcd83fff640 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559a58a7c5f0 0x559a58ae9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.236+0000 7fcd83fff640 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559a58a7c5f0 0x559a58ae9410 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f22c13e28efedb1 server_cookie=c4d103f059724dbf in_seq=0 out_seq=0 2024-09-11T22:04:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.236+0000 7fcd637fe640 10 client.15336 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.236+0000 7fcd637fe640 1 -- 172.21.15.152:0/1869148355 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559a58947210 con 0x559a58a7c5f0 2024-09-11T22:04:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.236+0000 7fcd637fe640 10 client.15336 handle_command_reply: tid=0 2024-09-11T22:04:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.236+0000 7fcd8cd46740 1 client.15336 shutdown 2024-09-11T22:04:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1869148355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a6ca90 msgr2=0x559a58a70110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a6ca90 0x559a58a70110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c02adf0 tx=0x7fcd7c031ce0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1869148355 shutdown_connections 2024-09-11T22:04:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559a58a7c5f0 0x559a58ae9410 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559a58a6ca90 0x559a58a70110 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559a58a5dc80 0x559a58a75220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd8cd46740 1 --2- 172.21.15.152:0/1869148355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a58a5d360 0x559a58a74ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1869148355 >> 172.21.15.152:0/1869148355 conn(0x559a58a59a30 msgr2=0x559a58a58350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:29.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd637fe640 0 client.15336 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:29.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1869148355 shutdown_connections 2024-09-11T22:04:29.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd8cd46740 1 -- 172.21.15.152:0/1869148355 wait complete. 2024-09-11T22:04:29.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.237+0000 7fcd8cd46740 20 client.15336 trim_cache size 0 max 16384 2024-09-11T22:04:29.242 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:04:29.242 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:04:29.242 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:04:29.243 INFO:teuthology.orchestra.run.smithi152.stdout: "4a985efc-17fd-4653-93c9-1f9c08164cf0": { 2024-09-11T22:04:29.243 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:04:29.243 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "4a985efc-17fd-4653-93c9-1f9c08164cf0", 2024-09-11T22:04:29.243 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:04:29.243 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:04:29.243 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:04:29.243 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:04:29.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 -- 172.21.15.152:0/1434578560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd6c0a2e10 msgr2=0x7fcd6c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd6c0a2e10 0x7fcd6c0a52d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400bbe0 tx=0x7fcd7400b390 comp rx=0 tx=0).stop 2024-09-11T22:04:29.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 -- 172.21.15.152:0/1434578560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd84103780 msgr2=0x7fcd84198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd84103780 0x7fcd84198ad0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800d750 tx=0x7fcd7800dc10 comp rx=0 tx=0).stop 2024-09-11T22:04:29.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 -- 172.21.15.152:0/1434578560 shutdown_connections 2024-09-11T22:04:29.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd6c0a2e10 0x7fcd6c0a52d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84108300 0x7fcd8419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd84103780 0x7fcd84198ad0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 --2- 172.21.15.152:0/1434578560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd84102dd0 0x7fcd84198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 -- 172.21.15.152:0/1434578560 >> 172.21.15.152:0/1434578560 conn(0x7fcd840fc7d0 msgr2=0x7fcd84105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:29.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 -- 172.21.15.152:0/1434578560 shutdown_connections 2024-09-11T22:04:29.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.238+0000 7fcd8a96d640 1 -- 172.21.15.152:0/1434578560 wait complete. 2024-09-11T22:04:29.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.391+0000 7f7a507a1640 1 -- 172.21.15.152:0/3804039695 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f7a48062630 con 0x7f7a340a2f40 2024-09-11T22:04:29.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.398+0000 7f7a3f7fe640 1 -- 172.21.15.152:0/3804039695 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f7a48062630 con 0x7f7a340a2f40 2024-09-11T22:04:29.399 INFO:teuthology.orchestra.run.smithi152.stdout:/ 1m 6m3h 2024-09-11T22:04:29.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.400+0000 7f7a507a1640 1 -- 172.21.15.152:0/3804039695 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a340a2f40 msgr2=0x7f7a340a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.400+0000 7f7a507a1640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a340a2f40 0x7f7a340a5400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009230 tx=0x7f7a440058d0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.400+0000 7f7a507a1640 1 -- 172.21.15.152:0/3804039695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a481035a0 msgr2=0x7f7a481988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:29.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.400+0000 7f7a507a1640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a481035a0 0x7f7a481988c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800d950 tx=0x7f7a3800de10 comp rx=0 tx=0).stop 2024-09-11T22:04:29.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.400+0000 7f7a507a1640 1 -- 172.21.15.152:0/3804039695 shutdown_connections 2024-09-11T22:04:29.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.400+0000 7f7a507a1640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a340a2f40 0x7f7a340a5400 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.400+0000 7f7a507a1640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4810c0d0 0x7f7a4819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.400+0000 7f7a507a1640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a481035a0 0x7f7a481988c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.400+0000 7f7a507a1640 1 --2- 172.21.15.152:0/3804039695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a48102c80 0x7f7a48198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:29.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.400+0000 7f7a507a1640 1 -- 172.21.15.152:0/3804039695 >> 172.21.15.152:0/3804039695 conn(0x7f7a48077990 msgr2=0x7f7a480fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:29.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.401+0000 7f7a507a1640 1 -- 172.21.15.152:0/3804039695 shutdown_connections 2024-09-11T22:04:29.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:29.401+0000 7f7a507a1640 1 -- 172.21.15.152:0/3804039695 wait complete. 2024-09-11T22:04:29.412 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-11T22:04:29.438 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-11T22:04:29.450 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-11T22:04:29.459 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T22:04:29.460 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-11T22:04:29.481 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-11T22:04:29.494 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T22:04:29.494 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:04:29.501 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:29 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:04:29.501 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:29 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:04:29.501 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:29 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:04:29.501 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:29 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:04:29.501 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:29 smithi152 ceph-mon[31188]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:29 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:04:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:29 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:04:29.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:29 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:04:29.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:29 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:04:29.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:29 smithi179 ceph-mon[35603]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:29 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:04:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:29 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:04:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:29 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:04:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:29 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:04:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:29 smithi193 ceph-mon[35545]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:29.988 INFO:tasks.cephfs.filesystem:scrub status for tag:4a985efc-17fd-4653-93c9-1f9c08164cf0 - {'path': '/', 'tag': '4a985efc-17fd-4653-93c9-1f9c08164cf0', 'options': 'recursive,force'} 2024-09-11T22:04:30.072 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:30.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.538+0000 7f0fe186e640 1 -- 172.21.15.152:0/3738927004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fdc102d30 msgr2=0x7f0fdc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.538+0000 7f0fe186e640 1 --2- 172.21.15.152:0/3738927004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fdc102d30 0x7f0fdc103110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc009cd0 tx=0x7f0fcc02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.539+0000 7f0fe186e640 1 -- 172.21.15.152:0/3738927004 shutdown_connections 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.539+0000 7f0fe186e640 1 --2- 172.21.15.152:0/3738927004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fdc1082a0 0x7f0fdc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.539+0000 7f0fe186e640 1 --2- 172.21.15.152:0/3738927004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fdc1036e0 0x7f0fdc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.539+0000 7f0fe186e640 1 --2- 172.21.15.152:0/3738927004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fdc102d30 0x7f0fdc103110 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.539+0000 7f0fe186e640 1 -- 172.21.15.152:0/3738927004 >> 172.21.15.152:0/3738927004 conn(0x7f0fdc0fc7d0 msgr2=0x7f0fdc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.539+0000 7f0fe186e640 1 -- 172.21.15.152:0/3738927004 shutdown_connections 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.539+0000 7f0fe186e640 1 -- 172.21.15.152:0/3738927004 wait complete. 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.539+0000 7f0fe186e640 1 Processor -- start 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.539+0000 7f0fe186e640 1 -- start start 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.539+0000 7f0fe186e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fdc102d30 0x7f0fdc1a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fe186e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fdc1036e0 0x7f0fdc1a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fe186e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fdc1082a0 0x7f0fdc19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fe186e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0fdc1120a0 con 0x7f0fdc1082a0 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fe186e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0fdc111f20 con 0x7f0fdc1036e0 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fe186e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0fdc112220 con 0x7f0fdc102d30 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fdb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fdc1082a0 0x7f0fdc19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fdb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fdc1082a0 0x7f0fdc19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59178/0 (socket says 172.21.15.152:59178) 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fdb7fe640 1 -- 172.21.15.152:0/1022820080 learned_addr learned my addr 172.21.15.152:0/1022820080 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fda7fc640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fdc1036e0 0x7f0fdc1a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fdaffd640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fdc102d30 0x7f0fdc1a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fdb7fe640 1 -- 172.21.15.152:0/1022820080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fdc102d30 msgr2=0x7f0fdc1a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fdb7fe640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fdc102d30 0x7f0fdc1a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fdb7fe640 1 -- 172.21.15.152:0/1022820080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fdc1036e0 msgr2=0x7f0fdc1a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fdb7fe640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fdc1036e0 0x7f0fdc1a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fdb7fe640 1 -- 172.21.15.152:0/1022820080 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fdc19ad20 con 0x7f0fdc1082a0 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fdb7fe640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fdc1082a0 0x7f0fdc19a5f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400c970 tx=0x7f0fd400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fe086c640 1 -- 172.21.15.152:0/1022820080 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4007bb0 con 0x7f0fdc1082a0 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fe086c640 1 -- 172.21.15.152:0/1022820080 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fd4007d50 con 0x7f0fdc1082a0 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fe186e640 1 -- 172.21.15.152:0/1022820080 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fdc19b010 con 0x7f0fdc1082a0 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fe086c640 1 -- 172.21.15.152:0/1022820080 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400f450 con 0x7f0fdc1082a0 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.540+0000 7f0fe186e640 1 -- 172.21.15.152:0/1022820080 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fdc1a7300 con 0x7f0fdc1082a0 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.541+0000 7f0fe186e640 1 -- 172.21.15.152:0/1022820080 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fdc06a850 con 0x7f0fdc1082a0 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.542+0000 7f0fe086c640 1 -- 172.21.15.152:0/1022820080 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f0fd4004f20 con 0x7f0fdc1082a0 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.544+0000 7f0fe086c640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0fc80a2e10 0x7f0fc80a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.544+0000 7f0fdaffd640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0fc80a2e10 0x7f0fc80a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.544+0000 7f0fe086c640 1 -- 172.21.15.152:0/1022820080 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f0fd40cf290 con 0x7f0fdc1082a0 2024-09-11T22:04:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.544+0000 7f0fdaffd640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0fc80a2e10 0x7f0fc80a52d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc006010 tx=0x7f0fcc009360 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.548+0000 7f0fe086c640 1 -- 172.21.15.152:0/1022820080 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0fd4014030 con 0x7f0fdc1082a0 2024-09-11T22:04:30.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.711+0000 7f0fe186e640 1 -- 172.21.15.152:0/1022820080 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0fdc10c330 con 0x7f0fc80a2e10 2024-09-11T22:04:30.712 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:30 smithi152 ceph-mon[31188]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:30.712 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:30 smithi152 ceph-mon[31188]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:30.712 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:30 smithi152 ceph-mon[31188]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-09-11T22:04:30.713 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:30 smithi152 ceph-mon[31188]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:30.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.718+0000 7f0fe086c640 1 -- 172.21.15.152:0/1022820080 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257753 (secure 0 0 0) 0x7f0fcc031660 con 0x7f0fc80a2e10 2024-09-11T22:04:30.721 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:30.722 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-09-11T22:04:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 -- 172.21.15.152:0/1022820080 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0fc80a2e10 msgr2=0x7f0fc80a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0fc80a2e10 0x7f0fc80a52d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc006010 tx=0x7f0fcc009360 comp rx=0 tx=0).stop 2024-09-11T22:04:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 -- 172.21.15.152:0/1022820080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fdc1082a0 msgr2=0x7f0fdc19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fdc1082a0 0x7f0fdc19a5f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400c970 tx=0x7f0fd400ce30 comp rx=0 tx=0).stop 2024-09-11T22:04:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 -- 172.21.15.152:0/1022820080 shutdown_connections 2024-09-11T22:04:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0fc80a2e10 0x7f0fc80a52d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fdc1082a0 0x7f0fdc19a5f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fdc1036e0 0x7f0fdc1a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 --2- 172.21.15.152:0/1022820080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fdc102d30 0x7f0fdc1a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 -- 172.21.15.152:0/1022820080 >> 172.21.15.152:0/1022820080 conn(0x7f0fdc0fc7d0 msgr2=0x7f0fdc100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:30.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 -- 172.21.15.152:0/1022820080 shutdown_connections 2024-09-11T22:04:30.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:30.721+0000 7f0fe186e640 1 -- 172.21.15.152:0/1022820080 wait complete. 2024-09-11T22:04:30.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:30 smithi179 ceph-mon[35603]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:30.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:30 smithi179 ceph-mon[35603]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:30.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:30 smithi179 ceph-mon[35603]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-09-11T22:04:30.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:30 smithi179 ceph-mon[35603]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:30 smithi193 ceph-mon[35545]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:30 smithi193 ceph-mon[35545]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:30 smithi193 ceph-mon[35545]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-09-11T22:04:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:30 smithi193 ceph-mon[35545]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:04:31.370 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-11T22:04:29.372346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1388086,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1095,"num_read_kb":917,"num_write":565,"num_write_kb":5036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":925,"ondisk_log_size":925,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368372,"kb_used_data":14880,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124573452,"statfs":{"total":1151940427776,"available":1151563214848,"internally_reserved":0,"allocated":15237120,"data_stored":9191802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":199938,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":348,"num_write":91,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.001031"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414391+0000","last_change":"2024-09-11T22:02:36.105689+0000","last_active":"2024-09-11T22:04:17.414391+0000","last_peered":"2024-09-11T22:04:17.414391+0000","last_clean":"2024-09-11T22:04:17.414391+0000","last_became_active":"2024-09-11T22:02:36.105128+0000","last_became_peered":"2024-09-11T22:02:36.105128+0000","last_unstale":"2024-09-11T22:04:17.414391+0000","last_undegraded":"2024-09-11T22:04:17.414391+0000","last_fullsized":"2024-09-11T22:04:17.414391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:18.018731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.410505+0000","last_change":"2024-09-11T22:02:36.096961+0000","last_active":"2024-09-11T22:04:17.410505+0000","last_peered":"2024-09-11T22:04:17.410505+0000","last_clean":"2024-09-11T22:04:17.410505+0000","last_became_active":"2024-09-11T22:02:36.096540+0000","last_became_peered":"2024-09-11T22:02:36.096540+0000","last_unstale":"2024-09-11T22:04:17.410505+0000","last_undegraded":"2024-09-11T22:04:17.410505+0000","last_fullsized":"2024-09-11T22:04:17.410505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:48.517125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413305+0000","last_change":"2024-09-11T22:02:36.108119+0000","last_active":"2024-09-11T22:04:17.413305+0000","last_peered":"2024-09-11T22:04:17.413305+0000","last_clean":"2024-09-11T22:04:17.413305+0000","last_became_active":"2024-09-11T22:02:36.107737+0000","last_became_peered":"2024-09-11T22:02:36.107737+0000","last_unstale":"2024-09-11T22:04:17.413305+0000","last_undegraded":"2024-09-11T22:04:17.413305+0000","last_fullsized":"2024-09-11T22:04:17.413305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:54.225935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395071+0000","last_change":"2024-09-11T22:02:36.107710+0000","last_active":"2024-09-11T22:04:17.395071+0000","last_peered":"2024-09-11T22:04:17.395071+0000","last_clean":"2024-09-11T22:04:17.395071+0000","last_became_active":"2024-09-11T22:02:36.107327+0000","last_became_peered":"2024-09-11T22:02:36.107327+0000","last_unstale":"2024-09-11T22:04:17.395071+0000","last_undegraded":"2024-09-11T22:04:17.395071+0000","last_fullsized":"2024-09-11T22:04:17.395071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.358535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396846+0000","last_change":"2024-09-11T22:02:36.100531+0000","last_active":"2024-09-11T22:04:17.396846+0000","last_peered":"2024-09-11T22:04:17.396846+0000","last_clean":"2024-09-11T22:04:17.396846+0000","last_became_active":"2024-09-11T22:02:36.100187+0000","last_became_peered":"2024-09-11T22:02:36.100187+0000","last_unstale":"2024-09-11T22:04:17.396846+0000","last_undegraded":"2024-09-11T22:04:17.396846+0000","last_fullsized":"2024-09-11T22:04:17.396846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.156080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397927+0000","last_change":"2024-09-11T22:02:36.101316+0000","last_active":"2024-09-11T22:04:17.397927+0000","last_peered":"2024-09-11T22:04:17.397927+0000","last_clean":"2024-09-11T22:04:17.397927+0000","last_became_active":"2024-09-11T22:02:36.100985+0000","last_became_peered":"2024-09-11T22:02:36.100985+0000","last_unstale":"2024-09-11T22:04:17.397927+0000","last_undegraded":"2024-09-11T22:04:17.397927+0000","last_fullsized":"2024-09-11T22:04:17.397927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:55.972974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.385307+0000","last_change":"2024-09-11T22:02:36.109146+0000","last_active":"2024-09-11T22:04:17.385307+0000","last_peered":"2024-09-11T22:04:17.385307+0000","last_clean":"2024-09-11T22:04:17.385307+0000","last_became_active":"2024-09-11T22:02:36.108817+0000","last_became_peered":"2024-09-11T22:02:36.108817+0000","last_unstale":"2024-09-11T22:04:17.385307+0000","last_undegraded":"2024-09-11T22:04:17.385307+0000","last_fullsized":"2024-09-11T22:04:17.385307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.222383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398948+0000","last_change":"2024-09-11T22:02:36.100362+0000","last_active":"2024-09-11T22:04:17.398948+0000","last_peered":"2024-09-11T22:04:17.398948+0000","last_clean":"2024-09-11T22:04:17.398948+0000","last_became_active":"2024-09-11T22:02:36.100088+0000","last_became_peered":"2024-09-11T22:02:36.100088+0000","last_unstale":"2024-09-11T22:04:17.398948+0000","last_undegraded":"2024-09-11T22:04:17.398948+0000","last_fullsized":"2024-09-11T22:04:17.398948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.478879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401808+0000","last_change":"2024-09-11T22:02:36.106360+0000","last_active":"2024-09-11T22:04:17.401808+0000","last_peered":"2024-09-11T22:04:17.401808+0000","last_clean":"2024-09-11T22:04:17.401808+0000","last_became_active":"2024-09-11T22:02:36.105994+0000","last_became_peered":"2024-09-11T22:02:36.105994+0000","last_unstale":"2024-09-11T22:04:17.401808+0000","last_undegraded":"2024-09-11T22:04:17.401808+0000","last_fullsized":"2024-09-11T22:04:17.401808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:33.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.394089+0000","last_change":"2024-09-11T22:02:36.109477+0000","last_active":"2024-09-11T22:04:17.394089+0000","last_peered":"2024-09-11T22:04:17.394089+0000","last_clean":"2024-09-11T22:04:17.394089+0000","last_became_active":"2024-09-11T22:02:36.109077+0000","last_became_peered":"2024-09-11T22:02:36.109077+0000","last_unstale":"2024-09-11T22:04:17.394089+0000","last_undegraded":"2024-09-11T22:04:17.394089+0000","last_fullsized":"2024-09-11T22:04:17.394089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.862359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399588+0000","last_change":"2024-09-11T22:02:36.112998+0000","last_active":"2024-09-11T22:04:17.399588+0000","last_peered":"2024-09-11T22:04:17.399588+0000","last_clean":"2024-09-11T22:04:17.399588+0000","last_became_active":"2024-09-11T22:02:36.112649+0000","last_became_peered":"2024-09-11T22:02:36.112649+0000","last_unstale":"2024-09-11T22:04:17.399588+0000","last_undegraded":"2024-09-11T22:04:17.399588+0000","last_fullsized":"2024-09-11T22:04:17.399588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:01.582572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398221+0000","last_change":"2024-09-11T22:02:36.099591+0000","last_active":"2024-09-11T22:04:17.398221+0000","last_peered":"2024-09-11T22:04:17.398221+0000","last_clean":"2024-09-11T22:04:17.398221+0000","last_became_active":"2024-09-11T22:02:36.099269+0000","last_became_peered":"2024-09-11T22:02:36.099269+0000","last_unstale":"2024-09-11T22:04:17.398221+0000","last_undegraded":"2024-09-11T22:04:17.398221+0000","last_fullsized":"2024-09-11T22:04:17.398221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:10.918188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403970+0000","last_change":"2024-09-11T22:02:36.100056+0000","last_active":"2024-09-11T22:04:17.403970+0000","last_peered":"2024-09-11T22:04:17.403970+0000","last_clean":"2024-09-11T22:04:17.403970+0000","last_became_active":"2024-09-11T22:02:36.099717+0000","last_became_peered":"2024-09-11T22:02:36.099717+0000","last_unstale":"2024-09-11T22:04:17.403970+0000","last_undegraded":"2024-09-11T22:04:17.403970+0000","last_fullsized":"2024-09-11T22:04:17.403970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.486256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411675+0000","last_change":"2024-09-11T22:02:36.097281+0000","last_active":"2024-09-11T22:04:17.411675+0000","last_peered":"2024-09-11T22:04:17.411675+0000","last_clean":"2024-09-11T22:04:17.411675+0000","last_became_active":"2024-09-11T22:02:36.096768+0000","last_became_peered":"2024-09-11T22:02:36.096768+0000","last_unstale":"2024-09-11T22:04:17.411675+0000","last_undegraded":"2024-09-11T22:04:17.411675+0000","last_fullsized":"2024-09-11T22:04:17.411675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:31.232578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412627+0000","last_change":"2024-09-11T22:02:55.351065+0000","last_active":"2024-09-11T22:04:17.412627+0000","last_peered":"2024-09-11T22:04:17.412627+0000","last_clean":"2024-09-11T22:04:17.412627+0000","last_became_active":"2024-09-11T22:02:55.350669+0000","last_became_peered":"2024-09-11T22:02:55.350669+0000","last_unstale":"2024-09-11T22:04:17.412627+0000","last_undegraded":"2024-09-11T22:04:17.412627+0000","last_fullsized":"2024-09-11T22:04:17.412627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:51.799060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414040+0000","last_change":"2024-09-11T22:02:36.109573+0000","last_active":"2024-09-11T22:04:17.414040+0000","last_peered":"2024-09-11T22:04:17.414040+0000","last_clean":"2024-09-11T22:04:17.414040+0000","last_became_active":"2024-09-11T22:02:36.109019+0000","last_became_peered":"2024-09-11T22:02:36.109019+0000","last_unstale":"2024-09-11T22:04:17.414040+0000","last_undegraded":"2024-09-11T22:04:17.414040+0000","last_fullsized":"2024-09-11T22:04:17.414040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:39.699762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414508+0000","last_change":"2024-09-11T22:02:36.105427+0000","last_active":"2024-09-11T22:04:17.414508+0000","last_peered":"2024-09-11T22:04:17.414508+0000","last_clean":"2024-09-11T22:04:17.414508+0000","last_became_active":"2024-09-11T22:02:36.104712+0000","last_became_peered":"2024-09-11T22:02:36.104712+0000","last_unstale":"2024-09-11T22:04:17.414508+0000","last_undegraded":"2024-09-11T22:04:17.414508+0000","last_fullsized":"2024-09-11T22:04:17.414508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:45.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399613+0000","last_change":"2024-09-11T22:02:36.097925+0000","last_active":"2024-09-11T22:04:17.399613+0000","last_peered":"2024-09-11T22:04:17.399613+0000","last_clean":"2024-09-11T22:04:17.399613+0000","last_became_active":"2024-09-11T22:02:36.097649+0000","last_became_peered":"2024-09-11T22:02:36.097649+0000","last_unstale":"2024-09-11T22:04:17.399613+0000","last_undegraded":"2024-09-11T22:04:17.399613+0000","last_fullsized":"2024-09-11T22:04:17.399613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.272197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400978+0000","last_change":"2024-09-11T22:02:36.107266+0000","last_active":"2024-09-11T22:04:17.400978+0000","last_peered":"2024-09-11T22:04:17.400978+0000","last_clean":"2024-09-11T22:04:17.400978+0000","last_became_active":"2024-09-11T22:02:36.106865+0000","last_became_peered":"2024-09-11T22:02:36.106865+0000","last_unstale":"2024-09-11T22:04:17.400978+0000","last_undegraded":"2024-09-11T22:04:17.400978+0000","last_fullsized":"2024-09-11T22:04:17.400978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:53.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396320+0000","last_change":"2024-09-11T22:02:55.349854+0000","last_active":"2024-09-11T22:04:17.396320+0000","last_peered":"2024-09-11T22:04:17.396320+0000","last_clean":"2024-09-11T22:04:17.396320+0000","last_became_active":"2024-09-11T22:02:55.349521+0000","last_became_peered":"2024-09-11T22:02:55.349521+0000","last_unstale":"2024-09-11T22:04:17.396320+0000","last_undegraded":"2024-09-11T22:04:17.396320+0000","last_fullsized":"2024-09-11T22:04:17.396320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406936+0000","last_change":"2024-09-11T22:02:36.110460+0000","last_active":"2024-09-11T22:04:17.406936+0000","last_peered":"2024-09-11T22:04:17.406936+0000","last_clean":"2024-09-11T22:04:17.406936+0000","last_became_active":"2024-09-11T22:02:36.110136+0000","last_became_peered":"2024-09-11T22:02:36.110136+0000","last_unstale":"2024-09-11T22:04:17.406936+0000","last_undegraded":"2024-09-11T22:04:17.406936+0000","last_fullsized":"2024-09-11T22:04:17.406936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:30.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403836+0000","last_change":"2024-09-11T22:02:36.111403+0000","last_active":"2024-09-11T22:04:17.403836+0000","last_peered":"2024-09-11T22:04:17.403836+0000","last_clean":"2024-09-11T22:04:17.403836+0000","last_became_active":"2024-09-11T22:02:36.110976+0000","last_became_peered":"2024-09-11T22:02:36.110976+0000","last_unstale":"2024-09-11T22:04:17.403836+0000","last_undegraded":"2024-09-11T22:04:17.403836+0000","last_fullsized":"2024-09-11T22:04:17.403836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:03.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.405071+0000","last_change":"2024-09-11T22:02:36.110002+0000","last_active":"2024-09-11T22:04:17.405071+0000","last_peered":"2024-09-11T22:04:17.405071+0000","last_clean":"2024-09-11T22:04:17.405071+0000","last_became_active":"2024-09-11T22:02:36.109694+0000","last_became_peered":"2024-09-11T22:02:36.109694+0000","last_unstale":"2024-09-11T22:04:17.405071+0000","last_undegraded":"2024-09-11T22:04:17.405071+0000","last_fullsized":"2024-09-11T22:04:17.405071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:00.338509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406553+0000","last_change":"2024-09-11T22:02:36.101638+0000","last_active":"2024-09-11T22:04:17.406553+0000","last_peered":"2024-09-11T22:04:17.406553+0000","last_clean":"2024-09-11T22:04:17.406553+0000","last_became_active":"2024-09-11T22:02:36.101363+0000","last_became_peered":"2024-09-11T22:02:36.101363+0000","last_unstale":"2024-09-11T22:04:17.406553+0000","last_undegraded":"2024-09-11T22:04:17.406553+0000","last_fullsized":"2024-09-11T22:04:17.406553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:35.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399143+0000","last_change":"2024-09-11T22:02:36.109250+0000","last_active":"2024-09-11T22:04:17.399143+0000","last_peered":"2024-09-11T22:04:17.399143+0000","last_clean":"2024-09-11T22:04:17.399143+0000","last_became_active":"2024-09-11T22:02:36.108931+0000","last_became_peered":"2024-09-11T22:02:36.108931+0000","last_unstale":"2024-09-11T22:04:17.399143+0000","last_undegraded":"2024-09-11T22:04:17.399143+0000","last_fullsized":"2024-09-11T22:04:17.399143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:09.616621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400102+0000","last_change":"2024-09-11T22:02:36.113064+0000","last_active":"2024-09-11T22:04:17.400102+0000","last_peered":"2024-09-11T22:04:17.400102+0000","last_clean":"2024-09-11T22:04:17.400102+0000","last_became_active":"2024-09-11T22:02:36.112674+0000","last_became_peered":"2024-09-11T22:02:36.112674+0000","last_unstale":"2024-09-11T22:04:17.400102+0000","last_undegraded":"2024-09-11T22:04:17.400102+0000","last_fullsized":"2024-09-11T22:04:17.400102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:17.923053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395397+0000","last_change":"2024-09-11T22:02:36.101799+0000","last_active":"2024-09-11T22:04:17.395397+0000","last_peered":"2024-09-11T22:04:17.395397+0000","last_clean":"2024-09-11T22:04:17.395397+0000","last_became_active":"2024-09-11T22:02:36.101429+0000","last_became_peered":"2024-09-11T22:02:36.101429+0000","last_unstale":"2024-09-11T22:04:17.395397+0000","last_undegraded":"2024-09-11T22:04:17.395397+0000","last_fullsized":"2024-09-11T22:04:17.395397+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.597619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402304+0000","last_change":"2024-09-11T22:02:36.100993+0000","last_active":"2024-09-11T22:04:17.402304+0000","last_peered":"2024-09-11T22:04:17.402304+0000","last_clean":"2024-09-11T22:04:17.402304+0000","last_became_active":"2024-09-11T22:02:36.100678+0000","last_became_peered":"2024-09-11T22:02:36.100678+0000","last_unstale":"2024-09-11T22:04:17.402304+0000","last_undegraded":"2024-09-11T22:04:17.402304+0000","last_fullsized":"2024-09-11T22:04:17.402304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:18.808422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.408677+0000","last_change":"2024-09-11T22:02:36.103507+0000","last_active":"2024-09-11T22:04:17.408677+0000","last_peered":"2024-09-11T22:04:17.408677+0000","last_clean":"2024-09-11T22:04:17.408677+0000","last_became_active":"2024-09-11T22:02:36.103228+0000","last_became_peered":"2024-09-11T22:02:36.103228+0000","last_unstale":"2024-09-11T22:04:17.408677+0000","last_undegraded":"2024-09-11T22:04:17.408677+0000","last_fullsized":"2024-09-11T22:04:17.408677+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.898635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413675+0000","last_change":"2024-09-11T22:02:36.104734+0000","last_active":"2024-09-11T22:04:17.413675+0000","last_peered":"2024-09-11T22:04:17.413675+0000","last_clean":"2024-09-11T22:04:17.413675+0000","last_became_active":"2024-09-11T22:02:36.103974+0000","last_became_peered":"2024-09-11T22:02:36.103974+0000","last_unstale":"2024-09-11T22:04:17.413675+0000","last_undegraded":"2024-09-11T22:04:17.413675+0000","last_fullsized":"2024-09-11T22:04:17.413675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:54.142031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397564+0000","last_change":"2024-09-11T22:02:36.106103+0000","last_active":"2024-09-11T22:04:17.397564+0000","last_peered":"2024-09-11T22:04:17.397564+0000","last_clean":"2024-09-11T22:04:17.397564+0000","last_became_active":"2024-09-11T22:02:36.105792+0000","last_became_peered":"2024-09-11T22:02:36.105792+0000","last_unstale":"2024-09-11T22:04:17.397564+0000","last_undegraded":"2024-09-11T22:04:17.397564+0000","last_fullsized":"2024-09-11T22:04:17.397564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:06.607094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397456+0000","last_change":"2024-09-11T22:02:36.104147+0000","last_active":"2024-09-11T22:04:17.397456+0000","last_peered":"2024-09-11T22:04:17.397456+0000","last_clean":"2024-09-11T22:04:17.397456+0000","last_became_active":"2024-09-11T22:02:36.103782+0000","last_became_peered":"2024-09-11T22:02:36.103782+0000","last_unstale":"2024-09-11T22:04:17.397456+0000","last_undegraded":"2024-09-11T22:04:17.397456+0000","last_fullsized":"2024-09-11T22:04:17.397456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.127609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.392542+0000","last_change":"2024-09-11T22:02:36.101259+0000","last_active":"2024-09-11T22:04:17.392542+0000","last_peered":"2024-09-11T22:04:17.392542+0000","last_clean":"2024-09-11T22:04:17.392542+0000","last_became_active":"2024-09-11T22:02:36.100761+0000","last_became_peered":"2024-09-11T22:02:36.100761+0000","last_unstale":"2024-09-11T22:04:17.392542+0000","last_undegraded":"2024-09-11T22:04:17.392542+0000","last_fullsized":"2024-09-11T22:04:17.392542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:47.045252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:26.985511+0000","last_change":"2024-09-11T22:02:34.084522+0000","last_active":"2024-09-11T22:04:26.985511+0000","last_peered":"2024-09-11T22:04:26.985511+0000","last_clean":"2024-09-11T22:04:26.985511+0000","last_became_active":"2024-09-11T22:02:34.084211+0000","last_became_peered":"2024-09-11T22:02:34.084211+0000","last_unstale":"2024-09-11T22:04:26.985511+0000","last_undegraded":"2024-09-11T22:04:26.985511+0000","last_fullsized":"2024-09-11T22:04:26.985511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:18.963998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406451+0000","last_change":"2024-09-11T22:02:36.106890+0000","last_active":"2024-09-11T22:04:17.406451+0000","last_peered":"2024-09-11T22:04:17.406451+0000","last_clean":"2024-09-11T22:04:17.406451+0000","last_became_active":"2024-09-11T22:02:36.105255+0000","last_became_peered":"2024-09-11T22:02:36.105255+0000","last_unstale":"2024-09-11T22:04:17.406451+0000","last_undegraded":"2024-09-11T22:04:17.406451+0000","last_fullsized":"2024-09-11T22:04:17.406451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.995542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.355903+0000","last_change":"2024-09-11T22:02:34.079967+0000","last_active":"2024-09-11T22:04:17.355903+0000","last_peered":"2024-09-11T22:04:17.355903+0000","last_clean":"2024-09-11T22:04:17.355903+0000","last_became_active":"2024-09-11T22:02:34.079649+0000","last_became_peered":"2024-09-11T22:02:34.079649+0000","last_unstale":"2024-09-11T22:04:17.355903+0000","last_undegraded":"2024-09-11T22:04:17.355903+0000","last_fullsized":"2024-09-11T22:04:17.355903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.661256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.351613+0000","last_change":"2024-09-11T22:02:34.079850+0000","last_active":"2024-09-11T22:04:17.351613+0000","last_peered":"2024-09-11T22:04:17.351613+0000","last_clean":"2024-09-11T22:04:17.351613+0000","last_became_active":"2024-09-11T22:02:34.079514+0000","last_became_peered":"2024-09-11T22:02:34.079514+0000","last_unstale":"2024-09-11T22:04:17.351613+0000","last_undegraded":"2024-09-11T22:04:17.351613+0000","last_fullsized":"2024-09-11T22:04:17.351613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.359482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407046+0000","last_change":"2024-09-11T22:02:36.099310+0000","last_active":"2024-09-11T22:04:17.407046+0000","last_peered":"2024-09-11T22:04:17.407046+0000","last_clean":"2024-09-11T22:04:17.407046+0000","last_became_active":"2024-09-11T22:02:36.099026+0000","last_became_peered":"2024-09-11T22:02:36.099026+0000","last_unstale":"2024-09-11T22:04:17.407046+0000","last_undegraded":"2024-09-11T22:04:17.407046+0000","last_fullsized":"2024-09-11T22:04:17.407046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:57.570147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358629+0000","last_change":"2024-09-11T22:02:34.083757+0000","last_active":"2024-09-11T22:04:17.358629+0000","last_peered":"2024-09-11T22:04:17.358629+0000","last_clean":"2024-09-11T22:04:17.358629+0000","last_became_active":"2024-09-11T22:02:34.083467+0000","last_became_peered":"2024-09-11T22:02:34.083467+0000","last_unstale":"2024-09-11T22:04:17.358629+0000","last_undegraded":"2024-09-11T22:04:17.358629+0000","last_fullsized":"2024-09-11T22:04:17.358629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.546772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407844+0000","last_change":"2024-09-11T22:02:36.098939+0000","last_active":"2024-09-11T22:04:17.407844+0000","last_peered":"2024-09-11T22:04:17.407844+0000","last_clean":"2024-09-11T22:04:17.407844+0000","last_became_active":"2024-09-11T22:02:36.098631+0000","last_became_peered":"2024-09-11T22:02:36.098631+0000","last_unstale":"2024-09-11T22:04:17.407844+0000","last_undegraded":"2024-09-11T22:04:17.407844+0000","last_fullsized":"2024-09-11T22:04:17.407844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:07.663332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":131,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:26.984926+0000","last_change":"2024-09-11T22:02:34.085325+0000","last_active":"2024-09-11T22:04:26.984926+0000","last_peered":"2024-09-11T22:04:26.984926+0000","last_clean":"2024-09-11T22:04:26.984926+0000","last_became_active":"2024-09-11T22:02:34.084967+0000","last_became_peered":"2024-09-11T22:02:34.084967+0000","last_unstale":"2024-09-11T22:04:26.984926+0000","last_undegraded":"2024-09-11T22:04:26.984926+0000","last_fullsized":"2024-09-11T22:04:26.984926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:35.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396449+0000","last_change":"2024-09-11T22:02:36.104454+0000","last_active":"2024-09-11T22:04:17.396449+0000","last_peered":"2024-09-11T22:04:17.396449+0000","last_clean":"2024-09-11T22:04:17.396449+0000","last_became_active":"2024-09-11T22:02:36.103988+0000","last_became_peered":"2024-09-11T22:02:36.103988+0000","last_unstale":"2024-09-11T22:04:17.396449+0000","last_undegraded":"2024-09-11T22:04:17.396449+0000","last_fullsized":"2024-09-11T22:04:17.396449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:32.748524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362192+0000","last_change":"2024-09-11T22:02:55.548642+0000","last_active":"2024-09-11T22:04:17.362192+0000","last_peered":"2024-09-11T22:04:17.362192+0000","last_clean":"2024-09-11T22:04:17.362192+0000","last_became_active":"2024-09-11T22:02:55.545771+0000","last_became_peered":"2024-09-11T22:02:55.545771+0000","last_unstale":"2024-09-11T22:04:17.362192+0000","last_undegraded":"2024-09-11T22:04:17.362192+0000","last_fullsized":"2024-09-11T22:04:17.362192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:03.431986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411866+0000","last_change":"2024-09-11T22:02:55.349125+0000","last_active":"2024-09-11T22:04:17.411866+0000","last_peered":"2024-09-11T22:04:17.411866+0000","last_clean":"2024-09-11T22:04:17.411866+0000","last_became_active":"2024-09-11T22:02:55.348746+0000","last_became_peered":"2024-09-11T22:02:55.348746+0000","last_unstale":"2024-09-11T22:04:17.411866+0000","last_undegraded":"2024-09-11T22:04:17.411866+0000","last_fullsized":"2024-09-11T22:04:17.411866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358974+0000","last_change":"2024-09-11T22:02:34.089793+0000","last_active":"2024-09-11T22:04:17.358974+0000","last_peered":"2024-09-11T22:04:17.358974+0000","last_clean":"2024-09-11T22:04:17.358974+0000","last_became_active":"2024-09-11T22:02:34.089468+0000","last_became_peered":"2024-09-11T22:02:34.089468+0000","last_unstale":"2024-09-11T22:04:17.358974+0000","last_undegraded":"2024-09-11T22:04:17.358974+0000","last_fullsized":"2024-09-11T22:04:17.358974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:10:21.034822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401964+0000","last_change":"2024-09-11T22:02:36.106224+0000","last_active":"2024-09-11T22:04:17.401964+0000","last_peered":"2024-09-11T22:04:17.401964+0000","last_clean":"2024-09-11T22:04:17.401964+0000","last_became_active":"2024-09-11T22:02:36.105903+0000","last_became_peered":"2024-09-11T22:02:36.105903+0000","last_unstale":"2024-09-11T22:04:17.401964+0000","last_undegraded":"2024-09-11T22:04:17.401964+0000","last_fullsized":"2024-09-11T22:04:17.401964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.354653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'36","reported_seq":280,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:27.988592+0000","last_change":"2024-09-11T22:02:34.082150+0000","last_active":"2024-09-11T22:04:27.988592+0000","last_peered":"2024-09-11T22:04:27.988592+0000","last_clean":"2024-09-11T22:04:27.988592+0000","last_became_active":"2024-09-11T22:02:34.081822+0000","last_became_peered":"2024-09-11T22:02:34.081822+0000","last_unstale":"2024-09-11T22:04:27.988592+0000","last_undegraded":"2024-09-11T22:04:27.988592+0000","last_fullsized":"2024-09-11T22:04:27.988592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:39.320410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69393,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":178,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.386796+0000","last_change":"2024-09-11T22:02:36.112124+0000","last_active":"2024-09-11T22:04:17.386796+0000","last_peered":"2024-09-11T22:04:17.386796+0000","last_clean":"2024-09-11T22:04:17.386796+0000","last_became_active":"2024-09-11T22:02:36.111739+0000","last_became_peered":"2024-09-11T22:02:36.111739+0000","last_unstale":"2024-09-11T22:04:17.386796+0000","last_undegraded":"2024-09-11T22:04:17.386796+0000","last_fullsized":"2024-09-11T22:04:17.386796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:52.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352659+0000","last_change":"2024-09-11T22:02:34.083047+0000","last_active":"2024-09-11T22:04:17.352659+0000","last_peered":"2024-09-11T22:04:17.352659+0000","last_clean":"2024-09-11T22:04:17.352659+0000","last_became_active":"2024-09-11T22:02:34.082406+0000","last_became_peered":"2024-09-11T22:02:34.082406+0000","last_unstale":"2024-09-11T22:04:17.352659+0000","last_undegraded":"2024-09-11T22:04:17.352659+0000","last_fullsized":"2024-09-11T22:04:17.352659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:33.249337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407254+0000","last_change":"2024-09-11T22:02:36.108859+0000","last_active":"2024-09-11T22:04:17.407254+0000","last_peered":"2024-09-11T22:04:17.407254+0000","last_clean":"2024-09-11T22:04:17.407254+0000","last_became_active":"2024-09-11T22:02:36.108558+0000","last_became_peered":"2024-09-11T22:02:36.108558+0000","last_unstale":"2024-09-11T22:04:17.407254+0000","last_undegraded":"2024-09-11T22:04:17.407254+0000","last_fullsized":"2024-09-11T22:04:17.407254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.430672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358635+0000","last_change":"2024-09-11T22:02:34.080560+0000","last_active":"2024-09-11T22:04:17.358635+0000","last_peered":"2024-09-11T22:04:17.358635+0000","last_clean":"2024-09-11T22:04:17.358635+0000","last_became_active":"2024-09-11T22:02:34.080262+0000","last_became_peered":"2024-09-11T22:02:34.080262+0000","last_unstale":"2024-09-11T22:04:17.358635+0000","last_undegraded":"2024-09-11T22:04:17.358635+0000","last_fullsized":"2024-09-11T22:04:17.358635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:44.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403367+0000","last_change":"2024-09-11T22:02:36.107722+0000","last_active":"2024-09-11T22:04:17.403367+0000","last_peered":"2024-09-11T22:04:17.403367+0000","last_clean":"2024-09-11T22:04:17.403367+0000","last_became_active":"2024-09-11T22:02:36.107219+0000","last_became_peered":"2024-09-11T22:02:36.107219+0000","last_unstale":"2024-09-11T22:04:17.403367+0000","last_undegraded":"2024-09-11T22:04:17.403367+0000","last_fullsized":"2024-09-11T22:04:17.403367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.576045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'8","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:26.984919+0000","last_change":"2024-09-11T22:02:34.083573+0000","last_active":"2024-09-11T22:04:26.984919+0000","last_peered":"2024-09-11T22:04:26.984919+0000","last_clean":"2024-09-11T22:04:26.984919+0000","last_became_active":"2024-09-11T22:02:34.083277+0000","last_became_peered":"2024-09-11T22:02:34.083277+0000","last_unstale":"2024-09-11T22:04:26.984919+0000","last_undegraded":"2024-09-11T22:04:26.984919+0000","last_fullsized":"2024-09-11T22:04:26.984919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:31.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2301,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":6,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.382984+0000","last_change":"2024-09-11T22:02:36.105075+0000","last_active":"2024-09-11T22:04:17.382984+0000","last_peered":"2024-09-11T22:04:17.382984+0000","last_clean":"2024-09-11T22:04:17.382984+0000","last_became_active":"2024-09-11T22:02:36.104022+0000","last_became_peered":"2024-09-11T22:02:36.104022+0000","last_unstale":"2024-09-11T22:04:17.382984+0000","last_undegraded":"2024-09-11T22:04:17.382984+0000","last_fullsized":"2024-09-11T22:04:17.382984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.693146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.366650+0000","last_change":"2024-09-11T22:02:34.088727+0000","last_active":"2024-09-11T22:04:17.366650+0000","last_peered":"2024-09-11T22:04:17.366650+0000","last_clean":"2024-09-11T22:04:17.366650+0000","last_became_active":"2024-09-11T22:02:34.088394+0000","last_became_peered":"2024-09-11T22:02:34.088394+0000","last_unstale":"2024-09-11T22:04:17.366650+0000","last_undegraded":"2024-09-11T22:04:17.366650+0000","last_fullsized":"2024-09-11T22:04:17.366650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:11.809765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399053+0000","last_change":"2024-09-11T22:02:36.104522+0000","last_active":"2024-09-11T22:04:17.399053+0000","last_peered":"2024-09-11T22:04:17.399053+0000","last_clean":"2024-09-11T22:04:17.399053+0000","last_became_active":"2024-09-11T22:02:36.104181+0000","last_became_peered":"2024-09-11T22:02:36.104181+0000","last_unstale":"2024-09-11T22:04:17.399053+0000","last_undegraded":"2024-09-11T22:04:17.399053+0000","last_fullsized":"2024-09-11T22:04:17.399053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:08.139180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368106+0000","last_change":"2024-09-11T22:02:34.080341+0000","last_active":"2024-09-11T22:04:17.368106+0000","last_peered":"2024-09-11T22:04:17.368106+0000","last_clean":"2024-09-11T22:04:17.368106+0000","last_became_active":"2024-09-11T22:02:34.078761+0000","last_became_peered":"2024-09-11T22:02:34.078761+0000","last_unstale":"2024-09-11T22:04:17.368106+0000","last_undegraded":"2024-09-11T22:04:17.368106+0000","last_fullsized":"2024-09-11T22:04:17.368106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393697+0000","last_change":"2024-09-11T22:02:55.545135+0000","last_active":"2024-09-11T22:04:17.393697+0000","last_peered":"2024-09-11T22:04:17.393697+0000","last_clean":"2024-09-11T22:04:17.393697+0000","last_became_active":"2024-09-11T22:02:55.544785+0000","last_became_peered":"2024-09-11T22:02:55.544785+0000","last_unstale":"2024-09-11T22:04:17.393697+0000","last_undegraded":"2024-09-11T22:04:17.393697+0000","last_fullsized":"2024-09-11T22:04:17.393697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:05.815828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352013+0000","last_change":"2024-09-11T22:02:34.082364+0000","last_active":"2024-09-11T22:04:17.352013+0000","last_peered":"2024-09-11T22:04:17.352013+0000","last_clean":"2024-09-11T22:04:17.352013+0000","last_became_active":"2024-09-11T22:02:34.081906+0000","last_became_peered":"2024-09-11T22:02:34.081906+0000","last_unstale":"2024-09-11T22:04:17.352013+0000","last_undegraded":"2024-09-11T22:04:17.352013+0000","last_fullsized":"2024-09-11T22:04:17.352013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:58.603942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.390768+0000","last_change":"2024-09-11T22:02:36.110725+0000","last_active":"2024-09-11T22:04:17.390768+0000","last_peered":"2024-09-11T22:04:17.390768+0000","last_clean":"2024-09-11T22:04:17.390768+0000","last_became_active":"2024-09-11T22:02:36.110401+0000","last_became_peered":"2024-09-11T22:02:36.110401+0000","last_unstale":"2024-09-11T22:04:17.390768+0000","last_undegraded":"2024-09-11T22:04:17.390768+0000","last_fullsized":"2024-09-11T22:04:17.390768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:41.789134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'57","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:28.314091+0000","last_change":"2024-09-11T22:02:34.082983+0000","last_active":"2024-09-11T22:04:28.314091+0000","last_peered":"2024-09-11T22:04:28.314091+0000","last_clean":"2024-09-11T22:04:28.314091+0000","last_became_active":"2024-09-11T22:02:34.082618+0000","last_became_peered":"2024-09-11T22:02:34.082618+0000","last_unstale":"2024-09-11T22:04:28.314091+0000","last_undegraded":"2024-09-11T22:04:28.314091+0000","last_fullsized":"2024-09-11T22:04:28.314091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.481228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":68,"num_write_kb":807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393689+0000","last_change":"2024-09-11T22:02:36.108222+0000","last_active":"2024-09-11T22:04:17.393689+0000","last_peered":"2024-09-11T22:04:17.393689+0000","last_clean":"2024-09-11T22:04:17.393689+0000","last_became_active":"2024-09-11T22:02:36.107739+0000","last_became_peered":"2024-09-11T22:02:36.107739+0000","last_unstale":"2024-09-11T22:04:17.393689+0000","last_undegraded":"2024-09-11T22:04:17.393689+0000","last_fullsized":"2024-09-11T22:04:17.393689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:11.353217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352780+0000","last_change":"2024-09-11T22:02:34.090068+0000","last_active":"2024-09-11T22:04:17.352780+0000","last_peered":"2024-09-11T22:04:17.352780+0000","last_clean":"2024-09-11T22:04:17.352780+0000","last_became_active":"2024-09-11T22:02:34.089735+0000","last_became_peered":"2024-09-11T22:02:34.089735+0000","last_unstale":"2024-09-11T22:04:17.352780+0000","last_undegraded":"2024-09-11T22:04:17.352780+0000","last_fullsized":"2024-09-11T22:04:17.352780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:32.917459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401828+0000","last_change":"2024-09-11T22:02:36.108017+0000","last_active":"2024-09-11T22:04:17.401828+0000","last_peered":"2024-09-11T22:04:17.401828+0000","last_clean":"2024-09-11T22:04:17.401828+0000","last_became_active":"2024-09-11T22:02:36.107339+0000","last_became_peered":"2024-09-11T22:02:36.107339+0000","last_unstale":"2024-09-11T22:04:17.401828+0000","last_undegraded":"2024-09-11T22:04:17.401828+0000","last_fullsized":"2024-09-11T22:04:17.401828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:19.240354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"85'148","reported_seq":391,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:19.483724+0000","last_change":"2024-09-11T22:01:28.522567+0000","last_active":"2024-09-11T22:04:19.483724+0000","last_peered":"2024-09-11T22:04:19.483724+0000","last_clean":"2024-09-11T22:04:19.483724+0000","last_became_active":"2024-09-11T22:01:28.522079+0000","last_became_peered":"2024-09-11T22:01:28.522079+0000","last_unstale":"2024-09-11T22:04:19.483724+0000","last_undegraded":"2024-09-11T22:04:19.483724+0000","last_fullsized":"2024-09-11T22:04:19.483724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_clean_scrub_stamp":"2024-09-11T21:58:11.245706+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:48.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365565+0000","last_change":"2024-09-11T22:02:34.080535+0000","last_active":"2024-09-11T22:04:17.365565+0000","last_peered":"2024-09-11T22:04:17.365565+0000","last_clean":"2024-09-11T22:04:17.365565+0000","last_became_active":"2024-09-11T22:02:34.079351+0000","last_became_peered":"2024-09-11T22:02:34.079351+0000","last_unstale":"2024-09-11T22:04:17.365565+0000","last_undegraded":"2024-09-11T22:04:17.365565+0000","last_fullsized":"2024-09-11T22:04:17.365565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:29.737198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400866+0000","last_change":"2024-09-11T22:02:36.104476+0000","last_active":"2024-09-11T22:04:17.400866+0000","last_peered":"2024-09-11T22:04:17.400866+0000","last_clean":"2024-09-11T22:04:17.400866+0000","last_became_active":"2024-09-11T22:02:36.104163+0000","last_became_peered":"2024-09-11T22:02:36.104163+0000","last_unstale":"2024-09-11T22:04:17.400866+0000","last_undegraded":"2024-09-11T22:04:17.400866+0000","last_fullsized":"2024-09-11T22:04:17.400866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.570125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362393+0000","last_change":"2024-09-11T22:02:34.079652+0000","last_active":"2024-09-11T22:04:17.362393+0000","last_peered":"2024-09-11T22:04:17.362393+0000","last_clean":"2024-09-11T22:04:17.362393+0000","last_became_active":"2024-09-11T22:02:34.079365+0000","last_became_peered":"2024-09-11T22:02:34.079365+0000","last_unstale":"2024-09-11T22:04:17.362393+0000","last_undegraded":"2024-09-11T22:04:17.362393+0000","last_fullsized":"2024-09-11T22:04:17.362393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:15.371852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399253+0000","last_change":"2024-09-11T22:02:36.107209+0000","last_active":"2024-09-11T22:04:17.399253+0000","last_peered":"2024-09-11T22:04:17.399253+0000","last_clean":"2024-09-11T22:04:17.399253+0000","last_became_active":"2024-09-11T22:02:36.106896+0000","last_became_peered":"2024-09-11T22:02:36.106896+0000","last_unstale":"2024-09-11T22:04:17.399253+0000","last_undegraded":"2024-09-11T22:04:17.399253+0000","last_fullsized":"2024-09-11T22:04:17.399253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:04.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:26.984181+0000","last_change":"2024-09-11T22:02:34.088531+0000","last_active":"2024-09-11T22:04:26.984181+0000","last_peered":"2024-09-11T22:04:26.984181+0000","last_clean":"2024-09-11T22:04:26.984181+0000","last_became_active":"2024-09-11T22:02:34.088252+0000","last_became_peered":"2024-09-11T22:02:34.088252+0000","last_unstale":"2024-09-11T22:04:26.984181+0000","last_undegraded":"2024-09-11T22:04:26.984181+0000","last_fullsized":"2024-09-11T22:04:26.984181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:43.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.389359+0000","last_change":"2024-09-11T22:02:36.108963+0000","last_active":"2024-09-11T22:04:17.389359+0000","last_peered":"2024-09-11T22:04:17.389359+0000","last_clean":"2024-09-11T22:04:17.389359+0000","last_became_active":"2024-09-11T22:02:36.108435+0000","last_became_peered":"2024-09-11T22:02:36.108435+0000","last_unstale":"2024-09-11T22:04:17.389359+0000","last_undegraded":"2024-09-11T22:04:17.389359+0000","last_fullsized":"2024-09-11T22:04:17.389359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:11.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.361831+0000","last_change":"2024-09-11T22:02:34.084283+0000","last_active":"2024-09-11T22:04:17.361831+0000","last_peered":"2024-09-11T22:04:17.361831+0000","last_clean":"2024-09-11T22:04:17.361831+0000","last_became_active":"2024-09-11T22:02:34.083948+0000","last_became_peered":"2024-09-11T22:02:34.083948+0000","last_unstale":"2024-09-11T22:04:17.361831+0000","last_undegraded":"2024-09-11T22:04:17.361831+0000","last_fullsized":"2024-09-11T22:04:17.361831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:48.763643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.391536+0000","last_change":"2024-09-11T22:02:36.102147+0000","last_active":"2024-09-11T22:04:17.391536+0000","last_peered":"2024-09-11T22:04:17.391536+0000","last_clean":"2024-09-11T22:04:17.391536+0000","last_became_active":"2024-09-11T22:02:36.101641+0000","last_became_peered":"2024-09-11T22:02:36.101641+0000","last_unstale":"2024-09-11T22:04:17.391536+0000","last_undegraded":"2024-09-11T22:04:17.391536+0000","last_fullsized":"2024-09-11T22:04:17.391536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:58.145304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358234+0000","last_change":"2024-09-11T22:02:34.090538+0000","last_active":"2024-09-11T22:04:17.358234+0000","last_peered":"2024-09-11T22:04:17.358234+0000","last_clean":"2024-09-11T22:04:17.358234+0000","last_became_active":"2024-09-11T22:02:34.090238+0000","last_became_peered":"2024-09-11T22:02:34.090238+0000","last_unstale":"2024-09-11T22:04:17.358234+0000","last_undegraded":"2024-09-11T22:04:17.358234+0000","last_fullsized":"2024-09-11T22:04:17.358234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:47.037999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397510+0000","last_change":"2024-09-11T22:02:36.095664+0000","last_active":"2024-09-11T22:04:17.397510+0000","last_peered":"2024-09-11T22:04:17.397510+0000","last_clean":"2024-09-11T22:04:17.397510+0000","last_became_active":"2024-09-11T22:02:36.095304+0000","last_became_peered":"2024-09-11T22:02:36.095304+0000","last_unstale":"2024-09-11T22:04:17.397510+0000","last_undegraded":"2024-09-11T22:04:17.397510+0000","last_fullsized":"2024-09-11T22:04:17.397510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.484809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368818+0000","last_change":"2024-09-11T22:02:34.089781+0000","last_active":"2024-09-11T22:04:17.368818+0000","last_peered":"2024-09-11T22:04:17.368818+0000","last_clean":"2024-09-11T22:04:17.368818+0000","last_became_active":"2024-09-11T22:02:34.089439+0000","last_became_peered":"2024-09-11T22:02:34.089439+0000","last_unstale":"2024-09-11T22:04:17.368818+0000","last_undegraded":"2024-09-11T22:04:17.368818+0000","last_fullsized":"2024-09-11T22:04:17.368818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:38.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400049+0000","last_change":"2024-09-11T22:02:36.107159+0000","last_active":"2024-09-11T22:04:17.400049+0000","last_peered":"2024-09-11T22:04:17.400049+0000","last_clean":"2024-09-11T22:04:17.400049+0000","last_became_active":"2024-09-11T22:02:36.106846+0000","last_became_peered":"2024-09-11T22:02:36.106846+0000","last_unstale":"2024-09-11T22:04:17.400049+0000","last_undegraded":"2024-09-11T22:04:17.400049+0000","last_fullsized":"2024-09-11T22:04:17.400049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.972944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'72","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:28.318602+0000","last_change":"2024-09-11T22:02:55.352887+0000","last_active":"2024-09-11T22:04:28.318602+0000","last_peered":"2024-09-11T22:04:28.318602+0000","last_clean":"2024-09-11T22:04:28.318602+0000","last_became_active":"2024-09-11T22:02:55.348619+0000","last_became_peered":"2024-09-11T22:02:55.348619+0000","last_unstale":"2024-09-11T22:04:28.318602+0000","last_undegraded":"2024-09-11T22:04:28.318602+0000","last_fullsized":"2024-09-11T22:04:28.318602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:51.259114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":160,"num_write":131,"num_write_kb":1159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399780+0000","last_change":"2024-09-11T22:02:36.108560+0000","last_active":"2024-09-11T22:04:17.399780+0000","last_peered":"2024-09-11T22:04:17.399780+0000","last_clean":"2024-09-11T22:04:17.399780+0000","last_became_active":"2024-09-11T22:02:36.107593+0000","last_became_peered":"2024-09-11T22:02:36.107593+0000","last_unstale":"2024-09-11T22:04:17.399780+0000","last_undegraded":"2024-09-11T22:04:17.399780+0000","last_fullsized":"2024-09-11T22:04:17.399780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.479991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365257+0000","last_change":"2024-09-11T22:02:34.087394+0000","last_active":"2024-09-11T22:04:17.365257+0000","last_peered":"2024-09-11T22:04:17.365257+0000","last_clean":"2024-09-11T22:04:17.365257+0000","last_became_active":"2024-09-11T22:02:34.087146+0000","last_became_peered":"2024-09-11T22:02:34.087146+0000","last_unstale":"2024-09-11T22:04:17.365257+0000","last_undegraded":"2024-09-11T22:04:17.365257+0000","last_fullsized":"2024-09-11T22:04:17.365257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:30.772437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412826+0000","last_change":"2024-09-11T22:02:55.545065+0000","last_active":"2024-09-11T22:04:17.412826+0000","last_peered":"2024-09-11T22:04:17.412826+0000","last_clean":"2024-09-11T22:04:17.412826+0000","last_became_active":"2024-09-11T22:02:55.544736+0000","last_became_peered":"2024-09-11T22:02:55.544736+0000","last_unstale":"2024-09-11T22:04:17.412826+0000","last_undegraded":"2024-09-11T22:04:17.412826+0000","last_fullsized":"2024-09-11T22:04:17.412826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:23.706253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358626+0000","last_change":"2024-09-11T22:02:34.088717+0000","last_active":"2024-09-11T22:04:17.358626+0000","last_peered":"2024-09-11T22:04:17.358626+0000","last_clean":"2024-09-11T22:04:17.358626+0000","last_became_active":"2024-09-11T22:02:34.088412+0000","last_became_peered":"2024-09-11T22:02:34.088412+0000","last_unstale":"2024-09-11T22:04:17.358626+0000","last_undegraded":"2024-09-11T22:04:17.358626+0000","last_fullsized":"2024-09-11T22:04:17.358626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.376778+0000","last_change":"2024-09-11T22:02:36.103781+0000","last_active":"2024-09-11T22:04:17.376778+0000","last_peered":"2024-09-11T22:04:17.376778+0000","last_clean":"2024-09-11T22:04:17.376778+0000","last_became_active":"2024-09-11T22:02:36.103426+0000","last_became_peered":"2024-09-11T22:02:36.103426+0000","last_unstale":"2024-09-11T22:04:17.376778+0000","last_undegraded":"2024-09-11T22:04:17.376778+0000","last_fullsized":"2024-09-11T22:04:17.376778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:34.962793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.357294+0000","last_change":"2024-09-11T22:02:34.080333+0000","last_active":"2024-09-11T22:04:17.357294+0000","last_peered":"2024-09-11T22:04:17.357294+0000","last_clean":"2024-09-11T22:04:17.357294+0000","last_became_active":"2024-09-11T22:02:34.079384+0000","last_became_peered":"2024-09-11T22:02:34.079384+0000","last_unstale":"2024-09-11T22:04:17.357294+0000","last_undegraded":"2024-09-11T22:04:17.357294+0000","last_fullsized":"2024-09-11T22:04:17.357294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:38.313516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414236+0000","last_change":"2024-09-11T22:02:36.103306+0000","last_active":"2024-09-11T22:04:17.414236+0000","last_peered":"2024-09-11T22:04:17.414236+0000","last_clean":"2024-09-11T22:04:17.414236+0000","last_became_active":"2024-09-11T22:02:36.102967+0000","last_became_peered":"2024-09-11T22:02:36.102967+0000","last_unstale":"2024-09-11T22:04:17.414236+0000","last_undegraded":"2024-09-11T22:04:17.414236+0000","last_fullsized":"2024-09-11T22:04:17.414236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:34.138931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365503+0000","last_change":"2024-09-11T22:02:55.355119+0000","last_active":"2024-09-11T22:04:17.365503+0000","last_peered":"2024-09-11T22:04:17.365503+0000","last_clean":"2024-09-11T22:04:17.365503+0000","last_became_active":"2024-09-11T22:02:55.350440+0000","last_became_peered":"2024-09-11T22:02:55.350440+0000","last_unstale":"2024-09-11T22:04:17.365503+0000","last_undegraded":"2024-09-11T22:04:17.365503+0000","last_fullsized":"2024-09-11T22:04:17.365503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:47.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398642+0000","last_change":"2024-09-11T22:02:36.102491+0000","last_active":"2024-09-11T22:04:17.398642+0000","last_peered":"2024-09-11T22:04:17.398642+0000","last_clean":"2024-09-11T22:04:17.398642+0000","last_became_active":"2024-09-11T22:02:36.102112+0000","last_became_peered":"2024-09-11T22:02:36.102112+0000","last_unstale":"2024-09-11T22:04:17.398642+0000","last_undegraded":"2024-09-11T22:04:17.398642+0000","last_fullsized":"2024-09-11T22:04:17.398642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:47.588539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.367510+0000","last_change":"2024-09-11T22:02:34.082590+0000","last_active":"2024-09-11T22:04:17.367510+0000","last_peered":"2024-09-11T22:04:17.367510+0000","last_clean":"2024-09-11T22:04:17.367510+0000","last_became_active":"2024-09-11T22:02:34.082288+0000","last_became_peered":"2024-09-11T22:02:34.082288+0000","last_unstale":"2024-09-11T22:04:17.367510+0000","last_undegraded":"2024-09-11T22:04:17.367510+0000","last_fullsized":"2024-09-11T22:04:17.367510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:57.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402698+0000","last_change":"2024-09-11T22:02:36.105247+0000","last_active":"2024-09-11T22:04:17.402698+0000","last_peered":"2024-09-11T22:04:17.402698+0000","last_clean":"2024-09-11T22:04:17.402698+0000","last_became_active":"2024-09-11T22:02:36.104912+0000","last_became_peered":"2024-09-11T22:02:36.104912+0000","last_unstale":"2024-09-11T22:04:17.402698+0000","last_undegraded":"2024-09-11T22:04:17.402698+0000","last_fullsized":"2024-09-11T22:04:17.402698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:05.396671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398828+0000","last_change":"2024-09-11T22:02:55.544428+0000","last_active":"2024-09-11T22:04:17.398828+0000","last_peered":"2024-09-11T22:04:17.398828+0000","last_clean":"2024-09-11T22:04:17.398828+0000","last_became_active":"2024-09-11T22:02:55.544151+0000","last_became_peered":"2024-09-11T22:02:55.544151+0000","last_unstale":"2024-09-11T22:04:17.398828+0000","last_undegraded":"2024-09-11T22:04:17.398828+0000","last_fullsized":"2024-09-11T22:04:17.398828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.100131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368511+0000","last_change":"2024-09-11T22:02:34.079017+0000","last_active":"2024-09-11T22:04:17.368511+0000","last_peered":"2024-09-11T22:04:17.368511+0000","last_clean":"2024-09-11T22:04:17.368511+0000","last_became_active":"2024-09-11T22:02:34.078663+0000","last_became_peered":"2024-09-11T22:02:34.078663+0000","last_unstale":"2024-09-11T22:04:17.368511+0000","last_undegraded":"2024-09-11T22:04:17.368511+0000","last_fullsized":"2024-09-11T22:04:17.368511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:05.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406599+0000","last_change":"2024-09-11T22:02:36.097768+0000","last_active":"2024-09-11T22:04:17.406599+0000","last_peered":"2024-09-11T22:04:17.406599+0000","last_clean":"2024-09-11T22:04:17.406599+0000","last_became_active":"2024-09-11T22:02:36.097396+0000","last_became_peered":"2024-09-11T22:02:36.097396+0000","last_unstale":"2024-09-11T22:04:17.406599+0000","last_undegraded":"2024-09-11T22:04:17.406599+0000","last_fullsized":"2024-09-11T22:04:17.406599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:35.673268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368326+0000","last_change":"2024-09-11T22:02:55.355229+0000","last_active":"2024-09-11T22:04:17.368326+0000","last_peered":"2024-09-11T22:04:17.368326+0000","last_clean":"2024-09-11T22:04:17.368326+0000","last_became_active":"2024-09-11T22:02:55.350492+0000","last_became_peered":"2024-09-11T22:02:55.350492+0000","last_unstale":"2024-09-11T22:04:17.368326+0000","last_undegraded":"2024-09-11T22:04:17.368326+0000","last_fullsized":"2024-09-11T22:04:17.368326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:03:31.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412937+0000","last_change":"2024-09-11T22:02:36.108992+0000","last_active":"2024-09-11T22:04:17.412937+0000","last_peered":"2024-09-11T22:04:17.412937+0000","last_clean":"2024-09-11T22:04:17.412937+0000","last_became_active":"2024-09-11T22:02:36.108674+0000","last_became_peered":"2024-09-11T22:02:36.108674+0000","last_unstale":"2024-09-11T22:04:17.412937+0000","last_undegraded":"2024-09-11T22:04:17.412937+0000","last_fullsized":"2024-09-11T22:04:17.412937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:57.083127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358697+0000","last_change":"2024-09-11T22:02:34.088833+0000","last_active":"2024-09-11T22:04:17.358697+0000","last_peered":"2024-09-11T22:04:17.358697+0000","last_clean":"2024-09-11T22:04:17.358697+0000","last_became_active":"2024-09-11T22:02:34.088275+0000","last_became_peered":"2024-09-11T22:02:34.088275+0000","last_unstale":"2024-09-11T22:04:17.358697+0000","last_undegraded":"2024-09-11T22:04:17.358697+0000","last_fullsized":"2024-09-11T22:04:17.358697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:31.167486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403337+0000","last_change":"2024-09-11T22:02:36.108154+0000","last_active":"2024-09-11T22:04:17.403337+0000","last_peered":"2024-09-11T22:04:17.403337+0000","last_clean":"2024-09-11T22:04:17.403337+0000","last_became_active":"2024-09-11T22:02:36.107817+0000","last_became_peered":"2024-09-11T22:02:36.107817+0000","last_unstale":"2024-09-11T22:04:17.403337+0000","last_undegraded":"2024-09-11T22:04:17.403337+0000","last_fullsized":"2024-09-11T22:04:17.403337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.168339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358899+0000","last_change":"2024-09-11T22:02:34.082193+0000","last_active":"2024-09-11T22:04:17.358899+0000","last_peered":"2024-09-11T22:04:17.358899+0000","last_clean":"2024-09-11T22:04:17.358899+0000","last_became_active":"2024-09-11T22:02:34.081852+0000","last_became_peered":"2024-09-11T22:02:34.081852+0000","last_unstale":"2024-09-11T22:04:17.358899+0000","last_undegraded":"2024-09-11T22:04:17.358899+0000","last_fullsized":"2024-09-11T22:04:17.358899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:08.319444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797484,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":858,"num_read_kb":587,"num_write":362,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2392452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514531,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32488,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712664,"statfs":{"total":95995035648,"available":95961767936,"internally_reserved":0,"allocated":1331200,"data_stored":845532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28760,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716392,"statfs":{"total":95995035648,"available":95965585408,"internally_reserved":0,"allocated":1777664,"data_stored":1246503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906989,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28340,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716812,"statfs":{"total":95995035648,"available":95966015488,"internally_reserved":0,"allocated":1347584,"data_stored":845768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":452472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397558,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1047044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528379,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":451941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28740,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716412,"statfs":{"total":95995035648,"available":95965605888,"internally_reserved":0,"allocated":1695744,"data_stored":1176615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953541,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":454091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1173700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":523797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":521127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":453212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":72063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":400916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:04:31.374 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:04:31.625 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:32.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.082+0000 7f1829a41640 1 -- 172.21.15.152:0/2256330304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1824106ba0 msgr2=0x7f1824106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:32.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.082+0000 7f1829a41640 1 --2- 172.21.15.152:0/2256330304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1824106ba0 0x7f1824106f80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1814009900 tx=0x7f181402a410 comp rx=0 tx=0).stop 2024-09-11T22:04:32.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.082+0000 7f1829a41640 1 -- 172.21.15.152:0/2256330304 shutdown_connections 2024-09-11T22:04:32.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.082+0000 7f1829a41640 1 --2- 172.21.15.152:0/2256330304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18241005c0 0x7f182410ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:32.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.082+0000 7f1829a41640 1 --2- 172.21.15.152:0/2256330304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18240ffc20 0x7f1824100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:32.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.082+0000 7f1829a41640 1 --2- 172.21.15.152:0/2256330304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1824106ba0 0x7f1824106f80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:32.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.082+0000 7f1829a41640 1 -- 172.21.15.152:0/2256330304 >> 172.21.15.152:0/2256330304 conn(0x7f18240fba90 msgr2=0x7f18240fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:32.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.082+0000 7f1829a41640 1 -- 172.21.15.152:0/2256330304 shutdown_connections 2024-09-11T22:04:32.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.082+0000 7f1829a41640 1 -- 172.21.15.152:0/2256330304 wait complete. 2024-09-11T22:04:32.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f1829a41640 1 Processor -- start 2024-09-11T22:04:32.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f1829a41640 1 -- start start 2024-09-11T22:04:32.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f1829a41640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18240ffc20 0x7f1824198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:32.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f1829a41640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18241005c0 0x7f1824198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:32.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f1829a41640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1824106ba0 0x7f182419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:32.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f1829a41640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1824112000 con 0x7f18241005c0 2024-09-11T22:04:32.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f1829a41640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1824111e80 con 0x7f1824106ba0 2024-09-11T22:04:32.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f1829a41640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1824112180 con 0x7f18240ffc20 2024-09-11T22:04:32.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f18227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18241005c0 0x7f1824198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:32.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f18227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18241005c0 0x7f1824198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59194/0 (socket says 172.21.15.152:59194) 2024-09-11T22:04:32.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f18227fc640 1 -- 172.21.15.152:0/44407224 learned_addr learned my addr 172.21.15.152:0/44407224 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:32.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f18237fe640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1824106ba0 0x7f182419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:32.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f1822ffd640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18240ffc20 0x7f1824198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:32.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f18227fc640 1 -- 172.21.15.152:0/44407224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18240ffc20 msgr2=0x7f1824198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f18227fc640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18240ffc20 0x7f1824198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f18227fc640 1 -- 172.21.15.152:0/44407224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1824106ba0 msgr2=0x7f182419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f18227fc640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1824106ba0 0x7f182419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f18227fc640 1 -- 172.21.15.152:0/44407224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182419d4b0 con 0x7f18241005c0 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.083+0000 7f18237fe640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1824106ba0 0x7f182419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.084+0000 7f18227fc640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18241005c0 0x7f1824198a40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f180c00b4a0 tx=0x7f180c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.084+0000 7f1828a3f640 1 -- 172.21.15.152:0/44407224 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c014070 con 0x7f18241005c0 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.084+0000 7f1828a3f640 1 -- 172.21.15.152:0/44407224 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f180c010af0 con 0x7f18241005c0 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.084+0000 7f1829a41640 1 -- 172.21.15.152:0/44407224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182419d7a0 con 0x7f18241005c0 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.084+0000 7f1828a3f640 1 -- 172.21.15.152:0/44407224 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c017d10 con 0x7f18241005c0 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.084+0000 7f1829a41640 1 -- 172.21.15.152:0/44407224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18241a5080 con 0x7f18241005c0 2024-09-11T22:04:32.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.085+0000 7f1829a41640 1 -- 172.21.15.152:0/44407224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1824100080 con 0x7f18241005c0 2024-09-11T22:04:32.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.086+0000 7f1828a3f640 1 -- 172.21.15.152:0/44407224 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f180c017070 con 0x7f18241005c0 2024-09-11T22:04:32.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.087+0000 7f1828a3f640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18100a2e90 0x7f18100a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:32.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.087+0000 7f1828a3f640 1 -- 172.21.15.152:0/44407224 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f180c0ce9c0 con 0x7f18241005c0 2024-09-11T22:04:32.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.087+0000 7f1822ffd640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18100a2e90 0x7f18100a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:32.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.087+0000 7f1822ffd640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18100a2e90 0x7f18100a5350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18140096c0 tx=0x7f1814000bc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:32.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.091+0000 7f1828a3f640 1 -- 172.21.15.152:0/44407224 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f180c0d0e20 con 0x7f18241005c0 2024-09-11T22:04:32.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.254+0000 7f1829a41640 1 -- 172.21.15.152:0/44407224 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1824062630 con 0x7f18100a2e90 2024-09-11T22:04:32.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.263+0000 7f1828a3f640 1 -- 172.21.15.152:0/44407224 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257754 (secure 0 0 0) 0x7f1824062630 con 0x7f18100a2e90 2024-09-11T22:04:32.266 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:32.266 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-09-11T22:04:32.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 -- 172.21.15.152:0/44407224 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18100a2e90 msgr2=0x7f18100a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:32.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18100a2e90 0x7f18100a5350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18140096c0 tx=0x7f1814000bc0 comp rx=0 tx=0).stop 2024-09-11T22:04:32.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 -- 172.21.15.152:0/44407224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18241005c0 msgr2=0x7f1824198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:32.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18241005c0 0x7f1824198a40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f180c00b4a0 tx=0x7f180c00b960 comp rx=0 tx=0).stop 2024-09-11T22:04:32.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 -- 172.21.15.152:0/44407224 shutdown_connections 2024-09-11T22:04:32.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18100a2e90 0x7f18100a5350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:32.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1824106ba0 0x7f182419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:32.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18241005c0 0x7f1824198a40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:32.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 --2- 172.21.15.152:0/44407224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18240ffc20 0x7f1824198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:32.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 -- 172.21.15.152:0/44407224 >> 172.21.15.152:0/44407224 conn(0x7f18240fba90 msgr2=0x7f18240fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:32.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 -- 172.21.15.152:0/44407224 shutdown_connections 2024-09-11T22:04:32.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:32.266+0000 7f1829a41640 1 -- 172.21.15.152:0/44407224 wait complete. 2024-09-11T22:04:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:32 smithi152 ceph-mon[31188]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:32.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:32 smithi152 ceph-mon[31188]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 55 KiB/s wr, 30 op/s 2024-09-11T22:04:32.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:32 smithi179 ceph-mon[35603]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:32.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:32 smithi179 ceph-mon[35603]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 55 KiB/s wr, 30 op/s 2024-09-11T22:04:32.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:32 smithi193 ceph-mon[35545]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:32.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:32 smithi193 ceph-mon[35545]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 55 KiB/s wr, 30 op/s 2024-09-11T22:04:33.035 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-11T22:04:31.372855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1388086,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1095,"num_read_kb":917,"num_write":565,"num_write_kb":5036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":925,"ondisk_log_size":925,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368372,"kb_used_data":14880,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124573452,"statfs":{"total":1151940427776,"available":1151563214848,"internally_reserved":0,"allocated":15237120,"data_stored":9191802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":199938,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":348,"num_write":91,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002383"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414391+0000","last_change":"2024-09-11T22:02:36.105689+0000","last_active":"2024-09-11T22:04:17.414391+0000","last_peered":"2024-09-11T22:04:17.414391+0000","last_clean":"2024-09-11T22:04:17.414391+0000","last_became_active":"2024-09-11T22:02:36.105128+0000","last_became_peered":"2024-09-11T22:02:36.105128+0000","last_unstale":"2024-09-11T22:04:17.414391+0000","last_undegraded":"2024-09-11T22:04:17.414391+0000","last_fullsized":"2024-09-11T22:04:17.414391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:18.018731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.410505+0000","last_change":"2024-09-11T22:02:36.096961+0000","last_active":"2024-09-11T22:04:17.410505+0000","last_peered":"2024-09-11T22:04:17.410505+0000","last_clean":"2024-09-11T22:04:17.410505+0000","last_became_active":"2024-09-11T22:02:36.096540+0000","last_became_peered":"2024-09-11T22:02:36.096540+0000","last_unstale":"2024-09-11T22:04:17.410505+0000","last_undegraded":"2024-09-11T22:04:17.410505+0000","last_fullsized":"2024-09-11T22:04:17.410505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:48.517125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413305+0000","last_change":"2024-09-11T22:02:36.108119+0000","last_active":"2024-09-11T22:04:17.413305+0000","last_peered":"2024-09-11T22:04:17.413305+0000","last_clean":"2024-09-11T22:04:17.413305+0000","last_became_active":"2024-09-11T22:02:36.107737+0000","last_became_peered":"2024-09-11T22:02:36.107737+0000","last_unstale":"2024-09-11T22:04:17.413305+0000","last_undegraded":"2024-09-11T22:04:17.413305+0000","last_fullsized":"2024-09-11T22:04:17.413305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:54.225935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395071+0000","last_change":"2024-09-11T22:02:36.107710+0000","last_active":"2024-09-11T22:04:17.395071+0000","last_peered":"2024-09-11T22:04:17.395071+0000","last_clean":"2024-09-11T22:04:17.395071+0000","last_became_active":"2024-09-11T22:02:36.107327+0000","last_became_peered":"2024-09-11T22:02:36.107327+0000","last_unstale":"2024-09-11T22:04:17.395071+0000","last_undegraded":"2024-09-11T22:04:17.395071+0000","last_fullsized":"2024-09-11T22:04:17.395071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.358535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396846+0000","last_change":"2024-09-11T22:02:36.100531+0000","last_active":"2024-09-11T22:04:17.396846+0000","last_peered":"2024-09-11T22:04:17.396846+0000","last_clean":"2024-09-11T22:04:17.396846+0000","last_became_active":"2024-09-11T22:02:36.100187+0000","last_became_peered":"2024-09-11T22:02:36.100187+0000","last_unstale":"2024-09-11T22:04:17.396846+0000","last_undegraded":"2024-09-11T22:04:17.396846+0000","last_fullsized":"2024-09-11T22:04:17.396846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.156080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397927+0000","last_change":"2024-09-11T22:02:36.101316+0000","last_active":"2024-09-11T22:04:17.397927+0000","last_peered":"2024-09-11T22:04:17.397927+0000","last_clean":"2024-09-11T22:04:17.397927+0000","last_became_active":"2024-09-11T22:02:36.100985+0000","last_became_peered":"2024-09-11T22:02:36.100985+0000","last_unstale":"2024-09-11T22:04:17.397927+0000","last_undegraded":"2024-09-11T22:04:17.397927+0000","last_fullsized":"2024-09-11T22:04:17.397927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:55.972974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.385307+0000","last_change":"2024-09-11T22:02:36.109146+0000","last_active":"2024-09-11T22:04:17.385307+0000","last_peered":"2024-09-11T22:04:17.385307+0000","last_clean":"2024-09-11T22:04:17.385307+0000","last_became_active":"2024-09-11T22:02:36.108817+0000","last_became_peered":"2024-09-11T22:02:36.108817+0000","last_unstale":"2024-09-11T22:04:17.385307+0000","last_undegraded":"2024-09-11T22:04:17.385307+0000","last_fullsized":"2024-09-11T22:04:17.385307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.222383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398948+0000","last_change":"2024-09-11T22:02:36.100362+0000","last_active":"2024-09-11T22:04:17.398948+0000","last_peered":"2024-09-11T22:04:17.398948+0000","last_clean":"2024-09-11T22:04:17.398948+0000","last_became_active":"2024-09-11T22:02:36.100088+0000","last_became_peered":"2024-09-11T22:02:36.100088+0000","last_unstale":"2024-09-11T22:04:17.398948+0000","last_undegraded":"2024-09-11T22:04:17.398948+0000","last_fullsized":"2024-09-11T22:04:17.398948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.478879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401808+0000","last_change":"2024-09-11T22:02:36.106360+0000","last_active":"2024-09-11T22:04:17.401808+0000","last_peered":"2024-09-11T22:04:17.401808+0000","last_clean":"2024-09-11T22:04:17.401808+0000","last_became_active":"2024-09-11T22:02:36.105994+0000","last_became_peered":"2024-09-11T22:02:36.105994+0000","last_unstale":"2024-09-11T22:04:17.401808+0000","last_undegraded":"2024-09-11T22:04:17.401808+0000","last_fullsized":"2024-09-11T22:04:17.401808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:33.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.394089+0000","last_change":"2024-09-11T22:02:36.109477+0000","last_active":"2024-09-11T22:04:17.394089+0000","last_peered":"2024-09-11T22:04:17.394089+0000","last_clean":"2024-09-11T22:04:17.394089+0000","last_became_active":"2024-09-11T22:02:36.109077+0000","last_became_peered":"2024-09-11T22:02:36.109077+0000","last_unstale":"2024-09-11T22:04:17.394089+0000","last_undegraded":"2024-09-11T22:04:17.394089+0000","last_fullsized":"2024-09-11T22:04:17.394089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.862359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399588+0000","last_change":"2024-09-11T22:02:36.112998+0000","last_active":"2024-09-11T22:04:17.399588+0000","last_peered":"2024-09-11T22:04:17.399588+0000","last_clean":"2024-09-11T22:04:17.399588+0000","last_became_active":"2024-09-11T22:02:36.112649+0000","last_became_peered":"2024-09-11T22:02:36.112649+0000","last_unstale":"2024-09-11T22:04:17.399588+0000","last_undegraded":"2024-09-11T22:04:17.399588+0000","last_fullsized":"2024-09-11T22:04:17.399588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:01.582572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398221+0000","last_change":"2024-09-11T22:02:36.099591+0000","last_active":"2024-09-11T22:04:17.398221+0000","last_peered":"2024-09-11T22:04:17.398221+0000","last_clean":"2024-09-11T22:04:17.398221+0000","last_became_active":"2024-09-11T22:02:36.099269+0000","last_became_peered":"2024-09-11T22:02:36.099269+0000","last_unstale":"2024-09-11T22:04:17.398221+0000","last_undegraded":"2024-09-11T22:04:17.398221+0000","last_fullsized":"2024-09-11T22:04:17.398221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:10.918188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403970+0000","last_change":"2024-09-11T22:02:36.100056+0000","last_active":"2024-09-11T22:04:17.403970+0000","last_peered":"2024-09-11T22:04:17.403970+0000","last_clean":"2024-09-11T22:04:17.403970+0000","last_became_active":"2024-09-11T22:02:36.099717+0000","last_became_peered":"2024-09-11T22:02:36.099717+0000","last_unstale":"2024-09-11T22:04:17.403970+0000","last_undegraded":"2024-09-11T22:04:17.403970+0000","last_fullsized":"2024-09-11T22:04:17.403970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.486256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411675+0000","last_change":"2024-09-11T22:02:36.097281+0000","last_active":"2024-09-11T22:04:17.411675+0000","last_peered":"2024-09-11T22:04:17.411675+0000","last_clean":"2024-09-11T22:04:17.411675+0000","last_became_active":"2024-09-11T22:02:36.096768+0000","last_became_peered":"2024-09-11T22:02:36.096768+0000","last_unstale":"2024-09-11T22:04:17.411675+0000","last_undegraded":"2024-09-11T22:04:17.411675+0000","last_fullsized":"2024-09-11T22:04:17.411675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:31.232578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412627+0000","last_change":"2024-09-11T22:02:55.351065+0000","last_active":"2024-09-11T22:04:17.412627+0000","last_peered":"2024-09-11T22:04:17.412627+0000","last_clean":"2024-09-11T22:04:17.412627+0000","last_became_active":"2024-09-11T22:02:55.350669+0000","last_became_peered":"2024-09-11T22:02:55.350669+0000","last_unstale":"2024-09-11T22:04:17.412627+0000","last_undegraded":"2024-09-11T22:04:17.412627+0000","last_fullsized":"2024-09-11T22:04:17.412627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:51.799060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414040+0000","last_change":"2024-09-11T22:02:36.109573+0000","last_active":"2024-09-11T22:04:17.414040+0000","last_peered":"2024-09-11T22:04:17.414040+0000","last_clean":"2024-09-11T22:04:17.414040+0000","last_became_active":"2024-09-11T22:02:36.109019+0000","last_became_peered":"2024-09-11T22:02:36.109019+0000","last_unstale":"2024-09-11T22:04:17.414040+0000","last_undegraded":"2024-09-11T22:04:17.414040+0000","last_fullsized":"2024-09-11T22:04:17.414040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:39.699762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414508+0000","last_change":"2024-09-11T22:02:36.105427+0000","last_active":"2024-09-11T22:04:17.414508+0000","last_peered":"2024-09-11T22:04:17.414508+0000","last_clean":"2024-09-11T22:04:17.414508+0000","last_became_active":"2024-09-11T22:02:36.104712+0000","last_became_peered":"2024-09-11T22:02:36.104712+0000","last_unstale":"2024-09-11T22:04:17.414508+0000","last_undegraded":"2024-09-11T22:04:17.414508+0000","last_fullsized":"2024-09-11T22:04:17.414508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:45.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399613+0000","last_change":"2024-09-11T22:02:36.097925+0000","last_active":"2024-09-11T22:04:17.399613+0000","last_peered":"2024-09-11T22:04:17.399613+0000","last_clean":"2024-09-11T22:04:17.399613+0000","last_became_active":"2024-09-11T22:02:36.097649+0000","last_became_peered":"2024-09-11T22:02:36.097649+0000","last_unstale":"2024-09-11T22:04:17.399613+0000","last_undegraded":"2024-09-11T22:04:17.399613+0000","last_fullsized":"2024-09-11T22:04:17.399613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.272197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400978+0000","last_change":"2024-09-11T22:02:36.107266+0000","last_active":"2024-09-11T22:04:17.400978+0000","last_peered":"2024-09-11T22:04:17.400978+0000","last_clean":"2024-09-11T22:04:17.400978+0000","last_became_active":"2024-09-11T22:02:36.106865+0000","last_became_peered":"2024-09-11T22:02:36.106865+0000","last_unstale":"2024-09-11T22:04:17.400978+0000","last_undegraded":"2024-09-11T22:04:17.400978+0000","last_fullsized":"2024-09-11T22:04:17.400978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:53.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396320+0000","last_change":"2024-09-11T22:02:55.349854+0000","last_active":"2024-09-11T22:04:17.396320+0000","last_peered":"2024-09-11T22:04:17.396320+0000","last_clean":"2024-09-11T22:04:17.396320+0000","last_became_active":"2024-09-11T22:02:55.349521+0000","last_became_peered":"2024-09-11T22:02:55.349521+0000","last_unstale":"2024-09-11T22:04:17.396320+0000","last_undegraded":"2024-09-11T22:04:17.396320+0000","last_fullsized":"2024-09-11T22:04:17.396320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406936+0000","last_change":"2024-09-11T22:02:36.110460+0000","last_active":"2024-09-11T22:04:17.406936+0000","last_peered":"2024-09-11T22:04:17.406936+0000","last_clean":"2024-09-11T22:04:17.406936+0000","last_became_active":"2024-09-11T22:02:36.110136+0000","last_became_peered":"2024-09-11T22:02:36.110136+0000","last_unstale":"2024-09-11T22:04:17.406936+0000","last_undegraded":"2024-09-11T22:04:17.406936+0000","last_fullsized":"2024-09-11T22:04:17.406936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:30.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403836+0000","last_change":"2024-09-11T22:02:36.111403+0000","last_active":"2024-09-11T22:04:17.403836+0000","last_peered":"2024-09-11T22:04:17.403836+0000","last_clean":"2024-09-11T22:04:17.403836+0000","last_became_active":"2024-09-11T22:02:36.110976+0000","last_became_peered":"2024-09-11T22:02:36.110976+0000","last_unstale":"2024-09-11T22:04:17.403836+0000","last_undegraded":"2024-09-11T22:04:17.403836+0000","last_fullsized":"2024-09-11T22:04:17.403836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:03.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.405071+0000","last_change":"2024-09-11T22:02:36.110002+0000","last_active":"2024-09-11T22:04:17.405071+0000","last_peered":"2024-09-11T22:04:17.405071+0000","last_clean":"2024-09-11T22:04:17.405071+0000","last_became_active":"2024-09-11T22:02:36.109694+0000","last_became_peered":"2024-09-11T22:02:36.109694+0000","last_unstale":"2024-09-11T22:04:17.405071+0000","last_undegraded":"2024-09-11T22:04:17.405071+0000","last_fullsized":"2024-09-11T22:04:17.405071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:00.338509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406553+0000","last_change":"2024-09-11T22:02:36.101638+0000","last_active":"2024-09-11T22:04:17.406553+0000","last_peered":"2024-09-11T22:04:17.406553+0000","last_clean":"2024-09-11T22:04:17.406553+0000","last_became_active":"2024-09-11T22:02:36.101363+0000","last_became_peered":"2024-09-11T22:02:36.101363+0000","last_unstale":"2024-09-11T22:04:17.406553+0000","last_undegraded":"2024-09-11T22:04:17.406553+0000","last_fullsized":"2024-09-11T22:04:17.406553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:35.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399143+0000","last_change":"2024-09-11T22:02:36.109250+0000","last_active":"2024-09-11T22:04:17.399143+0000","last_peered":"2024-09-11T22:04:17.399143+0000","last_clean":"2024-09-11T22:04:17.399143+0000","last_became_active":"2024-09-11T22:02:36.108931+0000","last_became_peered":"2024-09-11T22:02:36.108931+0000","last_unstale":"2024-09-11T22:04:17.399143+0000","last_undegraded":"2024-09-11T22:04:17.399143+0000","last_fullsized":"2024-09-11T22:04:17.399143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:09.616621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400102+0000","last_change":"2024-09-11T22:02:36.113064+0000","last_active":"2024-09-11T22:04:17.400102+0000","last_peered":"2024-09-11T22:04:17.400102+0000","last_clean":"2024-09-11T22:04:17.400102+0000","last_became_active":"2024-09-11T22:02:36.112674+0000","last_became_peered":"2024-09-11T22:02:36.112674+0000","last_unstale":"2024-09-11T22:04:17.400102+0000","last_undegraded":"2024-09-11T22:04:17.400102+0000","last_fullsized":"2024-09-11T22:04:17.400102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:17.923053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395397+0000","last_change":"2024-09-11T22:02:36.101799+0000","last_active":"2024-09-11T22:04:17.395397+0000","last_peered":"2024-09-11T22:04:17.395397+0000","last_clean":"2024-09-11T22:04:17.395397+0000","last_became_active":"2024-09-11T22:02:36.101429+0000","last_became_peered":"2024-09-11T22:02:36.101429+0000","last_unstale":"2024-09-11T22:04:17.395397+0000","last_undegraded":"2024-09-11T22:04:17.395397+0000","last_fullsized":"2024-09-11T22:04:17.395397+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.597619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402304+0000","last_change":"2024-09-11T22:02:36.100993+0000","last_active":"2024-09-11T22:04:17.402304+0000","last_peered":"2024-09-11T22:04:17.402304+0000","last_clean":"2024-09-11T22:04:17.402304+0000","last_became_active":"2024-09-11T22:02:36.100678+0000","last_became_peered":"2024-09-11T22:02:36.100678+0000","last_unstale":"2024-09-11T22:04:17.402304+0000","last_undegraded":"2024-09-11T22:04:17.402304+0000","last_fullsized":"2024-09-11T22:04:17.402304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:18.808422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.408677+0000","last_change":"2024-09-11T22:02:36.103507+0000","last_active":"2024-09-11T22:04:17.408677+0000","last_peered":"2024-09-11T22:04:17.408677+0000","last_clean":"2024-09-11T22:04:17.408677+0000","last_became_active":"2024-09-11T22:02:36.103228+0000","last_became_peered":"2024-09-11T22:02:36.103228+0000","last_unstale":"2024-09-11T22:04:17.408677+0000","last_undegraded":"2024-09-11T22:04:17.408677+0000","last_fullsized":"2024-09-11T22:04:17.408677+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.898635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413675+0000","last_change":"2024-09-11T22:02:36.104734+0000","last_active":"2024-09-11T22:04:17.413675+0000","last_peered":"2024-09-11T22:04:17.413675+0000","last_clean":"2024-09-11T22:04:17.413675+0000","last_became_active":"2024-09-11T22:02:36.103974+0000","last_became_peered":"2024-09-11T22:02:36.103974+0000","last_unstale":"2024-09-11T22:04:17.413675+0000","last_undegraded":"2024-09-11T22:04:17.413675+0000","last_fullsized":"2024-09-11T22:04:17.413675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:54.142031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397564+0000","last_change":"2024-09-11T22:02:36.106103+0000","last_active":"2024-09-11T22:04:17.397564+0000","last_peered":"2024-09-11T22:04:17.397564+0000","last_clean":"2024-09-11T22:04:17.397564+0000","last_became_active":"2024-09-11T22:02:36.105792+0000","last_became_peered":"2024-09-11T22:02:36.105792+0000","last_unstale":"2024-09-11T22:04:17.397564+0000","last_undegraded":"2024-09-11T22:04:17.397564+0000","last_fullsized":"2024-09-11T22:04:17.397564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:06.607094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397456+0000","last_change":"2024-09-11T22:02:36.104147+0000","last_active":"2024-09-11T22:04:17.397456+0000","last_peered":"2024-09-11T22:04:17.397456+0000","last_clean":"2024-09-11T22:04:17.397456+0000","last_became_active":"2024-09-11T22:02:36.103782+0000","last_became_peered":"2024-09-11T22:02:36.103782+0000","last_unstale":"2024-09-11T22:04:17.397456+0000","last_undegraded":"2024-09-11T22:04:17.397456+0000","last_fullsized":"2024-09-11T22:04:17.397456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.127609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.392542+0000","last_change":"2024-09-11T22:02:36.101259+0000","last_active":"2024-09-11T22:04:17.392542+0000","last_peered":"2024-09-11T22:04:17.392542+0000","last_clean":"2024-09-11T22:04:17.392542+0000","last_became_active":"2024-09-11T22:02:36.100761+0000","last_became_peered":"2024-09-11T22:02:36.100761+0000","last_unstale":"2024-09-11T22:04:17.392542+0000","last_undegraded":"2024-09-11T22:04:17.392542+0000","last_fullsized":"2024-09-11T22:04:17.392542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:47.045252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:26.985511+0000","last_change":"2024-09-11T22:02:34.084522+0000","last_active":"2024-09-11T22:04:26.985511+0000","last_peered":"2024-09-11T22:04:26.985511+0000","last_clean":"2024-09-11T22:04:26.985511+0000","last_became_active":"2024-09-11T22:02:34.084211+0000","last_became_peered":"2024-09-11T22:02:34.084211+0000","last_unstale":"2024-09-11T22:04:26.985511+0000","last_undegraded":"2024-09-11T22:04:26.985511+0000","last_fullsized":"2024-09-11T22:04:26.985511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:18.963998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406451+0000","last_change":"2024-09-11T22:02:36.106890+0000","last_active":"2024-09-11T22:04:17.406451+0000","last_peered":"2024-09-11T22:04:17.406451+0000","last_clean":"2024-09-11T22:04:17.406451+0000","last_became_active":"2024-09-11T22:02:36.105255+0000","last_became_peered":"2024-09-11T22:02:36.105255+0000","last_unstale":"2024-09-11T22:04:17.406451+0000","last_undegraded":"2024-09-11T22:04:17.406451+0000","last_fullsized":"2024-09-11T22:04:17.406451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.995542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.355903+0000","last_change":"2024-09-11T22:02:34.079967+0000","last_active":"2024-09-11T22:04:17.355903+0000","last_peered":"2024-09-11T22:04:17.355903+0000","last_clean":"2024-09-11T22:04:17.355903+0000","last_became_active":"2024-09-11T22:02:34.079649+0000","last_became_peered":"2024-09-11T22:02:34.079649+0000","last_unstale":"2024-09-11T22:04:17.355903+0000","last_undegraded":"2024-09-11T22:04:17.355903+0000","last_fullsized":"2024-09-11T22:04:17.355903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.661256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.351613+0000","last_change":"2024-09-11T22:02:34.079850+0000","last_active":"2024-09-11T22:04:17.351613+0000","last_peered":"2024-09-11T22:04:17.351613+0000","last_clean":"2024-09-11T22:04:17.351613+0000","last_became_active":"2024-09-11T22:02:34.079514+0000","last_became_peered":"2024-09-11T22:02:34.079514+0000","last_unstale":"2024-09-11T22:04:17.351613+0000","last_undegraded":"2024-09-11T22:04:17.351613+0000","last_fullsized":"2024-09-11T22:04:17.351613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.359482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407046+0000","last_change":"2024-09-11T22:02:36.099310+0000","last_active":"2024-09-11T22:04:17.407046+0000","last_peered":"2024-09-11T22:04:17.407046+0000","last_clean":"2024-09-11T22:04:17.407046+0000","last_became_active":"2024-09-11T22:02:36.099026+0000","last_became_peered":"2024-09-11T22:02:36.099026+0000","last_unstale":"2024-09-11T22:04:17.407046+0000","last_undegraded":"2024-09-11T22:04:17.407046+0000","last_fullsized":"2024-09-11T22:04:17.407046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:57.570147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358629+0000","last_change":"2024-09-11T22:02:34.083757+0000","last_active":"2024-09-11T22:04:17.358629+0000","last_peered":"2024-09-11T22:04:17.358629+0000","last_clean":"2024-09-11T22:04:17.358629+0000","last_became_active":"2024-09-11T22:02:34.083467+0000","last_became_peered":"2024-09-11T22:02:34.083467+0000","last_unstale":"2024-09-11T22:04:17.358629+0000","last_undegraded":"2024-09-11T22:04:17.358629+0000","last_fullsized":"2024-09-11T22:04:17.358629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.546772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407844+0000","last_change":"2024-09-11T22:02:36.098939+0000","last_active":"2024-09-11T22:04:17.407844+0000","last_peered":"2024-09-11T22:04:17.407844+0000","last_clean":"2024-09-11T22:04:17.407844+0000","last_became_active":"2024-09-11T22:02:36.098631+0000","last_became_peered":"2024-09-11T22:02:36.098631+0000","last_unstale":"2024-09-11T22:04:17.407844+0000","last_undegraded":"2024-09-11T22:04:17.407844+0000","last_fullsized":"2024-09-11T22:04:17.407844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:07.663332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":131,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:26.984926+0000","last_change":"2024-09-11T22:02:34.085325+0000","last_active":"2024-09-11T22:04:26.984926+0000","last_peered":"2024-09-11T22:04:26.984926+0000","last_clean":"2024-09-11T22:04:26.984926+0000","last_became_active":"2024-09-11T22:02:34.084967+0000","last_became_peered":"2024-09-11T22:02:34.084967+0000","last_unstale":"2024-09-11T22:04:26.984926+0000","last_undegraded":"2024-09-11T22:04:26.984926+0000","last_fullsized":"2024-09-11T22:04:26.984926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:35.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396449+0000","last_change":"2024-09-11T22:02:36.104454+0000","last_active":"2024-09-11T22:04:17.396449+0000","last_peered":"2024-09-11T22:04:17.396449+0000","last_clean":"2024-09-11T22:04:17.396449+0000","last_became_active":"2024-09-11T22:02:36.103988+0000","last_became_peered":"2024-09-11T22:02:36.103988+0000","last_unstale":"2024-09-11T22:04:17.396449+0000","last_undegraded":"2024-09-11T22:04:17.396449+0000","last_fullsized":"2024-09-11T22:04:17.396449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:32.748524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362192+0000","last_change":"2024-09-11T22:02:55.548642+0000","last_active":"2024-09-11T22:04:17.362192+0000","last_peered":"2024-09-11T22:04:17.362192+0000","last_clean":"2024-09-11T22:04:17.362192+0000","last_became_active":"2024-09-11T22:02:55.545771+0000","last_became_peered":"2024-09-11T22:02:55.545771+0000","last_unstale":"2024-09-11T22:04:17.362192+0000","last_undegraded":"2024-09-11T22:04:17.362192+0000","last_fullsized":"2024-09-11T22:04:17.362192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:03.431986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411866+0000","last_change":"2024-09-11T22:02:55.349125+0000","last_active":"2024-09-11T22:04:17.411866+0000","last_peered":"2024-09-11T22:04:17.411866+0000","last_clean":"2024-09-11T22:04:17.411866+0000","last_became_active":"2024-09-11T22:02:55.348746+0000","last_became_peered":"2024-09-11T22:02:55.348746+0000","last_unstale":"2024-09-11T22:04:17.411866+0000","last_undegraded":"2024-09-11T22:04:17.411866+0000","last_fullsized":"2024-09-11T22:04:17.411866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358974+0000","last_change":"2024-09-11T22:02:34.089793+0000","last_active":"2024-09-11T22:04:17.358974+0000","last_peered":"2024-09-11T22:04:17.358974+0000","last_clean":"2024-09-11T22:04:17.358974+0000","last_became_active":"2024-09-11T22:02:34.089468+0000","last_became_peered":"2024-09-11T22:02:34.089468+0000","last_unstale":"2024-09-11T22:04:17.358974+0000","last_undegraded":"2024-09-11T22:04:17.358974+0000","last_fullsized":"2024-09-11T22:04:17.358974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:10:21.034822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401964+0000","last_change":"2024-09-11T22:02:36.106224+0000","last_active":"2024-09-11T22:04:17.401964+0000","last_peered":"2024-09-11T22:04:17.401964+0000","last_clean":"2024-09-11T22:04:17.401964+0000","last_became_active":"2024-09-11T22:02:36.105903+0000","last_became_peered":"2024-09-11T22:02:36.105903+0000","last_unstale":"2024-09-11T22:04:17.401964+0000","last_undegraded":"2024-09-11T22:04:17.401964+0000","last_fullsized":"2024-09-11T22:04:17.401964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.354653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'36","reported_seq":280,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:27.988592+0000","last_change":"2024-09-11T22:02:34.082150+0000","last_active":"2024-09-11T22:04:27.988592+0000","last_peered":"2024-09-11T22:04:27.988592+0000","last_clean":"2024-09-11T22:04:27.988592+0000","last_became_active":"2024-09-11T22:02:34.081822+0000","last_became_peered":"2024-09-11T22:02:34.081822+0000","last_unstale":"2024-09-11T22:04:27.988592+0000","last_undegraded":"2024-09-11T22:04:27.988592+0000","last_fullsized":"2024-09-11T22:04:27.988592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:39.320410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69393,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":178,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.386796+0000","last_change":"2024-09-11T22:02:36.112124+0000","last_active":"2024-09-11T22:04:17.386796+0000","last_peered":"2024-09-11T22:04:17.386796+0000","last_clean":"2024-09-11T22:04:17.386796+0000","last_became_active":"2024-09-11T22:02:36.111739+0000","last_became_peered":"2024-09-11T22:02:36.111739+0000","last_unstale":"2024-09-11T22:04:17.386796+0000","last_undegraded":"2024-09-11T22:04:17.386796+0000","last_fullsized":"2024-09-11T22:04:17.386796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:52.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352659+0000","last_change":"2024-09-11T22:02:34.083047+0000","last_active":"2024-09-11T22:04:17.352659+0000","last_peered":"2024-09-11T22:04:17.352659+0000","last_clean":"2024-09-11T22:04:17.352659+0000","last_became_active":"2024-09-11T22:02:34.082406+0000","last_became_peered":"2024-09-11T22:02:34.082406+0000","last_unstale":"2024-09-11T22:04:17.352659+0000","last_undegraded":"2024-09-11T22:04:17.352659+0000","last_fullsized":"2024-09-11T22:04:17.352659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:33.249337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407254+0000","last_change":"2024-09-11T22:02:36.108859+0000","last_active":"2024-09-11T22:04:17.407254+0000","last_peered":"2024-09-11T22:04:17.407254+0000","last_clean":"2024-09-11T22:04:17.407254+0000","last_became_active":"2024-09-11T22:02:36.108558+0000","last_became_peered":"2024-09-11T22:02:36.108558+0000","last_unstale":"2024-09-11T22:04:17.407254+0000","last_undegraded":"2024-09-11T22:04:17.407254+0000","last_fullsized":"2024-09-11T22:04:17.407254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.430672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358635+0000","last_change":"2024-09-11T22:02:34.080560+0000","last_active":"2024-09-11T22:04:17.358635+0000","last_peered":"2024-09-11T22:04:17.358635+0000","last_clean":"2024-09-11T22:04:17.358635+0000","last_became_active":"2024-09-11T22:02:34.080262+0000","last_became_peered":"2024-09-11T22:02:34.080262+0000","last_unstale":"2024-09-11T22:04:17.358635+0000","last_undegraded":"2024-09-11T22:04:17.358635+0000","last_fullsized":"2024-09-11T22:04:17.358635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:44.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403367+0000","last_change":"2024-09-11T22:02:36.107722+0000","last_active":"2024-09-11T22:04:17.403367+0000","last_peered":"2024-09-11T22:04:17.403367+0000","last_clean":"2024-09-11T22:04:17.403367+0000","last_became_active":"2024-09-11T22:02:36.107219+0000","last_became_peered":"2024-09-11T22:02:36.107219+0000","last_unstale":"2024-09-11T22:04:17.403367+0000","last_undegraded":"2024-09-11T22:04:17.403367+0000","last_fullsized":"2024-09-11T22:04:17.403367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.576045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'8","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:26.984919+0000","last_change":"2024-09-11T22:02:34.083573+0000","last_active":"2024-09-11T22:04:26.984919+0000","last_peered":"2024-09-11T22:04:26.984919+0000","last_clean":"2024-09-11T22:04:26.984919+0000","last_became_active":"2024-09-11T22:02:34.083277+0000","last_became_peered":"2024-09-11T22:02:34.083277+0000","last_unstale":"2024-09-11T22:04:26.984919+0000","last_undegraded":"2024-09-11T22:04:26.984919+0000","last_fullsized":"2024-09-11T22:04:26.984919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:31.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2301,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":6,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.382984+0000","last_change":"2024-09-11T22:02:36.105075+0000","last_active":"2024-09-11T22:04:17.382984+0000","last_peered":"2024-09-11T22:04:17.382984+0000","last_clean":"2024-09-11T22:04:17.382984+0000","last_became_active":"2024-09-11T22:02:36.104022+0000","last_became_peered":"2024-09-11T22:02:36.104022+0000","last_unstale":"2024-09-11T22:04:17.382984+0000","last_undegraded":"2024-09-11T22:04:17.382984+0000","last_fullsized":"2024-09-11T22:04:17.382984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.693146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.366650+0000","last_change":"2024-09-11T22:02:34.088727+0000","last_active":"2024-09-11T22:04:17.366650+0000","last_peered":"2024-09-11T22:04:17.366650+0000","last_clean":"2024-09-11T22:04:17.366650+0000","last_became_active":"2024-09-11T22:02:34.088394+0000","last_became_peered":"2024-09-11T22:02:34.088394+0000","last_unstale":"2024-09-11T22:04:17.366650+0000","last_undegraded":"2024-09-11T22:04:17.366650+0000","last_fullsized":"2024-09-11T22:04:17.366650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:11.809765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399053+0000","last_change":"2024-09-11T22:02:36.104522+0000","last_active":"2024-09-11T22:04:17.399053+0000","last_peered":"2024-09-11T22:04:17.399053+0000","last_clean":"2024-09-11T22:04:17.399053+0000","last_became_active":"2024-09-11T22:02:36.104181+0000","last_became_peered":"2024-09-11T22:02:36.104181+0000","last_unstale":"2024-09-11T22:04:17.399053+0000","last_undegraded":"2024-09-11T22:04:17.399053+0000","last_fullsized":"2024-09-11T22:04:17.399053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:08.139180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368106+0000","last_change":"2024-09-11T22:02:34.080341+0000","last_active":"2024-09-11T22:04:17.368106+0000","last_peered":"2024-09-11T22:04:17.368106+0000","last_clean":"2024-09-11T22:04:17.368106+0000","last_became_active":"2024-09-11T22:02:34.078761+0000","last_became_peered":"2024-09-11T22:02:34.078761+0000","last_unstale":"2024-09-11T22:04:17.368106+0000","last_undegraded":"2024-09-11T22:04:17.368106+0000","last_fullsized":"2024-09-11T22:04:17.368106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393697+0000","last_change":"2024-09-11T22:02:55.545135+0000","last_active":"2024-09-11T22:04:17.393697+0000","last_peered":"2024-09-11T22:04:17.393697+0000","last_clean":"2024-09-11T22:04:17.393697+0000","last_became_active":"2024-09-11T22:02:55.544785+0000","last_became_peered":"2024-09-11T22:02:55.544785+0000","last_unstale":"2024-09-11T22:04:17.393697+0000","last_undegraded":"2024-09-11T22:04:17.393697+0000","last_fullsized":"2024-09-11T22:04:17.393697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:05.815828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352013+0000","last_change":"2024-09-11T22:02:34.082364+0000","last_active":"2024-09-11T22:04:17.352013+0000","last_peered":"2024-09-11T22:04:17.352013+0000","last_clean":"2024-09-11T22:04:17.352013+0000","last_became_active":"2024-09-11T22:02:34.081906+0000","last_became_peered":"2024-09-11T22:02:34.081906+0000","last_unstale":"2024-09-11T22:04:17.352013+0000","last_undegraded":"2024-09-11T22:04:17.352013+0000","last_fullsized":"2024-09-11T22:04:17.352013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:58.603942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.390768+0000","last_change":"2024-09-11T22:02:36.110725+0000","last_active":"2024-09-11T22:04:17.390768+0000","last_peered":"2024-09-11T22:04:17.390768+0000","last_clean":"2024-09-11T22:04:17.390768+0000","last_became_active":"2024-09-11T22:02:36.110401+0000","last_became_peered":"2024-09-11T22:02:36.110401+0000","last_unstale":"2024-09-11T22:04:17.390768+0000","last_undegraded":"2024-09-11T22:04:17.390768+0000","last_fullsized":"2024-09-11T22:04:17.390768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:41.789134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'57","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:28.314091+0000","last_change":"2024-09-11T22:02:34.082983+0000","last_active":"2024-09-11T22:04:28.314091+0000","last_peered":"2024-09-11T22:04:28.314091+0000","last_clean":"2024-09-11T22:04:28.314091+0000","last_became_active":"2024-09-11T22:02:34.082618+0000","last_became_peered":"2024-09-11T22:02:34.082618+0000","last_unstale":"2024-09-11T22:04:28.314091+0000","last_undegraded":"2024-09-11T22:04:28.314091+0000","last_fullsized":"2024-09-11T22:04:28.314091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.481228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":68,"num_write_kb":807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393689+0000","last_change":"2024-09-11T22:02:36.108222+0000","last_active":"2024-09-11T22:04:17.393689+0000","last_peered":"2024-09-11T22:04:17.393689+0000","last_clean":"2024-09-11T22:04:17.393689+0000","last_became_active":"2024-09-11T22:02:36.107739+0000","last_became_peered":"2024-09-11T22:02:36.107739+0000","last_unstale":"2024-09-11T22:04:17.393689+0000","last_undegraded":"2024-09-11T22:04:17.393689+0000","last_fullsized":"2024-09-11T22:04:17.393689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:11.353217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352780+0000","last_change":"2024-09-11T22:02:34.090068+0000","last_active":"2024-09-11T22:04:17.352780+0000","last_peered":"2024-09-11T22:04:17.352780+0000","last_clean":"2024-09-11T22:04:17.352780+0000","last_became_active":"2024-09-11T22:02:34.089735+0000","last_became_peered":"2024-09-11T22:02:34.089735+0000","last_unstale":"2024-09-11T22:04:17.352780+0000","last_undegraded":"2024-09-11T22:04:17.352780+0000","last_fullsized":"2024-09-11T22:04:17.352780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:32.917459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401828+0000","last_change":"2024-09-11T22:02:36.108017+0000","last_active":"2024-09-11T22:04:17.401828+0000","last_peered":"2024-09-11T22:04:17.401828+0000","last_clean":"2024-09-11T22:04:17.401828+0000","last_became_active":"2024-09-11T22:02:36.107339+0000","last_became_peered":"2024-09-11T22:02:36.107339+0000","last_unstale":"2024-09-11T22:04:17.401828+0000","last_undegraded":"2024-09-11T22:04:17.401828+0000","last_fullsized":"2024-09-11T22:04:17.401828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:19.240354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"85'148","reported_seq":391,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:19.483724+0000","last_change":"2024-09-11T22:01:28.522567+0000","last_active":"2024-09-11T22:04:19.483724+0000","last_peered":"2024-09-11T22:04:19.483724+0000","last_clean":"2024-09-11T22:04:19.483724+0000","last_became_active":"2024-09-11T22:01:28.522079+0000","last_became_peered":"2024-09-11T22:01:28.522079+0000","last_unstale":"2024-09-11T22:04:19.483724+0000","last_undegraded":"2024-09-11T22:04:19.483724+0000","last_fullsized":"2024-09-11T22:04:19.483724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_clean_scrub_stamp":"2024-09-11T21:58:11.245706+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:48.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365565+0000","last_change":"2024-09-11T22:02:34.080535+0000","last_active":"2024-09-11T22:04:17.365565+0000","last_peered":"2024-09-11T22:04:17.365565+0000","last_clean":"2024-09-11T22:04:17.365565+0000","last_became_active":"2024-09-11T22:02:34.079351+0000","last_became_peered":"2024-09-11T22:02:34.079351+0000","last_unstale":"2024-09-11T22:04:17.365565+0000","last_undegraded":"2024-09-11T22:04:17.365565+0000","last_fullsized":"2024-09-11T22:04:17.365565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:29.737198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400866+0000","last_change":"2024-09-11T22:02:36.104476+0000","last_active":"2024-09-11T22:04:17.400866+0000","last_peered":"2024-09-11T22:04:17.400866+0000","last_clean":"2024-09-11T22:04:17.400866+0000","last_became_active":"2024-09-11T22:02:36.104163+0000","last_became_peered":"2024-09-11T22:02:36.104163+0000","last_unstale":"2024-09-11T22:04:17.400866+0000","last_undegraded":"2024-09-11T22:04:17.400866+0000","last_fullsized":"2024-09-11T22:04:17.400866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.570125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362393+0000","last_change":"2024-09-11T22:02:34.079652+0000","last_active":"2024-09-11T22:04:17.362393+0000","last_peered":"2024-09-11T22:04:17.362393+0000","last_clean":"2024-09-11T22:04:17.362393+0000","last_became_active":"2024-09-11T22:02:34.079365+0000","last_became_peered":"2024-09-11T22:02:34.079365+0000","last_unstale":"2024-09-11T22:04:17.362393+0000","last_undegraded":"2024-09-11T22:04:17.362393+0000","last_fullsized":"2024-09-11T22:04:17.362393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:15.371852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399253+0000","last_change":"2024-09-11T22:02:36.107209+0000","last_active":"2024-09-11T22:04:17.399253+0000","last_peered":"2024-09-11T22:04:17.399253+0000","last_clean":"2024-09-11T22:04:17.399253+0000","last_became_active":"2024-09-11T22:02:36.106896+0000","last_became_peered":"2024-09-11T22:02:36.106896+0000","last_unstale":"2024-09-11T22:04:17.399253+0000","last_undegraded":"2024-09-11T22:04:17.399253+0000","last_fullsized":"2024-09-11T22:04:17.399253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:04.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:26.984181+0000","last_change":"2024-09-11T22:02:34.088531+0000","last_active":"2024-09-11T22:04:26.984181+0000","last_peered":"2024-09-11T22:04:26.984181+0000","last_clean":"2024-09-11T22:04:26.984181+0000","last_became_active":"2024-09-11T22:02:34.088252+0000","last_became_peered":"2024-09-11T22:02:34.088252+0000","last_unstale":"2024-09-11T22:04:26.984181+0000","last_undegraded":"2024-09-11T22:04:26.984181+0000","last_fullsized":"2024-09-11T22:04:26.984181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:43.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.389359+0000","last_change":"2024-09-11T22:02:36.108963+0000","last_active":"2024-09-11T22:04:17.389359+0000","last_peered":"2024-09-11T22:04:17.389359+0000","last_clean":"2024-09-11T22:04:17.389359+0000","last_became_active":"2024-09-11T22:02:36.108435+0000","last_became_peered":"2024-09-11T22:02:36.108435+0000","last_unstale":"2024-09-11T22:04:17.389359+0000","last_undegraded":"2024-09-11T22:04:17.389359+0000","last_fullsized":"2024-09-11T22:04:17.389359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:11.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.361831+0000","last_change":"2024-09-11T22:02:34.084283+0000","last_active":"2024-09-11T22:04:17.361831+0000","last_peered":"2024-09-11T22:04:17.361831+0000","last_clean":"2024-09-11T22:04:17.361831+0000","last_became_active":"2024-09-11T22:02:34.083948+0000","last_became_peered":"2024-09-11T22:02:34.083948+0000","last_unstale":"2024-09-11T22:04:17.361831+0000","last_undegraded":"2024-09-11T22:04:17.361831+0000","last_fullsized":"2024-09-11T22:04:17.361831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:48.763643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.391536+0000","last_change":"2024-09-11T22:02:36.102147+0000","last_active":"2024-09-11T22:04:17.391536+0000","last_peered":"2024-09-11T22:04:17.391536+0000","last_clean":"2024-09-11T22:04:17.391536+0000","last_became_active":"2024-09-11T22:02:36.101641+0000","last_became_peered":"2024-09-11T22:02:36.101641+0000","last_unstale":"2024-09-11T22:04:17.391536+0000","last_undegraded":"2024-09-11T22:04:17.391536+0000","last_fullsized":"2024-09-11T22:04:17.391536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:58.145304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358234+0000","last_change":"2024-09-11T22:02:34.090538+0000","last_active":"2024-09-11T22:04:17.358234+0000","last_peered":"2024-09-11T22:04:17.358234+0000","last_clean":"2024-09-11T22:04:17.358234+0000","last_became_active":"2024-09-11T22:02:34.090238+0000","last_became_peered":"2024-09-11T22:02:34.090238+0000","last_unstale":"2024-09-11T22:04:17.358234+0000","last_undegraded":"2024-09-11T22:04:17.358234+0000","last_fullsized":"2024-09-11T22:04:17.358234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:47.037999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397510+0000","last_change":"2024-09-11T22:02:36.095664+0000","last_active":"2024-09-11T22:04:17.397510+0000","last_peered":"2024-09-11T22:04:17.397510+0000","last_clean":"2024-09-11T22:04:17.397510+0000","last_became_active":"2024-09-11T22:02:36.095304+0000","last_became_peered":"2024-09-11T22:02:36.095304+0000","last_unstale":"2024-09-11T22:04:17.397510+0000","last_undegraded":"2024-09-11T22:04:17.397510+0000","last_fullsized":"2024-09-11T22:04:17.397510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.484809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368818+0000","last_change":"2024-09-11T22:02:34.089781+0000","last_active":"2024-09-11T22:04:17.368818+0000","last_peered":"2024-09-11T22:04:17.368818+0000","last_clean":"2024-09-11T22:04:17.368818+0000","last_became_active":"2024-09-11T22:02:34.089439+0000","last_became_peered":"2024-09-11T22:02:34.089439+0000","last_unstale":"2024-09-11T22:04:17.368818+0000","last_undegraded":"2024-09-11T22:04:17.368818+0000","last_fullsized":"2024-09-11T22:04:17.368818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:38.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400049+0000","last_change":"2024-09-11T22:02:36.107159+0000","last_active":"2024-09-11T22:04:17.400049+0000","last_peered":"2024-09-11T22:04:17.400049+0000","last_clean":"2024-09-11T22:04:17.400049+0000","last_became_active":"2024-09-11T22:02:36.106846+0000","last_became_peered":"2024-09-11T22:02:36.106846+0000","last_unstale":"2024-09-11T22:04:17.400049+0000","last_undegraded":"2024-09-11T22:04:17.400049+0000","last_fullsized":"2024-09-11T22:04:17.400049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.972944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'72","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:28.318602+0000","last_change":"2024-09-11T22:02:55.352887+0000","last_active":"2024-09-11T22:04:28.318602+0000","last_peered":"2024-09-11T22:04:28.318602+0000","last_clean":"2024-09-11T22:04:28.318602+0000","last_became_active":"2024-09-11T22:02:55.348619+0000","last_became_peered":"2024-09-11T22:02:55.348619+0000","last_unstale":"2024-09-11T22:04:28.318602+0000","last_undegraded":"2024-09-11T22:04:28.318602+0000","last_fullsized":"2024-09-11T22:04:28.318602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:51.259114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":160,"num_write":131,"num_write_kb":1159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399780+0000","last_change":"2024-09-11T22:02:36.108560+0000","last_active":"2024-09-11T22:04:17.399780+0000","last_peered":"2024-09-11T22:04:17.399780+0000","last_clean":"2024-09-11T22:04:17.399780+0000","last_became_active":"2024-09-11T22:02:36.107593+0000","last_became_peered":"2024-09-11T22:02:36.107593+0000","last_unstale":"2024-09-11T22:04:17.399780+0000","last_undegraded":"2024-09-11T22:04:17.399780+0000","last_fullsized":"2024-09-11T22:04:17.399780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.479991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365257+0000","last_change":"2024-09-11T22:02:34.087394+0000","last_active":"2024-09-11T22:04:17.365257+0000","last_peered":"2024-09-11T22:04:17.365257+0000","last_clean":"2024-09-11T22:04:17.365257+0000","last_became_active":"2024-09-11T22:02:34.087146+0000","last_became_peered":"2024-09-11T22:02:34.087146+0000","last_unstale":"2024-09-11T22:04:17.365257+0000","last_undegraded":"2024-09-11T22:04:17.365257+0000","last_fullsized":"2024-09-11T22:04:17.365257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:30.772437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412826+0000","last_change":"2024-09-11T22:02:55.545065+0000","last_active":"2024-09-11T22:04:17.412826+0000","last_peered":"2024-09-11T22:04:17.412826+0000","last_clean":"2024-09-11T22:04:17.412826+0000","last_became_active":"2024-09-11T22:02:55.544736+0000","last_became_peered":"2024-09-11T22:02:55.544736+0000","last_unstale":"2024-09-11T22:04:17.412826+0000","last_undegraded":"2024-09-11T22:04:17.412826+0000","last_fullsized":"2024-09-11T22:04:17.412826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:23.706253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358626+0000","last_change":"2024-09-11T22:02:34.088717+0000","last_active":"2024-09-11T22:04:17.358626+0000","last_peered":"2024-09-11T22:04:17.358626+0000","last_clean":"2024-09-11T22:04:17.358626+0000","last_became_active":"2024-09-11T22:02:34.088412+0000","last_became_peered":"2024-09-11T22:02:34.088412+0000","last_unstale":"2024-09-11T22:04:17.358626+0000","last_undegraded":"2024-09-11T22:04:17.358626+0000","last_fullsized":"2024-09-11T22:04:17.358626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.376778+0000","last_change":"2024-09-11T22:02:36.103781+0000","last_active":"2024-09-11T22:04:17.376778+0000","last_peered":"2024-09-11T22:04:17.376778+0000","last_clean":"2024-09-11T22:04:17.376778+0000","last_became_active":"2024-09-11T22:02:36.103426+0000","last_became_peered":"2024-09-11T22:02:36.103426+0000","last_unstale":"2024-09-11T22:04:17.376778+0000","last_undegraded":"2024-09-11T22:04:17.376778+0000","last_fullsized":"2024-09-11T22:04:17.376778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:34.962793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.357294+0000","last_change":"2024-09-11T22:02:34.080333+0000","last_active":"2024-09-11T22:04:17.357294+0000","last_peered":"2024-09-11T22:04:17.357294+0000","last_clean":"2024-09-11T22:04:17.357294+0000","last_became_active":"2024-09-11T22:02:34.079384+0000","last_became_peered":"2024-09-11T22:02:34.079384+0000","last_unstale":"2024-09-11T22:04:17.357294+0000","last_undegraded":"2024-09-11T22:04:17.357294+0000","last_fullsized":"2024-09-11T22:04:17.357294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:38.313516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414236+0000","last_change":"2024-09-11T22:02:36.103306+0000","last_active":"2024-09-11T22:04:17.414236+0000","last_peered":"2024-09-11T22:04:17.414236+0000","last_clean":"2024-09-11T22:04:17.414236+0000","last_became_active":"2024-09-11T22:02:36.102967+0000","last_became_peered":"2024-09-11T22:02:36.102967+0000","last_unstale":"2024-09-11T22:04:17.414236+0000","last_undegraded":"2024-09-11T22:04:17.414236+0000","last_fullsized":"2024-09-11T22:04:17.414236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:34.138931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365503+0000","last_change":"2024-09-11T22:02:55.355119+0000","last_active":"2024-09-11T22:04:17.365503+0000","last_peered":"2024-09-11T22:04:17.365503+0000","last_clean":"2024-09-11T22:04:17.365503+0000","last_became_active":"2024-09-11T22:02:55.350440+0000","last_became_peered":"2024-09-11T22:02:55.350440+0000","last_unstale":"2024-09-11T22:04:17.365503+0000","last_undegraded":"2024-09-11T22:04:17.365503+0000","last_fullsized":"2024-09-11T22:04:17.365503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:47.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398642+0000","last_change":"2024-09-11T22:02:36.102491+0000","last_active":"2024-09-11T22:04:17.398642+0000","last_peered":"2024-09-11T22:04:17.398642+0000","last_clean":"2024-09-11T22:04:17.398642+0000","last_became_active":"2024-09-11T22:02:36.102112+0000","last_became_peered":"2024-09-11T22:02:36.102112+0000","last_unstale":"2024-09-11T22:04:17.398642+0000","last_undegraded":"2024-09-11T22:04:17.398642+0000","last_fullsized":"2024-09-11T22:04:17.398642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:47.588539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.367510+0000","last_change":"2024-09-11T22:02:34.082590+0000","last_active":"2024-09-11T22:04:17.367510+0000","last_peered":"2024-09-11T22:04:17.367510+0000","last_clean":"2024-09-11T22:04:17.367510+0000","last_became_active":"2024-09-11T22:02:34.082288+0000","last_became_peered":"2024-09-11T22:02:34.082288+0000","last_unstale":"2024-09-11T22:04:17.367510+0000","last_undegraded":"2024-09-11T22:04:17.367510+0000","last_fullsized":"2024-09-11T22:04:17.367510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:57.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402698+0000","last_change":"2024-09-11T22:02:36.105247+0000","last_active":"2024-09-11T22:04:17.402698+0000","last_peered":"2024-09-11T22:04:17.402698+0000","last_clean":"2024-09-11T22:04:17.402698+0000","last_became_active":"2024-09-11T22:02:36.104912+0000","last_became_peered":"2024-09-11T22:02:36.104912+0000","last_unstale":"2024-09-11T22:04:17.402698+0000","last_undegraded":"2024-09-11T22:04:17.402698+0000","last_fullsized":"2024-09-11T22:04:17.402698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:05.396671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398828+0000","last_change":"2024-09-11T22:02:55.544428+0000","last_active":"2024-09-11T22:04:17.398828+0000","last_peered":"2024-09-11T22:04:17.398828+0000","last_clean":"2024-09-11T22:04:17.398828+0000","last_became_active":"2024-09-11T22:02:55.544151+0000","last_became_peered":"2024-09-11T22:02:55.544151+0000","last_unstale":"2024-09-11T22:04:17.398828+0000","last_undegraded":"2024-09-11T22:04:17.398828+0000","last_fullsized":"2024-09-11T22:04:17.398828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.100131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368511+0000","last_change":"2024-09-11T22:02:34.079017+0000","last_active":"2024-09-11T22:04:17.368511+0000","last_peered":"2024-09-11T22:04:17.368511+0000","last_clean":"2024-09-11T22:04:17.368511+0000","last_became_active":"2024-09-11T22:02:34.078663+0000","last_became_peered":"2024-09-11T22:02:34.078663+0000","last_unstale":"2024-09-11T22:04:17.368511+0000","last_undegraded":"2024-09-11T22:04:17.368511+0000","last_fullsized":"2024-09-11T22:04:17.368511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:05.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406599+0000","last_change":"2024-09-11T22:02:36.097768+0000","last_active":"2024-09-11T22:04:17.406599+0000","last_peered":"2024-09-11T22:04:17.406599+0000","last_clean":"2024-09-11T22:04:17.406599+0000","last_became_active":"2024-09-11T22:02:36.097396+0000","last_became_peered":"2024-09-11T22:02:36.097396+0000","last_unstale":"2024-09-11T22:04:17.406599+0000","last_undegraded":"2024-09-11T22:04:17.406599+0000","last_fullsized":"2024-09-11T22:04:17.406599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:35.673268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368326+0000","last_change":"2024-09-11T22:02:55.355229+0000","last_active":"2024-09-11T22:04:17.368326+0000","last_peered":"2024-09-11T22:04:17.368326+0000","last_clean":"2024-09-11T22:04:17.368326+0000","last_became_active":"2024-09-11T22:02:55.350492+0000","last_became_peered":"2024-09-11T22:02:55.350492+0000","last_unstale":"2024-09-11T22:04:17.368326+0000","last_undegraded":"2024-09-11T22:04:17.368326+0000","last_fullsized":"2024-09-11T22:04:17.368326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:03:31.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412937+0000","last_change":"2024-09-11T22:02:36.108992+0000","last_active":"2024-09-11T22:04:17.412937+0000","last_peered":"2024-09-11T22:04:17.412937+0000","last_clean":"2024-09-11T22:04:17.412937+0000","last_became_active":"2024-09-11T22:02:36.108674+0000","last_became_peered":"2024-09-11T22:02:36.108674+0000","last_unstale":"2024-09-11T22:04:17.412937+0000","last_undegraded":"2024-09-11T22:04:17.412937+0000","last_fullsized":"2024-09-11T22:04:17.412937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:57.083127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358697+0000","last_change":"2024-09-11T22:02:34.088833+0000","last_active":"2024-09-11T22:04:17.358697+0000","last_peered":"2024-09-11T22:04:17.358697+0000","last_clean":"2024-09-11T22:04:17.358697+0000","last_became_active":"2024-09-11T22:02:34.088275+0000","last_became_peered":"2024-09-11T22:02:34.088275+0000","last_unstale":"2024-09-11T22:04:17.358697+0000","last_undegraded":"2024-09-11T22:04:17.358697+0000","last_fullsized":"2024-09-11T22:04:17.358697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:31.167486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403337+0000","last_change":"2024-09-11T22:02:36.108154+0000","last_active":"2024-09-11T22:04:17.403337+0000","last_peered":"2024-09-11T22:04:17.403337+0000","last_clean":"2024-09-11T22:04:17.403337+0000","last_became_active":"2024-09-11T22:02:36.107817+0000","last_became_peered":"2024-09-11T22:02:36.107817+0000","last_unstale":"2024-09-11T22:04:17.403337+0000","last_undegraded":"2024-09-11T22:04:17.403337+0000","last_fullsized":"2024-09-11T22:04:17.403337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.168339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358899+0000","last_change":"2024-09-11T22:02:34.082193+0000","last_active":"2024-09-11T22:04:17.358899+0000","last_peered":"2024-09-11T22:04:17.358899+0000","last_clean":"2024-09-11T22:04:17.358899+0000","last_became_active":"2024-09-11T22:02:34.081852+0000","last_became_peered":"2024-09-11T22:02:34.081852+0000","last_unstale":"2024-09-11T22:04:17.358899+0000","last_undegraded":"2024-09-11T22:04:17.358899+0000","last_fullsized":"2024-09-11T22:04:17.358899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:08.319444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797484,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":858,"num_read_kb":587,"num_write":362,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2392452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514531,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32488,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712664,"statfs":{"total":95995035648,"available":95961767936,"internally_reserved":0,"allocated":1331200,"data_stored":845532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28760,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716392,"statfs":{"total":95995035648,"available":95965585408,"internally_reserved":0,"allocated":1777664,"data_stored":1246503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906989,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28340,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716812,"statfs":{"total":95995035648,"available":95966015488,"internally_reserved":0,"allocated":1347584,"data_stored":845768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":452472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397558,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1047044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528379,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":451941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28740,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716412,"statfs":{"total":95995035648,"available":95965605888,"internally_reserved":0,"allocated":1695744,"data_stored":1176615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953541,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":454091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1173700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":523797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":521127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":453212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":72063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":400916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:04:33.039 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T22:04:33.039 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:04:33.286 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:33.698 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:33 smithi179 ceph-mon[35603]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:33.727 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:33 smithi193 ceph-mon[35545]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:33.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:33 smithi152 ceph-mon[31188]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:33.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.810+0000 7f1910c66640 1 -- 172.21.15.152:0/3195981334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190c100e20 msgr2=0x7f190c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:33.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.810+0000 7f1910c66640 1 --2- 172.21.15.152:0/3195981334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190c100e20 0x7f190c101200 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1904009ca0 tx=0x7f190402a950 comp rx=0 tx=0).stop 2024-09-11T22:04:33.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.810+0000 7f1910c66640 1 -- 172.21.15.152:0/3195981334 shutdown_connections 2024-09-11T22:04:33.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.810+0000 7f1910c66640 1 --2- 172.21.15.152:0/3195981334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f190c102ef0 0x7f190c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:33.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.810+0000 7f1910c66640 1 --2- 172.21.15.152:0/3195981334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f190c102570 0x7f190c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:33.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.810+0000 7f1910c66640 1 --2- 172.21.15.152:0/3195981334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190c100e20 0x7f190c101200 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:33.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.810+0000 7f1910c66640 1 -- 172.21.15.152:0/3195981334 >> 172.21.15.152:0/3195981334 conn(0x7f190c0fc7d0 msgr2=0x7f190c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:33.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.810+0000 7f1910c66640 1 -- 172.21.15.152:0/3195981334 shutdown_connections 2024-09-11T22:04:33.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.810+0000 7f1910c66640 1 -- 172.21.15.152:0/3195981334 wait complete. 2024-09-11T22:04:33.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f1910c66640 1 Processor -- start 2024-09-11T22:04:33.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f1910c66640 1 -- start start 2024-09-11T22:04:33.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f1910c66640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190c100e20 0x7f190c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:33.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f1910c66640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f190c102570 0x7f190c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:33.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f1910c66640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f190c102ef0 0x7f190c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f1910c66640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f190c110fc0 con 0x7f190c100e20 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f1910c66640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f190c110e40 con 0x7f190c102570 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f1910c66640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f190c111140 con 0x7f190c102ef0 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f190a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190c100e20 0x7f190c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f190a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190c100e20 0x7f190c198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33836/0 (socket says 172.21.15.152:33836) 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f190a59c640 1 -- 172.21.15.152:0/2828547020 learned_addr learned my addr 172.21.15.152:0/2828547020 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f190ad9d640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f190c102ef0 0x7f190c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f1909d9b640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f190c102570 0x7f190c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f190a59c640 1 -- 172.21.15.152:0/2828547020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f190c102ef0 msgr2=0x7f190c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f190a59c640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f190c102ef0 0x7f190c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f190a59c640 1 -- 172.21.15.152:0/2828547020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f190c102570 msgr2=0x7f190c198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:33.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f190a59c640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f190c102570 0x7f190c198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:33.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.811+0000 7f190a59c640 1 -- 172.21.15.152:0/2828547020 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190c19d500 con 0x7f190c100e20 2024-09-11T22:04:33.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.812+0000 7f190a59c640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190c100e20 0x7f190c198550 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1904005cc0 tx=0x7f190402f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:33.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.812+0000 7f19037fe640 1 -- 172.21.15.152:0/2828547020 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904034040 con 0x7f190c100e20 2024-09-11T22:04:33.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.812+0000 7f19037fe640 1 -- 172.21.15.152:0/2828547020 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1904030920 con 0x7f190c100e20 2024-09-11T22:04:33.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.812+0000 7f1910c66640 1 -- 172.21.15.152:0/2828547020 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190c19d790 con 0x7f190c100e20 2024-09-11T22:04:33.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.812+0000 7f19037fe640 1 -- 172.21.15.152:0/2828547020 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904004830 con 0x7f190c100e20 2024-09-11T22:04:33.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.812+0000 7f1910c66640 1 -- 172.21.15.152:0/2828547020 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190c1a50d0 con 0x7f190c100e20 2024-09-11T22:04:33.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.813+0000 7f1910c66640 1 -- 172.21.15.152:0/2828547020 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f190c101200 con 0x7f190c100e20 2024-09-11T22:04:33.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.814+0000 7f19037fe640 1 -- 172.21.15.152:0/2828547020 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f1904037020 con 0x7f190c100e20 2024-09-11T22:04:33.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.815+0000 7f19037fe640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18f80a2e10 0x7f18f80a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:33.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.815+0000 7f1909d9b640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18f80a2e10 0x7f18f80a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:33.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.815+0000 7f19037fe640 1 -- 172.21.15.152:0/2828547020 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f19040f05e0 con 0x7f190c100e20 2024-09-11T22:04:33.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.815+0000 7f1909d9b640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18f80a2e10 0x7f18f80a52d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f190c0ffee0 tx=0x7f18f400b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:33.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.819+0000 7f19037fe640 1 -- 172.21.15.152:0/2828547020 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19040bd090 con 0x7f190c100e20 2024-09-11T22:04:33.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.980+0000 7f1910c66640 1 -- 172.21.15.152:0/2828547020 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f190c1068a0 con 0x7f18f80a2e10 2024-09-11T22:04:33.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.986+0000 7f19037fe640 1 -- 172.21.15.152:0/2828547020 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257761 (secure 0 0 0) 0x7f190c1068a0 con 0x7f18f80a2e10 2024-09-11T22:04:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:33.990 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-09-11T22:04:33.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.989+0000 7f1910c66640 1 -- 172.21.15.152:0/2828547020 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18f80a2e10 msgr2=0x7f18f80a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.989+0000 7f1910c66640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18f80a2e10 0x7f18f80a52d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f190c0ffee0 tx=0x7f18f400b390 comp rx=0 tx=0).stop 2024-09-11T22:04:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.989+0000 7f1910c66640 1 -- 172.21.15.152:0/2828547020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190c100e20 msgr2=0x7f190c198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.989+0000 7f1910c66640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190c100e20 0x7f190c198550 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1904005cc0 tx=0x7f190402f650 comp rx=0 tx=0).stop 2024-09-11T22:04:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.990+0000 7f1910c66640 1 -- 172.21.15.152:0/2828547020 shutdown_connections 2024-09-11T22:04:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.990+0000 7f1910c66640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18f80a2e10 0x7f18f80a52d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.990+0000 7f1910c66640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f190c102ef0 0x7f190c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.990+0000 7f1910c66640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f190c102570 0x7f190c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.990+0000 7f1910c66640 1 --2- 172.21.15.152:0/2828547020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190c100e20 0x7f190c198550 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.990+0000 7f1910c66640 1 -- 172.21.15.152:0/2828547020 >> 172.21.15.152:0/2828547020 conn(0x7f190c0fc7d0 msgr2=0x7f190c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.990+0000 7f1910c66640 1 -- 172.21.15.152:0/2828547020 shutdown_connections 2024-09-11T22:04:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:33.990+0000 7f1910c66640 1 -- 172.21.15.152:0/2828547020 wait complete. 2024-09-11T22:04:34.710 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:34 smithi179 ceph-mon[35603]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-11T22:04:34.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:34 smithi152 ceph-mon[31188]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-11T22:04:34.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:34 smithi193 ceph-mon[35545]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-11T22:04:34.843 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-11T22:04:33.373206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1388086,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1268,"num_read_kb":1062,"num_write":627,"num_write_kb":5298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":961,"ondisk_log_size":961,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369052,"kb_used_data":15264,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124572772,"statfs":{"total":1151940427776,"available":1151562518528,"internally_reserved":0,"allocated":15630336,"data_stored":9585066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":199938,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":493,"num_write":153,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002311"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414391+0000","last_change":"2024-09-11T22:02:36.105689+0000","last_active":"2024-09-11T22:04:17.414391+0000","last_peered":"2024-09-11T22:04:17.414391+0000","last_clean":"2024-09-11T22:04:17.414391+0000","last_became_active":"2024-09-11T22:02:36.105128+0000","last_became_peered":"2024-09-11T22:02:36.105128+0000","last_unstale":"2024-09-11T22:04:17.414391+0000","last_undegraded":"2024-09-11T22:04:17.414391+0000","last_fullsized":"2024-09-11T22:04:17.414391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:18.018731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.410505+0000","last_change":"2024-09-11T22:02:36.096961+0000","last_active":"2024-09-11T22:04:17.410505+0000","last_peered":"2024-09-11T22:04:17.410505+0000","last_clean":"2024-09-11T22:04:17.410505+0000","last_became_active":"2024-09-11T22:02:36.096540+0000","last_became_peered":"2024-09-11T22:02:36.096540+0000","last_unstale":"2024-09-11T22:04:17.410505+0000","last_undegraded":"2024-09-11T22:04:17.410505+0000","last_fullsized":"2024-09-11T22:04:17.410505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:48.517125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413305+0000","last_change":"2024-09-11T22:02:36.108119+0000","last_active":"2024-09-11T22:04:17.413305+0000","last_peered":"2024-09-11T22:04:17.413305+0000","last_clean":"2024-09-11T22:04:17.413305+0000","last_became_active":"2024-09-11T22:02:36.107737+0000","last_became_peered":"2024-09-11T22:02:36.107737+0000","last_unstale":"2024-09-11T22:04:17.413305+0000","last_undegraded":"2024-09-11T22:04:17.413305+0000","last_fullsized":"2024-09-11T22:04:17.413305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:54.225935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395071+0000","last_change":"2024-09-11T22:02:36.107710+0000","last_active":"2024-09-11T22:04:17.395071+0000","last_peered":"2024-09-11T22:04:17.395071+0000","last_clean":"2024-09-11T22:04:17.395071+0000","last_became_active":"2024-09-11T22:02:36.107327+0000","last_became_peered":"2024-09-11T22:02:36.107327+0000","last_unstale":"2024-09-11T22:04:17.395071+0000","last_undegraded":"2024-09-11T22:04:17.395071+0000","last_fullsized":"2024-09-11T22:04:17.395071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.358535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396846+0000","last_change":"2024-09-11T22:02:36.100531+0000","last_active":"2024-09-11T22:04:17.396846+0000","last_peered":"2024-09-11T22:04:17.396846+0000","last_clean":"2024-09-11T22:04:17.396846+0000","last_became_active":"2024-09-11T22:02:36.100187+0000","last_became_peered":"2024-09-11T22:02:36.100187+0000","last_unstale":"2024-09-11T22:04:17.396846+0000","last_undegraded":"2024-09-11T22:04:17.396846+0000","last_fullsized":"2024-09-11T22:04:17.396846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.156080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397927+0000","last_change":"2024-09-11T22:02:36.101316+0000","last_active":"2024-09-11T22:04:17.397927+0000","last_peered":"2024-09-11T22:04:17.397927+0000","last_clean":"2024-09-11T22:04:17.397927+0000","last_became_active":"2024-09-11T22:02:36.100985+0000","last_became_peered":"2024-09-11T22:02:36.100985+0000","last_unstale":"2024-09-11T22:04:17.397927+0000","last_undegraded":"2024-09-11T22:04:17.397927+0000","last_fullsized":"2024-09-11T22:04:17.397927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:55.972974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.385307+0000","last_change":"2024-09-11T22:02:36.109146+0000","last_active":"2024-09-11T22:04:17.385307+0000","last_peered":"2024-09-11T22:04:17.385307+0000","last_clean":"2024-09-11T22:04:17.385307+0000","last_became_active":"2024-09-11T22:02:36.108817+0000","last_became_peered":"2024-09-11T22:02:36.108817+0000","last_unstale":"2024-09-11T22:04:17.385307+0000","last_undegraded":"2024-09-11T22:04:17.385307+0000","last_fullsized":"2024-09-11T22:04:17.385307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.222383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398948+0000","last_change":"2024-09-11T22:02:36.100362+0000","last_active":"2024-09-11T22:04:17.398948+0000","last_peered":"2024-09-11T22:04:17.398948+0000","last_clean":"2024-09-11T22:04:17.398948+0000","last_became_active":"2024-09-11T22:02:36.100088+0000","last_became_peered":"2024-09-11T22:02:36.100088+0000","last_unstale":"2024-09-11T22:04:17.398948+0000","last_undegraded":"2024-09-11T22:04:17.398948+0000","last_fullsized":"2024-09-11T22:04:17.398948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.478879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401808+0000","last_change":"2024-09-11T22:02:36.106360+0000","last_active":"2024-09-11T22:04:17.401808+0000","last_peered":"2024-09-11T22:04:17.401808+0000","last_clean":"2024-09-11T22:04:17.401808+0000","last_became_active":"2024-09-11T22:02:36.105994+0000","last_became_peered":"2024-09-11T22:02:36.105994+0000","last_unstale":"2024-09-11T22:04:17.401808+0000","last_undegraded":"2024-09-11T22:04:17.401808+0000","last_fullsized":"2024-09-11T22:04:17.401808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:33.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.394089+0000","last_change":"2024-09-11T22:02:36.109477+0000","last_active":"2024-09-11T22:04:17.394089+0000","last_peered":"2024-09-11T22:04:17.394089+0000","last_clean":"2024-09-11T22:04:17.394089+0000","last_became_active":"2024-09-11T22:02:36.109077+0000","last_became_peered":"2024-09-11T22:02:36.109077+0000","last_unstale":"2024-09-11T22:04:17.394089+0000","last_undegraded":"2024-09-11T22:04:17.394089+0000","last_fullsized":"2024-09-11T22:04:17.394089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.862359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399588+0000","last_change":"2024-09-11T22:02:36.112998+0000","last_active":"2024-09-11T22:04:17.399588+0000","last_peered":"2024-09-11T22:04:17.399588+0000","last_clean":"2024-09-11T22:04:17.399588+0000","last_became_active":"2024-09-11T22:02:36.112649+0000","last_became_peered":"2024-09-11T22:02:36.112649+0000","last_unstale":"2024-09-11T22:04:17.399588+0000","last_undegraded":"2024-09-11T22:04:17.399588+0000","last_fullsized":"2024-09-11T22:04:17.399588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:01.582572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398221+0000","last_change":"2024-09-11T22:02:36.099591+0000","last_active":"2024-09-11T22:04:17.398221+0000","last_peered":"2024-09-11T22:04:17.398221+0000","last_clean":"2024-09-11T22:04:17.398221+0000","last_became_active":"2024-09-11T22:02:36.099269+0000","last_became_peered":"2024-09-11T22:02:36.099269+0000","last_unstale":"2024-09-11T22:04:17.398221+0000","last_undegraded":"2024-09-11T22:04:17.398221+0000","last_fullsized":"2024-09-11T22:04:17.398221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:10.918188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403970+0000","last_change":"2024-09-11T22:02:36.100056+0000","last_active":"2024-09-11T22:04:17.403970+0000","last_peered":"2024-09-11T22:04:17.403970+0000","last_clean":"2024-09-11T22:04:17.403970+0000","last_became_active":"2024-09-11T22:02:36.099717+0000","last_became_peered":"2024-09-11T22:02:36.099717+0000","last_unstale":"2024-09-11T22:04:17.403970+0000","last_undegraded":"2024-09-11T22:04:17.403970+0000","last_fullsized":"2024-09-11T22:04:17.403970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.486256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411675+0000","last_change":"2024-09-11T22:02:36.097281+0000","last_active":"2024-09-11T22:04:17.411675+0000","last_peered":"2024-09-11T22:04:17.411675+0000","last_clean":"2024-09-11T22:04:17.411675+0000","last_became_active":"2024-09-11T22:02:36.096768+0000","last_became_peered":"2024-09-11T22:02:36.096768+0000","last_unstale":"2024-09-11T22:04:17.411675+0000","last_undegraded":"2024-09-11T22:04:17.411675+0000","last_fullsized":"2024-09-11T22:04:17.411675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:31.232578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412627+0000","last_change":"2024-09-11T22:02:55.351065+0000","last_active":"2024-09-11T22:04:17.412627+0000","last_peered":"2024-09-11T22:04:17.412627+0000","last_clean":"2024-09-11T22:04:17.412627+0000","last_became_active":"2024-09-11T22:02:55.350669+0000","last_became_peered":"2024-09-11T22:02:55.350669+0000","last_unstale":"2024-09-11T22:04:17.412627+0000","last_undegraded":"2024-09-11T22:04:17.412627+0000","last_fullsized":"2024-09-11T22:04:17.412627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:51.799060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414040+0000","last_change":"2024-09-11T22:02:36.109573+0000","last_active":"2024-09-11T22:04:17.414040+0000","last_peered":"2024-09-11T22:04:17.414040+0000","last_clean":"2024-09-11T22:04:17.414040+0000","last_became_active":"2024-09-11T22:02:36.109019+0000","last_became_peered":"2024-09-11T22:02:36.109019+0000","last_unstale":"2024-09-11T22:04:17.414040+0000","last_undegraded":"2024-09-11T22:04:17.414040+0000","last_fullsized":"2024-09-11T22:04:17.414040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:39.699762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414508+0000","last_change":"2024-09-11T22:02:36.105427+0000","last_active":"2024-09-11T22:04:17.414508+0000","last_peered":"2024-09-11T22:04:17.414508+0000","last_clean":"2024-09-11T22:04:17.414508+0000","last_became_active":"2024-09-11T22:02:36.104712+0000","last_became_peered":"2024-09-11T22:02:36.104712+0000","last_unstale":"2024-09-11T22:04:17.414508+0000","last_undegraded":"2024-09-11T22:04:17.414508+0000","last_fullsized":"2024-09-11T22:04:17.414508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:45.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399613+0000","last_change":"2024-09-11T22:02:36.097925+0000","last_active":"2024-09-11T22:04:17.399613+0000","last_peered":"2024-09-11T22:04:17.399613+0000","last_clean":"2024-09-11T22:04:17.399613+0000","last_became_active":"2024-09-11T22:02:36.097649+0000","last_became_peered":"2024-09-11T22:02:36.097649+0000","last_unstale":"2024-09-11T22:04:17.399613+0000","last_undegraded":"2024-09-11T22:04:17.399613+0000","last_fullsized":"2024-09-11T22:04:17.399613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.272197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400978+0000","last_change":"2024-09-11T22:02:36.107266+0000","last_active":"2024-09-11T22:04:17.400978+0000","last_peered":"2024-09-11T22:04:17.400978+0000","last_clean":"2024-09-11T22:04:17.400978+0000","last_became_active":"2024-09-11T22:02:36.106865+0000","last_became_peered":"2024-09-11T22:02:36.106865+0000","last_unstale":"2024-09-11T22:04:17.400978+0000","last_undegraded":"2024-09-11T22:04:17.400978+0000","last_fullsized":"2024-09-11T22:04:17.400978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:53.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396320+0000","last_change":"2024-09-11T22:02:55.349854+0000","last_active":"2024-09-11T22:04:17.396320+0000","last_peered":"2024-09-11T22:04:17.396320+0000","last_clean":"2024-09-11T22:04:17.396320+0000","last_became_active":"2024-09-11T22:02:55.349521+0000","last_became_peered":"2024-09-11T22:02:55.349521+0000","last_unstale":"2024-09-11T22:04:17.396320+0000","last_undegraded":"2024-09-11T22:04:17.396320+0000","last_fullsized":"2024-09-11T22:04:17.396320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406936+0000","last_change":"2024-09-11T22:02:36.110460+0000","last_active":"2024-09-11T22:04:17.406936+0000","last_peered":"2024-09-11T22:04:17.406936+0000","last_clean":"2024-09-11T22:04:17.406936+0000","last_became_active":"2024-09-11T22:02:36.110136+0000","last_became_peered":"2024-09-11T22:02:36.110136+0000","last_unstale":"2024-09-11T22:04:17.406936+0000","last_undegraded":"2024-09-11T22:04:17.406936+0000","last_fullsized":"2024-09-11T22:04:17.406936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:30.644192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403836+0000","last_change":"2024-09-11T22:02:36.111403+0000","last_active":"2024-09-11T22:04:17.403836+0000","last_peered":"2024-09-11T22:04:17.403836+0000","last_clean":"2024-09-11T22:04:17.403836+0000","last_became_active":"2024-09-11T22:02:36.110976+0000","last_became_peered":"2024-09-11T22:02:36.110976+0000","last_unstale":"2024-09-11T22:04:17.403836+0000","last_undegraded":"2024-09-11T22:04:17.403836+0000","last_fullsized":"2024-09-11T22:04:17.403836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:03.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.405071+0000","last_change":"2024-09-11T22:02:36.110002+0000","last_active":"2024-09-11T22:04:17.405071+0000","last_peered":"2024-09-11T22:04:17.405071+0000","last_clean":"2024-09-11T22:04:17.405071+0000","last_became_active":"2024-09-11T22:02:36.109694+0000","last_became_peered":"2024-09-11T22:02:36.109694+0000","last_unstale":"2024-09-11T22:04:17.405071+0000","last_undegraded":"2024-09-11T22:04:17.405071+0000","last_fullsized":"2024-09-11T22:04:17.405071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:00.338509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406553+0000","last_change":"2024-09-11T22:02:36.101638+0000","last_active":"2024-09-11T22:04:17.406553+0000","last_peered":"2024-09-11T22:04:17.406553+0000","last_clean":"2024-09-11T22:04:17.406553+0000","last_became_active":"2024-09-11T22:02:36.101363+0000","last_became_peered":"2024-09-11T22:02:36.101363+0000","last_unstale":"2024-09-11T22:04:17.406553+0000","last_undegraded":"2024-09-11T22:04:17.406553+0000","last_fullsized":"2024-09-11T22:04:17.406553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:35.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399143+0000","last_change":"2024-09-11T22:02:36.109250+0000","last_active":"2024-09-11T22:04:17.399143+0000","last_peered":"2024-09-11T22:04:17.399143+0000","last_clean":"2024-09-11T22:04:17.399143+0000","last_became_active":"2024-09-11T22:02:36.108931+0000","last_became_peered":"2024-09-11T22:02:36.108931+0000","last_unstale":"2024-09-11T22:04:17.399143+0000","last_undegraded":"2024-09-11T22:04:17.399143+0000","last_fullsized":"2024-09-11T22:04:17.399143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:09.616621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400102+0000","last_change":"2024-09-11T22:02:36.113064+0000","last_active":"2024-09-11T22:04:17.400102+0000","last_peered":"2024-09-11T22:04:17.400102+0000","last_clean":"2024-09-11T22:04:17.400102+0000","last_became_active":"2024-09-11T22:02:36.112674+0000","last_became_peered":"2024-09-11T22:02:36.112674+0000","last_unstale":"2024-09-11T22:04:17.400102+0000","last_undegraded":"2024-09-11T22:04:17.400102+0000","last_fullsized":"2024-09-11T22:04:17.400102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:17.923053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.395397+0000","last_change":"2024-09-11T22:02:36.101799+0000","last_active":"2024-09-11T22:04:17.395397+0000","last_peered":"2024-09-11T22:04:17.395397+0000","last_clean":"2024-09-11T22:04:17.395397+0000","last_became_active":"2024-09-11T22:02:36.101429+0000","last_became_peered":"2024-09-11T22:02:36.101429+0000","last_unstale":"2024-09-11T22:04:17.395397+0000","last_undegraded":"2024-09-11T22:04:17.395397+0000","last_fullsized":"2024-09-11T22:04:17.395397+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.597619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402304+0000","last_change":"2024-09-11T22:02:36.100993+0000","last_active":"2024-09-11T22:04:17.402304+0000","last_peered":"2024-09-11T22:04:17.402304+0000","last_clean":"2024-09-11T22:04:17.402304+0000","last_became_active":"2024-09-11T22:02:36.100678+0000","last_became_peered":"2024-09-11T22:02:36.100678+0000","last_unstale":"2024-09-11T22:04:17.402304+0000","last_undegraded":"2024-09-11T22:04:17.402304+0000","last_fullsized":"2024-09-11T22:04:17.402304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:18.808422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.408677+0000","last_change":"2024-09-11T22:02:36.103507+0000","last_active":"2024-09-11T22:04:17.408677+0000","last_peered":"2024-09-11T22:04:17.408677+0000","last_clean":"2024-09-11T22:04:17.408677+0000","last_became_active":"2024-09-11T22:02:36.103228+0000","last_became_peered":"2024-09-11T22:02:36.103228+0000","last_unstale":"2024-09-11T22:04:17.408677+0000","last_undegraded":"2024-09-11T22:04:17.408677+0000","last_fullsized":"2024-09-11T22:04:17.408677+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.898635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.413675+0000","last_change":"2024-09-11T22:02:36.104734+0000","last_active":"2024-09-11T22:04:17.413675+0000","last_peered":"2024-09-11T22:04:17.413675+0000","last_clean":"2024-09-11T22:04:17.413675+0000","last_became_active":"2024-09-11T22:02:36.103974+0000","last_became_peered":"2024-09-11T22:02:36.103974+0000","last_unstale":"2024-09-11T22:04:17.413675+0000","last_undegraded":"2024-09-11T22:04:17.413675+0000","last_fullsized":"2024-09-11T22:04:17.413675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:54.142031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397564+0000","last_change":"2024-09-11T22:02:36.106103+0000","last_active":"2024-09-11T22:04:17.397564+0000","last_peered":"2024-09-11T22:04:17.397564+0000","last_clean":"2024-09-11T22:04:17.397564+0000","last_became_active":"2024-09-11T22:02:36.105792+0000","last_became_peered":"2024-09-11T22:02:36.105792+0000","last_unstale":"2024-09-11T22:04:17.397564+0000","last_undegraded":"2024-09-11T22:04:17.397564+0000","last_fullsized":"2024-09-11T22:04:17.397564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:06.607094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397456+0000","last_change":"2024-09-11T22:02:36.104147+0000","last_active":"2024-09-11T22:04:17.397456+0000","last_peered":"2024-09-11T22:04:17.397456+0000","last_clean":"2024-09-11T22:04:17.397456+0000","last_became_active":"2024-09-11T22:02:36.103782+0000","last_became_peered":"2024-09-11T22:02:36.103782+0000","last_unstale":"2024-09-11T22:04:17.397456+0000","last_undegraded":"2024-09-11T22:04:17.397456+0000","last_fullsized":"2024-09-11T22:04:17.397456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.127609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.392542+0000","last_change":"2024-09-11T22:02:36.101259+0000","last_active":"2024-09-11T22:04:17.392542+0000","last_peered":"2024-09-11T22:04:17.392542+0000","last_clean":"2024-09-11T22:04:17.392542+0000","last_became_active":"2024-09-11T22:02:36.100761+0000","last_became_peered":"2024-09-11T22:02:36.100761+0000","last_unstale":"2024-09-11T22:04:17.392542+0000","last_undegraded":"2024-09-11T22:04:17.392542+0000","last_fullsized":"2024-09-11T22:04:17.392542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:47.045252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":145,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:31.993818+0000","last_change":"2024-09-11T22:02:34.084522+0000","last_active":"2024-09-11T22:04:31.993818+0000","last_peered":"2024-09-11T22:04:31.993818+0000","last_clean":"2024-09-11T22:04:31.993818+0000","last_became_active":"2024-09-11T22:02:34.084211+0000","last_became_peered":"2024-09-11T22:02:34.084211+0000","last_unstale":"2024-09-11T22:04:31.993818+0000","last_undegraded":"2024-09-11T22:04:31.993818+0000","last_fullsized":"2024-09-11T22:04:31.993818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:18.963998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406451+0000","last_change":"2024-09-11T22:02:36.106890+0000","last_active":"2024-09-11T22:04:17.406451+0000","last_peered":"2024-09-11T22:04:17.406451+0000","last_clean":"2024-09-11T22:04:17.406451+0000","last_became_active":"2024-09-11T22:02:36.105255+0000","last_became_peered":"2024-09-11T22:02:36.105255+0000","last_unstale":"2024-09-11T22:04:17.406451+0000","last_undegraded":"2024-09-11T22:04:17.406451+0000","last_fullsized":"2024-09-11T22:04:17.406451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.995542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.355903+0000","last_change":"2024-09-11T22:02:34.079967+0000","last_active":"2024-09-11T22:04:17.355903+0000","last_peered":"2024-09-11T22:04:17.355903+0000","last_clean":"2024-09-11T22:04:17.355903+0000","last_became_active":"2024-09-11T22:02:34.079649+0000","last_became_peered":"2024-09-11T22:02:34.079649+0000","last_unstale":"2024-09-11T22:04:17.355903+0000","last_undegraded":"2024-09-11T22:04:17.355903+0000","last_fullsized":"2024-09-11T22:04:17.355903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.661256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.351613+0000","last_change":"2024-09-11T22:02:34.079850+0000","last_active":"2024-09-11T22:04:17.351613+0000","last_peered":"2024-09-11T22:04:17.351613+0000","last_clean":"2024-09-11T22:04:17.351613+0000","last_became_active":"2024-09-11T22:02:34.079514+0000","last_became_peered":"2024-09-11T22:02:34.079514+0000","last_unstale":"2024-09-11T22:04:17.351613+0000","last_undegraded":"2024-09-11T22:04:17.351613+0000","last_fullsized":"2024-09-11T22:04:17.351613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.359482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407046+0000","last_change":"2024-09-11T22:02:36.099310+0000","last_active":"2024-09-11T22:04:17.407046+0000","last_peered":"2024-09-11T22:04:17.407046+0000","last_clean":"2024-09-11T22:04:17.407046+0000","last_became_active":"2024-09-11T22:02:36.099026+0000","last_became_peered":"2024-09-11T22:02:36.099026+0000","last_unstale":"2024-09-11T22:04:17.407046+0000","last_undegraded":"2024-09-11T22:04:17.407046+0000","last_fullsized":"2024-09-11T22:04:17.407046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:57.570147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358629+0000","last_change":"2024-09-11T22:02:34.083757+0000","last_active":"2024-09-11T22:04:17.358629+0000","last_peered":"2024-09-11T22:04:17.358629+0000","last_clean":"2024-09-11T22:04:17.358629+0000","last_became_active":"2024-09-11T22:02:34.083467+0000","last_became_peered":"2024-09-11T22:02:34.083467+0000","last_unstale":"2024-09-11T22:04:17.358629+0000","last_undegraded":"2024-09-11T22:04:17.358629+0000","last_fullsized":"2024-09-11T22:04:17.358629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.546772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407844+0000","last_change":"2024-09-11T22:02:36.098939+0000","last_active":"2024-09-11T22:04:17.407844+0000","last_peered":"2024-09-11T22:04:17.407844+0000","last_clean":"2024-09-11T22:04:17.407844+0000","last_became_active":"2024-09-11T22:02:36.098631+0000","last_became_peered":"2024-09-11T22:02:36.098631+0000","last_unstale":"2024-09-11T22:04:17.407844+0000","last_undegraded":"2024-09-11T22:04:17.407844+0000","last_fullsized":"2024-09-11T22:04:17.407844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:07.663332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:31.993104+0000","last_change":"2024-09-11T22:02:34.085325+0000","last_active":"2024-09-11T22:04:31.993104+0000","last_peered":"2024-09-11T22:04:31.993104+0000","last_clean":"2024-09-11T22:04:31.993104+0000","last_became_active":"2024-09-11T22:02:34.084967+0000","last_became_peered":"2024-09-11T22:02:34.084967+0000","last_unstale":"2024-09-11T22:04:31.993104+0000","last_undegraded":"2024-09-11T22:04:31.993104+0000","last_fullsized":"2024-09-11T22:04:31.993104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:35.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.396449+0000","last_change":"2024-09-11T22:02:36.104454+0000","last_active":"2024-09-11T22:04:17.396449+0000","last_peered":"2024-09-11T22:04:17.396449+0000","last_clean":"2024-09-11T22:04:17.396449+0000","last_became_active":"2024-09-11T22:02:36.103988+0000","last_became_peered":"2024-09-11T22:02:36.103988+0000","last_unstale":"2024-09-11T22:04:17.396449+0000","last_undegraded":"2024-09-11T22:04:17.396449+0000","last_fullsized":"2024-09-11T22:04:17.396449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:32.748524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362192+0000","last_change":"2024-09-11T22:02:55.548642+0000","last_active":"2024-09-11T22:04:17.362192+0000","last_peered":"2024-09-11T22:04:17.362192+0000","last_clean":"2024-09-11T22:04:17.362192+0000","last_became_active":"2024-09-11T22:02:55.545771+0000","last_became_peered":"2024-09-11T22:02:55.545771+0000","last_unstale":"2024-09-11T22:04:17.362192+0000","last_undegraded":"2024-09-11T22:04:17.362192+0000","last_fullsized":"2024-09-11T22:04:17.362192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:03.431986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.411866+0000","last_change":"2024-09-11T22:02:55.349125+0000","last_active":"2024-09-11T22:04:17.411866+0000","last_peered":"2024-09-11T22:04:17.411866+0000","last_clean":"2024-09-11T22:04:17.411866+0000","last_became_active":"2024-09-11T22:02:55.348746+0000","last_became_peered":"2024-09-11T22:02:55.348746+0000","last_unstale":"2024-09-11T22:04:17.411866+0000","last_undegraded":"2024-09-11T22:04:17.411866+0000","last_fullsized":"2024-09-11T22:04:17.411866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358974+0000","last_change":"2024-09-11T22:02:34.089793+0000","last_active":"2024-09-11T22:04:17.358974+0000","last_peered":"2024-09-11T22:04:17.358974+0000","last_clean":"2024-09-11T22:04:17.358974+0000","last_became_active":"2024-09-11T22:02:34.089468+0000","last_became_peered":"2024-09-11T22:02:34.089468+0000","last_unstale":"2024-09-11T22:04:17.358974+0000","last_undegraded":"2024-09-11T22:04:17.358974+0000","last_fullsized":"2024-09-11T22:04:17.358974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:10:21.034822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401964+0000","last_change":"2024-09-11T22:02:36.106224+0000","last_active":"2024-09-11T22:04:17.401964+0000","last_peered":"2024-09-11T22:04:17.401964+0000","last_clean":"2024-09-11T22:04:17.401964+0000","last_became_active":"2024-09-11T22:02:36.105903+0000","last_became_peered":"2024-09-11T22:02:36.105903+0000","last_unstale":"2024-09-11T22:04:17.401964+0000","last_undegraded":"2024-09-11T22:04:17.401964+0000","last_fullsized":"2024-09-11T22:04:17.401964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.354653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'36","reported_seq":290,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:32.994746+0000","last_change":"2024-09-11T22:02:34.082150+0000","last_active":"2024-09-11T22:04:32.994746+0000","last_peered":"2024-09-11T22:04:32.994746+0000","last_clean":"2024-09-11T22:04:32.994746+0000","last_became_active":"2024-09-11T22:02:34.081822+0000","last_became_peered":"2024-09-11T22:02:34.081822+0000","last_unstale":"2024-09-11T22:04:32.994746+0000","last_undegraded":"2024-09-11T22:04:32.994746+0000","last_fullsized":"2024-09-11T22:04:32.994746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:39.320410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69393,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":183,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.386796+0000","last_change":"2024-09-11T22:02:36.112124+0000","last_active":"2024-09-11T22:04:17.386796+0000","last_peered":"2024-09-11T22:04:17.386796+0000","last_clean":"2024-09-11T22:04:17.386796+0000","last_became_active":"2024-09-11T22:02:36.111739+0000","last_became_peered":"2024-09-11T22:02:36.111739+0000","last_unstale":"2024-09-11T22:04:17.386796+0000","last_undegraded":"2024-09-11T22:04:17.386796+0000","last_fullsized":"2024-09-11T22:04:17.386796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:52.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352659+0000","last_change":"2024-09-11T22:02:34.083047+0000","last_active":"2024-09-11T22:04:17.352659+0000","last_peered":"2024-09-11T22:04:17.352659+0000","last_clean":"2024-09-11T22:04:17.352659+0000","last_became_active":"2024-09-11T22:02:34.082406+0000","last_became_peered":"2024-09-11T22:02:34.082406+0000","last_unstale":"2024-09-11T22:04:17.352659+0000","last_undegraded":"2024-09-11T22:04:17.352659+0000","last_fullsized":"2024-09-11T22:04:17.352659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:33.249337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.407254+0000","last_change":"2024-09-11T22:02:36.108859+0000","last_active":"2024-09-11T22:04:17.407254+0000","last_peered":"2024-09-11T22:04:17.407254+0000","last_clean":"2024-09-11T22:04:17.407254+0000","last_became_active":"2024-09-11T22:02:36.108558+0000","last_became_peered":"2024-09-11T22:02:36.108558+0000","last_unstale":"2024-09-11T22:04:17.407254+0000","last_undegraded":"2024-09-11T22:04:17.407254+0000","last_fullsized":"2024-09-11T22:04:17.407254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.430672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358635+0000","last_change":"2024-09-11T22:02:34.080560+0000","last_active":"2024-09-11T22:04:17.358635+0000","last_peered":"2024-09-11T22:04:17.358635+0000","last_clean":"2024-09-11T22:04:17.358635+0000","last_became_active":"2024-09-11T22:02:34.080262+0000","last_became_peered":"2024-09-11T22:02:34.080262+0000","last_unstale":"2024-09-11T22:04:17.358635+0000","last_undegraded":"2024-09-11T22:04:17.358635+0000","last_fullsized":"2024-09-11T22:04:17.358635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:44.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403367+0000","last_change":"2024-09-11T22:02:36.107722+0000","last_active":"2024-09-11T22:04:17.403367+0000","last_peered":"2024-09-11T22:04:17.403367+0000","last_clean":"2024-09-11T22:04:17.403367+0000","last_became_active":"2024-09-11T22:02:36.107219+0000","last_became_peered":"2024-09-11T22:02:36.107219+0000","last_unstale":"2024-09-11T22:04:17.403367+0000","last_undegraded":"2024-09-11T22:04:17.403367+0000","last_fullsized":"2024-09-11T22:04:17.403367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.576045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'8","reported_seq":145,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:32.004357+0000","last_change":"2024-09-11T22:02:34.083573+0000","last_active":"2024-09-11T22:04:32.004357+0000","last_peered":"2024-09-11T22:04:32.004357+0000","last_clean":"2024-09-11T22:04:32.004357+0000","last_became_active":"2024-09-11T22:02:34.083277+0000","last_became_peered":"2024-09-11T22:02:34.083277+0000","last_unstale":"2024-09-11T22:04:32.004357+0000","last_undegraded":"2024-09-11T22:04:32.004357+0000","last_fullsized":"2024-09-11T22:04:32.004357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:31.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2301,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":6,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.382984+0000","last_change":"2024-09-11T22:02:36.105075+0000","last_active":"2024-09-11T22:04:17.382984+0000","last_peered":"2024-09-11T22:04:17.382984+0000","last_clean":"2024-09-11T22:04:17.382984+0000","last_became_active":"2024-09-11T22:02:36.104022+0000","last_became_peered":"2024-09-11T22:02:36.104022+0000","last_unstale":"2024-09-11T22:04:17.382984+0000","last_undegraded":"2024-09-11T22:04:17.382984+0000","last_fullsized":"2024-09-11T22:04:17.382984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.693146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.366650+0000","last_change":"2024-09-11T22:02:34.088727+0000","last_active":"2024-09-11T22:04:17.366650+0000","last_peered":"2024-09-11T22:04:17.366650+0000","last_clean":"2024-09-11T22:04:17.366650+0000","last_became_active":"2024-09-11T22:02:34.088394+0000","last_became_peered":"2024-09-11T22:02:34.088394+0000","last_unstale":"2024-09-11T22:04:17.366650+0000","last_undegraded":"2024-09-11T22:04:17.366650+0000","last_fullsized":"2024-09-11T22:04:17.366650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:11.809765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399053+0000","last_change":"2024-09-11T22:02:36.104522+0000","last_active":"2024-09-11T22:04:17.399053+0000","last_peered":"2024-09-11T22:04:17.399053+0000","last_clean":"2024-09-11T22:04:17.399053+0000","last_became_active":"2024-09-11T22:02:36.104181+0000","last_became_peered":"2024-09-11T22:02:36.104181+0000","last_unstale":"2024-09-11T22:04:17.399053+0000","last_undegraded":"2024-09-11T22:04:17.399053+0000","last_fullsized":"2024-09-11T22:04:17.399053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:08.139180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368106+0000","last_change":"2024-09-11T22:02:34.080341+0000","last_active":"2024-09-11T22:04:17.368106+0000","last_peered":"2024-09-11T22:04:17.368106+0000","last_clean":"2024-09-11T22:04:17.368106+0000","last_became_active":"2024-09-11T22:02:34.078761+0000","last_became_peered":"2024-09-11T22:02:34.078761+0000","last_unstale":"2024-09-11T22:04:17.368106+0000","last_undegraded":"2024-09-11T22:04:17.368106+0000","last_fullsized":"2024-09-11T22:04:17.368106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:56.475702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393697+0000","last_change":"2024-09-11T22:02:55.545135+0000","last_active":"2024-09-11T22:04:17.393697+0000","last_peered":"2024-09-11T22:04:17.393697+0000","last_clean":"2024-09-11T22:04:17.393697+0000","last_became_active":"2024-09-11T22:02:55.544785+0000","last_became_peered":"2024-09-11T22:02:55.544785+0000","last_unstale":"2024-09-11T22:04:17.393697+0000","last_undegraded":"2024-09-11T22:04:17.393697+0000","last_fullsized":"2024-09-11T22:04:17.393697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:05.815828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352013+0000","last_change":"2024-09-11T22:02:34.082364+0000","last_active":"2024-09-11T22:04:17.352013+0000","last_peered":"2024-09-11T22:04:17.352013+0000","last_clean":"2024-09-11T22:04:17.352013+0000","last_became_active":"2024-09-11T22:02:34.081906+0000","last_became_peered":"2024-09-11T22:02:34.081906+0000","last_unstale":"2024-09-11T22:04:17.352013+0000","last_undegraded":"2024-09-11T22:04:17.352013+0000","last_fullsized":"2024-09-11T22:04:17.352013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:58.603942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.390768+0000","last_change":"2024-09-11T22:02:36.110725+0000","last_active":"2024-09-11T22:04:17.390768+0000","last_peered":"2024-09-11T22:04:17.390768+0000","last_clean":"2024-09-11T22:04:17.390768+0000","last_became_active":"2024-09-11T22:02:36.110401+0000","last_became_peered":"2024-09-11T22:02:36.110401+0000","last_unstale":"2024-09-11T22:04:17.390768+0000","last_undegraded":"2024-09-11T22:04:17.390768+0000","last_fullsized":"2024-09-11T22:04:17.390768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:41.789134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'65","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:29.040703+0000","last_change":"2024-09-11T22:02:34.082983+0000","last_active":"2024-09-11T22:04:29.040703+0000","last_peered":"2024-09-11T22:04:29.040703+0000","last_clean":"2024-09-11T22:04:29.040703+0000","last_became_active":"2024-09-11T22:02:34.082618+0000","last_became_peered":"2024-09-11T22:02:34.082618+0000","last_unstale":"2024-09-11T22:04:29.040703+0000","last_undegraded":"2024-09-11T22:04:29.040703+0000","last_fullsized":"2024-09-11T22:04:29.040703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.481228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.393689+0000","last_change":"2024-09-11T22:02:36.108222+0000","last_active":"2024-09-11T22:04:17.393689+0000","last_peered":"2024-09-11T22:04:17.393689+0000","last_clean":"2024-09-11T22:04:17.393689+0000","last_became_active":"2024-09-11T22:02:36.107739+0000","last_became_peered":"2024-09-11T22:02:36.107739+0000","last_unstale":"2024-09-11T22:04:17.393689+0000","last_undegraded":"2024-09-11T22:04:17.393689+0000","last_fullsized":"2024-09-11T22:04:17.393689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:11.353217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.352780+0000","last_change":"2024-09-11T22:02:34.090068+0000","last_active":"2024-09-11T22:04:17.352780+0000","last_peered":"2024-09-11T22:04:17.352780+0000","last_clean":"2024-09-11T22:04:17.352780+0000","last_became_active":"2024-09-11T22:02:34.089735+0000","last_became_peered":"2024-09-11T22:02:34.089735+0000","last_unstale":"2024-09-11T22:04:17.352780+0000","last_undegraded":"2024-09-11T22:04:17.352780+0000","last_fullsized":"2024-09-11T22:04:17.352780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:32.917459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.401828+0000","last_change":"2024-09-11T22:02:36.108017+0000","last_active":"2024-09-11T22:04:17.401828+0000","last_peered":"2024-09-11T22:04:17.401828+0000","last_clean":"2024-09-11T22:04:17.401828+0000","last_became_active":"2024-09-11T22:02:36.107339+0000","last_became_peered":"2024-09-11T22:02:36.107339+0000","last_unstale":"2024-09-11T22:04:17.401828+0000","last_undegraded":"2024-09-11T22:04:17.401828+0000","last_fullsized":"2024-09-11T22:04:17.401828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:19.240354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"85'148","reported_seq":391,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:19.483724+0000","last_change":"2024-09-11T22:01:28.522567+0000","last_active":"2024-09-11T22:04:19.483724+0000","last_peered":"2024-09-11T22:04:19.483724+0000","last_clean":"2024-09-11T22:04:19.483724+0000","last_became_active":"2024-09-11T22:01:28.522079+0000","last_became_peered":"2024-09-11T22:01:28.522079+0000","last_unstale":"2024-09-11T22:04:19.483724+0000","last_undegraded":"2024-09-11T22:04:19.483724+0000","last_fullsized":"2024-09-11T22:04:19.483724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T21:58:11.245706+0000","last_clean_scrub_stamp":"2024-09-11T21:58:11.245706+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:48.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365565+0000","last_change":"2024-09-11T22:02:34.080535+0000","last_active":"2024-09-11T22:04:17.365565+0000","last_peered":"2024-09-11T22:04:17.365565+0000","last_clean":"2024-09-11T22:04:17.365565+0000","last_became_active":"2024-09-11T22:02:34.079351+0000","last_became_peered":"2024-09-11T22:02:34.079351+0000","last_unstale":"2024-09-11T22:04:17.365565+0000","last_undegraded":"2024-09-11T22:04:17.365565+0000","last_fullsized":"2024-09-11T22:04:17.365565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:29.737198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400866+0000","last_change":"2024-09-11T22:02:36.104476+0000","last_active":"2024-09-11T22:04:17.400866+0000","last_peered":"2024-09-11T22:04:17.400866+0000","last_clean":"2024-09-11T22:04:17.400866+0000","last_became_active":"2024-09-11T22:02:36.104163+0000","last_became_peered":"2024-09-11T22:02:36.104163+0000","last_unstale":"2024-09-11T22:04:17.400866+0000","last_undegraded":"2024-09-11T22:04:17.400866+0000","last_fullsized":"2024-09-11T22:04:17.400866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.570125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.362441+0000","last_change":"2024-09-11T22:02:34.079652+0000","last_active":"2024-09-11T22:04:17.362441+0000","last_peered":"2024-09-11T22:04:17.362441+0000","last_clean":"2024-09-11T22:04:17.362441+0000","last_became_active":"2024-09-11T22:02:34.079365+0000","last_became_peered":"2024-09-11T22:02:34.079365+0000","last_unstale":"2024-09-11T22:04:17.362441+0000","last_undegraded":"2024-09-11T22:04:17.362441+0000","last_fullsized":"2024-09-11T22:04:17.362441+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:15.371852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399253+0000","last_change":"2024-09-11T22:02:36.107209+0000","last_active":"2024-09-11T22:04:17.399253+0000","last_peered":"2024-09-11T22:04:17.399253+0000","last_clean":"2024-09-11T22:04:17.399253+0000","last_became_active":"2024-09-11T22:02:36.106896+0000","last_became_peered":"2024-09-11T22:02:36.106896+0000","last_unstale":"2024-09-11T22:04:17.399253+0000","last_undegraded":"2024-09-11T22:04:17.399253+0000","last_fullsized":"2024-09-11T22:04:17.399253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:04.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:32.003614+0000","last_change":"2024-09-11T22:02:34.088531+0000","last_active":"2024-09-11T22:04:32.003614+0000","last_peered":"2024-09-11T22:04:32.003614+0000","last_clean":"2024-09-11T22:04:32.003614+0000","last_became_active":"2024-09-11T22:02:34.088252+0000","last_became_peered":"2024-09-11T22:02:34.088252+0000","last_unstale":"2024-09-11T22:04:32.003614+0000","last_undegraded":"2024-09-11T22:04:32.003614+0000","last_fullsized":"2024-09-11T22:04:32.003614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:43.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.389359+0000","last_change":"2024-09-11T22:02:36.108963+0000","last_active":"2024-09-11T22:04:17.389359+0000","last_peered":"2024-09-11T22:04:17.389359+0000","last_clean":"2024-09-11T22:04:17.389359+0000","last_became_active":"2024-09-11T22:02:36.108435+0000","last_became_peered":"2024-09-11T22:02:36.108435+0000","last_unstale":"2024-09-11T22:04:17.389359+0000","last_undegraded":"2024-09-11T22:04:17.389359+0000","last_fullsized":"2024-09-11T22:04:17.389359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:11.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.361831+0000","last_change":"2024-09-11T22:02:34.084283+0000","last_active":"2024-09-11T22:04:17.361831+0000","last_peered":"2024-09-11T22:04:17.361831+0000","last_clean":"2024-09-11T22:04:17.361831+0000","last_became_active":"2024-09-11T22:02:34.083948+0000","last_became_peered":"2024-09-11T22:02:34.083948+0000","last_unstale":"2024-09-11T22:04:17.361831+0000","last_undegraded":"2024-09-11T22:04:17.361831+0000","last_fullsized":"2024-09-11T22:04:17.361831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:48.763643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.391536+0000","last_change":"2024-09-11T22:02:36.102147+0000","last_active":"2024-09-11T22:04:17.391536+0000","last_peered":"2024-09-11T22:04:17.391536+0000","last_clean":"2024-09-11T22:04:17.391536+0000","last_became_active":"2024-09-11T22:02:36.101641+0000","last_became_peered":"2024-09-11T22:02:36.101641+0000","last_unstale":"2024-09-11T22:04:17.391536+0000","last_undegraded":"2024-09-11T22:04:17.391536+0000","last_fullsized":"2024-09-11T22:04:17.391536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:58.145304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358234+0000","last_change":"2024-09-11T22:02:34.090538+0000","last_active":"2024-09-11T22:04:17.358234+0000","last_peered":"2024-09-11T22:04:17.358234+0000","last_clean":"2024-09-11T22:04:17.358234+0000","last_became_active":"2024-09-11T22:02:34.090238+0000","last_became_peered":"2024-09-11T22:02:34.090238+0000","last_unstale":"2024-09-11T22:04:17.358234+0000","last_undegraded":"2024-09-11T22:04:17.358234+0000","last_fullsized":"2024-09-11T22:04:17.358234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:47.037999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.397510+0000","last_change":"2024-09-11T22:02:36.095664+0000","last_active":"2024-09-11T22:04:17.397510+0000","last_peered":"2024-09-11T22:04:17.397510+0000","last_clean":"2024-09-11T22:04:17.397510+0000","last_became_active":"2024-09-11T22:02:36.095304+0000","last_became_peered":"2024-09-11T22:02:36.095304+0000","last_unstale":"2024-09-11T22:04:17.397510+0000","last_undegraded":"2024-09-11T22:04:17.397510+0000","last_fullsized":"2024-09-11T22:04:17.397510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.484809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368818+0000","last_change":"2024-09-11T22:02:34.089781+0000","last_active":"2024-09-11T22:04:17.368818+0000","last_peered":"2024-09-11T22:04:17.368818+0000","last_clean":"2024-09-11T22:04:17.368818+0000","last_became_active":"2024-09-11T22:02:34.089439+0000","last_became_peered":"2024-09-11T22:02:34.089439+0000","last_unstale":"2024-09-11T22:04:17.368818+0000","last_undegraded":"2024-09-11T22:04:17.368818+0000","last_fullsized":"2024-09-11T22:04:17.368818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:38.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.400049+0000","last_change":"2024-09-11T22:02:36.107159+0000","last_active":"2024-09-11T22:04:17.400049+0000","last_peered":"2024-09-11T22:04:17.400049+0000","last_clean":"2024-09-11T22:04:17.400049+0000","last_became_active":"2024-09-11T22:02:36.106846+0000","last_became_peered":"2024-09-11T22:02:36.106846+0000","last_unstale":"2024-09-11T22:04:17.400049+0000","last_undegraded":"2024-09-11T22:04:17.400049+0000","last_fullsized":"2024-09-11T22:04:17.400049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.972944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'100","reported_seq":228,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:29.397642+0000","last_change":"2024-09-11T22:02:55.352887+0000","last_active":"2024-09-11T22:04:29.397642+0000","last_peered":"2024-09-11T22:04:29.397642+0000","last_clean":"2024-09-11T22:04:29.397642+0000","last_became_active":"2024-09-11T22:02:55.348619+0000","last_became_peered":"2024-09-11T22:02:55.348619+0000","last_unstale":"2024-09-11T22:04:29.397642+0000","last_undegraded":"2024-09-11T22:04:29.397642+0000","last_fullsized":"2024-09-11T22:04:29.397642+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:51.259114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":185,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.399780+0000","last_change":"2024-09-11T22:02:36.108560+0000","last_active":"2024-09-11T22:04:17.399780+0000","last_peered":"2024-09-11T22:04:17.399780+0000","last_clean":"2024-09-11T22:04:17.399780+0000","last_became_active":"2024-09-11T22:02:36.107593+0000","last_became_peered":"2024-09-11T22:02:36.107593+0000","last_unstale":"2024-09-11T22:04:17.399780+0000","last_undegraded":"2024-09-11T22:04:17.399780+0000","last_fullsized":"2024-09-11T22:04:17.399780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.479991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365257+0000","last_change":"2024-09-11T22:02:34.087394+0000","last_active":"2024-09-11T22:04:17.365257+0000","last_peered":"2024-09-11T22:04:17.365257+0000","last_clean":"2024-09-11T22:04:17.365257+0000","last_became_active":"2024-09-11T22:02:34.087146+0000","last_became_peered":"2024-09-11T22:02:34.087146+0000","last_unstale":"2024-09-11T22:04:17.365257+0000","last_undegraded":"2024-09-11T22:04:17.365257+0000","last_fullsized":"2024-09-11T22:04:17.365257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:30.772437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412826+0000","last_change":"2024-09-11T22:02:55.545065+0000","last_active":"2024-09-11T22:04:17.412826+0000","last_peered":"2024-09-11T22:04:17.412826+0000","last_clean":"2024-09-11T22:04:17.412826+0000","last_became_active":"2024-09-11T22:02:55.544736+0000","last_became_peered":"2024-09-11T22:02:55.544736+0000","last_unstale":"2024-09-11T22:04:17.412826+0000","last_undegraded":"2024-09-11T22:04:17.412826+0000","last_fullsized":"2024-09-11T22:04:17.412826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:23.706253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358626+0000","last_change":"2024-09-11T22:02:34.088717+0000","last_active":"2024-09-11T22:04:17.358626+0000","last_peered":"2024-09-11T22:04:17.358626+0000","last_clean":"2024-09-11T22:04:17.358626+0000","last_became_active":"2024-09-11T22:02:34.088412+0000","last_became_peered":"2024-09-11T22:02:34.088412+0000","last_unstale":"2024-09-11T22:04:17.358626+0000","last_undegraded":"2024-09-11T22:04:17.358626+0000","last_fullsized":"2024-09-11T22:04:17.358626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.376778+0000","last_change":"2024-09-11T22:02:36.103781+0000","last_active":"2024-09-11T22:04:17.376778+0000","last_peered":"2024-09-11T22:04:17.376778+0000","last_clean":"2024-09-11T22:04:17.376778+0000","last_became_active":"2024-09-11T22:02:36.103426+0000","last_became_peered":"2024-09-11T22:02:36.103426+0000","last_unstale":"2024-09-11T22:04:17.376778+0000","last_undegraded":"2024-09-11T22:04:17.376778+0000","last_fullsized":"2024-09-11T22:04:17.376778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:34.962793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.357294+0000","last_change":"2024-09-11T22:02:34.080333+0000","last_active":"2024-09-11T22:04:17.357294+0000","last_peered":"2024-09-11T22:04:17.357294+0000","last_clean":"2024-09-11T22:04:17.357294+0000","last_became_active":"2024-09-11T22:02:34.079384+0000","last_became_peered":"2024-09-11T22:02:34.079384+0000","last_unstale":"2024-09-11T22:04:17.357294+0000","last_undegraded":"2024-09-11T22:04:17.357294+0000","last_fullsized":"2024-09-11T22:04:17.357294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:38.313516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.414236+0000","last_change":"2024-09-11T22:02:36.103306+0000","last_active":"2024-09-11T22:04:17.414236+0000","last_peered":"2024-09-11T22:04:17.414236+0000","last_clean":"2024-09-11T22:04:17.414236+0000","last_became_active":"2024-09-11T22:02:36.102967+0000","last_became_peered":"2024-09-11T22:02:36.102967+0000","last_unstale":"2024-09-11T22:04:17.414236+0000","last_undegraded":"2024-09-11T22:04:17.414236+0000","last_fullsized":"2024-09-11T22:04:17.414236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:34.138931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.365503+0000","last_change":"2024-09-11T22:02:55.355119+0000","last_active":"2024-09-11T22:04:17.365503+0000","last_peered":"2024-09-11T22:04:17.365503+0000","last_clean":"2024-09-11T22:04:17.365503+0000","last_became_active":"2024-09-11T22:02:55.350440+0000","last_became_peered":"2024-09-11T22:02:55.350440+0000","last_unstale":"2024-09-11T22:04:17.365503+0000","last_undegraded":"2024-09-11T22:04:17.365503+0000","last_fullsized":"2024-09-11T22:04:17.365503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:47.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398642+0000","last_change":"2024-09-11T22:02:36.102491+0000","last_active":"2024-09-11T22:04:17.398642+0000","last_peered":"2024-09-11T22:04:17.398642+0000","last_clean":"2024-09-11T22:04:17.398642+0000","last_became_active":"2024-09-11T22:02:36.102112+0000","last_became_peered":"2024-09-11T22:02:36.102112+0000","last_unstale":"2024-09-11T22:04:17.398642+0000","last_undegraded":"2024-09-11T22:04:17.398642+0000","last_fullsized":"2024-09-11T22:04:17.398642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:47.588539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.367510+0000","last_change":"2024-09-11T22:02:34.082590+0000","last_active":"2024-09-11T22:04:17.367510+0000","last_peered":"2024-09-11T22:04:17.367510+0000","last_clean":"2024-09-11T22:04:17.367510+0000","last_became_active":"2024-09-11T22:02:34.082288+0000","last_became_peered":"2024-09-11T22:02:34.082288+0000","last_unstale":"2024-09-11T22:04:17.367510+0000","last_undegraded":"2024-09-11T22:04:17.367510+0000","last_fullsized":"2024-09-11T22:04:17.367510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:57.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.402698+0000","last_change":"2024-09-11T22:02:36.105247+0000","last_active":"2024-09-11T22:04:17.402698+0000","last_peered":"2024-09-11T22:04:17.402698+0000","last_clean":"2024-09-11T22:04:17.402698+0000","last_became_active":"2024-09-11T22:02:36.104912+0000","last_became_peered":"2024-09-11T22:02:36.104912+0000","last_unstale":"2024-09-11T22:04:17.402698+0000","last_undegraded":"2024-09-11T22:04:17.402698+0000","last_fullsized":"2024-09-11T22:04:17.402698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:05.396671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.398828+0000","last_change":"2024-09-11T22:02:55.544428+0000","last_active":"2024-09-11T22:04:17.398828+0000","last_peered":"2024-09-11T22:04:17.398828+0000","last_clean":"2024-09-11T22:04:17.398828+0000","last_became_active":"2024-09-11T22:02:55.544151+0000","last_became_peered":"2024-09-11T22:02:55.544151+0000","last_unstale":"2024-09-11T22:04:17.398828+0000","last_undegraded":"2024-09-11T22:04:17.398828+0000","last_fullsized":"2024-09-11T22:04:17.398828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.100131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368511+0000","last_change":"2024-09-11T22:02:34.079017+0000","last_active":"2024-09-11T22:04:17.368511+0000","last_peered":"2024-09-11T22:04:17.368511+0000","last_clean":"2024-09-11T22:04:17.368511+0000","last_became_active":"2024-09-11T22:02:34.078663+0000","last_became_peered":"2024-09-11T22:02:34.078663+0000","last_unstale":"2024-09-11T22:04:17.368511+0000","last_undegraded":"2024-09-11T22:04:17.368511+0000","last_fullsized":"2024-09-11T22:04:17.368511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:05.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.406599+0000","last_change":"2024-09-11T22:02:36.097768+0000","last_active":"2024-09-11T22:04:17.406599+0000","last_peered":"2024-09-11T22:04:17.406599+0000","last_clean":"2024-09-11T22:04:17.406599+0000","last_became_active":"2024-09-11T22:02:36.097396+0000","last_became_peered":"2024-09-11T22:02:36.097396+0000","last_unstale":"2024-09-11T22:04:17.406599+0000","last_undegraded":"2024-09-11T22:04:17.406599+0000","last_fullsized":"2024-09-11T22:04:17.406599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:35.673268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.368326+0000","last_change":"2024-09-11T22:02:55.355229+0000","last_active":"2024-09-11T22:04:17.368326+0000","last_peered":"2024-09-11T22:04:17.368326+0000","last_clean":"2024-09-11T22:04:17.368326+0000","last_became_active":"2024-09-11T22:02:55.350492+0000","last_became_peered":"2024-09-11T22:02:55.350492+0000","last_unstale":"2024-09-11T22:04:17.368326+0000","last_undegraded":"2024-09-11T22:04:17.368326+0000","last_fullsized":"2024-09-11T22:04:17.368326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:03:31.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.412937+0000","last_change":"2024-09-11T22:02:36.108992+0000","last_active":"2024-09-11T22:04:17.412937+0000","last_peered":"2024-09-11T22:04:17.412937+0000","last_clean":"2024-09-11T22:04:17.412937+0000","last_became_active":"2024-09-11T22:02:36.108674+0000","last_became_peered":"2024-09-11T22:02:36.108674+0000","last_unstale":"2024-09-11T22:04:17.412937+0000","last_undegraded":"2024-09-11T22:04:17.412937+0000","last_fullsized":"2024-09-11T22:04:17.412937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:57.083127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358697+0000","last_change":"2024-09-11T22:02:34.088833+0000","last_active":"2024-09-11T22:04:17.358697+0000","last_peered":"2024-09-11T22:04:17.358697+0000","last_clean":"2024-09-11T22:04:17.358697+0000","last_became_active":"2024-09-11T22:02:34.088275+0000","last_became_peered":"2024-09-11T22:02:34.088275+0000","last_unstale":"2024-09-11T22:04:17.358697+0000","last_undegraded":"2024-09-11T22:04:17.358697+0000","last_fullsized":"2024-09-11T22:04:17.358697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:31.167486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.403337+0000","last_change":"2024-09-11T22:02:36.108154+0000","last_active":"2024-09-11T22:04:17.403337+0000","last_peered":"2024-09-11T22:04:17.403337+0000","last_clean":"2024-09-11T22:04:17.403337+0000","last_became_active":"2024-09-11T22:02:36.107817+0000","last_became_peered":"2024-09-11T22:02:36.107817+0000","last_unstale":"2024-09-11T22:04:17.403337+0000","last_undegraded":"2024-09-11T22:04:17.403337+0000","last_fullsized":"2024-09-11T22:04:17.403337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:35.068997+0000","last_clean_scrub_stamp":"2024-09-11T22:02:35.068997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.168339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:04:17.358899+0000","last_change":"2024-09-11T22:02:34.082193+0000","last_active":"2024-09-11T22:04:17.358899+0000","last_peered":"2024-09-11T22:04:17.358899+0000","last_clean":"2024-09-11T22:04:17.358899+0000","last_became_active":"2024-09-11T22:02:34.081852+0000","last_became_peered":"2024-09-11T22:02:34.081852+0000","last_unstale":"2024-09-11T22:04:17.358899+0000","last_undegraded":"2024-09-11T22:04:17.358899+0000","last_fullsized":"2024-09-11T22:04:17.358899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:02:33.065181+0000","last_clean_scrub_stamp":"2024-09-11T22:02:33.065181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:08.319444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797484,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1031,"num_read_kb":732,"num_write":424,"num_write_kb":2358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2392452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514532,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32484,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712668,"statfs":{"total":95995035648,"available":95961772032,"internally_reserved":0,"allocated":1331200,"data_stored":845532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29072,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716080,"statfs":{"total":95995035648,"available":95965265920,"internally_reserved":0,"allocated":1974272,"data_stored":1443135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906990,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28340,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716812,"statfs":{"total":95995035648,"available":95966015488,"internally_reserved":0,"allocated":1347584,"data_stored":845768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":452472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1047044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528380,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":451941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28992,"kb_used_data":1848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716160,"statfs":{"total":95995035648,"available":95965347840,"internally_reserved":0,"allocated":1892352,"data_stored":1373247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":454091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28788,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716364,"statfs":{"total":95995035648,"available":95965556736,"internally_reserved":0,"allocated":1683456,"data_stored":1173700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":523797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":521127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":453212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":72063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":400916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:04:34.910 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:04:35.159 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:35.558 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:35 smithi152 ceph-mon[31188]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:35.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.562+0000 7f8eb9306640 1 -- 172.21.15.152:0/656013732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb4100e20 msgr2=0x7f8eb4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:35.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.562+0000 7f8eb9306640 1 --2- 172.21.15.152:0/656013732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb4100e20 0x7f8eb4101200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009900 tx=0x7f8ea402a480 comp rx=0 tx=0).stop 2024-09-11T22:04:35.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.562+0000 7f8eb9306640 1 -- 172.21.15.152:0/656013732 shutdown_connections 2024-09-11T22:04:35.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.562+0000 7f8eb9306640 1 --2- 172.21.15.152:0/656013732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4102ef0 0x7f8eb410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:35.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.562+0000 7f8eb9306640 1 --2- 172.21.15.152:0/656013732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8eb4102570 0x7f8eb41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.562+0000 7f8eb9306640 1 --2- 172.21.15.152:0/656013732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb4100e20 0x7f8eb4101200 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.562+0000 7f8eb9306640 1 -- 172.21.15.152:0/656013732 >> 172.21.15.152:0/656013732 conn(0x7f8eb40fc7d0 msgr2=0x7f8eb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.562+0000 7f8eb9306640 1 -- 172.21.15.152:0/656013732 shutdown_connections 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.562+0000 7f8eb9306640 1 -- 172.21.15.152:0/656013732 wait complete. 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb9306640 1 Processor -- start 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb9306640 1 -- start start 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb9306640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8eb4100e20 0x7f8eb41973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb9306640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4102570 0x7f8eb4197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb9306640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb4102ef0 0x7f8eb419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb9306640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb4110f80 con 0x7f8eb4102ef0 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb9306640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb4110e00 con 0x7f8eb4102570 2024-09-11T22:04:35.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb9306640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb4111100 con 0x7f8eb4100e20 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb4102ef0 0x7f8eb419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb4102ef0 0x7f8eb419bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33858/0 (socket says 172.21.15.152:33858) 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb37fe640 1 -- 172.21.15.152:0/2143502971 learned_addr learned my addr 172.21.15.152:0/2143502971 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eaa7fc640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4102570 0x7f8eb4197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.563+0000 7f8eb2ffd640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8eb4100e20 0x7f8eb41973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eb37fe640 1 -- 172.21.15.152:0/2143502971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8eb4100e20 msgr2=0x7f8eb41973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eb37fe640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8eb4100e20 0x7f8eb41973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eb37fe640 1 -- 172.21.15.152:0/2143502971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4102570 msgr2=0x7f8eb4197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eb37fe640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4102570 0x7f8eb4197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eb37fe640 1 -- 172.21.15.152:0/2143502971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb419c3a0 con 0x7f8eb4102ef0 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eaa7fc640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4102570 0x7f8eb4197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:35.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eb37fe640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb4102ef0 0x7f8eb419bcc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00eb10 tx=0x7f8eac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:35.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eb0ff9640 1 -- 172.21.15.152:0/2143502971 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac004b20 con 0x7f8eb4102ef0 2024-09-11T22:04:35.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eb9306640 1 -- 172.21.15.152:0/2143502971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb419c690 con 0x7f8eb4102ef0 2024-09-11T22:04:35.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eb0ff9640 1 -- 172.21.15.152:0/2143502971 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8eac004cc0 con 0x7f8eb4102ef0 2024-09-11T22:04:35.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eb0ff9640 1 -- 172.21.15.152:0/2143502971 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac010760 con 0x7f8eb4102ef0 2024-09-11T22:04:35.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.564+0000 7f8eb9306640 1 -- 172.21.15.152:0/2143502971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb41a3f70 con 0x7f8eb4102ef0 2024-09-11T22:04:35.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.565+0000 7f8eb9306640 1 -- 172.21.15.152:0/2143502971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb4101200 con 0x7f8eb4102ef0 2024-09-11T22:04:35.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.566+0000 7f8eb0ff9640 1 -- 172.21.15.152:0/2143502971 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f8eac005020 con 0x7f8eb4102ef0 2024-09-11T22:04:35.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.567+0000 7f8eb0ff9640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ea00a2e10 0x7f8ea00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:35.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.567+0000 7f8eb2ffd640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ea00a2e10 0x7f8ea00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:35.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.567+0000 7f8eb0ff9640 1 -- 172.21.15.152:0/2143502971 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8eac0cfce0 con 0x7f8eb4102ef0 2024-09-11T22:04:35.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.567+0000 7f8eb2ffd640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ea00a2e10 0x7f8ea00a52d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009230 tx=0x7f8ea40058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:35.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.571+0000 7f8eb0ff9640 1 -- 172.21.15.152:0/2143502971 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8eac09c680 con 0x7f8eb4102ef0 2024-09-11T22:04:35.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.770+0000 7f8eb9306640 1 -- 172.21.15.152:0/2143502971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8eb4109090 con 0x7f8eb4102ef0 2024-09-11T22:04:35.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.771+0000 7f8eb0ff9640 1 -- 172.21.15.152:0/2143502971 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11923 (secure 0 0 0) 0x7f8eac09bf80 con 0x7f8eb4102ef0 2024-09-11T22:04:35.771 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:35.772 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"btime":"2024-09-11T22:04:19:354379+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:18.708640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:04:35.772 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 24 2024-09-11T22:04:35.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 -- 172.21.15.152:0/2143502971 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ea00a2e10 msgr2=0x7f8ea00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:35.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ea00a2e10 0x7f8ea00a52d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009230 tx=0x7f8ea40058d0 comp rx=0 tx=0).stop 2024-09-11T22:04:35.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 -- 172.21.15.152:0/2143502971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb4102ef0 msgr2=0x7f8eb419bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:35.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb4102ef0 0x7f8eb419bcc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00eb10 tx=0x7f8eac00c2d0 comp rx=0 tx=0).stop 2024-09-11T22:04:35.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 -- 172.21.15.152:0/2143502971 shutdown_connections 2024-09-11T22:04:35.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ea00a2e10 0x7f8ea00a52d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:35.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb4102ef0 0x7f8eb419bcc0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:35.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4102570 0x7f8eb4197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:35.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 --2- 172.21.15.152:0/2143502971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8eb4100e20 0x7f8eb41973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:35.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 -- 172.21.15.152:0/2143502971 >> 172.21.15.152:0/2143502971 conn(0x7f8eb40fc7d0 msgr2=0x7f8eb40fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:35.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 -- 172.21.15.152:0/2143502971 shutdown_connections 2024-09-11T22:04:35.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:35.773+0000 7f8eb9306640 1 -- 172.21.15.152:0/2143502971 wait complete. 2024-09-11T22:04:35.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:35 smithi179 ceph-mon[35603]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:35.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:35 smithi193 ceph-mon[35545]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:04:36.407 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:04:36.651 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:36.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:36 smithi152 ceph-mon[31188]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-11T22:04:36.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:36 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2143502971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:36.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:36 smithi179 ceph-mon[35603]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-11T22:04:36.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:36 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2143502971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:36.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:36 smithi193 ceph-mon[35545]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-11T22:04:36.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:36 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2143502971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:37.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.046+0000 7fcdf04f1640 1 -- 172.21.15.152:0/1810371935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8100ca0 msgr2=0x7fcde8106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:37.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.046+0000 7fcdf04f1640 1 --2- 172.21.15.152:0/1810371935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8100ca0 0x7fcde8106840 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009930 tx=0x7fcdd802a420 comp rx=0 tx=0).stop 2024-09-11T22:04:37.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.046+0000 7fcdf04f1640 1 -- 172.21.15.152:0/1810371935 shutdown_connections 2024-09-11T22:04:37.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.046+0000 7fcdf04f1640 1 --2- 172.21.15.152:0/1810371935 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcde8106f50 0x7fcde810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:37.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.046+0000 7fcdf04f1640 1 --2- 172.21.15.152:0/1810371935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8100ca0 0x7fcde8106840 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:37.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.046+0000 7fcdf04f1640 1 --2- 172.21.15.152:0/1810371935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcde81002f0 0x7fcde81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:37.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.046+0000 7fcdf04f1640 1 -- 172.21.15.152:0/1810371935 >> 172.21.15.152:0/1810371935 conn(0x7fcde8077210 msgr2=0x7fcde80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:37.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.046+0000 7fcdf04f1640 1 -- 172.21.15.152:0/1810371935 shutdown_connections 2024-09-11T22:04:37.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.046+0000 7fcdf04f1640 1 -- 172.21.15.152:0/1810371935 wait complete. 2024-09-11T22:04:37.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdf04f1640 1 Processor -- start 2024-09-11T22:04:37.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdf04f1640 1 -- start start 2024-09-11T22:04:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdf04f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcde81002f0 0x7fcde8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdf04f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8100ca0 0x7fcde8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdf04f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcde8106f50 0x7fcde819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdf04f1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8111fe0 con 0x7fcde8100ca0 2024-09-11T22:04:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdf04f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8111e60 con 0x7fcde8106f50 2024-09-11T22:04:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdf04f1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8112160 con 0x7fcde81002f0 2024-09-11T22:04:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdeda8c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8100ca0 0x7fcde8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdeda8c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8100ca0 0x7fcde8198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33880/0 (socket says 172.21.15.152:33880) 2024-09-11T22:04:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdeda8c640 1 -- 172.21.15.152:0/366791956 learned_addr learned my addr 172.21.15.152:0/366791956 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdee28d640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcde81002f0 0x7fcde8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.047+0000 7fcdeea8e640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcde8106f50 0x7fcde819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.048+0000 7fcdeda8c640 1 -- 172.21.15.152:0/366791956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcde81002f0 msgr2=0x7fcde8198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.048+0000 7fcdeda8c640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcde81002f0 0x7fcde8198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.048+0000 7fcdeda8c640 1 -- 172.21.15.152:0/366791956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcde8106f50 msgr2=0x7fcde819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.048+0000 7fcdeda8c640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcde8106f50 0x7fcde819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.048+0000 7fcdeda8c640 1 -- 172.21.15.152:0/366791956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde819d4b0 con 0x7fcde8100ca0 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.048+0000 7fcdeda8c640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8100ca0 0x7fcde8198a40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009230 tx=0x7fcdd80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.048+0000 7fcddf7fe640 1 -- 172.21.15.152:0/366791956 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd803f030 con 0x7fcde8100ca0 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.048+0000 7fcddf7fe640 1 -- 172.21.15.152:0/366791956 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdd8003ce0 con 0x7fcde8100ca0 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.048+0000 7fcdf04f1640 1 -- 172.21.15.152:0/366791956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde819d740 con 0x7fcde8100ca0 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.048+0000 7fcddf7fe640 1 -- 172.21.15.152:0/366791956 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8035070 con 0x7fcde8100ca0 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.048+0000 7fcdf04f1640 1 -- 172.21.15.152:0/366791956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde81a5080 con 0x7fcde8100ca0 2024-09-11T22:04:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.049+0000 7fcdf04f1640 1 -- 172.21.15.152:0/366791956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde81006d0 con 0x7fcde8100ca0 2024-09-11T22:04:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.051+0000 7fcddf7fe640 1 -- 172.21.15.152:0/366791956 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7fcdd8042030 con 0x7fcde8100ca0 2024-09-11T22:04:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.052+0000 7fcddf7fe640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcdd40a2e10 0x7fcdd40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.052+0000 7fcdee28d640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcdd40a2e10 0x7fcdd40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.052+0000 7fcddf7fe640 1 -- 172.21.15.152:0/366791956 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcdd80f00c0 con 0x7fcde8100ca0 2024-09-11T22:04:37.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.052+0000 7fcdee28d640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcdd40a2e10 0x7fcdd40a52d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcde4005e10 tx=0x7fcde4005da0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:37.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.055+0000 7fcddf7fe640 1 -- 172.21.15.152:0/366791956 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcdd80bcb30 con 0x7fcde8100ca0 2024-09-11T22:04:37.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.256+0000 7fcdf04f1640 1 -- 172.21.15.152:0/366791956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcde810a120 con 0x7fcde8100ca0 2024-09-11T22:04:37.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.257+0000 7fcddf7fe640 1 -- 172.21.15.152:0/366791956 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11923 (secure 0 0 0) 0x7fcdd80bc430 con 0x7fcde8100ca0 2024-09-11T22:04:37.258 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:37.258 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"btime":"2024-09-11T22:04:19:354379+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:18.708640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:04:37.259 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 24 2024-09-11T22:04:37.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 -- 172.21.15.152:0/366791956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcdd40a2e10 msgr2=0x7fcdd40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:37.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcdd40a2e10 0x7fcdd40a52d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcde4005e10 tx=0x7fcde4005da0 comp rx=0 tx=0).stop 2024-09-11T22:04:37.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 -- 172.21.15.152:0/366791956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8100ca0 msgr2=0x7fcde8198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:37.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8100ca0 0x7fcde8198a40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009230 tx=0x7fcdd80042f0 comp rx=0 tx=0).stop 2024-09-11T22:04:37.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 -- 172.21.15.152:0/366791956 shutdown_connections 2024-09-11T22:04:37.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcdd40a2e10 0x7fcdd40a52d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:37.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcde8106f50 0x7fcde819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:37.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8100ca0 0x7fcde8198a40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:37.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 --2- 172.21.15.152:0/366791956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcde81002f0 0x7fcde8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:37.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 -- 172.21.15.152:0/366791956 >> 172.21.15.152:0/366791956 conn(0x7fcde8077210 msgr2=0x7fcde8105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:37.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 -- 172.21.15.152:0/366791956 shutdown_connections 2024-09-11T22:04:37.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:37.259+0000 7fcdf04f1640 1 -- 172.21.15.152:0/366791956 wait complete. 2024-09-11T22:04:37.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:37 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/366791956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:37 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/366791956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:37.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:37 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/366791956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:38.001 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:04:38.248 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:38.661 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:38 smithi152 ceph-mon[31188]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-11T22:04:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.674+0000 7f8cc533d640 1 -- 172.21.15.152:0/2089273929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0106f10 msgr2=0x7f8cc010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.674+0000 7f8cc533d640 1 --2- 172.21.15.152:0/2089273929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0106f10 0x7f8cc010ea90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8009ca0 tx=0x7f8cb802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:04:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.674+0000 7f8cc533d640 1 -- 172.21.15.152:0/2089273929 shutdown_connections 2024-09-11T22:04:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.674+0000 7f8cc533d640 1 --2- 172.21.15.152:0/2089273929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0106f10 0x7f8cc010ea90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.674+0000 7f8cc533d640 1 --2- 172.21.15.152:0/2089273929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc0102790 0x7f8cc01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.674+0000 7f8cc533d640 1 --2- 172.21.15.152:0/2089273929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cc0101de0 0x7f8cc01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.674+0000 7f8cc533d640 1 -- 172.21.15.152:0/2089273929 >> 172.21.15.152:0/2089273929 conn(0x7f8cc00fd8c0 msgr2=0x7f8cc00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.674+0000 7f8cc533d640 1 -- 172.21.15.152:0/2089273929 shutdown_connections 2024-09-11T22:04:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.674+0000 7f8cc533d640 1 -- 172.21.15.152:0/2089273929 wait complete. 2024-09-11T22:04:38.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cc533d640 1 Processor -- start 2024-09-11T22:04:38.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cc533d640 1 -- start start 2024-09-11T22:04:38.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cc533d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cc0101de0 0x7f8cc00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:38.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cc533d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc0102790 0x7f8cc0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:38.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cc533d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0106f10 0x7f8cc0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cc533d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc0111f90 con 0x7f8cc0106f10 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cc533d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc0111e10 con 0x7f8cc0102790 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cc533d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc0112110 con 0x7f8cc0101de0 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cbf7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0106f10 0x7f8cc0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cbf7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0106f10 0x7f8cc0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33898/0 (socket says 172.21.15.152:33898) 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cbf7fe640 1 -- 172.21.15.152:0/3520253463 learned_addr learned my addr 172.21.15.152:0/3520253463 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cbeffd640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cc0101de0 0x7f8cc00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.675+0000 7f8cbe7fc640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc0102790 0x7f8cc0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8cbf7fe640 1 -- 172.21.15.152:0/3520253463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cc0101de0 msgr2=0x7f8cc00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8cbf7fe640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cc0101de0 0x7f8cc00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8cbf7fe640 1 -- 172.21.15.152:0/3520253463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc0102790 msgr2=0x7f8cc0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8cbf7fe640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc0102790 0x7f8cc0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:38.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8cbf7fe640 1 -- 172.21.15.152:0/3520253463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc01a68d0 con 0x7f8cc0106f10 2024-09-11T22:04:38.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8cbe7fc640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc0102790 0x7f8cc0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:38.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8cbf7fe640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0106f10 0x7f8cc0074f70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8031a60 tx=0x7f8cb8031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:38.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8ca7fff640 1 -- 172.21.15.152:0/3520253463 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8003b70 con 0x7f8cc0106f10 2024-09-11T22:04:38.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8cc533d640 1 -- 172.21.15.152:0/3520253463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc01a6b60 con 0x7f8cc0106f10 2024-09-11T22:04:38.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8ca7fff640 1 -- 172.21.15.152:0/3520253463 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cb8003d10 con 0x7f8cc0106f10 2024-09-11T22:04:38.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8ca7fff640 1 -- 172.21.15.152:0/3520253463 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8004770 con 0x7f8cc0106f10 2024-09-11T22:04:38.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.676+0000 7f8cc533d640 1 -- 172.21.15.152:0/3520253463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc01a70f0 con 0x7f8cc0106f10 2024-09-11T22:04:38.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.677+0000 7f8cc533d640 1 -- 172.21.15.152:0/3520253463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc01021c0 con 0x7f8cc0106f10 2024-09-11T22:04:38.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.678+0000 7f8ca7fff640 1 -- 172.21.15.152:0/3520253463 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f8cb802f790 con 0x7f8cc0106f10 2024-09-11T22:04:38.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.679+0000 7f8ca7fff640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ca80a2e10 0x7f8ca80a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:38.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.679+0000 7f8cbeffd640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ca80a2e10 0x7f8ca80a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:38.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.679+0000 7f8ca7fff640 1 -- 172.21.15.152:0/3520253463 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8cb80f0950 con 0x7f8cc0106f10 2024-09-11T22:04:38.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.680+0000 7f8cbeffd640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ca80a2e10 0x7f8ca80a52d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000abe0 tx=0x7f8cb000a2d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:38.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.683+0000 7f8ca7fff640 1 -- 172.21.15.152:0/3520253463 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8cb80bd400 con 0x7f8cc0106f10 2024-09-11T22:04:38.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:38 smithi179 ceph-mon[35603]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-11T22:04:38.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:38 smithi193 ceph-mon[35545]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-11T22:04:38.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.850+0000 7f8cc533d640 1 -- 172.21.15.152:0/3520253463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cc01a73e0 con 0x7f8cc0106f10 2024-09-11T22:04:38.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.852+0000 7f8ca7fff640 1 -- 172.21.15.152:0/3520253463 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23266 (secure 0 0 0) 0x7f8cb80bcd00 con 0x7f8cc0106f10 2024-09-11T22:04:38.853 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:38.853 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":85,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:04:17.346575+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2394077400":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/1809855628":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6801/3828412393":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6800/3828412393":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/2661528324":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/321546578":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/1096456467":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:04:38.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 -- 172.21.15.152:0/3520253463 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ca80a2e10 msgr2=0x7f8ca80a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:38.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ca80a2e10 0x7f8ca80a52d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000abe0 tx=0x7f8cb000a2d0 comp rx=0 tx=0).stop 2024-09-11T22:04:38.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 -- 172.21.15.152:0/3520253463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0106f10 msgr2=0x7f8cc0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:38.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0106f10 0x7f8cc0074f70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8031a60 tx=0x7f8cb8031a90 comp rx=0 tx=0).stop 2024-09-11T22:04:38.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 -- 172.21.15.152:0/3520253463 shutdown_connections 2024-09-11T22:04:38.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ca80a2e10 0x7f8ca80a52d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:38.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0106f10 0x7f8cc0074f70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:38.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc0102790 0x7f8cc0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:38.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 --2- 172.21.15.152:0/3520253463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cc0101de0 0x7f8cc00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:38.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 -- 172.21.15.152:0/3520253463 >> 172.21.15.152:0/3520253463 conn(0x7f8cc00fd8c0 msgr2=0x7f8cc00ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:38.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 -- 172.21.15.152:0/3520253463 shutdown_connections 2024-09-11T22:04:38.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:38.854+0000 7f8cc533d640 1 -- 172.21.15.152:0/3520253463 wait complete. 2024-09-11T22:04:39.661 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-11T22:04:39.683 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:39 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:04:39.683 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:39 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3520253463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:39 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:04:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:39 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3520253463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:39.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:39 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:04:39.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:39 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3520253463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:04:39.908 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:40.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:40 smithi152 ceph-mon[31188]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-11T22:04:40.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:40 smithi179 ceph-mon[35603]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-11T22:04:40.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:40 smithi193 ceph-mon[35545]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-11T22:04:40.983 INFO:teuthology.orchestra.run.smithi152.stdout:{"run_dir":"/var/run/ceph"} 2024-09-11T22:04:40.984 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-11T22:04:40.984 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 481 2024-09-11T22:04:40.984 DEBUG:tasks.quiescer:Yielding 2024-09-11T22:04:40.984 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T22:04:40.994 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T22:04:40.994 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T22:04:40.994 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-11T22:04:40.995 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:04:41.059 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:04:41.071 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-11T22:04:41.071 INFO:teuthology.orchestra.run.smithi152.stdout:0@5c140ed8-7088-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/0374fba9-eccf-4301-9e16-9053a3555c98 340G 0 340G 0% /tmp/cephfs 2024-09-11T22:04:41.073 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-11T22:04:41.164 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-11T22:04:41.204 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-11T22:04:41.282 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:41.527 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:41 smithi152 ceph-mon[31188]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-11T22:04:41.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.694+0000 7fc80835d640 1 -- 172.21.15.152:0/4200003672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc800102d90 msgr2=0x7fc800103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:41.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.694+0000 7fc80835d640 1 --2- 172.21.15.152:0/4200003672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc800102d90 0x7fc800103170 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc009930 tx=0x7fc7fc02a420 comp rx=0 tx=0).stop 2024-09-11T22:04:41.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.694+0000 7fc80835d640 1 -- 172.21.15.152:0/4200003672 shutdown_connections 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.694+0000 7fc80835d640 1 --2- 172.21.15.152:0/4200003672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc800108290 0x7fc80010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.694+0000 7fc80835d640 1 --2- 172.21.15.152:0/4200003672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc800103740 0x7fc800107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.694+0000 7fc80835d640 1 --2- 172.21.15.152:0/4200003672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc800102d90 0x7fc800103170 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.694+0000 7fc80835d640 1 -- 172.21.15.152:0/4200003672 >> 172.21.15.152:0/4200003672 conn(0x7fc8000fc7d0 msgr2=0x7fc8000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.694+0000 7fc80835d640 1 -- 172.21.15.152:0/4200003672 shutdown_connections 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.694+0000 7fc80835d640 1 -- 172.21.15.152:0/4200003672 wait complete. 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.694+0000 7fc80835d640 1 Processor -- start 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.694+0000 7fc80835d640 1 -- start start 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc80835d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc800102d90 0x7fc800198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc80835d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc800103740 0x7fc800198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc80835d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc800108290 0x7fc80019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:41.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc80835d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc800112090 con 0x7fc800103740 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc80835d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc800111f10 con 0x7fc800108290 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc80835d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc800112210 con 0x7fc800102d90 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc8058f8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc800103740 0x7fc800198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc8058f8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc800103740 0x7fc800198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33910/0 (socket says 172.21.15.152:33910) 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc8058f8640 1 -- 172.21.15.152:0/1149046972 learned_addr learned my addr 172.21.15.152:0/1149046972 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc8060f9640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc800102d90 0x7fc800198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc8058f8640 1 -- 172.21.15.152:0/1149046972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc800102d90 msgr2=0x7fc800198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc8058f8640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc800102d90 0x7fc800198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc8068fa640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc800108290 0x7fc80019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc8058f8640 1 -- 172.21.15.152:0/1149046972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc800108290 msgr2=0x7fc80019ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc8058f8640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc800108290 0x7fc80019ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc8058f8640 1 -- 172.21.15.152:0/1149046972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80019d520 con 0x7fc800103740 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc8058f8640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc800103740 0x7fc800198ab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000c970 tx=0x7fc7f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc7f77fe640 1 -- 172.21.15.152:0/1149046972 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0007bb0 con 0x7fc800103740 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc80835d640 1 -- 172.21.15.152:0/1149046972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80019d810 con 0x7fc800103740 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc7f77fe640 1 -- 172.21.15.152:0/1149046972 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7f0007d50 con 0x7fc800103740 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.695+0000 7fc7f77fe640 1 -- 172.21.15.152:0/1149046972 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00187a0 con 0x7fc800103740 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.696+0000 7fc80835d640 1 -- 172.21.15.152:0/1149046972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8001a50f0 con 0x7fc800103740 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.697+0000 7fc80835d640 1 -- 172.21.15.152:0/1149046972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc80006a7f0 con 0x7fc800103740 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.698+0000 7fc7f77fe640 1 -- 172.21.15.152:0/1149046972 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7fc7f000f450 con 0x7fc800103740 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.698+0000 7fc7f77fe640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7ec0a2e10 0x7fc7ec0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.699+0000 7fc8060f9640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7ec0a2e10 0x7fc7ec0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.699+0000 7fc7f77fe640 1 -- 172.21.15.152:0/1149046972 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc7f00cf790 con 0x7fc800103740 2024-09-11T22:04:41.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.699+0000 7fc8060f9640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7ec0a2e10 0x7fc7ec0a52d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc009900 tx=0x7fc7fc0058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:41.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.703+0000 7fc7f77fe640 1 -- 172.21.15.152:0/1149046972 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc7f0014030 con 0x7fc800103740 2024-09-11T22:04:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:41 smithi179 ceph-mon[35603]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-11T22:04:41.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:41 smithi193 ceph-mon[35545]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-11T22:04:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.910+0000 7fc80835d640 1 -- 172.21.15.152:0/1149046972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc80010a2a0 con 0x7fc800103740 2024-09-11T22:04:41.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.911+0000 7fc7f77fe640 1 -- 172.21.15.152:0/1149046972 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11923 (secure 0 0 0) 0x7fc7f009c130 con 0x7fc800103740 2024-09-11T22:04:41.912 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:41.912 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"btime":"2024-09-11T22:04:19:354379+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:18.708640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:04:41.912 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 24 2024-09-11T22:04:41.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 -- 172.21.15.152:0/1149046972 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7ec0a2e10 msgr2=0x7fc7ec0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:41.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7ec0a2e10 0x7fc7ec0a52d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc009900 tx=0x7fc7fc0058d0 comp rx=0 tx=0).stop 2024-09-11T22:04:41.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 -- 172.21.15.152:0/1149046972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc800103740 msgr2=0x7fc800198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:41.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc800103740 0x7fc800198ab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000c970 tx=0x7fc7f000ce30 comp rx=0 tx=0).stop 2024-09-11T22:04:41.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 -- 172.21.15.152:0/1149046972 shutdown_connections 2024-09-11T22:04:41.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7ec0a2e10 0x7fc7ec0a52d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:41.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc800108290 0x7fc80019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:41.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc800103740 0x7fc800198ab0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:41.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 --2- 172.21.15.152:0/1149046972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc800102d90 0x7fc800198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:41.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 -- 172.21.15.152:0/1149046972 >> 172.21.15.152:0/1149046972 conn(0x7fc8000fc7d0 msgr2=0x7fc800105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:41.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 -- 172.21.15.152:0/1149046972 shutdown_connections 2024-09-11T22:04:41.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:41.913+0000 7fc80835d640 1 -- 172.21.15.152:0/1149046972 wait complete. 2024-09-11T22:04:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.613+0000 7f8aa222e640 1 -- 172.21.15.152:0/7166595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a9c102050 msgr2=0x7f8a9c10d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.613+0000 7f8aa222e640 1 --2- 172.21.15.152:0/7166595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a9c102050 0x7f8a9c10d7d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009ca0 tx=0x7f8a9402a950 comp rx=0 tx=0).stop 2024-09-11T22:04:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.613+0000 7f8aa222e640 1 -- 172.21.15.152:0/7166595 shutdown_connections 2024-09-11T22:04:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.613+0000 7f8aa222e640 1 --2- 172.21.15.152:0/7166595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a9c102050 0x7f8a9c10d7d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.613+0000 7f8aa222e640 1 --2- 172.21.15.152:0/7166595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a9c1016d0 0x7f8a9c101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.613+0000 7f8aa222e640 1 --2- 172.21.15.152:0/7166595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a9c105af0 0x7f8a9c105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.613+0000 7f8aa222e640 1 -- 172.21.15.152:0/7166595 >> 172.21.15.152:0/7166595 conn(0x7f8a9c075f20 msgr2=0x7f8a9c076330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.613+0000 7f8aa222e640 1 -- 172.21.15.152:0/7166595 shutdown_connections 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.613+0000 7f8aa222e640 1 -- 172.21.15.152:0/7166595 wait complete. 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.614+0000 7f8aa222e640 1 Processor -- start 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.614+0000 7f8aa222e640 1 -- start start 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.614+0000 7f8aa222e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a9c1016d0 0x7f8a9c1990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.614+0000 7f8aa222e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a9c102050 0x7f8a9c199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.614+0000 7f8aa222e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a9c105af0 0x7f8a9c1a4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.614+0000 7f8aa222e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c110da0 con 0x7f8a9c102050 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.614+0000 7f8aa222e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c110c20 con 0x7f8a9c105af0 2024-09-11T22:04:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.614+0000 7f8aa222e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c110f20 con 0x7f8a9c1016d0 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.614+0000 7f8a93fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a9c102050 0x7f8a9c199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.614+0000 7f8a93fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a9c102050 0x7f8a9c199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33924/0 (socket says 172.21.15.152:33924) 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.614+0000 7f8a93fff640 1 -- 172.21.15.152:0/1745486898 learned_addr learned my addr 172.21.15.152:0/1745486898 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a9bfff640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a9c105af0 0x7f8a9c1a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a93fff640 1 -- 172.21.15.152:0/1745486898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a9c1016d0 msgr2=0x7f8a9c1990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a9b7fe640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a9c1016d0 0x7f8a9c1990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a93fff640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a9c1016d0 0x7f8a9c1990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a93fff640 1 -- 172.21.15.152:0/1745486898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a9c105af0 msgr2=0x7f8a9c1a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a93fff640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a9c105af0 0x7f8a9c1a4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a93fff640 1 -- 172.21.15.152:0/1745486898 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c1a4690 con 0x7f8a9c102050 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a9bfff640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a9c105af0 0x7f8a9c1a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a93fff640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a9c102050 0x7f8a9c199610 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400d950 tx=0x7f8a8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a997fa640 1 -- 172.21.15.152:0/1745486898 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84017070 con 0x7f8a9c102050 2024-09-11T22:04:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a997fa640 1 -- 172.21.15.152:0/1745486898 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a84009c30 con 0x7f8a9c102050 2024-09-11T22:04:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8aa222e640 1 -- 172.21.15.152:0/1745486898 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9c1a4860 con 0x7f8a9c102050 2024-09-11T22:04:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8a997fa640 1 -- 172.21.15.152:0/1745486898 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8400f6b0 con 0x7f8a9c102050 2024-09-11T22:04:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.615+0000 7f8aa222e640 1 -- 172.21.15.152:0/1745486898 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9c1a4dd0 con 0x7f8a9c102050 2024-09-11T22:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8a997fa640 1 -- 172.21.15.152:0/1745486898 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f8a840109d0 con 0x7f8a9c102050 2024-09-11T22:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8aa4fcc740 1 Processor -- start 2024-09-11T22:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8aa4fcc740 1 -- start start 2024-09-11T22:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4caf0 0x56075ce4ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4d410 0x56075ce57770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56075cdb12f0 con 0x56075ce57cb0 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56075cd59270 con 0x56075ce4d410 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56075cdad2b0 con 0x56075ce4caf0 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8a93fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8a93fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33926/0 (socket says 172.21.15.152:33926) 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8a93fff640 1 -- 172.21.15.152:0/104011791 learned_addr learned my addr 172.21.15.152:0/104011791 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.618+0000 7f8a997fa640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a880a2f40 0x7f8a880a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a9bfff640 1 --2- 172.21.15.152:0/104011791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4caf0 0x56075ce4ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a9b7fe640 1 --2- 172.21.15.152:0/104011791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4d410 0x56075ce57770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a9bfff640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a880a2f40 0x7f8a880a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a93fff640 1 -- 172.21.15.152:0/104011791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4caf0 msgr2=0x56075ce4ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a93fff640 1 --2- 172.21.15.152:0/104011791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4caf0 0x56075ce4ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a93fff640 1 -- 172.21.15.152:0/104011791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4d410 msgr2=0x56075ce57770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a93fff640 1 --2- 172.21.15.152:0/104011791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4d410 0x56075ce57770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a997fa640 1 -- 172.21.15.152:0/1745486898 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8a840cf390 con 0x7f8a9c102050 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a93fff640 1 -- 172.21.15.152:0/104011791 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075cd58340 con 0x56075ce57cb0 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a9b7fe640 1 --2- 172.21.15.152:0/104011791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4d410 0x56075ce57770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a9bfff640 1 --2- 172.21.15.152:0/104011791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4caf0 0x56075ce4ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a93fff640 1 --2- 172.21.15.152:0/104011791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5a0a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8a840cc9a0 tx=0x7f8a84000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423ccaeb416a3378 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a9bfff640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a880a2f40 0x7f8a880a5400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a94030040 tx=0x7f8a940095c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a91ffb640 1 -- 172.21.15.152:0/104011791 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84020070 con 0x56075ce57cb0 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a91ffb640 1 -- 172.21.15.152:0/104011791 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a84009de0 con 0x56075ce57cb0 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.619+0000 7f8a91ffb640 1 -- 172.21.15.152:0/104011791 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84097e20 con 0x56075ce57cb0 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.620+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/104011791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 msgr2=0x56075ce5a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.620+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/104011791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5a0a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8a840cc9a0 tx=0x7f8a84000bc0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.620+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/104011791 shutdown_connections 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.620+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/104011791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5a0a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.620+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/104011791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4d410 0x56075ce57770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.620+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/104011791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4caf0 0x56075ce4ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.620+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/104011791 >> 172.21.15.152:0/104011791 conn(0x56075ce49060 msgr2=0x56075ce49440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.620+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/104011791 shutdown_connections 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.620+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/104011791 wait complete. 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.620+0000 7f8aa4fcc740 1 -- start start 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.620+0000 7f8aa4fcc740 1 Processor -- start 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4caf0 0x56075ce54bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4d410 0x56075ce55130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce57cb0 0x56075ce55670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56075ce5a880 con 0x56075ce4caf0 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56075cd3a290 con 0x56075ce57cb0 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56075ce5aa00 con 0x56075ce4d410 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8aa4fcc740 10 client.0 _ll_register_callbacks cb 0x56075cd6b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a9b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4caf0 0x56075ce54bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a9b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4caf0 0x56075ce54bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33936/0 (socket says 172.21.15.152:33936) 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a9b7fe640 1 -- 172.21.15.152:0/2828247836 learned_addr learned my addr 172.21.15.152:0/2828247836 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a93fff640 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4d410 0x56075ce55130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a9bfff640 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce57cb0 0x56075ce55670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a9b7fe640 1 -- 172.21.15.152:0/2828247836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4d410 msgr2=0x56075ce55130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a9b7fe640 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4d410 0x56075ce55130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a9b7fe640 1 -- 172.21.15.152:0/2828247836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce57cb0 msgr2=0x56075ce55670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a9b7fe640 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce57cb0 0x56075ce55670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a9b7fe640 1 -- 172.21.15.152:0/2828247836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56075cac4210 con 0x56075ce4caf0 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a9b7fe640 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4caf0 0x56075ce54bf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00f6f0 tx=0x7f8a8c00fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1667195f3f4d24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a7affd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a7affd640 1 -- 172.21.15.152:0/2828247836 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c016070 con 0x56075ce4caf0 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8a7affd640 1 -- 172.21.15.152:0/2828247836 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8a8c00bb00 con 0x56075ce4caf0 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.621+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/2828247836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a84009de0 con 0x56075ce4caf0 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8a7affd640 1 -- 172.21.15.152:0/2828247836 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8a8c00bd00 con 0x56075ce4caf0 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8aa4fcc740 10 client.15390 fetch_fsmap learned FSMap version 24 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/2828247836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56075cb90620 con 0x56075ce4caf0 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8a7affd640 1 -- 172.21.15.152:0/2828247836 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a84009de0 con 0x56075ce4caf0 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8a7affd640 1 -- 172.21.15.152:0/2828247836 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8a8c010660 con 0x56075ce4caf0 2024-09-11T22:04:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8aa4fcc740 10 client.15390 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8aa4fcc740 10 client.15390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8aa4fcc740 20 client.15390 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56075ce67cb0 0x56075ce6a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8aa4fcc740 4 client.15390 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/2828247836 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56075cdbea20 con 0x56075ce67cb0 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.622+0000 7f8a93fff640 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56075ce67cb0 0x56075ce6a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.623+0000 7f8a7affd640 10 client.15390 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.623+0000 7f8a93fff640 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56075ce67cb0 0x56075ce6a100 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f56e36e0581b86e server_cookie=8caf263bcb33db8c in_seq=0 out_seq=0 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.623+0000 7f8a7affd640 1 -- 172.21.15.152:0/2828247836 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56075cdbea20 con 0x56075ce67cb0 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.623+0000 7f8a7affd640 10 client.15390 handle_command_reply: tid=0 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.623+0000 7f8aa4fcc740 1 client.15390 shutdown 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.623+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/2828247836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4caf0 msgr2=0x56075ce54bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.623+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4caf0 0x56075ce54bf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00f6f0 tx=0x7f8a8c00fbb0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.623+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/2828247836 shutdown_connections 2024-09-11T22:04:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.623+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56075ce67cb0 0x56075ce6a100 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.623+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce57cb0 0x56075ce55670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.624+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4d410 0x56075ce55130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.624+0000 7f8a7affd640 0 client.15390 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.624+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/2828247836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4caf0 0x56075ce54bf0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.624+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/2828247836 >> 172.21.15.152:0/2828247836 conn(0x56075ce49060 msgr2=0x56075ce4edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.624+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/2828247836 shutdown_connections 2024-09-11T22:04:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.624+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/2828247836 wait complete. 2024-09-11T22:04:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.624+0000 7f8aa4fcc740 20 client.15390 trim_cache size 0 max 16384 2024-09-11T22:04:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8aa4fcc740 1 Processor -- start 2024-09-11T22:04:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8aa4fcc740 1 -- start start 2024-09-11T22:04:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4caf0 0x56075ce4f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4d410 0x56075ce554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce57cb0 0x56075ce6fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1b0170 con 0x56075ce4d410 2024-09-11T22:04:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1ada40 con 0x56075ce4caf0 2024-09-11T22:04:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1ab890 con 0x56075ce57cb0 2024-09-11T22:04:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a93fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4d410 0x56075ce554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a93fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4d410 0x56075ce554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33938/0 (socket says 172.21.15.152:33938) 2024-09-11T22:04:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a93fff640 1 -- 172.21.15.152:0/4241266174 learned_addr learned my addr 172.21.15.152:0/4241266174 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a9bfff640 1 --2- 172.21.15.152:0/4241266174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce57cb0 0x56075ce6fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a93fff640 1 -- 172.21.15.152:0/4241266174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce57cb0 msgr2=0x56075ce6fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a93fff640 1 --2- 172.21.15.152:0/4241266174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce57cb0 0x56075ce6fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a93fff640 1 -- 172.21.15.152:0/4241266174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4caf0 msgr2=0x56075ce4f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a9b7fe640 1 --2- 172.21.15.152:0/4241266174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4caf0 0x56075ce4f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a93fff640 1 --2- 172.21.15.152:0/4241266174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4caf0 0x56075ce4f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a93fff640 1 -- 172.21.15.152:0/4241266174 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075ce4d240 con 0x56075ce4d410 2024-09-11T22:04:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a93fff640 1 --2- 172.21.15.152:0/4241266174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4d410 0x56075ce554a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8a84010db0 tx=0x7f8a84086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9204f356be3073b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a917fa640 1 -- 172.21.15.152:0/4241266174 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84014070 con 0x56075ce4d410 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.638+0000 7f8a917fa640 1 -- 172.21.15.152:0/4241266174 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a84009de0 con 0x56075ce4d410 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.639+0000 7f8a917fa640 1 -- 172.21.15.152:0/4241266174 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84020040 con 0x56075ce4d410 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.639+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/4241266174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4d410 msgr2=0x56075ce554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.639+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/4241266174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4d410 0x56075ce554a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8a84010db0 tx=0x7f8a84086040 comp rx=0 tx=0).stop 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.639+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/4241266174 shutdown_connections 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.639+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/4241266174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce57cb0 0x56075ce6fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.639+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/4241266174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce4d410 0x56075ce554a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.639+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/4241266174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4caf0 0x56075ce4f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.639+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/4241266174 >> 172.21.15.152:0/4241266174 conn(0x56075ce49060 msgr2=0x56075ce56c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.639+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/4241266174 shutdown_connections 2024-09-11T22:04:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.639+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/4241266174 wait complete. 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.639+0000 7f8aa4fcc740 1 -- start start 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8aa4fcc740 1 Processor -- start 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4caf0 0x56075ce5b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4d410 0x56075ce5be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8aa4fcc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1abf00 con 0x56075ce57cb0 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1ad370 con 0x56075ce4caf0 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8aa4fcc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1ac5d0 con 0x56075ce4d410 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8aa4fcc740 10 client.0 _ll_register_callbacks cb 0x7f8a8c00d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a9bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a9bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33954/0 (socket says 172.21.15.152:33954) 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a9bfff640 1 -- 172.21.15.152:0/1980602591 learned_addr learned my addr 172.21.15.152:0/1980602591 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a9b7fe640 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4caf0 0x56075ce5b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a93fff640 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4d410 0x56075ce5be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a9bfff640 1 -- 172.21.15.152:0/1980602591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4d410 msgr2=0x56075ce5be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a9bfff640 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4d410 0x56075ce5be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a9bfff640 1 -- 172.21.15.152:0/1980602591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4caf0 msgr2=0x56075ce5b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a9bfff640 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4caf0 0x56075ce5b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a9bfff640 1 -- 172.21.15.152:0/1980602591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56075ced1a30 con 0x56075ce57cb0 2024-09-11T22:04:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a93fff640 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4d410 0x56075ce5be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a9b7fe640 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4caf0 0x56075ce5b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a9bfff640 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5c3d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009ca0 tx=0x7f8a9402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d56133786b85ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.640+0000 7f8a7affd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8a7affd640 1 -- 172.21.15.152:0/1980602591 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94034040 con 0x56075ce57cb0 2024-09-11T22:04:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8a7affd640 1 -- 172.21.15.152:0/1980602591 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8a94004790 con 0x56075ce57cb0 2024-09-11T22:04:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/1980602591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a84009de0 con 0x56075ce57cb0 2024-09-11T22:04:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8a7affd640 1 -- 172.21.15.152:0/1980602591 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8a94053470 con 0x56075ce57cb0 2024-09-11T22:04:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8aa4fcc740 10 client.15396 fetch_fsmap learned FSMap version 24 2024-09-11T22:04:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/1980602591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56075ced2ca0 con 0x56075ce57cb0 2024-09-11T22:04:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8a7affd640 1 -- 172.21.15.152:0/1980602591 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a84009de0 con 0x56075ce57cb0 2024-09-11T22:04:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8a7affd640 1 -- 172.21.15.152:0/1980602591 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8a94047070 con 0x56075ce57cb0 2024-09-11T22:04:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8aa4fcc740 10 client.15396 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:04:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8aa4fcc740 10 client.15396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:04:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8aa4fcc740 20 client.15396 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56075ced3470 0x56075ced5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8aa4fcc740 4 client.15396 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:04:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/1980602591 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56075cdb8d70 con 0x56075ced3470 2024-09-11T22:04:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.641+0000 7f8a9b7fe640 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56075ced3470 0x56075ced5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.642+0000 7f8a9b7fe640 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56075ced3470 0x56075ced5890 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c32174c0866d99ca server_cookie=8f7ffc74f931378f in_seq=0 out_seq=0 2024-09-11T22:04:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.642+0000 7f8a7affd640 10 client.15396 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.655+0000 7f8a7affd640 1 -- 172.21.15.152:0/1980602591 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56075cdb8d70 con 0x56075ced3470 2024-09-11T22:04:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.655+0000 7f8a7affd640 10 client.15396 handle_command_reply: tid=0 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.655+0000 7f8aa4fcc740 1 client.15396 shutdown 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/1980602591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 msgr2=0x56075ce5c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5c3d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009ca0 tx=0x7f8a9402a950 comp rx=0 tx=0).stop 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/1980602591 shutdown_connections 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56075ced3470 0x56075ced5890 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56075ce57cb0 0x56075ce5c3d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56075ce4d410 0x56075ce5be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa4fcc740 1 --2- 172.21.15.152:0/1980602591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56075ce4caf0 0x56075ce5b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8a7affd640 0 client.15396 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/1980602591 >> 172.21.15.152:0/1980602591 conn(0x56075ce49060 msgr2=0x56075ce479a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/1980602591 shutdown_connections 2024-09-11T22:04:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa4fcc740 1 -- 172.21.15.152:0/1980602591 wait complete. 2024-09-11T22:04:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa4fcc740 20 client.15396 trim_cache size 0 max 16384 2024-09-11T22:04:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:04:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:04:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:04:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:04:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.656+0000 7f8aa222e640 1 -- 172.21.15.152:0/1745486898 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a880a2f40 msgr2=0x7f8a880a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.657+0000 7f8aa222e640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a880a2f40 0x7f8a880a5400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a94030040 tx=0x7f8a940095c0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.657+0000 7f8aa222e640 1 -- 172.21.15.152:0/1745486898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a9c102050 msgr2=0x7f8a9c199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.657+0000 7f8aa222e640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a9c102050 0x7f8a9c199610 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400d950 tx=0x7f8a8400de10 comp rx=0 tx=0).stop 2024-09-11T22:04:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.657+0000 7f8aa222e640 1 -- 172.21.15.152:0/1745486898 shutdown_connections 2024-09-11T22:04:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.657+0000 7f8aa222e640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a880a2f40 0x7f8a880a5400 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.657+0000 7f8aa222e640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a9c105af0 0x7f8a9c1a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.657+0000 7f8aa222e640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a9c102050 0x7f8a9c199610 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.657+0000 7f8aa222e640 1 --2- 172.21.15.152:0/1745486898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a9c1016d0 0x7f8a9c1990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.657+0000 7f8aa222e640 1 -- 172.21.15.152:0/1745486898 >> 172.21.15.152:0/1745486898 conn(0x7f8a9c075f20 msgr2=0x7f8a9c0ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.657+0000 7f8aa222e640 1 -- 172.21.15.152:0/1745486898 shutdown_connections 2024-09-11T22:04:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:42.657+0000 7f8aa222e640 1 -- 172.21.15.152:0/1745486898 wait complete. 2024-09-11T22:04:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:42 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1149046972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:42.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:42 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1149046972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:42.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:42 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1149046972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:04:43.392 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-11T22:04:43.469 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-11T22:04:43.471 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-11T22:04:43.502 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T22:02:36.537273+0000', 'modified': '2024-09-11T22:04:18.708640+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24472, 'mds_1': 24470, 'mds_2': 24457}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24431': {'gid': 24431, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6835/161011948', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 161011948}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 161011948}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6837/4020116810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 4020116810}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 4020116810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6835/714804093', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 714804093}, {'type': 'v1', 'addr': '172.21.15.193:6835', 'nonce': 714804093}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.193:6837/3273726370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6836', 'nonce': 3273726370}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 3273726370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'b', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.179:6839/7269368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6838', 'nonce': 7269368}, {'type': 'v1', 'addr': '172.21.15.179:6839', 'nonce': 7269368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.193:6839/1925980452', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6838', 'nonce': 1925980452}, {'type': 'v1', 'addr': '172.21.15.193:6839', 'nonce': 1925980452}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24472, 'qdb_cluster': [24472, 24470, 24457]} 2024-09-11T22:04:43.502 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T22:04:43.502 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T22:04:43.562 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:43 smithi152 ceph-mon[31188]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 30 op/s 2024-09-11T22:04:43.579 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-11T22:04:43.654 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/: 2024-09-11T22:04:43.654 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:04:43.654 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 . 2024-09-11T22:04:43.654 INFO:teuthology.orchestra.run.smithi152.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 .. 2024-09-11T22:04:43.655 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 data 2024-09-11T22:04:43.655 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:04:43.655 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data: 2024-09-11T22:04:43.655 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:04:43.655 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:04:43.655 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 .. 2024-09-11T22:04:43.656 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-11T22:04:43.742 INFO:teuthology.orchestra.run.smithi152.stdout:[Service] 2024-09-11T22:04:43.742 INFO:teuthology.orchestra.run.smithi152.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-11T22:04:43.742 INFO:teuthology.orchestra.run.smithi152.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-11T22:04:43.745 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-11T22:04:43.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:43 smithi179 ceph-mon[35603]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 30 op/s 2024-09-11T22:04:43.800 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:43.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:43 smithi193 ceph-mon[35545]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 30 op/s 2024-09-11T22:04:43.835 INFO:teuthology.orchestra.run.smithi152.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-11T22:04:44.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.362+0000 7f37dce5a640 1 -- 172.21.15.152:0/2857945260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d81082a0 msgr2=0x7f37d810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:44.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.362+0000 7f37dce5a640 1 --2- 172.21.15.152:0/2857945260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d81082a0 0x7f37d810ec40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009cd0 tx=0x7f37d002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.362+0000 7f37dce5a640 1 -- 172.21.15.152:0/2857945260 shutdown_connections 2024-09-11T22:04:44.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.362+0000 7f37dce5a640 1 --2- 172.21.15.152:0/2857945260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d81082a0 0x7f37d810ec40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.362+0000 7f37dce5a640 1 --2- 172.21.15.152:0/2857945260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37d81036e0 0x7f37d8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.362+0000 7f37dce5a640 1 --2- 172.21.15.152:0/2857945260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37d8102d30 0x7f37d8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.362+0000 7f37dce5a640 1 -- 172.21.15.152:0/2857945260 >> 172.21.15.152:0/2857945260 conn(0x7f37d80fc7d0 msgr2=0x7f37d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:44.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.362+0000 7f37dce5a640 1 -- 172.21.15.152:0/2857945260 shutdown_connections 2024-09-11T22:04:44.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.362+0000 7f37dce5a640 1 -- 172.21.15.152:0/2857945260 wait complete. 2024-09-11T22:04:44.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37dce5a640 1 Processor -- start 2024-09-11T22:04:44.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37dce5a640 1 -- start start 2024-09-11T22:04:44.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37dce5a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37d8102d30 0x7f37d81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37dce5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37d81036e0 0x7f37d8198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37dce5a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d81082a0 0x7f37d819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37dce5a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f37d81120a0 con 0x7f37d81082a0 2024-09-11T22:04:44.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37dce5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f37d8111f20 con 0x7f37d81036e0 2024-09-11T22:04:44.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37dce5a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f37d8112220 con 0x7f37d8102d30 2024-09-11T22:04:44.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37d6d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d81082a0 0x7f37d819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37d6d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d81082a0 0x7f37d819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47074/0 (socket says 172.21.15.152:47074) 2024-09-11T22:04:44.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37d6d9d640 1 -- 172.21.15.152:0/1522202450 learned_addr learned my addr 172.21.15.152:0/1522202450 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:44.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.363+0000 7f37d659c640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37d8102d30 0x7f37d81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37d6d9d640 1 -- 172.21.15.152:0/1522202450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37d8102d30 msgr2=0x7f37d81984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:44.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37d81036e0 0x7f37d8198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37d6d9d640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37d8102d30 0x7f37d81984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37d6d9d640 1 -- 172.21.15.152:0/1522202450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37d81036e0 msgr2=0x7f37d8198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:44.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37d6d9d640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37d81036e0 0x7f37d8198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37d6d9d640 1 -- 172.21.15.152:0/1522202450 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d819d490 con 0x7f37d81082a0 2024-09-11T22:04:44.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37d6d9d640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d81082a0 0x7f37d819cdb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f37d0005cc0 tx=0x7f37d0032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:44.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37c77fe640 1 -- 172.21.15.152:0/1522202450 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0004040 con 0x7f37d81082a0 2024-09-11T22:04:44.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37c77fe640 1 -- 172.21.15.152:0/1522202450 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37d00046c0 con 0x7f37d81082a0 2024-09-11T22:04:44.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37c77fe640 1 -- 172.21.15.152:0/1522202450 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0030dc0 con 0x7f37d81082a0 2024-09-11T22:04:44.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37dce5a640 1 -- 172.21.15.152:0/1522202450 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d819d720 con 0x7f37d81082a0 2024-09-11T22:04:44.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.364+0000 7f37dce5a640 1 -- 172.21.15.152:0/1522202450 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d81a5060 con 0x7f37d81082a0 2024-09-11T22:04:44.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.366+0000 7f37c77fe640 1 -- 172.21.15.152:0/1522202450 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f37d00041e0 con 0x7f37d81082a0 2024-09-11T22:04:44.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37df233740 1 Processor -- start 2024-09-11T22:04:44.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37df233740 1 -- start start 2024-09-11T22:04:44.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37df233740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1629db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37df233740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d162a2f0 0x5635d1634670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37c77fe640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37c00a2e90 0x7f37c00a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37df233740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d1634bb0 0x5635d1636fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37df233740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5635d1590090 con 0x5635d1634bb0 2024-09-11T22:04:44.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37df233740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5635d1537a70 con 0x5635d162a2f0 2024-09-11T22:04:44.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37df233740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5635d158c050 con 0x5635d16299d0 2024-09-11T22:04:44.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37d5d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1629db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37d5d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1629db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:42486/0 (socket says 172.21.15.152:42486) 2024-09-11T22:04:44.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37d5d9b640 1 -- 172.21.15.152:0/132052164 learned_addr learned my addr 172.21.15.152:0/132052164 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:44.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37d6d9d640 1 --2- 172.21.15.152:0/132052164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d1634bb0 0x5635d1636fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37d659c640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37c00a2e90 0x7f37c00a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/132052164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d162a2f0 0x5635d1634670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.367+0000 7f37c77fe640 1 -- 172.21.15.152:0/1522202450 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f37d002e030 con 0x7f37d81082a0 2024-09-11T22:04:44.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.368+0000 7f37d5d9b640 1 -- 172.21.15.152:0/132052164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d162a2f0 msgr2=0x5635d1634670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:44.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.368+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/132052164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d162a2f0 0x5635d1634670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.368+0000 7f37d5d9b640 1 -- 172.21.15.152:0/132052164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d1634bb0 msgr2=0x5635d1636fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:44.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.368+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/132052164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d1634bb0 0x5635d1636fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.368+0000 7f37d5d9b640 1 -- 172.21.15.152:0/132052164 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d1544130 con 0x5635d16299d0 2024-09-11T22:04:44.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.368+0000 7f37d659c640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37c00a2e90 0x7f37c00a5350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f37c800abe0 tx=0x7f37c800a2d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.368+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/132052164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1629db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f37cc009fd0 tx=0x7f37cc009630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2009c52042e8d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.368+0000 7f37c4ff9640 1 -- 172.21.15.152:0/132052164 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0140d0 con 0x5635d16299d0 2024-09-11T22:04:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.368+0000 7f37c4ff9640 1 -- 172.21.15.152:0/132052164 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37cc014270 con 0x5635d16299d0 2024-09-11T22:04:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.368+0000 7f37c4ff9640 1 -- 172.21.15.152:0/132052164 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0047a0 con 0x5635d16299d0 2024-09-11T22:04:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.369+0000 7f37df233740 1 -- 172.21.15.152:0/132052164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 msgr2=0x5635d1629db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.369+0000 7f37df233740 1 --2- 172.21.15.152:0/132052164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1629db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f37cc009fd0 tx=0x7f37cc009630 comp rx=0 tx=0).stop 2024-09-11T22:04:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.369+0000 7f37df233740 1 -- 172.21.15.152:0/132052164 shutdown_connections 2024-09-11T22:04:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.369+0000 7f37df233740 1 --2- 172.21.15.152:0/132052164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d1634bb0 0x5635d1636fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.369+0000 7f37df233740 1 --2- 172.21.15.152:0/132052164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d162a2f0 0x5635d1634670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.369+0000 7f37df233740 1 --2- 172.21.15.152:0/132052164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1629db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.369+0000 7f37df233740 1 -- 172.21.15.152:0/132052164 >> 172.21.15.152:0/132052164 conn(0x5635d1625f60 msgr2=0x5635d1626340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:44.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.369+0000 7f37df233740 1 -- 172.21.15.152:0/132052164 shutdown_connections 2024-09-11T22:04:44.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.369+0000 7f37df233740 1 -- 172.21.15.152:0/132052164 wait complete. 2024-09-11T22:04:44.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.369+0000 7f37df233740 1 -- start start 2024-09-11T22:04:44.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.369+0000 7f37df233740 1 Processor -- start 2024-09-11T22:04:44.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37df233740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1634400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37df233740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 0x5635d1631750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37df233740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d1634bb0 0x5635d1631c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37df233740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5635d1637780 con 0x5635d162a2f0 2024-09-11T22:04:44.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37df233740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5635d154af20 con 0x5635d1634bb0 2024-09-11T22:04:44.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37df233740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5635d1637900 con 0x5635d16299d0 2024-09-11T22:04:44.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37df233740 10 client.0 _ll_register_callbacks cb 0x5635d1514030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:44.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37d659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1634400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37d5d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 0x5635d1631750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37d659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1634400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:42496/0 (socket says 172.21.15.152:42496) 2024-09-11T22:04:44.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37d659c640 1 -- 172.21.15.152:0/2989596674 learned_addr learned my addr 172.21.15.152:0/2989596674 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:44.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37d6d9d640 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d1634bb0 0x5635d1631c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37d659c640 1 -- 172.21.15.152:0/2989596674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d1634bb0 msgr2=0x5635d1631c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:44.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37d659c640 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d1634bb0 0x5635d1631c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37d659c640 1 -- 172.21.15.152:0/2989596674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 msgr2=0x5635d1631750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37d659c640 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 0x5635d1631750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37d659c640 1 -- 172.21.15.152:0/2989596674 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635d13012b0 con 0x5635d16299d0 2024-09-11T22:04:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37d659c640 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1634400 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f37c8005e10 tx=0x7f37c8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b5cb0c77745fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:04:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.370+0000 7f37bdffb640 1 -- 172.21.15.152:0/2989596674 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c8016070 con 0x5635d16299d0 2024-09-11T22:04:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37df233740 1 -- 172.21.15.152:0/2989596674 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37cc014270 con 0x5635d16299d0 2024-09-11T22:04:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37bdffb640 1 -- 172.21.15.152:0/2989596674 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f37c800fe40 con 0x5635d16299d0 2024-09-11T22:04:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37bdffb640 1 -- 172.21.15.152:0/2989596674 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f37c8027480 con 0x5635d16299d0 2024-09-11T22:04:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37df233740 10 client.25102 fetch_fsmap learned FSMap version 24 2024-09-11T22:04:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37df233740 1 -- 172.21.15.152:0/2989596674 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5635d1643100 con 0x5635d16299d0 2024-09-11T22:04:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37bdffb640 1 -- 172.21.15.152:0/2989596674 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37cc014270 con 0x5635d16299d0 2024-09-11T22:04:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37bdffb640 1 -- 172.21.15.152:0/2989596674 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f37c802e070 con 0x5635d16299d0 2024-09-11T22:04:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37df233740 10 client.25102 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:04:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37df233740 10 client.25102 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:04:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37df233740 20 client.25102 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37df233740 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5635d1645680 0x5635d1646af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37df233740 4 client.25102 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:04:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37df233740 1 -- 172.21.15.152:0/2989596674 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635d159d600 con 0x5635d1645680 2024-09-11T22:04:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.371+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5635d1645680 0x5635d1646af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.372+0000 7f37bdffb640 10 client.25102 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:04:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.372+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5635d1645680 0x5635d1646af0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31a19b228b1a35ae server_cookie=d9de1dd7237d56c3 in_seq=0 out_seq=0 2024-09-11T22:04:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.372+0000 7f37bdffb640 1 -- 172.21.15.152:0/2989596674 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635d159d600 con 0x5635d1645680 2024-09-11T22:04:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.372+0000 7f37bdffb640 10 client.25102 handle_command_reply: tid=0 2024-09-11T22:04:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 1 client.25102 shutdown 2024-09-11T22:04:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 1 -- 172.21.15.152:0/2989596674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 msgr2=0x5635d1634400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1634400 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f37c8005e10 tx=0x7f37c8004730 comp rx=0 tx=0).stop 2024-09-11T22:04:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 1 -- 172.21.15.152:0/2989596674 shutdown_connections 2024-09-11T22:04:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5635d1645680 0x5635d1646af0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d1634bb0 0x5635d1631c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 0x5635d1631750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 1 --2- 172.21.15.152:0/2989596674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d16299d0 0x5635d1634400 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37bdffb640 0 client.25102 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:04:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 1 -- 172.21.15.152:0/2989596674 >> 172.21.15.152:0/2989596674 conn(0x5635d1625f60 msgr2=0x5635d162bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 1 -- 172.21.15.152:0/2989596674 shutdown_connections 2024-09-11T22:04:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 1 -- 172.21.15.152:0/2989596674 wait complete. 2024-09-11T22:04:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.373+0000 7f37df233740 20 client.25102 trim_cache size 0 max 16384 2024-09-11T22:04:44.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37df233740 1 Processor -- start 2024-09-11T22:04:44.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37df233740 1 -- start start 2024-09-11T22:04:44.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37df233740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d16299d0 0x5635d1644fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37df233740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d162a2f0 0x5635d1645d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37df233740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d1634bb0 0x5635d164eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37df233740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5635d1644e30 con 0x5635d16299d0 2024-09-11T22:04:44.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37df233740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5635d1645500 con 0x5635d1634bb0 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37df233740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5635d1645bd0 con 0x5635d162a2f0 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37d659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d16299d0 0x5635d1644fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37d5d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d162a2f0 0x5635d1645d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37d659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d16299d0 0x5635d1644fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47100/0 (socket says 172.21.15.152:47100) 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37d659c640 1 -- 172.21.15.152:0/147206638 learned_addr learned my addr 172.21.15.152:0/147206638 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.393+0000 7f37d6d9d640 1 --2- 172.21.15.152:0/147206638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d1634bb0 0x5635d164eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.394+0000 7f37d5d9b640 1 -- 172.21.15.152:0/147206638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d1634bb0 msgr2=0x5635d164eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.394+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/147206638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d1634bb0 0x5635d164eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.394+0000 7f37d5d9b640 1 -- 172.21.15.152:0/147206638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d16299d0 msgr2=0x5635d1644fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.394+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/147206638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d16299d0 0x5635d1644fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.394+0000 7f37d5d9b640 1 -- 172.21.15.152:0/147206638 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d162fca0 con 0x5635d162a2f0 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.394+0000 7f37d6d9d640 1 --2- 172.21.15.152:0/147206638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d1634bb0 0x5635d164eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:44.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.394+0000 7f37d659c640 1 --2- 172.21.15.152:0/147206638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d16299d0 0x5635d1644fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.394+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/147206638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d162a2f0 0x5635d1645d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0058c0 tx=0x7f37cc0053f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823f0ff06b64bc84 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.394+0000 7f37bffff640 1 -- 172.21.15.152:0/147206638 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc02d070 con 0x5635d162a2f0 2024-09-11T22:04:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.394+0000 7f37bffff640 1 -- 172.21.15.152:0/147206638 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37cc005460 con 0x5635d162a2f0 2024-09-11T22:04:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.394+0000 7f37bffff640 1 -- 172.21.15.152:0/147206638 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0048e0 con 0x5635d162a2f0 2024-09-11T22:04:44.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 -- 172.21.15.152:0/147206638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d162a2f0 msgr2=0x5635d1645d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:44.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 --2- 172.21.15.152:0/147206638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d162a2f0 0x5635d1645d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0058c0 tx=0x7f37cc0053f0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 -- 172.21.15.152:0/147206638 shutdown_connections 2024-09-11T22:04:44.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 --2- 172.21.15.152:0/147206638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d1634bb0 0x5635d164eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 --2- 172.21.15.152:0/147206638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d162a2f0 0x5635d1645d50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 --2- 172.21.15.152:0/147206638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d16299d0 0x5635d1644fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 -- 172.21.15.152:0/147206638 >> 172.21.15.152:0/147206638 conn(0x5635d1625f60 msgr2=0x5635d1630020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:44.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 -- 172.21.15.152:0/147206638 shutdown_connections 2024-09-11T22:04:44.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 -- 172.21.15.152:0/147206638 wait complete. 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 -- start start 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 Processor -- start 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d16299d0 0x5635d164a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.395+0000 7f37df233740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 0x5635d164a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37df233740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d1634bb0 0x5635d16add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37df233740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5635d1646970 con 0x5635d162a2f0 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37df233740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5635d16462a0 con 0x5635d16299d0 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37df233740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5635d1647040 con 0x5635d1634bb0 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37df233740 10 client.0 _ll_register_callbacks cb 0x7f37c800a8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d5d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 0x5635d164a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d6d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d1634bb0 0x5635d16add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d5d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 0x5635d164a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47102/0 (socket says 172.21.15.152:47102) 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d5d9b640 1 -- 172.21.15.152:0/2818289756 learned_addr learned my addr 172.21.15.152:0/2818289756 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d6d9d640 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d1634bb0 0x5635d16add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:42508/0 (socket says 172.21.15.152:42508) 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d659c640 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d16299d0 0x5635d164a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d5d9b640 1 -- 172.21.15.152:0/2818289756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d1634bb0 msgr2=0x5635d16add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d1634bb0 0x5635d16add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d5d9b640 1 -- 172.21.15.152:0/2818289756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d16299d0 msgr2=0x5635d164a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d16299d0 0x5635d164a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d5d9b640 1 -- 172.21.15.152:0/2818289756 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635d16ae3c0 con 0x5635d162a2f0 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d6d9d640 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d1634bb0 0x5635d16add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37d5d9b640 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 0x5635d164a940 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f37cc009fd0 tx=0x7f37cc005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5e50c7f69d2458 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:44.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37bdffb640 1 -- 172.21.15.152:0/2818289756 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc036020 con 0x5635d162a2f0 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37df233740 1 -- 172.21.15.152:0/2818289756 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37cc005460 con 0x5635d162a2f0 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.396+0000 7f37bdffb640 1 -- 172.21.15.152:0/2818289756 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f37cc00f730 con 0x5635d162a2f0 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37bdffb640 1 -- 172.21.15.152:0/2818289756 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f37cc041050 con 0x5635d162a2f0 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37df233740 10 client.15414 fetch_fsmap learned FSMap version 24 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37df233740 1 -- 172.21.15.152:0/2818289756 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5635d16af680 con 0x5635d162a2f0 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37bdffb640 1 -- 172.21.15.152:0/2818289756 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37cc005460 con 0x5635d162a2f0 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37bdffb640 1 -- 172.21.15.152:0/2818289756 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f37cc003bf0 con 0x5635d162a2f0 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37df233740 10 client.15414 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37df233740 10 client.15414 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37df233740 20 client.15414 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37df233740 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5635d16b3c20 0x5635d16b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:44.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37df233740 4 client.15414 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37df233740 1 -- 172.21.15.152:0/2818289756 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "status"}) -- 0x5635d1597b10 con 0x5635d16b3c20 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.397+0000 7f37d659c640 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5635d16b3c20 0x5635d16b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37d659c640 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5635d16b3c20 0x5635d16b2930 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41c16b6afbe217fa server_cookie=16962e10e0fc5cbc in_seq=0 out_seq=0 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37bdffb640 10 client.15414 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37bdffb640 1 -- 172.21.15.152:0/2818289756 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x5635d1597b10 con 0x5635d16b3c20 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37bdffb640 10 client.15414 handle_command_reply: tid=0 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 1 client.15414 shutdown 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 1 -- 172.21.15.152:0/2818289756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 msgr2=0x5635d164a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 0x5635d164a940 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f37cc009fd0 tx=0x7f37cc005f10 comp rx=0 tx=0).stop 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 1 -- 172.21.15.152:0/2818289756 shutdown_connections 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5635d16b3c20 0x5635d16b2930 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635d1634bb0 0x5635d16add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37bdffb640 0 client.15414 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:04:44.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5635d162a2f0 0x5635d164a940 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 1 --2- 172.21.15.152:0/2818289756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5635d16299d0 0x5635d164a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 1 -- 172.21.15.152:0/2818289756 >> 172.21.15.152:0/2818289756 conn(0x5635d1625f60 msgr2=0x5635d16247e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:44.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 1 -- 172.21.15.152:0/2818289756 shutdown_connections 2024-09-11T22:04:44.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 1 -- 172.21.15.152:0/2818289756 wait complete. 2024-09-11T22:04:44.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.398+0000 7f37df233740 20 client.15414 trim_cache size 0 max 16384 2024-09-11T22:04:44.406 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:04:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "5c140ed8-7088-11ef-bcea-c7b262605968", 2024-09-11T22:04:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 2, 2024-09-11T22:04:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 24457, 2024-09-11T22:04:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-09-11T22:04:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-09-11T22:04:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-09-11T22:04:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 119.569113974, 2024-09-11T22:04:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 24, 2024-09-11T22:04:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 85, 2024-09-11T22:04:44.408 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 85, 2024-09-11T22:04:44.408 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 150.37725182 2024-09-11T22:04:44.408 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:04:44.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 -- 172.21.15.152:0/1522202450 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37c00a2e90 msgr2=0x7f37c00a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:44.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37c00a2e90 0x7f37c00a5350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f37c800abe0 tx=0x7f37c800a2d0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 -- 172.21.15.152:0/1522202450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d81082a0 msgr2=0x7f37d819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:44.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d81082a0 0x7f37d819cdb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f37d0005cc0 tx=0x7f37d0032f40 comp rx=0 tx=0).stop 2024-09-11T22:04:44.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 -- 172.21.15.152:0/1522202450 shutdown_connections 2024-09-11T22:04:44.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37c00a2e90 0x7f37c00a5350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d81082a0 0x7f37d819cdb0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37d81036e0 0x7f37d8198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 --2- 172.21.15.152:0/1522202450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37d8102d30 0x7f37d81984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:44.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 -- 172.21.15.152:0/1522202450 >> 172.21.15.152:0/1522202450 conn(0x7f37d80fc7d0 msgr2=0x7f37d80fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:44.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 -- 172.21.15.152:0/1522202450 shutdown_connections 2024-09-11T22:04:44.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:44.399+0000 7f37dce5a640 1 -- 172.21.15.152:0/1522202450 wait complete. 2024-09-11T22:04:45.008 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T22:04:45.257 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:45.659 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:45 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:45.659 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:45 smithi152 ceph-mon[31188]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.7 KiB/s wr, 10 op/s 2024-09-11T22:04:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.739+0000 7f85aa9ca640 1 -- 172.21.15.152:0/1445232623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a4102570 msgr2=0x7f85a41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.739+0000 7f85aa9ca640 1 --2- 172.21.15.152:0/1445232623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a4102570 0x7f85a41029b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f858c009900 tx=0x7f858c02a480 comp rx=0 tx=0).stop 2024-09-11T22:04:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.739+0000 7f85aa9ca640 1 -- 172.21.15.152:0/1445232623 shutdown_connections 2024-09-11T22:04:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.739+0000 7f85aa9ca640 1 --2- 172.21.15.152:0/1445232623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85a4102ef0 0x7f85a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.739+0000 7f85aa9ca640 1 --2- 172.21.15.152:0/1445232623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a4102570 0x7f85a41029b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.739+0000 7f85aa9ca640 1 --2- 172.21.15.152:0/1445232623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a4100e20 0x7f85a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.739+0000 7f85aa9ca640 1 -- 172.21.15.152:0/1445232623 >> 172.21.15.152:0/1445232623 conn(0x7f85a40fc7d0 msgr2=0x7f85a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:45.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.739+0000 7f85aa9ca640 1 -- 172.21.15.152:0/1445232623 shutdown_connections 2024-09-11T22:04:45.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.739+0000 7f85aa9ca640 1 -- 172.21.15.152:0/1445232623 wait complete. 2024-09-11T22:04:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f85aa9ca640 1 Processor -- start 2024-09-11T22:04:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f85aa9ca640 1 -- start start 2024-09-11T22:04:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f85aa9ca640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a4100e20 0x7f85a41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f85aa9ca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a4102570 0x7f85a4198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f85aa9ca640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85a4102ef0 0x7f85a419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f85aa9ca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f85a4110f80 con 0x7f85a4102570 2024-09-11T22:04:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f85aa9ca640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f85a4110e00 con 0x7f85a4102ef0 2024-09-11T22:04:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f85aa9ca640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f85a4111100 con 0x7f85a4100e20 2024-09-11T22:04:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f859bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a4102570 0x7f85a4198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f859bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a4102570 0x7f85a4198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47122/0 (socket says 172.21.15.152:47122) 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f859bfff640 1 -- 172.21.15.152:0/2657462370 learned_addr learned my addr 172.21.15.152:0/2657462370 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.740+0000 7f85a8f67640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85a4102ef0 0x7f85a419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f85a3fff640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a4100e20 0x7f85a41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f859bfff640 1 -- 172.21.15.152:0/2657462370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a4100e20 msgr2=0x7f85a41985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f859bfff640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a4100e20 0x7f85a41985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f859bfff640 1 -- 172.21.15.152:0/2657462370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85a4102ef0 msgr2=0x7f85a419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f859bfff640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85a4102ef0 0x7f85a419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f859bfff640 1 -- 172.21.15.152:0/2657462370 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a419d570 con 0x7f85a4102570 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f85a8f67640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85a4102ef0 0x7f85a419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f859bfff640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a4102570 0x7f85a4198b00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f858c006010 tx=0x7f858c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f85a1ffb640 1 -- 172.21.15.152:0/2657462370 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c03f070 con 0x7f85a4102570 2024-09-11T22:04:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f85a1ffb640 1 -- 172.21.15.152:0/2657462370 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f858c031c30 con 0x7f85a4102570 2024-09-11T22:04:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f85aa9ca640 1 -- 172.21.15.152:0/2657462370 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a419d800 con 0x7f85a4102570 2024-09-11T22:04:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f85a1ffb640 1 -- 172.21.15.152:0/2657462370 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c035030 con 0x7f85a4102570 2024-09-11T22:04:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.741+0000 7f85aa9ca640 1 -- 172.21.15.152:0/2657462370 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a41a5140 con 0x7f85a4102570 2024-09-11T22:04:45.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.743+0000 7f85a1ffb640 1 -- 172.21.15.152:0/2657462370 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f858c042070 con 0x7f85a4102570 2024-09-11T22:04:45.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f85acda3740 1 Processor -- start 2024-09-11T22:04:45.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f85acda3740 1 -- start start 2024-09-11T22:04:45.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f85acda3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ad48b0 0x555d83ad4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f85acda3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83ae3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f85acda3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ae3fc0 0x555d83ae63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f85acda3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555d83a3b090 con 0x555d83ae3fc0 2024-09-11T22:04:45.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f85acda3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555d839e2a70 con 0x555d83ad48b0 2024-09-11T22:04:45.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f85acda3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555d83a37050 con 0x555d83ad51d0 2024-09-11T22:04:45.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f859bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ae3fc0 0x555d83ae63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f859bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ae3fc0 0x555d83ae63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47136/0 (socket says 172.21.15.152:47136) 2024-09-11T22:04:45.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f85a1ffb640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f85900a2e10 0x7f85900a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f859bfff640 1 -- 172.21.15.152:0/4100611255 learned_addr learned my addr 172.21.15.152:0/4100611255 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:45.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f85a3fff640 1 --2- 172.21.15.152:0/4100611255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83ae3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.744+0000 7f85a8f67640 1 --2- 172.21.15.152:0/4100611255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ad48b0 0x555d83ad4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f85a8f67640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f85900a2e10 0x7f85900a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f85a1ffb640 1 -- 172.21.15.152:0/2657462370 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f858c0eff70 con 0x7f85a4102570 2024-09-11T22:04:45.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f859bfff640 1 -- 172.21.15.152:0/4100611255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 msgr2=0x555d83ae3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:45.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f859bfff640 1 --2- 172.21.15.152:0/4100611255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83ae3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f859bfff640 1 -- 172.21.15.152:0/4100611255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ad48b0 msgr2=0x555d83ad4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:45.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f859bfff640 1 --2- 172.21.15.152:0/4100611255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ad48b0 0x555d83ad4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f859bfff640 1 -- 172.21.15.152:0/4100611255 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d839ef130 con 0x555d83ae3fc0 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f85a3fff640 1 --2- 172.21.15.152:0/4100611255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83ae3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f859bfff640 1 --2- 172.21.15.152:0/4100611255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ae3fc0 0x555d83ae63b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f858c0edc90 tx=0x7f858c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c79e7191cb9f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f85a8f67640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f85900a2e10 0x7f85900a52d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f859c00afd0 tx=0x7f859c005c60 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f859a7fc640 1 -- 172.21.15.152:0/4100611255 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c049070 con 0x555d83ae3fc0 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f859a7fc640 1 -- 172.21.15.152:0/4100611255 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f858c0bc9e0 con 0x555d83ae3fc0 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.745+0000 7f859a7fc640 1 -- 172.21.15.152:0/4100611255 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c0f20d0 con 0x555d83ae3fc0 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.746+0000 7f85acda3740 1 -- 172.21.15.152:0/4100611255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ae3fc0 msgr2=0x555d83ae63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.746+0000 7f85acda3740 1 --2- 172.21.15.152:0/4100611255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ae3fc0 0x555d83ae63b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f858c0edc90 tx=0x7f858c02a480 comp rx=0 tx=0).stop 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.746+0000 7f85acda3740 1 -- 172.21.15.152:0/4100611255 shutdown_connections 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.746+0000 7f85acda3740 1 --2- 172.21.15.152:0/4100611255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ae3fc0 0x555d83ae63b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.746+0000 7f85acda3740 1 --2- 172.21.15.152:0/4100611255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83ae3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.746+0000 7f85acda3740 1 --2- 172.21.15.152:0/4100611255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ad48b0 0x555d83ad4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.746+0000 7f85acda3740 1 -- 172.21.15.152:0/4100611255 >> 172.21.15.152:0/4100611255 conn(0x555d83ad0f60 msgr2=0x555d83ad1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.746+0000 7f85acda3740 1 -- 172.21.15.152:0/4100611255 shutdown_connections 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.746+0000 7f85acda3740 1 -- 172.21.15.152:0/4100611255 wait complete. 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.746+0000 7f85acda3740 1 -- start start 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.746+0000 7f85acda3740 1 Processor -- start 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f85acda3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad48b0 0x555d83ae3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f85acda3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad51d0 0x555d83ae0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f85acda3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 0x555d83ae1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f85acda3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555d83ae6950 con 0x555d83ad51d0 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f85acda3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555d839f5f20 con 0x555d83ae3fc0 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f85acda3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555d83ae6ad0 con 0x555d83ad48b0 2024-09-11T22:04:45.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f85acda3740 10 client.0 _ll_register_callbacks cb 0x555d839bf030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f859bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad51d0 0x555d83ae0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f85a3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad48b0 0x555d83ae3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f859bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad51d0 0x555d83ae0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47142/0 (socket says 172.21.15.152:47142) 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f859bfff640 1 -- 172.21.15.152:0/1091852139 learned_addr learned my addr 172.21.15.152:0/1091852139 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f859bfff640 1 -- 172.21.15.152:0/1091852139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad48b0 msgr2=0x555d83ae3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f859bfff640 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad48b0 0x555d83ae3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f859bfff640 1 -- 172.21.15.152:0/1091852139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 msgr2=0x555d83ae1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f859bfff640 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 0x555d83ae1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f859bfff640 1 -- 172.21.15.152:0/1091852139 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d837ac2b0 con 0x555d83ad51d0 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f85a3fff640 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad48b0 0x555d83ae3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f859bfff640 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad51d0 0x555d83ae0be0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f858c0bc270 tx=0x7f858c0b8b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dff1bb956efa932 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:45.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f85837fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.747+0000 7f85837fe640 1 -- 172.21.15.152:0/1091852139 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c049070 con 0x555d83ad51d0 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85837fe640 1 -- 172.21.15.152:0/1091852139 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f858c0bc540 con 0x555d83ad51d0 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85acda3740 1 -- 172.21.15.152:0/1091852139 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f858c0bc9e0 con 0x555d83ad51d0 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85837fe640 1 -- 172.21.15.152:0/1091852139 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f858c0bc2e0 con 0x555d83ad51d0 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85acda3740 10 client.15426 fetch_fsmap learned FSMap version 25 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85acda3740 1 -- 172.21.15.152:0/1091852139 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555d83ae6950 con 0x555d83ad51d0 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85837fe640 1 -- 172.21.15.152:0/1091852139 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f858c0bc9e0 con 0x555d83ad51d0 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85837fe640 1 -- 172.21.15.152:0/1091852139 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f858c0c4b50 con 0x555d83ad51d0 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85acda3740 10 client.15426 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85acda3740 10 client.15426 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85acda3740 20 client.15426 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:45.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85acda3740 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555d83af44e0 0x555d83af5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85acda3740 4 client.15426 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:04:45.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85acda3740 1 -- 172.21.15.152:0/1091852139 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d83a48600 con 0x555d83af44e0 2024-09-11T22:04:45.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.748+0000 7f85a3fff640 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555d83af44e0 0x555d83af5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.749+0000 7f85837fe640 10 client.15426 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:04:45.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.749+0000 7f85a3fff640 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555d83af44e0 0x555d83af5950 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e96f871f8c77e2a server_cookie=64b92c005f0c678f in_seq=0 out_seq=0 2024-09-11T22:04:45.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.749+0000 7f85837fe640 1 -- 172.21.15.152:0/1091852139 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d83a48600 con 0x555d83af44e0 2024-09-11T22:04:45.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.749+0000 7f85837fe640 10 client.15426 handle_command_reply: tid=0 2024-09-11T22:04:45.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 1 client.15426 shutdown 2024-09-11T22:04:45.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 1 -- 172.21.15.152:0/1091852139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad51d0 msgr2=0x555d83ae0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:45.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad51d0 0x555d83ae0be0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f858c0bc270 tx=0x7f858c0b8b80 comp rx=0 tx=0).stop 2024-09-11T22:04:45.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 1 -- 172.21.15.152:0/1091852139 shutdown_connections 2024-09-11T22:04:45.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555d83af44e0 0x555d83af5950 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 0x555d83ae1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad51d0 0x555d83ae0be0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85837fe640 0 client.15426 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:04:45.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 1 --2- 172.21.15.152:0/1091852139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad48b0 0x555d83ae3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 1 -- 172.21.15.152:0/1091852139 >> 172.21.15.152:0/1091852139 conn(0x555d83ad0f60 msgr2=0x555d83ad6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:45.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 1 -- 172.21.15.152:0/1091852139 shutdown_connections 2024-09-11T22:04:45.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 1 -- 172.21.15.152:0/1091852139 wait complete. 2024-09-11T22:04:45.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.750+0000 7f85acda3740 20 client.15426 trim_cache size 0 max 16384 2024-09-11T22:04:45.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.767+0000 7f85acda3740 1 Processor -- start 2024-09-11T22:04:45.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.767+0000 7f85acda3740 1 -- start start 2024-09-11T22:04:45.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.767+0000 7f85acda3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83af5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.767+0000 7f85acda3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83adfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.767+0000 7f85acda3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 0x555d83adde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.767+0000 7f85acda3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555d83af3c90 con 0x555d83ad48b0 2024-09-11T22:04:45.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85acda3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555d83af4360 con 0x555d83ae3fc0 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85acda3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555d83af4a30 con 0x555d83ad51d0 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83af5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83af5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47156/0 (socket says 172.21.15.152:47156) 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85a3fff640 1 -- 172.21.15.152:0/4223612136 learned_addr learned my addr 172.21.15.152:0/4223612136 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f859bfff640 1 --2- 172.21.15.152:0/4223612136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83adfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85a8f67640 1 --2- 172.21.15.152:0/4223612136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 0x555d83adde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85a3fff640 1 -- 172.21.15.152:0/4223612136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 msgr2=0x555d83adfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85a3fff640 1 --2- 172.21.15.152:0/4223612136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83adfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85a3fff640 1 -- 172.21.15.152:0/4223612136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 msgr2=0x555d83adde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85a3fff640 1 --2- 172.21.15.152:0/4223612136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 0x555d83adde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85a3fff640 1 -- 172.21.15.152:0/4223612136 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d83ae6950 con 0x555d83ad48b0 2024-09-11T22:04:45.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f85a3fff640 1 --2- 172.21.15.152:0/4223612136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83af5950 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x555d839f6030 tx=0x7f8594014900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89721e5ca08874c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:45.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f8599ffb640 1 -- 172.21.15.152:0/4223612136 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594014190 con 0x555d83ad48b0 2024-09-11T22:04:45.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f8599ffb640 1 -- 172.21.15.152:0/4223612136 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8594005500 con 0x555d83ad48b0 2024-09-11T22:04:45.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.768+0000 7f8599ffb640 1 -- 172.21.15.152:0/4223612136 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85940126b0 con 0x555d83ad48b0 2024-09-11T22:04:45.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.769+0000 7f85acda3740 1 -- 172.21.15.152:0/4223612136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 msgr2=0x555d83af5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:45.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.769+0000 7f85acda3740 1 --2- 172.21.15.152:0/4223612136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83af5950 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x555d839f6030 tx=0x7f8594014900 comp rx=0 tx=0).stop 2024-09-11T22:04:45.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.769+0000 7f85acda3740 1 -- 172.21.15.152:0/4223612136 shutdown_connections 2024-09-11T22:04:45.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.769+0000 7f85acda3740 1 --2- 172.21.15.152:0/4223612136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 0x555d83adde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.769+0000 7f85acda3740 1 --2- 172.21.15.152:0/4223612136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83adfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.769+0000 7f85acda3740 1 --2- 172.21.15.152:0/4223612136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83af5950 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.769+0000 7f85acda3740 1 -- 172.21.15.152:0/4223612136 >> 172.21.15.152:0/4223612136 conn(0x555d83ad0f60 msgr2=0x555d83adf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.769+0000 7f85acda3740 1 -- 172.21.15.152:0/4223612136 shutdown_connections 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.769+0000 7f85acda3740 1 -- 172.21.15.152:0/4223612136 wait complete. 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.769+0000 7f85acda3740 1 -- start start 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.769+0000 7f85acda3740 1 Processor -- start 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85acda3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83afdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85acda3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83afe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85acda3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 0x555d83af7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85acda3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555d83af57d0 con 0x555d83ad48b0 2024-09-11T22:04:45.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85acda3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555d83af5100 con 0x555d83ae3fc0 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85acda3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555d83af5ea0 con 0x555d83ad51d0 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85acda3740 10 client.0 _ll_register_callbacks cb 0x7f858c0b7f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83afdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83afdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47162/0 (socket says 172.21.15.152:47162) 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85a3fff640 1 -- 172.21.15.152:0/3301700187 learned_addr learned my addr 172.21.15.152:0/3301700187 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f859bfff640 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83afe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85a8f67640 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 0x555d83af7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85a3fff640 1 -- 172.21.15.152:0/3301700187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 msgr2=0x555d83afe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85a3fff640 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83afe510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85a3fff640 1 -- 172.21.15.152:0/3301700187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 msgr2=0x555d83af7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85a3fff640 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 0x555d83af7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85a3fff640 1 -- 172.21.15.152:0/3301700187 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d83af7d80 con 0x555d83ad48b0 2024-09-11T22:04:45.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85a3fff640 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83afdfd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f859400bd10 tx=0x7f85940056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7a20890ff63faf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:45.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85837fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:45.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.770+0000 7f85837fe640 1 -- 172.21.15.152:0/3301700187 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594005000 con 0x555d83ad48b0 2024-09-11T22:04:45.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85837fe640 1 -- 172.21.15.152:0/3301700187 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8594022040 con 0x555d83ad48b0 2024-09-11T22:04:45.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85acda3740 1 -- 172.21.15.152:0/3301700187 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8594005500 con 0x555d83ad48b0 2024-09-11T22:04:45.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85837fe640 1 -- 172.21.15.152:0/3301700187 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f85940051a0 con 0x555d83ad48b0 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85acda3740 10 client.15432 fetch_fsmap learned FSMap version 25 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85acda3740 1 -- 172.21.15.152:0/3301700187 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555d83afc790 con 0x555d83ad48b0 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85837fe640 1 -- 172.21.15.152:0/3301700187 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8594005500 con 0x555d83ad48b0 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85837fe640 1 -- 172.21.15.152:0/3301700187 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f8594039070 con 0x555d83ad48b0 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85acda3740 10 client.15432 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85acda3740 10 client.15432 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85acda3740 20 client.15432 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85acda3740 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555d83b63100 0x555d83b61de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85acda3740 4 client.15432 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f85acda3740 1 -- 172.21.15.152:0/3301700187 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "status"}) -- 0x555d83a42b10 con 0x555d83b63100 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.771+0000 7f859bfff640 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555d83b63100 0x555d83b61de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f859bfff640 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555d83b63100 0x555d83b61de0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a60827bdaab42cc6 server_cookie=3c6ce5dfb11cd408 in_seq=0 out_seq=0 2024-09-11T22:04:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85837fe640 10 client.15432 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85837fe640 1 -- 172.21.15.152:0/3301700187 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555d83a42b10 con 0x555d83b63100 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85837fe640 10 client.15432 handle_command_reply: tid=0 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 1 client.15432 shutdown 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 1 -- 172.21.15.152:0/3301700187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 msgr2=0x555d83afdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83afdfd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f859400bd10 tx=0x7f85940056d0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 1 -- 172.21.15.152:0/3301700187 shutdown_connections 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555d83b63100 0x555d83b61de0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d83ae3fc0 0x555d83af7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d83ad51d0 0x555d83afe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85837fe640 0 client.15432 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 1 --2- 172.21.15.152:0/3301700187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d83ad48b0 0x555d83afdfd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 1 -- 172.21.15.152:0/3301700187 >> 172.21.15.152:0/3301700187 conn(0x555d83ad0f60 msgr2=0x555d83adfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:45.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 1 -- 172.21.15.152:0/3301700187 shutdown_connections 2024-09-11T22:04:45.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 1 -- 172.21.15.152:0/3301700187 wait complete. 2024-09-11T22:04:45.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.772+0000 7f85acda3740 20 client.15432 trim_cache size 0 max 16384 2024-09-11T22:04:45.780 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:04:45.780 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "5c140ed8-7088-11ef-bcea-c7b262605968", 2024-09-11T22:04:45.780 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 1, 2024-09-11T22:04:45.780 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 24470, 2024-09-11T22:04:45.780 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-09-11T22:04:45.781 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-09-11T22:04:45.781 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-09-11T22:04:45.781 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 121.94844944099999, 2024-09-11T22:04:45.781 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 25, 2024-09-11T22:04:45.781 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 85, 2024-09-11T22:04:45.781 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 85, 2024-09-11T22:04:45.781 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 138.92363317499999 2024-09-11T22:04:45.781 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:04:45.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 -- 172.21.15.152:0/2657462370 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f85900a2e10 msgr2=0x7f85900a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:45.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f85900a2e10 0x7f85900a52d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f859c00afd0 tx=0x7f859c005c60 comp rx=0 tx=0).stop 2024-09-11T22:04:45.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 -- 172.21.15.152:0/2657462370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a4102570 msgr2=0x7f85a4198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:45.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a4102570 0x7f85a4198b00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f858c006010 tx=0x7f858c003c10 comp rx=0 tx=0).stop 2024-09-11T22:04:45.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 -- 172.21.15.152:0/2657462370 shutdown_connections 2024-09-11T22:04:45.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f85900a2e10 0x7f85900a52d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85a4102ef0 0x7f85a419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a4102570 0x7f85a4198b00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 --2- 172.21.15.152:0/2657462370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a4100e20 0x7f85a41985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:45.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 -- 172.21.15.152:0/2657462370 >> 172.21.15.152:0/2657462370 conn(0x7f85a40fc7d0 msgr2=0x7f85a406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:45.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 -- 172.21.15.152:0/2657462370 shutdown_connections 2024-09-11T22:04:45.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:45.773+0000 7f85aa9ca640 1 -- 172.21.15.152:0/2657462370 wait complete. 2024-09-11T22:04:45.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:45 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:45.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:45 smithi179 ceph-mon[35603]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.7 KiB/s wr, 10 op/s 2024-09-11T22:04:45.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:45 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:45.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:45 smithi193 ceph-mon[35545]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.7 KiB/s wr, 10 op/s 2024-09-11T22:04:46.500 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T22:04:46.746 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:04:47.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.207+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/3060984810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef0101420 msgr2=0x7f5ef010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:47.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.207+0000 7f5ef6ba8640 1 --2- 172.21.15.152:0/3060984810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef0101420 0x7f5ef010d950 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009cd0 tx=0x7f5ee802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.207+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/3060984810 shutdown_connections 2024-09-11T22:04:47.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.207+0000 7f5ef6ba8640 1 --2- 172.21.15.152:0/3060984810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef0101420 0x7f5ef010d950 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.207+0000 7f5ef6ba8640 1 --2- 172.21.15.152:0/3060984810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef0100a80 0x7f5ef0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.207+0000 7f5ef6ba8640 1 --2- 172.21.15.152:0/3060984810 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ef0106a80 0x7f5ef0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.207+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/3060984810 >> 172.21.15.152:0/3060984810 conn(0x7f5ef00fc7a0 msgr2=0x7f5ef00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.207+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/3060984810 shutdown_connections 2024-09-11T22:04:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.207+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/3060984810 wait complete. 2024-09-11T22:04:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.207+0000 7f5ef6ba8640 1 Processor -- start 2024-09-11T22:04:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.207+0000 7f5ef6ba8640 1 -- start start 2024-09-11T22:04:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef6ba8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ef0100a80 0x7f5ef0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef6ba8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef0101420 0x7f5ef0199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef6ba8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef0106a80 0x7f5ef01a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef6ba8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0110ea0 con 0x7f5ef0106a80 2024-09-11T22:04:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef6ba8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0110d20 con 0x7f5ef0101420 2024-09-11T22:04:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef6ba8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0111020 con 0x7f5ef0100a80 2024-09-11T22:04:47.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef5145640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef0106a80 0x7f5ef01a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef5145640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef0106a80 0x7f5ef01a42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47178/0 (socket says 172.21.15.152:47178) 2024-09-11T22:04:47.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef5145640 1 -- 172.21.15.152:0/178116421 learned_addr learned my addr 172.21.15.152:0/178116421 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:47.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef4944640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ef0100a80 0x7f5ef0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5eeffff640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef0101420 0x7f5ef0199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef5145640 1 -- 172.21.15.152:0/178116421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ef0100a80 msgr2=0x7f5ef0199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:47.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef5145640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ef0100a80 0x7f5ef0199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef5145640 1 -- 172.21.15.152:0/178116421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef0101420 msgr2=0x7f5ef0199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:47.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef5145640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef0101420 0x7f5ef0199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef5145640 1 -- 172.21.15.152:0/178116421 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef01a4810 con 0x7f5ef0106a80 2024-09-11T22:04:47.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5eeffff640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef0101420 0x7f5ef0199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:04:47.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef5145640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef0106a80 0x7f5ef01a42d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8006010 tx=0x7f5ee8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:47.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5eedffb640 1 -- 172.21.15.152:0/178116421 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8004450 con 0x7f5ef0106a80 2024-09-11T22:04:47.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5eedffb640 1 -- 172.21.15.152:0/178116421 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ee8003e10 con 0x7f5ef0106a80 2024-09-11T22:04:47.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/178116421 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef01a49e0 con 0x7f5ef0106a80 2024-09-11T22:04:47.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.208+0000 7f5eedffb640 1 -- 172.21.15.152:0/178116421 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8046480 con 0x7f5ef0106a80 2024-09-11T22:04:47.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.209+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/178116421 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef01a4ec0 con 0x7f5ef0106a80 2024-09-11T22:04:47.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5eedffb640 1 -- 172.21.15.152:0/178116421 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f5ee80045f0 con 0x7f5ef0106a80 2024-09-11T22:04:47.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef8f81740 1 Processor -- start 2024-09-11T22:04:47.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef8f81740 1 -- start start 2024-09-11T22:04:47.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec54ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec559a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec55c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5639ec4b1090 con 0x5639ec54b1d0 2024-09-11T22:04:47.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5639ec458a70 con 0x5639ec54a8b0 2024-09-11T22:04:47.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5639ec4ad050 con 0x5639ec559fc0 2024-09-11T22:04:47.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef4944640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec559a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef4944640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec559a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47194/0 (socket says 172.21.15.152:47194) 2024-09-11T22:04:47.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef4944640 1 -- 172.21.15.152:0/3423593163 learned_addr learned my addr 172.21.15.152:0/3423593163 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:47.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5eeffff640 1 --2- 172.21.15.152:0/3423593163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec55c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5eedffb640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ee00a2e90 0x7f5ee00a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5eeffff640 1 --2- 172.21.15.152:0/3423593163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec54ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef4944640 1 -- 172.21.15.152:0/3423593163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 msgr2=0x5639ec55c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:47.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef4944640 1 --2- 172.21.15.152:0/3423593163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec55c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef4944640 1 -- 172.21.15.152:0/3423593163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 msgr2=0x5639ec54ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef4944640 1 --2- 172.21.15.152:0/3423593163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec54ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef4944640 1 -- 172.21.15.152:0/3423593163 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ec465130 con 0x5639ec54b1d0 2024-09-11T22:04:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5eeffff640 1 --2- 172.21.15.152:0/3423593163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec54ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.212+0000 7f5ef5145640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ee00a2e90 0x7f5ee00a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.213+0000 7f5ef4944640 1 --2- 172.21.15.152:0/3423593163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec559a80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009a70 tx=0x7f5ee4009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a72ef43b5d132d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.213+0000 7f5eedffb640 1 -- 172.21.15.152:0/178116421 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f5ee802e030 con 0x7f5ef0106a80 2024-09-11T22:04:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.213+0000 7f5edaffd640 1 -- 172.21.15.152:0/3423593163 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4017070 con 0x5639ec54b1d0 2024-09-11T22:04:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.213+0000 7f5edaffd640 1 -- 172.21.15.152:0/3423593163 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ee4013470 con 0x5639ec54b1d0 2024-09-11T22:04:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.213+0000 7f5edaffd640 1 -- 172.21.15.152:0/3423593163 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4012630 con 0x5639ec54b1d0 2024-09-11T22:04:47.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.213+0000 7f5ef8f81740 1 -- 172.21.15.152:0/3423593163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 msgr2=0x5639ec559a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:47.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.213+0000 7f5ef5145640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ee00a2e90 0x7f5ee00a5350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80ee660 tx=0x7f5ee8088320 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:47.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.213+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/3423593163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec559a80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009a70 tx=0x7f5ee4009f30 comp rx=0 tx=0).stop 2024-09-11T22:04:47.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 -- 172.21.15.152:0/3423593163 shutdown_connections 2024-09-11T22:04:47.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/3423593163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec55c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/3423593163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec559a80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/3423593163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec54ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 -- 172.21.15.152:0/3423593163 >> 172.21.15.152:0/3423593163 conn(0x5639ec546f60 msgr2=0x5639ec547340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:47.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 -- 172.21.15.152:0/3423593163 shutdown_connections 2024-09-11T22:04:47.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 -- 172.21.15.152:0/3423593163 wait complete. 2024-09-11T22:04:47.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 -- start start 2024-09-11T22:04:47.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 Processor -- start 2024-09-11T22:04:47.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec5597a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec556af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec557030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5639ec55cb90 con 0x5639ec54b1d0 2024-09-11T22:04:47.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5639ec46bf20 con 0x5639ec54a8b0 2024-09-11T22:04:47.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5639ec55cd10 con 0x5639ec559fc0 2024-09-11T22:04:47.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.214+0000 7f5ef8f81740 10 client.0 _ll_register_callbacks cb 0x5639ec435030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:47.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef4944640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec556af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef4944640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec556af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47206/0 (socket says 172.21.15.152:47206) 2024-09-11T22:04:47.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef4944640 1 -- 172.21.15.152:0/1882051768 learned_addr learned my addr 172.21.15.152:0/1882051768 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:47.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5eeffff640 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec557030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5eeffff640 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec5597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef4944640 1 -- 172.21.15.152:0/1882051768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 msgr2=0x5639ec557030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:47.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef4944640 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec557030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef4944640 1 -- 172.21.15.152:0/1882051768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 msgr2=0x5639ec5597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:47.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef4944640 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec5597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef4944640 1 -- 172.21.15.152:0/1882051768 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ec2222b0 con 0x5639ec54b1d0 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5eeffff640 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec5597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef4944640 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec556af0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400e660 tx=0x7f5ee4013c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee7a168968fe24e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ecffff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ecffff640 1 -- 172.21.15.152:0/1882051768 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4017050 con 0x5639ec54b1d0 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef8f81740 1 -- 172.21.15.152:0/1882051768 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ee4013470 con 0x5639ec54b1d0 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ecffff640 1 -- 172.21.15.152:0/1882051768 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f5ee401c650 con 0x5639ec54b1d0 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ecffff640 1 -- 172.21.15.152:0/1882051768 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5ee4013970 con 0x5639ec54b1d0 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef8f81740 10 client.15444 fetch_fsmap learned FSMap version 25 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ef8f81740 1 -- 172.21.15.152:0/1882051768 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5639ec568460 con 0x5639ec54b1d0 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.215+0000 7f5ecffff640 1 -- 172.21.15.152:0/1882051768 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ee4013470 con 0x5639ec54b1d0 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.216+0000 7f5ecffff640 1 -- 172.21.15.152:0/1882051768 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f5ee402d070 con 0x5639ec54b1d0 2024-09-11T22:04:47.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.216+0000 7f5ef8f81740 10 client.15444 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.216+0000 7f5ef8f81740 10 client.15444 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.216+0000 7f5ef8f81740 20 client.15444 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.216+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639ec56a780 0x5639ec56bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.216+0000 7f5ef8f81740 4 client.15444 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.216+0000 7f5ef8f81740 1 -- 172.21.15.152:0/1882051768 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639ec4be600 con 0x5639ec56a780 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.216+0000 7f5eeffff640 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639ec56a780 0x5639ec56bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5eeffff640 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639ec56a780 0x5639ec56bbf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a72aa15122ea852 server_cookie=bdfc93852a82c529 in_seq=0 out_seq=0 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ecffff640 10 client.15444 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ecffff640 1 -- 172.21.15.152:0/1882051768 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5639ec4be600 con 0x5639ec56a780 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ecffff640 10 client.15444 handle_command_reply: tid=0 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ef8f81740 1 client.15444 shutdown 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ef8f81740 1 -- 172.21.15.152:0/1882051768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 msgr2=0x5639ec556af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:47.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec556af0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400e660 tx=0x7f5ee4013c50 comp rx=0 tx=0).stop 2024-09-11T22:04:47.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ef8f81740 1 -- 172.21.15.152:0/1882051768 shutdown_connections 2024-09-11T22:04:47.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639ec56a780 0x5639ec56bbf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec557030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec556af0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/1882051768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec5597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ecffff640 0 client.15444 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:47.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.217+0000 7f5ef8f81740 1 -- 172.21.15.152:0/1882051768 >> 172.21.15.152:0/1882051768 conn(0x5639ec546f60 msgr2=0x5639ec54ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:47.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.218+0000 7f5ef8f81740 1 -- 172.21.15.152:0/1882051768 shutdown_connections 2024-09-11T22:04:47.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.218+0000 7f5ef8f81740 1 -- 172.21.15.152:0/1882051768 wait complete. 2024-09-11T22:04:47.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.218+0000 7f5ef8f81740 20 client.15444 trim_cache size 0 max 16384 2024-09-11T22:04:47.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.235+0000 7f5ef8f81740 1 Processor -- start 2024-09-11T22:04:47.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.235+0000 7f5ef8f81740 1 -- start start 2024-09-11T22:04:47.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.235+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec56b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.235+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec56ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.235+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec56a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.235+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5639ec569f30 con 0x5639ec54b1d0 2024-09-11T22:04:47.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.235+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5639ec56a600 con 0x5639ec54a8b0 2024-09-11T22:04:47.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.235+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5639ec56acd0 con 0x5639ec559fc0 2024-09-11T22:04:47.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5ef4944640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec56ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5ef4944640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec56ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47216/0 (socket says 172.21.15.152:47216) 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5ef4944640 1 -- 172.21.15.152:0/2653674295 learned_addr learned my addr 172.21.15.152:0/2653674295 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5eeffff640 1 --2- 172.21.15.152:0/2653674295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec56b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5eeffff640 1 --2- 172.21.15.152:0/2653674295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec56a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5ef4944640 1 -- 172.21.15.152:0/2653674295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 msgr2=0x5639ec56a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5ef4944640 1 --2- 172.21.15.152:0/2653674295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec56a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5ef4944640 1 -- 172.21.15.152:0/2653674295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 msgr2=0x5639ec56b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5ef4944640 1 --2- 172.21.15.152:0/2653674295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec56b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5ef4944640 1 -- 172.21.15.152:0/2653674295 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ec54b000 con 0x5639ec54b1d0 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5ef4944640 1 --2- 172.21.15.152:0/2653674295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec56ae50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4013f00 tx=0x7f5ee4006ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4a12a968f6e4b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5eda7fc640 1 -- 172.21.15.152:0/2653674295 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4033030 con 0x5639ec54b1d0 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5eda7fc640 1 -- 172.21.15.152:0/2653674295 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ee4013cc0 con 0x5639ec54b1d0 2024-09-11T22:04:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.236+0000 7f5eda7fc640 1 -- 172.21.15.152:0/2653674295 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4017040 con 0x5639ec54b1d0 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.237+0000 7f5ef8f81740 1 -- 172.21.15.152:0/2653674295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 msgr2=0x5639ec56ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.237+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/2653674295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec56ae50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4013f00 tx=0x7f5ee4006ec0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.237+0000 7f5ef8f81740 1 -- 172.21.15.152:0/2653674295 shutdown_connections 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.237+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/2653674295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec56a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.237+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/2653674295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54b1d0 0x5639ec56ae50 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.237+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/2653674295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54a8b0 0x5639ec56b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.237+0000 7f5ef8f81740 1 -- 172.21.15.152:0/2653674295 >> 172.21.15.152:0/2653674295 conn(0x5639ec546f60 msgr2=0x5639ec547340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.237+0000 7f5ef8f81740 1 -- 172.21.15.152:0/2653674295 shutdown_connections 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.237+0000 7f5ef8f81740 1 -- 172.21.15.152:0/2653674295 wait complete. 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.237+0000 7f5ef8f81740 1 -- start start 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.237+0000 7f5ef8f81740 1 Processor -- start 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54a8b0 0x5639ec56d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54b1d0 0x5639ec56da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5ef8f81740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec5d2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5639ec56ba70 con 0x5639ec54a8b0 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5639ec56b3a0 con 0x5639ec54b1d0 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5ef8f81740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5639ec56c140 con 0x5639ec559fc0 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5ef8f81740 10 client.0 _ll_register_callbacks cb 0x7f5ee40098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5eeffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54a8b0 0x5639ec56d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5eeffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54a8b0 0x5639ec56d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47226/0 (socket says 172.21.15.152:47226) 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5eeffff640 1 -- 172.21.15.152:0/730300831 learned_addr learned my addr 172.21.15.152:0/730300831 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5ef4944640 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54b1d0 0x5639ec56da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5eeffff640 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec5d2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5eeffff640 1 -- 172.21.15.152:0/730300831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 msgr2=0x5639ec5d2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5eeffff640 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec5d2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5eeffff640 1 -- 172.21.15.152:0/730300831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54b1d0 msgr2=0x5639ec56da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5eeffff640 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54b1d0 0x5639ec56da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5eeffff640 1 -- 172.21.15.152:0/730300831 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ec5d33f0 con 0x5639ec54a8b0 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5eeffff640 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54a8b0 0x5639ec56d4d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x5639ec56c7c0 tx=0x7f5edc00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1565ccbd476ae99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.238+0000 7f5ecffff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ecffff640 1 -- 172.21.15.152:0/730300831 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc003e90 con 0x5639ec54a8b0 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ecffff640 1 -- 172.21.15.152:0/730300831 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f5edc0114a0 con 0x5639ec54a8b0 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ef8f81740 1 -- 172.21.15.152:0/730300831 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ee4013cc0 con 0x5639ec54a8b0 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ecffff640 1 -- 172.21.15.152:0/730300831 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5edc005020 con 0x5639ec54a8b0 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ef8f81740 10 client.15450 fetch_fsmap learned FSMap version 25 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ef8f81740 1 -- 172.21.15.152:0/730300831 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5639ec5d45a0 con 0x5639ec54a8b0 2024-09-11T22:04:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ecffff640 1 -- 172.21.15.152:0/730300831 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ee4013cc0 con 0x5639ec54a8b0 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ecffff640 1 -- 172.21.15.152:0/730300831 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f5edc01a070 con 0x5639ec54a8b0 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ef8f81740 10 client.15450 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ef8f81740 10 client.15450 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ef8f81740 20 client.15450 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639ec5d9210 0x5639ec5d7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ef8f81740 4 client.15450 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.239+0000 7f5ef8f81740 1 -- 172.21.15.152:0/730300831 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "status"}) -- 0x5639ec4b8b10 con 0x5639ec5d9210 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ef4944640 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639ec5d9210 0x5639ec5d7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ef4944640 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639ec5d9210 0x5639ec5d7ef0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf43d97701ea235 server_cookie=9511ffd94d22a5d3 in_seq=0 out_seq=0 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ecffff640 10 client.15450 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ecffff640 1 -- 172.21.15.152:0/730300831 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5639ec4b8b10 con 0x5639ec5d9210 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ecffff640 10 client.15450 handle_command_reply: tid=0 2024-09-11T22:04:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ef8f81740 1 client.15450 shutdown 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ef8f81740 1 -- 172.21.15.152:0/730300831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54a8b0 msgr2=0x5639ec56d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54a8b0 0x5639ec56d4d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x5639ec56c7c0 tx=0x7f5edc00b460 comp rx=0 tx=0).stop 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ef8f81740 1 -- 172.21.15.152:0/730300831 shutdown_connections 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639ec5d9210 0x5639ec5d7ef0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639ec559fc0 0x5639ec5d2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ecffff640 0 client.15450 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec54b1d0 0x5639ec56da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ef8f81740 1 --2- 172.21.15.152:0/730300831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5639ec54a8b0 0x5639ec56d4d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.240+0000 7f5ef8f81740 1 -- 172.21.15.152:0/730300831 >> 172.21.15.152:0/730300831 conn(0x5639ec546f60 msgr2=0x5639ec5457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef8f81740 1 -- 172.21.15.152:0/730300831 shutdown_connections 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef8f81740 1 -- 172.21.15.152:0/730300831 wait complete. 2024-09-11T22:04:47.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef8f81740 20 client.15450 trim_cache size 0 max 16384 2024-09-11T22:04:47.254 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:04:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "5c140ed8-7088-11ef-bcea-c7b262605968", 2024-09-11T22:04:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 0, 2024-09-11T22:04:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 24472, 2024-09-11T22:04:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-09-11T22:04:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-09-11T22:04:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-09-11T22:04:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 130.15433367200001, 2024-09-11T22:04:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 25, 2024-09-11T22:04:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 85, 2024-09-11T22:04:47.255 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 85, 2024-09-11T22:04:47.255 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 148.44348718399999 2024-09-11T22:04:47.255 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:04:47.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/178116421 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ee00a2e90 msgr2=0x7f5ee00a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:47.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ee00a2e90 0x7f5ee00a5350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80ee660 tx=0x7f5ee8088320 comp rx=0 tx=0).stop 2024-09-11T22:04:47.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/178116421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef0106a80 msgr2=0x7f5ef01a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:47.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef0106a80 0x7f5ef01a42d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8006010 tx=0x7f5ee8003c20 comp rx=0 tx=0).stop 2024-09-11T22:04:47.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/178116421 shutdown_connections 2024-09-11T22:04:47.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ee00a2e90 0x7f5ee00a5350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef0106a80 0x7f5ef01a42d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef0101420 0x7f5ef0199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 --2- 172.21.15.152:0/178116421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ef0100a80 0x7f5ef0199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/178116421 >> 172.21.15.152:0/178116421 conn(0x7f5ef00fc7a0 msgr2=0x7f5ef00fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/178116421 shutdown_connections 2024-09-11T22:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:04:47.241+0000 7f5ef6ba8640 1 -- 172.21.15.152:0/178116421 wait complete. 2024-09-11T22:04:47.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:47 smithi152 ceph-mon[31188]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.7 KiB/s wr, 10 op/s 2024-09-11T22:04:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:47 smithi179 ceph-mon[35603]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.7 KiB/s wr, 10 op/s 2024-09-11T22:04:47.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:47 smithi193 ceph-mon[35545]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.7 KiB/s wr, 10 op/s 2024-09-11T22:04:47.849 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-11T22:04:50.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:50 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:50.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:50 smithi152 ceph-mon[31188]: pgmap v19: 97 pgs: 97 active+clean; 20 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 1.6 MiB/s wr, 23 op/s 2024-09-11T22:04:50.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:50 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:50.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:50 smithi179 ceph-mon[35603]: pgmap v19: 97 pgs: 97 active+clean; 20 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 1.6 MiB/s wr, 23 op/s 2024-09-11T22:04:50.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:50 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:50.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:50 smithi193 ceph-mon[35545]: pgmap v19: 97 pgs: 97 active+clean; 20 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 1.6 MiB/s wr, 23 op/s 2024-09-11T22:04:51.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:51 smithi152 ceph-mon[31188]: pgmap v20: 97 pgs: 97 active+clean; 20 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 1.6 MiB/s wr, 21 op/s 2024-09-11T22:04:51.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:51 smithi179 ceph-mon[35603]: pgmap v20: 97 pgs: 97 active+clean; 20 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 1.6 MiB/s wr, 21 op/s 2024-09-11T22:04:51.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:51 smithi193 ceph-mon[35545]: pgmap v20: 97 pgs: 97 active+clean; 20 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 1.6 MiB/s wr, 21 op/s 2024-09-11T22:04:53.734 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:53 smithi152 ceph-mon[31188]: pgmap v21: 97 pgs: 97 active+clean; 21 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 1.6 MiB/s wr, 32 op/s 2024-09-11T22:04:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:53 smithi179 ceph-mon[35603]: pgmap v21: 97 pgs: 97 active+clean; 21 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 1.6 MiB/s wr, 32 op/s 2024-09-11T22:04:53.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:53 smithi193 ceph-mon[35545]: pgmap v21: 97 pgs: 97 active+clean; 21 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 1.6 MiB/s wr, 32 op/s 2024-09-11T22:04:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.750+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3478135993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4100a90 msgr2=0x7fa3e4100e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.750+0000 7fa3eb9f6640 1 --2- 172.21.15.152:0/3478135993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4100a90 0x7fa3e4100e70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009900 tx=0x7fa3d402a480 comp rx=0 tx=0).stop 2024-09-11T22:04:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.750+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3478135993 shutdown_connections 2024-09-11T22:04:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.750+0000 7fa3eb9f6640 1 --2- 172.21.15.152:0/3478135993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e4105ec0 0x7fa3e4106330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.750+0000 7fa3eb9f6640 1 --2- 172.21.15.152:0/3478135993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3e41013b0 0x7fa3e4105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.750+0000 7fa3eb9f6640 1 --2- 172.21.15.152:0/3478135993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4100a90 0x7fa3e4100e70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.750+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3478135993 >> 172.21.15.152:0/3478135993 conn(0x7fa3e40fc6f0 msgr2=0x7fa3e40feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.750+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3478135993 shutdown_connections 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.750+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3478135993 wait complete. 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3eb9f6640 1 Processor -- start 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3eb9f6640 1 -- start start 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3eb9f6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4100a90 0x7fa3e41a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3eb9f6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3e41013b0 0x7fa3e41a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3eb9f6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e4105ec0 0x7fa3e419e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3eb9f6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e41184d0 con 0x7fa3e4100a90 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3eb9f6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4118350 con 0x7fa3e41013b0 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3eb9f6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4118650 con 0x7fa3e4105ec0 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e9792640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4100a90 0x7fa3e41a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e9792640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4100a90 0x7fa3e41a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59902/0 (socket says 172.21.15.152:59902) 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e9792640 1 -- 172.21.15.152:0/3728332767 learned_addr learned my addr 172.21.15.152:0/3728332767 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e8f91640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3e41013b0 0x7fa3e41a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e4105ec0 0x7fa3e419e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e9792640 1 -- 172.21.15.152:0/3728332767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e4105ec0 msgr2=0x7fa3e419e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e9792640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e4105ec0 0x7fa3e419e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e9792640 1 -- 172.21.15.152:0/3728332767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3e41013b0 msgr2=0x7fa3e41a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e9792640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3e41013b0 0x7fa3e41a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e9792640 1 -- 172.21.15.152:0/3728332767 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e419f000 con 0x7fa3e4100a90 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e4105ec0 0x7fa3e419e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.751+0000 7fa3e9792640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4100a90 0x7fa3e41a4680 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006010 tx=0x7fa3d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.752+0000 7fa3e27fc640 1 -- 172.21.15.152:0/3728332767 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d403f030 con 0x7fa3e4100a90 2024-09-11T22:04:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.752+0000 7fa3e27fc640 1 -- 172.21.15.152:0/3728332767 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d4003ce0 con 0x7fa3e4100a90 2024-09-11T22:04:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.752+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3728332767 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e419f290 con 0x7fa3e4100a90 2024-09-11T22:04:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.752+0000 7fa3e27fc640 1 -- 172.21.15.152:0/3728332767 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4035070 con 0x7fa3e4100a90 2024-09-11T22:04:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.752+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3728332767 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e41ab420 con 0x7fa3e4100a90 2024-09-11T22:04:55.762 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3e27fc640 1 -- 172.21.15.152:0/3728332767 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7fa3d4042030 con 0x7fa3e4100a90 2024-09-11T22:04:55.762 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3ee86d740 1 Processor -- start 2024-09-11T22:04:55.762 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3ee86d740 1 -- start start 2024-09-11T22:04:55.762 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f4af0 0x55c0690f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.762 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c0690ff770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.762 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 0x55c0691020a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.762 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c0690592f0 con 0x55c0690f4af0 2024-09-11T22:04:55.762 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c069001270 con 0x55c0690ffcb0 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c0690552b0 con 0x55c0690f5410 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3e9f93640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f4af0 0x55c0690f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3e9f93640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f4af0 0x55c0690f4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59914/0 (socket says 172.21.15.152:59914) 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.755+0000 7fa3e9f93640 1 -- 172.21.15.152:0/347475943 learned_addr learned my addr 172.21.15.152:0/347475943 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e9792640 1 --2- 172.21.15.152:0/347475943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c0690ff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e8f91640 1 --2- 172.21.15.152:0/347475943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 0x55c0691020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e9f93640 1 -- 172.21.15.152:0/347475943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 msgr2=0x55c0690ff770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/347475943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c0690ff770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e9f93640 1 -- 172.21.15.152:0/347475943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 msgr2=0x55c0691020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e27fc640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3cc0a2ec0 0x7fa3cc0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/347475943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 0x55c0691020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e9f93640 1 -- 172.21.15.152:0/347475943 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c069000340 con 0x55c0690f4af0 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e8f91640 1 --2- 172.21.15.152:0/347475943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 0x55c0691020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e27fc640 1 -- 172.21.15.152:0/3728332767 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa3d40efcf0 con 0x7fa3e4100a90 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/347475943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f4af0 0x55c0690f4ed0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009f10 tx=0x7fa3dc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb72003c2520ebc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3cc0a2ec0 0x7fa3cc0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3cb7fe640 1 -- 172.21.15.152:0/347475943 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011720 con 0x55c0690f4af0 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3cb7fe640 1 -- 172.21.15.152:0/347475943 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3dc011da0 con 0x55c0690f4af0 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.756+0000 7fa3cb7fe640 1 -- 172.21.15.152:0/347475943 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc010630 con 0x55c0690f4af0 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3ee86d740 1 -- 172.21.15.152:0/347475943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f4af0 msgr2=0x55c0690f4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3cc0a2ec0 0x7fa3cc0a5380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc019000 tx=0x7fa3dc01a790 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/347475943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f4af0 0x55c0690f4ed0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009f10 tx=0x7fa3dc00f730 comp rx=0 tx=0).stop 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3ee86d740 1 -- 172.21.15.152:0/347475943 shutdown_connections 2024-09-11T22:04:55.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/347475943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 0x55c0691020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/347475943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c0690ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/347475943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f4af0 0x55c0690f4ed0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3ee86d740 1 -- 172.21.15.152:0/347475943 >> 172.21.15.152:0/347475943 conn(0x55c0690f1060 msgr2=0x55c0690f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3ee86d740 1 -- 172.21.15.152:0/347475943 shutdown_connections 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3ee86d740 1 -- 172.21.15.152:0/347475943 wait complete. 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3ee86d740 1 -- start start 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.757+0000 7fa3ee86d740 1 Processor -- start 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690f4af0 0x55c0690fcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c0690fd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c0690fd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c069102880 con 0x55c0690ffcb0 2024-09-11T22:04:55.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c068fe2290 con 0x55c0690f4af0 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c069102a00 con 0x55c0690f5410 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3ee86d740 10 client.0 _ll_register_callbacks cb 0x55c069013140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3e9f93640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c0690fd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3e9f93640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c0690fd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59922/0 (socket says 172.21.15.152:59922) 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3e9f93640 1 -- 172.21.15.152:0/616464156 learned_addr learned my addr 172.21.15.152:0/616464156 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3e9792640 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690f4af0 0x55c0690fcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3e8f91640 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c0690fd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3e9f93640 1 -- 172.21.15.152:0/616464156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 msgr2=0x55c0690fd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c0690fd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3e9f93640 1 -- 172.21.15.152:0/616464156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690f4af0 msgr2=0x55c0690fcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690f4af0 0x55c0690fcb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3e9f93640 1 -- 172.21.15.152:0/616464156 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c068d6c210 con 0x55c0690ffcb0 2024-09-11T22:04:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c0690fd610 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc010fd0 tx=0x7fa3dc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79be9541b779b034 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.758+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/616464156 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0105e0 con 0x55c0690ffcb0 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3ee86d740 1 -- 172.21.15.152:0/616464156 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3dc011da0 con 0x55c0690ffcb0 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/616464156 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa3dc01b410 con 0x55c0690ffcb0 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/616464156 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa3dc01b610 con 0x55c0690ffcb0 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3ee86d740 10 client.15462 fetch_fsmap learned FSMap version 27 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3ee86d740 1 -- 172.21.15.152:0/616464156 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c068e38620 con 0x55c0690ffcb0 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/616464156 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3dc011da0 con 0x55c0690ffcb0 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/616464156 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fa3dc011440 con 0x55c0690ffcb0 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3ee86d740 10 client.15462 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3ee86d740 10 client.15462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:04:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3ee86d740 20 client.15462 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c06910fb60 0x55c069111f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3ee86d740 4 client.15462 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3ee86d740 1 -- 172.21.15.152:0/616464156 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c069066a20 con 0x55c06910fb60 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.759+0000 7fa3e9792640 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c06910fb60 0x55c069111f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.760+0000 7fa3c8ff9640 10 client.15462 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.760+0000 7fa3e9792640 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c06910fb60 0x55c069111f50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6a38399f79ea10c server_cookie=ebc8c73ce60192a0 in_seq=0 out_seq=0 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.760+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/616464156 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c069066a20 con 0x55c06910fb60 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.760+0000 7fa3c8ff9640 10 client.15462 handle_command_reply: tid=0 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.760+0000 7fa3ee86d740 1 client.15462 shutdown 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3ee86d740 1 -- 172.21.15.152:0/616464156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 msgr2=0x55c0690fd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c0690fd610 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc010fd0 tx=0x7fa3dc01a000 comp rx=0 tx=0).stop 2024-09-11T22:04:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3ee86d740 1 -- 172.21.15.152:0/616464156 shutdown_connections 2024-09-11T22:04:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c06910fb60 0x55c069111f50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c0690fd610 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c0690fd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/616464156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690f4af0 0x55c0690fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3c8ff9640 0 client.15462 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3ee86d740 1 -- 172.21.15.152:0/616464156 >> 172.21.15.152:0/616464156 conn(0x55c0690f1060 msgr2=0x55c0690f6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3ee86d740 1 -- 172.21.15.152:0/616464156 shutdown_connections 2024-09-11T22:04:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3ee86d740 1 -- 172.21.15.152:0/616464156 wait complete. 2024-09-11T22:04:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.761+0000 7fa3ee86d740 20 client.15462 trim_cache size 0 max 16384 2024-09-11T22:04:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.775+0000 7fa3ee86d740 1 Processor -- start 2024-09-11T22:04:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.775+0000 7fa3ee86d740 1 -- start start 2024-09-11T22:04:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.775+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f4af0 0x55c0690fd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.775+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f5410 0x55c0691175e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.775+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 0x55c069117b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.775+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e41b67c0 con 0x55c0690f5410 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.775+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e41b4060 con 0x55c0690ffcb0 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.775+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e41b1eb0 con 0x55c0690f4af0 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.775+0000 7fa3e8f91640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f5410 0x55c0691175e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.775+0000 7fa3e8f91640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f5410 0x55c0691175e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59924/0 (socket says 172.21.15.152:59924) 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.775+0000 7fa3e8f91640 1 -- 172.21.15.152:0/3613006577 learned_addr learned my addr 172.21.15.152:0/3613006577 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3e9792640 1 --2- 172.21.15.152:0/3613006577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f4af0 0x55c0690fd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/3613006577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 0x55c069117b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3e8f91640 1 -- 172.21.15.152:0/3613006577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f4af0 msgr2=0x55c0690fd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3e8f91640 1 --2- 172.21.15.152:0/3613006577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f4af0 0x55c0690fd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3e8f91640 1 -- 172.21.15.152:0/3613006577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 msgr2=0x55c069117b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3e8f91640 1 --2- 172.21.15.152:0/3613006577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 0x55c069117b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3e8f91640 1 -- 172.21.15.152:0/3613006577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0690f2110 con 0x55c0690f5410 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/3613006577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 0x55c069117b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3e8f91640 1 --2- 172.21.15.152:0/3613006577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f5410 0x55c0691175e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa3e419ff90 tx=0x7fa3d8013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baed1b0f5d658de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3caffd640 1 -- 172.21.15.152:0/3613006577 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8004030 con 0x55c0690f5410 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3caffd640 1 -- 172.21.15.152:0/3613006577 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d80041d0 con 0x55c0690f5410 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.776+0000 7fa3caffd640 1 -- 172.21.15.152:0/3613006577 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d801c7e0 con 0x55c0690f5410 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 -- 172.21.15.152:0/3613006577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f5410 msgr2=0x55c0691175e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/3613006577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f5410 0x55c0691175e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa3e419ff90 tx=0x7fa3d8013830 comp rx=0 tx=0).stop 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 -- 172.21.15.152:0/3613006577 shutdown_connections 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/3613006577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690ffcb0 0x55c069117b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/3613006577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690f5410 0x55c0691175e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/3613006577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f4af0 0x55c0690fd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 -- 172.21.15.152:0/3613006577 >> 172.21.15.152:0/3613006577 conn(0x55c0690f1060 msgr2=0x55c0690fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 -- 172.21.15.152:0/3613006577 shutdown_connections 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 -- 172.21.15.152:0/3613006577 wait complete. 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 -- start start 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 Processor -- start 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690f4af0 0x55c069108300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c069103620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c069103b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e41b2520 con 0x55c0690ffcb0 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e41b3990 con 0x55c0690f4af0 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.777+0000 7fa3ee86d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e41b2bf0 con 0x55c0690f5410 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3ee86d740 10 client.0 _ll_register_callbacks cb 0x7fa3dc015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3e9f93640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c069103b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3e9f93640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c069103b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59928/0 (socket says 172.21.15.152:59928) 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3e9f93640 1 -- 172.21.15.152:0/1469819079 learned_addr learned my addr 172.21.15.152:0/1469819079 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3e9792640 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690f4af0 0x55c069108300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3e8f91640 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c069103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3e9f93640 1 -- 172.21.15.152:0/1469819079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 msgr2=0x55c069103620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c069103620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3e9f93640 1 -- 172.21.15.152:0/1469819079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690f4af0 msgr2=0x55c069108300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690f4af0 0x55c069108300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3e9f93640 1 -- 172.21.15.152:0/1469819079 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c069104390 con 0x55c0690ffcb0 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3e9f93640 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c069103b60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009600 tx=0x7fa3dc0107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4044282ef444b175 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/1469819079 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc03d070 con 0x55c0690ffcb0 2024-09-11T22:04:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/1469819079 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa3dc01b410 con 0x55c0690ffcb0 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3ee86d740 1 -- 172.21.15.152:0/1469819079 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3d80041d0 con 0x55c0690ffcb0 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/1469819079 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa3dc0105e0 con 0x55c0690ffcb0 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3ee86d740 10 client.15468 fetch_fsmap learned FSMap version 27 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3ee86d740 1 -- 172.21.15.152:0/1469819079 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c06917a460 con 0x55c0690ffcb0 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.778+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/1469819079 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d80041d0 con 0x55c0690ffcb0 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.779+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/1469819079 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fa3dc01b7b0 con 0x55c0690ffcb0 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.779+0000 7fa3ee86d740 10 client.15468 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.779+0000 7fa3ee86d740 10 client.15468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.779+0000 7fa3ee86d740 20 client.15468 populate_metadata read hostname 'smithi152' 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.779+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c06917abd0 0x55c06917cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.779+0000 7fa3ee86d740 4 client.15468 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.779+0000 7fa3ee86d740 1 -- 172.21.15.152:0/1469819079 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c069060d70 con 0x55c06917abd0 2024-09-11T22:04:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.779+0000 7fa3e9792640 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c06917abd0 0x55c06917cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:04:55.787 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.779+0000 7fa3c8ff9640 10 client.15468 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:55.787 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.779+0000 7fa3e9792640 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c06917abd0 0x55c06917cff0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=822fcffa19415d59 server_cookie=55c4024197d18a01 in_seq=0 out_seq=0 2024-09-11T22:04:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3c8ff9640 1 -- 172.21.15.152:0/1469819079 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c069060d70 con 0x55c06917abd0 2024-09-11T22:04:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3c8ff9640 10 client.15468 handle_command_reply: tid=0 2024-09-11T22:04:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 1 client.15468 shutdown 2024-09-11T22:04:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 1 -- 172.21.15.152:0/1469819079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 msgr2=0x55c069103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c069103b60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009600 tx=0x7fa3dc0107d0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 1 -- 172.21.15.152:0/1469819079 shutdown_connections 2024-09-11T22:04:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c06917abd0 0x55c06917cff0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c0690ffcb0 0x55c069103b60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c0690f5410 0x55c069103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3c8ff9640 0 client.15468 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:04:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 1 --2- 172.21.15.152:0/1469819079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0690f4af0 0x55c069108300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 1 -- 172.21.15.152:0/1469819079 >> 172.21.15.152:0/1469819079 conn(0x55c0690f1060 msgr2=0x55c0690f6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 1 -- 172.21.15.152:0/1469819079 shutdown_connections 2024-09-11T22:04:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 1 -- 172.21.15.152:0/1469819079 wait complete. 2024-09-11T22:04:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.790+0000 7fa3ee86d740 20 client.15468 trim_cache size 0 max 16384 2024-09-11T22:04:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:04:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:04:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:04:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:04:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3728332767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3cc0a2ec0 msgr2=0x7fa3cc0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3cc0a2ec0 0x7fa3cc0a5380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc019000 tx=0x7fa3dc01a790 comp rx=0 tx=0).stop 2024-09-11T22:04:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3728332767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4100a90 msgr2=0x7fa3e41a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:04:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4100a90 0x7fa3e41a4680 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006010 tx=0x7fa3d40042f0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3728332767 shutdown_connections 2024-09-11T22:04:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3cc0a2ec0 0x7fa3cc0a5380 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e4105ec0 0x7fa3e419e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3e41013b0 0x7fa3e41a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 --2- 172.21.15.152:0/3728332767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3e4100a90 0x7fa3e41a4680 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:04:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3728332767 >> 172.21.15.152:0/3728332767 conn(0x7fa3e40fc6f0 msgr2=0x7fa3e4103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:04:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3728332767 shutdown_connections 2024-09-11T22:04:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:04:55.791+0000 7fa3eb9f6640 1 -- 172.21.15.152:0/3728332767 wait complete. 2024-09-11T22:04:55.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:55 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:55.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:55 smithi179 ceph-mon[35603]: pgmap v22: 97 pgs: 97 active+clean; 21 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 1.6 MiB/s wr, 24 op/s 2024-09-11T22:04:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:55 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:55 smithi193 ceph-mon[35545]: pgmap v22: 97 pgs: 97 active+clean; 21 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 1.6 MiB/s wr, 24 op/s 2024-09-11T22:04:55.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:55 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:04:55.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:55 smithi152 ceph-mon[31188]: pgmap v22: 97 pgs: 97 active+clean; 21 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 1.6 MiB/s wr, 24 op/s 2024-09-11T22:04:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:57 smithi152 ceph-mon[31188]: pgmap v23: 97 pgs: 97 active+clean; 21 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 1.6 MiB/s wr, 24 op/s 2024-09-11T22:04:57.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:57 smithi179 ceph-mon[35603]: pgmap v23: 97 pgs: 97 active+clean; 21 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 1.6 MiB/s wr, 24 op/s 2024-09-11T22:04:57.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:57 smithi193 ceph-mon[35545]: pgmap v23: 97 pgs: 97 active+clean; 21 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 1.6 MiB/s wr, 24 op/s 2024-09-11T22:04:59.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:04:59 smithi152 ceph-mon[31188]: pgmap v24: 97 pgs: 97 active+clean; 21 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 1.7 MiB/s wr, 33 op/s 2024-09-11T22:04:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:04:59 smithi179 ceph-mon[35603]: pgmap v24: 97 pgs: 97 active+clean; 21 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 1.7 MiB/s wr, 33 op/s 2024-09-11T22:04:59.815 INFO:teuthology.orchestra.run.smithi152.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-11T22:04:59.819 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-11T22:04:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:04:59 smithi193 ceph-mon[35545]: pgmap v24: 97 pgs: 97 active+clean; 21 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 1.7 MiB/s wr, 33 op/s 2024-09-11T22:04:59.989 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:05:00.038 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/: 2024-09-11T22:05:00.038 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.038 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 . 2024-09-11T22:05:00.038 INFO:teuthology.orchestra.run.smithi152.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 .. 2024-09-11T22:05:00.038 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 data 2024-09-11T22:05:00.039 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.039 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data: 2024-09-11T22:05:00.039 INFO:teuthology.orchestra.run.smithi152.stdout:total 35 2024-09-11T22:05:00.039 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 . 2024-09-11T22:05:00.039 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 .. 2024-09-11T22:05:00.039 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 base 2024-09-11T22:05:00.039 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 11 22:04 global 2024-09-11T22:05:00.039 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 log 2024-09-11T22:05:00.039 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_commit_ts 2024-09-11T22:05:00.039 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_dynshmem 2024-09-11T22:05:00.040 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 11 22:04 pg_hba.conf 2024-09-11T22:05:00.040 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 11 22:04 pg_ident.conf 2024-09-11T22:05:00.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 pg_logical 2024-09-11T22:05:00.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:04 pg_multixact 2024-09-11T22:05:00.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_notify 2024-09-11T22:05:00.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_replslot 2024-09-11T22:05:00.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_serial 2024-09-11T22:05:00.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_snapshots 2024-09-11T22:05:00.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_stat 2024-09-11T22:05:00.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_stat_tmp 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 pg_subtrans 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_tblspc 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_twophase 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 PG_VERSION 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:04 pg_wal 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 pg_xact 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 11 22:04 postgresql.auto.conf 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 11 22:04 postgresql.conf 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/base: 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.041 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 . 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 22:04 1 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 22:04 13493 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 22:04 13494 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout:total 7777 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 22:04 . 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 .. 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 112 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 113 2024-09-11T22:05:00.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:04 1247 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1247_fsm 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1247_vm 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 22:04 1249 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1249_fsm 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1249_vm 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 22:04 1255 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1255_fsm 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1255_vm 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 22:04 1259 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1259_fsm 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1259_vm 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 22:04 13344 2024-09-11T22:05:00.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13344_fsm 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13344_vm 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13346 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13348 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13349_fsm 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349_vm 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13351 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13353 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13354_fsm 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354_vm 2024-09-11T22:05:00.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13356 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13358 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13359_fsm 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359_vm 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13361 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13363 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1417 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1418 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 174 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 175 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2187 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2224 2024-09-11T22:05:00.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2328 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2336 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2337 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2579 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2600 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2600_fsm 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2600_vm 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2601_fsm 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601_vm 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2602 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2602_fsm 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2602_vm 2024-09-11T22:05:00.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2603 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2603_fsm 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2603_vm 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2604 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2605 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2605_fsm 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2605_vm 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2606 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2606_fsm 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2606_vm 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2607 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2607_fsm 2024-09-11T22:05:00.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2607_vm 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 22:04 2608 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2608_fsm 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2608_vm 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 22:04 2609 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2609_fsm 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2609_vm 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2610 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2610_fsm 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2610_vm 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2611 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612 2024-09-11T22:05:00.048 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2612_fsm 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612_vm 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2613 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2615_fsm 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615_vm 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2616 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2616_fsm 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2616_vm 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 22:04 2617 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2617_fsm 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2617_vm 2024-09-11T22:05:00.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 22:04 2618 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2618_fsm 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2618_vm 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 11 22:04 2619 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2619_fsm 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2619_vm 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2620 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2650 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2651 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2652 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2653 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2654 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2655 2024-09-11T22:05:00.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2656 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2657 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 22:04 2658 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:04 2659 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2660 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2661 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2662 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2663 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2664 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2665 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2666 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2667 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2668 2024-09-11T22:05:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2669 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2670 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 22:04 2673 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 22:04 2674 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 22:04 2675 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2678 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2679 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2680 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2681 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2682 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2683 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2684 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2685 2024-09-11T22:05:00.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2686 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2687 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2688 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2689 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 22:04 2690 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 22:04 2691 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2692 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2693 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2696 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2699 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2701 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2702 2024-09-11T22:05:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2703 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2704 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2753 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2753_fsm 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2753_vm 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2754 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2755 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2756 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2757 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2830 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2831 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2832 2024-09-11T22:05:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2833 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2834 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2835 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2836 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2837 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 22:04 2838 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2838_fsm 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2838_vm 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2839 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840_fsm 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2840_vm 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2841 2024-09-11T22:05:00.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2995 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2996 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3079_fsm 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079_vm 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3080 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3081 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 3085 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3118 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3119 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 22:04 3164 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3256 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3257 2024-09-11T22:05:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3258 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3350 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3351 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3379 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3380 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3381 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3394 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3394_fsm 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3394_vm 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3395 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3429 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3430 2024-09-11T22:05:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3431 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3433 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3439 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3440 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 3455 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 22:04 3456 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3456_fsm 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3456_vm 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3466 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3467 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3468 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3501 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3502 2024-09-11T22:05:00.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3503 2024-09-11T22:05:00.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3534 2024-09-11T22:05:00.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541 2024-09-11T22:05:00.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3541_fsm 2024-09-11T22:05:00.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541_vm 2024-09-11T22:05:00.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3542 2024-09-11T22:05:00.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3574 2024-09-11T22:05:00.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3575 2024-09-11T22:05:00.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3576 2024-09-11T22:05:00.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3596 2024-09-11T22:05:00.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3597 2024-09-11T22:05:00.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3598 2024-09-11T22:05:00.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3599 2024-09-11T22:05:00.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600 2024-09-11T22:05:00.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3600_fsm 2024-09-11T22:05:00.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600_vm 2024-09-11T22:05:00.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601 2024-09-11T22:05:00.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3601_fsm 2024-09-11T22:05:00.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601_vm 2024-09-11T22:05:00.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602 2024-09-11T22:05:00.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3602_fsm 2024-09-11T22:05:00.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602_vm 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603_fsm 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3603_vm 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3604 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3605 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3606 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3607 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3608 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 3609 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3712 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764 2024-09-11T22:05:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3764_fsm 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764_vm 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3766 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3767 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3997 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4143 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4144 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4145 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4146 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4147 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4148 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4149 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4150 2024-09-11T22:05:00.062 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4151 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4152 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4153 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4154 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4155 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4156 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4157 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4158 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4159 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4160 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4161 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4162 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4163 2024-09-11T22:05:00.063 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4164 2024-09-11T22:05:00.064 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4165 2024-09-11T22:05:00.067 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4166 2024-09-11T22:05:00.067 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4167 2024-09-11T22:05:00.067 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4168 2024-09-11T22:05:00.067 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4169 2024-09-11T22:05:00.068 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4170 2024-09-11T22:05:00.068 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4171 2024-09-11T22:05:00.068 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4172 2024-09-11T22:05:00.068 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4173 2024-09-11T22:05:00.068 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4174 2024-09-11T22:05:00.068 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 5002 2024-09-11T22:05:00.068 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 548 2024-09-11T22:05:00.068 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 549 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6102 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6104 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6106 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6110 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6111 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6112 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6113 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6117 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 826 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 827 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 828 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 22:04 pg_filenode.map 2024-09-11T22:05:00.069 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 PG_VERSION 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:total 7777 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 22:04 . 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 .. 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 112 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 113 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:04 1247 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1247_fsm 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1247_vm 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 22:04 1249 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1249_fsm 2024-09-11T22:05:00.070 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1249_vm 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 22:04 1255 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1255_fsm 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1255_vm 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 22:04 1259 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1259_fsm 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1259_vm 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 22:04 13344 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13344_fsm 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13344_vm 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13346 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13348 2024-09-11T22:05:00.071 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13349_fsm 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349_vm 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13351 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13353 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13354_fsm 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354_vm 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13356 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13358 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13359_fsm 2024-09-11T22:05:00.072 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359_vm 2024-09-11T22:05:00.073 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13361 2024-09-11T22:05:00.073 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13363 2024-09-11T22:05:00.073 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1417 2024-09-11T22:05:00.073 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1418 2024-09-11T22:05:00.073 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 174 2024-09-11T22:05:00.073 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 175 2024-09-11T22:05:00.073 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2187 2024-09-11T22:05:00.073 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2224 2024-09-11T22:05:00.073 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2328 2024-09-11T22:05:00.073 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2336 2024-09-11T22:05:00.073 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2337 2024-09-11T22:05:00.074 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2579 2024-09-11T22:05:00.074 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2600 2024-09-11T22:05:00.074 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2600_fsm 2024-09-11T22:05:00.074 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2600_vm 2024-09-11T22:05:00.074 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601 2024-09-11T22:05:00.074 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2601_fsm 2024-09-11T22:05:00.074 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601_vm 2024-09-11T22:05:00.074 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2602 2024-09-11T22:05:00.074 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2602_fsm 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2602_vm 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2603 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2603_fsm 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2603_vm 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2604 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2605 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2605_fsm 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2605_vm 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2606 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2606_fsm 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2606_vm 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2607 2024-09-11T22:05:00.075 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2607_fsm 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2607_vm 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 22:04 2608 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2608_fsm 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2608_vm 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 22:04 2609 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2609_fsm 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2609_vm 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2610 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2610_fsm 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2610_vm 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2611 2024-09-11T22:05:00.076 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2612_fsm 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612_vm 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2613 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2615_fsm 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615_vm 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2616 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2616_fsm 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2616_vm 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 22:04 2617 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2617_fsm 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2617_vm 2024-09-11T22:05:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 22:04 2618 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2618_fsm 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2618_vm 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 11 22:04 2619 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2619_fsm 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2619_vm 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2620 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2650 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2651 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2652 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2653 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2654 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2655 2024-09-11T22:05:00.078 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2656 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2657 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 22:04 2658 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:04 2659 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2660 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2661 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2662 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2663 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2664 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2665 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2666 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2667 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2668 2024-09-11T22:05:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2669 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2670 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 22:04 2673 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 22:04 2674 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 22:04 2675 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2678 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2679 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2680 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2681 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2682 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2683 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2684 2024-09-11T22:05:00.080 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2685 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2686 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2687 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2688 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2689 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 22:04 2690 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 22:04 2691 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2692 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2693 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2696 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2699 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2701 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2702 2024-09-11T22:05:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2703 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2704 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2753 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2753_fsm 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2753_vm 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2754 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2755 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2756 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2757 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2830 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2831 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2832 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2833 2024-09-11T22:05:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2834 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2835 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2836 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2837 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 22:04 2838 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2838_fsm 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2838_vm 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2839 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840_fsm 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2840_vm 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2841 2024-09-11T22:05:00.083 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2995 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2996 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3079_fsm 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079_vm 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3080 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3081 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 3085 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3118 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3119 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 22:04 3164 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3256 2024-09-11T22:05:00.084 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3257 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3258 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3350 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3351 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3379 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3380 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3381 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3394 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3394_fsm 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3394_vm 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3395 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3429 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3430 2024-09-11T22:05:00.085 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3431 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3433 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3439 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3440 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 3455 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 22:04 3456 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3456_fsm 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3456_vm 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3466 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3467 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3468 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3501 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3502 2024-09-11T22:05:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3503 2024-09-11T22:05:00.087 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3534 2024-09-11T22:05:00.087 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541 2024-09-11T22:05:00.087 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3541_fsm 2024-09-11T22:05:00.087 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541_vm 2024-09-11T22:05:00.087 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3542 2024-09-11T22:05:00.087 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3574 2024-09-11T22:05:00.087 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3575 2024-09-11T22:05:00.087 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3576 2024-09-11T22:05:00.087 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3596 2024-09-11T22:05:00.087 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3597 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3598 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3599 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3600_fsm 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600_vm 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3601_fsm 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601_vm 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3602_fsm 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602_vm 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603 2024-09-11T22:05:00.088 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603_fsm 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3603_vm 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3604 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3605 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3606 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3607 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3608 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 3609 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3712 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3764_fsm 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764_vm 2024-09-11T22:05:00.089 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3766 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3767 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3997 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4143 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4144 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4145 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4146 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4147 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4148 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4149 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4150 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4151 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4152 2024-09-11T22:05:00.090 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4153 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4154 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4155 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4156 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4157 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4158 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4159 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4160 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4161 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4162 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4163 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4164 2024-09-11T22:05:00.091 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4165 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4166 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4167 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4168 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4169 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4170 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4171 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4172 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4173 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4174 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 5002 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 548 2024-09-11T22:05:00.092 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 549 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6102 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6104 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6106 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6110 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6111 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6112 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6113 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6117 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 826 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 827 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 828 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 22:04 pg_filenode.map 2024-09-11T22:05:00.093 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 PG_VERSION 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:total 7777 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 22:04 . 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 .. 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 112 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 113 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:04 1247 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1247_fsm 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1247_vm 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 22:04 1249 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1249_fsm 2024-09-11T22:05:00.094 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1249_vm 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 22:04 1255 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1255_fsm 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1255_vm 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 22:04 1259 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1259_fsm 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1259_vm 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 22:04 13344 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13344_fsm 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13344_vm 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13346 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13348 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349 2024-09-11T22:05:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13349_fsm 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349_vm 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13351 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13353 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13354_fsm 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354_vm 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13356 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13358 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13359_fsm 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359_vm 2024-09-11T22:05:00.096 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13361 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13363 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1417 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1418 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 174 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 175 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2187 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2224 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2328 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2336 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2337 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2579 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2600 2024-09-11T22:05:00.097 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2600_fsm 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2600_vm 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2601_fsm 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601_vm 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2602 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2602_fsm 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2602_vm 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2603 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2603_fsm 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2603_vm 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2604 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2605 2024-09-11T22:05:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2605_fsm 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2605_vm 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2606 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2606_fsm 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2606_vm 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2607 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2607_fsm 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2607_vm 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 22:04 2608 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2608_fsm 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2608_vm 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 22:04 2609 2024-09-11T22:05:00.099 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2609_fsm 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2609_vm 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2610 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2610_fsm 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2610_vm 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2611 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2612_fsm 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612_vm 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2613 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2615_fsm 2024-09-11T22:05:00.100 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615_vm 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2616 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2616_fsm 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2616_vm 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 22:04 2617 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2617_fsm 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2617_vm 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 22:04 2618 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2618_fsm 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2618_vm 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 11 22:04 2619 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2619_fsm 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2619_vm 2024-09-11T22:05:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2620 2024-09-11T22:05:00.102 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2650 2024-09-11T22:05:00.104 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2651 2024-09-11T22:05:00.104 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2652 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2653 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2654 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2655 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2656 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2657 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 22:04 2658 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:04 2659 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2660 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2661 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2662 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2663 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2664 2024-09-11T22:05:00.105 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2665 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2666 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2667 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2668 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2669 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2670 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 22:04 2673 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 22:04 2674 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 22:04 2675 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2678 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2679 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2680 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2681 2024-09-11T22:05:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2682 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2683 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2684 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2685 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2686 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2687 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2688 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2689 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 22:04 2690 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 22:04 2691 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2692 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2693 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2696 2024-09-11T22:05:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2699 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2701 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2702 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2703 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2704 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2753 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2753_fsm 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2753_vm 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2754 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2755 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2756 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2757 2024-09-11T22:05:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2830 2024-09-11T22:05:00.109 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2831 2024-09-11T22:05:00.109 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2832 2024-09-11T22:05:00.109 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2833 2024-09-11T22:05:00.109 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2834 2024-09-11T22:05:00.109 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2835 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2836 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2837 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 22:04 2838 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2838_fsm 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2838_vm 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2839 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840_fsm 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2840_vm 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2841 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2995 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2996 2024-09-11T22:05:00.110 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3079_fsm 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079_vm 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3080 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3081 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 3085 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3118 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3119 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 22:04 3164 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3256 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3257 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3258 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3350 2024-09-11T22:05:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3351 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3379 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3380 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3381 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3394 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3394_fsm 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3394_vm 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3395 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3429 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3430 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3431 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3433 2024-09-11T22:05:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3439 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3440 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 3455 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 22:04 3456 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3456_fsm 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3456_vm 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3466 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3467 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3468 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3501 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3502 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3503 2024-09-11T22:05:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3534 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3541_fsm 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541_vm 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3542 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3574 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3575 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3576 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3596 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3597 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3598 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3599 2024-09-11T22:05:00.114 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3600_fsm 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600_vm 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3601_fsm 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601_vm 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3602_fsm 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602_vm 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603_fsm 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3603_vm 2024-09-11T22:05:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3604 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3605 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3606 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3607 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3608 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 3609 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3712 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3764_fsm 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764_vm 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3766 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3767 2024-09-11T22:05:00.116 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3997 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4143 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4144 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4145 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4146 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4147 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4148 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4149 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4150 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4151 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4152 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4153 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4154 2024-09-11T22:05:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4155 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4156 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4157 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4158 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4159 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4160 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4161 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4162 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4163 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4164 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4165 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4166 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4167 2024-09-11T22:05:00.118 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4168 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4169 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4170 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4171 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4172 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4173 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4174 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 5002 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 548 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 549 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6102 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6104 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6106 2024-09-11T22:05:00.119 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6110 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6111 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6112 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6113 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6117 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 826 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 827 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 828 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 22:04 pg_filenode.map 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 PG_VERSION 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/global: 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:total 537 2024-09-11T22:05:00.120 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 11 22:04 . 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1213 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1213_fsm 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1213_vm 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1214 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1214_fsm 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1214_vm 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 1232 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 1233 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1260 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1260_fsm 2024-09-11T22:05:00.121 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1260_vm 2024-09-11T22:05:00.122 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1261 2024-09-11T22:05:00.122 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1261_fsm 2024-09-11T22:05:00.122 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1261_vm 2024-09-11T22:05:00.122 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1262 2024-09-11T22:05:00.122 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1262_fsm 2024-09-11T22:05:00.122 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1262_vm 2024-09-11T22:05:00.122 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2396 2024-09-11T22:05:00.122 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2396_fsm 2024-09-11T22:05:00.122 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2396_vm 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2397 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2671 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2672 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2676 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2677 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2694 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2695 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2697 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2698 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2846 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2847 2024-09-11T22:05:00.123 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2964 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2965 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2966 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2967 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3592 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3593 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4060 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4061 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4175 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4176 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4177 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4178 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4181 2024-09-11T22:05:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4182 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4183 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4184 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4185 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4186 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6000 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6001 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6002 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6100 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6114 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6115 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 pg_control 2024-09-11T22:05:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 22:04 pg_filenode.map 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/log: 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-11T22:05:00.126 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:total 1 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 . 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 mappings 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 11 22:04 replorigin_checkpoint 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 snapshots 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-11T22:05:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 .. 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 .. 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:04 . 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 members 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 offsets 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout:total 8 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 . 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:04 .. 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 0000 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout:total 8 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 . 2024-09-11T22:05:00.129 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:04 .. 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 0000 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout:total 8 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 . 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 0000 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.132 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout:total 16384 2024-09-11T22:05:00.133 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:04 . 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:04 000000010000000000000001 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 archive_status 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:04 .. 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:total 8 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 . 2024-09-11T22:05:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 11 22:04 .. 2024-09-11T22:05:00.135 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 0000 2024-09-11T22:05:00.135 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-11T22:05:00.247 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-11T22:05:00.254 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:dropping old tables... 2024-09-11T22:05:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-11T22:05:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-11T22:05:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-11T22:05:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-11T22:05:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:creating tables... 2024-09-11T22:05:00.305 INFO:teuthology.orchestra.run.smithi152.stderr:generating data (client-side)... 2024-09-11T22:05:00.381 INFO:teuthology.orchestra.run.smithi152.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.06 s, remaining 1.85 s) 2024-09-11T22:05:00.549 INFO:teuthology.orchestra.run.smithi152.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.23 s, remaining 3.41 s) 2024-09-11T22:05:00.638 INFO:teuthology.orchestra.run.smithi152.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.32 s, remaining 3.06 s) 2024-09-11T22:05:00.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.702+0000 7f5429980640 1 -- 172.21.15.152:0/2449076408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54241082a0 msgr2=0x7f542410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:00.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.702+0000 7f5429980640 1 --2- 172.21.15.152:0/2449076408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54241082a0 0x7f542410ec40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f541c009cd0 tx=0x7f541c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.702+0000 7f5429980640 1 -- 172.21.15.152:0/2449076408 shutdown_connections 2024-09-11T22:05:00.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.702+0000 7f5429980640 1 --2- 172.21.15.152:0/2449076408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54241082a0 0x7f542410ec40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.702+0000 7f5429980640 1 --2- 172.21.15.152:0/2449076408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54241036e0 0x7f5424107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.702+0000 7f5429980640 1 --2- 172.21.15.152:0/2449076408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5424102d30 0x7f5424103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.702+0000 7f5429980640 1 -- 172.21.15.152:0/2449076408 >> 172.21.15.152:0/2449076408 conn(0x7f54240fc7d0 msgr2=0x7f54240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:00.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.702+0000 7f5429980640 1 -- 172.21.15.152:0/2449076408 shutdown_connections 2024-09-11T22:05:00.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.702+0000 7f5429980640 1 -- 172.21.15.152:0/2449076408 wait complete. 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.702+0000 7f5429980640 1 Processor -- start 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f5429980640 1 -- start start 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f5429980640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5424102d30 0x7f5424198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f5429980640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54241036e0 0x7f5424198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f5429980640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54241082a0 0x7f542419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f5429980640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f54241120f0 con 0x7f54241036e0 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f5429980640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5424111f70 con 0x7f5424102d30 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f5429980640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5424112270 con 0x7f54241082a0 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f54227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54241036e0 0x7f5424198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f54227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54241036e0 0x7f5424198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59946/0 (socket says 172.21.15.152:59946) 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f54227fc640 1 -- 172.21.15.152:0/3942530886 learned_addr learned my addr 172.21.15.152:0/3942530886 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:00.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f5422ffd640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5424102d30 0x7f5424198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f54237fe640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54241082a0 0x7f542419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f54227fc640 1 -- 172.21.15.152:0/3942530886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54241082a0 msgr2=0x7f542419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f54227fc640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54241082a0 0x7f542419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f54227fc640 1 -- 172.21.15.152:0/3942530886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5424102d30 msgr2=0x7f5424198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f54227fc640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5424102d30 0x7f5424198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f54227fc640 1 -- 172.21.15.152:0/3942530886 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542419d5e0 con 0x7f54241036e0 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.703+0000 7f54237fe640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54241082a0 0x7f542419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.704+0000 7f54227fc640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54241036e0 0x7f5424198b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f541800d950 tx=0x7f541800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.704+0000 7f542897e640 1 -- 172.21.15.152:0/3942530886 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418017070 con 0x7f54241036e0 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.704+0000 7f5429980640 1 -- 172.21.15.152:0/3942530886 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542419d8d0 con 0x7f54241036e0 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.704+0000 7f542897e640 1 -- 172.21.15.152:0/3942530886 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5418009c30 con 0x7f54241036e0 2024-09-11T22:05:00.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.704+0000 7f542897e640 1 -- 172.21.15.152:0/3942530886 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54180047a0 con 0x7f54241036e0 2024-09-11T22:05:00.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.704+0000 7f5429980640 1 -- 172.21.15.152:0/3942530886 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54241a51b0 con 0x7f54241036e0 2024-09-11T22:05:00.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.706+0000 7f542897e640 1 -- 172.21.15.152:0/3942530886 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138061+0+0 (secure 0 0 0) 0x7f5418004020 con 0x7f54241036e0 2024-09-11T22:05:00.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.706+0000 7f542bd59740 1 Processor -- start 2024-09-11T22:05:00.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f542bd59740 1 -- start start 2024-09-11T22:05:00.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f542bd59740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b22880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f542bd59740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b22dc0 0x558742b2d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f542bd59740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b2d680 0x558742b2fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f542bd59740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558742a882e0 con 0x558742b2d680 2024-09-11T22:05:00.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f542bd59740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558742a2fce0 con 0x558742b224a0 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f542bd59740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558742a842a0 con 0x558742b22dc0 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f54227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b2d680 0x558742b2fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f54237fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b22880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f542897e640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f540c0a2e10 0x7f540c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f54237fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b22880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:42942/0 (socket says 172.21.15.152:42942) 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f54237fe640 1 -- 172.21.15.152:0/3120882825 learned_addr learned my addr 172.21.15.152:0/3120882825 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f5422ffd640 1 --2- 172.21.15.152:0/3120882825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b22dc0 0x558742b2d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f54237fe640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f540c0a2e10 0x7f540c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f542897e640 1 -- 172.21.15.152:0/3942530886 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f54180cf340 con 0x7f54241036e0 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f54237fe640 1 -- 172.21.15.152:0/3120882825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b22dc0 msgr2=0x558742b2d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f54237fe640 1 --2- 172.21.15.152:0/3120882825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b22dc0 0x558742b2d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f54237fe640 1 -- 172.21.15.152:0/3120882825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b2d680 msgr2=0x558742b2fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f54237fe640 1 --2- 172.21.15.152:0/3120882825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b2d680 0x558742b2fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f54237fe640 1 -- 172.21.15.152:0/3120882825 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558742a14440 con 0x558742b224a0 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f54227fc640 1 --2- 172.21.15.152:0/3120882825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b2d680 0x558742b2fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.707+0000 7f5422ffd640 1 --2- 172.21.15.152:0/3120882825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b22dc0 0x558742b2d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.708+0000 7f54237fe640 1 --2- 172.21.15.152:0/3120882825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b22880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f541c009cd0 tx=0x7f541c031b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=215de9a4b3b6a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.708+0000 7f5409ffb640 1 -- 172.21.15.152:0/3120882825 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c004040 con 0x558742b224a0 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.708+0000 7f5409ffb640 1 -- 172.21.15.152:0/3120882825 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f541c036040 con 0x558742b224a0 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.708+0000 7f54237fe640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f540c0a2e10 0x7f540c0a52d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f541c04d000 tx=0x7f541c04b000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.708+0000 7f5409ffb640 1 -- 172.21.15.152:0/3120882825 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c030a60 con 0x558742b224a0 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.709+0000 7f542bd59740 1 -- 172.21.15.152:0/3120882825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 msgr2=0x558742b22880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.709+0000 7f542bd59740 1 --2- 172.21.15.152:0/3120882825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b22880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f541c009cd0 tx=0x7f541c031b50 comp rx=0 tx=0).stop 2024-09-11T22:05:00.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.709+0000 7f542bd59740 1 -- 172.21.15.152:0/3120882825 shutdown_connections 2024-09-11T22:05:00.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.709+0000 7f542bd59740 1 --2- 172.21.15.152:0/3120882825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b2d680 0x558742b2fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.709+0000 7f542bd59740 1 --2- 172.21.15.152:0/3120882825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b22dc0 0x558742b2d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.709+0000 7f542bd59740 1 --2- 172.21.15.152:0/3120882825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b22880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.709+0000 7f542bd59740 1 -- 172.21.15.152:0/3120882825 >> 172.21.15.152:0/3120882825 conn(0x558742b1ea30 msgr2=0x558742b1ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:00.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.709+0000 7f542bd59740 1 -- 172.21.15.152:0/3120882825 shutdown_connections 2024-09-11T22:05:00.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.709+0000 7f542bd59740 1 -- 172.21.15.152:0/3120882825 wait complete. 2024-09-11T22:05:00.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.709+0000 7f542bd59740 1 -- start start 2024-09-11T22:05:00.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.709+0000 7f542bd59740 1 Processor -- start 2024-09-11T22:05:00.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f542bd59740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b2d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f542bd59740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742b2a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f542bd59740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 0x558742b2a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f542bd59740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558742b30250 con 0x558742b22dc0 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f542bd59740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558742a43050 con 0x558742b224a0 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f542bd59740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558742b303d0 con 0x558742b2d680 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f542bd59740 10 client.0 _ll_register_callbacks cb 0x558742a83160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f5422ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b2d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f54227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742b2a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f5422ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b2d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:42944/0 (socket says 172.21.15.152:42944) 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f5422ffd640 1 -- 172.21.15.152:0/2636751826 learned_addr learned my addr 172.21.15.152:0/2636751826 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f54237fe640 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 0x558742b2a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f5422ffd640 1 -- 172.21.15.152:0/2636751826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 msgr2=0x558742b2a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f5422ffd640 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 0x558742b2a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f5422ffd640 1 -- 172.21.15.152:0/2636751826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 msgr2=0x558742b2a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f5422ffd640 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742b2a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f5422ffd640 1 -- 172.21.15.152:0/2636751826 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587427f93c0 con 0x558742b224a0 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f54237fe640 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 0x558742b2a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f5422ffd640 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b2d030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5414012700 tx=0x7f5414012b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54ce9b3e3d2b3928 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.710+0000 7f5402ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f5402ffd640 1 -- 172.21.15.152:0/2636751826 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414004050 con 0x558742b224a0 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f5402ffd640 1 -- 172.21.15.152:0/2636751826 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f54140041f0 con 0x558742b224a0 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f542bd59740 1 -- 172.21.15.152:0/2636751826 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f541c036040 con 0x558742b224a0 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f5402ffd640 1 -- 172.21.15.152:0/2636751826 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f54140043f0 con 0x558742b224a0 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f542bd59740 10 client.25025 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f542bd59740 1 -- 172.21.15.152:0/2636751826 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558742b3bcc0 con 0x558742b224a0 2024-09-11T22:05:00.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f5402ffd640 1 -- 172.21.15.152:0/2636751826 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f541c036040 con 0x558742b224a0 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f5402ffd640 1 -- 172.21.15.152:0/2636751826 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f541400f8b0 con 0x558742b224a0 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f542bd59740 10 client.25025 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f542bd59740 10 client.25025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f542bd59740 20 client.25025 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f542bd59740 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558742b3d180 0x558742b3f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f542bd59740 4 client.25025 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.711+0000 7f542bd59740 1 -- 172.21.15.152:0/2636751826 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558742a95850 con 0x558742b3d180 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.712+0000 7f54227fc640 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558742b3d180 0x558742b3f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.712+0000 7f5402ffd640 10 client.25025 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.712+0000 7f54227fc640 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558742b3d180 0x558742b3f5b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e9ed0447e7d9f3 server_cookie=53b9d8f3cdbeef03 in_seq=0 out_seq=0 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f5402ffd640 1 -- 172.21.15.152:0/2636751826 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558742a95850 con 0x558742b3d180 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f5402ffd640 10 client.25025 handle_command_reply: tid=0 2024-09-11T22:05:00.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f542bd59740 1 client.25025 shutdown 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f542bd59740 1 -- 172.21.15.152:0/2636751826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 msgr2=0x558742b2d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f542bd59740 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b2d030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5414012700 tx=0x7f5414012b00 comp rx=0 tx=0).stop 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f542bd59740 1 -- 172.21.15.152:0/2636751826 shutdown_connections 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f542bd59740 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558742b3d180 0x558742b3f5b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f542bd59740 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 0x558742b2a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f542bd59740 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742b2a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f542bd59740 1 --2- 172.21.15.152:0/2636751826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b2d030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f5402ffd640 0 client.25025 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f542bd59740 1 -- 172.21.15.152:0/2636751826 >> 172.21.15.152:0/2636751826 conn(0x558742b1ea30 msgr2=0x558742b24710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.713+0000 7f542bd59740 1 -- 172.21.15.152:0/2636751826 shutdown_connections 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.714+0000 7f542bd59740 1 -- 172.21.15.152:0/2636751826 wait complete. 2024-09-11T22:05:00.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.714+0000 7f542bd59740 20 client.25025 trim_cache size 0 max 16384 2024-09-11T22:05:00.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.737+0000 7f542bd59740 1 Processor -- start 2024-09-11T22:05:00.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.737+0000 7f542bd59740 1 -- start start 2024-09-11T22:05:00.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.737+0000 7f542bd59740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b1ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.738+0000 7f542bd59740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742b44e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.738+0000 7f542bd59740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 0x558742b453c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.738+0000 7f542bd59740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f54241b0390 con 0x558742b22dc0 2024-09-11T22:05:00.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.738+0000 7f542bd59740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f54241adc30 con 0x558742b224a0 2024-09-11T22:05:00.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.738+0000 7f542bd59740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f54241aba80 con 0x558742b2d680 2024-09-11T22:05:00.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.738+0000 7f54237fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 0x558742b453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.738+0000 7f54237fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 0x558742b453c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52512/0 (socket says 172.21.15.152:52512) 2024-09-11T22:05:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.738+0000 7f54237fe640 1 -- 172.21.15.152:0/1333096409 learned_addr learned my addr 172.21.15.152:0/1333096409 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.738+0000 7f54227fc640 1 --2- 172.21.15.152:0/1333096409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742b44e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.739+0000 7f5422ffd640 1 --2- 172.21.15.152:0/1333096409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b1ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.739+0000 7f54227fc640 1 -- 172.21.15.152:0/1333096409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 msgr2=0x558742b453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.739+0000 7f54227fc640 1 --2- 172.21.15.152:0/1333096409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 0x558742b453c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.739+0000 7f54227fc640 1 -- 172.21.15.152:0/1333096409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 msgr2=0x558742b1ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.739+0000 7f54227fc640 1 --2- 172.21.15.152:0/1333096409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b1ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.739+0000 7f54227fc640 1 -- 172.21.15.152:0/1333096409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558742b3fc30 con 0x558742b22dc0 2024-09-11T22:05:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.739+0000 7f54227fc640 1 --2- 172.21.15.152:0/1333096409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742b44e80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f54180cc8e0 tx=0x7f541809f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a5a68ca41e0fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.739+0000 7f54097fa640 1 -- 172.21.15.152:0/1333096409 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541809b5e0 con 0x558742b22dc0 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.739+0000 7f54097fa640 1 -- 172.21.15.152:0/1333096409 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5418015070 con 0x558742b22dc0 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.739+0000 7f54097fa640 1 -- 172.21.15.152:0/1333096409 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54180ccbc0 con 0x558742b22dc0 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.740+0000 7f542bd59740 1 -- 172.21.15.152:0/1333096409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 msgr2=0x558742b44e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.740+0000 7f542bd59740 1 --2- 172.21.15.152:0/1333096409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742b44e80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f54180cc8e0 tx=0x7f541809f040 comp rx=0 tx=0).stop 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.740+0000 7f542bd59740 1 -- 172.21.15.152:0/1333096409 shutdown_connections 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.740+0000 7f542bd59740 1 --2- 172.21.15.152:0/1333096409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b2d680 0x558742b453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.740+0000 7f542bd59740 1 --2- 172.21.15.152:0/1333096409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742b44e80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.740+0000 7f542bd59740 1 --2- 172.21.15.152:0/1333096409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b224a0 0x558742b1ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.740+0000 7f542bd59740 1 -- 172.21.15.152:0/1333096409 >> 172.21.15.152:0/1333096409 conn(0x558742b1ea30 msgr2=0x558742b28bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.740+0000 7f542bd59740 1 -- 172.21.15.152:0/1333096409 shutdown_connections 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.740+0000 7f542bd59740 1 -- 172.21.15.152:0/1333096409 wait complete. 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.741+0000 7f542bd59740 1 -- start start 2024-09-11T22:05:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.741+0000 7f542bd59740 1 Processor -- start 2024-09-11T22:05:00.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.741+0000 7f542bd59740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b224a0 0x558742b35e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f542bd59740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742ba0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f542bd59740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b2d680 0x558742ba13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f54227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742ba0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f54227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742ba0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60000/0 (socket says 172.21.15.152:60000) 2024-09-11T22:05:00.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f54227fc640 1 -- 172.21.15.152:0/655856463 learned_addr learned my addr 172.21.15.152:0/655856463 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:00.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f542bd59740 1 -- 172.21.15.152:0/655856463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f54241ac0f0 con 0x558742b22dc0 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f542bd59740 1 -- 172.21.15.152:0/655856463 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f54241ad560 con 0x558742b2d680 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f542bd59740 1 -- 172.21.15.152:0/655856463 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f54241ac7c0 con 0x558742b224a0 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f542bd59740 10 client.0 _ll_register_callbacks cb 0x7f5414009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f5422ffd640 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b224a0 0x558742b35e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f54227fc640 1 -- 172.21.15.152:0/655856463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b224a0 msgr2=0x558742b35e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f54227fc640 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b224a0 0x558742b35e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f54227fc640 1 -- 172.21.15.152:0/655856463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b2d680 msgr2=0x558742ba13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f54227fc640 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b2d680 0x558742ba13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.742+0000 7f54227fc640 1 -- 172.21.15.152:0/655856463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558742ba1be0 con 0x558742b22dc0 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.743+0000 7f54227fc640 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742ba0db0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f541809b570 tx=0x7f5418097880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c508057f8f252ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.743+0000 7f5402ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:00.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.743+0000 7f5402ffd640 1 -- 172.21.15.152:0/655856463 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54180b9060 con 0x558742b22dc0 2024-09-11T22:05:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.743+0000 7f542bd59740 1 -- 172.21.15.152:0/655856463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5418015070 con 0x558742b22dc0 2024-09-11T22:05:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.743+0000 7f5402ffd640 1 -- 172.21.15.152:0/655856463 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f5418097c50 con 0x558742b22dc0 2024-09-11T22:05:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.743+0000 7f5402ffd640 1 -- 172.21.15.152:0/655856463 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f541809b5e0 con 0x558742b22dc0 2024-09-11T22:05:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.743+0000 7f542bd59740 10 client.15492 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.743+0000 7f542bd59740 1 -- 172.21.15.152:0/655856463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558742bb0b40 con 0x558742b22dc0 2024-09-11T22:05:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.743+0000 7f5402ffd640 1 -- 172.21.15.152:0/655856463 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5418015070 con 0x558742b22dc0 2024-09-11T22:05:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.743+0000 7f5402ffd640 1 -- 172.21.15.152:0/655856463 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f541809aac0 con 0x558742b22dc0 2024-09-11T22:05:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.744+0000 7f542bd59740 10 client.15492 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.744+0000 7f542bd59740 10 client.15492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.744+0000 7f542bd59740 20 client.15492 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.744+0000 7f542bd59740 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558742bb1270 0x558742bb3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.744+0000 7f542bd59740 4 client.15492 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.744+0000 7f542bd59740 1 -- 172.21.15.152:0/655856463 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558742a8fd60 con 0x558742bb1270 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.744+0000 7f5422ffd640 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558742bb1270 0x558742bb3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.744+0000 7f5422ffd640 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558742bb1270 0x558742bb3690 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea11603c8d4ca3a server_cookie=ba50b0f9a5e5e292 in_seq=0 out_seq=0 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.744+0000 7f5402ffd640 10 client.15492 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f5402ffd640 1 -- 172.21.15.152:0/655856463 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558742a8fd60 con 0x558742bb1270 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f5402ffd640 10 client.15492 handle_command_reply: tid=0 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 1 client.15492 shutdown 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 1 -- 172.21.15.152:0/655856463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 msgr2=0x558742ba0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742ba0db0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f541809b570 tx=0x7f5418097880 comp rx=0 tx=0).stop 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 1 -- 172.21.15.152:0/655856463 shutdown_connections 2024-09-11T22:05:00.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558742bb1270 0x558742bb3690 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558742b2d680 0x558742ba13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558742b22dc0 0x558742ba0db0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f5402ffd640 0 client.15492 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:00.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 1 --2- 172.21.15.152:0/655856463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558742b224a0 0x558742b35e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 1 -- 172.21.15.152:0/655856463 >> 172.21.15.152:0/655856463 conn(0x558742b1ea30 msgr2=0x558742b2bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:00.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 1 -- 172.21.15.152:0/655856463 shutdown_connections 2024-09-11T22:05:00.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 1 -- 172.21.15.152:0/655856463 wait complete. 2024-09-11T22:05:00.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.745+0000 7f542bd59740 20 client.15492 trim_cache size 0 max 16384 2024-09-11T22:05:00.751 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:05:00.751 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:05:00.751 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:05:00.751 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 -- 172.21.15.152:0/3942530886 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f540c0a2e10 msgr2=0x7f540c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f540c0a2e10 0x7f540c0a52d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f541c04d000 tx=0x7f541c04b000 comp rx=0 tx=0).stop 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 -- 172.21.15.152:0/3942530886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54241036e0 msgr2=0x7f5424198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54241036e0 0x7f5424198b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f541800d950 tx=0x7f541800de10 comp rx=0 tx=0).stop 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 -- 172.21.15.152:0/3942530886 shutdown_connections 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f540c0a2e10 0x7f540c0a52d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54241082a0 0x7f542419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54241036e0 0x7f5424198b70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 --2- 172.21.15.152:0/3942530886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5424102d30 0x7f5424198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 -- 172.21.15.152:0/3942530886 >> 172.21.15.152:0/3942530886 conn(0x7f54240fc7d0 msgr2=0x7f54240fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 -- 172.21.15.152:0/3942530886 shutdown_connections 2024-09-11T22:05:00.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:00.746+0000 7f5429980640 1 -- 172.21.15.152:0/3942530886 wait complete. 2024-09-11T22:05:00.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:05:00 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:05:00.725+0000 7f79b223d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:05:00.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:05:00 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:05:00.725+0000 7f79b223d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:05:00.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:05:00 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:05:00.725+0000 7f79b223d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:05:00.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:05:00 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:05:00.725+0000 7f79b223d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:05:00.980 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:05:00 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:05:00.725+0000 7f79b223d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:05:01.422 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:05:01.422 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:05:01.779 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:02.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.297+0000 7f1ef0338640 1 -- 172.21.15.152:0/586360624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee8106a90 msgr2=0x7f1ee8106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:02.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.297+0000 7f1ef0338640 1 --2- 172.21.15.152:0/586360624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee8106a90 0x7f1ee8106e70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009860 tx=0x7f1ee402a340 comp rx=0 tx=0).stop 2024-09-11T22:05:02.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.297+0000 7f1ef0338640 1 -- 172.21.15.152:0/586360624 shutdown_connections 2024-09-11T22:05:02.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.297+0000 7f1ef0338640 1 --2- 172.21.15.152:0/586360624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ee8101430 0x7f1ee810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:02.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.297+0000 7f1ef0338640 1 --2- 172.21.15.152:0/586360624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ee8100a90 0x7f1ee8100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:02.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.297+0000 7f1ef0338640 1 --2- 172.21.15.152:0/586360624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee8106a90 0x7f1ee8106e70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:02.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.297+0000 7f1ef0338640 1 -- 172.21.15.152:0/586360624 >> 172.21.15.152:0/586360624 conn(0x7f1ee80fc7d0 msgr2=0x7f1ee80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:02.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.297+0000 7f1ef0338640 1 -- 172.21.15.152:0/586360624 shutdown_connections 2024-09-11T22:05:02.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.297+0000 7f1ef0338640 1 -- 172.21.15.152:0/586360624 wait complete. 2024-09-11T22:05:02.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1ef0338640 1 Processor -- start 2024-09-11T22:05:02.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1ef0338640 1 -- start start 2024-09-11T22:05:02.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1ef0338640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ee8100a90 0x7f1ee81970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:02.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1ef0338640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ee8101430 0x7f1ee8197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:02.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1ef0338640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee8106a90 0x7f1ee8197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:02.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1ef0338640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee8110e90 con 0x7f1ee8100a90 2024-09-11T22:05:02.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1ef0338640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee8110d10 con 0x7f1ee8106a90 2024-09-11T22:05:02.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1ef0338640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee8111010 con 0x7f1ee8101430 2024-09-11T22:05:02.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1eee0d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ee8100a90 0x7f1ee81970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:02.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1eee0d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ee8100a90 0x7f1ee81970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60032/0 (socket says 172.21.15.152:60032) 2024-09-11T22:05:02.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1eee0d4640 1 -- 172.21.15.152:0/1377667084 learned_addr learned my addr 172.21.15.152:0/1377667084 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:02.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1eee8d5640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee8106a90 0x7f1ee8197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:02.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.298+0000 7f1eed8d3640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ee8101430 0x7f1ee8197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:02.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1eee0d4640 1 -- 172.21.15.152:0/1377667084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ee8101430 msgr2=0x7f1ee8197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:02.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1eee0d4640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ee8101430 0x7f1ee8197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:02.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1eee0d4640 1 -- 172.21.15.152:0/1377667084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee8106a90 msgr2=0x7f1ee8197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:02.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1eee0d4640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee8106a90 0x7f1ee8197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:02.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1eee0d4640 1 -- 172.21.15.152:0/1377667084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee81a6940 con 0x7f1ee8100a90 2024-09-11T22:05:02.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1eee8d5640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee8106a90 0x7f1ee8197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:02.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1eee0d4640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ee8100a90 0x7f1ee81970d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4035040 tx=0x7f1ee4033b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:02.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1edf7fe640 1 -- 172.21.15.152:0/1377667084 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4037040 con 0x7f1ee8100a90 2024-09-11T22:05:02.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1edf7fe640 1 -- 172.21.15.152:0/1377667084 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ee4040070 con 0x7f1ee8100a90 2024-09-11T22:05:02.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1ef0338640 1 -- 172.21.15.152:0/1377667084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee81a6bd0 con 0x7f1ee8100a90 2024-09-11T22:05:02.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1edf7fe640 1 -- 172.21.15.152:0/1377667084 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4003a10 con 0x7f1ee8100a90 2024-09-11T22:05:02.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.299+0000 7f1ef0338640 1 -- 172.21.15.152:0/1377667084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee81a7100 con 0x7f1ee8100a90 2024-09-11T22:05:02.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.301+0000 7f1ef0338640 1 -- 172.21.15.152:0/1377667084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee8100ef0 con 0x7f1ee8100a90 2024-09-11T22:05:02.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.302+0000 7f1edf7fe640 1 -- 172.21.15.152:0/1377667084 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7f1ee4004150 con 0x7f1ee8100a90 2024-09-11T22:05:02.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.303+0000 7f1edf7fe640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1ed40a2f20 0x7f1ed40a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:02.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.303+0000 7f1edf7fe640 1 -- 172.21.15.152:0/1377667084 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1ee40ef620 con 0x7f1ee8100a90 2024-09-11T22:05:02.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.303+0000 7f1eed8d3640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1ed40a2f20 0x7f1ed40a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:02.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.304+0000 7f1eed8d3640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1ed40a2f20 0x7f1ed40a53e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8199230 tx=0x7f1ed8005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:02.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.308+0000 7f1edf7fe640 1 -- 172.21.15.152:0/1377667084 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ee40bc0e0 con 0x7f1ee8100a90 2024-09-11T22:05:02.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:02 smithi152 ceph-mon[31188]: pgmap v25: 97 pgs: 97 active+clean; 21 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 141 KiB/s wr, 19 op/s 2024-09-11T22:05:02.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:02 smithi152 ceph-mon[31188]: mgrmap e24: x(active, since 44s), standbys: y, z 2024-09-11T22:05:02.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.591+0000 7f1ef0338640 1 -- 172.21.15.152:0/1377667084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ee8108a70 con 0x7f1ee8100a90 2024-09-11T22:05:02.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.592+0000 7f1edf7fe640 1 -- 172.21.15.152:0/1377667084 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11927 (secure 0 0 0) 0x7f1ee40bb9e0 con 0x7f1ee8100a90 2024-09-11T22:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":27,"btime":"2024-09-11T22:04:54:476799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:53.804306+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:05:02.594 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 27 2024-09-11T22:05:02.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 -- 172.21.15.152:0/1377667084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1ed40a2f20 msgr2=0x7f1ed40a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:02.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1ed40a2f20 0x7f1ed40a53e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8199230 tx=0x7f1ed8005f90 comp rx=0 tx=0).stop 2024-09-11T22:05:02.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 -- 172.21.15.152:0/1377667084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ee8100a90 msgr2=0x7f1ee81970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:02.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ee8100a90 0x7f1ee81970d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4035040 tx=0x7f1ee4033b60 comp rx=0 tx=0).stop 2024-09-11T22:05:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 -- 172.21.15.152:0/1377667084 shutdown_connections 2024-09-11T22:05:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1ed40a2f20 0x7f1ed40a53e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee8106a90 0x7f1ee8197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ee8101430 0x7f1ee8197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 --2- 172.21.15.152:0/1377667084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ee8100a90 0x7f1ee81970d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 -- 172.21.15.152:0/1377667084 >> 172.21.15.152:0/1377667084 conn(0x7f1ee80fc7d0 msgr2=0x7f1ee80fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 -- 172.21.15.152:0/1377667084 shutdown_connections 2024-09-11T22:05:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:02.595+0000 7f1ef0338640 1 -- 172.21.15.152:0/1377667084 wait complete. 2024-09-11T22:05:02.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:02 smithi179 ceph-mon[35603]: pgmap v25: 97 pgs: 97 active+clean; 21 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 141 KiB/s wr, 19 op/s 2024-09-11T22:05:02.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:02 smithi179 ceph-mon[35603]: mgrmap e24: x(active, since 44s), standbys: y, z 2024-09-11T22:05:02.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:02 smithi193 ceph-mon[35545]: pgmap v25: 97 pgs: 97 active+clean; 21 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 141 KiB/s wr, 19 op/s 2024-09-11T22:05:02.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:02 smithi193 ceph-mon[35545]: mgrmap e24: x(active, since 44s), standbys: y, z 2024-09-11T22:05:02.851 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-11T22:05:02.851 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:05:03.289 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:05:03.344 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:03.697 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:03 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1377667084' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:03.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:03 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1377667084' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:03.727 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:03 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1377667084' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:04.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:03.999+0000 7f068ef14640 1 -- 172.21.15.152:0/2081364045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0688102d90 msgr2=0x7f0688103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:03.999+0000 7f068ef14640 1 --2- 172.21.15.152:0/2081364045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0688102d90 0x7f0688103170 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f067c009930 tx=0x7f067c02a420 comp rx=0 tx=0).stop 2024-09-11T22:05:04.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:03.999+0000 7f068ef14640 1 -- 172.21.15.152:0/2081364045 shutdown_connections 2024-09-11T22:05:04.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:03.999+0000 7f068ef14640 1 --2- 172.21.15.152:0/2081364045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0688108290 0x7f068810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:03.999+0000 7f068ef14640 1 --2- 172.21.15.152:0/2081364045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0688103740 0x7f0688107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:03.999+0000 7f068ef14640 1 --2- 172.21.15.152:0/2081364045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0688102d90 0x7f0688103170 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:03.999+0000 7f068ef14640 1 -- 172.21.15.152:0/2081364045 >> 172.21.15.152:0/2081364045 conn(0x7f06880fc7d0 msgr2=0x7f06880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:03.999+0000 7f068ef14640 1 -- 172.21.15.152:0/2081364045 shutdown_connections 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:03.999+0000 7f068ef14640 1 -- 172.21.15.152:0/2081364045 wait complete. 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.000+0000 7f068ef14640 1 Processor -- start 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.000+0000 7f068ef14640 1 -- start start 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.000+0000 7f068ef14640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0688102d90 0x7f06881985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.000+0000 7f068ef14640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0688103740 0x7f0688198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.000+0000 7f068ef14640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0688108290 0x7f068819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.000+0000 7f068ef14640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0688112090 con 0x7f0688108290 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.000+0000 7f068ef14640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0688111f10 con 0x7f0688103740 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.000+0000 7f068ef14640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0688112210 con 0x7f0688102d90 2024-09-11T22:05:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f068d4b1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0688108290 0x7f068819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f068ccb0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0688102d90 0x7f06881985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f0687fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0688103740 0x7f0688198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f068ccb0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0688102d90 0x7f06881985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:56316/0 (socket says 172.21.15.152:56316) 2024-09-11T22:05:04.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f068ccb0640 1 -- 172.21.15.152:0/1155658416 learned_addr learned my addr 172.21.15.152:0/1155658416 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:04.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f0687fff640 1 -- 172.21.15.152:0/1155658416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0688102d90 msgr2=0x7f06881985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f0687fff640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0688102d90 0x7f06881985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f0687fff640 1 -- 172.21.15.152:0/1155658416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0688108290 msgr2=0x7f068819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f0687fff640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0688108290 0x7f068819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f0687fff640 1 -- 172.21.15.152:0/1155658416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068819d550 con 0x7f0688103740 2024-09-11T22:05:04.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f068d4b1640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0688108290 0x7f068819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:04.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f0687fff640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0688103740 0x7f0688198ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f067400e9c0 tx=0x7f067400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:04.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f0685ffb640 1 -- 172.21.15.152:0/1155658416 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067400ccc0 con 0x7f0688103740 2024-09-11T22:05:04.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.001+0000 7f068ef14640 1 -- 172.21.15.152:0/1155658416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068819d840 con 0x7f0688103740 2024-09-11T22:05:04.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.002+0000 7f0685ffb640 1 -- 172.21.15.152:0/1155658416 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0674005020 con 0x7f0688103740 2024-09-11T22:05:04.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.002+0000 7f0685ffb640 1 -- 172.21.15.152:0/1155658416 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674004a00 con 0x7f0688103740 2024-09-11T22:05:04.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.002+0000 7f068ef14640 1 -- 172.21.15.152:0/1155658416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06881a5120 con 0x7f0688103740 2024-09-11T22:05:04.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.003+0000 7f068ef14640 1 -- 172.21.15.152:0/1155658416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068806a7f0 con 0x7f0688103740 2024-09-11T22:05:04.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.004+0000 7f0685ffb640 1 -- 172.21.15.152:0/1155658416 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7f0674004c80 con 0x7f0688103740 2024-09-11T22:05:04.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.004+0000 7f0685ffb640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f06780a2f20 0x7f06780a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.004+0000 7f068ccb0640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f06780a2f20 0x7f06780a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.004+0000 7f0685ffb640 1 -- 172.21.15.152:0/1155658416 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f06740cf650 con 0x7f0688103740 2024-09-11T22:05:04.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.005+0000 7f068ccb0640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f06780a2f20 0x7f06780a53e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f067c000c00 tx=0x7f067c009560 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:04.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.009+0000 7f0685ffb640 1 -- 172.21.15.152:0/1155658416 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f067409c000 con 0x7f0688103740 2024-09-11T22:05:04.098 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:04.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.278+0000 7f068ef14640 1 -- 172.21.15.152:0/1155658416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f068810a2a0 con 0x7f0688103740 2024-09-11T22:05:04.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.279+0000 7f0685ffb640 1 -- 172.21.15.152:0/1155658416 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11927 (secure 0 0 0) 0x7f06740afe20 con 0x7f0688103740 2024-09-11T22:05:04.280 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:04.281 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":27,"btime":"2024-09-11T22:04:54:476799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:53.804306+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:05:04.281 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 27 2024-09-11T22:05:04.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 -- 172.21.15.152:0/1155658416 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f06780a2f20 msgr2=0x7f06780a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f06780a2f20 0x7f06780a53e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f067c000c00 tx=0x7f067c009560 comp rx=0 tx=0).stop 2024-09-11T22:05:04.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 -- 172.21.15.152:0/1155658416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0688103740 msgr2=0x7f0688198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0688103740 0x7f0688198ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f067400e9c0 tx=0x7f067400ee80 comp rx=0 tx=0).stop 2024-09-11T22:05:04.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 -- 172.21.15.152:0/1155658416 shutdown_connections 2024-09-11T22:05:04.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f06780a2f20 0x7f06780a53e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0688108290 0x7f068819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0688103740 0x7f0688198ae0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 --2- 172.21.15.152:0/1155658416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0688102d90 0x7f06881985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 -- 172.21.15.152:0/1155658416 >> 172.21.15.152:0/1155658416 conn(0x7f06880fc7d0 msgr2=0x7f0688105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:04.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 -- 172.21.15.152:0/1155658416 shutdown_connections 2024-09-11T22:05:04.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.282+0000 7f068ef14640 1 -- 172.21.15.152:0/1155658416 wait complete. 2024-09-11T22:05:04.495 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:04 smithi152 ceph-mon[31188]: pgmap v26: 97 pgs: 97 active+clean; 94 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 9.3 MiB/s wr, 359 op/s 2024-09-11T22:05:04.495 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:04 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1155658416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:04.565 INFO:teuthology.orchestra.run.smithi152.stderr:400000 of 3200000 tuples (12%) done (elapsed 4.24 s, remaining 29.70 s) 2024-09-11T22:05:04.713 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:04 smithi179 ceph-mon[35603]: pgmap v26: 97 pgs: 97 active+clean; 94 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 9.3 MiB/s wr, 359 op/s 2024-09-11T22:05:04.713 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:04 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1155658416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:04.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:04 smithi193 ceph-mon[35545]: pgmap v26: 97 pgs: 97 active+clean; 94 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 9.3 MiB/s wr, 359 op/s 2024-09-11T22:05:04.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:04 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1155658416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.831+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2054079210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf8109c10 msgr2=0x7f3cf81160f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.831+0000 7f3cff1a8640 1 --2- 172.21.15.152:0/2054079210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf8109c10 0x7f3cf81160f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009ca0 tx=0x7f3cf002a950 comp rx=0 tx=0).stop 2024-09-11T22:05:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.831+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2054079210 shutdown_connections 2024-09-11T22:05:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.831+0000 7f3cff1a8640 1 --2- 172.21.15.152:0/2054079210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf8109c10 0x7f3cf81160f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.831+0000 7f3cff1a8640 1 --2- 172.21.15.152:0/2054079210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cf8109290 0x7f3cf81096d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.831+0000 7f3cff1a8640 1 --2- 172.21.15.152:0/2054079210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf810f340 0x7f3cf810f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.831+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2054079210 >> 172.21.15.152:0/2054079210 conn(0x7f3cf806d650 msgr2=0x7f3cf806fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.831+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2054079210 shutdown_connections 2024-09-11T22:05:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.831+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2054079210 wait complete. 2024-09-11T22:05:04.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.831+0000 7f3cff1a8640 1 Processor -- start 2024-09-11T22:05:04.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cff1a8640 1 -- start start 2024-09-11T22:05:04.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cff1a8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cf8109290 0x7f3cf81a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cff1a8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf8109c10 0x7f3cf81a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cff1a8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf810f340 0x7f3cf81a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cff1a8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf8119620 con 0x7f3cf8109c10 2024-09-11T22:05:04.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cff1a8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf81194a0 con 0x7f3cf810f340 2024-09-11T22:05:04.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cff1a8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf81197a0 con 0x7f3cf8109290 2024-09-11T22:05:04.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf8109c10 0x7f3cf81a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cfcf44640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cf8109290 0x7f3cf81a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cfd745640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf810f340 0x7f3cf81a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cfcf44640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cf8109290 0x7f3cf81a67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:56332/0 (socket says 172.21.15.152:56332) 2024-09-11T22:05:04.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cfcf44640 1 -- 172.21.15.152:0/2189044659 learned_addr learned my addr 172.21.15.152:0/2189044659 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:04.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf8109c10 0x7f3cf81a6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52740/0 (socket says 172.21.15.152:52740) 2024-09-11T22:05:04.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cfcf44640 1 -- 172.21.15.152:0/2189044659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf810f340 msgr2=0x7f3cf81a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf810f340 0x7f3cf81a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cfcf44640 1 -- 172.21.15.152:0/2189044659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf8109c10 msgr2=0x7f3cf81a6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf8109c10 0x7f3cf81a6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.832+0000 7f3cfcf44640 1 -- 172.21.15.152:0/2189044659 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf81a1090 con 0x7f3cf8109290 2024-09-11T22:05:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.833+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cf8109290 0x7f3cf81a67a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009dd0 tx=0x7f3cec00d6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.833+0000 7f3cf5ffb640 1 -- 172.21.15.152:0/2189044659 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec004020 con 0x7f3cf8109290 2024-09-11T22:05:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.833+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2189044659 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf81a1380 con 0x7f3cf8109290 2024-09-11T22:05:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.833+0000 7f3cf5ffb640 1 -- 172.21.15.152:0/2189044659 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cec0041c0 con 0x7f3cf8109290 2024-09-11T22:05:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.833+0000 7f3cf5ffb640 1 -- 172.21.15.152:0/2189044659 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec00f740 con 0x7f3cf8109290 2024-09-11T22:05:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.833+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2189044659 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf810ae70 con 0x7f3cf8109290 2024-09-11T22:05:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.835+0000 7f3cf5ffb640 1 -- 172.21.15.152:0/2189044659 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7f3cec0035f0 con 0x7f3cf8109290 2024-09-11T22:05:04.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.836+0000 7f3cf5ffb640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2ea0 0x7f3ce80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.836+0000 7f3d01581740 1 Processor -- start 2024-09-11T22:05:04.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.836+0000 7f3d01581740 1 -- start start 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.836+0000 7f3cf7fff640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2ea0 0x7f3ce80a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.836+0000 7f3cf5ffb640 1 -- 172.21.15.152:0/2189044659 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3cec0cf5a0 con 0x7f3cf8109290 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.836+0000 7f3d01581740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd843090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3d01581740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd843a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3d01581740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd84e370 0x563fdd850760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3d01581740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563fdd7a92f0 con 0x563fdd8435d0 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3d01581740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563fdd750cf0 con 0x563fdd844b40 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3d01581740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563fdd7a52b0 con 0x563fdd84e370 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cfcf44640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd843090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cfcf44640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd843090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:45756/0 (socket says 172.21.15.152:45756) 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cfcf44640 1 -- 172.21.15.152:0/1014215905 learned_addr learned my addr 172.21.15.152:0/1014215905 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:04.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cfd745640 1 --2- 172.21.15.152:0/1014215905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd84e370 0x563fdd850760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cf7fff640 1 --2- 172.21.15.152:0/1014215905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd843a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cfcf44640 1 -- 172.21.15.152:0/1014215905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd84e370 msgr2=0x563fdd850760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/1014215905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd84e370 0x563fdd850760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cfcf44640 1 -- 172.21.15.152:0/1014215905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 msgr2=0x563fdd843a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/1014215905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd843a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cfcf44640 1 -- 172.21.15.152:0/1014215905 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fdd7353a0 con 0x563fdd844b40 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cf7fff640 1 --2- 172.21.15.152:0/1014215905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd843a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cf7fff640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2ea0 0x7f3ce80a5360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40095f0 tx=0x7f3ce4005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/1014215905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd843090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0ccb70 tx=0x7f3cec09b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eef77605b51418e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3ce2ffd640 1 -- 172.21.15.152:0/1014215905 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec01e040 con 0x563fdd844b40 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.837+0000 7f3ce2ffd640 1 -- 172.21.15.152:0/1014215905 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cec0a44c0 con 0x563fdd844b40 2024-09-11T22:05:04.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.838+0000 7f3ce2ffd640 1 -- 172.21.15.152:0/1014215905 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0a4030 con 0x563fdd844b40 2024-09-11T22:05:04.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.838+0000 7f3d01581740 1 -- 172.21.15.152:0/1014215905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 msgr2=0x563fdd843090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.838+0000 7f3d01581740 1 --2- 172.21.15.152:0/1014215905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd843090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0ccb70 tx=0x7f3cec09b260 comp rx=0 tx=0).stop 2024-09-11T22:05:04.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.838+0000 7f3d01581740 1 -- 172.21.15.152:0/1014215905 shutdown_connections 2024-09-11T22:05:04.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.838+0000 7f3d01581740 1 --2- 172.21.15.152:0/1014215905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd84e370 0x563fdd850760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.838+0000 7f3d01581740 1 --2- 172.21.15.152:0/1014215905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd843a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.838+0000 7f3d01581740 1 --2- 172.21.15.152:0/1014215905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd843090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.838+0000 7f3d01581740 1 -- 172.21.15.152:0/1014215905 >> 172.21.15.152:0/1014215905 conn(0x563fdd80c310 msgr2=0x563fdd83fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:04.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.839+0000 7f3d01581740 1 -- 172.21.15.152:0/1014215905 shutdown_connections 2024-09-11T22:05:04.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.839+0000 7f3d01581740 1 -- 172.21.15.152:0/1014215905 wait complete. 2024-09-11T22:05:04.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.839+0000 7f3d01581740 1 -- start start 2024-09-11T22:05:04.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.839+0000 7f3d01581740 1 Processor -- start 2024-09-11T22:05:04.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3d01581740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd8435d0 0x563fdd84ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3d01581740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd84b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3d01581740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd84e370 0x563fdd84b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3d01581740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563fdd851070 con 0x563fdd84e370 2024-09-11T22:05:04.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3d01581740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563fdd764060 con 0x563fdd844b40 2024-09-11T22:05:04.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3d01581740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563fdd8511f0 con 0x563fdd8435d0 2024-09-11T22:05:04.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3d01581740 10 client.0 _ll_register_callbacks cb 0x563fdd4b78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:04.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cfcf44640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd8435d0 0x563fdd84ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd84b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cfcf44640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd8435d0 0x563fdd84ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:56346/0 (socket says 172.21.15.152:56346) 2024-09-11T22:05:04.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cfcf44640 1 -- 172.21.15.152:0/298973271 learned_addr learned my addr 172.21.15.152:0/298973271 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:04.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cfcf44640 1 -- 172.21.15.152:0/298973271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 msgr2=0x563fdd84b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:04.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd84b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cfcf44640 1 -- 172.21.15.152:0/298973271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd84e370 msgr2=0x563fdd84b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:04.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cfd745640 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd84e370 0x563fdd84b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd84e370 0x563fdd84b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cfcf44640 1 -- 172.21.15.152:0/298973271 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fdd51a3c0 con 0x563fdd8435d0 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cfd745640 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd84e370 0x563fdd84b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd8435d0 0x563fdd84ddd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0a3f90 tx=0x7f3cec09fcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8247a0ffd0199988 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.840+0000 7f3cd7fff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.841+0000 7f3cd7fff640 1 -- 172.21.15.152:0/298973271 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0b9060 con 0x563fdd8435d0 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.841+0000 7f3cd7fff640 1 -- 172.21.15.152:0/298973271 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3cec0861c0 con 0x563fdd8435d0 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.841+0000 7f3d01581740 1 -- 172.21.15.152:0/298973271 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cec0a44c0 con 0x563fdd8435d0 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.841+0000 7f3cd7fff640 1 -- 172.21.15.152:0/298973271 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3cec0b3030 con 0x563fdd8435d0 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.841+0000 7f3d01581740 10 client.25195 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.841+0000 7f3d01581740 1 -- 172.21.15.152:0/298973271 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563fdd851070 con 0x563fdd8435d0 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.841+0000 7f3cd7fff640 1 -- 172.21.15.152:0/298973271 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cec0ba260 con 0x563fdd8435d0 2024-09-11T22:05:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.841+0000 7f3cd7fff640 1 -- 172.21.15.152:0/298973271 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f3cec09ad50 con 0x563fdd8435d0 2024-09-11T22:05:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.842+0000 7f3d01581740 10 client.25195 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.842+0000 7f3d01581740 10 client.25195 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:05:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.842+0000 7f3d01581740 20 client.25195 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.842+0000 7f3d01581740 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563fdd85dc80 0x563fdd860070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.842+0000 7f3d01581740 4 client.25195 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.842+0000 7f3d01581740 1 -- 172.21.15.152:0/298973271 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3cec0a44c0 con 0x563fdd85dc80 2024-09-11T22:05:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.842+0000 7f3cf7fff640 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563fdd85dc80 0x563fdd860070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.842+0000 7f3cf7fff640 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563fdd85dc80 0x563fdd860070 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a73b9003d1ec243d server_cookie=4be9f462a9b06070 in_seq=0 out_seq=0 2024-09-11T22:05:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.842+0000 7f3cd7fff640 10 client.25195 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:05:04.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.843+0000 7f3cd7fff640 1 -- 172.21.15.152:0/298973271 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3cec0a44c0 con 0x563fdd85dc80 2024-09-11T22:05:04.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.843+0000 7f3cd7fff640 10 client.25195 handle_command_reply: tid=0 2024-09-11T22:05:04.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.843+0000 7f3d01581740 1 client.25195 shutdown 2024-09-11T22:05:04.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.843+0000 7f3d01581740 1 -- 172.21.15.152:0/298973271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd8435d0 msgr2=0x563fdd84ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.843+0000 7f3d01581740 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd8435d0 0x563fdd84ddd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0a3f90 tx=0x7f3cec09fcc0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.844+0000 7f3d01581740 1 -- 172.21.15.152:0/298973271 shutdown_connections 2024-09-11T22:05:04.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.844+0000 7f3d01581740 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563fdd85dc80 0x563fdd860070 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.844+0000 7f3d01581740 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd84e370 0x563fdd84b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.844+0000 7f3cd7fff640 0 client.25195 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:05:04.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.844+0000 7f3d01581740 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd84b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.844+0000 7f3d01581740 1 --2- 172.21.15.152:0/298973271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd8435d0 0x563fdd84ddd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.844+0000 7f3d01581740 1 -- 172.21.15.152:0/298973271 >> 172.21.15.152:0/298973271 conn(0x563fdd80c310 msgr2=0x563fdd8459c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:04.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.844+0000 7f3d01581740 1 -- 172.21.15.152:0/298973271 shutdown_connections 2024-09-11T22:05:04.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.844+0000 7f3d01581740 1 -- 172.21.15.152:0/298973271 wait complete. 2024-09-11T22:05:04.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.844+0000 7f3d01581740 20 client.25195 trim_cache size 0 max 16384 2024-09-11T22:05:04.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.858+0000 7f3d01581740 1 Processor -- start 2024-09-11T22:05:04.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.858+0000 7f3d01581740 1 -- start start 2024-09-11T22:05:04.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.858+0000 7f3d01581740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd84a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3d01581740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd865700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3d01581740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd84e370 0x563fdd865c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3d01581740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf81b68b0 con 0x563fdd8435d0 2024-09-11T22:05:04.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3d01581740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf81b4150 con 0x563fdd844b40 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3d01581740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf81b1fa0 con 0x563fdd84e370 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cfcf44640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd84a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd865700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cfcf44640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd84a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52770/0 (socket says 172.21.15.152:52770) 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cfd745640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd84e370 0x563fdd865c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cfcf44640 1 -- 172.21.15.152:0/2160481650 learned_addr learned my addr 172.21.15.152:0/2160481650 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cfcf44640 1 -- 172.21.15.152:0/2160481650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd84e370 msgr2=0x563fdd865c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/2160481650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd84e370 0x563fdd865c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cfcf44640 1 -- 172.21.15.152:0/2160481650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 msgr2=0x563fdd865700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/2160481650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd865700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cfcf44640 1 -- 172.21.15.152:0/2160481650 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fdd83e310 con 0x563fdd8435d0 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cfd745640 1 --2- 172.21.15.152:0/2160481650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd84e370 0x563fdd865c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cf7fff640 1 --2- 172.21.15.152:0/2160481650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd865700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:04.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/2160481650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd84a060 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00dbb0 tx=0x7f3cec09b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bebee458d53748 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:04.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.859+0000 7f3ce27fc640 1 -- 172.21.15.152:0/2160481650 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0b9070 con 0x563fdd8435d0 2024-09-11T22:05:04.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.860+0000 7f3ce27fc640 1 -- 172.21.15.152:0/2160481650 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cec0a44c0 con 0x563fdd8435d0 2024-09-11T22:05:04.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.860+0000 7f3ce27fc640 1 -- 172.21.15.152:0/2160481650 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec01e040 con 0x563fdd8435d0 2024-09-11T22:05:04.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.860+0000 7f3d01581740 1 -- 172.21.15.152:0/2160481650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 msgr2=0x563fdd84a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.860+0000 7f3d01581740 1 --2- 172.21.15.152:0/2160481650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd84a060 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00dbb0 tx=0x7f3cec09b260 comp rx=0 tx=0).stop 2024-09-11T22:05:04.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.860+0000 7f3d01581740 1 -- 172.21.15.152:0/2160481650 shutdown_connections 2024-09-11T22:05:04.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.860+0000 7f3d01581740 1 --2- 172.21.15.152:0/2160481650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd84e370 0x563fdd865c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.860+0000 7f3d01581740 1 --2- 172.21.15.152:0/2160481650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd844b40 0x563fdd865700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.860+0000 7f3d01581740 1 --2- 172.21.15.152:0/2160481650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd84a060 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.860+0000 7f3d01581740 1 -- 172.21.15.152:0/2160481650 >> 172.21.15.152:0/2160481650 conn(0x563fdd80c310 msgr2=0x563fdd849950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.860+0000 7f3d01581740 1 -- 172.21.15.152:0/2160481650 shutdown_connections 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.860+0000 7f3d01581740 1 -- 172.21.15.152:0/2160481650 wait complete. 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.861+0000 7f3d01581740 1 -- start start 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.861+0000 7f3d01581740 1 Processor -- start 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.861+0000 7f3d01581740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd856b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.861+0000 7f3d01581740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd844b40 0x563fdd851e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.861+0000 7f3d01581740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd84e370 0x563fdd852370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.861+0000 7f3d01581740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf81b2610 con 0x563fdd8435d0 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.861+0000 7f3d01581740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf81b3a80 con 0x563fdd84e370 2024-09-11T22:05:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.861+0000 7f3d01581740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf81b2ce0 con 0x563fdd844b40 2024-09-11T22:05:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.861+0000 7f3d01581740 10 client.0 _ll_register_callbacks cb 0x7f3ce4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.861+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd844b40 0x563fdd851e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd844b40 0x563fdd851e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:56366/0 (socket says 172.21.15.152:56366) 2024-09-11T22:05:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cf7fff640 1 -- 172.21.15.152:0/4151189969 learned_addr learned my addr 172.21.15.152:0/4151189969 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd856b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cf7fff640 1 -- 172.21.15.152:0/4151189969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd84e370 msgr2=0x563fdd852370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:05:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cf7fff640 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd84e370 0x563fdd852370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cf7fff640 1 -- 172.21.15.152:0/4151189969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 msgr2=0x563fdd856b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cf7fff640 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd856b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cf7fff640 1 -- 172.21.15.152:0/4151189969 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fdd852a60 con 0x563fdd844b40 2024-09-11T22:05:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd856b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cf7fff640 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd844b40 0x563fdd851e30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3ce401f000 tx=0x7f3ce401e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61c0500c2a8ef3fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cd7fff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cd7fff640 1 -- 172.21.15.152:0/4151189969 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4003d00 con 0x563fdd844b40 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3cd7fff640 1 -- 172.21.15.152:0/4151189969 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3ce401d040 con 0x563fdd844b40 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.862+0000 7f3d01581740 1 -- 172.21.15.152:0/4151189969 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cec0a44c0 con 0x563fdd844b40 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.863+0000 7f3cd7fff640 1 -- 172.21.15.152:0/4151189969 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3ce4003ea0 con 0x563fdd844b40 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.863+0000 7f3d01581740 10 client.25201 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.863+0000 7f3d01581740 1 -- 172.21.15.152:0/4151189969 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563fdd8c8620 con 0x563fdd844b40 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.863+0000 7f3cd7fff640 1 -- 172.21.15.152:0/4151189969 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cec0a44c0 con 0x563fdd844b40 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.864+0000 7f3cd7fff640 1 -- 172.21.15.152:0/4151189969 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f3ce4021050 con 0x563fdd844b40 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.864+0000 7f3d01581740 10 client.25201 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.864+0000 7f3d01581740 10 client.25201 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:05:04.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.864+0000 7f3d01581740 20 client.25201 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.864+0000 7f3d01581740 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563fdd8c8e00 0x563fdd8cb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.864+0000 7f3d01581740 4 client.25201 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.864+0000 7f3d01581740 1 -- 172.21.15.152:0/4151189969 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563fdd7b6860 con 0x563fdd8c8e00 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.864+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563fdd8c8e00 0x563fdd8cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3cfcf44640 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563fdd8c8e00 0x563fdd8cb220 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=28710f1f8b6c2a63 server_cookie=66b79577a28f0ca6 in_seq=0 out_seq=0 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3cd7fff640 10 client.25201 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3cd7fff640 1 -- 172.21.15.152:0/4151189969 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563fdd7b6860 con 0x563fdd8c8e00 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3cd7fff640 10 client.25201 handle_command_reply: tid=0 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3d01581740 1 client.25201 shutdown 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3d01581740 1 -- 172.21.15.152:0/4151189969 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd844b40 msgr2=0x563fdd851e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3d01581740 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd844b40 0x563fdd851e30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3ce401f000 tx=0x7f3ce401e000 comp rx=0 tx=0).stop 2024-09-11T22:05:04.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3d01581740 1 -- 172.21.15.152:0/4151189969 shutdown_connections 2024-09-11T22:05:04.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3d01581740 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563fdd8c8e00 0x563fdd8cb220 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3d01581740 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563fdd84e370 0x563fdd852370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3d01581740 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563fdd844b40 0x563fdd851e30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3cd7fff640 0 client.25201 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:05:04.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3d01581740 1 --2- 172.21.15.152:0/4151189969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563fdd8435d0 0x563fdd856b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3d01581740 1 -- 172.21.15.152:0/4151189969 >> 172.21.15.152:0/4151189969 conn(0x563fdd80c310 msgr2=0x563fdd84a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:04.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3d01581740 1 -- 172.21.15.152:0/4151189969 shutdown_connections 2024-09-11T22:05:04.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.865+0000 7f3d01581740 1 -- 172.21.15.152:0/4151189969 wait complete. 2024-09-11T22:05:04.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.866+0000 7f3d01581740 20 client.25201 trim_cache size 0 max 16384 2024-09-11T22:05:04.871 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:05:04.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.866+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2189044659 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2ea0 msgr2=0x7f3ce80a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.866+0000 7f3cff1a8640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2ea0 0x7f3ce80a5360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40095f0 tx=0x7f3ce4005f90 comp rx=0 tx=0).stop 2024-09-11T22:05:04.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.866+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2189044659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cf8109290 msgr2=0x7f3cf81a67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:04.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.866+0000 7f3cff1a8640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cf8109290 0x7f3cf81a67a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009dd0 tx=0x7f3cec00d6b0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.867+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2189044659 shutdown_connections 2024-09-11T22:05:04.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.867+0000 7f3cff1a8640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2ea0 0x7f3ce80a5360 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.867+0000 7f3cff1a8640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf810f340 0x7f3cf81a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.867+0000 7f3cff1a8640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf8109c10 0x7f3cf81a6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.867+0000 7f3cff1a8640 1 --2- 172.21.15.152:0/2189044659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cf8109290 0x7f3cf81a67a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:04.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.867+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2189044659 >> 172.21.15.152:0/2189044659 conn(0x7f3cf806d650 msgr2=0x7f3cf806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:04.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.867+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2189044659 shutdown_connections 2024-09-11T22:05:04.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:04.867+0000 7f3cff1a8640 1 -- 172.21.15.152:0/2189044659 wait complete. 2024-09-11T22:05:05.271 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-11T22:05:05.271 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-11T22:05:05.630 INFO:teuthology.orchestra.run.smithi152.stderr:500000 of 3200000 tuples (15%) done (elapsed 5.31 s, remaining 28.67 s) 2024-09-11T22:05:05.736 INFO:teuthology.orchestra.run.smithi152.stderr:600000 of 3200000 tuples (18%) done (elapsed 5.42 s, remaining 23.47 s) 2024-09-11T22:05:05.914 INFO:teuthology.orchestra.run.smithi152.stderr:700000 of 3200000 tuples (21%) done (elapsed 5.59 s, remaining 19.98 s) 2024-09-11T22:05:05.978 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:05:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:06.118 INFO:teuthology.orchestra.run.smithi152.stderr:800000 of 3200000 tuples (25%) done (elapsed 5.80 s, remaining 17.39 s) 2024-09-11T22:05:06.224 INFO:teuthology.orchestra.run.smithi152.stderr:900000 of 3200000 tuples (28%) done (elapsed 5.90 s, remaining 15.09 s) 2024-09-11T22:05:06.411 INFO:teuthology.orchestra.run.smithi152.stderr:1000000 of 3200000 tuples (31%) done (elapsed 6.09 s, remaining 13.40 s) 2024-09-11T22:05:06.555 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:06 smithi152 ceph-mon[31188]: pgmap v27: 97 pgs: 97 active+clean; 94 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 9.2 MiB/s wr, 347 op/s 2024-09-11T22:05:06.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.566+0000 7f15988a1640 1 -- 172.21.15.152:0/4259999366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15941027a0 msgr2=0x7f15941067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:06.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.566+0000 7f15988a1640 1 --2- 172.21.15.152:0/4259999366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15941027a0 0x7f15941067f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1588009900 tx=0x7f158802a410 comp rx=0 tx=0).stop 2024-09-11T22:05:06.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.566+0000 7f15988a1640 1 -- 172.21.15.152:0/4259999366 shutdown_connections 2024-09-11T22:05:06.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.566+0000 7f15988a1640 1 --2- 172.21.15.152:0/4259999366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1594106f20 0x7f159410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.566+0000 7f15988a1640 1 --2- 172.21.15.152:0/4259999366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15941027a0 0x7f15941067f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.566+0000 7f15988a1640 1 --2- 172.21.15.152:0/4259999366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1594101df0 0x7f15941021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.566+0000 7f15988a1640 1 -- 172.21.15.152:0/4259999366 >> 172.21.15.152:0/4259999366 conn(0x7f15940fd8f0 msgr2=0x7f15940ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:06.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.566+0000 7f15988a1640 1 -- 172.21.15.152:0/4259999366 shutdown_connections 2024-09-11T22:05:06.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.566+0000 7f15988a1640 1 -- 172.21.15.152:0/4259999366 wait complete. 2024-09-11T22:05:06.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.567+0000 7f15988a1640 1 Processor -- start 2024-09-11T22:05:06.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.567+0000 7f15988a1640 1 -- start start 2024-09-11T22:05:06.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.567+0000 7f15988a1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1594101df0 0x7f1594073a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.567+0000 7f15988a1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15941027a0 0x7f159406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.567+0000 7f15988a1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1594106f20 0x7f159406d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.567+0000 7f15988a1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1594111f40 con 0x7f1594106f20 2024-09-11T22:05:06.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.567+0000 7f15988a1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1594111dc0 con 0x7f15941027a0 2024-09-11T22:05:06.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.567+0000 7f15988a1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15941120c0 con 0x7f1594101df0 2024-09-11T22:05:06.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f1591d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15941027a0 0x7f159406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f159259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1594101df0 0x7f1594073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f1591d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15941027a0 0x7f159406cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:45814/0 (socket says 172.21.15.152:45814) 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f1591d9b640 1 -- 172.21.15.152:0/3070479452 learned_addr learned my addr 172.21.15.152:0/3070479452 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f1592d9d640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1594106f20 0x7f159406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f1591d9b640 1 -- 172.21.15.152:0/3070479452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1594101df0 msgr2=0x7f1594073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f1591d9b640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1594101df0 0x7f1594073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f1591d9b640 1 -- 172.21.15.152:0/3070479452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1594106f20 msgr2=0x7f159406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f1591d9b640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1594106f20 0x7f159406d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f1591d9b640 1 -- 172.21.15.152:0/3070479452 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159406d650 con 0x7f15941027a0 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f1591d9b640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15941027a0 0x7f159406cad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1588006010 tx=0x7f15880042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.568+0000 7f15837fe640 1 -- 172.21.15.152:0/3070479452 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158803f030 con 0x7f15941027a0 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.569+0000 7f15837fe640 1 -- 172.21.15.152:0/3070479452 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1588003ce0 con 0x7f15941027a0 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.569+0000 7f15837fe640 1 -- 172.21.15.152:0/3070479452 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588035070 con 0x7f15941027a0 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.569+0000 7f15988a1640 1 -- 172.21.15.152:0/3070479452 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159406d8e0 con 0x7f15941027a0 2024-09-11T22:05:06.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.569+0000 7f15988a1640 1 -- 172.21.15.152:0/3070479452 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1594071800 con 0x7f15941027a0 2024-09-11T22:05:06.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.571+0000 7f15837fe640 1 -- 172.21.15.152:0/3070479452 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7f1588042030 con 0x7f15941027a0 2024-09-11T22:05:06.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.571+0000 7f159ac7a740 1 Processor -- start 2024-09-11T22:05:06.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.572+0000 7f159ac7a740 1 -- start start 2024-09-11T22:05:06.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.572+0000 7f159ac7a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de836760 0x5580de836b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.572+0000 7f1592d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de836760 0x5580de836b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.572+0000 7f15837fe640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f157c0a2f20 0x7f157c0a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.572+0000 7f1592d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de836760 0x5580de836b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:45820/0 (socket says 172.21.15.152:45820) 2024-09-11T22:05:06.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.573+0000 7f1591d9b640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f157c0a2f20 0x7f157c0a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.572+0000 7f159ac7a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de837080 0x5580de841400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.573+0000 7f15837fe640 1 -- 172.21.15.152:0/3070479452 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f15880ef8b0 con 0x7f15941027a0 2024-09-11T22:05:06.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.573+0000 7f1592d9d640 1 -- 172.21.15.152:0/580989356 learned_addr learned my addr 172.21.15.152:0/580989356 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:06.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.573+0000 7f159259c640 1 --2- 172.21.15.152:0/580989356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de837080 0x5580de841400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.574+0000 7f159ac7a740 1 --2- 172.21.15.152:0/580989356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de841940 0x5580de843d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.574+0000 7f159ac7a740 1 -- 172.21.15.152:0/580989356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5580de79c2a0 con 0x5580de841940 2024-09-11T22:05:06.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.574+0000 7f159ac7a740 1 -- 172.21.15.152:0/580989356 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5580de743b10 con 0x5580de836760 2024-09-11T22:05:06.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.574+0000 7f159ac7a740 1 -- 172.21.15.152:0/580989356 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5580de798260 con 0x5580de837080 2024-09-11T22:05:06.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.574+0000 7f1591d9b640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f157c0a2f20 0x7f157c0a53e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15880ecdf0 tx=0x7f158808bb40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:06.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.574+0000 7f1592d9d640 1 --2- 172.21.15.152:0/580989356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de841940 0x5580de843d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.574+0000 7f159259c640 1 -- 172.21.15.152:0/580989356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de836760 msgr2=0x5580de836b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:06.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.574+0000 7f159259c640 1 --2- 172.21.15.152:0/580989356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de836760 0x5580de836b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.575+0000 7f159259c640 1 -- 172.21.15.152:0/580989356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de841940 msgr2=0x5580de843d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:06.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.575+0000 7f159259c640 1 --2- 172.21.15.152:0/580989356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de841940 0x5580de843d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.575+0000 7f159259c640 1 -- 172.21.15.152:0/580989356 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580de50db90 con 0x5580de837080 2024-09-11T22:05:06.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.575+0000 7f1592d9d640 1 --2- 172.21.15.152:0/580989356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de841940 0x5580de843d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:06.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.575+0000 7f159259c640 1 --2- 172.21.15.152:0/580989356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de837080 0x5580de841400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f158400dbe0 tx=0x7f158400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c4c50de3b719a7f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:06.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.575+0000 7f1580ff9640 1 -- 172.21.15.152:0/580989356 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584005020 con 0x5580de837080 2024-09-11T22:05:06.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.575+0000 7f1580ff9640 1 -- 172.21.15.152:0/580989356 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15840047a0 con 0x5580de837080 2024-09-11T22:05:06.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.575+0000 7f1580ff9640 1 -- 172.21.15.152:0/580989356 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840116a0 con 0x5580de837080 2024-09-11T22:05:06.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.576+0000 7f159ac7a740 1 -- 172.21.15.152:0/580989356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de837080 msgr2=0x5580de841400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:06.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.576+0000 7f159ac7a740 1 --2- 172.21.15.152:0/580989356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de837080 0x5580de841400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f158400dbe0 tx=0x7f158400f730 comp rx=0 tx=0).stop 2024-09-11T22:05:06.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.577+0000 7f159ac7a740 1 -- 172.21.15.152:0/580989356 shutdown_connections 2024-09-11T22:05:06.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.577+0000 7f159ac7a740 1 --2- 172.21.15.152:0/580989356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de841940 0x5580de843d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.577+0000 7f159ac7a740 1 --2- 172.21.15.152:0/580989356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de837080 0x5580de841400 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.577+0000 7f159ac7a740 1 --2- 172.21.15.152:0/580989356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de836760 0x5580de836b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.577+0000 7f159ac7a740 1 -- 172.21.15.152:0/580989356 >> 172.21.15.152:0/580989356 conn(0x5580de832cf0 msgr2=0x5580de8330d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:06.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.577+0000 7f159ac7a740 1 -- 172.21.15.152:0/580989356 shutdown_connections 2024-09-11T22:05:06.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.577+0000 7f159ac7a740 1 -- 172.21.15.152:0/580989356 wait complete. 2024-09-11T22:05:06.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.577+0000 7f159ac7a740 1 -- start start 2024-09-11T22:05:06.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.577+0000 7f159ac7a740 1 Processor -- start 2024-09-11T22:05:06.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159ac7a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de83e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159ac7a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159ac7a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159ac7a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5580de844510 con 0x5580de837080 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159ac7a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5580de7246e0 con 0x5580de841940 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159ac7a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5580de844690 con 0x5580de836760 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52816/0 (socket says 172.21.15.152:52816) 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159259c640 1 -- 172.21.15.152:0/4195732843 learned_addr learned my addr 172.21.15.152:0/4195732843 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f1592d9d640 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de83e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159ac7a740 10 client.0 _ll_register_callbacks cb 0x5580de748a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159259c640 1 -- 172.21.15.152:0/4195732843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 msgr2=0x5580de83e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159259c640 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de83e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f159259c640 1 -- 172.21.15.152:0/4195732843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 msgr2=0x5580de83f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.578+0000 7f1592d9d640 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.579+0000 7f159259c640 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.579+0000 7f159259c640 1 -- 172.21.15.152:0/4195732843 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580de84da30 con 0x5580de837080 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.579+0000 7f1592d9d640 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.579+0000 7f159259c640 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83ed90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f158400d370 tx=0x7f158400df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68704f6fa953087 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.579+0000 7f1579ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.579+0000 7f1579ffb640 1 -- 172.21.15.152:0/4195732843 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584004be0 con 0x5580de837080 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.579+0000 7f1579ffb640 1 -- 172.21.15.152:0/4195732843 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1584004030 con 0x5580de837080 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.579+0000 7f159ac7a740 1 -- 172.21.15.152:0/4195732843 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15840047a0 con 0x5580de837080 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.579+0000 7f1579ffb640 1 -- 172.21.15.152:0/4195732843 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1584004230 con 0x5580de837080 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.579+0000 7f159ac7a740 10 client.15528 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.579+0000 7f159ac7a740 1 -- 172.21.15.152:0/4195732843 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5580de8503a0 con 0x5580de837080 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.580+0000 7f1579ffb640 1 -- 172.21.15.152:0/4195732843 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15840047a0 con 0x5580de837080 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.580+0000 7f1579ffb640 1 -- 172.21.15.152:0/4195732843 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f15840038f0 con 0x5580de837080 2024-09-11T22:05:06.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.580+0000 7f159ac7a740 10 client.15528 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:06.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.580+0000 7f159ac7a740 10 client.15528 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:05:06.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.580+0000 7f159ac7a740 20 client.15528 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:06.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.580+0000 7f159ac7a740 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5580de8517b0 0x5580de853ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.580+0000 7f159ac7a740 4 client.15528 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:06.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.580+0000 7f159ac7a740 1 -- 172.21.15.152:0/4195732843 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580de7a99d0 con 0x5580de8517b0 2024-09-11T22:05:06.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.580+0000 7f1592d9d640 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5580de8517b0 0x5580de853ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.580+0000 7f1579ffb640 10 client.15528 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:06.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.580+0000 7f1592d9d640 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5580de8517b0 0x5580de853ba0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78c33441cc2ca532 server_cookie=b7aa8efd5e7bd75d in_seq=0 out_seq=0 2024-09-11T22:05:06.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f1579ffb640 1 -- 172.21.15.152:0/4195732843 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5580de7a99d0 con 0x5580de8517b0 2024-09-11T22:05:06.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f1579ffb640 10 client.15528 handle_command_reply: tid=0 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 1 client.15528 shutdown 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 1 -- 172.21.15.152:0/4195732843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 msgr2=0x5580de83ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83ed90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f158400d370 tx=0x7f158400df00 comp rx=0 tx=0).stop 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 1 -- 172.21.15.152:0/4195732843 shutdown_connections 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5580de8517b0 0x5580de853ba0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f1579ffb640 0 client.15528 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83ed90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 1 --2- 172.21.15.152:0/4195732843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de83e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 1 -- 172.21.15.152:0/4195732843 >> 172.21.15.152:0/4195732843 conn(0x5580de832cf0 msgr2=0x5580de831e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 1 -- 172.21.15.152:0/4195732843 shutdown_connections 2024-09-11T22:05:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 1 -- 172.21.15.152:0/4195732843 wait complete. 2024-09-11T22:05:06.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.582+0000 7f159ac7a740 20 client.15528 trim_cache size 0 max 16384 2024-09-11T22:05:06.591 INFO:teuthology.orchestra.run.smithi152.stderr:1100000 of 3200000 tuples (34%) done (elapsed 6.27 s, remaining 11.97 s) 2024-09-11T22:05:06.599 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:06.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.600+0000 7f159ac7a740 1 Processor -- start 2024-09-11T22:05:06.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.600+0000 7f159ac7a740 1 -- start start 2024-09-11T22:05:06.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.600+0000 7f159ac7a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de8593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.600+0000 7f159ac7a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de8598f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.600+0000 7f159ac7a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.600+0000 7f159ac7a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f15941bad40 con 0x5580de837080 2024-09-11T22:05:06.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.600+0000 7f159ac7a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b85e0 con 0x5580de841940 2024-09-11T22:05:06.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.600+0000 7f159ac7a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b6430 con 0x5580de836760 2024-09-11T22:05:06.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.600+0000 7f159259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de8598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.600+0000 7f159259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de8598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52830/0 (socket says 172.21.15.152:52830) 2024-09-11T22:05:06.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.600+0000 7f159259c640 1 -- 172.21.15.152:0/1266183444 learned_addr learned my addr 172.21.15.152:0/1266183444 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:06.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f1592d9d640 1 --2- 172.21.15.152:0/1266183444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f1592d9d640 1 --2- 172.21.15.152:0/1266183444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de8593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f159259c640 1 -- 172.21.15.152:0/1266183444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 msgr2=0x5580de8593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:06.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f159259c640 1 --2- 172.21.15.152:0/1266183444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de8593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f159259c640 1 -- 172.21.15.152:0/1266183444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 msgr2=0x5580de83bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:06.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f159259c640 1 --2- 172.21.15.152:0/1266183444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f159259c640 1 -- 172.21.15.152:0/1266183444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580de82e260 con 0x5580de837080 2024-09-11T22:05:06.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f1592d9d640 1 --2- 172.21.15.152:0/1266183444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de8593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:06.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f159259c640 1 --2- 172.21.15.152:0/1266183444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de8598f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1584003d90 tx=0x7f158400df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1aa79aad7b40e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:06.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f157bfff640 1 -- 172.21.15.152:0/1266183444 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584003f80 con 0x5580de837080 2024-09-11T22:05:06.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f157bfff640 1 -- 172.21.15.152:0/1266183444 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1584003ad0 con 0x5580de837080 2024-09-11T22:05:06.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.601+0000 7f157bfff640 1 -- 172.21.15.152:0/1266183444 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158401bd30 con 0x5580de837080 2024-09-11T22:05:06.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.602+0000 7f159ac7a740 1 -- 172.21.15.152:0/1266183444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 msgr2=0x5580de8598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:06.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.602+0000 7f159ac7a740 1 --2- 172.21.15.152:0/1266183444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de8598f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1584003d90 tx=0x7f158400df70 comp rx=0 tx=0).stop 2024-09-11T22:05:06.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.602+0000 7f159ac7a740 1 -- 172.21.15.152:0/1266183444 shutdown_connections 2024-09-11T22:05:06.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.602+0000 7f159ac7a740 1 --2- 172.21.15.152:0/1266183444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.602+0000 7f159ac7a740 1 --2- 172.21.15.152:0/1266183444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de8598f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.602+0000 7f159ac7a740 1 --2- 172.21.15.152:0/1266183444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de8593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.602+0000 7f159ac7a740 1 -- 172.21.15.152:0/1266183444 >> 172.21.15.152:0/1266183444 conn(0x5580de832cf0 msgr2=0x5580de83d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:06.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.603+0000 7f159ac7a740 1 -- 172.21.15.152:0/1266183444 shutdown_connections 2024-09-11T22:05:06.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.603+0000 7f159ac7a740 1 -- 172.21.15.152:0/1266183444 wait complete. 2024-09-11T22:05:06.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.603+0000 7f159ac7a740 1 -- start start 2024-09-11T22:05:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.603+0000 7f159ac7a740 1 Processor -- start 2024-09-11T22:05:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.603+0000 7f159ac7a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de83b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.603+0000 7f159ac7a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.603+0000 7f159ac7a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.603+0000 7f159ac7a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b6aa0 con 0x5580de837080 2024-09-11T22:05:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.603+0000 7f159ac7a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b7f10 con 0x5580de841940 2024-09-11T22:05:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.603+0000 7f159ac7a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b7170 con 0x5580de836760 2024-09-11T22:05:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f159ac7a740 10 client.0 _ll_register_callbacks cb 0x7f158400da60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f159259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f159259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52834/0 (socket says 172.21.15.152:52834) 2024-09-11T22:05:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f159259c640 1 -- 172.21.15.152:0/3972798079 learned_addr learned my addr 172.21.15.152:0/3972798079 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:06.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f1592d9d640 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de83b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f159259c640 1 -- 172.21.15.152:0/3972798079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 msgr2=0x5580de83b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:06.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f159259c640 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de83b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f159259c640 1 -- 172.21.15.152:0/3972798079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 msgr2=0x5580de83c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:06.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f159259c640 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:06.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f159259c640 1 -- 172.21.15.152:0/3972798079 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580de8bb4b0 con 0x5580de837080 2024-09-11T22:05:06.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f159259c640 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83bf20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1584003e80 tx=0x7f158400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192e069dd4b11f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:06.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f1579ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:06.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f1579ffb640 1 -- 172.21.15.152:0/3972798079 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840035f0 con 0x5580de837080 2024-09-11T22:05:06.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f1579ffb640 1 -- 172.21.15.152:0/3972798079 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1584003790 con 0x5580de837080 2024-09-11T22:05:06.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.604+0000 7f159ac7a740 1 -- 172.21.15.152:0/3972798079 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1584003ad0 con 0x5580de837080 2024-09-11T22:05:06.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.605+0000 7f1579ffb640 1 -- 172.21.15.152:0/3972798079 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1584046050 con 0x5580de837080 2024-09-11T22:05:06.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.605+0000 7f159ac7a740 10 client.15534 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:06.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.605+0000 7f159ac7a740 1 -- 172.21.15.152:0/3972798079 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5580de8bc750 con 0x5580de837080 2024-09-11T22:05:06.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.605+0000 7f1579ffb640 1 -- 172.21.15.152:0/3972798079 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f158401bc30 con 0x5580de837080 2024-09-11T22:05:06.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.605+0000 7f1579ffb640 1 -- 172.21.15.152:0/3972798079 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f1584036020 con 0x5580de837080 2024-09-11T22:05:06.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.605+0000 7f159ac7a740 10 client.15534 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:06.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.605+0000 7f159ac7a740 10 client.15534 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:05:06.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.605+0000 7f159ac7a740 20 client.15534 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.605+0000 7f159ac7a740 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5580de8517b0 0x5580de8beee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.605+0000 7f159ac7a740 4 client.15534 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-11T22:05:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.605+0000 7f159ac7a740 1 -- 172.21.15.152:0/3972798079 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x7f1584003ad0 con 0x5580de8517b0 2024-09-11T22:05:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.606+0000 7f1592d9d640 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5580de8517b0 0x5580de8beee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.606+0000 7f1592d9d640 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5580de8517b0 0x5580de8beee0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=650f557f8f30a543 server_cookie=1c823363ddef65cd in_seq=0 out_seq=0 2024-09-11T22:05:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:06.606+0000 7f1579ffb640 10 client.15534 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:06.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:06 smithi179 ceph-mon[35603]: pgmap v27: 97 pgs: 97 active+clean; 94 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 9.2 MiB/s wr, 347 op/s 2024-09-11T22:05:06.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:06 smithi193 ceph-mon[35545]: pgmap v27: 97 pgs: 97 active+clean; 94 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 9.2 MiB/s wr, 347 op/s 2024-09-11T22:05:07.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.123+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2272000261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d0100e20 msgr2=0x7f98d0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.123+0000 7f98d7dc3640 1 --2- 172.21.15.152:0/2272000261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d0100e20 0x7f98d0101200 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009900 tx=0x7f98cc02a4a0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.123+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2272000261 shutdown_connections 2024-09-11T22:05:07.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.123+0000 7f98d7dc3640 1 --2- 172.21.15.152:0/2272000261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98d0102ef0 0x7f98d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.123+0000 7f98d7dc3640 1 --2- 172.21.15.152:0/2272000261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98d0102570 0x7f98d01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.123+0000 7f98d7dc3640 1 --2- 172.21.15.152:0/2272000261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d0100e20 0x7f98d0101200 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.123+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2272000261 >> 172.21.15.152:0/2272000261 conn(0x7f98d00fc7d0 msgr2=0x7f98d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:07.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.123+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2272000261 shutdown_connections 2024-09-11T22:05:07.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.123+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2272000261 wait complete. 2024-09-11T22:05:07.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d7dc3640 1 Processor -- start 2024-09-11T22:05:07.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d7dc3640 1 -- start start 2024-09-11T22:05:07.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d7dc3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d0100e20 0x7f98d0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d7dc3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98d0102570 0x7f98d0199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d7dc3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98d0102ef0 0x7f98d01a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d7dc3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0110fd0 con 0x7f98d0100e20 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d7dc3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0110e50 con 0x7f98d0102570 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d7dc3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0111150 con 0x7f98d0102ef0 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d5b5f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d0100e20 0x7f98d0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d5b5f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d0100e20 0x7f98d0199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52842/0 (socket says 172.21.15.152:52842) 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d5b5f640 1 -- 172.21.15.152:0/2697441348 learned_addr learned my addr 172.21.15.152:0/2697441348 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d6360640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98d0102ef0 0x7f98d01a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.124+0000 7f98d535e640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98d0102570 0x7f98d0199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.125+0000 7f98d6360640 1 -- 172.21.15.152:0/2697441348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98d0102570 msgr2=0x7f98d0199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.125+0000 7f98d6360640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98d0102570 0x7f98d0199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.125+0000 7f98d6360640 1 -- 172.21.15.152:0/2697441348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d0100e20 msgr2=0x7f98d0199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.125+0000 7f98d6360640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d0100e20 0x7f98d0199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.125+0000 7f98d6360640 1 -- 172.21.15.152:0/2697441348 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d01a48e0 con 0x7f98d0102ef0 2024-09-11T22:05:07.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.125+0000 7f98d6360640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98d0102ef0 0x7f98d01a43a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009fd0 tx=0x7f98c800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:07.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.125+0000 7f98c6ffd640 1 -- 172.21.15.152:0/2697441348 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c800ce20 con 0x7f98d0102ef0 2024-09-11T22:05:07.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.126+0000 7f98c6ffd640 1 -- 172.21.15.152:0/2697441348 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98c80137d0 con 0x7f98d0102ef0 2024-09-11T22:05:07.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.126+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2697441348 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d0197110 con 0x7f98d0102ef0 2024-09-11T22:05:07.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.126+0000 7f98c6ffd640 1 -- 172.21.15.152:0/2697441348 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c801ba70 con 0x7f98d0102ef0 2024-09-11T22:05:07.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.126+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2697441348 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d0197650 con 0x7f98d0102ef0 2024-09-11T22:05:07.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.128+0000 7f98c6ffd640 1 -- 172.21.15.152:0/2697441348 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7f98c801bcf0 con 0x7f98d0102ef0 2024-09-11T22:05:07.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.129+0000 7f98da19c740 1 Processor -- start 2024-09-11T22:05:07.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.129+0000 7f98da19c740 1 -- start start 2024-09-11T22:05:07.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.129+0000 7f98da19c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16eb40 0x55d47c16d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.129+0000 7f98da19c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 0x55d47c16da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.129+0000 7f98c6ffd640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f98bc0a2fa0 0x7f98bc0a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.129+0000 7f98da19c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 0x55d47c182f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.129+0000 7f98da19c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d47c0d32f0 con 0x55d47c16d5d0 2024-09-11T22:05:07.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.129+0000 7f98da19c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d47c07acf0 con 0x55d47c16eb40 2024-09-11T22:05:07.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.129+0000 7f98da19c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d47c0cf2b0 con 0x55d47c180b80 2024-09-11T22:05:07.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d6360640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 0x55d47c182f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d5b5f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 0x55d47c16da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d6360640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 0x55d47c182f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:56454/0 (socket says 172.21.15.152:56454) 2024-09-11T22:05:07.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d6360640 1 -- 172.21.15.152:0/1587265021 learned_addr learned my addr 172.21.15.152:0/1587265021 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:07.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d535e640 1 --2- 172.21.15.152:0/1587265021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16eb40 0x55d47c16d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d535e640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f98bc0a2fa0 0x7f98bc0a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d6360640 1 -- 172.21.15.152:0/1587265021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16eb40 msgr2=0x55d47c16d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:07.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d6360640 1 --2- 172.21.15.152:0/1587265021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16eb40 0x55d47c16d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d6360640 1 -- 172.21.15.152:0/1587265021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 msgr2=0x55d47c16da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:07.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d6360640 1 --2- 172.21.15.152:0/1587265021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 0x55d47c16da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d6360640 1 -- 172.21.15.152:0/1587265021 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47c05f3a0 con 0x55d47c180b80 2024-09-11T22:05:07.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98c6ffd640 1 -- 172.21.15.152:0/2697441348 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f98c80d39e0 con 0x7f98d0102ef0 2024-09-11T22:05:07.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98d6360640 1 --2- 172.21.15.152:0/1587265021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 0x55d47c182f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f98c809fde0 tx=0x7f98c8072ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=284ec209740f9fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:07.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98bbfff640 1 -- 172.21.15.152:0/1587265021 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c809fe50 con 0x55d47c180b80 2024-09-11T22:05:07.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98bbfff640 1 -- 172.21.15.152:0/1587265021 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98c80a4150 con 0x55d47c180b80 2024-09-11T22:05:07.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.130+0000 7f98bbfff640 1 -- 172.21.15.152:0/1587265021 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c80a87c0 con 0x55d47c180b80 2024-09-11T22:05:07.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.131+0000 7f98da19c740 1 -- 172.21.15.152:0/1587265021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 msgr2=0x55d47c182f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.131+0000 7f98da19c740 1 --2- 172.21.15.152:0/1587265021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 0x55d47c182f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f98c809fde0 tx=0x7f98c8072ec0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.131+0000 7f98d535e640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f98bc0a2fa0 0x7f98bc0a5460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98c00058c0 tx=0x7f98c0005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:07.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.131+0000 7f98da19c740 1 -- 172.21.15.152:0/1587265021 shutdown_connections 2024-09-11T22:05:07.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.131+0000 7f98da19c740 1 --2- 172.21.15.152:0/1587265021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 0x55d47c182f70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.131+0000 7f98da19c740 1 --2- 172.21.15.152:0/1587265021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 0x55d47c16da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.131+0000 7f98da19c740 1 --2- 172.21.15.152:0/1587265021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16eb40 0x55d47c16d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.131+0000 7f98da19c740 1 -- 172.21.15.152:0/1587265021 >> 172.21.15.152:0/1587265021 conn(0x55d47c136310 msgr2=0x55d47c169c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.131+0000 7f98da19c740 1 -- 172.21.15.152:0/1587265021 shutdown_connections 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.131+0000 7f98da19c740 1 -- 172.21.15.152:0/1587265021 wait complete. 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.132+0000 7f98da19c740 1 -- start start 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.132+0000 7f98da19c740 1 Processor -- start 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.132+0000 7f98da19c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c180570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.132+0000 7f98da19c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c16eb40 0x55d47c17d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.132+0000 7f98da19c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c180b80 0x55d47c17de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.132+0000 7f98da19c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d47c183820 con 0x55d47c180b80 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.132+0000 7f98da19c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d47c08e060 con 0x55d47c16d5d0 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.132+0000 7f98da19c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d47c1839a0 con 0x55d47c16eb40 2024-09-11T22:05:07.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.132+0000 7f98da19c740 10 client.0 _ll_register_callbacks cb 0x55d47bde18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:07.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d5b5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c180570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d535e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c16eb40 0x55d47c17d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d5b5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c180570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:45876/0 (socket says 172.21.15.152:45876) 2024-09-11T22:05:07.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d5b5f640 1 -- 172.21.15.152:0/458711722 learned_addr learned my addr 172.21.15.152:0/458711722 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d6360640 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c180b80 0x55d47c17de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d5b5f640 1 -- 172.21.15.152:0/458711722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c16eb40 msgr2=0x55d47c17d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d5b5f640 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c16eb40 0x55d47c17d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d5b5f640 1 -- 172.21.15.152:0/458711722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c180b80 msgr2=0x55d47c17de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d5b5f640 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c180b80 0x55d47c17de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d5b5f640 1 -- 172.21.15.152:0/458711722 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d47be443c0 con 0x55d47c16d5d0 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d6360640 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c180b80 0x55d47c17de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d535e640 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c16eb40 0x55d47c17d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98d5b5f640 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c180570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f98cc004eb0 tx=0x7f98cc004ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97f7ec89cbb76551 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.133+0000 7f98b97fa640 1 -- 172.21.15.152:0/458711722 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98cc04b060 con 0x55d47c16d5d0 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98da19c740 1 -- 172.21.15.152:0/458711722 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98c80a4150 con 0x55d47c16d5d0 2024-09-11T22:05:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98b97fa640 1 -- 172.21.15.152:0/458711722 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f98cc005290 con 0x55d47c16d5d0 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98b97fa640 1 -- 172.21.15.152:0/458711722 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f98cc005490 con 0x55d47c16d5d0 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98da19c740 10 client.25082 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98da19c740 1 -- 172.21.15.152:0/458711722 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d47c18f2c0 con 0x55d47c16d5d0 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98b97fa640 1 -- 172.21.15.152:0/458711722 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98c80a4150 con 0x55d47c16d5d0 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98b97fa640 1 -- 172.21.15.152:0/458711722 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f98cc03d420 con 0x55d47c16d5d0 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98da19c740 10 client.25082 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98da19c740 10 client.25082 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98da19c740 20 client.25082 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98da19c740 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d47c1907d0 0x55d47c192c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98da19c740 4 client.25082 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.134+0000 7f98da19c740 1 -- 172.21.15.152:0/458711722 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d47c0e0860 con 0x55d47c1907d0 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.135+0000 7f98d535e640 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d47c1907d0 0x55d47c192c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.135+0000 7f98b97fa640 10 client.25082 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.135+0000 7f98d535e640 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d47c1907d0 0x55d47c192c10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=146511a59d3f20e9 server_cookie=fd56406c5de9fadc in_seq=0 out_seq=0 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.136+0000 7f98b97fa640 1 -- 172.21.15.152:0/458711722 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d47c0e0860 con 0x55d47c1907d0 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.136+0000 7f98b97fa640 10 client.25082 handle_command_reply: tid=0 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.136+0000 7f98da19c740 1 client.25082 shutdown 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.136+0000 7f98da19c740 1 -- 172.21.15.152:0/458711722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 msgr2=0x55d47c180570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.136+0000 7f98da19c740 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c180570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f98cc004eb0 tx=0x7f98cc004ee0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.136+0000 7f98da19c740 1 -- 172.21.15.152:0/458711722 shutdown_connections 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.136+0000 7f98da19c740 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d47c1907d0 0x55d47c192c10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.136+0000 7f98b97fa640 0 client.25082 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.136+0000 7f98da19c740 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c180b80 0x55d47c17de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.136+0000 7f98da19c740 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c16eb40 0x55d47c17d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.136+0000 7f98da19c740 1 --2- 172.21.15.152:0/458711722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c180570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.137+0000 7f98da19c740 1 -- 172.21.15.152:0/458711722 >> 172.21.15.152:0/458711722 conn(0x55d47c136310 msgr2=0x55d47c16f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:07.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.137+0000 7f98da19c740 1 -- 172.21.15.152:0/458711722 shutdown_connections 2024-09-11T22:05:07.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.137+0000 7f98da19c740 1 -- 172.21.15.152:0/458711722 wait complete. 2024-09-11T22:05:07.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.137+0000 7f98da19c740 20 client.25082 trim_cache size 0 max 16384 2024-09-11T22:05:07.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98da19c740 1 Processor -- start 2024-09-11T22:05:07.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98da19c740 1 -- start start 2024-09-11T22:05:07.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98da19c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 0x55d47c18cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98da19c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16eb40 0x55d47c168bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98da19c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 0x55d47c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98da19c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f98d01ae050 con 0x55d47c16d5d0 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98da19c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f98d01ab8f0 con 0x55d47c16eb40 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98da19c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f98d01a9740 con 0x55d47c180b80 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98d5b5f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 0x55d47c18cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98d5b5f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 0x55d47c18cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52864/0 (socket says 172.21.15.152:52864) 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98d5b5f640 1 -- 172.21.15.152:0/3690282945 learned_addr learned my addr 172.21.15.152:0/3690282945 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98d6360640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 0x55d47c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.157+0000 7f98d535e640 1 --2- 172.21.15.152:0/3690282945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16eb40 0x55d47c168bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.158+0000 7f98d5b5f640 1 -- 172.21.15.152:0/3690282945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 msgr2=0x55d47c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:07.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.158+0000 7f98d5b5f640 1 --2- 172.21.15.152:0/3690282945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 0x55d47c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.158+0000 7f98d5b5f640 1 -- 172.21.15.152:0/3690282945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16eb40 msgr2=0x55d47c168bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:07.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.158+0000 7f98d5b5f640 1 --2- 172.21.15.152:0/3690282945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16eb40 0x55d47c168bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.158+0000 7f98d5b5f640 1 -- 172.21.15.152:0/3690282945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47c170120 con 0x55d47c16d5d0 2024-09-11T22:05:07.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.158+0000 7f98d6360640 1 --2- 172.21.15.152:0/3690282945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 0x55d47c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:07.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.158+0000 7f98d5b5f640 1 --2- 172.21.15.152:0/3690282945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 0x55d47c18cac0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f98cc03d870 tx=0x7f98cc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb8aca66bbce6e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:07.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.158+0000 7f98bb7fe640 1 -- 172.21.15.152:0/3690282945 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98cc04b070 con 0x55d47c16d5d0 2024-09-11T22:05:07.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.158+0000 7f98bb7fe640 1 -- 172.21.15.152:0/3690282945 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98cc005290 con 0x55d47c16d5d0 2024-09-11T22:05:07.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.158+0000 7f98bb7fe640 1 -- 172.21.15.152:0/3690282945 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98cc04fb80 con 0x55d47c16d5d0 2024-09-11T22:05:07.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.159+0000 7f98da19c740 1 -- 172.21.15.152:0/3690282945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 msgr2=0x55d47c18cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.159+0000 7f98da19c740 1 --2- 172.21.15.152:0/3690282945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 0x55d47c18cac0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f98cc03d870 tx=0x7f98cc009260 comp rx=0 tx=0).stop 2024-09-11T22:05:07.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.159+0000 7f98da19c740 1 -- 172.21.15.152:0/3690282945 shutdown_connections 2024-09-11T22:05:07.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.159+0000 7f98da19c740 1 --2- 172.21.15.152:0/3690282945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c180b80 0x55d47c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.159+0000 7f98da19c740 1 --2- 172.21.15.152:0/3690282945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16eb40 0x55d47c168bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.159+0000 7f98da19c740 1 --2- 172.21.15.152:0/3690282945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c16d5d0 0x55d47c18cac0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.159+0000 7f98da19c740 1 -- 172.21.15.152:0/3690282945 >> 172.21.15.152:0/3690282945 conn(0x55d47c136310 msgr2=0x55d47c1684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:07.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.159+0000 7f98da19c740 1 -- 172.21.15.152:0/3690282945 shutdown_connections 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.159+0000 7f98da19c740 1 -- 172.21.15.152:0/3690282945 wait complete. 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.160+0000 7f98da19c740 1 -- start start 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.160+0000 7f98da19c740 1 Processor -- start 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.160+0000 7f98da19c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c184d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.160+0000 7f98da19c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c16eb40 0x55d47c1852a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98da19c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c180b80 0x55d47c1fa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98da19c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f98d01a9db0 con 0x55d47c180b80 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98da19c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f98d01ab220 con 0x55d47c16d5d0 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98da19c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f98d01aa480 con 0x55d47c16eb40 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98d5b5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c184d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98d5b5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c184d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:45888/0 (socket says 172.21.15.152:45888) 2024-09-11T22:05:07.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98da19c740 10 client.0 _ll_register_callbacks cb 0x7f98cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98d5b5f640 1 -- 172.21.15.152:0/2820679514 learned_addr learned my addr 172.21.15.152:0/2820679514 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98d6360640 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c180b80 0x55d47c1fa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98d535e640 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c16eb40 0x55d47c1852a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98d5b5f640 1 -- 172.21.15.152:0/2820679514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c16eb40 msgr2=0x55d47c1852a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98d5b5f640 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c16eb40 0x55d47c1852a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98d5b5f640 1 -- 172.21.15.152:0/2820679514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c180b80 msgr2=0x55d47c1fa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98d5b5f640 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c180b80 0x55d47c1fa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98d5b5f640 1 -- 172.21.15.152:0/2820679514 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d47c185b80 con 0x55d47c16d5d0 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98d5b5f640 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c184d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f98cc004c20 tx=0x7f98cc005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f3c0abfe0dd15d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.161+0000 7f98b97fa640 1 -- 172.21.15.152:0/2820679514 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98cc05c070 con 0x55d47c16d5d0 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98b97fa640 1 -- 172.21.15.152:0/2820679514 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f98cc031a80 con 0x55d47c16d5d0 2024-09-11T22:05:07.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98da19c740 1 -- 172.21.15.152:0/2820679514 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98cc005290 con 0x55d47c16d5d0 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98b97fa640 1 -- 172.21.15.152:0/2820679514 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f98cc068050 con 0x55d47c16d5d0 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98da19c740 10 client.25088 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98da19c740 1 -- 172.21.15.152:0/2820679514 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d47c1fbb00 con 0x55d47c16d5d0 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98b97fa640 1 -- 172.21.15.152:0/2820679514 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98cc005630 con 0x55d47c16d5d0 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98b97fa640 1 -- 172.21.15.152:0/2820679514 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f98cc04f920 con 0x55d47c16d5d0 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98da19c740 10 client.25088 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98da19c740 10 client.25088 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98da19c740 20 client.25088 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98da19c740 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d47c1fc160 0x55d47c1fe550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.162+0000 7f98da19c740 4 client.25088 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.163+0000 7f98da19c740 1 -- 172.21.15.152:0/2820679514 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f98cc005290 con 0x55d47c1fc160 2024-09-11T22:05:07.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.163+0000 7f98d535e640 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d47c1fc160 0x55d47c1fe550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:07.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.163+0000 7f98d535e640 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d47c1fc160 0x55d47c1fe550 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2cc9ef8c47f493b5 server_cookie=c253705c5ea0e669 in_seq=0 out_seq=0 2024-09-11T22:05:07.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.163+0000 7f98b97fa640 10 client.25088 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:05:07.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.163+0000 7f98b97fa640 1 -- 172.21.15.152:0/2820679514 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f98cc005290 con 0x55d47c1fc160 2024-09-11T22:05:07.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.163+0000 7f98b97fa640 10 client.25088 handle_command_reply: tid=0 2024-09-11T22:05:07.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.164+0000 7f98da19c740 1 client.25088 shutdown 2024-09-11T22:05:07.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.164+0000 7f98da19c740 1 -- 172.21.15.152:0/2820679514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 msgr2=0x55d47c184d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.164+0000 7f98da19c740 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c184d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f98cc004c20 tx=0x7f98cc005c90 comp rx=0 tx=0).stop 2024-09-11T22:05:07.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.164+0000 7f98da19c740 1 -- 172.21.15.152:0/2820679514 shutdown_connections 2024-09-11T22:05:07.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.164+0000 7f98da19c740 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d47c1fc160 0x55d47c1fe550 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.164+0000 7f98b97fa640 0 client.25088 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:05:07.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.164+0000 7f98da19c740 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d47c180b80 0x55d47c1fa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.164+0000 7f98da19c740 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d47c16eb40 0x55d47c1852a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.164+0000 7f98da19c740 1 --2- 172.21.15.152:0/2820679514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d47c16d5d0 0x55d47c184d60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.164+0000 7f98da19c740 1 -- 172.21.15.152:0/2820679514 >> 172.21.15.152:0/2820679514 conn(0x55d47c136310 msgr2=0x55d47c168d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:07.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.164+0000 7f98da19c740 1 -- 172.21.15.152:0/2820679514 shutdown_connections 2024-09-11T22:05:07.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.165+0000 7f98da19c740 1 -- 172.21.15.152:0/2820679514 wait complete. 2024-09-11T22:05:07.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.165+0000 7f98da19c740 20 client.25088 trim_cache size 0 max 16384 2024-09-11T22:05:07.171 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:05:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2697441348 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f98bc0a2fa0 msgr2=0x7f98bc0a5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f98bc0a2fa0 0x7f98bc0a5460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98c00058c0 tx=0x7f98c0005f90 comp rx=0 tx=0).stop 2024-09-11T22:05:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2697441348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98d0102ef0 msgr2=0x7f98d01a43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98d0102ef0 0x7f98d01a43a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009fd0 tx=0x7f98c800ef10 comp rx=0 tx=0).stop 2024-09-11T22:05:07.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2697441348 shutdown_connections 2024-09-11T22:05:07.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f98bc0a2fa0 0x7f98bc0a5460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98d0102ef0 0x7f98d01a43a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98d0102570 0x7f98d0199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 --2- 172.21.15.152:0/2697441348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d0100e20 0x7f98d0199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2697441348 >> 172.21.15.152:0/2697441348 conn(0x7f98d00fc7d0 msgr2=0x7f98d00fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:07.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2697441348 shutdown_connections 2024-09-11T22:05:07.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.166+0000 7f98d7dc3640 1 -- 172.21.15.152:0/2697441348 wait complete. 2024-09-11T22:05:07.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.737+0000 7f1579ffb640 1 -- 172.21.15.152:0/3972798079 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f1584003ad0 con 0x5580de8517b0 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.737+0000 7f1579ffb640 10 client.15534 handle_command_reply: tid=0 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.737+0000 7f159ac7a740 1 client.15534 shutdown 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.737+0000 7f159ac7a740 1 -- 172.21.15.152:0/3972798079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 msgr2=0x5580de83bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.737+0000 7f159ac7a740 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83bf20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1584003e80 tx=0x7f158400fc30 comp rx=0 tx=0).stop 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.737+0000 7f159ac7a740 1 -- 172.21.15.152:0/3972798079 shutdown_connections 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.737+0000 7f159ac7a740 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5580de8517b0 0x5580de8beee0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.737+0000 7f159ac7a740 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5580de841940 0x5580de83c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.737+0000 7f1579ffb640 0 client.15534 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.737+0000 7f159ac7a740 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5580de837080 0x5580de83bf20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.737+0000 7f159ac7a740 1 --2- 172.21.15.152:0/3972798079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5580de836760 0x5580de83b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f159ac7a740 1 -- 172.21.15.152:0/3972798079 >> 172.21.15.152:0/3972798079 conn(0x5580de832cf0 msgr2=0x5580de8381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:07.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f159ac7a740 1 -- 172.21.15.152:0/3972798079 shutdown_connections 2024-09-11T22:05:07.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f159ac7a740 1 -- 172.21.15.152:0/3972798079 wait complete. 2024-09-11T22:05:07.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f159ac7a740 20 client.15534 trim_cache size 0 max 16384 2024-09-11T22:05:07.741 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:05:07.741 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 27, 2024-09-11T22:05:07.741 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:05:07.741 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 2, 2024-09-11T22:05:07.741 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:05:07.741 INFO:teuthology.orchestra.run.smithi152.stdout: "72c0cedc": { 2024-09-11T22:05:07.741 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 2, 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 144.5, 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:05:07.742 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:05:07.743 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:07.743 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:07.743 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:07.743 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:07.743 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:07.743 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:05:07.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 -- 172.21.15.152:0/3070479452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f157c0a2f20 msgr2=0x7f157c0a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f157c0a2f20 0x7f157c0a53e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15880ecdf0 tx=0x7f158808bb40 comp rx=0 tx=0).stop 2024-09-11T22:05:07.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 -- 172.21.15.152:0/3070479452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15941027a0 msgr2=0x7f159406cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:07.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15941027a0 0x7f159406cad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1588006010 tx=0x7f15880042f0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 -- 172.21.15.152:0/3070479452 shutdown_connections 2024-09-11T22:05:07.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f157c0a2f20 0x7f157c0a53e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1594106f20 0x7f159406d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15941027a0 0x7f159406cad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 --2- 172.21.15.152:0/3070479452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1594101df0 0x7f1594073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:07.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 -- 172.21.15.152:0/3070479452 >> 172.21.15.152:0/3070479452 conn(0x7f15940fd8f0 msgr2=0x7f15940fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:07.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 -- 172.21.15.152:0/3070479452 shutdown_connections 2024-09-11T22:05:07.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:07.738+0000 7f15988a1640 1 -- 172.21.15.152:0/3070479452 wait complete. 2024-09-11T22:05:07.841 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:05:08.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:08 smithi152 ceph-mon[31188]: pgmap v28: 97 pgs: 97 active+clean; 94 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 9.2 MiB/s wr, 347 op/s 2024-09-11T22:05:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:08 smithi179 ceph-mon[35603]: pgmap v28: 97 pgs: 97 active+clean; 94 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 9.2 MiB/s wr, 347 op/s 2024-09-11T22:05:08.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:08 smithi193 ceph-mon[35545]: pgmap v28: 97 pgs: 97 active+clean; 94 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 9.2 MiB/s wr, 347 op/s 2024-09-11T22:05:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.887+0000 7fc205ad0640 1 -- 172.21.15.152:0/3137458045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200101350 msgr2=0x7fc20010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.887+0000 7fc205ad0640 1 --2- 172.21.15.152:0/3137458045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200101350 0x7fc20010d880 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009930 tx=0x7fc1f802a420 comp rx=0 tx=0).stop 2024-09-11T22:05:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.887+0000 7fc205ad0640 1 -- 172.21.15.152:0/3137458045 shutdown_connections 2024-09-11T22:05:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.887+0000 7fc205ad0640 1 --2- 172.21.15.152:0/3137458045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200101350 0x7fc20010d880 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.887+0000 7fc205ad0640 1 --2- 172.21.15.152:0/3137458045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2001009b0 0x7fc200100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.887+0000 7fc205ad0640 1 --2- 172.21.15.152:0/3137458045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2001069c0 0x7fc200106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.887+0000 7fc205ad0640 1 -- 172.21.15.152:0/3137458045 >> 172.21.15.152:0/3137458045 conn(0x7fc200077990 msgr2=0x7fc2000fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.887+0000 7fc205ad0640 1 -- 172.21.15.152:0/3137458045 shutdown_connections 2024-09-11T22:05:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.887+0000 7fc205ad0640 1 -- 172.21.15.152:0/3137458045 wait complete. 2024-09-11T22:05:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.888+0000 7fc205ad0640 1 Processor -- start 2024-09-11T22:05:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.888+0000 7fc205ad0640 1 -- start start 2024-09-11T22:05:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.888+0000 7fc205ad0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2001009b0 0x7fc2000fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.888+0000 7fc205ad0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc200101350 0x7fc2000fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.888+0000 7fc205ad0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2001069c0 0x7fc2000fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.888+0000 7fc205ad0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc200110e00 con 0x7fc2001009b0 2024-09-11T22:05:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.888+0000 7fc205ad0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc200110c80 con 0x7fc2001069c0 2024-09-11T22:05:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.888+0000 7fc205ad0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc200110f80 con 0x7fc200101350 2024-09-11T22:05:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2001009b0 0x7fc2000fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2001009b0 0x7fc2000fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52906/0 (socket says 172.21.15.152:52906) 2024-09-11T22:05:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/918904991 learned_addr learned my addr 172.21.15.152:0/918904991 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1feffd640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc200101350 0x7fc2000fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1fffff640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2001069c0 0x7fc2000fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/918904991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc200101350 msgr2=0x7fc2000fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc200101350 0x7fc2000fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/918904991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2001069c0 msgr2=0x7fc2000fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2001069c0 0x7fc2000fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/918904991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2001a67f0 con 0x7fc2001009b0 2024-09-11T22:05:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1fffff640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2001069c0 0x7fc2000fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2001009b0 0x7fc2000fcde0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000d950 tx=0x7fc1f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1fcff9640 1 -- 172.21.15.152:0/918904991 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0017030 con 0x7fc2001009b0 2024-09-11T22:05:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1fcff9640 1 -- 172.21.15.152:0/918904991 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1f0004020 con 0x7fc2001009b0 2024-09-11T22:05:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc205ad0640 1 -- 172.21.15.152:0/918904991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2001a6ae0 con 0x7fc2001009b0 2024-09-11T22:05:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc1fcff9640 1 -- 172.21.15.152:0/918904991 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00047a0 con 0x7fc2001009b0 2024-09-11T22:05:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.889+0000 7fc205ad0640 1 -- 172.21.15.152:0/918904991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2001a7030 con 0x7fc2001009b0 2024-09-11T22:05:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc1fcff9640 1 -- 172.21.15.152:0/918904991 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7fc1f00041d0 con 0x7fc2001009b0 2024-09-11T22:05:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc208866740 1 Processor -- start 2024-09-11T22:05:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc208866740 1 -- start start 2024-09-11T22:05:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc208866740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4daf0 0x563dbed4ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc208866740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed58770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc208866740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed5b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc208866740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563dbecb22f0 con 0x563dbed58cb0 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc208866740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563dbec5a270 con 0x563dbed4daf0 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc208866740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563dbecae2b0 con 0x563dbed4e410 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc1fcff9640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc1e80a2f50 0x7fc1e80a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc1feffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed5b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc1feffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed5b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52918/0 (socket says 172.21.15.152:52918) 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.892+0000 7fc1feffd640 1 -- 172.21.15.152:0/403015356 learned_addr learned my addr 172.21.15.152:0/403015356 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1fffff640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc1e80a2f50 0x7fc1e80a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1fcff9640 1 -- 172.21.15.152:0/918904991 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc1f00cf0b0 con 0x7fc2001009b0 2024-09-11T22:05:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1fffff640 1 --2- 172.21.15.152:0/403015356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4daf0 0x563dbed4ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/403015356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed58770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1feffd640 1 -- 172.21.15.152:0/403015356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 msgr2=0x563dbed58770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1feffd640 1 --2- 172.21.15.152:0/403015356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed58770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1feffd640 1 -- 172.21.15.152:0/403015356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4daf0 msgr2=0x563dbed4ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1feffd640 1 --2- 172.21.15.152:0/403015356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4daf0 0x563dbed4ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1feffd640 1 -- 172.21.15.152:0/403015356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dbec59340 con 0x563dbed58cb0 2024-09-11T22:05:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1feffd640 1 --2- 172.21.15.152:0/403015356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed5b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4010420 tx=0x7fc1f4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87328e72f3845c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1fffff640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc1e80a2f50 0x7fc1e80a5410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005c20 tx=0x7fc1f8005b50 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1e5ffb640 1 -- 172.21.15.152:0/403015356 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4016070 con 0x563dbed58cb0 2024-09-11T22:05:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1e5ffb640 1 -- 172.21.15.152:0/403015356 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1f4004d20 con 0x563dbed58cb0 2024-09-11T22:05:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.893+0000 7fc1e5ffb640 1 -- 172.21.15.152:0/403015356 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f40054e0 con 0x563dbed58cb0 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.894+0000 7fc208866740 1 -- 172.21.15.152:0/403015356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 msgr2=0x563dbed5b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.894+0000 7fc208866740 1 --2- 172.21.15.152:0/403015356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed5b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4010420 tx=0x7fc1f4009f90 comp rx=0 tx=0).stop 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.894+0000 7fc208866740 1 -- 172.21.15.152:0/403015356 shutdown_connections 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.894+0000 7fc208866740 1 --2- 172.21.15.152:0/403015356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed5b0a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.894+0000 7fc208866740 1 --2- 172.21.15.152:0/403015356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed58770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.894+0000 7fc208866740 1 --2- 172.21.15.152:0/403015356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4daf0 0x563dbed4ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.894+0000 7fc208866740 1 -- 172.21.15.152:0/403015356 >> 172.21.15.152:0/403015356 conn(0x563dbed4a060 msgr2=0x563dbed4a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.894+0000 7fc208866740 1 -- 172.21.15.152:0/403015356 shutdown_connections 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.894+0000 7fc208866740 1 -- 172.21.15.152:0/403015356 wait complete. 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.894+0000 7fc208866740 1 -- start start 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc208866740 1 Processor -- start 2024-09-11T22:05:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc208866740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed55b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc208866740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed560d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc208866740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed58cb0 0x563dbed56610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc208866740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563dbed5b880 con 0x563dbed4daf0 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc208866740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563dbec3b290 con 0x563dbed58cb0 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc208866740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563dbed5ba00 con 0x563dbed4e410 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc208866740 10 client.0 _ll_register_callbacks cb 0x563dbec6c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc1ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed55b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc1ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed55b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52924/0 (socket says 172.21.15.152:52924) 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/3025193242 learned_addr learned my addr 172.21.15.152:0/3025193242 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc1feffd640 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/3025193242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 msgr2=0x563dbed560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc1fffff640 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed58cb0 0x563dbed56610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/3025193242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed58cb0 msgr2=0x563dbed56610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed58cb0 0x563dbed56610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.895+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/3025193242 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dbe9c5210 con 0x563dbed4daf0 2024-09-11T22:05:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed55b90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00cc6d0 tx=0x7fc1f009af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86497dbe6ccd7a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc1deffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc1deffd640 1 -- 172.21.15.152:0/3025193242 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00b4060 con 0x563dbed4daf0 2024-09-11T22:05:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc1deffd640 1 -- 172.21.15.152:0/3025193242 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc1f009a7b0 con 0x563dbed4daf0 2024-09-11T22:05:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc208866740 1 -- 172.21.15.152:0/3025193242 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1f4004d20 con 0x563dbed4daf0 2024-09-11T22:05:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc1deffd640 1 -- 172.21.15.152:0/3025193242 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc1f009b360 con 0x563dbed4daf0 2024-09-11T22:05:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc208866740 10 client.15564 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc208866740 1 -- 172.21.15.152:0/3025193242 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563dbea91620 con 0x563dbed4daf0 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc1deffd640 1 -- 172.21.15.152:0/3025193242 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1f4004d20 con 0x563dbed4daf0 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc1deffd640 1 -- 172.21.15.152:0/3025193242 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fc1f009f200 con 0x563dbed4daf0 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc208866740 10 client.15564 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc208866740 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc208866740 20 client.15564 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc208866740 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563dbed68c50 0x563dbed6b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc208866740 4 client.15564 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.896+0000 7fc208866740 1 -- 172.21.15.152:0/3025193242 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dbecbfa20 con 0x563dbed68c50 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.897+0000 7fc1feffd640 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563dbed68c50 0x563dbed6b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.897+0000 7fc1feffd640 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563dbed68c50 0x563dbed6b040 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e6fcc2341c7f01b server_cookie=6747255dc2b157b5 in_seq=0 out_seq=0 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.897+0000 7fc1deffd640 10 client.15564 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc1deffd640 1 -- 172.21.15.152:0/3025193242 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563dbecbfa20 con 0x563dbed68c50 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc1deffd640 10 client.15564 handle_command_reply: tid=0 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 1 client.15564 shutdown 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 1 -- 172.21.15.152:0/3025193242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 msgr2=0x563dbed55b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed55b90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00cc6d0 tx=0x7fc1f009af60 comp rx=0 tx=0).stop 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 1 -- 172.21.15.152:0/3025193242 shutdown_connections 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563dbed68c50 0x563dbed6b040 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed58cb0 0x563dbed56610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 1 --2- 172.21.15.152:0/3025193242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed55b90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc1deffd640 0 client.15564 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 1 -- 172.21.15.152:0/3025193242 >> 172.21.15.152:0/3025193242 conn(0x563dbed4a060 msgr2=0x563dbed4fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 1 -- 172.21.15.152:0/3025193242 shutdown_connections 2024-09-11T22:05:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 1 -- 172.21.15.152:0/3025193242 wait complete. 2024-09-11T22:05:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.898+0000 7fc208866740 20 client.15564 trim_cache size 0 max 16384 2024-09-11T22:05:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.913+0000 7fc208866740 1 Processor -- start 2024-09-11T22:05:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.913+0000 7fc208866740 1 -- start start 2024-09-11T22:05:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.913+0000 7fc208866740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed560e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.913+0000 7fc208866740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4e410 0x563dbed56620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.913+0000 7fc208866740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed58cb0 0x563dbed70930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.913+0000 7fc208866740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc2001b2350 con 0x563dbed4daf0 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.913+0000 7fc208866740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc2001afbf0 con 0x563dbed4e410 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.913+0000 7fc208866740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc2001ada40 con 0x563dbed58cb0 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52932/0 (socket says 172.21.15.152:52932) 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/4272563231 learned_addr learned my addr 172.21.15.152:0/4272563231 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1feffd640 1 --2- 172.21.15.152:0/4272563231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4e410 0x563dbed56620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1fffff640 1 --2- 172.21.15.152:0/4272563231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed58cb0 0x563dbed70930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/4272563231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed58cb0 msgr2=0x563dbed70930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/4272563231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed58cb0 0x563dbed70930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/4272563231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4e410 msgr2=0x563dbed56620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/4272563231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4e410 0x563dbed56620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1ff7fe640 1 -- 172.21.15.152:0/4272563231 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dbed4e240 con 0x563dbed4daf0 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/4272563231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed560e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00cc680 tx=0x7fc1f009afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf12fe369396c426 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1e57fa640 1 -- 172.21.15.152:0/4272563231 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f009b130 con 0x563dbed4daf0 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1e57fa640 1 -- 172.21.15.152:0/4272563231 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1f009f710 con 0x563dbed4daf0 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.914+0000 7fc1e57fa640 1 -- 172.21.15.152:0/4272563231 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f009aa10 con 0x563dbed4daf0 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.915+0000 7fc208866740 1 -- 172.21.15.152:0/4272563231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 msgr2=0x563dbed560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.915+0000 7fc208866740 1 --2- 172.21.15.152:0/4272563231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed560e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00cc680 tx=0x7fc1f009afd0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.915+0000 7fc208866740 1 -- 172.21.15.152:0/4272563231 shutdown_connections 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.915+0000 7fc208866740 1 --2- 172.21.15.152:0/4272563231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed58cb0 0x563dbed70930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.915+0000 7fc208866740 1 --2- 172.21.15.152:0/4272563231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4e410 0x563dbed56620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.915+0000 7fc208866740 1 --2- 172.21.15.152:0/4272563231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed4daf0 0x563dbed560e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.915+0000 7fc208866740 1 -- 172.21.15.152:0/4272563231 >> 172.21.15.152:0/4272563231 conn(0x563dbed4a060 msgr2=0x563dbed57c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.915+0000 7fc208866740 1 -- 172.21.15.152:0/4272563231 shutdown_connections 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.915+0000 7fc208866740 1 -- 172.21.15.152:0/4272563231 wait complete. 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.915+0000 7fc208866740 1 -- start start 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc208866740 1 Processor -- start 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc208866740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4daf0 0x563dbed61520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc208866740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc208866740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed52ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc208866740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc2001ae0b0 con 0x563dbed58cb0 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc208866740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc2001af520 con 0x563dbed4daf0 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc208866740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc2001ae780 con 0x563dbed4e410 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc208866740 10 client.0 _ll_register_callbacks cb 0x7fc1f00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc1fffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed52ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc1fffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed52ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52948/0 (socket says 172.21.15.152:52948) 2024-09-11T22:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc1fffff640 1 -- 172.21.15.152:0/3262695840 learned_addr learned my addr 172.21.15.152:0/3262695840 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4daf0 0x563dbed61520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc1feffd640 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc1fffff640 1 -- 172.21.15.152:0/3262695840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 msgr2=0x563dbed529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc1fffff640 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc1fffff640 1 -- 172.21.15.152:0/3262695840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4daf0 msgr2=0x563dbed61520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc1fffff640 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4daf0 0x563dbed61520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc1fffff640 1 -- 172.21.15.152:0/3262695840 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dbed53820 con 0x563dbed58cb0 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.916+0000 7fc1feffd640 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc1fffff640 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed52ff0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80042c0 tx=0x7fc1f8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07e2a12f4035941 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc1deffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc1deffd640 1 -- 172.21.15.152:0/3262695840 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8050060 con 0x563dbed58cb0 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc208866740 1 -- 172.21.15.152:0/3262695840 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1f009f710 con 0x563dbed58cb0 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc1deffd640 1 -- 172.21.15.152:0/3262695840 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc1f80046c0 con 0x563dbed58cb0 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc1deffd640 1 -- 172.21.15.152:0/3262695840 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc1f8035040 con 0x563dbed58cb0 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc208866740 10 client.15570 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc208866740 1 -- 172.21.15.152:0/3262695840 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563dbedd3a90 con 0x563dbed58cb0 2024-09-11T22:05:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc1deffd640 1 -- 172.21.15.152:0/3262695840 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1f009f710 con 0x563dbed58cb0 2024-09-11T22:05:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc1deffd640 1 -- 172.21.15.152:0/3262695840 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fc1f803a070 con 0x563dbed58cb0 2024-09-11T22:05:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc208866740 10 client.15570 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc208866740 10 client.15570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc208866740 20 client.15570 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc208866740 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563dbedd4220 0x563dbedd6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc208866740 4 client.15570 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:05:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.917+0000 7fc208866740 1 -- 172.21.15.152:0/3262695840 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563dbecb9d70 con 0x563dbedd4220 2024-09-11T22:05:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.918+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563dbedd4220 0x563dbedd6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.918+0000 7fc1deffd640 10 client.15570 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.918+0000 7fc1ff7fe640 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563dbedd4220 0x563dbedd6640 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=981187e86d9faa3c server_cookie=9e14bd91cf02efe6 in_seq=0 out_seq=0 2024-09-11T22:05:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc1deffd640 1 -- 172.21.15.152:0/3262695840 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563dbecb9d70 con 0x563dbedd4220 2024-09-11T22:05:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc1deffd640 10 client.15570 handle_command_reply: tid=0 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 1 client.15570 shutdown 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 1 -- 172.21.15.152:0/3262695840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 msgr2=0x563dbed52ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed52ff0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80042c0 tx=0x7fc1f8009260 comp rx=0 tx=0).stop 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 1 -- 172.21.15.152:0/3262695840 shutdown_connections 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563dbedd4220 0x563dbedd6640 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dbed58cb0 0x563dbed52ff0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc1deffd640 0 client.15570 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dbed4e410 0x563dbed529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 1 --2- 172.21.15.152:0/3262695840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dbed4daf0 0x563dbed61520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 1 -- 172.21.15.152:0/3262695840 >> 172.21.15.152:0/3262695840 conn(0x563dbed4a060 msgr2=0x563dbed489a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 1 -- 172.21.15.152:0/3262695840 shutdown_connections 2024-09-11T22:05:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 1 -- 172.21.15.152:0/3262695840 wait complete. 2024-09-11T22:05:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.926+0000 7fc208866740 20 client.15570 trim_cache size 0 max 16384 2024-09-11T22:05:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:05:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:05:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:05:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:05:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 -- 172.21.15.152:0/918904991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc1e80a2f50 msgr2=0x7fc1e80a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc1e80a2f50 0x7fc1e80a5410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005c20 tx=0x7fc1f8005b50 comp rx=0 tx=0).stop 2024-09-11T22:05:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 -- 172.21.15.152:0/918904991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2001009b0 msgr2=0x7fc2000fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2001009b0 0x7fc2000fcde0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000d950 tx=0x7fc1f000de10 comp rx=0 tx=0).stop 2024-09-11T22:05:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 -- 172.21.15.152:0/918904991 shutdown_connections 2024-09-11T22:05:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc1e80a2f50 0x7fc1e80a5410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2001069c0 0x7fc2000fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc200101350 0x7fc2000fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 --2- 172.21.15.152:0/918904991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2001009b0 0x7fc2000fcde0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 -- 172.21.15.152:0/918904991 >> 172.21.15.152:0/918904991 conn(0x7fc200077990 msgr2=0x7fc200069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 -- 172.21.15.152:0/918904991 shutdown_connections 2024-09-11T22:05:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:08.927+0000 7fc205ad0640 1 -- 172.21.15.152:0/918904991 wait complete. 2024-09-11T22:05:09.087 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '72c0cedc', quiesce took 6.2 seconds. Will release after: 18.3 2024-09-11T22:05:09.123 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:09.616 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:09 smithi152 ceph-mon[31188]: pgmap v29: 97 pgs: 97 active+clean; 189 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 23 MiB/s wr, 592 op/s 2024-09-11T22:05:09.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.603+0000 7fd693d96640 1 -- 172.21.15.152:0/2255544428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd68c103660 msgr2=0x7fd68c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:09.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.603+0000 7fd693d96640 1 --2- 172.21.15.152:0/2255544428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd68c103660 0x7fd68c10bb50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009900 tx=0x7fd67c02a480 comp rx=0 tx=0).stop 2024-09-11T22:05:09.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.603+0000 7fd693d96640 1 -- 172.21.15.152:0/2255544428 shutdown_connections 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.603+0000 7fd693d96640 1 --2- 172.21.15.152:0/2255544428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd68c10c170 0x7fd68c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.603+0000 7fd693d96640 1 --2- 172.21.15.152:0/2255544428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd68c103660 0x7fd68c10bb50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.603+0000 7fd693d96640 1 --2- 172.21.15.152:0/2255544428 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c102d40 0x7fd68c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.603+0000 7fd693d96640 1 -- 172.21.15.152:0/2255544428 >> 172.21.15.152:0/2255544428 conn(0x7fd68c0fc7a0 msgr2=0x7fd68c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.603+0000 7fd693d96640 1 -- 172.21.15.152:0/2255544428 shutdown_connections 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.603+0000 7fd693d96640 1 -- 172.21.15.152:0/2255544428 wait complete. 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd693d96640 1 Processor -- start 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd693d96640 1 -- start start 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd693d96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd68c102d40 0x7fd68c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd693d96640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c103660 0x7fd68c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd693d96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd68c10c170 0x7fd68c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd693d96640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c111f70 con 0x7fd68c102d40 2024-09-11T22:05:09.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd693d96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c111df0 con 0x7fd68c10c170 2024-09-11T22:05:09.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd693d96640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c1120f0 con 0x7fd68c103660 2024-09-11T22:05:09.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd691b32640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd68c102d40 0x7fd68c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd691b32640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd68c102d40 0x7fd68c198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52974/0 (socket says 172.21.15.152:52974) 2024-09-11T22:05:09.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd691b32640 1 -- 172.21.15.152:0/2050663647 learned_addr learned my addr 172.21.15.152:0/2050663647 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:09.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.604+0000 7fd692333640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd68c10c170 0x7fd68c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd691331640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c103660 0x7fd68c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd691b32640 1 -- 172.21.15.152:0/2050663647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c103660 msgr2=0x7fd68c198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd691b32640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c103660 0x7fd68c198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd691b32640 1 -- 172.21.15.152:0/2050663647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd68c10c170 msgr2=0x7fd68c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd691b32640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd68c10c170 0x7fd68c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd691b32640 1 -- 172.21.15.152:0/2050663647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c19d500 con 0x7fd68c102d40 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd691331640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c103660 0x7fd68c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd691b32640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd68c102d40 0x7fd68c198550 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd68800ea80 tx=0x7fd68800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd682ffd640 1 -- 172.21.15.152:0/2050663647 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68800ce40 con 0x7fd68c102d40 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd682ffd640 1 -- 172.21.15.152:0/2050663647 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd688005020 con 0x7fd68c102d40 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd682ffd640 1 -- 172.21.15.152:0/2050663647 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688011760 con 0x7fd68c102d40 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd693d96640 1 -- 172.21.15.152:0/2050663647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68c19d7f0 con 0x7fd68c102d40 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.605+0000 7fd693d96640 1 -- 172.21.15.152:0/2050663647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68c1a50d0 con 0x7fd68c102d40 2024-09-11T22:05:09.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.607+0000 7fd682ffd640 1 -- 172.21.15.152:0/2050663647 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7fd6880051d0 con 0x7fd68c102d40 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.607+0000 7fd69616f740 1 Processor -- start 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd69616f740 1 -- start start 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd69616f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345ecb40 0x55ac345eb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd69616f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd69616f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd69616f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ac345512f0 con 0x55ac345f6370 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd69616f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ac344f8cf0 con 0x55ac345eb5d0 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd69616f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ac3454d2b0 con 0x55ac345ecb40 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd682ffd640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6780a2ea0 0x7fd6780a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd691331640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd691331640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52982/0 (socket says 172.21.15.152:52982) 2024-09-11T22:05:09.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd691331640 1 -- 172.21.15.152:0/3129230274 learned_addr learned my addr 172.21.15.152:0/3129230274 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd692333640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6780a2ea0 0x7fd6780a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd692333640 1 --2- 172.21.15.152:0/3129230274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345ecb40 0x55ac345eb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd691b32640 1 --2- 172.21.15.152:0/3129230274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd691331640 1 -- 172.21.15.152:0/3129230274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345ecb40 msgr2=0x55ac345eb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd682ffd640 1 -- 172.21.15.152:0/2050663647 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd6880cfdf0 con 0x7fd68c102d40 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd691331640 1 --2- 172.21.15.152:0/3129230274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345ecb40 0x55ac345eb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd691331640 1 -- 172.21.15.152:0/3129230274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 msgr2=0x55ac345eba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd691331640 1 --2- 172.21.15.152:0/3129230274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345eba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd691331640 1 -- 172.21.15.152:0/3129230274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac344dd3a0 con 0x55ac345f6370 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.608+0000 7fd691b32640 1 --2- 172.21.15.152:0/3129230274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.609+0000 7fd691331640 1 --2- 172.21.15.152:0/3129230274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f8760 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd67c031550 tx=0x7fd67c032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f217655373a0cf19 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:09.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.609+0000 7fd692333640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6780a2ea0 0x7fd6780a5360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd684005d80 tx=0x7fd684004730 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.609+0000 7fd677fff640 1 -- 172.21.15.152:0/3129230274 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c03f070 con 0x55ac345f6370 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.609+0000 7fd677fff640 1 -- 172.21.15.152:0/3129230274 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd67c032e20 con 0x55ac345f6370 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.609+0000 7fd677fff640 1 -- 172.21.15.152:0/3129230274 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c035070 con 0x55ac345f6370 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.610+0000 7fd69616f740 1 -- 172.21.15.152:0/3129230274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 msgr2=0x55ac345f8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.610+0000 7fd69616f740 1 --2- 172.21.15.152:0/3129230274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f8760 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd67c031550 tx=0x7fd67c032c30 comp rx=0 tx=0).stop 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.610+0000 7fd69616f740 1 -- 172.21.15.152:0/3129230274 shutdown_connections 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.610+0000 7fd69616f740 1 --2- 172.21.15.152:0/3129230274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f8760 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.610+0000 7fd69616f740 1 --2- 172.21.15.152:0/3129230274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.610+0000 7fd69616f740 1 --2- 172.21.15.152:0/3129230274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345ecb40 0x55ac345eb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.610+0000 7fd69616f740 1 -- 172.21.15.152:0/3129230274 >> 172.21.15.152:0/3129230274 conn(0x55ac345b4310 msgr2=0x55ac345e7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.610+0000 7fd69616f740 1 -- 172.21.15.152:0/3129230274 shutdown_connections 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.610+0000 7fd69616f740 1 -- 172.21.15.152:0/3129230274 wait complete. 2024-09-11T22:05:09.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.610+0000 7fd69616f740 1 -- start start 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.610+0000 7fd69616f740 1 Processor -- start 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd69616f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd69616f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345ecb40 0x55ac345f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd69616f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd69616f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ac345f9010 con 0x55ac345f6370 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd69616f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ac3450c060 con 0x55ac345eb5d0 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd69616f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ac345f9190 con 0x55ac345ecb40 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd69616f740 10 client.0 _ll_register_callbacks cb 0x55ac3425f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd692333640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd692333640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52988/0 (socket says 172.21.15.152:52988) 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd692333640 1 -- 172.21.15.152:0/732202253 learned_addr learned my addr 172.21.15.152:0/732202253 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:09.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd691b32640 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd691331640 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345ecb40 0x55ac345f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd692333640 1 -- 172.21.15.152:0/732202253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345ecb40 msgr2=0x55ac345f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd692333640 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345ecb40 0x55ac345f2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd692333640 1 -- 172.21.15.152:0/732202253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 msgr2=0x55ac345f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd692333640 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd692333640 1 -- 172.21.15.152:0/732202253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac342c23c0 con 0x55ac345f6370 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd691331640 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345ecb40 0x55ac345f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd692333640 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f34f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd684005880 tx=0x7fd6840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a24ebe8b36631e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd6757fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd6757fa640 1 -- 172.21.15.152:0/732202253 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684005220 con 0x55ac345f6370 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd6757fa640 1 -- 172.21.15.152:0/732202253 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd6840053c0 con 0x55ac345f6370 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd69616f740 1 -- 172.21.15.152:0/732202253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd67c032e20 con 0x55ac345f6370 2024-09-11T22:05:09.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd6757fa640 1 -- 172.21.15.152:0/732202253 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd6840055c0 con 0x55ac345f6370 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd69616f740 10 client.15582 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.611+0000 7fd69616f740 1 -- 172.21.15.152:0/732202253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ac346049f0 con 0x55ac345f6370 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.612+0000 7fd6757fa640 1 -- 172.21.15.152:0/732202253 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd67c032e20 con 0x55ac345f6370 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.612+0000 7fd6757fa640 1 -- 172.21.15.152:0/732202253 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fd68402f070 con 0x55ac345f6370 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.612+0000 7fd69616f740 10 client.15582 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.612+0000 7fd69616f740 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.612+0000 7fd69616f740 20 client.15582 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.612+0000 7fd69616f740 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac34605e00 0x55ac346082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.612+0000 7fd69616f740 4 client.15582 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.612+0000 7fd69616f740 1 -- 172.21.15.152:0/732202253 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac3455e860 con 0x55ac34605e00 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.612+0000 7fd691b32640 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac34605e00 0x55ac346082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.613+0000 7fd691b32640 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac34605e00 0x55ac346082c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53cb290f2ebde7e2 server_cookie=fc460b01c3e5097c in_seq=0 out_seq=0 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.613+0000 7fd6757fa640 10 client.15582 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.613+0000 7fd6757fa640 1 -- 172.21.15.152:0/732202253 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac3455e860 con 0x55ac34605e00 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.613+0000 7fd6757fa640 10 client.15582 handle_command_reply: tid=0 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.613+0000 7fd69616f740 1 client.15582 shutdown 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd69616f740 1 -- 172.21.15.152:0/732202253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 msgr2=0x55ac345f34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd69616f740 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f34f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd684005880 tx=0x7fd6840046c0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd69616f740 1 -- 172.21.15.152:0/732202253 shutdown_connections 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd69616f740 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac34605e00 0x55ac346082c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd69616f740 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345f6370 0x55ac345f34f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd69616f740 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345ecb40 0x55ac345f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd6757fa640 0 client.15582 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd69616f740 1 --2- 172.21.15.152:0/732202253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd69616f740 1 -- 172.21.15.152:0/732202253 >> 172.21.15.152:0/732202253 conn(0x55ac345b4310 msgr2=0x55ac345ed960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:09.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd69616f740 1 -- 172.21.15.152:0/732202253 shutdown_connections 2024-09-11T22:05:09.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd69616f740 1 -- 172.21.15.152:0/732202253 wait complete. 2024-09-11T22:05:09.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.614+0000 7fd69616f740 20 client.15582 trim_cache size 0 max 16384 2024-09-11T22:05:09.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd69616f740 1 Processor -- start 2024-09-11T22:05:09.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd69616f740 1 -- start start 2024-09-11T22:05:09.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd69616f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd69616f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd69616f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345f6370 0x55ac345ee660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd69616f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c1b0240 con 0x55ac345ecb40 2024-09-11T22:05:09.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd69616f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c1adae0 con 0x55ac345eb5d0 2024-09-11T22:05:09.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd69616f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c1ab930 con 0x55ac345f6370 2024-09-11T22:05:09.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd691331640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd691331640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345ee120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52990/0 (socket says 172.21.15.152:52990) 2024-09-11T22:05:09.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd691331640 1 -- 172.21.15.152:0/1625609 learned_addr learned my addr 172.21.15.152:0/1625609 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:09.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd691b32640 1 --2- 172.21.15.152:0/1625609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.627+0000 7fd692333640 1 --2- 172.21.15.152:0/1625609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345f6370 0x55ac345ee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.628+0000 7fd691331640 1 -- 172.21.15.152:0/1625609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345f6370 msgr2=0x55ac345ee660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:09.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.628+0000 7fd691331640 1 --2- 172.21.15.152:0/1625609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345f6370 0x55ac345ee660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.628+0000 7fd691331640 1 -- 172.21.15.152:0/1625609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 msgr2=0x55ac345f4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.628+0000 7fd691331640 1 --2- 172.21.15.152:0/1625609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.628+0000 7fd691331640 1 -- 172.21.15.152:0/1625609 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac345eeba0 con 0x55ac345ecb40 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.628+0000 7fd692333640 1 --2- 172.21.15.152:0/1625609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345f6370 0x55ac345ee660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.628+0000 7fd691b32640 1 --2- 172.21.15.152:0/1625609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.628+0000 7fd691331640 1 --2- 172.21.15.152:0/1625609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345ee120 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd67c031550 tx=0x7fd67c032ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bc9822e860adcd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.628+0000 7fd6777fe640 1 -- 172.21.15.152:0/1625609 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c03f070 con 0x55ac345ecb40 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.628+0000 7fd6777fe640 1 -- 172.21.15.152:0/1625609 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd67c0318b0 con 0x55ac345ecb40 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.628+0000 7fd6777fe640 1 -- 172.21.15.152:0/1625609 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c035040 con 0x55ac345ecb40 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.629+0000 7fd69616f740 1 -- 172.21.15.152:0/1625609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 msgr2=0x55ac345ee120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.629+0000 7fd69616f740 1 --2- 172.21.15.152:0/1625609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345ee120 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd67c031550 tx=0x7fd67c032ea0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.629+0000 7fd69616f740 1 -- 172.21.15.152:0/1625609 shutdown_connections 2024-09-11T22:05:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.629+0000 7fd69616f740 1 --2- 172.21.15.152:0/1625609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345f6370 0x55ac345ee660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.629+0000 7fd69616f740 1 --2- 172.21.15.152:0/1625609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345ee120 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.629+0000 7fd69616f740 1 --2- 172.21.15.152:0/1625609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.629+0000 7fd69616f740 1 -- 172.21.15.152:0/1625609 >> 172.21.15.152:0/1625609 conn(0x55ac345b4310 msgr2=0x55ac345f47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.629+0000 7fd69616f740 1 -- 172.21.15.152:0/1625609 shutdown_connections 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.629+0000 7fd69616f740 1 -- 172.21.15.152:0/1625609 wait complete. 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.629+0000 7fd69616f740 1 -- start start 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.629+0000 7fd69616f740 1 Processor -- start 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd69616f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd69616f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd69616f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345f6370 0x55ac345f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd69616f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c1abfa0 con 0x55ac345ecb40 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd69616f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c1ad410 con 0x55ac345eb5d0 2024-09-11T22:05:09.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd69616f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c1ac670 con 0x55ac345f6370 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd69616f740 10 client.0 _ll_register_callbacks cb 0x7fd68400b7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd691331640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd691331640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345f05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53000/0 (socket says 172.21.15.152:53000) 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd691331640 1 -- 172.21.15.152:0/2172738586 learned_addr learned my addr 172.21.15.152:0/2172738586 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd691b32640 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd692333640 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345f6370 0x55ac345f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd691331640 1 -- 172.21.15.152:0/2172738586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345f6370 msgr2=0x55ac345f0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd691331640 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345f6370 0x55ac345f0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd691331640 1 -- 172.21.15.152:0/2172738586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 msgr2=0x55ac345f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd691331640 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd691331640 1 -- 172.21.15.152:0/2172738586 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac3466fc10 con 0x55ac345ecb40 2024-09-11T22:05:09.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd691b32640 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:09.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd691331640 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345f05e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009900 tx=0x7fd67c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec49bba8088e867 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:09.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.630+0000 7fd6757fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:09.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd6757fa640 1 -- 172.21.15.152:0/2172738586 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c053070 con 0x55ac345ecb40 2024-09-11T22:05:09.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd6757fa640 1 -- 172.21.15.152:0/2172738586 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd67c003e70 con 0x55ac345ecb40 2024-09-11T22:05:09.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd69616f740 1 -- 172.21.15.152:0/2172738586 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd67c0318b0 con 0x55ac345ecb40 2024-09-11T22:05:09.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd6757fa640 1 -- 172.21.15.152:0/2172738586 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd67c035030 con 0x55ac345ecb40 2024-09-11T22:05:09.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd69616f740 10 client.15588 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd69616f740 1 -- 172.21.15.152:0/2172738586 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ac34670e60 con 0x55ac345ecb40 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd6757fa640 1 -- 172.21.15.152:0/2172738586 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd67c0318b0 con 0x55ac345ecb40 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd6757fa640 1 -- 172.21.15.152:0/2172738586 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fd67c03bc80 con 0x55ac345ecb40 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd69616f740 10 client.15588 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd69616f740 10 client.15588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd69616f740 20 client.15588 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd69616f740 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac34671180 0x55ac346735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd69616f740 4 client.15588 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.631+0000 7fd69616f740 1 -- 172.21.15.152:0/2172738586 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ac34558d70 con 0x55ac34671180 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.632+0000 7fd691b32640 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac34671180 0x55ac346735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.632+0000 7fd691b32640 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac34671180 0x55ac346735a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c6f7cffc532876a server_cookie=d7c36c695efac0ce in_seq=0 out_seq=0 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.632+0000 7fd6757fa640 10 client.15588 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:09.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.632+0000 7fd6757fa640 1 -- 172.21.15.152:0/2172738586 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ac34558d70 con 0x55ac34671180 2024-09-11T22:05:09.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.632+0000 7fd6757fa640 10 client.15588 handle_command_reply: tid=0 2024-09-11T22:05:09.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.632+0000 7fd69616f740 1 client.15588 shutdown 2024-09-11T22:05:09.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.632+0000 7fd69616f740 1 -- 172.21.15.152:0/2172738586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 msgr2=0x55ac345f05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:09.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.632+0000 7fd69616f740 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345f05e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009900 tx=0x7fd67c003820 comp rx=0 tx=0).stop 2024-09-11T22:05:09.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.632+0000 7fd69616f740 1 -- 172.21.15.152:0/2172738586 shutdown_connections 2024-09-11T22:05:09.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.632+0000 7fd69616f740 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac34671180 0x55ac346735a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd69616f740 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac345f6370 0x55ac345f0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd69616f740 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac345ecb40 0x55ac345f05e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd6757fa640 0 client.15588 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:09.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd69616f740 1 --2- 172.21.15.152:0/2172738586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac345eb5d0 0x55ac345f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd69616f740 1 -- 172.21.15.152:0/2172738586 >> 172.21.15.152:0/2172738586 conn(0x55ac345b4310 msgr2=0x55ac345f5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:09.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd69616f740 1 -- 172.21.15.152:0/2172738586 shutdown_connections 2024-09-11T22:05:09.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd69616f740 1 -- 172.21.15.152:0/2172738586 wait complete. 2024-09-11T22:05:09.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd69616f740 20 client.15588 trim_cache size 0 max 16384 2024-09-11T22:05:09.647 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:05:09.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 -- 172.21.15.152:0/2050663647 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6780a2ea0 msgr2=0x7fd6780a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:09.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6780a2ea0 0x7fd6780a5360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd684005d80 tx=0x7fd684004730 comp rx=0 tx=0).stop 2024-09-11T22:05:09.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 -- 172.21.15.152:0/2050663647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd68c102d40 msgr2=0x7fd68c198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:09.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd68c102d40 0x7fd68c198550 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd68800ea80 tx=0x7fd68800ef40 comp rx=0 tx=0).stop 2024-09-11T22:05:09.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 -- 172.21.15.152:0/2050663647 shutdown_connections 2024-09-11T22:05:09.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6780a2ea0 0x7fd6780a5360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd68c10c170 0x7fd68c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c103660 0x7fd68c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 --2- 172.21.15.152:0/2050663647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd68c102d40 0x7fd68c198550 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:09.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 -- 172.21.15.152:0/2050663647 >> 172.21.15.152:0/2050663647 conn(0x7fd68c0fc7a0 msgr2=0x7fd68c0fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:09.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 -- 172.21.15.152:0/2050663647 shutdown_connections 2024-09-11T22:05:09.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:09.633+0000 7fd693d96640 1 -- 172.21.15.152:0/2050663647 wait complete. 2024-09-11T22:05:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:09 smithi179 ceph-mon[35603]: pgmap v29: 97 pgs: 97 active+clean; 189 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 23 MiB/s wr, 592 op/s 2024-09-11T22:05:09.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:09 smithi193 ceph-mon[35545]: pgmap v29: 97 pgs: 97 active+clean; 189 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 23 MiB/s wr, 592 op/s 2024-09-11T22:05:11.290 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:05:11.291 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:05:11.548 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:11.669 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:11 smithi152 ceph-mon[31188]: pgmap v30: 97 pgs: 97 active+clean; 189 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 23 MiB/s wr, 583 op/s 2024-09-11T22:05:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:11 smithi179 ceph-mon[35603]: pgmap v30: 97 pgs: 97 active+clean; 189 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 23 MiB/s wr, 583 op/s 2024-09-11T22:05:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:11 smithi193 ceph-mon[35545]: pgmap v30: 97 pgs: 97 active+clean; 189 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 23 MiB/s wr, 583 op/s 2024-09-11T22:05:12.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.970+0000 7fb01d8af640 1 -- 172.21.15.152:0/2586750138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb018106f10 msgr2=0x7fb01810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:12.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.970+0000 7fb01d8af640 1 --2- 172.21.15.152:0/2586750138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb018106f10 0x7fb01810ea90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb008009ca0 tx=0x7fb00802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.970+0000 7fb01d8af640 1 -- 172.21.15.152:0/2586750138 shutdown_connections 2024-09-11T22:05:12.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.970+0000 7fb01d8af640 1 --2- 172.21.15.152:0/2586750138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb018106f10 0x7fb01810ea90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.970+0000 7fb01d8af640 1 --2- 172.21.15.152:0/2586750138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb018102790 0x7fb0181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.970+0000 7fb01d8af640 1 --2- 172.21.15.152:0/2586750138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb018101de0 0x7fb0181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.970+0000 7fb01d8af640 1 -- 172.21.15.152:0/2586750138 >> 172.21.15.152:0/2586750138 conn(0x7fb0180fd8c0 msgr2=0x7fb0180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.970+0000 7fb01d8af640 1 -- 172.21.15.152:0/2586750138 shutdown_connections 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.971+0000 7fb01d8af640 1 -- 172.21.15.152:0/2586750138 wait complete. 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.971+0000 7fb01d8af640 1 Processor -- start 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.971+0000 7fb01d8af640 1 -- start start 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.971+0000 7fb01d8af640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb018101de0 0x7fb0181983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb01d8af640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb018102790 0x7fb018198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb01d8af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb018106f10 0x7fb01819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb01d8af640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb018111f70 con 0x7fb018101de0 2024-09-11T22:05:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb01d8af640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb018111df0 con 0x7fb018106f10 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb01d8af640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0181120f0 con 0x7fb018102790 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb016ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb018101de0 0x7fb0181983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb016ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb018101de0 0x7fb0181983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53014/0 (socket says 172.21.15.152:53014) 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb016ffd640 1 -- 172.21.15.152:0/2040809588 learned_addr learned my addr 172.21.15.152:0/2040809588 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb0177fe640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb018106f10 0x7fb01819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb0167fc640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb018102790 0x7fb018198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb016ffd640 1 -- 172.21.15.152:0/2040809588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb018102790 msgr2=0x7fb018198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb016ffd640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb018102790 0x7fb018198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb016ffd640 1 -- 172.21.15.152:0/2040809588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb018106f10 msgr2=0x7fb01819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb016ffd640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb018106f10 0x7fb01819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb016ffd640 1 -- 172.21.15.152:0/2040809588 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01819d3a0 con 0x7fb018101de0 2024-09-11T22:05:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb016ffd640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb018101de0 0x7fb0181983f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb01000d950 tx=0x7fb01000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb01c8ad640 1 -- 172.21.15.152:0/2040809588 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010017070 con 0x7fb018101de0 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb01d8af640 1 -- 172.21.15.152:0/2040809588 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01819d690 con 0x7fb018101de0 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb01c8ad640 1 -- 172.21.15.152:0/2040809588 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb010009c30 con 0x7fb018101de0 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb01c8ad640 1 -- 172.21.15.152:0/2040809588 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01000f6b0 con 0x7fb018101de0 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.972+0000 7fb01d8af640 1 -- 172.21.15.152:0/2040809588 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0181a4f70 con 0x7fb018101de0 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb01c8ad640 1 -- 172.21.15.152:0/2040809588 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7fb0100109d0 con 0x7fb018101de0 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb01fc88740 1 Processor -- start 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb01fc88740 1 -- start start 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb01c8ad640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0000a2ea0 0x7fb0000a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be8593ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be8594a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be8594d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb0177fe640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0000a2ea0 0x7fb0000a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb01fc88740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55be858a5280 con 0x55be85940480 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb01fc88740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55be8584cb10 con 0x55be8593fb60 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb01fc88740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55be858a1240 con 0x55be8594ad40 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.975+0000 7fb01c8ad640 1 -- 172.21.15.152:0/2040809588 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb0100cf7a0 con 0x7fb018101de0 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0167fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be8594a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0167fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be8594a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53018/0 (socket says 172.21.15.152:53018) 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0167fc640 1 -- 172.21.15.152:0/1391075466 learned_addr learned my addr 172.21.15.152:0/1391075466 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0177fe640 1 --2- 172.21.15.152:0/1391075466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be8594d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0167fc640 1 -- 172.21.15.152:0/1391075466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 msgr2=0x55be8594d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0167fc640 1 --2- 172.21.15.152:0/1391075466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be8594d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0167fc640 1 -- 172.21.15.152:0/1391075466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 msgr2=0x55be8593ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0167fc640 1 --2- 172.21.15.152:0/1391075466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be8593ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0167fc640 1 -- 172.21.15.152:0/1391075466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be858591f0 con 0x55be85940480 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0177fe640 1 --2- 172.21.15.152:0/1391075466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be8594d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0167fc640 1 --2- 172.21.15.152:0/1391075466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be8594a800 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00bc00 tx=0x7fb00c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d21242ac14ff43 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7fb0177fe640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0000a2ea0 0x7fb0000a5360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55be8593d470 tx=0x7fb008005ef0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7faffdffb640 1 -- 172.21.15.152:0/1391075466 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c015070 con 0x55be85940480 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7faffdffb640 1 -- 172.21.15.152:0/1391075466 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb00c005500 con 0x55be85940480 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.976+0000 7faffdffb640 1 -- 172.21.15.152:0/1391075466 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0116a0 con 0x55be85940480 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.977+0000 7fb01fc88740 1 -- 172.21.15.152:0/1391075466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 msgr2=0x55be8594a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.977+0000 7fb01fc88740 1 --2- 172.21.15.152:0/1391075466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be8594a800 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00bc00 tx=0x7fb00c00f730 comp rx=0 tx=0).stop 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.977+0000 7fb01fc88740 1 -- 172.21.15.152:0/1391075466 shutdown_connections 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.977+0000 7fb01fc88740 1 --2- 172.21.15.152:0/1391075466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be8594d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.977+0000 7fb01fc88740 1 --2- 172.21.15.152:0/1391075466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be8594a800 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.977+0000 7fb01fc88740 1 --2- 172.21.15.152:0/1391075466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be8593ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.977+0000 7fb01fc88740 1 -- 172.21.15.152:0/1391075466 >> 172.21.15.152:0/1391075466 conn(0x55be8593c0f0 msgr2=0x55be8593c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.977+0000 7fb01fc88740 1 -- 172.21.15.152:0/1391075466 shutdown_connections 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.977+0000 7fb01fc88740 1 -- 172.21.15.152:0/1391075466 wait complete. 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.977+0000 7fb01fc88740 1 -- start start 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb01fc88740 1 Processor -- start 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8593fb60 0x55be85947c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be85940480 0x55be859481b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be859486f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb01fc88740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55be8594d910 con 0x55be8593fb60 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb01fc88740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55be8585ff10 con 0x55be85940480 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb01fc88740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55be8594da90 con 0x55be8594ad40 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb01fc88740 10 client.0 _ll_register_callbacks cb 0x55be85828a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb016ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8593fb60 0x55be85947c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb016ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8593fb60 0x55be85947c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53024/0 (socket says 172.21.15.152:53024) 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb016ffd640 1 -- 172.21.15.152:0/2375248940 learned_addr learned my addr 172.21.15.152:0/2375248940 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb0177fe640 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be859486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb016ffd640 1 -- 172.21.15.152:0/2375248940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 msgr2=0x55be859486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb016ffd640 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be859486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb0167fc640 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be85940480 0x55be859481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb016ffd640 1 -- 172.21.15.152:0/2375248940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be85940480 msgr2=0x55be859481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb016ffd640 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be85940480 0x55be859481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.978+0000 7fb016ffd640 1 -- 172.21.15.152:0/2375248940 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be856166a0 con 0x55be8593fb60 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7fb016ffd640 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8593fb60 0x55be85947c70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb010009610 tx=0x7fb010009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220b937bc3d17a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7faff6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7faff6ffd640 1 -- 172.21.15.152:0/2375248940 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010020070 con 0x55be8593fb60 2024-09-11T22:05:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7faff6ffd640 1 -- 172.21.15.152:0/2375248940 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb0100a4430 con 0x55be8593fb60 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7fb01fc88740 1 -- 172.21.15.152:0/2375248940 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb00c005500 con 0x55be8593fb60 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7faff6ffd640 1 -- 172.21.15.152:0/2375248940 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb01009fe00 con 0x55be8593fb60 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7fb01fc88740 10 client.15600 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7fb01fc88740 1 -- 172.21.15.152:0/2375248940 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55be85959540 con 0x55be8593fb60 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7faff6ffd640 1 -- 172.21.15.152:0/2375248940 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb00c005500 con 0x55be8593fb60 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7faff6ffd640 1 -- 172.21.15.152:0/2375248940 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fb0100978c0 con 0x55be8593fb60 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7fb01fc88740 10 client.15600 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7fb01fc88740 10 client.15600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7fb01fc88740 20 client.15600 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7fb01fc88740 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55be8595a950 0x55be8595cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7fb01fc88740 4 client.15600 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.979+0000 7fb01fc88740 1 -- 172.21.15.152:0/2375248940 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be858b27f0 con 0x55be8595a950 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.980+0000 7fb0167fc640 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55be8595a950 0x55be8595cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.980+0000 7fb0167fc640 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55be8595a950 0x55be8595cd80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3a68dda08be4412 server_cookie=4786d5bdac5b113e in_seq=0 out_seq=0 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.980+0000 7faff6ffd640 10 client.15600 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7faff6ffd640 1 -- 172.21.15.152:0/2375248940 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be858b27f0 con 0x55be8595a950 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7faff6ffd640 10 client.15600 handle_command_reply: tid=0 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 1 client.15600 shutdown 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 1 -- 172.21.15.152:0/2375248940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8593fb60 msgr2=0x55be85947c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8593fb60 0x55be85947c70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb010009610 tx=0x7fb010009ea0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 1 -- 172.21.15.152:0/2375248940 shutdown_connections 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55be8595a950 0x55be8595cd80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be859486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be85940480 0x55be859481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 1 --2- 172.21.15.152:0/2375248940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8593fb60 0x55be85947c70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7faff6ffd640 0 client.15600 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 1 -- 172.21.15.152:0/2375248940 >> 172.21.15.152:0/2375248940 conn(0x55be8593c0f0 msgr2=0x55be85941e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 1 -- 172.21.15.152:0/2375248940 shutdown_connections 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 1 -- 172.21.15.152:0/2375248940 wait complete. 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.981+0000 7fb01fc88740 20 client.15600 trim_cache size 0 max 16384 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb01fc88740 1 Processor -- start 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb01fc88740 1 -- start start 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be85962650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be85940480 0x55be85962b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8594ad40 0x55be85944ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb01fc88740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb0181b01e0 con 0x55be8594ad40 2024-09-11T22:05:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb01fc88740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb0181ada80 con 0x55be8593fb60 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb01fc88740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0181ab8d0 con 0x55be85940480 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb0177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8594ad40 0x55be85944ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb0177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8594ad40 0x55be85944ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53026/0 (socket says 172.21.15.152:53026) 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb0177fe640 1 -- 172.21.15.152:0/195207351 learned_addr learned my addr 172.21.15.152:0/195207351 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb016ffd640 1 --2- 172.21.15.152:0/195207351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be85962650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb0167fc640 1 --2- 172.21.15.152:0/195207351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be85940480 0x55be85962b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb0177fe640 1 -- 172.21.15.152:0/195207351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be85940480 msgr2=0x55be85962b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb0177fe640 1 --2- 172.21.15.152:0/195207351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be85940480 0x55be85962b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb0177fe640 1 -- 172.21.15.152:0/195207351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 msgr2=0x55be85962650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.998+0000 7fb0177fe640 1 --2- 172.21.15.152:0/195207351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be85962650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.999+0000 7fb0177fe640 1 -- 172.21.15.152:0/195207351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be85946c20 con 0x55be8594ad40 2024-09-11T22:05:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.999+0000 7fb016ffd640 1 --2- 172.21.15.152:0/195207351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be85962650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.999+0000 7fb0167fc640 1 --2- 172.21.15.152:0/195207351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be85940480 0x55be85962b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.999+0000 7fb0177fe640 1 --2- 172.21.15.152:0/195207351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8594ad40 0x55be85944ed0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb008004a90 tx=0x7fb00803f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8eb21972665b04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.999+0000 7faffd7fa640 1 -- 172.21.15.152:0/195207351 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00803c1d0 con 0x55be8594ad40 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.999+0000 7faffd7fa640 1 -- 172.21.15.152:0/195207351 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb008036070 con 0x55be8594ad40 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.999+0000 7faffd7fa640 1 -- 172.21.15.152:0/195207351 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008004850 con 0x55be8594ad40 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.999+0000 7fb01fc88740 1 -- 172.21.15.152:0/195207351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8594ad40 msgr2=0x55be85944ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:11.999+0000 7fb01fc88740 1 --2- 172.21.15.152:0/195207351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8594ad40 0x55be85944ed0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb008004a90 tx=0x7fb00803f040 comp rx=0 tx=0).stop 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 -- 172.21.15.152:0/195207351 shutdown_connections 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 --2- 172.21.15.152:0/195207351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be8594ad40 0x55be85944ed0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 --2- 172.21.15.152:0/195207351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be85940480 0x55be85962b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 --2- 172.21.15.152:0/195207351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be85962650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 -- 172.21.15.152:0/195207351 >> 172.21.15.152:0/195207351 conn(0x55be8593c0f0 msgr2=0x55be8593b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:12.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 -- 172.21.15.152:0/195207351 shutdown_connections 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 -- 172.21.15.152:0/195207351 wait complete. 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 -- start start 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 Processor -- start 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be85952d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be85953260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be8594f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb0181abf40 con 0x55be85940480 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb0181ad3b0 con 0x55be8593fb60 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0181ac610 con 0x55be8594ad40 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb01fc88740 10 client.0 _ll_register_callbacks cb 0x7fb01009b590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.000+0000 7fb0167fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be85953260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb0167fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be85953260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53032/0 (socket says 172.21.15.152:53032) 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb0167fc640 1 -- 172.21.15.152:0/3846445412 learned_addr learned my addr 172.21.15.152:0/3846445412 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb0177fe640 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be8594f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb016ffd640 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be85952d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb0167fc640 1 -- 172.21.15.152:0/3846445412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 msgr2=0x55be8594f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb0167fc640 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be8594f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb0167fc640 1 -- 172.21.15.152:0/3846445412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 msgr2=0x55be85952d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb0167fc640 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be85952d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb0167fc640 1 -- 172.21.15.152:0/3846445412 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be8594f9d0 con 0x55be85940480 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb0167fc640 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be85953260 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00bc00 tx=0x7fb00c004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf713f9b8a73241 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7faff6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7faff6ffd640 1 -- 172.21.15.152:0/3846445412 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c02d060 con 0x55be85940480 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7faff6ffd640 1 -- 172.21.15.152:0/3846445412 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb00c004d50 con 0x55be85940480 2024-09-11T22:05:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb01fc88740 1 -- 172.21.15.152:0/3846445412 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb008036070 con 0x55be85940480 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7faff6ffd640 1 -- 172.21.15.152:0/3846445412 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb00c015040 con 0x55be85940480 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb01fc88740 10 client.15606 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7fb01fc88740 1 -- 172.21.15.152:0/3846445412 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55be859c6110 con 0x55be85940480 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.001+0000 7faff6ffd640 1 -- 172.21.15.152:0/3846445412 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb008036070 con 0x55be85940480 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.002+0000 7faff6ffd640 1 -- 172.21.15.152:0/3846445412 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fb00c026630 con 0x55be85940480 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.002+0000 7fb01fc88740 10 client.15606 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.002+0000 7fb01fc88740 10 client.15606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.002+0000 7fb01fc88740 20 client.15606 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.002+0000 7fb01fc88740 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55be859c65b0 0x55be859c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.002+0000 7fb01fc88740 4 client.15606 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.002+0000 7fb01fc88740 1 -- 172.21.15.152:0/3846445412 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55be858acd00 con 0x55be859c65b0 2024-09-11T22:05:12.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.002+0000 7fb016ffd640 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55be859c65b0 0x55be859c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.002+0000 7faff6ffd640 10 client.15606 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.002+0000 7fb016ffd640 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55be859c65b0 0x55be859c89a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aa0b3ab6e650f0a server_cookie=4ad81cfd394f2b80 in_seq=0 out_seq=0 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7faff6ffd640 1 -- 172.21.15.152:0/3846445412 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55be858acd00 con 0x55be859c65b0 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7faff6ffd640 10 client.15606 handle_command_reply: tid=0 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 1 client.15606 shutdown 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 1 -- 172.21.15.152:0/3846445412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 msgr2=0x55be85953260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be85953260 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00bc00 tx=0x7fb00c004bc0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 1 -- 172.21.15.152:0/3846445412 shutdown_connections 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55be859c65b0 0x55be859c89a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55be8594ad40 0x55be8594f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be85940480 0x55be85953260 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 1 --2- 172.21.15.152:0/3846445412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be8593fb60 0x55be85952d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7faff6ffd640 0 client.15606 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:12.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 1 -- 172.21.15.152:0/3846445412 >> 172.21.15.152:0/3846445412 conn(0x55be8593c0f0 msgr2=0x55be85941600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:12.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 1 -- 172.21.15.152:0/3846445412 shutdown_connections 2024-09-11T22:05:12.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 1 -- 172.21.15.152:0/3846445412 wait complete. 2024-09-11T22:05:12.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.003+0000 7fb01fc88740 20 client.15606 trim_cache size 0 max 16384 2024-09-11T22:05:12.040 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:05:12.040 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:05:12.040 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "5b43a1ca-26fb-450d-8525-6622a4201d20", 2024-09-11T22:05:12.040 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:05:12.041 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:05:12.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 -- 172.21.15.152:0/2040809588 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0000a2ea0 msgr2=0x7fb0000a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:12.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0000a2ea0 0x7fb0000a5360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55be8593d470 tx=0x7fb008005ef0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 -- 172.21.15.152:0/2040809588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb018101de0 msgr2=0x7fb0181983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:12.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb018101de0 0x7fb0181983f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb01000d950 tx=0x7fb01000de10 comp rx=0 tx=0).stop 2024-09-11T22:05:12.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 -- 172.21.15.152:0/2040809588 shutdown_connections 2024-09-11T22:05:12.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0000a2ea0 0x7fb0000a5360 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb018106f10 0x7fb01819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb018102790 0x7fb018198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 --2- 172.21.15.152:0/2040809588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb018101de0 0x7fb0181983f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:12.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 -- 172.21.15.152:0/2040809588 >> 172.21.15.152:0/2040809588 conn(0x7fb0180fd8c0 msgr2=0x7fb0180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:12.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 -- 172.21.15.152:0/2040809588 shutdown_connections 2024-09-11T22:05:12.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:12.004+0000 7fb01d8af640 1 -- 172.21.15.152:0/2040809588 wait complete. 2024-09-11T22:05:12.588 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:05:12.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:12 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:05:12.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:12 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:05:12.835 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:12.957 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:12 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:05:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.318+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/2984147017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c98101df0 msgr2=0x7f0c981021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.318+0000 7f0c9f4f9640 1 --2- 172.21.15.152:0/2984147017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c98101df0 0x7f0c981021d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009ca0 tx=0x7f0c8802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.319+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/2984147017 shutdown_connections 2024-09-11T22:05:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.319+0000 7f0c9f4f9640 1 --2- 172.21.15.152:0/2984147017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c98106f20 0x7f0c9810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.319+0000 7f0c9f4f9640 1 --2- 172.21.15.152:0/2984147017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c981027a0 0x7f0c981067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.319+0000 7f0c9f4f9640 1 --2- 172.21.15.152:0/2984147017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c98101df0 0x7f0c981021d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.319+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/2984147017 >> 172.21.15.152:0/2984147017 conn(0x7f0c980fd8f0 msgr2=0x7f0c980ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.319+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/2984147017 shutdown_connections 2024-09-11T22:05:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.319+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/2984147017 wait complete. 2024-09-11T22:05:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.319+0000 7f0c9f4f9640 1 Processor -- start 2024-09-11T22:05:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.319+0000 7f0c9f4f9640 1 -- start start 2024-09-11T22:05:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.319+0000 7f0c9f4f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c98101df0 0x7f0c9819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9f4f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c981027a0 0x7f0c9819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9f4f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c98106f20 0x7f0c9819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9f4f9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0c98111f80 con 0x7f0c98106f20 2024-09-11T22:05:13.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9f4f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0c98111e00 con 0x7f0c98101df0 2024-09-11T22:05:13.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9f4f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0c98112100 con 0x7f0c981027a0 2024-09-11T22:05:13.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9da96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c98106f20 0x7f0c9819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9da96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c98106f20 0x7f0c9819efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53036/0 (socket says 172.21.15.152:53036) 2024-09-11T22:05:13.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9da96640 1 -- 172.21.15.152:0/3654113240 learned_addr learned my addr 172.21.15.152:0/3654113240 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:13.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c981027a0 0x7f0c9819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9d295640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c98101df0 0x7f0c9819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9da96640 1 -- 172.21.15.152:0/3654113240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c981027a0 msgr2=0x7f0c9819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:13.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9da96640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c981027a0 0x7f0c9819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9da96640 1 -- 172.21.15.152:0/3654113240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c98101df0 msgr2=0x7f0c9819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:13.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9da96640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c98101df0 0x7f0c9819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9da96640 1 -- 172.21.15.152:0/3654113240 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9819f690 con 0x7f0c98106f20 2024-09-11T22:05:13.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9d295640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c98101df0 0x7f0c9819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:13.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9da96640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c98106f20 0x7f0c9819efb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000d750 tx=0x7f0c9000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:13.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c967fc640 1 -- 172.21.15.152:0/3654113240 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90017070 con 0x7f0c98106f20 2024-09-11T22:05:13.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/3654113240 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9819f980 con 0x7f0c98106f20 2024-09-11T22:05:13.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c967fc640 1 -- 172.21.15.152:0/3654113240 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c90005500 con 0x7f0c98106f20 2024-09-11T22:05:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.320+0000 7f0c967fc640 1 -- 172.21.15.152:0/3654113240 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90004d90 con 0x7f0c98106f20 2024-09-11T22:05:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.321+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/3654113240 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c981a7260 con 0x7f0c98106f20 2024-09-11T22:05:13.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.323+0000 7f0c967fc640 1 -- 172.21.15.152:0/3654113240 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7f0c90004f30 con 0x7f0c98106f20 2024-09-11T22:05:13.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.323+0000 7f0ca18d2740 1 Processor -- start 2024-09-11T22:05:13.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.323+0000 7f0ca18d2740 1 -- start start 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 0x55f8cd0daa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f8cd0332e0 con 0x55f8cd0d8680 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f8ccfdace0 con 0x55f8cd0cd4a0 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f8cd02f2a0 con 0x55f8cd0cddc0 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c967fc640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0c800a2ea0 0x7f0c800a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9ca94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9d295640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9da96640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0c800a2ea0 0x7f0c800a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9ca94640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 0x55f8cd0daa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9d295640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:56670/0 (socket says 172.21.15.152:56670) 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9d295640 1 -- 172.21.15.152:0/2789941225 learned_addr learned my addr 172.21.15.152:0/2789941225 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c967fc640 1 -- 172.21.15.152:0/3654113240 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f0c900cf0b0 con 0x7f0c98106f20 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9ca94640 1 -- 172.21.15.152:0/2789941225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 msgr2=0x55f8cd0d8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/2789941225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9ca94640 1 -- 172.21.15.152:0/2789941225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 msgr2=0x55f8cd0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/2789941225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9ca94640 1 -- 172.21.15.152:0/2789941225 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ccfbf440 con 0x55f8cd0d8680 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9d295640 1 --2- 172.21.15.152:0/2789941225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/2789941225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 0x55f8cd0daa70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0c980fe160 tx=0x7f0c8c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea8ad164d5645c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c9da96640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0c800a2ea0 0x7f0c800a5360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c900cc5f0 tx=0x7f0c900c5ef0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.324+0000 7f0c7f7fe640 1 -- 172.21.15.152:0/2789941225 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c005020 con 0x55f8cd0d8680 2024-09-11T22:05:13.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.325+0000 7f0c7f7fe640 1 -- 172.21.15.152:0/2789941225 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c8c0047a0 con 0x55f8cd0d8680 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.325+0000 7f0c7f7fe640 1 -- 172.21.15.152:0/2789941225 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c00e8e0 con 0x55f8cd0d8680 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.325+0000 7f0ca18d2740 1 -- 172.21.15.152:0/2789941225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 msgr2=0x55f8cd0daa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.325+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/2789941225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 0x55f8cd0daa70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0c980fe160 tx=0x7f0c8c00a2d0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.325+0000 7f0ca18d2740 1 -- 172.21.15.152:0/2789941225 shutdown_connections 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.325+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/2789941225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 0x55f8cd0daa70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.325+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/2789941225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.325+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/2789941225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.325+0000 7f0ca18d2740 1 -- 172.21.15.152:0/2789941225 >> 172.21.15.152:0/2789941225 conn(0x55f8cd0c9a30 msgr2=0x55f8cd0c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.325+0000 7f0ca18d2740 1 -- 172.21.15.152:0/2789941225 shutdown_connections 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.325+0000 7f0ca18d2740 1 -- 172.21.15.152:0/2789941225 wait complete. 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0ca18d2740 1 -- start start 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0ca18d2740 1 Processor -- start 2024-09-11T22:05:13.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0d8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0d8680 0x55f8cd0d5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f8cd0db250 con 0x55f8cd0cddc0 2024-09-11T22:05:13.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f8ccfee050 con 0x55f8cd0cd4a0 2024-09-11T22:05:13.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f8cd0db3d0 con 0x55f8cd0d8680 2024-09-11T22:05:13.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0ca18d2740 10 client.0 _ll_register_callbacks cb 0x55f8cd02e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:13.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0c9d295640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0c9d295640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53062/0 (socket says 172.21.15.152:53062) 2024-09-11T22:05:13.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.326+0000 7f0c9d295640 1 -- 172.21.15.152:0/4100989710 learned_addr learned my addr 172.21.15.152:0/4100989710 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:13.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0d8680 0x55f8cd0d5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0d8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c9d295640 1 -- 172.21.15.152:0/4100989710 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0d8680 msgr2=0x55f8cd0d5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:13.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c9d295640 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0d8680 0x55f8cd0d5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c9d295640 1 -- 172.21.15.152:0/4100989710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 msgr2=0x55f8cd0d8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:13.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c9d295640 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0d8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c9d295640 1 -- 172.21.15.152:0/4100989710 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ccda43c0 con 0x55f8cd0cddc0 2024-09-11T22:05:13.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0d8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:13.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c9d295640 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d52c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009a10 tx=0x7f0c88003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214c882349c9e892 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:13.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:13.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c7cff9640 1 -- 172.21.15.152:0/4100989710 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88049060 con 0x55f8cd0cddc0 2024-09-11T22:05:13.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0ca18d2740 1 -- 172.21.15.152:0/4100989710 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c8c0047a0 con 0x55f8cd0cddc0 2024-09-11T22:05:13.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c7cff9640 1 -- 172.21.15.152:0/4100989710 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f0c88031450 con 0x55f8cd0cddc0 2024-09-11T22:05:13.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c7cff9640 1 -- 172.21.15.152:0/4100989710 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0c88031650 con 0x55f8cd0cddc0 2024-09-11T22:05:13.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0ca18d2740 10 client.15618 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:13.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0ca18d2740 1 -- 172.21.15.152:0/4100989710 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f8cd0e6c40 con 0x55f8cd0cddc0 2024-09-11T22:05:13.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.327+0000 7f0c7cff9640 1 -- 172.21.15.152:0/4100989710 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c8c0047a0 con 0x55f8cd0cddc0 2024-09-11T22:05:13.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.328+0000 7f0c7cff9640 1 -- 172.21.15.152:0/4100989710 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f0c88030650 con 0x55f8cd0cddc0 2024-09-11T22:05:13.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.328+0000 7f0ca18d2740 10 client.15618 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:13.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.328+0000 7f0ca18d2740 10 client.15618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:13.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.328+0000 7f0ca18d2740 20 client.15618 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:13.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.328+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8cd0e81a0 0x55f8cd0ea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.328+0000 7f0ca18d2740 4 client.15618 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:13.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.328+0000 7f0ca18d2740 1 -- 172.21.15.152:0/4100989710 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8cd040850 con 0x55f8cd0e81a0 2024-09-11T22:05:13.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.328+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8cd0e81a0 0x55f8cd0ea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.328+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8cd0e81a0 0x55f8cd0ea5d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46225cdd5b753d6b server_cookie=b78263ebc4d56fa5 in_seq=0 out_seq=0 2024-09-11T22:05:13.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.328+0000 7f0c7cff9640 10 client.15618 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:13.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0c7cff9640 1 -- 172.21.15.152:0/4100989710 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8cd040850 con 0x55f8cd0e81a0 2024-09-11T22:05:13.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0c7cff9640 10 client.15618 handle_command_reply: tid=0 2024-09-11T22:05:13.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0ca18d2740 1 client.15618 shutdown 2024-09-11T22:05:13.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0ca18d2740 1 -- 172.21.15.152:0/4100989710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 msgr2=0x55f8cd0d52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:13.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d52c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009a10 tx=0x7f0c88003970 comp rx=0 tx=0).stop 2024-09-11T22:05:13.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0ca18d2740 1 -- 172.21.15.152:0/4100989710 shutdown_connections 2024-09-11T22:05:13.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8cd0e81a0 0x55f8cd0ea5d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0d8680 0x55f8cd0d5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0c7cff9640 0 client.15618 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:13.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d52c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/4100989710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0d8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.329+0000 7f0ca18d2740 1 -- 172.21.15.152:0/4100989710 >> 172.21.15.152:0/4100989710 conn(0x55f8cd0c9a30 msgr2=0x55f8cd0cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:13.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.330+0000 7f0ca18d2740 1 -- 172.21.15.152:0/4100989710 shutdown_connections 2024-09-11T22:05:13.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.330+0000 7f0ca18d2740 1 -- 172.21.15.152:0/4100989710 wait complete. 2024-09-11T22:05:13.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.330+0000 7f0ca18d2740 20 client.15618 trim_cache size 0 max 16384 2024-09-11T22:05:13.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.346+0000 7f0ca18d2740 1 Processor -- start 2024-09-11T22:05:13.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.346+0000 7f0ca18d2740 1 -- start start 2024-09-11T22:05:13.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0efea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0d8680 0x55f8cd0f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981b25c0 con 0x55f8cd0cddc0 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981afe60 con 0x55f8cd0d8680 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981adcb0 con 0x55f8cd0cd4a0 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c9d295640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c9d295640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0efea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53066/0 (socket says 172.21.15.152:53066) 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c9d295640 1 -- 172.21.15.152:0/1757346636 learned_addr learned my addr 172.21.15.152:0/1757346636 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/1757346636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0d8680 0x55f8cd0f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/1757346636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c9d295640 1 -- 172.21.15.152:0/1757346636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cd4a0 msgr2=0x55f8cd0e44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c9d295640 1 --2- 172.21.15.152:0/1757346636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0e44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c9d295640 1 -- 172.21.15.152:0/1757346636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0d8680 msgr2=0x55f8cd0f03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c9d295640 1 --2- 172.21.15.152:0/1757346636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0d8680 0x55f8cd0f03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c9d295640 1 -- 172.21.15.152:0/1757346636 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8cd0cdbf0 con 0x55f8cd0cddc0 2024-09-11T22:05:13.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c9d295640 1 --2- 172.21.15.152:0/1757346636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0efea0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0c88002230 tx=0x7f0c88005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57db8a65bd499434 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c7effd640 1 -- 172.21.15.152:0/1757346636 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8803e020 con 0x55f8cd0cddc0 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c7effd640 1 -- 172.21.15.152:0/1757346636 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c88036040 con 0x55f8cd0cddc0 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.347+0000 7f0c7effd640 1 -- 172.21.15.152:0/1757346636 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88049070 con 0x55f8cd0cddc0 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.348+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1757346636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 msgr2=0x55f8cd0efea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.348+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/1757346636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0efea0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0c88002230 tx=0x7f0c88005d10 comp rx=0 tx=0).stop 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.348+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1757346636 shutdown_connections 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.348+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/1757346636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0d8680 0x55f8cd0f03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.348+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/1757346636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0efea0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.348+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/1757346636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.348+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1757346636 >> 172.21.15.152:0/1757346636 conn(0x55f8cd0c9a30 msgr2=0x55f8cd0d43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.348+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1757346636 shutdown_connections 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.348+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1757346636 wait complete. 2024-09-11T22:05:13.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.348+0000 7f0ca18d2740 1 -- start start 2024-09-11T22:05:13.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0ca18d2740 1 Processor -- start 2024-09-11T22:05:13.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0e0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0ca18d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 0x55f8cd0d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981ae320 con 0x55f8cd0d8680 2024-09-11T22:05:13.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981af790 con 0x55f8cd0cd4a0 2024-09-11T22:05:13.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0ca18d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981ae9f0 con 0x55f8cd0cddc0 2024-09-11T22:05:13.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0ca18d2740 10 client.0 _ll_register_callbacks cb 0x7f0c88005f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:13.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0c9ca94640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 0x55f8cd0d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0c9ca94640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 0x55f8cd0d2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53074/0 (socket says 172.21.15.152:53074) 2024-09-11T22:05:13.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0c9ca94640 1 -- 172.21.15.152:0/1126705799 learned_addr learned my addr 172.21.15.152:0/1126705799 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:13.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0e0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0c9d295640 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0c9ca94640 1 -- 172.21.15.152:0/1126705799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 msgr2=0x55f8cd0d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:13.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0c9ca94640 1 -- 172.21.15.152:0/1126705799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 msgr2=0x55f8cd0e0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:13.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0e0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0c9ca94640 1 -- 172.21.15.152:0/1126705799 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8cd0d2910 con 0x55f8cd0d8680 2024-09-11T22:05:13.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.349+0000 7f0c9d295640 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:13.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0c9ca94640 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 0x55f8cd0d2350 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c005d50 tx=0x7f0c8c00a830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e83ba01da44842f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:13.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0c7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:13.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0c7cff9640 1 -- 172.21.15.152:0/1126705799 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c00e890 con 0x55f8cd0d8680 2024-09-11T22:05:13.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0c7cff9640 1 -- 172.21.15.152:0/1126705799 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f0c8c00ea30 con 0x55f8cd0d8680 2024-09-11T22:05:13.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1126705799 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c88036040 con 0x55f8cd0d8680 2024-09-11T22:05:13.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0c7cff9640 1 -- 172.21.15.152:0/1126705799 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0c8c03b050 con 0x55f8cd0d8680 2024-09-11T22:05:13.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0ca18d2740 10 client.15624 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:13.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1126705799 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f8cd152c10 con 0x55f8cd0d8680 2024-09-11T22:05:13.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0c7cff9640 1 -- 172.21.15.152:0/1126705799 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c88036040 con 0x55f8cd0d8680 2024-09-11T22:05:13.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0c7cff9640 1 -- 172.21.15.152:0/1126705799 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f0c8c01b020 con 0x55f8cd0d8680 2024-09-11T22:05:13.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0ca18d2740 10 client.15624 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:13.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0ca18d2740 10 client.15624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:13.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0ca18d2740 20 client.15624 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:13.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8cd0e81a0 0x55f8cd155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:13.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0ca18d2740 4 client.15624 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:05:13.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.350+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1126705799 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f8cd03ad60 con 0x55f8cd0e81a0 2024-09-11T22:05:13.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.351+0000 7f0c9d295640 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8cd0e81a0 0x55f8cd155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:13.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.351+0000 7f0c7cff9640 10 client.15624 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:13.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.351+0000 7f0c9d295640 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8cd0e81a0 0x55f8cd155210 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecd0ec72dd66f74b server_cookie=e3e515971a483e8c in_seq=0 out_seq=0 2024-09-11T22:05:13.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.351+0000 7f0c7cff9640 1 -- 172.21.15.152:0/1126705799 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f8cd03ad60 con 0x55f8cd0e81a0 2024-09-11T22:05:13.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0c7cff9640 10 client.15624 handle_command_reply: tid=0 2024-09-11T22:05:13.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 1 client.15624 shutdown 2024-09-11T22:05:13.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1126705799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 msgr2=0x55f8cd0d2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:13.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 0x55f8cd0d2350 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c005d50 tx=0x7f0c8c00a830 comp rx=0 tx=0).stop 2024-09-11T22:05:13.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1126705799 shutdown_connections 2024-09-11T22:05:13.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8cd0e81a0 0x55f8cd155210 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8cd0d8680 0x55f8cd0d2350 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8cd0cddc0 0x55f8cd0d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 1 --2- 172.21.15.152:0/1126705799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cd0cd4a0 0x55f8cd0e0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1126705799 >> 172.21.15.152:0/1126705799 conn(0x55f8cd0c9a30 msgr2=0x55f8cd0d6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:13.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0c7cff9640 0 client.15624 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:13.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1126705799 shutdown_connections 2024-09-11T22:05:13.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 1 -- 172.21.15.152:0/1126705799 wait complete. 2024-09-11T22:05:13.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0ca18d2740 20 client.15624 trim_cache size 0 max 16384 2024-09-11T22:05:13.361 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:05:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:05:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:05:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: "5b43a1ca-26fb-450d-8525-6622a4201d20": { 2024-09-11T22:05:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:05:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "5b43a1ca-26fb-450d-8525-6622a4201d20", 2024-09-11T22:05:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:05:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:13.362 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:05:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/3654113240 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0c800a2ea0 msgr2=0x7f0c800a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0c9f4f9640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0c800a2ea0 0x7f0c800a5360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c900cc5f0 tx=0x7f0c900c5ef0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/3654113240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c98106f20 msgr2=0x7f0c9819efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0c9f4f9640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c98106f20 0x7f0c9819efb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000d750 tx=0x7f0c9000dc10 comp rx=0 tx=0).stop 2024-09-11T22:05:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.352+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/3654113240 shutdown_connections 2024-09-11T22:05:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.353+0000 7f0c9f4f9640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0c800a2ea0 0x7f0c800a5360 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.353+0000 7f0c9f4f9640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c98106f20 0x7f0c9819efb0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.353+0000 7f0c9f4f9640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c981027a0 0x7f0c9819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.353+0000 7f0c9f4f9640 1 --2- 172.21.15.152:0/3654113240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c98101df0 0x7f0c9819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.353+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/3654113240 >> 172.21.15.152:0/3654113240 conn(0x7f0c980fd8f0 msgr2=0x7f0c980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.353+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/3654113240 shutdown_connections 2024-09-11T22:05:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:13.353+0000 7f0c9f4f9640 1 -- 172.21.15.152:0/3654113240 wait complete. 2024-09-11T22:05:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:13 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:05:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:13 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:13 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:05:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:13 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:13 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:13 smithi152 ceph-mon[31188]: pgmap v31: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 23 MiB/s wr, 592 op/s 2024-09-11T22:05:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:13 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:05:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:13 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:13.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:13 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:05:13.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:13 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:13.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:13 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:13.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:13 smithi179 ceph-mon[35603]: pgmap v31: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 23 MiB/s wr, 592 op/s 2024-09-11T22:05:13.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:13 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:05:13.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:13 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:13.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:13 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:05:13.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:13 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:13.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:13 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:13.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:13 smithi193 ceph-mon[35545]: pgmap v31: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 23 MiB/s wr, 592 op/s 2024-09-11T22:05:14.201 INFO:tasks.cephfs.filesystem:scrub status for tag:5b43a1ca-26fb-450d-8525-6622a4201d20 - {'path': '/', 'tag': '5b43a1ca-26fb-450d-8525-6622a4201d20', 'options': 'recursive,force'} 2024-09-11T22:05:15.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:15 smithi179 ceph-mon[35603]: pgmap v32: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 14 MiB/s wr, 252 op/s 2024-09-11T22:05:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:15 smithi193 ceph-mon[35545]: pgmap v32: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 14 MiB/s wr, 252 op/s 2024-09-11T22:05:15.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:15 smithi152 ceph-mon[31188]: pgmap v32: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 14 MiB/s wr, 252 op/s 2024-09-11T22:05:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:17 smithi152 ceph-mon[31188]: pgmap v33: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 14 MiB/s wr, 252 op/s 2024-09-11T22:05:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:17 smithi179 ceph-mon[35603]: pgmap v33: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 14 MiB/s wr, 252 op/s 2024-09-11T22:05:17.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:17 smithi193 ceph-mon[35545]: pgmap v33: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 14 MiB/s wr, 252 op/s 2024-09-11T22:05:19.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:18 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:05:19.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:18 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:05:19.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:18 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:05:20.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:19 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:05:20.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:19 smithi152 ceph-mon[31188]: pgmap v34: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 14 MiB/s wr, 256 op/s 2024-09-11T22:05:20.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:19 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:05:20.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:19 smithi179 ceph-mon[35603]: pgmap v34: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 14 MiB/s wr, 256 op/s 2024-09-11T22:05:20.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:19 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:05:20.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:19 smithi193 ceph-mon[35545]: pgmap v34: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 14 MiB/s wr, 256 op/s 2024-09-11T22:05:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:21 smithi179 ceph-mon[35603]: pgmap v35: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-09-11T22:05:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:21 smithi193 ceph-mon[35545]: pgmap v35: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-09-11T22:05:21.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:21 smithi152 ceph-mon[31188]: pgmap v35: 97 pgs: 97 active+clean; 190 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-09-11T22:05:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.025+0000 7f493d29b640 1 -- 172.21.15.152:0/2922692759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4938101200 msgr2=0x7f49381079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.025+0000 7f493d29b640 1 --2- 172.21.15.152:0/2922692759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4938101200 0x7f49381079b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4920009930 tx=0x7f492002a420 comp rx=0 tx=0).stop 2024-09-11T22:05:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.025+0000 7f493d29b640 1 -- 172.21.15.152:0/2922692759 shutdown_connections 2024-09-11T22:05:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.025+0000 7f493d29b640 1 --2- 172.21.15.152:0/2922692759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4938108110 0x7f493810ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.025+0000 7f493d29b640 1 --2- 172.21.15.152:0/2922692759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4938101200 0x7f49381079b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.025+0000 7f493d29b640 1 --2- 172.21.15.152:0/2922692759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4938100850 0x7f4938100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.025+0000 7f493d29b640 1 -- 172.21.15.152:0/2922692759 >> 172.21.15.152:0/2922692759 conn(0x7f4938075db0 msgr2=0x7f49380761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.025+0000 7f493d29b640 1 -- 172.21.15.152:0/2922692759 shutdown_connections 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.025+0000 7f493d29b640 1 -- 172.21.15.152:0/2922692759 wait complete. 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f493d29b640 1 Processor -- start 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f493d29b640 1 -- start start 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f493d29b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4938100850 0x7f49381982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f493d29b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4938108110 0x7f4938198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f493d29b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f493819cba0 0x7f493819d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f493d29b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4938111f10 con 0x7f4938100850 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f493d29b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4938111d90 con 0x7f4938108110 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f493d29b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4938112090 con 0x7f493819cba0 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f4936ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4938100850 0x7f49381982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f4936ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4938100850 0x7f49381982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56638/0 (socket says 172.21.15.152:56638) 2024-09-11T22:05:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f4936ffd640 1 -- 172.21.15.152:0/3332998452 learned_addr learned my addr 172.21.15.152:0/3332998452 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f4936ffd640 1 -- 172.21.15.152:0/3332998452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f493819cba0 msgr2=0x7f493819d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f49367fc640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4938108110 0x7f4938198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.026+0000 7f49377fe640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f493819cba0 0x7f493819d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f4936ffd640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f493819cba0 0x7f493819d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f4936ffd640 1 -- 172.21.15.152:0/3332998452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4938108110 msgr2=0x7f4938198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f4936ffd640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4938108110 0x7f4938198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f4936ffd640 1 -- 172.21.15.152:0/3332998452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493819d690 con 0x7f4938100850 2024-09-11T22:05:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f49367fc640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4938108110 0x7f4938198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f49377fe640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f493819cba0 0x7f493819d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f4936ffd640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4938100850 0x7f49381982e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f492800cce0 tx=0x7f492800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f492ffff640 1 -- 172.21.15.152:0/3332998452 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492800f650 con 0x7f4938100850 2024-09-11T22:05:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f493d29b640 1 -- 172.21.15.152:0/3332998452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493819d980 con 0x7f4938100850 2024-09-11T22:05:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f492ffff640 1 -- 172.21.15.152:0/3332998452 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f492800fcd0 con 0x7f4938100850 2024-09-11T22:05:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f492ffff640 1 -- 172.21.15.152:0/3332998452 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928018c70 con 0x7f4938100850 2024-09-11T22:05:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.027+0000 7f493d29b640 1 -- 172.21.15.152:0/3332998452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49381a5170 con 0x7f4938100850 2024-09-11T22:05:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.029+0000 7f492ffff640 1 -- 172.21.15.152:0/3332998452 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7f492800f7f0 con 0x7f4938100850 2024-09-11T22:05:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.030+0000 7f4940034740 1 Processor -- start 2024-09-11T22:05:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.030+0000 7f4940034740 1 -- start start 2024-09-11T22:05:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.030+0000 7f492ffff640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f49240a2f50 0x7f49240a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.030+0000 7f49377fe640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f49240a2f50 0x7f49240a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.030+0000 7f492ffff640 1 -- 172.21.15.152:0/3332998452 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f49280cfd80 con 0x7f4938100850 2024-09-11T22:05:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.030+0000 7f4940034740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abc5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.030+0000 7f4940034740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc62f0 0x56046abd4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.030+0000 7f4940034740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abd50c0 0x56046abd74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.030+0000 7f4940034740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56046ab2a2f0 con 0x56046abc59d0 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.030+0000 7f4940034740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56046aad2270 con 0x56046abc62f0 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.030+0000 7f4940034740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56046ab262b0 con 0x56046abd50c0 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f4936ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abc5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f4936ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abc5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56650/0 (socket says 172.21.15.152:56650) 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f4936ffd640 1 -- 172.21.15.152:0/2162826557 learned_addr learned my addr 172.21.15.152:0/2162826557 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f49367fc640 1 --2- 172.21.15.152:0/2162826557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc62f0 0x56046abd4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f49377fe640 1 --2- 172.21.15.152:0/2162826557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abd50c0 0x56046abd74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f49377fe640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f49240a2f50 0x7f49240a5410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f493000b9b0 tx=0x7f4930005bf0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f4936ffd640 1 -- 172.21.15.152:0/2162826557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abd50c0 msgr2=0x56046abd74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f4936ffd640 1 --2- 172.21.15.152:0/2162826557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abd50c0 0x56046abd74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f4936ffd640 1 -- 172.21.15.152:0/2162826557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc62f0 msgr2=0x56046abd4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f4936ffd640 1 --2- 172.21.15.152:0/2162826557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc62f0 0x56046abd4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f4936ffd640 1 -- 172.21.15.152:0/2162826557 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56046aad1340 con 0x56046abc59d0 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f49367fc640 1 --2- 172.21.15.152:0/2162826557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc62f0 0x56046abd4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f4936ffd640 1 --2- 172.21.15.152:0/2162826557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abc5db0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f492809bc50 tx=0x7f492809b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf868dc277a475b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f492d7fa640 1 -- 172.21.15.152:0/2162826557 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280a0300 con 0x56046abc59d0 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f492d7fa640 1 -- 172.21.15.152:0/2162826557 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49280a4bc0 con 0x56046abc59d0 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.031+0000 7f492d7fa640 1 -- 172.21.15.152:0/2162826557 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280a4990 con 0x56046abc59d0 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.032+0000 7f4940034740 1 -- 172.21.15.152:0/2162826557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 msgr2=0x56046abc5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.032+0000 7f4940034740 1 --2- 172.21.15.152:0/2162826557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abc5db0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f492809bc50 tx=0x7f492809b8b0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.032+0000 7f4940034740 1 -- 172.21.15.152:0/2162826557 shutdown_connections 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.032+0000 7f4940034740 1 --2- 172.21.15.152:0/2162826557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abd50c0 0x56046abd74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.032+0000 7f4940034740 1 --2- 172.21.15.152:0/2162826557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc62f0 0x56046abd4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.032+0000 7f4940034740 1 --2- 172.21.15.152:0/2162826557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abc5db0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.032+0000 7f4940034740 1 -- 172.21.15.152:0/2162826557 >> 172.21.15.152:0/2162826557 conn(0x56046abc2060 msgr2=0x56046abc2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.032+0000 7f4940034740 1 -- 172.21.15.152:0/2162826557 shutdown_connections 2024-09-11T22:05:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.032+0000 7f4940034740 1 -- 172.21.15.152:0/2162826557 wait complete. 2024-09-11T22:05:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.032+0000 7f4940034740 1 -- start start 2024-09-11T22:05:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.032+0000 7f4940034740 1 Processor -- start 2024-09-11T22:05:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4940034740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abd2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4940034740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abd25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4940034740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abd50c0 0x56046abd2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4940034740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56046abd7c90 con 0x56046abc59d0 2024-09-11T22:05:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4940034740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56046aab3290 con 0x56046abd50c0 2024-09-11T22:05:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4940034740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56046abd7e10 con 0x56046abc62f0 2024-09-11T22:05:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4940034740 10 client.0 _ll_register_callbacks cb 0x56046aae4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4936ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abd2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4936ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abd2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56660/0 (socket says 172.21.15.152:56660) 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4936ffd640 1 -- 172.21.15.152:0/2404923054 learned_addr learned my addr 172.21.15.152:0/2404923054 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f49367fc640 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abd25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f49377fe640 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abd50c0 0x56046abd2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4936ffd640 1 -- 172.21.15.152:0/2404923054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 msgr2=0x56046abd25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4936ffd640 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abd25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4936ffd640 1 -- 172.21.15.152:0/2404923054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abd50c0 msgr2=0x56046abd2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4936ffd640 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abd50c0 0x56046abd2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4936ffd640 1 -- 172.21.15.152:0/2404923054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56046a83d210 con 0x56046abc59d0 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4936ffd640 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abd2080 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f49280cd350 tx=0x7f492809c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c0e86418b22305 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f491e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f491e7fc640 1 -- 172.21.15.152:0/2404923054 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928065070 con 0x56046abc59d0 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f491e7fc640 1 -- 172.21.15.152:0/2404923054 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f49280bad90 con 0x56046abc59d0 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.033+0000 7f4940034740 1 -- 172.21.15.152:0/2404923054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49280a4bc0 con 0x56046abc59d0 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f491e7fc640 1 -- 172.21.15.152:0/2404923054 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4928018e10 con 0x56046abc59d0 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f4940034740 10 client.15636 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f4940034740 1 -- 172.21.15.152:0/2404923054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56046a909620 con 0x56046abc59d0 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f491e7fc640 1 -- 172.21.15.152:0/2404923054 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49280a4bc0 con 0x56046abc59d0 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f491e7fc640 1 -- 172.21.15.152:0/2404923054 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f4928097ca0 con 0x56046abc59d0 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f4940034740 10 client.15636 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f4940034740 10 client.15636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f4940034740 20 client.15636 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f4940034740 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56046abe4ee0 0x56046abe72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f4940034740 4 client.15636 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f4940034740 1 -- 172.21.15.152:0/2404923054 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56046ab37a20 con 0x56046abe4ee0 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.034+0000 7f49367fc640 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56046abe4ee0 0x56046abe72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.035+0000 7f491e7fc640 10 client.15636 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.035+0000 7f49367fc640 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56046abe4ee0 0x56046abe72d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a463ade006cc9890 server_cookie=e6c6cd1af06fd9a9 in_seq=0 out_seq=0 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.035+0000 7f491e7fc640 1 -- 172.21.15.152:0/2404923054 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56046ab37a20 con 0x56046abe4ee0 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.035+0000 7f491e7fc640 10 client.15636 handle_command_reply: tid=0 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.035+0000 7f4940034740 1 client.15636 shutdown 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f4940034740 1 -- 172.21.15.152:0/2404923054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 msgr2=0x56046abd2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f4940034740 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abd2080 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f49280cd350 tx=0x7f492809c0d0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f4940034740 1 -- 172.21.15.152:0/2404923054 shutdown_connections 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f4940034740 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56046abe4ee0 0x56046abe72d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f4940034740 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abd50c0 0x56046abd2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f4940034740 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abd25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f491e7fc640 0 client.15636 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f4940034740 1 --2- 172.21.15.152:0/2404923054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abc59d0 0x56046abd2080 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f4940034740 1 -- 172.21.15.152:0/2404923054 >> 172.21.15.152:0/2404923054 conn(0x56046abc2060 msgr2=0x56046abc7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f4940034740 1 -- 172.21.15.152:0/2404923054 shutdown_connections 2024-09-11T22:05:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f4940034740 1 -- 172.21.15.152:0/2404923054 wait complete. 2024-09-11T22:05:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.036+0000 7f4940034740 20 client.15636 trim_cache size 0 max 16384 2024-09-11T22:05:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.050+0000 7f4940034740 1 Processor -- start 2024-09-11T22:05:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.050+0000 7f4940034740 1 -- start start 2024-09-11T22:05:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.050+0000 7f4940034740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc59d0 0x56046abc19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.050+0000 7f4940034740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abd37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.050+0000 7f4940034740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.050+0000 7f4940034740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f49381aded0 con 0x56046abd50c0 2024-09-11T22:05:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.050+0000 7f4940034740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49381ab770 con 0x56046abc59d0 2024-09-11T22:05:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.050+0000 7f4940034740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f49381a95e0 con 0x56046abc62f0 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f49377fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f49377fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56662/0 (socket says 172.21.15.152:56662) 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f49377fe640 1 -- 172.21.15.152:0/3876459940 learned_addr learned my addr 172.21.15.152:0/3876459940 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f49367fc640 1 --2- 172.21.15.152:0/3876459940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abd37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f4936ffd640 1 --2- 172.21.15.152:0/3876459940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc59d0 0x56046abc19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f49377fe640 1 -- 172.21.15.152:0/3876459940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 msgr2=0x56046abd37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f49377fe640 1 --2- 172.21.15.152:0/3876459940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abd37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f49377fe640 1 -- 172.21.15.152:0/3876459940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc59d0 msgr2=0x56046abc19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f49377fe640 1 --2- 172.21.15.152:0/3876459940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc59d0 0x56046abc19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f49377fe640 1 -- 172.21.15.152:0/3876459940 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56046abd4680 con 0x56046abd50c0 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f49377fe640 1 --2- 172.21.15.152:0/3876459940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd1850 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f493000dd30 tx=0x7f4930010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e737eece76dae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f492cff9640 1 -- 172.21.15.152:0/3876459940 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4930029070 con 0x56046abd50c0 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f492cff9640 1 -- 172.21.15.152:0/3876459940 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f493000fb00 con 0x56046abd50c0 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.051+0000 7f492cff9640 1 -- 172.21.15.152:0/3876459940 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493001ac60 con 0x56046abd50c0 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.052+0000 7f4940034740 1 -- 172.21.15.152:0/3876459940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 msgr2=0x56046abd1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.052+0000 7f4940034740 1 --2- 172.21.15.152:0/3876459940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd1850 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f493000dd30 tx=0x7f4930010000 comp rx=0 tx=0).stop 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.052+0000 7f4940034740 1 -- 172.21.15.152:0/3876459940 shutdown_connections 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.052+0000 7f4940034740 1 --2- 172.21.15.152:0/3876459940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd1850 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.052+0000 7f4940034740 1 --2- 172.21.15.152:0/3876459940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abd37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.052+0000 7f4940034740 1 --2- 172.21.15.152:0/3876459940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc59d0 0x56046abc19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.052+0000 7f4940034740 1 -- 172.21.15.152:0/3876459940 >> 172.21.15.152:0/3876459940 conn(0x56046abc2060 msgr2=0x56046abd2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.052+0000 7f4940034740 1 -- 172.21.15.152:0/3876459940 shutdown_connections 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.052+0000 7f4940034740 1 -- 172.21.15.152:0/3876459940 wait complete. 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.052+0000 7f4940034740 1 -- start start 2024-09-11T22:05:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.052+0000 7f4940034740 1 Processor -- start 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f4940034740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc59d0 0x56046abdd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f4940034740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abdd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f4940034740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f4940034740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f49381a9c30 con 0x56046abd50c0 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f4940034740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49381ab0a0 con 0x56046abc59d0 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f4940034740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f49381aa300 con 0x56046abc62f0 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f4940034740 10 client.0 _ll_register_callbacks cb 0x7f492809bd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f49377fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f49377fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56670/0 (socket says 172.21.15.152:56670) 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f49377fe640 1 -- 172.21.15.152:0/3067956413 learned_addr learned my addr 172.21.15.152:0/3067956413 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f4936ffd640 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc59d0 0x56046abdd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f49367fc640 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abdd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f49377fe640 1 -- 172.21.15.152:0/3067956413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 msgr2=0x56046abdd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f49377fe640 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abdd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f49377fe640 1 -- 172.21.15.152:0/3067956413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc59d0 msgr2=0x56046abdd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f49377fe640 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc59d0 0x56046abdd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f49377fe640 1 -- 172.21.15.152:0/3067956413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56046abcce90 con 0x56046abd50c0 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f49377fe640 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd8840 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4930027040 tx=0x7f493000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619c5302b5abf297 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.053+0000 7f491e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f491e7fc640 1 -- 172.21.15.152:0/3067956413 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4930033070 con 0x56046abd50c0 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f491e7fc640 1 -- 172.21.15.152:0/3067956413 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f493000f830 con 0x56046abd50c0 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f4940034740 1 -- 172.21.15.152:0/3067956413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f493000fb00 con 0x56046abd50c0 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f491e7fc640 1 -- 172.21.15.152:0/3067956413 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f493003f050 con 0x56046abd50c0 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f4940034740 10 client.15642 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f4940034740 1 -- 172.21.15.152:0/3067956413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56046ac4f2c0 con 0x56046abd50c0 2024-09-11T22:05:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f491e7fc640 1 -- 172.21.15.152:0/3067956413 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f493000fb00 con 0x56046abd50c0 2024-09-11T22:05:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f491e7fc640 1 -- 172.21.15.152:0/3067956413 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f4930023030 con 0x56046abd50c0 2024-09-11T22:05:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f4940034740 10 client.15642 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f4940034740 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f4940034740 20 client.15642 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f4940034740 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56046abe4ee0 0x56046ac51940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f4940034740 4 client.15642 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:05:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f4940034740 1 -- 172.21.15.152:0/3067956413 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56046ab31d70 con 0x56046abe4ee0 2024-09-11T22:05:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.054+0000 7f4936ffd640 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56046abe4ee0 0x56046ac51940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.055+0000 7f491e7fc640 10 client.15642 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.055+0000 7f4936ffd640 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56046abe4ee0 0x56046ac51940 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6078e7dbc1d1674 server_cookie=f0f1783ab65679b1 in_seq=0 out_seq=0 2024-09-11T22:05:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f491e7fc640 1 -- 172.21.15.152:0/3067956413 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56046ab31d70 con 0x56046abe4ee0 2024-09-11T22:05:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f491e7fc640 10 client.15642 handle_command_reply: tid=0 2024-09-11T22:05:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f4940034740 1 client.15642 shutdown 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f4940034740 1 -- 172.21.15.152:0/3067956413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 msgr2=0x56046abd8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f4940034740 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd8840 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4930027040 tx=0x7f493000da60 comp rx=0 tx=0).stop 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f4940034740 1 -- 172.21.15.152:0/3067956413 shutdown_connections 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f4940034740 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56046abe4ee0 0x56046ac51940 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f4940034740 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56046abd50c0 0x56046abd8840 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f491e7fc640 0 client.15642 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f4940034740 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56046abc62f0 0x56046abdd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f4940034740 1 --2- 172.21.15.152:0/3067956413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56046abc59d0 0x56046abdd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f4940034740 1 -- 172.21.15.152:0/3067956413 >> 172.21.15.152:0/3067956413 conn(0x56046abc2060 msgr2=0x56046abc7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.063+0000 7f4940034740 1 -- 172.21.15.152:0/3067956413 shutdown_connections 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f4940034740 1 -- 172.21.15.152:0/3067956413 wait complete. 2024-09-11T22:05:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f4940034740 20 client.15642 trim_cache size 0 max 16384 2024-09-11T22:05:22.066 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:05:22.066 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:05:22.066 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:05:22.066 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:05:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 -- 172.21.15.152:0/3332998452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f49240a2f50 msgr2=0x7f49240a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f49240a2f50 0x7f49240a5410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f493000b9b0 tx=0x7f4930005bf0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 -- 172.21.15.152:0/3332998452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4938100850 msgr2=0x7f49381982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4938100850 0x7f49381982e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f492800cce0 tx=0x7f492800a620 comp rx=0 tx=0).stop 2024-09-11T22:05:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 -- 172.21.15.152:0/3332998452 shutdown_connections 2024-09-11T22:05:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f49240a2f50 0x7f49240a5410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f493819cba0 0x7f493819d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4938108110 0x7f4938198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 --2- 172.21.15.152:0/3332998452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4938100850 0x7f49381982e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 -- 172.21.15.152:0/3332998452 >> 172.21.15.152:0/3332998452 conn(0x7f4938075db0 msgr2=0x7f49380ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 -- 172.21.15.152:0/3332998452 shutdown_connections 2024-09-11T22:05:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:22.064+0000 7f493d29b640 1 -- 172.21.15.152:0/3332998452 wait complete. 2024-09-11T22:05:23.782 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:23 smithi152 ceph-mon[31188]: pgmap v36: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 20 op/s 2024-09-11T22:05:23.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:23 smithi179 ceph-mon[35603]: pgmap v36: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 20 op/s 2024-09-11T22:05:23.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:23 smithi193 ceph-mon[35545]: pgmap v36: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 20 op/s 2024-09-11T22:05:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:25 smithi179 ceph-mon[35603]: pgmap v37: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 12 MiB/s wr, 12 op/s 2024-09-11T22:05:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:25 smithi193 ceph-mon[35545]: pgmap v37: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 12 MiB/s wr, 12 op/s 2024-09-11T22:05:25.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:25 smithi152 ceph-mon[31188]: pgmap v37: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 12 MiB/s wr, 12 op/s 2024-09-11T22:05:27.388 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:05:27.654 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:27.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:27 smithi152 ceph-mon[31188]: pgmap v38: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 12 MiB/s wr, 12 op/s 2024-09-11T22:05:27.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:27 smithi179 ceph-mon[35603]: pgmap v38: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 12 MiB/s wr, 12 op/s 2024-09-11T22:05:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:27 smithi193 ceph-mon[35545]: pgmap v38: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 12 MiB/s wr, 12 op/s 2024-09-11T22:05:28.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.085+0000 7fac5ce86640 1 -- 172.21.15.152:0/1951869404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac58103740 msgr2=0x7fac58107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:28.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.085+0000 7fac5ce86640 1 --2- 172.21.15.152:0/1951869404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac58103740 0x7fac58107b80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fac40009930 tx=0x7fac4002a420 comp rx=0 tx=0).stop 2024-09-11T22:05:28.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.085+0000 7fac5ce86640 1 -- 172.21.15.152:0/1951869404 shutdown_connections 2024-09-11T22:05:28.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.085+0000 7fac5ce86640 1 --2- 172.21.15.152:0/1951869404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac58108290 0x7fac5810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:28.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.085+0000 7fac5ce86640 1 --2- 172.21.15.152:0/1951869404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac58103740 0x7fac58107b80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:28.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.085+0000 7fac5ce86640 1 --2- 172.21.15.152:0/1951869404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac58102d90 0x7fac58103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:28.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.085+0000 7fac5ce86640 1 -- 172.21.15.152:0/1951869404 >> 172.21.15.152:0/1951869404 conn(0x7fac580fc7d0 msgr2=0x7fac580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:28.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.086+0000 7fac5ce86640 1 -- 172.21.15.152:0/1951869404 shutdown_connections 2024-09-11T22:05:28.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.086+0000 7fac5ce86640 1 -- 172.21.15.152:0/1951869404 wait complete. 2024-09-11T22:05:28.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.086+0000 7fac5ce86640 1 Processor -- start 2024-09-11T22:05:28.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5ce86640 1 -- start start 2024-09-11T22:05:28.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5ce86640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac58102d90 0x7fac58198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5ce86640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac58103740 0x7fac58198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5ce86640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac58108290 0x7fac5819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5ce86640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fac58112090 con 0x7fac58102d90 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5ce86640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fac58111f10 con 0x7fac58103740 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5ce86640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fac58112210 con 0x7fac58108290 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac58102d90 0x7fac58198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac58102d90 0x7fac58198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53244/0 (socket says 172.21.15.152:53244) 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac4ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac58103740 0x7fac58198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5659c640 1 -- 172.21.15.152:0/2820876475 learned_addr learned my addr 172.21.15.152:0/2820876475 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac56d9d640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac58108290 0x7fac5819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5659c640 1 -- 172.21.15.152:0/2820876475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac58108290 msgr2=0x7fac5819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5659c640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac58108290 0x7fac5819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:28.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5659c640 1 -- 172.21.15.152:0/2820876475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac58103740 msgr2=0x7fac58198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:28.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5659c640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac58103740 0x7fac58198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:28.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac5659c640 1 -- 172.21.15.152:0/2820876475 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5819d620 con 0x7fac58102d90 2024-09-11T22:05:28.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.087+0000 7fac4ffff640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac58103740 0x7fac58198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:28.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.088+0000 7fac5659c640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac58102d90 0x7fac58198670 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fac4800e9f0 tx=0x7fac4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:28.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.088+0000 7fac4f7fe640 1 -- 172.21.15.152:0/2820876475 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4800cd80 con 0x7fac58102d90 2024-09-11T22:05:28.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.088+0000 7fac4f7fe640 1 -- 172.21.15.152:0/2820876475 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac48010910 con 0x7fac58102d90 2024-09-11T22:05:28.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.088+0000 7fac5ce86640 1 -- 172.21.15.152:0/2820876475 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5819d910 con 0x7fac58102d90 2024-09-11T22:05:28.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.088+0000 7fac4f7fe640 1 -- 172.21.15.152:0/2820876475 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac480188f0 con 0x7fac58102d90 2024-09-11T22:05:28.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.088+0000 7fac5ce86640 1 -- 172.21.15.152:0/2820876475 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac581a51f0 con 0x7fac58102d90 2024-09-11T22:05:28.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.089+0000 7fac5ce86640 1 -- 172.21.15.152:0/2820876475 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac58103170 con 0x7fac58102d90 2024-09-11T22:05:28.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.091+0000 7fac4f7fe640 1 -- 172.21.15.152:0/2820876475 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7fac48010ac0 con 0x7fac58102d90 2024-09-11T22:05:28.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.091+0000 7fac4f7fe640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fac440a2ea0 0x7fac440a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:28.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.091+0000 7fac4f7fe640 1 -- 172.21.15.152:0/2820876475 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fac480cfef0 con 0x7fac58102d90 2024-09-11T22:05:28.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.091+0000 7fac4ffff640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fac440a2ea0 0x7fac440a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:28.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.092+0000 7fac4ffff640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fac440a2ea0 0x7fac440a5360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fac40004770 tx=0x7fac400058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:28.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.099+0000 7fac4f7fe640 1 -- 172.21.15.152:0/2820876475 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac4809c250 con 0x7fac58102d90 2024-09-11T22:05:28.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.312+0000 7fac5ce86640 1 -- 172.21.15.152:0/2820876475 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac5810a2a0 con 0x7fac58102d90 2024-09-11T22:05:28.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.313+0000 7fac4f7fe640 1 -- 172.21.15.152:0/2820876475 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11927 (secure 0 0 0) 0x7fac480a0550 con 0x7fac58102d90 2024-09-11T22:05:28.314 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:28.314 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":27,"btime":"2024-09-11T22:04:54:476799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:53.804306+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:05:28.314 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 27 2024-09-11T22:05:28.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 -- 172.21.15.152:0/2820876475 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fac440a2ea0 msgr2=0x7fac440a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:28.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fac440a2ea0 0x7fac440a5360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fac40004770 tx=0x7fac400058d0 comp rx=0 tx=0).stop 2024-09-11T22:05:28.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 -- 172.21.15.152:0/2820876475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac58102d90 msgr2=0x7fac58198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:28.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac58102d90 0x7fac58198670 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fac4800e9f0 tx=0x7fac4800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:05:28.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 -- 172.21.15.152:0/2820876475 shutdown_connections 2024-09-11T22:05:28.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fac440a2ea0 0x7fac440a5360 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:28.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac58108290 0x7fac5819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:28.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac58103740 0x7fac58198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:28.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 --2- 172.21.15.152:0/2820876475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac58102d90 0x7fac58198670 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:28.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 -- 172.21.15.152:0/2820876475 >> 172.21.15.152:0/2820876475 conn(0x7fac580fc7d0 msgr2=0x7fac58105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:28.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 -- 172.21.15.152:0/2820876475 shutdown_connections 2024-09-11T22:05:28.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:28.316+0000 7fac5ce86640 1 -- 172.21.15.152:0/2820876475 wait complete. 2024-09-11T22:05:28.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:28 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:05:28.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:28 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2820876475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:28 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:05:28.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:28 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2820876475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:28.884 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:28 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:05:28.884 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:28 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2820876475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:28.910 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 72c0cedc --release --await' 2024-09-11T22:05:28.910 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 72c0cedc --release --await 2024-09-11T22:05:29.156 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:29.611 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:05:29.611 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:05:29.612 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:05:29.612 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:29 smithi152 ceph-mon[31188]: pgmap v39: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 16 op/s 2024-09-11T22:05:29.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.699+0000 7f73d13a8640 1 -- 172.21.15.152:0/3372719624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73cc108160 msgr2=0x7f73cc10eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:29.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.699+0000 7f73d13a8640 1 --2- 172.21.15.152:0/3372719624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73cc108160 0x7f73cc10eb00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009cd0 tx=0x7f73c402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.699+0000 7f73d13a8640 1 -- 172.21.15.152:0/3372719624 shutdown_connections 2024-09-11T22:05:29.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.699+0000 7f73d13a8640 1 --2- 172.21.15.152:0/3372719624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73cc108160 0x7f73cc10eb00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.699+0000 7f73d13a8640 1 --2- 172.21.15.152:0/3372719624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73cc101290 0x7f73cc107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.699+0000 7f73d13a8640 1 --2- 172.21.15.152:0/3372719624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73cc1008e0 0x7f73cc100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.699+0000 7f73d13a8640 1 -- 172.21.15.152:0/3372719624 >> 172.21.15.152:0/3372719624 conn(0x7f73cc077210 msgr2=0x7f73cc077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:29.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.699+0000 7f73d13a8640 1 -- 172.21.15.152:0/3372719624 shutdown_connections 2024-09-11T22:05:29.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.699+0000 7f73d13a8640 1 -- 172.21.15.152:0/3372719624 wait complete. 2024-09-11T22:05:29.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73d13a8640 1 Processor -- start 2024-09-11T22:05:29.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73d13a8640 1 -- start start 2024-09-11T22:05:29.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73d13a8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73cc1008e0 0x7f73cc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73d13a8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73cc101290 0x7f73cc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73d13a8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73cc108160 0x7f73cc19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73d13a8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc111ff0 con 0x7f73cc101290 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73d13a8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc111e70 con 0x7f73cc1008e0 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73d13a8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc112170 con 0x7f73cc108160 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73c3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73cc101290 0x7f73cc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73c3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73cc101290 0x7f73cc1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53262/0 (socket says 172.21.15.152:53262) 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73c3fff640 1 -- 172.21.15.152:0/3249617696 learned_addr learned my addr 172.21.15.152:0/3249617696 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73cb7fe640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73cc108160 0x7f73cc19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73caffd640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73cc1008e0 0x7f73cc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73c3fff640 1 -- 172.21.15.152:0/3249617696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73cc108160 msgr2=0x7f73cc19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73c3fff640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73cc108160 0x7f73cc19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73c3fff640 1 -- 172.21.15.152:0/3249617696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73cc1008e0 msgr2=0x7f73cc198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73c3fff640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73cc1008e0 0x7f73cc198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.700+0000 7f73c3fff640 1 -- 172.21.15.152:0/3249617696 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc19d410 con 0x7f73cc101290 2024-09-11T22:05:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.701+0000 7f73c3fff640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73cc101290 0x7f73cc1989a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c940 tx=0x7f73b400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.701+0000 7f73c8ff9640 1 -- 172.21.15.152:0/3249617696 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4004220 con 0x7f73cc101290 2024-09-11T22:05:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.701+0000 7f73c8ff9640 1 -- 172.21.15.152:0/3249617696 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b40043c0 con 0x7f73cc101290 2024-09-11T22:05:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.701+0000 7f73d13a8640 1 -- 172.21.15.152:0/3249617696 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73cc19d700 con 0x7f73cc101290 2024-09-11T22:05:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.701+0000 7f73c8ff9640 1 -- 172.21.15.152:0/3249617696 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4004a00 con 0x7f73cc101290 2024-09-11T22:05:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.701+0000 7f73d13a8640 1 -- 172.21.15.152:0/3249617696 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73cc101790 con 0x7f73cc101290 2024-09-11T22:05:29.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.703+0000 7f73c8ff9640 1 -- 172.21.15.152:0/3249617696 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7f73b40079b0 con 0x7f73cc101290 2024-09-11T22:05:29.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.703+0000 7f73d3781740 1 Processor -- start 2024-09-11T22:05:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.703+0000 7f73d3781740 1 -- start start 2024-09-11T22:05:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73d3781740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca060 0x55ce0a8ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73c8ff9640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73b80a2ea0 0x7f73b80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73d3781740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca980 0x55ce0a8d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73d3781740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8d7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73d3781740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ce0a82f620 con 0x55ce0a8d5240 2024-09-11T22:05:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73d3781740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ce0a7d6e50 con 0x55ce0a8ca060 2024-09-11T22:05:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73d3781740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ce0a82b5e0 con 0x55ce0a8ca980 2024-09-11T22:05:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8d7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8d7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53268/0 (socket says 172.21.15.152:53268) 2024-09-11T22:05:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73c8ff9640 1 -- 172.21.15.152:0/3249617696 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f73b40cf3a0 con 0x7f73cc101290 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73cb7fe640 1 -- 172.21.15.152:0/2307670243 learned_addr learned my addr 172.21.15.152:0/2307670243 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73caffd640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73b80a2ea0 0x7f73b80a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73cb7fe640 1 --2- 172.21.15.152:0/2307670243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca060 0x55ce0a8ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73c3fff640 1 --2- 172.21.15.152:0/2307670243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca980 0x55ce0a8d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73cb7fe640 1 -- 172.21.15.152:0/2307670243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca980 msgr2=0x55ce0a8d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73cb7fe640 1 --2- 172.21.15.152:0/2307670243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca980 0x55ce0a8d4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73cb7fe640 1 -- 172.21.15.152:0/2307670243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca060 msgr2=0x55ce0a8ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73cb7fe640 1 --2- 172.21.15.152:0/2307670243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca060 0x55ce0a8ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.704+0000 7f73cb7fe640 1 -- 172.21.15.152:0/2307670243 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0a7c7d40 con 0x55ce0a8d5240 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.705+0000 7f73cb7fe640 1 --2- 172.21.15.152:0/2307670243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8d7630 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f73c4005fe0 tx=0x7f73c4005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b063a0f3f8376d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.705+0000 7f73c17fa640 1 -- 172.21.15.152:0/2307670243 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4031a00 con 0x55ce0a8d5240 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.705+0000 7f73caffd640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73b80a2ea0 0x7f73b80a5360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009b60 tx=0x7f73bc005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.705+0000 7f73c17fa640 1 -- 172.21.15.152:0/2307670243 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73c4036050 con 0x55ce0a8d5240 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.705+0000 7f73c17fa640 1 -- 172.21.15.152:0/2307670243 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c40044b0 con 0x55ce0a8d5240 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 -- 172.21.15.152:0/2307670243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 msgr2=0x55ce0a8d7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 --2- 172.21.15.152:0/2307670243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8d7630 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f73c4005fe0 tx=0x7f73c4005f10 comp rx=0 tx=0).stop 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 -- 172.21.15.152:0/2307670243 shutdown_connections 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 --2- 172.21.15.152:0/2307670243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8d7630 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 --2- 172.21.15.152:0/2307670243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca980 0x55ce0a8d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 --2- 172.21.15.152:0/2307670243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca060 0x55ce0a8ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 -- 172.21.15.152:0/2307670243 >> 172.21.15.152:0/2307670243 conn(0x55ce0a8c65f0 msgr2=0x55ce0a8c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 -- 172.21.15.152:0/2307670243 shutdown_connections 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 -- 172.21.15.152:0/2307670243 wait complete. 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 -- start start 2024-09-11T22:05:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 Processor -- start 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca060 0x55ce0a8d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca980 0x55ce0a8d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8d5240 0x55ce0a8d2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ce0a8d7e10 con 0x55ce0a8ca980 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ce0a7b7f10 con 0x55ce0a8d5240 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ce0a8d7f90 con 0x55ce0a8ca060 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.706+0000 7f73d3781740 10 client.0 _ll_register_callbacks cb 0x55ce0a7dbdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73c3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca980 0x55ce0a8d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73c3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca980 0x55ce0a8d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53270/0 (socket says 172.21.15.152:53270) 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73c3fff640 1 -- 172.21.15.152:0/4232035239 learned_addr learned my addr 172.21.15.152:0/4232035239 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73cb7fe640 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8d5240 0x55ce0a8d2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73caffd640 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca060 0x55ce0a8d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73c3fff640 1 -- 172.21.15.152:0/4232035239 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca060 msgr2=0x55ce0a8d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73c3fff640 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca060 0x55ce0a8d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73c3fff640 1 -- 172.21.15.152:0/4232035239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8d5240 msgr2=0x55ce0a8d2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73c3fff640 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8d5240 0x55ce0a8d2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73c3fff640 1 -- 172.21.15.152:0/4232035239 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce0a53e580 con 0x55ce0a8ca980 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73caffd640 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca060 0x55ce0a8d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73c3fff640 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca980 0x55ce0a8d2640 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f73b4007590 tx=0x7f73b409b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a01724421e62cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73b27fc640 1 -- 172.21.15.152:0/4232035239 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b401d040 con 0x55ce0a8ca980 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73b27fc640 1 -- 172.21.15.152:0/4232035239 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f73b409cbb0 con 0x55ce0a8ca980 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73d3781740 1 -- 172.21.15.152:0/4232035239 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73c4036050 con 0x55ce0a8ca980 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73b27fc640 1 -- 172.21.15.152:0/4232035239 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f73b409b650 con 0x55ce0a8ca980 2024-09-11T22:05:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73d3781740 10 client.15660 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73d3781740 1 -- 172.21.15.152:0/4232035239 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ce0a608960 con 0x55ce0a8ca980 2024-09-11T22:05:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.707+0000 7f73b27fc640 1 -- 172.21.15.152:0/4232035239 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73c4036050 con 0x55ce0a8ca980 2024-09-11T22:05:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.708+0000 7f73b27fc640 1 -- 172.21.15.152:0/4232035239 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f73b4084b90 con 0x55ce0a8ca980 2024-09-11T22:05:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.708+0000 7f73d3781740 10 client.15660 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.708+0000 7f73d3781740 10 client.15660 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:05:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.708+0000 7f73d3781740 20 client.15660 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.708+0000 7f73d3781740 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ce0a8e4cd0 0x55ce0a8e7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.708+0000 7f73d3781740 4 client.15660 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.708+0000 7f73d3781740 1 -- 172.21.15.152:0/4232035239 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce0a83cb90 con 0x55ce0a8e4cd0 2024-09-11T22:05:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.708+0000 7f73caffd640 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ce0a8e4cd0 0x55ce0a8e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.709+0000 7f73b27fc640 10 client.15660 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.709+0000 7f73caffd640 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ce0a8e4cd0 0x55ce0a8e7140 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26a160d2bf325f45 server_cookie=e548c70104e2c69d in_seq=0 out_seq=0 2024-09-11T22:05:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.709+0000 7f73b27fc640 1 -- 172.21.15.152:0/4232035239 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce0a83cb90 con 0x55ce0a8e4cd0 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.709+0000 7f73b27fc640 10 client.15660 handle_command_reply: tid=0 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.709+0000 7f73d3781740 1 client.15660 shutdown 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.709+0000 7f73d3781740 1 -- 172.21.15.152:0/4232035239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca980 msgr2=0x55ce0a8d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.709+0000 7f73d3781740 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca980 0x55ce0a8d2640 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f73b4007590 tx=0x7f73b409b2c0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.709+0000 7f73d3781740 1 -- 172.21.15.152:0/4232035239 shutdown_connections 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.709+0000 7f73d3781740 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ce0a8e4cd0 0x55ce0a8e7140 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.709+0000 7f73d3781740 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8d5240 0x55ce0a8d2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.709+0000 7f73d3781740 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca980 0x55ce0a8d2640 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.710+0000 7f73b27fc640 0 client.15660 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.710+0000 7f73d3781740 1 --2- 172.21.15.152:0/4232035239 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca060 0x55ce0a8d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.710+0000 7f73d3781740 1 -- 172.21.15.152:0/4232035239 >> 172.21.15.152:0/4232035239 conn(0x55ce0a8c65f0 msgr2=0x55ce0a8cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.710+0000 7f73d3781740 1 -- 172.21.15.152:0/4232035239 shutdown_connections 2024-09-11T22:05:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.710+0000 7f73d3781740 1 -- 172.21.15.152:0/4232035239 wait complete. 2024-09-11T22:05:29.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.710+0000 7f73d3781740 20 client.15660 trim_cache size 0 max 16384 2024-09-11T22:05:29.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73d3781740 1 Processor -- start 2024-09-11T22:05:29.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73d3781740 1 -- start start 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73d3781740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca060 0x55ce0a8c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73d3781740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca980 0x55ce0a8eca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73d3781740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8d5240 0x55ce0a8ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73d3781740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b23f0 con 0x55ce0a8ca060 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73d3781740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1afc90 con 0x55ce0a8ca980 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73d3781740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1adae0 con 0x55ce0a8d5240 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73caffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca060 0x55ce0a8c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73caffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca060 0x55ce0a8c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53286/0 (socket says 172.21.15.152:53286) 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73caffd640 1 -- 172.21.15.152:0/2755024303 learned_addr learned my addr 172.21.15.152:0/2755024303 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73cb7fe640 1 --2- 172.21.15.152:0/2755024303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8d5240 0x55ce0a8ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73c3fff640 1 --2- 172.21.15.152:0/2755024303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca980 0x55ce0a8eca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73caffd640 1 -- 172.21.15.152:0/2755024303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8d5240 msgr2=0x55ce0a8ecf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:29.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73caffd640 1 --2- 172.21.15.152:0/2755024303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8d5240 0x55ce0a8ecf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73caffd640 1 -- 172.21.15.152:0/2755024303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca980 msgr2=0x55ce0a8eca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:29.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73caffd640 1 --2- 172.21.15.152:0/2755024303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca980 0x55ce0a8eca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73caffd640 1 -- 172.21.15.152:0/2755024303 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0a8c6420 con 0x55ce0a8ca060 2024-09-11T22:05:29.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.727+0000 7f73c3fff640 1 --2- 172.21.15.152:0/2755024303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca980 0x55ce0a8eca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:29.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.728+0000 7f73caffd640 1 --2- 172.21.15.152:0/2755024303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca060 0x55ce0a8c5640 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f73bc011870 tx=0x7f73bc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f21f01c5db06c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:29.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.728+0000 7f73c0ff9640 1 -- 172.21.15.152:0/2755024303 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc012e10 con 0x55ce0a8ca060 2024-09-11T22:05:29.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.728+0000 7f73c0ff9640 1 -- 172.21.15.152:0/2755024303 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73bc0035f0 con 0x55ce0a8ca060 2024-09-11T22:05:29.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.728+0000 7f73c0ff9640 1 -- 172.21.15.152:0/2755024303 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc028590 con 0x55ce0a8ca060 2024-09-11T22:05:29.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.728+0000 7f73d3781740 1 -- 172.21.15.152:0/2755024303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca060 msgr2=0x55ce0a8c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:29.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.728+0000 7f73d3781740 1 --2- 172.21.15.152:0/2755024303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca060 0x55ce0a8c5640 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f73bc011870 tx=0x7f73bc014000 comp rx=0 tx=0).stop 2024-09-11T22:05:29.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 -- 172.21.15.152:0/2755024303 shutdown_connections 2024-09-11T22:05:29.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 --2- 172.21.15.152:0/2755024303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8d5240 0x55ce0a8ecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 --2- 172.21.15.152:0/2755024303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca980 0x55ce0a8eca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 --2- 172.21.15.152:0/2755024303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8ca060 0x55ce0a8c5640 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 -- 172.21.15.152:0/2755024303 >> 172.21.15.152:0/2755024303 conn(0x55ce0a8c65f0 msgr2=0x55ce0a8c4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 -- 172.21.15.152:0/2755024303 shutdown_connections 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 -- 172.21.15.152:0/2755024303 wait complete. 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 -- start start 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 Processor -- start 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca060 0x55ce0a8dda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca980 0x55ce0a8da1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8da780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1ae150 con 0x55ce0a8d5240 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1af5c0 con 0x55ce0a8ca060 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1ae820 con 0x55ce0a8ca980 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73d3781740 10 client.0 _ll_register_callbacks cb 0x7f73b409b490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:29.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8da780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73c3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca980 0x55ce0a8da1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8da780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53288/0 (socket says 172.21.15.152:53288) 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73c3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca980 0x55ce0a8da1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:51602/0 (socket says 172.21.15.152:51602) 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.729+0000 7f73cb7fe640 1 -- 172.21.15.152:0/3365984397 learned_addr learned my addr 172.21.15.152:0/3365984397 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73caffd640 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca060 0x55ce0a8dda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73cb7fe640 1 -- 172.21.15.152:0/3365984397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca980 msgr2=0x55ce0a8da1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73cb7fe640 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca980 0x55ce0a8da1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73cb7fe640 1 -- 172.21.15.152:0/3365984397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca060 msgr2=0x55ce0a8dda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73cb7fe640 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca060 0x55ce0a8dda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73cb7fe640 1 -- 172.21.15.152:0/3365984397 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce0a8c7280 con 0x55ce0a8d5240 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73cb7fe640 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8da780 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f73c4005fe0 tx=0x7f73c402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722bc483e6381783 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:29.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73b27fc640 1 -- 172.21.15.152:0/3365984397 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4004630 con 0x55ce0a8d5240 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73b27fc640 1 -- 172.21.15.152:0/3365984397 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f73c40047d0 con 0x55ce0a8d5240 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73d3781740 1 -- 172.21.15.152:0/3365984397 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73bc0035f0 con 0x55ce0a8d5240 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73b27fc640 1 -- 172.21.15.152:0/3365984397 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f73c405b050 con 0x55ce0a8d5240 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73d3781740 10 client.15666 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73d3781740 1 -- 172.21.15.152:0/3365984397 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ce0a950940 con 0x55ce0a8d5240 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.730+0000 7f73b27fc640 1 -- 172.21.15.152:0/3365984397 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73bc0035f0 con 0x55ce0a8d5240 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.731+0000 7f73b27fc640 1 -- 172.21.15.152:0/3365984397 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f73c4030070 con 0x55ce0a8d5240 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.731+0000 7f73d3781740 10 client.15666 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.731+0000 7f73d3781740 10 client.15666 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.731+0000 7f73d3781740 20 client.15666 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.731+0000 7f73d3781740 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ce0a8e4cd0 0x55ce0a952b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:29.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.731+0000 7f73d3781740 4 client.15666 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "72c0cedc", "release": true, "await": true}] 2024-09-11T22:05:29.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.731+0000 7f73d3781740 1 -- 172.21.15.152:0/3365984397 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "72c0cedc", "release": true, "await": true}) -- 0x55ce0a8370a0 con 0x55ce0a8e4cd0 2024-09-11T22:05:29.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.731+0000 7f73caffd640 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ce0a8e4cd0 0x55ce0a952b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:29.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.731+0000 7f73b27fc640 10 client.15666 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:29.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.731+0000 7f73caffd640 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ce0a8e4cd0 0x55ce0a952b70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7c96cac92d868a9 server_cookie=81a0ef1852e0b572 in_seq=0 out_seq=0 2024-09-11T22:05:29.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.776+0000 7f73b27fc640 1 -- 172.21.15.152:0/3365984397 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ce0a8370a0 con 0x55ce0a8e4cd0 2024-09-11T22:05:29.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.776+0000 7f73b27fc640 10 client.15666 handle_command_reply: tid=0 2024-09-11T22:05:29.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.776+0000 7f73d3781740 1 client.15666 shutdown 2024-09-11T22:05:29.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73d3781740 1 -- 172.21.15.152:0/3365984397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 msgr2=0x55ce0a8da780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:29.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73d3781740 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8da780 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f73c4005fe0 tx=0x7f73c402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73d3781740 1 -- 172.21.15.152:0/3365984397 shutdown_connections 2024-09-11T22:05:29.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73d3781740 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ce0a8e4cd0 0x55ce0a952b70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73d3781740 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ce0a8d5240 0x55ce0a8da780 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73d3781740 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce0a8ca980 0x55ce0a8da1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73d3781740 1 --2- 172.21.15.152:0/3365984397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ce0a8ca060 0x55ce0a8dda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73d3781740 1 -- 172.21.15.152:0/3365984397 >> 172.21.15.152:0/3365984397 conn(0x55ce0a8c65f0 msgr2=0x55ce0a8d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:29.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73b27fc640 0 client.15666 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:29.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73d3781740 1 -- 172.21.15.152:0/3365984397 shutdown_connections 2024-09-11T22:05:29.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73d3781740 1 -- 172.21.15.152:0/3365984397 wait complete. 2024-09-11T22:05:29.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.777+0000 7f73d3781740 20 client.15666 trim_cache size 0 max 16384 2024-09-11T22:05:29.779 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:05:29.779 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 27, 2024-09-11T22:05:29.779 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:05:29.779 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 4, 2024-09-11T22:05:29.779 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "72c0cedc": { 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 4, 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 144.5, 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:05:29.780 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:05:29.781 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:05:29.781 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:29.781 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:29.781 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:29.781 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:29.781 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:29.781 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:05:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 -- 172.21.15.152:0/3249617696 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73b80a2ea0 msgr2=0x7f73b80a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73b80a2ea0 0x7f73b80a5360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009b60 tx=0x7f73bc005f90 comp rx=0 tx=0).stop 2024-09-11T22:05:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 -- 172.21.15.152:0/3249617696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73cc101290 msgr2=0x7f73cc1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73cc101290 0x7f73cc1989a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c940 tx=0x7f73b400ce00 comp rx=0 tx=0).stop 2024-09-11T22:05:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 -- 172.21.15.152:0/3249617696 shutdown_connections 2024-09-11T22:05:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73b80a2ea0 0x7f73b80a5360 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73cc108160 0x7f73cc19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73cc101290 0x7f73cc1989a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 --2- 172.21.15.152:0/3249617696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73cc1008e0 0x7f73cc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 -- 172.21.15.152:0/3249617696 >> 172.21.15.152:0/3249617696 conn(0x7f73cc077210 msgr2=0x7f73cc105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:29.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 -- 172.21.15.152:0/3249617696 shutdown_connections 2024-09-11T22:05:29.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:29.778+0000 7f73d13a8640 1 -- 172.21.15.152:0/3249617696 wait complete. 2024-09-11T22:05:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:05:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:05:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:05:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:29 smithi179 ceph-mon[35603]: pgmap v39: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 16 op/s 2024-09-11T22:05:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:05:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:05:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:05:29.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:29 smithi193 ceph-mon[35545]: pgmap v39: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 16 op/s 2024-09-11T22:05:29.837 INFO:teuthology.orchestra.run.smithi152.stderr:1200000 of 3200000 tuples (37%) done (elapsed 29.52 s, remaining 49.19 s) 2024-09-11T22:05:29.987 INFO:teuthology.orchestra.run.smithi152.stderr:1300000 of 3200000 tuples (40%) done (elapsed 29.67 s, remaining 43.36 s) 2024-09-11T22:05:30.167 INFO:teuthology.orchestra.run.smithi152.stderr:1400000 of 3200000 tuples (43%) done (elapsed 29.85 s, remaining 38.37 s) 2024-09-11T22:05:30.265 INFO:teuthology.orchestra.run.smithi152.stderr:1500000 of 3200000 tuples (46%) done (elapsed 29.94 s, remaining 33.94 s) 2024-09-11T22:05:30.407 INFO:teuthology.orchestra.run.smithi152.stderr:1600000 of 3200000 tuples (50%) done (elapsed 30.09 s, remaining 30.09 s) 2024-09-11T22:05:30.486 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '72c0cedc', total seconds elapsed: 27.6 2024-09-11T22:05:30.526 INFO:teuthology.orchestra.run.smithi152.stderr:1700000 of 3200000 tuples (53%) done (elapsed 30.20 s, remaining 26.65 s) 2024-09-11T22:05:30.704 INFO:teuthology.orchestra.run.smithi152.stderr:1800000 of 3200000 tuples (56%) done (elapsed 30.38 s, remaining 23.63 s) 2024-09-11T22:05:30.871 INFO:teuthology.orchestra.run.smithi152.stderr:1900000 of 3200000 tuples (59%) done (elapsed 30.55 s, remaining 20.90 s) 2024-09-11T22:05:30.976 INFO:teuthology.orchestra.run.smithi152.stderr:2000000 of 3200000 tuples (62%) done (elapsed 30.66 s, remaining 18.39 s) 2024-09-11T22:05:31.119 INFO:teuthology.orchestra.run.smithi152.stderr:2100000 of 3200000 tuples (65%) done (elapsed 30.80 s, remaining 16.13 s) 2024-09-11T22:05:31.293 INFO:teuthology.orchestra.run.smithi152.stderr:2200000 of 3200000 tuples (68%) done (elapsed 30.97 s, remaining 14.08 s) 2024-09-11T22:05:31.388 INFO:teuthology.orchestra.run.smithi152.stderr:2300000 of 3200000 tuples (71%) done (elapsed 31.07 s, remaining 12.16 s) 2024-09-11T22:05:31.529 INFO:teuthology.orchestra.run.smithi152.stderr:2400000 of 3200000 tuples (75%) done (elapsed 31.21 s, remaining 10.40 s) 2024-09-11T22:05:31.705 INFO:teuthology.orchestra.run.smithi152.stderr:2500000 of 3200000 tuples (78%) done (elapsed 31.38 s, remaining 8.79 s) 2024-09-11T22:05:31.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:31 smithi179 ceph-mon[35603]: pgmap v40: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 MiB/s wr, 13 op/s 2024-09-11T22:05:31.798 INFO:teuthology.orchestra.run.smithi152.stderr:2600000 of 3200000 tuples (81%) done (elapsed 31.48 s, remaining 7.26 s) 2024-09-11T22:05:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:31 smithi193 ceph-mon[35545]: pgmap v40: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 MiB/s wr, 13 op/s 2024-09-11T22:05:31.939 INFO:teuthology.orchestra.run.smithi152.stderr:2700000 of 3200000 tuples (84%) done (elapsed 31.62 s, remaining 5.86 s) 2024-09-11T22:05:31.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:31 smithi152 ceph-mon[31188]: pgmap v40: 97 pgs: 97 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 MiB/s wr, 13 op/s 2024-09-11T22:05:32.037 INFO:teuthology.orchestra.run.smithi152.stderr:2800000 of 3200000 tuples (87%) done (elapsed 31.72 s, remaining 4.53 s) 2024-09-11T22:05:32.205 INFO:teuthology.orchestra.run.smithi152.stderr:2900000 of 3200000 tuples (90%) done (elapsed 31.88 s, remaining 3.30 s) 2024-09-11T22:05:32.339 INFO:teuthology.orchestra.run.smithi152.stderr:3000000 of 3200000 tuples (93%) done (elapsed 32.02 s, remaining 2.13 s) 2024-09-11T22:05:32.443 INFO:teuthology.orchestra.run.smithi152.stderr:3100000 of 3200000 tuples (96%) done (elapsed 32.12 s, remaining 1.04 s) 2024-09-11T22:05:32.612 INFO:teuthology.orchestra.run.smithi152.stderr:3200000 of 3200000 tuples (100%) done (elapsed 32.29 s, remaining 0.00 s) 2024-09-11T22:05:32.630 INFO:teuthology.orchestra.run.smithi152.stderr:vacuuming... 2024-09-11T22:05:33.248 INFO:teuthology.orchestra.run.smithi152.stderr:creating primary keys... 2024-09-11T22:05:33.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:33 smithi179 ceph-mon[35603]: pgmap v41: 97 pgs: 97 active+clean; 558 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 49 MiB/s wr, 43 op/s 2024-09-11T22:05:33.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:33 smithi193 ceph-mon[35545]: pgmap v41: 97 pgs: 97 active+clean; 558 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 49 MiB/s wr, 43 op/s 2024-09-11T22:05:33.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:33 smithi152 ceph-mon[31188]: pgmap v41: 97 pgs: 97 active+clean; 558 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 49 MiB/s wr, 43 op/s 2024-09-11T22:05:34.673 INFO:teuthology.orchestra.run.smithi152.stderr:done in 34.38 s (drop tables 0.00 s, create tables 0.01 s, client-side generate 32.32 s, vacuum 0.62 s, primary keys 1.42 s). 2024-09-11T22:05:34.676 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-11T22:05:34.818 INFO:teuthology.orchestra.run.smithi152.stderr:starting vacuum...end. 2024-09-11T22:05:35.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.261+0000 7fdf65801640 1 -- 172.21.15.152:0/4074807513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf601007f0 msgr2=0x7fdf60100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:35.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.261+0000 7fdf65801640 1 --2- 172.21.15.152:0/4074807513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf601007f0 0x7fdf60100c50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009930 tx=0x7fdf4802a420 comp rx=0 tx=0).stop 2024-09-11T22:05:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.261+0000 7fdf65801640 1 -- 172.21.15.152:0/4074807513 shutdown_connections 2024-09-11T22:05:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.261+0000 7fdf65801640 1 --2- 172.21.15.152:0/4074807513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf60101190 0x7fdf6010d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.261+0000 7fdf65801640 1 --2- 172.21.15.152:0/4074807513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf601007f0 0x7fdf60100c50 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.261+0000 7fdf65801640 1 --2- 172.21.15.152:0/4074807513 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf60106800 0x7fdf60106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.261+0000 7fdf65801640 1 -- 172.21.15.152:0/4074807513 >> 172.21.15.152:0/4074807513 conn(0x7fdf600777c0 msgr2=0x7fdf600feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.261+0000 7fdf65801640 1 -- 172.21.15.152:0/4074807513 shutdown_connections 2024-09-11T22:05:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.261+0000 7fdf65801640 1 -- 172.21.15.152:0/4074807513 wait complete. 2024-09-11T22:05:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.262+0000 7fdf65801640 1 Processor -- start 2024-09-11T22:05:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.262+0000 7fdf65801640 1 -- start start 2024-09-11T22:05:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.262+0000 7fdf65801640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf601007f0 0x7fdf60199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.262+0000 7fdf65801640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf60101190 0x7fdf601996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.262+0000 7fdf65801640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf60106800 0x7fdf601a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.262+0000 7fdf65801640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60110c40 con 0x7fdf601007f0 2024-09-11T22:05:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.262+0000 7fdf65801640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60110ac0 con 0x7fdf60106800 2024-09-11T22:05:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.262+0000 7fdf65801640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60110dc0 con 0x7fdf60101190 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.262+0000 7fdf5effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf601007f0 0x7fdf60199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf601007f0 0x7fdf60199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52706/0 (socket says 172.21.15.152:52706) 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5effd640 1 -- 172.21.15.152:0/1022827314 learned_addr learned my addr 172.21.15.152:0/1022827314 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5f7fe640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf60106800 0x7fdf601a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf57fff640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf60101190 0x7fdf601996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5effd640 1 -- 172.21.15.152:0/1022827314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf60101190 msgr2=0x7fdf601996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5effd640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf60101190 0x7fdf601996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5effd640 1 -- 172.21.15.152:0/1022827314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf60106800 msgr2=0x7fdf601a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5effd640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf60106800 0x7fdf601a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5effd640 1 -- 172.21.15.152:0/1022827314 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf601a4750 con 0x7fdf601007f0 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5effd640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf601007f0 0x7fdf60199190 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000b4a0 tx=0x7fdf5000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5cff9640 1 -- 172.21.15.152:0/1022827314 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50014070 con 0x7fdf601007f0 2024-09-11T22:05:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5cff9640 1 -- 172.21.15.152:0/1022827314 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf50010af0 con 0x7fdf601007f0 2024-09-11T22:05:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf65801640 1 -- 172.21.15.152:0/1022827314 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf601a4920 con 0x7fdf601007f0 2024-09-11T22:05:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf5cff9640 1 -- 172.21.15.152:0/1022827314 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50017d10 con 0x7fdf601007f0 2024-09-11T22:05:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.263+0000 7fdf65801640 1 -- 172.21.15.152:0/1022827314 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf601a4e40 con 0x7fdf601007f0 2024-09-11T22:05:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.266+0000 7fdf5cff9640 1 -- 172.21.15.152:0/1022827314 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7fdf50017070 con 0x7fdf601007f0 2024-09-11T22:05:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.267+0000 7fdf5cff9640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf4c0a2ea0 0x7fdf4c0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.267+0000 7fdf68675740 1 Processor -- start 2024-09-11T22:05:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.267+0000 7fdf68675740 1 -- start start 2024-09-11T22:05:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.267+0000 7fdf5cff9640 1 -- 172.21.15.152:0/1022827314 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fdf500ce950 con 0x7fdf601007f0 2024-09-11T22:05:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.267+0000 7fdf57fff640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf4c0a2ea0 0x7fdf4c0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf68675740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 0x563907dbf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf68675740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbf5e0 0x563907dc9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf68675740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dc9e80 0x563907dcc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf68675740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563907d232f0 con 0x563907dbf5e0 2024-09-11T22:05:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf68675740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563907ccb270 con 0x563907dbecc0 2024-09-11T22:05:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf68675740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563907d1f2b0 con 0x563907dc9e80 2024-09-11T22:05:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf5effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 0x563907dbf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf5effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 0x563907dbf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33532/0 (socket says 172.21.15.152:33532) 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf5effd640 1 -- 172.21.15.152:0/1006227300 learned_addr learned my addr 172.21.15.152:0/1006227300 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf57fff640 1 --2- 172.21.15.152:0/1006227300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbf5e0 0x563907dc9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf5f7fe640 1 --2- 172.21.15.152:0/1006227300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dc9e80 0x563907dcc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf57fff640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf4c0a2ea0 0x7fdf4c0a5360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf48000c00 tx=0x7fdf48032d10 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf5effd640 1 -- 172.21.15.152:0/1006227300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dc9e80 msgr2=0x563907dcc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf5effd640 1 --2- 172.21.15.152:0/1006227300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dc9e80 0x563907dcc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf5effd640 1 -- 172.21.15.152:0/1006227300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbf5e0 msgr2=0x563907dc9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf5effd640 1 --2- 172.21.15.152:0/1006227300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbf5e0 0x563907dc9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf5effd640 1 -- 172.21.15.152:0/1006227300 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563907cca340 con 0x563907dbecc0 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.268+0000 7fdf5effd640 1 --2- 172.21.15.152:0/1006227300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 0x563907dbf0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdf5009aa10 tx=0x7fdf50097130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69c55b3310b92a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.269+0000 7fdf557fa640 1 -- 172.21.15.152:0/1006227300 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5001e070 con 0x563907dbecc0 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.269+0000 7fdf557fa640 1 -- 172.21.15.152:0/1006227300 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf500a3980 con 0x563907dbecc0 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.269+0000 7fdf557fa640 1 -- 172.21.15.152:0/1006227300 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5009a160 con 0x563907dbecc0 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.269+0000 7fdf68675740 1 -- 172.21.15.152:0/1006227300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 msgr2=0x563907dbf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.269+0000 7fdf68675740 1 --2- 172.21.15.152:0/1006227300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 0x563907dbf0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdf5009aa10 tx=0x7fdf50097130 comp rx=0 tx=0).stop 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 -- 172.21.15.152:0/1006227300 shutdown_connections 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 --2- 172.21.15.152:0/1006227300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dc9e80 0x563907dcc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 --2- 172.21.15.152:0/1006227300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbf5e0 0x563907dc9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 --2- 172.21.15.152:0/1006227300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 0x563907dbf0a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 -- 172.21.15.152:0/1006227300 >> 172.21.15.152:0/1006227300 conn(0x563907dbb230 msgr2=0x563907dbb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 -- 172.21.15.152:0/1006227300 shutdown_connections 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 -- 172.21.15.152:0/1006227300 wait complete. 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 -- start start 2024-09-11T22:05:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 Processor -- start 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dbecc0 0x563907dc6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbf5e0 0x563907dc72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dc9e80 0x563907dc7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563907dcca50 con 0x563907dbf5e0 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563907cac290 con 0x563907dc9e80 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.270+0000 7fdf68675740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563907dccbd0 con 0x563907dbecc0 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf68675740 10 client.0 _ll_register_callbacks cb 0x563907cdd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf57fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbf5e0 0x563907dc72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf5f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dc9e80 0x563907dc7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf57fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbf5e0 0x563907dc72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52724/0 (socket says 172.21.15.152:52724) 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf57fff640 1 -- 172.21.15.152:0/944703292 learned_addr learned my addr 172.21.15.152:0/944703292 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf5f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dc9e80 0x563907dc7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33540/0 (socket says 172.21.15.152:33540) 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf5effd640 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dbecc0 0x563907dc6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf5f7fe640 1 -- 172.21.15.152:0/944703292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dbecc0 msgr2=0x563907dc6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf5f7fe640 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dbecc0 0x563907dc6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf5f7fe640 1 -- 172.21.15.152:0/944703292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbf5e0 msgr2=0x563907dc72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf5f7fe640 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbf5e0 0x563907dc72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf5f7fe640 1 -- 172.21.15.152:0/944703292 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563907a36210 con 0x563907dc9e80 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf5f7fe640 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dc9e80 0x563907dc7820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x563907dc1860 tx=0x7fdf58012b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e62ba05edbb0750c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.271+0000 7fdf467fc640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf467fc640 1 -- 172.21.15.152:0/944703292 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58010920 con 0x563907dc9e80 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf68675740 1 -- 172.21.15.152:0/944703292 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf500a3980 con 0x563907dc9e80 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf467fc640 1 -- 172.21.15.152:0/944703292 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fdf58010ac0 con 0x563907dc9e80 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf467fc640 1 -- 172.21.15.152:0/944703292 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdf58010cc0 con 0x563907dc9e80 2024-09-11T22:05:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf68675740 10 client.25181 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf68675740 1 -- 172.21.15.152:0/944703292 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563907b02620 con 0x563907dc9e80 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf467fc640 1 -- 172.21.15.152:0/944703292 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf500a3980 con 0x563907dc9e80 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf467fc640 1 -- 172.21.15.152:0/944703292 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fdf5800f040 con 0x563907dc9e80 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf68675740 10 client.25181 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf68675740 10 client.25181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf68675740 20 client.25181 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf68675740 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563907dde370 0x563907de07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf68675740 4 client.25181 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.272+0000 7fdf68675740 1 -- 172.21.15.152:0/944703292 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563907d30a20 con 0x563907dde370 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.273+0000 7fdf5effd640 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563907dde370 0x563907de07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.274+0000 7fdf467fc640 10 client.25181 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.274+0000 7fdf5effd640 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563907dde370 0x563907de07b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c644a6c2f131593b server_cookie=e0ac5ebfa6531a73 in_seq=0 out_seq=0 2024-09-11T22:05:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf467fc640 1 -- 172.21.15.152:0/944703292 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563907d30a20 con 0x563907dde370 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf467fc640 10 client.25181 handle_command_reply: tid=0 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf68675740 1 client.25181 shutdown 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf68675740 1 -- 172.21.15.152:0/944703292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dc9e80 msgr2=0x563907dc7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf68675740 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dc9e80 0x563907dc7820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x563907dc1860 tx=0x7fdf58012b00 comp rx=0 tx=0).stop 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf68675740 1 -- 172.21.15.152:0/944703292 shutdown_connections 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf68675740 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563907dde370 0x563907de07b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf467fc640 0 client.25181 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf68675740 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dc9e80 0x563907dc7820 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf68675740 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbf5e0 0x563907dc72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf68675740 1 --2- 172.21.15.152:0/944703292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dbecc0 0x563907dc6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf68675740 1 -- 172.21.15.152:0/944703292 >> 172.21.15.152:0/944703292 conn(0x563907dbb230 msgr2=0x563907dc0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.275+0000 7fdf68675740 1 -- 172.21.15.152:0/944703292 shutdown_connections 2024-09-11T22:05:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.276+0000 7fdf68675740 1 -- 172.21.15.152:0/944703292 wait complete. 2024-09-11T22:05:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.276+0000 7fdf68675740 20 client.25181 trim_cache size 0 max 16384 2024-09-11T22:05:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.294+0000 7fdf68675740 1 Processor -- start 2024-09-11T22:05:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.294+0000 7fdf68675740 1 -- start start 2024-09-11T22:05:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf68675740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 0x563907dc0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf68675740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dbf5e0 0x563907de60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf68675740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dc9e80 0x563907de6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf68675740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf601adf80 con 0x563907dc9e80 2024-09-11T22:05:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf68675740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf601ab820 con 0x563907dbecc0 2024-09-11T22:05:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf68675740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf601a9670 con 0x563907dbf5e0 2024-09-11T22:05:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf5f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dc9e80 0x563907de6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf5f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dc9e80 0x563907de6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52740/0 (socket says 172.21.15.152:52740) 2024-09-11T22:05:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf5f7fe640 1 -- 172.21.15.152:0/3810313175 learned_addr learned my addr 172.21.15.152:0/3810313175 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf5effd640 1 --2- 172.21.15.152:0/3810313175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 0x563907dc0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf57fff640 1 --2- 172.21.15.152:0/3810313175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dbf5e0 0x563907de60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf5f7fe640 1 -- 172.21.15.152:0/3810313175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dbf5e0 msgr2=0x563907de60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf5f7fe640 1 --2- 172.21.15.152:0/3810313175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dbf5e0 0x563907de60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf5f7fe640 1 -- 172.21.15.152:0/3810313175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 msgr2=0x563907dc0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf5f7fe640 1 --2- 172.21.15.152:0/3810313175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 0x563907dc0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf5f7fe640 1 -- 172.21.15.152:0/3810313175 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563907dc98f0 con 0x563907dc9e80 2024-09-11T22:05:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf5effd640 1 --2- 172.21.15.152:0/3810313175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 0x563907dc0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.295+0000 7fdf5f7fe640 1 --2- 172.21.15.152:0/3810313175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dc9e80 0x563907de6600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdf58000f80 tx=0x7fdf58005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6854a8e37c5a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.296+0000 7fdf54ff9640 1 -- 172.21.15.152:0/3810313175 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58032070 con 0x563907dc9e80 2024-09-11T22:05:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.296+0000 7fdf54ff9640 1 -- 172.21.15.152:0/3810313175 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf58023720 con 0x563907dc9e80 2024-09-11T22:05:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.296+0000 7fdf54ff9640 1 -- 172.21.15.152:0/3810313175 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58010e60 con 0x563907dc9e80 2024-09-11T22:05:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.296+0000 7fdf68675740 1 -- 172.21.15.152:0/3810313175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dc9e80 msgr2=0x563907de6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.296+0000 7fdf68675740 1 --2- 172.21.15.152:0/3810313175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dc9e80 0x563907de6600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdf58000f80 tx=0x7fdf58005bd0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.297+0000 7fdf68675740 1 -- 172.21.15.152:0/3810313175 shutdown_connections 2024-09-11T22:05:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.297+0000 7fdf68675740 1 --2- 172.21.15.152:0/3810313175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dc9e80 0x563907de6600 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.297+0000 7fdf68675740 1 --2- 172.21.15.152:0/3810313175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dbf5e0 0x563907de60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.297+0000 7fdf68675740 1 --2- 172.21.15.152:0/3810313175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbecc0 0x563907dc0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.297+0000 7fdf68675740 1 -- 172.21.15.152:0/3810313175 >> 172.21.15.152:0/3810313175 conn(0x563907dbb230 msgr2=0x563907dc0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.297+0000 7fdf68675740 1 -- 172.21.15.152:0/3810313175 shutdown_connections 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.297+0000 7fdf68675740 1 -- 172.21.15.152:0/3810313175 wait complete. 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.298+0000 7fdf68675740 1 -- start start 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.298+0000 7fdf68675740 1 Processor -- start 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.298+0000 7fdf68675740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbecc0 0x563907dd68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.298+0000 7fdf68675740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbf5e0 0x563907dc3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.298+0000 7fdf68675740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dc9e80 0x563907dc41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf68675740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf601a9ce0 con 0x563907dbecc0 2024-09-11T22:05:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf68675740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf601ab150 con 0x563907dbf5e0 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf68675740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf601aa3b0 con 0x563907dc9e80 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf68675740 10 client.0 _ll_register_callbacks cb 0x7fdf58009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf5effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbecc0 0x563907dd68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf5effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbecc0 0x563907dd68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52750/0 (socket says 172.21.15.152:52750) 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf5effd640 1 -- 172.21.15.152:0/2036236443 learned_addr learned my addr 172.21.15.152:0/2036236443 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf57fff640 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbf5e0 0x563907dc3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf5effd640 1 -- 172.21.15.152:0/2036236443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dc9e80 msgr2=0x563907dc41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf5effd640 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dc9e80 0x563907dc41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf5effd640 1 -- 172.21.15.152:0/2036236443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbf5e0 msgr2=0x563907dc3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf5effd640 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbf5e0 0x563907dc3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf5effd640 1 -- 172.21.15.152:0/2036236443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563907dc4860 con 0x563907dbecc0 2024-09-11T22:05:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf5effd640 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbecc0 0x563907dd68e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000be60 tx=0x7fdf5009ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccae4a13da4d0839 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.299+0000 7fdf467fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf467fc640 1 -- 172.21.15.152:0/2036236443 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5007f060 con 0x563907dbecc0 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf467fc640 1 -- 172.21.15.152:0/2036236443 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fdf50010ca0 con 0x563907dbecc0 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf68675740 1 -- 172.21.15.152:0/2036236443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf58023720 con 0x563907dbecc0 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf467fc640 1 -- 172.21.15.152:0/2036236443 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdf5001e040 con 0x563907dbecc0 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf68675740 10 client.15684 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf68675740 1 -- 172.21.15.152:0/2036236443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563907e4d880 con 0x563907dbecc0 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf467fc640 1 -- 172.21.15.152:0/2036236443 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf58023720 con 0x563907dbecc0 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf467fc640 1 -- 172.21.15.152:0/2036236443 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fdf500a3c60 con 0x563907dbecc0 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf68675740 10 client.15684 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf68675740 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf68675740 20 client.15684 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf68675740 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563907dde370 0x563907e4ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf68675740 4 client.15684 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:05:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.300+0000 7fdf68675740 1 -- 172.21.15.152:0/2036236443 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563907d2ad70 con 0x563907dde370 2024-09-11T22:05:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.301+0000 7fdf57fff640 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563907dde370 0x563907e4ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.302+0000 7fdf57fff640 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563907dde370 0x563907e4ff00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1efa29877790b918 server_cookie=306c121dcc834ba4 in_seq=0 out_seq=0 2024-09-11T22:05:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.302+0000 7fdf467fc640 10 client.15684 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.331+0000 7fdf467fc640 1 -- 172.21.15.152:0/2036236443 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563907d2ad70 con 0x563907dde370 2024-09-11T22:05:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.331+0000 7fdf467fc640 10 client.15684 handle_command_reply: tid=0 2024-09-11T22:05:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.331+0000 7fdf68675740 1 client.15684 shutdown 2024-09-11T22:05:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf68675740 1 -- 172.21.15.152:0/2036236443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbecc0 msgr2=0x563907dd68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf68675740 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbecc0 0x563907dd68e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000be60 tx=0x7fdf5009ae50 comp rx=0 tx=0).stop 2024-09-11T22:05:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf68675740 1 -- 172.21.15.152:0/2036236443 shutdown_connections 2024-09-11T22:05:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf68675740 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563907dde370 0x563907e4ff00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf68675740 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563907dc9e80 0x563907dc41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf467fc640 0 client.15684 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf68675740 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563907dbf5e0 0x563907dc3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf68675740 1 --2- 172.21.15.152:0/2036236443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563907dbecc0 0x563907dd68e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf68675740 1 -- 172.21.15.152:0/2036236443 >> 172.21.15.152:0/2036236443 conn(0x563907dbb230 msgr2=0x563907dc6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf68675740 1 -- 172.21.15.152:0/2036236443 shutdown_connections 2024-09-11T22:05:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf68675740 1 -- 172.21.15.152:0/2036236443 wait complete. 2024-09-11T22:05:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.332+0000 7fdf68675740 20 client.15684 trim_cache size 0 max 16384 2024-09-11T22:05:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:05:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:05:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:05:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:05:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.333+0000 7fdf65801640 1 -- 172.21.15.152:0/1022827314 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf4c0a2ea0 msgr2=0x7fdf4c0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.333+0000 7fdf65801640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf4c0a2ea0 0x7fdf4c0a5360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf48000c00 tx=0x7fdf48032d10 comp rx=0 tx=0).stop 2024-09-11T22:05:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.333+0000 7fdf65801640 1 -- 172.21.15.152:0/1022827314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf601007f0 msgr2=0x7fdf60199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.333+0000 7fdf65801640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf601007f0 0x7fdf60199190 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000b4a0 tx=0x7fdf5000b960 comp rx=0 tx=0).stop 2024-09-11T22:05:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.333+0000 7fdf65801640 1 -- 172.21.15.152:0/1022827314 shutdown_connections 2024-09-11T22:05:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.333+0000 7fdf65801640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf4c0a2ea0 0x7fdf4c0a5360 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.333+0000 7fdf65801640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf60106800 0x7fdf601a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.333+0000 7fdf65801640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf60101190 0x7fdf601996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.333+0000 7fdf65801640 1 --2- 172.21.15.152:0/1022827314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf601007f0 0x7fdf60199190 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.333+0000 7fdf65801640 1 -- 172.21.15.152:0/1022827314 >> 172.21.15.152:0/1022827314 conn(0x7fdf600777c0 msgr2=0x7fdf60103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.334+0000 7fdf65801640 1 -- 172.21.15.152:0/1022827314 shutdown_connections 2024-09-11T22:05:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:35.334+0000 7fdf65801640 1 -- 172.21.15.152:0/1022827314 wait complete. 2024-09-11T22:05:35.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:35 smithi179 ceph-mon[35603]: pgmap v42: 97 pgs: 97 active+clean; 558 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 37 MiB/s wr, 34 op/s 2024-09-11T22:05:35.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:35 smithi193 ceph-mon[35545]: pgmap v42: 97 pgs: 97 active+clean; 558 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 37 MiB/s wr, 34 op/s 2024-09-11T22:05:35.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:35 smithi152 ceph-mon[31188]: pgmap v42: 97 pgs: 97 active+clean; 558 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 37 MiB/s wr, 34 op/s 2024-09-11T22:05:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:37 smithi179 ceph-mon[35603]: pgmap v43: 97 pgs: 97 active+clean; 558 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 37 MiB/s wr, 34 op/s 2024-09-11T22:05:37.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:37 smithi193 ceph-mon[35545]: pgmap v43: 97 pgs: 97 active+clean; 558 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 37 MiB/s wr, 34 op/s 2024-09-11T22:05:37.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:37 smithi152 ceph-mon[31188]: pgmap v43: 97 pgs: 97 active+clean; 558 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 37 MiB/s wr, 34 op/s 2024-09-11T22:05:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:39 smithi179 ceph-mon[35603]: pgmap v44: 97 pgs: 97 active+clean; 943 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 75 MiB/s wr, 280 op/s 2024-09-11T22:05:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 5.0 s, 6645.3 tps, lat 14.781 ms stddev 19.711 2024-09-11T22:05:39.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:39 smithi193 ceph-mon[35545]: pgmap v44: 97 pgs: 97 active+clean; 943 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 75 MiB/s wr, 280 op/s 2024-09-11T22:05:39.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:39 smithi152 ceph-mon[31188]: pgmap v44: 97 pgs: 97 active+clean; 943 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 75 MiB/s wr, 280 op/s 2024-09-11T22:05:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:41 smithi179 ceph-mon[35603]: pgmap v45: 97 pgs: 97 active+clean; 943 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 75 MiB/s wr, 275 op/s 2024-09-11T22:05:41.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:41 smithi193 ceph-mon[35545]: pgmap v45: 97 pgs: 97 active+clean; 943 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 75 MiB/s wr, 275 op/s 2024-09-11T22:05:41.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:41 smithi152 ceph-mon[31188]: pgmap v45: 97 pgs: 97 active+clean; 943 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 75 MiB/s wr, 275 op/s 2024-09-11T22:05:43.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:43 smithi179 ceph-mon[35603]: pgmap v46: 97 pgs: 97 active+clean; 990 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 81 MiB/s wr, 681 op/s 2024-09-11T22:05:43.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:43 smithi193 ceph-mon[35545]: pgmap v46: 97 pgs: 97 active+clean; 990 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 81 MiB/s wr, 681 op/s 2024-09-11T22:05:43.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:43 smithi152 ceph-mon[31188]: pgmap v46: 97 pgs: 97 active+clean; 990 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 81 MiB/s wr, 681 op/s 2024-09-11T22:05:44.203 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:05:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 10.0 s, 6165.2 tps, lat 16.245 ms stddev 17.152 2024-09-11T22:05:45.688 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:45 smithi152 ceph-mon[31188]: pgmap v47: 97 pgs: 97 active+clean; 990 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 43 MiB/s wr, 651 op/s 2024-09-11T22:05:45.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.720+0000 7fab81ffb640 1 -- 172.21.15.152:0/2018881718 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c02c040 con 0x7fab84102ef0 2024-09-11T22:05:45.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.721+0000 7fab89411640 1 -- 172.21.15.152:0/2018881718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab84102ef0 msgr2=0x7fab84069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:45.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.721+0000 7fab89411640 1 --2- 172.21.15.152:0/2018881718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab84102ef0 0x7fab84069f70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009ca0 tx=0x7fab7c02a950 comp rx=0 tx=0).stop 2024-09-11T22:05:45.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.721+0000 7fab89411640 1 -- 172.21.15.152:0/2018881718 shutdown_connections 2024-09-11T22:05:45.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.721+0000 7fab89411640 1 --2- 172.21.15.152:0/2018881718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab84102ef0 0x7fab84069f70 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.721+0000 7fab89411640 1 --2- 172.21.15.152:0/2018881718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab84102570 0x7fab841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.722+0000 7fab89411640 1 --2- 172.21.15.152:0/2018881718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab84100e20 0x7fab84101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.722+0000 7fab89411640 1 -- 172.21.15.152:0/2018881718 >> 172.21.15.152:0/2018881718 conn(0x7fab840fc7d0 msgr2=0x7fab840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:45.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.722+0000 7fab89411640 1 -- 172.21.15.152:0/2018881718 shutdown_connections 2024-09-11T22:05:45.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.722+0000 7fab89411640 1 -- 172.21.15.152:0/2018881718 wait complete. 2024-09-11T22:05:45.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.723+0000 7fab89411640 1 Processor -- start 2024-09-11T22:05:45.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.723+0000 7fab89411640 1 -- start start 2024-09-11T22:05:45.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.723+0000 7fab89411640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab84100e20 0x7fab8410d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.723+0000 7fab89411640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab84102570 0x7fab8410d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.723+0000 7fab89411640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab84102ef0 0x7fab841a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.723+0000 7fab89411640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab8410fed0 con 0x7fab84102ef0 2024-09-11T22:05:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.723+0000 7fab89411640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab8410fd50 con 0x7fab84102570 2024-09-11T22:05:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.723+0000 7fab89411640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab84110050 con 0x7fab84100e20 2024-09-11T22:05:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.724+0000 7fab837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab84102ef0 0x7fab841a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.724+0000 7fab837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab84102ef0 0x7fab841a4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42784/0 (socket says 172.21.15.152:42784) 2024-09-11T22:05:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.724+0000 7fab837fe640 1 -- 172.21.15.152:0/1532905954 learned_addr learned my addr 172.21.15.152:0/1532905954 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.724+0000 7fab82ffd640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab84100e20 0x7fab8410d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.724+0000 7fab827fc640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab84102570 0x7fab8410d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.724+0000 7fab82ffd640 1 -- 172.21.15.152:0/1532905954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab84102570 msgr2=0x7fab8410d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.724+0000 7fab82ffd640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab84102570 0x7fab8410d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.724+0000 7fab82ffd640 1 -- 172.21.15.152:0/1532905954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab84102ef0 msgr2=0x7fab841a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.724+0000 7fab82ffd640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab84102ef0 0x7fab841a4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.724+0000 7fab82ffd640 1 -- 172.21.15.152:0/1532905954 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab841a4d20 con 0x7fab84100e20 2024-09-11T22:05:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.725+0000 7fab82ffd640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab84100e20 0x7fab8410d160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab7400d720 tx=0x7fab7400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.725+0000 7fab6bfff640 1 -- 172.21.15.152:0/1532905954 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74017070 con 0x7fab84100e20 2024-09-11T22:05:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.725+0000 7fab89411640 1 -- 172.21.15.152:0/1532905954 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab841a5010 con 0x7fab84100e20 2024-09-11T22:05:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.725+0000 7fab6bfff640 1 -- 172.21.15.152:0/1532905954 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7400de30 con 0x7fab84100e20 2024-09-11T22:05:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.725+0000 7fab6bfff640 1 -- 172.21.15.152:0/1532905954 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab740047a0 con 0x7fab84100e20 2024-09-11T22:05:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.726+0000 7fab89411640 1 -- 172.21.15.152:0/1532905954 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab841ab6d0 con 0x7fab84100e20 2024-09-11T22:05:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.729+0000 7fab6bfff640 1 -- 172.21.15.152:0/1532905954 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7fab740099d0 con 0x7fab84100e20 2024-09-11T22:05:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.730+0000 7fab8b7ea740 1 Processor -- start 2024-09-11T22:05:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.730+0000 7fab8b7ea740 1 -- start start 2024-09-11T22:05:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.730+0000 7fab6bfff640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab6c0a2fa0 0x7fab6c0a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.731+0000 7fab837fe640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab6c0a2fa0 0x7fab6c0a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.731+0000 7fab6bfff640 1 -- 172.21.15.152:0/1532905954 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fab740cf350 con 0x7fab84100e20 2024-09-11T22:05:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.731+0000 7fab8b7ea740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092f4a0 0x564d3092f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.731+0000 7fab8b7ea740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d3093a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.731+0000 7fab8b7ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3093a680 0x564d3093ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.731+0000 7fab8b7ea740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564d308952e0 con 0x564d3092f4a0 2024-09-11T22:05:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.731+0000 7fab8b7ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564d3083cce0 con 0x564d3093a680 2024-09-11T22:05:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.731+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092f4a0 0x564d3092f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.731+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092f4a0 0x564d3092f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42796/0 (socket says 172.21.15.152:42796) 2024-09-11T22:05:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.731+0000 7fab82ffd640 1 -- 172.21.15.152:0/1315602758 learned_addr learned my addr 172.21.15.152:0/1315602758 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.731+0000 7fab8b7ea740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564d308912a0 con 0x564d3092fdc0 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab827fc640 1 --2- 172.21.15.152:0/1315602758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d3093a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab82ffd640 1 -- 172.21.15.152:0/1315602758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 msgr2=0x564d3093a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab82ffd640 1 --2- 172.21.15.152:0/1315602758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d3093a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab837fe640 1 --2- 172.21.15.152:0/1315602758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3093a680 0x564d3093ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab82ffd640 1 -- 172.21.15.152:0/1315602758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3093a680 msgr2=0x564d3093ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab82ffd640 1 --2- 172.21.15.152:0/1315602758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3093a680 0x564d3093ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab82ffd640 1 -- 172.21.15.152:0/1315602758 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d30821440 con 0x564d3092f4a0 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab837fe640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab6c0a2fa0 0x7fab6c0a5460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009a60 tx=0x7fab7c02ff20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab82ffd640 1 --2- 172.21.15.152:0/1315602758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092f4a0 0x564d3092f880 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fab74097fd0 tx=0x7fab7409b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f05113a8f49941f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab697fa640 1 -- 172.21.15.152:0/1315602758 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74097040 con 0x564d3092f4a0 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab697fa640 1 -- 172.21.15.152:0/1315602758 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7409b600 con 0x564d3092f4a0 2024-09-11T22:05:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.732+0000 7fab697fa640 1 -- 172.21.15.152:0/1315602758 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74009cc0 con 0x564d3092f4a0 2024-09-11T22:05:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.733+0000 7fab8b7ea740 1 -- 172.21.15.152:0/1315602758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092f4a0 msgr2=0x564d3092f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.733+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/1315602758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092f4a0 0x564d3092f880 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fab74097fd0 tx=0x7fab7409b020 comp rx=0 tx=0).stop 2024-09-11T22:05:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.735+0000 7fab8b7ea740 1 -- 172.21.15.152:0/1315602758 shutdown_connections 2024-09-11T22:05:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.735+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/1315602758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3093a680 0x564d3093ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.735+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/1315602758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d3093a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.735+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/1315602758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092f4a0 0x564d3092f880 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.735+0000 7fab8b7ea740 1 -- 172.21.15.152:0/1315602758 >> 172.21.15.152:0/1315602758 conn(0x564d3092ba30 msgr2=0x564d3092be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:45.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.735+0000 7fab8b7ea740 1 -- 172.21.15.152:0/1315602758 shutdown_connections 2024-09-11T22:05:45.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.735+0000 7fab8b7ea740 1 -- 172.21.15.152:0/1315602758 wait complete. 2024-09-11T22:05:45.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.736+0000 7fab8b7ea740 1 -- start start 2024-09-11T22:05:45.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.736+0000 7fab8b7ea740 1 Processor -- start 2024-09-11T22:05:45.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.737+0000 7fab8b7ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3093a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.737+0000 7fab8b7ea740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d309372e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.737+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3093a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.737+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3093a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35202/0 (socket says 172.21.15.152:35202) 2024-09-11T22:05:45.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.737+0000 7fab82ffd640 1 -- 172.21.15.152:0/2803824218 learned_addr learned my addr 172.21.15.152:0/2803824218 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:45.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.737+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3093a680 0x564d30937880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.737+0000 7fab827fc640 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d309372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.738+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2803824218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564d3093d250 con 0x564d3093a680 2024-09-11T22:05:45.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.738+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2803824218 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564d30850050 con 0x564d3092f4a0 2024-09-11T22:05:45.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.738+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2803824218 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564d3093d3d0 con 0x564d3092fdc0 2024-09-11T22:05:45.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.738+0000 7fab837fe640 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3093a680 0x564d30937880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.738+0000 7fab82ffd640 1 -- 172.21.15.152:0/2803824218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 msgr2=0x564d309372e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.738+0000 7fab82ffd640 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d309372e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.738+0000 7fab82ffd640 1 -- 172.21.15.152:0/2803824218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3093a680 msgr2=0x564d30937880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.738+0000 7fab82ffd640 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3093a680 0x564d30937880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.738+0000 7fab82ffd640 1 -- 172.21.15.152:0/2803824218 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d306063c0 con 0x564d3092f4a0 2024-09-11T22:05:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.738+0000 7fab8b7ea740 10 client.0 _ll_register_callbacks cb 0x564d30890160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.738+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2803824218 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab7409b600 con 0x564d3092f4a0 2024-09-11T22:05:45.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.739+0000 7fab82ffd640 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3093a030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab740998b0 tx=0x7fab74005020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74df9c0fb5810cc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:45.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.739+0000 7fab66ff5640 10 client.25196 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:05:45.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.739+0000 7fab66ff5640 1 -- 172.21.15.152:0/2803824218 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab740b8020 con 0x564d3092f4a0 2024-09-11T22:05:45.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.739+0000 7fab66ff5640 1 -- 172.21.15.152:0/2803824218 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fab74084d50 con 0x564d3092f4a0 2024-09-11T22:05:45.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.739+0000 7fab66ff5640 1 -- 172.21.15.152:0/2803824218 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fab74097040 con 0x564d3092f4a0 2024-09-11T22:05:45.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.739+0000 7fab8b7ea740 10 client.25196 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:45.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.739+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2803824218 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=27}) -- 0x564d309489c0 con 0x564d3092f4a0 2024-09-11T22:05:45.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.740+0000 7fab66ff5640 1 -- 172.21.15.152:0/2803824218 <== mon.2 v2:172.21.15.179:3300/0 4 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fab7409aa50 con 0x564d3092f4a0 2024-09-11T22:05:45.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.740+0000 7fab8b7ea740 10 client.25196 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:45.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.740+0000 7fab8b7ea740 10 client.25196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:45.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.740+0000 7fab8b7ea740 20 client.25196 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:45.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.740+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564d30949d10 0x564d3094c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.740+0000 7fab8b7ea740 4 client.25196 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.740+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2803824218 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d308a2850 con 0x564d30949d10 2024-09-11T22:05:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.741+0000 7fab827fc640 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564d30949d10 0x564d3094c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.741+0000 7fab827fc640 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564d30949d10 0x564d3094c100 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dadab4512d88319 server_cookie=e087b9bcdb4ade6f in_seq=0 out_seq=0 2024-09-11T22:05:45.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.742+0000 7fab66ff5640 10 client.25196 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:45.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.742+0000 7fab66ff5640 1 -- 172.21.15.152:0/2803824218 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d308a2850 con 0x564d30949d10 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.742+0000 7fab66ff5640 10 client.25196 handle_command_reply: tid=0 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.742+0000 7fab8b7ea740 1 client.25196 shutdown 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.743+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2803824218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 msgr2=0x564d3093a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.743+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3093a030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab740998b0 tx=0x7fab74005020 comp rx=0 tx=0).stop 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.743+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2803824218 shutdown_connections 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.743+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564d30949d10 0x564d3094c100 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.744+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3093a680 0x564d30937880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.744+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d309372e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.744+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/2803824218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3093a030 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.744+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2803824218 >> 172.21.15.152:0/2803824218 conn(0x564d3092ba30 msgr2=0x564d30931710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.744+0000 7fab66ff5640 0 client.25196 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:45.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.744+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2803824218 shutdown_connections 2024-09-11T22:05:45.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.744+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2803824218 wait complete. 2024-09-11T22:05:45.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.744+0000 7fab8b7ea740 20 client.25196 trim_cache size 0 max 16384 2024-09-11T22:05:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.775+0000 7fab8b7ea740 1 Processor -- start 2024-09-11T22:05:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.775+0000 7fab8b7ea740 1 -- start start 2024-09-11T22:05:45.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.775+0000 7fab8b7ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3092b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.775+0000 7fab8b7ea740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d30932740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.775+0000 7fab8b7ea740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3093a680 0x564d30951750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.775+0000 7fab8b7ea740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b6820 con 0x564d3093a680 2024-09-11T22:05:45.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.775+0000 7fab8b7ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b40c0 con 0x564d3092f4a0 2024-09-11T22:05:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.775+0000 7fab8b7ea740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b1f10 con 0x564d3092fdc0 2024-09-11T22:05:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.776+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3092b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.776+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3092b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35206/0 (socket says 172.21.15.152:35206) 2024-09-11T22:05:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.776+0000 7fab82ffd640 1 -- 172.21.15.152:0/2381379918 learned_addr learned my addr 172.21.15.152:0/2381379918 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.776+0000 7fab827fc640 1 --2- 172.21.15.152:0/2381379918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d30932740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.776+0000 7fab82ffd640 1 -- 172.21.15.152:0/2381379918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 msgr2=0x564d30932740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.776+0000 7fab82ffd640 1 --2- 172.21.15.152:0/2381379918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d30932740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.776+0000 7fab82ffd640 1 -- 172.21.15.152:0/2381379918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3093a680 msgr2=0x564d30951750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.776+0000 7fab82ffd640 1 --2- 172.21.15.152:0/2381379918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3093a680 0x564d30951750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.776+0000 7fab82ffd640 1 -- 172.21.15.152:0/2381379918 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d309362b0 con 0x564d3092f4a0 2024-09-11T22:05:45.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.777+0000 7fab82ffd640 1 --2- 172.21.15.152:0/2381379918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3092b380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fab7409b590 tx=0x7fab740b0000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b53d5edf4b4c9234 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.777+0000 7fab68ff9640 1 -- 172.21.15.152:0/2381379918 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab740b8040 con 0x564d3092f4a0 2024-09-11T22:05:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.777+0000 7fab68ff9640 1 -- 172.21.15.152:0/2381379918 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab74083070 con 0x564d3092f4a0 2024-09-11T22:05:45.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.777+0000 7fab68ff9640 1 -- 172.21.15.152:0/2381379918 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74097350 con 0x564d3092f4a0 2024-09-11T22:05:45.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.780+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2381379918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 msgr2=0x564d3092b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:45.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.780+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/2381379918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3092b380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fab7409b590 tx=0x7fab740b0000 comp rx=0 tx=0).stop 2024-09-11T22:05:45.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.780+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2381379918 shutdown_connections 2024-09-11T22:05:45.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.780+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/2381379918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3093a680 0x564d30951750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.780+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/2381379918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3092fdc0 0x564d30932740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.780+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/2381379918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d3092f4a0 0x564d3092b380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.780+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2381379918 >> 172.21.15.152:0/2381379918 conn(0x564d3092ba30 msgr2=0x564d30932030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:45.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.780+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2381379918 shutdown_connections 2024-09-11T22:05:45.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.780+0000 7fab8b7ea740 1 -- 172.21.15.152:0/2381379918 wait complete. 2024-09-11T22:05:45.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.780+0000 7fab8b7ea740 1 -- start start 2024-09-11T22:05:45.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab8b7ea740 1 Processor -- start 2024-09-11T22:05:45.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab8b7ea740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092fdc0 0x564d30934290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab8b7ea740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3093a680 0x564d309347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab8b7ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d30934d10 0x564d309b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab8b7ea740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b2580 con 0x564d3092fdc0 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab8b7ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b39f0 con 0x564d30934d10 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab8b7ea740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b2c50 con 0x564d3093a680 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab8b7ea740 10 client.0 _ll_register_callbacks cb 0x7fab78009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab837fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d30934d10 0x564d309b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab837fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d30934d10 0x564d309b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35208/0 (socket says 172.21.15.152:35208) 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab837fe640 1 -- 172.21.15.152:0/3314375503 learned_addr learned my addr 172.21.15.152:0/3314375503 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab827fc640 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3093a680 0x564d309347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab82ffd640 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092fdc0 0x564d30934290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab837fe640 1 -- 172.21.15.152:0/3314375503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3093a680 msgr2=0x564d309347d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab837fe640 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3093a680 0x564d309347d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab837fe640 1 -- 172.21.15.152:0/3314375503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092fdc0 msgr2=0x564d30934290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab837fe640 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092fdc0 0x564d30934290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.781+0000 7fab837fe640 1 -- 172.21.15.152:0/3314375503 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d309c4c70 con 0x564d30934d10 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.782+0000 7fab82ffd640 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092fdc0 0x564d30934290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.782+0000 7fab827fc640 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3093a680 0x564d309347d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.782+0000 7fab837fe640 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d30934d10 0x564d309b3720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab7c02fd90 tx=0x7fab7c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985b4efcc3d2b3f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.782+0000 7fab66ff5640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.782+0000 7fab66ff5640 1 -- 172.21.15.152:0/3314375503 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c034040 con 0x564d30934d10 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.782+0000 7fab8b7ea740 1 -- 172.21.15.152:0/3314375503 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab74083070 con 0x564d30934d10 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.782+0000 7fab66ff5640 1 -- 172.21.15.152:0/3314375503 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fab7c043070 con 0x564d30934d10 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.782+0000 7fab66ff5640 1 -- 172.21.15.152:0/3314375503 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fab7c003d00 con 0x564d30934d10 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.782+0000 7fab8b7ea740 10 client.25202 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:45.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.782+0000 7fab8b7ea740 1 -- 172.21.15.152:0/3314375503 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564d309c5e50 con 0x564d30934d10 2024-09-11T22:05:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.783+0000 7fab66ff5640 1 -- 172.21.15.152:0/3314375503 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab74083070 con 0x564d30934d10 2024-09-11T22:05:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.784+0000 7fab66ff5640 1 -- 172.21.15.152:0/3314375503 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fab7c05a070 con 0x564d30934d10 2024-09-11T22:05:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.784+0000 7fab8b7ea740 10 client.25202 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.784+0000 7fab8b7ea740 10 client.25202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.784+0000 7fab8b7ea740 20 client.25202 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.784+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564d309c6520 0x564d309c8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.784+0000 7fab8b7ea740 4 client.25202 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:05:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.784+0000 7fab8b7ea740 1 -- 172.21.15.152:0/3314375503 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564d3089cd60 con 0x564d309c6520 2024-09-11T22:05:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.784+0000 7fab82ffd640 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564d309c6520 0x564d309c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.785+0000 7fab82ffd640 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564d309c6520 0x564d309c8940 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca58e277f9983ebc server_cookie=b730c9fdeb7a2685 in_seq=0 out_seq=0 2024-09-11T22:05:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.785+0000 7fab66ff5640 10 client.25202 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.785+0000 7fab66ff5640 1 -- 172.21.15.152:0/3314375503 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564d3089cd60 con 0x564d309c6520 2024-09-11T22:05:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.785+0000 7fab66ff5640 10 client.25202 handle_command_reply: tid=0 2024-09-11T22:05:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.785+0000 7fab8b7ea740 1 client.25202 shutdown 2024-09-11T22:05:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.785+0000 7fab8b7ea740 1 -- 172.21.15.152:0/3314375503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d30934d10 msgr2=0x564d309b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.785+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d30934d10 0x564d309b3720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab7c02fd90 tx=0x7fab7c0095c0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.786+0000 7fab8b7ea740 1 -- 172.21.15.152:0/3314375503 shutdown_connections 2024-09-11T22:05:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.786+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564d309c6520 0x564d309c8940 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.786+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d30934d10 0x564d309b3720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.786+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564d3093a680 0x564d309347d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.786+0000 7fab8b7ea740 1 --2- 172.21.15.152:0/3314375503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d3092fdc0 0x564d30934290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.786+0000 7fab8b7ea740 1 -- 172.21.15.152:0/3314375503 >> 172.21.15.152:0/3314375503 conn(0x564d3092ba30 msgr2=0x564d30931710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.786+0000 7fab66ff5640 0 client.25202 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.788+0000 7fab8b7ea740 1 -- 172.21.15.152:0/3314375503 shutdown_connections 2024-09-11T22:05:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.788+0000 7fab8b7ea740 1 -- 172.21.15.152:0/3314375503 wait complete. 2024-09-11T22:05:45.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.789+0000 7fab8b7ea740 20 client.25202 trim_cache size 0 max 16384 2024-09-11T22:05:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:05:45.791 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:05:45.791 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:05:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:05:45.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.791+0000 7fab89411640 1 -- 172.21.15.152:0/1532905954 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab6c0a2fa0 msgr2=0x7fab6c0a5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:45.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.791+0000 7fab89411640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab6c0a2fa0 0x7fab6c0a5460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009a60 tx=0x7fab7c02ff20 comp rx=0 tx=0).stop 2024-09-11T22:05:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.791+0000 7fab89411640 1 -- 172.21.15.152:0/1532905954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab84100e20 msgr2=0x7fab8410d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.791+0000 7fab89411640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab84100e20 0x7fab8410d160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab7400d720 tx=0x7fab7400dbe0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.791+0000 7fab89411640 1 -- 172.21.15.152:0/1532905954 shutdown_connections 2024-09-11T22:05:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.792+0000 7fab89411640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab6c0a2fa0 0x7fab6c0a5460 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.792+0000 7fab89411640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab84102ef0 0x7fab841a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.792+0000 7fab89411640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab84102570 0x7fab8410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.792+0000 7fab89411640 1 --2- 172.21.15.152:0/1532905954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab84100e20 0x7fab8410d160 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.792+0000 7fab89411640 1 -- 172.21.15.152:0/1532905954 >> 172.21.15.152:0/1532905954 conn(0x7fab840fc7d0 msgr2=0x7fab84105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.792+0000 7fab89411640 1 -- 172.21.15.152:0/1532905954 shutdown_connections 2024-09-11T22:05:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:45.792+0000 7fab89411640 1 -- 172.21.15.152:0/1532905954 wait complete. 2024-09-11T22:05:45.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:45 smithi179 ceph-mon[35603]: pgmap v47: 97 pgs: 97 active+clean; 990 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 43 MiB/s wr, 651 op/s 2024-09-11T22:05:45.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:45 smithi193 ceph-mon[35545]: pgmap v47: 97 pgs: 97 active+clean; 990 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 43 MiB/s wr, 651 op/s 2024-09-11T22:05:46.657 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:05:46.658 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:05:47.106 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:47.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.694+0000 7f5681ffb640 1 -- 172.21.15.152:0/1840798322 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568409d320 con 0x7f567c0051d0 2024-09-11T22:05:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.696+0000 7f56895b1640 1 -- 172.21.15.152:0/1840798322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f567c0051d0 msgr2=0x7f567c097fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.696+0000 7f56895b1640 1 --2- 172.21.15.152:0/1840798322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f567c0051d0 0x7f567c097fd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5684065a40 tx=0x7f5684096db0 comp rx=0 tx=0).stop 2024-09-11T22:05:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.697+0000 7f56895b1640 1 -- 172.21.15.152:0/1840798322 shutdown_connections 2024-09-11T22:05:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.697+0000 7f56895b1640 1 --2- 172.21.15.152:0/1840798322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f567c0051d0 0x7f567c097fd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.697+0000 7f56895b1640 1 --2- 172.21.15.152:0/1840798322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f567c004740 0x7f567c004b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.697+0000 7f56895b1640 1 --2- 172.21.15.152:0/1840798322 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c09a4c0 0x7f567c09a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.697+0000 7f56895b1640 1 -- 172.21.15.152:0/1840798322 >> 172.21.15.152:0/1840798322 conn(0x7f567c00a1b0 msgr2=0x7f567c00a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.697+0000 7f56895b1640 1 -- 172.21.15.152:0/1840798322 shutdown_connections 2024-09-11T22:05:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.697+0000 7f56895b1640 1 -- 172.21.15.152:0/1840798322 wait complete. 2024-09-11T22:05:47.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.698+0000 7f56895b1640 1 Processor -- start 2024-09-11T22:05:47.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.698+0000 7f56895b1640 1 -- start start 2024-09-11T22:05:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.699+0000 7f56895b1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f567c004740 0x7f567c1323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.699+0000 7f56895b1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f567c0051d0 0x7f567c132920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.699+0000 7f56895b1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c09a4c0 0x7f567c136cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.699+0000 7f56895b1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f567c0abf40 con 0x7f567c004740 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.699+0000 7f56895b1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f567c0abdc0 con 0x7f567c0051d0 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.699+0000 7f56895b1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f567c0ac0c0 con 0x7f567c09a4c0 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.699+0000 7f56827fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f567c0051d0 0x7f567c132920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.699+0000 7f56827fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f567c0051d0 0x7f567c132920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35216/0 (socket says 172.21.15.152:35216) 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.699+0000 7f56827fc640 1 -- 172.21.15.152:0/1936277067 learned_addr learned my addr 172.21.15.152:0/1936277067 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.699+0000 7f5682ffd640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f567c004740 0x7f567c1323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.699+0000 7f56837fe640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c09a4c0 0x7f567c136cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.700+0000 7f56827fc640 1 -- 172.21.15.152:0/1936277067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c09a4c0 msgr2=0x7f567c136cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.700+0000 7f56827fc640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c09a4c0 0x7f567c136cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.700+0000 7f56827fc640 1 -- 172.21.15.152:0/1936277067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f567c004740 msgr2=0x7f567c1323e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.700+0000 7f56827fc640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f567c004740 0x7f567c1323e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.700+0000 7f56827fc640 1 -- 172.21.15.152:0/1936277067 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567c137390 con 0x7f567c0051d0 2024-09-11T22:05:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.700+0000 7f56837fe640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c09a4c0 0x7f567c136cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.701+0000 7f56827fc640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f567c0051d0 0x7f567c132920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f567800e9f0 tx=0x7f567800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.701+0000 7f566bfff640 1 -- 172.21.15.152:0/1936277067 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567800ccc0 con 0x7f567c0051d0 2024-09-11T22:05:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.702+0000 7f56895b1640 1 -- 172.21.15.152:0/1936277067 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567c137680 con 0x7f567c0051d0 2024-09-11T22:05:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.702+0000 7f566bfff640 1 -- 172.21.15.152:0/1936277067 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5678010910 con 0x7f567c0051d0 2024-09-11T22:05:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.702+0000 7f566bfff640 1 -- 172.21.15.152:0/1936277067 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678018920 con 0x7f567c0051d0 2024-09-11T22:05:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.702+0000 7f56895b1640 1 -- 172.21.15.152:0/1936277067 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567c13ef60 con 0x7f567c0051d0 2024-09-11T22:05:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.703+0000 7f56895b1640 1 -- 172.21.15.152:0/1936277067 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567c097fd0 con 0x7f567c0051d0 2024-09-11T22:05:47.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.705+0000 7f566bfff640 1 -- 172.21.15.152:0/1936277067 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7f5678010430 con 0x7f567c0051d0 2024-09-11T22:05:47.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.705+0000 7f566bfff640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f566c0a2f30 0x7f566c0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:47.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.705+0000 7f566bfff640 1 -- 172.21.15.152:0/1936277067 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f56780cfa30 con 0x7f567c0051d0 2024-09-11T22:05:47.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.705+0000 7f5682ffd640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f566c0a2f30 0x7f566c0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:47.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.706+0000 7f5682ffd640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f566c0a2f30 0x7f566c0a53f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5674009b50 tx=0x7f5674005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:47.710+0000 7f566bfff640 1 -- 172.21.15.152:0/1936277067 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f567809c3e0 con 0x7f567c0051d0 2024-09-11T22:05:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:47 smithi179 ceph-mon[35603]: pgmap v48: 97 pgs: 97 active+clean; 990 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 43 MiB/s wr, 651 op/s 2024-09-11T22:05:47.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:47 smithi193 ceph-mon[35545]: pgmap v48: 97 pgs: 97 active+clean; 990 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 43 MiB/s wr, 651 op/s 2024-09-11T22:05:47.887 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:47 smithi152 ceph-mon[31188]: pgmap v48: 97 pgs: 97 active+clean; 990 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 43 MiB/s wr, 651 op/s 2024-09-11T22:05:48.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.089+0000 7f56895b1640 1 -- 172.21.15.152:0/1936277067 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f567c13f190 con 0x7f567c0051d0 2024-09-11T22:05:48.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.090+0000 7f566bfff640 1 -- 172.21.15.152:0/1936277067 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11927 (secure 0 0 0) 0x7f567809bce0 con 0x7f567c0051d0 2024-09-11T22:05:48.092 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:05:48.092 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":27,"btime":"2024-09-11T22:04:54:476799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:53.804306+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:05:48.092 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 27 2024-09-11T22:05:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.094+0000 7f56895b1640 1 -- 172.21.15.152:0/1936277067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f566c0a2f30 msgr2=0x7f566c0a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.094+0000 7f56895b1640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f566c0a2f30 0x7f566c0a53f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5674009b50 tx=0x7f5674005f90 comp rx=0 tx=0).stop 2024-09-11T22:05:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.094+0000 7f56895b1640 1 -- 172.21.15.152:0/1936277067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f567c0051d0 msgr2=0x7f567c132920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.094+0000 7f56895b1640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f567c0051d0 0x7f567c132920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f567800e9f0 tx=0x7f567800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.094+0000 7f56895b1640 1 -- 172.21.15.152:0/1936277067 shutdown_connections 2024-09-11T22:05:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.094+0000 7f56895b1640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f566c0a2f30 0x7f566c0a53f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.094+0000 7f56895b1640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c09a4c0 0x7f567c136cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.094+0000 7f56895b1640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f567c0051d0 0x7f567c132920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.094+0000 7f56895b1640 1 --2- 172.21.15.152:0/1936277067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f567c004740 0x7f567c1323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.094+0000 7f56895b1640 1 -- 172.21.15.152:0/1936277067 >> 172.21.15.152:0/1936277067 conn(0x7f567c00a1b0 msgr2=0x7f567c091e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.095+0000 7f56895b1640 1 -- 172.21.15.152:0/1936277067 shutdown_connections 2024-09-11T22:05:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:48.095+0000 7f56895b1640 1 -- 172.21.15.152:0/1936277067 wait complete. 2024-09-11T22:05:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.476+0000 7f4d92ffd640 1 -- 172.21.15.152:0/2532878860 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c030d30 con 0x7f4d94102470 2024-09-11T22:05:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.477+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/2532878860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d94102470 msgr2=0x7f4d9410e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.477+0000 7f4d9a6f1640 1 --2- 172.21.15.152:0/2532878860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d94102470 0x7f4d9410e9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009ca0 tx=0x7f4d8c02a8b0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.478+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/2532878860 shutdown_connections 2024-09-11T22:05:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.478+0000 7f4d9a6f1640 1 --2- 172.21.15.152:0/2532878860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d94102470 0x7f4d9410e9a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.478+0000 7f4d9a6f1640 1 --2- 172.21.15.152:0/2532878860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d94101ad0 0x7f4d94101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.478+0000 7f4d9a6f1640 1 --2- 172.21.15.152:0/2532878860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d94107b70 0x7f4d94107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.478+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/2532878860 >> 172.21.15.152:0/2532878860 conn(0x7f4d940fd7d0 msgr2=0x7f4d940ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.478+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/2532878860 shutdown_connections 2024-09-11T22:05:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.478+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/2532878860 wait complete. 2024-09-11T22:05:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d9a6f1640 1 Processor -- start 2024-09-11T22:05:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d9a6f1640 1 -- start start 2024-09-11T22:05:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d9a6f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d94101ad0 0x7f4d941160f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d9a6f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d94102470 0x7f4d94116630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d9a6f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d94107b70 0x7f4d94111200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d9a6f1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9410fcc0 con 0x7f4d94101ad0 2024-09-11T22:05:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d9a6f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9410fb40 con 0x7f4d94107b70 2024-09-11T22:05:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d9a6f1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9410fe40 con 0x7f4d94102470 2024-09-11T22:05:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d94101ad0 0x7f4d941160f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d98c8e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d94107b70 0x7f4d94111200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d94101ad0 0x7f4d941160f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42852/0 (socket says 172.21.15.152:42852) 2024-09-11T22:05:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d98c8e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d94107b70 0x7f4d94111200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35238/0 (socket says 172.21.15.152:35238) 2024-09-11T22:05:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.479+0000 7f4d93fff640 1 -- 172.21.15.152:0/1149408923 learned_addr learned my addr 172.21.15.152:0/1149408923 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d937fe640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d94102470 0x7f4d94116630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d98c8e640 1 -- 172.21.15.152:0/1149408923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d94102470 msgr2=0x7f4d94116630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d98c8e640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d94102470 0x7f4d94116630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d98c8e640 1 -- 172.21.15.152:0/1149408923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d94101ad0 msgr2=0x7f4d941160f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d98c8e640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d94101ad0 0x7f4d941160f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d98c8e640 1 -- 172.21.15.152:0/1149408923 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d94111ac0 con 0x7f4d94107b70 2024-09-11T22:05:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d93fff640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d94101ad0 0x7f4d941160f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d98c8e640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d94107b70 0x7f4d94111200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009bf0 tx=0x7f4d8c003ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d917fa640 1 -- 172.21.15.152:0/1149408923 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c030d40 con 0x7f4d94107b70 2024-09-11T22:05:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/1149408923 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d94111d50 con 0x7f4d94107b70 2024-09-11T22:05:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d917fa640 1 -- 172.21.15.152:0/1149408923 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d8c040070 con 0x7f4d94107b70 2024-09-11T22:05:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d917fa640 1 -- 172.21.15.152:0/1149408923 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0459d0 con 0x7f4d94107b70 2024-09-11T22:05:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.480+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/1149408923 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9411dff0 con 0x7f4d94107b70 2024-09-11T22:05:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.484+0000 7f4d917fa640 1 -- 172.21.15.152:0/1149408923 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 24) ==== 138118+0+0 (secure 0 0 0) 0x7f4d8c004620 con 0x7f4d94107b70 2024-09-11T22:05:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.485+0000 7f4d9d48f740 1 Processor -- start 2024-09-11T22:05:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d917fa640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4d7c0a30a0 0x7f4d7c0a5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d9d48f740 1 -- start start 2024-09-11T22:05:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d917fa640 1 -- 172.21.15.152:0/1149408923 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f4d8c0f0590 con 0x7f4d94107b70 2024-09-11T22:05:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d937fe640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4d7c0a30a0 0x7f4d7c0a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1369af0 0x55f4d1369ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d136a410 0x55f4d1374770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 0x55f4d13770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d9d48f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f4d12ce2f0 con 0x55f4d136a410 2024-09-11T22:05:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d9d48f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f4d1276270 con 0x55f4d1374cb0 2024-09-11T22:05:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d9d48f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f4d12ca2b0 con 0x55f4d1369af0 2024-09-11T22:05:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d937fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d136a410 0x55f4d1374770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1369af0 0x55f4d1369ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d937fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d136a410 0x55f4d1374770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42860/0 (socket says 172.21.15.152:42860) 2024-09-11T22:05:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d937fe640 1 -- 172.21.15.152:0/2679409339 learned_addr learned my addr 172.21.15.152:0/2679409339 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.486+0000 7f4d98c8e640 1 --2- 172.21.15.152:0/2679409339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 0x55f4d13770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.487+0000 7f4d93fff640 1 -- 172.21.15.152:0/2679409339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 msgr2=0x55f4d13770a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.487+0000 7f4d93fff640 1 --2- 172.21.15.152:0/2679409339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 0x55f4d13770a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.487+0000 7f4d93fff640 1 -- 172.21.15.152:0/2679409339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d136a410 msgr2=0x55f4d1374770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.487+0000 7f4d93fff640 1 --2- 172.21.15.152:0/2679409339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d136a410 0x55f4d1374770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.487+0000 7f4d93fff640 1 -- 172.21.15.152:0/2679409339 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4d1275340 con 0x55f4d1369af0 2024-09-11T22:05:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.487+0000 7f4d937fe640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4d7c0a30a0 0x7f4d7c0a5560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009fb0 tx=0x7f4d840147e0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.487+0000 7f4d93fff640 1 --2- 172.21.15.152:0/2679409339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1369af0 0x55f4d1369ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d88005d00 tx=0x7f4d88011950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fce5c1caaca8e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.487+0000 7f4d7a7fc640 1 -- 172.21.15.152:0/2679409339 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88011310 con 0x55f4d1369af0 2024-09-11T22:05:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.487+0000 7f4d7a7fc640 1 -- 172.21.15.152:0/2679409339 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d88005500 con 0x55f4d1369af0 2024-09-11T22:05:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.487+0000 7f4d7a7fc640 1 -- 172.21.15.152:0/2679409339 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8800f7a0 con 0x55f4d1369af0 2024-09-11T22:05:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.488+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2679409339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1369af0 msgr2=0x55f4d1369ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.488+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2679409339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1369af0 0x55f4d1369ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d88005d00 tx=0x7f4d88011950 comp rx=0 tx=0).stop 2024-09-11T22:05:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.489+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2679409339 shutdown_connections 2024-09-11T22:05:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.489+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2679409339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 0x55f4d13770a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.489+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2679409339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d136a410 0x55f4d1374770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.489+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2679409339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1369af0 0x55f4d1369ed0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.489+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2679409339 >> 172.21.15.152:0/2679409339 conn(0x55f4d1366060 msgr2=0x55f4d1366440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.489+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2679409339 shutdown_connections 2024-09-11T22:05:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.489+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2679409339 wait complete. 2024-09-11T22:05:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.490+0000 7f4d9d48f740 1 -- start start 2024-09-11T22:05:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.490+0000 7f4d9d48f740 1 Processor -- start 2024-09-11T22:05:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1369af0 0x55f4d1371b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d136a410 0x55f4d13720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1374cb0 0x55f4d1372600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d9d48f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f4d1377880 con 0x55f4d136a410 2024-09-11T22:05:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d9d48f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f4d1257290 con 0x55f4d1369af0 2024-09-11T22:05:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d9d48f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f4d1377a00 con 0x55f4d1374cb0 2024-09-11T22:05:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d9d48f740 10 client.0 _ll_register_callbacks cb 0x55f4d1288140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1369af0 0x55f4d1371b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d937fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d136a410 0x55f4d13720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1369af0 0x55f4d1371b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35262/0 (socket says 172.21.15.152:35262) 2024-09-11T22:05:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d93fff640 1 -- 172.21.15.152:0/2955507367 learned_addr learned my addr 172.21.15.152:0/2955507367 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.491+0000 7f4d98c8e640 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1374cb0 0x55f4d1372600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.492+0000 7f4d93fff640 1 -- 172.21.15.152:0/2955507367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1374cb0 msgr2=0x55f4d1372600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.492+0000 7f4d93fff640 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1374cb0 0x55f4d1372600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.492+0000 7f4d93fff640 1 -- 172.21.15.152:0/2955507367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d136a410 msgr2=0x55f4d13720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.492+0000 7f4d93fff640 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d136a410 0x55f4d13720c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.492+0000 7f4d93fff640 1 -- 172.21.15.152:0/2955507367 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4d0fe1210 con 0x55f4d1369af0 2024-09-11T22:05:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.492+0000 7f4d93fff640 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1369af0 0x55f4d1371b80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800a010 tx=0x7f4d88005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3da5b0819b7242b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.492+0000 7f4d737fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:05:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.496+0000 7f4d737fe640 1 -- 172.21.15.152:0/2955507367 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88029020 con 0x55f4d1369af0 2024-09-11T22:05:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.496+0000 7f4d737fe640 1 -- 172.21.15.152:0/2955507367 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f4d88004ef0 con 0x55f4d1369af0 2024-09-11T22:05:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.496+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2955507367 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d88005500 con 0x55f4d1369af0 2024-09-11T22:05:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.496+0000 7f4d737fe640 1 -- 172.21.15.152:0/2955507367 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d880050f0 con 0x55f4d1369af0 2024-09-11T22:05:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.496+0000 7f4d9d48f740 10 client.25220 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.496+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2955507367 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f4d10ad620 con 0x55f4d1369af0 2024-09-11T22:05:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.497+0000 7f4d737fe640 1 -- 172.21.15.152:0/2955507367 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d88005500 con 0x55f4d1369af0 2024-09-11T22:05:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.497+0000 7f4d737fe640 1 -- 172.21.15.152:0/2955507367 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f4d88003b50 con 0x55f4d1369af0 2024-09-11T22:05:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.497+0000 7f4d9d48f740 10 client.25220 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.497+0000 7f4d9d48f740 10 client.25220 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.497+0000 7f4d9d48f740 20 client.25220 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.497+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4d1384b40 0x55f4d1386f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.497+0000 7f4d9d48f740 4 client.25220 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.497+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2955507367 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4d12dba20 con 0x55f4d1384b40 2024-09-11T22:05:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.497+0000 7f4d937fe640 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4d1384b40 0x55f4d1386f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.498+0000 7f4d937fe640 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4d1384b40 0x55f4d1386f30 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3c2c4d4c108fc37 server_cookie=41ee0a535e18bf37 in_seq=0 out_seq=0 2024-09-11T22:05:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.499+0000 7f4d737fe640 10 client.25220 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.499+0000 7f4d737fe640 1 -- 172.21.15.152:0/2955507367 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4d12dba20 con 0x55f4d1384b40 2024-09-11T22:05:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.499+0000 7f4d737fe640 10 client.25220 handle_command_reply: tid=0 2024-09-11T22:05:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.499+0000 7f4d9d48f740 1 client.25220 shutdown 2024-09-11T22:05:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2955507367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1369af0 msgr2=0x55f4d1371b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1369af0 0x55f4d1371b80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800a010 tx=0x7f4d88005720 comp rx=0 tx=0).stop 2024-09-11T22:05:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2955507367 shutdown_connections 2024-09-11T22:05:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4d1384b40 0x55f4d1386f30 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1374cb0 0x55f4d1372600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d136a410 0x55f4d13720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2955507367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1369af0 0x55f4d1371b80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2955507367 >> 172.21.15.152:0/2955507367 conn(0x55f4d1366060 msgr2=0x55f4d136bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d737fe640 0 client.25220 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2955507367 shutdown_connections 2024-09-11T22:05:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2955507367 wait complete. 2024-09-11T22:05:48.502 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.500+0000 7f4d9d48f740 20 client.25220 trim_cache size 0 max 16384 2024-09-11T22:05:48.530 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.530+0000 7f4d9d48f740 1 Processor -- start 2024-09-11T22:05:48.531 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.530+0000 7f4d9d48f740 1 -- start start 2024-09-11T22:05:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.531+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1369af0 0x55f4d136bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.531+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d136a410 0x55f4d13720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.531+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d1374cb0 0x55f4d13725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.531+0000 7f4d9d48f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941291f0 con 0x55f4d1374cb0 2024-09-11T22:05:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.531+0000 7f4d9d48f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94126a90 con 0x55f4d136a410 2024-09-11T22:05:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.531+0000 7f4d9d48f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94103210 con 0x55f4d1369af0 2024-09-11T22:05:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.532+0000 7f4d937fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d136a410 0x55f4d13720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.532+0000 7f4d937fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d136a410 0x55f4d13720b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35272/0 (socket says 172.21.15.152:35272) 2024-09-11T22:05:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.532+0000 7f4d937fe640 1 -- 172.21.15.152:0/578549330 learned_addr learned my addr 172.21.15.152:0/578549330 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.532+0000 7f4d93fff640 1 --2- 172.21.15.152:0/578549330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1369af0 0x55f4d136bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.532+0000 7f4d937fe640 1 -- 172.21.15.152:0/578549330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1369af0 msgr2=0x55f4d136bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.532+0000 7f4d937fe640 1 --2- 172.21.15.152:0/578549330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1369af0 0x55f4d136bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.532+0000 7f4d937fe640 1 -- 172.21.15.152:0/578549330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d1374cb0 msgr2=0x55f4d13725f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:05:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.533+0000 7f4d937fe640 1 --2- 172.21.15.152:0/578549330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d1374cb0 0x55f4d13725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.533+0000 7f4d937fe640 1 -- 172.21.15.152:0/578549330 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4d1365e90 con 0x55f4d136a410 2024-09-11T22:05:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.533+0000 7f4d937fe640 1 --2- 172.21.15.152:0/578549330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d136a410 0x55f4d13720b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d8401c000 tx=0x7f4d8401d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09f9b465a9b0a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.534+0000 7f4d79ffb640 1 -- 172.21.15.152:0/578549330 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84005220 con 0x55f4d136a410 2024-09-11T22:05:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.534+0000 7f4d79ffb640 1 -- 172.21.15.152:0/578549330 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d84004c80 con 0x55f4d136a410 2024-09-11T22:05:48.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.534+0000 7f4d79ffb640 1 -- 172.21.15.152:0/578549330 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84021d00 con 0x55f4d136a410 2024-09-11T22:05:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.536+0000 7f4d9d48f740 1 -- 172.21.15.152:0/578549330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d136a410 msgr2=0x55f4d13720b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.536+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/578549330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d136a410 0x55f4d13720b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d8401c000 tx=0x7f4d8401d000 comp rx=0 tx=0).stop 2024-09-11T22:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.536+0000 7f4d9d48f740 1 -- 172.21.15.152:0/578549330 shutdown_connections 2024-09-11T22:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.536+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/578549330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d1374cb0 0x55f4d13725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.537+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/578549330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d136a410 0x55f4d13720b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.537+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/578549330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d1369af0 0x55f4d136bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.537+0000 7f4d9d48f740 1 -- 172.21.15.152:0/578549330 >> 172.21.15.152:0/578549330 conn(0x55f4d1366060 msgr2=0x55f4d136b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.537+0000 7f4d9d48f740 1 -- 172.21.15.152:0/578549330 shutdown_connections 2024-09-11T22:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.537+0000 7f4d9d48f740 1 -- 172.21.15.152:0/578549330 wait complete. 2024-09-11T22:05:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.538+0000 7f4d9d48f740 1 -- start start 2024-09-11T22:05:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.538+0000 7f4d9d48f740 1 Processor -- start 2024-09-11T22:05:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.539+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d1369af0 0x55f4d137d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.539+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d136a410 0x55f4d13784c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.539+0000 7f4d9d48f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 0x55f4d1378a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.539+0000 7f4d98c8e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 0x55f4d1378a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.540+0000 7f4d98c8e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 0x55f4d1378a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35288/0 (socket says 172.21.15.152:35288) 2024-09-11T22:05:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.540+0000 7f4d98c8e640 1 -- 172.21.15.152:0/2983198308 learned_addr learned my addr 172.21.15.152:0/2983198308 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.540+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2983198308 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94124f70 con 0x55f4d1369af0 2024-09-11T22:05:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.540+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2983198308 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941263c0 con 0x55f4d1374cb0 2024-09-11T22:05:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.540+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2983198308 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94125620 con 0x55f4d136a410 2024-09-11T22:05:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.540+0000 7f4d9d48f740 10 client.0 _ll_register_callbacks cb 0x7f4d840098b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.542+0000 7f4d98c8e640 1 -- 172.21.15.152:0/2983198308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d136a410 msgr2=0x55f4d13784c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:05:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.542+0000 7f4d98c8e640 1 --2- 172.21.15.152:0/2983198308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d136a410 0x55f4d13784c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.542+0000 7f4d98c8e640 1 -- 172.21.15.152:0/2983198308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d1369af0 msgr2=0x55f4d137d150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:05:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.542+0000 7f4d98c8e640 1 --2- 172.21.15.152:0/2983198308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d1369af0 0x55f4d137d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.542+0000 7f4d98c8e640 1 -- 172.21.15.152:0/2983198308 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4d136c940 con 0x55f4d1374cb0 2024-09-11T22:05:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.542+0000 7f4d98c8e640 1 --2- 172.21.15.152:0/2983198308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 0x55f4d1378a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c006010 tx=0x7f4d8c0bc550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=797c18931e7459ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.542+0000 7f4d737fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:05:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.542+0000 7f4d737fe640 1 -- 172.21.15.152:0/2983198308 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0bcdb0 con 0x55f4d1374cb0 2024-09-11T22:05:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.543+0000 7f4d737fe640 1 -- 172.21.15.152:0/2983198308 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f4d8c0a70c0 con 0x55f4d1374cb0 2024-09-11T22:05:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.543+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2983198308 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d84004c80 con 0x55f4d1374cb0 2024-09-11T22:05:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.543+0000 7f4d737fe640 1 -- 172.21.15.152:0/2983198308 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d8c0c0d00 con 0x55f4d1374cb0 2024-09-11T22:05:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.543+0000 7f4d9d48f740 10 client.25226 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.543+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2983198308 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f4d13ef2b0 con 0x55f4d1374cb0 2024-09-11T22:05:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.544+0000 7f4d737fe640 1 -- 172.21.15.152:0/2983198308 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d8c036040 con 0x55f4d1374cb0 2024-09-11T22:05:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.544+0000 7f4d737fe640 1 -- 172.21.15.152:0/2983198308 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f4d8c04d030 con 0x55f4d1374cb0 2024-09-11T22:05:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.544+0000 7f4d9d48f740 10 client.25226 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.544+0000 7f4d9d48f740 10 client.25226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.544+0000 7f4d9d48f740 20 client.25226 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.544+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2983198308 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4d13efa10 0x55f4d13f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.544+0000 7f4d9d48f740 4 client.25226 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:05:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.545+0000 7f4d93fff640 1 --2- 172.21.15.152:0/2983198308 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4d13efa10 0x55f4d13f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.545+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2983198308 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f4d84004c80 con 0x55f4d13efa10 2024-09-11T22:05:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.545+0000 7f4d737fe640 10 client.25226 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.546+0000 7f4d93fff640 1 --2- 172.21.15.152:0/2983198308 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4d13efa10 0x55f4d13f1e30 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2559926fa1d7e52 server_cookie=d5a91345c7bfcfe3 in_seq=0 out_seq=0 2024-09-11T22:05:48.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.552+0000 7f4d737fe640 1 -- 172.21.15.152:0/2983198308 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f4d84004c80 con 0x55f4d13efa10 2024-09-11T22:05:48.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.553+0000 7f4d737fe640 10 client.25226 handle_command_reply: tid=0 2024-09-11T22:05:48.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.553+0000 7f4d9d48f740 1 client.25226 shutdown 2024-09-11T22:05:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.553+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2983198308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 msgr2=0x55f4d1378a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.553+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2983198308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 0x55f4d1378a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c006010 tx=0x7f4d8c0bc550 comp rx=0 tx=0).stop 2024-09-11T22:05:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.553+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2983198308 shutdown_connections 2024-09-11T22:05:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.553+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2983198308 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4d13efa10 0x55f4d13f1e30 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2983198308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4d1374cb0 0x55f4d1378a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d737fe640 0 client.25226 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2983198308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4d136a410 0x55f4d13784c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d9d48f740 1 --2- 172.21.15.152:0/2983198308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4d1369af0 0x55f4d137d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2983198308 >> 172.21.15.152:0/2983198308 conn(0x55f4d1366060 msgr2=0x55f4d1373c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:48.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2983198308 shutdown_connections 2024-09-11T22:05:48.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d9d48f740 1 -- 172.21.15.152:0/2983198308 wait complete. 2024-09-11T22:05:48.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d9d48f740 20 client.25226 trim_cache size 0 max 16384 2024-09-11T22:05:48.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:05:48.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:05:48.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:05:48.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:05:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/1149408923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4d7c0a30a0 msgr2=0x7f4d7c0a5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d9a6f1640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4d7c0a30a0 0x7f4d7c0a5560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009fb0 tx=0x7f4d840147e0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/1149408923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d94107b70 msgr2=0x7f4d94111200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.554+0000 7f4d9a6f1640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d94107b70 0x7f4d94111200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009bf0 tx=0x7f4d8c003ea0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.555+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/1149408923 shutdown_connections 2024-09-11T22:05:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.555+0000 7f4d9a6f1640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4d7c0a30a0 0x7f4d7c0a5560 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.555+0000 7f4d9a6f1640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d94107b70 0x7f4d94111200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.555+0000 7f4d9a6f1640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d94102470 0x7f4d94116630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.555+0000 7f4d9a6f1640 1 --2- 172.21.15.152:0/1149408923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d94101ad0 0x7f4d941160f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.555+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/1149408923 >> 172.21.15.152:0/1149408923 conn(0x7f4d940fd7d0 msgr2=0x7f4d940fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.555+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/1149408923 shutdown_connections 2024-09-11T22:05:48.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:05:48.555+0000 7f4d9a6f1640 1 -- 172.21.15.152:0/1149408923 wait complete. 2024-09-11T22:05:48.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:48 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1936277067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:48.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:48 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1936277067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:48.894 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:48 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1936277067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:05:48.942 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:05:49.351 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:49.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:49 smithi179 ceph-mon[35603]: pgmap v49: 97 pgs: 97 active+clean; 1011 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 49 MiB/s wr, 1.03k op/s 2024-09-11T22:05:49.808 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:49 smithi152 ceph-mon[31188]: pgmap v49: 97 pgs: 97 active+clean; 1011 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 49 MiB/s wr, 1.03k op/s 2024-09-11T22:05:49.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 15.0 s, 4331.4 tps, lat 22.958 ms stddev 22.985 2024-09-11T22:05:49.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:49 smithi193 ceph-mon[35545]: pgmap v49: 97 pgs: 97 active+clean; 1011 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 49 MiB/s wr, 1.03k op/s 2024-09-11T22:05:50.276 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:05:50.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.931+0000 7face6072640 1 -- 172.21.15.152:0/3915078811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7face0105d90 msgr2=0x7face0106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:50.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.931+0000 7face6072640 1 --2- 172.21.15.152:0/3915078811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7face0105d90 0x7face0106220 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7facd8009ca0 tx=0x7facd802a940 comp rx=0 tx=0).stop 2024-09-11T22:05:50.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.932+0000 7face6072640 1 -- 172.21.15.152:0/3915078811 shutdown_connections 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.932+0000 7face6072640 1 --2- 172.21.15.152:0/3915078811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7face0105d90 0x7face0106220 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.932+0000 7face6072640 1 --2- 172.21.15.152:0/3915078811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face01012a0 0x7face0105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.932+0000 7face6072640 1 --2- 172.21.15.152:0/3915078811 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face0100980 0x7face0100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.932+0000 7face6072640 1 -- 172.21.15.152:0/3915078811 >> 172.21.15.152:0/3915078811 conn(0x7face00fc610 msgr2=0x7face00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.932+0000 7face6072640 1 -- 172.21.15.152:0/3915078811 shutdown_connections 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.932+0000 7face6072640 1 -- 172.21.15.152:0/3915078811 wait complete. 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.933+0000 7face6072640 1 Processor -- start 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.933+0000 7face6072640 1 -- start start 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.933+0000 7face6072640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7face0100980 0x7face01a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.933+0000 7face6072640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face01012a0 0x7face01a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face6072640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face0105d90 0x7face019e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face6072640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7face0118420 con 0x7face0100980 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face6072640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7face01182a0 con 0x7face0105d90 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face5070640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7face0100980 0x7face01a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face6072640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7face01185a0 con 0x7face01012a0 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face5070640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7face0100980 0x7face01a4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42896/0 (socket says 172.21.15.152:42896) 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face5070640 1 -- 172.21.15.152:0/199595847 learned_addr learned my addr 172.21.15.152:0/199595847 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face486f640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face01012a0 0x7face01a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face5871640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face0105d90 0x7face019e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face486f640 1 -- 172.21.15.152:0/199595847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face0105d90 msgr2=0x7face019e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face486f640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face0105d90 0x7face019e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face486f640 1 -- 172.21.15.152:0/199595847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7face0100980 msgr2=0x7face01a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face486f640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7face0100980 0x7face01a4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face486f640 1 -- 172.21.15.152:0/199595847 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face019ef60 con 0x7face01012a0 2024-09-11T22:05:50.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.934+0000 7face5871640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face0105d90 0x7face019e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.935+0000 7face486f640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face01012a0 0x7face01a4b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7facd000d680 tx=0x7facd000db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.935+0000 7facd67fc640 1 -- 172.21.15.152:0/199595847 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0017070 con 0x7face01012a0 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.935+0000 7facd67fc640 1 -- 172.21.15.152:0/199595847 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facd00097c0 con 0x7face01012a0 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.935+0000 7face6072640 1 -- 172.21.15.152:0/199595847 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face019f250 con 0x7face01012a0 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.936+0000 7facd67fc640 1 -- 172.21.15.152:0/199595847 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0004c60 con 0x7face01012a0 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.936+0000 7face6072640 1 -- 172.21.15.152:0/199595847 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face01ab5a0 con 0x7face01012a0 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.940+0000 7facd67fc640 1 -- 172.21.15.152:0/199595847 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7facd0009970 con 0x7face01012a0 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.942+0000 7facd67fc640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faccc0a2d70 0x7faccc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.942+0000 7face96ad740 1 Processor -- start 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.942+0000 7facd67fc640 1 -- 172.21.15.152:0/199595847 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7facd00cec30 con 0x7face01012a0 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.942+0000 7face5070640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faccc0a2d70 0x7faccc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.942+0000 7face96ad740 1 -- start start 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.942+0000 7face96ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 0x556977067270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.942+0000 7face96ad740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569770677b0 0x556977067bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.942+0000 7face96ad740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556977072550 0x556977074940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.942+0000 7face96ad740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556976fcd2f0 con 0x556977072550 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.942+0000 7face96ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556976f74cf0 con 0x556977068d20 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.942+0000 7face96ad740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556976fc92b0 con 0x5569770677b0 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face5070640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faccc0a2d70 0x7faccc0a5230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7facdc009a40 tx=0x7facdc0091c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face5070640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 0x556977067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face5070640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 0x556977067270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35302/0 (socket says 172.21.15.152:35302) 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face5871640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556977072550 0x556977074940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face5070640 1 -- 172.21.15.152:0/3334539060 learned_addr learned my addr 172.21.15.152:0/3334539060 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face486f640 1 --2- 172.21.15.152:0/3334539060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569770677b0 0x556977067bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face5070640 1 -- 172.21.15.152:0/3334539060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569770677b0 msgr2=0x556977067bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face5070640 1 --2- 172.21.15.152:0/3334539060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569770677b0 0x556977067bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face5070640 1 -- 172.21.15.152:0/3334539060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556977072550 msgr2=0x556977074940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face5070640 1 --2- 172.21.15.152:0/3334539060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556977072550 0x556977074940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face5070640 1 -- 172.21.15.152:0/3334539060 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556976f593a0 con 0x556977068d20 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.943+0000 7face5871640 1 --2- 172.21.15.152:0/3334539060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556977072550 0x556977074940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.945+0000 7face5070640 1 --2- 172.21.15.152:0/3334539060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 0x556977067270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facdc00ec50 tx=0x7facdc011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=531c6fdc93778716 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.945+0000 7faccb7fe640 1 -- 172.21.15.152:0/3334539060 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc01b040 con 0x556977068d20 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.945+0000 7faccb7fe640 1 -- 172.21.15.152:0/3334539060 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facdc024070 con 0x556977068d20 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.945+0000 7faccb7fe640 1 -- 172.21.15.152:0/3334539060 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc01f650 con 0x556977068d20 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.947+0000 7face96ad740 1 -- 172.21.15.152:0/3334539060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 msgr2=0x556977067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.947+0000 7face96ad740 1 --2- 172.21.15.152:0/3334539060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 0x556977067270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facdc00ec50 tx=0x7facdc011000 comp rx=0 tx=0).stop 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.947+0000 7face96ad740 1 -- 172.21.15.152:0/3334539060 shutdown_connections 2024-09-11T22:05:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.947+0000 7face96ad740 1 --2- 172.21.15.152:0/3334539060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556977072550 0x556977074940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.947+0000 7face96ad740 1 --2- 172.21.15.152:0/3334539060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569770677b0 0x556977067bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.947+0000 7face96ad740 1 --2- 172.21.15.152:0/3334539060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 0x556977067270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.947+0000 7face96ad740 1 -- 172.21.15.152:0/3334539060 >> 172.21.15.152:0/3334539060 conn(0x556977030310 msgr2=0x556977063e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.948+0000 7face96ad740 1 -- 172.21.15.152:0/3334539060 shutdown_connections 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.948+0000 7face96ad740 1 -- 172.21.15.152:0/3334539060 wait complete. 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.948+0000 7face96ad740 1 -- start start 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.948+0000 7face96ad740 1 Processor -- start 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.949+0000 7face96ad740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 0x556977071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.949+0000 7face96ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 0x55697706f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face96ad740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977072550 0x55697706f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face96ad740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556977075250 con 0x5569770677b0 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face96ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556976f88060 con 0x556977068d20 2024-09-11T22:05:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face96ad740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5569770753d0 con 0x556977072550 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face5070640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 0x556977071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face486f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 0x55697706f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face5070640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 0x556977071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42912/0 (socket says 172.21.15.152:42912) 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face5070640 1 -- 172.21.15.152:0/946760845 learned_addr learned my addr 172.21.15.152:0/946760845 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face5871640 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977072550 0x55697706f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face96ad740 10 client.0 _ll_register_callbacks cb 0x556976cdb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face5871640 1 -- 172.21.15.152:0/946760845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 msgr2=0x55697706f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face5871640 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 0x55697706f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face5871640 1 -- 172.21.15.152:0/946760845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 msgr2=0x556977071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face5871640 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 0x556977071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.950+0000 7face5871640 1 -- 172.21.15.152:0/946760845 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556976d3e3c0 con 0x556977072550 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.951+0000 7face5871640 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977072550 0x55697706f8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7facd8005cc0 tx=0x7facd8030c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8089ac679b30a6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:50.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.951+0000 7facc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.951+0000 7facc8ff9640 1 -- 172.21.15.152:0/946760845 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8049060 con 0x556977072550 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.951+0000 7facc8ff9640 1 -- 172.21.15.152:0/946760845 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7facd802fd40 con 0x556977072550 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.951+0000 7face96ad740 1 -- 172.21.15.152:0/946760845 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facdc024070 con 0x556977072550 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.952+0000 7facc8ff9640 1 -- 172.21.15.152:0/946760845 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7facd8034040 con 0x556977072550 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.952+0000 7face96ad740 10 client.25369 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.952+0000 7face96ad740 1 -- 172.21.15.152:0/946760845 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556977080d20 con 0x556977072550 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.952+0000 7facc8ff9640 1 -- 172.21.15.152:0/946760845 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facd8003e50 con 0x556977072550 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.953+0000 7facc8ff9640 1 -- 172.21.15.152:0/946760845 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7facd8043070 con 0x556977072550 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.953+0000 7face96ad740 10 client.25369 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.953+0000 7face96ad740 10 client.25369 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.953+0000 7face96ad740 20 client.25369 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:50.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.953+0000 7face96ad740 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5569770821e0 0x5569770845d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.953+0000 7face96ad740 4 client.25369 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.953+0000 7face96ad740 1 -- 172.21.15.152:0/946760845 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7facdc024070 con 0x5569770821e0 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.953+0000 7face5070640 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5569770821e0 0x5569770845d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.953+0000 7face5070640 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5569770821e0 0x5569770845d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b51e685f6a35d114 server_cookie=ca5ae77482bae53b in_seq=0 out_seq=0 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.953+0000 7facc8ff9640 10 client.25369 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7facc8ff9640 1 -- 172.21.15.152:0/946760845 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7facdc024070 con 0x5569770821e0 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7facc8ff9640 10 client.25369 handle_command_reply: tid=0 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7face96ad740 1 client.25369 shutdown 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7face96ad740 1 -- 172.21.15.152:0/946760845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977072550 msgr2=0x55697706f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7face96ad740 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977072550 0x55697706f8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7facd8005cc0 tx=0x7facd8030c20 comp rx=0 tx=0).stop 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7face96ad740 1 -- 172.21.15.152:0/946760845 shutdown_connections 2024-09-11T22:05:50.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7face96ad740 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5569770821e0 0x5569770845d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7facc8ff9640 0 client.25369 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7face96ad740 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977072550 0x55697706f8c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7face96ad740 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977068d20 0x55697706f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7face96ad740 1 --2- 172.21.15.152:0/946760845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 0x556977071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.954+0000 7face96ad740 1 -- 172.21.15.152:0/946760845 >> 172.21.15.152:0/946760845 conn(0x556977030310 msgr2=0x556977069b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.955+0000 7face96ad740 1 -- 172.21.15.152:0/946760845 shutdown_connections 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.955+0000 7face96ad740 1 -- 172.21.15.152:0/946760845 wait complete. 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.955+0000 7face96ad740 20 client.25369 trim_cache size 0 max 16384 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.977+0000 7face96ad740 1 Processor -- start 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.977+0000 7face96ad740 1 -- start start 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.977+0000 7face96ad740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 0x556977063f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.977+0000 7face96ad740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977068d20 0x55697706a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.977+0000 7face96ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977072550 0x55697706a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.977+0000 7face96ad740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7face01b6860 con 0x5569770677b0 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.977+0000 7face5070640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 0x556977063f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.977+0000 7face96ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7face01b4100 con 0x556977072550 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.977+0000 7face5070640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 0x556977063f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42924/0 (socket says 172.21.15.152:42924) 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.977+0000 7face5070640 1 -- 172.21.15.152:0/3901239637 learned_addr learned my addr 172.21.15.152:0/3901239637 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.977+0000 7face96ad740 1 -- 172.21.15.152:0/3901239637 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7face01b1f50 con 0x556977068d20 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.978+0000 7face486f640 1 --2- 172.21.15.152:0/3901239637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977068d20 0x55697706a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.978+0000 7face5070640 1 -- 172.21.15.152:0/3901239637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977068d20 msgr2=0x55697706a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.978+0000 7face5070640 1 --2- 172.21.15.152:0/3901239637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977068d20 0x55697706a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.978+0000 7face5070640 1 -- 172.21.15.152:0/3901239637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977072550 msgr2=0x55697706a840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.978+0000 7face5070640 1 --2- 172.21.15.152:0/3901239637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977072550 0x55697706a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.978+0000 7face5070640 1 -- 172.21.15.152:0/3901239637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569770674b0 con 0x5569770677b0 2024-09-11T22:05:50.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.978+0000 7face5070640 1 --2- 172.21.15.152:0/3901239637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 0x556977063f50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7facdc013cd0 tx=0x7facdc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecd16e4ba00e2fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.978+0000 7faccaffd640 1 -- 172.21.15.152:0/3901239637 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc036070 con 0x5569770677b0 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.978+0000 7faccaffd640 1 -- 172.21.15.152:0/3901239637 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facdc02d030 con 0x5569770677b0 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.978+0000 7faccaffd640 1 -- 172.21.15.152:0/3901239637 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc030a20 con 0x5569770677b0 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.979+0000 7face96ad740 1 -- 172.21.15.152:0/3901239637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 msgr2=0x556977063f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.979+0000 7face96ad740 1 --2- 172.21.15.152:0/3901239637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 0x556977063f50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7facdc013cd0 tx=0x7facdc011000 comp rx=0 tx=0).stop 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.980+0000 7face96ad740 1 -- 172.21.15.152:0/3901239637 shutdown_connections 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.980+0000 7face96ad740 1 --2- 172.21.15.152:0/3901239637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556977072550 0x55697706a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.980+0000 7face96ad740 1 --2- 172.21.15.152:0/3901239637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977068d20 0x55697706a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.980+0000 7face96ad740 1 --2- 172.21.15.152:0/3901239637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569770677b0 0x556977063f50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.980+0000 7face96ad740 1 -- 172.21.15.152:0/3901239637 >> 172.21.15.152:0/3901239637 conn(0x556977030310 msgr2=0x556977062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.980+0000 7face96ad740 1 -- 172.21.15.152:0/3901239637 shutdown_connections 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.980+0000 7face96ad740 1 -- 172.21.15.152:0/3901239637 wait complete. 2024-09-11T22:05:50.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.980+0000 7face96ad740 1 -- start start 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.980+0000 7face96ad740 1 Processor -- start 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.981+0000 7face96ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569770677b0 0x55697707a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.981+0000 7face96ad740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556977068d20 0x55697707aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.981+0000 7face96ad740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977072550 0x556977077630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.981+0000 7face96ad740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7face01b25c0 con 0x556977068d20 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.981+0000 7face96ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7face01b3a30 con 0x5569770677b0 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.981+0000 7face96ad740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7face01b2c90 con 0x556977072550 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.981+0000 7face96ad740 10 client.0 _ll_register_callbacks cb 0x7facd8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.981+0000 7face5070640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569770677b0 0x55697707a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.981+0000 7face5070640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569770677b0 0x55697707a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35318/0 (socket says 172.21.15.152:35318) 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.981+0000 7face5070640 1 -- 172.21.15.152:0/1783650306 learned_addr learned my addr 172.21.15.152:0/1783650306 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.981+0000 7face486f640 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556977068d20 0x55697707aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.982+0000 7face5070640 1 -- 172.21.15.152:0/1783650306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977072550 msgr2=0x556977077630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:50.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.982+0000 7face5070640 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977072550 0x556977077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.982+0000 7face5070640 1 -- 172.21.15.152:0/1783650306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556977068d20 msgr2=0x55697707aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:50.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.982+0000 7face5070640 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556977068d20 0x55697707aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.982+0000 7face5070640 1 -- 172.21.15.152:0/1783650306 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556977077ba0 con 0x5569770677b0 2024-09-11T22:05:50.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.982+0000 7face5070640 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569770677b0 0x55697707a660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7facdc004700 tx=0x7facdc006dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85fa1fa3b88024bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:50.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.982+0000 7facc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:05:50.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.983+0000 7facc8ff9640 1 -- 172.21.15.152:0/1783650306 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc036070 con 0x5569770677b0 2024-09-11T22:05:50.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.983+0000 7facc8ff9640 1 -- 172.21.15.152:0/1783650306 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7facdc013650 con 0x5569770677b0 2024-09-11T22:05:50.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.983+0000 7face96ad740 1 -- 172.21.15.152:0/1783650306 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facdc02d030 con 0x5569770677b0 2024-09-11T22:05:50.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.983+0000 7facc8ff9640 1 -- 172.21.15.152:0/1783650306 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7facdc013850 con 0x5569770677b0 2024-09-11T22:05:50.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.983+0000 7face96ad740 10 client.25241 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:50.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.983+0000 7face96ad740 1 -- 172.21.15.152:0/1783650306 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5569770ed600 con 0x5569770677b0 2024-09-11T22:05:50.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.984+0000 7facc8ff9640 1 -- 172.21.15.152:0/1783650306 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facdc02d030 con 0x5569770677b0 2024-09-11T22:05:50.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.984+0000 7facc8ff9640 1 -- 172.21.15.152:0/1783650306 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7facdc01e030 con 0x5569770677b0 2024-09-11T22:05:50.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.984+0000 7face96ad740 10 client.25241 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:50.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.984+0000 7face96ad740 10 client.25241 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:05:50.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.984+0000 7face96ad740 20 client.25241 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:50.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.984+0000 7face96ad740 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5569770ed8e0 0x5569770efd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:50.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.984+0000 7face96ad740 4 client.25241 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:05:50.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.984+0000 7face96ad740 1 -- 172.21.15.152:0/1783650306 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556976fda860 con 0x5569770ed8e0 2024-09-11T22:05:50.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.984+0000 7face486f640 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5569770ed8e0 0x5569770efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:50.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7facc8ff9640 10 client.25241 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:05:50.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7face486f640 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5569770ed8e0 0x5569770efd00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cb5b9401a538ee04 server_cookie=3b54e4d017a195ee in_seq=0 out_seq=0 2024-09-11T22:05:50.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7facc8ff9640 1 -- 172.21.15.152:0/1783650306 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556976fda860 con 0x5569770ed8e0 2024-09-11T22:05:50.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7facc8ff9640 10 client.25241 handle_command_reply: tid=0 2024-09-11T22:05:50.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7face96ad740 1 client.25241 shutdown 2024-09-11T22:05:50.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7face96ad740 1 -- 172.21.15.152:0/1783650306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569770677b0 msgr2=0x55697707a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:50.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7face96ad740 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569770677b0 0x55697707a660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7facdc004700 tx=0x7facdc006dc0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7face96ad740 1 -- 172.21.15.152:0/1783650306 shutdown_connections 2024-09-11T22:05:50.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7face96ad740 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5569770ed8e0 0x5569770efd00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7face96ad740 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556977072550 0x556977077630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7face96ad740 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556977068d20 0x55697707aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7face96ad740 1 --2- 172.21.15.152:0/1783650306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569770677b0 0x55697707a660 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.985+0000 7face96ad740 1 -- 172.21.15.152:0/1783650306 >> 172.21.15.152:0/1783650306 conn(0x556977030310 msgr2=0x556977070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:50.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.986+0000 7facc8ff9640 0 client.25241 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:05:50.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.986+0000 7face96ad740 1 -- 172.21.15.152:0/1783650306 shutdown_connections 2024-09-11T22:05:50.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.986+0000 7face96ad740 1 -- 172.21.15.152:0/1783650306 wait complete. 2024-09-11T22:05:50.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.986+0000 7face96ad740 20 client.25241 trim_cache size 0 max 16384 2024-09-11T22:05:50.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.987+0000 7face6072640 1 -- 172.21.15.152:0/199595847 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faccc0a2d70 msgr2=0x7faccc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:50.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.987+0000 7face6072640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faccc0a2d70 0x7faccc0a5230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7facdc009a40 tx=0x7facdc0091c0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.987+0000 7face6072640 1 -- 172.21.15.152:0/199595847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face01012a0 msgr2=0x7face01a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:50.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.987+0000 7face6072640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face01012a0 0x7face01a4b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7facd000d680 tx=0x7facd000db40 comp rx=0 tx=0).stop 2024-09-11T22:05:50.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.987+0000 7face6072640 1 -- 172.21.15.152:0/199595847 shutdown_connections 2024-09-11T22:05:50.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.987+0000 7face6072640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faccc0a2d70 0x7faccc0a5230 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.987+0000 7face6072640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face0105d90 0x7face019e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.987+0000 7face6072640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face01012a0 0x7face01a4b60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.987+0000 7face6072640 1 --2- 172.21.15.152:0/199595847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7face0100980 0x7face01a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:50.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.987+0000 7face6072640 1 -- 172.21.15.152:0/199595847 >> 172.21.15.152:0/199595847 conn(0x7face00fc610 msgr2=0x7face0103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:50.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.988+0000 7face6072640 1 -- 172.21.15.152:0/199595847 shutdown_connections 2024-09-11T22:05:50.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:49.988+0000 7face6072640 1 -- 172.21.15.152:0/199595847 wait complete. 2024-09-11T22:05:50.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:50 smithi152 ceph-mon[31188]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-11T22:05:50.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:50 smithi179 ceph-mon[35603]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-11T22:05:50.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:50 smithi193 ceph-mon[35545]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-11T22:05:51.411 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:05:51.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:51 smithi152 ceph-mon[31188]: pgmap v50: 97 pgs: 97 active+clean; 1011 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 781 op/s 2024-09-11T22:05:51.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:51 smithi179 ceph-mon[35603]: pgmap v50: 97 pgs: 97 active+clean; 1011 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 781 op/s 2024-09-11T22:05:51.821 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:51.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:51 smithi193 ceph-mon[35545]: pgmap v50: 97 pgs: 97 active+clean; 1011 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 781 op/s 2024-09-11T22:05:52.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.353+0000 7fed16728640 1 -- 172.21.15.152:0/4040328261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed10105de0 msgr2=0x7fed1010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:52.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.353+0000 7fed16728640 1 --2- 172.21.15.152:0/4040328261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed10105de0 0x7fed1010d960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed08009ca0 tx=0x7fed0802a8d0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.353+0000 7fed16728640 1 -- 172.21.15.152:0/4040328261 shutdown_connections 2024-09-11T22:05:52.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.353+0000 7fed16728640 1 --2- 172.21.15.152:0/4040328261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed10105de0 0x7fed1010d960 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.353+0000 7fed16728640 1 --2- 172.21.15.152:0/4040328261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed10101e20 0x7fed101056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.353+0000 7fed16728640 1 --2- 172.21.15.152:0/4040328261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed10101470 0x7fed10101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.353+0000 7fed16728640 1 -- 172.21.15.152:0/4040328261 >> 172.21.15.152:0/4040328261 conn(0x7fed10077230 msgr2=0x7fed100fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:52.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.355+0000 7fed16728640 1 -- 172.21.15.152:0/4040328261 shutdown_connections 2024-09-11T22:05:52.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.355+0000 7fed16728640 1 -- 172.21.15.152:0/4040328261 wait complete. 2024-09-11T22:05:52.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.356+0000 7fed16728640 1 Processor -- start 2024-09-11T22:05:52.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.356+0000 7fed16728640 1 -- start start 2024-09-11T22:05:52.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.356+0000 7fed16728640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed10101470 0x7fed1006d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.356+0000 7fed16728640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed10101e20 0x7fed1006d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.356+0000 7fed16728640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed1006e050 0x7fed10071f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.356+0000 7fed16728640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fed1006c1e0 con 0x7fed10101e20 2024-09-11T22:05:52.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.356+0000 7fed16728640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fed1006c060 con 0x7fed10101470 2024-09-11T22:05:52.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.356+0000 7fed16728640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fed1006c360 con 0x7fed1006e050 2024-09-11T22:05:52.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.357+0000 7fed0ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed10101470 0x7fed1006d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.357+0000 7fed14cc5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed1006e050 0x7fed10071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.357+0000 7fed14cc5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed1006e050 0x7fed10071f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:57560/0 (socket says 172.21.15.152:57560) 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.357+0000 7fed14cc5640 1 -- 172.21.15.152:0/2346176290 learned_addr learned my addr 172.21.15.152:0/2346176290 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.358+0000 7fed14cc5640 1 -- 172.21.15.152:0/2346176290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed10101470 msgr2=0x7fed1006d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.358+0000 7fed14cc5640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed10101470 0x7fed1006d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.358+0000 7fed14cc5640 1 -- 172.21.15.152:0/2346176290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed10101e20 msgr2=0x7fed1006d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.358+0000 7fed14cc5640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed10101e20 0x7fed1006d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.358+0000 7fed14cc5640 1 -- 172.21.15.152:0/2346176290 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed100727f0 con 0x7fed1006e050 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.358+0000 7fed14cc5640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed1006e050 0x7fed10071f30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed08031710 tx=0x7fed08031740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.359+0000 7fed0d7fa640 1 -- 172.21.15.152:0/2346176290 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08004240 con 0x7fed1006e050 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.359+0000 7fed16728640 1 -- 172.21.15.152:0/2346176290 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed10072a80 con 0x7fed1006e050 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.359+0000 7fed16728640 1 -- 172.21.15.152:0/2346176290 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed101ab6d0 con 0x7fed1006e050 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.359+0000 7fed0d7fa640 1 -- 172.21.15.152:0/2346176290 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed0803f070 con 0x7fed1006e050 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.360+0000 7fed0d7fa640 1 -- 172.21.15.152:0/2346176290 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08030db0 con 0x7fed1006e050 2024-09-11T22:05:52.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.363+0000 7fed0d7fa640 1 -- 172.21.15.152:0/2346176290 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fed080305d0 con 0x7fed1006e050 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.365+0000 7fed0d7fa640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fecf80a2f00 0x7fecf80a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.365+0000 7fed18b01740 1 Processor -- start 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.365+0000 7fed0d7fa640 1 -- 172.21.15.152:0/2346176290 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fed080f0190 con 0x7fed1006e050 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.365+0000 7fed18b01740 1 -- start start 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.366+0000 7fed18b01740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca47090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.366+0000 7fed18b01740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca475d0 0x556e6ca47a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.366+0000 7fed0ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca47090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.366+0000 7fed0ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca47090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35348/0 (socket says 172.21.15.152:35348) 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.366+0000 7fed18b01740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca52370 0x556e6ca54760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.366+0000 7fed0ffff640 1 -- 172.21.15.152:0/2370908954 learned_addr learned my addr 172.21.15.152:0/2370908954 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.366+0000 7fed18b01740 1 -- 172.21.15.152:0/2370908954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556e6c9ad2f0 con 0x556e6ca475d0 2024-09-11T22:05:52.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.366+0000 7fed18b01740 1 -- 172.21.15.152:0/2370908954 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556e6c954cf0 con 0x556e6ca48b40 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.366+0000 7fed18b01740 1 -- 172.21.15.152:0/2370908954 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556e6c9a92b0 con 0x556e6ca52370 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.366+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/2370908954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca475d0 0x556e6ca47a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.366+0000 7fed14cc5640 1 --2- 172.21.15.152:0/2370908954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca52370 0x556e6ca54760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.367+0000 7fed0f7fe640 1 -- 172.21.15.152:0/2370908954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca52370 msgr2=0x556e6ca54760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.367+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/2370908954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca52370 0x556e6ca54760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.367+0000 7fed0f7fe640 1 -- 172.21.15.152:0/2370908954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 msgr2=0x556e6ca47090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.367+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/2370908954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca47090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.367+0000 7fed0f7fe640 1 -- 172.21.15.152:0/2370908954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e6c9393a0 con 0x556e6ca475d0 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.367+0000 7fed0ffff640 1 --2- 172.21.15.152:0/2370908954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca47090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.367+0000 7fed0ffff640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fecf80a2f00 0x7fecf80a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.367+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/2370908954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca475d0 0x556e6ca47a10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fed1006ec80 tx=0x7fed0400d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b5fe877bdd50d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.367+0000 7fecf67fc640 1 -- 172.21.15.152:0/2370908954 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed04019020 con 0x556e6ca475d0 2024-09-11T22:05:52.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.367+0000 7fecf67fc640 1 -- 172.21.15.152:0/2370908954 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed04009dd0 con 0x556e6ca475d0 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.367+0000 7fecf67fc640 1 -- 172.21.15.152:0/2370908954 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed040047a0 con 0x556e6ca475d0 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.368+0000 7fed18b01740 1 -- 172.21.15.152:0/2370908954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca475d0 msgr2=0x556e6ca47a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.368+0000 7fed18b01740 1 --2- 172.21.15.152:0/2370908954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca475d0 0x556e6ca47a10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fed1006ec80 tx=0x7fed0400d040 comp rx=0 tx=0).stop 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.369+0000 7fed18b01740 1 -- 172.21.15.152:0/2370908954 shutdown_connections 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.369+0000 7fed18b01740 1 --2- 172.21.15.152:0/2370908954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca52370 0x556e6ca54760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.369+0000 7fed18b01740 1 --2- 172.21.15.152:0/2370908954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca475d0 0x556e6ca47a10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.369+0000 7fed18b01740 1 --2- 172.21.15.152:0/2370908954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca47090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.369+0000 7fed18b01740 1 -- 172.21.15.152:0/2370908954 >> 172.21.15.152:0/2370908954 conn(0x556e6ca10310 msgr2=0x556e6ca43c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.369+0000 7fed18b01740 1 -- 172.21.15.152:0/2370908954 shutdown_connections 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.369+0000 7fed18b01740 1 -- 172.21.15.152:0/2370908954 wait complete. 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.369+0000 7fed18b01740 1 -- start start 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.370+0000 7fed18b01740 1 Processor -- start 2024-09-11T22:05:52.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.370+0000 7fed0ffff640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fecf80a2f00 0x7fecf80a53c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed00004600 tx=0x7fed00004730 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:52.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.370+0000 7fed18b01740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca475d0 0x556e6ca51d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.370+0000 7fed18b01740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca48b40 0x556e6ca4efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.370+0000 7fed18b01740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca4f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.370+0000 7fed18b01740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556e6ca55070 con 0x556e6ca52370 2024-09-11T22:05:52.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.370+0000 7fed18b01740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556e6c968060 con 0x556e6ca475d0 2024-09-11T22:05:52.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.370+0000 7fed18b01740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556e6ca551f0 con 0x556e6ca48b40 2024-09-11T22:05:52.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed18b01740 10 client.0 _ll_register_callbacks cb 0x556e6c6bb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:52.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed0ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca475d0 0x556e6ca51d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed0ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca475d0 0x556e6ca51d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35358/0 (socket says 172.21.15.152:35358) 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed0ffff640 1 -- 172.21.15.152:0/2685822197 learned_addr learned my addr 172.21.15.152:0/2685822197 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca48b40 0x556e6ca4efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed14cc5640 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca4f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed0ffff640 1 -- 172.21.15.152:0/2685822197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca48b40 msgr2=0x556e6ca4efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed0ffff640 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca48b40 0x556e6ca4efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed0ffff640 1 -- 172.21.15.152:0/2685822197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 msgr2=0x556e6ca4f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed0ffff640 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca4f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed0ffff640 1 -- 172.21.15.152:0/2685822197 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e6c71e3c0 con 0x556e6ca475d0 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fed0ffff640 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca475d0 0x556e6ca51d20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed00010c20 tx=0x7fed00005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8957ad8511258fde server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.371+0000 7fecef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.372+0000 7fecef7fe640 1 -- 172.21.15.152:0/2685822197 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0002a060 con 0x556e6ca475d0 2024-09-11T22:05:52.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.372+0000 7fecef7fe640 1 -- 172.21.15.152:0/2685822197 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fed0001db90 con 0x556e6ca475d0 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.372+0000 7fed18b01740 1 -- 172.21.15.152:0/2685822197 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed04009dd0 con 0x556e6ca475d0 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.372+0000 7fecef7fe640 1 -- 172.21.15.152:0/2685822197 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fed0001dd90 con 0x556e6ca475d0 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.372+0000 7fed18b01740 10 client.25250 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.372+0000 7fed18b01740 1 -- 172.21.15.152:0/2685822197 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556e6ca60af0 con 0x556e6ca475d0 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.373+0000 7fecef7fe640 1 -- 172.21.15.152:0/2685822197 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed04009dd0 con 0x556e6ca475d0 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.374+0000 7fecef7fe640 1 -- 172.21.15.152:0/2685822197 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fed00019040 con 0x556e6ca475d0 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.374+0000 7fed18b01740 10 client.25250 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.374+0000 7fed18b01740 10 client.25250 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.374+0000 7fed18b01740 20 client.25250 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.374+0000 7fed18b01740 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556e6ca62000 0x556e6ca64460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.374+0000 7fed18b01740 4 client.25250 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:52.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.374+0000 7fed18b01740 1 -- 172.21.15.152:0/2685822197 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e6c9ba860 con 0x556e6ca62000 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.374+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556e6ca62000 0x556e6ca64460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.374+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556e6ca62000 0x556e6ca64460 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a84959c6ae2740b0 server_cookie=d067dc3063b5ddc8 in_seq=0 out_seq=0 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.375+0000 7fecef7fe640 10 client.25250 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.375+0000 7fecef7fe640 1 -- 172.21.15.152:0/2685822197 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e6c9ba860 con 0x556e6ca62000 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.375+0000 7fecef7fe640 10 client.25250 handle_command_reply: tid=0 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.375+0000 7fed18b01740 1 client.25250 shutdown 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.376+0000 7fed18b01740 1 -- 172.21.15.152:0/2685822197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca475d0 msgr2=0x556e6ca51d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.376+0000 7fed18b01740 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca475d0 0x556e6ca51d20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed00010c20 tx=0x7fed00005f90 comp rx=0 tx=0).stop 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.376+0000 7fed18b01740 1 -- 172.21.15.152:0/2685822197 shutdown_connections 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.376+0000 7fed18b01740 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556e6ca62000 0x556e6ca64460 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.376+0000 7fed18b01740 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca4f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.376+0000 7fed18b01740 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca48b40 0x556e6ca4efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.376+0000 7fed18b01740 1 --2- 172.21.15.152:0/2685822197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca475d0 0x556e6ca51d20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.376+0000 7fecef7fe640 0 client.25250 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.376+0000 7fed18b01740 1 -- 172.21.15.152:0/2685822197 >> 172.21.15.152:0/2685822197 conn(0x556e6ca10310 msgr2=0x556e6ca49930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.376+0000 7fed18b01740 1 -- 172.21.15.152:0/2685822197 shutdown_connections 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.377+0000 7fed18b01740 1 -- 172.21.15.152:0/2685822197 wait complete. 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.377+0000 7fed18b01740 20 client.25250 trim_cache size 0 max 16384 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.400+0000 7fed18b01740 1 Processor -- start 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.401+0000 7fed18b01740 1 -- start start 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.401+0000 7fed18b01740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 0x556e6ca4efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.401+0000 7fed18b01740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca5e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.401+0000 7fed18b01740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca53760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.401+0000 7fed18b01740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc011100 con 0x556e6ca52370 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.401+0000 7fed18b01740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc00e9a0 con 0x556e6ca48b40 2024-09-11T22:05:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.401+0000 7fed18b01740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc00c7f0 con 0x556e6ca475d0 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.401+0000 7fed0f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca5e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.401+0000 7fed0f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca5e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35366/0 (socket says 172.21.15.152:35366) 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.401+0000 7fed0f7fe640 1 -- 172.21.15.152:0/2124129919 learned_addr learned my addr 172.21.15.152:0/2124129919 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.401+0000 7fed14cc5640 1 --2- 172.21.15.152:0/2124129919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca53760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.402+0000 7fed0ffff640 1 --2- 172.21.15.152:0/2124129919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 0x556e6ca4efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.402+0000 7fed0f7fe640 1 -- 172.21.15.152:0/2124129919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 msgr2=0x556e6ca4efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.402+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/2124129919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 0x556e6ca4efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.402+0000 7fed0f7fe640 1 -- 172.21.15.152:0/2124129919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 msgr2=0x556e6ca53760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.402+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/2124129919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca53760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.402+0000 7fed0f7fe640 1 -- 172.21.15.152:0/2124129919 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e6ca55240 con 0x556e6ca48b40 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.402+0000 7fed0ffff640 1 --2- 172.21.15.152:0/2124129919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 0x556e6ca4efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.402+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/2124129919 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca5e370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed0400bb20 tx=0x7fed04005410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae6f1bcb4759eb71 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.402+0000 7fecf5ffb640 1 -- 172.21.15.152:0/2124129919 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0402d070 con 0x556e6ca48b40 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.402+0000 7fecf5ffb640 1 -- 172.21.15.152:0/2124129919 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed04009dd0 con 0x556e6ca48b40 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.402+0000 7fecf5ffb640 1 -- 172.21.15.152:0/2124129919 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed04019040 con 0x556e6ca48b40 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.403+0000 7fed18b01740 1 -- 172.21.15.152:0/2124129919 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 msgr2=0x556e6ca5e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.403+0000 7fed18b01740 1 --2- 172.21.15.152:0/2124129919 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca5e370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed0400bb20 tx=0x7fed04005410 comp rx=0 tx=0).stop 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.404+0000 7fed18b01740 1 -- 172.21.15.152:0/2124129919 shutdown_connections 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.404+0000 7fed18b01740 1 --2- 172.21.15.152:0/2124129919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca53760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.404+0000 7fed18b01740 1 --2- 172.21.15.152:0/2124129919 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca5e370 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.404+0000 7fed18b01740 1 --2- 172.21.15.152:0/2124129919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 0x556e6ca4efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.404+0000 7fed18b01740 1 -- 172.21.15.152:0/2124129919 >> 172.21.15.152:0/2124129919 conn(0x556e6ca10310 msgr2=0x556e6ca4e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.404+0000 7fed18b01740 1 -- 172.21.15.152:0/2124129919 shutdown_connections 2024-09-11T22:05:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.404+0000 7fed18b01740 1 -- 172.21.15.152:0/2124129919 wait complete. 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.405+0000 7fed18b01740 1 -- start start 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.405+0000 7fed18b01740 1 Processor -- start 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.405+0000 7fed18b01740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 0x556e6ca5a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.405+0000 7fed18b01740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca5ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.405+0000 7fed18b01740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca69510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed18b01740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc00ce60 con 0x556e6ca52370 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed18b01740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc00e2d0 con 0x556e6ca48b40 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed18b01740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc00d530 con 0x556e6ca475d0 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed18b01740 10 client.0 _ll_register_callbacks cb 0x7fed00009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed0ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 0x556e6ca5a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed0ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 0x556e6ca5a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:57600/0 (socket says 172.21.15.152:57600) 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed0ffff640 1 -- 172.21.15.152:0/1477315534 learned_addr learned my addr 172.21.15.152:0/1477315534 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed14cc5640 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca69510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca5ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed0ffff640 1 -- 172.21.15.152:0/1477315534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 msgr2=0x556e6ca5ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed0ffff640 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca5ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed0ffff640 1 -- 172.21.15.152:0/1477315534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 msgr2=0x556e6ca69510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed0ffff640 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca69510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.406+0000 7fed0ffff640 1 -- 172.21.15.152:0/1477315534 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e6ca69d40 con 0x556e6ca475d0 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.407+0000 7fed0ffff640 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 0x556e6ca5a860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed000059f0 tx=0x7fed00005cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d38b586f748c0836 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.407+0000 7fecef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.407+0000 7fecef7fe640 1 -- 172.21.15.152:0/1477315534 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0002dc10 con 0x556e6ca475d0 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.407+0000 7fed18b01740 1 -- 172.21.15.152:0/1477315534 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed04009dd0 con 0x556e6ca475d0 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.407+0000 7fecef7fe640 1 -- 172.21.15.152:0/1477315534 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fed0001b460 con 0x556e6ca475d0 2024-09-11T22:05:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.407+0000 7fecef7fe640 1 -- 172.21.15.152:0/1477315534 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fed0002a020 con 0x556e6ca475d0 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.407+0000 7fed18b01740 10 client.25387 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.407+0000 7fed18b01740 1 -- 172.21.15.152:0/1477315534 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556e6ca5a160 con 0x556e6ca475d0 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.408+0000 7fecef7fe640 1 -- 172.21.15.152:0/1477315534 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed0001bb40 con 0x556e6ca475d0 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.408+0000 7fecef7fe640 1 -- 172.21.15.152:0/1477315534 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fed00019040 con 0x556e6ca475d0 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.408+0000 7fed18b01740 10 client.25387 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.408+0000 7fed18b01740 10 client.25387 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.408+0000 7fed18b01740 20 client.25387 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.408+0000 7fed18b01740 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556e6cacd090 0x556e6cacf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.408+0000 7fed18b01740 4 client.25387 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.408+0000 7fed18b01740 1 -- 172.21.15.152:0/1477315534 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fed04009dd0 con 0x556e6cacd090 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.408+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556e6cacd090 0x556e6cacf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:52.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.409+0000 7fed0f7fe640 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556e6cacd090 0x556e6cacf480 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f800201f407d3821 server_cookie=7b50e6c60b7b8c6 in_seq=0 out_seq=0 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.409+0000 7fecef7fe640 10 client.25387 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.409+0000 7fecef7fe640 1 -- 172.21.15.152:0/1477315534 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fed04009dd0 con 0x556e6cacd090 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.409+0000 7fecef7fe640 10 client.25387 handle_command_reply: tid=0 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.409+0000 7fed18b01740 1 client.25387 shutdown 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.410+0000 7fed18b01740 1 -- 172.21.15.152:0/1477315534 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 msgr2=0x556e6ca5a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.410+0000 7fed18b01740 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 0x556e6ca5a860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed000059f0 tx=0x7fed00005cd0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.410+0000 7fed18b01740 1 -- 172.21.15.152:0/1477315534 shutdown_connections 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.410+0000 7fed18b01740 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556e6cacd090 0x556e6cacf480 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.410+0000 7fed18b01740 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6ca52370 0x556e6ca69510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.410+0000 7fecef7fe640 0 client.25387 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.410+0000 7fed18b01740 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e6ca48b40 0x556e6ca5ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.410+0000 7fed18b01740 1 --2- 172.21.15.152:0/1477315534 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556e6ca475d0 0x556e6ca5a860 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.410+0000 7fed18b01740 1 -- 172.21.15.152:0/1477315534 >> 172.21.15.152:0/1477315534 conn(0x556e6ca10310 msgr2=0x556e6ca424e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:52.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.410+0000 7fed18b01740 1 -- 172.21.15.152:0/1477315534 shutdown_connections 2024-09-11T22:05:52.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.410+0000 7fed18b01740 1 -- 172.21.15.152:0/1477315534 wait complete. 2024-09-11T22:05:52.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.411+0000 7fed18b01740 20 client.25387 trim_cache size 0 max 16384 2024-09-11T22:05:52.430 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:05:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.411+0000 7fed16728640 1 -- 172.21.15.152:0/2346176290 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fecf80a2f00 msgr2=0x7fecf80a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.411+0000 7fed16728640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fecf80a2f00 0x7fecf80a53c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed00004600 tx=0x7fed00004730 comp rx=0 tx=0).stop 2024-09-11T22:05:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.411+0000 7fed16728640 1 -- 172.21.15.152:0/2346176290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed1006e050 msgr2=0x7fed10071f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.411+0000 7fed16728640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed1006e050 0x7fed10071f30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed08031710 tx=0x7fed08031740 comp rx=0 tx=0).stop 2024-09-11T22:05:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.412+0000 7fed16728640 1 -- 172.21.15.152:0/2346176290 shutdown_connections 2024-09-11T22:05:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.412+0000 7fed16728640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fecf80a2f00 0x7fecf80a53c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.412+0000 7fed16728640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed1006e050 0x7fed10071f30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.412+0000 7fed16728640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed10101e20 0x7fed1006d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.412+0000 7fed16728640 1 --2- 172.21.15.152:0/2346176290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed10101470 0x7fed1006d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.412+0000 7fed16728640 1 -- 172.21.15.152:0/2346176290 >> 172.21.15.152:0/2346176290 conn(0x7fed10077230 msgr2=0x7fed10103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.412+0000 7fed16728640 1 -- 172.21.15.152:0/2346176290 shutdown_connections 2024-09-11T22:05:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:52.412+0000 7fed16728640 1 -- 172.21.15.152:0/2346176290 wait complete. 2024-09-11T22:05:53.390 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:05:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:53 smithi179 ceph-mon[35603]: pgmap v51: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2024-09-11T22:05:53.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:53 smithi193 ceph-mon[35545]: pgmap v51: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2024-09-11T22:05:53.830 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:53.970 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:53 smithi152 ceph-mon[31188]: pgmap v51: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2024-09-11T22:05:54.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.409+0000 7f322306c640 1 -- 172.21.15.152:0/4106249256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f321c1091f0 msgr2=0x7f321c1095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:54.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.409+0000 7f322306c640 1 --2- 172.21.15.152:0/4106249256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f321c1091f0 0x7f321c1095d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3210009900 tx=0x7f321002a3f0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.409+0000 7f322306c640 1 -- 172.21.15.152:0/4106249256 shutdown_connections 2024-09-11T22:05:54.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.409+0000 7f322306c640 1 --2- 172.21.15.152:0/4106249256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321c116ea0 0x7f321c119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.409+0000 7f322306c640 1 --2- 172.21.15.152:0/4106249256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f321c109b10 0x7f321c116960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.409+0000 7f322306c640 1 --2- 172.21.15.152:0/4106249256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f321c1091f0 0x7f321c1095d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.409+0000 7f322306c640 1 -- 172.21.15.152:0/4106249256 >> 172.21.15.152:0/4106249256 conn(0x7f321c06e140 msgr2=0x7f321c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:54.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.410+0000 7f322306c640 1 -- 172.21.15.152:0/4106249256 shutdown_connections 2024-09-11T22:05:54.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.410+0000 7f322306c640 1 -- 172.21.15.152:0/4106249256 wait complete. 2024-09-11T22:05:54.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.411+0000 7f322306c640 1 Processor -- start 2024-09-11T22:05:54.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.411+0000 7f322306c640 1 -- start start 2024-09-11T22:05:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.413+0000 7f322306c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f321c1091f0 0x7f321c1a2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.413+0000 7f322306c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f321c109b10 0x7f321c1a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.413+0000 7f322306c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321c116ea0 0x7f321c1a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.413+0000 7f322306c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f321c11ca00 con 0x7f321c116ea0 2024-09-11T22:05:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.413+0000 7f322306c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f321c11c880 con 0x7f321c1091f0 2024-09-11T22:05:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.413+0000 7f322306c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f321c11cb80 con 0x7f321c109b10 2024-09-11T22:05:54.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.414+0000 7f3220e08640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f321c1091f0 0x7f321c1a2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.414+0000 7f3220e08640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f321c1091f0 0x7f321c1a2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58656/0 (socket says 172.21.15.152:58656) 2024-09-11T22:05:54.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.414+0000 7f3220e08640 1 -- 172.21.15.152:0/3921690636 learned_addr learned my addr 172.21.15.152:0/3921690636 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:54.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.414+0000 7f3221609640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321c116ea0 0x7f321c1a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.414+0000 7f321bfff640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f321c109b10 0x7f321c1a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.414+0000 7f321bfff640 1 -- 172.21.15.152:0/3921690636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f321c1091f0 msgr2=0x7f321c1a2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:54.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.414+0000 7f321bfff640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f321c1091f0 0x7f321c1a2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.414+0000 7f321bfff640 1 -- 172.21.15.152:0/3921690636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321c116ea0 msgr2=0x7f321c1a77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:54.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.414+0000 7f321bfff640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321c116ea0 0x7f321c1a77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.414+0000 7f321bfff640 1 -- 172.21.15.152:0/3921690636 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c1a7eb0 con 0x7f321c109b10 2024-09-11T22:05:54.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.415+0000 7f321bfff640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f321c109b10 0x7f321c1a3440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f320800e9f0 tx=0x7f320800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:54.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.415+0000 7f3219ffb640 1 -- 172.21.15.152:0/3921690636 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320800ccc0 con 0x7f321c109b10 2024-09-11T22:05:54.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.415+0000 7f322306c640 1 -- 172.21.15.152:0/3921690636 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321c1a81a0 con 0x7f321c109b10 2024-09-11T22:05:54.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.415+0000 7f3219ffb640 1 -- 172.21.15.152:0/3921690636 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3208005020 con 0x7f321c109b10 2024-09-11T22:05:54.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.415+0000 7f3219ffb640 1 -- 172.21.15.152:0/3921690636 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32080049e0 con 0x7f321c109b10 2024-09-11T22:05:54.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.415+0000 7f322306c640 1 -- 172.21.15.152:0/3921690636 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321c1afa80 con 0x7f321c109b10 2024-09-11T22:05:54.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.418+0000 7f3219ffb640 1 -- 172.21.15.152:0/3921690636 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3208004be0 con 0x7f321c109b10 2024-09-11T22:05:54.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.420+0000 7f3219ffb640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f320c0a2df0 0x7f320c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.420+0000 7f3219ffb640 1 -- 172.21.15.152:0/3921690636 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f32080d0490 con 0x7f321c109b10 2024-09-11T22:05:54.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.421+0000 7f3220e08640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f320c0a2df0 0x7f320c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.422+0000 7f3225445740 1 Processor -- start 2024-09-11T22:05:54.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.422+0000 7f3225445740 1 -- start start 2024-09-11T22:05:54.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.422+0000 7f3225445740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 0x5652ebf768a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.422+0000 7f3225445740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf77220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.422+0000 7f3225445740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf72690 0x5652ebf8cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.423+0000 7f3225445740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5652ebed42f0 con 0x5652ebf78350 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.423+0000 7f3225445740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5652ebe7bcf0 con 0x5652ebf72690 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.423+0000 7f3225445740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5652ebed02b0 con 0x5652ebf76de0 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.423+0000 7f321bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf77220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.423+0000 7f321bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf77220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46656/0 (socket says 172.21.15.152:46656) 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.423+0000 7f321bfff640 1 -- 172.21.15.152:0/1225196667 learned_addr learned my addr 172.21.15.152:0/1225196667 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.423+0000 7f321bfff640 1 -- 172.21.15.152:0/1225196667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf72690 msgr2=0x5652ebf8cb40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.423+0000 7f321bfff640 1 --2- 172.21.15.152:0/1225196667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf72690 0x5652ebf8cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.423+0000 7f321bfff640 1 -- 172.21.15.152:0/1225196667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 msgr2=0x5652ebf768a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.423+0000 7f321bfff640 1 --2- 172.21.15.152:0/1225196667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 0x5652ebf768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.423+0000 7f321bfff640 1 -- 172.21.15.152:0/1225196667 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652ebe603a0 con 0x5652ebf76de0 2024-09-11T22:05:54.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.424+0000 7f321bfff640 1 --2- 172.21.15.152:0/1225196667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf77220 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f32080a5060 tx=0x7f320809d020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e780b70648e0b955 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:54.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.424+0000 7f3206ffd640 1 -- 172.21.15.152:0/1225196667 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32080b5070 con 0x5652ebf76de0 2024-09-11T22:05:54.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.424+0000 7f3206ffd640 1 -- 172.21.15.152:0/1225196667 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32080a0cd0 con 0x5652ebf76de0 2024-09-11T22:05:54.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.424+0000 7f3206ffd640 1 -- 172.21.15.152:0/1225196667 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3208085e60 con 0x5652ebf76de0 2024-09-11T22:05:54.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.425+0000 7f3220e08640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f320c0a2df0 0x7f320c0a52b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32100096c0 tx=0x7f32100046c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:54.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.426+0000 7f3225445740 1 -- 172.21.15.152:0/1225196667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 msgr2=0x5652ebf77220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:54.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.426+0000 7f3225445740 1 --2- 172.21.15.152:0/1225196667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf77220 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f32080a5060 tx=0x7f320809d020 comp rx=0 tx=0).stop 2024-09-11T22:05:54.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.426+0000 7f3225445740 1 -- 172.21.15.152:0/1225196667 shutdown_connections 2024-09-11T22:05:54.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.426+0000 7f3225445740 1 --2- 172.21.15.152:0/1225196667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf72690 0x5652ebf8cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.426+0000 7f3225445740 1 --2- 172.21.15.152:0/1225196667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf77220 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.426+0000 7f3225445740 1 --2- 172.21.15.152:0/1225196667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 0x5652ebf768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.426+0000 7f3225445740 1 -- 172.21.15.152:0/1225196667 >> 172.21.15.152:0/1225196667 conn(0x5652ebf37310 msgr2=0x5652ebf73470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:54.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.426+0000 7f3225445740 1 -- 172.21.15.152:0/1225196667 shutdown_connections 2024-09-11T22:05:54.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.426+0000 7f3225445740 1 -- 172.21.15.152:0/1225196667 wait complete. 2024-09-11T22:05:54.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.427+0000 7f3225445740 1 -- start start 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.427+0000 7f3225445740 1 Processor -- start 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.427+0000 7f3225445740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf72690 0x5652ebf79fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.427+0000 7f3225445740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf76de0 0x5652ebf7a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.427+0000 7f3225445740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 0x5652ebf85050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3225445740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5652ebf79b80 con 0x5652ebf78350 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3225445740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5652ebe8f060 con 0x5652ebf76de0 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3225445740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5652ebf79d00 con 0x5652ebf72690 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3225445740 10 client.0 _ll_register_callbacks cb 0x5652ebbe28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3220e08640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf72690 0x5652ebf79fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3220e08640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf72690 0x5652ebf79fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46662/0 (socket says 172.21.15.152:46662) 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3220e08640 1 -- 172.21.15.152:0/3361263984 learned_addr learned my addr 172.21.15.152:0/3361263984 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:54.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f321bfff640 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf76de0 0x5652ebf7a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3221609640 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 0x5652ebf85050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3220e08640 1 -- 172.21.15.152:0/3361263984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf76de0 msgr2=0x5652ebf7a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:54.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3220e08640 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf76de0 0x5652ebf7a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3220e08640 1 -- 172.21.15.152:0/3361263984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 msgr2=0x5652ebf85050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:54.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3220e08640 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 0x5652ebf85050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3220e08640 1 -- 172.21.15.152:0/3361263984 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652ebc453c0 con 0x5652ebf72690 2024-09-11T22:05:54.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.428+0000 7f3220e08640 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf72690 0x5652ebf79fd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3210004510 tx=0x7f3210004540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=498027645334e0e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:54.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.429+0000 7f31fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:05:54.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.429+0000 7f31fbfff640 1 -- 172.21.15.152:0/3361263984 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321004d070 con 0x5652ebf72690 2024-09-11T22:05:54.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.429+0000 7f31fbfff640 1 -- 172.21.15.152:0/3361263984 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f32100317b0 con 0x5652ebf72690 2024-09-11T22:05:54.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.429+0000 7f3225445740 1 -- 172.21.15.152:0/3361263984 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32080a0cd0 con 0x5652ebf72690 2024-09-11T22:05:54.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.429+0000 7f31fbfff640 1 -- 172.21.15.152:0/3361263984 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3210057050 con 0x5652ebf72690 2024-09-11T22:05:54.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.429+0000 7f3225445740 10 client.25399 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:54.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.429+0000 7f3225445740 1 -- 172.21.15.152:0/3361263984 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5652ebf87bb0 con 0x5652ebf72690 2024-09-11T22:05:54.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.430+0000 7f31fbfff640 1 -- 172.21.15.152:0/3361263984 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3210049450 con 0x5652ebf72690 2024-09-11T22:05:54.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.430+0000 7f31fbfff640 1 -- 172.21.15.152:0/3361263984 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f3210052440 con 0x5652ebf72690 2024-09-11T22:05:54.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.430+0000 7f3225445740 10 client.25399 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:54.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.430+0000 7f3225445740 10 client.25399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:54.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.430+0000 7f3225445740 20 client.25399 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:54.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.430+0000 7f3225445740 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652ebf89180 0x5652ebf8b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.430+0000 7f3225445740 4 client.25399 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:54.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.430+0000 7f3225445740 1 -- 172.21.15.152:0/3361263984 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f32080a0cd0 con 0x5652ebf89180 2024-09-11T22:05:54.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.431+0000 7f321bfff640 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652ebf89180 0x5652ebf8b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.432+0000 7f321bfff640 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652ebf89180 0x5652ebf8b640 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e17488fccdcc87e2 server_cookie=8156254777fc6bbb in_seq=0 out_seq=0 2024-09-11T22:05:54.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.432+0000 7f31fbfff640 10 client.25399 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:54.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.432+0000 7f31fbfff640 1 -- 172.21.15.152:0/3361263984 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f32080a0cd0 con 0x5652ebf89180 2024-09-11T22:05:54.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.432+0000 7f31fbfff640 10 client.25399 handle_command_reply: tid=0 2024-09-11T22:05:54.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.433+0000 7f3225445740 1 client.25399 shutdown 2024-09-11T22:05:54.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.433+0000 7f3225445740 1 -- 172.21.15.152:0/3361263984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf72690 msgr2=0x5652ebf79fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:54.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.433+0000 7f3225445740 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf72690 0x5652ebf79fd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3210004510 tx=0x7f3210004540 comp rx=0 tx=0).stop 2024-09-11T22:05:54.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.433+0000 7f3225445740 1 -- 172.21.15.152:0/3361263984 shutdown_connections 2024-09-11T22:05:54.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.433+0000 7f3225445740 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652ebf89180 0x5652ebf8b640 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.433+0000 7f31fbfff640 0 client.25399 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:54.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.433+0000 7f3225445740 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 0x5652ebf85050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.433+0000 7f3225445740 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf76de0 0x5652ebf7a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.433+0000 7f3225445740 1 --2- 172.21.15.152:0/3361263984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf72690 0x5652ebf79fd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.433+0000 7f3225445740 1 -- 172.21.15.152:0/3361263984 >> 172.21.15.152:0/3361263984 conn(0x5652ebf37310 msgr2=0x5652ebf791d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:54.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.433+0000 7f3225445740 1 -- 172.21.15.152:0/3361263984 shutdown_connections 2024-09-11T22:05:54.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.434+0000 7f3225445740 1 -- 172.21.15.152:0/3361263984 wait complete. 2024-09-11T22:05:54.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.434+0000 7f3225445740 20 client.25399 trim_cache size 0 max 16384 2024-09-11T22:05:54.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.460+0000 7f3225445740 1 Processor -- start 2024-09-11T22:05:54.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.460+0000 7f3225445740 1 -- start start 2024-09-11T22:05:54.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.460+0000 7f3225445740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf72690 0x5652ebf73570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.460+0000 7f3225445740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf76de0 0x5652ebf790c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.460+0000 7f3225445740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf78350 0x5652ebf90f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.460+0000 7f3225445740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f321c1b68b0 con 0x5652ebf76de0 2024-09-11T22:05:54.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.460+0000 7f3225445740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f321c1b4150 con 0x5652ebf78350 2024-09-11T22:05:54.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.460+0000 7f3225445740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f321c1b2000 con 0x5652ebf72690 2024-09-11T22:05:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.461+0000 7f3221609640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf78350 0x5652ebf90f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.461+0000 7f3221609640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf78350 0x5652ebf90f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58686/0 (socket says 172.21.15.152:58686) 2024-09-11T22:05:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.461+0000 7f3221609640 1 -- 172.21.15.152:0/2317669751 learned_addr learned my addr 172.21.15.152:0/2317669751 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.462+0000 7f3221609640 1 -- 172.21.15.152:0/2317669751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf72690 msgr2=0x5652ebf73570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:05:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.462+0000 7f3221609640 1 --2- 172.21.15.152:0/2317669751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf72690 0x5652ebf73570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.462+0000 7f3221609640 1 -- 172.21.15.152:0/2317669751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf76de0 msgr2=0x5652ebf790c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.462+0000 7f3221609640 1 --2- 172.21.15.152:0/2317669751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf76de0 0x5652ebf790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.462+0000 7f3221609640 1 -- 172.21.15.152:0/2317669751 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652ebf745e0 con 0x5652ebf78350 2024-09-11T22:05:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.462+0000 7f3221609640 1 --2- 172.21.15.152:0/2317669751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf78350 0x5652ebf90f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3214009db0 tx=0x7f32140117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1224ba4a09f20ba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.462+0000 7f32067fc640 1 -- 172.21.15.152:0/2317669751 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214012650 con 0x5652ebf78350 2024-09-11T22:05:54.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.462+0000 7f32067fc640 1 -- 172.21.15.152:0/2317669751 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3214012cd0 con 0x5652ebf78350 2024-09-11T22:05:54.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.462+0000 7f32067fc640 1 -- 172.21.15.152:0/2317669751 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321401ae20 con 0x5652ebf78350 2024-09-11T22:05:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.463+0000 7f3225445740 1 -- 172.21.15.152:0/2317669751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf78350 msgr2=0x5652ebf90f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.463+0000 7f3225445740 1 --2- 172.21.15.152:0/2317669751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf78350 0x5652ebf90f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3214009db0 tx=0x7f32140117b0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.463+0000 7f3225445740 1 -- 172.21.15.152:0/2317669751 shutdown_connections 2024-09-11T22:05:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.463+0000 7f3225445740 1 --2- 172.21.15.152:0/2317669751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf78350 0x5652ebf90f50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.463+0000 7f3225445740 1 --2- 172.21.15.152:0/2317669751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf76de0 0x5652ebf790c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.463+0000 7f3225445740 1 --2- 172.21.15.152:0/2317669751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf72690 0x5652ebf73570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.464+0000 7f3225445740 1 -- 172.21.15.152:0/2317669751 >> 172.21.15.152:0/2317669751 conn(0x5652ebf37310 msgr2=0x5652ebf789b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.464+0000 7f3225445740 1 -- 172.21.15.152:0/2317669751 shutdown_connections 2024-09-11T22:05:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.464+0000 7f3225445740 1 -- 172.21.15.152:0/2317669751 wait complete. 2024-09-11T22:05:54.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.464+0000 7f3225445740 1 -- start start 2024-09-11T22:05:54.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.464+0000 7f3225445740 1 Processor -- start 2024-09-11T22:05:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.465+0000 7f3225445740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf72690 0x5652ebf7fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.465+0000 7f3225445740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf801f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.465+0000 7f3225445740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 0x5652ebfeb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.465+0000 7f3225445740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f321c1b2650 con 0x5652ebf78350 2024-09-11T22:05:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.465+0000 7f321bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf801f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.465+0000 7f321bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf801f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46682/0 (socket says 172.21.15.152:46682) 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.465+0000 7f321bfff640 1 -- 172.21.15.152:0/3557951290 learned_addr learned my addr 172.21.15.152:0/3557951290 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.466+0000 7f3225445740 1 -- 172.21.15.152:0/3557951290 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f321c1b3a80 con 0x5652ebf72690 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.466+0000 7f3225445740 1 -- 172.21.15.152:0/3557951290 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f321c1b2ce0 con 0x5652ebf76de0 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.466+0000 7f3225445740 10 client.0 _ll_register_callbacks cb 0x7f3210040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.466+0000 7f3221609640 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 0x5652ebfeb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.466+0000 7f321bfff640 1 -- 172.21.15.152:0/3557951290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf72690 msgr2=0x5652ebf7fcb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.466+0000 7f321bfff640 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf72690 0x5652ebf7fcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.466+0000 7f321bfff640 1 -- 172.21.15.152:0/3557951290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 msgr2=0x5652ebfeb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.466+0000 7f321bfff640 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 0x5652ebfeb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.466+0000 7f321bfff640 1 -- 172.21.15.152:0/3557951290 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652ebfeba90 con 0x5652ebf76de0 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.467+0000 7f321bfff640 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf801f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3208098d80 tx=0x7f3208098cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f204e58476eb322 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.467+0000 7f31fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:05:54.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.467+0000 7f31fbfff640 1 -- 172.21.15.152:0/3557951290 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32080b9030 con 0x5652ebf76de0 2024-09-11T22:05:54.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.467+0000 7f31fbfff640 1 -- 172.21.15.152:0/3557951290 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f32080bb2c0 con 0x5652ebf76de0 2024-09-11T22:05:54.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.467+0000 7f3225445740 1 -- 172.21.15.152:0/3557951290 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3214012cd0 con 0x5652ebf76de0 2024-09-11T22:05:54.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.470+0000 7f31fbfff640 1 -- 172.21.15.152:0/3557951290 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f32080b5040 con 0x5652ebf76de0 2024-09-11T22:05:54.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.470+0000 7f3225445740 10 client.25402 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:54.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.470+0000 7f3225445740 1 -- 172.21.15.152:0/3557951290 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5652ebff4040 con 0x5652ebf76de0 2024-09-11T22:05:54.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.471+0000 7f31fbfff640 1 -- 172.21.15.152:0/3557951290 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32080a0cd0 con 0x5652ebf76de0 2024-09-11T22:05:54.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.471+0000 7f31fbfff640 1 -- 172.21.15.152:0/3557951290 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f32080870b0 con 0x5652ebf76de0 2024-09-11T22:05:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.471+0000 7f3225445740 10 client.25402 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.471+0000 7f3225445740 10 client.25402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.471+0000 7f3225445740 20 client.25402 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.471+0000 7f3225445740 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652ebf89180 0x5652ebff6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.471+0000 7f3225445740 4 client.25402 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:05:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.471+0000 7f3225445740 1 -- 172.21.15.152:0/3557951290 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3214012cd0 con 0x5652ebf89180 2024-09-11T22:05:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.471+0000 7f3220e08640 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652ebf89180 0x5652ebff6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:54.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.475+0000 7f3220e08640 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652ebf89180 0x5652ebff6300 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=498d8379ad307faa server_cookie=fd0f5de80382b2c6 in_seq=0 out_seq=0 2024-09-11T22:05:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.475+0000 7f31fbfff640 10 client.25402 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f31fbfff640 1 -- 172.21.15.152:0/3557951290 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3214012cd0 con 0x5652ebf89180 2024-09-11T22:05:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f31fbfff640 10 client.25402 handle_command_reply: tid=0 2024-09-11T22:05:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f3225445740 1 client.25402 shutdown 2024-09-11T22:05:54.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f3225445740 1 -- 172.21.15.152:0/3557951290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 msgr2=0x5652ebf801f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f3225445740 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf801f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3208098d80 tx=0x7f3208098cf0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f3225445740 1 -- 172.21.15.152:0/3557951290 shutdown_connections 2024-09-11T22:05:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f3225445740 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652ebf89180 0x5652ebff6300 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f3225445740 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652ebf78350 0x5652ebfeb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f3225445740 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652ebf76de0 0x5652ebf801f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f31fbfff640 0 client.25402 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f3225445740 1 --2- 172.21.15.152:0/3557951290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ebf72690 0x5652ebf7fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.476+0000 7f3225445740 1 -- 172.21.15.152:0/3557951290 >> 172.21.15.152:0/3557951290 conn(0x5652ebf37310 msgr2=0x5652ebf791d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.477+0000 7f3225445740 1 -- 172.21.15.152:0/3557951290 shutdown_connections 2024-09-11T22:05:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.477+0000 7f3225445740 1 -- 172.21.15.152:0/3557951290 wait complete. 2024-09-11T22:05:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.477+0000 7f3225445740 20 client.25402 trim_cache size 0 max 16384 2024-09-11T22:05:54.479 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:05:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.478+0000 7f322306c640 1 -- 172.21.15.152:0/3921690636 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f320c0a2df0 msgr2=0x7f320c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.478+0000 7f322306c640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f320c0a2df0 0x7f320c0a52b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32100096c0 tx=0x7f32100046c0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.478+0000 7f322306c640 1 -- 172.21.15.152:0/3921690636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f321c109b10 msgr2=0x7f321c1a3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.478+0000 7f322306c640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f321c109b10 0x7f321c1a3440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f320800e9f0 tx=0x7f320800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.479+0000 7f322306c640 1 -- 172.21.15.152:0/3921690636 shutdown_connections 2024-09-11T22:05:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.479+0000 7f322306c640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f320c0a2df0 0x7f320c0a52b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.479+0000 7f322306c640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321c116ea0 0x7f321c1a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.479+0000 7f322306c640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f321c109b10 0x7f321c1a3440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.479+0000 7f322306c640 1 --2- 172.21.15.152:0/3921690636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f321c1091f0 0x7f321c1a2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.479+0000 7f322306c640 1 -- 172.21.15.152:0/3921690636 >> 172.21.15.152:0/3921690636 conn(0x7f321c06e140 msgr2=0x7f321c1173c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.479+0000 7f322306c640 1 -- 172.21.15.152:0/3921690636 shutdown_connections 2024-09-11T22:05:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:54.479+0000 7f322306c640 1 -- 172.21.15.152:0/3921690636 wait complete. 2024-09-11T22:05:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 20.0 s, 5920.4 tps, lat 16.997 ms stddev 17.447 2024-09-11T22:05:55.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:55 smithi179 ceph-mon[35603]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 739 op/s 2024-09-11T22:05:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:55 smithi193 ceph-mon[35545]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 739 op/s 2024-09-11T22:05:55.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:55 smithi152 ceph-mon[31188]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 739 op/s 2024-09-11T22:05:56.217 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:05:56.217 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:05:56.639 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:57.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.197+0000 7f163ae58640 1 -- 172.21.15.152:0/3778255545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16341027a0 msgr2=0x7f16341067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:57.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.197+0000 7f163ae58640 1 --2- 172.21.15.152:0/3778255545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16341027a0 0x7f16341067f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1628009900 tx=0x7f162802a400 comp rx=0 tx=0).stop 2024-09-11T22:05:57.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.198+0000 7f163ae58640 1 -- 172.21.15.152:0/3778255545 shutdown_connections 2024-09-11T22:05:57.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.198+0000 7f163ae58640 1 --2- 172.21.15.152:0/3778255545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1634106f20 0x7f163410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.198+0000 7f163ae58640 1 --2- 172.21.15.152:0/3778255545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16341027a0 0x7f16341067f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.198+0000 7f163ae58640 1 --2- 172.21.15.152:0/3778255545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1634101df0 0x7f16341021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.198+0000 7f163ae58640 1 -- 172.21.15.152:0/3778255545 >> 172.21.15.152:0/3778255545 conn(0x7f16340fd8f0 msgr2=0x7f16340ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:57.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.198+0000 7f163ae58640 1 -- 172.21.15.152:0/3778255545 shutdown_connections 2024-09-11T22:05:57.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.199+0000 7f163ae58640 1 -- 172.21.15.152:0/3778255545 wait complete. 2024-09-11T22:05:57.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.199+0000 7f163ae58640 1 Processor -- start 2024-09-11T22:05:57.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f163ae58640 1 -- start start 2024-09-11T22:05:57.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f163ae58640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1634101df0 0x7f1634073a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f163ae58640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16341027a0 0x7f163406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f163ae58640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1634106f20 0x7f163406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f163ae58640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1634111f90 con 0x7f1634106f20 2024-09-11T22:05:57.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f163ae58640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1634111e10 con 0x7f1634101df0 2024-09-11T22:05:57.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f163ae58640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1634112110 con 0x7f16341027a0 2024-09-11T22:05:57.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f16393f5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1634106f20 0x7f163406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f16393f5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1634106f20 0x7f163406cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49526/0 (socket says 172.21.15.152:49526) 2024-09-11T22:05:57.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f16393f5640 1 -- 172.21.15.152:0/317999155 learned_addr learned my addr 172.21.15.152:0/317999155 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:57.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f1633fff640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16341027a0 0x7f163406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.200+0000 7f1638bf4640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1634101df0 0x7f1634073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.201+0000 7f1633fff640 1 -- 172.21.15.152:0/317999155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1634101df0 msgr2=0x7f1634073a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:57.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.201+0000 7f1633fff640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1634101df0 0x7f1634073a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.201+0000 7f1633fff640 1 -- 172.21.15.152:0/317999155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1634106f20 msgr2=0x7f163406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:57.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.201+0000 7f1633fff640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1634106f20 0x7f163406cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.201+0000 7f1633fff640 1 -- 172.21.15.152:0/317999155 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163406d5e0 con 0x7f16341027a0 2024-09-11T22:05:57.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.201+0000 7f1633fff640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16341027a0 0x7f163406cab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f162802a9f0 tx=0x7f1628003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:57.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.201+0000 7f1631ffb640 1 -- 172.21.15.152:0/317999155 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162803f070 con 0x7f16341027a0 2024-09-11T22:05:57.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.202+0000 7f1631ffb640 1 -- 172.21.15.152:0/317999155 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1628031c90 con 0x7f16341027a0 2024-09-11T22:05:57.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.202+0000 7f163ae58640 1 -- 172.21.15.152:0/317999155 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f163406d870 con 0x7f16341027a0 2024-09-11T22:05:57.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.202+0000 7f1631ffb640 1 -- 172.21.15.152:0/317999155 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628035030 con 0x7f16341027a0 2024-09-11T22:05:57.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.202+0000 7f163ae58640 1 -- 172.21.15.152:0/317999155 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1634071770 con 0x7f16341027a0 2024-09-11T22:05:57.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.206+0000 7f163d231740 1 Processor -- start 2024-09-11T22:05:57.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.206+0000 7f1631ffb640 1 -- 172.21.15.152:0/317999155 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f1628042070 con 0x7f16341027a0 2024-09-11T22:05:57.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.206+0000 7f163d231740 1 -- start start 2024-09-11T22:05:57.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.206+0000 7f163d231740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f21865e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.206+0000 7f163d231740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f2186586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.206+0000 7f163d231740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f218658d60 0x55f2186591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.206+0000 7f163d231740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f2185b4280 con 0x55f21865e6c0 2024-09-11T22:05:57.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.206+0000 7f163d231740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f21855bb10 con 0x55f21865dda0 2024-09-11T22:05:57.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.206+0000 7f163d231740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f2185b0240 con 0x55f218658d60 2024-09-11T22:05:57.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.207+0000 7f16393f5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f21865e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.207+0000 7f16393f5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f21865e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58722/0 (socket says 172.21.15.152:58722) 2024-09-11T22:05:57.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.207+0000 7f16393f5640 1 -- 172.21.15.152:0/3919699941 learned_addr learned my addr 172.21.15.152:0/3919699941 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.207+0000 7f1638bf4640 1 --2- 172.21.15.152:0/3919699941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f2186586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.207+0000 7f1633fff640 1 --2- 172.21.15.152:0/3919699941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f218658d60 0x55f2186591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.208+0000 7f1638bf4640 1 -- 172.21.15.152:0/3919699941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f218658d60 msgr2=0x55f2186591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.208+0000 7f1638bf4640 1 --2- 172.21.15.152:0/3919699941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f218658d60 0x55f2186591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.208+0000 7f1638bf4640 1 -- 172.21.15.152:0/3919699941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 msgr2=0x55f21865e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.208+0000 7f1638bf4640 1 --2- 172.21.15.152:0/3919699941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f21865e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.208+0000 7f1638bf4640 1 -- 172.21.15.152:0/3919699941 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2185681f0 con 0x55f21865e6c0 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.208+0000 7f1633fff640 1 --2- 172.21.15.152:0/3919699941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f218658d60 0x55f2186591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.208+0000 7f1638bf4640 1 --2- 172.21.15.152:0/3919699941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f2186586f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f162000bbf0 tx=0x7f16200107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f30f8e5b38bfc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.209+0000 7f1631ffb640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16240a2e40 0x7f16240a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.209+0000 7f161effd640 1 -- 172.21.15.152:0/3919699941 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620004030 con 0x55f21865e6c0 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.209+0000 7f161effd640 1 -- 172.21.15.152:0/3919699941 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16200041d0 con 0x55f21865e6c0 2024-09-11T22:05:57.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.209+0000 7f161effd640 1 -- 172.21.15.152:0/3919699941 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16200117b0 con 0x55f21865e6c0 2024-09-11T22:05:57.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.209+0000 7f1631ffb640 1 -- 172.21.15.152:0/317999155 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f16280efb30 con 0x7f16341027a0 2024-09-11T22:05:57.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.209+0000 7f16393f5640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16240a2e40 0x7f16240a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.210+0000 7f163d231740 1 -- 172.21.15.152:0/3919699941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 msgr2=0x55f2186586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:57.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.210+0000 7f163d231740 1 --2- 172.21.15.152:0/3919699941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f2186586f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f162000bbf0 tx=0x7f16200107a0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.211+0000 7f163d231740 1 -- 172.21.15.152:0/3919699941 shutdown_connections 2024-09-11T22:05:57.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.211+0000 7f163d231740 1 --2- 172.21.15.152:0/3919699941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f218658d60 0x55f2186591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.211+0000 7f163d231740 1 --2- 172.21.15.152:0/3919699941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f2186586f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.211+0000 7f163d231740 1 --2- 172.21.15.152:0/3919699941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f21865e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.211+0000 7f163d231740 1 -- 172.21.15.152:0/3919699941 >> 172.21.15.152:0/3919699941 conn(0x55f21864aba0 msgr2=0x55f21864af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:57.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.211+0000 7f16393f5640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16240a2e40 0x7f16240a5300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f162c009fd0 tx=0x7f162c009500 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:57.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.211+0000 7f163d231740 1 -- 172.21.15.152:0/3919699941 shutdown_connections 2024-09-11T22:05:57.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.212+0000 7f163d231740 1 -- 172.21.15.152:0/3919699941 wait complete. 2024-09-11T22:05:57.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.212+0000 7f163d231740 1 -- start start 2024-09-11T22:05:57.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.212+0000 7f163d231740 1 Processor -- start 2024-09-11T22:05:57.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.213+0000 7f163d231740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f218658d60 0x55f218661be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.213+0000 7f163d231740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f218662120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.213+0000 7f163d231740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865e6c0 0x55f218662660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.213+0000 7f163d231740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f2186650e0 con 0x55f218658d60 2024-09-11T22:05:57.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.213+0000 7f163d231740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f21856ef10 con 0x55f21865dda0 2024-09-11T22:05:57.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.213+0000 7f163d231740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f218665260 con 0x55f21865e6c0 2024-09-11T22:05:57.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.213+0000 7f163d231740 10 client.0 _ll_register_callbacks cb 0x55f218537a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.213+0000 7f16393f5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865e6c0 0x55f218662660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.213+0000 7f16393f5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865e6c0 0x55f218662660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46716/0 (socket says 172.21.15.152:46716) 2024-09-11T22:05:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.213+0000 7f16393f5640 1 -- 172.21.15.152:0/2602987369 learned_addr learned my addr 172.21.15.152:0/2602987369 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.213+0000 7f1638bf4640 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f218658d60 0x55f218661be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.214+0000 7f16393f5640 1 -- 172.21.15.152:0/2602987369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 msgr2=0x55f218662120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:05:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.214+0000 7f16393f5640 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f218662120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.214+0000 7f16393f5640 1 -- 172.21.15.152:0/2602987369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f218658d60 msgr2=0x55f218661be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.214+0000 7f16393f5640 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f218658d60 0x55f218661be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.214+0000 7f16393f5640 1 -- 172.21.15.152:0/2602987369 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2183256a0 con 0x55f21865e6c0 2024-09-11T22:05:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.214+0000 7f16393f5640 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865e6c0 0x55f218662660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f162c00fad0 tx=0x7f162c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5eefdc58af18a4b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.214+0000 7f1613fff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:05:57.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.214+0000 7f1613fff640 1 -- 172.21.15.152:0/2602987369 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c02d060 con 0x55f21865e6c0 2024-09-11T22:05:57.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.214+0000 7f1613fff640 1 -- 172.21.15.152:0/2602987369 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f162c017030 con 0x55f21865e6c0 2024-09-11T22:05:57.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.214+0000 7f163d231740 1 -- 172.21.15.152:0/2602987369 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16200041d0 con 0x55f21865e6c0 2024-09-11T22:05:57.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.214+0000 7f1613fff640 1 -- 172.21.15.152:0/2602987369 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f162c01d6a0 con 0x55f21865e6c0 2024-09-11T22:05:57.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.215+0000 7f163d231740 10 client.25414 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:57.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.215+0000 7f163d231740 1 -- 172.21.15.152:0/2602987369 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f218670e60 con 0x55f21865e6c0 2024-09-11T22:05:57.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.215+0000 7f1613fff640 1 -- 172.21.15.152:0/2602987369 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16200041d0 con 0x55f21865e6c0 2024-09-11T22:05:57.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.215+0000 7f1613fff640 1 -- 172.21.15.152:0/2602987369 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f162c028a20 con 0x55f21865e6c0 2024-09-11T22:05:57.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.215+0000 7f163d231740 10 client.25414 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:57.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.215+0000 7f163d231740 10 client.25414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:57.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.215+0000 7f163d231740 20 client.25414 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:57.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.215+0000 7f163d231740 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f218672320 0x55f2186747b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.215+0000 7f163d231740 4 client.25414 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.215+0000 7f163d231740 1 -- 172.21.15.152:0/2602987369 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2185c17f0 con 0x55f218672320 2024-09-11T22:05:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.217+0000 7f1638bf4640 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f218672320 0x55f2186747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.218+0000 7f1613fff640 10 client.25414 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.218+0000 7f1638bf4640 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f218672320 0x55f2186747b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac06c0f42eb3602d server_cookie=d53a6daa89055dfe in_seq=0 out_seq=0 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.219+0000 7f1613fff640 1 -- 172.21.15.152:0/2602987369 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2185c17f0 con 0x55f218672320 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.219+0000 7f1613fff640 10 client.25414 handle_command_reply: tid=0 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.219+0000 7f163d231740 1 client.25414 shutdown 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.219+0000 7f163d231740 1 -- 172.21.15.152:0/2602987369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865e6c0 msgr2=0x55f218662660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.219+0000 7f163d231740 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865e6c0 0x55f218662660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f162c00fad0 tx=0x7f162c004ab0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.220+0000 7f163d231740 1 -- 172.21.15.152:0/2602987369 shutdown_connections 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.220+0000 7f163d231740 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f218672320 0x55f2186747b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.220+0000 7f163d231740 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865e6c0 0x55f218662660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.220+0000 7f163d231740 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f218662120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.220+0000 7f163d231740 1 --2- 172.21.15.152:0/2602987369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f218658d60 0x55f218661be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.220+0000 7f163d231740 1 -- 172.21.15.152:0/2602987369 >> 172.21.15.152:0/2602987369 conn(0x55f21864aba0 msgr2=0x55f21864a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.220+0000 7f1613fff640 0 client.25414 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.220+0000 7f163d231740 1 -- 172.21.15.152:0/2602987369 shutdown_connections 2024-09-11T22:05:57.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.220+0000 7f163d231740 1 -- 172.21.15.152:0/2602987369 wait complete. 2024-09-11T22:05:57.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.220+0000 7f163d231740 20 client.25414 trim_cache size 0 max 16384 2024-09-11T22:05:57.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.240+0000 7f163d231740 1 Processor -- start 2024-09-11T22:05:57.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.240+0000 7f163d231740 1 -- start start 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.240+0000 7f163d231740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f218658d60 0x55f2186586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.240+0000 7f163d231740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865dda0 0x55f21867a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f163d231740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f21867a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f163d231740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f16341b6840 con 0x55f21865e6c0 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f163d231740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f16341b40e0 con 0x55f218658d60 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f1638bf4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f218658d60 0x55f2186586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f1638bf4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f218658d60 0x55f2186586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58742/0 (socket says 172.21.15.152:58742) 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f1638bf4640 1 -- 172.21.15.152:0/716421140 learned_addr learned my addr 172.21.15.152:0/716421140 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f1633fff640 1 --2- 172.21.15.152:0/716421140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865dda0 0x55f21867a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f16393f5640 1 --2- 172.21.15.152:0/716421140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f21867a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f163d231740 1 -- 172.21.15.152:0/716421140 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f16341b1f30 con 0x55f21865dda0 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f1638bf4640 1 -- 172.21.15.152:0/716421140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865dda0 msgr2=0x55f21867a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:57.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f1638bf4640 1 --2- 172.21.15.152:0/716421140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865dda0 0x55f21867a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f1638bf4640 1 -- 172.21.15.152:0/716421140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 msgr2=0x55f21867a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:57.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f1638bf4640 1 --2- 172.21.15.152:0/716421140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f21867a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f1638bf4640 1 -- 172.21.15.152:0/716421140 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f21865d450 con 0x55f218658d60 2024-09-11T22:05:57.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f16393f5640 1 --2- 172.21.15.152:0/716421140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f21867a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:05:57.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f1638bf4640 1 --2- 172.21.15.152:0/716421140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f218658d60 0x55f2186586f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55f21864bff0 tx=0x7f1620003cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b114a24a3f05cbde server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:57.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.241+0000 7f161e7fc640 1 -- 172.21.15.152:0/716421140 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162002c020 con 0x55f218658d60 2024-09-11T22:05:57.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.242+0000 7f161e7fc640 1 -- 172.21.15.152:0/716421140 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1620003ad0 con 0x55f218658d60 2024-09-11T22:05:57.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.242+0000 7f161e7fc640 1 -- 172.21.15.152:0/716421140 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16200118a0 con 0x55f218658d60 2024-09-11T22:05:57.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.242+0000 7f163d231740 1 -- 172.21.15.152:0/716421140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f218658d60 msgr2=0x55f2186586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:57.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.242+0000 7f163d231740 1 --2- 172.21.15.152:0/716421140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f218658d60 0x55f2186586f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55f21864bff0 tx=0x7f1620003cb0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.242+0000 7f163d231740 1 -- 172.21.15.152:0/716421140 shutdown_connections 2024-09-11T22:05:57.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.242+0000 7f163d231740 1 --2- 172.21.15.152:0/716421140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f21867a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.242+0000 7f163d231740 1 --2- 172.21.15.152:0/716421140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f21865dda0 0x55f21867a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.242+0000 7f163d231740 1 --2- 172.21.15.152:0/716421140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f218658d60 0x55f2186586f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.242+0000 7f163d231740 1 -- 172.21.15.152:0/716421140 >> 172.21.15.152:0/716421140 conn(0x55f21864aba0 msgr2=0x55f21864a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:57.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.243+0000 7f163d231740 1 -- 172.21.15.152:0/716421140 shutdown_connections 2024-09-11T22:05:57.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.243+0000 7f163d231740 1 -- 172.21.15.152:0/716421140 wait complete. 2024-09-11T22:05:57.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.243+0000 7f163d231740 1 -- start start 2024-09-11T22:05:57.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.243+0000 7f163d231740 1 Processor -- start 2024-09-11T22:05:57.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.244+0000 7f163d231740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f218658d60 0x55f21866a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.244+0000 7f163d231740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f21866aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.244+0000 7f163d231740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f2186674f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.244+0000 7f163d231740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f16341b25a0 con 0x55f21865e6c0 2024-09-11T22:05:57.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.244+0000 7f163d231740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f16341b3a10 con 0x55f21865dda0 2024-09-11T22:05:57.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.244+0000 7f163d231740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f16341b2c70 con 0x55f218658d60 2024-09-11T22:05:57.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.244+0000 7f163d231740 10 client.0 _ll_register_callbacks cb 0x7f162c009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:57.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.244+0000 7f1633fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f21866aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.244+0000 7f1633fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f21866aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58746/0 (socket says 172.21.15.152:58746) 2024-09-11T22:05:57.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.244+0000 7f1633fff640 1 -- 172.21.15.152:0/1730490352 learned_addr learned my addr 172.21.15.152:0/1730490352 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:57.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.244+0000 7f16393f5640 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f2186674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.245+0000 7f16393f5640 1 -- 172.21.15.152:0/1730490352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f218658d60 msgr2=0x55f21866a520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:05:57.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.245+0000 7f16393f5640 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f218658d60 0x55f21866a520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.245+0000 7f16393f5640 1 -- 172.21.15.152:0/1730490352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 msgr2=0x55f21866aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:57.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.245+0000 7f16393f5640 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f21866aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.245+0000 7f16393f5640 1 -- 172.21.15.152:0/1730490352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f218667a30 con 0x55f21865e6c0 2024-09-11T22:05:57.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.245+0000 7f16393f5640 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f2186674f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f162c028e40 tx=0x7f162c011270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887b72c61f6cd6c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.248+0000 7f1613fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:05:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.248+0000 7f1613fff640 1 -- 172.21.15.152:0/1730490352 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c04f060 con 0x55f21865e6c0 2024-09-11T22:05:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.248+0000 7f1613fff640 1 -- 172.21.15.152:0/1730490352 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f162c01da50 con 0x55f21865e6c0 2024-09-11T22:05:57.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.248+0000 7f163d231740 1 -- 172.21.15.152:0/1730490352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1620003ad0 con 0x55f21865e6c0 2024-09-11T22:05:57.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.249+0000 7f1613fff640 1 -- 172.21.15.152:0/1730490352 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f162c01dc70 con 0x55f21865e6c0 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.249+0000 7f163d231740 10 client.15777 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.249+0000 7f163d231740 1 -- 172.21.15.152:0/1730490352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f21864eed0 con 0x55f21865e6c0 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.250+0000 7f1613fff640 1 -- 172.21.15.152:0/1730490352 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f162c01de10 con 0x55f21865e6c0 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.251+0000 7f1613fff640 1 -- 172.21.15.152:0/1730490352 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f162c049030 con 0x55f21865e6c0 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.251+0000 7f163d231740 10 client.15777 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.251+0000 7f163d231740 10 client.15777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.251+0000 7f163d231740 20 client.15777 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.251+0000 7f163d231740 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f21864f630 0x55f218651a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.251+0000 7f163d231740 4 client.15777 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.251+0000 7f163d231740 1 -- 172.21.15.152:0/1730490352 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f1620003ad0 con 0x55f21864f630 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.252+0000 7f1638bf4640 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f21864f630 0x55f218651a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:57.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.256+0000 7f1638bf4640 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f21864f630 0x55f218651a50 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=737566e2f397a54b server_cookie=da4583ee2a9e9ed3 in_seq=0 out_seq=0 2024-09-11T22:05:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.256+0000 7f1613fff640 10 client.15777 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.258+0000 7f1613fff640 1 -- 172.21.15.152:0/1730490352 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f1620003ad0 con 0x55f21864f630 2024-09-11T22:05:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.258+0000 7f1613fff640 10 client.15777 handle_command_reply: tid=0 2024-09-11T22:05:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.258+0000 7f163d231740 1 client.15777 shutdown 2024-09-11T22:05:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.258+0000 7f163d231740 1 -- 172.21.15.152:0/1730490352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 msgr2=0x55f2186674f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.258+0000 7f163d231740 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f2186674f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f162c028e40 tx=0x7f162c011270 comp rx=0 tx=0).stop 2024-09-11T22:05:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.259+0000 7f163d231740 1 -- 172.21.15.152:0/1730490352 shutdown_connections 2024-09-11T22:05:57.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.259+0000 7f163d231740 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f21864f630 0x55f218651a50 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.259+0000 7f1613fff640 0 client.15777 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:57.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.259+0000 7f163d231740 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f21865e6c0 0x55f2186674f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.259+0000 7f163d231740 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f21865dda0 0x55f21866aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.259+0000 7f163d231740 1 --2- 172.21.15.152:0/1730490352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f218658d60 0x55f21866a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.259+0000 7f163d231740 1 -- 172.21.15.152:0/1730490352 >> 172.21.15.152:0/1730490352 conn(0x55f21864aba0 msgr2=0x55f218661ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:57.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.260+0000 7f163d231740 1 -- 172.21.15.152:0/1730490352 shutdown_connections 2024-09-11T22:05:57.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.260+0000 7f163d231740 1 -- 172.21.15.152:0/1730490352 wait complete. 2024-09-11T22:05:57.262 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:05:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:05:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "d588d587-f74e-4fe6-94fa-34c75f439cd8", 2024-09-11T22:05:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:05:57.262 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:05:57.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.260+0000 7f163d231740 20 client.15777 trim_cache size 0 max 16384 2024-09-11T22:05:57.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.263+0000 7f163ae58640 1 -- 172.21.15.152:0/317999155 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16240a2e40 msgr2=0x7f16240a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:57.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.263+0000 7f163ae58640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16240a2e40 0x7f16240a5300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f162c009fd0 tx=0x7f162c009500 comp rx=0 tx=0).stop 2024-09-11T22:05:57.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.263+0000 7f163ae58640 1 -- 172.21.15.152:0/317999155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16341027a0 msgr2=0x7f163406cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:57.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.263+0000 7f163ae58640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16341027a0 0x7f163406cab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f162802a9f0 tx=0x7f1628003b90 comp rx=0 tx=0).stop 2024-09-11T22:05:57.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.263+0000 7f163ae58640 1 -- 172.21.15.152:0/317999155 shutdown_connections 2024-09-11T22:05:57.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.263+0000 7f163ae58640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f16240a2e40 0x7f16240a5300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.263+0000 7f163ae58640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1634106f20 0x7f163406cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.263+0000 7f163ae58640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16341027a0 0x7f163406cab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.263+0000 7f163ae58640 1 --2- 172.21.15.152:0/317999155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1634101df0 0x7f1634073a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:57.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.263+0000 7f163ae58640 1 -- 172.21.15.152:0/317999155 >> 172.21.15.152:0/317999155 conn(0x7f16340fd8f0 msgr2=0x7f16340fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:57.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.264+0000 7f163ae58640 1 -- 172.21.15.152:0/317999155 shutdown_connections 2024-09-11T22:05:57.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:57.264+0000 7f163ae58640 1 -- 172.21.15.152:0/317999155 wait complete. 2024-09-11T22:05:57.796 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:57 smithi152 ceph-mon[31188]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 739 op/s 2024-09-11T22:05:57.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:57 smithi179 ceph-mon[35603]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 739 op/s 2024-09-11T22:05:57.839 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:57 smithi193 ceph-mon[35545]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 739 op/s 2024-09-11T22:05:58.119 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:05:58.542 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:05:58.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:58 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:05:58.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:58 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:58.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:58 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:05:58.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:58 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:05:58.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:58 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:58.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:58 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:58.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:58 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:05:58.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:58 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:58.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:58 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:05:58.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:58 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:05:58.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:58 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:58.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:58 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:58.851 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:58 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:05:58.851 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:58 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:58.851 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:58 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:05:58.851 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:58 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:05:58.851 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:58 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:58.851 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:58 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:05:59.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.140+0000 7f9c8d633640 1 -- 172.21.15.152:0/3969223295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c88100860 msgr2=0x7f9c881045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:59.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.140+0000 7f9c8d633640 1 --2- 172.21.15.152:0/3969223295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c88100860 0x7f9c881045a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009900 tx=0x7f9c7802a420 comp rx=0 tx=0).stop 2024-09-11T22:05:59.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.141+0000 7f9c8d633640 1 -- 172.21.15.152:0/3969223295 shutdown_connections 2024-09-11T22:05:59.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.141+0000 7f9c8d633640 1 --2- 172.21.15.152:0/3969223295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c88100860 0x7f9c881045a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.141+0000 7f9c8d633640 1 --2- 172.21.15.152:0/3969223295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c88107440 0x7f9c88100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.141+0000 7f9c8d633640 1 --2- 172.21.15.152:0/3969223295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c88106a90 0x7f9c88106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.141+0000 7f9c8d633640 1 -- 172.21.15.152:0/3969223295 >> 172.21.15.152:0/3969223295 conn(0x7f9c88077230 msgr2=0x7f9c880fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:59.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.141+0000 7f9c8d633640 1 -- 172.21.15.152:0/3969223295 shutdown_connections 2024-09-11T22:05:59.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.141+0000 7f9c8d633640 1 -- 172.21.15.152:0/3969223295 wait complete. 2024-09-11T22:05:59.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.142+0000 7f9c8d633640 1 Processor -- start 2024-09-11T22:05:59.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.143+0000 7f9c8d633640 1 -- start start 2024-09-11T22:05:59.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.143+0000 7f9c8d633640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c88100860 0x7f9c881155e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.143+0000 7f9c8d633640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c88106a90 0x7f9c88115b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.143+0000 7f9c8d633640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8810e780 0x7f9c8810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.143+0000 7f9c8d633640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881185b0 con 0x7f9c88100860 2024-09-11T22:05:59.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.143+0000 7f9c8d633640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88118430 con 0x7f9c8810e780 2024-09-11T22:05:59.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.143+0000 7f9c8d633640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88118730 con 0x7f9c88106a90 2024-09-11T22:05:59.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.143+0000 7f9c867fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c88106a90 0x7f9c88115b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.143+0000 7f9c867fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c88106a90 0x7f9c88115b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46760/0 (socket says 172.21.15.152:46760) 2024-09-11T22:05:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.143+0000 7f9c867fc640 1 -- 172.21.15.152:0/1273073975 learned_addr learned my addr 172.21.15.152:0/1273073975 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.143+0000 7f9c86ffd640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c88100860 0x7f9c881155e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.144+0000 7f9c867fc640 1 -- 172.21.15.152:0/1273073975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8810e780 msgr2=0x7f9c8810ec30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:05:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.144+0000 7f9c867fc640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8810e780 0x7f9c8810ec30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.144+0000 7f9c867fc640 1 -- 172.21.15.152:0/1273073975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c88100860 msgr2=0x7f9c881155e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.144+0000 7f9c867fc640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c88100860 0x7f9c881155e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.144+0000 7f9c867fc640 1 -- 172.21.15.152:0/1273073975 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c88113110 con 0x7f9c88106a90 2024-09-11T22:05:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.144+0000 7f9c867fc640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c88106a90 0x7f9c88115b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00b470 tx=0x7f9c7c00b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.144+0000 7f9c6ffff640 1 -- 172.21.15.152:0/1273073975 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c015020 con 0x7f9c88106a90 2024-09-11T22:05:59.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.144+0000 7f9c6ffff640 1 -- 172.21.15.152:0/1273073975 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c7c011d70 con 0x7f9c88106a90 2024-09-11T22:05:59.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.145+0000 7f9c6ffff640 1 -- 172.21.15.152:0/1273073975 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00f340 con 0x7f9c88106a90 2024-09-11T22:05:59.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.146+0000 7f9c8d633640 1 -- 172.21.15.152:0/1273073975 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c88113400 con 0x7f9c88106a90 2024-09-11T22:05:59.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.146+0000 7f9c8d633640 1 -- 172.21.15.152:0/1273073975 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c881138c0 con 0x7f9c88106a90 2024-09-11T22:05:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.152+0000 7f9c8fa0c740 1 Processor -- start 2024-09-11T22:05:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.152+0000 7f9c8fa0c740 1 -- start start 2024-09-11T22:05:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.152+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77214f4a0 0x55d77214f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.152+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d77215a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.152+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77215a680 0x55d77215ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.152+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d7720b52e0 con 0x55d77214fdc0 2024-09-11T22:05:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.152+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d77205cce0 con 0x55d77215a680 2024-09-11T22:05:59.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.152+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d7720b12a0 con 0x55d77214f4a0 2024-09-11T22:05:59.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c877fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77214f4a0 0x55d77214f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c6ffff640 1 -- 172.21.15.152:0/1273073975 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9c7c018020 con 0x7f9c88106a90 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c867fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77215a680 0x55d77215ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c86ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d77215a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c877fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77214f4a0 0x55d77214f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46766/0 (socket says 172.21.15.152:46766) 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c877fe640 1 -- 172.21.15.152:0/2034049651 learned_addr learned my addr 172.21.15.152:0/2034049651 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c867fc640 1 -- 172.21.15.152:0/2034049651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77214f4a0 msgr2=0x55d77214f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c867fc640 1 --2- 172.21.15.152:0/2034049651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77214f4a0 0x55d77214f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c867fc640 1 -- 172.21.15.152:0/2034049651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 msgr2=0x55d77215a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c867fc640 1 --2- 172.21.15.152:0/2034049651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d77215a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c867fc640 1 -- 172.21.15.152:0/2034049651 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d772041440 con 0x55d77215a680 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.153+0000 7f9c877fe640 1 --2- 172.21.15.152:0/2034049651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77214f4a0 0x55d77214f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.154+0000 7f9c867fc640 1 --2- 172.21.15.152:0/2034049651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77215a680 0x55d77215ca70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0cc340 tx=0x7f9c7c0d7610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e6ce039c23848b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.154+0000 7f9c6d7fa640 1 -- 172.21.15.152:0/2034049651 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0d2e40 con 0x55d77215a680 2024-09-11T22:05:59.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.154+0000 7f9c6d7fa640 1 -- 172.21.15.152:0/2034049651 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c7c0db900 con 0x55d77215a680 2024-09-11T22:05:59.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.155+0000 7f9c6ffff640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c700a2de0 0x7f9c700a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.155+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/2034049651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77215a680 msgr2=0x55d77215ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:59.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.155+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/2034049651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77215a680 0x55d77215ca70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0cc340 tx=0x7f9c7c0d7610 comp rx=0 tx=0).stop 2024-09-11T22:05:59.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.155+0000 7f9c6d7fa640 1 -- 172.21.15.152:0/2034049651 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0daa10 con 0x55d77215a680 2024-09-11T22:05:59.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.156+0000 7f9c6ffff640 1 -- 172.21.15.152:0/1273073975 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f9c7c0ceb70 con 0x7f9c88106a90 2024-09-11T22:05:59.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.156+0000 7f9c877fe640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c700a2de0 0x7f9c700a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.156+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/2034049651 shutdown_connections 2024-09-11T22:05:59.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.156+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/2034049651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77215a680 0x55d77215ca70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.156+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/2034049651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d77215a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.156+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/2034049651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77214f4a0 0x55d77214f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.156+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/2034049651 >> 172.21.15.152:0/2034049651 conn(0x55d77214ba30 msgr2=0x55d77214be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:59.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.156+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/2034049651 shutdown_connections 2024-09-11T22:05:59.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.157+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/2034049651 wait complete. 2024-09-11T22:05:59.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.157+0000 7f9c877fe640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c700a2de0 0x7f9c700a52a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c780096c0 tx=0x7f9c78005d50 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:59.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.157+0000 7f9c8fa0c740 1 -- start start 2024-09-11T22:05:59.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.157+0000 7f9c8fa0c740 1 Processor -- start 2024-09-11T22:05:59.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214f4a0 0x55d77215a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d7721572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d772157830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d77215d2a0 con 0x55d77214fdc0 2024-09-11T22:05:59.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d772070050 con 0x55d77214f4a0 2024-09-11T22:05:59.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d77215d420 con 0x55d77215a680 2024-09-11T22:05:59.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c8fa0c740 10 client.0 _ll_register_callbacks cb 0x55d7720b0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:59.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c86ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214f4a0 0x55d77215a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c86ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214f4a0 0x55d77215a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58784/0 (socket says 172.21.15.152:58784) 2024-09-11T22:05:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c86ffd640 1 -- 172.21.15.152:0/700241558 learned_addr learned my addr 172.21.15.152:0/700241558 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c877fe640 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d772157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c867fc640 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d7721572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c86ffd640 1 -- 172.21.15.152:0/700241558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 msgr2=0x55d772157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c86ffd640 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d772157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c86ffd640 1 -- 172.21.15.152:0/700241558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 msgr2=0x55d7721572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c86ffd640 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d7721572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c86ffd640 1 -- 172.21.15.152:0/700241558 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d771e263c0 con 0x55d77214f4a0 2024-09-11T22:05:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c867fc640 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d7721572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:05:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c877fe640 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d772157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:05:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c86ffd640 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214f4a0 0x55d77215a000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c80011910 tx=0x7f9c80011dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b09c0c20e75bdef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.158+0000 7f9c6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:05:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.159+0000 7f9c6aff5640 1 -- 172.21.15.152:0/700241558 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000fc00 con 0x55d77214f4a0 2024-09-11T22:05:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.159+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/700241558 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c7c0db900 con 0x55d77214f4a0 2024-09-11T22:05:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.159+0000 7f9c6aff5640 1 -- 172.21.15.152:0/700241558 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f9c8000fda0 con 0x55d77214f4a0 2024-09-11T22:05:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.159+0000 7f9c6aff5640 1 -- 172.21.15.152:0/700241558 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9c80012450 con 0x55d77214f4a0 2024-09-11T22:05:59.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.160+0000 7f9c8fa0c740 10 client.25289 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:59.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.161+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/700241558 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d772168dc0 con 0x55d77214f4a0 2024-09-11T22:05:59.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.161+0000 7f9c6aff5640 1 -- 172.21.15.152:0/700241558 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c7c0db900 con 0x55d77214f4a0 2024-09-11T22:05:59.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.161+0000 7f9c6aff5640 1 -- 172.21.15.152:0/700241558 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f9c8000f040 con 0x55d77214f4a0 2024-09-11T22:05:59.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.162+0000 7f9c8fa0c740 10 client.25289 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:59.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.162+0000 7f9c8fa0c740 10 client.25289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:59.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.162+0000 7f9c8fa0c740 20 client.25289 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:59.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.162+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d77216a710 0x55d77216cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.162+0000 7f9c8fa0c740 4 client.25289 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:05:59.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.162+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/700241558 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7720c2850 con 0x55d77216a710 2024-09-11T22:05:59.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.163+0000 7f9c867fc640 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d77216a710 0x55d77216cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.164+0000 7f9c867fc640 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d77216a710 0x55d77216cbb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=488490454c2653ed server_cookie=81924c7d51706395 in_seq=0 out_seq=0 2024-09-11T22:05:59.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.164+0000 7f9c6aff5640 10 client.25289 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:59.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.168+0000 7f9c6aff5640 1 -- 172.21.15.152:0/700241558 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7720c2850 con 0x55d77216a710 2024-09-11T22:05:59.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.168+0000 7f9c6aff5640 10 client.25289 handle_command_reply: tid=0 2024-09-11T22:05:59.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.168+0000 7f9c8fa0c740 1 client.25289 shutdown 2024-09-11T22:05:59.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.169+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/700241558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214f4a0 msgr2=0x55d77215a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:59.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.169+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214f4a0 0x55d77215a000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c80011910 tx=0x7f9c80011dd0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.170+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/700241558 shutdown_connections 2024-09-11T22:05:59.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.170+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d77216a710 0x55d77216cbb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.170+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d772157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.170+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d7721572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.170+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/700241558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214f4a0 0x55d77215a000 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c80011910 tx=0x7f9c80011dd0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.170+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/700241558 >> 172.21.15.152:0/700241558 conn(0x55d77214ba30 msgr2=0x55d772151760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:59.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.170+0000 7f9c6aff5640 0 client.25289 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:59.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.171+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/700241558 shutdown_connections 2024-09-11T22:05:59.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.171+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/700241558 wait complete. 2024-09-11T22:05:59.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.174+0000 7f9c8fa0c740 20 client.25289 trim_cache size 0 max 16384 2024-09-11T22:05:59.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.212+0000 7f9c8fa0c740 1 Processor -- start 2024-09-11T22:05:59.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.212+0000 7f9c8fa0c740 1 -- start start 2024-09-11T22:05:59.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.212+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d772166580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.212+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d772155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.212+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7721527a0 0x55d7721724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.212+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881c7570 con 0x55d77214fdc0 2024-09-11T22:05:59.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.212+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88073750 con 0x55d7721527a0 2024-09-11T22:05:59.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.212+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c880715a0 con 0x55d77215a680 2024-09-11T22:05:59.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.213+0000 7f9c86ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d772166580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.213+0000 7f9c86ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d772166580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49636/0 (socket says 172.21.15.152:49636) 2024-09-11T22:05:59.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.213+0000 7f9c86ffd640 1 -- 172.21.15.152:0/1006026386 learned_addr learned my addr 172.21.15.152:0/1006026386 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:59.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.214+0000 7f9c86ffd640 1 -- 172.21.15.152:0/1006026386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 msgr2=0x55d772155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:59.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.214+0000 7f9c86ffd640 1 --2- 172.21.15.152:0/1006026386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d772155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.214+0000 7f9c86ffd640 1 -- 172.21.15.152:0/1006026386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7721527a0 msgr2=0x55d7721724c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:05:59.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.214+0000 7f9c86ffd640 1 --2- 172.21.15.152:0/1006026386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7721527a0 0x55d7721724c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.214+0000 7f9c86ffd640 1 -- 172.21.15.152:0/1006026386 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d772156260 con 0x55d77214fdc0 2024-09-11T22:05:59.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.214+0000 7f9c86ffd640 1 --2- 172.21.15.152:0/1006026386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d772166580 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9c80023b40 tx=0x7f9c8000f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1343f1dfd669e02a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:59.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.215+0000 7f9c6cff9640 1 -- 172.21.15.152:0/1006026386 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c80023bc0 con 0x55d77214fdc0 2024-09-11T22:05:59.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.215+0000 7f9c6cff9640 1 -- 172.21.15.152:0/1006026386 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c80023d60 con 0x55d77214fdc0 2024-09-11T22:05:59.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.216+0000 7f9c6cff9640 1 -- 172.21.15.152:0/1006026386 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c80003bd0 con 0x55d77214fdc0 2024-09-11T22:05:59.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.216+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/1006026386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 msgr2=0x55d772166580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:59.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.216+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/1006026386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d772166580 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9c80023b40 tx=0x7f9c8000f7e0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.216+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/1006026386 shutdown_connections 2024-09-11T22:05:59.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.216+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/1006026386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7721527a0 0x55d7721724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.216+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/1006026386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d772155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.216+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/1006026386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d77214fdc0 0x55d772166580 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.216+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/1006026386 >> 172.21.15.152:0/1006026386 conn(0x55d77214ba30 msgr2=0x55d772152090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:59.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.217+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/1006026386 shutdown_connections 2024-09-11T22:05:59.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.217+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/1006026386 wait complete. 2024-09-11T22:05:59.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.217+0000 7f9c8fa0c740 1 -- start start 2024-09-11T22:05:59.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.217+0000 7f9c8fa0c740 1 Processor -- start 2024-09-11T22:05:59.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.218+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214fdc0 0x55d772162ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.218+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7721527a0 0x55d772163020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.218+0000 7f9c8fa0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d77215e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.218+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88071c10 con 0x55d7721527a0 2024-09-11T22:05:59.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.218+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88073080 con 0x55d77214fdc0 2024-09-11T22:05:59.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.218+0000 7f9c8fa0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c880722e0 con 0x55d77215a680 2024-09-11T22:05:59.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.218+0000 7f9c8fa0c740 10 client.0 _ll_register_callbacks cb 0x7f9c80009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:05:59.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.218+0000 7f9c877fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d77215e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.218+0000 7f9c867fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7721527a0 0x55d772163020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.218+0000 7f9c877fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d77215e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46796/0 (socket says 172.21.15.152:46796) 2024-09-11T22:05:59.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.218+0000 7f9c877fe640 1 -- 172.21.15.152:0/3236246064 learned_addr learned my addr 172.21.15.152:0/3236246064 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:05:59.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.219+0000 7f9c86ffd640 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214fdc0 0x55d772162ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.220+0000 7f9c877fe640 1 -- 172.21.15.152:0/3236246064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214fdc0 msgr2=0x55d772162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:59.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.220+0000 7f9c877fe640 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214fdc0 0x55d772162ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.220+0000 7f9c877fe640 1 -- 172.21.15.152:0/3236246064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7721527a0 msgr2=0x55d772163020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:05:59.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.220+0000 7f9c877fe640 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7721527a0 0x55d772163020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.220+0000 7f9c877fe640 1 -- 172.21.15.152:0/3236246064 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d77215e890 con 0x55d77215a680 2024-09-11T22:05:59.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.220+0000 7f9c877fe640 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d77215e060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c78005dc0 tx=0x7f9c78009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebe91f637c76c162 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:05:59.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.220+0000 7f9c6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:05:59.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.220+0000 7f9c6aff5640 1 -- 172.21.15.152:0/3236246064 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7804d020 con 0x55d77215a680 2024-09-11T22:05:59.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.220+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/3236246064 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c80023d60 con 0x55d77215a680 2024-09-11T22:05:59.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c6aff5640 1 -- 172.21.15.152:0/3236246064 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f9c78004d90 con 0x55d77215a680 2024-09-11T22:05:59.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c6aff5640 1 -- 172.21.15.152:0/3236246064 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9c78058050 con 0x55d77215a680 2024-09-11T22:05:59.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c8fa0c740 10 client.25426 fetch_fsmap learned FSMap version 27 2024-09-11T22:05:59.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/3236246064 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d7721d5150 con 0x55d77215a680 2024-09-11T22:05:59.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c6aff5640 1 -- 172.21.15.152:0/3236246064 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c80023d60 con 0x55d77215a680 2024-09-11T22:05:59.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c6aff5640 1 -- 172.21.15.152:0/3236246064 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f9c7803a040 con 0x55d77215a680 2024-09-11T22:05:59.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c8fa0c740 10 client.25426 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:05:59.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c8fa0c740 10 client.25426 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:05:59.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c8fa0c740 20 client.25426 populate_metadata read hostname 'smithi152' 2024-09-11T22:05:59.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7721d5900 0x55d7721d7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:05:59.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c8fa0c740 4 client.25426 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:05:59.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.221+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/3236246064 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d7720bcd60 con 0x55d7721d5900 2024-09-11T22:05:59.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.222+0000 7f9c86ffd640 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7721d5900 0x55d7721d7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:05:59.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.222+0000 7f9c6aff5640 10 client.25426 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:59.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.223+0000 7f9c86ffd640 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7721d5900 0x55d7721d7d20 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2124f7db7f859d3f server_cookie=e22c5668110bec32 in_seq=0 out_seq=0 2024-09-11T22:05:59.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.224+0000 7f9c6aff5640 1 -- 172.21.15.152:0/3236246064 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d7720bcd60 con 0x55d7721d5900 2024-09-11T22:05:59.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.224+0000 7f9c6aff5640 10 client.25426 handle_command_reply: tid=0 2024-09-11T22:05:59.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.224+0000 7f9c8fa0c740 1 client.25426 shutdown 2024-09-11T22:05:59.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.225+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/3236246064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 msgr2=0x55d77215e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:59.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.225+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d77215e060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c78005dc0 tx=0x7f9c78009260 comp rx=0 tx=0).stop 2024-09-11T22:05:59.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.225+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/3236246064 shutdown_connections 2024-09-11T22:05:59.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.225+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7721d5900 0x55d7721d7d20 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.225+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d77215a680 0x55d77215e060 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.225+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7721527a0 0x55d772163020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.225+0000 7f9c8fa0c740 1 --2- 172.21.15.152:0/3236246064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d77214fdc0 0x55d772162ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.225+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/3236246064 >> 172.21.15.152:0/3236246064 conn(0x55d77214ba30 msgr2=0x55d772155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:59.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.225+0000 7f9c6aff5640 0 client.25426 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:05:59.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.226+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/3236246064 shutdown_connections 2024-09-11T22:05:59.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.227+0000 7f9c8fa0c740 1 -- 172.21.15.152:0/3236246064 wait complete. 2024-09-11T22:05:59.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.227+0000 7f9c8fa0c740 20 client.25426 trim_cache size 0 max 16384 2024-09-11T22:05:59.228 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:05:59.228 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:05:59.228 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:05:59.228 INFO:teuthology.orchestra.run.smithi152.stdout: "d588d587-f74e-4fe6-94fa-34c75f439cd8": { 2024-09-11T22:05:59.228 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:05:59.228 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "d588d587-f74e-4fe6-94fa-34c75f439cd8", 2024-09-11T22:05:59.229 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:05:59.229 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:59.229 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:05:59.229 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:05:59.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.228+0000 7f9c8d633640 1 -- 172.21.15.152:0/1273073975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c700a2de0 msgr2=0x7f9c700a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.229+0000 7f9c8d633640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c700a2de0 0x7f9c700a52a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c780096c0 tx=0x7f9c78005d50 comp rx=0 tx=0).stop 2024-09-11T22:05:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.229+0000 7f9c8d633640 1 -- 172.21.15.152:0/1273073975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c88106a90 msgr2=0x7f9c88115b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:05:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.229+0000 7f9c8d633640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c88106a90 0x7f9c88115b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00b470 tx=0x7f9c7c00b930 comp rx=0 tx=0).stop 2024-09-11T22:05:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.229+0000 7f9c8d633640 1 -- 172.21.15.152:0/1273073975 shutdown_connections 2024-09-11T22:05:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.229+0000 7f9c8d633640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c700a2de0 0x7f9c700a52a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.229+0000 7f9c8d633640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8810e780 0x7f9c8810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.229+0000 7f9c8d633640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c88106a90 0x7f9c88115b20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.230+0000 7f9c8d633640 1 --2- 172.21.15.152:0/1273073975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c88100860 0x7f9c881155e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:05:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.230+0000 7f9c8d633640 1 -- 172.21.15.152:0/1273073975 >> 172.21.15.152:0/1273073975 conn(0x7f9c88077230 msgr2=0x7f9c881026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:05:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.230+0000 7f9c8d633640 1 -- 172.21.15.152:0/1273073975 shutdown_connections 2024-09-11T22:05:59.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:05:59.230+0000 7f9c8d633640 1 -- 172.21.15.152:0/1273073975 wait complete. 2024-09-11T22:05:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:05:59 smithi179 ceph-mon[35603]: pgmap v54: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2024-09-11T22:05:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 25.0 s, 5398.6 tps, lat 18.486 ms stddev 18.975 2024-09-11T22:05:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:05:59 smithi193 ceph-mon[35545]: pgmap v54: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2024-09-11T22:05:59.856 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:05:59 smithi152 ceph-mon[31188]: pgmap v54: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2024-09-11T22:06:00.090 INFO:tasks.cephfs.filesystem:scrub status for tag:d588d587-f74e-4fe6-94fa-34c75f439cd8 - {'path': '/', 'tag': 'd588d587-f74e-4fe6-94fa-34c75f439cd8', 'options': 'recursive,force'} 2024-09-11T22:06:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.655+0000 7ff7fc191640 1 -- 172.21.15.152:0/4219555637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f4102470 msgr2=0x7ff7f410e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.655+0000 7ff7fc191640 1 --2- 172.21.15.152:0/4219555637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f4102470 0x7ff7f410e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009c10 tx=0x7ff7ec02a6e0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.655+0000 7ff7fc191640 1 -- 172.21.15.152:0/4219555637 shutdown_connections 2024-09-11T22:06:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.655+0000 7ff7fc191640 1 --2- 172.21.15.152:0/4219555637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f4102470 0x7ff7f410e9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.655+0000 7ff7fc191640 1 --2- 172.21.15.152:0/4219555637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4101ad0 0x7ff7f4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.655+0000 7ff7fc191640 1 --2- 172.21.15.152:0/4219555637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4107b70 0x7ff7f4107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.655+0000 7ff7fc191640 1 -- 172.21.15.152:0/4219555637 >> 172.21.15.152:0/4219555637 conn(0x7ff7f40fd7d0 msgr2=0x7ff7f40ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.655+0000 7ff7fc191640 1 -- 172.21.15.152:0/4219555637 shutdown_connections 2024-09-11T22:06:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.655+0000 7ff7fc191640 1 -- 172.21.15.152:0/4219555637 wait complete. 2024-09-11T22:06:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.655+0000 7ff7fc191640 1 Processor -- start 2024-09-11T22:06:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.655+0000 7ff7fc191640 1 -- start start 2024-09-11T22:06:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7fc191640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4101ad0 0x7ff7f4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7fc191640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4102470 0x7ff7f4198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7fc191640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f4107b70 0x7ff7f419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7fc191640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4111ed0 con 0x7ff7f4102470 2024-09-11T22:06:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7fc191640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4111d50 con 0x7ff7f4101ad0 2024-09-11T22:06:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7fc191640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4112050 con 0x7ff7f4107b70 2024-09-11T22:06:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7f9f2d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4101ad0 0x7ff7f4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7f9f2d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4101ad0 0x7ff7f4198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58832/0 (socket says 172.21.15.152:58832) 2024-09-11T22:06:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/700114918 learned_addr learned my addr 172.21.15.152:0/700114918 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7f972c640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4102470 0x7ff7f4198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7fa72e640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f4107b70 0x7ff7f419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/700114918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f4107b70 msgr2=0x7ff7f419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f4107b70 0x7ff7f419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/700114918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4102470 msgr2=0x7ff7f4198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4102470 0x7ff7f4198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/700114918 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f419d2f0 con 0x7ff7f4101ad0 2024-09-11T22:06:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7f972c640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4102470 0x7ff7f4198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7fa72e640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f4107b70 0x7ff7f419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.656+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4101ad0 0x7ff7f4198300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000e9c0 tx=0x7ff7f000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.657+0000 7ff7eaffd640 1 -- 172.21.15.152:0/700114918 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f000cde0 con 0x7ff7f4101ad0 2024-09-11T22:06:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.657+0000 7ff7eaffd640 1 -- 172.21.15.152:0/700114918 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7f00035f0 con 0x7ff7f4101ad0 2024-09-11T22:06:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.657+0000 7ff7fc191640 1 -- 172.21.15.152:0/700114918 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f419d5e0 con 0x7ff7f4101ad0 2024-09-11T22:06:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.657+0000 7ff7eaffd640 1 -- 172.21.15.152:0/700114918 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0010650 con 0x7ff7f4101ad0 2024-09-11T22:06:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.657+0000 7ff7fc191640 1 -- 172.21.15.152:0/700114918 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f41a4e70 con 0x7ff7f4101ad0 2024-09-11T22:06:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.659+0000 7ff7eaffd640 1 -- 172.21.15.152:0/700114918 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff7f00037a0 con 0x7ff7f4101ad0 2024-09-11T22:06:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.659+0000 7ff7ff009740 1 Processor -- start 2024-09-11T22:06:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.659+0000 7ff7ff009740 1 -- start start 2024-09-11T22:06:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd19bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 0x5593bd1a6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7ff009740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5593bd1002f0 con 0x5593bd19c410 2024-09-11T22:06:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7ff009740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5593bd0a8270 con 0x5593bd1a6cb0 2024-09-11T22:06:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7ff009740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5593bd0fc2b0 con 0x5593bd19baf0 2024-09-11T22:06:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7f9f2d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 0x5593bd1a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7fa72e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd19bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7fa72e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd19bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46822/0 (socket says 172.21.15.152:46822) 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7fa72e640 1 -- 172.21.15.152:0/1790617953 learned_addr learned my addr 172.21.15.152:0/1790617953 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7f972c640 1 --2- 172.21.15.152:0/1790617953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7eaffd640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7e00a2da0 0x7ff7e00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7f972c640 1 -- 172.21.15.152:0/1790617953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 msgr2=0x5593bd19bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7f972c640 1 --2- 172.21.15.152:0/1790617953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd19bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7f972c640 1 -- 172.21.15.152:0/1790617953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 msgr2=0x5593bd1a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7f972c640 1 --2- 172.21.15.152:0/1790617953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 0x5593bd1a6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7f972c640 1 -- 172.21.15.152:0/1790617953 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593bd0a7340 con 0x5593bd1a6cb0 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7fa72e640 1 --2- 172.21.15.152:0/1790617953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd19bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/1790617953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 0x5593bd1a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7eaffd640 1 -- 172.21.15.152:0/700114918 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff7f00cf780 con 0x7ff7f4101ad0 2024-09-11T22:06:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.660+0000 7ff7fa72e640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7e00a2da0 0x7ff7e00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.661+0000 7ff7f972c640 1 --2- 172.21.15.152:0/1790617953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a90a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009fa0 tx=0x7ff7e40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58f6be77faceec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.661+0000 7ff7dffff640 1 -- 172.21.15.152:0/1790617953 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4004030 con 0x5593bd1a6cb0 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.661+0000 7ff7dffff640 1 -- 172.21.15.152:0/1790617953 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7e4005500 con 0x5593bd1a6cb0 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.661+0000 7ff7dffff640 1 -- 172.21.15.152:0/1790617953 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4004dd0 con 0x5593bd1a6cb0 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 -- 172.21.15.152:0/1790617953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd1a6cb0 msgr2=0x5593bd1a90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7fa72e640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7e00a2da0 0x7ff7e00a5260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec031040 tx=0x7ff7ec009500 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1790617953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a90a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009fa0 tx=0x7ff7e40118d0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 -- 172.21.15.152:0/1790617953 shutdown_connections 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1790617953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a90a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1790617953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 0x5593bd1a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1790617953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd19bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 -- 172.21.15.152:0/1790617953 >> 172.21.15.152:0/1790617953 conn(0x5593bd198060 msgr2=0x5593bd198440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 -- 172.21.15.152:0/1790617953 shutdown_connections 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 -- 172.21.15.152:0/1790617953 wait complete. 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 -- start start 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 Processor -- start 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.662+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd1a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19c410 0x5593bd1a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7ff009740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5593bd1adc90 con 0x5593bd1a6cb0 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7ff009740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5593bd089290 con 0x5593bd19c410 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7ff009740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5593bd1ade10 con 0x5593bd19baf0 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7ff009740 10 client.0 _ll_register_callbacks cb 0x5593bd0ba140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7fa72e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7f9f2d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd1a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7f9f2d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd1a3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46828/0 (socket says 172.21.15.152:46828) 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/1704168338 learned_addr learned my addr 172.21.15.152:0/1704168338 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7f972c640 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19c410 0x5593bd1a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7f972c640 1 -- 172.21.15.152:0/1704168338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 msgr2=0x5593bd1a3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7f972c640 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd1a3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7f972c640 1 -- 172.21.15.152:0/1704168338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd1a6cb0 msgr2=0x5593bd1a4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7f972c640 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7f972c640 1 -- 172.21.15.152:0/1704168338 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593bce13210 con 0x5593bd19c410 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7fa72e640 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd1a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7f972c640 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19c410 0x5593bd1a4050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5593bd1993e0 tx=0x7ff7e4004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a297890f8af340f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/1704168338 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4027070 con 0x5593bd19c410 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/1704168338 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff7e4005180 con 0x5593bd19c410 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.663+0000 7ff7ff009740 1 -- 172.21.15.152:0/1704168338 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7e4005500 con 0x5593bd19c410 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/1704168338 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff7e4032050 con 0x5593bd19c410 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7ff009740 10 client.25301 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7ff009740 1 -- 172.21.15.152:0/1704168338 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5593bcedf620 con 0x5593bd19c410 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/1704168338 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7e4005500 con 0x5593bd19c410 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/1704168338 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7ff7e4022460 con 0x5593bd19c410 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7ff009740 10 client.25301 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7ff009740 10 client.25301 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7ff009740 20 client.25301 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593bd1baf00 0x5593bd1bd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7ff009740 4 client.25301 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7ff009740 1 -- 172.21.15.152:0/1704168338 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593bd10da20 con 0x5593bd1baf00 2024-09-11T22:06:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.664+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593bd1baf00 0x5593bd1bd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.665+0000 7ff7dd7fa640 10 client.25301 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.665+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593bd1baf00 0x5593bd1bd2f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8743638a156cba2e server_cookie=c4d3226cefa914e4 in_seq=0 out_seq=0 2024-09-11T22:06:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.665+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/1704168338 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593bd10da20 con 0x5593bd1baf00 2024-09-11T22:06:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.665+0000 7ff7dd7fa640 10 client.25301 handle_command_reply: tid=0 2024-09-11T22:06:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.665+0000 7ff7ff009740 1 client.25301 shutdown 2024-09-11T22:06:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7ff009740 1 -- 172.21.15.152:0/1704168338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19c410 msgr2=0x5593bd1a4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19c410 0x5593bd1a4050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5593bd1993e0 tx=0x7ff7e4004f90 comp rx=0 tx=0).stop 2024-09-11T22:06:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7ff009740 1 -- 172.21.15.152:0/1704168338 shutdown_connections 2024-09-11T22:06:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593bd1baf00 0x5593bd1bd2f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7dd7fa640 0 client.25301 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19c410 0x5593bd1a4050 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1704168338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd19baf0 0x5593bd1a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7ff009740 1 -- 172.21.15.152:0/1704168338 >> 172.21.15.152:0/1704168338 conn(0x5593bd198060 msgr2=0x5593bd19ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7ff009740 1 -- 172.21.15.152:0/1704168338 shutdown_connections 2024-09-11T22:06:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7ff009740 1 -- 172.21.15.152:0/1704168338 wait complete. 2024-09-11T22:06:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.666+0000 7ff7ff009740 20 client.25301 trim_cache size 0 max 16384 2024-09-11T22:06:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.680+0000 7ff7ff009740 1 Processor -- start 2024-09-11T22:06:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.680+0000 7ff7ff009740 1 -- start start 2024-09-11T22:06:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19baf0 0x5593bd1a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 0x5593bd1c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd1a6cb0 0x5593bd1c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7ff009740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f41ae000 con 0x5593bd19c410 2024-09-11T22:06:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7ff009740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f41ab8a0 con 0x5593bd19baf0 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7ff009740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f41a96f0 con 0x5593bd1a6cb0 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7f972c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 0x5593bd1c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7f9f2d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19baf0 0x5593bd1a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7f972c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 0x5593bd1c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49688/0 (socket says 172.21.15.152:49688) 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7f972c640 1 -- 172.21.15.152:0/1235731583 learned_addr learned my addr 172.21.15.152:0/1235731583 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7fa72e640 1 --2- 172.21.15.152:0/1235731583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd1a6cb0 0x5593bd1c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/1235731583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd1a6cb0 msgr2=0x5593bd1c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/1235731583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd1a6cb0 0x5593bd1c2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/1235731583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 msgr2=0x5593bd1c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/1235731583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 0x5593bd1c2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/1235731583 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593bd197e90 con 0x5593bd19baf0 2024-09-11T22:06:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7f972c640 1 --2- 172.21.15.152:0/1235731583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 0x5593bd1c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/1235731583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19baf0 0x5593bd1a5a80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000c6a0 tx=0x7ff7f00d5300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c38fe7bd2b56fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7df7fe640 1 -- 172.21.15.152:0/1235731583 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f009c310 con 0x5593bd19baf0 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7df7fe640 1 -- 172.21.15.152:0/1235731583 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7f009bc10 con 0x5593bd19baf0 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.681+0000 7ff7df7fe640 1 -- 172.21.15.152:0/1235731583 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00cfb70 con 0x5593bd19baf0 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.682+0000 7ff7ff009740 1 -- 172.21.15.152:0/1235731583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19baf0 msgr2=0x5593bd1a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.682+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1235731583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19baf0 0x5593bd1a5a80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000c6a0 tx=0x7ff7f00d5300 comp rx=0 tx=0).stop 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.682+0000 7ff7ff009740 1 -- 172.21.15.152:0/1235731583 shutdown_connections 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.682+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1235731583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd1a6cb0 0x5593bd1c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.682+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1235731583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19c410 0x5593bd1c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.682+0000 7ff7ff009740 1 --2- 172.21.15.152:0/1235731583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19baf0 0x5593bd1a5a80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.682+0000 7ff7ff009740 1 -- 172.21.15.152:0/1235731583 >> 172.21.15.152:0/1235731583 conn(0x5593bd198060 msgr2=0x5593bd1a5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.682+0000 7ff7ff009740 1 -- 172.21.15.152:0/1235731583 shutdown_connections 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.682+0000 7ff7ff009740 1 -- 172.21.15.152:0/1235731583 wait complete. 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.682+0000 7ff7ff009740 1 -- start start 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7ff009740 1 Processor -- start 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19baf0 0x5593bd1b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19c410 0x5593bd1b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7ff009740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7ff009740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f41a9d60 con 0x5593bd19baf0 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7ff009740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f41ab1d0 con 0x5593bd19c410 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7ff009740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f41aa430 con 0x5593bd1a6cb0 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7ff009740 10 client.0 _ll_register_callbacks cb 0x7ff7f00d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7f9f2d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19baf0 0x5593bd1b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7f9f2d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19baf0 0x5593bd1b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49692/0 (socket says 172.21.15.152:49692) 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/731903089 learned_addr learned my addr 172.21.15.152:0/731903089 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7fa72e640 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7f972c640 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19c410 0x5593bd1b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/731903089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd1a6cb0 msgr2=0x5593bd1a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/731903089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19c410 msgr2=0x5593bd1b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19c410 0x5593bd1b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7f9f2d640 1 -- 172.21.15.152:0/731903089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593bd1a0bd0 con 0x5593bd19baf0 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7f9f2d640 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19baf0 0x5593bd1b33b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0098590 tx=0x7ff7f00a4880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0713b90526be32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.683+0000 7ff7dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/731903089 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f009c310 con 0x5593bd19baf0 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/731903089 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff7f00cd0c0 con 0x5593bd19baf0 2024-09-11T22:06:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7ff009740 1 -- 172.21.15.152:0/731903089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7f009bc10 con 0x5593bd19baf0 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/731903089 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff7f00cd2c0 con 0x5593bd19baf0 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7ff009740 10 client.15813 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7ff009740 1 -- 172.21.15.152:0/731903089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5593bd1b2c90 con 0x5593bd19baf0 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/731903089 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7f009bc10 con 0x5593bd19baf0 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/731903089 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7ff7f009b060 con 0x5593bd19baf0 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7ff009740 10 client.15813 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7ff009740 10 client.15813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7ff009740 20 client.15813 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7ff009740 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593bd225c40 0x5593bd228060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7ff009740 4 client.15813 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7ff009740 1 -- 172.21.15.152:0/731903089 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5593bd107d70 con 0x5593bd225c40 2024-09-11T22:06:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.684+0000 7ff7f972c640 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593bd225c40 0x5593bd228060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:01.693 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.685+0000 7ff7dd7fa640 10 client.15813 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:01.693 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:01.685+0000 7ff7f972c640 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593bd225c40 0x5593bd228060 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38b38cd644f936f7 server_cookie=a653941858f3cebc in_seq=0 out_seq=0 2024-09-11T22:06:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:01 smithi179 ceph-mon[35603]: pgmap v55: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 765 op/s 2024-09-11T22:06:01.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:01 smithi193 ceph-mon[35545]: pgmap v55: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 765 op/s 2024-09-11T22:06:01.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:01 smithi152 ceph-mon[31188]: pgmap v55: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 765 op/s 2024-09-11T22:06:03.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:03 smithi179 ceph-mon[35603]: pgmap v56: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2024-09-11T22:06:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7dd7fa640 1 -- 172.21.15.152:0/731903089 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5593bd107d70 con 0x5593bd225c40 2024-09-11T22:06:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7dd7fa640 10 client.15813 handle_command_reply: tid=0 2024-09-11T22:06:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 1 client.15813 shutdown 2024-09-11T22:06:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 1 -- 172.21.15.152:0/731903089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19baf0 msgr2=0x5593bd1b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19baf0 0x5593bd1b33b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0098590 tx=0x7ff7f00a4880 comp rx=0 tx=0).stop 2024-09-11T22:06:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 1 -- 172.21.15.152:0/731903089 shutdown_connections 2024-09-11T22:06:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593bd225c40 0x5593bd228060 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593bd1a6cb0 0x5593bd1a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7dd7fa640 0 client.15813 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593bd19c410 0x5593bd1b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 1 --2- 172.21.15.152:0/731903089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593bd19baf0 0x5593bd1b33b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 1 -- 172.21.15.152:0/731903089 >> 172.21.15.152:0/731903089 conn(0x5593bd198060 msgr2=0x5593bd1a5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 1 -- 172.21.15.152:0/731903089 shutdown_connections 2024-09-11T22:06:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 1 -- 172.21.15.152:0/731903089 wait complete. 2024-09-11T22:06:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.807+0000 7ff7ff009740 20 client.15813 trim_cache size 0 max 16384 2024-09-11T22:06:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:06:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:06:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:06:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:06:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 -- 172.21.15.152:0/700114918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7e00a2da0 msgr2=0x7ff7e00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7e00a2da0 0x7ff7e00a5260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec031040 tx=0x7ff7ec009500 comp rx=0 tx=0).stop 2024-09-11T22:06:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 -- 172.21.15.152:0/700114918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4101ad0 msgr2=0x7ff7f4198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4101ad0 0x7ff7f4198300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000e9c0 tx=0x7ff7f000ee80 comp rx=0 tx=0).stop 2024-09-11T22:06:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 -- 172.21.15.152:0/700114918 shutdown_connections 2024-09-11T22:06:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7e00a2da0 0x7ff7e00a5260 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f4107b70 0x7ff7f419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4102470 0x7ff7f4198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 --2- 172.21.15.152:0/700114918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4101ad0 0x7ff7f4198300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 -- 172.21.15.152:0/700114918 >> 172.21.15.152:0/700114918 conn(0x7ff7f40fd7d0 msgr2=0x7ff7f40fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 -- 172.21.15.152:0/700114918 shutdown_connections 2024-09-11T22:06:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:03.808+0000 7ff7fc191640 1 -- 172.21.15.152:0/700114918 wait complete. 2024-09-11T22:06:03.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:03 smithi193 ceph-mon[35545]: pgmap v56: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2024-09-11T22:06:03.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:03 smithi152 ceph-mon[31188]: pgmap v56: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2024-09-11T22:06:04.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:04 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:06:04.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:04 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:06:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 30.0 s, 1596.0 tps, lat 60.267 ms stddev 99.550 2024-09-11T22:06:04.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:04 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:06:04.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:04 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:06:04.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:04 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:06:04.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:04 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:06:05.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:05 smithi179 ceph-mon[35603]: pgmap v57: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.5 MiB/s wr, 814 op/s 2024-09-11T22:06:05.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:05 smithi193 ceph-mon[35545]: pgmap v57: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.5 MiB/s wr, 814 op/s 2024-09-11T22:06:05.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:05 smithi152 ceph-mon[31188]: pgmap v57: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.5 MiB/s wr, 814 op/s 2024-09-11T22:06:07.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:07 smithi179 ceph-mon[35603]: pgmap v58: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.5 MiB/s wr, 814 op/s 2024-09-11T22:06:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:07 smithi193 ceph-mon[35545]: pgmap v58: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.5 MiB/s wr, 814 op/s 2024-09-11T22:06:07.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:07 smithi152 ceph-mon[31188]: pgmap v58: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.5 MiB/s wr, 814 op/s 2024-09-11T22:06:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:09 smithi179 ceph-mon[35603]: pgmap v59: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 50 MiB/s wr, 1.84k op/s 2024-09-11T22:06:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 35.0 s, 2589.4 tps, lat 40.140 ms stddev 88.301 2024-09-11T22:06:09.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:09 smithi193 ceph-mon[35545]: pgmap v59: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 50 MiB/s wr, 1.84k op/s 2024-09-11T22:06:09.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:09 smithi152 ceph-mon[31188]: pgmap v59: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 50 MiB/s wr, 1.84k op/s 2024-09-11T22:06:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:11 smithi179 ceph-mon[35603]: pgmap v60: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 45 MiB/s wr, 1.44k op/s 2024-09-11T22:06:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:11 smithi193 ceph-mon[35545]: pgmap v60: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 45 MiB/s wr, 1.44k op/s 2024-09-11T22:06:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:11 smithi152 ceph-mon[31188]: pgmap v60: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 45 MiB/s wr, 1.44k op/s 2024-09-11T22:06:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:13 smithi179 ceph-mon[35603]: pgmap v61: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 51 MiB/s wr, 1.86k op/s 2024-09-11T22:06:13.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:13 smithi193 ceph-mon[35545]: pgmap v61: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 51 MiB/s wr, 1.86k op/s 2024-09-11T22:06:13.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:13 smithi152 ceph-mon[31188]: pgmap v61: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 51 MiB/s wr, 1.86k op/s 2024-09-11T22:06:14.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 40.0 s, 6650.1 tps, lat 15.027 ms stddev 16.048 2024-09-11T22:06:15.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:15 smithi179 ceph-mon[35603]: pgmap v62: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 48 MiB/s wr, 1.45k op/s 2024-09-11T22:06:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:15 smithi193 ceph-mon[35545]: pgmap v62: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 48 MiB/s wr, 1.45k op/s 2024-09-11T22:06:15.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:15 smithi152 ceph-mon[31188]: pgmap v62: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 48 MiB/s wr, 1.45k op/s 2024-09-11T22:06:15.987 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.4 2024-09-11T22:06:15.988 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:06:16.413 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.954+0000 7fa5012b7640 1 -- 172.21.15.152:0/4194972166 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4fc11b140 msgr2=0x7fa4fc11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.954+0000 7fa5012b7640 1 --2- 172.21.15.152:0/4194972166 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4fc11b140 0x7fa4fc11d530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa4f401ace0 tx=0x7fa4f403b950 comp rx=0 tx=0).stop 2024-09-11T22:06:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.955+0000 7fa5012b7640 1 -- 172.21.15.152:0/4194972166 shutdown_connections 2024-09-11T22:06:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.955+0000 7fa5012b7640 1 --2- 172.21.15.152:0/4194972166 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4fc11b140 0x7fa4fc11d530 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.955+0000 7fa5012b7640 1 --2- 172.21.15.152:0/4194972166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4fc1095d0 0x7fa4fc109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.955+0000 7fa5012b7640 1 --2- 172.21.15.152:0/4194972166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc1091f0 0x7fa4fc110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.955+0000 7fa5012b7640 1 -- 172.21.15.152:0/4194972166 >> 172.21.15.152:0/4194972166 conn(0x7fa4fc06ce00 msgr2=0x7fa4fc06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.955+0000 7fa5012b7640 1 -- 172.21.15.152:0/4194972166 shutdown_connections 2024-09-11T22:06:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.955+0000 7fa5012b7640 1 -- 172.21.15.152:0/4194972166 wait complete. 2024-09-11T22:06:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.956+0000 7fa5012b7640 1 Processor -- start 2024-09-11T22:06:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.956+0000 7fa5012b7640 1 -- start start 2024-09-11T22:06:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.956+0000 7fa5012b7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4fc1091f0 0x7fa4fc11a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.956+0000 7fa5012b7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc1095d0 0x7fa4fc116800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.956+0000 7fa5012b7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4fc11b140 0x7fa4fc116d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.956+0000 7fa5012b7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc113300 con 0x7fa4fc1095d0 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.956+0000 7fa5012b7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc113180 con 0x7fa4fc1091f0 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.956+0000 7fa5012b7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc113480 con 0x7fa4fc11b140 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.957+0000 7fa4faffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4fc1091f0 0x7fa4fc11a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.957+0000 7fa4faffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4fc1091f0 0x7fa4fc11a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34516/0 (socket says 172.21.15.152:34516) 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.957+0000 7fa4faffd640 1 -- 172.21.15.152:0/1718822626 learned_addr learned my addr 172.21.15.152:0/1718822626 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.957+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc1095d0 0x7fa4fc116800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.957+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4fc11b140 0x7fa4fc116d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.957+0000 7fa4faffd640 1 -- 172.21.15.152:0/1718822626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4fc11b140 msgr2=0x7fa4fc116d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.957+0000 7fa4faffd640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4fc11b140 0x7fa4fc116d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.957+0000 7fa4faffd640 1 -- 172.21.15.152:0/1718822626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc1095d0 msgr2=0x7fa4fc116800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.957+0000 7fa4faffd640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc1095d0 0x7fa4fc116800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.957+0000 7fa4faffd640 1 -- 172.21.15.152:0/1718822626 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc117300 con 0x7fa4fc1091f0 2024-09-11T22:06:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.958+0000 7fa4faffd640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4fc1091f0 0x7fa4fc11a770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00d950 tx=0x7fa4ec00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.958+0000 7fa4e3fff640 1 -- 172.21.15.152:0/1718822626 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec017070 con 0x7fa4fc1091f0 2024-09-11T22:06:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.958+0000 7fa4e3fff640 1 -- 172.21.15.152:0/1718822626 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4ec009c30 con 0x7fa4fc1091f0 2024-09-11T22:06:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.958+0000 7fa4e3fff640 1 -- 172.21.15.152:0/1718822626 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec017070 con 0x7fa4fc1091f0 2024-09-11T22:06:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.958+0000 7fa5012b7640 1 -- 172.21.15.152:0/1718822626 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4fc1175f0 con 0x7fa4fc1091f0 2024-09-11T22:06:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.958+0000 7fa5012b7640 1 -- 172.21.15.152:0/1718822626 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4fc1ab370 con 0x7fa4fc1091f0 2024-09-11T22:06:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.962+0000 7fa504052740 1 Processor -- start 2024-09-11T22:06:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.962+0000 7fa504052740 1 -- start start 2024-09-11T22:06:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.962+0000 7fa504052740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdc5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.962+0000 7fa504052740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc6410 0x55a4fcdd0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.962+0000 7fa504052740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdd30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.962+0000 7fa504052740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a4fcd2a2f0 con 0x55a4fcdc6410 2024-09-11T22:06:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.962+0000 7fa504052740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a4fccd2270 con 0x55a4fcdd0cb0 2024-09-11T22:06:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.962+0000 7fa504052740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a4fcd262b0 con 0x55a4fcdc5af0 2024-09-11T22:06:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.963+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdc5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.963+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdc5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50442/0 (socket says 172.21.15.152:50442) 2024-09-11T22:06:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.963+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/2058358370 learned_addr learned my addr 172.21.15.152:0/2058358370 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.963+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/2058358370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdd30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.963+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/2058358370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdd0cb0 msgr2=0x55a4fcdd30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.963+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/2058358370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdd30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.963+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/2058358370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc6410 msgr2=0x55a4fcdd0770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:06:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.963+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/2058358370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc6410 0x55a4fcdd0770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.963+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/2058358370 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4fccd1340 con 0x55a4fcdc5af0 2024-09-11T22:06:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.963+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/2058358370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdd30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:06:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.964+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/2058358370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdc5ed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4046000 tx=0x7fa4f40405a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11a0312e11791507 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.964+0000 7fa4e17fa640 1 -- 172.21.15.152:0/2058358370 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4045070 con 0x55a4fcdc5af0 2024-09-11T22:06:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.964+0000 7fa4e17fa640 1 -- 172.21.15.152:0/2058358370 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4f4003e50 con 0x55a4fcdc5af0 2024-09-11T22:06:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.964+0000 7fa4e17fa640 1 -- 172.21.15.152:0/2058358370 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4041990 con 0x55a4fcdc5af0 2024-09-11T22:06:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.964+0000 7fa4e3fff640 1 -- 172.21.15.152:0/1718822626 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa4ec010460 con 0x7fa4fc1091f0 2024-09-11T22:06:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.965+0000 7fa4e3fff640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4e40a3250 0x7fa4e40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.965+0000 7fa504052740 1 -- 172.21.15.152:0/2058358370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc5af0 msgr2=0x55a4fcdc5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.965+0000 7fa504052740 1 --2- 172.21.15.152:0/2058358370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdc5ed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4046000 tx=0x7fa4f40405a0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.965+0000 7fa4e3fff640 1 -- 172.21.15.152:0/1718822626 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa4ec009a30 con 0x7fa4fc1091f0 2024-09-11T22:06:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.965+0000 7fa504052740 1 -- 172.21.15.152:0/2058358370 shutdown_connections 2024-09-11T22:06:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.965+0000 7fa504052740 1 --2- 172.21.15.152:0/2058358370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdd30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.965+0000 7fa504052740 1 --2- 172.21.15.152:0/2058358370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc6410 0x55a4fcdd0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.965+0000 7fa504052740 1 --2- 172.21.15.152:0/2058358370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdc5ed0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.965+0000 7fa504052740 1 -- 172.21.15.152:0/2058358370 >> 172.21.15.152:0/2058358370 conn(0x55a4fcdc2060 msgr2=0x55a4fcdc2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.966+0000 7fa504052740 1 -- 172.21.15.152:0/2058358370 shutdown_connections 2024-09-11T22:06:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.966+0000 7fa4faffd640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4e40a3250 0x7fa4e40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.966+0000 7fa504052740 1 -- 172.21.15.152:0/2058358370 wait complete. 2024-09-11T22:06:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.966+0000 7fa504052740 1 -- start start 2024-09-11T22:06:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.966+0000 7fa504052740 1 Processor -- start 2024-09-11T22:06:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.967+0000 7fa4faffd640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4e40a3250 0x7fa4e40a5710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55a4fcdc2ec0 tx=0x7fa4ec00dfd0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.967+0000 7fa504052740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdcdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.967+0000 7fa504052740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 0x55a4fcdce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.967+0000 7fa504052740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.967+0000 7fa504052740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a4fcdd3880 con 0x55a4fcdc5af0 2024-09-11T22:06:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.967+0000 7fa504052740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a4fccb3290 con 0x55a4fcdc6410 2024-09-11T22:06:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.967+0000 7fa504052740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a4fcdd3a00 con 0x55a4fcdd0cb0 2024-09-11T22:06:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.967+0000 7fa504052740 10 client.0 _ll_register_callbacks cb 0x55a4fcce4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.967+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdcdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.967+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdcdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42684/0 (socket says 172.21.15.152:42684) 2024-09-11T22:06:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.967+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/1911047009 learned_addr learned my addr 172.21.15.152:0/1911047009 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.968+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.968+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 0x55a4fcdce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.968+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/1911047009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdd0cb0 msgr2=0x55a4fcdce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.968+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.968+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/1911047009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 msgr2=0x55a4fcdce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.968+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 0x55a4fcdce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.968+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/1911047009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4fca3d210 con 0x55a4fcdc5af0 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.968+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdcdbb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa4f401ac00 tx=0x7fa4f4040f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201106557b29f7c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.969+0000 7fa4deff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.969+0000 7fa4deff5640 1 -- 172.21.15.152:0/1911047009 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4045050 con 0x55a4fcdc5af0 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.969+0000 7fa504052740 1 -- 172.21.15.152:0/1911047009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4f4003e50 con 0x55a4fcdc5af0 2024-09-11T22:06:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.969+0000 7fa4deff5640 1 -- 172.21.15.152:0/1911047009 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa4f4019040 con 0x55a4fcdc5af0 2024-09-11T22:06:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.969+0000 7fa4deff5640 1 -- 172.21.15.152:0/1911047009 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa4f406a050 con 0x55a4fcdc5af0 2024-09-11T22:06:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.970+0000 7fa504052740 10 client.15822 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.970+0000 7fa504052740 1 -- 172.21.15.152:0/1911047009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a4fcb09620 con 0x55a4fcdc5af0 2024-09-11T22:06:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.970+0000 7fa4deff5640 1 -- 172.21.15.152:0/1911047009 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4f4004000 con 0x55a4fcdc5af0 2024-09-11T22:06:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.970+0000 7fa4deff5640 1 -- 172.21.15.152:0/1911047009 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fa4f4053020 con 0x55a4fcdc5af0 2024-09-11T22:06:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.971+0000 7fa504052740 10 client.15822 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.971+0000 7fa504052740 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.971+0000 7fa504052740 20 client.15822 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.971+0000 7fa504052740 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a4fcde0bc0 0x55a4fcde3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.971+0000 7fa504052740 4 client.15822 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.971+0000 7fa504052740 1 -- 172.21.15.152:0/1911047009 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa4f4003e50 con 0x55a4fcde0bc0 2024-09-11T22:06:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.971+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a4fcde0bc0 0x55a4fcde3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.972+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a4fcde0bc0 0x55a4fcde3000 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c24c300f26a0e920 server_cookie=c20cb6e399469fcc in_seq=0 out_seq=0 2024-09-11T22:06:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.972+0000 7fa4deff5640 10 client.15822 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.973+0000 7fa4deff5640 1 -- 172.21.15.152:0/1911047009 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa4f4003e50 con 0x55a4fcde0bc0 2024-09-11T22:06:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.973+0000 7fa4deff5640 10 client.15822 handle_command_reply: tid=0 2024-09-11T22:06:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.973+0000 7fa504052740 1 client.15822 shutdown 2024-09-11T22:06:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa504052740 1 -- 172.21.15.152:0/1911047009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 msgr2=0x55a4fcdcdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa504052740 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdcdbb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa4f401ac00 tx=0x7fa4f4040f00 comp rx=0 tx=0).stop 2024-09-11T22:06:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa504052740 1 -- 172.21.15.152:0/1911047009 shutdown_connections 2024-09-11T22:06:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa504052740 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a4fcde0bc0 0x55a4fcde3000 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa504052740 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa504052740 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 0x55a4fcdce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa504052740 1 --2- 172.21.15.152:0/1911047009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdcdbb0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa504052740 1 -- 172.21.15.152:0/1911047009 >> 172.21.15.152:0/1911047009 conn(0x55a4fcdc2060 msgr2=0x55a4fcdc7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa4deff5640 0 client.15822 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa504052740 1 -- 172.21.15.152:0/1911047009 shutdown_connections 2024-09-11T22:06:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa504052740 1 -- 172.21.15.152:0/1911047009 wait complete. 2024-09-11T22:06:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:16.974+0000 7fa504052740 20 client.15822 trim_cache size 0 max 16384 2024-09-11T22:06:16.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.976+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/264154320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dc8101500 msgr2=0x7f3dc8101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:16.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.976+0000 7f3dcd9c0640 1 --2- 172.21.15.152:0/264154320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dc8101500 0x7f3dc8101960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009900 tx=0x7f3db802a3f0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.980+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/264154320 shutdown_connections 2024-09-11T22:06:16.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.980+0000 7f3dcd9c0640 1 --2- 172.21.15.152:0/264154320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc8101ea0 0x7f3dc810d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.980+0000 7f3dcd9c0640 1 --2- 172.21.15.152:0/264154320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dc8101500 0x7f3dc8101960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.980+0000 7f3dcd9c0640 1 --2- 172.21.15.152:0/264154320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dc8106be0 0x7f3dc8106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.980+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/264154320 >> 172.21.15.152:0/264154320 conn(0x7f3dc80fba90 msgr2=0x7f3dc80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.980+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/264154320 shutdown_connections 2024-09-11T22:06:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.980+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/264154320 wait complete. 2024-09-11T22:06:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.981+0000 7f3dcd9c0640 1 Processor -- start 2024-09-11T22:06:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.982+0000 7f3dcd9c0640 1 -- start start 2024-09-11T22:06:16.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.982+0000 7f3dcd9c0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dc8101500 0x7f3dc81974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.982+0000 7f3dcd9c0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc8101ea0 0x7f3dc81979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.982+0000 7f3dcd9c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dc8106be0 0x7f3dc819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.983+0000 7f3dc6ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dc8101500 0x7f3dc81974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.983+0000 7f3dc6ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dc8101500 0x7f3dc81974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50470/0 (socket says 172.21.15.152:50470) 2024-09-11T22:06:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.983+0000 7f3dc6ffd640 1 -- 172.21.15.152:0/3353508899 learned_addr learned my addr 172.21.15.152:0/3353508899 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.983+0000 7f3dc67fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc8101ea0 0x7f3dc81979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.983+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc8110fa0 con 0x7f3dc8106be0 2024-09-11T22:06:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.983+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc8110e20 con 0x7f3dc8101ea0 2024-09-11T22:06:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.983+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc8111120 con 0x7f3dc8101500 2024-09-11T22:06:16.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.984+0000 7f3dc6ffd640 1 -- 172.21.15.152:0/3353508899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc8101ea0 msgr2=0x7f3dc81979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:16.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.984+0000 7f3dc6ffd640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc8101ea0 0x7f3dc81979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.984+0000 7f3dc6ffd640 1 -- 172.21.15.152:0/3353508899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dc8106be0 msgr2=0x7f3dc819bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.984+0000 7f3dc6ffd640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dc8106be0 0x7f3dc819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.984+0000 7f3dc6ffd640 1 -- 172.21.15.152:0/3353508899 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc819c450 con 0x7f3dc8101500 2024-09-11T22:06:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.984+0000 7f3dc6ffd640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dc8101500 0x7f3dc81974a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00e9f0 tx=0x7f3dbc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.984+0000 7f3dcc9be640 1 -- 172.21.15.152:0/3353508899 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00cd80 con 0x7f3dc8101500 2024-09-11T22:06:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.984+0000 7f3dcc9be640 1 -- 172.21.15.152:0/3353508899 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dbc010910 con 0x7f3dc8101500 2024-09-11T22:06:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.984+0000 7f3dcc9be640 1 -- 172.21.15.152:0/3353508899 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0188b0 con 0x7f3dc8101500 2024-09-11T22:06:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.985+0000 7f3dc67fc640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc8101ea0 0x7f3dc81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:06:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.985+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc819c740 con 0x7f3dc8101500 2024-09-11T22:06:16.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.985+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc81003f0 con 0x7f3dc8101500 2024-09-11T22:06:16.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.989+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc8100070 con 0x7f3dc8101500 2024-09-11T22:06:16.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.989+0000 7f3dcc9be640 1 -- 172.21.15.152:0/3353508899 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3dbc010ac0 con 0x7f3dc8101500 2024-09-11T22:06:16.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.990+0000 7f3dcc9be640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db00a4f80 0x7f3db00a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:16.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.990+0000 7f3dcc9be640 1 -- 172.21.15.152:0/3353508899 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3dbc0cf810 con 0x7f3dc8101500 2024-09-11T22:06:16.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.991+0000 7f3dc67fc640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db00a4f80 0x7f3db00a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:16.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.994+0000 7f3dc67fc640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db00a4f80 0x7f3db00a7440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3db8005ab0 tx=0x7f3db8000bc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:16.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:16.996+0000 7f3dcc9be640 1 -- 172.21.15.152:0/3353508899 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3dbc09c400 con 0x7f3dc8101500 2024-09-11T22:06:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.003+0000 7fa504052740 1 Processor -- start 2024-09-11T22:06:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.003+0000 7fa504052740 1 -- start start 2024-09-11T22:06:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.003+0000 7fa504052740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa504052740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 0x55a4fcdcfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa504052740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcde8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa4fa7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 0x55a4fcdcfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa4fa7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 0x55a4fcdcfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34588/0 (socket says 172.21.15.152:34588) 2024-09-11T22:06:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa504052740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8011210 con 0x55a4fcdc5af0 2024-09-11T22:06:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa504052740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e800eab0 con 0x55a4fcdc6410 2024-09-11T22:06:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa504052740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e800c900 con 0x55a4fcdd0cb0 2024-09-11T22:06:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdce4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42710/0 (socket says 172.21.15.152:42710) 2024-09-11T22:06:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/2418597829 learned_addr learned my addr 172.21.15.152:0/2418597829 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/2418597829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcde8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa4fa7fc640 1 -- 172.21.15.152:0/2418597829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdd0cb0 msgr2=0x55a4fcde8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/2418597829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcde8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa4fa7fc640 1 -- 172.21.15.152:0/2418597829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 msgr2=0x55a4fcdce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/2418597829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.004+0000 7fa4fa7fc640 1 -- 172.21.15.152:0/2418597829 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4fcdbd2d0 con 0x55a4fcdc6410 2024-09-11T22:06:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.005+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/2418597829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 0x55a4fcdcfb20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55a4fcdc8690 tx=0x7fa4f000a2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b313439a1f2c1d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.005+0000 7fa4e0ff9640 1 -- 172.21.15.152:0/2418597829 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00140d0 con 0x55a4fcdc6410 2024-09-11T22:06:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.005+0000 7fa4e0ff9640 1 -- 172.21.15.152:0/2418597829 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4f0014270 con 0x55a4fcdc6410 2024-09-11T22:06:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.005+0000 7fa4e0ff9640 1 -- 172.21.15.152:0/2418597829 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0012840 con 0x55a4fcdc6410 2024-09-11T22:06:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.006+0000 7fa504052740 1 -- 172.21.15.152:0/2418597829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 msgr2=0x55a4fcdcfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.006+0000 7fa504052740 1 --2- 172.21.15.152:0/2418597829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 0x55a4fcdcfb20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55a4fcdc8690 tx=0x7fa4f000a2d0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.006+0000 7fa504052740 1 -- 172.21.15.152:0/2418597829 shutdown_connections 2024-09-11T22:06:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.006+0000 7fa504052740 1 --2- 172.21.15.152:0/2418597829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcde8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.006+0000 7fa504052740 1 --2- 172.21.15.152:0/2418597829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdc6410 0x55a4fcdcfb20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.007+0000 7fa504052740 1 --2- 172.21.15.152:0/2418597829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.007+0000 7fa504052740 1 -- 172.21.15.152:0/2418597829 >> 172.21.15.152:0/2418597829 conn(0x55a4fcdc2060 msgr2=0x55a4fcdcf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.007+0000 7fa504052740 1 -- 172.21.15.152:0/2418597829 shutdown_connections 2024-09-11T22:06:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.007+0000 7fa504052740 1 -- 172.21.15.152:0/2418597829 wait complete. 2024-09-11T22:06:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.008+0000 7fa504052740 1 -- start start 2024-09-11T22:06:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.008+0000 7fa504052740 1 Processor -- start 2024-09-11T22:06:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.008+0000 7fa504052740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdd8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.009+0000 7fa504052740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc6410 0x55a4fcdd9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.009+0000 7fa504052740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.009+0000 7fa504052740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e800cf70 con 0x55a4fcdc5af0 2024-09-11T22:06:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.009+0000 7fa504052740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e800e3e0 con 0x55a4fcdd0cb0 2024-09-11T22:06:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.009+0000 7fa504052740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e800d640 con 0x55a4fcdc6410 2024-09-11T22:06:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.009+0000 7fa504052740 10 client.0 _ll_register_callbacks cb 0x7fa4f40404f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.009+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdd8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.009+0000 7fa4fa7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc6410 0x55a4fcdd9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.009+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdd8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42714/0 (socket says 172.21.15.152:42714) 2024-09-11T22:06:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.009+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/3334001913 learned_addr learned my addr 172.21.15.152:0/3334001913 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.009+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.010+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/3334001913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc6410 msgr2=0x55a4fcdd9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.010+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc6410 0x55a4fcdd9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.010+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/3334001913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdd0cb0 msgr2=0x55a4fcdca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.010+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.010+0000 7fa4fb7fe640 1 -- 172.21.15.152:0/3334001913 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4fcdca8b0 con 0x55a4fcdc5af0 2024-09-11T22:06:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.010+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc6410 0x55a4fcdd9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.010+0000 7fa4fb7fe640 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdd8d20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4003d90 tx=0x7fa4f4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9cbcfc3a07abbe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.010+0000 7fa4deff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:06:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.014+0000 7fa4deff5640 1 -- 172.21.15.152:0/3334001913 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4045070 con 0x55a4fcdc5af0 2024-09-11T22:06:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.014+0000 7fa4deff5640 1 -- 172.21.15.152:0/3334001913 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa4f4019040 con 0x55a4fcdc5af0 2024-09-11T22:06:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.014+0000 7fa504052740 1 -- 172.21.15.152:0/3334001913 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4f0014270 con 0x55a4fcdc5af0 2024-09-11T22:06:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.019+0000 7fa4deff5640 1 -- 172.21.15.152:0/3334001913 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa4f4055670 con 0x55a4fcdc5af0 2024-09-11T22:06:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.020+0000 7fa504052740 10 client.15831 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.020+0000 7fa504052740 1 -- 172.21.15.152:0/3334001913 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a4fce4b230 con 0x55a4fcdc5af0 2024-09-11T22:06:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.022+0000 7fa4deff5640 1 -- 172.21.15.152:0/3334001913 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4f4055cf0 con 0x55a4fcdc5af0 2024-09-11T22:06:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.022+0000 7fa4deff5640 1 -- 172.21.15.152:0/3334001913 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fa4f4053040 con 0x55a4fcdc5af0 2024-09-11T22:06:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.022+0000 7fa504052740 10 client.15831 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.022+0000 7fa504052740 10 client.15831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.022+0000 7fa504052740 20 client.15831 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.022+0000 7fa504052740 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a4fce4b770 0x55a4fce4db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.023+0000 7fa504052740 4 client.15831 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:06:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.023+0000 7fa504052740 1 -- 172.21.15.152:0/3334001913 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fa4f0014270 con 0x55a4fce4b770 2024-09-11T22:06:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.024+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a4fce4b770 0x55a4fce4db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:17.026 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.026+0000 7fa4fa7fc640 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a4fce4b770 0x55a4fce4db90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=646504a1b693aa68 server_cookie=4a7ebe78e41c4cfd in_seq=0 out_seq=0 2024-09-11T22:06:17.027 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.026+0000 7fa4deff5640 10 client.15831 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.032+0000 7fa4deff5640 1 -- 172.21.15.152:0/3334001913 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fa4f0014270 con 0x55a4fce4b770 2024-09-11T22:06:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.032+0000 7fa4deff5640 10 client.15831 handle_command_reply: tid=0 2024-09-11T22:06:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.032+0000 7fa504052740 1 client.15831 shutdown 2024-09-11T22:06:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.033+0000 7fa504052740 1 -- 172.21.15.152:0/3334001913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 msgr2=0x55a4fcdd8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.033+0000 7fa504052740 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdd8d20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4003d90 tx=0x7fa4f4005fd0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.033+0000 7fa504052740 1 -- 172.21.15.152:0/3334001913 shutdown_connections 2024-09-11T22:06:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.033+0000 7fa504052740 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a4fce4b770 0x55a4fce4db90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.034+0000 7fa4deff5640 0 client.15831 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.034+0000 7fa504052740 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4fcdd0cb0 0x55a4fcdca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.034+0000 7fa504052740 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4fcdc6410 0x55a4fcdd9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.034+0000 7fa504052740 1 --2- 172.21.15.152:0/3334001913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a4fcdc5af0 0x55a4fcdd8d20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.034+0000 7fa504052740 1 -- 172.21.15.152:0/3334001913 >> 172.21.15.152:0/3334001913 conn(0x55a4fcdc2060 msgr2=0x55a4fcdcc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.035+0000 7fa504052740 1 -- 172.21.15.152:0/3334001913 shutdown_connections 2024-09-11T22:06:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.035+0000 7fa504052740 1 -- 172.21.15.152:0/3334001913 wait complete. 2024-09-11T22:06:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.035+0000 7fa504052740 20 client.15831 trim_cache size 0 max 16384 2024-09-11T22:06:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:06:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:06:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:06:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:06:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.037+0000 7fa5012b7640 1 -- 172.21.15.152:0/1718822626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4e40a3250 msgr2=0x7fa4e40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.037+0000 7fa5012b7640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4e40a3250 0x7fa4e40a5710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55a4fcdc2ec0 tx=0x7fa4ec00dfd0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.037+0000 7fa5012b7640 1 -- 172.21.15.152:0/1718822626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4fc1091f0 msgr2=0x7fa4fc11a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.037+0000 7fa5012b7640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4fc1091f0 0x7fa4fc11a770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00d950 tx=0x7fa4ec00de10 comp rx=0 tx=0).stop 2024-09-11T22:06:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.038+0000 7fa5012b7640 1 -- 172.21.15.152:0/1718822626 shutdown_connections 2024-09-11T22:06:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.038+0000 7fa5012b7640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4e40a3250 0x7fa4e40a5710 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.039+0000 7fa5012b7640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4fc11b140 0x7fa4fc116d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.039+0000 7fa5012b7640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc1095d0 0x7fa4fc116800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.039+0000 7fa5012b7640 1 --2- 172.21.15.152:0/1718822626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4fc1091f0 0x7fa4fc11a770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.039+0000 7fa5012b7640 1 -- 172.21.15.152:0/1718822626 >> 172.21.15.152:0/1718822626 conn(0x7fa4fc06ce00 msgr2=0x7fa4fc0707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.039+0000 7fa5012b7640 1 -- 172.21.15.152:0/1718822626 shutdown_connections 2024-09-11T22:06:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:17.039+0000 7fa5012b7640 1 -- 172.21.15.152:0/1718822626 wait complete. 2024-09-11T22:06:17.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.383+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dc8101960 con 0x7f3dc8101500 2024-09-11T22:06:17.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.385+0000 7f3dcc9be640 1 -- 172.21.15.152:0/3353508899 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11927 (secure 0 0 0) 0x7f3dbc09c400 con 0x7f3dc8101500 2024-09-11T22:06:17.386 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:06:17.386 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":27,"btime":"2024-09-11T22:04:54:476799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:53.804306+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:06:17.386 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 27 2024-09-11T22:06:17.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.388+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db00a4f80 msgr2=0x7f3db00a7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:17.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.388+0000 7f3dcd9c0640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db00a4f80 0x7f3db00a7440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3db8005ab0 tx=0x7f3db8000bc0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.388+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dc8101500 msgr2=0x7f3dc81974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:17.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.388+0000 7f3dcd9c0640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dc8101500 0x7f3dc81974a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00e9f0 tx=0x7f3dbc00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.389+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 shutdown_connections 2024-09-11T22:06:17.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.389+0000 7f3dcd9c0640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db00a4f80 0x7f3db00a7440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.389+0000 7f3dcd9c0640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dc8106be0 0x7f3dc819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.389+0000 7f3dcd9c0640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc8101ea0 0x7f3dc81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.389+0000 7f3dcd9c0640 1 --2- 172.21.15.152:0/3353508899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dc8101500 0x7f3dc81974a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:17.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.389+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 >> 172.21.15.152:0/3353508899 conn(0x7f3dc80fba90 msgr2=0x7f3dc80fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:17.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.389+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 shutdown_connections 2024-09-11T22:06:17.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:17.390+0000 7f3dcd9c0640 1 -- 172.21.15.152:0/3353508899 wait complete. 2024-09-11T22:06:17.641 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:17 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3353508899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:06:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:17 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3353508899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:06:17.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:17 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3353508899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:06:18.104 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0' 2024-09-11T22:06:18.104 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0 2024-09-11T22:06:18.552 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:18.719 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:18 smithi152 ceph-mon[31188]: pgmap v63: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 48 MiB/s wr, 1.45k op/s 2024-09-11T22:06:18.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:18 smithi179 ceph-mon[35603]: pgmap v63: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 48 MiB/s wr, 1.45k op/s 2024-09-11T22:06:18.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:18 smithi193 ceph-mon[35545]: pgmap v63: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 48 MiB/s wr, 1.45k op/s 2024-09-11T22:06:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.187+0000 7f04da15e640 1 -- 172.21.15.152:0/4245043522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04d4101df0 msgr2=0x7f04d41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.187+0000 7f04da15e640 1 --2- 172.21.15.152:0/4245043522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04d4101df0 0x7f04d41021d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009900 tx=0x7f04c402a410 comp rx=0 tx=0).stop 2024-09-11T22:06:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.187+0000 7f04da15e640 1 -- 172.21.15.152:0/4245043522 shutdown_connections 2024-09-11T22:06:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.187+0000 7f04da15e640 1 --2- 172.21.15.152:0/4245043522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d4106f20 0x7f04d410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.187+0000 7f04da15e640 1 --2- 172.21.15.152:0/4245043522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d41027a0 0x7f04d41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.187+0000 7f04da15e640 1 --2- 172.21.15.152:0/4245043522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04d4101df0 0x7f04d41021d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.187+0000 7f04da15e640 1 -- 172.21.15.152:0/4245043522 >> 172.21.15.152:0/4245043522 conn(0x7f04d40fd8f0 msgr2=0x7f04d40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:19.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.187+0000 7f04da15e640 1 -- 172.21.15.152:0/4245043522 shutdown_connections 2024-09-11T22:06:19.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.187+0000 7f04da15e640 1 -- 172.21.15.152:0/4245043522 wait complete. 2024-09-11T22:06:19.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.188+0000 7f04da15e640 1 Processor -- start 2024-09-11T22:06:19.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.188+0000 7f04da15e640 1 -- start start 2024-09-11T22:06:19.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04da15e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04d4101df0 0x7f04d410b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04da15e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d41027a0 0x7f04d410ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04da15e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d4106f20 0x7f04d41a4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04da15e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04d4075830 con 0x7f04d4101df0 2024-09-11T22:06:19.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04da15e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f04d40756b0 con 0x7f04d41027a0 2024-09-11T22:06:19.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04da15e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04d40759b0 con 0x7f04d4106f20 2024-09-11T22:06:19.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d41027a0 0x7f04d410ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d4106f20 0x7f04d41a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d4106f20 0x7f04d41a4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50516/0 (socket says 172.21.15.152:50516) 2024-09-11T22:06:19.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d41027a0 0x7f04d410ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34608/0 (socket says 172.21.15.152:34608) 2024-09-11T22:06:19.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04d3fff640 1 -- 172.21.15.152:0/1849176871 learned_addr learned my addr 172.21.15.152:0/1849176871 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:19.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04d37fe640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04d4101df0 0x7f04d410b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04cbfff640 1 -- 172.21.15.152:0/1849176871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d4106f20 msgr2=0x7f04d41a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:19.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04cbfff640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d4106f20 0x7f04d41a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04cbfff640 1 -- 172.21.15.152:0/1849176871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04d4101df0 msgr2=0x7f04d410b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:19.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04cbfff640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04d4101df0 0x7f04d410b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.189+0000 7f04cbfff640 1 -- 172.21.15.152:0/1849176871 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d41a4c20 con 0x7f04d41027a0 2024-09-11T22:06:19.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.190+0000 7f04d3fff640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d4106f20 0x7f04d41a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:19.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.190+0000 7f04d37fe640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04d4101df0 0x7f04d410b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:19.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.190+0000 7f04cbfff640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d41027a0 0x7f04d410ba60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00e9f0 tx=0x7f04bc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:19.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.190+0000 7f04d17fa640 1 -- 172.21.15.152:0/1849176871 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00cd80 con 0x7f04d41027a0 2024-09-11T22:06:19.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.190+0000 7f04d17fa640 1 -- 172.21.15.152:0/1849176871 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04bc0035f0 con 0x7f04d41027a0 2024-09-11T22:06:19.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.190+0000 7f04d17fa640 1 -- 172.21.15.152:0/1849176871 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc010690 con 0x7f04d41027a0 2024-09-11T22:06:19.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.190+0000 7f04da15e640 1 -- 172.21.15.152:0/1849176871 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d41a4f10 con 0x7f04d41027a0 2024-09-11T22:06:19.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.191+0000 7f04da15e640 1 -- 172.21.15.152:0/1849176871 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d406dc20 con 0x7f04d41027a0 2024-09-11T22:06:19.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.194+0000 7f04d17fa640 1 -- 172.21.15.152:0/1849176871 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f04bc010830 con 0x7f04d41027a0 2024-09-11T22:06:19.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.196+0000 7f04dc537740 1 Processor -- start 2024-09-11T22:06:19.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.196+0000 7f04d17fa640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04b40a2e40 0x7f04b40a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.196+0000 7f04d17fa640 1 -- 172.21.15.152:0/1849176871 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f04bc0cf610 con 0x7f04d41027a0 2024-09-11T22:06:19.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04dc537740 1 -- start start 2024-09-11T22:06:19.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04dc537740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 0x565418168b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04dc537740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 0x565418173400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04d3fff640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04b40a2e40 0x7f04b40a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04dc537740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x565418175d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04dc537740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5654180ce2a0 con 0x565418168760 2024-09-11T22:06:19.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04dc537740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x565418075b10 con 0x565418169080 2024-09-11T22:06:19.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04dc537740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5654180ca260 con 0x565418173940 2024-09-11T22:06:19.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 0x565418173400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04d37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 0x565418168b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 0x565418173400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34618/0 (socket says 172.21.15.152:34618) 2024-09-11T22:06:19.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04cbfff640 1 -- 172.21.15.152:0/3101065968 learned_addr learned my addr 172.21.15.152:0/3101065968 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:19.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.197+0000 7f04d3fff640 1 --2- 172.21.15.152:0/3101065968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x565418175d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.198+0000 7f04cbfff640 1 -- 172.21.15.152:0/3101065968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 msgr2=0x565418175d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:19.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.198+0000 7f04cbfff640 1 --2- 172.21.15.152:0/3101065968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x565418175d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.198+0000 7f04cbfff640 1 -- 172.21.15.152:0/3101065968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 msgr2=0x565418168b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:19.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.198+0000 7f04cbfff640 1 --2- 172.21.15.152:0/3101065968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 0x565418168b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.198+0000 7f04cbfff640 1 -- 172.21.15.152:0/3101065968 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565417e3fb90 con 0x565418169080 2024-09-11T22:06:19.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.198+0000 7f04d3fff640 1 --2- 172.21.15.152:0/3101065968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x565418175d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:06:19.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.198+0000 7f04cbfff640 1 --2- 172.21.15.152:0/3101065968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 0x565418173400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0984d0 tx=0x7f04bc097ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd4f595c13ad9dbd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:19.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.198+0000 7f04d3fff640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04b40a2e40 0x7f04b40a5300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0049d0 tx=0x7f04cc00fc70 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:19.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.198+0000 7f04c9ffb640 1 -- 172.21.15.152:0/3101065968 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc09feb0 con 0x565418169080 2024-09-11T22:06:19.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.198+0000 7f04c9ffb640 1 -- 172.21.15.152:0/3101065968 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04bc0a4770 con 0x565418169080 2024-09-11T22:06:19.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.198+0000 7f04c9ffb640 1 -- 172.21.15.152:0/3101065968 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0a4540 con 0x565418169080 2024-09-11T22:06:19.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.199+0000 7f04dc537740 1 -- 172.21.15.152:0/3101065968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 msgr2=0x565418173400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:19.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.199+0000 7f04dc537740 1 --2- 172.21.15.152:0/3101065968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 0x565418173400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0984d0 tx=0x7f04bc097ed0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.200+0000 7f04dc537740 1 -- 172.21.15.152:0/3101065968 shutdown_connections 2024-09-11T22:06:19.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.200+0000 7f04dc537740 1 --2- 172.21.15.152:0/3101065968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x565418175d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.200+0000 7f04dc537740 1 --2- 172.21.15.152:0/3101065968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 0x565418173400 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.200+0000 7f04dc537740 1 --2- 172.21.15.152:0/3101065968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 0x565418168b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.200+0000 7f04dc537740 1 -- 172.21.15.152:0/3101065968 >> 172.21.15.152:0/3101065968 conn(0x565418164cf0 msgr2=0x5654181650d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:19.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.200+0000 7f04dc537740 1 -- 172.21.15.152:0/3101065968 shutdown_connections 2024-09-11T22:06:19.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.200+0000 7f04dc537740 1 -- 172.21.15.152:0/3101065968 wait complete. 2024-09-11T22:06:19.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.201+0000 7f04dc537740 1 -- start start 2024-09-11T22:06:19.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.201+0000 7f04dc537740 1 Processor -- start 2024-09-11T22:06:19.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.202+0000 7f04dc537740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x565418170950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.202+0000 7f04dc537740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418169080 0x565418170e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.202+0000 7f04dc537740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x5654181713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.202+0000 7f04dc537740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x565418176510 con 0x565418169080 2024-09-11T22:06:19.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.202+0000 7f04dc537740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5654180566e0 con 0x565418168760 2024-09-11T22:06:19.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.202+0000 7f04dc537740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x565418176690 con 0x565418173940 2024-09-11T22:06:19.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.202+0000 7f04dc537740 10 client.0 _ll_register_callbacks cb 0x56541807aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:19.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.202+0000 7f04d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x565418170950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.202+0000 7f04d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x565418170950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34626/0 (socket says 172.21.15.152:34626) 2024-09-11T22:06:19.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.202+0000 7f04d37fe640 1 -- 172.21.15.152:0/2835146767 learned_addr learned my addr 172.21.15.152:0/2835146767 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:19.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.202+0000 7f04d3fff640 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x5654181713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.203+0000 7f04cbfff640 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418169080 0x565418170e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.203+0000 7f04d37fe640 1 -- 172.21.15.152:0/2835146767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 msgr2=0x5654181713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:19.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.203+0000 7f04d37fe640 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x5654181713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.203+0000 7f04d37fe640 1 -- 172.21.15.152:0/2835146767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418169080 msgr2=0x565418170e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:19.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.203+0000 7f04d37fe640 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418169080 0x565418170e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.203+0000 7f04d37fe640 1 -- 172.21.15.152:0/2835146767 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56541817fb30 con 0x565418168760 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.203+0000 7f04cbfff640 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418169080 0x565418170e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.203+0000 7f04d37fe640 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x565418170950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009900 tx=0x7f04c4009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16e3397b64192954 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.203+0000 7f04c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04c2ffd640 1 -- 172.21.15.152:0/2835146767 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4035040 con 0x565418168760 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04dc537740 1 -- 172.21.15.152:0/2835146767 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04bc0a4770 con 0x565418168760 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04c2ffd640 1 -- 172.21.15.152:0/2835146767 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f04c4004b70 con 0x565418168760 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04c2ffd640 1 -- 172.21.15.152:0/2835146767 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f04c4005d50 con 0x565418168760 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04dc537740 10 client.25334 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04dc537740 1 -- 172.21.15.152:0/2835146767 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x565418182410 con 0x565418168760 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04c2ffd640 1 -- 172.21.15.152:0/2835146767 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04bc0a4770 con 0x565418168760 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04c2ffd640 1 -- 172.21.15.152:0/2835146767 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f04c4066070 con 0x565418168760 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04dc537740 10 client.25334 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:19.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04dc537740 10 client.25334 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:06:19.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04dc537740 20 client.25334 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:19.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04dc537740 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565418183d30 0x5654181861d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04dc537740 4 client.25334 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:19.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.204+0000 7f04dc537740 1 -- 172.21.15.152:0/2835146767 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654180db9d0 con 0x565418183d30 2024-09-11T22:06:19.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.205+0000 7f04cbfff640 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565418183d30 0x5654181861d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.206+0000 7f04cbfff640 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565418183d30 0x5654181861d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0d8538111468d00 server_cookie=4fa10ee9ef3165eb in_seq=0 out_seq=0 2024-09-11T22:06:19.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.206+0000 7f04c2ffd640 10 client.25334 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:19.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.207+0000 7f04c2ffd640 1 -- 172.21.15.152:0/2835146767 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654180db9d0 con 0x565418183d30 2024-09-11T22:06:19.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.207+0000 7f04c2ffd640 10 client.25334 handle_command_reply: tid=0 2024-09-11T22:06:19.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.207+0000 7f04dc537740 1 client.25334 shutdown 2024-09-11T22:06:19.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04dc537740 1 -- 172.21.15.152:0/2835146767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 msgr2=0x565418170950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:19.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04dc537740 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x565418170950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009900 tx=0x7f04c4009620 comp rx=0 tx=0).stop 2024-09-11T22:06:19.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04dc537740 1 -- 172.21.15.152:0/2835146767 shutdown_connections 2024-09-11T22:06:19.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04dc537740 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565418183d30 0x5654181861d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04dc537740 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x5654181713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04dc537740 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418169080 0x565418170e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04dc537740 1 --2- 172.21.15.152:0/2835146767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x565418170950 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04dc537740 1 -- 172.21.15.152:0/2835146767 >> 172.21.15.152:0/2835146767 conn(0x565418164cf0 msgr2=0x565418163e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:19.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04c2ffd640 0 client.25334 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:19.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04dc537740 1 -- 172.21.15.152:0/2835146767 shutdown_connections 2024-09-11T22:06:19.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04dc537740 1 -- 172.21.15.152:0/2835146767 wait complete. 2024-09-11T22:06:19.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.208+0000 7f04dc537740 20 client.25334 trim_cache size 0 max 16384 2024-09-11T22:06:19.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.234+0000 7f04dc537740 1 Processor -- start 2024-09-11T22:06:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.234+0000 7f04dc537740 1 -- start start 2024-09-11T22:06:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.234+0000 7f04dc537740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x56541816f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.234+0000 7f04dc537740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418169080 0x56541818baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.234+0000 7f04dc537740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418173940 0x56541818bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418169080 0x56541818baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418169080 0x56541818baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50546/0 (socket says 172.21.15.152:50546) 2024-09-11T22:06:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418173940 0x56541818bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418173940 0x56541818bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42754/0 (socket says 172.21.15.152:42754) 2024-09-11T22:06:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x56541816f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x56541816f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34634/0 (socket says 172.21.15.152:34634) 2024-09-11T22:06:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04cbfff640 1 -- 172.21.15.152:0/2228193075 learned_addr learned my addr 172.21.15.152:0/2228193075 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:19.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04dc537740 1 -- 172.21.15.152:0/2228193075 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04d41adfc0 con 0x565418173940 2024-09-11T22:06:19.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04dc537740 1 -- 172.21.15.152:0/2228193075 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f04d41ab860 con 0x565418168760 2024-09-11T22:06:19.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04dc537740 1 -- 172.21.15.152:0/2228193075 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04d4103310 con 0x565418169080 2024-09-11T22:06:19.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04d37fe640 1 -- 172.21.15.152:0/2228193075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418169080 msgr2=0x56541818baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:19.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04d37fe640 1 --2- 172.21.15.152:0/2228193075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418169080 0x56541818baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04d37fe640 1 -- 172.21.15.152:0/2228193075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418173940 msgr2=0x56541818bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:19.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04d37fe640 1 --2- 172.21.15.152:0/2228193075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418173940 0x56541818bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.235+0000 7f04d37fe640 1 -- 172.21.15.152:0/2228193075 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56541816c340 con 0x565418168760 2024-09-11T22:06:19.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.236+0000 7f04d37fe640 1 --2- 172.21.15.152:0/2228193075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x56541816f240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f04c4006010 tx=0x7f04c402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e636f380aa81e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:19.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.236+0000 7f04c97fa640 1 -- 172.21.15.152:0/2228193075 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4035070 con 0x565418168760 2024-09-11T22:06:19.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.236+0000 7f04c97fa640 1 -- 172.21.15.152:0/2228193075 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04c4004e50 con 0x565418168760 2024-09-11T22:06:19.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.236+0000 7f04c97fa640 1 -- 172.21.15.152:0/2228193075 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4031ae0 con 0x565418168760 2024-09-11T22:06:19.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.237+0000 7f04dc537740 1 -- 172.21.15.152:0/2228193075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 msgr2=0x56541816f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:19.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.237+0000 7f04dc537740 1 --2- 172.21.15.152:0/2228193075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x56541816f240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f04c4006010 tx=0x7f04c402a410 comp rx=0 tx=0).stop 2024-09-11T22:06:19.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.237+0000 7f04dc537740 1 -- 172.21.15.152:0/2228193075 shutdown_connections 2024-09-11T22:06:19.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.237+0000 7f04dc537740 1 --2- 172.21.15.152:0/2228193075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418173940 0x56541818bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.237+0000 7f04dc537740 1 --2- 172.21.15.152:0/2228193075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418169080 0x56541818baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.237+0000 7f04dc537740 1 --2- 172.21.15.152:0/2228193075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418168760 0x56541816f240 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.237+0000 7f04dc537740 1 -- 172.21.15.152:0/2228193075 >> 172.21.15.152:0/2228193075 conn(0x565418164cf0 msgr2=0x5654181729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:19.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.238+0000 7f04dc537740 1 -- 172.21.15.152:0/2228193075 shutdown_connections 2024-09-11T22:06:19.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.238+0000 7f04dc537740 1 -- 172.21.15.152:0/2228193075 wait complete. 2024-09-11T22:06:19.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.238+0000 7f04dc537740 1 -- start start 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.239+0000 7f04dc537740 1 Processor -- start 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.239+0000 7f04dc537740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 0x56541817b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.239+0000 7f04dc537740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 0x56541817be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.239+0000 7f04d37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 0x56541817b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04d37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 0x56541817b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42756/0 (socket says 172.21.15.152:42756) 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04d37fe640 1 -- 172.21.15.152:0/3896576660 learned_addr learned my addr 172.21.15.152:0/3896576660 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04dc537740 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x5654181788b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04dc537740 1 -- 172.21.15.152:0/3896576660 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04d4073970 con 0x565418168760 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04cbfff640 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 0x56541817be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04dc537740 1 -- 172.21.15.152:0/3896576660 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f04d41ab190 con 0x565418169080 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04d3fff640 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x5654181788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04dc537740 1 -- 172.21.15.152:0/3896576660 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04d4074020 con 0x565418173940 2024-09-11T22:06:19.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04dc537740 10 client.0 _ll_register_callbacks cb 0x7f04c4005520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:19.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04cbfff640 1 -- 172.21.15.152:0/3896576660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 msgr2=0x5654181788b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:19.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04cbfff640 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x5654181788b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04cbfff640 1 -- 172.21.15.152:0/3896576660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 msgr2=0x56541817b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:19.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04cbfff640 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 0x56541817b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04cbfff640 1 -- 172.21.15.152:0/3896576660 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56541816f920 con 0x565418169080 2024-09-11T22:06:19.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.240+0000 7f04d37fe640 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 0x56541817b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:19.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.241+0000 7f04cbfff640 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 0x56541817be20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04bc09b800 tx=0x7f04bc0a4770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15a4d5b09aff6e5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.241+0000 7f04c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:06:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.241+0000 7f04c2ffd640 1 -- 172.21.15.152:0/3896576660 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0037a0 con 0x565418169080 2024-09-11T22:06:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.241+0000 7f04c2ffd640 1 -- 172.21.15.152:0/3896576660 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f04bc0ccfb0 con 0x565418169080 2024-09-11T22:06:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.241+0000 7f04dc537740 1 -- 172.21.15.152:0/3896576660 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04c4004e50 con 0x565418169080 2024-09-11T22:06:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.242+0000 7f04c2ffd640 1 -- 172.21.15.152:0/3896576660 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f04bc0ba2c0 con 0x565418169080 2024-09-11T22:06:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.242+0000 7f04dc537740 10 client.25340 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.242+0000 7f04dc537740 1 -- 172.21.15.152:0/3896576660 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5654181eed20 con 0x565418169080 2024-09-11T22:06:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.242+0000 7f04c2ffd640 1 -- 172.21.15.152:0/3896576660 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04bc0ba460 con 0x565418169080 2024-09-11T22:06:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.242+0000 7f04c2ffd640 1 -- 172.21.15.152:0/3896576660 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f04bc0cf220 con 0x565418169080 2024-09-11T22:06:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.242+0000 7f04dc537740 10 client.25340 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.242+0000 7f04dc537740 10 client.25340 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:06:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.242+0000 7f04dc537740 20 client.25340 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.242+0000 7f04dc537740 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654181ef610 0x5654181f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.242+0000 7f04dc537740 4 client.25340 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}] 2024-09-11T22:06:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.242+0000 7f04dc537740 1 -- 172.21.15.152:0/3896576660 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}) -- 0x7f04c4004e50 con 0x5654181ef610 2024-09-11T22:06:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.243+0000 7f04d37fe640 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654181ef610 0x5654181f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.243+0000 7f04c2ffd640 10 client.25340 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.243+0000 7f04d37fe640 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654181ef610 0x5654181f1a30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e0644d1a30aefd server_cookie=70cc59612cd283e in_seq=0 out_seq=0 2024-09-11T22:06:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04c2ffd640 1 -- 172.21.15.152:0/3896576660 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f04c4004e50 con 0x5654181ef610 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04c2ffd640 10 client.25340 handle_command_reply: tid=0 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 1 client.25340 shutdown 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 1 -- 172.21.15.152:0/3896576660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 msgr2=0x56541817be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 0x56541817be20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04bc09b800 tx=0x7f04bc0a4770 comp rx=0 tx=0).stop 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 1 -- 172.21.15.152:0/3896576660 shutdown_connections 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654181ef610 0x5654181f1a30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565418173940 0x5654181788b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565418169080 0x56541817be20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 1 --2- 172.21.15.152:0/3896576660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565418168760 0x56541817b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 1 -- 172.21.15.152:0/3896576660 >> 172.21.15.152:0/3896576660 conn(0x565418164cf0 msgr2=0x5654181729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04c2ffd640 0 client.25340 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 1 -- 172.21.15.152:0/3896576660 shutdown_connections 2024-09-11T22:06:19.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 1 -- 172.21.15.152:0/3896576660 wait complete. 2024-09-11T22:06:19.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.595+0000 7f04dc537740 20 client.25340 trim_cache size 0 max 16384 2024-09-11T22:06:19.598 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:06:19.598 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 27, 2024-09-11T22:06:19.598 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:06:19.598 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 6, 2024-09-11T22:06:19.598 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "96655348": { 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 6, 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 133.4, 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:06:19.599 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:06:19.600 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:06:19.600 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:06:19.600 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:19.600 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:19.600 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:19.600 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:19.600 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:19.600 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:06:19.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 -- 172.21.15.152:0/1849176871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04b40a2e40 msgr2=0x7f04b40a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:19.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04b40a2e40 0x7f04b40a5300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0049d0 tx=0x7f04cc00fc70 comp rx=0 tx=0).stop 2024-09-11T22:06:19.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 -- 172.21.15.152:0/1849176871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d41027a0 msgr2=0x7f04d410ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:19.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d41027a0 0x7f04d410ba60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00e9f0 tx=0x7f04bc00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 -- 172.21.15.152:0/1849176871 shutdown_connections 2024-09-11T22:06:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04b40a2e40 0x7f04b40a5300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04d4106f20 0x7f04d41a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d41027a0 0x7f04d410ba60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 --2- 172.21.15.152:0/1849176871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04d4101df0 0x7f04d410b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 -- 172.21.15.152:0/1849176871 >> 172.21.15.152:0/1849176871 conn(0x7f04d40fd8f0 msgr2=0x7f04d40fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 -- 172.21.15.152:0/1849176871 shutdown_connections 2024-09-11T22:06:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:19.596+0000 7f04da15e640 1 -- 172.21.15.152:0/1849176871 wait complete. 2024-09-11T22:06:19.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:19 smithi152 ceph-mon[31188]: pgmap v64: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 53 MiB/s wr, 1.82k op/s 2024-09-11T22:06:19.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:19 smithi179 ceph-mon[35603]: pgmap v64: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 53 MiB/s wr, 1.82k op/s 2024-09-11T22:06:19.821 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 45.0 s, 4187.6 tps, lat 21.244 ms stddev 21.749 2024-09-11T22:06:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:19 smithi193 ceph-mon[35545]: pgmap v64: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 53 MiB/s wr, 1.82k op/s 2024-09-11T22:06:20.254 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '96655348', quiesce took 4.3 seconds. Will release after: 9.100000000000001 2024-09-11T22:06:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:21 smithi179 ceph-mon[35603]: pgmap v65: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 11 MiB/s wr, 795 op/s 2024-09-11T22:06:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:21 smithi193 ceph-mon[35545]: pgmap v65: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 11 MiB/s wr, 795 op/s 2024-09-11T22:06:21.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:21 smithi152 ceph-mon[31188]: pgmap v65: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 11 MiB/s wr, 795 op/s 2024-09-11T22:06:23.783 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:23 smithi152 ceph-mon[31188]: pgmap v66: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 12 MiB/s wr, 882 op/s 2024-09-11T22:06:23.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:23 smithi179 ceph-mon[35603]: pgmap v66: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 12 MiB/s wr, 882 op/s 2024-09-11T22:06:23.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:23 smithi193 ceph-mon[35545]: pgmap v66: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 12 MiB/s wr, 882 op/s 2024-09-11T22:06:24.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 50.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:06:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:25 smithi179 ceph-mon[35603]: pgmap v67: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 458 op/s 2024-09-11T22:06:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:25 smithi193 ceph-mon[35545]: pgmap v67: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 458 op/s 2024-09-11T22:06:25.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:25 smithi152 ceph-mon[31188]: pgmap v67: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 458 op/s 2024-09-11T22:06:27.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:27 smithi179 ceph-mon[35603]: pgmap v68: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 458 op/s 2024-09-11T22:06:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:27 smithi193 ceph-mon[35545]: pgmap v68: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 458 op/s 2024-09-11T22:06:27.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:27 smithi152 ceph-mon[31188]: pgmap v68: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 458 op/s 2024-09-11T22:06:28.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:28 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:06:29.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:28 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:06:29.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:28 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:06:29.356 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:06:29.608 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:29.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 55.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:06:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:06:29.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:06:29.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:29.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:29 smithi152 ceph-mon[31188]: pgmap v69: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.0 MiB/s wr, 461 op/s 2024-09-11T22:06:30.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.060+0000 7fa7c643d640 1 -- 172.21.15.152:0/2857873181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7c0102d30 msgr2=0x7fa7c0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.060+0000 7fa7c643d640 1 --2- 172.21.15.152:0/2857873181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7c0102d30 0x7fa7c0103110 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009930 tx=0x7fa7b002a420 comp rx=0 tx=0).stop 2024-09-11T22:06:30.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.060+0000 7fa7c643d640 1 -- 172.21.15.152:0/2857873181 shutdown_connections 2024-09-11T22:06:30.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.060+0000 7fa7c643d640 1 --2- 172.21.15.152:0/2857873181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7c01082a0 0x7fa7c010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.060+0000 7fa7c643d640 1 --2- 172.21.15.152:0/2857873181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01036e0 0x7fa7c0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.060+0000 7fa7c643d640 1 --2- 172.21.15.152:0/2857873181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7c0102d30 0x7fa7c0103110 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.060+0000 7fa7c643d640 1 -- 172.21.15.152:0/2857873181 >> 172.21.15.152:0/2857873181 conn(0x7fa7c00fc7d0 msgr2=0x7fa7c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.060+0000 7fa7c643d640 1 -- 172.21.15.152:0/2857873181 shutdown_connections 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.060+0000 7fa7c643d640 1 -- 172.21.15.152:0/2857873181 wait complete. 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.060+0000 7fa7c643d640 1 Processor -- start 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7c643d640 1 -- start start 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7c643d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7c0102d30 0x7fa7c0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7c643d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01036e0 0x7fa7c0198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7c643d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7c01082a0 0x7fa7c019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7c643d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c01120a0 con 0x7fa7c0102d30 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7c643d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c0111f20 con 0x7fa7c01082a0 2024-09-11T22:06:30.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7c643d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c0112220 con 0x7fa7c01036e0 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7bffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7c0102d30 0x7fa7c0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7bffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7c0102d30 0x7fa7c0198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38632/0 (socket says 172.21.15.152:38632) 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7bffff640 1 -- 172.21.15.152:0/3262825417 learned_addr learned my addr 172.21.15.152:0/3262825417 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7c49da640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7c01082a0 0x7fa7c019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7b7fff640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01036e0 0x7fa7c0198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7bffff640 1 -- 172.21.15.152:0/3262825417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01036e0 msgr2=0x7fa7c0198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7bffff640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01036e0 0x7fa7c0198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7bffff640 1 -- 172.21.15.152:0/3262825417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7c01082a0 msgr2=0x7fa7c019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7bffff640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7c01082a0 0x7fa7c019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7bffff640 1 -- 172.21.15.152:0/3262825417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c019d4e0 con 0x7fa7c0102d30 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.061+0000 7fa7bffff640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7c0102d30 0x7fa7c0198530 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009230 tx=0x7fa7b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:30.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.062+0000 7fa7bdffb640 1 -- 172.21.15.152:0/3262825417 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b003f030 con 0x7fa7c0102d30 2024-09-11T22:06:30.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.062+0000 7fa7c643d640 1 -- 172.21.15.152:0/3262825417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c019d770 con 0x7fa7c0102d30 2024-09-11T22:06:30.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.062+0000 7fa7bdffb640 1 -- 172.21.15.152:0/3262825417 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7b0003ad0 con 0x7fa7c0102d30 2024-09-11T22:06:30.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.062+0000 7fa7bdffb640 1 -- 172.21.15.152:0/3262825417 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0035070 con 0x7fa7c0102d30 2024-09-11T22:06:30.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.062+0000 7fa7c643d640 1 -- 172.21.15.152:0/3262825417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c01a50b0 con 0x7fa7c0102d30 2024-09-11T22:06:30.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.063+0000 7fa7c643d640 1 -- 172.21.15.152:0/3262825417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c0103110 con 0x7fa7c0102d30 2024-09-11T22:06:30.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.065+0000 7fa7bdffb640 1 -- 172.21.15.152:0/3262825417 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa7b0042030 con 0x7fa7c0102d30 2024-09-11T22:06:30.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.065+0000 7fa7bdffb640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa7ac0a2cf0 0x7fa7ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.065+0000 7fa7b7fff640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa7ac0a2cf0 0x7fa7ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.065+0000 7fa7bdffb640 1 -- 172.21.15.152:0/3262825417 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa7b00ef7f0 con 0x7fa7c0102d30 2024-09-11T22:06:30.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.066+0000 7fa7b7fff640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa7ac0a2cf0 0x7fa7ac0a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00fedf0 tx=0x7fa7a8005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:30.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.070+0000 7fa7bdffb640 1 -- 172.21.15.152:0/3262825417 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7b00bbd90 con 0x7fa7c0102d30 2024-09-11T22:06:30.091 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:06:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.136+0000 7fc7c075f640 1 -- 172.21.15.152:0/1379090639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b8100880 msgr2=0x7fc7b8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.136+0000 7fc7c075f640 1 --2- 172.21.15.152:0/1379090639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b8100880 0x7fc7b8100c60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009900 tx=0x7fc7b402a410 comp rx=0 tx=0).stop 2024-09-11T22:06:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.136+0000 7fc7c075f640 1 -- 172.21.15.152:0/1379090639 shutdown_connections 2024-09-11T22:06:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.136+0000 7fc7c075f640 1 --2- 172.21.15.152:0/1379090639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7b810e430 0x7fc7b8110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.136+0000 7fc7c075f640 1 --2- 172.21.15.152:0/1379090639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7b8101230 0x7fc7b810def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.136+0000 7fc7c075f640 1 --2- 172.21.15.152:0/1379090639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b8100880 0x7fc7b8100c60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.136+0000 7fc7c075f640 1 -- 172.21.15.152:0/1379090639 >> 172.21.15.152:0/1379090639 conn(0x7fc7b8077990 msgr2=0x7fc7b80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.136+0000 7fc7c075f640 1 -- 172.21.15.152:0/1379090639 shutdown_connections 2024-09-11T22:06:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.136+0000 7fc7c075f640 1 -- 172.21.15.152:0/1379090639 wait complete. 2024-09-11T22:06:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7c075f640 1 Processor -- start 2024-09-11T22:06:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7c075f640 1 -- start start 2024-09-11T22:06:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7c075f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7b8100880 0x7fc7b819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7c075f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b8101230 0x7fc7b819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7c075f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7b810e430 0x7fc7b819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7c075f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81140e0 con 0x7fc7b8101230 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7c075f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b8113f60 con 0x7fc7b810e430 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7c075f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b8114260 con 0x7fc7b8100880 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7bdcfa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b8101230 0x7fc7b819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7be4fb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7b8100880 0x7fc7b819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7bdcfa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b8101230 0x7fc7b819ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38658/0 (socket says 172.21.15.152:38658) 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7bdcfa640 1 -- 172.21.15.152:0/180640580 learned_addr learned my addr 172.21.15.152:0/180640580 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7be4fb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7b8100880 0x7fc7b819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52904/0 (socket says 172.21.15.152:52904) 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.137+0000 7fc7becfc640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7b810e430 0x7fc7b819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7bdcfa640 1 -- 172.21.15.152:0/180640580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7b8100880 msgr2=0x7fc7b819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7bdcfa640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7b8100880 0x7fc7b819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7bdcfa640 1 -- 172.21.15.152:0/180640580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7b810e430 msgr2=0x7fc7b819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7bdcfa640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7b810e430 0x7fc7b819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7bdcfa640 1 -- 172.21.15.152:0/180640580 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b819f5c0 con 0x7fc7b8101230 2024-09-11T22:06:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7be4fb640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7b8100880 0x7fc7b819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7bdcfa640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b8101230 0x7fc7b819ab10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800e9f0 tx=0x7fc7a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7af7fe640 1 -- 172.21.15.152:0/180640580 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800cd80 con 0x7fc7b8101230 2024-09-11T22:06:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7af7fe640 1 -- 172.21.15.152:0/180640580 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7a8010910 con 0x7fc7b8101230 2024-09-11T22:06:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7af7fe640 1 -- 172.21.15.152:0/180640580 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8018990 con 0x7fc7b8101230 2024-09-11T22:06:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7c075f640 1 -- 172.21.15.152:0/180640580 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b819f8b0 con 0x7fc7b8101230 2024-09-11T22:06:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.138+0000 7fc7c075f640 1 -- 172.21.15.152:0/180640580 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b81a7140 con 0x7fc7b8101230 2024-09-11T22:06:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.141+0000 7fc7c35d6740 1 Processor -- start 2024-09-11T22:06:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.141+0000 7fc7c35d6740 1 -- start start 2024-09-11T22:06:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.141+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 0x55a9bd673ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.141+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd674410 0x55a9bd67e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.141+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd6810a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.141+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a9bd5d82f0 con 0x55a9bd67ecb0 2024-09-11T22:06:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.141+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a9bd580270 con 0x55a9bd673af0 2024-09-11T22:06:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.141+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a9bd5d42b0 con 0x55a9bd674410 2024-09-11T22:06:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7becfc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 0x55a9bd673ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7becfc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 0x55a9bd673ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54660/0 (socket says 172.21.15.152:54660) 2024-09-11T22:06:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7becfc640 1 -- 172.21.15.152:0/1052373770 learned_addr learned my addr 172.21.15.152:0/1052373770 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7be4fb640 1 --2- 172.21.15.152:0/1052373770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd674410 0x55a9bd67e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7af7fe640 1 -- 172.21.15.152:0/180640580 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fc7a8010ac0 con 0x7fc7b8101230 2024-09-11T22:06:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7becfc640 1 -- 172.21.15.152:0/1052373770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd674410 msgr2=0x55a9bd67e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7becfc640 1 --2- 172.21.15.152:0/1052373770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd674410 0x55a9bd67e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7becfc640 1 -- 172.21.15.152:0/1052373770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 msgr2=0x55a9bd6810a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7becfc640 1 --2- 172.21.15.152:0/1052373770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd6810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7becfc640 1 -- 172.21.15.152:0/1052373770 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9bd57f340 con 0x55a9bd673af0 2024-09-11T22:06:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7becfc640 1 --2- 172.21.15.152:0/1052373770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 0x55a9bd673ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009f30 tx=0x7fc7b00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e39c571ecbd1bab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7acff9640 1 -- 172.21.15.152:0/1052373770 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0004d20 con 0x55a9bd673af0 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7acff9640 1 -- 172.21.15.152:0/1052373770 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b0004050 con 0x55a9bd673af0 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.142+0000 7fc7acff9640 1 -- 172.21.15.152:0/1052373770 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0005280 con 0x55a9bd673af0 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7af7fe640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7a40a2e20 0x7fc7a40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7be4fb640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7a40a2e20 0x7fc7a40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7af7fe640 1 -- 172.21.15.152:0/180640580 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc7a80cf6e0 con 0x7fc7b8101230 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7be4fb640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7a40a2e20 0x7fc7a40a52e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009230 tx=0x7fc7b40058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7c35d6740 1 -- 172.21.15.152:0/1052373770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 msgr2=0x55a9bd673ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/1052373770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 0x55a9bd673ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009f30 tx=0x7fc7b00118d0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7c35d6740 1 -- 172.21.15.152:0/1052373770 shutdown_connections 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/1052373770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd6810a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/1052373770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd674410 0x55a9bd67e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/1052373770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 0x55a9bd673ed0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7c35d6740 1 -- 172.21.15.152:0/1052373770 >> 172.21.15.152:0/1052373770 conn(0x55a9bd670060 msgr2=0x55a9bd670440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.143+0000 7fc7c35d6740 1 -- 172.21.15.152:0/1052373770 shutdown_connections 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.144+0000 7fc7c35d6740 1 -- 172.21.15.152:0/1052373770 wait complete. 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.144+0000 7fc7c35d6740 1 -- start start 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.144+0000 7fc7c35d6740 1 Processor -- start 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.144+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd673af0 0x55a9bd67bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.144+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd674410 0x55a9bd67c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.144+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd67c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.144+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a9bd681880 con 0x55a9bd67ecb0 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.144+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a9bd561290 con 0x55a9bd674410 2024-09-11T22:06:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.144+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a9bd681a00 con 0x55a9bd673af0 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.144+0000 7fc7c35d6740 10 client.0 _ll_register_callbacks cb 0x55a9bd592140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7becfc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd67c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7becfc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd67c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38680/0 (socket says 172.21.15.152:38680) 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7becfc640 1 -- 172.21.15.152:0/3146530121 learned_addr learned my addr 172.21.15.152:0/3146530121 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7bdcfa640 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd674410 0x55a9bd67c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7be4fb640 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd673af0 0x55a9bd67bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7becfc640 1 -- 172.21.15.152:0/3146530121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd673af0 msgr2=0x55a9bd67bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7becfc640 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd673af0 0x55a9bd67bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7becfc640 1 -- 172.21.15.152:0/3146530121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd674410 msgr2=0x55a9bd67c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7becfc640 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd674410 0x55a9bd67c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7becfc640 1 -- 172.21.15.152:0/3146530121 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9bd2eb210 con 0x55a9bd67ecb0 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7bdcfa640 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd674410 0x55a9bd67c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7becfc640 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd67c610 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0004c70 tx=0x7fc7b0004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86837ab629cef021 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/3146530121 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0029020 con 0x55a9bd67ecb0 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7c35d6740 1 -- 172.21.15.152:0/3146530121 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b0004050 con 0x55a9bd67ecb0 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/3146530121 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc7b0004610 con 0x55a9bd67ecb0 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/3146530121 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc7b0005040 con 0x55a9bd67ecb0 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.145+0000 7fc7c35d6740 10 client.15864 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.146+0000 7fc7c35d6740 1 -- 172.21.15.152:0/3146530121 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a9bd3b7620 con 0x55a9bd67ecb0 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.146+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/3146530121 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b0004050 con 0x55a9bd67ecb0 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.146+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/3146530121 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fc7b0025790 con 0x55a9bd67ecb0 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.146+0000 7fc7c35d6740 10 client.15864 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.146+0000 7fc7c35d6740 10 client.15864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.146+0000 7fc7c35d6740 20 client.15864 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.146+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9bd68eba0 0x55a9bd690f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.146+0000 7fc7c35d6740 4 client.15864 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.146+0000 7fc7c35d6740 1 -- 172.21.15.152:0/3146530121 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9bd5e5a20 con 0x55a9bd68eba0 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.146+0000 7fc7be4fb640 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9bd68eba0 0x55a9bd690f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.147+0000 7fc7be4fb640 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9bd68eba0 0x55a9bd690f90 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fae9be24a3e1b935 server_cookie=827dcc86980843c6 in_seq=0 out_seq=0 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.147+0000 7fc7a1ffb640 10 client.15864 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.147+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/3146530121 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9bd5e5a20 con 0x55a9bd68eba0 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.147+0000 7fc7a1ffb640 10 client.15864 handle_command_reply: tid=0 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 1 client.15864 shutdown 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 1 -- 172.21.15.152:0/3146530121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 msgr2=0x55a9bd67c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd67c610 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0004c70 tx=0x7fc7b0004ca0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 1 -- 172.21.15.152:0/3146530121 shutdown_connections 2024-09-11T22:06:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9bd68eba0 0x55a9bd690f90 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7a1ffb640 0 client.15864 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd67c610 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd674410 0x55a9bd67c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/3146530121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd673af0 0x55a9bd67bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 1 -- 172.21.15.152:0/3146530121 >> 172.21.15.152:0/3146530121 conn(0x55a9bd670060 msgr2=0x55a9bd675d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 1 -- 172.21.15.152:0/3146530121 shutdown_connections 2024-09-11T22:06:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 1 -- 172.21.15.152:0/3146530121 wait complete. 2024-09-11T22:06:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.148+0000 7fc7c35d6740 20 client.15864 trim_cache size 0 max 16384 2024-09-11T22:06:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.173+0000 7fc7c35d6740 1 Processor -- start 2024-09-11T22:06:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.173+0000 7fc7c35d6740 1 -- start start 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.173+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 0x55a9bd67a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.173+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd674410 0x55a9bd67c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.173+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd696720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.173+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81b2390 con 0x55a9bd67ecb0 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.173+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81afc30 con 0x55a9bd673af0 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.173+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81ada80 con 0x55a9bd674410 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7becfc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd696720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7be4fb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 0x55a9bd67a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7becfc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd696720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38684/0 (socket says 172.21.15.152:38684) 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7becfc640 1 -- 172.21.15.152:0/1305167379 learned_addr learned my addr 172.21.15.152:0/1305167379 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7bdcfa640 1 --2- 172.21.15.152:0/1305167379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd674410 0x55a9bd67c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7becfc640 1 -- 172.21.15.152:0/1305167379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd674410 msgr2=0x55a9bd67c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7becfc640 1 --2- 172.21.15.152:0/1305167379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd674410 0x55a9bd67c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7becfc640 1 -- 172.21.15.152:0/1305167379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 msgr2=0x55a9bd67a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7becfc640 1 --2- 172.21.15.152:0/1305167379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 0x55a9bd67a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7becfc640 1 -- 172.21.15.152:0/1305167379 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9bd6914f0 con 0x55a9bd67ecb0 2024-09-11T22:06:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7be4fb640 1 --2- 172.21.15.152:0/1305167379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 0x55a9bd67a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7bdcfa640 1 --2- 172.21.15.152:0/1305167379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd674410 0x55a9bd67c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:06:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7becfc640 1 --2- 172.21.15.152:0/1305167379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd696720 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0025c00 tx=0x7fc7b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5506ced60fd0a9ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7a3fff640 1 -- 172.21.15.152:0/1305167379 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0029040 con 0x55a9bd67ecb0 2024-09-11T22:06:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7a3fff640 1 -- 172.21.15.152:0/1305167379 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b0009e00 con 0x55a9bd67ecb0 2024-09-11T22:06:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.174+0000 7fc7a3fff640 1 -- 172.21.15.152:0/1305167379 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b000f6d0 con 0x55a9bd67ecb0 2024-09-11T22:06:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.175+0000 7fc7c35d6740 1 -- 172.21.15.152:0/1305167379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 msgr2=0x55a9bd696720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.175+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/1305167379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd696720 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0025c00 tx=0x7fc7b0009bb0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.175+0000 7fc7c35d6740 1 -- 172.21.15.152:0/1305167379 shutdown_connections 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.175+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/1305167379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd67ecb0 0x55a9bd696720 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.175+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/1305167379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd674410 0x55a9bd67c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.176+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/1305167379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd673af0 0x55a9bd67a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.176+0000 7fc7c35d6740 1 -- 172.21.15.152:0/1305167379 >> 172.21.15.152:0/1305167379 conn(0x55a9bd670060 msgr2=0x55a9bd67dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.176+0000 7fc7c35d6740 1 -- 172.21.15.152:0/1305167379 shutdown_connections 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.176+0000 7fc7c35d6740 1 -- 172.21.15.152:0/1305167379 wait complete. 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.176+0000 7fc7c35d6740 1 -- start start 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.176+0000 7fc7c35d6740 1 Processor -- start 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.176+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd673af0 0x55a9bd686e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.176+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd674410 0x55a9bd6873c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.176+0000 7fc7c35d6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd67ecb0 0x55a9bd6783e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81ae0f0 con 0x55a9bd673af0 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81af560 con 0x55a9bd674410 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7c35d6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81ae7c0 con 0x55a9bd67ecb0 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7be4fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd673af0 0x55a9bd686e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7be4fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd673af0 0x55a9bd686e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38696/0 (socket says 172.21.15.152:38696) 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7be4fb640 1 -- 172.21.15.152:0/2993828680 learned_addr learned my addr 172.21.15.152:0/2993828680 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7c35d6740 10 client.0 _ll_register_callbacks cb 0x7fc7b00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7bdcfa640 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd674410 0x55a9bd6873c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7becfc640 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd67ecb0 0x55a9bd6783e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7be4fb640 1 -- 172.21.15.152:0/2993828680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd67ecb0 msgr2=0x55a9bd6783e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7be4fb640 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd67ecb0 0x55a9bd6783e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7be4fb640 1 -- 172.21.15.152:0/2993828680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd674410 msgr2=0x55a9bd6873c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7be4fb640 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd674410 0x55a9bd6873c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7be4fb640 1 -- 172.21.15.152:0/2993828680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9bd678ad0 con 0x55a9bd673af0 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7be4fb640 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd673af0 0x55a9bd686e80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009900 tx=0x7fc7b4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e12eb505fe4a475 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/2993828680 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4056070 con 0x55a9bd673af0 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/2993828680 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc7b4003a00 con 0x55a9bd673af0 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7c35d6740 1 -- 172.21.15.152:0/2993828680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b0009e00 con 0x55a9bd673af0 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/2993828680 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc7b4043070 con 0x55a9bd673af0 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7c35d6740 10 client.15870 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.177+0000 7fc7c35d6740 1 -- 172.21.15.152:0/2993828680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a9bd6f9100 con 0x55a9bd673af0 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.178+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/2993828680 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b0009e00 con 0x55a9bd673af0 2024-09-11T22:06:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.178+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/2993828680 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fc7b405bcb0 con 0x55a9bd673af0 2024-09-11T22:06:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.178+0000 7fc7c35d6740 10 client.15870 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.178+0000 7fc7c35d6740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.178+0000 7fc7c35d6740 20 client.15870 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.178+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9bd68eba0 0x55a9bd6fb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.178+0000 7fc7c35d6740 4 client.15870 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:06:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.178+0000 7fc7c35d6740 1 -- 172.21.15.152:0/2993828680 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a9bd5dfd70 con 0x55a9bd68eba0 2024-09-11T22:06:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.178+0000 7fc7bdcfa640 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9bd68eba0 0x55a9bd6fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.178+0000 7fc7bdcfa640 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9bd68eba0 0x55a9bd6fb900 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61e07642a767e35d server_cookie=3b4eb2716a106971 in_seq=0 out_seq=0 2024-09-11T22:06:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.178+0000 7fc7a1ffb640 10 client.15870 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7a1ffb640 1 -- 172.21.15.152:0/2993828680 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a9bd5dfd70 con 0x55a9bd68eba0 2024-09-11T22:06:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7a1ffb640 10 client.15870 handle_command_reply: tid=0 2024-09-11T22:06:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 1 client.15870 shutdown 2024-09-11T22:06:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 1 -- 172.21.15.152:0/2993828680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd673af0 msgr2=0x55a9bd686e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd673af0 0x55a9bd686e80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009900 tx=0x7fc7b4009260 comp rx=0 tx=0).stop 2024-09-11T22:06:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 1 -- 172.21.15.152:0/2993828680 shutdown_connections 2024-09-11T22:06:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9bd68eba0 0x55a9bd6fb900 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7a1ffb640 0 client.15870 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9bd67ecb0 0x55a9bd6783e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9bd674410 0x55a9bd6873c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 1 --2- 172.21.15.152:0/2993828680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9bd673af0 0x55a9bd686e80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 1 -- 172.21.15.152:0/2993828680 >> 172.21.15.152:0/2993828680 conn(0x55a9bd670060 msgr2=0x55a9bd66e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 1 -- 172.21.15.152:0/2993828680 shutdown_connections 2024-09-11T22:06:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 1 -- 172.21.15.152:0/2993828680 wait complete. 2024-09-11T22:06:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.185+0000 7fc7c35d6740 20 client.15870 trim_cache size 0 max 16384 2024-09-11T22:06:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:06:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:06:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:06:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:06:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 -- 172.21.15.152:0/180640580 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7a40a2e20 msgr2=0x7fc7a40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7a40a2e20 0x7fc7a40a52e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009230 tx=0x7fc7b40058d0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 -- 172.21.15.152:0/180640580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b8101230 msgr2=0x7fc7b819ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b8101230 0x7fc7b819ab10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800e9f0 tx=0x7fc7a800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 -- 172.21.15.152:0/180640580 shutdown_connections 2024-09-11T22:06:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7a40a2e20 0x7fc7a40a52e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7b810e430 0x7fc7b819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b8101230 0x7fc7b819ab10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 --2- 172.21.15.152:0/180640580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7b8100880 0x7fc7b819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 -- 172.21.15.152:0/180640580 >> 172.21.15.152:0/180640580 conn(0x7fc7b8077990 msgr2=0x7fc7b80ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 -- 172.21.15.152:0/180640580 shutdown_connections 2024-09-11T22:06:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:30.186+0000 7fc7c075f640 1 -- 172.21.15.152:0/180640580 wait complete. 2024-09-11T22:06:30.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.285+0000 7fa7c643d640 1 -- 172.21.15.152:0/3262825417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7c010a2b0 con 0x7fa7c0102d30 2024-09-11T22:06:30.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.286+0000 7fa7bdffb640 1 -- 172.21.15.152:0/3262825417 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11927 (secure 0 0 0) 0x7fa7b00c0090 con 0x7fa7c0102d30 2024-09-11T22:06:30.288 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:06:30.288 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":27,"btime":"2024-09-11T22:04:54:476799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:53.804306+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:06:30.289 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 27 2024-09-11T22:06:30.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 -- 172.21.15.152:0/3262825417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa7ac0a2cf0 msgr2=0x7fa7ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa7ac0a2cf0 0x7fa7ac0a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00fedf0 tx=0x7fa7a8005f90 comp rx=0 tx=0).stop 2024-09-11T22:06:30.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 -- 172.21.15.152:0/3262825417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7c0102d30 msgr2=0x7fa7c0198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:30.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7c0102d30 0x7fa7c0198530 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009230 tx=0x7fa7b0004270 comp rx=0 tx=0).stop 2024-09-11T22:06:30.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 -- 172.21.15.152:0/3262825417 shutdown_connections 2024-09-11T22:06:30.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa7ac0a2cf0 0x7fa7ac0a51b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7c01082a0 0x7fa7c019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01036e0 0x7fa7c0198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 --2- 172.21.15.152:0/3262825417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7c0102d30 0x7fa7c0198530 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:30.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 -- 172.21.15.152:0/3262825417 >> 172.21.15.152:0/3262825417 conn(0x7fa7c00fc7d0 msgr2=0x7fa7c0105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:30.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 -- 172.21.15.152:0/3262825417 shutdown_connections 2024-09-11T22:06:30.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:30.289+0000 7fa7c643d640 1 -- 172.21.15.152:0/3262825417 wait complete. 2024-09-11T22:06:30.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:06:30.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:06:30.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:29 smithi179 ceph-mon[35603]: pgmap v69: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.0 MiB/s wr, 461 op/s 2024-09-11T22:06:30.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:06:30.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:06:30.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:06:30.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:29 smithi193 ceph-mon[35545]: pgmap v69: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.0 MiB/s wr, 461 op/s 2024-09-11T22:06:30.949 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 96655348 --release --await' 2024-09-11T22:06:30.949 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 96655348 --release --await 2024-09-11T22:06:30.950 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:31.067 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:30 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3262825417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:06:31.298 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:30 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3262825417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:06:31.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:30 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3262825417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:06:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.448+0000 7f6199f0e640 1 -- 172.21.15.152:0/392965097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6194100e20 msgr2=0x7f6194101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.448+0000 7f6199f0e640 1 --2- 172.21.15.152:0/392965097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6194100e20 0x7f6194101200 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6184009930 tx=0x7f618402a510 comp rx=0 tx=0).stop 2024-09-11T22:06:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.449+0000 7f6199f0e640 1 -- 172.21.15.152:0/392965097 shutdown_connections 2024-09-11T22:06:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.449+0000 7f6199f0e640 1 --2- 172.21.15.152:0/392965097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6194102ef0 0x7f619410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.449+0000 7f6199f0e640 1 --2- 172.21.15.152:0/392965097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6194102570 0x7f61941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.449+0000 7f6199f0e640 1 --2- 172.21.15.152:0/392965097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6194100e20 0x7f6194101200 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.449+0000 7f6199f0e640 1 -- 172.21.15.152:0/392965097 >> 172.21.15.152:0/392965097 conn(0x7f61940fc7d0 msgr2=0x7f61940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.449+0000 7f6199f0e640 1 -- 172.21.15.152:0/392965097 shutdown_connections 2024-09-11T22:06:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.449+0000 7f6199f0e640 1 -- 172.21.15.152:0/392965097 wait complete. 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.450+0000 7f6199f0e640 1 Processor -- start 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.450+0000 7f6199f0e640 1 -- start start 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.451+0000 7f6199f0e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6194100e20 0x7f619406db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.451+0000 7f6199f0e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6194102570 0x7f619406e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.451+0000 7f6199f0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6194102ef0 0x7f6194072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.451+0000 7f6199f0e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f619406c740 con 0x7f6194102570 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.451+0000 7f6199f0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f619406c5c0 con 0x7f6194102ef0 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.451+0000 7f6199f0e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f619406c8c0 con 0x7f6194100e20 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.451+0000 7f61937fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6194100e20 0x7f619406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.451+0000 7f61937fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6194100e20 0x7f619406db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52972/0 (socket says 172.21.15.152:52972) 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.451+0000 7f61937fe640 1 -- 172.21.15.152:0/2044535169 learned_addr learned my addr 172.21.15.152:0/2044535169 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.451+0000 7f6193fff640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6194102ef0 0x7f6194072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.452+0000 7f61937fe640 1 -- 172.21.15.152:0/2044535169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6194102ef0 msgr2=0x7f6194072bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.452+0000 7f61937fe640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6194102ef0 0x7f6194072bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.452+0000 7f61937fe640 1 -- 172.21.15.152:0/2044535169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6194102570 msgr2=0x7f619406e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.452+0000 7f61937fe640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6194102570 0x7f619406e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.452+0000 7f61937fe640 1 -- 172.21.15.152:0/2044535169 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61940730f0 con 0x7f6194100e20 2024-09-11T22:06:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.452+0000 7f61937fe640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6194100e20 0x7f619406db60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6184005ab0 tx=0x7f61840040f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.452+0000 7f6190ff9640 1 -- 172.21.15.152:0/2044535169 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184040030 con 0x7f6194100e20 2024-09-11T22:06:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.453+0000 7f6199f0e640 1 -- 172.21.15.152:0/2044535169 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6194073380 con 0x7f6194100e20 2024-09-11T22:06:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.453+0000 7f6199f0e640 1 -- 172.21.15.152:0/2044535169 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6194073860 con 0x7f6194100e20 2024-09-11T22:06:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.455+0000 7f6190ff9640 1 -- 172.21.15.152:0/2044535169 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6184005370 con 0x7f6194100e20 2024-09-11T22:06:31.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.455+0000 7f6190ff9640 1 -- 172.21.15.152:0/2044535169 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618403cd10 con 0x7f6194100e20 2024-09-11T22:06:31.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.457+0000 7f619c2e7740 1 Processor -- start 2024-09-11T22:06:31.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.457+0000 7f619c2e7740 1 -- start start 2024-09-11T22:06:31.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.457+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 0x55d68c3fd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.457+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 0x55d68c408140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c408680 0x55d68c40aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f619c2e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d68c3632e0 con 0x55d68c408680 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f619c2e7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d68c30ace0 con 0x55d68c3fd4a0 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f619c2e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d68c35f2a0 con 0x55d68c3fddc0 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f6193fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 0x55d68c3fd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f6193fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 0x55d68c3fd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54704/0 (socket says 172.21.15.152:54704) 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f6193fff640 1 -- 172.21.15.152:0/452328190 learned_addr learned my addr 172.21.15.152:0/452328190 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f61937fe640 1 --2- 172.21.15.152:0/452328190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 0x55d68c408140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f6193fff640 1 -- 172.21.15.152:0/452328190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 msgr2=0x55d68c408140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f6193fff640 1 --2- 172.21.15.152:0/452328190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 0x55d68c408140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f6193fff640 1 -- 172.21.15.152:0/452328190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c408680 msgr2=0x55d68c40aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f6193fff640 1 --2- 172.21.15.152:0/452328190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c408680 0x55d68c40aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f6193fff640 1 -- 172.21.15.152:0/452328190 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d68c2ef440 con 0x55d68c3fd4a0 2024-09-11T22:06:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.459+0000 7f6190ff9640 1 -- 172.21.15.152:0/2044535169 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f6184043030 con 0x7f6194100e20 2024-09-11T22:06:31.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.460+0000 7f6193fff640 1 --2- 172.21.15.152:0/452328190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 0x55d68c3fd880 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f618800ab00 tx=0x7f618800f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14d4568c2dab4122 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:31.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.460+0000 7f6179ffb640 1 -- 172.21.15.152:0/452328190 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618801d070 con 0x55d68c3fd4a0 2024-09-11T22:06:31.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.460+0000 7f6179ffb640 1 -- 172.21.15.152:0/452328190 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6188018920 con 0x55d68c3fd4a0 2024-09-11T22:06:31.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.460+0000 7f6179ffb640 1 -- 172.21.15.152:0/452328190 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6188010b00 con 0x55d68c3fd4a0 2024-09-11T22:06:31.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.461+0000 7f6190ff9640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f617c0a2f00 0x7f617c0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.461+0000 7f61937fe640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f617c0a2f00 0x7f617c0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.461+0000 7f619c2e7740 1 -- 172.21.15.152:0/452328190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 msgr2=0x55d68c3fd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:31.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.461+0000 7f619c2e7740 1 --2- 172.21.15.152:0/452328190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 0x55d68c3fd880 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f618800ab00 tx=0x7f618800f3c0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.461+0000 7f6190ff9640 1 -- 172.21.15.152:0/2044535169 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f61840ef9f0 con 0x7f6194100e20 2024-09-11T22:06:31.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.461+0000 7f619c2e7740 1 -- 172.21.15.152:0/452328190 shutdown_connections 2024-09-11T22:06:31.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.462+0000 7f619c2e7740 1 --2- 172.21.15.152:0/452328190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c408680 0x55d68c40aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.462+0000 7f619c2e7740 1 --2- 172.21.15.152:0/452328190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 0x55d68c408140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.462+0000 7f619c2e7740 1 --2- 172.21.15.152:0/452328190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 0x55d68c3fd880 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.462+0000 7f619c2e7740 1 -- 172.21.15.152:0/452328190 >> 172.21.15.152:0/452328190 conn(0x55d68c3f9a30 msgr2=0x55d68c3f9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.462+0000 7f619c2e7740 1 -- 172.21.15.152:0/452328190 shutdown_connections 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.462+0000 7f619c2e7740 1 -- 172.21.15.152:0/452328190 wait complete. 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.462+0000 7f619c2e7740 1 -- start start 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.463+0000 7f619c2e7740 1 Processor -- start 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.463+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c407f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.463+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c3fddc0 0x55d68c405240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.463+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c408680 0x55d68c405780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.463+0000 7f619c2e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d68c40b250 con 0x55d68c3fddc0 2024-09-11T22:06:31.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.463+0000 7f619c2e7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d68c31e050 con 0x55d68c408680 2024-09-11T22:06:31.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.463+0000 7f619c2e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d68c40b3d0 con 0x55d68c3fd4a0 2024-09-11T22:06:31.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.463+0000 7f619c2e7740 10 client.0 _ll_register_callbacks cb 0x55d68c35e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:31.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.463+0000 7f61937fe640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f617c0a2f00 0x7f617c0a53c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55d68c3fa890 tx=0x7f6184009260 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:31.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6193fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c407f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6193fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c407f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52982/0 (socket says 172.21.15.152:52982) 2024-09-11T22:06:31.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6193fff640 1 -- 172.21.15.152:0/582430660 learned_addr learned my addr 172.21.15.152:0/582430660 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:31.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6193fff640 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c408680 0x55d68c405780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6192ffd640 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c3fddc0 0x55d68c405240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6193fff640 1 -- 172.21.15.152:0/582430660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c408680 msgr2=0x55d68c405780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6193fff640 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c408680 0x55d68c405780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6193fff640 1 -- 172.21.15.152:0/582430660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c3fddc0 msgr2=0x55d68c405240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6193fff640 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c3fddc0 0x55d68c405240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6193fff640 1 -- 172.21.15.152:0/582430660 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d68c0d43c0 con 0x55d68c3fd4a0 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6193fff640 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c407f90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f61880107e0 tx=0x7f61880106e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6921228e586b141 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6172ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6172ffd640 1 -- 172.21.15.152:0/582430660 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618801d030 con 0x55d68c3fd4a0 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f6172ffd640 1 -- 172.21.15.152:0/582430660 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f6188010c90 con 0x55d68c3fd4a0 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.464+0000 7f619c2e7740 1 -- 172.21.15.152:0/582430660 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6188018920 con 0x55d68c3fd4a0 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f6172ffd640 1 -- 172.21.15.152:0/582430660 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6188005020 con 0x55d68c3fd4a0 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f619c2e7740 10 client.25519 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f619c2e7740 1 -- 172.21.15.152:0/582430660 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d68c438c70 con 0x55d68c3fd4a0 2024-09-11T22:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f6172ffd640 1 -- 172.21.15.152:0/582430660 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6188018920 con 0x55d68c3fd4a0 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f6172ffd640 1 -- 172.21.15.152:0/582430660 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f618802f440 con 0x55d68c3fd4a0 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f619c2e7740 10 client.25519 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f619c2e7740 10 client.25519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f619c2e7740 20 client.25519 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f619c2e7740 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d68c43a0d0 0x55d68c43c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f619c2e7740 4 client.25519 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f619c2e7740 1 -- 172.21.15.152:0/582430660 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d68c370850 con 0x55d68c43a0d0 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.465+0000 7f6192ffd640 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d68c43a0d0 0x55d68c43c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.466+0000 7f6192ffd640 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d68c43a0d0 0x55d68c43c4c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e30a43ffe1e97e5 server_cookie=1243d17d7bce1b2a in_seq=0 out_seq=0 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.466+0000 7f6172ffd640 10 client.25519 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f6172ffd640 1 -- 172.21.15.152:0/582430660 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d68c370850 con 0x55d68c43a0d0 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f6172ffd640 10 client.25519 handle_command_reply: tid=0 2024-09-11T22:06:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 1 client.25519 shutdown 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 1 -- 172.21.15.152:0/582430660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 msgr2=0x55d68c407f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c407f90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f61880107e0 tx=0x7f61880106e0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 1 -- 172.21.15.152:0/582430660 shutdown_connections 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d68c43a0d0 0x55d68c43c4c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c408680 0x55d68c405780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c3fddc0 0x55d68c405240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 1 --2- 172.21.15.152:0/582430660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c407f90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 1 -- 172.21.15.152:0/582430660 >> 172.21.15.152:0/582430660 conn(0x55d68c3f9a30 msgr2=0x55d68c3ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f6172ffd640 0 client.25519 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 1 -- 172.21.15.152:0/582430660 shutdown_connections 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 1 -- 172.21.15.152:0/582430660 wait complete. 2024-09-11T22:06:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.467+0000 7f619c2e7740 20 client.25519 trim_cache size 0 max 16384 2024-09-11T22:06:31.479 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:31.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.489+0000 7f619c2e7740 1 Processor -- start 2024-09-11T22:06:31.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.489+0000 7f619c2e7740 1 -- start start 2024-09-11T22:06:31.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.489+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 0x55d68c3f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.489+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 0x55d68c3f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.489+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c408680 0x55d68c441bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f619c2e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f61800111d0 con 0x55d68c408680 2024-09-11T22:06:31.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f619c2e7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f618000ea70 con 0x55d68c3fd4a0 2024-09-11T22:06:31.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f619c2e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f618000c8c0 con 0x55d68c3fddc0 2024-09-11T22:06:31.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6192ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 0x55d68c3f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6193fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 0x55d68c3f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6192ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 0x55d68c3f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52998/0 (socket says 172.21.15.152:52998) 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6192ffd640 1 -- 172.21.15.152:0/4234695857 learned_addr learned my addr 172.21.15.152:0/4234695857 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6193fff640 1 --2- 172.21.15.152:0/4234695857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c408680 0x55d68c441bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6192ffd640 1 -- 172.21.15.152:0/4234695857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 msgr2=0x55d68c3f9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6192ffd640 1 --2- 172.21.15.152:0/4234695857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 0x55d68c3f9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6192ffd640 1 -- 172.21.15.152:0/4234695857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c408680 msgr2=0x55d68c441bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6192ffd640 1 --2- 172.21.15.152:0/4234695857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c408680 0x55d68c441bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6192ffd640 1 -- 172.21.15.152:0/4234695857 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d68c4041f0 con 0x55d68c3fddc0 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6193fff640 1 --2- 172.21.15.152:0/4234695857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c408680 0x55d68c441bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f6192ffd640 1 --2- 172.21.15.152:0/4234695857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 0x55d68c3f8a60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f618c005fd0 tx=0x7f618c0099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f1f6f61d518ee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f61797fa640 1 -- 172.21.15.152:0/4234695857 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c003b70 con 0x55d68c3fddc0 2024-09-11T22:06:31.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f61797fa640 1 -- 172.21.15.152:0/4234695857 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f618c003d10 con 0x55d68c3fddc0 2024-09-11T22:06:31.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.490+0000 7f61797fa640 1 -- 172.21.15.152:0/4234695857 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c019850 con 0x55d68c3fddc0 2024-09-11T22:06:31.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.491+0000 7f619c2e7740 1 -- 172.21.15.152:0/4234695857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 msgr2=0x55d68c3f8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:31.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.491+0000 7f619c2e7740 1 --2- 172.21.15.152:0/4234695857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 0x55d68c3f8a60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f618c005fd0 tx=0x7f618c0099c0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.491+0000 7f619c2e7740 1 -- 172.21.15.152:0/4234695857 shutdown_connections 2024-09-11T22:06:31.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.491+0000 7f619c2e7740 1 --2- 172.21.15.152:0/4234695857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c408680 0x55d68c441bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.491+0000 7f619c2e7740 1 --2- 172.21.15.152:0/4234695857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fddc0 0x55d68c3f8a60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.491+0000 7f619c2e7740 1 --2- 172.21.15.152:0/4234695857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c3fd4a0 0x55d68c3f9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.491+0000 7f619c2e7740 1 -- 172.21.15.152:0/4234695857 >> 172.21.15.152:0/4234695857 conn(0x55d68c3f9a30 msgr2=0x55d68c3f8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.491+0000 7f619c2e7740 1 -- 172.21.15.152:0/4234695857 shutdown_connections 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.491+0000 7f619c2e7740 1 -- 172.21.15.152:0/4234695857 wait complete. 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.492+0000 7f619c2e7740 1 -- start start 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.492+0000 7f619c2e7740 1 Processor -- start 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.492+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c4106a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.492+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c3fddc0 0x55d68c410be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.492+0000 7f619c2e7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c408680 0x55d68c40dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.492+0000 7f619c2e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f618000cf30 con 0x55d68c3fddc0 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.492+0000 7f619c2e7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f618000e3a0 con 0x55d68c408680 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.492+0000 7f619c2e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f618000d600 con 0x55d68c3fd4a0 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.492+0000 7f619c2e7740 10 client.0 _ll_register_callbacks cb 0x7f618801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6193fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c4106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6192ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c3fddc0 0x55d68c410be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6193fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c4106a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:53000/0 (socket says 172.21.15.152:53000) 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6193fff640 1 -- 172.21.15.152:0/198379219 learned_addr learned my addr 172.21.15.152:0/198379219 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6192ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c3fddc0 0x55d68c410be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38740/0 (socket says 172.21.15.152:38740) 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6193fff640 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c408680 0x55d68c40dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6193fff640 1 -- 172.21.15.152:0/198379219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c408680 msgr2=0x55d68c40dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6193fff640 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c408680 0x55d68c40dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6193fff640 1 -- 172.21.15.152:0/198379219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c3fddc0 msgr2=0x55d68c410be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6193fff640 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c3fddc0 0x55d68c410be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6193fff640 1 -- 172.21.15.152:0/198379219 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d68c408300 con 0x55d68c3fd4a0 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6193fff640 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c4106a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61880106b0 tx=0x7f61880106e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83dd31804e4970b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6172ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6172ffd640 1 -- 172.21.15.152:0/198379219 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618801d070 con 0x55d68c3fd4a0 2024-09-11T22:06:31.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f6172ffd640 1 -- 172.21.15.152:0/198379219 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f6188010c90 con 0x55d68c3fd4a0 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.493+0000 7f619c2e7740 1 -- 172.21.15.152:0/198379219 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f618c003d10 con 0x55d68c3fd4a0 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f6172ffd640 1 -- 172.21.15.152:0/198379219 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f61880051c0 con 0x55d68c3fd4a0 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f619c2e7740 10 client.25525 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f619c2e7740 1 -- 172.21.15.152:0/198379219 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d68c4a44a0 con 0x55d68c3fd4a0 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f6172ffd640 1 -- 172.21.15.152:0/198379219 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f618c003d10 con 0x55d68c3fd4a0 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f6172ffd640 1 -- 172.21.15.152:0/198379219 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f6188038070 con 0x55d68c3fd4a0 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f619c2e7740 10 client.25525 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f619c2e7740 10 client.25525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f619c2e7740 20 client.25525 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f619c2e7740 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d68c4a4bf0 0x55d68c4a7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f619c2e7740 4 client.25525 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:06:31.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f619c2e7740 1 -- 172.21.15.152:0/198379219 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d68c36ad60 con 0x55d68c4a4bf0 2024-09-11T22:06:31.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.494+0000 7f6192ffd640 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d68c4a4bf0 0x55d68c4a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:31.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f6172ffd640 10 client.25525 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:31.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f6192ffd640 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d68c4a4bf0 0x55d68c4a7010 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2db34857f3dc3ac server_cookie=5b1c4e895260744d in_seq=0 out_seq=0 2024-09-11T22:06:31.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f6172ffd640 1 -- 172.21.15.152:0/198379219 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d68c36ad60 con 0x55d68c4a4bf0 2024-09-11T22:06:31.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f6172ffd640 10 client.25525 handle_command_reply: tid=0 2024-09-11T22:06:31.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 1 client.25525 shutdown 2024-09-11T22:06:31.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 1 -- 172.21.15.152:0/198379219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 msgr2=0x55d68c4106a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:31.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c4106a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61880106b0 tx=0x7f61880106e0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 1 -- 172.21.15.152:0/198379219 shutdown_connections 2024-09-11T22:06:31.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d68c4a4bf0 0x55d68c4a7010 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d68c408680 0x55d68c40dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f6172ffd640 0 client.25525 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:31.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68c3fddc0 0x55d68c410be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 1 --2- 172.21.15.152:0/198379219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d68c3fd4a0 0x55d68c4106a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 1 -- 172.21.15.152:0/198379219 >> 172.21.15.152:0/198379219 conn(0x55d68c3f9a30 msgr2=0x55d68c3f8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:31.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 1 -- 172.21.15.152:0/198379219 shutdown_connections 2024-09-11T22:06:31.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 1 -- 172.21.15.152:0/198379219 wait complete. 2024-09-11T22:06:31.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.495+0000 7f619c2e7740 20 client.25525 trim_cache size 0 max 16384 2024-09-11T22:06:31.502 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:06:31.504 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:06:31.504 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:06:31.505 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:06:31.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 -- 172.21.15.152:0/2044535169 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f617c0a2f00 msgr2=0x7f617c0a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:31.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f617c0a2f00 0x7f617c0a53c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55d68c3fa890 tx=0x7f6184009260 comp rx=0 tx=0).stop 2024-09-11T22:06:31.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 -- 172.21.15.152:0/2044535169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6194100e20 msgr2=0x7f619406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:31.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6194100e20 0x7f619406db60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6184005ab0 tx=0x7f61840040f0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 -- 172.21.15.152:0/2044535169 shutdown_connections 2024-09-11T22:06:31.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f617c0a2f00 0x7f617c0a53c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6194102ef0 0x7f6194072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6194102570 0x7f619406e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 --2- 172.21.15.152:0/2044535169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6194100e20 0x7f619406db60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:31.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 -- 172.21.15.152:0/2044535169 >> 172.21.15.152:0/2044535169 conn(0x7f61940fc7d0 msgr2=0x7f61940fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:31.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 -- 172.21.15.152:0/2044535169 shutdown_connections 2024-09-11T22:06:31.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:31.496+0000 7f6199f0e640 1 -- 172.21.15.152:0/2044535169 wait complete. 2024-09-11T22:06:32.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:31 smithi152 ceph-mon[31188]: pgmap v70: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 841 KiB/s wr, 89 op/s 2024-09-11T22:06:32.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:31 smithi179 ceph-mon[35603]: pgmap v70: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 841 KiB/s wr, 89 op/s 2024-09-11T22:06:32.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:31 smithi193 ceph-mon[35545]: pgmap v70: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 841 KiB/s wr, 89 op/s 2024-09-11T22:06:32.366 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:06:32.366 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:06:32.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 -- 172.21.15.152:0/3287281426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c10e450 msgr2=0x7f333c110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 --2- 172.21.15.152:0/3287281426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c10e450 0x7f333c110840 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3334009ca0 tx=0x7f333402a950 comp rx=0 tx=0).stop 2024-09-11T22:06:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 -- 172.21.15.152:0/3287281426 shutdown_connections 2024-09-11T22:06:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 --2- 172.21.15.152:0/3287281426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c10e450 0x7f333c110840 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 --2- 172.21.15.152:0/3287281426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f333c074e30 0x7f333c10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 --2- 172.21.15.152:0/3287281426 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c074510 0x7f333c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 -- 172.21.15.152:0/3287281426 >> 172.21.15.152:0/3287281426 conn(0x7f333c0fd8f0 msgr2=0x7f333c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 -- 172.21.15.152:0/3287281426 shutdown_connections 2024-09-11T22:06:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 -- 172.21.15.152:0/3287281426 wait complete. 2024-09-11T22:06:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 Processor -- start 2024-09-11T22:06:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 -- start start 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f333c074510 0x7f333c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.584+0000 7f3342929640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c074e30 0x7f333c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3342929640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c10e450 0x7f333c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3342929640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1141e0 con 0x7f333c10e450 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3342929640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f333c114060 con 0x7f333c074510 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3342929640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f333c114360 con 0x7f333c074e30 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3340ec6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c10e450 0x7f333c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3340ec6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c10e450 0x7f333c19efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38756/0 (socket says 172.21.15.152:38756) 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3340ec6640 1 -- 172.21.15.152:0/2037517724 learned_addr learned my addr 172.21.15.152:0/2037517724 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f333bfff640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f333c074510 0x7f333c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3333fff640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c074e30 0x7f333c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3340ec6640 1 -- 172.21.15.152:0/2037517724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c074e30 msgr2=0x7f333c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3340ec6640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c074e30 0x7f333c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3340ec6640 1 -- 172.21.15.152:0/2037517724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f333c074510 msgr2=0x7f333c19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3340ec6640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f333c074510 0x7f333c19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3340ec6640 1 -- 172.21.15.152:0/2037517724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c19f6a0 con 0x7f333c10e450 2024-09-11T22:06:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3340ec6640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c10e450 0x7f333c19efc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3334006010 tx=0x7f333402f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3339ffb640 1 -- 172.21.15.152:0/2037517724 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334034040 con 0x7f333c10e450 2024-09-11T22:06:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3339ffb640 1 -- 172.21.15.152:0/2037517724 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3334003e00 con 0x7f333c10e450 2024-09-11T22:06:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3339ffb640 1 -- 172.21.15.152:0/2037517724 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33340456e0 con 0x7f333c10e450 2024-09-11T22:06:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3342929640 1 -- 172.21.15.152:0/2037517724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333c19f930 con 0x7f333c10e450 2024-09-11T22:06:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.585+0000 7f3342929640 1 -- 172.21.15.152:0/2037517724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333c1a7270 con 0x7f333c10e450 2024-09-11T22:06:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.588+0000 7f3339ffb640 1 -- 172.21.15.152:0/2037517724 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3334037020 con 0x7f333c10e450 2024-09-11T22:06:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.588+0000 7f3344d02740 1 Processor -- start 2024-09-11T22:06:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.588+0000 7f3344d02740 1 -- start start 2024-09-11T22:06:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3344d02740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fd3060 0x5625e3fd3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3344d02740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fddd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3344d02740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fde240 0x5625e3fe0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3344d02740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5625e3f38620 con 0x5625e3fd3980 2024-09-11T22:06:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3344d02740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5625e3edfe50 con 0x5625e3fd3060 2024-09-11T22:06:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3344d02740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5625e3f345e0 con 0x5625e3fde240 2024-09-11T22:06:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3339ffb640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f33280a2cf0 0x7f33280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f333bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f333bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fddd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38772/0 (socket says 172.21.15.152:38772) 2024-09-11T22:06:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3333fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fde240 0x5625e3fe0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f333bfff640 1 -- 172.21.15.152:0/3475879934 learned_addr learned my addr 172.21.15.152:0/3475879934 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3333fff640 1 --2- 172.21.15.152:0/3475879934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fd3060 0x5625e3fd3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3340ec6640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f33280a2cf0 0x7f33280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3339ffb640 1 -- 172.21.15.152:0/2037517724 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f33340f05b0 con 0x7f333c10e450 2024-09-11T22:06:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3333fff640 1 -- 172.21.15.152:0/3475879934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fd3060 msgr2=0x5625e3fd3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3333fff640 1 --2- 172.21.15.152:0/3475879934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fd3060 0x5625e3fd3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.589+0000 7f3333fff640 1 -- 172.21.15.152:0/3475879934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 msgr2=0x5625e3fddd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.590+0000 7f3333fff640 1 --2- 172.21.15.152:0/3475879934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fddd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.590+0000 7f3333fff640 1 -- 172.21.15.152:0/3475879934 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e3ed0d40 con 0x5625e3fde240 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.590+0000 7f333bfff640 1 --2- 172.21.15.152:0/3475879934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fddd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.590+0000 7f3340ec6640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f33280a2cf0 0x7f33280a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f33340ede90 tx=0x7f3334041c60 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.590+0000 7f3333fff640 1 --2- 172.21.15.152:0/3475879934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fde240 0x5625e3fe0630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3324016470 tx=0x7f332400a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1fa7ad3ff44b09f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.590+0000 7f33327fc640 1 -- 172.21.15.152:0/3475879934 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324016df0 con 0x5625e3fde240 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.590+0000 7f33327fc640 1 -- 172.21.15.152:0/3475879934 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3324018910 con 0x5625e3fde240 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.590+0000 7f33327fc640 1 -- 172.21.15.152:0/3475879934 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324017840 con 0x5625e3fde240 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.591+0000 7f3344d02740 1 -- 172.21.15.152:0/3475879934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fde240 msgr2=0x5625e3fe0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.591+0000 7f3344d02740 1 --2- 172.21.15.152:0/3475879934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fde240 0x5625e3fe0630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3324016470 tx=0x7f332400a230 comp rx=0 tx=0).stop 2024-09-11T22:06:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.591+0000 7f3344d02740 1 -- 172.21.15.152:0/3475879934 shutdown_connections 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.591+0000 7f3344d02740 1 --2- 172.21.15.152:0/3475879934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fde240 0x5625e3fe0630 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.591+0000 7f3344d02740 1 --2- 172.21.15.152:0/3475879934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fddd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.591+0000 7f3344d02740 1 --2- 172.21.15.152:0/3475879934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fd3060 0x5625e3fd3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.591+0000 7f3344d02740 1 -- 172.21.15.152:0/3475879934 >> 172.21.15.152:0/3475879934 conn(0x5625e3fcf5f0 msgr2=0x5625e3fcf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.591+0000 7f3344d02740 1 -- 172.21.15.152:0/3475879934 shutdown_connections 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.591+0000 7f3344d02740 1 -- 172.21.15.152:0/3475879934 wait complete. 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.591+0000 7f3344d02740 1 -- start start 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3344d02740 1 Processor -- start 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3344d02740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3060 0x5625e3fdb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3344d02740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fd3980 0x5625e3fdb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3344d02740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fde240 0x5625e3fdbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3344d02740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5625e3fe0e10 con 0x5625e3fd3060 2024-09-11T22:06:32.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3344d02740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5625e3ec0f10 con 0x5625e3fde240 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3344d02740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5625e3fe0f90 con 0x5625e3fd3980 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3344d02740 10 client.0 _ll_register_callbacks cb 0x5625e3ee4db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3333fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3060 0x5625e3fdb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3333fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3060 0x5625e3fdb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38778/0 (socket says 172.21.15.152:38778) 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3333fff640 1 -- 172.21.15.152:0/2474080649 learned_addr learned my addr 172.21.15.152:0/2474080649 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f333bfff640 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fd3980 0x5625e3fdb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3333fff640 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fde240 0x5625e3fdbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3333fff640 1 -- 172.21.15.152:0/2474080649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fd3980 msgr2=0x5625e3fdb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3333fff640 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fd3980 0x5625e3fdb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3333fff640 1 -- 172.21.15.152:0/2474080649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fde240 msgr2=0x5625e3fdbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3333fff640 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fde240 0x5625e3fdbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.592+0000 7f3333fff640 1 -- 172.21.15.152:0/2474080649 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625e3c47580 con 0x5625e3fd3060 2024-09-11T22:06:32.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.593+0000 7f3333fff640 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3060 0x5625e3fdb110 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f332401a040 tx=0x7f3324017520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd360373f56f83c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:32.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.593+0000 7f331b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:06:32.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.593+0000 7f331b7fe640 1 -- 172.21.15.152:0/2474080649 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324029060 con 0x5625e3fd3060 2024-09-11T22:06:32.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.593+0000 7f331b7fe640 1 -- 172.21.15.152:0/2474080649 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3324017600 con 0x5625e3fd3060 2024-09-11T22:06:32.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.593+0000 7f3344d02740 1 -- 172.21.15.152:0/2474080649 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3324018910 con 0x5625e3fd3060 2024-09-11T22:06:32.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.593+0000 7f331b7fe640 1 -- 172.21.15.152:0/2474080649 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f33240059c0 con 0x5625e3fd3060 2024-09-11T22:06:32.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.593+0000 7f3344d02740 10 client.15888 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:32.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.593+0000 7f3344d02740 1 -- 172.21.15.152:0/2474080649 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5625e3d11960 con 0x5625e3fd3060 2024-09-11T22:06:32.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.593+0000 7f331b7fe640 1 -- 172.21.15.152:0/2474080649 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3324017ce0 con 0x5625e3fd3060 2024-09-11T22:06:32.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.593+0000 7f331b7fe640 1 -- 172.21.15.152:0/2474080649 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f3324012050 con 0x5625e3fd3060 2024-09-11T22:06:32.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.593+0000 7f3344d02740 10 client.15888 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:32.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.594+0000 7f3344d02740 10 client.15888 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:06:32.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.594+0000 7f3344d02740 20 client.15888 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:32.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.594+0000 7f3344d02740 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5625e3fedd80 0x5625e3ff0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.594+0000 7f3344d02740 4 client.15888 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:32.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.594+0000 7f3344d02740 1 -- 172.21.15.152:0/2474080649 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3324018910 con 0x5625e3fedd80 2024-09-11T22:06:32.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.594+0000 7f333bfff640 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5625e3fedd80 0x5625e3ff0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.594+0000 7f331b7fe640 10 client.15888 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:32.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.594+0000 7f333bfff640 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5625e3fedd80 0x5625e3ff0170 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19c40a1143d239a4 server_cookie=ba54c6a3be2a23ba in_seq=0 out_seq=0 2024-09-11T22:06:32.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f331b7fe640 1 -- 172.21.15.152:0/2474080649 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3324018910 con 0x5625e3fedd80 2024-09-11T22:06:32.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f331b7fe640 10 client.15888 handle_command_reply: tid=0 2024-09-11T22:06:32.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 1 client.15888 shutdown 2024-09-11T22:06:32.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 1 -- 172.21.15.152:0/2474080649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3060 msgr2=0x5625e3fdb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:32.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3060 0x5625e3fdb110 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f332401a040 tx=0x7f3324017520 comp rx=0 tx=0).stop 2024-09-11T22:06:32.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 1 -- 172.21.15.152:0/2474080649 shutdown_connections 2024-09-11T22:06:32.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5625e3fedd80 0x5625e3ff0170 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fde240 0x5625e3fdbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fd3980 0x5625e3fdb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 1 --2- 172.21.15.152:0/2474080649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3060 0x5625e3fdb110 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 1 -- 172.21.15.152:0/2474080649 >> 172.21.15.152:0/2474080649 conn(0x5625e3fcf5f0 msgr2=0x5625e3fd5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:32.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f331b7fe640 0 client.15888 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:32.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 1 -- 172.21.15.152:0/2474080649 shutdown_connections 2024-09-11T22:06:32.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 1 -- 172.21.15.152:0/2474080649 wait complete. 2024-09-11T22:06:32.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.595+0000 7f3344d02740 20 client.15888 trim_cache size 0 max 16384 2024-09-11T22:06:32.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f3344d02740 1 Processor -- start 2024-09-11T22:06:32.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f3344d02740 1 -- start start 2024-09-11T22:06:32.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f3344d02740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fd3060 0x5625e3fd6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f3344d02740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fd51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f3344d02740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fde240 0x5625e3ff5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f3344d02740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1b2450 con 0x5625e3fd3980 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f3344d02740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1afcf0 con 0x5625e3fde240 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f3344d02740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1adb40 con 0x5625e3fd3060 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f333bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fd51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f333bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fd51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38784/0 (socket says 172.21.15.152:38784) 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f333bfff640 1 -- 172.21.15.152:0/3414632326 learned_addr learned my addr 172.21.15.152:0/3414632326 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f3333fff640 1 --2- 172.21.15.152:0/3414632326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fde240 0x5625e3ff5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f3333fff640 1 --2- 172.21.15.152:0/3414632326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fd3060 0x5625e3fd6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f333bfff640 1 -- 172.21.15.152:0/3414632326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fd3060 msgr2=0x5625e3fd6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:32.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f333bfff640 1 --2- 172.21.15.152:0/3414632326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fd3060 0x5625e3fd6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f333bfff640 1 -- 172.21.15.152:0/3414632326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fde240 msgr2=0x5625e3ff5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:32.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f333bfff640 1 --2- 172.21.15.152:0/3414632326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fde240 0x5625e3ff5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.614+0000 7f333bfff640 1 -- 172.21.15.152:0/3414632326 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e3fdd050 con 0x5625e3fd3980 2024-09-11T22:06:32.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.615+0000 7f333bfff640 1 --2- 172.21.15.152:0/3414632326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fd51c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x5625e3fda9a0 tx=0x7f332c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947471587fab70e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:32.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.615+0000 7f3331ffb640 1 -- 172.21.15.152:0/3414632326 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c004220 con 0x5625e3fd3980 2024-09-11T22:06:32.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.615+0000 7f3331ffb640 1 -- 172.21.15.152:0/3414632326 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f332c010e40 con 0x5625e3fd3980 2024-09-11T22:06:32.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.615+0000 7f3331ffb640 1 -- 172.21.15.152:0/3414632326 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c004d60 con 0x5625e3fd3980 2024-09-11T22:06:32.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.616+0000 7f3344d02740 1 -- 172.21.15.152:0/3414632326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 msgr2=0x5625e3fd51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:32.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.616+0000 7f3344d02740 1 --2- 172.21.15.152:0/3414632326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fd51c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x5625e3fda9a0 tx=0x7f332c010800 comp rx=0 tx=0).stop 2024-09-11T22:06:32.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.616+0000 7f3344d02740 1 -- 172.21.15.152:0/3414632326 shutdown_connections 2024-09-11T22:06:32.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.616+0000 7f3344d02740 1 --2- 172.21.15.152:0/3414632326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fde240 0x5625e3ff5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.616+0000 7f3344d02740 1 --2- 172.21.15.152:0/3414632326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fd51c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.616+0000 7f3344d02740 1 --2- 172.21.15.152:0/3414632326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fd3060 0x5625e3fd6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.616+0000 7f3344d02740 1 -- 172.21.15.152:0/3414632326 >> 172.21.15.152:0/3414632326 conn(0x5625e3fcf5f0 msgr2=0x5625e3fd4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:32.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.616+0000 7f3344d02740 1 -- 172.21.15.152:0/3414632326 shutdown_connections 2024-09-11T22:06:32.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.616+0000 7f3344d02740 1 -- 172.21.15.152:0/3414632326 wait complete. 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.616+0000 7f3344d02740 1 -- start start 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.616+0000 7f3344d02740 1 Processor -- start 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f3344d02740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fd3060 0x5625e3fe2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f3344d02740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fe26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f3344d02740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fde240 0x5625e3fe2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f3344d02740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1ae1b0 con 0x5625e3fd3980 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f3344d02740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1af620 con 0x5625e3fd3060 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f3344d02740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1ae880 con 0x5625e3fde240 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f3344d02740 10 client.0 _ll_register_callbacks cb 0x7f3324016370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f333bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fe26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f333bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fe26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38792/0 (socket says 172.21.15.152:38792) 2024-09-11T22:06:32.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f333bfff640 1 -- 172.21.15.152:0/235795955 learned_addr learned my addr 172.21.15.152:0/235795955 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f3333fff640 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fd3060 0x5625e3fe2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f3333fff640 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fde240 0x5625e3fe2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f333bfff640 1 -- 172.21.15.152:0/235795955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fde240 msgr2=0x5625e3fe2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f333bfff640 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fde240 0x5625e3fe2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f333bfff640 1 -- 172.21.15.152:0/235795955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fd3060 msgr2=0x5625e3fe2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f333bfff640 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fd3060 0x5625e3fe2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f333bfff640 1 -- 172.21.15.152:0/235795955 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625e4057960 con 0x5625e3fd3980 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f333bfff640 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fe26b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f332c0048d0 tx=0x7f332c0049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67e04399c995d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.617+0000 7f331b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f331b7fe640 1 -- 172.21.15.152:0/235795955 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c005050 con 0x5625e3fd3980 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f331b7fe640 1 -- 172.21.15.152:0/235795955 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f332c0051f0 con 0x5625e3fd3980 2024-09-11T22:06:32.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f3344d02740 1 -- 172.21.15.152:0/235795955 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5625e3fd6d30 con 0x5625e3fd3980 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f331b7fe640 1 -- 172.21.15.152:0/235795955 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f332c005430 con 0x5625e3fd3980 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f3344d02740 10 client.15894 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f3344d02740 1 -- 172.21.15.152:0/235795955 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5625e4058c60 con 0x5625e3fd3980 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f331b7fe640 1 -- 172.21.15.152:0/235795955 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5625e3fd6d30 con 0x5625e3fd3980 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f331b7fe640 1 -- 172.21.15.152:0/235795955 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f332c025620 con 0x5625e3fd3980 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f3344d02740 10 client.15894 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f3344d02740 10 client.15894 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f3344d02740 20 client.15894 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f3344d02740 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5625e4059400 0x5625e405b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f3344d02740 4 client.15894 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "96655348", "release": true, "await": true}] 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.618+0000 7f3344d02740 1 -- 172.21.15.152:0/235795955 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "96655348", "release": true, "await": true}) -- 0x5625e3f45b90 con 0x5625e4059400 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.619+0000 7f3333fff640 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5625e4059400 0x5625e405b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:32.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.619+0000 7f331b7fe640 10 client.15894 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:32.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.619+0000 7f3333fff640 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5625e4059400 0x5625e405b820 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c6e5df7d1fdc290 server_cookie=36383a37720bf575 in_seq=0 out_seq=0 2024-09-11T22:06:32.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.670+0000 7f331b7fe640 1 -- 172.21.15.152:0/235795955 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5625e3f45b90 con 0x5625e4059400 2024-09-11T22:06:32.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.670+0000 7f331b7fe640 10 client.15894 handle_command_reply: tid=0 2024-09-11T22:06:32.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.670+0000 7f3344d02740 1 client.15894 shutdown 2024-09-11T22:06:32.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.671+0000 7f3344d02740 1 -- 172.21.15.152:0/235795955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 msgr2=0x5625e3fe26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:32.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.671+0000 7f3344d02740 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fe26b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f332c0048d0 tx=0x7f332c0049e0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.671+0000 7f3344d02740 1 -- 172.21.15.152:0/235795955 shutdown_connections 2024-09-11T22:06:32.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.671+0000 7f3344d02740 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5625e4059400 0x5625e405b820 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.671+0000 7f3344d02740 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5625e3fde240 0x5625e3fe2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.671+0000 7f3344d02740 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5625e3fd3980 0x5625e3fe26b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.671+0000 7f331b7fe640 0 client.15894 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:32.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.671+0000 7f3344d02740 1 --2- 172.21.15.152:0/235795955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625e3fd3060 0x5625e3fe2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.671+0000 7f3344d02740 1 -- 172.21.15.152:0/235795955 >> 172.21.15.152:0/235795955 conn(0x5625e3fcf5f0 msgr2=0x5625e3fdb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:32.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.672+0000 7f3344d02740 1 -- 172.21.15.152:0/235795955 shutdown_connections 2024-09-11T22:06:32.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.672+0000 7f3344d02740 1 -- 172.21.15.152:0/235795955 wait complete. 2024-09-11T22:06:32.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.672+0000 7f3344d02740 20 client.15894 trim_cache size 0 max 16384 2024-09-11T22:06:32.676 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:06:32.676 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 27, 2024-09-11T22:06:32.676 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:06:32.676 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 8, 2024-09-11T22:06:32.676 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:06:32.676 INFO:teuthology.orchestra.run.smithi152.stdout: "96655348": { 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 8, 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 133.4, 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:06:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:06:32.678 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:06:32.678 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:32.678 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:32.678 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:32.678 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:32.678 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:32.678 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:06:32.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.673+0000 7f3342929640 1 -- 172.21.15.152:0/2037517724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f33280a2cf0 msgr2=0x7f33280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:32.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.673+0000 7f3342929640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f33280a2cf0 0x7f33280a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f33340ede90 tx=0x7f3334041c60 comp rx=0 tx=0).stop 2024-09-11T22:06:32.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.673+0000 7f3342929640 1 -- 172.21.15.152:0/2037517724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c10e450 msgr2=0x7f333c19efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:32.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.673+0000 7f3342929640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c10e450 0x7f333c19efc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3334006010 tx=0x7f333402f710 comp rx=0 tx=0).stop 2024-09-11T22:06:32.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.673+0000 7f3342929640 1 -- 172.21.15.152:0/2037517724 shutdown_connections 2024-09-11T22:06:32.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.673+0000 7f3342929640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f33280a2cf0 0x7f33280a51b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.673+0000 7f3342929640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c10e450 0x7f333c19efc0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.673+0000 7f3342929640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c074e30 0x7f333c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.673+0000 7f3342929640 1 --2- 172.21.15.152:0/2037517724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f333c074510 0x7f333c19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:32.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.673+0000 7f3342929640 1 -- 172.21.15.152:0/2037517724 >> 172.21.15.152:0/2037517724 conn(0x7f333c0fd8f0 msgr2=0x7f333c0ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:32.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.674+0000 7f3342929640 1 -- 172.21.15.152:0/2037517724 shutdown_connections 2024-09-11T22:06:32.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:32.674+0000 7f3342929640 1 -- 172.21.15.152:0/2037517724 wait complete. 2024-09-11T22:06:32.680 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:33.567 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '96655348', total seconds elapsed: 17.6 2024-09-11T22:06:33.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:33 smithi179 ceph-mon[35603]: pgmap v71: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 398 op/s 2024-09-11T22:06:33.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:33 smithi193 ceph-mon[35545]: pgmap v71: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 398 op/s 2024-09-11T22:06:33.831 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:33 smithi152 ceph-mon[31188]: pgmap v71: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 398 op/s 2024-09-11T22:06:33.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.863+0000 7f5b9f7fe640 1 -- 172.21.15.152:0/1204166417 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4004e20 con 0x7f5ba8109450 2024-09-11T22:06:33.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.863+0000 7f5baee86640 1 -- 172.21.15.152:0/1204166417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ba8109450 msgr2=0x7f5ba8109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:33.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.863+0000 7f5baee86640 1 --2- 172.21.15.152:0/1204166417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ba8109450 0x7f5ba8109830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40074e0 tx=0x7f5ba402b080 comp rx=0 tx=0).stop 2024-09-11T22:06:33.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.864+0000 7f5baee86640 1 -- 172.21.15.152:0/1204166417 shutdown_connections 2024-09-11T22:06:33.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.864+0000 7f5baee86640 1 --2- 172.21.15.152:0/1204166417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ba810ea80 0x7f5ba81154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:33.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.864+0000 7f5baee86640 1 --2- 172.21.15.152:0/1204166417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba8109e00 0x7f5ba810e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:33.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.864+0000 7f5baee86640 1 --2- 172.21.15.152:0/1204166417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ba8109450 0x7f5ba8109830 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:33.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.864+0000 7f5baee86640 1 -- 172.21.15.152:0/1204166417 >> 172.21.15.152:0/1204166417 conn(0x7f5ba806e2d0 msgr2=0x7f5ba806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:33.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.864+0000 7f5baee86640 1 -- 172.21.15.152:0/1204166417 shutdown_connections 2024-09-11T22:06:33.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.864+0000 7f5baee86640 1 -- 172.21.15.152:0/1204166417 wait complete. 2024-09-11T22:06:33.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.865+0000 7f5baee86640 1 Processor -- start 2024-09-11T22:06:33.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.865+0000 7f5baee86640 1 -- start start 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.865+0000 7f5baee86640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba8109450 0x7f5ba81a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.865+0000 7f5baee86640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ba8109e00 0x7f5ba81a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.865+0000 7f5baee86640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ba810ea80 0x7f5ba81a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.865+0000 7f5baee86640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8118610 con 0x7f5ba810ea80 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.865+0000 7f5baee86640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8118490 con 0x7f5ba8109450 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.865+0000 7f5baee86640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8118790 con 0x7f5ba8109e00 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.866+0000 7f5bacc22640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba8109450 0x7f5ba81a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.866+0000 7f5bacc22640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba8109450 0x7f5ba81a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47736/0 (socket says 172.21.15.152:47736) 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.866+0000 7f5bacc22640 1 -- 172.21.15.152:0/1965482747 learned_addr learned my addr 172.21.15.152:0/1965482747 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.866+0000 7f5b9ffff640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ba8109e00 0x7f5ba81a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.869+0000 7f5bacc22640 1 -- 172.21.15.152:0/1965482747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ba8109e00 msgr2=0x7f5ba81a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:33.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.869+0000 7f5bacc22640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ba8109e00 0x7f5ba81a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:33.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.869+0000 7f5bacc22640 1 -- 172.21.15.152:0/1965482747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ba810ea80 msgr2=0x7f5ba81a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:33.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.869+0000 7f5b9ffff640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ba8109e00 0x7f5ba81a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:06:33.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.869+0000 7f5bad423640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ba810ea80 0x7f5ba81a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:33.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.870+0000 7f5bacc22640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ba810ea80 0x7f5ba81a5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:33.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.870+0000 7f5bacc22640 1 -- 172.21.15.152:0/1965482747 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba81a5d40 con 0x7f5ba8109450 2024-09-11T22:06:33.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.870+0000 7f5bad423640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ba810ea80 0x7f5ba81a5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:06:33.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.871+0000 7f5bacc22640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba8109450 0x7f5ba81a0d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4000c00 tx=0x7f5ba40048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:33.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.872+0000 7f5b9dffb640 1 -- 172.21.15.152:0/1965482747 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4061020 con 0x7f5ba8109450 2024-09-11T22:06:33.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.872+0000 7f5baee86640 1 -- 172.21.15.152:0/1965482747 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba81a5fd0 con 0x7f5ba8109450 2024-09-11T22:06:33.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.872+0000 7f5baee86640 1 -- 172.21.15.152:0/1965482747 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba8074420 con 0x7f5ba8109450 2024-09-11T22:06:33.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.872+0000 7f5b9dffb640 1 -- 172.21.15.152:0/1965482747 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ba402bcc0 con 0x7f5ba8109450 2024-09-11T22:06:33.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.872+0000 7f5b9dffb640 1 -- 172.21.15.152:0/1965482747 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4059040 con 0x7f5ba8109450 2024-09-11T22:06:33.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.875+0000 7f5baee86640 1 -- 172.21.15.152:0/1965482747 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba8073f40 con 0x7f5ba8109450 2024-09-11T22:06:33.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.877+0000 7f5b9dffb640 1 -- 172.21.15.152:0/1965482747 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f5ba4064020 con 0x7f5ba8109450 2024-09-11T22:06:33.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.878+0000 7f5b9dffb640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5b900a2e40 0x7f5b900a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:33.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.879+0000 7f5b9dffb640 1 -- 172.21.15.152:0/1965482747 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f5ba4110c40 con 0x7f5ba8109450 2024-09-11T22:06:33.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.880+0000 7f5b9ffff640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5b900a2e40 0x7f5b900a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:33.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.880+0000 7f5b9ffff640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5b900a2e40 0x7f5b900a5300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80735e0 tx=0x7f5b98008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:33.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:33.882+0000 7f5b9dffb640 1 -- 172.21.15.152:0/1965482747 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ba406b020 con 0x7f5ba8109450 2024-09-11T22:06:34.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.278+0000 7f5baee86640 1 -- 172.21.15.152:0/1965482747 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ba81a2120 con 0x7f5ba8109450 2024-09-11T22:06:34.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.278+0000 7f5b9dffb640 1 -- 172.21.15.152:0/1965482747 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11927 (secure 0 0 0) 0x7f5ba81a2120 con 0x7f5ba8109450 2024-09-11T22:06:34.280 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:06:34.281 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":27,"btime":"2024-09-11T22:04:54:476799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:04:53.804306+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24457,24470,24472]},"id":1}]} 2024-09-11T22:06:34.281 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 27 2024-09-11T22:06:34.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.283+0000 7f5baee86640 1 -- 172.21.15.152:0/1965482747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5b900a2e40 msgr2=0x7f5b900a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:34.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.283+0000 7f5baee86640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5b900a2e40 0x7f5b900a5300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80735e0 tx=0x7f5b98008040 comp rx=0 tx=0).stop 2024-09-11T22:06:34.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.283+0000 7f5baee86640 1 -- 172.21.15.152:0/1965482747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba8109450 msgr2=0x7f5ba81a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:34.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.283+0000 7f5baee86640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba8109450 0x7f5ba81a0d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4000c00 tx=0x7f5ba40048f0 comp rx=0 tx=0).stop 2024-09-11T22:06:34.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.284+0000 7f5baee86640 1 -- 172.21.15.152:0/1965482747 shutdown_connections 2024-09-11T22:06:34.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.284+0000 7f5baee86640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5b900a2e40 0x7f5b900a5300 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:34.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.284+0000 7f5baee86640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ba810ea80 0x7f5ba81a5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:34.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.284+0000 7f5baee86640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ba8109e00 0x7f5ba81a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:34.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.284+0000 7f5baee86640 1 --2- 172.21.15.152:0/1965482747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba8109450 0x7f5ba81a0d90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:34.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.284+0000 7f5baee86640 1 -- 172.21.15.152:0/1965482747 >> 172.21.15.152:0/1965482747 conn(0x7f5ba806e2d0 msgr2=0x7f5ba810c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:34.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.284+0000 7f5baee86640 1 -- 172.21.15.152:0/1965482747 shutdown_connections 2024-09-11T22:06:34.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:34.284+0000 7f5baee86640 1 -- 172.21.15.152:0/1965482747 wait complete. 2024-09-11T22:06:34.683 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:34 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1965482747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:06:34.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:34 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1965482747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:06:34.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 60.0 s, 2761.0 tps, lat 112.700 ms stddev 1140.031 2024-09-11T22:06:34.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:34 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1965482747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:06:35.052 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:06:35.487 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:35.760 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:35 smithi152 ceph-mon[31188]: pgmap v72: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-09-11T22:06:35.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:35 smithi179 ceph-mon[35603]: pgmap v72: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-09-11T22:06:35.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:35 smithi193 ceph-mon[35545]: pgmap v72: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-09-11T22:06:35.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.981+0000 7f3b80907640 1 -- 172.21.15.152:0/2822865461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b7c100b30 msgr2=0x7f3b7c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:35.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.981+0000 7f3b80907640 1 --2- 172.21.15.152:0/2822865461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b7c100b30 0x7f3b7c100f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009ca0 tx=0x7f3b7402a940 comp rx=0 tx=0).stop 2024-09-11T22:06:35.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.981+0000 7f3b80907640 1 -- 172.21.15.152:0/2822865461 shutdown_connections 2024-09-11T22:06:35.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.981+0000 7f3b80907640 1 --2- 172.21.15.152:0/2822865461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c105f40 0x7f3b7c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:35.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.981+0000 7f3b80907640 1 --2- 172.21.15.152:0/2822865461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b7c101450 0x7f3b7c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:35.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.981+0000 7f3b80907640 1 --2- 172.21.15.152:0/2822865461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b7c100b30 0x7f3b7c100f10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:35.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.981+0000 7f3b80907640 1 -- 172.21.15.152:0/2822865461 >> 172.21.15.152:0/2822865461 conn(0x7f3b7c0fc7a0 msgr2=0x7f3b7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:35.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.983+0000 7f3b80907640 1 -- 172.21.15.152:0/2822865461 shutdown_connections 2024-09-11T22:06:35.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.983+0000 7f3b80907640 1 -- 172.21.15.152:0/2822865461 wait complete. 2024-09-11T22:06:35.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.984+0000 7f3b80907640 1 Processor -- start 2024-09-11T22:06:35.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.984+0000 7f3b80907640 1 -- start start 2024-09-11T22:06:35.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b80907640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b7c100b30 0x7f3b7c073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:35.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b80907640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b7c101450 0x7f3b7c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:35.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b80907640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c105f40 0x7f3b7c06e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:35.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b80907640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c06c660 con 0x7f3b7c100b30 2024-09-11T22:06:35.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b80907640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c06c4e0 con 0x7f3b7c105f40 2024-09-11T22:06:35.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b80907640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c06c7e0 con 0x7f3b7c101450 2024-09-11T22:06:35.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b79d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b7c101450 0x7f3b7c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:35.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b7ad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c105f40 0x7f3b7c06e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:35.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b79d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b7c101450 0x7f3b7c06dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:53994/0 (socket says 172.21.15.152:53994) 2024-09-11T22:06:35.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b7a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b7c100b30 0x7f3b7c073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:35.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b79d9b640 1 -- 172.21.15.152:0/4091643624 learned_addr learned my addr 172.21.15.152:0/4091643624 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:35.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b7ad9d640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c105f40 0x7f3b7c06e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47764/0 (socket says 172.21.15.152:47764) 2024-09-11T22:06:35.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.985+0000 7f3b7ad9d640 1 -- 172.21.15.152:0/4091643624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b7c101450 msgr2=0x7f3b7c06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:35.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.986+0000 7f3b7ad9d640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b7c101450 0x7f3b7c06dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:35.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.986+0000 7f3b7ad9d640 1 -- 172.21.15.152:0/4091643624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b7c100b30 msgr2=0x7f3b7c073bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:35.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.986+0000 7f3b7ad9d640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b7c100b30 0x7f3b7c073bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:35.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.986+0000 7f3b7ad9d640 1 -- 172.21.15.152:0/4091643624 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c06e980 con 0x7f3b7c105f40 2024-09-11T22:06:35.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.986+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b7c100b30 0x7f3b7c073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:35.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.986+0000 7f3b7ad9d640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c105f40 0x7f3b7c06e1b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000e970 tx=0x7f3b7000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:35.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.986+0000 7f3b6b7fe640 1 -- 172.21.15.152:0/4091643624 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000ccc0 con 0x7f3b7c105f40 2024-09-11T22:06:35.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.986+0000 7f3b80907640 1 -- 172.21.15.152:0/4091643624 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c1b38a0 con 0x7f3b7c105f40 2024-09-11T22:06:35.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.986+0000 7f3b80907640 1 -- 172.21.15.152:0/4091643624 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c1b3db0 con 0x7f3b7c105f40 2024-09-11T22:06:35.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.990+0000 7f3b82ce0740 1 Processor -- start 2024-09-11T22:06:35.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.990+0000 7f3b6b7fe640 1 -- 172.21.15.152:0/4091643624 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b70005020 con 0x7f3b7c105f40 2024-09-11T22:06:35.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.990+0000 7f3b6b7fe640 1 -- 172.21.15.152:0/4091643624 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000ccc0 con 0x7f3b7c105f40 2024-09-11T22:06:35.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.991+0000 7f3b82ce0740 1 -- start start 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.993+0000 7f3b6b7fe640 1 -- 172.21.15.152:0/4091643624 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3b700047c0 con 0x7f3b7c105f40 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.993+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 0x5624f9065f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.993+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f90643e0 0x5624f9064840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f9064e60 0x5624f9071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5624f8fca2f0 con 0x5624f9065b40 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5624f8f71cf0 con 0x5624f90643e0 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5624f8fc62b0 con 0x5624f9064e60 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b7a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f90643e0 0x5624f9064840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b7a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f90643e0 0x5624f9064840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47770/0 (socket says 172.21.15.152:47770) 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b7a59c640 1 -- 172.21.15.152:0/2832659181 learned_addr learned my addr 172.21.15.152:0/2832659181 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b79d9b640 1 --2- 172.21.15.152:0/2832659181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f9064e60 0x5624f9071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:35.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b79d9b640 1 --2- 172.21.15.152:0/2832659181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 0x5624f9065f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b7a59c640 1 -- 172.21.15.152:0/2832659181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f9064e60 msgr2=0x5624f9071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/2832659181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f9064e60 0x5624f9071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b7a59c640 1 -- 172.21.15.152:0/2832659181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 msgr2=0x5624f9065f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/2832659181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 0x5624f9065f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.994+0000 7f3b7a59c640 1 -- 172.21.15.152:0/2832659181 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f8f563a0 con 0x5624f90643e0 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.995+0000 7f3b6b7fe640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b640a2ff0 0x7f3b640a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.996+0000 7f3b6b7fe640 1 -- 172.21.15.152:0/4091643624 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3b700cf3d0 con 0x7f3b7c105f40 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.996+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/2832659181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f90643e0 0x5624f9064840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009ca0 tx=0x7f3b74009970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38eb8faefe9ed345 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.996+0000 7f3b79d9b640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b640a2ff0 0x7f3b640a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.996+0000 7f3b80907640 1 -- 172.21.15.152:0/2832659181 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74034040 con 0x5624f90643e0 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.997+0000 7f3b80907640 1 -- 172.21.15.152:0/2832659181 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b740309f0 con 0x5624f90643e0 2024-09-11T22:06:36.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.997+0000 7f3b80907640 1 -- 172.21.15.152:0/2832659181 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7402f950 con 0x5624f90643e0 2024-09-11T22:06:36.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.998+0000 7f3b82ce0740 1 -- 172.21.15.152:0/2832659181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f90643e0 msgr2=0x5624f9064840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:36.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.998+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/2832659181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f90643e0 0x5624f9064840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009ca0 tx=0x7f3b74009970 comp rx=0 tx=0).stop 2024-09-11T22:06:36.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.998+0000 7f3b79d9b640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b640a2ff0 0x7f3b640a54b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00b6c0 tx=0x7f3b6c00b3d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:36.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.998+0000 7f3b82ce0740 1 -- 172.21.15.152:0/2832659181 shutdown_connections 2024-09-11T22:06:36.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.998+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/2832659181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f9064e60 0x5624f9071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.998+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/2832659181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f90643e0 0x5624f9064840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.998+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/2832659181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 0x5624f9065f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.998+0000 7f3b82ce0740 1 -- 172.21.15.152:0/2832659181 >> 172.21.15.152:0/2832659181 conn(0x5624f902d310 msgr2=0x5624f9060f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:36.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:35.999+0000 7f3b82ce0740 1 -- 172.21.15.152:0/2832659181 shutdown_connections 2024-09-11T22:06:36.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.000+0000 7f3b82ce0740 1 -- 172.21.15.152:0/2832659181 wait complete. 2024-09-11T22:06:36.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b82ce0740 1 -- start start 2024-09-11T22:06:36.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b82ce0740 1 Processor -- start 2024-09-11T22:06:36.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f90714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 0x5624f906e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 0x5624f906ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5624f9072010 con 0x5624f9065b40 2024-09-11T22:06:36.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5624f8f85060 con 0x5624f9064e60 2024-09-11T22:06:36.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5624f9072190 con 0x5624f90643e0 2024-09-11T22:06:36.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b82ce0740 10 client.0 _ll_register_callbacks cb 0x5624f8cd88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:36.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b7a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f90714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b7a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f90714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54016/0 (socket says 172.21.15.152:54016) 2024-09-11T22:06:36.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.001+0000 7f3b7a59c640 1 -- 172.21.15.152:0/1849859545 learned_addr learned my addr 172.21.15.152:0/1849859545 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:36.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.002+0000 7f3b79d9b640 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 0x5624f906e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.002+0000 7f3b7a59c640 1 -- 172.21.15.152:0/1849859545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 msgr2=0x5624f906e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:36.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.002+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 0x5624f906e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.002+0000 7f3b7a59c640 1 -- 172.21.15.152:0/1849859545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 msgr2=0x5624f906ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:36.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.002+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 0x5624f906ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.002+0000 7f3b7a59c640 1 -- 172.21.15.152:0/1849859545 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f8d3b3c0 con 0x5624f90643e0 2024-09-11T22:06:36.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.002+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f90714a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3b74006010 tx=0x7f3b740095a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fafab53bd739eaec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:36.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.003+0000 7f3b61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:06:36.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.004+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1849859545 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74034070 con 0x5624f90643e0 2024-09-11T22:06:36.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.004+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1849859545 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b740309f0 con 0x5624f90643e0 2024-09-11T22:06:36.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.004+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1849859545 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3b7402f620 con 0x5624f90643e0 2024-09-11T22:06:36.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.005+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1849859545 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3b7402f930 con 0x5624f90643e0 2024-09-11T22:06:36.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.005+0000 7f3b82ce0740 10 client.25555 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:36.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.005+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1849859545 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5624f9072040 con 0x5624f90643e0 2024-09-11T22:06:36.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.005+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1849859545 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b740309f0 con 0x5624f90643e0 2024-09-11T22:06:36.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.006+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1849859545 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f3b74053070 con 0x5624f90643e0 2024-09-11T22:06:36.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.007+0000 7f3b82ce0740 10 client.25555 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:36.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.007+0000 7f3b82ce0740 10 client.25555 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:06:36.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.007+0000 7f3b82ce0740 20 client.25555 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:36.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.007+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5624f907f060 0x5624f90814e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.007+0000 7f3b82ce0740 4 client.25555 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:36.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.007+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1849859545 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624f8fd7860 con 0x5624f907f060 2024-09-11T22:06:36.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.007+0000 7f3b79d9b640 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5624f907f060 0x5624f90814e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.008+0000 7f3b79d9b640 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5624f907f060 0x5624f90814e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c23ed0fb4b1c314a server_cookie=626399fee8996c3b in_seq=0 out_seq=0 2024-09-11T22:06:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.008+0000 7f3b61ffb640 10 client.25555 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:06:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.009+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1849859545 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5624f8fd7860 con 0x5624f907f060 2024-09-11T22:06:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.009+0000 7f3b61ffb640 10 client.25555 handle_command_reply: tid=0 2024-09-11T22:06:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.009+0000 7f3b82ce0740 1 client.25555 shutdown 2024-09-11T22:06:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.009+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1849859545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 msgr2=0x5624f90714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.009+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f90714a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3b74006010 tx=0x7f3b740095a0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.009+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1849859545 shutdown_connections 2024-09-11T22:06:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.009+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5624f907f060 0x5624f90814e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.009+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 0x5624f906ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.009+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 0x5624f906e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.009+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1849859545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f90714a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.009+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1849859545 >> 172.21.15.152:0/1849859545 conn(0x5624f902d310 msgr2=0x5624f90601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.010+0000 7f3b61ffb640 0 client.25555 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:06:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.010+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1849859545 shutdown_connections 2024-09-11T22:06:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.010+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1849859545 wait complete. 2024-09-11T22:06:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.010+0000 7f3b82ce0740 20 client.25555 trim_cache size 0 max 16384 2024-09-11T22:06:36.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.040+0000 7f3b82ce0740 1 Processor -- start 2024-09-11T22:06:36.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.040+0000 7f3b82ce0740 1 -- start start 2024-09-11T22:06:36.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.040+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f902d310 0x5624f907b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.040+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f9066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.040+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9064e60 0x5624f90706c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.040+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c011220 con 0x5624f9064e60 2024-09-11T22:06:36.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.040+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c00eac0 con 0x5624f902d310 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.040+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c00c910 con 0x5624f90643e0 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.040+0000 7f3b7a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f902d310 0x5624f907b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.040+0000 7f3b7a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f902d310 0x5624f907b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47798/0 (socket says 172.21.15.152:47798) 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.040+0000 7f3b7a59c640 1 -- 172.21.15.152:0/1631394471 learned_addr learned my addr 172.21.15.152:0/1631394471 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b79d9b640 1 --2- 172.21.15.152:0/1631394471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f9066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b7ad9d640 1 --2- 172.21.15.152:0/1631394471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9064e60 0x5624f90706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b7a59c640 1 -- 172.21.15.152:0/1631394471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 msgr2=0x5624f9066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/1631394471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f9066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b7a59c640 1 -- 172.21.15.152:0/1631394471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9064e60 msgr2=0x5624f90706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/1631394471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9064e60 0x5624f90706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b7a59c640 1 -- 172.21.15.152:0/1631394471 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f90656d0 con 0x5624f902d310 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b7ad9d640 1 --2- 172.21.15.152:0/1631394471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9064e60 0x5624f90706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/1631394471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f902d310 0x5624f907b340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3b7402a980 tx=0x7f3b74005d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32b4aa8d1b802b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:36.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b63fff640 1 -- 172.21.15.152:0/1631394471 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74059020 con 0x5624f902d310 2024-09-11T22:06:36.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b63fff640 1 -- 172.21.15.152:0/1631394471 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b740309f0 con 0x5624f902d310 2024-09-11T22:06:36.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.041+0000 7f3b63fff640 1 -- 172.21.15.152:0/1631394471 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74034040 con 0x5624f902d310 2024-09-11T22:06:36.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.043+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1631394471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f902d310 msgr2=0x5624f907b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:36.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.043+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1631394471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f902d310 0x5624f907b340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3b7402a980 tx=0x7f3b74005d80 comp rx=0 tx=0).stop 2024-09-11T22:06:36.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.043+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1631394471 shutdown_connections 2024-09-11T22:06:36.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.043+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1631394471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9064e60 0x5624f90706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.043+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1631394471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f9066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.043+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1631394471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f902d310 0x5624f907b340 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3b7402a980 tx=0x7f3b74005d80 comp rx=0 tx=0).stop 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.043+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1631394471 >> 172.21.15.152:0/1631394471 conn(0x5624f906edf0 msgr2=0x5624f906ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.043+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1631394471 shutdown_connections 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.043+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1631394471 wait complete. 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.043+0000 7f3b82ce0740 1 -- start start 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.043+0000 7f3b82ce0740 1 Processor -- start 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f90686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 0x5624f9068be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b82ce0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 0x5624f9069160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c00cf80 con 0x5624f9065b40 2024-09-11T22:06:36.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c00e3f0 con 0x5624f9064e60 2024-09-11T22:06:36.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b82ce0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c00d650 con 0x5624f90643e0 2024-09-11T22:06:36.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b82ce0740 10 client.0 _ll_register_callbacks cb 0x7f3b6c00bb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:36.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b7a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f90686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b79d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 0x5624f9068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b79d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 0x5624f9068be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47802/0 (socket says 172.21.15.152:47802) 2024-09-11T22:06:36.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b79d9b640 1 -- 172.21.15.152:0/1235860189 learned_addr learned my addr 172.21.15.152:0/1235860189 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:36.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.044+0000 7f3b7ad9d640 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 0x5624f9069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.045+0000 7f3b79d9b640 1 -- 172.21.15.152:0/1235860189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 msgr2=0x5624f90686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:36.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.045+0000 7f3b79d9b640 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f90686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.045+0000 7f3b79d9b640 1 -- 172.21.15.152:0/1235860189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 msgr2=0x5624f9069160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:36.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.045+0000 7f3b79d9b640 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 0x5624f9069160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.045+0000 7f3b79d9b640 1 -- 172.21.15.152:0/1235860189 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f90767a0 con 0x5624f9064e60 2024-09-11T22:06:36.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.046+0000 7f3b79d9b640 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 0x5624f9068be0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c005fd0 tx=0x7f3b6c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21e26e5ea9eee8df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:36.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.046+0000 7f3b61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:06:36.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.046+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1235860189 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c02b040 con 0x5624f9064e60 2024-09-11T22:06:36.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.046+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1235860189 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b740309f0 con 0x5624f9064e60 2024-09-11T22:06:36.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.046+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1235860189 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3b6c004230 con 0x5624f9064e60 2024-09-11T22:06:36.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.047+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1235860189 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3b6c04c050 con 0x5624f9064e60 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.048+0000 7f3b82ce0740 10 client.25415 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.048+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1235860189 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5624f9077b50 con 0x5624f9064e60 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.048+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1235860189 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b740309f0 con 0x5624f9064e60 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.048+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1235860189 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f3b6c004c00 con 0x5624f9064e60 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.048+0000 7f3b82ce0740 10 client.25415 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.048+0000 7f3b82ce0740 10 client.25415 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.048+0000 7f3b82ce0740 20 client.25415 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.048+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5624f90e9d80 0x5624f90ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.048+0000 7f3b82ce0740 4 client.25415 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.048+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1235860189 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624f8fd1d70 con 0x5624f90e9d80 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.049+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5624f90e9d80 0x5624f90ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:36.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.049+0000 7f3b7a59c640 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5624f90e9d80 0x5624f90ec1a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=88d0675db1251168 server_cookie=12f5199c66f4d1d6 in_seq=0 out_seq=0 2024-09-11T22:06:36.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.049+0000 7f3b61ffb640 10 client.25415 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:06:36.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.050+0000 7f3b61ffb640 1 -- 172.21.15.152:0/1235860189 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5624f8fd1d70 con 0x5624f90e9d80 2024-09-11T22:06:36.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.050+0000 7f3b61ffb640 10 client.25415 handle_command_reply: tid=0 2024-09-11T22:06:36.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.050+0000 7f3b82ce0740 1 client.25415 shutdown 2024-09-11T22:06:36.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.051+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1235860189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 msgr2=0x5624f9068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:36.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.051+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 0x5624f9068be0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c005fd0 tx=0x7f3b6c004730 comp rx=0 tx=0).stop 2024-09-11T22:06:36.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.051+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1235860189 shutdown_connections 2024-09-11T22:06:36.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.051+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5624f90e9d80 0x5624f90ec1a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.051+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624f9065b40 0x5624f9069160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.051+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624f9064e60 0x5624f9068be0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.051+0000 7f3b82ce0740 1 --2- 172.21.15.152:0/1235860189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624f90643e0 0x5624f90686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.051+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1235860189 >> 172.21.15.152:0/1235860189 conn(0x5624f906edf0 msgr2=0x5624f906cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:36.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.051+0000 7f3b61ffb640 0 client.25415 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:06:36.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.052+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1235860189 shutdown_connections 2024-09-11T22:06:36.054 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:06:36.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.052+0000 7f3b82ce0740 1 -- 172.21.15.152:0/1235860189 wait complete. 2024-09-11T22:06:36.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.052+0000 7f3b82ce0740 20 client.25415 trim_cache size 0 max 16384 2024-09-11T22:06:36.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.053+0000 7f3b697fa640 1 -- 172.21.15.152:0/4091643624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b640a2ff0 msgr2=0x7f3b640a54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:36.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.053+0000 7f3b697fa640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b640a2ff0 0x7f3b640a54b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00b6c0 tx=0x7f3b6c00b3d0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.053+0000 7f3b697fa640 1 -- 172.21.15.152:0/4091643624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c105f40 msgr2=0x7f3b7c06e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:36.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.053+0000 7f3b697fa640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c105f40 0x7f3b7c06e1b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000e970 tx=0x7f3b7000ee30 comp rx=0 tx=0).stop 2024-09-11T22:06:36.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.053+0000 7f3b697fa640 1 -- 172.21.15.152:0/4091643624 shutdown_connections 2024-09-11T22:06:36.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.053+0000 7f3b697fa640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b640a2ff0 0x7f3b640a54b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.053+0000 7f3b697fa640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c105f40 0x7f3b7c06e1b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.053+0000 7f3b697fa640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b7c101450 0x7f3b7c06dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.053+0000 7f3b697fa640 1 --2- 172.21.15.152:0/4091643624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b7c100b30 0x7f3b7c073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:36.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.054+0000 7f3b697fa640 1 -- 172.21.15.152:0/4091643624 >> 172.21.15.152:0/4091643624 conn(0x7f3b7c0fc7a0 msgr2=0x7f3b7c1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:36.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.054+0000 7f3b697fa640 1 -- 172.21.15.152:0/4091643624 shutdown_connections 2024-09-11T22:06:36.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:36.054+0000 7f3b697fa640 1 -- 172.21.15.152:0/4091643624 wait complete. 2024-09-11T22:06:36.649 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:06:37.090 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:37 smithi179 ceph-mon[35603]: pgmap v73: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-09-11T22:06:37.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:37 smithi193 ceph-mon[35545]: pgmap v73: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-09-11T22:06:37.904 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:37 smithi152 ceph-mon[31188]: pgmap v73: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-09-11T22:06:38.098 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:06:38.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.034+0000 7fd70ffff640 1 -- 172.21.15.152:0/4262196822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd710102370 msgr2=0x7fd71010e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:38.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.034+0000 7fd70ffff640 1 --2- 172.21.15.152:0/4262196822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd710102370 0x7fd71010e8a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd708009cd0 tx=0x7fd70802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.035+0000 7fd70ffff640 1 -- 172.21.15.152:0/4262196822 shutdown_connections 2024-09-11T22:06:38.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.035+0000 7fd70ffff640 1 --2- 172.21.15.152:0/4262196822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd710102370 0x7fd71010e8a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.035+0000 7fd70ffff640 1 --2- 172.21.15.152:0/4262196822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7101019d0 0x7fd710101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.035+0000 7fd70ffff640 1 --2- 172.21.15.152:0/4262196822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7101079d0 0x7fd710107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.035+0000 7fd70ffff640 1 -- 172.21.15.152:0/4262196822 >> 172.21.15.152:0/4262196822 conn(0x7fd7100fd710 msgr2=0x7fd7100ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:38.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.035+0000 7fd70ffff640 1 -- 172.21.15.152:0/4262196822 shutdown_connections 2024-09-11T22:06:38.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.035+0000 7fd70ffff640 1 -- 172.21.15.152:0/4262196822 wait complete. 2024-09-11T22:06:38.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.036+0000 7fd70ffff640 1 Processor -- start 2024-09-11T22:06:38.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.036+0000 7fd70ffff640 1 -- start start 2024-09-11T22:06:38.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.036+0000 7fd70ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7101019d0 0x7fd7100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.036+0000 7fd70ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd710102370 0x7fd710074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.037+0000 7fd70ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7101079d0 0x7fd710074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.037+0000 7fd70ffff640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd710111e20 con 0x7fd7101019d0 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.037+0000 7fd70effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7101019d0 0x7fd7100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.037+0000 7fd70effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7101019d0 0x7fd7100744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39112/0 (socket says 172.21.15.152:39112) 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.037+0000 7fd70effd640 1 -- 172.21.15.152:0/1458443601 learned_addr learned my addr 172.21.15.152:0/1458443601 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.037+0000 7fd707fff640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd710102370 0x7fd710074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.037+0000 7fd70ffff640 1 -- 172.21.15.152:0/1458443601 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd710111ca0 con 0x7fd7101079d0 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.037+0000 7fd70ffff640 1 -- 172.21.15.152:0/1458443601 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd710111fa0 con 0x7fd710102370 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.038+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7101079d0 0x7fd710074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.038+0000 7fd707fff640 1 -- 172.21.15.152:0/1458443601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7101079d0 msgr2=0x7fd710074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.038+0000 7fd707fff640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7101079d0 0x7fd710074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.038+0000 7fd707fff640 1 -- 172.21.15.152:0/1458443601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7101019d0 msgr2=0x7fd7100744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.038+0000 7fd707fff640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7101019d0 0x7fd7100744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.038+0000 7fd707fff640 1 -- 172.21.15.152:0/1458443601 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7101a6740 con 0x7fd710102370 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.038+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7101079d0 0x7fd710074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.039+0000 7fd707fff640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd710102370 0x7fd710074a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800d720 tx=0x7fd6f800dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.039+0000 7fd70cff9640 1 -- 172.21.15.152:0/1458443601 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8017070 con 0x7fd710102370 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.040+0000 7fd70cff9640 1 -- 172.21.15.152:0/1458443601 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6f800de30 con 0x7fd710102370 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.040+0000 7fd70cff9640 1 -- 172.21.15.152:0/1458443601 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8004dd0 con 0x7fd710102370 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.040+0000 7fd70ffff640 1 -- 172.21.15.152:0/1458443601 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7101a6a30 con 0x7fd710102370 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.041+0000 7fd70ffff640 1 -- 172.21.15.152:0/1458443601 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7101a6f20 con 0x7fd710102370 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.045+0000 7fd70cff9640 1 -- 172.21.15.152:0/1458443601 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd6f8004f70 con 0x7fd710102370 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.045+0000 7fd717787740 1 Processor -- start 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.045+0000 7fd717787740 1 -- start start 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.046+0000 7fd717787740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92b0d20 0x555ba92af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.046+0000 7fd717787740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92af7b0 0x555ba92afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.046+0000 7fd717787740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92c2d60 0x555ba92c5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.046+0000 7fd717787740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555ba92152f0 con 0x555ba92b0d20 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.046+0000 7fd717787740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555ba91bccf0 con 0x555ba92c2d60 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.046+0000 7fd717787740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555ba92112b0 con 0x555ba92af7b0 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.047+0000 7fd70f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92b0d20 0x555ba92af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.047+0000 7fd707fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92c2d60 0x555ba92c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.047+0000 7fd707fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92c2d60 0x555ba92c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47828/0 (socket says 172.21.15.152:47828) 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.047+0000 7fd707fff640 1 -- 172.21.15.152:0/532837867 learned_addr learned my addr 172.21.15.152:0/532837867 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.047+0000 7fd70effd640 1 --2- 172.21.15.152:0/532837867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92af7b0 0x555ba92afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.047+0000 7fd70f7fe640 1 -- 172.21.15.152:0/532837867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92af7b0 msgr2=0x555ba92afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.047+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/532837867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92af7b0 0x555ba92afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.047+0000 7fd70f7fe640 1 -- 172.21.15.152:0/532837867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92c2d60 msgr2=0x555ba92c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.047+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/532837867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92c2d60 0x555ba92c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.047+0000 7fd70f7fe640 1 -- 172.21.15.152:0/532837867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ba91a13a0 con 0x555ba92b0d20 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.047+0000 7fd70cff9640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6fc0a2d70 0x7fd6fc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.048+0000 7fd70cff9640 1 -- 172.21.15.152:0/1458443601 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd6f80ce940 con 0x7fd710102370 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.048+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/532837867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92b0d20 0x555ba92af270 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd708009ca0 tx=0x7fd708009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24087f66c3de952 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.048+0000 7fd707fff640 1 --2- 172.21.15.152:0/532837867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92c2d60 0x555ba92c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.048+0000 7fd70effd640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6fc0a2d70 0x7fd6fc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.048+0000 7fd7057fa640 1 -- 172.21.15.152:0/532837867 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708049070 con 0x555ba92b0d20 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.048+0000 7fd7057fa640 1 -- 172.21.15.152:0/532837867 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd708036040 con 0x555ba92b0d20 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.048+0000 7fd7057fa640 1 -- 172.21.15.152:0/532837867 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7080044e0 con 0x555ba92b0d20 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.050+0000 7fd717787740 1 -- 172.21.15.152:0/532837867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92b0d20 msgr2=0x555ba92af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:38.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.050+0000 7fd717787740 1 --2- 172.21.15.152:0/532837867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92b0d20 0x555ba92af270 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd708009ca0 tx=0x7fd708009a20 comp rx=0 tx=0).stop 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.050+0000 7fd70effd640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6fc0a2d70 0x7fd6fc0a5230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x555ba92acca0 tx=0x7fd70000b480 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.050+0000 7fd717787740 1 -- 172.21.15.152:0/532837867 shutdown_connections 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.050+0000 7fd717787740 1 --2- 172.21.15.152:0/532837867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92c2d60 0x555ba92c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.050+0000 7fd717787740 1 --2- 172.21.15.152:0/532837867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92af7b0 0x555ba92afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.050+0000 7fd717787740 1 --2- 172.21.15.152:0/532837867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92b0d20 0x555ba92af270 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.050+0000 7fd717787740 1 -- 172.21.15.152:0/532837867 >> 172.21.15.152:0/532837867 conn(0x555ba9278310 msgr2=0x555ba92abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.050+0000 7fd717787740 1 -- 172.21.15.152:0/532837867 shutdown_connections 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.050+0000 7fd717787740 1 -- 172.21.15.152:0/532837867 wait complete. 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.051+0000 7fd717787740 1 -- start start 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.051+0000 7fd717787740 1 Processor -- start 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.051+0000 7fd717787740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92af7b0 0x555ba92bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.051+0000 7fd717787740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b0d20 0x555ba92bcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.051+0000 7fd717787740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92c2d60 0x555ba92c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd717787740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555ba92b2860 con 0x555ba92c2d60 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd717787740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555ba91d0060 con 0x555ba92b0d20 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd717787740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555ba92b29e0 con 0x555ba92af7b0 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd717787740 10 client.0 _ll_register_callbacks cb 0x555ba8f238c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd70f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92c2d60 0x555ba92c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd707fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b0d20 0x555ba92bcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd70f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92c2d60 0x555ba92c23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39132/0 (socket says 172.21.15.152:39132) 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd707fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b0d20 0x555ba92bcbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47832/0 (socket says 172.21.15.152:47832) 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd70f7fe640 1 -- 172.21.15.152:0/3422605233 learned_addr learned my addr 172.21.15.152:0/3422605233 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd70effd640 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92af7b0 0x555ba92bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd707fff640 1 -- 172.21.15.152:0/3422605233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92af7b0 msgr2=0x555ba92bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:38.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd707fff640 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92af7b0 0x555ba92bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd707fff640 1 -- 172.21.15.152:0/3422605233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92c2d60 msgr2=0x555ba92c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd707fff640 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92c2d60 0x555ba92c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd707fff640 1 -- 172.21.15.152:0/3422605233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ba8f863c0 con 0x555ba92b0d20 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.052+0000 7fd707fff640 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b0d20 0x555ba92bcbe0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80cc660 tx=0x7fd6f80d41e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b43f7316923e8e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.053+0000 7fd6f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.053+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3422605233 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8020070 con 0x555ba92b0d20 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.053+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3422605233 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd6f8009c60 con 0x555ba92b0d20 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.053+0000 7fd717787740 1 -- 172.21.15.152:0/3422605233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd708036040 con 0x555ba92b0d20 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.053+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3422605233 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd6f809aa20 con 0x555ba92b0d20 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.054+0000 7fd717787740 10 client.25427 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.054+0000 7fd717787740 1 -- 172.21.15.152:0/3422605233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555ba92d9d00 con 0x555ba92b0d20 2024-09-11T22:06:38.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.054+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3422605233 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6f809aee0 con 0x555ba92b0d20 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.054+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3422605233 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fd6f809a330 con 0x555ba92b0d20 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.054+0000 7fd717787740 10 client.25427 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.054+0000 7fd717787740 10 client.25427 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.054+0000 7fd717787740 20 client.25427 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.054+0000 7fd717787740 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555ba92db630 0x555ba92dda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.054+0000 7fd717787740 4 client.25427 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.055+0000 7fd717787740 1 -- 172.21.15.152:0/3422605233 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd708036040 con 0x555ba92db630 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.055+0000 7fd70effd640 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555ba92db630 0x555ba92dda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.055+0000 7fd70effd640 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555ba92db630 0x555ba92dda50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=15da8d80a79600b6 server_cookie=b38c7a07490fe208 in_seq=0 out_seq=0 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.055+0000 7fd6f67fc640 10 client.25427 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.056+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3422605233 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd708036040 con 0x555ba92db630 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.056+0000 7fd6f67fc640 10 client.25427 handle_command_reply: tid=0 2024-09-11T22:06:38.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.056+0000 7fd717787740 1 client.25427 shutdown 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.056+0000 7fd717787740 1 -- 172.21.15.152:0/3422605233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b0d20 msgr2=0x555ba92bcbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.056+0000 7fd717787740 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b0d20 0x555ba92bcbe0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80cc660 tx=0x7fd6f80d41e0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.057+0000 7fd717787740 1 -- 172.21.15.152:0/3422605233 shutdown_connections 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.057+0000 7fd717787740 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555ba92db630 0x555ba92dda50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.057+0000 7fd717787740 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92c2d60 0x555ba92c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.057+0000 7fd717787740 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b0d20 0x555ba92bcbe0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80cc660 tx=0x7fd6f80d41e0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.057+0000 7fd717787740 1 --2- 172.21.15.152:0/3422605233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92af7b0 0x555ba92bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.057+0000 7fd717787740 1 -- 172.21.15.152:0/3422605233 >> 172.21.15.152:0/3422605233 conn(0x555ba9278310 msgr2=0x555ba92b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.057+0000 7fd6f67fc640 0 client.25427 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.057+0000 7fd717787740 1 -- 172.21.15.152:0/3422605233 shutdown_connections 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.057+0000 7fd717787740 1 -- 172.21.15.152:0/3422605233 wait complete. 2024-09-11T22:06:38.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.057+0000 7fd717787740 20 client.25427 trim_cache size 0 max 16384 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.082+0000 7fd717787740 1 Processor -- start 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.082+0000 7fd717787740 1 -- start start 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.082+0000 7fd717787740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92af7b0 0x555ba92c2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.082+0000 7fd717787740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92c2d60 0x555ba92e3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd717787740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92b7990 0x555ba92e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd717787740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101ade90 con 0x555ba92c2d60 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd717787740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101ab730 con 0x555ba92af7b0 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd717787740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101a95c0 con 0x555ba92b7990 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd70f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92b7990 0x555ba92e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd70f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92b7990 0x555ba92e38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54086/0 (socket says 172.21.15.152:54086) 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd70f7fe640 1 -- 172.21.15.152:0/3731653596 learned_addr learned my addr 172.21.15.152:0/3731653596 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd707fff640 1 --2- 172.21.15.152:0/3731653596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92c2d60 0x555ba92e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd70f7fe640 1 -- 172.21.15.152:0/3731653596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92af7b0 msgr2=0x555ba92c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd70effd640 1 --2- 172.21.15.152:0/3731653596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92af7b0 0x555ba92c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/3731653596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92af7b0 0x555ba92c2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd70f7fe640 1 -- 172.21.15.152:0/3731653596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92c2d60 msgr2=0x555ba92e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/3731653596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92c2d60 0x555ba92e3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.083+0000 7fd70f7fe640 1 -- 172.21.15.152:0/3731653596 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ba92b29d0 con 0x555ba92b7990 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.084+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/3731653596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92b7990 0x555ba92e38a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd70802ae00 tx=0x7fd7080040e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0efb62d0f8716d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.084+0000 7fd704ff9640 1 -- 172.21.15.152:0/3731653596 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708049070 con 0x555ba92b7990 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.084+0000 7fd704ff9640 1 -- 172.21.15.152:0/3731653596 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd708036040 con 0x555ba92b7990 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.084+0000 7fd704ff9640 1 -- 172.21.15.152:0/3731653596 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7080305a0 con 0x555ba92b7990 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.085+0000 7fd717787740 1 -- 172.21.15.152:0/3731653596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92b7990 msgr2=0x555ba92e38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.085+0000 7fd717787740 1 --2- 172.21.15.152:0/3731653596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92b7990 0x555ba92e38a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd70802ae00 tx=0x7fd7080040e0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.085+0000 7fd717787740 1 -- 172.21.15.152:0/3731653596 shutdown_connections 2024-09-11T22:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.085+0000 7fd717787740 1 --2- 172.21.15.152:0/3731653596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92b7990 0x555ba92e38a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.085+0000 7fd717787740 1 --2- 172.21.15.152:0/3731653596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92c2d60 0x555ba92e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.085+0000 7fd717787740 1 --2- 172.21.15.152:0/3731653596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92af7b0 0x555ba92c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.085+0000 7fd717787740 1 -- 172.21.15.152:0/3731653596 >> 172.21.15.152:0/3731653596 conn(0x555ba9278310 msgr2=0x555ba92b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.085+0000 7fd717787740 1 -- 172.21.15.152:0/3731653596 shutdown_connections 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.085+0000 7fd717787740 1 -- 172.21.15.152:0/3731653596 wait complete. 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.086+0000 7fd717787740 1 -- start start 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.086+0000 7fd717787740 1 Processor -- start 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.087+0000 7fd717787740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92af7b0 0x555ba92ef090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.087+0000 7fd717787740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b7990 0x555ba92ef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.087+0000 7fd717787740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92c2d60 0x555ba92ec060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.087+0000 7fd717787740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101a9c10 con 0x555ba92af7b0 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.087+0000 7fd717787740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101ab060 con 0x555ba92b7990 2024-09-11T22:06:38.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.087+0000 7fd717787740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101aa2c0 con 0x555ba92c2d60 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.087+0000 7fd717787740 10 client.0 _ll_register_callbacks cb 0x555ba8f238c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.087+0000 7fd70effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92af7b0 0x555ba92ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.087+0000 7fd70effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92af7b0 0x555ba92ef090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39162/0 (socket says 172.21.15.152:39162) 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.087+0000 7fd70effd640 1 -- 172.21.15.152:0/3085068795 learned_addr learned my addr 172.21.15.152:0/3085068795 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.087+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92c2d60 0x555ba92ec060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.088+0000 7fd707fff640 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b7990 0x555ba92ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.088+0000 7fd70f7fe640 1 -- 172.21.15.152:0/3085068795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b7990 msgr2=0x555ba92ef5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.088+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b7990 0x555ba92ef5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.088+0000 7fd70f7fe640 1 -- 172.21.15.152:0/3085068795 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92af7b0 msgr2=0x555ba92ef090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.088+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92af7b0 0x555ba92ef090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.088+0000 7fd70f7fe640 1 -- 172.21.15.152:0/3085068795 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ba92ec650 con 0x555ba92c2d60 2024-09-11T22:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.088+0000 7fd70f7fe640 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92c2d60 0x555ba92ec060 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd70802af70 tx=0x7fd7080048d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7588b45eedd5d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.088+0000 7fd6f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.089+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3085068795 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708049070 con 0x555ba92c2d60 2024-09-11T22:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.089+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3085068795 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd70802e040 con 0x555ba92c2d60 2024-09-11T22:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.089+0000 7fd717787740 1 -- 172.21.15.152:0/3085068795 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd708036040 con 0x555ba92c2d60 2024-09-11T22:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.089+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3085068795 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd708031c90 con 0x555ba92c2d60 2024-09-11T22:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.089+0000 7fd717787740 10 client.25579 fetch_fsmap learned FSMap version 27 2024-09-11T22:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.089+0000 7fd717787740 1 -- 172.21.15.152:0/3085068795 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555ba9346aa0 con 0x555ba92c2d60 2024-09-11T22:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.090+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3085068795 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7080305a0 con 0x555ba92c2d60 2024-09-11T22:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.090+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3085068795 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fd70805e070 con 0x555ba92c2d60 2024-09-11T22:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.090+0000 7fd717787740 10 client.25579 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T22:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.090+0000 7fd717787740 10 client.25579 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.090+0000 7fd717787740 20 client.25579 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.090+0000 7fd717787740 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555ba9346d20 0x555ba9349110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.090+0000 7fd717787740 4 client.25579 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.090+0000 7fd717787740 1 -- 172.21.15.152:0/3085068795 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd708036040 con 0x555ba9346d20 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.090+0000 7fd70effd640 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555ba9346d20 0x555ba9349110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.091+0000 7fd70effd640 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555ba9346d20 0x555ba9349110 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f03c41904713458 server_cookie=e9f6ae8d5ca49f87 in_seq=0 out_seq=0 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.091+0000 7fd6f67fc640 10 client.25579 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.091+0000 7fd6f67fc640 1 -- 172.21.15.152:0/3085068795 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd708036040 con 0x555ba9346d20 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.091+0000 7fd6f67fc640 10 client.25579 handle_command_reply: tid=0 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.091+0000 7fd717787740 1 client.25579 shutdown 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.092+0000 7fd717787740 1 -- 172.21.15.152:0/3085068795 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92c2d60 msgr2=0x555ba92ec060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.092+0000 7fd717787740 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92c2d60 0x555ba92ec060 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd70802af70 tx=0x7fd7080048d0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.093+0000 7fd717787740 1 -- 172.21.15.152:0/3085068795 shutdown_connections 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.093+0000 7fd717787740 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555ba9346d20 0x555ba9349110 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.093+0000 7fd717787740 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555ba92c2d60 0x555ba92ec060 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.093+0000 7fd6f67fc640 0 client.25579 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.093+0000 7fd717787740 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ba92b7990 0x555ba92ef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.093+0000 7fd717787740 1 --2- 172.21.15.152:0/3085068795 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ba92af7b0 0x555ba92ef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.093+0000 7fd717787740 1 -- 172.21.15.152:0/3085068795 >> 172.21.15.152:0/3085068795 conn(0x555ba9278310 msgr2=0x555ba92aa780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.093+0000 7fd717787740 1 -- 172.21.15.152:0/3085068795 shutdown_connections 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.093+0000 7fd717787740 1 -- 172.21.15.152:0/3085068795 wait complete. 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.093+0000 7fd717787740 20 client.25579 trim_cache size 0 max 16384 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.094+0000 7fd70ffff640 1 -- 172.21.15.152:0/1458443601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6fc0a2d70 msgr2=0x7fd6fc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.094+0000 7fd70ffff640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6fc0a2d70 0x7fd6fc0a5230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x555ba92acca0 tx=0x7fd70000b480 comp rx=0 tx=0).stop 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.094+0000 7fd70ffff640 1 -- 172.21.15.152:0/1458443601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd710102370 msgr2=0x7fd710074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.094+0000 7fd70ffff640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd710102370 0x7fd710074a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800d720 tx=0x7fd6f800dbe0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.094+0000 7fd70ffff640 1 -- 172.21.15.152:0/1458443601 shutdown_connections 2024-09-11T22:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.094+0000 7fd70ffff640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6fc0a2d70 0x7fd6fc0a5230 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.094+0000 7fd70ffff640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7101079d0 0x7fd710074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.094+0000 7fd70ffff640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd710102370 0x7fd710074a30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.094+0000 7fd70ffff640 1 --2- 172.21.15.152:0/1458443601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7101019d0 0x7fd7100744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.094+0000 7fd70ffff640 1 -- 172.21.15.152:0/1458443601 >> 172.21.15.152:0/1458443601 conn(0x7fd7100fd710 msgr2=0x7fd7100fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.094+0000 7fd70ffff640 1 -- 172.21.15.152:0/1458443601 shutdown_connections 2024-09-11T22:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:38.095+0000 7fd70ffff640 1 -- 172.21.15.152:0/1458443601 wait complete. 2024-09-11T22:06:39.001 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:06:39.430 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 65.0 s, 5946.4 tps, lat 16.856 ms stddev 19.555 2024-09-11T22:06:39.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.996+0000 7f3778e2c640 1 -- 172.21.15.152:0/843590966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c0a4d30 msgr2=0x7f376c0a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:39.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.996+0000 7f3778e2c640 1 --2- 172.21.15.152:0/843590966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c0a4d30 0x7f376c0a51e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3774067960 tx=0x7f377408e360 comp rx=0 tx=0).stop 2024-09-11T22:06:39.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.996+0000 7f3778e2c640 1 -- 172.21.15.152:0/843590966 shutdown_connections 2024-09-11T22:06:39.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.997+0000 7f3778e2c640 1 --2- 172.21.15.152:0/843590966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c0a4d30 0x7f376c0a51e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:39.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.997+0000 7f3778e2c640 1 --2- 172.21.15.152:0/843590966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0aab50 0x7f376c0a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:39.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.997+0000 7f3778e2c640 1 --2- 172.21.15.152:0/843590966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c0aa230 0x7f376c0aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:39.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.997+0000 7f3778e2c640 1 -- 172.21.15.152:0/843590966 >> 172.21.15.152:0/843590966 conn(0x7f376c01a0a0 msgr2=0x7f376c01a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:39.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.997+0000 7f3778e2c640 1 -- 172.21.15.152:0/843590966 shutdown_connections 2024-09-11T22:06:39.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.997+0000 7f3778e2c640 1 -- 172.21.15.152:0/843590966 wait complete. 2024-09-11T22:06:40.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.998+0000 7f3778e2c640 1 Processor -- start 2024-09-11T22:06:40.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.999+0000 7f3778e2c640 1 -- start start 2024-09-11T22:06:40.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.999+0000 7f3778e2c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0a4d30 0x7f376c143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.999+0000 7f3778e2c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c0aa230 0x7f376c1438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:39.999+0000 7f3778e2c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c0aab50 0x7f376c147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.000+0000 7f3778e2c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f376c0bcf00 con 0x7f376c0aa230 2024-09-11T22:06:40.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.000+0000 7f3773fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c0aab50 0x7f376c147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.000+0000 7f3773fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c0aab50 0x7f376c147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54124/0 (socket says 172.21.15.152:54124) 2024-09-11T22:06:40.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.000+0000 7f3773fff640 1 -- 172.21.15.152:0/4100929265 learned_addr learned my addr 172.21.15.152:0/4100929265 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:40.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.000+0000 7f3778e2c640 1 -- 172.21.15.152:0/4100929265 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f376c0bcd80 con 0x7f376c0a4d30 2024-09-11T22:06:40.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.000+0000 7f3778e2c640 1 -- 172.21.15.152:0/4100929265 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f376c0bd080 con 0x7f376c0aab50 2024-09-11T22:06:40.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.000+0000 7f37737fe640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0a4d30 0x7f376c143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.000+0000 7f3772ffd640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c0aa230 0x7f376c1438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.001+0000 7f3772ffd640 1 -- 172.21.15.152:0/4100929265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c0aab50 msgr2=0x7f376c147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:40.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.001+0000 7f3772ffd640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c0aab50 0x7f376c147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.001+0000 7f3772ffd640 1 -- 172.21.15.152:0/4100929265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0a4d30 msgr2=0x7f376c143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:40.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.001+0000 7f3772ffd640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0a4d30 0x7f376c143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.001+0000 7f3772ffd640 1 -- 172.21.15.152:0/4100929265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376c148310 con 0x7f376c0aa230 2024-09-11T22:06:40.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.001+0000 7f3773fff640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c0aab50 0x7f376c147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:40.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.001+0000 7f3772ffd640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c0aa230 0x7f376c1438a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f376800d6d0 tx=0x7f376800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:40.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.002+0000 7f3770ff9640 1 -- 172.21.15.152:0/4100929265 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768017070 con 0x7f376c0aa230 2024-09-11T22:06:40.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.002+0000 7f3770ff9640 1 -- 172.21.15.152:0/4100929265 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3768009820 con 0x7f376c0aa230 2024-09-11T22:06:40.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.002+0000 7f3770ff9640 1 -- 172.21.15.152:0/4100929265 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768017070 con 0x7f376c0aa230 2024-09-11T22:06:40.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.002+0000 7f3778e2c640 1 -- 172.21.15.152:0/4100929265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376c148600 con 0x7f376c0aa230 2024-09-11T22:06:40.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.002+0000 7f3778e2c640 1 -- 172.21.15.152:0/4100929265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376c14fee0 con 0x7f376c0aa230 2024-09-11T22:06:40.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.006+0000 7f377c467740 1 Processor -- start 2024-09-11T22:06:40.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.007+0000 7f377c467740 1 -- start start 2024-09-11T22:06:40.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.007+0000 7f377c467740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x5608810f9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.007+0000 7f377c467740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810f97b0 0x5608810f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.007+0000 7f377c467740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 0x560881106940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.007+0000 7f377c467740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56088105f2f0 con 0x560881104550 2024-09-11T22:06:40.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.007+0000 7f377c467740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560881006cf0 con 0x5608810f97b0 2024-09-11T22:06:40.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.007+0000 7f377c467740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56088105b2b0 con 0x5608810fad20 2024-09-11T22:06:40.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.008+0000 7f37737fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810f97b0 0x5608810f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.008+0000 7f3773fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x5608810f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.008+0000 7f3770ff9640 1 -- 172.21.15.152:0/4100929265 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3768009cd0 con 0x7f376c0aa230 2024-09-11T22:06:40.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.008+0000 7f3773fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x5608810f9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54138/0 (socket says 172.21.15.152:54138) 2024-09-11T22:06:40.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.009+0000 7f3773fff640 1 -- 172.21.15.152:0/3977483646 learned_addr learned my addr 172.21.15.152:0/3977483646 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:40.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.009+0000 7f3772ffd640 1 --2- 172.21.15.152:0/3977483646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 0x560881106940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.009+0000 7f3770ff9640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37640a3140 0x7f37640a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.010+0000 7f3773fff640 1 -- 172.21.15.152:0/3977483646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810f97b0 msgr2=0x5608810f9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:40.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.010+0000 7f3773fff640 1 --2- 172.21.15.152:0/3977483646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810f97b0 0x5608810f9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.010+0000 7f3773fff640 1 -- 172.21.15.152:0/3977483646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 msgr2=0x560881106940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:40.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.010+0000 7f3773fff640 1 --2- 172.21.15.152:0/3977483646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 0x560881106940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.010+0000 7f3773fff640 1 -- 172.21.15.152:0/3977483646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560880feb3a0 con 0x5608810fad20 2024-09-11T22:06:40.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.010+0000 7f3772ffd640 1 --2- 172.21.15.152:0/3977483646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 0x560881106940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:06:40.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.010+0000 7f3770ff9640 1 -- 172.21.15.152:0/4100929265 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3768005020 con 0x7f376c0aa230 2024-09-11T22:06:40.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.011+0000 7f3773fff640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37640a3140 0x7f37640a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.011+0000 7f3773fff640 1 --2- 172.21.15.152:0/3977483646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x5608810f9270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3774051500 tx=0x7f377406e7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7b8c0dd061b901d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:40.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.013+0000 7f375dffb640 1 -- 172.21.15.152:0/3977483646 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37740a5040 con 0x5608810fad20 2024-09-11T22:06:40.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.013+0000 7f375dffb640 1 -- 172.21.15.152:0/3977483646 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37740a6030 con 0x5608810fad20 2024-09-11T22:06:40.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.013+0000 7f375dffb640 1 -- 172.21.15.152:0/3977483646 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377409f8f0 con 0x5608810fad20 2024-09-11T22:06:40.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.014+0000 7f377c467740 1 -- 172.21.15.152:0/3977483646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 msgr2=0x5608810f9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:40.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.014+0000 7f377c467740 1 --2- 172.21.15.152:0/3977483646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x5608810f9270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3774051500 tx=0x7f377406e7e0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.014+0000 7f3773fff640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37640a3140 0x7f37640a5600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x560881106f20 tx=0x7f37740ab3e0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:40.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.014+0000 7f377c467740 1 -- 172.21.15.152:0/3977483646 shutdown_connections 2024-09-11T22:06:40.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.014+0000 7f377c467740 1 --2- 172.21.15.152:0/3977483646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 0x560881106940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.014+0000 7f377c467740 1 --2- 172.21.15.152:0/3977483646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810f97b0 0x5608810f9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.014+0000 7f377c467740 1 --2- 172.21.15.152:0/3977483646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x5608810f9270 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.014+0000 7f377c467740 1 -- 172.21.15.152:0/3977483646 >> 172.21.15.152:0/3977483646 conn(0x5608810c2310 msgr2=0x5608810f5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:40.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.014+0000 7f377c467740 1 -- 172.21.15.152:0/3977483646 shutdown_connections 2024-09-11T22:06:40.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.014+0000 7f377c467740 1 -- 172.21.15.152:0/3977483646 wait complete. 2024-09-11T22:06:40.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.015+0000 7f377c467740 1 -- start start 2024-09-11T22:06:40.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.015+0000 7f377c467740 1 Processor -- start 2024-09-11T22:06:40.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.015+0000 7f377c467740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608810f97b0 0x560881103ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.015+0000 7f377c467740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810fad20 0x560881101170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.015+0000 7f377c467740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560881104550 0x5608811016d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.015+0000 7f377c467740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560881107250 con 0x5608810f97b0 2024-09-11T22:06:40.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.015+0000 7f377c467740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56088101a060 con 0x5608810fad20 2024-09-11T22:06:40.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f377c467740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5608811073d0 con 0x560881104550 2024-09-11T22:06:40.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f3773fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560881104550 0x5608811016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f377c467740 10 client.0 _ll_register_callbacks cb 0x560880d6d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:40.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f3773fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560881104550 0x5608811016d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54154/0 (socket says 172.21.15.152:54154) 2024-09-11T22:06:40.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f3773fff640 1 -- 172.21.15.152:0/1753340741 learned_addr learned my addr 172.21.15.152:0/1753340741 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:40.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f3773fff640 1 -- 172.21.15.152:0/1753340741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810fad20 msgr2=0x560881101170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:40.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f3773fff640 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810fad20 0x560881101170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f3773fff640 1 -- 172.21.15.152:0/1753340741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608810f97b0 msgr2=0x560881103ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:40.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f37737fe640 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608810f97b0 0x560881103ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f3773fff640 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608810f97b0 0x560881103ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f3773fff640 1 -- 172.21.15.152:0/1753340741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560880dd03c0 con 0x560881104550 2024-09-11T22:06:40.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.016+0000 7f37737fe640 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608810f97b0 0x560881103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:06:40.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.017+0000 7f3773fff640 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560881104550 0x5608811016d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f37740679f0 tx=0x7f37740a0000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2295af4e17fa3d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:40.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.017+0000 7f3752ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:06:40.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.017+0000 7f3752ffd640 1 -- 172.21.15.152:0/1753340741 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37740a5040 con 0x560881104550 2024-09-11T22:06:40.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.017+0000 7f3752ffd640 1 -- 172.21.15.152:0/1753340741 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f37740abb70 con 0x560881104550 2024-09-11T22:06:40.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.017+0000 7f377c467740 1 -- 172.21.15.152:0/1753340741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37740a6030 con 0x560881104550 2024-09-11T22:06:40.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.018+0000 7f3752ffd640 1 -- 172.21.15.152:0/1753340741 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f37740abd70 con 0x560881104550 2024-09-11T22:06:40.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.018+0000 7f377c467740 10 client.25591 fetch_fsmap learned FSMap version 28 2024-09-11T22:06:40.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.018+0000 7f377c467740 1 -- 172.21.15.152:0/1753340741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560881107250 con 0x560881104550 2024-09-11T22:06:40.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.018+0000 7f3752ffd640 1 -- 172.21.15.152:0/1753340741 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37740a6030 con 0x560881104550 2024-09-11T22:06:40.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.019+0000 7f3752ffd640 1 -- 172.21.15.152:0/1753340741 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3774096410 con 0x560881104550 2024-09-11T22:06:40.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.019+0000 7f377c467740 10 client.25591 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:06:40.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.019+0000 7f377c467740 10 client.25591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:40.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.019+0000 7f377c467740 20 client.25591 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:40.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.019+0000 7f377c467740 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560881114170 0x560881116600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.019+0000 7f377c467740 4 client.25591 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:40.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.019+0000 7f377c467740 1 -- 172.21.15.152:0/1753340741 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56088106c860 con 0x560881114170 2024-09-11T22:06:40.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.021+0000 7f37737fe640 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560881114170 0x560881116600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.023+0000 7f3752ffd640 10 client.25591 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:40.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.023+0000 7f37737fe640 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560881114170 0x560881116600 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6b4ad6284f6f2b2 server_cookie=3422c9285efe97fc in_seq=0 out_seq=0 2024-09-11T22:06:40.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.024+0000 7f3752ffd640 1 -- 172.21.15.152:0/1753340741 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56088106c860 con 0x560881114170 2024-09-11T22:06:40.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.024+0000 7f3752ffd640 10 client.25591 handle_command_reply: tid=0 2024-09-11T22:06:40.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.024+0000 7f377c467740 1 client.25591 shutdown 2024-09-11T22:06:40.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.024+0000 7f377c467740 1 -- 172.21.15.152:0/1753340741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560881104550 msgr2=0x5608811016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:40.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.024+0000 7f377c467740 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560881104550 0x5608811016d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f37740679f0 tx=0x7f37740a0000 comp rx=0 tx=0).stop 2024-09-11T22:06:40.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.024+0000 7f377c467740 1 -- 172.21.15.152:0/1753340741 shutdown_connections 2024-09-11T22:06:40.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.024+0000 7f377c467740 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560881114170 0x560881116600 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.024+0000 7f377c467740 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560881104550 0x5608811016d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.024+0000 7f377c467740 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810fad20 0x560881101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.024+0000 7f377c467740 1 --2- 172.21.15.152:0/1753340741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608810f97b0 0x560881103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.024+0000 7f377c467740 1 -- 172.21.15.152:0/1753340741 >> 172.21.15.152:0/1753340741 conn(0x5608810c2310 msgr2=0x5608810fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:40.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.025+0000 7f3752ffd640 0 client.25591 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:40.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.025+0000 7f377c467740 1 -- 172.21.15.152:0/1753340741 shutdown_connections 2024-09-11T22:06:40.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.025+0000 7f377c467740 1 -- 172.21.15.152:0/1753340741 wait complete. 2024-09-11T22:06:40.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.025+0000 7f377c467740 20 client.25591 trim_cache size 0 max 16384 2024-09-11T22:06:40.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f377c467740 1 Processor -- start 2024-09-11T22:06:40.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f377c467740 1 -- start start 2024-09-11T22:06:40.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f377c467740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810f97b0 0x5608811030e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f377c467740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810fad20 0x5608810fc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f377c467740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 0x5608810fc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f377c467740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f376c15b1e0 con 0x560881104550 2024-09-11T22:06:40.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f377c467740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f376c158a80 con 0x5608810fad20 2024-09-11T22:06:40.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f377c467740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f376c156980 con 0x5608810f97b0 2024-09-11T22:06:40.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f3773fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 0x5608810fc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f3773fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 0x5608810fc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39228/0 (socket says 172.21.15.152:39228) 2024-09-11T22:06:40.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f37737fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810f97b0 0x5608811030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f3773fff640 1 -- 172.21.15.152:0/1630458137 learned_addr learned my addr 172.21.15.152:0/1630458137 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:40.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.053+0000 7f3772ffd640 1 --2- 172.21.15.152:0/1630458137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810fad20 0x5608810fc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.054+0000 7f37737fe640 1 -- 172.21.15.152:0/1630458137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810fad20 msgr2=0x5608810fc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:40.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.054+0000 7f37737fe640 1 --2- 172.21.15.152:0/1630458137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810fad20 0x5608810fc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.054+0000 7f37737fe640 1 -- 172.21.15.152:0/1630458137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 msgr2=0x5608810fc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:40.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.054+0000 7f37737fe640 1 --2- 172.21.15.152:0/1630458137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 0x5608810fc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.054+0000 7f37737fe640 1 -- 172.21.15.152:0/1630458137 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608810f6b40 con 0x5608810f97b0 2024-09-11T22:06:40.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.054+0000 7f37737fe640 1 --2- 172.21.15.152:0/1630458137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810f97b0 0x5608811030e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x560881116e20 tx=0x7f376000b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a41a13b4c7b814a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:40.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.054+0000 7f375d7fa640 1 -- 172.21.15.152:0/1630458137 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760003d20 con 0x5608810f97b0 2024-09-11T22:06:40.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.054+0000 7f375d7fa640 1 -- 172.21.15.152:0/1630458137 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3760003ec0 con 0x5608810f97b0 2024-09-11T22:06:40.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.054+0000 7f375d7fa640 1 -- 172.21.15.152:0/1630458137 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760012740 con 0x5608810f97b0 2024-09-11T22:06:40.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.055+0000 7f377c467740 1 -- 172.21.15.152:0/1630458137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810f97b0 msgr2=0x5608811030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:40.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.055+0000 7f377c467740 1 --2- 172.21.15.152:0/1630458137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810f97b0 0x5608811030e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x560881116e20 tx=0x7f376000b390 comp rx=0 tx=0).stop 2024-09-11T22:06:40.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.056+0000 7f377c467740 1 -- 172.21.15.152:0/1630458137 shutdown_connections 2024-09-11T22:06:40.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.056+0000 7f377c467740 1 --2- 172.21.15.152:0/1630458137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560881104550 0x5608810fc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.056+0000 7f377c467740 1 --2- 172.21.15.152:0/1630458137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608810fad20 0x5608810fc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.056+0000 7f377c467740 1 --2- 172.21.15.152:0/1630458137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810f97b0 0x5608811030e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.056+0000 7f377c467740 1 -- 172.21.15.152:0/1630458137 >> 172.21.15.152:0/1630458137 conn(0x5608810c2310 msgr2=0x5608811029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:40.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.056+0000 7f377c467740 1 -- 172.21.15.152:0/1630458137 shutdown_connections 2024-09-11T22:06:40.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.056+0000 7f377c467740 1 -- 172.21.15.152:0/1630458137 wait complete. 2024-09-11T22:06:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.057+0000 7f377c467740 1 -- start start 2024-09-11T22:06:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.057+0000 7f377c467740 1 Processor -- start 2024-09-11T22:06:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f377c467740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608810f97b0 0x56088110c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f377c467740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x56088110ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f377c467740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560881104550 0x5608810fdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f377c467740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f376c156f40 con 0x5608810f97b0 2024-09-11T22:06:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f377c467740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1583b0 con 0x560881104550 2024-09-11T22:06:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f377c467740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f376c157610 con 0x5608810fad20 2024-09-11T22:06:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f377c467740 10 client.0 _ll_register_callbacks cb 0x7f377406e710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x56088110ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x56088110ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54172/0 (socket says 172.21.15.152:54172) 2024-09-11T22:06:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f3772ffd640 1 -- 172.21.15.152:0/2909677389 learned_addr learned my addr 172.21.15.152:0/2909677389 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:40.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f3773fff640 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560881104550 0x5608810fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f3772ffd640 1 -- 172.21.15.152:0/2909677389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560881104550 msgr2=0x5608810fdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:40.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f3772ffd640 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560881104550 0x5608810fdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f3772ffd640 1 -- 172.21.15.152:0/2909677389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608810f97b0 msgr2=0x56088110c8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:06:40.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f3772ffd640 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608810f97b0 0x56088110c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.058+0000 7f3772ffd640 1 -- 172.21.15.152:0/2909677389 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608810fe2f0 con 0x5608810fad20 2024-09-11T22:06:40.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.059+0000 7f3772ffd640 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x56088110ce30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f376809a950 tx=0x7f37680a38d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36157c8c20f25f3e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:40.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.059+0000 7f3752ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:06:40.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.060+0000 7f3752ffd640 1 -- 172.21.15.152:0/2909677389 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768020050 con 0x5608810fad20 2024-09-11T22:06:40.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.060+0000 7f3752ffd640 1 -- 172.21.15.152:0/2909677389 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f37680972c0 con 0x5608810fad20 2024-09-11T22:06:40.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.061+0000 7f377c467740 1 -- 172.21.15.152:0/2909677389 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3760003ec0 con 0x5608810fad20 2024-09-11T22:06:40.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.061+0000 7f3752ffd640 1 -- 172.21.15.152:0/2909677389 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3768017040 con 0x5608810fad20 2024-09-11T22:06:40.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.061+0000 7f377c467740 10 client.25597 fetch_fsmap learned FSMap version 28 2024-09-11T22:06:40.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.061+0000 7f377c467740 1 -- 172.21.15.152:0/2909677389 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56088117ea90 con 0x5608810fad20 2024-09-11T22:06:40.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.062+0000 7f3752ffd640 1 -- 172.21.15.152:0/2909677389 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37680b92e0 con 0x5608810fad20 2024-09-11T22:06:40.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.062+0000 7f3752ffd640 1 -- 172.21.15.152:0/2909677389 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f376809a0a0 con 0x5608810fad20 2024-09-11T22:06:40.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.062+0000 7f377c467740 10 client.25597 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:06:40.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.062+0000 7f377c467740 10 client.25597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:40.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.062+0000 7f377c467740 20 client.25597 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:40.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.062+0000 7f377c467740 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56088117f240 0x560881181660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:40.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.062+0000 7f377c467740 4 client.25597 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:06:40.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.062+0000 7f377c467740 1 -- 172.21.15.152:0/2909677389 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3760003ec0 con 0x56088117f240 2024-09-11T22:06:40.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.062+0000 7f37737fe640 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56088117f240 0x560881181660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:40.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.063+0000 7f37737fe640 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56088117f240 0x560881181660 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d37315e9038f69e server_cookie=fa2f0c7964ff9a62 in_seq=0 out_seq=0 2024-09-11T22:06:40.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.063+0000 7f3752ffd640 10 client.25597 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:40.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.064+0000 7f3752ffd640 1 -- 172.21.15.152:0/2909677389 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3760003ec0 con 0x56088117f240 2024-09-11T22:06:40.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.064+0000 7f3752ffd640 10 client.25597 handle_command_reply: tid=0 2024-09-11T22:06:40.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.064+0000 7f377c467740 1 client.25597 shutdown 2024-09-11T22:06:40.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.064+0000 7f377c467740 1 -- 172.21.15.152:0/2909677389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 msgr2=0x56088110ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:40.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.064+0000 7f377c467740 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x56088110ce30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f376809a950 tx=0x7f37680a38d0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.065+0000 7f377c467740 1 -- 172.21.15.152:0/2909677389 shutdown_connections 2024-09-11T22:06:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.065+0000 7f377c467740 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56088117f240 0x560881181660 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.065+0000 7f377c467740 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560881104550 0x5608810fdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.065+0000 7f377c467740 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5608810fad20 0x56088110ce30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.065+0000 7f377c467740 1 --2- 172.21.15.152:0/2909677389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608810f97b0 0x56088110c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.065+0000 7f3752ffd640 0 client.25597 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.065+0000 7f377c467740 1 -- 172.21.15.152:0/2909677389 >> 172.21.15.152:0/2909677389 conn(0x5608810c2310 msgr2=0x5608811031f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.066+0000 7f377c467740 1 -- 172.21.15.152:0/2909677389 shutdown_connections 2024-09-11T22:06:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.066+0000 7f377c467740 1 -- 172.21.15.152:0/2909677389 wait complete. 2024-09-11T22:06:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.066+0000 7f377c467740 20 client.25597 trim_cache size 0 max 16384 2024-09-11T22:06:40.068 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:06:40.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 -- 172.21.15.152:0/4100929265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37640a3140 msgr2=0x7f37640a5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:40.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37640a3140 0x7f37640a5600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x560881106f20 tx=0x7f37740ab3e0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 -- 172.21.15.152:0/4100929265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c0aa230 msgr2=0x7f376c1438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:40.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c0aa230 0x7f376c1438a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f376800d6d0 tx=0x7f376800db90 comp rx=0 tx=0).stop 2024-09-11T22:06:40.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 -- 172.21.15.152:0/4100929265 shutdown_connections 2024-09-11T22:06:40.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37640a3140 0x7f37640a5600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c0aab50 0x7f376c147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c0aa230 0x7f376c1438a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 --2- 172.21.15.152:0/4100929265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0a4d30 0x7f376c143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:40.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 -- 172.21.15.152:0/4100929265 >> 172.21.15.152:0/4100929265 conn(0x7f376c01a0a0 msgr2=0x7f376c0a6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:40.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 -- 172.21.15.152:0/4100929265 shutdown_connections 2024-09-11T22:06:40.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:40.067+0000 7f3778e2c640 1 -- 172.21.15.152:0/4100929265 wait complete. 2024-09-11T22:06:40.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:39 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:06:40.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:39 smithi152 ceph-mon[31188]: pgmap v74: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 814 op/s 2024-09-11T22:06:40.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:39 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:06:40.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:39 smithi179 ceph-mon[35603]: pgmap v74: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 814 op/s 2024-09-11T22:06:40.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:39 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:06:40.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:39 smithi193 ceph-mon[35545]: pgmap v74: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 814 op/s 2024-09-11T22:06:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:41 smithi179 ceph-mon[35603]: pgmap v75: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 811 op/s 2024-09-11T22:06:41.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:41 smithi193 ceph-mon[35545]: pgmap v75: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 811 op/s 2024-09-11T22:06:41.831 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:06:41.831 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:06:41.864 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:41 smithi152 ceph-mon[31188]: pgmap v75: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 811 op/s 2024-09-11T22:06:42.242 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:42.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.899+0000 7f05e8d67640 1 -- 172.21.15.152:0/2300535152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05e4105560 msgr2=0x7f05e410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:42.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.899+0000 7f05e8d67640 1 --2- 172.21.15.152:0/2300535152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05e4105560 0x7f05e410d0e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00adb0 tx=0x7f05dc02b7a0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.899+0000 7f05e8d67640 1 -- 172.21.15.152:0/2300535152 shutdown_connections 2024-09-11T22:06:42.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.899+0000 7f05e8d67640 1 --2- 172.21.15.152:0/2300535152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05e4105560 0x7f05e410d0e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.899+0000 7f05e8d67640 1 --2- 172.21.15.152:0/2300535152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4100de0 0x7f05e4104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.899+0000 7f05e8d67640 1 --2- 172.21.15.152:0/2300535152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05e4100430 0x7f05e4100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.900+0000 7f05e8d67640 1 -- 172.21.15.152:0/2300535152 >> 172.21.15.152:0/2300535152 conn(0x7f05e4077230 msgr2=0x7f05e40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:42.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.900+0000 7f05e8d67640 1 -- 172.21.15.152:0/2300535152 shutdown_connections 2024-09-11T22:06:42.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.900+0000 7f05e8d67640 1 -- 172.21.15.152:0/2300535152 wait complete. 2024-09-11T22:06:42.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.902+0000 7f05e8d67640 1 Processor -- start 2024-09-11T22:06:42.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.902+0000 7f05e8d67640 1 -- start start 2024-09-11T22:06:42.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.902+0000 7f05e8d67640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4100430 0x7f05e4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.902+0000 7f05e8d67640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05e4100de0 0x7f05e4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.902+0000 7f05e8d67640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05e4105560 0x7f05e419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.902+0000 7f05e8d67640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4111fa0 con 0x7f05e4105560 2024-09-11T22:06:42.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.902+0000 7f05e8d67640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4111e20 con 0x7f05e4100430 2024-09-11T22:06:42.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.902+0000 7f05e8d67640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4112120 con 0x7f05e4100de0 2024-09-11T22:06:42.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.903+0000 7f05e259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4100430 0x7f05e4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.903+0000 7f05e259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4100430 0x7f05e4198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47914/0 (socket says 172.21.15.152:47914) 2024-09-11T22:06:42.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.903+0000 7f05e259c640 1 -- 172.21.15.152:0/888800335 learned_addr learned my addr 172.21.15.152:0/888800335 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:42.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.903+0000 7f05e2d9d640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05e4105560 0x7f05e419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.903+0000 7f05e1d9b640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05e4100de0 0x7f05e4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.903+0000 7f05e259c640 1 -- 172.21.15.152:0/888800335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05e4100de0 msgr2=0x7f05e4198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:42.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.903+0000 7f05e259c640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05e4100de0 0x7f05e4198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.903+0000 7f05e259c640 1 -- 172.21.15.152:0/888800335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05e4105560 msgr2=0x7f05e419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:42.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.903+0000 7f05e259c640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05e4105560 0x7f05e419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.903+0000 7f05e259c640 1 -- 172.21.15.152:0/888800335 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e419d3c0 con 0x7f05e4100430 2024-09-11T22:06:42.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.904+0000 7f05e259c640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4100430 0x7f05e4198410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f05d800e9f0 tx=0x7f05d800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:42.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.904+0000 7f05d37fe640 1 -- 172.21.15.152:0/888800335 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d800cd80 con 0x7f05e4100430 2024-09-11T22:06:42.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.904+0000 7f05d37fe640 1 -- 172.21.15.152:0/888800335 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05d8005500 con 0x7f05e4100430 2024-09-11T22:06:42.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.904+0000 7f05d37fe640 1 -- 172.21.15.152:0/888800335 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8010690 con 0x7f05e4100430 2024-09-11T22:06:42.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.904+0000 7f05e8d67640 1 -- 172.21.15.152:0/888800335 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e419d6b0 con 0x7f05e4100430 2024-09-11T22:06:42.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.905+0000 7f05e8d67640 1 -- 172.21.15.152:0/888800335 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e41a4f90 con 0x7f05e4100430 2024-09-11T22:06:42.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.908+0000 7f05d37fe640 1 -- 172.21.15.152:0/888800335 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f05d80046c0 con 0x7f05e4100430 2024-09-11T22:06:42.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.909+0000 7f05d37fe640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05cc0a2e40 0x7f05cc0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.909+0000 7f05d37fe640 1 -- 172.21.15.152:0/888800335 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f05d80cf7d0 con 0x7f05e4100430 2024-09-11T22:06:42.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.909+0000 7f05eb140740 1 Processor -- start 2024-09-11T22:06:42.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05e1d9b640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05cc0a2e40 0x7f05cc0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05eb140740 1 -- start start 2024-09-11T22:06:42.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05eb140740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f67f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05eb140740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f72800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05eb140740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 0x562cd7f75130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05eb140740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562cd7ecd280 con 0x562cd7f68480 2024-09-11T22:06:42.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05eb140740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562cd7e74b10 con 0x562cd7f72d40 2024-09-11T22:06:42.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05eb140740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562cd7ec9240 con 0x562cd7f67b60 2024-09-11T22:06:42.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05e1d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f72800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05e2d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 0x562cd7f75130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05e2d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 0x562cd7f75130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47926/0 (socket says 172.21.15.152:47926) 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05e1d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f72800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39256/0 (socket says 172.21.15.152:39256) 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.910+0000 7f05e2d9d640 1 -- 172.21.15.152:0/3399202508 learned_addr learned my addr 172.21.15.152:0/3399202508 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05e259c640 1 --2- 172.21.15.152:0/3399202508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f67f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05e1d9b640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05cc0a2e40 0x7f05cc0a5300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05d4005fd0 tx=0x7f05d4005850 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05e259c640 1 -- 172.21.15.152:0/3399202508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 msgr2=0x562cd7f75130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05e259c640 1 --2- 172.21.15.152:0/3399202508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 0x562cd7f75130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05e259c640 1 -- 172.21.15.152:0/3399202508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 msgr2=0x562cd7f72800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05e259c640 1 --2- 172.21.15.152:0/3399202508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f72800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05e259c640 1 -- 172.21.15.152:0/3399202508 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd7e811f0 con 0x562cd7f67b60 2024-09-11T22:06:42.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05e2d9d640 1 --2- 172.21.15.152:0/3399202508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 0x562cd7f75130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05e1d9b640 1 --2- 172.21.15.152:0/3399202508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f72800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05e259c640 1 --2- 172.21.15.152:0/3399202508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f67f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f05d80ccef0 tx=0x7f05d809b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53a325c1a97c4ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05d0ff9640 1 -- 172.21.15.152:0/3399202508 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80b9070 con 0x562cd7f67b60 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.911+0000 7f05d0ff9640 1 -- 172.21.15.152:0/3399202508 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05d809bcc0 con 0x562cd7f67b60 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.912+0000 7f05d0ff9640 1 -- 172.21.15.152:0/3399202508 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80cd300 con 0x562cd7f67b60 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.912+0000 7f05eb140740 1 -- 172.21.15.152:0/3399202508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 msgr2=0x562cd7f67f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.912+0000 7f05eb140740 1 --2- 172.21.15.152:0/3399202508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f67f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f05d80ccef0 tx=0x7f05d809b8c0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.912+0000 7f05eb140740 1 -- 172.21.15.152:0/3399202508 shutdown_connections 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.912+0000 7f05eb140740 1 --2- 172.21.15.152:0/3399202508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 0x562cd7f75130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.912+0000 7f05eb140740 1 --2- 172.21.15.152:0/3399202508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f72800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.912+0000 7f05eb140740 1 --2- 172.21.15.152:0/3399202508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f67f40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.912+0000 7f05eb140740 1 -- 172.21.15.152:0/3399202508 >> 172.21.15.152:0/3399202508 conn(0x562cd7f640f0 msgr2=0x562cd7f644d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.913+0000 7f05eb140740 1 -- 172.21.15.152:0/3399202508 shutdown_connections 2024-09-11T22:06:42.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.913+0000 7f05eb140740 1 -- 172.21.15.152:0/3399202508 wait complete. 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.913+0000 7f05eb140740 1 -- start start 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.913+0000 7f05eb140740 1 Processor -- start 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.914+0000 7f05eb140740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f6fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.914+0000 7f05eb140740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f68480 0x562cd7f701b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.914+0000 7f05e259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f6fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.914+0000 7f05eb140740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f72d40 0x562cd7f706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.914+0000 7f05e259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f6fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54210/0 (socket says 172.21.15.152:54210) 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.914+0000 7f05e259c640 1 -- 172.21.15.152:0/4143409029 learned_addr learned my addr 172.21.15.152:0/4143409029 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05eb140740 1 -- 172.21.15.152:0/4143409029 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562cd7f75960 con 0x562cd7f72d40 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05eb140740 1 -- 172.21.15.152:0/4143409029 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562cd7e87f10 con 0x562cd7f68480 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05e1d9b640 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f68480 0x562cd7f701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05e2d9d640 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f72d40 0x562cd7f706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05eb140740 1 -- 172.21.15.152:0/4143409029 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562cd7f75ae0 con 0x562cd7f67b60 2024-09-11T22:06:42.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05eb140740 10 client.0 _ll_register_callbacks cb 0x562cd7e50a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:42.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05e259c640 1 -- 172.21.15.152:0/4143409029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f68480 msgr2=0x562cd7f701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:42.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05e259c640 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f68480 0x562cd7f701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05e259c640 1 -- 172.21.15.152:0/4143409029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f72d40 msgr2=0x562cd7f706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:42.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05e259c640 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f72d40 0x562cd7f706f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05e259c640 1 -- 172.21.15.152:0/4143409029 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd7c3e6a0 con 0x562cd7f67b60 2024-09-11T22:06:42.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05e2d9d640 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f72d40 0x562cd7f706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:06:42.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05e259c640 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f6fc70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f05d8005760 tx=0x7f05d8009790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc8326925aa99087 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:42.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.915+0000 7f05c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:06:42.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.916+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4143409029 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80b9070 con 0x562cd7f67b60 2024-09-11T22:06:42.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.916+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4143409029 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f05d80a46a0 con 0x562cd7f67b60 2024-09-11T22:06:42.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.916+0000 7f05eb140740 1 -- 172.21.15.152:0/4143409029 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05d809bcc0 con 0x562cd7f67b60 2024-09-11T22:06:42.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.917+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4143409029 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05d80a4930 con 0x562cd7f67b60 2024-09-11T22:06:42.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.917+0000 7f05eb140740 10 client.25609 fetch_fsmap learned FSMap version 28 2024-09-11T22:06:42.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.917+0000 7f05eb140740 1 -- 172.21.15.152:0/4143409029 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562cd7f75960 con 0x562cd7f67b60 2024-09-11T22:06:42.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.917+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4143409029 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05d80a0070 con 0x562cd7f67b60 2024-09-11T22:06:42.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.918+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4143409029 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f05d809ab80 con 0x562cd7f67b60 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.918+0000 7f05eb140740 10 client.25609 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.918+0000 7f05eb140740 10 client.25609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.918+0000 7f05eb140740 20 client.25609 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.918+0000 7f05eb140740 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562cd7f82760 0x562cd7f84b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.918+0000 7f05eb140740 4 client.25609 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.918+0000 7f05eb140740 1 -- 172.21.15.152:0/4143409029 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f05d809bcc0 con 0x562cd7f82760 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.918+0000 7f05e1d9b640 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562cd7f82760 0x562cd7f84b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.919+0000 7f05e1d9b640 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562cd7f82760 0x562cd7f84b50 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67eef4865234f396 server_cookie=fa1a361b35478921 in_seq=0 out_seq=0 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.919+0000 7f05c9ffb640 10 client.25609 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4143409029 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f05d809bcc0 con 0x562cd7f82760 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05c9ffb640 10 client.25609 handle_command_reply: tid=0 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 1 client.25609 shutdown 2024-09-11T22:06:42.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 1 -- 172.21.15.152:0/4143409029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 msgr2=0x562cd7f6fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f6fc70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f05d8005760 tx=0x7f05d8009790 comp rx=0 tx=0).stop 2024-09-11T22:06:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 1 -- 172.21.15.152:0/4143409029 shutdown_connections 2024-09-11T22:06:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562cd7f82760 0x562cd7f84b50 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f72d40 0x562cd7f706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f68480 0x562cd7f701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 1 --2- 172.21.15.152:0/4143409029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f6fc70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 1 -- 172.21.15.152:0/4143409029 >> 172.21.15.152:0/4143409029 conn(0x562cd7f640f0 msgr2=0x562cd7f63270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05c9ffb640 0 client.25609 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 1 -- 172.21.15.152:0/4143409029 shutdown_connections 2024-09-11T22:06:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 1 -- 172.21.15.152:0/4143409029 wait complete. 2024-09-11T22:06:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.920+0000 7f05eb140740 20 client.25609 trim_cache size 0 max 16384 2024-09-11T22:06:42.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.950+0000 7f05eb140740 1 Processor -- start 2024-09-11T22:06:42.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.951+0000 7f05eb140740 1 -- start start 2024-09-11T22:06:42.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.951+0000 7f05eb140740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f67b60 0x562cd7f70540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.951+0000 7f05eb140740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f8a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.951+0000 7f05eb140740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f72d40 0x562cd7f8a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.951+0000 7f05eb140740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41b0280 con 0x562cd7f68480 2024-09-11T22:06:42.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.951+0000 7f05eb140740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41adb20 con 0x562cd7f67b60 2024-09-11T22:06:42.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.951+0000 7f05eb140740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41ab970 con 0x562cd7f72d40 2024-09-11T22:06:42.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.952+0000 7f05e1d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f8a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.952+0000 7f05e259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f67b60 0x562cd7f70540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.952+0000 7f05e1d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f8a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39270/0 (socket says 172.21.15.152:39270) 2024-09-11T22:06:42.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.952+0000 7f05e1d9b640 1 -- 172.21.15.152:0/68067142 learned_addr learned my addr 172.21.15.152:0/68067142 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:42.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.952+0000 7f05e2d9d640 1 --2- 172.21.15.152:0/68067142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f72d40 0x562cd7f8a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.952+0000 7f05e259c640 1 -- 172.21.15.152:0/68067142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f72d40 msgr2=0x562cd7f8a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:42.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.952+0000 7f05e259c640 1 --2- 172.21.15.152:0/68067142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f72d40 0x562cd7f8a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.952+0000 7f05e259c640 1 -- 172.21.15.152:0/68067142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 msgr2=0x562cd7f8a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:42.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.952+0000 7f05e259c640 1 --2- 172.21.15.152:0/68067142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f8a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.952+0000 7f05e259c640 1 -- 172.21.15.152:0/68067142 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd7f651a0 con 0x562cd7f67b60 2024-09-11T22:06:42.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.952+0000 7f05e2d9d640 1 --2- 172.21.15.152:0/68067142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f72d40 0x562cd7f8a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:42.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.953+0000 7f05e259c640 1 --2- 172.21.15.152:0/68067142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f67b60 0x562cd7f70540 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05d8098120 tx=0x7f05d809a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f28a8d85029004a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:42.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.953+0000 7f05cbfff640 1 -- 172.21.15.152:0/68067142 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80b9070 con 0x562cd7f67b60 2024-09-11T22:06:42.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.953+0000 7f05cbfff640 1 -- 172.21.15.152:0/68067142 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05d80a1200 con 0x562cd7f67b60 2024-09-11T22:06:42.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.953+0000 7f05cbfff640 1 -- 172.21.15.152:0/68067142 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d809ab80 con 0x562cd7f67b60 2024-09-11T22:06:42.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.954+0000 7f05eb140740 1 -- 172.21.15.152:0/68067142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f67b60 msgr2=0x562cd7f70540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:42.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.954+0000 7f05eb140740 1 --2- 172.21.15.152:0/68067142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f67b60 0x562cd7f70540 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05d8098120 tx=0x7f05d809a1d0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.954+0000 7f05eb140740 1 -- 172.21.15.152:0/68067142 shutdown_connections 2024-09-11T22:06:42.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.954+0000 7f05eb140740 1 --2- 172.21.15.152:0/68067142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f72d40 0x562cd7f8a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.954+0000 7f05eb140740 1 --2- 172.21.15.152:0/68067142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f8a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.954+0000 7f05eb140740 1 --2- 172.21.15.152:0/68067142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f67b60 0x562cd7f70540 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.955+0000 7f05eb140740 1 -- 172.21.15.152:0/68067142 >> 172.21.15.152:0/68067142 conn(0x562cd7f640f0 msgr2=0x562cd7f71be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:42.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.955+0000 7f05eb140740 1 -- 172.21.15.152:0/68067142 shutdown_connections 2024-09-11T22:06:42.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.955+0000 7f05eb140740 1 -- 172.21.15.152:0/68067142 wait complete. 2024-09-11T22:06:42.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.955+0000 7f05eb140740 1 -- start start 2024-09-11T22:06:42.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.956+0000 7f05eb140740 1 Processor -- start 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.956+0000 7f05eb140740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f76cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.956+0000 7f05eb140740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f77200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.956+0000 7f05e259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f76cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.956+0000 7f05e259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f76cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54230/0 (socket says 172.21.15.152:54230) 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.956+0000 7f05e259c640 1 -- 172.21.15.152:0/4024834171 learned_addr learned my addr 172.21.15.152:0/4024834171 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05e1d9b640 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f77200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05eb140740 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 0x562cd7f77740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05eb140740 1 -- 172.21.15.152:0/4024834171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41abfe0 con 0x562cd7f68480 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05eb140740 1 -- 172.21.15.152:0/4024834171 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41ad450 con 0x562cd7f72d40 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05eb140740 1 -- 172.21.15.152:0/4024834171 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41ac6b0 con 0x562cd7f67b60 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05e2d9d640 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 0x562cd7f77740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05eb140740 10 client.0 _ll_register_callbacks cb 0x7f05d80b7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:42.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05e259c640 1 -- 172.21.15.152:0/4024834171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 msgr2=0x562cd7f77740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:42.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05e259c640 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 0x562cd7f77740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05e259c640 1 -- 172.21.15.152:0/4024834171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 msgr2=0x562cd7f77200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:42.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05e259c640 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f77200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.957+0000 7f05e259c640 1 -- 172.21.15.152:0/4024834171 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd7ff4d00 con 0x562cd7f67b60 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.958+0000 7f05e259c640 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f76cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05d80cd4f0 tx=0x7f05d80a4db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e782f92a71608565 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.958+0000 7f05c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.958+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4024834171 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80b9070 con 0x562cd7f67b60 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.958+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4024834171 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f05d807ab60 con 0x562cd7f67b60 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.958+0000 7f05eb140740 1 -- 172.21.15.152:0/4024834171 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05d80a1200 con 0x562cd7f67b60 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.958+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4024834171 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05d80a0070 con 0x562cd7f67b60 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.958+0000 7f05eb140740 10 client.25615 fetch_fsmap learned FSMap version 28 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.958+0000 7f05eb140740 1 -- 172.21.15.152:0/4024834171 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562cd7ff4d00 con 0x562cd7f67b60 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.959+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4024834171 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05d80cd170 con 0x562cd7f67b60 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.959+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4024834171 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f05d8004f20 con 0x562cd7f67b60 2024-09-11T22:06:42.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.959+0000 7f05eb140740 10 client.25615 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:06:42.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.959+0000 7f05eb140740 10 client.25615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:42.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.959+0000 7f05eb140740 20 client.25615 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:42.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.959+0000 7f05eb140740 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562cd7ff62f0 0x562cd7ff86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:42.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.959+0000 7f05eb140740 4 client.25615 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:06:42.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.959+0000 7f05eb140740 1 -- 172.21.15.152:0/4024834171 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f05d80a1200 con 0x562cd7ff62f0 2024-09-11T22:06:42.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.959+0000 7f05e1d9b640 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562cd7ff62f0 0x562cd7ff86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:42.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.960+0000 7f05c9ffb640 10 client.25615 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:42.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.960+0000 7f05e1d9b640 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562cd7ff62f0 0x562cd7ff86e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94d348d02357e053 server_cookie=6b2799c4bd23b675 in_seq=0 out_seq=0 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.961+0000 7f05c9ffb640 1 -- 172.21.15.152:0/4024834171 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f05d80a1200 con 0x562cd7ff62f0 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.961+0000 7f05c9ffb640 10 client.25615 handle_command_reply: tid=0 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.961+0000 7f05eb140740 1 client.25615 shutdown 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.961+0000 7f05eb140740 1 -- 172.21.15.152:0/4024834171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 msgr2=0x562cd7f76cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.961+0000 7f05eb140740 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f76cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05d80cd4f0 tx=0x7f05d80a4db0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.962+0000 7f05eb140740 1 -- 172.21.15.152:0/4024834171 shutdown_connections 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.962+0000 7f05eb140740 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562cd7ff62f0 0x562cd7ff86e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.962+0000 7f05eb140740 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562cd7f72d40 0x562cd7f77740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.962+0000 7f05eb140740 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562cd7f68480 0x562cd7f77200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.962+0000 7f05eb140740 1 --2- 172.21.15.152:0/4024834171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cd7f67b60 0x562cd7f76cc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.962+0000 7f05eb140740 1 -- 172.21.15.152:0/4024834171 >> 172.21.15.152:0/4024834171 conn(0x562cd7f640f0 msgr2=0x562cd7f711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:42.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.962+0000 7f05c9ffb640 0 client.25615 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:42.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.962+0000 7f05eb140740 1 -- 172.21.15.152:0/4024834171 shutdown_connections 2024-09-11T22:06:42.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.962+0000 7f05eb140740 1 -- 172.21.15.152:0/4024834171 wait complete. 2024-09-11T22:06:42.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.962+0000 7f05eb140740 20 client.25615 trim_cache size 0 max 16384 2024-09-11T22:06:42.965 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:06:42.965 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:06:42.965 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "bc1b4e4d-5e52-4696-b796-40af0e402bd6", 2024-09-11T22:06:42.965 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:06:42.965 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:06:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 -- 172.21.15.152:0/888800335 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05cc0a2e40 msgr2=0x7f05cc0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05cc0a2e40 0x7f05cc0a5300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05d4005fd0 tx=0x7f05d4005850 comp rx=0 tx=0).stop 2024-09-11T22:06:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 -- 172.21.15.152:0/888800335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4100430 msgr2=0x7f05e4198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4100430 0x7f05e4198410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f05d800e9f0 tx=0x7f05d800edf0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 -- 172.21.15.152:0/888800335 shutdown_connections 2024-09-11T22:06:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f05cc0a2e40 0x7f05cc0a5300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05e4105560 0x7f05e419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05e4100de0 0x7f05e4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 --2- 172.21.15.152:0/888800335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4100430 0x7f05e4198410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 -- 172.21.15.152:0/888800335 >> 172.21.15.152:0/888800335 conn(0x7f05e4077230 msgr2=0x7f05e4103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:42.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 -- 172.21.15.152:0/888800335 shutdown_connections 2024-09-11T22:06:42.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:42.964+0000 7f05e8d67640 1 -- 172.21.15.152:0/888800335 wait complete. 2024-09-11T22:06:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.329+0000 7f1b34c4c640 1 -- 172.21.15.152:0/3456070357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3010d490 msgr2=0x7f1b30114fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.329+0000 7f1b34c4c640 1 --2- 172.21.15.152:0/3456070357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3010d490 0x7f1b30114fe0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009900 tx=0x7f1b2002a3f0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.330+0000 7f1b34c4c640 1 -- 172.21.15.152:0/3456070357 shutdown_connections 2024-09-11T22:06:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.330+0000 7f1b34c4c640 1 --2- 172.21.15.152:0/3456070357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3010d490 0x7f1b30114fe0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.330+0000 7f1b34c4c640 1 --2- 172.21.15.152:0/3456070357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b30108cf0 0x7f1b3010cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.330+0000 7f1b34c4c640 1 --2- 172.21.15.152:0/3456070357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30108340 0x7f1b30108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.330+0000 7f1b34c4c640 1 -- 172.21.15.152:0/3456070357 >> 172.21.15.152:0/3456070357 conn(0x7f1b30077a40 msgr2=0x7f1b30079e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.330+0000 7f1b34c4c640 1 -- 172.21.15.152:0/3456070357 shutdown_connections 2024-09-11T22:06:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.331+0000 7f1b34c4c640 1 -- 172.21.15.152:0/3456070357 wait complete. 2024-09-11T22:06:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.332+0000 7f1b34c4c640 1 Processor -- start 2024-09-11T22:06:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.332+0000 7f1b34c4c640 1 -- start start 2024-09-11T22:06:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.332+0000 7f1b34c4c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30108340 0x7f1b301a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.332+0000 7f1b34c4c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3010d490 0x7f1b301a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.332+0000 7f1b34c4c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b3019e710 0x7f1b3019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b34c4c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301184c0 con 0x7f1b3010d490 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30108340 0x7f1b301a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b34c4c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30118340 con 0x7f1b30108340 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b34c4c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30118640 con 0x7f1b3019e710 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30108340 0x7f1b301a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47984/0 (socket says 172.21.15.152:47984) 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2e59c640 1 -- 172.21.15.152:0/2830447806 learned_addr learned my addr 172.21.15.152:0/2830447806 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2dd9b640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3010d490 0x7f1b301a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b3019e710 0x7f1b3019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2e59c640 1 -- 172.21.15.152:0/2830447806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b3019e710 msgr2=0x7f1b3019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2e59c640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b3019e710 0x7f1b3019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2e59c640 1 -- 172.21.15.152:0/2830447806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3010d490 msgr2=0x7f1b301a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2e59c640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3010d490 0x7f1b301a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2e59c640 1 -- 172.21.15.152:0/2830447806 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3019f310 con 0x7f1b30108340 2024-09-11T22:06:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b3019e710 0x7f1b3019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:06:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.333+0000 7f1b2e59c640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30108340 0x7f1b301a4650 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800ebc0 tx=0x7f1b2800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.334+0000 7f1b1f7fe640 1 -- 172.21.15.152:0/2830447806 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28010630 con 0x7f1b30108340 2024-09-11T22:06:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.334+0000 7f1b1f7fe640 1 -- 172.21.15.152:0/2830447806 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b28010cb0 con 0x7f1b30108340 2024-09-11T22:06:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.334+0000 7f1b1f7fe640 1 -- 172.21.15.152:0/2830447806 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28018bd0 con 0x7f1b30108340 2024-09-11T22:06:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.334+0000 7f1b34c4c640 1 -- 172.21.15.152:0/2830447806 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b301ab3f0 con 0x7f1b30108340 2024-09-11T22:06:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.334+0000 7f1b34c4c640 1 -- 172.21.15.152:0/2830447806 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b301ab7a0 con 0x7f1b30108340 2024-09-11T22:06:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b379e6740 1 Processor -- start 2024-09-11T22:06:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b379e6740 1 -- start start 2024-09-11T22:06:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b379e6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b97baf0 0x561c3b97bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b379e6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97c410 0x561c3b986770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b1f7fe640 1 -- 172.21.15.152:0/2830447806 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f1b280107d0 con 0x7f1b30108340 2024-09-11T22:06:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b379e6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b986cb0 0x561c3b9890a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b379e6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561c3b8e02f0 con 0x561c3b97c410 2024-09-11T22:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b379e6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561c3b888270 con 0x561c3b97baf0 2024-09-11T22:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b379e6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561c3b8dc2b0 con 0x561c3b986cb0 2024-09-11T22:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b2ed9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b97baf0 0x561c3b97bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b2ed9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b97baf0 0x561c3b97bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47994/0 (socket says 172.21.15.152:47994) 2024-09-11T22:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.338+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/1995718796 learned_addr learned my addr 172.21.15.152:0/1995718796 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.339+0000 7f1b2e59c640 1 --2- 172.21.15.152:0/1995718796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97c410 0x561c3b986770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.339+0000 7f1b2dd9b640 1 --2- 172.21.15.152:0/1995718796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b986cb0 0x561c3b9890a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.339+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/1995718796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b986cb0 msgr2=0x561c3b9890a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.339+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/1995718796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b986cb0 0x561c3b9890a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.339+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/1995718796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97c410 msgr2=0x561c3b986770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.339+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/1995718796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97c410 0x561c3b986770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.339+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/1995718796 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c3b887340 con 0x561c3b97baf0 2024-09-11T22:06:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.340+0000 7f1b1f7fe640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1b180a2e20 0x7f1b180a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.340+0000 7f1b1f7fe640 1 -- 172.21.15.152:0/2830447806 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1b280cfc00 con 0x7f1b30108340 2024-09-11T22:06:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.340+0000 7f1b2e59c640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1b180a2e20 0x7f1b180a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.341+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/1995718796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b97baf0 0x561c3b97bed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b20005c40 tx=0x7f1b20005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2df71a88bfb439 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.341+0000 7f1b1cff9640 1 -- 172.21.15.152:0/1995718796 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2003f070 con 0x561c3b97baf0 2024-09-11T22:06:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.341+0000 7f1b2e59c640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1b180a2e20 0x7f1b180a52e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x561c3b978ec0 tx=0x7f1b280d36b0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.341+0000 7f1b1cff9640 1 -- 172.21.15.152:0/1995718796 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b20004030 con 0x561c3b97baf0 2024-09-11T22:06:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.342+0000 7f1b1cff9640 1 -- 172.21.15.152:0/1995718796 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20035070 con 0x561c3b97baf0 2024-09-11T22:06:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.343+0000 7f1b379e6740 1 -- 172.21.15.152:0/1995718796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b97baf0 msgr2=0x561c3b97bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.343+0000 7f1b379e6740 1 --2- 172.21.15.152:0/1995718796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b97baf0 0x561c3b97bed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b20005c40 tx=0x7f1b20005e80 comp rx=0 tx=0).stop 2024-09-11T22:06:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.343+0000 7f1b379e6740 1 -- 172.21.15.152:0/1995718796 shutdown_connections 2024-09-11T22:06:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.343+0000 7f1b379e6740 1 --2- 172.21.15.152:0/1995718796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b986cb0 0x561c3b9890a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.343+0000 7f1b379e6740 1 --2- 172.21.15.152:0/1995718796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97c410 0x561c3b986770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.343+0000 7f1b379e6740 1 --2- 172.21.15.152:0/1995718796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b97baf0 0x561c3b97bed0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.343+0000 7f1b379e6740 1 -- 172.21.15.152:0/1995718796 >> 172.21.15.152:0/1995718796 conn(0x561c3b978060 msgr2=0x561c3b978440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.343+0000 7f1b379e6740 1 -- 172.21.15.152:0/1995718796 shutdown_connections 2024-09-11T22:06:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.343+0000 7f1b379e6740 1 -- 172.21.15.152:0/1995718796 wait complete. 2024-09-11T22:06:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.343+0000 7f1b379e6740 1 -- start start 2024-09-11T22:06:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.343+0000 7f1b379e6740 1 Processor -- start 2024-09-11T22:06:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b379e6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b983af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b379e6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97c410 0x561c3b984030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b2ed9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b983af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b2dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97c410 0x561c3b984030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b2ed9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b983af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54272/0 (socket says 172.21.15.152:54272) 2024-09-11T22:06:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/2232082911 learned_addr learned my addr 172.21.15.152:0/2232082911 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b379e6740 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b986cb0 0x561c3b984570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b379e6740 1 -- 172.21.15.152:0/2232082911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561c3b989880 con 0x561c3b97c410 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b379e6740 1 -- 172.21.15.152:0/2232082911 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561c3b869290 con 0x561c3b986cb0 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b379e6740 1 -- 172.21.15.152:0/2232082911 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561c3b989a00 con 0x561c3b97baf0 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b379e6740 10 client.0 _ll_register_callbacks cb 0x561c3b89a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/2232082911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b986cb0 msgr2=0x561c3b984570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b986cb0 0x561c3b984570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/2232082911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97c410 msgr2=0x561c3b984030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97c410 0x561c3b984030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.344+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/2232082911 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c3b5f3210 con 0x561c3b97baf0 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.345+0000 7f1b379e6740 1 -- 172.21.15.152:0/2232082911 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b20004030 con 0x561c3b97baf0 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.345+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b983af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009850 tx=0x7f1b20032e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f46d8d6b370cb06f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.345+0000 7f1b15ffb640 10 client.25624 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:06:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.345+0000 7f1b15ffb640 1 -- 172.21.15.152:0/2232082911 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20035050 con 0x561c3b97baf0 2024-09-11T22:06:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.345+0000 7f1b15ffb640 1 -- 172.21.15.152:0/2232082911 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1b200315b0 con 0x561c3b97baf0 2024-09-11T22:06:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.345+0000 7f1b15ffb640 1 -- 172.21.15.152:0/2232082911 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b2003f040 con 0x561c3b97baf0 2024-09-11T22:06:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.345+0000 7f1b379e6740 10 client.25624 fetch_fsmap learned FSMap version 28 2024-09-11T22:06:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.345+0000 7f1b379e6740 1 -- 172.21.15.152:0/2232082911 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561c3b6bf620 con 0x561c3b97baf0 2024-09-11T22:06:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.346+0000 7f1b15ffb640 1 -- 172.21.15.152:0/2232082911 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1b200317b0 con 0x561c3b97baf0 2024-09-11T22:06:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.346+0000 7f1b379e6740 10 client.25624 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.346+0000 7f1b379e6740 10 client.25624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.346+0000 7f1b379e6740 20 client.25624 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.346+0000 7f1b379e6740 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561c3b996c10 0x561c3b9990b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.346+0000 7f1b379e6740 4 client.25624 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.346+0000 7f1b379e6740 1 -- 172.21.15.152:0/2232082911 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c3b8eda20 con 0x561c3b996c10 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.346+0000 7f1b2dd9b640 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561c3b996c10 0x561c3b9990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.347+0000 7f1b15ffb640 10 client.25624 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.347+0000 7f1b2dd9b640 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561c3b996c10 0x561c3b9990b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5a90c29a41a1bbc server_cookie=8e1b845128ac0fb9 in_seq=0 out_seq=0 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.348+0000 7f1b15ffb640 1 -- 172.21.15.152:0/2232082911 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561c3b8eda20 con 0x561c3b996c10 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.348+0000 7f1b15ffb640 10 client.25624 handle_command_reply: tid=0 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.348+0000 7f1b379e6740 1 client.25624 shutdown 2024-09-11T22:06:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.348+0000 7f1b379e6740 1 -- 172.21.15.152:0/2232082911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 msgr2=0x561c3b983af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.348+0000 7f1b379e6740 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b983af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009850 tx=0x7f1b20032e70 comp rx=0 tx=0).stop 2024-09-11T22:06:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.349+0000 7f1b379e6740 1 -- 172.21.15.152:0/2232082911 shutdown_connections 2024-09-11T22:06:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.349+0000 7f1b379e6740 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561c3b996c10 0x561c3b9990b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.349+0000 7f1b379e6740 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b986cb0 0x561c3b984570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.349+0000 7f1b379e6740 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97c410 0x561c3b984030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.349+0000 7f1b379e6740 1 --2- 172.21.15.152:0/2232082911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b983af0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.349+0000 7f1b379e6740 1 -- 172.21.15.152:0/2232082911 >> 172.21.15.152:0/2232082911 conn(0x561c3b978060 msgr2=0x561c3b97ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.349+0000 7f1b15ffb640 0 client.25624 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.349+0000 7f1b379e6740 1 -- 172.21.15.152:0/2232082911 shutdown_connections 2024-09-11T22:06:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.349+0000 7f1b379e6740 1 -- 172.21.15.152:0/2232082911 wait complete. 2024-09-11T22:06:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.349+0000 7f1b379e6740 20 client.25624 trim_cache size 0 max 16384 2024-09-11T22:06:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.373+0000 7f1b379e6740 1 Processor -- start 2024-09-11T22:06:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.373+0000 7f1b379e6740 1 -- start start 2024-09-11T22:06:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b379e6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97baf0 0x561c3b9843a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b379e6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97c410 0x561c3b985a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b379e6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b986cb0 0x561c3b99e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b379e6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301b6790 con 0x561c3b97baf0 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b379e6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301b4030 con 0x561c3b986cb0 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b379e6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301b1e80 con 0x561c3b97c410 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b2dd9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97c410 0x561c3b985a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b2dd9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97c410 0x561c3b985a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59360/0 (socket says 172.21.15.152:59360) 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b2dd9b640 1 -- 172.21.15.152:0/1858360857 learned_addr learned my addr 172.21.15.152:0/1858360857 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/1858360857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97baf0 0x561c3b9843a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/1858360857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b986cb0 0x561c3b99e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b2dd9b640 1 -- 172.21.15.152:0/1858360857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b986cb0 msgr2=0x561c3b99e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b2dd9b640 1 --2- 172.21.15.152:0/1858360857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b986cb0 0x561c3b99e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b2dd9b640 1 -- 172.21.15.152:0/1858360857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97baf0 msgr2=0x561c3b9843a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b2dd9b640 1 --2- 172.21.15.152:0/1858360857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97baf0 0x561c3b9843a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b2dd9b640 1 -- 172.21.15.152:0/1858360857 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c3b993530 con 0x561c3b97c410 2024-09-11T22:06:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.374+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/1858360857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97baf0 0x561c3b9843a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:06:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.375+0000 7f1b2dd9b640 1 --2- 172.21.15.152:0/1858360857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97c410 0x561c3b985a60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b3019ff60 tx=0x7f1b240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6acfadc0a5f370f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.376+0000 7f1b17fff640 1 -- 172.21.15.152:0/1858360857 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24003aa0 con 0x561c3b97c410 2024-09-11T22:06:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.376+0000 7f1b17fff640 1 -- 172.21.15.152:0/1858360857 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b24003c40 con 0x561c3b97c410 2024-09-11T22:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.376+0000 7f1b17fff640 1 -- 172.21.15.152:0/1858360857 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2401e630 con 0x561c3b97c410 2024-09-11T22:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.377+0000 7f1b379e6740 1 -- 172.21.15.152:0/1858360857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97c410 msgr2=0x561c3b985a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.377+0000 7f1b379e6740 1 --2- 172.21.15.152:0/1858360857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97c410 0x561c3b985a60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b3019ff60 tx=0x7f1b240046c0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.377+0000 7f1b379e6740 1 -- 172.21.15.152:0/1858360857 shutdown_connections 2024-09-11T22:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.377+0000 7f1b379e6740 1 --2- 172.21.15.152:0/1858360857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b986cb0 0x561c3b99e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.377+0000 7f1b379e6740 1 --2- 172.21.15.152:0/1858360857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97c410 0x561c3b985a60 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b3019ff60 tx=0x7f1b240046c0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.377+0000 7f1b379e6740 1 --2- 172.21.15.152:0/1858360857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b97baf0 0x561c3b9843a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.377+0000 7f1b379e6740 1 -- 172.21.15.152:0/1858360857 >> 172.21.15.152:0/1858360857 conn(0x561c3b978060 msgr2=0x561c3b985350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.377+0000 7f1b379e6740 1 -- 172.21.15.152:0/1858360857 shutdown_connections 2024-09-11T22:06:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.378+0000 7f1b379e6740 1 -- 172.21.15.152:0/1858360857 wait complete. 2024-09-11T22:06:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.378+0000 7f1b379e6740 1 -- start start 2024-09-11T22:06:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.378+0000 7f1b379e6740 1 Processor -- start 2024-09-11T22:06:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.378+0000 7f1b379e6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b98f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b379e6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b986cb0 0x561c3b98f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b379e6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b9fa0c0 0x561c3b9fa540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b2ed9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b98f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b379e6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301b24f0 con 0x561c3b986cb0 2024-09-11T22:06:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b2ed9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b98f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59376/0 (socket says 172.21.15.152:59376) 2024-09-11T22:06:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b379e6740 1 -- 172.21.15.152:0/757026099 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301b3960 con 0x561c3b9fa0c0 2024-09-11T22:06:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/757026099 learned_addr learned my addr 172.21.15.152:0/757026099 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b379e6740 1 -- 172.21.15.152:0/757026099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301b2bc0 con 0x561c3b97baf0 2024-09-11T22:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b379e6740 10 client.0 _ll_register_callbacks cb 0x7f1b280d3580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b9fa0c0 0x561c3b9fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b2dd9b640 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b986cb0 0x561c3b98f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/757026099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b9fa0c0 msgr2=0x561c3b9fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b9fa0c0 0x561c3b9fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/757026099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b986cb0 msgr2=0x561c3b98f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b986cb0 0x561c3b98f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b2ed9d640 1 -- 172.21.15.152:0/757026099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c3b98bc90 con 0x561c3b97baf0 2024-09-11T22:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.379+0000 7f1b2dd9b640 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b986cb0 0x561c3b98f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:06:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.380+0000 7f1b2ed9d640 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b98f050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b2002a430 tx=0x7f1b20048000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33f0c0d53645b6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.380+0000 7f1b15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:06:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.380+0000 7f1b15ffb640 1 -- 172.21.15.152:0/757026099 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20061030 con 0x561c3b97baf0 2024-09-11T22:06:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.380+0000 7f1b15ffb640 1 -- 172.21.15.152:0/757026099 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1b200038d0 con 0x561c3b97baf0 2024-09-11T22:06:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.380+0000 7f1b379e6740 1 -- 172.21.15.152:0/757026099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b24003c40 con 0x561c3b97baf0 2024-09-11T22:06:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.383+0000 7f1b15ffb640 1 -- 172.21.15.152:0/757026099 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b20035070 con 0x561c3b97baf0 2024-09-11T22:06:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.383+0000 7f1b379e6740 10 client.25630 fetch_fsmap learned FSMap version 28 2024-09-11T22:06:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.383+0000 7f1b379e6740 1 -- 172.21.15.152:0/757026099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c3ba12960 con 0x561c3b97baf0 2024-09-11T22:06:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.384+0000 7f1b15ffb640 1 -- 172.21.15.152:0/757026099 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b24003c40 con 0x561c3b97baf0 2024-09-11T22:06:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.384+0000 7f1b15ffb640 1 -- 172.21.15.152:0/757026099 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1b2003ba70 con 0x561c3b97baf0 2024-09-11T22:06:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.384+0000 7f1b379e6740 10 client.25630 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:06:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.384+0000 7f1b379e6740 10 client.25630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.384+0000 7f1b379e6740 20 client.25630 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.384+0000 7f1b379e6740 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561c3ba12ec0 0x561c3ba152b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.385+0000 7f1b379e6740 4 client.25630 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:06:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.385+0000 7f1b379e6740 1 -- 172.21.15.152:0/757026099 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561c3b8e7d70 con 0x561c3ba12ec0 2024-09-11T22:06:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.385+0000 7f1b2dd9b640 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561c3ba12ec0 0x561c3ba152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:43.388 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:43 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:06:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.387+0000 7f1b2dd9b640 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561c3ba12ec0 0x561c3ba152b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9e355bf109a5213 server_cookie=6773eaf7b8c04467 in_seq=0 out_seq=0 2024-09-11T22:06:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.388+0000 7f1b15ffb640 10 client.25630 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.395+0000 7f1b15ffb640 1 -- 172.21.15.152:0/757026099 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561c3b8e7d70 con 0x561c3ba12ec0 2024-09-11T22:06:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.395+0000 7f1b15ffb640 10 client.25630 handle_command_reply: tid=0 2024-09-11T22:06:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.395+0000 7f1b379e6740 1 client.25630 shutdown 2024-09-11T22:06:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.396+0000 7f1b379e6740 1 -- 172.21.15.152:0/757026099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 msgr2=0x561c3b98f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.396+0000 7f1b379e6740 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b98f050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b2002a430 tx=0x7f1b20048000 comp rx=0 tx=0).stop 2024-09-11T22:06:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.396+0000 7f1b379e6740 1 -- 172.21.15.152:0/757026099 shutdown_connections 2024-09-11T22:06:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.396+0000 7f1b379e6740 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561c3ba12ec0 0x561c3ba152b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.396+0000 7f1b379e6740 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c3b9fa0c0 0x561c3b9fa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.396+0000 7f1b15ffb640 0 client.25630 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.397+0000 7f1b379e6740 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c3b986cb0 0x561c3b98f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.397+0000 7f1b379e6740 1 --2- 172.21.15.152:0/757026099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561c3b97baf0 0x561c3b98f050 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.397+0000 7f1b379e6740 1 -- 172.21.15.152:0/757026099 >> 172.21.15.152:0/757026099 conn(0x561c3b978060 msgr2=0x561c3b97dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.397+0000 7f1b379e6740 1 -- 172.21.15.152:0/757026099 shutdown_connections 2024-09-11T22:06:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.397+0000 7f1b379e6740 1 -- 172.21.15.152:0/757026099 wait complete. 2024-09-11T22:06:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.398+0000 7f1b379e6740 20 client.25630 trim_cache size 0 max 16384 2024-09-11T22:06:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:06:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:06:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:06:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:06:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 -- 172.21.15.152:0/2830447806 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1b180a2e20 msgr2=0x7f1b180a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1b180a2e20 0x7f1b180a52e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x561c3b978ec0 tx=0x7f1b280d36b0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 -- 172.21.15.152:0/2830447806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30108340 msgr2=0x7f1b301a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30108340 0x7f1b301a4650 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800ebc0 tx=0x7f1b2800c6a0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 -- 172.21.15.152:0/2830447806 shutdown_connections 2024-09-11T22:06:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1b180a2e20 0x7f1b180a52e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b3019e710 0x7f1b3019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3010d490 0x7f1b301a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 --2- 172.21.15.152:0/2830447806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30108340 0x7f1b301a4650 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 -- 172.21.15.152:0/2830447806 >> 172.21.15.152:0/2830447806 conn(0x7f1b30077a40 msgr2=0x7f1b30078480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 -- 172.21.15.152:0/2830447806 shutdown_connections 2024-09-11T22:06:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:43.399+0000 7f1b34c4c640 1 -- 172.21.15.152:0/2830447806 wait complete. 2024-09-11T22:06:43.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:43 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:06:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:43 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:06:43.706 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:06:44.184 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:44.460 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:44 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:06:44.460 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:44 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:06:44.460 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:44 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:06:44.460 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:44 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:06:44.460 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:44 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:06:44.460 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:44 smithi152 ceph-mon[31188]: pgmap v76: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2024-09-11T22:06:44.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:44 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:06:44.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:44 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:06:44.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:44 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:06:44.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:44 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:06:44.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:44 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:06:44.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:44 smithi179 ceph-mon[35603]: pgmap v76: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2024-09-11T22:06:44.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:44 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:06:44.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:44 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:06:44.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:44 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:06:44.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:44 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:06:44.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:44 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:06:44.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:44 smithi193 ceph-mon[35545]: pgmap v76: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2024-09-11T22:06:44.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.747+0000 7fa8e55ce640 1 -- 172.21.15.152:0/2681286327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e0109e00 msgr2=0x7fa8e010e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:44.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.747+0000 7fa8e55ce640 1 --2- 172.21.15.152:0/2681286327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e0109e00 0x7fa8e010e350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009370 tx=0x7fa8c802a500 comp rx=0 tx=0).stop 2024-09-11T22:06:44.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.747+0000 7fa8e55ce640 1 -- 172.21.15.152:0/2681286327 shutdown_connections 2024-09-11T22:06:44.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.747+0000 7fa8e55ce640 1 --2- 172.21.15.152:0/2681286327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e010ea80 0x7fa8e01154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.747+0000 7fa8e55ce640 1 --2- 172.21.15.152:0/2681286327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e0109e00 0x7fa8e010e350 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.747+0000 7fa8e55ce640 1 --2- 172.21.15.152:0/2681286327 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8e0109450 0x7fa8e0109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.747+0000 7fa8e55ce640 1 -- 172.21.15.152:0/2681286327 >> 172.21.15.152:0/2681286327 conn(0x7fa8e006e2d0 msgr2=0x7fa8e006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:44.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.748+0000 7fa8e55ce640 1 -- 172.21.15.152:0/2681286327 shutdown_connections 2024-09-11T22:06:44.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.748+0000 7fa8e55ce640 1 -- 172.21.15.152:0/2681286327 wait complete. 2024-09-11T22:06:44.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.749+0000 7fa8e55ce640 1 Processor -- start 2024-09-11T22:06:44.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.749+0000 7fa8e55ce640 1 -- start start 2024-09-11T22:06:44.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.749+0000 7fa8e55ce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8e0109450 0x7fa8e01a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.749+0000 7fa8e55ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e0109e00 0x7fa8e01a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.749+0000 7fa8e55ce640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e010ea80 0x7fa8e019e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.749+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e0109e00 0x7fa8e01a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.749+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e0109e00 0x7fa8e01a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34888/0 (socket says 172.21.15.152:34888) 2024-09-11T22:06:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.749+0000 7fa8d7fff640 1 -- 172.21.15.152:0/926634286 learned_addr learned my addr 172.21.15.152:0/926634286 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.749+0000 7fa8e55ce640 1 -- 172.21.15.152:0/926634286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e0118590 con 0x7fa8e0109450 2024-09-11T22:06:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.749+0000 7fa8e55ce640 1 -- 172.21.15.152:0/926634286 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e0118410 con 0x7fa8e0109e00 2024-09-11T22:06:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.749+0000 7fa8e55ce640 1 -- 172.21.15.152:0/926634286 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e0118710 con 0x7fa8e010ea80 2024-09-11T22:06:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.750+0000 7fa8df7fe640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e010ea80 0x7fa8e019e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.750+0000 7fa8deffd640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8e0109450 0x7fa8e01a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.750+0000 7fa8d7fff640 1 -- 172.21.15.152:0/926634286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e010ea80 msgr2=0x7fa8e019e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.750+0000 7fa8d7fff640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e010ea80 0x7fa8e019e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.750+0000 7fa8d7fff640 1 -- 172.21.15.152:0/926634286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8e0109450 msgr2=0x7fa8e01a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:44.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.750+0000 7fa8d7fff640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8e0109450 0x7fa8e01a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.750+0000 7fa8d7fff640 1 -- 172.21.15.152:0/926634286 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e019f010 con 0x7fa8e0109e00 2024-09-11T22:06:44.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.750+0000 7fa8d7fff640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e0109e00 0x7fa8e01a4c60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa8c802aaf0 tx=0x7fa8c80305d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:44.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.751+0000 7fa8dcff9640 1 -- 172.21.15.152:0/926634286 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8040070 con 0x7fa8e0109e00 2024-09-11T22:06:44.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.751+0000 7fa8dcff9640 1 -- 172.21.15.152:0/926634286 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8c8030bd0 con 0x7fa8e0109e00 2024-09-11T22:06:44.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.751+0000 7fa8e55ce640 1 -- 172.21.15.152:0/926634286 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e019f2a0 con 0x7fa8e0109e00 2024-09-11T22:06:44.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.751+0000 7fa8e55ce640 1 -- 172.21.15.152:0/926634286 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e01ab5f0 con 0x7fa8e0109e00 2024-09-11T22:06:44.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.752+0000 7fa8dcff9640 1 -- 172.21.15.152:0/926634286 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8035030 con 0x7fa8e0109e00 2024-09-11T22:06:44.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.756+0000 7fa8dcff9640 1 -- 172.21.15.152:0/926634286 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa8c8043070 con 0x7fa8e0109e00 2024-09-11T22:06:44.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.758+0000 7fa8dcff9640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8cc0a2e40 0x7fa8cc0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.758+0000 7fa8e79a7740 1 Processor -- start 2024-09-11T22:06:44.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.758+0000 7fa8e79a7740 1 -- start start 2024-09-11T22:06:44.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.758+0000 7fa8deffd640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8cc0a2e40 0x7fa8cc0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.758+0000 7fa8dcff9640 1 -- 172.21.15.152:0/926634286 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa8c80f0f40 con 0x7fa8e0109e00 2024-09-11T22:06:44.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.758+0000 7fa8e79a7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a04a0 0x55f2249a0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.758+0000 7fa8e79a7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249a0dc0 0x55f2249ab140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8e79a7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249ab680 0x55f2249ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8e79a7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f2249062e0 con 0x55f2249a0dc0 2024-09-11T22:06:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8e79a7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f2248adce0 con 0x55f2249ab680 2024-09-11T22:06:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8e79a7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f2249022a0 con 0x55f2249a04a0 2024-09-11T22:06:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8df7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249ab680 0x55f2249ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8df7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249ab680 0x55f2249ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34896/0 (socket says 172.21.15.152:34896) 2024-09-11T22:06:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8df7fe640 1 -- 172.21.15.152:0/1764508636 learned_addr learned my addr 172.21.15.152:0/1764508636 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8deffd640 1 --2- 172.21.15.152:0/1764508636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a04a0 0x55f2249a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8df7fe640 1 -- 172.21.15.152:0/1764508636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a04a0 msgr2=0x55f2249a0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8df7fe640 1 --2- 172.21.15.152:0/1764508636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a04a0 0x55f2249a0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8df7fe640 1 -- 172.21.15.152:0/1764508636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249a0dc0 msgr2=0x55f2249ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8df7fe640 1 --2- 172.21.15.152:0/1764508636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249a0dc0 0x55f2249ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8df7fe640 1 -- 172.21.15.152:0/1764508636 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f224892440 con 0x55f2249ab680 2024-09-11T22:06:44.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8deffd640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8cc0a2e40 0x7fa8cc0a5300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8e019fa20 tx=0x7fa8d00197d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:44.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.759+0000 7fa8df7fe640 1 --2- 172.21.15.152:0/1764508636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249ab680 0x55f2249ada70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800b3e0 tx=0x7fa8d800bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7d447ab440d4a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:44.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.760+0000 7fa8d57fa640 1 -- 172.21.15.152:0/1764508636 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8004b20 con 0x55f2249ab680 2024-09-11T22:06:44.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.760+0000 7fa8d57fa640 1 -- 172.21.15.152:0/1764508636 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8d8004cc0 con 0x55f2249ab680 2024-09-11T22:06:44.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.760+0000 7fa8d57fa640 1 -- 172.21.15.152:0/1764508636 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8015810 con 0x55f2249ab680 2024-09-11T22:06:44.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.761+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1764508636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249ab680 msgr2=0x55f2249ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:44.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.761+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/1764508636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249ab680 0x55f2249ada70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800b3e0 tx=0x7fa8d800bf90 comp rx=0 tx=0).stop 2024-09-11T22:06:44.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.761+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1764508636 shutdown_connections 2024-09-11T22:06:44.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.761+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/1764508636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249ab680 0x55f2249ada70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.761+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/1764508636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249a0dc0 0x55f2249ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.761+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/1764508636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a04a0 0x55f2249a0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.761+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1764508636 >> 172.21.15.152:0/1764508636 conn(0x55f22499ca30 msgr2=0x55f22499ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:44.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.761+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1764508636 shutdown_connections 2024-09-11T22:06:44.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.761+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1764508636 wait complete. 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.762+0000 7fa8e79a7740 1 -- start start 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.762+0000 7fa8e79a7740 1 Processor -- start 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8e79a7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249ab010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8e79a7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 0x55f2249a82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8e79a7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249ab680 0x55f2249a8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8e79a7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f2249ae250 con 0x55f2249ab680 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8e79a7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f2248c1050 con 0x55f2249a04a0 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8deffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8deffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249ab010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34910/0 (socket says 172.21.15.152:34910) 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8e79a7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f2249ae3d0 con 0x55f2249a0dc0 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8deffd640 1 -- 172.21.15.152:0/1808662481 learned_addr learned my addr 172.21.15.152:0/1808662481 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8e79a7740 10 client.0 _ll_register_callbacks cb 0x55f224901160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:44.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8df7fe640 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249ab680 0x55f2249a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.763+0000 7fa8d7fff640 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 0x55f2249a82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.764+0000 7fa8deffd640 1 -- 172.21.15.152:0/1808662481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 msgr2=0x55f2249a82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.764+0000 7fa8deffd640 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 0x55f2249a82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.764+0000 7fa8deffd640 1 -- 172.21.15.152:0/1808662481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249ab680 msgr2=0x55f2249a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.764+0000 7fa8deffd640 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249ab680 0x55f2249a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.764+0000 7fa8deffd640 1 -- 172.21.15.152:0/1808662481 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2246773c0 con 0x55f2249a04a0 2024-09-11T22:06:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.764+0000 7fa8df7fe640 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249ab680 0x55f2249a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.764+0000 7fa8d7fff640 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 0x55f2249a82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.764+0000 7fa8deffd640 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249ab010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0020d70 tx=0x7fa8d0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb8dcf9bc83da4ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.764+0000 7fa8c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.764+0000 7fa8c67fc640 1 -- 172.21.15.152:0/1808662481 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d002d060 con 0x55f2249a04a0 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.764+0000 7fa8c67fc640 1 -- 172.21.15.152:0/1808662481 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa8d001dbc0 con 0x55f2249a04a0 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.765+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1808662481 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8d8004cc0 con 0x55f2249a04a0 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.765+0000 7fa8c67fc640 1 -- 172.21.15.152:0/1808662481 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa8d0016040 con 0x55f2249a04a0 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.765+0000 7fa8e79a7740 10 client.25490 fetch_fsmap learned FSMap version 28 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.765+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1808662481 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f2249b9cd0 con 0x55f2249a04a0 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.765+0000 7fa8c67fc640 1 -- 172.21.15.152:0/1808662481 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8d8004cc0 con 0x55f2249a04a0 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.766+0000 7fa8c67fc640 1 -- 172.21.15.152:0/1808662481 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa8d001c070 con 0x55f2249a04a0 2024-09-11T22:06:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.766+0000 7fa8e79a7740 10 client.25490 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:06:44.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.766+0000 7fa8e79a7740 10 client.25490 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:44.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.766+0000 7fa8e79a7740 20 client.25490 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:44.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.766+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f2249bb0e0 0x55f2249bd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.766+0000 7fa8e79a7740 4 client.25490 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:44.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.766+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1808662481 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f224913850 con 0x55f2249bb0e0 2024-09-11T22:06:44.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.768+0000 7fa8d7fff640 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f2249bb0e0 0x55f2249bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.772+0000 7fa8d7fff640 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f2249bb0e0 0x55f2249bd520 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14848fe843f5e968 server_cookie=1a038992546c182f in_seq=0 out_seq=0 2024-09-11T22:06:44.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.774+0000 7fa8c67fc640 10 client.25490 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:44.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.774+0000 7fa8c67fc640 1 -- 172.21.15.152:0/1808662481 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f224913850 con 0x55f2249bb0e0 2024-09-11T22:06:44.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.774+0000 7fa8c67fc640 10 client.25490 handle_command_reply: tid=0 2024-09-11T22:06:44.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.775+0000 7fa8e79a7740 1 client.25490 shutdown 2024-09-11T22:06:44.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.775+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1808662481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 msgr2=0x55f2249ab010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:44.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.775+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249ab010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0020d70 tx=0x7fa8d0004730 comp rx=0 tx=0).stop 2024-09-11T22:06:44.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.776+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1808662481 shutdown_connections 2024-09-11T22:06:44.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.777+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f2249bb0e0 0x55f2249bd520 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.777+0000 7fa8c67fc640 0 client.25490 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:44.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.777+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249ab680 0x55f2249a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.777+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 0x55f2249a82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.777+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/1808662481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249ab010 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.777+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1808662481 >> 172.21.15.152:0/1808662481 conn(0x55f22499ca30 msgr2=0x55f2249a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.779+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1808662481 shutdown_connections 2024-09-11T22:06:44.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.779+0000 7fa8e79a7740 1 -- 172.21.15.152:0/1808662481 wait complete. 2024-09-11T22:06:44.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.779+0000 7fa8e79a7740 20 client.25490 trim_cache size 0 max 16384 2024-09-11T22:06:44.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.812+0000 7fa8e79a7740 1 Processor -- start 2024-09-11T22:06:44.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.812+0000 7fa8e79a7740 1 -- start start 2024-09-11T22:06:44.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8e79a7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249a04a0 0x55f2249b7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8e79a7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a0dc0 0x55f2249c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8e79a7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249ab680 0x55f2249c3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8e79a7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c00111d0 con 0x55f2249a04a0 2024-09-11T22:06:44.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8e79a7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c000ea70 con 0x55f2249a0dc0 2024-09-11T22:06:44.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8e79a7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c000c8c0 con 0x55f2249ab680 2024-09-11T22:06:44.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8df7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249ab680 0x55f2249c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8df7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249ab680 0x55f2249c3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59410/0 (socket says 172.21.15.152:59410) 2024-09-11T22:06:44.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a0dc0 0x55f2249c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8df7fe640 1 -- 172.21.15.152:0/2331603812 learned_addr learned my addr 172.21.15.152:0/2331603812 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:44.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8deffd640 1 --2- 172.21.15.152:0/2331603812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249a04a0 0x55f2249b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8df7fe640 1 -- 172.21.15.152:0/2331603812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a0dc0 msgr2=0x55f2249c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:44.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8df7fe640 1 --2- 172.21.15.152:0/2331603812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a0dc0 0x55f2249c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8df7fe640 1 -- 172.21.15.152:0/2331603812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249a04a0 msgr2=0x55f2249b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:44.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8df7fe640 1 --2- 172.21.15.152:0/2331603812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249a04a0 0x55f2249b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.813+0000 7fa8df7fe640 1 -- 172.21.15.152:0/2331603812 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2249a0bf0 con 0x55f2249ab680 2024-09-11T22:06:44.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.814+0000 7fa8df7fe640 1 --2- 172.21.15.152:0/2331603812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249ab680 0x55f2249c3330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f22499ddb0 tx=0x7fa8d8004a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a34e717e58c2fd1f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:44.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.814+0000 7fa8d4ff9640 1 -- 172.21.15.152:0/2331603812 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8023030 con 0x55f2249ab680 2024-09-11T22:06:44.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.814+0000 7fa8d4ff9640 1 -- 172.21.15.152:0/2331603812 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8d801f9f0 con 0x55f2249ab680 2024-09-11T22:06:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.814+0000 7fa8d4ff9640 1 -- 172.21.15.152:0/2331603812 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8015980 con 0x55f2249ab680 2024-09-11T22:06:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.815+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2331603812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249ab680 msgr2=0x55f2249c3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.815+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/2331603812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249ab680 0x55f2249c3330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f22499ddb0 tx=0x7fa8d8004a90 comp rx=0 tx=0).stop 2024-09-11T22:06:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.816+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2331603812 shutdown_connections 2024-09-11T22:06:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.816+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/2331603812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249ab680 0x55f2249c3330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.816+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/2331603812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a0dc0 0x55f2249c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.816+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/2331603812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249a04a0 0x55f2249b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.816+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2331603812 >> 172.21.15.152:0/2331603812 conn(0x55f22499ca30 msgr2=0x55f2249a3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.817+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2331603812 shutdown_connections 2024-09-11T22:06:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.817+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2331603812 wait complete. 2024-09-11T22:06:44.819 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 70.0 s, 5241.4 tps, lat 19.065 ms stddev 20.066 2024-09-11T22:06:44.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.817+0000 7fa8e79a7740 1 -- start start 2024-09-11T22:06:44.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.817+0000 7fa8e79a7740 1 Processor -- start 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.818+0000 7fa8e79a7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.818+0000 7fa8e79a7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 0x55f2249af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.818+0000 7fa8deffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.818+0000 7fa8deffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34922/0 (socket says 172.21.15.152:34922) 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.818+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 0x55f2249af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.818+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 0x55f2249af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59416/0 (socket says 172.21.15.152:59416) 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.818+0000 7fa8deffd640 1 -- 172.21.15.152:0/2761168205 learned_addr learned my addr 172.21.15.152:0/2761168205 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.818+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249ab680 0x55f2249afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.818+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2761168205 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c000cf30 con 0x55f2249ab680 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.818+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2761168205 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c000e3a0 con 0x55f2249a04a0 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.818+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2761168205 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c000d600 con 0x55f2249a0dc0 2024-09-11T22:06:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.819+0000 7fa8deffd640 1 -- 172.21.15.152:0/2761168205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 msgr2=0x55f2249af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:44.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.819+0000 7fa8deffd640 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 0x55f2249af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.819+0000 7fa8deffd640 1 -- 172.21.15.152:0/2761168205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249ab680 msgr2=0x55f2249afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:44.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.819+0000 7fa8deffd640 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249ab680 0x55f2249afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.819+0000 7fa8deffd640 1 -- 172.21.15.152:0/2761168205 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f224a2d5d0 con 0x55f2249a04a0 2024-09-11T22:06:44.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.819+0000 7fa8e79a7740 10 client.0 _ll_register_callbacks cb 0x7fa8d000b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:44.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.819+0000 7fa8deffd640 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249af350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0020d70 tx=0x7fa8d001cff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75aa98f3cf96d379 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:44.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.819+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2761168205 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8d801f9f0 con 0x55f2249a04a0 2024-09-11T22:06:44.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.819+0000 7fa8c67fc640 10 client.25496 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:06:44.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.819+0000 7fa8c67fc640 1 -- 172.21.15.152:0/2761168205 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0020e60 con 0x55f2249a04a0 2024-09-11T22:06:44.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.819+0000 7fa8c67fc640 1 -- 172.21.15.152:0/2761168205 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa8d00285f0 con 0x55f2249a04a0 2024-09-11T22:06:44.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.820+0000 7fa8c67fc640 1 -- 172.21.15.152:0/2761168205 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa8d002d040 con 0x55f2249a04a0 2024-09-11T22:06:44.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.820+0000 7fa8e79a7740 10 client.25496 fetch_fsmap learned FSMap version 28 2024-09-11T22:06:44.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.820+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2761168205 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f224a2e6a0 con 0x55f2249a04a0 2024-09-11T22:06:44.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.820+0000 7fa8c67fc640 1 -- 172.21.15.152:0/2761168205 <== mon.2 v2:172.21.15.179:3300/0 4 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa8d003a030 con 0x55f2249a04a0 2024-09-11T22:06:44.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.820+0000 7fa8e79a7740 10 client.25496 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:06:44.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.820+0000 7fa8e79a7740 10 client.25496 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:44.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.820+0000 7fa8e79a7740 20 client.25496 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:44.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.820+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f2249bb0e0 0x55f224a30d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:44.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.820+0000 7fa8e79a7740 4 client.25496 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:06:44.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.820+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2761168205 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa8d801f9f0 con 0x55f2249bb0e0 2024-09-11T22:06:44.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.820+0000 7fa8d7fff640 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f2249bb0e0 0x55f224a30d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:44.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.821+0000 7fa8d7fff640 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f2249bb0e0 0x55f224a30d50 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=630c28aada54aea0 server_cookie=6c22ed5f2191f1a0 in_seq=0 out_seq=0 2024-09-11T22:06:44.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.821+0000 7fa8c67fc640 10 client.25496 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:44.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.821+0000 7fa8c67fc640 1 -- 172.21.15.152:0/2761168205 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fa8d801f9f0 con 0x55f2249bb0e0 2024-09-11T22:06:44.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.821+0000 7fa8c67fc640 10 client.25496 handle_command_reply: tid=0 2024-09-11T22:06:44.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.822+0000 7fa8e79a7740 1 client.25496 shutdown 2024-09-11T22:06:44.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2761168205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 msgr2=0x55f2249af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:44.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249af350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0020d70 tx=0x7fa8d001cff0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2761168205 shutdown_connections 2024-09-11T22:06:44.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f2249bb0e0 0x55f224a30d50 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2249ab680 0x55f2249afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2249a0dc0 0x55f2249af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8e79a7740 1 --2- 172.21.15.152:0/2761168205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2249a04a0 0x55f2249af350 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2761168205 >> 172.21.15.152:0/2761168205 conn(0x55f22499ca30 msgr2=0x55f2249a1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:44.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8c67fc640 0 client.25496 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:44.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2761168205 shutdown_connections 2024-09-11T22:06:44.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8e79a7740 1 -- 172.21.15.152:0/2761168205 wait complete. 2024-09-11T22:06:44.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.824+0000 7fa8e79a7740 20 client.25496 trim_cache size 0 max 16384 2024-09-11T22:06:44.829 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:06:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:06:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:06:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "bc1b4e4d-5e52-4696-b796-40af0e402bd6": { 2024-09-11T22:06:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:06:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "bc1b4e4d-5e52-4696-b796-40af0e402bd6", 2024-09-11T22:06:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:06:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:06:44.829 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:06:44.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.825+0000 7fa8e55ce640 1 -- 172.21.15.152:0/926634286 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8cc0a2e40 msgr2=0x7fa8cc0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:44.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.825+0000 7fa8e55ce640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8cc0a2e40 0x7fa8cc0a5300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8e019fa20 tx=0x7fa8d00197d0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.825+0000 7fa8e55ce640 1 -- 172.21.15.152:0/926634286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e0109e00 msgr2=0x7fa8e01a4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:44.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.825+0000 7fa8e55ce640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e0109e00 0x7fa8e01a4c60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa8c802aaf0 tx=0x7fa8c80305d0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.825+0000 7fa8e55ce640 1 -- 172.21.15.152:0/926634286 shutdown_connections 2024-09-11T22:06:44.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.825+0000 7fa8e55ce640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8cc0a2e40 0x7fa8cc0a5300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.825+0000 7fa8e55ce640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e010ea80 0x7fa8e019e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.825+0000 7fa8e55ce640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e0109e00 0x7fa8e01a4c60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.825+0000 7fa8e55ce640 1 --2- 172.21.15.152:0/926634286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8e0109450 0x7fa8e01a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:44.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.825+0000 7fa8e55ce640 1 -- 172.21.15.152:0/926634286 >> 172.21.15.152:0/926634286 conn(0x7fa8e006e2d0 msgr2=0x7fa8e010c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:44.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.825+0000 7fa8e55ce640 1 -- 172.21.15.152:0/926634286 shutdown_connections 2024-09-11T22:06:44.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:44.826+0000 7fa8e55ce640 1 -- 172.21.15.152:0/926634286 wait complete. 2024-09-11T22:06:45.698 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:45 smithi152 ceph-mon[31188]: pgmap v77: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 886 op/s 2024-09-11T22:06:45.701 INFO:tasks.cephfs.filesystem:scrub status for tag:bc1b4e4d-5e52-4696-b796-40af0e402bd6 - {'path': '/', 'tag': 'bc1b4e4d-5e52-4696-b796-40af0e402bd6', 'options': 'recursive,force'} 2024-09-11T22:06:45.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:45 smithi179 ceph-mon[35603]: pgmap v77: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 886 op/s 2024-09-11T22:06:45.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:45 smithi193 ceph-mon[35545]: pgmap v77: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 886 op/s 2024-09-11T22:06:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:47 smithi179 ceph-mon[35603]: pgmap v78: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 886 op/s 2024-09-11T22:06:47.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:47 smithi193 ceph-mon[35545]: pgmap v78: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 886 op/s 2024-09-11T22:06:47.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:47 smithi152 ceph-mon[31188]: pgmap v78: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 886 op/s 2024-09-11T22:06:49.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:48 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:06:49.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:48 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:06:49.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:48 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:06:49.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 75.0 s, 5882.5 tps, lat 16.990 ms stddev 17.837 2024-09-11T22:06:50.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:49 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:06:50.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:49 smithi152 ceph-mon[31188]: pgmap v79: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 MiB/s wr, 1.28k op/s 2024-09-11T22:06:50.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:49 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:06:50.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:49 smithi179 ceph-mon[35603]: pgmap v79: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 MiB/s wr, 1.28k op/s 2024-09-11T22:06:50.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:49 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:06:50.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:49 smithi193 ceph-mon[35545]: pgmap v79: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 MiB/s wr, 1.28k op/s 2024-09-11T22:06:51.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:51 smithi179 ceph-mon[35603]: pgmap v80: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 775 op/s 2024-09-11T22:06:51.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:51 smithi193 ceph-mon[35545]: pgmap v80: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 775 op/s 2024-09-11T22:06:51.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:51 smithi152 ceph-mon[31188]: pgmap v80: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 775 op/s 2024-09-11T22:06:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:53 smithi179 ceph-mon[35603]: pgmap v81: 97 pgs: 97 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 1.18k op/s 2024-09-11T22:06:53.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:53 smithi193 ceph-mon[35545]: pgmap v81: 97 pgs: 97 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 1.18k op/s 2024-09-11T22:06:53.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:53 smithi152 ceph-mon[31188]: pgmap v81: 97 pgs: 97 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 1.18k op/s 2024-09-11T22:06:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 80.0 s, 5990.8 tps, lat 16.636 ms stddev 17.256 2024-09-11T22:06:55.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:55 smithi179 ceph-mon[35603]: pgmap v82: 97 pgs: 97 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.7 MiB/s wr, 798 op/s 2024-09-11T22:06:55.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:55 smithi193 ceph-mon[35545]: pgmap v82: 97 pgs: 97 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.7 MiB/s wr, 798 op/s 2024-09-11T22:06:55.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:55 smithi152 ceph-mon[31188]: pgmap v82: 97 pgs: 97 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.7 MiB/s wr, 798 op/s 2024-09-11T22:06:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.551+0000 7f479fd98640 1 -- 172.21.15.152:0/1602681915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f479810c0d0 msgr2=0x7f479810e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.551+0000 7f479fd98640 1 --2- 172.21.15.152:0/1602681915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f479810c0d0 0x7f479810e570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4790009be0 tx=0x7f479002a6c0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.551+0000 7f479fd98640 1 -- 172.21.15.152:0/1602681915 shutdown_connections 2024-09-11T22:06:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.551+0000 7f479fd98640 1 --2- 172.21.15.152:0/1602681915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f479810c0d0 0x7f479810e570 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.551+0000 7f479fd98640 1 --2- 172.21.15.152:0/1602681915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47981035c0 0x7f479810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.551+0000 7f479fd98640 1 --2- 172.21.15.152:0/1602681915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4798102ca0 0x7f4798103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.551+0000 7f479fd98640 1 -- 172.21.15.152:0/1602681915 >> 172.21.15.152:0/1602681915 conn(0x7f47980fc6b0 msgr2=0x7f47980fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.552+0000 7f479fd98640 1 -- 172.21.15.152:0/1602681915 shutdown_connections 2024-09-11T22:06:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.552+0000 7f479fd98640 1 -- 172.21.15.152:0/1602681915 wait complete. 2024-09-11T22:06:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.553+0000 7f479fd98640 1 Processor -- start 2024-09-11T22:06:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.553+0000 7f479fd98640 1 -- start start 2024-09-11T22:06:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.553+0000 7f479fd98640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798102ca0 0x7f47981982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.553+0000 7f479fd98640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47981035c0 0x7f47981987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.553+0000 7f479fd98640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f479810c0d0 0x7f479819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.553+0000 7f479db34640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798102ca0 0x7f47981982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479db34640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798102ca0 0x7f47981982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60434/0 (socket says 172.21.15.152:60434) 2024-09-11T22:06:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479db34640 1 -- 172.21.15.152:0/3109705178 learned_addr learned my addr 172.21.15.152:0/3109705178 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479fd98640 1 -- 172.21.15.152:0/3109705178 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4798111e90 con 0x7f479810c0d0 2024-09-11T22:06:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479fd98640 1 -- 172.21.15.152:0/3109705178 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4798111d10 con 0x7f4798102ca0 2024-09-11T22:06:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479fd98640 1 -- 172.21.15.152:0/3109705178 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4798112010 con 0x7f47981035c0 2024-09-11T22:06:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479e335640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f479810c0d0 0x7f479819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479d333640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47981035c0 0x7f47981987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479e335640 1 -- 172.21.15.152:0/3109705178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47981035c0 msgr2=0x7f47981987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479e335640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47981035c0 0x7f47981987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479e335640 1 -- 172.21.15.152:0/3109705178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798102ca0 msgr2=0x7f47981982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479e335640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798102ca0 0x7f47981982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479e335640 1 -- 172.21.15.152:0/3109705178 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479819d2a0 con 0x7f479810c0d0 2024-09-11T22:06:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479db34640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798102ca0 0x7f47981982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.554+0000 7f479d333640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47981035c0 0x7f47981987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.555+0000 7f479e335640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f479810c0d0 0x7f479819cb70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4790009b30 tx=0x7f4790030da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.555+0000 7f478effd640 1 -- 172.21.15.152:0/3109705178 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4790041020 con 0x7f479810c0d0 2024-09-11T22:06:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.555+0000 7f478effd640 1 -- 172.21.15.152:0/3109705178 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4790003e50 con 0x7f479810c0d0 2024-09-11T22:06:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.555+0000 7f478effd640 1 -- 172.21.15.152:0/3109705178 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4790036040 con 0x7f479810c0d0 2024-09-11T22:06:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.555+0000 7f479fd98640 1 -- 172.21.15.152:0/3109705178 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479819d530 con 0x7f479810c0d0 2024-09-11T22:06:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.556+0000 7f479fd98640 1 -- 172.21.15.152:0/3109705178 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f479819d8e0 con 0x7f479810c0d0 2024-09-11T22:06:56.560 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.559+0000 7f47a2c10740 1 Processor -- start 2024-09-11T22:06:56.560 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.560+0000 7f478effd640 1 -- 172.21.15.152:0/3109705178 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f4790044020 con 0x7f479810c0d0 2024-09-11T22:06:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.560+0000 7f47a2c10740 1 -- start start 2024-09-11T22:06:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e4ecac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f479d333640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f479d333640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60440/0 (socket says 172.21.15.152:60440) 2024-09-11T22:06:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f479db34640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e4ecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f479db34640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e4ecac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37812/0 (socket says 172.21.15.152:37812) 2024-09-11T22:06:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4ed000 0x56429e4f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f47a2c10740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56429e4472f0 con 0x56429e4ed000 2024-09-11T22:06:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f47a2c10740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56429e3ef270 con 0x56429e4f0cc0 2024-09-11T22:06:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f47a2c10740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56429e4432b0 con 0x56429e4ec660 2024-09-11T22:06:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f479d333640 1 -- 172.21.15.152:0/2635478225 learned_addr learned my addr 172.21.15.152:0/2635478225 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f479d333640 1 --2- 172.21.15.152:0/2635478225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4ed000 0x56429e4f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f479d333640 1 -- 172.21.15.152:0/2635478225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 msgr2=0x56429e4ecac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f479d333640 1 --2- 172.21.15.152:0/2635478225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e4ecac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f479d333640 1 -- 172.21.15.152:0/2635478225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4ed000 msgr2=0x56429e4f89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f479d333640 1 --2- 172.21.15.152:0/2635478225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4ed000 0x56429e4f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.561+0000 7f479d333640 1 -- 172.21.15.152:0/2635478225 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56429e3ee340 con 0x56429e4f0cc0 2024-09-11T22:06:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.562+0000 7f479d333640 1 --2- 172.21.15.152:0/2635478225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f10a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47940125c0 tx=0x7f479400bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76c15f15c78f806b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.562+0000 7f4783fff640 1 -- 172.21.15.152:0/2635478225 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4794005020 con 0x56429e4f0cc0 2024-09-11T22:06:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.562+0000 7f4783fff640 1 -- 172.21.15.152:0/2635478225 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47940047a0 con 0x56429e4f0cc0 2024-09-11T22:06:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.562+0000 7f4783fff640 1 -- 172.21.15.152:0/2635478225 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479400e840 con 0x56429e4f0cc0 2024-09-11T22:06:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.563+0000 7f478effd640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47840a2e20 0x7f47840a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.563+0000 7f47a2c10740 1 -- 172.21.15.152:0/2635478225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 msgr2=0x56429e4f10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.563+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2635478225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f10a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47940125c0 tx=0x7f479400bb40 comp rx=0 tx=0).stop 2024-09-11T22:06:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.564+0000 7f47a2c10740 1 -- 172.21.15.152:0/2635478225 shutdown_connections 2024-09-11T22:06:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.564+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2635478225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4ed000 0x56429e4f89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.564+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2635478225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e4ecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.564+0000 7f478effd640 1 -- 172.21.15.152:0/3109705178 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f47900f0000 con 0x7f479810c0d0 2024-09-11T22:06:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.564+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2635478225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f10a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.564+0000 7f47a2c10740 1 -- 172.21.15.152:0/2635478225 >> 172.21.15.152:0/2635478225 conn(0x56429e4deb10 msgr2=0x56429e4deef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.565+0000 7f479db34640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47840a2e20 0x7f47840a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.565+0000 7f47a2c10740 1 -- 172.21.15.152:0/2635478225 shutdown_connections 2024-09-11T22:06:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.565+0000 7f47a2c10740 1 -- 172.21.15.152:0/2635478225 wait complete. 2024-09-11T22:06:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.566+0000 7f479db34640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47840a2e20 0x7f47840a52e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x56429e4e0260 tx=0x7f478800b4a0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.566+0000 7f47a2c10740 1 -- start start 2024-09-11T22:06:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.566+0000 7f47a2c10740 1 Processor -- start 2024-09-11T22:06:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e4f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4ed000 0x56429e4f6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f47a2c10740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56429e4f90b0 con 0x56429e4ed000 2024-09-11T22:06:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f47a2c10740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56429e3d0290 con 0x56429e4f0cc0 2024-09-11T22:06:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f47a2c10740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56429e4f9230 con 0x56429e4ec660 2024-09-11T22:06:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f47a2c10740 10 client.0 _ll_register_callbacks cb 0x56429e401140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f479e335640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f479d333640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4ed000 0x56429e4f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f479e335640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60456/0 (socket says 172.21.15.152:60456) 2024-09-11T22:06:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f479e335640 1 -- 172.21.15.152:0/2206455125 learned_addr learned my addr 172.21.15.152:0/2206455125 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.567+0000 7f479db34640 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e4f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.568+0000 7f479e335640 1 -- 172.21.15.152:0/2206455125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 msgr2=0x56429e4f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.568+0000 7f479e335640 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e4f5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.568+0000 7f479e335640 1 -- 172.21.15.152:0/2206455125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4ed000 msgr2=0x56429e4f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.568+0000 7f479e335640 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4ed000 0x56429e4f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.568+0000 7f479e335640 1 -- 172.21.15.152:0/2206455125 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56429e15a210 con 0x56429e4f0cc0 2024-09-11T22:06:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.568+0000 7f479db34640 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e4f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.568+0000 7f479e335640 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f69a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4790034040 tx=0x7f47900bc380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb10a05594dd27ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.568+0000 7f47817fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:06:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.568+0000 7f47817fa640 1 -- 172.21.15.152:0/2206455125 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47900d5060 con 0x56429e4f0cc0 2024-09-11T22:06:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.568+0000 7f47a2c10740 1 -- 172.21.15.152:0/2206455125 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47940047a0 con 0x56429e4f0cc0 2024-09-11T22:06:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.568+0000 7f47817fa640 1 -- 172.21.15.152:0/2206455125 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f4790004670 con 0x56429e4f0cc0 2024-09-11T22:06:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.569+0000 7f47817fa640 1 -- 172.21.15.152:0/2206455125 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f47900bcbf0 con 0x56429e4f0cc0 2024-09-11T22:06:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.569+0000 7f47a2c10740 10 client.25508 fetch_fsmap learned FSMap version 28 2024-09-11T22:06:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.569+0000 7f47a2c10740 1 -- 172.21.15.152:0/2206455125 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56429e226620 con 0x56429e4f0cc0 2024-09-11T22:06:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.569+0000 7f47817fa640 1 -- 172.21.15.152:0/2206455125 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47900bc4f0 con 0x56429e4f0cc0 2024-09-11T22:06:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.569+0000 7f47817fa640 1 -- 172.21.15.152:0/2206455125 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f47900d5200 con 0x56429e4f0cc0 2024-09-11T22:06:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.570+0000 7f47a2c10740 10 client.25508 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:06:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.570+0000 7f47a2c10740 10 client.25508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.570+0000 7f47a2c10740 20 client.25508 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.570+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56429e5064e0 0x56429e5088f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.570+0000 7f47a2c10740 4 client.25508 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:06:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.570+0000 7f47a2c10740 1 -- 172.21.15.152:0/2206455125 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f47940047a0 con 0x56429e5064e0 2024-09-11T22:06:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.570+0000 7f479db34640 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56429e5064e0 0x56429e5088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.571+0000 7f479db34640 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56429e5064e0 0x56429e5088f0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29d705aca00f9794 server_cookie=338097a3b0c537e3 in_seq=0 out_seq=0 2024-09-11T22:06:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.571+0000 7f47817fa640 10 client.25508 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.572+0000 7f47817fa640 1 -- 172.21.15.152:0/2206455125 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f47940047a0 con 0x56429e5064e0 2024-09-11T22:06:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.572+0000 7f47817fa640 10 client.25508 handle_command_reply: tid=0 2024-09-11T22:06:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.572+0000 7f47a2c10740 1 client.25508 shutdown 2024-09-11T22:06:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.572+0000 7f47a2c10740 1 -- 172.21.15.152:0/2206455125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 msgr2=0x56429e4f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.572+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f69a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4790034040 tx=0x7f47900bc380 comp rx=0 tx=0).stop 2024-09-11T22:06:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.573+0000 7f47a2c10740 1 -- 172.21.15.152:0/2206455125 shutdown_connections 2024-09-11T22:06:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.573+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56429e5064e0 0x56429e5088f0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.573+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4f0cc0 0x56429e4f69a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.573+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4ed000 0x56429e4f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.573+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2206455125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e4f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.573+0000 7f47a2c10740 1 -- 172.21.15.152:0/2206455125 >> 172.21.15.152:0/2206455125 conn(0x56429e4deb10 msgr2=0x56429e4ebe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.573+0000 7f47817fa640 0 client.25508 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.573+0000 7f47a2c10740 1 -- 172.21.15.152:0/2206455125 shutdown_connections 2024-09-11T22:06:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.573+0000 7f47a2c10740 1 -- 172.21.15.152:0/2206455125 wait complete. 2024-09-11T22:06:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.573+0000 7f47a2c10740 20 client.25508 trim_cache size 0 max 16384 2024-09-11T22:06:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.594+0000 7f47a2c10740 1 Processor -- start 2024-09-11T22:06:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.594+0000 7f47a2c10740 1 -- start start 2024-09-11T22:06:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.594+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e50e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.594+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ed000 0x56429e50e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.594+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4f0cc0 0x56429e4eb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f479db34640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e50e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f47a2c10740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f47981adf50 con 0x56429e4f0cc0 2024-09-11T22:06:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f479db34640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e50e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37816/0 (socket says 172.21.15.152:37816) 2024-09-11T22:06:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f47a2c10740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f47981ab7f0 con 0x56429e4ed000 2024-09-11T22:06:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f47a2c10740 1 -- 172.21.15.152:0/2840796106 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f47981a9640 con 0x56429e4ec660 2024-09-11T22:06:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f479db34640 1 -- 172.21.15.152:0/2840796106 learned_addr learned my addr 172.21.15.152:0/2840796106 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f479d333640 1 --2- 172.21.15.152:0/2840796106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ed000 0x56429e50e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f479e335640 1 --2- 172.21.15.152:0/2840796106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4f0cc0 0x56429e4eb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f479d333640 1 -- 172.21.15.152:0/2840796106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 msgr2=0x56429e50e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f479d333640 1 --2- 172.21.15.152:0/2840796106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e50e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f479d333640 1 -- 172.21.15.152:0/2840796106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4f0cc0 msgr2=0x56429e4eb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f479d333640 1 --2- 172.21.15.152:0/2840796106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4f0cc0 0x56429e4eb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f479d333640 1 -- 172.21.15.152:0/2840796106 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56429e4f4450 con 0x56429e4ed000 2024-09-11T22:06:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.595+0000 7f479e335640 1 --2- 172.21.15.152:0/2840796106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4f0cc0 0x56429e4eb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.596+0000 7f479d333640 1 --2- 172.21.15.152:0/2840796106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ed000 0x56429e50e740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4794012f10 tx=0x7f479400b5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e04b6d616ef0b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.596+0000 7f47837fe640 1 -- 172.21.15.152:0/2840796106 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47940052d0 con 0x56429e4ed000 2024-09-11T22:06:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.596+0000 7f47837fe640 1 -- 172.21.15.152:0/2840796106 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4794021040 con 0x56429e4ed000 2024-09-11T22:06:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.596+0000 7f47837fe640 1 -- 172.21.15.152:0/2840796106 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479400e790 con 0x56429e4ed000 2024-09-11T22:06:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.597+0000 7f47a2c10740 1 -- 172.21.15.152:0/2840796106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ed000 msgr2=0x56429e50e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.597+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2840796106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ed000 0x56429e50e740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4794012f10 tx=0x7f479400b5b0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.597+0000 7f47a2c10740 1 -- 172.21.15.152:0/2840796106 shutdown_connections 2024-09-11T22:06:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.597+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2840796106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4f0cc0 0x56429e4eb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.597+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2840796106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ed000 0x56429e50e740 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.597+0000 7f47a2c10740 1 --2- 172.21.15.152:0/2840796106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ec660 0x56429e50e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.597+0000 7f47a2c10740 1 -- 172.21.15.152:0/2840796106 >> 172.21.15.152:0/2840796106 conn(0x56429e4deb10 msgr2=0x56429e502bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.597+0000 7f47a2c10740 1 -- 172.21.15.152:0/2840796106 shutdown_connections 2024-09-11T22:06:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.597+0000 7f47a2c10740 1 -- 172.21.15.152:0/2840796106 wait complete. 2024-09-11T22:06:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.598+0000 7f47a2c10740 1 -- start start 2024-09-11T22:06:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.598+0000 7f47a2c10740 1 Processor -- start 2024-09-11T22:06:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ec660 0x56429e4feb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ed000 0x56429e4f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f47a2c10740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4f0cc0 0x56429e4f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f47a2c10740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f47981a9cb0 con 0x56429e4f0cc0 2024-09-11T22:06:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f47a2c10740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f47981ab120 con 0x56429e4ec660 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f47a2c10740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f47981aa380 con 0x56429e4ed000 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f47a2c10740 10 client.0 _ll_register_callbacks cb 0x7f4790030f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f479d333640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ed000 0x56429e4f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f479db34640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ec660 0x56429e4feb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f479d333640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ed000 0x56429e4f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37826/0 (socket says 172.21.15.152:37826) 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f479db34640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ec660 0x56429e4feb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60474/0 (socket says 172.21.15.152:60474) 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f479d333640 1 -- 172.21.15.152:0/3072821106 learned_addr learned my addr 172.21.15.152:0/3072821106 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f479e335640 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4f0cc0 0x56429e4f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f479d333640 1 -- 172.21.15.152:0/3072821106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ec660 msgr2=0x56429e4feb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f479d333640 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ec660 0x56429e4feb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f479d333640 1 -- 172.21.15.152:0/3072821106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4f0cc0 msgr2=0x56429e4f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:06:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f479d333640 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4f0cc0 0x56429e4f30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.599+0000 7f479d333640 1 -- 172.21.15.152:0/3072821106 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56429e4f38b0 con 0x56429e4ed000 2024-09-11T22:06:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.600+0000 7f479d333640 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ed000 0x56429e4f2b70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4794000c00 tx=0x7f47940052e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b19fc9be1c89f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.600+0000 7f47817fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:06:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.600+0000 7f47817fa640 1 -- 172.21.15.152:0/3072821106 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47940037f0 con 0x56429e4ed000 2024-09-11T22:06:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.600+0000 7f47817fa640 1 -- 172.21.15.152:0/3072821106 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f4794003990 con 0x56429e4ed000 2024-09-11T22:06:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.600+0000 7f47a2c10740 1 -- 172.21.15.152:0/3072821106 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4794021040 con 0x56429e4ed000 2024-09-11T22:06:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f47817fa640 1 -- 172.21.15.152:0/3072821106 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4794038050 con 0x56429e4ed000 2024-09-11T22:06:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f47a2c10740 10 client.25666 fetch_fsmap learned FSMap version 28 2024-09-11T22:06:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f47a2c10740 1 -- 172.21.15.152:0/3072821106 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56429e571120 con 0x56429e4ed000 2024-09-11T22:06:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f47817fa640 1 -- 172.21.15.152:0/3072821106 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4794021040 con 0x56429e4ed000 2024-09-11T22:06:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f47817fa640 1 -- 172.21.15.152:0/3072821106 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4794010460 con 0x56429e4ed000 2024-09-11T22:06:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f47a2c10740 10 client.25666 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:06:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f47a2c10740 10 client.25666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:06:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f47a2c10740 20 client.25666 populate_metadata read hostname 'smithi152' 2024-09-11T22:06:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f47a2c10740 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56429e5715f0 0x56429e573a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f47a2c10740 4 client.25666 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:06:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f47a2c10740 1 -- 172.21.15.152:0/3072821106 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56429e454a20 con 0x56429e5715f0 2024-09-11T22:06:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.601+0000 7f479db34640 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56429e5715f0 0x56429e573a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.602+0000 7f47817fa640 10 client.25666 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.603+0000 7f479db34640 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56429e5715f0 0x56429e573a10 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=857f16021f01b70e server_cookie=cb64e98a6eb0c2a8 in_seq=0 out_seq=0 2024-09-11T22:06:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.612+0000 7f47817fa640 1 -- 172.21.15.152:0/3072821106 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56429e454a20 con 0x56429e5715f0 2024-09-11T22:06:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.612+0000 7f47817fa640 10 client.25666 handle_command_reply: tid=0 2024-09-11T22:06:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.612+0000 7f47a2c10740 1 client.25666 shutdown 2024-09-11T22:06:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.613+0000 7f47a2c10740 1 -- 172.21.15.152:0/3072821106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ed000 msgr2=0x56429e4f2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.613+0000 7f47a2c10740 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ed000 0x56429e4f2b70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4794000c00 tx=0x7f47940052e0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.613+0000 7f47a2c10740 1 -- 172.21.15.152:0/3072821106 shutdown_connections 2024-09-11T22:06:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.613+0000 7f47a2c10740 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56429e5715f0 0x56429e573a10 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.613+0000 7f47a2c10740 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56429e4f0cc0 0x56429e4f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.613+0000 7f47a2c10740 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56429e4ed000 0x56429e4f2b70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.613+0000 7f47a2c10740 1 --2- 172.21.15.152:0/3072821106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56429e4ec660 0x56429e4feb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.613+0000 7f47a2c10740 1 -- 172.21.15.152:0/3072821106 >> 172.21.15.152:0/3072821106 conn(0x56429e4deb10 msgr2=0x56429e4f7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.613+0000 7f47817fa640 0 client.25666 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:06:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.613+0000 7f47a2c10740 1 -- 172.21.15.152:0/3072821106 shutdown_connections 2024-09-11T22:06:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.614+0000 7f47a2c10740 1 -- 172.21.15.152:0/3072821106 wait complete. 2024-09-11T22:06:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.614+0000 7f47a2c10740 20 client.25666 trim_cache size 0 max 16384 2024-09-11T22:06:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:06:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:06:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:06:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.615+0000 7f479fd98640 1 -- 172.21.15.152:0/3109705178 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47840a2e20 msgr2=0x7f47840a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.615+0000 7f479fd98640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47840a2e20 0x7f47840a52e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x56429e4e0260 tx=0x7f478800b4a0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.615+0000 7f479fd98640 1 -- 172.21.15.152:0/3109705178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f479810c0d0 msgr2=0x7f479819cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.615+0000 7f479fd98640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f479810c0d0 0x7f479819cb70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4790009b30 tx=0x7f4790030da0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.616+0000 7f479fd98640 1 -- 172.21.15.152:0/3109705178 shutdown_connections 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.616+0000 7f479fd98640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47840a2e20 0x7f47840a52e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.616+0000 7f479fd98640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f479810c0d0 0x7f479819cb70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.616+0000 7f479fd98640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47981035c0 0x7f47981987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.616+0000 7f479fd98640 1 --2- 172.21.15.152:0/3109705178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798102ca0 0x7f47981982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.616+0000 7f479fd98640 1 -- 172.21.15.152:0/3109705178 >> 172.21.15.152:0/3109705178 conn(0x7f47980fc6b0 msgr2=0x7f47980fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.616+0000 7f479fd98640 1 -- 172.21.15.152:0/3109705178 shutdown_connections 2024-09-11T22:06:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:06:56.616+0000 7f479fd98640 1 -- 172.21.15.152:0/3109705178 wait complete. 2024-09-11T22:06:57.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:57 smithi179 ceph-mon[35603]: pgmap v83: 97 pgs: 97 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.7 MiB/s wr, 798 op/s 2024-09-11T22:06:57.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:57 smithi193 ceph-mon[35545]: pgmap v83: 97 pgs: 97 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.7 MiB/s wr, 798 op/s 2024-09-11T22:06:57.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:57 smithi152 ceph-mon[31188]: pgmap v83: 97 pgs: 97 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.7 MiB/s wr, 798 op/s 2024-09-11T22:06:58.454 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.7 2024-09-11T22:06:58.454 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:06:58.884 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:06:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:06:59 smithi152 ceph-mon[31188]: pgmap v84: 97 pgs: 97 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-09-11T22:06:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:06:59 smithi179 ceph-mon[35603]: pgmap v84: 97 pgs: 97 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-09-11T22:06:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 85.0 s, 5956.2 tps, lat 16.838 ms stddev 19.043 2024-09-11T22:06:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:06:59 smithi193 ceph-mon[35545]: pgmap v84: 97 pgs: 97 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-09-11T22:06:59.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.937+0000 7fee318de640 1 -- 172.21.15.152:0/3630490794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee2c112a30 msgr2=0x7fee2c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:59.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.937+0000 7fee318de640 1 --2- 172.21.15.152:0/3630490794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee2c112a30 0x7fee2c114e20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fee24009be0 tx=0x7fee2402a6f0 comp rx=0 tx=0).stop 2024-09-11T22:06:59.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.937+0000 7fee318de640 1 -- 172.21.15.152:0/3630490794 shutdown_connections 2024-09-11T22:06:59.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.937+0000 7fee318de640 1 --2- 172.21.15.152:0/3630490794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee2c112a30 0x7fee2c114e20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:59.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.937+0000 7fee318de640 1 --2- 172.21.15.152:0/3630490794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee2c077040 0x7fee2c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:59.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.937+0000 7fee318de640 1 --2- 172.21.15.152:0/3630490794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c076720 0x7fee2c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:59.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.937+0000 7fee318de640 1 -- 172.21.15.152:0/3630490794 >> 172.21.15.152:0/3630490794 conn(0x7fee2c0ffab0 msgr2=0x7fee2c101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:06:59.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.940+0000 7fee318de640 1 -- 172.21.15.152:0/3630490794 shutdown_connections 2024-09-11T22:06:59.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.941+0000 7fee318de640 1 -- 172.21.15.152:0/3630490794 wait complete. 2024-09-11T22:06:59.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.942+0000 7fee318de640 1 Processor -- start 2024-09-11T22:06:59.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.942+0000 7fee318de640 1 -- start start 2024-09-11T22:06:59.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.943+0000 7fee318de640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c076720 0x7fee2c1a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:59.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.943+0000 7fee318de640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee2c077040 0x7fee2c1a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:59.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.943+0000 7fee318de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee2c112a30 0x7fee2c19e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:59.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.943+0000 7fee318de640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c118570 con 0x7fee2c112a30 2024-09-11T22:06:59.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.943+0000 7fee318de640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c1183f0 con 0x7fee2c077040 2024-09-11T22:06:59.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.943+0000 7fee318de640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c1186f0 con 0x7fee2c076720 2024-09-11T22:06:59.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.943+0000 7fee2affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c076720 0x7fee2c1a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:59.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.943+0000 7fee2affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c076720 0x7fee2c1a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37842/0 (socket says 172.21.15.152:37842) 2024-09-11T22:06:59.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.943+0000 7fee2affd640 1 -- 172.21.15.152:0/175297871 learned_addr learned my addr 172.21.15.152:0/175297871 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:06:59.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.943+0000 7fee2b7fe640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee2c112a30 0x7fee2c19e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:59.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.943+0000 7fee2a7fc640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee2c077040 0x7fee2c1a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:59.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.944+0000 7fee2affd640 1 -- 172.21.15.152:0/175297871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee2c077040 msgr2=0x7fee2c1a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:59.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.944+0000 7fee2affd640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee2c077040 0x7fee2c1a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:59.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.944+0000 7fee2affd640 1 -- 172.21.15.152:0/175297871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee2c112a30 msgr2=0x7fee2c19e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:06:59.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.944+0000 7fee2affd640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee2c112a30 0x7fee2c19e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:06:59.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.944+0000 7fee2affd640 1 -- 172.21.15.152:0/175297871 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2c19f010 con 0x7fee2c076720 2024-09-11T22:06:59.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.944+0000 7fee2b7fe640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee2c112a30 0x7fee2c19e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:06:59.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.944+0000 7fee2affd640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c076720 0x7fee2c1a4720 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00e9c0 tx=0x7fee1c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:59.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.944+0000 7fee308dc640 1 -- 172.21.15.152:0/175297871 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c00cc40 con 0x7fee2c076720 2024-09-11T22:06:59.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.944+0000 7fee308dc640 1 -- 172.21.15.152:0/175297871 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee1c00cde0 con 0x7fee2c076720 2024-09-11T22:06:59.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.945+0000 7fee318de640 1 -- 172.21.15.152:0/175297871 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2c19f300 con 0x7fee2c076720 2024-09-11T22:06:59.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.945+0000 7fee318de640 1 -- 172.21.15.152:0/175297871 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2c1ab5f0 con 0x7fee2c076720 2024-09-11T22:06:59.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.945+0000 7fee308dc640 1 -- 172.21.15.152:0/175297871 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c010430 con 0x7fee2c076720 2024-09-11T22:06:59.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.950+0000 7fee308dc640 1 -- 172.21.15.152:0/175297871 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fee1c005020 con 0x7fee2c076720 2024-09-11T22:06:59.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.950+0000 7fee318de640 1 -- 172.21.15.152:0/175297871 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee18005290 con 0x7fee2c076720 2024-09-11T22:06:59.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.951+0000 7fee308dc640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fee140a2f00 0x7fee140a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:06:59.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.951+0000 7fee308dc640 1 -- 172.21.15.152:0/175297871 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fee1c0cf660 con 0x7fee2c076720 2024-09-11T22:06:59.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.951+0000 7fee2a7fc640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fee140a2f00 0x7fee140a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:06:59.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.952+0000 7fee2a7fc640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fee140a2f00 0x7fee140a53c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fee200095f0 tx=0x7fee20005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:06:59.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:06:59.956+0000 7fee308dc640 1 -- 172.21.15.152:0/175297871 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee1c09c1f0 con 0x7fee2c076720 2024-09-11T22:07:00.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.343+0000 7fee318de640 1 -- 172.21.15.152:0/175297871 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee18005850 con 0x7fee2c076720 2024-09-11T22:07:00.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.345+0000 7fee308dc640 1 -- 172.21.15.152:0/175297871 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11925 (secure 0 0 0) 0x7fee1c09baf0 con 0x7fee2c076720 2024-09-11T22:07:00.346 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:07:00.346 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"btime":"2024-09-11T22:06:38:855821+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:06:38.805635+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:07:00.346 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 28 2024-09-11T22:07:00.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 -- 172.21.15.152:0/175297871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fee140a2f00 msgr2=0x7fee140a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:00.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fee140a2f00 0x7fee140a53c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fee200095f0 tx=0x7fee20005f90 comp rx=0 tx=0).stop 2024-09-11T22:07:00.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 -- 172.21.15.152:0/175297871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c076720 msgr2=0x7fee2c1a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:00.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c076720 0x7fee2c1a4720 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00e9c0 tx=0x7fee1c00ee80 comp rx=0 tx=0).stop 2024-09-11T22:07:00.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 -- 172.21.15.152:0/175297871 shutdown_connections 2024-09-11T22:07:00.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fee140a2f00 0x7fee140a53c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:00.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee2c112a30 0x7fee2c19e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:00.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee2c077040 0x7fee2c1a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:00.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 --2- 172.21.15.152:0/175297871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c076720 0x7fee2c1a4720 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:00.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 -- 172.21.15.152:0/175297871 >> 172.21.15.152:0/175297871 conn(0x7fee2c0ffab0 msgr2=0x7fee2c101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:00.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 -- 172.21.15.152:0/175297871 shutdown_connections 2024-09-11T22:07:00.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:00.349+0000 7fee318de640 1 -- 172.21.15.152:0/175297871 wait complete. 2024-09-11T22:07:00.727 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:00 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/175297871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:07:00.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:00 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/175297871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:07:00.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:00 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/175297871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:07:01.163 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0' 2024-09-11T22:07:01.163 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0 2024-09-11T22:07:01.440 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:07:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:01 smithi179 ceph-mon[35603]: pgmap v85: 97 pgs: 97 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 806 op/s 2024-09-11T22:07:01.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:01 smithi193 ceph-mon[35545]: pgmap v85: 97 pgs: 97 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 806 op/s 2024-09-11T22:07:01.864 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:01 smithi152 ceph-mon[31188]: pgmap v85: 97 pgs: 97 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 806 op/s 2024-09-11T22:07:01.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.966+0000 7fa789f17640 1 -- 172.21.15.152:0/3556745157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7841009b0 msgr2=0x7fa784100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:01.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.966+0000 7fa789f17640 1 --2- 172.21.15.152:0/3556745157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7841009b0 0x7fa784100d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa774009900 tx=0x7fa77402a3f0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.966+0000 7fa789f17640 1 -- 172.21.15.152:0/3556745157 shutdown_connections 2024-09-11T22:07:01.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.966+0000 7fa789f17640 1 --2- 172.21.15.152:0/3556745157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa78410e4d0 0x7fa7841108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.966+0000 7fa789f17640 1 --2- 172.21.15.152:0/3556745157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa784101360 0x7fa78410df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.966+0000 7fa789f17640 1 --2- 172.21.15.152:0/3556745157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7841009b0 0x7fa784100d90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.966+0000 7fa789f17640 1 -- 172.21.15.152:0/3556745157 >> 172.21.15.152:0/3556745157 conn(0x7fa7840fc7d0 msgr2=0x7fa7840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:01.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.966+0000 7fa789f17640 1 -- 172.21.15.152:0/3556745157 shutdown_connections 2024-09-11T22:07:01.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.966+0000 7fa789f17640 1 -- 172.21.15.152:0/3556745157 wait complete. 2024-09-11T22:07:01.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa789f17640 1 Processor -- start 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa789f17640 1 -- start start 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa789f17640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7841009b0 0x7fa7841a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa789f17640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa784101360 0x7fa7841a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa789f17640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa78410e4d0 0x7fa78419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa789f17640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa784114230 con 0x7fa7841009b0 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa789f17640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841140b0 con 0x7fa78410e4d0 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa789f17640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841143b0 con 0x7fa784101360 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa7837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7841009b0 0x7fa7841a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa783fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa78410e4d0 0x7fa78419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa783fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa78410e4d0 0x7fa78419a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60522/0 (socket says 172.21.15.152:60522) 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa7837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7841009b0 0x7fa7841a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51016/0 (socket says 172.21.15.152:51016) 2024-09-11T22:07:01.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa783fff640 1 -- 172.21.15.152:0/4266038990 learned_addr learned my addr 172.21.15.152:0/4266038990 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.967+0000 7fa782ffd640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa784101360 0x7fa7841a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa783fff640 1 -- 172.21.15.152:0/4266038990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa784101360 msgr2=0x7fa7841a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa783fff640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa784101360 0x7fa7841a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa783fff640 1 -- 172.21.15.152:0/4266038990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7841009b0 msgr2=0x7fa7841a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa783fff640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7841009b0 0x7fa7841a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa783fff640 1 -- 172.21.15.152:0/4266038990 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78419ace0 con 0x7fa78410e4d0 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa782ffd640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa784101360 0x7fa7841a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa783fff640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa78410e4d0 0x7fa78419a5b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00efd0 tx=0x7fa77c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa780ff9640 1 -- 172.21.15.152:0/4266038990 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c003b70 con 0x7fa78410e4d0 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa780ff9640 1 -- 172.21.15.152:0/4266038990 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa77c003d10 con 0x7fa78410e4d0 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa789f17640 1 -- 172.21.15.152:0/4266038990 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78419afd0 con 0x7fa78410e4d0 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa780ff9640 1 -- 172.21.15.152:0/4266038990 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0109f0 con 0x7fa78410e4d0 2024-09-11T22:07:01.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.968+0000 7fa789f17640 1 -- 172.21.15.152:0/4266038990 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7841a72c0 con 0x7fa78410e4d0 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa780ff9640 1 -- 172.21.15.152:0/4266038990 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa77c004020 con 0x7fa78410e4d0 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa78c2f0740 1 Processor -- start 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa78c2f0740 1 -- start start 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676ae760 0x55f4676aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676af080 0x55f4676b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676b9940 0x55f4676bbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f4676142a0 con 0x55f4676ae760 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f4675bbb10 con 0x55f4676af080 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f467610260 con 0x55f4676b9940 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa782ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676ae760 0x55f4676aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa7837fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676af080 0x55f4676b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa782ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676ae760 0x55f4676aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51032/0 (socket says 172.21.15.152:51032) 2024-09-11T22:07:01.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa782ffd640 1 -- 172.21.15.152:0/4212241674 learned_addr learned my addr 172.21.15.152:0/4212241674 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.971+0000 7fa782ffd640 1 --2- 172.21.15.152:0/4212241674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676b9940 0x55f4676bbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa780ff9640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 0x7fa76c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa782ffd640 1 -- 172.21.15.152:0/4212241674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676b9940 msgr2=0x55f4676bbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa782ffd640 1 --2- 172.21.15.152:0/4212241674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676b9940 0x55f4676bbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa782ffd640 1 -- 172.21.15.152:0/4212241674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676af080 msgr2=0x55f4676b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa782ffd640 1 --2- 172.21.15.152:0/4212241674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676af080 0x55f4676b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa782ffd640 1 -- 172.21.15.152:0/4212241674 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f467385b90 con 0x55f4676ae760 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa7837fe640 1 --2- 172.21.15.152:0/4212241674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676af080 0x55f4676b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa783fff640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 0x7fa76c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa780ff9640 1 -- 172.21.15.152:0/4266038990 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa77c0cf870 con 0x7fa78410e4d0 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa782ffd640 1 --2- 172.21.15.152:0/4212241674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676ae760 0x55f4676aeb40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa778009fd0 tx=0x7fa7780096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6151d0527f421b6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa769ffb640 1 -- 172.21.15.152:0/4212241674 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7780110d0 con 0x55f4676ae760 2024-09-11T22:07:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa769ffb640 1 -- 172.21.15.152:0/4212241674 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa778005500 con 0x55f4676ae760 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.972+0000 7fa769ffb640 1 -- 172.21.15.152:0/4212241674 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778004e00 con 0x55f4676ae760 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.973+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4212241674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676ae760 msgr2=0x55f4676aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.973+0000 7fa783fff640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 0x7fa76c0a5230 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0cd040 tx=0x7fa77c06bbc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.973+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/4212241674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676ae760 0x55f4676aeb40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa778009fd0 tx=0x7fa7780096f0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.973+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4212241674 shutdown_connections 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.973+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/4212241674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676b9940 0x55f4676bbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.973+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/4212241674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676af080 0x55f4676b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.973+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/4212241674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676ae760 0x55f4676aeb40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.973+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4212241674 >> 172.21.15.152:0/4212241674 conn(0x55f4676aacf0 msgr2=0x55f4676ab0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.973+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4212241674 shutdown_connections 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.973+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4212241674 wait complete. 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa78c2f0740 1 -- start start 2024-09-11T22:07:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa78c2f0740 1 Processor -- start 2024-09-11T22:07:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676ae760 0x55f4676b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676af080 0x55f4676b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676b9940 0x55f4676b7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f4676bc510 con 0x55f4676af080 2024-09-11T22:07:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f46759c6e0 con 0x55f4676b9940 2024-09-11T22:07:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f4676bc690 con 0x55f4676ae760 2024-09-11T22:07:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa78c2f0740 10 client.0 _ll_register_callbacks cb 0x55f4675c0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa782ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676ae760 0x55f4676b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa7837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676af080 0x55f4676b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa782ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676ae760 0x55f4676b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37884/0 (socket says 172.21.15.152:37884) 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa7837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676af080 0x55f4676b6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51036/0 (socket says 172.21.15.152:51036) 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa782ffd640 1 -- 172.21.15.152:0/2054881711 learned_addr learned my addr 172.21.15.152:0/2054881711 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.974+0000 7fa782ffd640 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676b9940 0x55f4676b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa782ffd640 1 -- 172.21.15.152:0/2054881711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676b9940 msgr2=0x55f4676b7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa782ffd640 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676b9940 0x55f4676b7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa782ffd640 1 -- 172.21.15.152:0/2054881711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676af080 msgr2=0x55f4676b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa782ffd640 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676af080 0x55f4676b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa782ffd640 1 -- 172.21.15.152:0/2054881711 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4676c5980 con 0x55f4676ae760 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa782ffd640 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676ae760 0x55f4676b6780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa778004840 tx=0x7fa778015040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e73fe7488bf88d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa762ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa762ffd640 1 -- 172.21.15.152:0/2054881711 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778013cf0 con 0x55f4676ae760 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa762ffd640 1 -- 172.21.15.152:0/2054881711 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa778011d80 con 0x55f4676ae760 2024-09-11T22:07:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa78c2f0740 1 -- 172.21.15.152:0/2054881711 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa778005500 con 0x55f4676ae760 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa762ffd640 1 -- 172.21.15.152:0/2054881711 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa778004b80 con 0x55f4676ae760 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa78c2f0740 10 client.25684 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.975+0000 7fa78c2f0740 1 -- 172.21.15.152:0/2054881711 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f4676c82c0 con 0x55f4676ae760 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.976+0000 7fa762ffd640 1 -- 172.21.15.152:0/2054881711 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa778005500 con 0x55f4676ae760 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.976+0000 7fa762ffd640 1 -- 172.21.15.152:0/2054881711 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa77800f880 con 0x55f4676ae760 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.976+0000 7fa78c2f0740 10 client.25684 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.976+0000 7fa78c2f0740 10 client.25684 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.976+0000 7fa78c2f0740 20 client.25684 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.976+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4676c9610 0x55f4676cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.976+0000 7fa78c2f0740 4 client.25684 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.976+0000 7fa78c2f0740 1 -- 172.21.15.152:0/2054881711 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4676219d0 con 0x55f4676c9610 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.976+0000 7fa7837fe640 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4676c9610 0x55f4676cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:01.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.977+0000 7fa7837fe640 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4676c9610 0x55f4676cba00 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=964f406100dca4c3 server_cookie=d4ba70b7e59627e2 in_seq=0 out_seq=0 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.977+0000 7fa762ffd640 10 client.25684 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.977+0000 7fa762ffd640 1 -- 172.21.15.152:0/2054881711 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4676219d0 con 0x55f4676c9610 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.977+0000 7fa762ffd640 10 client.25684 handle_command_reply: tid=0 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.977+0000 7fa78c2f0740 1 client.25684 shutdown 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa78c2f0740 1 -- 172.21.15.152:0/2054881711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676ae760 msgr2=0x55f4676b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676ae760 0x55f4676b6780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa778004840 tx=0x7fa778015040 comp rx=0 tx=0).stop 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa78c2f0740 1 -- 172.21.15.152:0/2054881711 shutdown_connections 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4676c9610 0x55f4676cba00 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676b9940 0x55f4676b7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676af080 0x55f4676b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/2054881711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676ae760 0x55f4676b6780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa762ffd640 0 client.25684 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa78c2f0740 1 -- 172.21.15.152:0/2054881711 >> 172.21.15.152:0/2054881711 conn(0x55f4676aacf0 msgr2=0x55f4676b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:01.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa78c2f0740 1 -- 172.21.15.152:0/2054881711 shutdown_connections 2024-09-11T22:07:01.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa78c2f0740 1 -- 172.21.15.152:0/2054881711 wait complete. 2024-09-11T22:07:01.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.978+0000 7fa78c2f0740 20 client.25684 trim_cache size 0 max 16384 2024-09-11T22:07:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.999+0000 7fa78c2f0740 1 Processor -- start 2024-09-11T22:07:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.999+0000 7fa78c2f0740 1 -- start start 2024-09-11T22:07:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.999+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 0x55f4676b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.999+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 0x55f4676b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.999+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676b9940 0x55f4676d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.999+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841b23e0 con 0x55f4676b9940 2024-09-11T22:07:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.999+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841afc80 con 0x55f4676ae760 2024-09-11T22:07:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:01.999+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841adad0 con 0x55f4676af080 2024-09-11T22:07:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.000+0000 7fa782ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 0x55f4676b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.000+0000 7fa782ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 0x55f4676b11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60540/0 (socket says 172.21.15.152:60540) 2024-09-11T22:07:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.000+0000 7fa782ffd640 1 -- 172.21.15.152:0/50678254 learned_addr learned my addr 172.21.15.152:0/50678254 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.000+0000 7fa7837fe640 1 --2- 172.21.15.152:0/50678254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 0x55f4676b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.000+0000 7fa782ffd640 1 --2- 172.21.15.152:0/50678254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676b9940 0x55f4676d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.001+0000 7fa7837fe640 1 -- 172.21.15.152:0/50678254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 msgr2=0x55f4676b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.001+0000 7fa7837fe640 1 --2- 172.21.15.152:0/50678254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 0x55f4676b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.001+0000 7fa7837fe640 1 -- 172.21.15.152:0/50678254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676b9940 msgr2=0x55f4676d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.001+0000 7fa7837fe640 1 --2- 172.21.15.152:0/50678254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676b9940 0x55f4676d10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.001+0000 7fa7837fe640 1 -- 172.21.15.152:0/50678254 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4676aab20 con 0x55f4676af080 2024-09-11T22:07:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.001+0000 7fa782ffd640 1 --2- 172.21.15.152:0/50678254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 0x55f4676b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:07:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.001+0000 7fa7837fe640 1 --2- 172.21.15.152:0/50678254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 0x55f4676b5ce0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa774005940 tx=0x7fa774000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c044638a92c8a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.002+0000 7fa7697fa640 1 -- 172.21.15.152:0/50678254 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa774035040 con 0x55f4676af080 2024-09-11T22:07:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.002+0000 7fa7697fa640 1 -- 172.21.15.152:0/50678254 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa774005020 con 0x55f4676af080 2024-09-11T22:07:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.002+0000 7fa7697fa640 1 -- 172.21.15.152:0/50678254 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa774004a90 con 0x55f4676af080 2024-09-11T22:07:02.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.002+0000 7fa78c2f0740 1 -- 172.21.15.152:0/50678254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 msgr2=0x55f4676b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:02.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.003+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/50678254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 0x55f4676b5ce0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa774005940 tx=0x7fa774000bc0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.003+0000 7fa78c2f0740 1 -- 172.21.15.152:0/50678254 shutdown_connections 2024-09-11T22:07:02.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.003+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/50678254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676b9940 0x55f4676d10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.003+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/50678254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 0x55f4676b5ce0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.003+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/50678254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 0x55f4676b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.003+0000 7fa78c2f0740 1 -- 172.21.15.152:0/50678254 >> 172.21.15.152:0/50678254 conn(0x55f4676aacf0 msgr2=0x55f4676a9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:02.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.003+0000 7fa78c2f0740 1 -- 172.21.15.152:0/50678254 shutdown_connections 2024-09-11T22:07:02.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.003+0000 7fa78c2f0740 1 -- 172.21.15.152:0/50678254 wait complete. 2024-09-11T22:07:02.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.003+0000 7fa78c2f0740 1 -- start start 2024-09-11T22:07:02.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.003+0000 7fa78c2f0740 1 Processor -- start 2024-09-11T22:07:02.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 0x55f4676bd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:02.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 0x55f4676bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa78c2f0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676b9940 0x55f4676be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841ae140 con 0x55f4676b9940 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841af5b0 con 0x55f4676ae760 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa78c2f0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841ae810 con 0x55f4676af080 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa78c2f0740 10 client.0 _ll_register_callbacks cb 0x7fa778011a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa782ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676b9940 0x55f4676be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa782ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676b9940 0x55f4676be2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51042/0 (socket says 172.21.15.152:51042) 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa782ffd640 1 -- 172.21.15.152:0/4098085567 learned_addr learned my addr 172.21.15.152:0/4098085567 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa7837fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 0x55f4676bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.004+0000 7fa782ffd640 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 0x55f4676bd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa7837fe640 1 -- 172.21.15.152:0/4098085567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 msgr2=0x55f4676bd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa7837fe640 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 0x55f4676bd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa7837fe640 1 -- 172.21.15.152:0/4098085567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676b9940 msgr2=0x55f4676be2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa7837fe640 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676b9940 0x55f4676be2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa7837fe640 1 -- 172.21.15.152:0/4098085567 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4676abda0 con 0x55f4676af080 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa7837fe640 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 0x55f4676bdda0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55f4676aa840 tx=0x7fa774009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2328b030fbeca887 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa762ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa762ffd640 1 -- 172.21.15.152:0/4098085567 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa774035030 con 0x55f4676af080 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa762ffd640 1 -- 172.21.15.152:0/4098085567 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa774004240 con 0x55f4676af080 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4098085567 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa774005020 con 0x55f4676af080 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa762ffd640 1 -- 172.21.15.152:0/4098085567 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa774060050 con 0x55f4676af080 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa78c2f0740 10 client.25690 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.005+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4098085567 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f467734330 con 0x55f4676af080 2024-09-11T22:07:02.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.006+0000 7fa762ffd640 1 -- 172.21.15.152:0/4098085567 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa774005020 con 0x55f4676af080 2024-09-11T22:07:02.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.006+0000 7fa762ffd640 1 -- 172.21.15.152:0/4098085567 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa774003710 con 0x55f4676af080 2024-09-11T22:07:02.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.006+0000 7fa78c2f0740 10 client.25690 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:02.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.006+0000 7fa78c2f0740 10 client.25690 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:07:02.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.006+0000 7fa78c2f0740 20 client.25690 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:02.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.006+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f467734b10 0x55f467736f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:02.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.006+0000 7fa78c2f0740 4 client.25690 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}] 2024-09-11T22:07:02.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.006+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4098085567 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}) -- 0x55f46761bd20 con 0x55f467734b10 2024-09-11T22:07:02.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.006+0000 7fa782ffd640 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f467734b10 0x55f467736f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:02.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.007+0000 7fa782ffd640 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f467734b10 0x55f467736f30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff24eb8ca539159c server_cookie=eda0a28ce3a0e9a4 in_seq=0 out_seq=0 2024-09-11T22:07:02.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.007+0000 7fa762ffd640 10 client.25690 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:02.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.261+0000 7fa762ffd640 1 -- 172.21.15.152:0/4098085567 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f46761bd20 con 0x55f467734b10 2024-09-11T22:07:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.261+0000 7fa762ffd640 10 client.25690 handle_command_reply: tid=0 2024-09-11T22:07:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.261+0000 7fa78c2f0740 1 client.25690 shutdown 2024-09-11T22:07:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4098085567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 msgr2=0x55f4676bdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 0x55f4676bdda0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55f4676aa840 tx=0x7fa774009680 comp rx=0 tx=0).stop 2024-09-11T22:07:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4098085567 shutdown_connections 2024-09-11T22:07:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f467734b10 0x55f467736f30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4676b9940 0x55f4676be2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4676af080 0x55f4676bdda0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa78c2f0740 1 --2- 172.21.15.152:0/4098085567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4676ae760 0x55f4676bd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa762ffd640 0 client.25690 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4098085567 >> 172.21.15.152:0/4098085567 conn(0x55f4676aacf0 msgr2=0x55f4676c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:02.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4098085567 shutdown_connections 2024-09-11T22:07:02.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa78c2f0740 1 -- 172.21.15.152:0/4098085567 wait complete. 2024-09-11T22:07:02.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa78c2f0740 20 client.25690 trim_cache size 0 max 16384 2024-09-11T22:07:02.264 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:07:02.264 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 28, 2024-09-11T22:07:02.264 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:07:02.264 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 10, 2024-09-11T22:07:02.264 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:07:02.264 INFO:teuthology.orchestra.run.smithi152.stdout: "a442924a": { 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 10, 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 144.7, 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:07:02.265 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:07:02.266 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:07:02.266 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:02.266 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:02.266 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:02.266 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:02.266 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:02.266 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa789f17640 1 -- 172.21.15.152:0/4266038990 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 msgr2=0x7fa76c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa789f17640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 0x7fa76c0a5230 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0cd040 tx=0x7fa77c06bbc0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa789f17640 1 -- 172.21.15.152:0/4266038990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa78410e4d0 msgr2=0x7fa78419a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa789f17640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa78410e4d0 0x7fa78419a5b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00efd0 tx=0x7fa77c00c6a0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa789f17640 1 -- 172.21.15.152:0/4266038990 shutdown_connections 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa789f17640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 0x7fa76c0a5230 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa789f17640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa78410e4d0 0x7fa78419a5b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa789f17640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa784101360 0x7fa7841a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa789f17640 1 --2- 172.21.15.152:0/4266038990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7841009b0 0x7fa7841a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.262+0000 7fa789f17640 1 -- 172.21.15.152:0/4266038990 >> 172.21.15.152:0/4266038990 conn(0x7fa7840fc7d0 msgr2=0x7fa7840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.263+0000 7fa789f17640 1 -- 172.21.15.152:0/4266038990 shutdown_connections 2024-09-11T22:07:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:02.263+0000 7fa789f17640 1 -- 172.21.15.152:0/4266038990 wait complete. 2024-09-11T22:07:02.983 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a442924a', quiesce took 4.5 seconds. Will release after: 20.2 2024-09-11T22:07:03.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:03 smithi179 ceph-mon[35603]: pgmap v86: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 13 MiB/s wr, 1.08k op/s 2024-09-11T22:07:03.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:03 smithi193 ceph-mon[35545]: pgmap v86: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 13 MiB/s wr, 1.08k op/s 2024-09-11T22:07:03.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:03 smithi152 ceph-mon[31188]: pgmap v86: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 13 MiB/s wr, 1.08k op/s 2024-09-11T22:07:04.821 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 90.0 s, 1249.1 tps, lat 33.677 ms stddev 70.115 2024-09-11T22:07:05.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:05 smithi179 ceph-mon[35603]: pgmap v87: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.2 MiB/s wr, 671 op/s 2024-09-11T22:07:05.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:05 smithi193 ceph-mon[35545]: pgmap v87: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.2 MiB/s wr, 671 op/s 2024-09-11T22:07:05.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:05 smithi152 ceph-mon[31188]: pgmap v87: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.2 MiB/s wr, 671 op/s 2024-09-11T22:07:07.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:07 smithi179 ceph-mon[35603]: pgmap v88: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.2 MiB/s wr, 671 op/s 2024-09-11T22:07:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:07 smithi193 ceph-mon[35545]: pgmap v88: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.2 MiB/s wr, 671 op/s 2024-09-11T22:07:07.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:07 smithi152 ceph-mon[31188]: pgmap v88: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.2 MiB/s wr, 671 op/s 2024-09-11T22:07:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.717+0000 7fb80855f640 1 -- 172.21.15.152:0/2088027916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8001009b0 msgr2=0x7fb800100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.717+0000 7fb80855f640 1 --2- 172.21.15.152:0/2088027916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8001009b0 0x7fb800100e10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009930 tx=0x7fb7f402a420 comp rx=0 tx=0).stop 2024-09-11T22:07:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.717+0000 7fb80855f640 1 -- 172.21.15.152:0/2088027916 shutdown_connections 2024-09-11T22:07:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.717+0000 7fb80855f640 1 --2- 172.21.15.152:0/2088027916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb800101350 0x7fb80010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.717+0000 7fb80855f640 1 --2- 172.21.15.152:0/2088027916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8001009b0 0x7fb800100e10 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.717+0000 7fb80855f640 1 --2- 172.21.15.152:0/2088027916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8001069c0 0x7fb800106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.717+0000 7fb80855f640 1 -- 172.21.15.152:0/2088027916 >> 172.21.15.152:0/2088027916 conn(0x7fb800077990 msgr2=0x7fb8000fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.717+0000 7fb80855f640 1 -- 172.21.15.152:0/2088027916 shutdown_connections 2024-09-11T22:07:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.717+0000 7fb80855f640 1 -- 172.21.15.152:0/2088027916 wait complete. 2024-09-11T22:07:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb80855f640 1 Processor -- start 2024-09-11T22:07:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb80855f640 1 -- start start 2024-09-11T22:07:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb80855f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8001009b0 0x7fb8001983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb80855f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb800101350 0x7fb8001988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb80855f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8001069c0 0x7fb80019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb80855f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb800110e00 con 0x7fb8001009b0 2024-09-11T22:07:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb80855f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb800110c80 con 0x7fb800101350 2024-09-11T22:07:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb80855f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb800110f80 con 0x7fb8001069c0 2024-09-11T22:07:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb8062fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8001009b0 0x7fb8001983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb8062fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8001009b0 0x7fb8001983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41606/0 (socket says 172.21.15.152:41606) 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb8062fb640 1 -- 172.21.15.152:0/4197445366 learned_addr learned my addr 172.21.15.152:0/4197445366 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb806afc640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8001069c0 0x7fb80019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.718+0000 7fb805afa640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb800101350 0x7fb8001988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.719+0000 7fb8062fb640 1 -- 172.21.15.152:0/4197445366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8001069c0 msgr2=0x7fb80019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.719+0000 7fb8062fb640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8001069c0 0x7fb80019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.719+0000 7fb8062fb640 1 -- 172.21.15.152:0/4197445366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb800101350 msgr2=0x7fb8001988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.719+0000 7fb8062fb640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb800101350 0x7fb8001988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.719+0000 7fb8062fb640 1 -- 172.21.15.152:0/4197445366 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80019d390 con 0x7fb8001009b0 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.719+0000 7fb8062fb640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8001009b0 0x7fb8001983a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000eb90 tx=0x7fb7f000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.719+0000 7fb7ff7fe640 1 -- 172.21.15.152:0/4197445366 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0004d20 con 0x7fb8001009b0 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.719+0000 7fb7ff7fe640 1 -- 172.21.15.152:0/4197445366 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f000ee90 con 0x7fb8001009b0 2024-09-11T22:07:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.719+0000 7fb80855f640 1 -- 172.21.15.152:0/4197445366 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80019d680 con 0x7fb8001009b0 2024-09-11T22:07:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.719+0000 7fb7ff7fe640 1 -- 172.21.15.152:0/4197445366 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0010830 con 0x7fb8001009b0 2024-09-11T22:07:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.719+0000 7fb80855f640 1 -- 172.21.15.152:0/4197445366 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8001a4f10 con 0x7fb8001009b0 2024-09-11T22:07:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.721+0000 7fb7ff7fe640 1 -- 172.21.15.152:0/4197445366 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb7f0005020 con 0x7fb8001009b0 2024-09-11T22:07:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.722+0000 7fb80b3d5740 1 Processor -- start 2024-09-11T22:07:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.722+0000 7fb80b3d5740 1 -- start start 2024-09-11T22:07:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.722+0000 7fb7ff7fe640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2da0 0x7fb7e80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.722+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f4f9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.722+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f504770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.722+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f504cb0 0x55e47f5070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.722+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e47f45e2f0 con 0x55e47f4fa410 2024-09-11T22:07:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.722+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e47f406270 con 0x55e47f4f9af0 2024-09-11T22:07:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.722+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e47f45a2b0 con 0x55e47f504cb0 2024-09-11T22:07:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb805afa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f504770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb806afc640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2da0 0x7fb7e80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb805afa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f504770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41614/0 (socket says 172.21.15.152:41614) 2024-09-11T22:07:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb805afa640 1 -- 172.21.15.152:0/1508804157 learned_addr learned my addr 172.21.15.152:0/1508804157 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb7ff7fe640 1 -- 172.21.15.152:0/4197445366 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb7f00cfaf0 con 0x7fb8001009b0 2024-09-11T22:07:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb8062fb640 1 --2- 172.21.15.152:0/1508804157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f4f9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb806afc640 1 --2- 172.21.15.152:0/1508804157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f504cb0 0x55e47f5070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb805afa640 1 -- 172.21.15.152:0/1508804157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f504cb0 msgr2=0x55e47f5070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb805afa640 1 --2- 172.21.15.152:0/1508804157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f504cb0 0x55e47f5070a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb805afa640 1 -- 172.21.15.152:0/1508804157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 msgr2=0x55e47f4f9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb805afa640 1 --2- 172.21.15.152:0/1508804157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f4f9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb805afa640 1 -- 172.21.15.152:0/1508804157 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47f405340 con 0x55e47f4fa410 2024-09-11T22:07:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb8062fb640 1 --2- 172.21.15.152:0/1508804157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f4f9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:07:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb806afc640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2da0 0x7fb7e80a5260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009710 tx=0x7fb7f8013830 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb805afa640 1 --2- 172.21.15.152:0/1508804157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f504770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb7f402a940 tx=0x7fb7f4005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35e574f9ff6b740 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb7fcbfe640 1 -- 172.21.15.152:0/1508804157 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f403f070 con 0x55e47f4fa410 2024-09-11T22:07:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb7fcbfe640 1 -- 172.21.15.152:0/1508804157 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f4004030 con 0x55e47f4fa410 2024-09-11T22:07:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.723+0000 7fb7fcbfe640 1 -- 172.21.15.152:0/1508804157 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4035070 con 0x55e47f4fa410 2024-09-11T22:07:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.724+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1508804157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 msgr2=0x55e47f504770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.724+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1508804157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f504770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb7f402a940 tx=0x7fb7f4005dd0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.724+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1508804157 shutdown_connections 2024-09-11T22:07:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.724+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1508804157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f504cb0 0x55e47f5070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.724+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1508804157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f504770 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.724+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1508804157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f4f9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.724+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1508804157 >> 172.21.15.152:0/1508804157 conn(0x55e47f4f6060 msgr2=0x55e47f4f6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.724+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1508804157 shutdown_connections 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.724+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1508804157 wait complete. 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb80b3d5740 1 -- start start 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb80b3d5740 1 Processor -- start 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4f9af0 0x55e47f501be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f4fa410 0x55e47f502120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f504cb0 0x55e47f502660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e47f507880 con 0x55e47f4f9af0 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e47f3e7290 con 0x55e47f504cb0 2024-09-11T22:07:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e47f507a00 con 0x55e47f4fa410 2024-09-11T22:07:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb80b3d5740 10 client.0 _ll_register_callbacks cb 0x55e47f418140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb8062fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4f9af0 0x55e47f501be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb8062fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4f9af0 0x55e47f501be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41622/0 (socket says 172.21.15.152:41622) 2024-09-11T22:07:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb8062fb640 1 -- 172.21.15.152:0/1959309396 learned_addr learned my addr 172.21.15.152:0/1959309396 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb806afc640 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f504cb0 0x55e47f502660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb805afa640 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f4fa410 0x55e47f502120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb8062fb640 1 -- 172.21.15.152:0/1959309396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f4fa410 msgr2=0x55e47f502120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb8062fb640 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f4fa410 0x55e47f502120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb8062fb640 1 -- 172.21.15.152:0/1959309396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f504cb0 msgr2=0x55e47f502660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb8062fb640 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f504cb0 0x55e47f502660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb8062fb640 1 -- 172.21.15.152:0/1959309396 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e47f171210 con 0x55e47f4f9af0 2024-09-11T22:07:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb806afc640 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f504cb0 0x55e47f502660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:07:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb8062fb640 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4f9af0 0x55e47f501be0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00cd270 tx=0x7fb7f009bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c48cbcc8d553f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.725+0000 7fb7e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1959309396 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00aeb20 con 0x55e47f4f9af0 2024-09-11T22:07:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1959309396 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb7f0005590 con 0x55e47f4f9af0 2024-09-11T22:07:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1959309396 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7f4004030 con 0x55e47f4f9af0 2024-09-11T22:07:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1959309396 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb7f009c6e0 con 0x55e47f4f9af0 2024-09-11T22:07:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb80b3d5740 10 client.16032 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1959309396 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e47f23d620 con 0x55e47f4f9af0 2024-09-11T22:07:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1959309396 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f4004030 con 0x55e47f4f9af0 2024-09-11T22:07:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1959309396 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb7f00cd490 con 0x55e47f4f9af0 2024-09-11T22:07:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb80b3d5740 10 client.16032 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb80b3d5740 10 client.16032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb80b3d5740 20 client.16032 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e47f514c80 0x55e47f5170f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb80b3d5740 4 client.16032 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.726+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1959309396 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e47f46ba20 con 0x55e47f514c80 2024-09-11T22:07:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.727+0000 7fb805afa640 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e47f514c80 0x55e47f5170f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.727+0000 7fb7e5ffb640 10 client.16032 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.727+0000 7fb805afa640 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e47f514c80 0x55e47f5170f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f34c1e0ac7641be1 server_cookie=34ab32a75469143e in_seq=0 out_seq=0 2024-09-11T22:07:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1959309396 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb7f404ee80 con 0x55e47f514c80 2024-09-11T22:07:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb7e5ffb640 10 client.16032 handle_command_reply: tid=0 2024-09-11T22:07:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 1 client.16032 shutdown 2024-09-11T22:07:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1959309396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4f9af0 msgr2=0x55e47f501be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4f9af0 0x55e47f501be0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00cd270 tx=0x7fb7f009bc50 comp rx=0 tx=0).stop 2024-09-11T22:07:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1959309396 shutdown_connections 2024-09-11T22:07:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e47f514c80 0x55e47f5170f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f504cb0 0x55e47f502660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb7e5ffb640 0 client.16032 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f4fa410 0x55e47f502120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1959309396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4f9af0 0x55e47f501be0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1959309396 >> 172.21.15.152:0/1959309396 conn(0x55e47f4f6060 msgr2=0x55e47f4fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1959309396 shutdown_connections 2024-09-11T22:07:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1959309396 wait complete. 2024-09-11T22:07:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.728+0000 7fb80b3d5740 20 client.16032 trim_cache size 0 max 16384 2024-09-11T22:07:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb80b3d5740 1 Processor -- start 2024-09-11T22:07:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb80b3d5740 1 -- start start 2024-09-11T22:07:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f502490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f51ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f504cb0 0x55e47f51cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001b0100 con 0x55e47f4fa410 2024-09-11T22:07:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001ad9a0 con 0x55e47f4f9af0 2024-09-11T22:07:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001ab7f0 con 0x55e47f504cb0 2024-09-11T22:07:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb805afa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f51ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb805afa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f51ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41638/0 (socket says 172.21.15.152:41638) 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb805afa640 1 -- 172.21.15.152:0/1907572636 learned_addr learned my addr 172.21.15.152:0/1907572636 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb8062fb640 1 --2- 172.21.15.152:0/1907572636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f502490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb806afc640 1 --2- 172.21.15.152:0/1907572636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f504cb0 0x55e47f51cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb805afa640 1 -- 172.21.15.152:0/1907572636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f504cb0 msgr2=0x55e47f51cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb805afa640 1 --2- 172.21.15.152:0/1907572636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f504cb0 0x55e47f51cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb805afa640 1 -- 172.21.15.152:0/1907572636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 msgr2=0x55e47f502490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb805afa640 1 --2- 172.21.15.152:0/1907572636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f502490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb805afa640 1 -- 172.21.15.152:0/1907572636 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47f4f5e90 con 0x55e47f4fa410 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.743+0000 7fb805afa640 1 --2- 172.21.15.152:0/1907572636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f51ca00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4005ec0 tx=0x7fb7f402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cba37de186d6e20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb7e7fff640 1 -- 172.21.15.152:0/1907572636 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4035070 con 0x55e47f4fa410 2024-09-11T22:07:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb7e7fff640 1 -- 172.21.15.152:0/1907572636 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f4049040 con 0x55e47f4fa410 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb7e7fff640 1 -- 172.21.15.152:0/1907572636 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f403f040 con 0x55e47f4fa410 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1907572636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 msgr2=0x55e47f51ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1907572636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f51ca00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4005ec0 tx=0x7fb7f402a420 comp rx=0 tx=0).stop 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1907572636 shutdown_connections 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1907572636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f504cb0 0x55e47f51cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1907572636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f4fa410 0x55e47f51ca00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1907572636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f502490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1907572636 >> 172.21.15.152:0/1907572636 conn(0x55e47f4f6060 msgr2=0x55e47f503c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1907572636 shutdown_connections 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.744+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1907572636 wait complete. 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb80b3d5740 1 -- start start 2024-09-11T22:07:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb80b3d5740 1 Processor -- start 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f4fed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f4fa410 0x55e47f4ff2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb80b3d5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f504cb0 0x55e47f4ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001abe60 con 0x55e47f504cb0 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001ad2d0 con 0x55e47f4f9af0 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb80b3d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001ac530 con 0x55e47f4fa410 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb80b3d5740 10 client.0 _ll_register_callbacks cb 0x7fb7f00099b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb806afc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f504cb0 0x55e47f4ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb806afc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f504cb0 0x55e47f4ff7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41644/0 (socket says 172.21.15.152:41644) 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb806afc640 1 -- 172.21.15.152:0/1983309157 learned_addr learned my addr 172.21.15.152:0/1983309157 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb8062fb640 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f4fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb805afa640 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f4fa410 0x55e47f4ff2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb806afc640 1 -- 172.21.15.152:0/1983309157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f4fa410 msgr2=0x55e47f4ff2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb806afc640 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f4fa410 0x55e47f4ff2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb806afc640 1 -- 172.21.15.152:0/1983309157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 msgr2=0x55e47f4fed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb806afc640 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f4fed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb806afc640 1 -- 172.21.15.152:0/1983309157 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e47f57eba0 con 0x55e47f504cb0 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb805afa640 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f4fa410 0x55e47f4ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb806afc640 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f504cb0 0x55e47f4ff7f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8012420 tx=0x7fb7f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9a47e8eb66be0c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.745+0000 7fb7e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1983309157 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800f480 con 0x55e47f504cb0 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1983309157 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb7f800f620 con 0x55e47f504cb0 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1983309157 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7f4049040 con 0x55e47f504cb0 2024-09-11T22:07:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1983309157 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb7f800f820 con 0x55e47f504cb0 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb80b3d5740 10 client.16038 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1983309157 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e47f57fed0 con 0x55e47f504cb0 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1983309157 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f4049040 con 0x55e47f504cb0 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1983309157 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb7f802f070 con 0x55e47f504cb0 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb80b3d5740 10 client.16038 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb80b3d5740 10 client.16038 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb80b3d5740 20 client.16038 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e47f580690 0x55e47f582ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb80b3d5740 4 client.16038 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1983309157 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e47f465d70 con 0x55e47f580690 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.746+0000 7fb8062fb640 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e47f580690 0x55e47f582ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.747+0000 7fb8062fb640 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e47f580690 0x55e47f582ab0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b97e374334dc1ba server_cookie=3966a0b31be70c91 in_seq=0 out_seq=0 2024-09-11T22:07:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.747+0000 7fb7e5ffb640 10 client.16038 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb7e5ffb640 1 -- 172.21.15.152:0/1983309157 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e47f465d70 con 0x55e47f580690 2024-09-11T22:07:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb7e5ffb640 10 client.16038 handle_command_reply: tid=0 2024-09-11T22:07:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb80b3d5740 1 client.16038 shutdown 2024-09-11T22:07:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1983309157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f504cb0 msgr2=0x55e47f4ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f504cb0 0x55e47f4ff7f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8012420 tx=0x7fb7f8004730 comp rx=0 tx=0).stop 2024-09-11T22:07:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1983309157 shutdown_connections 2024-09-11T22:07:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e47f580690 0x55e47f582ab0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e47f504cb0 0x55e47f4ff7f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e47f4fa410 0x55e47f4ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb7e5ffb640 0 client.16038 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb80b3d5740 1 --2- 172.21.15.152:0/1983309157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47f4f9af0 0x55e47f4fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1983309157 >> 172.21.15.152:0/1983309157 conn(0x55e47f4f6060 msgr2=0x55e47f4f49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.755+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1983309157 shutdown_connections 2024-09-11T22:07:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80b3d5740 1 -- 172.21.15.152:0/1983309157 wait complete. 2024-09-11T22:07:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80b3d5740 20 client.16038 trim_cache size 0 max 16384 2024-09-11T22:07:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:07:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:07:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:07:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:07:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 -- 172.21.15.152:0/4197445366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2da0 msgr2=0x7fb7e80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2da0 0x7fb7e80a5260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009710 tx=0x7fb7f8013830 comp rx=0 tx=0).stop 2024-09-11T22:07:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 -- 172.21.15.152:0/4197445366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8001009b0 msgr2=0x7fb8001983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8001009b0 0x7fb8001983a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000eb90 tx=0x7fb7f000c6a0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 -- 172.21.15.152:0/4197445366 shutdown_connections 2024-09-11T22:07:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2da0 0x7fb7e80a5260 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8001069c0 0x7fb80019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb800101350 0x7fb8001988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 --2- 172.21.15.152:0/4197445366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8001009b0 0x7fb8001983a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 -- 172.21.15.152:0/4197445366 >> 172.21.15.152:0/4197445366 conn(0x7fb800077990 msgr2=0x7fb800069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 -- 172.21.15.152:0/4197445366 shutdown_connections 2024-09-11T22:07:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:09.756+0000 7fb80855f640 1 -- 172.21.15.152:0/4197445366 wait complete. 2024-09-11T22:07:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:09 smithi179 ceph-mon[35603]: pgmap v89: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 11 MiB/s wr, 735 op/s 2024-09-11T22:07:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 95.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:07:09.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:09 smithi193 ceph-mon[35545]: pgmap v89: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 11 MiB/s wr, 735 op/s 2024-09-11T22:07:09.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:09 smithi152 ceph-mon[31188]: pgmap v89: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 11 MiB/s wr, 735 op/s 2024-09-11T22:07:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:11 smithi179 ceph-mon[35603]: pgmap v90: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 5.8 MiB/s wr, 334 op/s 2024-09-11T22:07:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:11 smithi193 ceph-mon[35545]: pgmap v90: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 5.8 MiB/s wr, 334 op/s 2024-09-11T22:07:11.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:11 smithi152 ceph-mon[31188]: pgmap v90: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 5.8 MiB/s wr, 334 op/s 2024-09-11T22:07:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:13 smithi179 ceph-mon[35603]: pgmap v91: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 5.8 MiB/s wr, 339 op/s 2024-09-11T22:07:13.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:13 smithi193 ceph-mon[35545]: pgmap v91: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 5.8 MiB/s wr, 339 op/s 2024-09-11T22:07:13.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:13 smithi152 ceph-mon[31188]: pgmap v91: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 5.8 MiB/s wr, 339 op/s 2024-09-11T22:07:14.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:07:15.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:07:15.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:15 smithi179 ceph-mon[35603]: pgmap v92: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.2 MiB/s wr, 69 op/s 2024-09-11T22:07:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:15 smithi193 ceph-mon[35545]: pgmap v92: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.2 MiB/s wr, 69 op/s 2024-09-11T22:07:15.950 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:07:15.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:15 smithi152 ceph-mon[31188]: pgmap v92: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.2 MiB/s wr, 69 op/s 2024-09-11T22:07:16.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.436+0000 7f9466000640 1 -- 172.21.15.152:0/3794740913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9460101420 msgr2=0x7f946010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:16.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.436+0000 7f9466000640 1 --2- 172.21.15.152:0/3794740913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9460101420 0x7f946010d950 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9458009cd0 tx=0x7f945802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.436+0000 7f9466000640 1 -- 172.21.15.152:0/3794740913 shutdown_connections 2024-09-11T22:07:16.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.436+0000 7f9466000640 1 --2- 172.21.15.152:0/3794740913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9460101420 0x7f946010d950 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.436+0000 7f9466000640 1 --2- 172.21.15.152:0/3794740913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9460100a80 0x7f9460100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.436+0000 7f9466000640 1 --2- 172.21.15.152:0/3794740913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9460106a80 0x7f9460106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.436+0000 7f9466000640 1 -- 172.21.15.152:0/3794740913 >> 172.21.15.152:0/3794740913 conn(0x7f94600fc7a0 msgr2=0x7f94600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:16.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.436+0000 7f9466000640 1 -- 172.21.15.152:0/3794740913 shutdown_connections 2024-09-11T22:07:16.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.436+0000 7f9466000640 1 -- 172.21.15.152:0/3794740913 wait complete. 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.437+0000 7f9466000640 1 Processor -- start 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.437+0000 7f9466000640 1 -- start start 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.437+0000 7f9466000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9460100a80 0x7f9460199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.437+0000 7f9466000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9460101420 0x7f94601997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.437+0000 7f9466000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9460106a80 0x7f94601a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.437+0000 7f9466000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9460110e80 con 0x7f9460106a80 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.437+0000 7f9466000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9460110d00 con 0x7f9460100a80 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.437+0000 7f9466000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9460111000 con 0x7f9460101420 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9460106a80 0x7f94601a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9460106a80 0x7f94601a4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56424/0 (socket says 172.21.15.152:56424) 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945ffff640 1 -- 172.21.15.152:0/677834044 learned_addr learned my addr 172.21.15.152:0/677834044 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:16.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945f7fe640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9460100a80 0x7f9460199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f9457fff640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9460101420 0x7f94601997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945ffff640 1 -- 172.21.15.152:0/677834044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9460101420 msgr2=0x7f94601997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945ffff640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9460101420 0x7f94601997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945ffff640 1 -- 172.21.15.152:0/677834044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9460100a80 msgr2=0x7f9460199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945ffff640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9460100a80 0x7f9460199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945ffff640 1 -- 172.21.15.152:0/677834044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94601a4850 con 0x7f9460106a80 2024-09-11T22:07:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945ffff640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9460106a80 0x7f94601a4310 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9458005cc0 tx=0x7f94580093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945d7fa640 1 -- 172.21.15.152:0/677834044 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458003e00 con 0x7f9460106a80 2024-09-11T22:07:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945d7fa640 1 -- 172.21.15.152:0/677834044 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9458004520 con 0x7f9460106a80 2024-09-11T22:07:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f945d7fa640 1 -- 172.21.15.152:0/677834044 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458030db0 con 0x7f9460106a80 2024-09-11T22:07:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f9466000640 1 -- 172.21.15.152:0/677834044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94601a4a20 con 0x7f9460106a80 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.438+0000 7f9466000640 1 -- 172.21.15.152:0/677834044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94601a4f00 con 0x7f9460106a80 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.440+0000 7f945d7fa640 1 -- 172.21.15.152:0/677834044 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f94580046d0 con 0x7f9460106a80 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f94683d9740 1 Processor -- start 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f94683d9740 1 -- start start 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f945d7fa640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f944c0a2d70 0x7f944c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f94683d9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc83740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f94683d9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 0x55ae5fc92550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f94683d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc92a90 0x55ae5fc94e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f94683d9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ae5fbe92e0 con 0x55ae5fc83360 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f94683d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ae5fb90ce0 con 0x55ae5fc92a90 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f94683d9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ae5fbe52a0 con 0x55ae5fc83c80 2024-09-11T22:07:16.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f9457fff640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f944c0a2d70 0x7f944c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f945f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc83740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f945d7fa640 1 -- 172.21.15.152:0/677834044 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f945802e030 con 0x7f9460106a80 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f945f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc83740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56432/0 (socket says 172.21.15.152:56432) 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.441+0000 7f945f7fe640 1 -- 172.21.15.152:0/2714336541 learned_addr learned my addr 172.21.15.152:0/2714336541 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f9457fff640 1 --2- 172.21.15.152:0/2714336541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 0x55ae5fc92550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f945ffff640 1 --2- 172.21.15.152:0/2714336541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc92a90 0x55ae5fc94e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f945f7fe640 1 -- 172.21.15.152:0/2714336541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 msgr2=0x55ae5fc92550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f945f7fe640 1 --2- 172.21.15.152:0/2714336541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 0x55ae5fc92550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f945f7fe640 1 -- 172.21.15.152:0/2714336541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc92a90 msgr2=0x55ae5fc94e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f945f7fe640 1 --2- 172.21.15.152:0/2714336541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc92a90 0x55ae5fc94e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f945f7fe640 1 -- 172.21.15.152:0/2714336541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae5fb75440 con 0x55ae5fc83360 2024-09-11T22:07:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f945ffff640 1 --2- 172.21.15.152:0/2714336541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc92a90 0x55ae5fc94e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f9457fff640 1 --2- 172.21.15.152:0/2714336541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 0x55ae5fc92550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f945f7fe640 1 --2- 172.21.15.152:0/2714336541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc83740 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9450009ca0 tx=0x7f9450011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d596c87de631da00 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f9457fff640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f944c0a2d70 0x7f944c0a5230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f946006b2e0 tx=0x7f94480097c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f9455ffb640 1 -- 172.21.15.152:0/2714336541 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945001e070 con 0x55ae5fc83360 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f9455ffb640 1 -- 172.21.15.152:0/2714336541 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9450019b10 con 0x55ae5fc83360 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.442+0000 7f9455ffb640 1 -- 172.21.15.152:0/2714336541 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945000eae0 con 0x55ae5fc83360 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.443+0000 7f94683d9740 1 -- 172.21.15.152:0/2714336541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 msgr2=0x55ae5fc83740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.443+0000 7f94683d9740 1 --2- 172.21.15.152:0/2714336541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc83740 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9450009ca0 tx=0x7f9450011810 comp rx=0 tx=0).stop 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.443+0000 7f94683d9740 1 -- 172.21.15.152:0/2714336541 shutdown_connections 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.443+0000 7f94683d9740 1 --2- 172.21.15.152:0/2714336541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc92a90 0x55ae5fc94e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.443+0000 7f94683d9740 1 --2- 172.21.15.152:0/2714336541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 0x55ae5fc92550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.443+0000 7f94683d9740 1 --2- 172.21.15.152:0/2714336541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc83740 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.443+0000 7f94683d9740 1 -- 172.21.15.152:0/2714336541 >> 172.21.15.152:0/2714336541 conn(0x55ae5fc7fa30 msgr2=0x55ae5fc7fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.443+0000 7f94683d9740 1 -- 172.21.15.152:0/2714336541 shutdown_connections 2024-09-11T22:07:16.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.443+0000 7f94683d9740 1 -- 172.21.15.152:0/2714336541 wait complete. 2024-09-11T22:07:16.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.443+0000 7f94683d9740 1 -- start start 2024-09-11T22:07:16.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.443+0000 7f94683d9740 1 Processor -- start 2024-09-11T22:07:16.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f94683d9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc923d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f94683d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 0x55ae5fc8f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f94683d9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc92a90 0x55ae5fc8fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f94683d9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ae5fc95660 con 0x55ae5fc83360 2024-09-11T22:07:16.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f94683d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ae5fba4050 con 0x55ae5fc83c80 2024-09-11T22:07:16.563 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:07:16.564 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:07:16.564 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:07:16.564 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:07:16.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f94683d9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ae5fc957e0 con 0x55ae5fc92a90 2024-09-11T22:07:16.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f94683d9740 10 client.0 _ll_register_callbacks cb 0x55ae5fbe4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:16.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f945f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc923d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f945f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc923d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56438/0 (socket says 172.21.15.152:56438) 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f945f7fe640 1 -- 172.21.15.152:0/2211011598 learned_addr learned my addr 172.21.15.152:0/2211011598 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f9457fff640 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 0x55ae5fc8f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f945ffff640 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc92a90 0x55ae5fc8fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f945f7fe640 1 -- 172.21.15.152:0/2211011598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc92a90 msgr2=0x55ae5fc8fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f945f7fe640 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc92a90 0x55ae5fc8fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f945f7fe640 1 -- 172.21.15.152:0/2211011598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 msgr2=0x55ae5fc8f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f945f7fe640 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 0x55ae5fc8f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f945f7fe640 1 -- 172.21.15.152:0/2211011598 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae5f95a3c0 con 0x55ae5fc83360 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f9457fff640 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 0x55ae5fc8f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f945f7fe640 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc923d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9450009c70 tx=0x7f9450019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba62a053588fdf03 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f943effd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:16.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f943effd640 1 -- 172.21.15.152:0/2211011598 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945001e070 con 0x55ae5fc83360 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f943effd640 1 -- 172.21.15.152:0/2211011598 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f9450004020 con 0x55ae5fc83360 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f94683d9740 1 -- 172.21.15.152:0/2211011598 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9450019b10 con 0x55ae5fc83360 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f943effd640 1 -- 172.21.15.152:0/2211011598 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9450030050 con 0x55ae5fc83360 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.444+0000 7f94683d9740 10 client.16050 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.445+0000 7f94683d9740 1 -- 172.21.15.152:0/2211011598 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae5fca0fc0 con 0x55ae5fc83360 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.445+0000 7f943effd640 1 -- 172.21.15.152:0/2211011598 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9450019b10 con 0x55ae5fc83360 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.445+0000 7f943effd640 1 -- 172.21.15.152:0/2211011598 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f945000e7e0 con 0x55ae5fc83360 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.445+0000 7f94683d9740 10 client.16050 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.445+0000 7f94683d9740 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.445+0000 7f94683d9740 20 client.16050 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.445+0000 7f94683d9740 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae5fca2420 0x55ae5fca4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.445+0000 7f94683d9740 4 client.16050 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.445+0000 7f94683d9740 1 -- 172.21.15.152:0/2211011598 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae5fbf6850 con 0x55ae5fca2420 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.445+0000 7f9457fff640 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae5fca2420 0x55ae5fca4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f943effd640 10 client.16050 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f9457fff640 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae5fca2420 0x55ae5fca4810 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d39019b7e4e5f42 server_cookie=d85e55be5128b2ff in_seq=0 out_seq=0 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f943effd640 1 -- 172.21.15.152:0/2211011598 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae5fbf6850 con 0x55ae5fca2420 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f943effd640 10 client.16050 handle_command_reply: tid=0 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f94683d9740 1 client.16050 shutdown 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f94683d9740 1 -- 172.21.15.152:0/2211011598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 msgr2=0x55ae5fc923d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f94683d9740 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc923d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9450009c70 tx=0x7f9450019660 comp rx=0 tx=0).stop 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f94683d9740 1 -- 172.21.15.152:0/2211011598 shutdown_connections 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f94683d9740 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae5fca2420 0x55ae5fca4810 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f94683d9740 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc92a90 0x55ae5fc8fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f94683d9740 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 0x55ae5fc8f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f94683d9740 1 --2- 172.21.15.152:0/2211011598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc83360 0x55ae5fc923d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f94683d9740 1 -- 172.21.15.152:0/2211011598 >> 172.21.15.152:0/2211011598 conn(0x55ae5fc7fa30 msgr2=0x55ae5fc85790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.446+0000 7f943effd640 0 client.16050 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.447+0000 7f94683d9740 1 -- 172.21.15.152:0/2211011598 shutdown_connections 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.447+0000 7f94683d9740 1 -- 172.21.15.152:0/2211011598 wait complete. 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.447+0000 7f94683d9740 20 client.16050 trim_cache size 0 max 16384 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f94683d9740 1 Processor -- start 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f94683d9740 1 -- start start 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f94683d9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83360 0x55ae5fc9e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f94683d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 0x55ae5fc89e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f94683d9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc8e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f94683d9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f94601adee0 con 0x55ae5fc92a90 2024-09-11T22:07:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f94683d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f94601ab780 con 0x55ae5fc83c80 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f94683d9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94601a95d0 con 0x55ae5fc83360 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f945ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc8e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f945ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc8e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56454/0 (socket says 172.21.15.152:56454) 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f945ffff640 1 -- 172.21.15.152:0/800012056 learned_addr learned my addr 172.21.15.152:0/800012056 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f945f7fe640 1 --2- 172.21.15.152:0/800012056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83360 0x55ae5fc9e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f9457fff640 1 --2- 172.21.15.152:0/800012056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 0x55ae5fc89e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f945ffff640 1 -- 172.21.15.152:0/800012056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83360 msgr2=0x55ae5fc9e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f945ffff640 1 --2- 172.21.15.152:0/800012056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83360 0x55ae5fc9e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f945ffff640 1 -- 172.21.15.152:0/800012056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 msgr2=0x55ae5fc89e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f945ffff640 1 --2- 172.21.15.152:0/800012056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 0x55ae5fc89e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f945ffff640 1 -- 172.21.15.152:0/800012056 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae5fc84910 con 0x55ae5fc92a90 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f9457fff640 1 --2- 172.21.15.152:0/800012056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 0x55ae5fc89e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f945f7fe640 1 --2- 172.21.15.152:0/800012056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83360 0x55ae5fc9e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.464+0000 7f945ffff640 1 --2- 172.21.15.152:0/800012056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc8e530 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9458032f10 tx=0x7f94580dd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6df023dfa9f28b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94557fa640 1 -- 172.21.15.152:0/800012056 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94580d5070 con 0x55ae5fc92a90 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94557fa640 1 -- 172.21.15.152:0/800012056 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9458036040 con 0x55ae5fc92a90 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94557fa640 1 -- 172.21.15.152:0/800012056 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94580b9650 con 0x55ae5fc92a90 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94683d9740 1 -- 172.21.15.152:0/800012056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 msgr2=0x55ae5fc8e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94683d9740 1 --2- 172.21.15.152:0/800012056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc8e530 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9458032f10 tx=0x7f94580dd040 comp rx=0 tx=0).stop 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94683d9740 1 -- 172.21.15.152:0/800012056 shutdown_connections 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94683d9740 1 --2- 172.21.15.152:0/800012056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc8e530 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94683d9740 1 --2- 172.21.15.152:0/800012056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83c80 0x55ae5fc89e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94683d9740 1 --2- 172.21.15.152:0/800012056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83360 0x55ae5fc9e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94683d9740 1 -- 172.21.15.152:0/800012056 >> 172.21.15.152:0/800012056 conn(0x55ae5fc7fa30 msgr2=0x55ae5fc8de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94683d9740 1 -- 172.21.15.152:0/800012056 shutdown_connections 2024-09-11T22:07:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.465+0000 7f94683d9740 1 -- 172.21.15.152:0/800012056 wait complete. 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f94683d9740 1 -- start start 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f94683d9740 1 Processor -- start 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f94683d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83360 0x55ae5fc865e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f94683d9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 0x55ae5fc86b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f94683d9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc87060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f94683d9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f94601a9c40 con 0x55ae5fc92a90 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f94683d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f94601ab0b0 con 0x55ae5fc83360 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f94683d9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94601aa310 con 0x55ae5fc83c80 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f94683d9740 10 client.0 _ll_register_callbacks cb 0x7f945001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f945ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc87060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f945ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc87060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56466/0 (socket says 172.21.15.152:56466) 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f945ffff640 1 -- 172.21.15.152:0/47529018 learned_addr learned my addr 172.21.15.152:0/47529018 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f945f7fe640 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83360 0x55ae5fc865e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f9457fff640 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 0x55ae5fc86b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f945ffff640 1 -- 172.21.15.152:0/47529018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 msgr2=0x55ae5fc86b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f945ffff640 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 0x55ae5fc86b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.466+0000 7f945ffff640 1 -- 172.21.15.152:0/47529018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83360 msgr2=0x55ae5fc865e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f945ffff640 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83360 0x55ae5fc865e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f945ffff640 1 -- 172.21.15.152:0/47529018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae5fc99cb0 con 0x55ae5fc92a90 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f945f7fe640 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83360 0x55ae5fc865e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f9457fff640 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 0x55ae5fc86b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f945ffff640 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc87060 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f94580bcce0 tx=0x7f945802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bc8b0eefaba4e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f943effd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f943effd640 1 -- 172.21.15.152:0/47529018 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945809f020 con 0x55ae5fc92a90 2024-09-11T22:07:16.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f943effd640 1 -- 172.21.15.152:0/47529018 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f94580b9650 con 0x55ae5fc92a90 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f94683d9740 1 -- 172.21.15.152:0/47529018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9458036040 con 0x55ae5fc92a90 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f943effd640 1 -- 172.21.15.152:0/47529018 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94580d5070 con 0x55ae5fc92a90 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f94683d9740 10 client.16056 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f94683d9740 1 -- 172.21.15.152:0/47529018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae5fc9afc0 con 0x55ae5fc92a90 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f943effd640 1 -- 172.21.15.152:0/47529018 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9458036040 con 0x55ae5fc92a90 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f943effd640 1 -- 172.21.15.152:0/47529018 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f945804e070 con 0x55ae5fc92a90 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f94683d9740 10 client.16056 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f94683d9740 10 client.16056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f94683d9740 20 client.16056 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f94683d9740 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae5fd117c0 0x55ae5fd13bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f94683d9740 4 client.16056 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.467+0000 7f94683d9740 1 -- 172.21.15.152:0/47529018 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ae5fbf0d60 con 0x55ae5fd117c0 2024-09-11T22:07:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f945f7fe640 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae5fd117c0 0x55ae5fd13bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f943effd640 10 client.16056 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f945f7fe640 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae5fd117c0 0x55ae5fd13bb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcb6a118813deff0 server_cookie=4bd3c8154a9be972 in_seq=0 out_seq=0 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f943effd640 1 -- 172.21.15.152:0/47529018 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ae5fbf0d60 con 0x55ae5fd117c0 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f943effd640 10 client.16056 handle_command_reply: tid=0 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f94683d9740 1 client.16056 shutdown 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f94683d9740 1 -- 172.21.15.152:0/47529018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 msgr2=0x55ae5fc87060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f94683d9740 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc87060 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f94580bcce0 tx=0x7f945802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f94683d9740 1 -- 172.21.15.152:0/47529018 shutdown_connections 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f94683d9740 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae5fd117c0 0x55ae5fd13bb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f94683d9740 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae5fc92a90 0x55ae5fc87060 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f94683d9740 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae5fc83c80 0x55ae5fc86b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f943effd640 0 client.16056 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f94683d9740 1 --2- 172.21.15.152:0/47529018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5fc83360 0x55ae5fc865e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.468+0000 7f94683d9740 1 -- 172.21.15.152:0/47529018 >> 172.21.15.152:0/47529018 conn(0x55ae5fc7fa30 msgr2=0x55ae5fc7eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f94683d9740 1 -- 172.21.15.152:0/47529018 shutdown_connections 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f94683d9740 1 -- 172.21.15.152:0/47529018 wait complete. 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f94683d9740 20 client.16056 trim_cache size 0 max 16384 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 -- 172.21.15.152:0/677834044 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f944c0a2d70 msgr2=0x7f944c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f944c0a2d70 0x7f944c0a5230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f946006b2e0 tx=0x7f94480097c0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 -- 172.21.15.152:0/677834044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9460106a80 msgr2=0x7f94601a4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9460106a80 0x7f94601a4310 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9458005cc0 tx=0x7f94580093d0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 -- 172.21.15.152:0/677834044 shutdown_connections 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f944c0a2d70 0x7f944c0a5230 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9460106a80 0x7f94601a4310 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9460101420 0x7f94601997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 --2- 172.21.15.152:0/677834044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9460100a80 0x7f9460199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 -- 172.21.15.152:0/677834044 >> 172.21.15.152:0/677834044 conn(0x7f94600fc7a0 msgr2=0x7f94600fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 -- 172.21.15.152:0/677834044 shutdown_connections 2024-09-11T22:07:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:16.469+0000 7f9466000640 1 -- 172.21.15.152:0/677834044 wait complete. 2024-09-11T22:07:17.339 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:07:17.339 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:07:17.600 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:07:17.721 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:17 smithi152 ceph-mon[31188]: pgmap v93: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.2 MiB/s wr, 69 op/s 2024-09-11T22:07:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:17 smithi179 ceph-mon[35603]: pgmap v93: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.2 MiB/s wr, 69 op/s 2024-09-11T22:07:17.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:17 smithi193 ceph-mon[35545]: pgmap v93: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.2 MiB/s wr, 69 op/s 2024-09-11T22:07:18.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.028+0000 7fb09b36d640 1 -- 172.21.15.152:0/4198373091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094102790 msgr2=0x7fb0941067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:18.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.028+0000 7fb09b36d640 1 --2- 172.21.15.152:0/4198373091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094102790 0x7fb0941067e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb090009900 tx=0x7fb09002a410 comp rx=0 tx=0).stop 2024-09-11T22:07:18.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.028+0000 7fb09b36d640 1 -- 172.21.15.152:0/4198373091 shutdown_connections 2024-09-11T22:07:18.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.028+0000 7fb09b36d640 1 --2- 172.21.15.152:0/4198373091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb094106f10 0x7fb09410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:18.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.028+0000 7fb09b36d640 1 --2- 172.21.15.152:0/4198373091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094102790 0x7fb0941067e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:18.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.028+0000 7fb09b36d640 1 --2- 172.21.15.152:0/4198373091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb094101de0 0x7fb0941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:18.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.028+0000 7fb09b36d640 1 -- 172.21.15.152:0/4198373091 >> 172.21.15.152:0/4198373091 conn(0x7fb0940fd8c0 msgr2=0x7fb0940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:18.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.028+0000 7fb09b36d640 1 -- 172.21.15.152:0/4198373091 shutdown_connections 2024-09-11T22:07:18.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.028+0000 7fb09b36d640 1 -- 172.21.15.152:0/4198373091 wait complete. 2024-09-11T22:07:18.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.028+0000 7fb09b36d640 1 Processor -- start 2024-09-11T22:07:18.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb09b36d640 1 -- start start 2024-09-11T22:07:18.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb09b36d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094101de0 0x7fb0940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:18.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb09b36d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb094102790 0x7fb094074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:18.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb09b36d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb094106f10 0x7fb094074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:18.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb09b36d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb094111f70 con 0x7fb094101de0 2024-09-11T22:07:18.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb09b36d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb094111df0 con 0x7fb094106f10 2024-09-11T22:07:18.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb09b36d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0941120f0 con 0x7fb094102790 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb099109640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094101de0 0x7fb0940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb099109640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094101de0 0x7fb0940744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56476/0 (socket says 172.21.15.152:56476) 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb099109640 1 -- 172.21.15.152:0/1687777683 learned_addr learned my addr 172.21.15.152:0/1687777683 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb098908640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb094102790 0x7fb094074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb09990a640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb094106f10 0x7fb094074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb099109640 1 -- 172.21.15.152:0/1687777683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb094102790 msgr2=0x7fb094074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb099109640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb094102790 0x7fb094074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb099109640 1 -- 172.21.15.152:0/1687777683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb094106f10 msgr2=0x7fb094074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb099109640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb094106f10 0x7fb094074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb099109640 1 -- 172.21.15.152:0/1687777683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0941a69d0 con 0x7fb094101de0 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb098908640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb094102790 0x7fb094074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:18.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb09990a640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb094106f10 0x7fb094074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb099109640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094101de0 0x7fb0940744f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb08400e9f0 tx=0x7fb08400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.029+0000 7fb08a7fc640 1 -- 172.21.15.152:0/1687777683 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08400cd80 con 0x7fb094101de0 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.030+0000 7fb08a7fc640 1 -- 172.21.15.152:0/1687777683 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb084005500 con 0x7fb094101de0 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.030+0000 7fb09b36d640 1 -- 172.21.15.152:0/1687777683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0941a6cc0 con 0x7fb094101de0 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.030+0000 7fb08a7fc640 1 -- 172.21.15.152:0/1687777683 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb084010690 con 0x7fb094101de0 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.030+0000 7fb09b36d640 1 -- 172.21.15.152:0/1687777683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0941a71b0 con 0x7fb094101de0 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.030+0000 7fb09b36d640 1 -- 172.21.15.152:0/1687777683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0941021c0 con 0x7fb094101de0 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.032+0000 7fb08a7fc640 1 -- 172.21.15.152:0/1687777683 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb0840046c0 con 0x7fb094101de0 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.033+0000 7fb08a7fc640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0800a2d70 0x7fb0800a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.033+0000 7fb098908640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0800a2d70 0x7fb0800a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.033+0000 7fb08a7fc640 1 -- 172.21.15.152:0/1687777683 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb0840cfc40 con 0x7fb094101de0 2024-09-11T22:07:18.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.033+0000 7fb098908640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0800a2d70 0x7fb0800a5230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb094075f80 tx=0x7fb090005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:18.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.036+0000 7fb08a7fc640 1 -- 172.21.15.152:0/1687777683 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb0840541b0 con 0x7fb094101de0 2024-09-11T22:07:18.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.236+0000 7fb09b36d640 1 -- 172.21.15.152:0/1687777683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb09410a180 con 0x7fb094101de0 2024-09-11T22:07:18.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.237+0000 7fb08a7fc640 1 -- 172.21.15.152:0/1687777683 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11925 (secure 0 0 0) 0x7fb08409c7d0 con 0x7fb094101de0 2024-09-11T22:07:18.238 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:07:18.238 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"btime":"2024-09-11T22:06:38:855821+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:06:38.805635+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:07:18.239 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 28 2024-09-11T22:07:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 -- 172.21.15.152:0/1687777683 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0800a2d70 msgr2=0x7fb0800a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0800a2d70 0x7fb0800a5230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb094075f80 tx=0x7fb090005a20 comp rx=0 tx=0).stop 2024-09-11T22:07:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 -- 172.21.15.152:0/1687777683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094101de0 msgr2=0x7fb0940744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094101de0 0x7fb0940744f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb08400e9f0 tx=0x7fb08400edf0 comp rx=0 tx=0).stop 2024-09-11T22:07:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 -- 172.21.15.152:0/1687777683 shutdown_connections 2024-09-11T22:07:18.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb0800a2d70 0x7fb0800a5230 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:18.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb094106f10 0x7fb094074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:18.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb094102790 0x7fb094074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:18.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 --2- 172.21.15.152:0/1687777683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb094101de0 0x7fb0940744f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:18.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 -- 172.21.15.152:0/1687777683 >> 172.21.15.152:0/1687777683 conn(0x7fb0940fd8c0 msgr2=0x7fb0940fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:18.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 -- 172.21.15.152:0/1687777683 shutdown_connections 2024-09-11T22:07:18.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:18.239+0000 7fb09b36d640 1 -- 172.21.15.152:0/1687777683 wait complete. 2024-09-11T22:07:18.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:18 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1687777683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:07:18.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:18 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1687777683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:07:18.861 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:18 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1687777683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:07:18.889 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:07:19.138 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:07:19.557 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:19 smithi152 ceph-mon[31188]: pgmap v94: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 35 MiB/s wr, 668 op/s 2024-09-11T22:07:19.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.556+0000 7fef1cfca640 1 -- 172.21.15.152:0/2988924870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef181036e0 msgr2=0x7fef18107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:19.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.556+0000 7fef1cfca640 1 --2- 172.21.15.152:0/2988924870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef181036e0 0x7fef18107b90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fef00009930 tx=0x7fef0002a420 comp rx=0 tx=0).stop 2024-09-11T22:07:19.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.556+0000 7fef1cfca640 1 -- 172.21.15.152:0/2988924870 shutdown_connections 2024-09-11T22:07:19.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.556+0000 7fef1cfca640 1 --2- 172.21.15.152:0/2988924870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181082a0 0x7fef1810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.556+0000 7fef1cfca640 1 --2- 172.21.15.152:0/2988924870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef181036e0 0x7fef18107b90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.556+0000 7fef1cfca640 1 --2- 172.21.15.152:0/2988924870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef18102d30 0x7fef18103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.556+0000 7fef1cfca640 1 -- 172.21.15.152:0/2988924870 >> 172.21.15.152:0/2988924870 conn(0x7fef180fc7d0 msgr2=0x7fef180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:19.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.556+0000 7fef1cfca640 1 -- 172.21.15.152:0/2988924870 shutdown_connections 2024-09-11T22:07:19.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.556+0000 7fef1cfca640 1 -- 172.21.15.152:0/2988924870 wait complete. 2024-09-11T22:07:19.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef1cfca640 1 Processor -- start 2024-09-11T22:07:19.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef1cfca640 1 -- start start 2024-09-11T22:07:19.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef1cfca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef18102d30 0x7fef18198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef1cfca640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef181036e0 0x7fef18198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef1cfca640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181082a0 0x7fef1819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef1cfca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fef181120c0 con 0x7fef18102d30 2024-09-11T22:07:19.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef1cfca640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fef18111f40 con 0x7fef181036e0 2024-09-11T22:07:19.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef1cfca640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fef18112240 con 0x7fef181082a0 2024-09-11T22:07:19.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef1659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef18102d30 0x7fef18198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef1659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef18102d30 0x7fef18198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56484/0 (socket says 172.21.15.152:56484) 2024-09-11T22:07:19.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef1659c640 1 -- 172.21.15.152:0/2986455075 learned_addr learned my addr 172.21.15.152:0/2986455075 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:19.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef15d9b640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef181036e0 0x7fef18198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.557+0000 7fef16d9d640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181082a0 0x7fef1819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef1659c640 1 -- 172.21.15.152:0/2986455075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181082a0 msgr2=0x7fef1819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:19.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef1659c640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181082a0 0x7fef1819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef1659c640 1 -- 172.21.15.152:0/2986455075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef181036e0 msgr2=0x7fef18198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:19.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef1659c640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef181036e0 0x7fef18198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef1659c640 1 -- 172.21.15.152:0/2986455075 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1819d5d0 con 0x7fef18102d30 2024-09-11T22:07:19.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef15d9b640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef181036e0 0x7fef18198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:07:19.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef16d9d640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181082a0 0x7fef1819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:07:19.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef1659c640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef18102d30 0x7fef18198620 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fef1000eab0 tx=0x7fef1000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:19.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef0f7fe640 1 -- 172.21.15.152:0/2986455075 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1000ce40 con 0x7fef18102d30 2024-09-11T22:07:19.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef1cfca640 1 -- 172.21.15.152:0/2986455075 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1819d8c0 con 0x7fef18102d30 2024-09-11T22:07:19.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef0f7fe640 1 -- 172.21.15.152:0/2986455075 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef10011950 con 0x7fef18102d30 2024-09-11T22:07:19.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef0f7fe640 1 -- 172.21.15.152:0/2986455075 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10010ae0 con 0x7fef18102d30 2024-09-11T22:07:19.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.558+0000 7fef1cfca640 1 -- 172.21.15.152:0/2986455075 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef181a51a0 con 0x7fef18102d30 2024-09-11T22:07:19.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.560+0000 7fef0f7fe640 1 -- 172.21.15.152:0/2986455075 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fef10011b00 con 0x7fef18102d30 2024-09-11T22:07:19.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.560+0000 7fef1f3a3740 1 Processor -- start 2024-09-11T22:07:19.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef1f3a3740 1 -- start start 2024-09-11T22:07:19.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f896b40 0x556a1f895090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f895a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556a1f7fb2f0 con 0x556a1f8a0370 2024-09-11T22:07:19.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556a1f7a2cf0 con 0x556a1f8955d0 2024-09-11T22:07:19.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556a1f7f72b0 con 0x556a1f896b40 2024-09-11T22:07:19.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef15d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef1659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f895a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef15d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56486/0 (socket says 172.21.15.152:56486) 2024-09-11T22:07:19.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef15d9b640 1 -- 172.21.15.152:0/2938880147 learned_addr learned my addr 172.21.15.152:0/2938880147 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:19.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef16d9d640 1 --2- 172.21.15.152:0/2938880147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f896b40 0x556a1f895090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.561+0000 7fef0f7fe640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fef040a2cf0 0x7fef040a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.562+0000 7fef15d9b640 1 -- 172.21.15.152:0/2938880147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f896b40 msgr2=0x556a1f895090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:19.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.562+0000 7fef15d9b640 1 --2- 172.21.15.152:0/2938880147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f896b40 0x556a1f895090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.562+0000 7fef15d9b640 1 -- 172.21.15.152:0/2938880147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 msgr2=0x556a1f895a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:19.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.562+0000 7fef15d9b640 1 --2- 172.21.15.152:0/2938880147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f895a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.562+0000 7fef16d9d640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fef040a2cf0 0x7fef040a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.562+0000 7fef15d9b640 1 -- 172.21.15.152:0/2938880147 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1f7873a0 con 0x556a1f8a0370 2024-09-11T22:07:19.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.562+0000 7fef0f7fe640 1 -- 172.21.15.152:0/2986455075 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fef100cfcd0 con 0x7fef18102d30 2024-09-11T22:07:19.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.562+0000 7fef15d9b640 1 --2- 172.21.15.152:0/2938880147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a2760 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fef00006010 tx=0x7fef00009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2c52d65f367140 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:19.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.562+0000 7fef0cff9640 1 -- 172.21.15.152:0/2938880147 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0003f070 con 0x556a1f8a0370 2024-09-11T22:07:19.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.562+0000 7fef0cff9640 1 -- 172.21.15.152:0/2938880147 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef000317b0 con 0x556a1f8a0370 2024-09-11T22:07:19.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.562+0000 7fef0cff9640 1 -- 172.21.15.152:0/2938880147 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef00035070 con 0x556a1f8a0370 2024-09-11T22:07:19.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef1f3a3740 1 -- 172.21.15.152:0/2938880147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 msgr2=0x556a1f8a2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:19.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/2938880147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a2760 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fef00006010 tx=0x7fef00009680 comp rx=0 tx=0).stop 2024-09-11T22:07:19.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef16d9d640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fef040a2cf0 0x7fef040a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef08015600 tx=0x7fef080046c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:19.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef1f3a3740 1 -- 172.21.15.152:0/2938880147 shutdown_connections 2024-09-11T22:07:19.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/2938880147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a2760 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/2938880147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f895a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/2938880147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f896b40 0x556a1f895090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef1f3a3740 1 -- 172.21.15.152:0/2938880147 >> 172.21.15.152:0/2938880147 conn(0x556a1f85e310 msgr2=0x556a1f891c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef1f3a3740 1 -- 172.21.15.152:0/2938880147 shutdown_connections 2024-09-11T22:07:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef1f3a3740 1 -- 172.21.15.152:0/2938880147 wait complete. 2024-09-11T22:07:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef1f3a3740 1 -- start start 2024-09-11T22:07:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.563+0000 7fef1f3a3740 1 Processor -- start 2024-09-11T22:07:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f8955d0 0x556a1f89fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f89cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8a0370 0x556a1f89d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556a1f8a3010 con 0x556a1f896b40 2024-09-11T22:07:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556a1f7b6060 con 0x556a1f8a0370 2024-09-11T22:07:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556a1f8a3190 con 0x556a1f8955d0 2024-09-11T22:07:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef1f3a3740 10 client.0 _ll_register_callbacks cb 0x556a1f5098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef15d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f89cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef15d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f89cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56498/0 (socket says 172.21.15.152:56498) 2024-09-11T22:07:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef15d9b640 1 -- 172.21.15.152:0/586883915 learned_addr learned my addr 172.21.15.152:0/586883915 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef1659c640 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f8955d0 0x556a1f89fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef16d9d640 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8a0370 0x556a1f89d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef15d9b640 1 -- 172.21.15.152:0/586883915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f8955d0 msgr2=0x556a1f89fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef15d9b640 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f8955d0 0x556a1f89fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef15d9b640 1 -- 172.21.15.152:0/586883915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8a0370 msgr2=0x556a1f89d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef15d9b640 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8a0370 0x556a1f89d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef15d9b640 1 -- 172.21.15.152:0/586883915 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a1f56c3c0 con 0x556a1f896b40 2024-09-11T22:07:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef15d9b640 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f89cf90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fef000092a0 tx=0x7fef0002ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dedeab84de26188b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7feefdffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7feefdffb640 1 -- 172.21.15.152:0/586883915 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0003f030 con 0x556a1f896b40 2024-09-11T22:07:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7feefdffb640 1 -- 172.21.15.152:0/586883915 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fef00004250 con 0x556a1f896b40 2024-09-11T22:07:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.564+0000 7fef1f3a3740 1 -- 172.21.15.152:0/586883915 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef000317b0 con 0x556a1f896b40 2024-09-11T22:07:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7feefdffb640 1 -- 172.21.15.152:0/586883915 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fef00054050 con 0x556a1f896b40 2024-09-11T22:07:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7fef1f3a3740 10 client.16074 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7fef1f3a3740 1 -- 172.21.15.152:0/586883915 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556a1f8aea20 con 0x556a1f896b40 2024-09-11T22:07:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7feefdffb640 1 -- 172.21.15.152:0/586883915 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef000317b0 con 0x556a1f896b40 2024-09-11T22:07:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7feefdffb640 1 -- 172.21.15.152:0/586883915 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fef000047e0 con 0x556a1f896b40 2024-09-11T22:07:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7fef1f3a3740 10 client.16074 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7fef1f3a3740 10 client.16074 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:07:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7fef1f3a3740 20 client.16074 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x556a1f8afd70 0x556a1f8b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7fef1f3a3740 4 client.16074 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7fef1f3a3740 1 -- 172.21.15.152:0/586883915 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a1f808860 con 0x556a1f8afd70 2024-09-11T22:07:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.565+0000 7fef1659c640 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x556a1f8afd70 0x556a1f8b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.566+0000 7fef1659c640 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x556a1f8afd70 0x556a1f8b2160 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b920bf4c455e3cb3 server_cookie=bc8639492e1ffa51 in_seq=0 out_seq=0 2024-09-11T22:07:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.566+0000 7feefdffb640 10 client.16074 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:07:19.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.566+0000 7feefdffb640 1 -- 172.21.15.152:0/586883915 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a1f808860 con 0x556a1f8afd70 2024-09-11T22:07:19.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.566+0000 7feefdffb640 10 client.16074 handle_command_reply: tid=0 2024-09-11T22:07:19.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 1 client.16074 shutdown 2024-09-11T22:07:19.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 1 -- 172.21.15.152:0/586883915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 msgr2=0x556a1f89cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:19.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f89cf90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fef000092a0 tx=0x7fef0002ab50 comp rx=0 tx=0).stop 2024-09-11T22:07:19.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 1 -- 172.21.15.152:0/586883915 shutdown_connections 2024-09-11T22:07:19.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x556a1f8afd70 0x556a1f8b2160 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8a0370 0x556a1f89d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7feefdffb640 0 client.16074 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:07:19.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f89cf90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/586883915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f8955d0 0x556a1f89fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 1 -- 172.21.15.152:0/586883915 >> 172.21.15.152:0/586883915 conn(0x556a1f85e310 msgr2=0x556a1f897960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:19.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 1 -- 172.21.15.152:0/586883915 shutdown_connections 2024-09-11T22:07:19.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 1 -- 172.21.15.152:0/586883915 wait complete. 2024-09-11T22:07:19.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.567+0000 7fef1f3a3740 20 client.16074 trim_cache size 0 max 16384 2024-09-11T22:07:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef1f3a3740 1 Processor -- start 2024-09-11T22:07:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef1f3a3740 1 -- start start 2024-09-11T22:07:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f89ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f896b40 0x556a1f8a8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fef181b0210 con 0x556a1f8a0370 2024-09-11T22:07:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fef181adab0 con 0x556a1f8955d0 2024-09-11T22:07:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fef181ab900 con 0x556a1f896b40 2024-09-11T22:07:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef16d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef16d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56508/0 (socket says 172.21.15.152:56508) 2024-09-11T22:07:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef16d9d640 1 -- 172.21.15.152:0/324324931 learned_addr learned my addr 172.21.15.152:0/324324931 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef1659c640 1 --2- 172.21.15.152:0/324324931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f89ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef15d9b640 1 --2- 172.21.15.152:0/324324931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f896b40 0x556a1f8a8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef16d9d640 1 -- 172.21.15.152:0/324324931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f896b40 msgr2=0x556a1f8a8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:19.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef16d9d640 1 --2- 172.21.15.152:0/324324931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f896b40 0x556a1f8a8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef16d9d640 1 -- 172.21.15.152:0/324324931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 msgr2=0x556a1f89ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:19.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef16d9d640 1 --2- 172.21.15.152:0/324324931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f89ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.580+0000 7fef16d9d640 1 -- 172.21.15.152:0/324324931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1f896760 con 0x556a1f8a0370 2024-09-11T22:07:19.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7fef16d9d640 1 --2- 172.21.15.152:0/324324931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a8d40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fef08016010 tx=0x7fef08009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b928eb0579d5c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:19.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7feefffff640 1 -- 172.21.15.152:0/324324931 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0800f040 con 0x556a1f8a0370 2024-09-11T22:07:19.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7feefffff640 1 -- 172.21.15.152:0/324324931 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef08028070 con 0x556a1f8a0370 2024-09-11T22:07:19.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7feefffff640 1 -- 172.21.15.152:0/324324931 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef080225e0 con 0x556a1f8a0370 2024-09-11T22:07:19.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7fef1f3a3740 1 -- 172.21.15.152:0/324324931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 msgr2=0x556a1f8a8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:19.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/324324931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a8d40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fef08016010 tx=0x7fef08009000 comp rx=0 tx=0).stop 2024-09-11T22:07:19.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7fef1f3a3740 1 -- 172.21.15.152:0/324324931 shutdown_connections 2024-09-11T22:07:19.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/324324931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f8a0370 0x556a1f8a8d40 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/324324931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f896b40 0x556a1f8a8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/324324931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f89ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7fef1f3a3740 1 -- 172.21.15.152:0/324324931 >> 172.21.15.152:0/324324931 conn(0x556a1f85e310 msgr2=0x556a1f89e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:19.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7fef1f3a3740 1 -- 172.21.15.152:0/324324931 shutdown_connections 2024-09-11T22:07:19.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.581+0000 7fef1f3a3740 1 -- 172.21.15.152:0/324324931 wait complete. 2024-09-11T22:07:19.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef1f3a3740 1 -- start start 2024-09-11T22:07:19.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef1f3a3740 1 Processor -- start 2024-09-11T22:07:19.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f899200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f899740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef1f3a3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f8a0370 0x556a1f899ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fef181abf70 con 0x556a1f896b40 2024-09-11T22:07:19.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fef181ad3e0 con 0x556a1f8955d0 2024-09-11T22:07:19.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef1f3a3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fef181ac640 con 0x556a1f8a0370 2024-09-11T22:07:19.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef1f3a3740 10 client.0 _ll_register_callbacks cb 0x7fef10098480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:19.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef15d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f899740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef15d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f899740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56516/0 (socket says 172.21.15.152:56516) 2024-09-11T22:07:19.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef15d9b640 1 -- 172.21.15.152:0/394469172 learned_addr learned my addr 172.21.15.152:0/394469172 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef16d9d640 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f8a0370 0x556a1f899ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.582+0000 7fef1659c640 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f899200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7fef15d9b640 1 -- 172.21.15.152:0/394469172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f8a0370 msgr2=0x556a1f899ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7fef15d9b640 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f8a0370 0x556a1f899ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7fef15d9b640 1 -- 172.21.15.152:0/394469172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 msgr2=0x556a1f899200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7fef15d9b640 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f899200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7fef15d9b640 1 -- 172.21.15.152:0/394469172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a1f89a6d0 con 0x556a1f896b40 2024-09-11T22:07:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7fef15d9b640 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f899740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x556a1f89e5d0 tx=0x7fef00005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd28435e481fa409 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7feefdffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7feefdffb640 1 -- 172.21.15.152:0/394469172 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0005d060 con 0x556a1f896b40 2024-09-11T22:07:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7fef1f3a3740 1 -- 172.21.15.152:0/394469172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef08028070 con 0x556a1f896b40 2024-09-11T22:07:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7feefdffb640 1 -- 172.21.15.152:0/394469172 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fef00004f80 con 0x556a1f896b40 2024-09-11T22:07:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7feefdffb640 1 -- 172.21.15.152:0/394469172 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fef0003f070 con 0x556a1f896b40 2024-09-11T22:07:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7fef1f3a3740 10 client.16080 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:19.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7fef1f3a3740 1 -- 172.21.15.152:0/394469172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556a1f91f010 con 0x556a1f896b40 2024-09-11T22:07:19.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7feefdffb640 1 -- 172.21.15.152:0/394469172 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef08028070 con 0x556a1f896b40 2024-09-11T22:07:19.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.583+0000 7feefdffb640 1 -- 172.21.15.152:0/394469172 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fef000035f0 con 0x556a1f896b40 2024-09-11T22:07:19.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7fef1f3a3740 10 client.16080 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:19.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7fef1f3a3740 10 client.16080 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:07:19.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7fef1f3a3740 20 client.16080 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:19.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x556a1f91f700 0x556a1f921b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7fef1f3a3740 4 client.16080 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:07:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7fef1f3a3740 1 -- 172.21.15.152:0/394469172 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556a1f802d70 con 0x556a1f91f700 2024-09-11T22:07:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7fef1659c640 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x556a1f91f700 0x556a1f921b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7fef1659c640 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x556a1f91f700 0x556a1f921b20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=76ec17b0305fecc0 server_cookie=a16587f11bec5168 in_seq=0 out_seq=0 2024-09-11T22:07:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7feefdffb640 10 client.16080 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:07:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7feefdffb640 1 -- 172.21.15.152:0/394469172 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556a1f802d70 con 0x556a1f91f700 2024-09-11T22:07:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7feefdffb640 10 client.16080 handle_command_reply: tid=0 2024-09-11T22:07:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.584+0000 7fef1f3a3740 1 client.16080 shutdown 2024-09-11T22:07:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1f3a3740 1 -- 172.21.15.152:0/394469172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 msgr2=0x556a1f899740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f899740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x556a1f89e5d0 tx=0x7fef00005fd0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1f3a3740 1 -- 172.21.15.152:0/394469172 shutdown_connections 2024-09-11T22:07:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x556a1f91f700 0x556a1f921b20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556a1f8a0370 0x556a1f899ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a1f896b40 0x556a1f899740 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1f3a3740 1 --2- 172.21.15.152:0/394469172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a1f8955d0 0x556a1f899200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1f3a3740 1 -- 172.21.15.152:0/394469172 >> 172.21.15.152:0/394469172 conn(0x556a1f85e310 msgr2=0x556a1f890d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7feefdffb640 0 client.16080 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:07:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1f3a3740 1 -- 172.21.15.152:0/394469172 shutdown_connections 2024-09-11T22:07:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1f3a3740 1 -- 172.21.15.152:0/394469172 wait complete. 2024-09-11T22:07:19.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1f3a3740 20 client.16080 trim_cache size 0 max 16384 2024-09-11T22:07:19.598 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:07:19.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 -- 172.21.15.152:0/2986455075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fef040a2cf0 msgr2=0x7fef040a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fef040a2cf0 0x7fef040a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef08015600 tx=0x7fef080046c0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 -- 172.21.15.152:0/2986455075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef18102d30 msgr2=0x7fef18198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef18102d30 0x7fef18198620 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fef1000eab0 tx=0x7fef1000ef70 comp rx=0 tx=0).stop 2024-09-11T22:07:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 -- 172.21.15.152:0/2986455075 shutdown_connections 2024-09-11T22:07:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fef040a2cf0 0x7fef040a51b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181082a0 0x7fef1819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef181036e0 0x7fef18198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 --2- 172.21.15.152:0/2986455075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef18102d30 0x7fef18198620 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 -- 172.21.15.152:0/2986455075 >> 172.21.15.152:0/2986455075 conn(0x7fef180fc7d0 msgr2=0x7fef18105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 -- 172.21.15.152:0/2986455075 shutdown_connections 2024-09-11T22:07:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:19.585+0000 7fef1cfca640 1 -- 172.21.15.152:0/2986455075 wait complete. 2024-09-11T22:07:19.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:19 smithi179 ceph-mon[35603]: pgmap v94: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 35 MiB/s wr, 668 op/s 2024-09-11T22:07:19.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:07:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:19 smithi193 ceph-mon[35545]: pgmap v94: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 35 MiB/s wr, 668 op/s 2024-09-11T22:07:20.342 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:07:20.591 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:07:20.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.953+0000 7f142063d640 1 -- 172.21.15.152:0/1654913235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1418101de0 msgr2=0x7f14181021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:20.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.953+0000 7f142063d640 1 --2- 172.21.15.152:0/1654913235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1418101de0 0x7f14181021c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1414009900 tx=0x7f141402a410 comp rx=0 tx=0).stop 2024-09-11T22:07:20.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.953+0000 7f142063d640 1 -- 172.21.15.152:0/1654913235 shutdown_connections 2024-09-11T22:07:20.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.953+0000 7f142063d640 1 --2- 172.21.15.152:0/1654913235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1418106f10 0x7f141810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.953+0000 7f142063d640 1 --2- 172.21.15.152:0/1654913235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1418102790 0x7f14181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.953+0000 7f142063d640 1 --2- 172.21.15.152:0/1654913235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1418101de0 0x7f14181021c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.953+0000 7f142063d640 1 -- 172.21.15.152:0/1654913235 >> 172.21.15.152:0/1654913235 conn(0x7f14180fd8c0 msgr2=0x7f14180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.953+0000 7f142063d640 1 -- 172.21.15.152:0/1654913235 shutdown_connections 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.953+0000 7f142063d640 1 -- 172.21.15.152:0/1654913235 wait complete. 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f142063d640 1 Processor -- start 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f142063d640 1 -- start start 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f142063d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1418101de0 0x7f1418198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f142063d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1418102790 0x7f1418198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f142063d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1418106f10 0x7f141819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f142063d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1418111f30 con 0x7f1418106f10 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f142063d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1418111db0 con 0x7f1418101de0 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f142063d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14181120b0 con 0x7f1418102790 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f141ebda640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1418106f10 0x7f141819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f141ebda640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1418106f10 0x7f141819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56542/0 (socket says 172.21.15.152:56542) 2024-09-11T22:07:20.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f141ebda640 1 -- 172.21.15.152:0/1199423797 learned_addr learned my addr 172.21.15.152:0/1199423797 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:20.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.954+0000 7f141e3d9640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1418101de0 0x7f1418198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f141dbd8640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1418102790 0x7f1418198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f141ebda640 1 -- 172.21.15.152:0/1199423797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1418102790 msgr2=0x7f1418198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:20.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f141ebda640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1418102790 0x7f1418198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f141ebda640 1 -- 172.21.15.152:0/1199423797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1418101de0 msgr2=0x7f1418198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:20.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f141ebda640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1418101de0 0x7f1418198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f141ebda640 1 -- 172.21.15.152:0/1199423797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141819d3e0 con 0x7f1418106f10 2024-09-11T22:07:20.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f141dbd8640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1418102790 0x7f1418198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:20.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f141ebda640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1418106f10 0x7f141819cd00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f141000cce0 tx=0x7f141000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:20.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f140f7fe640 1 -- 172.21.15.152:0/1199423797 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141000f450 con 0x7f1418106f10 2024-09-11T22:07:20.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f140f7fe640 1 -- 172.21.15.152:0/1199423797 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f141000fad0 con 0x7f1418106f10 2024-09-11T22:07:20.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f142063d640 1 -- 172.21.15.152:0/1199423797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141819d6d0 con 0x7f1418106f10 2024-09-11T22:07:20.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f140f7fe640 1 -- 172.21.15.152:0/1199423797 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410018c10 con 0x7f1418106f10 2024-09-11T22:07:20.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.955+0000 7f142063d640 1 -- 172.21.15.152:0/1199423797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14181a4fb0 con 0x7f1418106f10 2024-09-11T22:07:20.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.958+0000 7f1422a16740 1 Processor -- start 2024-09-11T22:07:20.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.958+0000 7f140f7fe640 1 -- 172.21.15.152:0/1199423797 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f141000f5f0 con 0x7f1418106f10 2024-09-11T22:07:20.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.958+0000 7f1422a16740 1 -- start start 2024-09-11T22:07:20.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f1422a16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d8008b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f1422a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008b5d0 0x556d8008ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f1422a16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d80098760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f1422a16740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556d7fff12f0 con 0x556d8008cb40 2024-09-11T22:07:20.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f1422a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556d7ff98cf0 con 0x556d8008b5d0 2024-09-11T22:07:20.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f1422a16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556d7ffed2b0 con 0x556d80096370 2024-09-11T22:07:20.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f141dbd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d8008b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f141dbd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d8008b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56554/0 (socket says 172.21.15.152:56554) 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f141dbd8640 1 -- 172.21.15.152:0/651565938 learned_addr learned my addr 172.21.15.152:0/651565938 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f141e3d9640 1 --2- 172.21.15.152:0/651565938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008b5d0 0x556d8008ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f141dbd8640 1 --2- 172.21.15.152:0/651565938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d80098760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f140f7fe640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14040a2cf0 0x7f14040a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f141dbd8640 1 -- 172.21.15.152:0/651565938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 msgr2=0x556d80098760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f141dbd8640 1 --2- 172.21.15.152:0/651565938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d80098760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f141dbd8640 1 -- 172.21.15.152:0/651565938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008b5d0 msgr2=0x556d8008ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f141dbd8640 1 --2- 172.21.15.152:0/651565938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008b5d0 0x556d8008ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f141dbd8640 1 -- 172.21.15.152:0/651565938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d7ff7d3a0 con 0x556d8008cb40 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.959+0000 7f141ebda640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14040a2cf0 0x7f14040a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.960+0000 7f141dbd8640 1 --2- 172.21.15.152:0/651565938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d8008b090 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f14080058c0 tx=0x7f140800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b6bd034b8d7d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.960+0000 7f140f7fe640 1 -- 172.21.15.152:0/1199423797 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f14100cfab0 con 0x7f1418106f10 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.960+0000 7f140cff9640 1 -- 172.21.15.152:0/651565938 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408019030 con 0x556d8008cb40 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.960+0000 7f140cff9640 1 -- 172.21.15.152:0/651565938 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1408011a20 con 0x556d8008cb40 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.960+0000 7f140cff9640 1 -- 172.21.15.152:0/651565938 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140801db30 con 0x556d8008cb40 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.960+0000 7f1422a16740 1 -- 172.21.15.152:0/651565938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 msgr2=0x556d8008b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.960+0000 7f1422a16740 1 --2- 172.21.15.152:0/651565938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d8008b090 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f14080058c0 tx=0x7f140800b730 comp rx=0 tx=0).stop 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.960+0000 7f141ebda640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14040a2cf0 0x7f14040a51b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14100cd280 tx=0x7f1410098320 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 -- 172.21.15.152:0/651565938 shutdown_connections 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 --2- 172.21.15.152:0/651565938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d80098760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 --2- 172.21.15.152:0/651565938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008b5d0 0x556d8008ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 --2- 172.21.15.152:0/651565938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d8008b090 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 -- 172.21.15.152:0/651565938 >> 172.21.15.152:0/651565938 conn(0x556d80054310 msgr2=0x556d80087c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:20.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 -- 172.21.15.152:0/651565938 shutdown_connections 2024-09-11T22:07:20.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 -- 172.21.15.152:0/651565938 wait complete. 2024-09-11T22:07:20.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 -- start start 2024-09-11T22:07:20.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 Processor -- start 2024-09-11T22:07:20.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008b5d0 0x556d80095d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008cb40 0x556d80093030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d80093640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556d80099070 con 0x556d8008b5d0 2024-09-11T22:07:20.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556d7ffac060 con 0x556d8008cb40 2024-09-11T22:07:20.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556d800991f0 con 0x556d80096370 2024-09-11T22:07:20.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f1422a16740 10 client.0 _ll_register_callbacks cb 0x556d7fcff8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:20.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.961+0000 7f141dbd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008b5d0 0x556d80095d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f141dbd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008b5d0 0x556d80095d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56564/0 (socket says 172.21.15.152:56564) 2024-09-11T22:07:20.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f141dbd8640 1 -- 172.21.15.152:0/3119126281 learned_addr learned my addr 172.21.15.152:0/3119126281 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:20.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f141e3d9640 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008cb40 0x556d80093030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f141dbd8640 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d80093640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f141dbd8640 1 -- 172.21.15.152:0/3119126281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 msgr2=0x556d80093640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:20.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f141dbd8640 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d80093640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f141dbd8640 1 -- 172.21.15.152:0/3119126281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008cb40 msgr2=0x556d80093030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:20.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f141dbd8640 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008cb40 0x556d80093030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f141dbd8640 1 -- 172.21.15.152:0/3119126281 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d7fd623c0 con 0x556d8008b5d0 2024-09-11T22:07:20.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f141dbd8640 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008b5d0 0x556d80095d80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f140801d5a0 tx=0x7f1408005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc812f62189aef1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:20.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f1401ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f1401ffb640 1 -- 172.21.15.152:0/3119126281 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408019040 con 0x556d8008b5d0 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f1401ffb640 1 -- 172.21.15.152:0/3119126281 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1408011740 con 0x556d8008b5d0 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f1422a16740 1 -- 172.21.15.152:0/3119126281 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1408011a20 con 0x556d8008b5d0 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f1401ffb640 1 -- 172.21.15.152:0/3119126281 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1408013020 con 0x556d8008b5d0 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f1422a16740 10 client.16092 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.962+0000 7f1422a16740 1 -- 172.21.15.152:0/3119126281 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556d800a4b40 con 0x556d8008b5d0 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.963+0000 7f1401ffb640 1 -- 172.21.15.152:0/3119126281 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1408011a20 con 0x556d8008b5d0 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.963+0000 7f1401ffb640 1 -- 172.21.15.152:0/3119126281 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f14080050b0 con 0x556d8008b5d0 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.963+0000 7f1422a16740 10 client.16092 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.963+0000 7f1422a16740 10 client.16092 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.963+0000 7f1422a16740 20 client.16092 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.963+0000 7f1422a16740 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556d800a5e90 0x556d800a8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.963+0000 7f1422a16740 4 client.16092 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.963+0000 7f1422a16740 1 -- 172.21.15.152:0/3119126281 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d7fffe860 con 0x556d800a5e90 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.963+0000 7f141e3d9640 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556d800a5e90 0x556d800a8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.964+0000 7f1401ffb640 10 client.16092 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.964+0000 7f141e3d9640 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556d800a5e90 0x556d800a8280 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2a4f0f092f8ca24c server_cookie=ab427c2306c087fa in_seq=0 out_seq=0 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.964+0000 7f1401ffb640 1 -- 172.21.15.152:0/3119126281 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d7fffe860 con 0x556d800a5e90 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.964+0000 7f1401ffb640 10 client.16092 handle_command_reply: tid=0 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.964+0000 7f1422a16740 1 client.16092 shutdown 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1422a16740 1 -- 172.21.15.152:0/3119126281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008b5d0 msgr2=0x556d80095d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1422a16740 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008b5d0 0x556d80095d80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f140801d5a0 tx=0x7f1408005fb0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1422a16740 1 -- 172.21.15.152:0/3119126281 shutdown_connections 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1422a16740 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556d800a5e90 0x556d800a8280 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1422a16740 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d80093640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1422a16740 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008cb40 0x556d80093030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1401ffb640 0 client.16092 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:07:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1422a16740 1 --2- 172.21.15.152:0/3119126281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008b5d0 0x556d80095d80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1422a16740 1 -- 172.21.15.152:0/3119126281 >> 172.21.15.152:0/3119126281 conn(0x556d80054310 msgr2=0x556d8008d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1422a16740 1 -- 172.21.15.152:0/3119126281 shutdown_connections 2024-09-11T22:07:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1422a16740 1 -- 172.21.15.152:0/3119126281 wait complete. 2024-09-11T22:07:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.965+0000 7f1422a16740 20 client.16092 trim_cache size 0 max 16384 2024-09-11T22:07:20.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.977+0000 7f1422a16740 1 Processor -- start 2024-09-11T22:07:20.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.977+0000 7f1422a16740 1 -- start start 2024-09-11T22:07:20.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f1422a16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d8008b5d0 0x556d800a2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f1422a16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d800928f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f1422a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d80096370 0x556d80087510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f1422a16740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f14181b0260 con 0x556d8008cb40 2024-09-11T22:07:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f1422a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14181adb00 con 0x556d80096370 2024-09-11T22:07:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f1422a16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14181ab950 con 0x556d8008b5d0 2024-09-11T22:07:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f141e3d9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d800928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f141e3d9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d800928f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56576/0 (socket says 172.21.15.152:56576) 2024-09-11T22:07:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f141e3d9640 1 -- 172.21.15.152:0/499855792 learned_addr learned my addr 172.21.15.152:0/499855792 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f141dbd8640 1 --2- 172.21.15.152:0/499855792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d80096370 0x556d80087510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f141e3d9640 1 -- 172.21.15.152:0/499855792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d8008b5d0 msgr2=0x556d800a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f141e3d9640 1 --2- 172.21.15.152:0/499855792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d8008b5d0 0x556d800a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f141e3d9640 1 -- 172.21.15.152:0/499855792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d80096370 msgr2=0x556d80087510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f141e3d9640 1 --2- 172.21.15.152:0/499855792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d80096370 0x556d80087510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f141e3d9640 1 -- 172.21.15.152:0/499855792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d80093c20 con 0x556d8008cb40 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f141dbd8640 1 --2- 172.21.15.152:0/499855792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d80096370 0x556d80087510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f141e3d9640 1 --2- 172.21.15.152:0/499855792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d800928f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1414009900 tx=0x7f1414031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea318c1f0d227cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f1403fff640 1 -- 172.21.15.152:0/499855792 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141404d030 con 0x556d8008cb40 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f1403fff640 1 -- 172.21.15.152:0/499855792 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1414005020 con 0x556d8008cb40 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.978+0000 7f1403fff640 1 -- 172.21.15.152:0/499855792 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414035040 con 0x556d8008cb40 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 -- 172.21.15.152:0/499855792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 msgr2=0x556d800928f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 --2- 172.21.15.152:0/499855792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d800928f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1414009900 tx=0x7f1414031400 comp rx=0 tx=0).stop 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 -- 172.21.15.152:0/499855792 shutdown_connections 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 --2- 172.21.15.152:0/499855792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d80096370 0x556d80087510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 --2- 172.21.15.152:0/499855792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d800928f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 --2- 172.21.15.152:0/499855792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d8008b5d0 0x556d800a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 -- 172.21.15.152:0/499855792 >> 172.21.15.152:0/499855792 conn(0x556d80054310 msgr2=0x556d80092120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 -- 172.21.15.152:0/499855792 shutdown_connections 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 -- 172.21.15.152:0/499855792 wait complete. 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 -- start start 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 Processor -- start 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008b5d0 0x556d8009e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d80099d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.979+0000 7f1422a16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d8009a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f1422a16740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f14181abfc0 con 0x556d8008cb40 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f1422a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14181ad430 con 0x556d8008b5d0 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f1422a16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14181ac690 con 0x556d80096370 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f1422a16740 10 client.0 _ll_register_callbacks cb 0x7f1414009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141e3d9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d80099d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141e3d9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d80099d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56592/0 (socket says 172.21.15.152:56592) 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141e3d9640 1 -- 172.21.15.152:0/1825754933 learned_addr learned my addr 172.21.15.152:0/1825754933 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141dbd8640 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008b5d0 0x556d8009e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141dbd8640 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d8009a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141e3d9640 1 -- 172.21.15.152:0/1825754933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 msgr2=0x556d8009a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141e3d9640 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d8009a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141e3d9640 1 -- 172.21.15.152:0/1825754933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008b5d0 msgr2=0x556d8009e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141e3d9640 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008b5d0 0x556d8009e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141e3d9640 1 -- 172.21.15.152:0/1825754933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d8008e120 con 0x556d8008cb40 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141dbd8640 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008b5d0 0x556d8009e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f141e3d9640 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d80099d40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1414005940 tx=0x7f1414031930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5748a7656c8ceb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f1401ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:20.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f1401ffb640 1 -- 172.21.15.152:0/1825754933 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414035040 con 0x556d8008cb40 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f1401ffb640 1 -- 172.21.15.152:0/1825754933 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f14140054a0 con 0x556d8008cb40 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.980+0000 7f1422a16740 1 -- 172.21.15.152:0/1825754933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1414005020 con 0x556d8008cb40 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f1401ffb640 1 -- 172.21.15.152:0/1825754933 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1414062050 con 0x556d8008cb40 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f1422a16740 10 client.16098 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f1422a16740 1 -- 172.21.15.152:0/1825754933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556d80114930 con 0x556d8008cb40 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f1401ffb640 1 -- 172.21.15.152:0/1825754933 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1414005020 con 0x556d8008cb40 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f1401ffb640 1 -- 172.21.15.152:0/1825754933 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f14140489d0 con 0x556d8008cb40 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f1422a16740 10 client.16098 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f1422a16740 10 client.16098 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f1422a16740 20 client.16098 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f1422a16740 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556d801150a0 0x556d801174c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f1422a16740 4 client.16098 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f1422a16740 1 -- 172.21.15.152:0/1825754933 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556d7fff8d70 con 0x556d801150a0 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.981+0000 7f141dbd8640 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556d801150a0 0x556d801174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f141dbd8640 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556d801150a0 0x556d801174c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc9fed1a5c91e7d5 server_cookie=780e0e7ae57ae3f2 in_seq=0 out_seq=0 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1401ffb640 10 client.16098 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1401ffb640 1 -- 172.21.15.152:0/1825754933 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556d7fff8d70 con 0x556d801150a0 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1401ffb640 10 client.16098 handle_command_reply: tid=0 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 1 client.16098 shutdown 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 1 -- 172.21.15.152:0/1825754933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 msgr2=0x556d80099d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d80099d40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1414005940 tx=0x7f1414031930 comp rx=0 tx=0).stop 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 1 -- 172.21.15.152:0/1825754933 shutdown_connections 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556d801150a0 0x556d801174c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556d80096370 0x556d8009a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556d8008cb40 0x556d80099d40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1401ffb640 0 client.16098 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:07:20.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 1 --2- 172.21.15.152:0/1825754933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d8008b5d0 0x556d8009e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 1 -- 172.21.15.152:0/1825754933 >> 172.21.15.152:0/1825754933 conn(0x556d80054310 msgr2=0x556d80092120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:20.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 1 -- 172.21.15.152:0/1825754933 shutdown_connections 2024-09-11T22:07:20.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 1 -- 172.21.15.152:0/1825754933 wait complete. 2024-09-11T22:07:20.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.982+0000 7f1422a16740 20 client.16098 trim_cache size 0 max 16384 2024-09-11T22:07:20.990 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:07:20.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 -- 172.21.15.152:0/1199423797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14040a2cf0 msgr2=0x7f14040a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:20.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14040a2cf0 0x7f14040a51b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14100cd280 tx=0x7f1410098320 comp rx=0 tx=0).stop 2024-09-11T22:07:20.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 -- 172.21.15.152:0/1199423797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1418106f10 msgr2=0x7f141819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:20.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1418106f10 0x7f141819cd00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f141000cce0 tx=0x7f141000a620 comp rx=0 tx=0).stop 2024-09-11T22:07:20.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 -- 172.21.15.152:0/1199423797 shutdown_connections 2024-09-11T22:07:20.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14040a2cf0 0x7f14040a51b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1418106f10 0x7f141819cd00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1418102790 0x7f1418198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 --2- 172.21.15.152:0/1199423797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1418101de0 0x7f1418198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:20.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 -- 172.21.15.152:0/1199423797 >> 172.21.15.152:0/1199423797 conn(0x7f14180fd8c0 msgr2=0x7f14180feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:20.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 -- 172.21.15.152:0/1199423797 shutdown_connections 2024-09-11T22:07:20.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:20.983+0000 7f142063d640 1 -- 172.21.15.152:0/1199423797 wait complete. 2024-09-11T22:07:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:21 smithi179 ceph-mon[35603]: pgmap v95: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 32 MiB/s wr, 604 op/s 2024-09-11T22:07:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:21 smithi193 ceph-mon[35545]: pgmap v95: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 32 MiB/s wr, 604 op/s 2024-09-11T22:07:21.880 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:21 smithi152 ceph-mon[31188]: pgmap v95: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 32 MiB/s wr, 604 op/s 2024-09-11T22:07:21.909 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:07:22.157 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:07:22.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.625+0000 7f8129268640 1 -- 172.21.15.152:0/381255996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8124102d40 msgr2=0x7f8124103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.625+0000 7f8129268640 1 --2- 172.21.15.152:0/381255996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8124102d40 0x7f8124103120 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8118009900 tx=0x7f811802a480 comp rx=0 tx=0).stop 2024-09-11T22:07:22.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.625+0000 7f8129268640 1 -- 172.21.15.152:0/381255996 shutdown_connections 2024-09-11T22:07:22.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.625+0000 7f8129268640 1 --2- 172.21.15.152:0/381255996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812410c170 0x7f812410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.625+0000 7f8129268640 1 --2- 172.21.15.152:0/381255996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8124103660 0x7f812410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.625+0000 7f8129268640 1 --2- 172.21.15.152:0/381255996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8124102d40 0x7f8124103120 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.625+0000 7f8129268640 1 -- 172.21.15.152:0/381255996 >> 172.21.15.152:0/381255996 conn(0x7f81240fc7a0 msgr2=0x7f81240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.625+0000 7f8129268640 1 -- 172.21.15.152:0/381255996 shutdown_connections 2024-09-11T22:07:22.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.625+0000 7f8129268640 1 -- 172.21.15.152:0/381255996 wait complete. 2024-09-11T22:07:22.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.625+0000 7f8129268640 1 Processor -- start 2024-09-11T22:07:22.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.625+0000 7f8129268640 1 -- start start 2024-09-11T22:07:22.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f8129268640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8124102d40 0x7f81241983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f8129268640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8124103660 0x7f8124198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f8129268640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812410c170 0x7f812419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f8129268640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8124111f70 con 0x7f8124103660 2024-09-11T22:07:22.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f8129268640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8124111df0 con 0x7f812410c170 2024-09-11T22:07:22.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f8129268640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81241120f0 con 0x7f8124102d40 2024-09-11T22:07:22.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f81227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8124103660 0x7f8124198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f81227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8124103660 0x7f8124198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56616/0 (socket says 172.21.15.152:56616) 2024-09-11T22:07:22.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f81227fc640 1 -- 172.21.15.152:0/674733621 learned_addr learned my addr 172.21.15.152:0/674733621 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:22.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f8122ffd640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8124102d40 0x7f81241983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f81237fe640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812410c170 0x7f812419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f81227fc640 1 -- 172.21.15.152:0/674733621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8124102d40 msgr2=0x7f81241983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f81227fc640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8124102d40 0x7f81241983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f81227fc640 1 -- 172.21.15.152:0/674733621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812410c170 msgr2=0x7f812419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f81227fc640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812410c170 0x7f812419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f81227fc640 1 -- 172.21.15.152:0/674733621 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812419d380 con 0x7f8124103660 2024-09-11T22:07:22.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f8122ffd640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8124102d40 0x7f81241983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:22.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f81237fe640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812410c170 0x7f812419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:22.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f81227fc640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8124103660 0x7f8124198910 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f811400c970 tx=0x7f811400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f810bfff640 1 -- 172.21.15.152:0/674733621 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114007bb0 con 0x7f8124103660 2024-09-11T22:07:22.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f8129268640 1 -- 172.21.15.152:0/674733621 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812419d670 con 0x7f8124103660 2024-09-11T22:07:22.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f810bfff640 1 -- 172.21.15.152:0/674733621 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8114007d50 con 0x7f8124103660 2024-09-11T22:07:22.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f810bfff640 1 -- 172.21.15.152:0/674733621 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114018820 con 0x7f8124103660 2024-09-11T22:07:22.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.626+0000 7f8129268640 1 -- 172.21.15.152:0/674733621 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81241a4f50 con 0x7f8124103660 2024-09-11T22:07:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.629+0000 7f810bfff640 1 -- 172.21.15.152:0/674733621 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f81140189c0 con 0x7f8124103660 2024-09-11T22:07:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.629+0000 7f812b641740 1 Processor -- start 2024-09-11T22:07:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.629+0000 7f812b641740 1 -- start start 2024-09-11T22:07:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.629+0000 7f810bfff640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f810c0a2cf0 0x7f810c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.629+0000 7f812b641740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b32b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.629+0000 7f812b641740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b32ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.629+0000 7f812b641740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b338760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.629+0000 7f812b641740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56545b2912f0 con 0x56545b32b5d0 2024-09-11T22:07:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.629+0000 7f812b641740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56545b238cf0 con 0x56545b336370 2024-09-11T22:07:22.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.629+0000 7f812b641740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56545b28d2b0 con 0x56545b32cb40 2024-09-11T22:07:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81237fe640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f810c0a2cf0 0x7f810c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b32ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b32ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56624/0 (socket says 172.21.15.152:56624) 2024-09-11T22:07:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f810bfff640 1 -- 172.21.15.152:0/674733621 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f81140cf670 con 0x7f8124103660 2024-09-11T22:07:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81227fc640 1 -- 172.21.15.152:0/4197437537 learned_addr learned my addr 172.21.15.152:0/4197437537 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f8122ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b32b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81237fe640 1 --2- 172.21.15.152:0/4197437537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b338760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81227fc640 1 -- 172.21.15.152:0/4197437537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 msgr2=0x56545b32b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81227fc640 1 --2- 172.21.15.152:0/4197437537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b32b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81227fc640 1 -- 172.21.15.152:0/4197437537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 msgr2=0x56545b338760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81227fc640 1 --2- 172.21.15.152:0/4197437537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b338760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81227fc640 1 -- 172.21.15.152:0/4197437537 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545b21d3a0 con 0x56545b32b5d0 2024-09-11T22:07:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81227fc640 1 --2- 172.21.15.152:0/4197437537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b32ba10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8114007590 tx=0x7f8114013b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600895aba713b0d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81237fe640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f810c0a2cf0 0x7f810c0a51b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f811c005fd0 tx=0x7f811c014af0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81097fa640 1 -- 172.21.15.152:0/4197437537 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114018cb0 con 0x56545b32b5d0 2024-09-11T22:07:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81097fa640 1 -- 172.21.15.152:0/4197437537 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f811409c200 con 0x56545b32b5d0 2024-09-11T22:07:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.630+0000 7f81097fa640 1 -- 172.21.15.152:0/4197437537 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114008230 con 0x56545b32b5d0 2024-09-11T22:07:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.631+0000 7f812b641740 1 -- 172.21.15.152:0/4197437537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 msgr2=0x56545b32ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.631+0000 7f812b641740 1 --2- 172.21.15.152:0/4197437537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b32ba10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8114007590 tx=0x7f8114013b80 comp rx=0 tx=0).stop 2024-09-11T22:07:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.631+0000 7f812b641740 1 -- 172.21.15.152:0/4197437537 shutdown_connections 2024-09-11T22:07:22.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.631+0000 7f812b641740 1 --2- 172.21.15.152:0/4197437537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b338760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.631+0000 7f812b641740 1 --2- 172.21.15.152:0/4197437537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b32ba10 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.631+0000 7f812b641740 1 --2- 172.21.15.152:0/4197437537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b32b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.631+0000 7f812b641740 1 -- 172.21.15.152:0/4197437537 >> 172.21.15.152:0/4197437537 conn(0x56545b2f4310 msgr2=0x56545b327c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.631+0000 7f812b641740 1 -- 172.21.15.152:0/4197437537 shutdown_connections 2024-09-11T22:07:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.631+0000 7f812b641740 1 -- 172.21.15.152:0/4197437537 wait complete. 2024-09-11T22:07:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.631+0000 7f812b641740 1 -- start start 2024-09-11T22:07:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f812b641740 1 Processor -- start 2024-09-11T22:07:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f812b641740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b32b5d0 0x56545b335cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f812b641740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32cb40 0x56545b332f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f812b641740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b336370 0x56545b3334d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f812b641740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56545b33d480 con 0x56545b32cb40 2024-09-11T22:07:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f812b641740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56545b24c060 con 0x56545b32b5d0 2024-09-11T22:07:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f812b641740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56545b33d600 con 0x56545b336370 2024-09-11T22:07:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f812b641740 10 client.0 _ll_register_callbacks cb 0x56545af9f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f81227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32cb40 0x56545b332f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f81227fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32cb40 0x56545b332f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56636/0 (socket says 172.21.15.152:56636) 2024-09-11T22:07:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f81227fc640 1 -- 172.21.15.152:0/3878615886 learned_addr learned my addr 172.21.15.152:0/3878615886 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f8122ffd640 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b32b5d0 0x56545b335cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f81237fe640 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b336370 0x56545b3334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f81227fc640 1 -- 172.21.15.152:0/3878615886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b336370 msgr2=0x56545b3334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f81227fc640 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b336370 0x56545b3334d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f81227fc640 1 -- 172.21.15.152:0/3878615886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b32b5d0 msgr2=0x56545b335cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f81227fc640 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b32b5d0 0x56545b335cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f81227fc640 1 -- 172.21.15.152:0/3878615886 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545b0023c0 con 0x56545b32cb40 2024-09-11T22:07:22.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f81237fe640 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b336370 0x56545b3334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:22.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f81227fc640 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32cb40 0x56545b332f70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f811409ba90 tx=0x7f811409a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9f3c0d3fc3bd7f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.632+0000 7f8106ff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:22.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f8106ff5640 1 -- 172.21.15.152:0/3878615886 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81140cd1b0 con 0x56545b32cb40 2024-09-11T22:07:22.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f8106ff5640 1 -- 172.21.15.152:0/3878615886 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f81140a42e0 con 0x56545b32cb40 2024-09-11T22:07:22.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f812b641740 1 -- 172.21.15.152:0/3878615886 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f811409c200 con 0x56545b32cb40 2024-09-11T22:07:22.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f8106ff5640 1 -- 172.21.15.152:0/3878615886 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f811409bb00 con 0x56545b32cb40 2024-09-11T22:07:22.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f812b641740 10 client.16110 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:22.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f812b641740 1 -- 172.21.15.152:0/3878615886 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56545b348e90 con 0x56545b32cb40 2024-09-11T22:07:22.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f8106ff5640 1 -- 172.21.15.152:0/3878615886 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f811409c200 con 0x56545b32cb40 2024-09-11T22:07:22.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f8106ff5640 1 -- 172.21.15.152:0/3878615886 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f8114013bf0 con 0x56545b32cb40 2024-09-11T22:07:22.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f812b641740 10 client.16110 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:22.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f812b641740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:22.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f812b641740 20 client.16110 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:22.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f812b641740 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56545b34a1e0 0x56545b34c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f812b641740 4 client.16110 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:22.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f812b641740 1 -- 172.21.15.152:0/3878615886 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56545b29e860 con 0x56545b34a1e0 2024-09-11T22:07:22.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.633+0000 7f8122ffd640 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56545b34a1e0 0x56545b34c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.634+0000 7f8106ff5640 10 client.16110 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:22.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.634+0000 7f8122ffd640 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56545b34a1e0 0x56545b34c5d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28b6a1ce3997dc9b server_cookie=b2b0b4b893916b50 in_seq=0 out_seq=0 2024-09-11T22:07:22.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.634+0000 7f8106ff5640 1 -- 172.21.15.152:0/3878615886 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56545b29e860 con 0x56545b34a1e0 2024-09-11T22:07:22.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.634+0000 7f8106ff5640 10 client.16110 handle_command_reply: tid=0 2024-09-11T22:07:22.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 1 client.16110 shutdown 2024-09-11T22:07:22.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 1 -- 172.21.15.152:0/3878615886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32cb40 msgr2=0x56545b332f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32cb40 0x56545b332f70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f811409ba90 tx=0x7f811409a010 comp rx=0 tx=0).stop 2024-09-11T22:07:22.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 1 -- 172.21.15.152:0/3878615886 shutdown_connections 2024-09-11T22:07:22.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56545b34a1e0 0x56545b34c5d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b336370 0x56545b3334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f8106ff5640 0 client.16110 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:22.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32cb40 0x56545b332f70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 1 --2- 172.21.15.152:0/3878615886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b32b5d0 0x56545b335cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 1 -- 172.21.15.152:0/3878615886 >> 172.21.15.152:0/3878615886 conn(0x56545b2f4310 msgr2=0x56545b32d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 1 -- 172.21.15.152:0/3878615886 shutdown_connections 2024-09-11T22:07:22.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 1 -- 172.21.15.152:0/3878615886 wait complete. 2024-09-11T22:07:22.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.635+0000 7f812b641740 20 client.16110 trim_cache size 0 max 16384 2024-09-11T22:07:22.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f812b641740 1 Processor -- start 2024-09-11T22:07:22.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f812b641740 1 -- start start 2024-09-11T22:07:22.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f812b641740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b330210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f812b641740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b330750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f812b641740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b3347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f812b641740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f81241adfd0 con 0x56545b32b5d0 2024-09-11T22:07:22.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f812b641740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f81241ab870 con 0x56545b336370 2024-09-11T22:07:22.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f812b641740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81241a96c0 con 0x56545b32cb40 2024-09-11T22:07:22.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f8122ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b330210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f8122ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b330210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56642/0 (socket says 172.21.15.152:56642) 2024-09-11T22:07:22.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f8122ffd640 1 -- 172.21.15.152:0/2029346924 learned_addr learned my addr 172.21.15.152:0/2029346924 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:22.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f81227fc640 1 --2- 172.21.15.152:0/2029346924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b330750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f8122ffd640 1 -- 172.21.15.152:0/2029346924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 msgr2=0x56545b330750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f8122ffd640 1 --2- 172.21.15.152:0/2029346924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b330750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f8122ffd640 1 -- 172.21.15.152:0/2029346924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 msgr2=0x56545b3347d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f81237fe640 1 --2- 172.21.15.152:0/2029346924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b3347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f8122ffd640 1 --2- 172.21.15.152:0/2029346924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b3347d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f8122ffd640 1 -- 172.21.15.152:0/2029346924 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545b32e120 con 0x56545b32b5d0 2024-09-11T22:07:22.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.648+0000 7f8122ffd640 1 --2- 172.21.15.152:0/2029346924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b330210 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f811802a9a0 tx=0x7f8118031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cd14328aa1492 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f8108ff9640 1 -- 172.21.15.152:0/2029346924 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8118035040 con 0x56545b32b5d0 2024-09-11T22:07:22.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f8108ff9640 1 -- 172.21.15.152:0/2029346924 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f811804a070 con 0x56545b32b5d0 2024-09-11T22:07:22.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f8108ff9640 1 -- 172.21.15.152:0/2029346924 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8118004920 con 0x56545b32b5d0 2024-09-11T22:07:22.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f812b641740 1 -- 172.21.15.152:0/2029346924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 msgr2=0x56545b330210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f812b641740 1 --2- 172.21.15.152:0/2029346924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b330210 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f811802a9a0 tx=0x7f8118031400 comp rx=0 tx=0).stop 2024-09-11T22:07:22.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f812b641740 1 -- 172.21.15.152:0/2029346924 shutdown_connections 2024-09-11T22:07:22.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f812b641740 1 --2- 172.21.15.152:0/2029346924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b3347d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f812b641740 1 --2- 172.21.15.152:0/2029346924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b330750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f812b641740 1 --2- 172.21.15.152:0/2029346924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b330210 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f812b641740 1 -- 172.21.15.152:0/2029346924 >> 172.21.15.152:0/2029346924 conn(0x56545b2f4310 msgr2=0x56545b332080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f812b641740 1 -- 172.21.15.152:0/2029346924 shutdown_connections 2024-09-11T22:07:22.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f812b641740 1 -- 172.21.15.152:0/2029346924 wait complete. 2024-09-11T22:07:22.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.649+0000 7f812b641740 1 -- start start 2024-09-11T22:07:22.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f812b641740 1 Processor -- start 2024-09-11T22:07:22.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f812b641740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b34fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f812b641740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b33bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f812b641740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b33c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f812b641740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f81241a9d30 con 0x56545b32b5d0 2024-09-11T22:07:22.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f812b641740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f81241ab1a0 con 0x56545b336370 2024-09-11T22:07:22.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f812b641740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81241aa400 con 0x56545b32cb40 2024-09-11T22:07:22.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f812b641740 10 client.0 _ll_register_callbacks cb 0x7f811409b4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:22.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f8122ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b34fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f8122ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b34fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56658/0 (socket says 172.21.15.152:56658) 2024-09-11T22:07:22.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f8122ffd640 1 -- 172.21.15.152:0/1762842871 learned_addr learned my addr 172.21.15.152:0/1762842871 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:22.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f81237fe640 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b33c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f81227fc640 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b33bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f8122ffd640 1 -- 172.21.15.152:0/1762842871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 msgr2=0x56545b33bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f8122ffd640 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b33bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f8122ffd640 1 -- 172.21.15.152:0/1762842871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 msgr2=0x56545b33c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f8122ffd640 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b33c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f8122ffd640 1 -- 172.21.15.152:0/1762842871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545b33cb70 con 0x56545b32b5d0 2024-09-11T22:07:22.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f81237fe640 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b33c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:22.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f8122ffd640 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b34fdf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8118009230 tx=0x7f8118032990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4a89ff0829be5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.650+0000 7f8106ff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:22.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f8106ff5640 1 -- 172.21.15.152:0/1762842871 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8118052070 con 0x56545b32b5d0 2024-09-11T22:07:22.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f8106ff5640 1 -- 172.21.15.152:0/1762842871 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f81180035f0 con 0x56545b32b5d0 2024-09-11T22:07:22.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f812b641740 1 -- 172.21.15.152:0/1762842871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f811804a070 con 0x56545b32b5d0 2024-09-11T22:07:22.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f8106ff5640 1 -- 172.21.15.152:0/1762842871 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f811805e050 con 0x56545b32b5d0 2024-09-11T22:07:22.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f812b641740 10 client.16116 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:22.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f812b641740 1 -- 172.21.15.152:0/1762842871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56545b3b9430 con 0x56545b32b5d0 2024-09-11T22:07:22.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f8106ff5640 1 -- 172.21.15.152:0/1762842871 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f811804a070 con 0x56545b32b5d0 2024-09-11T22:07:22.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f8106ff5640 1 -- 172.21.15.152:0/1762842871 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f811803c960 con 0x56545b32b5d0 2024-09-11T22:07:22.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f812b641740 10 client.16116 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:22.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f812b641740 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:22.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f812b641740 20 client.16116 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:22.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f812b641740 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56545b34a1e0 0x56545b3bbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f812b641740 4 client.16116 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:07:22.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f812b641740 1 -- 172.21.15.152:0/1762842871 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56545b298d70 con 0x56545b34a1e0 2024-09-11T22:07:22.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.651+0000 7f81227fc640 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56545b34a1e0 0x56545b3bbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f8106ff5640 10 client.16116 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:22.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f81227fc640 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56545b34a1e0 0x56545b3bbb10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adc06c8db12e88d1 server_cookie=d8364f0a4a28a6ce in_seq=0 out_seq=0 2024-09-11T22:07:22.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f8106ff5640 1 -- 172.21.15.152:0/1762842871 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56545b298d70 con 0x56545b34a1e0 2024-09-11T22:07:22.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f8106ff5640 10 client.16116 handle_command_reply: tid=0 2024-09-11T22:07:22.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 1 client.16116 shutdown 2024-09-11T22:07:22.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 1 -- 172.21.15.152:0/1762842871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 msgr2=0x56545b34fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b34fdf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8118009230 tx=0x7f8118032990 comp rx=0 tx=0).stop 2024-09-11T22:07:22.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 1 -- 172.21.15.152:0/1762842871 shutdown_connections 2024-09-11T22:07:22.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56545b34a1e0 0x56545b3bbb10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56545b336370 0x56545b33c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56545b32cb40 0x56545b33bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 1 --2- 172.21.15.152:0/1762842871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56545b32b5d0 0x56545b34fdf0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 1 -- 172.21.15.152:0/1762842871 >> 172.21.15.152:0/1762842871 conn(0x56545b2f4310 msgr2=0x56545b3264e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f8106ff5640 0 client.16116 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:22.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 1 -- 172.21.15.152:0/1762842871 shutdown_connections 2024-09-11T22:07:22.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 1 -- 172.21.15.152:0/1762842871 wait complete. 2024-09-11T22:07:22.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.652+0000 7f812b641740 20 client.16116 trim_cache size 0 max 16384 2024-09-11T22:07:22.662 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:07:22.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 -- 172.21.15.152:0/674733621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f810c0a2cf0 msgr2=0x7f810c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f810c0a2cf0 0x7f810c0a51b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f811c005fd0 tx=0x7f811c014af0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 -- 172.21.15.152:0/674733621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8124103660 msgr2=0x7f8124198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8124103660 0x7f8124198910 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f811400c970 tx=0x7f811400ce30 comp rx=0 tx=0).stop 2024-09-11T22:07:22.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 -- 172.21.15.152:0/674733621 shutdown_connections 2024-09-11T22:07:22.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f810c0a2cf0 0x7f810c0a51b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812410c170 0x7f812419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8124103660 0x7f8124198910 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 --2- 172.21.15.152:0/674733621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8124102d40 0x7f81241983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 -- 172.21.15.152:0/674733621 >> 172.21.15.152:0/674733621 conn(0x7f81240fc7a0 msgr2=0x7f81240fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 -- 172.21.15.152:0/674733621 shutdown_connections 2024-09-11T22:07:22.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:22.653+0000 7f8129268640 1 -- 172.21.15.152:0/674733621 wait complete. 2024-09-11T22:07:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.844+0000 7f8c7232c640 1 -- 172.21.15.152:0/3185321639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6c101350 msgr2=0x7f8c6c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.844+0000 7f8c7232c640 1 --2- 172.21.15.152:0/3185321639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6c101350 0x7f8c6c10d880 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009cd0 tx=0x7f8c6402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.844+0000 7f8c7232c640 1 -- 172.21.15.152:0/3185321639 shutdown_connections 2024-09-11T22:07:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.844+0000 7f8c7232c640 1 --2- 172.21.15.152:0/3185321639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6c101350 0x7f8c6c10d880 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.844+0000 7f8c7232c640 1 --2- 172.21.15.152:0/3185321639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6c1009b0 0x7f8c6c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.844+0000 7f8c7232c640 1 --2- 172.21.15.152:0/3185321639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c1069c0 0x7f8c6c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.844+0000 7f8c7232c640 1 -- 172.21.15.152:0/3185321639 >> 172.21.15.152:0/3185321639 conn(0x7f8c6c077990 msgr2=0x7f8c6c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.844+0000 7f8c7232c640 1 -- 172.21.15.152:0/3185321639 shutdown_connections 2024-09-11T22:07:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.844+0000 7f8c7232c640 1 -- 172.21.15.152:0/3185321639 wait complete. 2024-09-11T22:07:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.844+0000 7f8c7232c640 1 Processor -- start 2024-09-11T22:07:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.844+0000 7f8c7232c640 1 -- start start 2024-09-11T22:07:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c7232c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6c1009b0 0x7f8c6c199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c7232c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c101350 0x7f8c6c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c7232c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6c1069c0 0x7f8c6c1a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c7232c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c110e00 con 0x7f8c6c1009b0 2024-09-11T22:07:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c7232c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c110c80 con 0x7f8c6c101350 2024-09-11T22:07:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c7232c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c110f80 con 0x7f8c6c1069c0 2024-09-11T22:07:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6c1009b0 0x7f8c6c199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6c1009b0 0x7f8c6c199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56666/0 (socket says 172.21.15.152:56666) 2024-09-11T22:07:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c6bfff640 1 -- 172.21.15.152:0/1616908750 learned_addr learned my addr 172.21.15.152:0/1616908750 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c6b7fe640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c101350 0x7f8c6c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c708c9640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6c1069c0 0x7f8c6c1a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c6bfff640 1 -- 172.21.15.152:0/1616908750 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6c1069c0 msgr2=0x7f8c6c1a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6c1069c0 0x7f8c6c1a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c6bfff640 1 -- 172.21.15.152:0/1616908750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c101350 msgr2=0x7f8c6c199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c101350 0x7f8c6c199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c6bfff640 1 -- 172.21.15.152:0/1616908750 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6c1a46f0 con 0x7f8c6c1009b0 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c708c9640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6c1069c0 0x7f8c6c1a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6c1009b0 0x7f8c6c199130 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00d950 tx=0x7f8c5c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c697fa640 1 -- 172.21.15.152:0/1616908750 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c017030 con 0x7f8c6c1009b0 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c7232c640 1 -- 172.21.15.152:0/1616908750 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6c1a48c0 con 0x7f8c6c1009b0 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c697fa640 1 -- 172.21.15.152:0/1616908750 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c5c004020 con 0x7f8c6c1009b0 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c697fa640 1 -- 172.21.15.152:0/1616908750 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0047a0 con 0x7f8c6c1009b0 2024-09-11T22:07:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.845+0000 7f8c7232c640 1 -- 172.21.15.152:0/1616908750 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c6c1a4de0 con 0x7f8c6c1009b0 2024-09-11T22:07:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.848+0000 7f8c697fa640 1 -- 172.21.15.152:0/1616908750 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8c5c0041d0 con 0x7f8c6c1009b0 2024-09-11T22:07:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.848+0000 7f8c750c2740 1 Processor -- start 2024-09-11T22:07:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.848+0000 7f8c750c2740 1 -- start start 2024-09-11T22:07:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6379b0 0x558ada637d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada646b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6470c0 0x558ada6494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c750c2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558ada59c2f0 con 0x558ada6382d0 2024-09-11T22:07:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c750c2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558ada544270 con 0x558ada6379b0 2024-09-11T22:07:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c750c2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558ada5982b0 con 0x558ada6470c0 2024-09-11T22:07:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada646b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c697fa640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c540a2da0 0x7f8c540a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c708c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6379b0 0x558ada637d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada646b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56678/0 (socket says 172.21.15.152:56678) 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c6bfff640 1 -- 172.21.15.152:0/962430992 learned_addr learned my addr 172.21.15.152:0/962430992 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c6b7fe640 1 --2- 172.21.15.152:0/962430992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6470c0 0x558ada6494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c708c9640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c540a2da0 0x7f8c540a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c697fa640 1 -- 172.21.15.152:0/1616908750 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8c5c0ceeb0 con 0x7f8c6c1009b0 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c6bfff640 1 -- 172.21.15.152:0/962430992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6470c0 msgr2=0x558ada6494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/962430992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6470c0 0x558ada6494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c6bfff640 1 -- 172.21.15.152:0/962430992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6379b0 msgr2=0x558ada637d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/962430992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6379b0 0x558ada637d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c6bfff640 1 -- 172.21.15.152:0/962430992 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ada543340 con 0x558ada6382d0 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c6b7fe640 1 --2- 172.21.15.152:0/962430992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6470c0 0x558ada6494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.849+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/962430992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada646b80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0cc540 tx=0x7f8c5c004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e870e7bcf73c7432 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c527fc640 1 -- 172.21.15.152:0/962430992 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c09ad00 con 0x558ada6382d0 2024-09-11T22:07:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c708c9640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c540a2da0 0x7f8c540a5260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009430 tx=0x7f8c6402a8e0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c527fc640 1 -- 172.21.15.152:0/962430992 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c5c09baa0 con 0x558ada6382d0 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c527fc640 1 -- 172.21.15.152:0/962430992 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0a3b80 con 0x558ada6382d0 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c750c2740 1 -- 172.21.15.152:0/962430992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 msgr2=0x558ada646b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c750c2740 1 --2- 172.21.15.152:0/962430992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada646b80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0cc540 tx=0x7f8c5c004540 comp rx=0 tx=0).stop 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c750c2740 1 -- 172.21.15.152:0/962430992 shutdown_connections 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c750c2740 1 --2- 172.21.15.152:0/962430992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6470c0 0x558ada6494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c750c2740 1 --2- 172.21.15.152:0/962430992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada646b80 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c750c2740 1 --2- 172.21.15.152:0/962430992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6379b0 0x558ada637d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c750c2740 1 -- 172.21.15.152:0/962430992 >> 172.21.15.152:0/962430992 conn(0x558ada634060 msgr2=0x558ada634440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c750c2740 1 -- 172.21.15.152:0/962430992 shutdown_connections 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.850+0000 7f8c750c2740 1 -- 172.21.15.152:0/962430992 wait complete. 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c750c2740 1 -- start start 2024-09-11T22:07:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c750c2740 1 Processor -- start 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada644000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada644540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6470c0 0x558ada644a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c750c2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558ada649bd0 con 0x558ada6382d0 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c750c2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558ada525290 con 0x558ada6470c0 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c750c2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558ada649d50 con 0x558ada6379b0 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c750c2740 10 client.0 _ll_register_callbacks cb 0x558ada556140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c6b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada644540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c6b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada644540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56692/0 (socket says 172.21.15.152:56692) 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c6b7fe640 1 -- 172.21.15.152:0/2720890803 learned_addr learned my addr 172.21.15.152:0/2720890803 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.851+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada644000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c708c9640 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6470c0 0x558ada644a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c6b7fe640 1 -- 172.21.15.152:0/2720890803 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 msgr2=0x558ada644000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c6b7fe640 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada644000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c6b7fe640 1 -- 172.21.15.152:0/2720890803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6470c0 msgr2=0x558ada644a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c6b7fe640 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6470c0 0x558ada644a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c6b7fe640 1 -- 172.21.15.152:0/2720890803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ada2af210 con 0x558ada6382d0 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada644000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c6b7fe640 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada644540 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8c60012700 tx=0x7f8c60012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fdd203f1d76d7a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/2720890803 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c60004260 con 0x558ada6382d0 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/2720890803 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8c60004400 con 0x558ada6382d0 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c750c2740 1 -- 172.21.15.152:0/2720890803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c5c09baa0 con 0x558ada6382d0 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/2720890803 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8c600119a0 con 0x558ada6382d0 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c750c2740 10 client.16128 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c750c2740 1 -- 172.21.15.152:0/2720890803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558ada37b620 con 0x558ada6382d0 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/2720890803 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c5c09baa0 con 0x558ada6382d0 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/2720890803 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f8c60023070 con 0x558ada6382d0 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c750c2740 10 client.16128 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c750c2740 10 client.16128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c750c2740 20 client.16128 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c750c2740 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558ada657000 0x558ada659430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c750c2740 4 client.16128 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.852+0000 7f8c750c2740 1 -- 172.21.15.152:0/2720890803 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ada5a9a20 con 0x558ada657000 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.853+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558ada657000 0x558ada659430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.853+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558ada657000 0x558ada659430 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef16daf74eabb96d server_cookie=3a9aeb0b370f933d in_seq=0 out_seq=0 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.853+0000 7f8c4b7fe640 10 client.16128 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/2720890803 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ada5a9a20 con 0x558ada657000 2024-09-11T22:07:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c4b7fe640 10 client.16128 handle_command_reply: tid=0 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 1 client.16128 shutdown 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 1 -- 172.21.15.152:0/2720890803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 msgr2=0x558ada644540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada644540 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8c60012700 tx=0x7f8c60012bc0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 1 -- 172.21.15.152:0/2720890803 shutdown_connections 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558ada657000 0x558ada659430 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6470c0 0x558ada644a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6382d0 0x558ada644540 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c4b7fe640 0 client.16128 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 1 --2- 172.21.15.152:0/2720890803 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada644000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 1 -- 172.21.15.152:0/2720890803 >> 172.21.15.152:0/2720890803 conn(0x558ada634060 msgr2=0x558ada639d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 1 -- 172.21.15.152:0/2720890803 shutdown_connections 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 1 -- 172.21.15.152:0/2720890803 wait complete. 2024-09-11T22:07:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.854+0000 7f8c750c2740 20 client.16128 trim_cache size 0 max 16384 2024-09-11T22:07:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c750c2740 1 Processor -- start 2024-09-11T22:07:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c750c2740 1 -- start start 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada65ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6382d0 0x558ada65f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada641240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c750c2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1ae040 con 0x558ada6470c0 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c750c2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1ab8e0 con 0x558ada6382d0 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c750c2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1a9750 con 0x558ada6379b0 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c708c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada641240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c708c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada641240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56694/0 (socket says 172.21.15.152:56694) 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c708c9640 1 -- 172.21.15.152:0/3417723910 learned_addr learned my addr 172.21.15.152:0/3417723910 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/3417723910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada65ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c6b7fe640 1 --2- 172.21.15.152:0/3417723910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6382d0 0x558ada65f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c708c9640 1 -- 172.21.15.152:0/3417723910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 msgr2=0x558ada65ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c708c9640 1 --2- 172.21.15.152:0/3417723910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada65ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c708c9640 1 -- 172.21.15.152:0/3417723910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6382d0 msgr2=0x558ada65f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c708c9640 1 --2- 172.21.15.152:0/3417723910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6382d0 0x558ada65f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.870+0000 7f8c708c9640 1 -- 172.21.15.152:0/3417723910 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ada642f90 con 0x558ada6470c0 2024-09-11T22:07:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.871+0000 7f8c708c9640 1 --2- 172.21.15.152:0/3417723910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada641240 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8c64031c30 tx=0x7f8c64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42342bb2557201f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.871+0000 7f8c51ffb640 1 -- 172.21.15.152:0/3417723910 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64051070 con 0x558ada6470c0 2024-09-11T22:07:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.871+0000 7f8c51ffb640 1 -- 172.21.15.152:0/3417723910 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c64036040 con 0x558ada6470c0 2024-09-11T22:07:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.871+0000 7f8c51ffb640 1 -- 172.21.15.152:0/3417723910 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64030ce0 con 0x558ada6470c0 2024-09-11T22:07:22.876 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 -- 172.21.15.152:0/3417723910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 msgr2=0x558ada641240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 --2- 172.21.15.152:0/3417723910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada641240 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8c64031c30 tx=0x7f8c64004a40 comp rx=0 tx=0).stop 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 -- 172.21.15.152:0/3417723910 shutdown_connections 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 --2- 172.21.15.152:0/3417723910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada641240 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 --2- 172.21.15.152:0/3417723910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6382d0 0x558ada65f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 --2- 172.21.15.152:0/3417723910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada65ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 -- 172.21.15.152:0/3417723910 >> 172.21.15.152:0/3417723910 conn(0x558ada634060 msgr2=0x558ada646080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 -- 172.21.15.152:0/3417723910 shutdown_connections 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 -- 172.21.15.152:0/3417723910 wait complete. 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 -- start start 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 Processor -- start 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada64b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6382d0 0x558ada64bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada6c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1a9da0 con 0x558ada6470c0 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1ab210 con 0x558ada6382d0 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1aa470 con 0x558ada6379b0 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.872+0000 7f8c750c2740 10 client.0 _ll_register_callbacks cb 0x7f8c60009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c708c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada6c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c708c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada6c0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56704/0 (socket says 172.21.15.152:56704) 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c708c9640 1 -- 172.21.15.152:0/3555345616 learned_addr learned my addr 172.21.15.152:0/3555345616 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c6b7fe640 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6382d0 0x558ada64bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada64b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c708c9640 1 -- 172.21.15.152:0/3555345616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 msgr2=0x558ada64b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c708c9640 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada64b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c708c9640 1 -- 172.21.15.152:0/3555345616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6382d0 msgr2=0x558ada64bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c708c9640 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6382d0 0x558ada64bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c708c9640 1 -- 172.21.15.152:0/3555345616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ada6c1350 con 0x558ada6470c0 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada64b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c6b7fe640 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6382d0 0x558ada64bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c708c9640 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada6c0d10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8c6404f040 tx=0x7f8c64030c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8242347207fbd01c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/3555345616 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64051030 con 0x558ada6470c0 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/3555345616 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8c64031c60 con 0x558ada6470c0 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c750c2740 1 -- 172.21.15.152:0/3555345616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c64036040 con 0x558ada6470c0 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/3555345616 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8c64004850 con 0x558ada6470c0 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c750c2740 10 client.16134 fetch_fsmap learned FSMap version 28 2024-09-11T22:07:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c750c2740 1 -- 172.21.15.152:0/3555345616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558ada6c2660 con 0x558ada6470c0 2024-09-11T22:07:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.873+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/3555345616 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c64036040 con 0x558ada6470c0 2024-09-11T22:07:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.874+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/3555345616 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f8c64030070 con 0x558ada6470c0 2024-09-11T22:07:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.874+0000 7f8c750c2740 10 client.16134 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T22:07:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.874+0000 7f8c750c2740 10 client.16134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.874+0000 7f8c750c2740 20 client.16134 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.874+0000 7f8c750c2740 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558ada6c2d50 0x558ada6c5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.874+0000 7f8c750c2740 4 client.16134 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:07:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.874+0000 7f8c750c2740 1 -- 172.21.15.152:0/3555345616 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ada5a3d70 con 0x558ada6c2d50 2024-09-11T22:07:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.874+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558ada6c2d50 0x558ada6c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.874+0000 7f8c4b7fe640 10 client.16134 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.874+0000 7f8c6bfff640 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558ada6c2d50 0x558ada6c5170 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=829e55464769c9c2 server_cookie=65756c7e6a77c862 in_seq=0 out_seq=0 2024-09-11T22:07:22.883 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c4b7fe640 1 -- 172.21.15.152:0/3555345616 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ada5a3d70 con 0x558ada6c2d50 2024-09-11T22:07:22.883 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c4b7fe640 10 client.16134 handle_command_reply: tid=0 2024-09-11T22:07:22.883 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 1 client.16134 shutdown 2024-09-11T22:07:22.883 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 1 -- 172.21.15.152:0/3555345616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 msgr2=0x558ada6c0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.883 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada6c0d10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8c6404f040 tx=0x7f8c64030c00 comp rx=0 tx=0).stop 2024-09-11T22:07:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 1 -- 172.21.15.152:0/3555345616 shutdown_connections 2024-09-11T22:07:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558ada6c2d50 0x558ada6c5170 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ada6470c0 0x558ada6c0d10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c4b7fe640 0 client.16134 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ada6382d0 0x558ada64bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 1 --2- 172.21.15.152:0/3555345616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558ada6379b0 0x558ada64b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 1 -- 172.21.15.152:0/3555345616 >> 172.21.15.152:0/3555345616 conn(0x558ada634060 msgr2=0x558ada6329a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 1 -- 172.21.15.152:0/3555345616 shutdown_connections 2024-09-11T22:07:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 1 -- 172.21.15.152:0/3555345616 wait complete. 2024-09-11T22:07:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.882+0000 7f8c750c2740 20 client.16134 trim_cache size 0 max 16384 2024-09-11T22:07:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:07:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:07:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:07:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:07:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 -- 172.21.15.152:0/1616908750 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c540a2da0 msgr2=0x7f8c540a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c540a2da0 0x7f8c540a5260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009430 tx=0x7f8c6402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 -- 172.21.15.152:0/1616908750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6c1009b0 msgr2=0x7f8c6c199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6c1009b0 0x7f8c6c199130 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00d950 tx=0x7f8c5c00de10 comp rx=0 tx=0).stop 2024-09-11T22:07:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 -- 172.21.15.152:0/1616908750 shutdown_connections 2024-09-11T22:07:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c540a2da0 0x7f8c540a5260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6c1069c0 0x7f8c6c1a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c101350 0x7f8c6c199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 --2- 172.21.15.152:0/1616908750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6c1009b0 0x7f8c6c199130 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 -- 172.21.15.152:0/1616908750 >> 172.21.15.152:0/1616908750 conn(0x7f8c6c077990 msgr2=0x7f8c6c0fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 -- 172.21.15.152:0/1616908750 shutdown_connections 2024-09-11T22:07:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:22.883+0000 7f8c7232c640 1 -- 172.21.15.152:0/1616908750 wait complete. 2024-09-11T22:07:23.184 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:07:23.435 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:07:23.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:23 smithi179 ceph-mon[35603]: pgmap v96: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 608 op/s 2024-09-11T22:07:23.803 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:23 smithi152 ceph-mon[31188]: pgmap v96: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 608 op/s 2024-09-11T22:07:23.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:23 smithi193 ceph-mon[35545]: pgmap v96: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 608 op/s 2024-09-11T22:07:23.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.884+0000 7f553e3f9640 1 -- 172.21.15.152:0/1615202195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5538106a70 msgr2=0x7f5538106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:23.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.884+0000 7f553e3f9640 1 --2- 172.21.15.152:0/1615202195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5538106a70 0x7f5538106e50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5528009930 tx=0x7f552802a420 comp rx=0 tx=0).stop 2024-09-11T22:07:23.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.885+0000 7f553e3f9640 1 -- 172.21.15.152:0/1615202195 shutdown_connections 2024-09-11T22:07:23.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.885+0000 7f553e3f9640 1 --2- 172.21.15.152:0/1615202195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5538101410 0x7f553810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:23.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.885+0000 7f553e3f9640 1 --2- 172.21.15.152:0/1615202195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5538100a70 0x7f5538100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:23.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.885+0000 7f553e3f9640 1 --2- 172.21.15.152:0/1615202195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5538106a70 0x7f5538106e50 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:23.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.885+0000 7f553e3f9640 1 -- 172.21.15.152:0/1615202195 >> 172.21.15.152:0/1615202195 conn(0x7f55380fc790 msgr2=0x7f55380febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:23.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.885+0000 7f553e3f9640 1 -- 172.21.15.152:0/1615202195 shutdown_connections 2024-09-11T22:07:23.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.885+0000 7f553e3f9640 1 -- 172.21.15.152:0/1615202195 wait complete. 2024-09-11T22:07:23.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.885+0000 7f553e3f9640 1 Processor -- start 2024-09-11T22:07:23.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.885+0000 7f553e3f9640 1 -- start start 2024-09-11T22:07:23.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f553e3f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5538100a70 0x7f55381973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f553e3f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5538101410 0x7f5538197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f553e3f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5538106a70 0x7f553819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f553e3f9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5538110eb0 con 0x7f5538100a70 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f553e3f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5538110d30 con 0x7f5538101410 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f553e3f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5538111030 con 0x7f5538106a70 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5537fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5538100a70 0x7f55381973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5537fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5538100a70 0x7f55381973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42558/0 (socket says 172.21.15.152:42558) 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5537fff640 1 -- 172.21.15.152:0/2973460355 learned_addr learned my addr 172.21.15.152:0/2973460355 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f552ffff640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5538101410 0x7f5538197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f553c996640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5538106a70 0x7f553819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5537fff640 1 -- 172.21.15.152:0/2973460355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5538106a70 msgr2=0x7f553819bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:23.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5537fff640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5538106a70 0x7f553819bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5537fff640 1 -- 172.21.15.152:0/2973460355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5538101410 msgr2=0x7f5538197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5537fff640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5538101410 0x7f5538197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5537fff640 1 -- 172.21.15.152:0/2973460355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553819c390 con 0x7f5538100a70 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5537fff640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5538100a70 0x7f55381973e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5528009230 tx=0x7f5528004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5535ffb640 1 -- 172.21.15.152:0/2973460355 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552803f030 con 0x7f5538100a70 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f553e3f9640 1 -- 172.21.15.152:0/2973460355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553819c620 con 0x7f5538100a70 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5535ffb640 1 -- 172.21.15.152:0/2973460355 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5528003ad0 con 0x7f5538100a70 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.886+0000 7f5535ffb640 1 -- 172.21.15.152:0/2973460355 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528035070 con 0x7f5538100a70 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.887+0000 7f553e3f9640 1 -- 172.21.15.152:0/2973460355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55381a3f60 con 0x7f5538100a70 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.888+0000 7f553e3f9640 1 -- 172.21.15.152:0/2973460355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55381021b0 con 0x7f5538100a70 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.888+0000 7f5535ffb640 1 -- 172.21.15.152:0/2973460355 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f5528042030 con 0x7f5538100a70 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.889+0000 7f5535ffb640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55240a2cf0 0x7f55240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:23.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.889+0000 7f552ffff640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55240a2cf0 0x7f55240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:23.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.889+0000 7f5535ffb640 1 -- 172.21.15.152:0/2973460355 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f55280efa80 con 0x7f5538100a70 2024-09-11T22:07:23.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.890+0000 7f552ffff640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55240a2cf0 0x7f55240a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f55380fee80 tx=0x7f5520008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:23.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:23.893+0000 7f5535ffb640 1 -- 172.21.15.152:0/2973460355 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55280f1e20 con 0x7f5538100a70 2024-09-11T22:07:24.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.093+0000 7f553e3f9640 1 -- 172.21.15.152:0/2973460355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5538108fe0 con 0x7f5538100a70 2024-09-11T22:07:24.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.094+0000 7f5535ffb640 1 -- 172.21.15.152:0/2973460355 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11925 (secure 0 0 0) 0x7f55280bc610 con 0x7f5538100a70 2024-09-11T22:07:24.096 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:07:24.096 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"btime":"2024-09-11T22:06:38:855821+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:06:38.805635+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:07:24.096 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 28 2024-09-11T22:07:24.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 -- 172.21.15.152:0/2973460355 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55240a2cf0 msgr2=0x7f55240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:24.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55240a2cf0 0x7f55240a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f55380fee80 tx=0x7f5520008040 comp rx=0 tx=0).stop 2024-09-11T22:07:24.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 -- 172.21.15.152:0/2973460355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5538100a70 msgr2=0x7f55381973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:24.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5538100a70 0x7f55381973e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5528009230 tx=0x7f5528004270 comp rx=0 tx=0).stop 2024-09-11T22:07:24.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 -- 172.21.15.152:0/2973460355 shutdown_connections 2024-09-11T22:07:24.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55240a2cf0 0x7f55240a51b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:24.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5538106a70 0x7f553819bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:24.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5538101410 0x7f5538197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:24.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 --2- 172.21.15.152:0/2973460355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5538100a70 0x7f55381973e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:24.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 -- 172.21.15.152:0/2973460355 >> 172.21.15.152:0/2973460355 conn(0x7f55380fc790 msgr2=0x7f55380fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:24.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 -- 172.21.15.152:0/2973460355 shutdown_connections 2024-09-11T22:07:24.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:24.097+0000 7f553e3f9640 1 -- 172.21.15.152:0/2973460355 wait complete. 2024-09-11T22:07:24.375 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:07:24.375 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:07:24.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:24 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2973460355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:07:24.789 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id a442924a --release --await' 2024-09-11T22:07:24.789 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id a442924a --release --await 2024-09-11T22:07:24.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:24 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2973460355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:07:24.812 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:07:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:07:24.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:24 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2973460355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:07:25.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.305+0000 7f2c6d259640 1 -- 172.21.15.152:0/23194612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c681036e0 msgr2=0x7f2c68107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:25.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.305+0000 7f2c6d259640 1 --2- 172.21.15.152:0/23194612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c681036e0 0x7f2c68107b90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009930 tx=0x7f2c5c02a420 comp rx=0 tx=0).stop 2024-09-11T22:07:25.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.305+0000 7f2c6d259640 1 -- 172.21.15.152:0/23194612 shutdown_connections 2024-09-11T22:07:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.305+0000 7f2c6d259640 1 --2- 172.21.15.152:0/23194612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c681082a0 0x7f2c6810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.305+0000 7f2c6d259640 1 --2- 172.21.15.152:0/23194612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c681036e0 0x7f2c68107b90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.305+0000 7f2c6d259640 1 --2- 172.21.15.152:0/23194612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c68102d30 0x7f2c68103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.305+0000 7f2c6d259640 1 -- 172.21.15.152:0/23194612 >> 172.21.15.152:0/23194612 conn(0x7f2c680fc7d0 msgr2=0x7f2c680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.305+0000 7f2c6d259640 1 -- 172.21.15.152:0/23194612 shutdown_connections 2024-09-11T22:07:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.305+0000 7f2c6d259640 1 -- 172.21.15.152:0/23194612 wait complete. 2024-09-11T22:07:25.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.306+0000 7f2c6d259640 1 Processor -- start 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6d259640 1 -- start start 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6d259640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c68102d30 0x7f2c68100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6d259640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c681036e0 0x7f2c68100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6d259640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c681082a0 0x7f2c68101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6d259640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681120a0 con 0x7f2c681036e0 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6d259640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2c68111f20 con 0x7f2c681082a0 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6d259640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2c68112220 con 0x7f2c68102d30 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c681036e0 0x7f2c68100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c681036e0 0x7f2c68100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42588/0 (socket says 172.21.15.152:42588) 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6659c640 1 -- 172.21.15.152:0/3211394673 learned_addr learned my addr 172.21.15.152:0/3211394673 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6759e640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c681082a0 0x7f2c68101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c66d9d640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c68102d30 0x7f2c68100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6659c640 1 -- 172.21.15.152:0/3211394673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c68102d30 msgr2=0x7f2c68100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6659c640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c68102d30 0x7f2c68100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6659c640 1 -- 172.21.15.152:0/3211394673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c681082a0 msgr2=0x7f2c68101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6659c640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c681082a0 0x7f2c68101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.307+0000 7f2c6659c640 1 -- 172.21.15.152:0/3211394673 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c681a6b40 con 0x7f2c681036e0 2024-09-11T22:07:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.308+0000 7f2c6659c640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c681036e0 0x7f2c68100ed0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c005940 tx=0x7f2c5c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.308+0000 7f2c4ffff640 1 -- 172.21.15.152:0/3211394673 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c03f030 con 0x7f2c681036e0 2024-09-11T22:07:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.308+0000 7f2c6d259640 1 -- 172.21.15.152:0/3211394673 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c681a6dd0 con 0x7f2c681036e0 2024-09-11T22:07:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.308+0000 7f2c4ffff640 1 -- 172.21.15.152:0/3211394673 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c5c003ce0 con 0x7f2c681036e0 2024-09-11T22:07:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.308+0000 7f2c4ffff640 1 -- 172.21.15.152:0/3211394673 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c035070 con 0x7f2c681036e0 2024-09-11T22:07:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.308+0000 7f2c6d259640 1 -- 172.21.15.152:0/3211394673 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c681a7270 con 0x7f2c681036e0 2024-09-11T22:07:25.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.310+0000 7f2c4ffff640 1 -- 172.21.15.152:0/3211394673 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f2c5c042030 con 0x7f2c681036e0 2024-09-11T22:07:25.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.311+0000 7f2c6f632740 1 Processor -- start 2024-09-11T22:07:25.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.311+0000 7f2c6f632740 1 -- start start 2024-09-11T22:07:25.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.311+0000 7f2c4ffff640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c500a2cf0 0x7f2c500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.311+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1939b60 0x5623b1939f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.311+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b1944800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.311+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b1944d40 0x5623b1947130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.311+0000 7f2c6f632740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5623b189f280 con 0x5623b193a480 2024-09-11T22:07:25.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.311+0000 7f2c6f632740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5623b1846b10 con 0x5623b1944d40 2024-09-11T22:07:25.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.311+0000 7f2c6f632740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5623b189b240 con 0x5623b1939b60 2024-09-11T22:07:25.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.311+0000 7f2c4ffff640 1 -- 172.21.15.152:0/3211394673 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f2c5c0ef8d0 con 0x7f2c681036e0 2024-09-11T22:07:25.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.311+0000 7f2c6759e640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c500a2cf0 0x7f2c500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c6659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b1944800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c6659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b1944800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42594/0 (socket says 172.21.15.152:42594) 2024-09-11T22:07:25.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c6659c640 1 -- 172.21.15.152:0/4281952896 learned_addr learned my addr 172.21.15.152:0/4281952896 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:25.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c6759e640 1 --2- 172.21.15.152:0/4281952896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b1944d40 0x5623b1947130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c66d9d640 1 --2- 172.21.15.152:0/4281952896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1939b60 0x5623b1939f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c6659c640 1 -- 172.21.15.152:0/4281952896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1939b60 msgr2=0x5623b1939f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:25.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c6659c640 1 --2- 172.21.15.152:0/4281952896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1939b60 0x5623b1939f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c6659c640 1 -- 172.21.15.152:0/4281952896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b1944d40 msgr2=0x5623b1947130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:25.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c6659c640 1 --2- 172.21.15.152:0/4281952896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b1944d40 0x5623b1947130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c6659c640 1 -- 172.21.15.152:0/4281952896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b18531f0 con 0x5623b193a480 2024-09-11T22:07:25.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c6759e640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c500a2cf0 0x7f2c500a51b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000a780 tx=0x7f2c6000a940 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:25.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c6659c640 1 --2- 172.21.15.152:0/4281952896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b1944800 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0c4500 tx=0x7f2c5c0bba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22da0b9ca6f917c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:25.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c4d7fa640 1 -- 172.21.15.152:0/4281952896 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c049040 con 0x5623b193a480 2024-09-11T22:07:25.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c4d7fa640 1 -- 172.21.15.152:0/4281952896 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c5c0c4a30 con 0x5623b193a480 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.312+0000 7f2c4d7fa640 1 -- 172.21.15.152:0/4281952896 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c03bc50 con 0x5623b193a480 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.313+0000 7f2c6f632740 1 -- 172.21.15.152:0/4281952896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 msgr2=0x5623b1944800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.313+0000 7f2c6f632740 1 --2- 172.21.15.152:0/4281952896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b1944800 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0c4500 tx=0x7f2c5c0bba70 comp rx=0 tx=0).stop 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.313+0000 7f2c6f632740 1 -- 172.21.15.152:0/4281952896 shutdown_connections 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.313+0000 7f2c6f632740 1 --2- 172.21.15.152:0/4281952896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b1944d40 0x5623b1947130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.313+0000 7f2c6f632740 1 --2- 172.21.15.152:0/4281952896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b1944800 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.313+0000 7f2c6f632740 1 --2- 172.21.15.152:0/4281952896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1939b60 0x5623b1939f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.313+0000 7f2c6f632740 1 -- 172.21.15.152:0/4281952896 >> 172.21.15.152:0/4281952896 conn(0x5623b19360f0 msgr2=0x5623b19364d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.313+0000 7f2c6f632740 1 -- 172.21.15.152:0/4281952896 shutdown_connections 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.313+0000 7f2c6f632740 1 -- 172.21.15.152:0/4281952896 wait complete. 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6f632740 1 -- start start 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6f632740 1 Processor -- start 2024-09-11T22:07:25.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1939b60 0x5623b1941c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b193a480 0x5623b1942150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1944d40 0x5623b1942690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6f632740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5623b19476d0 con 0x5623b1944d40 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6f632740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5623b1859f10 con 0x5623b193a480 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6f632740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5623b1947850 con 0x5623b1939b60 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6f632740 10 client.0 _ll_register_callbacks cb 0x5623b1822a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6759e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1944d40 0x5623b1942690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6759e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1944d40 0x5623b1942690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42598/0 (socket says 172.21.15.152:42598) 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6759e640 1 -- 172.21.15.152:0/1157003503 learned_addr learned my addr 172.21.15.152:0/1157003503 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c66d9d640 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1939b60 0x5623b1941c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.314+0000 7f2c6659c640 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b193a480 0x5623b1942150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c6759e640 1 -- 172.21.15.152:0/1157003503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1939b60 msgr2=0x5623b1941c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:25.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c6759e640 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1939b60 0x5623b1941c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c6759e640 1 -- 172.21.15.152:0/1157003503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b193a480 msgr2=0x5623b1942150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:25.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c6759e640 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b193a480 0x5623b1942150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c6759e640 1 -- 172.21.15.152:0/1157003503 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b16106a0 con 0x5623b1944d40 2024-09-11T22:07:25.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c6759e640 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1944d40 0x5623b1942690 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000f950 tx=0x7f2c60004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fec847d223c889 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:25.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:25.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c4aff5640 1 -- 172.21.15.152:0/1157003503 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60004d20 con 0x5623b1944d40 2024-09-11T22:07:25.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c4aff5640 1 -- 172.21.15.152:0/1157003503 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f2c60003970 con 0x5623b1944d40 2024-09-11T22:07:25.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c6f632740 1 -- 172.21.15.152:0/1157003503 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c5c0c4a30 con 0x5623b1944d40 2024-09-11T22:07:25.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c4aff5640 1 -- 172.21.15.152:0/1157003503 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2c60011e60 con 0x5623b1944d40 2024-09-11T22:07:25.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c6f632740 10 client.16152 fetch_fsmap learned FSMap version 29 2024-09-11T22:07:25.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.315+0000 7f2c6f632740 1 -- 172.21.15.152:0/1157003503 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5623b1953240 con 0x5623b1944d40 2024-09-11T22:07:25.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.316+0000 7f2c4aff5640 1 -- 172.21.15.152:0/1157003503 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c5c0c4a30 con 0x5623b1944d40 2024-09-11T22:07:25.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.316+0000 7f2c4aff5640 1 -- 172.21.15.152:0/1157003503 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f2c6001f070 con 0x5623b1944d40 2024-09-11T22:07:25.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.316+0000 7f2c6f632740 10 client.16152 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T22:07:25.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.316+0000 7f2c6f632740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:25.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.316+0000 7f2c6f632740 20 client.16152 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:25.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.316+0000 7f2c6f632740 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5623b19546a0 0x5623b1956af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.316+0000 7f2c6f632740 4 client.16152 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.316+0000 7f2c6f632740 1 -- 172.21.15.152:0/1157003503 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623b18ac7f0 con 0x5623b19546a0 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.316+0000 7f2c66d9d640 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5623b19546a0 0x5623b1956af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.317+0000 7f2c4aff5640 10 client.16152 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.317+0000 7f2c66d9d640 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5623b19546a0 0x5623b1956af0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c9f6eeddbda39cf server_cookie=e2504d9602ede9a3 in_seq=0 out_seq=0 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.317+0000 7f2c4aff5640 1 -- 172.21.15.152:0/1157003503 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623b18ac7f0 con 0x5623b19546a0 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.317+0000 7f2c4aff5640 10 client.16152 handle_command_reply: tid=0 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.317+0000 7f2c6f632740 1 client.16152 shutdown 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c6f632740 1 -- 172.21.15.152:0/1157003503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1944d40 msgr2=0x5623b1942690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c6f632740 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1944d40 0x5623b1942690 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000f950 tx=0x7f2c60004ab0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c6f632740 1 -- 172.21.15.152:0/1157003503 shutdown_connections 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c6f632740 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5623b19546a0 0x5623b1956af0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c6f632740 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1944d40 0x5623b1942690 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c6f632740 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b193a480 0x5623b1942150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c4aff5640 0 client.16152 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:25.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c6f632740 1 --2- 172.21.15.152:0/1157003503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1939b60 0x5623b1941c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c6f632740 1 -- 172.21.15.152:0/1157003503 >> 172.21.15.152:0/1157003503 conn(0x5623b19360f0 msgr2=0x5623b193bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:25.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c6f632740 1 -- 172.21.15.152:0/1157003503 shutdown_connections 2024-09-11T22:07:25.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c6f632740 1 -- 172.21.15.152:0/1157003503 wait complete. 2024-09-11T22:07:25.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.318+0000 7f2c6f632740 20 client.16152 trim_cache size 0 max 16384 2024-09-11T22:07:25.334 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:07:25.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.336+0000 7f2c6f632740 1 Processor -- start 2024-09-11T22:07:25.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.336+0000 7f2c6f632740 1 -- start start 2024-09-11T22:07:25.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b1939b60 0x5623b193bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b195c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1944d40 0x5623b195c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6f632740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681b24a0 con 0x5623b193a480 2024-09-11T22:07:25.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6f632740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681afd70 con 0x5623b1939b60 2024-09-11T22:07:25.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6f632740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681adbc0 con 0x5623b1944d40 2024-09-11T22:07:25.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b195c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b195c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42614/0 (socket says 172.21.15.152:42614) 2024-09-11T22:07:25.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6659c640 1 -- 172.21.15.152:0/807152860 learned_addr learned my addr 172.21.15.152:0/807152860 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:25.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c66d9d640 1 --2- 172.21.15.152:0/807152860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b1939b60 0x5623b193bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6759e640 1 --2- 172.21.15.152:0/807152860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1944d40 0x5623b195c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6659c640 1 -- 172.21.15.152:0/807152860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1944d40 msgr2=0x5623b195c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:25.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6659c640 1 --2- 172.21.15.152:0/807152860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1944d40 0x5623b195c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6659c640 1 -- 172.21.15.152:0/807152860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b1939b60 msgr2=0x5623b193bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:25.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6659c640 1 --2- 172.21.15.152:0/807152860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b1939b60 0x5623b193bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6659c640 1 -- 172.21.15.152:0/807152860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b1936d80 con 0x5623b193a480 2024-09-11T22:07:25.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.337+0000 7f2c6659c640 1 --2- 172.21.15.152:0/807152860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b195c3c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0bbe00 tx=0x7f2c5c03b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae602b519df9fa1d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:25.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.338+0000 7f2c4cff9640 1 -- 172.21.15.152:0/807152860 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c049040 con 0x5623b193a480 2024-09-11T22:07:25.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.338+0000 7f2c4cff9640 1 -- 172.21.15.152:0/807152860 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c5c03b460 con 0x5623b193a480 2024-09-11T22:07:25.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.338+0000 7f2c4cff9640 1 -- 172.21.15.152:0/807152860 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c0c45a0 con 0x5623b193a480 2024-09-11T22:07:25.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.338+0000 7f2c6f632740 1 -- 172.21.15.152:0/807152860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 msgr2=0x5623b195c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:25.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.338+0000 7f2c6f632740 1 --2- 172.21.15.152:0/807152860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b195c3c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0bbe00 tx=0x7f2c5c03b720 comp rx=0 tx=0).stop 2024-09-11T22:07:25.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.338+0000 7f2c6f632740 1 -- 172.21.15.152:0/807152860 shutdown_connections 2024-09-11T22:07:25.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.338+0000 7f2c6f632740 1 --2- 172.21.15.152:0/807152860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1944d40 0x5623b195c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.338+0000 7f2c6f632740 1 --2- 172.21.15.152:0/807152860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b193a480 0x5623b195c3c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.338+0000 7f2c6f632740 1 --2- 172.21.15.152:0/807152860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b1939b60 0x5623b193bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.338+0000 7f2c6f632740 1 -- 172.21.15.152:0/807152860 >> 172.21.15.152:0/807152860 conn(0x5623b19360f0 msgr2=0x5623b193b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:25.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.339+0000 7f2c6f632740 1 -- 172.21.15.152:0/807152860 shutdown_connections 2024-09-11T22:07:25.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.339+0000 7f2c6f632740 1 -- 172.21.15.152:0/807152860 wait complete. 2024-09-11T22:07:25.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.339+0000 7f2c6f632740 1 -- start start 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.339+0000 7f2c6f632740 1 Processor -- start 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.339+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1939b60 0x5623b1948870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.339+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b193a480 0x5623b1948db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.339+0000 7f2c6f632740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1944d40 0x5623b19492f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.339+0000 7f2c6f632740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681ae230 con 0x5623b1939b60 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.339+0000 7f2c6f632740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681af6a0 con 0x5623b193a480 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.339+0000 7f2c6f632740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681ae900 con 0x5623b1944d40 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.339+0000 7f2c6f632740 10 client.0 _ll_register_callbacks cb 0x7f2c6000a890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c66d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1939b60 0x5623b1948870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c66d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1939b60 0x5623b1948870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42630/0 (socket says 172.21.15.152:42630) 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c66d9d640 1 -- 172.21.15.152:0/135110953 learned_addr learned my addr 172.21.15.152:0/135110953 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c6659c640 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b193a480 0x5623b1948db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c6759e640 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1944d40 0x5623b19492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c66d9d640 1 -- 172.21.15.152:0/135110953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1944d40 msgr2=0x5623b19492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c66d9d640 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1944d40 0x5623b19492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c66d9d640 1 -- 172.21.15.152:0/135110953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b193a480 msgr2=0x5623b1948db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c66d9d640 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b193a480 0x5623b1948db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c66d9d640 1 -- 172.21.15.152:0/135110953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b19be490 con 0x5623b1939b60 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c6659c640 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b193a480 0x5623b1948db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c66d9d640 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1939b60 0x5623b1948870 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800aba0 tx=0x7f2c58010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2808f94c2a5324d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c4aff5640 1 -- 172.21.15.152:0/135110953 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58004220 con 0x5623b1939b60 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c6f632740 1 -- 172.21.15.152:0/135110953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c5c03b460 con 0x5623b1939b60 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.340+0000 7f2c4aff5640 1 -- 172.21.15.152:0/135110953 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f2c580043c0 con 0x5623b1939b60 2024-09-11T22:07:25.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c4aff5640 1 -- 172.21.15.152:0/135110953 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2c5801d860 con 0x5623b1939b60 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c6f632740 10 client.16158 fetch_fsmap learned FSMap version 29 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c6f632740 1 -- 172.21.15.152:0/135110953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5623b19bf810 con 0x5623b1939b60 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c4aff5640 1 -- 172.21.15.152:0/135110953 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c5c03b460 con 0x5623b1939b60 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c4aff5640 1 -- 172.21.15.152:0/135110953 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f2c58026400 con 0x5623b1939b60 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c6f632740 10 client.16158 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c6f632740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c6f632740 20 client.16158 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c6f632740 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5623b19bff90 0x5623b19c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c6f632740 4 client.16158 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c6f632740 1 -- 172.21.15.152:0/135110953 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5623b18a6d00 con 0x5623b19bff90 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.341+0000 7f2c6659c640 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5623b19bff90 0x5623b19c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.342+0000 7f2c6659c640 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5623b19bff90 0x5623b19c23b0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e43809ce253afbc7 server_cookie=f597a1dd95acf094 in_seq=0 out_seq=0 2024-09-11T22:07:25.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.342+0000 7f2c4aff5640 10 client.16158 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:25.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.343+0000 7f2c4aff5640 1 -- 172.21.15.152:0/135110953 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5623b18a6d00 con 0x5623b19bff90 2024-09-11T22:07:25.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.343+0000 7f2c4aff5640 10 client.16158 handle_command_reply: tid=0 2024-09-11T22:07:25.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.343+0000 7f2c6f632740 1 client.16158 shutdown 2024-09-11T22:07:25.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.343+0000 7f2c6f632740 1 -- 172.21.15.152:0/135110953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1939b60 msgr2=0x5623b1948870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:25.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.343+0000 7f2c6f632740 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1939b60 0x5623b1948870 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800aba0 tx=0x7f2c58010af0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.344+0000 7f2c6f632740 1 -- 172.21.15.152:0/135110953 shutdown_connections 2024-09-11T22:07:25.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.344+0000 7f2c6f632740 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5623b19bff90 0x5623b19c23b0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.344+0000 7f2c6f632740 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b1944d40 0x5623b19492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.344+0000 7f2c4aff5640 0 client.16158 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:25.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.344+0000 7f2c6f632740 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5623b193a480 0x5623b1948db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.344+0000 7f2c6f632740 1 --2- 172.21.15.152:0/135110953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623b1939b60 0x5623b1948870 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.344+0000 7f2c6f632740 1 -- 172.21.15.152:0/135110953 >> 172.21.15.152:0/135110953 conn(0x5623b19360f0 msgr2=0x5623b19423f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:25.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.344+0000 7f2c6f632740 1 -- 172.21.15.152:0/135110953 shutdown_connections 2024-09-11T22:07:25.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.344+0000 7f2c6f632740 1 -- 172.21.15.152:0/135110953 wait complete. 2024-09-11T22:07:25.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.344+0000 7f2c6f632740 20 client.16158 trim_cache size 0 max 16384 2024-09-11T22:07:25.349 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:07:25.349 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:07:25.350 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "cb584c61-5b5f-4815-83a8-de721b1dc7a5", 2024-09-11T22:07:25.350 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:07:25.350 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:07:25.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 -- 172.21.15.152:0/3211394673 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c500a2cf0 msgr2=0x7f2c500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:25.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c500a2cf0 0x7f2c500a51b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000a780 tx=0x7f2c6000a940 comp rx=0 tx=0).stop 2024-09-11T22:07:25.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 -- 172.21.15.152:0/3211394673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c681036e0 msgr2=0x7f2c68100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c681036e0 0x7f2c68100ed0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c005940 tx=0x7f2c5c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 -- 172.21.15.152:0/3211394673 shutdown_connections 2024-09-11T22:07:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c500a2cf0 0x7f2c500a51b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c681082a0 0x7f2c68101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c681036e0 0x7f2c68100ed0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 --2- 172.21.15.152:0/3211394673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c68102d30 0x7f2c68100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 -- 172.21.15.152:0/3211394673 >> 172.21.15.152:0/3211394673 conn(0x7f2c680fc7d0 msgr2=0x7f2c68105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 -- 172.21.15.152:0/3211394673 shutdown_connections 2024-09-11T22:07:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:25.345+0000 7f2c6d259640 1 -- 172.21.15.152:0/3211394673 wait complete. 2024-09-11T22:07:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:25 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:07:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:25 smithi152 ceph-mon[31188]: pgmap v97: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 603 op/s 2024-09-11T22:07:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:25 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:07:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:25 smithi179 ceph-mon[35603]: pgmap v97: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 603 op/s 2024-09-11T22:07:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:25 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:07:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:25 smithi193 ceph-mon[35545]: pgmap v97: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 603 op/s 2024-09-11T22:07:26.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.052+0000 7f026a73f640 1 -- 172.21.15.152:0/2976981334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0264102790 msgr2=0x7f02641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:26.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.052+0000 7f026a73f640 1 --2- 172.21.15.152:0/2976981334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0264102790 0x7f02641067e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0258009900 tx=0x7f025802a410 comp rx=0 tx=0).stop 2024-09-11T22:07:26.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.052+0000 7f026a73f640 1 -- 172.21.15.152:0/2976981334 shutdown_connections 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.052+0000 7f026a73f640 1 --2- 172.21.15.152:0/2976981334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264106f10 0x7f026410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.052+0000 7f026a73f640 1 --2- 172.21.15.152:0/2976981334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0264102790 0x7f02641067e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.052+0000 7f026a73f640 1 --2- 172.21.15.152:0/2976981334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264101de0 0x7f02641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.052+0000 7f026a73f640 1 -- 172.21.15.152:0/2976981334 >> 172.21.15.152:0/2976981334 conn(0x7f02640fd8c0 msgr2=0x7f02640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.052+0000 7f026a73f640 1 -- 172.21.15.152:0/2976981334 shutdown_connections 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.052+0000 7f026a73f640 1 -- 172.21.15.152:0/2976981334 wait complete. 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.053+0000 7f026a73f640 1 Processor -- start 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.053+0000 7f026a73f640 1 -- start start 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.053+0000 7f026a73f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0264101de0 0x7f02640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.053+0000 7f026a73f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264102790 0x7f0264074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.053+0000 7f026a73f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264106f10 0x7f0264074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.053+0000 7f026a73f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0264111f30 con 0x7f0264101de0 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.053+0000 7f026a73f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0264111db0 con 0x7f0264106f10 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.053+0000 7f026a73f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f02641120b0 con 0x7f0264102790 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.053+0000 7f0263fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0264101de0 0x7f02640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.053+0000 7f0263fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0264101de0 0x7f02640744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42650/0 (socket says 172.21.15.152:42650) 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f0263fff640 1 -- 172.21.15.152:0/1624426575 learned_addr learned my addr 172.21.15.152:0/1624426575 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f0268cdc640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264106f10 0x7f0264074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f02637fe640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264102790 0x7f0264074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f0263fff640 1 -- 172.21.15.152:0/1624426575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264102790 msgr2=0x7f0264074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f0263fff640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264102790 0x7f0264074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f0263fff640 1 -- 172.21.15.152:0/1624426575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264106f10 msgr2=0x7f0264074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f0263fff640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264106f10 0x7f0264074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f0263fff640 1 -- 172.21.15.152:0/1624426575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02641a68e0 con 0x7f0264101de0 2024-09-11T22:07:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f02637fe640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264102790 0x7f0264074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f0263fff640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0264101de0 0x7f02640744f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f025400d770 tx=0x7f025400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f02617fa640 1 -- 172.21.15.152:0/1624426575 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254017070 con 0x7f0264101de0 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f02617fa640 1 -- 172.21.15.152:0/1624426575 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0254005500 con 0x7f0264101de0 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f026a73f640 1 -- 172.21.15.152:0/1624426575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02641a6bd0 con 0x7f0264101de0 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f02617fa640 1 -- 172.21.15.152:0/1624426575 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254004e40 con 0x7f0264101de0 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.054+0000 7f026a73f640 1 -- 172.21.15.152:0/1624426575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02641a70c0 con 0x7f0264101de0 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.056+0000 7f02617fa640 1 -- 172.21.15.152:0/1624426575 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0254009c30 con 0x7f0264101de0 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f026cb18740 1 Processor -- start 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f026cb18740 1 -- start start 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f026cb18740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a60060 0x55b640a60440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f026cb18740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60980 0x55b640a6ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f026cb18740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f026cb18740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b6409c5620 con 0x55b640a6b240 2024-09-11T22:07:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f026cb18740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b64096ce50 con 0x55b640a60060 2024-09-11T22:07:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f026cb18740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b6409c15e0 con 0x55b640a60980 2024-09-11T22:07:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f02617fa640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f024c0a2cf0 0x7f024c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f02637fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f02637fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42652/0 (socket says 172.21.15.152:42652) 2024-09-11T22:07:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f02637fe640 1 -- 172.21.15.152:0/340816517 learned_addr learned my addr 172.21.15.152:0/340816517 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f0268cdc640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f024c0a2cf0 0x7f024c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f02617fa640 1 -- 172.21.15.152:0/1624426575 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f02540cef10 con 0x7f0264101de0 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f0268cdc640 1 --2- 172.21.15.152:0/340816517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a60060 0x55b640a60440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.057+0000 7f0263fff640 1 --2- 172.21.15.152:0/340816517 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60980 0x55b640a6ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.058+0000 7f02637fe640 1 -- 172.21.15.152:0/340816517 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60980 msgr2=0x55b640a6ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.058+0000 7f02637fe640 1 --2- 172.21.15.152:0/340816517 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60980 0x55b640a6ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.058+0000 7f02637fe640 1 -- 172.21.15.152:0/340816517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a60060 msgr2=0x55b640a60440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.058+0000 7f02637fe640 1 --2- 172.21.15.152:0/340816517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a60060 0x55b640a60440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.058+0000 7f02637fe640 1 -- 172.21.15.152:0/340816517 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b64095dd40 con 0x55b640a6b240 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.058+0000 7f0268cdc640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f024c0a2cf0 0x7f024c0a51b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f025c0098b0 tx=0x7f025c009d90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.058+0000 7f02637fe640 1 --2- 172.21.15.152:0/340816517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6d630 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0258005c40 tx=0x7f0258032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7c9cecb4552208 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.058+0000 7f024a7fc640 1 -- 172.21.15.152:0/340816517 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025803f070 con 0x55b640a6b240 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.058+0000 7f024a7fc640 1 -- 172.21.15.152:0/340816517 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0258032e20 con 0x55b640a6b240 2024-09-11T22:07:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.058+0000 7f024a7fc640 1 -- 172.21.15.152:0/340816517 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258035070 con 0x55b640a6b240 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.059+0000 7f026cb18740 1 -- 172.21.15.152:0/340816517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 msgr2=0x55b640a6d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.059+0000 7f026cb18740 1 --2- 172.21.15.152:0/340816517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6d630 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0258005c40 tx=0x7f0258032cb0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.059+0000 7f026cb18740 1 -- 172.21.15.152:0/340816517 shutdown_connections 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.059+0000 7f026cb18740 1 --2- 172.21.15.152:0/340816517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6d630 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.059+0000 7f026cb18740 1 --2- 172.21.15.152:0/340816517 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60980 0x55b640a6ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.059+0000 7f026cb18740 1 --2- 172.21.15.152:0/340816517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a60060 0x55b640a60440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.059+0000 7f026cb18740 1 -- 172.21.15.152:0/340816517 >> 172.21.15.152:0/340816517 conn(0x55b640a5c5f0 msgr2=0x55b640a5c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.059+0000 7f026cb18740 1 -- 172.21.15.152:0/340816517 shutdown_connections 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.059+0000 7f026cb18740 1 -- 172.21.15.152:0/340816517 wait complete. 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.059+0000 7f026cb18740 1 -- start start 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.059+0000 7f026cb18740 1 Processor -- start 2024-09-11T22:07:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f026cb18740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60060 0x55b640a68080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f026cb18740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f026cb18740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a6b240 0x55b640a68b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f026cb18740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b640a6de10 con 0x55b640a60980 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f026cb18740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b64094df10 con 0x55b640a6b240 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f026cb18740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b640a6df90 con 0x55b640a60060 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f026cb18740 10 client.0 _ll_register_callbacks cb 0x55b640971db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02637fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02637fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42658/0 (socket says 172.21.15.152:42658) 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02637fe640 1 -- 172.21.15.152:0/3395431060 learned_addr learned my addr 172.21.15.152:0/3395431060 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f0268cdc640 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a6b240 0x55b640a68b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f0263fff640 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60060 0x55b640a68080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02637fe640 1 -- 172.21.15.152:0/3395431060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60060 msgr2=0x55b640a68080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02637fe640 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60060 0x55b640a68080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02637fe640 1 -- 172.21.15.152:0/3395431060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a6b240 msgr2=0x55b640a68b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02637fe640 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a6b240 0x55b640a68b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02637fe640 1 -- 172.21.15.152:0/3395431060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6406d4580 con 0x55b640a60980 2024-09-11T22:07:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02637fe640 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a685c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f02580096c0 tx=0x7f0258005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65be9d1df3817548 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02437fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02437fe640 1 -- 172.21.15.152:0/3395431060 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025803f050 con 0x55b640a60980 2024-09-11T22:07:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02437fe640 1 -- 172.21.15.152:0/3395431060 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f0258004040 con 0x55b640a60980 2024-09-11T22:07:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f026cb18740 1 -- 172.21.15.152:0/3395431060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0258032e20 con 0x55b640a60980 2024-09-11T22:07:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.060+0000 7f02437fe640 1 -- 172.21.15.152:0/3395431060 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0258035040 con 0x55b640a60980 2024-09-11T22:07:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.061+0000 7f026cb18740 10 client.16170 fetch_fsmap learned FSMap version 29 2024-09-11T22:07:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.061+0000 7f026cb18740 1 -- 172.21.15.152:0/3395431060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b64079e960 con 0x55b640a60980 2024-09-11T22:07:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.061+0000 7f02437fe640 1 -- 172.21.15.152:0/3395431060 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0258032e20 con 0x55b640a60980 2024-09-11T22:07:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.061+0000 7f02437fe640 1 -- 172.21.15.152:0/3395431060 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f0258054070 con 0x55b640a60980 2024-09-11T22:07:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.061+0000 7f026cb18740 10 client.16170 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T22:07:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.061+0000 7f026cb18740 10 client.16170 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:07:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.061+0000 7f026cb18740 20 client.16170 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.061+0000 7f026cb18740 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b640a7ab90 0x55b640a7cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.061+0000 7f026cb18740 4 client.16170 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.061+0000 7f026cb18740 1 -- 172.21.15.152:0/3395431060 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6409d2b90 con 0x55b640a7ab90 2024-09-11T22:07:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.061+0000 7f0263fff640 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b640a7ab90 0x55b640a7cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.062+0000 7f0263fff640 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b640a7ab90 0x55b640a7cf80 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c77c936ae975bb0b server_cookie=e123e13d70a50bb4 in_seq=0 out_seq=0 2024-09-11T22:07:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.062+0000 7f02437fe640 10 client.16170 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.062+0000 7f02437fe640 1 -- 172.21.15.152:0/3395431060 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6409d2b90 con 0x55b640a7ab90 2024-09-11T22:07:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.062+0000 7f02437fe640 10 client.16170 handle_command_reply: tid=0 2024-09-11T22:07:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.062+0000 7f026cb18740 1 client.16170 shutdown 2024-09-11T22:07:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f026cb18740 1 -- 172.21.15.152:0/3395431060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 msgr2=0x55b640a685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f026cb18740 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a685c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f02580096c0 tx=0x7f0258005680 comp rx=0 tx=0).stop 2024-09-11T22:07:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f026cb18740 1 -- 172.21.15.152:0/3395431060 shutdown_connections 2024-09-11T22:07:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f026cb18740 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b640a7ab90 0x55b640a7cf80 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f026cb18740 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a6b240 0x55b640a68b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f026cb18740 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a685c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f02437fe640 0 client.16170 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f026cb18740 1 --2- 172.21.15.152:0/3395431060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60060 0x55b640a68080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f026cb18740 1 -- 172.21.15.152:0/3395431060 >> 172.21.15.152:0/3395431060 conn(0x55b640a5c5f0 msgr2=0x55b640a622d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f026cb18740 1 -- 172.21.15.152:0/3395431060 shutdown_connections 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f026cb18740 1 -- 172.21.15.152:0/3395431060 wait complete. 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.063+0000 7f026cb18740 20 client.16170 trim_cache size 0 max 16384 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.079+0000 7f026cb18740 1 Processor -- start 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.079+0000 7f026cb18740 1 -- start start 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f026cb18740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60060 0x55b640a82610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f026cb18740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a82b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f026cb18740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a6b240 0x55b640a652e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f026cb18740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f02641b2380 con 0x55b640a60980 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f026cb18740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f02641afc50 con 0x55b640a6b240 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f026cb18740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f02641adaa0 con 0x55b640a60060 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f02637fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a82b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f02637fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a82b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42666/0 (socket says 172.21.15.152:42666) 2024-09-11T22:07:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f02637fe640 1 -- 172.21.15.152:0/2276122027 learned_addr learned my addr 172.21.15.152:0/2276122027 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f02637fe640 1 -- 172.21.15.152:0/2276122027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60060 msgr2=0x55b640a82610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f02637fe640 1 --2- 172.21.15.152:0/2276122027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60060 0x55b640a82610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f02637fe640 1 -- 172.21.15.152:0/2276122027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a6b240 msgr2=0x55b640a652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f02637fe640 1 --2- 172.21.15.152:0/2276122027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a6b240 0x55b640a652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f02637fe640 1 -- 172.21.15.152:0/2276122027 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b640a5c420 con 0x55b640a60980 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f02637fe640 1 --2- 172.21.15.152:0/2276122027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a82b50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f02580046c0 tx=0x7f0258005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c2939753c69b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f0249ffb640 1 -- 172.21.15.152:0/2276122027 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025805a020 con 0x55b640a60980 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f0249ffb640 1 -- 172.21.15.152:0/2276122027 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0258048070 con 0x55b640a60980 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.080+0000 7f0249ffb640 1 -- 172.21.15.152:0/2276122027 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025803f070 con 0x55b640a60980 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.081+0000 7f026cb18740 1 -- 172.21.15.152:0/2276122027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 msgr2=0x55b640a82b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.081+0000 7f026cb18740 1 --2- 172.21.15.152:0/2276122027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a82b50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f02580046c0 tx=0x7f0258005360 comp rx=0 tx=0).stop 2024-09-11T22:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.081+0000 7f026cb18740 1 -- 172.21.15.152:0/2276122027 shutdown_connections 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.081+0000 7f026cb18740 1 --2- 172.21.15.152:0/2276122027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a6b240 0x55b640a652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.081+0000 7f026cb18740 1 --2- 172.21.15.152:0/2276122027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a60980 0x55b640a82b50 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.081+0000 7f026cb18740 1 --2- 172.21.15.152:0/2276122027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60060 0x55b640a82610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.081+0000 7f026cb18740 1 -- 172.21.15.152:0/2276122027 >> 172.21.15.152:0/2276122027 conn(0x55b640a5c5f0 msgr2=0x55b640a66950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.081+0000 7f026cb18740 1 -- 172.21.15.152:0/2276122027 shutdown_connections 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.081+0000 7f026cb18740 1 -- 172.21.15.152:0/2276122027 wait complete. 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.081+0000 7f026cb18740 1 -- start start 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.081+0000 7f026cb18740 1 Processor -- start 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f026cb18740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a60060 0x55b640a733d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f026cb18740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60980 0x55b640a73910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f026cb18740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f026cb18740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f02641ae110 con 0x55b640a6b240 2024-09-11T22:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f026cb18740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f02641af580 con 0x55b640a60060 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f026cb18740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f02641ae7e0 con 0x55b640a60980 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f026cb18740 10 client.0 _ll_register_callbacks cb 0x7f0258009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f0268cdc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f0268cdc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42674/0 (socket says 172.21.15.152:42674) 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f0268cdc640 1 -- 172.21.15.152:0/2694852698 learned_addr learned my addr 172.21.15.152:0/2694852698 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f02637fe640 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60980 0x55b640a73910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f0263fff640 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a60060 0x55b640a733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f0268cdc640 1 -- 172.21.15.152:0/2694852698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60980 msgr2=0x55b640a73910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f0268cdc640 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60980 0x55b640a73910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f0268cdc640 1 -- 172.21.15.152:0/2694852698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a60060 msgr2=0x55b640a733d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f0268cdc640 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a60060 0x55b640a733d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f0268cdc640 1 -- 172.21.15.152:0/2694852698 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b640a5d280 con 0x55b640a6b240 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f0268cdc640 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6e1a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f025c010cf0 tx=0x7f025c009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df035a352e2ee98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f02437fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.082+0000 7f02437fe640 1 -- 172.21.15.152:0/2694852698 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c004530 con 0x55b640a6b240 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f02437fe640 1 -- 172.21.15.152:0/2694852698 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f025c0046d0 con 0x55b640a6b240 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f026cb18740 1 -- 172.21.15.152:0/2694852698 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0258048070 con 0x55b640a6b240 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f02437fe640 1 -- 172.21.15.152:0/2694852698 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f025c004b20 con 0x55b640a6b240 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f026cb18740 10 client.16176 fetch_fsmap learned FSMap version 29 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f026cb18740 1 -- 172.21.15.152:0/2694852698 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b640ae5f00 con 0x55b640a6b240 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f02437fe640 1 -- 172.21.15.152:0/2694852698 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0258048070 con 0x55b640a6b240 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f02437fe640 1 -- 172.21.15.152:0/2694852698 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f025c030070 con 0x55b640a6b240 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f026cb18740 10 client.16176 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f026cb18740 10 client.16176 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f026cb18740 20 client.16176 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f026cb18740 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b640ae6680 0x55b640ae8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f026cb18740 4 client.16176 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a442924a", "release": true, "await": true}] 2024-09-11T22:07:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f026cb18740 1 -- 172.21.15.152:0/2694852698 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a442924a", "release": true, "await": true}) -- 0x55b6409cd0a0 con 0x55b640ae6680 2024-09-11T22:07:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.083+0000 7f0263fff640 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b640ae6680 0x55b640ae8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.084+0000 7f02437fe640 10 client.16176 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.084+0000 7f0263fff640 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b640ae6680 0x55b640ae8aa0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0fb880cdf57c415 server_cookie=d36a199ce7ca27bb in_seq=0 out_seq=0 2024-09-11T22:07:26.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.132+0000 7f02437fe640 1 -- 172.21.15.152:0/2694852698 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b6409cd0a0 con 0x55b640ae6680 2024-09-11T22:07:26.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.132+0000 7f02437fe640 10 client.16176 handle_command_reply: tid=0 2024-09-11T22:07:26.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.132+0000 7f026cb18740 1 client.16176 shutdown 2024-09-11T22:07:26.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.132+0000 7f026cb18740 1 -- 172.21.15.152:0/2694852698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 msgr2=0x55b640a6e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:26.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.132+0000 7f026cb18740 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6e1a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f025c010cf0 tx=0x7f025c009600 comp rx=0 tx=0).stop 2024-09-11T22:07:26.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.133+0000 7f026cb18740 1 -- 172.21.15.152:0/2694852698 shutdown_connections 2024-09-11T22:07:26.136 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:07:26.136 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 29, 2024-09-11T22:07:26.137 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:07:26.137 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 12, 2024-09-11T22:07:26.137 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:07:26.137 INFO:teuthology.orchestra.run.smithi152.stdout: "a442924a": { 2024-09-11T22:07:26.137 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 12, 2024-09-11T22:07:26.137 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:07:26.137 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:07:26.137 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:07:26.137 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 144.7, 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:26.139 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:26.139 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:07:26.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.133+0000 7f026cb18740 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b640ae6680 0x55b640ae8aa0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.133+0000 7f026cb18740 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b640a6b240 0x55b640a6e1a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.133+0000 7f026cb18740 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b640a60980 0x55b640a73910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.133+0000 7f026cb18740 1 --2- 172.21.15.152:0/2694852698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b640a60060 0x55b640a733d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.133+0000 7f026cb18740 1 -- 172.21.15.152:0/2694852698 >> 172.21.15.152:0/2694852698 conn(0x55b640a5c5f0 msgr2=0x55b640a5af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:26.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.133+0000 7f02437fe640 0 client.16176 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:26.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.133+0000 7f026cb18740 1 -- 172.21.15.152:0/2694852698 shutdown_connections 2024-09-11T22:07:26.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.133+0000 7f026cb18740 1 -- 172.21.15.152:0/2694852698 wait complete. 2024-09-11T22:07:26.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.135+0000 7f026cb18740 20 client.16176 trim_cache size 0 max 16384 2024-09-11T22:07:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.136+0000 7f026a73f640 1 -- 172.21.15.152:0/1624426575 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f024c0a2cf0 msgr2=0x7f024c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.136+0000 7f026a73f640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f024c0a2cf0 0x7f024c0a51b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f025c0098b0 tx=0x7f025c009d90 comp rx=0 tx=0).stop 2024-09-11T22:07:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.136+0000 7f026a73f640 1 -- 172.21.15.152:0/1624426575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0264101de0 msgr2=0x7f02640744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.136+0000 7f026a73f640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0264101de0 0x7f02640744f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f025400d770 tx=0x7f025400dc30 comp rx=0 tx=0).stop 2024-09-11T22:07:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.136+0000 7f026a73f640 1 -- 172.21.15.152:0/1624426575 shutdown_connections 2024-09-11T22:07:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.136+0000 7f026a73f640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f024c0a2cf0 0x7f024c0a51b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.137+0000 7f026a73f640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264106f10 0x7f0264074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.137+0000 7f026a73f640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264102790 0x7f0264074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.137+0000 7f026a73f640 1 --2- 172.21.15.152:0/1624426575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0264101de0 0x7f02640744f0 secure :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f025400d770 tx=0x7f025400dc30 comp rx=0 tx=0).stop 2024-09-11T22:07:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.137+0000 7f026a73f640 1 -- 172.21.15.152:0/1624426575 >> 172.21.15.152:0/1624426575 conn(0x7f02640fd8c0 msgr2=0x7f02640fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:26.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.141+0000 7f026a73f640 1 -- 172.21.15.152:0/1624426575 shutdown_connections 2024-09-11T22:07:26.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:26.141+0000 7f026a73f640 1 -- 172.21.15.152:0/1624426575 wait complete. 2024-09-11T22:07:26.682 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:07:26.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:26 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:07:26.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:26 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:07:26.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:26 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:07:26.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:26 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:07:26.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:26 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:07:26.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:26 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:07:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:26 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:07:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:26 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:07:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:26 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:07:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:26 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:07:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:26 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:07:26.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:26 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:07:26.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:26 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:07:26.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:26 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:07:26.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:26 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:07:26.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:26 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:07:26.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:26 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:07:26.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:26 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:07:27.537 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a442924a', total seconds elapsed: 29.1 2024-09-11T22:07:27.695 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:07:27.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:27 smithi179 ceph-mon[35603]: pgmap v98: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 603 op/s 2024-09-11T22:07:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:27 smithi193 ceph-mon[35545]: pgmap v98: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 603 op/s 2024-09-11T22:07:27.831 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:27 smithi152 ceph-mon[31188]: pgmap v98: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 603 op/s 2024-09-11T22:07:28.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.275+0000 7f123a6ce640 1 -- 172.21.15.152:0/3672217518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234109110 msgr2=0x7f1234110c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:28.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.275+0000 7f123a6ce640 1 --2- 172.21.15.152:0/3672217518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234109110 0x7f1234110c90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f122c009be0 tx=0x7f122c02a710 comp rx=0 tx=0).stop 2024-09-11T22:07:28.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.275+0000 7f123a6ce640 1 -- 172.21.15.152:0/3672217518 shutdown_connections 2024-09-11T22:07:28.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.275+0000 7f123a6ce640 1 --2- 172.21.15.152:0/3672217518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234109110 0x7f1234110c90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.275+0000 7f123a6ce640 1 --2- 172.21.15.152:0/3672217518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1234104990 0x7f12341089e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.275+0000 7f123a6ce640 1 --2- 172.21.15.152:0/3672217518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1234103fe0 0x7f12341043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.275+0000 7f123a6ce640 1 -- 172.21.15.152:0/3672217518 >> 172.21.15.152:0/3672217518 conn(0x7f12340ffa40 msgr2=0x7f1234101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:28.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.276+0000 7f123a6ce640 1 -- 172.21.15.152:0/3672217518 shutdown_connections 2024-09-11T22:07:28.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.276+0000 7f123a6ce640 1 -- 172.21.15.152:0/3672217518 wait complete. 2024-09-11T22:07:28.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f123a6ce640 1 Processor -- start 2024-09-11T22:07:28.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f123a6ce640 1 -- start start 2024-09-11T22:07:28.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f123a6ce640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f123410f640 0x7f123410fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f123a6ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f123410ff60 0x7f123411b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f123a6ce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12341b15d0 0x7f12341b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f123a6ce640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1234077830 con 0x7f12341b15d0 2024-09-11T22:07:28.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f123a6ce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12340776b0 con 0x7f123410ff60 2024-09-11T22:07:28.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f123a6ce640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12340779b0 con 0x7f123410f640 2024-09-11T22:07:28.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f1233fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f123410f640 0x7f123410fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f1233fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f123410f640 0x7f123410fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52010/0 (socket says 172.21.15.152:52010) 2024-09-11T22:07:28.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f1233fff640 1 -- 172.21.15.152:0/3846940716 learned_addr learned my addr 172.21.15.152:0/3846940716 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:28.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.277+0000 7f12337fe640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f123410ff60 0x7f123411b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.278+0000 7f1233fff640 1 -- 172.21.15.152:0/3846940716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f123410ff60 msgr2=0x7f123411b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:28.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.278+0000 7f1233fff640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f123410ff60 0x7f123411b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.278+0000 7f1233fff640 1 -- 172.21.15.152:0/3846940716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12341b15d0 msgr2=0x7f12341b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:28.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.278+0000 7f1233fff640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12341b15d0 0x7f12341b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.278+0000 7f1233fff640 1 -- 172.21.15.152:0/3846940716 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12341b40f0 con 0x7f123410f640 2024-09-11T22:07:28.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.278+0000 7f1233fff640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f123410f640 0x7f123410fa20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f122400d6d0 tx=0x7f122400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:28.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.278+0000 7f12317fa640 1 -- 172.21.15.152:0/3846940716 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224017070 con 0x7f123410f640 2024-09-11T22:07:28.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.278+0000 7f12317fa640 1 -- 172.21.15.152:0/3846940716 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1224010460 con 0x7f123410f640 2024-09-11T22:07:28.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.278+0000 7f12317fa640 1 -- 172.21.15.152:0/3846940716 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122400f620 con 0x7f123410f640 2024-09-11T22:07:28.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.279+0000 7f123a6ce640 1 -- 172.21.15.152:0/3846940716 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12341b43e0 con 0x7f123410f640 2024-09-11T22:07:28.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.279+0000 7f123a6ce640 1 -- 172.21.15.152:0/3846940716 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12341b4810 con 0x7f123410f640 2024-09-11T22:07:28.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.283+0000 7f12317fa640 1 -- 172.21.15.152:0/3846940716 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f122401a070 con 0x7f123410f640 2024-09-11T22:07:28.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.284+0000 7f123caa7740 1 Processor -- start 2024-09-11T22:07:28.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f123caa7740 1 -- start start 2024-09-11T22:07:28.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f12317fa640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f121c0a2f00 0x7f121c0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f123caa7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44cca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f123caa7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f123caa7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cd5680 0x562b44cd7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f123caa7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562b44c302e0 con 0x562b44ccadc0 2024-09-11T22:07:28.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f123caa7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562b44bd7ce0 con 0x562b44cd5680 2024-09-11T22:07:28.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f123caa7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562b44c2c2a0 con 0x562b44cca4a0 2024-09-11T22:07:28.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f12317fa640 1 -- 172.21.15.152:0/3846940716 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f12240cef60 con 0x7f123410f640 2024-09-11T22:07:28.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f1238c6b640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f121c0a2f00 0x7f121c0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f12337fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f12337fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42708/0 (socket says 172.21.15.152:42708) 2024-09-11T22:07:28.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.285+0000 7f12337fe640 1 -- 172.21.15.152:0/137674086 learned_addr learned my addr 172.21.15.152:0/137674086 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:28.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.286+0000 7f1233fff640 1 --2- 172.21.15.152:0/137674086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44cca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.286+0000 7f1238c6b640 1 --2- 172.21.15.152:0/137674086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cd5680 0x562b44cd7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.286+0000 7f12337fe640 1 -- 172.21.15.152:0/137674086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 msgr2=0x562b44cca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:28.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.286+0000 7f12337fe640 1 --2- 172.21.15.152:0/137674086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44cca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.286+0000 7f12337fe640 1 -- 172.21.15.152:0/137674086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cd5680 msgr2=0x562b44cd7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:28.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.286+0000 7f12337fe640 1 --2- 172.21.15.152:0/137674086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cd5680 0x562b44cd7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.286+0000 7f12337fe640 1 -- 172.21.15.152:0/137674086 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b44bbc440 con 0x562b44ccadc0 2024-09-11T22:07:28.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.286+0000 7f12337fe640 1 --2- 172.21.15.152:0/137674086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd5140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1228004620 tx=0x7f122800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9417e5f30996f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:28.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.287+0000 7f121a7fc640 1 -- 172.21.15.152:0/137674086 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228003af0 con 0x562b44ccadc0 2024-09-11T22:07:28.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.287+0000 7f121a7fc640 1 -- 172.21.15.152:0/137674086 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1228015070 con 0x562b44ccadc0 2024-09-11T22:07:28.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.287+0000 7f121a7fc640 1 -- 172.21.15.152:0/137674086 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12280116a0 con 0x562b44ccadc0 2024-09-11T22:07:28.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.288+0000 7f1238c6b640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f121c0a2f00 0x7f121c0a53c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f122c034040 tx=0x7f122c009720 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:28.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.288+0000 7f123caa7740 1 -- 172.21.15.152:0/137674086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 msgr2=0x562b44cd5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:28.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.288+0000 7f123caa7740 1 --2- 172.21.15.152:0/137674086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd5140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1228004620 tx=0x7f122800bab0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.291+0000 7f123caa7740 1 -- 172.21.15.152:0/137674086 shutdown_connections 2024-09-11T22:07:28.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.291+0000 7f123caa7740 1 --2- 172.21.15.152:0/137674086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cd5680 0x562b44cd7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.291+0000 7f123caa7740 1 --2- 172.21.15.152:0/137674086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd5140 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.291+0000 7f123caa7740 1 --2- 172.21.15.152:0/137674086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44cca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.291+0000 7f123caa7740 1 -- 172.21.15.152:0/137674086 >> 172.21.15.152:0/137674086 conn(0x562b44cc6a30 msgr2=0x562b44cc6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:28.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.291+0000 7f123caa7740 1 -- 172.21.15.152:0/137674086 shutdown_connections 2024-09-11T22:07:28.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.291+0000 7f123caa7740 1 -- 172.21.15.152:0/137674086 wait complete. 2024-09-11T22:07:28.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.291+0000 7f123caa7740 1 -- start start 2024-09-11T22:07:28.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f123caa7740 1 Processor -- start 2024-09-11T22:07:28.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f123caa7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44cd4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f123caa7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f123caa7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cd5680 0x562b44cd2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f123caa7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562b44cd8250 con 0x562b44ccadc0 2024-09-11T22:07:28.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f123caa7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562b44beb050 con 0x562b44cd5680 2024-09-11T22:07:28.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f123caa7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562b44cd83d0 con 0x562b44cca4a0 2024-09-11T22:07:28.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f123caa7740 10 client.0 _ll_register_callbacks cb 0x562b44c2b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:28.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f12337fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f12337fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42710/0 (socket says 172.21.15.152:42710) 2024-09-11T22:07:28.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f12337fe640 1 -- 172.21.15.152:0/712771531 learned_addr learned my addr 172.21.15.152:0/712771531 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:28.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f1238c6b640 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cd5680 0x562b44cd2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.292+0000 7f1233fff640 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44cd4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.293+0000 7f12337fe640 1 -- 172.21.15.152:0/712771531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 msgr2=0x562b44cd4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:28.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.293+0000 7f12337fe640 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44cd4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.293+0000 7f12337fe640 1 -- 172.21.15.152:0/712771531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cd5680 msgr2=0x562b44cd2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:28.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.293+0000 7f12337fe640 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cd5680 0x562b44cd2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.293+0000 7f12337fe640 1 -- 172.21.15.152:0/712771531 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b449a13c0 con 0x562b44ccadc0 2024-09-11T22:07:28.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.293+0000 7f12337fe640 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd22a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f122801a960 tx=0x7f122801a990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0be0218521a43b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:28.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.293+0000 7f12137fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:28.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.293+0000 7f12137fe640 1 -- 172.21.15.152:0/712771531 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122802a060 con 0x562b44ccadc0 2024-09-11T22:07:28.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.294+0000 7f123caa7740 1 -- 172.21.15.152:0/712771531 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1228015070 con 0x562b44ccadc0 2024-09-11T22:07:28.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.294+0000 7f12137fe640 1 -- 172.21.15.152:0/712771531 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1228003b00 con 0x562b44ccadc0 2024-09-11T22:07:28.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.294+0000 7f12137fe640 1 -- 172.21.15.152:0/712771531 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1228004290 con 0x562b44ccadc0 2024-09-11T22:07:28.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.294+0000 7f123caa7740 10 client.16185 fetch_fsmap learned FSMap version 29 2024-09-11T22:07:28.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.294+0000 7f123caa7740 1 -- 172.21.15.152:0/712771531 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562b44ce3c20 con 0x562b44ccadc0 2024-09-11T22:07:28.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.296+0000 7f12137fe640 1 -- 172.21.15.152:0/712771531 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1228015070 con 0x562b44ccadc0 2024-09-11T22:07:28.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.296+0000 7f12137fe640 1 -- 172.21.15.152:0/712771531 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f1228010440 con 0x562b44ccadc0 2024-09-11T22:07:28.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.296+0000 7f123caa7740 10 client.16185 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T22:07:28.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.296+0000 7f123caa7740 10 client.16185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:28.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.296+0000 7f123caa7740 20 client.16185 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:28.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.296+0000 7f123caa7740 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562b44ce4fd0 0x562b44ce73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.296+0000 7f123caa7740 4 client.16185 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:28.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.296+0000 7f123caa7740 1 -- 172.21.15.152:0/712771531 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b44c3d850 con 0x562b44ce4fd0 2024-09-11T22:07:28.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.297+0000 7f1233fff640 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562b44ce4fd0 0x562b44ce73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.297+0000 7f12137fe640 10 client.16185 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:28.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.298+0000 7f1233fff640 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562b44ce4fd0 0x562b44ce73c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f1975d704afdff server_cookie=94d84d94363bcea6 in_seq=0 out_seq=0 2024-09-11T22:07:28.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.298+0000 7f12137fe640 1 -- 172.21.15.152:0/712771531 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b44c3d850 con 0x562b44ce4fd0 2024-09-11T22:07:28.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.298+0000 7f12137fe640 10 client.16185 handle_command_reply: tid=0 2024-09-11T22:07:28.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.298+0000 7f123caa7740 1 client.16185 shutdown 2024-09-11T22:07:28.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.299+0000 7f123caa7740 1 -- 172.21.15.152:0/712771531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 msgr2=0x562b44cd22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:28.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.299+0000 7f123caa7740 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd22a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f122801a960 tx=0x7f122801a990 comp rx=0 tx=0).stop 2024-09-11T22:07:28.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.299+0000 7f123caa7740 1 -- 172.21.15.152:0/712771531 shutdown_connections 2024-09-11T22:07:28.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.299+0000 7f123caa7740 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562b44ce4fd0 0x562b44ce73c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.299+0000 7f123caa7740 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cd5680 0x562b44cd2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.299+0000 7f12137fe640 0 client.16185 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:28.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.299+0000 7f123caa7740 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44ccadc0 0x562b44cd22a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.299+0000 7f123caa7740 1 --2- 172.21.15.152:0/712771531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44cd4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.299+0000 7f123caa7740 1 -- 172.21.15.152:0/712771531 >> 172.21.15.152:0/712771531 conn(0x562b44cc6a30 msgr2=0x562b44ccc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:28.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.299+0000 7f123caa7740 1 -- 172.21.15.152:0/712771531 shutdown_connections 2024-09-11T22:07:28.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.299+0000 7f123caa7740 1 -- 172.21.15.152:0/712771531 wait complete. 2024-09-11T22:07:28.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.300+0000 7f123caa7740 20 client.16185 trim_cache size 0 max 16384 2024-09-11T22:07:28.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.331+0000 7f123caa7740 1 Processor -- start 2024-09-11T22:07:28.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.331+0000 7f123caa7740 1 -- start start 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.332+0000 7f123caa7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44ce14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.332+0000 7f123caa7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44ccadc0 0x562b44cec960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.332+0000 7f123caa7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44cd5680 0x562b44cecea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.332+0000 7f123caa7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12341bfbb0 con 0x562b44cd5680 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.332+0000 7f123caa7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12341bd480 con 0x562b44ccadc0 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.332+0000 7f123caa7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12341bb2d0 con 0x562b44cca4a0 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.332+0000 7f1233fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44ce14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.332+0000 7f1233fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44ce14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52046/0 (socket says 172.21.15.152:52046) 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.332+0000 7f1233fff640 1 -- 172.21.15.152:0/3767175106 learned_addr learned my addr 172.21.15.152:0/3767175106 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f12337fe640 1 --2- 172.21.15.152:0/3767175106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44ccadc0 0x562b44cec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f1238c6b640 1 --2- 172.21.15.152:0/3767175106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44cd5680 0x562b44cecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f1233fff640 1 -- 172.21.15.152:0/3767175106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44ccadc0 msgr2=0x562b44cec960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f1233fff640 1 --2- 172.21.15.152:0/3767175106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44ccadc0 0x562b44cec960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f1233fff640 1 -- 172.21.15.152:0/3767175106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44cd5680 msgr2=0x562b44cecea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f1233fff640 1 --2- 172.21.15.152:0/3767175106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44cd5680 0x562b44cecea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f1233fff640 1 -- 172.21.15.152:0/3767175106 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b44ce7730 con 0x562b44cca4a0 2024-09-11T22:07:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f1238c6b640 1 --2- 172.21.15.152:0/3767175106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44cd5680 0x562b44cecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f1233fff640 1 --2- 172.21.15.152:0/3767175106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44ce14b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f122409b380 tx=0x7f122401e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db46f7dd335d6ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f1219ffb640 1 -- 172.21.15.152:0/3767175106 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224021040 con 0x562b44cca4a0 2024-09-11T22:07:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f1219ffb640 1 -- 172.21.15.152:0/3767175106 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12240b4070 con 0x562b44cca4a0 2024-09-11T22:07:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.333+0000 7f1219ffb640 1 -- 172.21.15.152:0/3767175106 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12240cc8a0 con 0x562b44cca4a0 2024-09-11T22:07:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.336+0000 7f123caa7740 1 -- 172.21.15.152:0/3767175106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 msgr2=0x562b44ce14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.336+0000 7f123caa7740 1 --2- 172.21.15.152:0/3767175106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44ce14b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f122409b380 tx=0x7f122401e040 comp rx=0 tx=0).stop 2024-09-11T22:07:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.336+0000 7f123caa7740 1 -- 172.21.15.152:0/3767175106 shutdown_connections 2024-09-11T22:07:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.336+0000 7f123caa7740 1 --2- 172.21.15.152:0/3767175106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44cd5680 0x562b44cecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.336+0000 7f123caa7740 1 --2- 172.21.15.152:0/3767175106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44ccadc0 0x562b44cec960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.336+0000 7f123caa7740 1 --2- 172.21.15.152:0/3767175106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44cca4a0 0x562b44ce14b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.336+0000 7f123caa7740 1 -- 172.21.15.152:0/3767175106 >> 172.21.15.152:0/3767175106 conn(0x562b44cc6a30 msgr2=0x562b44ccd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:28.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.337+0000 7f123caa7740 1 -- 172.21.15.152:0/3767175106 shutdown_connections 2024-09-11T22:07:28.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.337+0000 7f123caa7740 1 -- 172.21.15.152:0/3767175106 wait complete. 2024-09-11T22:07:28.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.337+0000 7f123caa7740 1 -- start start 2024-09-11T22:07:28.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.338+0000 7f123caa7740 1 Processor -- start 2024-09-11T22:07:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.338+0000 7f123caa7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cca4a0 0x562b44cd9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.339+0000 7f123caa7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44ccadc0 0x562b44cd9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.339+0000 7f1233fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cca4a0 0x562b44cd9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.339+0000 7f1233fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cca4a0 0x562b44cd9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:50002/0 (socket says 172.21.15.152:50002) 2024-09-11T22:07:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.339+0000 7f1233fff640 1 -- 172.21.15.152:0/2939619183 learned_addr learned my addr 172.21.15.152:0/2939619183 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.339+0000 7f123caa7740 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44cd5680 0x562b44cda090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.339+0000 7f12337fe640 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44ccadc0 0x562b44cd9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.339+0000 7f123caa7740 1 -- 172.21.15.152:0/2939619183 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12341bb940 con 0x562b44cd5680 2024-09-11T22:07:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.339+0000 7f123caa7740 1 -- 172.21.15.152:0/2939619183 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12341bcdb0 con 0x562b44cca4a0 2024-09-11T22:07:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.339+0000 7f123caa7740 1 -- 172.21.15.152:0/2939619183 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12341bc010 con 0x562b44ccadc0 2024-09-11T22:07:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.340+0000 7f12337fe640 1 -- 172.21.15.152:0/2939619183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cca4a0 msgr2=0x562b44cd9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.340+0000 7f12337fe640 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cca4a0 0x562b44cd9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.340+0000 7f12337fe640 1 -- 172.21.15.152:0/2939619183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44cd5680 msgr2=0x562b44cda090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.340+0000 7f12337fe640 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44cd5680 0x562b44cda090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.340+0000 7f12337fe640 1 -- 172.21.15.152:0/2939619183 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b44cd2b70 con 0x562b44ccadc0 2024-09-11T22:07:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.340+0000 7f12337fe640 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44ccadc0 0x562b44cd9b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x562b44cd3850 tx=0x7f1228010c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1525a015ddcbdfb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:28.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.340+0000 7f12137fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:07:28.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.341+0000 7f12137fe640 1 -- 172.21.15.152:0/2939619183 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122802a040 con 0x562b44ccadc0 2024-09-11T22:07:28.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.341+0000 7f12137fe640 1 -- 172.21.15.152:0/2939619183 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1228003d10 con 0x562b44ccadc0 2024-09-11T22:07:28.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.341+0000 7f12137fe640 10 client.0 inactive, discarding osd_map(85..85 src has 1..85) 2024-09-11T22:07:28.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.341+0000 7f123caa7740 10 client.0 _ll_register_callbacks cb 0x7f122c034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:28.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.341+0000 7f123caa7740 1 -- 172.21.15.152:0/2939619183 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12240b4070 con 0x562b44ccadc0 2024-09-11T22:07:28.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.341+0000 7f12137fe640 1 -- 172.21.15.152:0/2939619183 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f122800b3f0 con 0x562b44ccadc0 2024-09-11T22:07:28.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.341+0000 7f123caa7740 10 client.25822 fetch_fsmap learned FSMap version 29 2024-09-11T22:07:28.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.342+0000 7f123caa7740 1 -- 172.21.15.152:0/2939619183 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=29}) -- 0x562b44d4f960 con 0x562b44ccadc0 2024-09-11T22:07:28.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.342+0000 7f12137fe640 1 -- 172.21.15.152:0/2939619183 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f1228005040 con 0x562b44ccadc0 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.342+0000 7f123caa7740 10 client.25822 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.342+0000 7f123caa7740 10 client.25822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.342+0000 7f123caa7740 20 client.25822 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.342+0000 7f123caa7740 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562b44ce4fd0 0x562b44d51f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.342+0000 7f123caa7740 4 client.25822 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.342+0000 7f123caa7740 1 -- 172.21.15.152:0/2939619183 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f12240b4070 con 0x562b44ce4fd0 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.343+0000 7f1233fff640 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562b44ce4fd0 0x562b44d51f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.343+0000 7f1233fff640 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562b44ce4fd0 0x562b44d51f30 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=789975da63aca49c server_cookie=679bb645a149f31c in_seq=0 out_seq=0 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.343+0000 7f12137fe640 10 client.25822 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.343+0000 7f12137fe640 1 -- 172.21.15.152:0/2939619183 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f12240b4070 con 0x562b44ce4fd0 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.343+0000 7f12137fe640 10 client.25822 handle_command_reply: tid=0 2024-09-11T22:07:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.344+0000 7f123caa7740 1 client.25822 shutdown 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.344+0000 7f123caa7740 1 -- 172.21.15.152:0/2939619183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44ccadc0 msgr2=0x562b44cd9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.344+0000 7f123caa7740 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44ccadc0 0x562b44cd9b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x562b44cd3850 tx=0x7f1228010c80 comp rx=0 tx=0).stop 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.344+0000 7f123caa7740 1 -- 172.21.15.152:0/2939619183 shutdown_connections 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.344+0000 7f123caa7740 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562b44ce4fd0 0x562b44d51f30 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.344+0000 7f123caa7740 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b44cd5680 0x562b44cda090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.344+0000 7f123caa7740 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44ccadc0 0x562b44cd9b50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.344+0000 7f123caa7740 1 --2- 172.21.15.152:0/2939619183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b44cca4a0 0x562b44cd9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.344+0000 7f123caa7740 1 -- 172.21.15.152:0/2939619183 >> 172.21.15.152:0/2939619183 conn(0x562b44cc6a30 msgr2=0x562b44cd3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.344+0000 7f12137fe640 0 client.25822 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.345+0000 7f123caa7740 1 -- 172.21.15.152:0/2939619183 shutdown_connections 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.345+0000 7f123caa7740 1 -- 172.21.15.152:0/2939619183 wait complete. 2024-09-11T22:07:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.345+0000 7f123caa7740 20 client.25822 trim_cache size 0 max 16384 2024-09-11T22:07:28.348 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:07:28.348 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:07:28.348 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:07:28.348 INFO:teuthology.orchestra.run.smithi152.stdout: "cb584c61-5b5f-4815-83a8-de721b1dc7a5": { 2024-09-11T22:07:28.348 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:07:28.348 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "cb584c61-5b5f-4815-83a8-de721b1dc7a5", 2024-09-11T22:07:28.348 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:07:28.349 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:28.349 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:07:28.349 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:07:28.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 -- 172.21.15.152:0/3846940716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f121c0a2f00 msgr2=0x7f121c0a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:28.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f121c0a2f00 0x7f121c0a53c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f122c034040 tx=0x7f122c009720 comp rx=0 tx=0).stop 2024-09-11T22:07:28.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 -- 172.21.15.152:0/3846940716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f123410f640 msgr2=0x7f123410fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:28.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f123410f640 0x7f123410fa20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f122400d6d0 tx=0x7f122400db90 comp rx=0 tx=0).stop 2024-09-11T22:07:28.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 -- 172.21.15.152:0/3846940716 shutdown_connections 2024-09-11T22:07:28.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f121c0a2f00 0x7f121c0a53c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12341b15d0 0x7f12341b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f123410ff60 0x7f123411b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 --2- 172.21.15.152:0/3846940716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f123410f640 0x7f123410fa20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:28.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 -- 172.21.15.152:0/3846940716 >> 172.21.15.152:0/3846940716 conn(0x7f12340ffa40 msgr2=0x7f123407a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:28.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 -- 172.21.15.152:0/3846940716 shutdown_connections 2024-09-11T22:07:28.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:07:28.348+0000 7f123a6ce640 1 -- 172.21.15.152:0/3846940716 wait complete. 2024-09-11T22:07:29.123 INFO:tasks.cephfs.filesystem:scrub status for tag:cb584c61-5b5f-4815-83a8-de721b1dc7a5 - {'path': '/', 'tag': 'cb584c61-5b5f-4815-83a8-de721b1dc7a5', 'options': 'recursive,force'} 2024-09-11T22:07:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:29 smithi179 ceph-mon[35603]: pgmap v99: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 34 MiB/s wr, 779 op/s 2024-09-11T22:07:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:29 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:07:29.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 115.0 s, 3948.8 tps, lat 141.393 ms stddev 1724.503 2024-09-11T22:07:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:29 smithi193 ceph-mon[35545]: pgmap v99: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 34 MiB/s wr, 779 op/s 2024-09-11T22:07:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:29 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:07:29.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:29 smithi152 ceph-mon[31188]: pgmap v99: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 34 MiB/s wr, 779 op/s 2024-09-11T22:07:29.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:29 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:07:30.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:30 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:07:30.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:30 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:07:30.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:30 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:07:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:30 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:07:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:30 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:07:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:30 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:07:30.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:30 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:07:30.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:30 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:07:30.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:30 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:07:31.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:31 smithi179 ceph-mon[35603]: pgmap v100: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.9 MiB/s wr, 180 op/s 2024-09-11T22:07:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:31 smithi193 ceph-mon[35545]: pgmap v100: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.9 MiB/s wr, 180 op/s 2024-09-11T22:07:31.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:31 smithi152 ceph-mon[31188]: pgmap v100: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.9 MiB/s wr, 180 op/s 2024-09-11T22:07:33.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:33 smithi179 ceph-mon[35603]: pgmap v101: 97 pgs: 97 active+clean; 1.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 533 op/s 2024-09-11T22:07:33.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:33 smithi193 ceph-mon[35545]: pgmap v101: 97 pgs: 97 active+clean; 1.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 533 op/s 2024-09-11T22:07:33.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:33 smithi152 ceph-mon[31188]: pgmap v101: 97 pgs: 97 active+clean; 1.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 533 op/s 2024-09-11T22:07:34.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:34 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:07:34.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:34 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:07:34.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 120.0 s, 4746.8 tps, lat 21.085 ms stddev 21.766 2024-09-11T22:07:34.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:34 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:07:34.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:34 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:07:34.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:34 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:07:34.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:34 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:07:35.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:35 smithi179 ceph-mon[35603]: pgmap v102: 97 pgs: 97 active+clean; 1.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.8 MiB/s wr, 528 op/s 2024-09-11T22:07:35.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:35 smithi193 ceph-mon[35545]: pgmap v102: 97 pgs: 97 active+clean; 1.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.8 MiB/s wr, 528 op/s 2024-09-11T22:07:35.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:35 smithi152 ceph-mon[31188]: pgmap v102: 97 pgs: 97 active+clean; 1.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.8 MiB/s wr, 528 op/s 2024-09-11T22:07:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.017+0000 7ff29f247640 1 -- 172.21.15.152:0/2205276428 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff298100520 msgr2=0x7ff29810e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.017+0000 7ff29f247640 1 --2- 172.21.15.152:0/2205276428 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff298100520 0x7ff29810e9a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff290009cd0 tx=0x7ff29002e9c0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.017+0000 7ff29f247640 1 -- 172.21.15.152:0/2205276428 shutdown_connections 2024-09-11T22:07:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.017+0000 7ff29f247640 1 --2- 172.21.15.152:0/2205276428 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff298100520 0x7ff29810e9a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.017+0000 7ff29f247640 1 --2- 172.21.15.152:0/2205276428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2980ffb80 0x7ff2980fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.017+0000 7ff29f247640 1 --2- 172.21.15.152:0/2205276428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff298106b10 0x7ff298106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.017+0000 7ff29f247640 1 -- 172.21.15.152:0/2205276428 >> 172.21.15.152:0/2205276428 conn(0x7ff2980fba30 msgr2=0x7ff2980fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.018+0000 7ff29f247640 1 -- 172.21.15.152:0/2205276428 shutdown_connections 2024-09-11T22:07:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.018+0000 7ff29f247640 1 -- 172.21.15.152:0/2205276428 wait complete. 2024-09-11T22:07:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.019+0000 7ff29f247640 1 Processor -- start 2024-09-11T22:07:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.019+0000 7ff29f247640 1 -- start start 2024-09-11T22:07:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.019+0000 7ff29f247640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2980ffb80 0x7ff298196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.019+0000 7ff29f247640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff298100520 0x7ff2981965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.019+0000 7ff29f247640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff298106b10 0x7ff29819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.019+0000 7ff297fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff298100520 0x7ff2981965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.020+0000 7ff29f247640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff29810fd80 con 0x7ff2980ffb80 2024-09-11T22:07:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.020+0000 7ff29f247640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff29810fc00 con 0x7ff298100520 2024-09-11T22:07:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.020+0000 7ff29f247640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff29810ff00 con 0x7ff298106b10 2024-09-11T22:07:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.019+0000 7ff297fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff298100520 0x7ff2981965d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:43242/0 (socket says 172.21.15.152:43242) 2024-09-11T22:07:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.020+0000 7ff297fff640 1 -- 172.21.15.152:0/3476378195 learned_addr learned my addr 172.21.15.152:0/3476378195 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.020+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2980ffb80 0x7ff298196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.020+0000 7ff29d7e4640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff298106b10 0x7ff29819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.020+0000 7ff297fff640 1 -- 172.21.15.152:0/3476378195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff298106b10 msgr2=0x7ff29819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.020+0000 7ff297fff640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff298106b10 0x7ff29819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.020+0000 7ff297fff640 1 -- 172.21.15.152:0/3476378195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2980ffb80 msgr2=0x7ff298196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.020+0000 7ff297fff640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2980ffb80 0x7ff298196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.020+0000 7ff297fff640 1 -- 172.21.15.152:0/3476378195 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29819b080 con 0x7ff298100520 2024-09-11T22:07:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.021+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2980ffb80 0x7ff298196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:07:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.021+0000 7ff297fff640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff298100520 0x7ff2981965d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff28400e9f0 tx=0x7ff28400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.021+0000 7ff295ffb640 1 -- 172.21.15.152:0/3476378195 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28400cd80 con 0x7ff298100520 2024-09-11T22:07:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.021+0000 7ff29f247640 1 -- 172.21.15.152:0/3476378195 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29819b370 con 0x7ff298100520 2024-09-11T22:07:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.021+0000 7ff295ffb640 1 -- 172.21.15.152:0/3476378195 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff284010910 con 0x7ff298100520 2024-09-11T22:07:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.021+0000 7ff295ffb640 1 -- 172.21.15.152:0/3476378195 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2840188f0 con 0x7ff298100520 2024-09-11T22:07:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.021+0000 7ff29f247640 1 -- 172.21.15.152:0/3476378195 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2981a2c00 con 0x7ff298100520 2024-09-11T22:07:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.025+0000 7ff2a1fdc740 1 Processor -- start 2024-09-11T22:07:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.025+0000 7ff2a1fdc740 1 -- start start 2024-09-11T22:07:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.025+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc771faf0 0x564dc771fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.025+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc772a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.025+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc772acb0 0x564dc772d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.025+0000 7ff2a1fdc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564dc76842f0 con 0x564dc771faf0 2024-09-11T22:07:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.025+0000 7ff2a1fdc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564dc762c270 con 0x564dc7720410 2024-09-11T22:07:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.025+0000 7ff2a1fdc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564dc76802b0 con 0x564dc772acb0 2024-09-11T22:07:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.025+0000 7ff29cfe3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc772a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.025+0000 7ff29cfe3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc772a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:43246/0 (socket says 172.21.15.152:43246) 2024-09-11T22:07:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.025+0000 7ff29cfe3640 1 -- 172.21.15.152:0/1747287641 learned_addr learned my addr 172.21.15.152:0/1747287641 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.026+0000 7ff29cfe3640 1 -- 172.21.15.152:0/1747287641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc772acb0 msgr2=0x564dc772d0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:07:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.026+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/1747287641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc772acb0 0x564dc772d0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.026+0000 7ff29cfe3640 1 -- 172.21.15.152:0/1747287641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc771faf0 msgr2=0x564dc771fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.026+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/1747287641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc771faf0 0x564dc771fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.026+0000 7ff29cfe3640 1 -- 172.21.15.152:0/1747287641 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dc762b340 con 0x564dc7720410 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.026+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/1747287641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc772a770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0114f0 tx=0x7ff28c0119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be461f5ee2557ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.026+0000 7ff282ffd640 1 -- 172.21.15.152:0/1747287641 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c01e070 con 0x564dc7720410 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.027+0000 7ff282ffd640 1 -- 172.21.15.152:0/1747287641 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff28c011250 con 0x564dc7720410 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.027+0000 7ff295ffb640 1 -- 172.21.15.152:0/3476378195 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff284010ac0 con 0x7ff298100520 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.027+0000 7ff282ffd640 1 -- 172.21.15.152:0/1747287641 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0199f0 con 0x564dc7720410 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.027+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1747287641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 msgr2=0x564dc772a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.027+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/1747287641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc772a770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0114f0 tx=0x7ff28c0119b0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1747287641 shutdown_connections 2024-09-11T22:07:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/1747287641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc772acb0 0x564dc772d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/1747287641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc772a770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/1747287641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc771faf0 0x564dc771fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1747287641 >> 172.21.15.152:0/1747287641 conn(0x564dc771c060 msgr2=0x564dc771c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff295ffb640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2880a2e20 0x7ff2880a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1747287641 shutdown_connections 2024-09-11T22:07:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1747287641 wait complete. 2024-09-11T22:07:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff295ffb640 1 -- 172.21.15.152:0/3476378195 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff2840cf790 con 0x7ff298100520 2024-09-11T22:07:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2880a2e20 0x7ff2880a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff2a1fdc740 1 -- start start 2024-09-11T22:07:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.028+0000 7ff2a1fdc740 1 Processor -- start 2024-09-11T22:07:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.029+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2880a2e20 0x7ff2880a52e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff28c019570 tx=0x7ff28c0096c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.029+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc771faf0 0x564dc7727ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.029+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc7720410 0x564dc7728000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.029+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc772acb0 0x564dc7728540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.029+0000 7ff2a1fdc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564dc7736130 con 0x564dc772acb0 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.029+0000 7ff2a1fdc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564dc760d290 con 0x564dc771faf0 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.029+0000 7ff2a1fdc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564dc77362b0 con 0x564dc7720410 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.029+0000 7ff2a1fdc740 10 client.0 _ll_register_callbacks cb 0x564dc763e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.029+0000 7ff29cfe3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc771faf0 0x564dc7727ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.029+0000 7ff29cfe3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc771faf0 0x564dc7727ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:43248/0 (socket says 172.21.15.152:43248) 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.029+0000 7ff29cfe3640 1 -- 172.21.15.152:0/1360529695 learned_addr learned my addr 172.21.15.152:0/1360529695 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.030+0000 7ff297fff640 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc7720410 0x564dc7728000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.030+0000 7ff29cfe3640 1 -- 172.21.15.152:0/1360529695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc7720410 msgr2=0x564dc7728000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.030+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc7720410 0x564dc7728000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.030+0000 7ff29cfe3640 1 -- 172.21.15.152:0/1360529695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc772acb0 msgr2=0x564dc7728540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.030+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc772acb0 0x564dc7728540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.030+0000 7ff29cfe3640 1 -- 172.21.15.152:0/1360529695 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dc7397210 con 0x564dc771faf0 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.030+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc771faf0 0x564dc7727ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x564dc771cec0 tx=0x7ff28c0195d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7683499970d2e50 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.030+0000 7ff277fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.030+0000 7ff277fff640 1 -- 172.21.15.152:0/1360529695 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c01e040 con 0x564dc771faf0 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.031+0000 7ff277fff640 1 -- 172.21.15.152:0/1360529695 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff28c0048c0 con 0x564dc771faf0 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.031+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1360529695 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff28c011250 con 0x564dc771faf0 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.031+0000 7ff277fff640 1 -- 172.21.15.152:0/1360529695 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff28c03c050 con 0x564dc771faf0 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.031+0000 7ff2a1fdc740 10 client.25688 fetch_fsmap learned FSMap version 29 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.031+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1360529695 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564dc7463620 con 0x564dc771faf0 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.031+0000 7ff277fff640 1 -- 172.21.15.152:0/1360529695 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff28c011250 con 0x564dc771faf0 2024-09-11T22:07:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.032+0000 7ff277fff640 1 -- 172.21.15.152:0/1360529695 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7ff28c021030 con 0x564dc771faf0 2024-09-11T22:07:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.032+0000 7ff2a1fdc740 10 client.25688 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T22:07:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.032+0000 7ff2a1fdc740 10 client.25688 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.032+0000 7ff2a1fdc740 20 client.25688 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.032+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564dc77438a0 0x564dc7745d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.032+0000 7ff2a1fdc740 4 client.25688 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.032+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1360529695 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dc7691a20 con 0x564dc77438a0 2024-09-11T22:07:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.032+0000 7ff297fff640 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564dc77438a0 0x564dc7745d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.033+0000 7ff277fff640 10 client.25688 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.033+0000 7ff297fff640 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564dc77438a0 0x564dc7745d40 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=673f639c484d513e server_cookie=e75aff84f112aae5 in_seq=0 out_seq=0 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.033+0000 7ff277fff640 1 -- 172.21.15.152:0/1360529695 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564dc7691a20 con 0x564dc77438a0 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.033+0000 7ff277fff640 10 client.25688 handle_command_reply: tid=0 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.034+0000 7ff2a1fdc740 1 client.25688 shutdown 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.034+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1360529695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc771faf0 msgr2=0x564dc7727ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.034+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc771faf0 0x564dc7727ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x564dc771cec0 tx=0x7ff28c0195d0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.035+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1360529695 shutdown_connections 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.035+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564dc77438a0 0x564dc7745d40 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.035+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc772acb0 0x564dc7728540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.035+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc7720410 0x564dc7728000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.035+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/1360529695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc771faf0 0x564dc7727ac0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.035+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1360529695 >> 172.21.15.152:0/1360529695 conn(0x564dc771c060 msgr2=0x564dc7721dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.035+0000 7ff277fff640 0 client.25688 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.035+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1360529695 shutdown_connections 2024-09-11T22:07:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.035+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/1360529695 wait complete. 2024-09-11T22:07:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.035+0000 7ff2a1fdc740 20 client.25688 trim_cache size 0 max 16384 2024-09-11T22:07:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.060+0000 7ff2a1fdc740 1 Processor -- start 2024-09-11T22:07:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.060+0000 7ff2a1fdc740 1 -- start start 2024-09-11T22:07:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc771faf0 0x564dc774b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc774bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff29cfe3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc771faf0 0x564dc774b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff29cfe3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc771faf0 0x564dc774b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57980/0 (socket says 172.21.15.152:57980) 2024-09-11T22:07:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc772acb0 0x564dc771a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff29cfe3640 1 -- 172.21.15.152:0/488479615 learned_addr learned my addr 172.21.15.152:0/488479615 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/488479615 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff2981adfa0 con 0x564dc771faf0 2024-09-11T22:07:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/488479615 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff2981ab870 con 0x564dc7720410 2024-09-11T22:07:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/488479615 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff2981a96c0 con 0x564dc772acb0 2024-09-11T22:07:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff297fff640 1 --2- 172.21.15.152:0/488479615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc774bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff29d7e4640 1 --2- 172.21.15.152:0/488479615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc772acb0 0x564dc771a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff29cfe3640 1 -- 172.21.15.152:0/488479615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc772acb0 msgr2=0x564dc771a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/488479615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc772acb0 0x564dc771a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff29cfe3640 1 -- 172.21.15.152:0/488479615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 msgr2=0x564dc774bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/488479615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc774bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff29cfe3640 1 -- 172.21.15.152:0/488479615 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dc771d1d0 con 0x564dc771faf0 2024-09-11T22:07:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.061+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/488479615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc771faf0 0x564dc774b650 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff28c01c010 tx=0x7ff28c0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4641bc5af26451f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.062+0000 7ff2827fc640 1 -- 172.21.15.152:0/488479615 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c045070 con 0x564dc771faf0 2024-09-11T22:07:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.062+0000 7ff2827fc640 1 -- 172.21.15.152:0/488479615 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff28c033070 con 0x564dc771faf0 2024-09-11T22:07:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.062+0000 7ff2827fc640 1 -- 172.21.15.152:0/488479615 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c01e040 con 0x564dc771faf0 2024-09-11T22:07:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.063+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/488479615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc771faf0 msgr2=0x564dc774b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.063+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/488479615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc771faf0 0x564dc774b650 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff28c01c010 tx=0x7ff28c0119b0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.063+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/488479615 shutdown_connections 2024-09-11T22:07:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.063+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/488479615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc772acb0 0x564dc771a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.063+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/488479615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc774bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.063+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/488479615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc771faf0 0x564dc774b650 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.063+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/488479615 >> 172.21.15.152:0/488479615 conn(0x564dc771c060 msgr2=0x564dc7726bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.063+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/488479615 shutdown_connections 2024-09-11T22:07:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.063+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/488479615 wait complete. 2024-09-11T22:07:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.064+0000 7ff2a1fdc740 1 -- start start 2024-09-11T22:07:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.064+0000 7ff2a1fdc740 1 Processor -- start 2024-09-11T22:07:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.065+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc771faf0 0x564dc7724100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.065+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc7724640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.065+0000 7ff2a1fdc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc772acb0 0x564dc7724b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.065+0000 7ff297fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc7724640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff29d7e4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc772acb0 0x564dc7724b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff29d7e4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc772acb0 0x564dc7724b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57992/0 (socket says 172.21.15.152:57992) 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff29d7e4640 1 -- 172.21.15.152:0/474174883 learned_addr learned my addr 172.21.15.152:0/474174883 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc771faf0 0x564dc7724100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/474174883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff2981a9d30 con 0x564dc772acb0 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/474174883 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff2981ab1a0 con 0x564dc7720410 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/474174883 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff2981aa400 con 0x564dc771faf0 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff2a1fdc740 10 client.0 _ll_register_callbacks cb 0x7ff28c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff297fff640 1 -- 172.21.15.152:0/474174883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc771faf0 msgr2=0x564dc7724100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff297fff640 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc771faf0 0x564dc7724100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff297fff640 1 -- 172.21.15.152:0/474174883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc772acb0 msgr2=0x564dc7724b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff297fff640 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc772acb0 0x564dc7724b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.066+0000 7ff297fff640 1 -- 172.21.15.152:0/474174883 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dc771be90 con 0x564dc7720410 2024-09-11T22:07:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.067+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc771faf0 0x564dc7724100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:07:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.067+0000 7ff29d7e4640 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc772acb0 0x564dc7724b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:07:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.067+0000 7ff297fff640 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc7724640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff2840cceb0 tx=0x7ff28400c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d776b5d6077aa78 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.067+0000 7ff277fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:07:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.067+0000 7ff277fff640 1 -- 172.21.15.152:0/474174883 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28409a0f0 con 0x564dc7720410 2024-09-11T22:07:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.067+0000 7ff277fff640 1 -- 172.21.15.152:0/474174883 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff28409b180 con 0x564dc7720410 2024-09-11T22:07:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.068+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/474174883 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff28c033070 con 0x564dc7720410 2024-09-11T22:07:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.068+0000 7ff277fff640 1 -- 172.21.15.152:0/474174883 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff28409b380 con 0x564dc7720410 2024-09-11T22:07:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.068+0000 7ff2a1fdc740 10 client.25694 fetch_fsmap learned FSMap version 29 2024-09-11T22:07:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.068+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/474174883 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564dc773b980 con 0x564dc7720410 2024-09-11T22:07:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.069+0000 7ff277fff640 1 -- 172.21.15.152:0/474174883 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff28c033070 con 0x564dc7720410 2024-09-11T22:07:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.069+0000 7ff277fff640 1 -- 172.21.15.152:0/474174883 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7ff284097b10 con 0x564dc7720410 2024-09-11T22:07:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.069+0000 7ff2a1fdc740 10 client.25694 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T22:07:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.069+0000 7ff2a1fdc740 10 client.25694 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.069+0000 7ff2a1fdc740 20 client.25694 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.069+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564dc77ae620 0x564dc77b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.069+0000 7ff2a1fdc740 4 client.25694 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:07:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.069+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/474174883 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564dc768bd70 con 0x564dc77ae620 2024-09-11T22:07:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.069+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564dc77ae620 0x564dc77b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.070+0000 7ff277fff640 10 client.25694 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.070+0000 7ff29cfe3640 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564dc77ae620 0x564dc77b0a10 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43527f04acd95074 server_cookie=4aa56691374d2c14 in_seq=0 out_seq=0 2024-09-11T22:07:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff277fff640 1 -- 172.21.15.152:0/474174883 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564dc768bd70 con 0x564dc77ae620 2024-09-11T22:07:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff277fff640 10 client.25694 handle_command_reply: tid=0 2024-09-11T22:07:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff2a1fdc740 1 client.25694 shutdown 2024-09-11T22:07:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/474174883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 msgr2=0x564dc7724640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc7724640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff2840cceb0 tx=0x7ff28400c7d0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/474174883 shutdown_connections 2024-09-11T22:07:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564dc77ae620 0x564dc77b0a10 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dc772acb0 0x564dc7724b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dc7720410 0x564dc7724640 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff2a1fdc740 1 --2- 172.21.15.152:0/474174883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dc771faf0 0x564dc7724100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/474174883 >> 172.21.15.152:0/474174883 conn(0x564dc771c060 msgr2=0x564dc771a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.077+0000 7ff277fff640 0 client.25694 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.078+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/474174883 shutdown_connections 2024-09-11T22:07:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.079+0000 7ff2a1fdc740 1 -- 172.21.15.152:0/474174883 wait complete. 2024-09-11T22:07:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.079+0000 7ff2a1fdc740 20 client.25694 trim_cache size 0 max 16384 2024-09-11T22:07:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:07:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:07:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:07:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:07:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 -- 172.21.15.152:0/3476378195 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2880a2e20 msgr2=0x7ff2880a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2880a2e20 0x7ff2880a52e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff28c019570 tx=0x7ff28c0096c0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 -- 172.21.15.152:0/3476378195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff298100520 msgr2=0x7ff2981965d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff298100520 0x7ff2981965d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff28400e9f0 tx=0x7ff28400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 -- 172.21.15.152:0/3476378195 shutdown_connections 2024-09-11T22:07:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2880a2e20 0x7ff2880a52e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff298106b10 0x7ff29819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff298100520 0x7ff2981965d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 --2- 172.21.15.152:0/3476378195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2980ffb80 0x7ff298196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 -- 172.21.15.152:0/3476378195 >> 172.21.15.152:0/3476378195 conn(0x7ff2980fba30 msgr2=0x7ff2980fbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 -- 172.21.15.152:0/3476378195 shutdown_connections 2024-09-11T22:07:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:36.080+0000 7ff29f247640 1 -- 172.21.15.152:0/3476378195 wait complete. 2024-09-11T22:07:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:37 smithi179 ceph-mon[35603]: pgmap v103: 97 pgs: 97 active+clean; 1.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.8 MiB/s wr, 528 op/s 2024-09-11T22:07:37.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:37 smithi193 ceph-mon[35545]: pgmap v103: 97 pgs: 97 active+clean; 1.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.8 MiB/s wr, 528 op/s 2024-09-11T22:07:37.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:37 smithi152 ceph-mon[31188]: pgmap v103: 97 pgs: 97 active+clean; 1.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.8 MiB/s wr, 528 op/s 2024-09-11T22:07:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 125.0 s, 5224.0 tps, lat 19.147 ms stddev 21.897 2024-09-11T22:07:40.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:39 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:07:40.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:39 smithi152 ceph-mon[31188]: pgmap v104: 97 pgs: 97 active+clean; 1.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-09-11T22:07:40.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:39 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:07:40.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:39 smithi179 ceph-mon[35603]: pgmap v104: 97 pgs: 97 active+clean; 1.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-09-11T22:07:40.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:39 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:07:40.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:39 smithi193 ceph-mon[35545]: pgmap v104: 97 pgs: 97 active+clean; 1.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-09-11T22:07:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:41 smithi179 ceph-mon[35603]: pgmap v105: 97 pgs: 97 active+clean; 1.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 833 op/s 2024-09-11T22:07:41.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:41 smithi193 ceph-mon[35545]: pgmap v105: 97 pgs: 97 active+clean; 1.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 833 op/s 2024-09-11T22:07:41.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:41 smithi152 ceph-mon[31188]: pgmap v105: 97 pgs: 97 active+clean; 1.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 833 op/s 2024-09-11T22:07:43.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:43 smithi179 ceph-mon[35603]: pgmap v106: 97 pgs: 97 active+clean; 1.8 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-09-11T22:07:43.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:43 smithi193 ceph-mon[35545]: pgmap v106: 97 pgs: 97 active+clean; 1.8 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-09-11T22:07:43.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:43 smithi152 ceph-mon[31188]: pgmap v106: 97 pgs: 97 active+clean; 1.8 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-09-11T22:07:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 130.0 s, 5503.6 tps, lat 18.144 ms stddev 20.670 2024-09-11T22:07:45.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:45 smithi179 ceph-mon[35603]: pgmap v107: 97 pgs: 97 active+clean; 1.8 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 869 op/s 2024-09-11T22:07:45.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:45 smithi193 ceph-mon[35545]: pgmap v107: 97 pgs: 97 active+clean; 1.8 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 869 op/s 2024-09-11T22:07:45.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:45 smithi152 ceph-mon[31188]: pgmap v107: 97 pgs: 97 active+clean; 1.8 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 869 op/s 2024-09-11T22:07:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:47 smithi179 ceph-mon[35603]: pgmap v108: 97 pgs: 97 active+clean; 1.8 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 869 op/s 2024-09-11T22:07:47.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:47 smithi193 ceph-mon[35545]: pgmap v108: 97 pgs: 97 active+clean; 1.8 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 869 op/s 2024-09-11T22:07:47.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:47 smithi152 ceph-mon[31188]: pgmap v108: 97 pgs: 97 active+clean; 1.8 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 869 op/s 2024-09-11T22:07:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.216+0000 7f045c81e640 1 -- 172.21.15.152:0/1056747818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0458107b70 msgr2=0x7f0458107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.216+0000 7f045c81e640 1 --2- 172.21.15.152:0/1056747818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0458107b70 0x7f0458107f50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0448009930 tx=0x7f044802a420 comp rx=0 tx=0).stop 2024-09-11T22:07:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.217+0000 7f045c81e640 1 -- 172.21.15.152:0/1056747818 shutdown_connections 2024-09-11T22:07:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.217+0000 7f045c81e640 1 --2- 172.21.15.152:0/1056747818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458102470 0x7f045810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.217+0000 7f045c81e640 1 --2- 172.21.15.152:0/1056747818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0458101ad0 0x7f0458101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.217+0000 7f045c81e640 1 --2- 172.21.15.152:0/1056747818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0458107b70 0x7f0458107f50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.217+0000 7f045c81e640 1 -- 172.21.15.152:0/1056747818 >> 172.21.15.152:0/1056747818 conn(0x7f04580fd7d0 msgr2=0x7f04580ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.217+0000 7f045c81e640 1 -- 172.21.15.152:0/1056747818 shutdown_connections 2024-09-11T22:07:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.217+0000 7f045c81e640 1 -- 172.21.15.152:0/1056747818 wait complete. 2024-09-11T22:07:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.218+0000 7f045c81e640 1 Processor -- start 2024-09-11T22:07:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.218+0000 7f045c81e640 1 -- start start 2024-09-11T22:07:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.218+0000 7f045c81e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0458101ad0 0x7f04580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.218+0000 7f045c81e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458102470 0x7f0458074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.218+0000 7f045c81e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0458107b70 0x7f0458074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.218+0000 7f045c81e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0458111f20 con 0x7f0458101ad0 2024-09-11T22:07:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.218+0000 7f045c81e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0458111da0 con 0x7f0458102470 2024-09-11T22:07:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.218+0000 7f045c81e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04581120a0 con 0x7f0458107b70 2024-09-11T22:07:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.219+0000 7f0456d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0458107b70 0x7f0458074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.219+0000 7f0456d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0458107b70 0x7f0458074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:60828/0 (socket says 172.21.15.152:60828) 2024-09-11T22:07:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.219+0000 7f0456d9d640 1 -- 172.21.15.152:0/1595973366 learned_addr learned my addr 172.21.15.152:0/1595973366 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.219+0000 7f0455d9b640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458102470 0x7f0458074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.219+0000 7f045659c640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0458101ad0 0x7f04580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.219+0000 7f0455d9b640 1 -- 172.21.15.152:0/1595973366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0458107b70 msgr2=0x7f0458074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.219+0000 7f0455d9b640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0458107b70 0x7f0458074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.219+0000 7f0455d9b640 1 -- 172.21.15.152:0/1595973366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0458101ad0 msgr2=0x7f04580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.219+0000 7f0455d9b640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0458101ad0 0x7f04580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.219+0000 7f0455d9b640 1 -- 172.21.15.152:0/1595973366 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04581aacd0 con 0x7f0458102470 2024-09-11T22:07:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.219+0000 7f045659c640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0458101ad0 0x7f04580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.220+0000 7f0455d9b640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458102470 0x7f0458074a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f044c00c970 tx=0x7f044c00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.220+0000 7f04477fe640 1 -- 172.21.15.152:0/1595973366 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c007bb0 con 0x7f0458102470 2024-09-11T22:07:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.220+0000 7f04477fe640 1 -- 172.21.15.152:0/1595973366 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f044c007d50 con 0x7f0458102470 2024-09-11T22:07:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.220+0000 7f04477fe640 1 -- 172.21.15.152:0/1595973366 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c018820 con 0x7f0458102470 2024-09-11T22:07:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.220+0000 7f045c81e640 1 -- 172.21.15.152:0/1595973366 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04581aaf00 con 0x7f0458102470 2024-09-11T22:07:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.220+0000 7f045c81e640 1 -- 172.21.15.152:0/1595973366 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04581ab310 con 0x7f0458102470 2024-09-11T22:07:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.225+0000 7f04477fe640 1 -- 172.21.15.152:0/1595973366 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f044c0189c0 con 0x7f0458102470 2024-09-11T22:07:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.225+0000 7f045f1fd740 1 Processor -- start 2024-09-11T22:07:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f045f1fd740 1 -- start start 2024-09-11T22:07:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f045f1fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 0x55b5c211bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f045f1fd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c2126770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f045f1fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 0x55b5c21290a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f045f1fd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b5c20802f0 con 0x55b5c211c410 2024-09-11T22:07:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f045f1fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b5c2028270 con 0x55b5c2126cb0 2024-09-11T22:07:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f045f1fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b5c207c2b0 con 0x55b5c211baf0 2024-09-11T22:07:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f0456d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 0x55b5c211bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f0456d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 0x55b5c211bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:60842/0 (socket says 172.21.15.152:60842) 2024-09-11T22:07:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f0456d9d640 1 -- 172.21.15.152:0/2184810152 learned_addr learned my addr 172.21.15.152:0/2184810152 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f0455d9b640 1 --2- 172.21.15.152:0/2184810152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 0x55b5c21290a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.226+0000 7f045659c640 1 --2- 172.21.15.152:0/2184810152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c2126770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.227+0000 7f0456d9d640 1 -- 172.21.15.152:0/2184810152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 msgr2=0x55b5c21290a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.227+0000 7f0456d9d640 1 --2- 172.21.15.152:0/2184810152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 0x55b5c21290a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.227+0000 7f0456d9d640 1 -- 172.21.15.152:0/2184810152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 msgr2=0x55b5c2126770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.227+0000 7f0456d9d640 1 --2- 172.21.15.152:0/2184810152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c2126770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.227+0000 7f0456d9d640 1 -- 172.21.15.152:0/2184810152 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5c2027340 con 0x55b5c211baf0 2024-09-11T22:07:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.227+0000 7f0456d9d640 1 --2- 172.21.15.152:0/2184810152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 0x55b5c211bed0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0450007ef0 tx=0x7f045000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=383da6ddce369329 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.227+0000 7f0444ff9640 1 -- 172.21.15.152:0/2184810152 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450010840 con 0x55b5c211baf0 2024-09-11T22:07:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.227+0000 7f0444ff9640 1 -- 172.21.15.152:0/2184810152 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04500183f0 con 0x55b5c211baf0 2024-09-11T22:07:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.227+0000 7f0444ff9640 1 -- 172.21.15.152:0/2184810152 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04500175e0 con 0x55b5c211baf0 2024-09-11T22:07:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.228+0000 7f045f1fd740 1 -- 172.21.15.152:0/2184810152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 msgr2=0x55b5c211bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.229+0000 7f045f1fd740 1 --2- 172.21.15.152:0/2184810152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 0x55b5c211bed0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0450007ef0 tx=0x7f045000f790 comp rx=0 tx=0).stop 2024-09-11T22:07:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.229+0000 7f045f1fd740 1 -- 172.21.15.152:0/2184810152 shutdown_connections 2024-09-11T22:07:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.229+0000 7f04477fe640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04400a2ea0 0x7f04400a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.229+0000 7f045f1fd740 1 --2- 172.21.15.152:0/2184810152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 0x55b5c21290a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.229+0000 7f045f1fd740 1 --2- 172.21.15.152:0/2184810152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c2126770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.229+0000 7f045f1fd740 1 --2- 172.21.15.152:0/2184810152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 0x55b5c211bed0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.229+0000 7f045f1fd740 1 -- 172.21.15.152:0/2184810152 >> 172.21.15.152:0/2184810152 conn(0x55b5c2118060 msgr2=0x55b5c2118440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.229+0000 7f04477fe640 1 -- 172.21.15.152:0/1595973366 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f044c0cf570 con 0x7f0458102470 2024-09-11T22:07:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.229+0000 7f0456d9d640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04400a2ea0 0x7f04400a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.229+0000 7f045f1fd740 1 -- 172.21.15.152:0/2184810152 shutdown_connections 2024-09-11T22:07:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.229+0000 7f045f1fd740 1 -- 172.21.15.152:0/2184810152 wait complete. 2024-09-11T22:07:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.230+0000 7f0456d9d640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04400a2ea0 0x7f04400a5360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f045000fc90 tx=0x7f0450012040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.230+0000 7f045f1fd740 1 -- start start 2024-09-11T22:07:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.230+0000 7f045f1fd740 1 Processor -- start 2024-09-11T22:07:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f045f1fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 0x55b5c2123b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f045f1fd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c2124050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f045f1fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c2126cb0 0x55b5c2124590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f045f1fd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b5c2129880 con 0x55b5c211c410 2024-09-11T22:07:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f045f1fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b5c2009290 con 0x55b5c211baf0 2024-09-11T22:07:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f045f1fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b5c2129a00 con 0x55b5c2126cb0 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f045f1fd740 10 client.0 _ll_register_callbacks cb 0x55b5c203a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f045659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 0x55b5c2123b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f045659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 0x55b5c2123b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:43294/0 (socket says 172.21.15.152:43294) 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f045659c640 1 -- 172.21.15.152:0/1224331015 learned_addr learned my addr 172.21.15.152:0/1224331015 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f0455d9b640 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c2124050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f0455d9b640 1 -- 172.21.15.152:0/1224331015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c2126cb0 msgr2=0x55b5c2124590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f0455d9b640 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c2126cb0 0x55b5c2124590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f0455d9b640 1 -- 172.21.15.152:0/1224331015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 msgr2=0x55b5c2123b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f0455d9b640 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 0x55b5c2123b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.231+0000 7f0455d9b640 1 -- 172.21.15.152:0/1224331015 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5c1d93210 con 0x55b5c211c410 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.232+0000 7f0455d9b640 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c2124050 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f044c0ccc30 tx=0x7f044c098660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76593e2fe0a04b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.232+0000 7f043dffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:07:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.232+0000 7f043dffb640 1 -- 172.21.15.152:0/1224331015 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c09c380 con 0x55b5c211c410 2024-09-11T22:07:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.232+0000 7f045f1fd740 1 -- 172.21.15.152:0/1224331015 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04500183f0 con 0x55b5c211c410 2024-09-11T22:07:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.232+0000 7f043dffb640 1 -- 172.21.15.152:0/1224331015 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f044c0badb0 con 0x55b5c211c410 2024-09-11T22:07:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.232+0000 7f043dffb640 1 -- 172.21.15.152:0/1224331015 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f044c0bc070 con 0x55b5c211c410 2024-09-11T22:07:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.233+0000 7f045f1fd740 10 client.16212 fetch_fsmap learned FSMap version 30 2024-09-11T22:07:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.233+0000 7f045f1fd740 1 -- 172.21.15.152:0/1224331015 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b5c1e5f620 con 0x55b5c211c410 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.234+0000 7f043dffb640 1 -- 172.21.15.152:0/1224331015 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04500183f0 con 0x55b5c211c410 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.234+0000 7f043dffb640 1 -- 172.21.15.152:0/1224331015 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f044c0870b0 con 0x55b5c211c410 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.234+0000 7f045f1fd740 10 client.16212 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.234+0000 7f045f1fd740 10 client.16212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.234+0000 7f045f1fd740 20 client.16212 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.234+0000 7f045f1fd740 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5c2136ff0 0x55b5c2139490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.234+0000 7f045f1fd740 4 client.16212 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.234+0000 7f045f1fd740 1 -- 172.21.15.152:0/1224331015 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5c208da20 con 0x55b5c2136ff0 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.234+0000 7f045659c640 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5c2136ff0 0x55b5c2139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.235+0000 7f045659c640 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5c2136ff0 0x55b5c2139490 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4195f426b1499080 server_cookie=975eadf23463c669 in_seq=0 out_seq=0 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.235+0000 7f043dffb640 10 client.16212 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.236+0000 7f043dffb640 1 -- 172.21.15.152:0/1224331015 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5c208da20 con 0x55b5c2136ff0 2024-09-11T22:07:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.236+0000 7f043dffb640 10 client.16212 handle_command_reply: tid=0 2024-09-11T22:07:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.236+0000 7f045f1fd740 1 client.16212 shutdown 2024-09-11T22:07:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f045f1fd740 1 -- 172.21.15.152:0/1224331015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 msgr2=0x55b5c2124050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f045f1fd740 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c2124050 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f044c0ccc30 tx=0x7f044c098660 comp rx=0 tx=0).stop 2024-09-11T22:07:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f045f1fd740 1 -- 172.21.15.152:0/1224331015 shutdown_connections 2024-09-11T22:07:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f045f1fd740 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5c2136ff0 0x55b5c2139490 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f045f1fd740 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c2126cb0 0x55b5c2124590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f045f1fd740 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c2124050 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f045f1fd740 1 --2- 172.21.15.152:0/1224331015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 0x55b5c2123b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f045f1fd740 1 -- 172.21.15.152:0/1224331015 >> 172.21.15.152:0/1224331015 conn(0x55b5c2118060 msgr2=0x55b5c211ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f043dffb640 0 client.16212 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f045f1fd740 1 -- 172.21.15.152:0/1224331015 shutdown_connections 2024-09-11T22:07:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f045f1fd740 1 -- 172.21.15.152:0/1224331015 wait complete. 2024-09-11T22:07:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.237+0000 7f045f1fd740 20 client.16212 trim_cache size 0 max 16384 2024-09-11T22:07:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.264+0000 7f045f1fd740 1 Processor -- start 2024-09-11T22:07:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.264+0000 7f045f1fd740 1 -- start start 2024-09-11T22:07:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.264+0000 7f045f1fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 0x55b5c21243c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.264+0000 7f045f1fd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c213eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.264+0000 7f045f1fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 0x55b5c213f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.264+0000 7f045f1fd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0438011150 con 0x55b5c211c410 2024-09-11T22:07:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.264+0000 7f045f1fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f043800ea20 con 0x55b5c2126cb0 2024-09-11T22:07:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.264+0000 7f045f1fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f043800c870 con 0x55b5c211baf0 2024-09-11T22:07:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f0456d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 0x55b5c213f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f0456d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 0x55b5c213f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:43298/0 (socket says 172.21.15.152:43298) 2024-09-11T22:07:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f0456d9d640 1 -- 172.21.15.152:0/2686131072 learned_addr learned my addr 172.21.15.152:0/2686131072 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f045659c640 1 --2- 172.21.15.152:0/2686131072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 0x55b5c21243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f0455d9b640 1 --2- 172.21.15.152:0/2686131072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c213eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f0456d9d640 1 -- 172.21.15.152:0/2686131072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 msgr2=0x55b5c21243c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f0456d9d640 1 --2- 172.21.15.152:0/2686131072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 0x55b5c21243c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f0456d9d640 1 -- 172.21.15.152:0/2686131072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 msgr2=0x55b5c213eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f0456d9d640 1 --2- 172.21.15.152:0/2686131072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c213eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f0456d9d640 1 -- 172.21.15.152:0/2686131072 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5c2117e90 con 0x55b5c2126cb0 2024-09-11T22:07:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f045659c640 1 --2- 172.21.15.152:0/2686131072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 0x55b5c21243c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:07:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f0455d9b640 1 --2- 172.21.15.152:0/2686131072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c213eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:07:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f0456d9d640 1 --2- 172.21.15.152:0/2686131072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 0x55b5c213f2e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0450007ef0 tx=0x7f0450007560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9cec3b723ee9764 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f043ffff640 1 -- 172.21.15.152:0/2686131072 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450029050 con 0x55b5c2126cb0 2024-09-11T22:07:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f043ffff640 1 -- 172.21.15.152:0/2686131072 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0450033070 con 0x55b5c2126cb0 2024-09-11T22:07:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.265+0000 7f043ffff640 1 -- 172.21.15.152:0/2686131072 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450011d20 con 0x55b5c2126cb0 2024-09-11T22:07:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.266+0000 7f045f1fd740 1 -- 172.21.15.152:0/2686131072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 msgr2=0x55b5c213f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.266+0000 7f045f1fd740 1 --2- 172.21.15.152:0/2686131072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 0x55b5c213f2e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0450007ef0 tx=0x7f0450007560 comp rx=0 tx=0).stop 2024-09-11T22:07:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.267+0000 7f045f1fd740 1 -- 172.21.15.152:0/2686131072 shutdown_connections 2024-09-11T22:07:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.267+0000 7f045f1fd740 1 --2- 172.21.15.152:0/2686131072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c2126cb0 0x55b5c213f2e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.267+0000 7f045f1fd740 1 --2- 172.21.15.152:0/2686131072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c211c410 0x55b5c213eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.267+0000 7f045f1fd740 1 --2- 172.21.15.152:0/2686131072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211baf0 0x55b5c21243c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.267+0000 7f045f1fd740 1 -- 172.21.15.152:0/2686131072 >> 172.21.15.152:0/2686131072 conn(0x55b5c2118060 msgr2=0x55b5c21171c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.267+0000 7f045f1fd740 1 -- 172.21.15.152:0/2686131072 shutdown_connections 2024-09-11T22:07:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.267+0000 7f045f1fd740 1 -- 172.21.15.152:0/2686131072 wait complete. 2024-09-11T22:07:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f045f1fd740 1 -- start start 2024-09-11T22:07:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f045f1fd740 1 Processor -- start 2024-09-11T22:07:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f045f1fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 0x55b5c212f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f045f1fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211c410 0x55b5c21208a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f045659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 0x55b5c212f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f045659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 0x55b5c212f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:43304/0 (socket says 172.21.15.152:43304) 2024-09-11T22:07:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f045659c640 1 -- 172.21.15.152:0/3924338984 learned_addr learned my addr 172.21.15.152:0/3924338984 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:07:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f045f1fd740 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c2126cb0 0x55b5c2120e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f045f1fd740 1 -- 172.21.15.152:0/3924338984 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f043800cee0 con 0x55b5c2126cb0 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f045f1fd740 1 -- 172.21.15.152:0/3924338984 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f043800e350 con 0x55b5c211baf0 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f045f1fd740 1 -- 172.21.15.152:0/3924338984 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f043800d5b0 con 0x55b5c211c410 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.268+0000 7f0455d9b640 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211c410 0x55b5c21208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.269+0000 7f045659c640 1 -- 172.21.15.152:0/3924338984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211c410 msgr2=0x55b5c21208a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.269+0000 7f045659c640 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211c410 0x55b5c21208a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.269+0000 7f045659c640 1 -- 172.21.15.152:0/3924338984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c2126cb0 msgr2=0x55b5c2120e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.269+0000 7f045659c640 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c2126cb0 0x55b5c2120e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.269+0000 7f045659c640 1 -- 172.21.15.152:0/3924338984 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5c2121650 con 0x55b5c211baf0 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.269+0000 7f045f1fd740 10 client.0 _ll_register_callbacks cb 0x7f044c00a4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.269+0000 7f045f1fd740 1 -- 172.21.15.152:0/3924338984 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0450033070 con 0x55b5c211baf0 2024-09-11T22:07:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.269+0000 7f045659c640 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 0x55b5c212f4b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0448009900 tx=0x7f0448031a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c113108291046df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:07:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f043dffb640 10 client.25709 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f043dffb640 1 -- 172.21.15.152:0/3924338984 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448035040 con 0x55b5c211baf0 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f043dffb640 1 -- 172.21.15.152:0/3924338984 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f0448004450 con 0x55b5c211baf0 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f043dffb640 1 -- 172.21.15.152:0/3924338984 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0448005020 con 0x55b5c211baf0 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f045f1fd740 10 client.25709 fetch_fsmap learned FSMap version 30 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f045f1fd740 1 -- 172.21.15.152:0/3924338984 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b5c21a1cc0 con 0x55b5c211baf0 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f043dffb640 1 -- 172.21.15.152:0/3924338984 <== mon.2 v2:172.21.15.179:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f04480051c0 con 0x55b5c211baf0 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f045f1fd740 10 client.25709 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f045f1fd740 10 client.25709 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f045f1fd740 20 client.25709 populate_metadata read hostname 'smithi152' 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f045f1fd740 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5c21a2360 0x55b5c21a4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f045f1fd740 4 client.25709 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.270+0000 7f045f1fd740 1 -- 172.21.15.152:0/3924338984 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5c2087d70 con 0x55b5c21a2360 2024-09-11T22:07:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.271+0000 7f0455d9b640 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5c21a2360 0x55b5c21a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:07:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.271+0000 7f043dffb640 10 client.25709 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.271+0000 7f0455d9b640 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5c21a2360 0x55b5c21a4820 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46f5e8da593e2c66 server_cookie=795cf5c026a24fe1 in_seq=0 out_seq=0 2024-09-11T22:07:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.278+0000 7f043dffb640 1 -- 172.21.15.152:0/3924338984 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5c2087d70 con 0x55b5c21a2360 2024-09-11T22:07:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.278+0000 7f043dffb640 10 client.25709 handle_command_reply: tid=0 2024-09-11T22:07:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.278+0000 7f045f1fd740 1 client.25709 shutdown 2024-09-11T22:07:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.278+0000 7f045f1fd740 1 -- 172.21.15.152:0/3924338984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 msgr2=0x55b5c212f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.278+0000 7f045f1fd740 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 0x55b5c212f4b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0448009900 tx=0x7f0448031a80 comp rx=0 tx=0).stop 2024-09-11T22:07:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.279+0000 7f045f1fd740 1 -- 172.21.15.152:0/3924338984 shutdown_connections 2024-09-11T22:07:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.279+0000 7f045f1fd740 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5c21a2360 0x55b5c21a4820 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.279+0000 7f045f1fd740 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5c2126cb0 0x55b5c2120e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.279+0000 7f045f1fd740 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5c211c410 0x55b5c21208a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.279+0000 7f045f1fd740 1 --2- 172.21.15.152:0/3924338984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5c211baf0 0x55b5c212f4b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.279+0000 7f043dffb640 0 client.25709 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:07:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.279+0000 7f045f1fd740 1 -- 172.21.15.152:0/3924338984 >> 172.21.15.152:0/3924338984 conn(0x55b5c2118060 msgr2=0x55b5c211d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.279+0000 7f045f1fd740 1 -- 172.21.15.152:0/3924338984 shutdown_connections 2024-09-11T22:07:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.279+0000 7f045f1fd740 1 -- 172.21.15.152:0/3924338984 wait complete. 2024-09-11T22:07:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.280+0000 7f045f1fd740 20 client.25709 trim_cache size 0 max 16384 2024-09-11T22:07:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:07:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:07:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:07:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:07:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.281+0000 7f045c81e640 1 -- 172.21.15.152:0/1595973366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04400a2ea0 msgr2=0x7f04400a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.281+0000 7f045c81e640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04400a2ea0 0x7f04400a5360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f045000fc90 tx=0x7f0450012040 comp rx=0 tx=0).stop 2024-09-11T22:07:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.281+0000 7f045c81e640 1 -- 172.21.15.152:0/1595973366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458102470 msgr2=0x7f0458074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:07:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.281+0000 7f045c81e640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458102470 0x7f0458074a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f044c00c970 tx=0x7f044c00ce30 comp rx=0 tx=0).stop 2024-09-11T22:07:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.285+0000 7f045c81e640 1 -- 172.21.15.152:0/1595973366 shutdown_connections 2024-09-11T22:07:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.285+0000 7f045c81e640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04400a2ea0 0x7f04400a5360 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.285+0000 7f045c81e640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0458107b70 0x7f0458074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.285+0000 7f045c81e640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458102470 0x7f0458074a30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.285+0000 7f045c81e640 1 --2- 172.21.15.152:0/1595973366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0458101ad0 0x7f04580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:07:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.285+0000 7f045c81e640 1 -- 172.21.15.152:0/1595973366 >> 172.21.15.152:0/1595973366 conn(0x7f04580fd7d0 msgr2=0x7f04580fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:07:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.292+0000 7f045c81e640 1 -- 172.21.15.152:0/1595973366 shutdown_connections 2024-09-11T22:07:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:07:49.294+0000 7f045c81e640 1 -- 172.21.15.152:0/1595973366 wait complete. 2024-09-11T22:07:49.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:49 smithi179 ceph-mon[35603]: pgmap v109: 97 pgs: 97 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2024-09-11T22:07:49.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 135.0 s, 4626.0 tps, lat 21.607 ms stddev 22.668 2024-09-11T22:07:49.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:49 smithi193 ceph-mon[35545]: pgmap v109: 97 pgs: 97 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2024-09-11T22:07:49.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:49 smithi152 ceph-mon[31188]: pgmap v109: 97 pgs: 97 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2024-09-11T22:07:51.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:51 smithi179 ceph-mon[35603]: pgmap v110: 97 pgs: 97 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-11T22:07:51.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:51 smithi193 ceph-mon[35545]: pgmap v110: 97 pgs: 97 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-11T22:07:51.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:51 smithi152 ceph-mon[31188]: pgmap v110: 97 pgs: 97 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-11T22:07:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:53 smithi179 ceph-mon[35603]: pgmap v111: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 16 MiB/s wr, 1.13k op/s 2024-09-11T22:07:53.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:53 smithi193 ceph-mon[35545]: pgmap v111: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 16 MiB/s wr, 1.13k op/s 2024-09-11T22:07:53.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:53 smithi152 ceph-mon[31188]: pgmap v111: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 16 MiB/s wr, 1.13k op/s 2024-09-11T22:07:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 140.0 s, 5578.2 tps, lat 17.880 ms stddev 19.160 2024-09-11T22:07:55.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:55 smithi179 ceph-mon[35603]: pgmap v112: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-09-11T22:07:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:55 smithi193 ceph-mon[35545]: pgmap v112: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-09-11T22:07:55.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:55 smithi152 ceph-mon[31188]: pgmap v112: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-09-11T22:07:57.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:57 smithi179 ceph-mon[35603]: pgmap v113: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-09-11T22:07:57.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:57 smithi193 ceph-mon[35545]: pgmap v113: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-09-11T22:07:57.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:57 smithi152 ceph-mon[31188]: pgmap v113: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-09-11T22:07:59.124 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:07:59.510 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:07:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:07:59 smithi179 ceph-mon[35603]: pgmap v114: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 1.09k op/s 2024-09-11T22:07:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 145.0 s, 5143.1 tps, lat 19.521 ms stddev 22.371 2024-09-11T22:07:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:07:59 smithi193 ceph-mon[35545]: pgmap v114: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 1.09k op/s 2024-09-11T22:07:59.826 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:07:59 smithi152 ceph-mon[31188]: pgmap v114: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 1.09k op/s 2024-09-11T22:08:00.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.232+0000 7f7a7c454640 1 -- 172.21.15.152:0/1788846913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74102ef0 msgr2=0x7f7a7410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:00.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.232+0000 7f7a7c454640 1 --2- 172.21.15.152:0/1788846913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74102ef0 0x7f7a7410da40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009930 tx=0x7f7a6c02a4d0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.232+0000 7f7a7c454640 1 -- 172.21.15.152:0/1788846913 shutdown_connections 2024-09-11T22:08:00.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.232+0000 7f7a7c454640 1 --2- 172.21.15.152:0/1788846913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74102ef0 0x7f7a7410da40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.232+0000 7f7a7c454640 1 --2- 172.21.15.152:0/1788846913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a74102570 0x7f7a741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.232+0000 7f7a7c454640 1 --2- 172.21.15.152:0/1788846913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a74100e20 0x7f7a74101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.232+0000 7f7a7c454640 1 -- 172.21.15.152:0/1788846913 >> 172.21.15.152:0/1788846913 conn(0x7f7a740fc7d0 msgr2=0x7f7a740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:00.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.232+0000 7f7a7c454640 1 -- 172.21.15.152:0/1788846913 shutdown_connections 2024-09-11T22:08:00.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.232+0000 7f7a7c454640 1 -- 172.21.15.152:0/1788846913 wait complete. 2024-09-11T22:08:00.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.233+0000 7f7a7c454640 1 Processor -- start 2024-09-11T22:08:00.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.234+0000 7f7a7c454640 1 -- start start 2024-09-11T22:08:00.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.234+0000 7f7a7c454640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a74100e20 0x7f7a7419aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.234+0000 7f7a7c454640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a74102570 0x7f7a7419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.234+0000 7f7a7c454640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74102ef0 0x7f7a741a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.234+0000 7f7a7c454640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7410e850 con 0x7f7a74100e20 2024-09-11T22:08:00.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.234+0000 7f7a7c454640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7410e6d0 con 0x7f7a74102ef0 2024-09-11T22:08:00.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.234+0000 7f7a7c454640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7410e9d0 con 0x7f7a74102570 2024-09-11T22:08:00.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.234+0000 7f7a7a1f0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a74100e20 0x7f7a7419aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.235+0000 7f7a7a9f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74102ef0 0x7f7a741a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.235+0000 7f7a7a1f0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a74100e20 0x7f7a7419aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54214/0 (socket says 172.21.15.152:54214) 2024-09-11T22:08:00.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.235+0000 7f7a7a9f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74102ef0 0x7f7a741a2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35802/0 (socket says 172.21.15.152:35802) 2024-09-11T22:08:00.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.235+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/1644367574 learned_addr learned my addr 172.21.15.152:0/1644367574 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:00.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.235+0000 7f7a799ef640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a74102570 0x7f7a7419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.235+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/1644367574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a74102570 msgr2=0x7f7a7419b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:00.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.235+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a74102570 0x7f7a7419b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.235+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/1644367574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74102ef0 msgr2=0x7f7a741a2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:00.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.235+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74102ef0 0x7f7a741a2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.235+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/1644367574 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a74109720 con 0x7f7a74100e20 2024-09-11T22:08:00.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.236+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a74100e20 0x7f7a7419aed0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800e9f0 tx=0x7f7a6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:00.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.236+0000 7f7a737fe640 1 -- 172.21.15.152:0/1644367574 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800cd80 con 0x7f7a74100e20 2024-09-11T22:08:00.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.236+0000 7f7a7c454640 1 -- 172.21.15.152:0/1644367574 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a74109a10 con 0x7f7a74100e20 2024-09-11T22:08:00.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.236+0000 7f7a7c454640 1 -- 172.21.15.152:0/1644367574 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a74109fa0 con 0x7f7a74100e20 2024-09-11T22:08:00.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.237+0000 7f7a737fe640 1 -- 172.21.15.152:0/1644367574 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a68010910 con 0x7f7a74100e20 2024-09-11T22:08:00.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.237+0000 7f7a737fe640 1 -- 172.21.15.152:0/1644367574 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68018960 con 0x7f7a74100e20 2024-09-11T22:08:00.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.241+0000 7f7a737fe640 1 -- 172.21.15.152:0/1644367574 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f7a68010ac0 con 0x7f7a74100e20 2024-09-11T22:08:00.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.241+0000 7f7a7e82d740 1 Processor -- start 2024-09-11T22:08:00.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7e82d740 1 -- start start 2024-09-11T22:08:00.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a737fe640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a5c0a2d70 0x7f7a5c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef164a0 0x55f41ef16880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef16dc0 0x55f41ef21140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef21680 0x55f41ef23a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7e82d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f41ee7c2e0 con 0x55f41ef164a0 2024-09-11T22:08:00.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7e82d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f41ee23ce0 con 0x55f41ef16dc0 2024-09-11T22:08:00.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7e82d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f41ee782a0 con 0x55f41ef21680 2024-09-11T22:08:00.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7a9f1640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a5c0a2d70 0x7f7a5c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a737fe640 1 -- 172.21.15.152:0/1644367574 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f7a680cf800 con 0x7f7a74100e20 2024-09-11T22:08:00.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7a9f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef21680 0x55f41ef23a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7a9f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef21680 0x55f41ef23a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:51478/0 (socket says 172.21.15.152:51478) 2024-09-11T22:08:00.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7a9f1640 1 -- 172.21.15.152:0/1283932533 learned_addr learned my addr 172.21.15.152:0/1283932533 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:00.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.242+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/1283932533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef164a0 0x55f41ef16880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.243+0000 7f7a7a9f1640 1 -- 172.21.15.152:0/1283932533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef16dc0 msgr2=0x55f41ef21140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:00.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.243+0000 7f7a799ef640 1 --2- 172.21.15.152:0/1283932533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef16dc0 0x55f41ef21140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.243+0000 7f7a7a9f1640 1 --2- 172.21.15.152:0/1283932533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef16dc0 0x55f41ef21140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.243+0000 7f7a7a9f1640 1 -- 172.21.15.152:0/1283932533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef164a0 msgr2=0x55f41ef16880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:00.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.243+0000 7f7a7a9f1640 1 --2- 172.21.15.152:0/1283932533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef164a0 0x55f41ef16880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.243+0000 7f7a7a9f1640 1 -- 172.21.15.152:0/1283932533 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f41ee08440 con 0x55f41ef21680 2024-09-11T22:08:00.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.243+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/1283932533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef164a0 0x55f41ef16880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:00.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.243+0000 7f7a799ef640 1 --2- 172.21.15.152:0/1283932533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef16dc0 0x55f41ef21140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:00.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.244+0000 7f7a7a9f1640 1 --2- 172.21.15.152:0/1283932533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef21680 0x55f41ef23a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009900 tx=0x7f7a6c003700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9379bd64ed1dd103 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:00.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.244+0000 7f7a7a9f1640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a5c0a2d70 0x7f7a5c0a5230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009930 tx=0x7f7a6c043000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:00.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.244+0000 7f7a70dea640 1 -- 172.21.15.152:0/1283932533 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c04e070 con 0x55f41ef21680 2024-09-11T22:08:00.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.244+0000 7f7a70dea640 1 -- 172.21.15.152:0/1283932533 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a6c031a90 con 0x55f41ef21680 2024-09-11T22:08:00.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.245+0000 7f7a70dea640 1 -- 172.21.15.152:0/1283932533 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c03dac0 con 0x55f41ef21680 2024-09-11T22:08:00.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.245+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1283932533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef21680 msgr2=0x55f41ef23a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:00.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.245+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/1283932533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef21680 0x55f41ef23a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009900 tx=0x7f7a6c003700 comp rx=0 tx=0).stop 2024-09-11T22:08:00.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.245+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1283932533 shutdown_connections 2024-09-11T22:08:00.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.245+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/1283932533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef21680 0x55f41ef23a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.245+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/1283932533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef16dc0 0x55f41ef21140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.245+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/1283932533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef164a0 0x55f41ef16880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.246+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1283932533 >> 172.21.15.152:0/1283932533 conn(0x55f41ef12a30 msgr2=0x55f41ef12e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:00.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.246+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1283932533 shutdown_connections 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.246+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1283932533 wait complete. 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.246+0000 7f7a7e82d740 1 -- start start 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.246+0000 7f7a7e82d740 1 Processor -- start 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.246+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef164a0 0x55f41ef20fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.246+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef16dc0 0x55f41ef1e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef21680 0x55f41ef1e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a7e82d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f41ef242a0 con 0x55f41ef164a0 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a7e82d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f41ee37050 con 0x55f41ef21680 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a7e82d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f41ef24420 con 0x55f41ef16dc0 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a7e82d740 10 client.0 _ll_register_callbacks cb 0x55f41ee77160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a799ef640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef16dc0 0x55f41ef1e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a7a1f0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef164a0 0x55f41ef20fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a799ef640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef16dc0 0x55f41ef1e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:51484/0 (socket says 172.21.15.152:51484) 2024-09-11T22:08:00.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a799ef640 1 -- 172.21.15.152:0/4214418606 learned_addr learned my addr 172.21.15.152:0/4214418606 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:00.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a7a9f1640 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef21680 0x55f41ef1e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a799ef640 1 -- 172.21.15.152:0/4214418606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef21680 msgr2=0x55f41ef1e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:00.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a799ef640 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef21680 0x55f41ef1e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a799ef640 1 -- 172.21.15.152:0/4214418606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef164a0 msgr2=0x55f41ef20fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:00.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a799ef640 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef164a0 0x55f41ef20fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.247+0000 7f7a799ef640 1 -- 172.21.15.152:0/4214418606 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f41ebed3c0 con 0x55f41ef16dc0 2024-09-11T22:08:00.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.248+0000 7f7a799ef640 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef16dc0 0x55f41ef1e290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009dc0 tx=0x7f7a64004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dde31c2f5b2e44f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:00.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.248+0000 7f7a59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:08:00.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.248+0000 7f7a59ffb640 1 -- 172.21.15.152:0/4214418606 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64004d20 con 0x55f41ef16dc0 2024-09-11T22:08:00.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.248+0000 7f7a59ffb640 1 -- 172.21.15.152:0/4214418606 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f7a64012720 con 0x55f41ef16dc0 2024-09-11T22:08:00.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.248+0000 7f7a7e82d740 1 -- 172.21.15.152:0/4214418606 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a6c031a90 con 0x55f41ef16dc0 2024-09-11T22:08:00.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.249+0000 7f7a59ffb640 1 -- 172.21.15.152:0/4214418606 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7a64012920 con 0x55f41ef16dc0 2024-09-11T22:08:00.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.249+0000 7f7a7e82d740 10 client.25858 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:00.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.249+0000 7f7a7e82d740 1 -- 172.21.15.152:0/4214418606 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f41ef2fcd0 con 0x55f41ef16dc0 2024-09-11T22:08:00.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.249+0000 7f7a59ffb640 1 -- 172.21.15.152:0/4214418606 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a6c031a90 con 0x55f41ef16dc0 2024-09-11T22:08:00.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.250+0000 7f7a59ffb640 1 -- 172.21.15.152:0/4214418606 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7a64021070 con 0x55f41ef16dc0 2024-09-11T22:08:00.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.250+0000 7f7a7e82d740 10 client.25858 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:00.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.250+0000 7f7a7e82d740 10 client.25858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:00.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.250+0000 7f7a7e82d740 20 client.25858 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:00.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.250+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f41ef31230 0x55f41ef33650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.250+0000 7f7a7e82d740 4 client.25858 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:00.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.250+0000 7f7a7e82d740 1 -- 172.21.15.152:0/4214418606 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f41ee89850 con 0x55f41ef31230 2024-09-11T22:08:00.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.250+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f41ef31230 0x55f41ef33650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.251+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f41ef31230 0x55f41ef33650 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9431f233e5630296 server_cookie=3f0435665e8ba711 in_seq=0 out_seq=0 2024-09-11T22:08:00.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.251+0000 7f7a59ffb640 10 client.25858 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:00.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.251+0000 7f7a59ffb640 1 -- 172.21.15.152:0/4214418606 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f41ee89850 con 0x55f41ef31230 2024-09-11T22:08:00.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.251+0000 7f7a59ffb640 10 client.25858 handle_command_reply: tid=0 2024-09-11T22:08:00.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.252+0000 7f7a7e82d740 1 client.25858 shutdown 2024-09-11T22:08:00.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.252+0000 7f7a7e82d740 1 -- 172.21.15.152:0/4214418606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef16dc0 msgr2=0x55f41ef1e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:00.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.252+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef16dc0 0x55f41ef1e290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009dc0 tx=0x7f7a64004410 comp rx=0 tx=0).stop 2024-09-11T22:08:00.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.252+0000 7f7a7e82d740 1 -- 172.21.15.152:0/4214418606 shutdown_connections 2024-09-11T22:08:00.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.252+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f41ef31230 0x55f41ef33650 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.252+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef21680 0x55f41ef1e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.252+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef16dc0 0x55f41ef1e290 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.252+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/4214418606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef164a0 0x55f41ef20fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.252+0000 7f7a7e82d740 1 -- 172.21.15.152:0/4214418606 >> 172.21.15.152:0/4214418606 conn(0x55f41ef12a30 msgr2=0x55f41ef18760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:00.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.252+0000 7f7a59ffb640 0 client.25858 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:00.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.252+0000 7f7a7e82d740 1 -- 172.21.15.152:0/4214418606 shutdown_connections 2024-09-11T22:08:00.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.253+0000 7f7a7e82d740 1 -- 172.21.15.152:0/4214418606 wait complete. 2024-09-11T22:08:00.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.253+0000 7f7a7e82d740 20 client.25858 trim_cache size 0 max 16384 2024-09-11T22:08:00.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.284+0000 7f7a7e82d740 1 Processor -- start 2024-09-11T22:08:00.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.284+0000 7f7a7e82d740 1 -- start start 2024-09-11T22:08:00.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.284+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef2d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.284+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef16dc0 0x55f41ef38f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.284+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef21680 0x55f41ef394a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.284+0000 7f7a7e82d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7a60011130 con 0x55f41ef16dc0 2024-09-11T22:08:00.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7e82d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6000ea00 con 0x55f41ef21680 2024-09-11T22:08:00.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7e82d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6000c850 con 0x55f41ef164a0 2024-09-11T22:08:00.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7a1f0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef2d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7a1f0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef2d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:51494/0 (socket says 172.21.15.152:51494) 2024-09-11T22:08:00.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/2828865098 learned_addr learned my addr 172.21.15.152:0/2828865098 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:00.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7a9f1640 1 --2- 172.21.15.152:0/2828865098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef21680 0x55f41ef394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a799ef640 1 --2- 172.21.15.152:0/2828865098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef16dc0 0x55f41ef38f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/2828865098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef21680 msgr2=0x55f41ef394a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:00.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/2828865098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef21680 0x55f41ef394a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/2828865098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef16dc0 msgr2=0x55f41ef38f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:00.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/2828865098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef16dc0 0x55f41ef38f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/2828865098 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f41ef13bc0 con 0x55f41ef164a0 2024-09-11T22:08:00.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7a9f1640 1 --2- 172.21.15.152:0/2828865098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef21680 0x55f41ef394a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:00.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.285+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/2828865098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef2d590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800cfd0 tx=0x7f7a6809b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af085af6def97121 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:00.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.286+0000 7f7a5bfff640 1 -- 172.21.15.152:0/2828865098 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a680a4900 con 0x55f41ef164a0 2024-09-11T22:08:00.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.286+0000 7f7a5bfff640 1 -- 172.21.15.152:0/2828865098 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a68099d30 con 0x55f41ef164a0 2024-09-11T22:08:00.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.286+0000 7f7a5bfff640 1 -- 172.21.15.152:0/2828865098 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68018de0 con 0x55f41ef164a0 2024-09-11T22:08:00.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.287+0000 7f7a7e82d740 1 -- 172.21.15.152:0/2828865098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 msgr2=0x55f41ef2d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:00.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.287+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/2828865098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef2d590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800cfd0 tx=0x7f7a6809b710 comp rx=0 tx=0).stop 2024-09-11T22:08:00.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.287+0000 7f7a7e82d740 1 -- 172.21.15.152:0/2828865098 shutdown_connections 2024-09-11T22:08:00.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.287+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/2828865098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef21680 0x55f41ef394a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.287+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/2828865098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef16dc0 0x55f41ef38f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.287+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/2828865098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef2d590 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.287+0000 7f7a7e82d740 1 -- 172.21.15.152:0/2828865098 >> 172.21.15.152:0/2828865098 conn(0x55f41ef12a30 msgr2=0x55f41ef19900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:00.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.287+0000 7f7a7e82d740 1 -- 172.21.15.152:0/2828865098 shutdown_connections 2024-09-11T22:08:00.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.287+0000 7f7a7e82d740 1 -- 172.21.15.152:0/2828865098 wait complete. 2024-09-11T22:08:00.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.288+0000 7f7a7e82d740 1 -- start start 2024-09-11T22:08:00.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.288+0000 7f7a7e82d740 1 Processor -- start 2024-09-11T22:08:00.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.288+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef29700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.288+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef16dc0 0x55f41ef29c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.288+0000 7f7a7e82d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef21680 0x55f41ef266d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7a1f0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef29700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7a1f0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef29700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:51496/0 (socket says 172.21.15.152:51496) 2024-09-11T22:08:00.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/1141037506 learned_addr learned my addr 172.21.15.152:0/1141037506 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:00.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1141037506 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6000cec0 con 0x55f41ef21680 2024-09-11T22:08:00.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a799ef640 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef16dc0 0x55f41ef29c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1141037506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6000e330 con 0x55f41ef16dc0 2024-09-11T22:08:00.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1141037506 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6000d590 con 0x55f41ef164a0 2024-09-11T22:08:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7e82d740 10 client.0 _ll_register_callbacks cb 0x7f7a64003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7a9f1640 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef21680 0x55f41ef266d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/1141037506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef16dc0 msgr2=0x55f41ef29c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef16dc0 0x55f41ef29c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/1141037506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef21680 msgr2=0x55f41ef266d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef21680 0x55f41ef266d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.289+0000 7f7a7a1f0640 1 -- 172.21.15.152:0/1141037506 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f41ef1c1f0 con 0x55f41ef164a0 2024-09-11T22:08:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.290+0000 7f7a7a1f0640 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef29700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a68000be0 tx=0x7f7a6809b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5836058c2475e132 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.290+0000 7f7a59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:08:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.290+0000 7f7a59ffb640 1 -- 172.21.15.152:0/1141037506 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a680cd350 con 0x55f41ef164a0 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.290+0000 7f7a59ffb640 1 -- 172.21.15.152:0/1141037506 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f7a6809b0e0 con 0x55f41ef164a0 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.290+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1141037506 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a68099d30 con 0x55f41ef164a0 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.291+0000 7f7a59ffb640 1 -- 172.21.15.152:0/1141037506 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7a6809b300 con 0x55f41ef164a0 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.291+0000 7f7a7e82d740 10 client.25864 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.291+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1141037506 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f41ef9c400 con 0x55f41ef164a0 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.291+0000 7f7a59ffb640 1 -- 172.21.15.152:0/1141037506 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a68099d30 con 0x55f41ef164a0 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.291+0000 7f7a59ffb640 1 -- 172.21.15.152:0/1141037506 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7a680979e0 con 0x55f41ef164a0 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.291+0000 7f7a7e82d740 10 client.25864 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.291+0000 7f7a7e82d740 10 client.25864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.291+0000 7f7a7e82d740 20 client.25864 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.291+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f41ef9cb50 0x55f41ef9ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:00.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.291+0000 7f7a7e82d740 4 client.25864 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:08:00.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.292+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1141037506 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f41ee83d60 con 0x55f41ef9cb50 2024-09-11T22:08:00.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.292+0000 7f7a799ef640 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f41ef9cb50 0x55f41ef9ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:00.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a799ef640 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f41ef9cb50 0x55f41ef9ef70 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a81645777bfef4a6 server_cookie=eb0ce3df0a58beb3 in_seq=0 out_seq=0 2024-09-11T22:08:00.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a59ffb640 10 client.25864 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:00.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a59ffb640 1 -- 172.21.15.152:0/1141037506 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f41ee83d60 con 0x55f41ef9cb50 2024-09-11T22:08:00.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a59ffb640 10 client.25864 handle_command_reply: tid=0 2024-09-11T22:08:00.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a7e82d740 1 client.25864 shutdown 2024-09-11T22:08:00.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1141037506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 msgr2=0x55f41ef29700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:00.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef29700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a68000be0 tx=0x7f7a6809b660 comp rx=0 tx=0).stop 2024-09-11T22:08:00.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1141037506 shutdown_connections 2024-09-11T22:08:00.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f41ef9cb50 0x55f41ef9ef70 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f41ef21680 0x55f41ef266d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f41ef16dc0 0x55f41ef29c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a7e82d740 1 --2- 172.21.15.152:0/1141037506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f41ef164a0 0x55f41ef29700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1141037506 >> 172.21.15.152:0/1141037506 conn(0x55f41ef12a30 msgr2=0x55f41ef19090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:00.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a59ffb640 0 client.25864 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:00.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1141037506 shutdown_connections 2024-09-11T22:08:00.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.293+0000 7f7a7e82d740 1 -- 172.21.15.152:0/1141037506 wait complete. 2024-09-11T22:08:00.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.294+0000 7f7a7e82d740 20 client.25864 trim_cache size 0 max 16384 2024-09-11T22:08:00.299 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:08:00.299 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:08:00.299 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:08:00.299 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:08:00.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.295+0000 7f7a7c454640 1 -- 172.21.15.152:0/1644367574 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a5c0a2d70 msgr2=0x7f7a5c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:00.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.295+0000 7f7a7c454640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a5c0a2d70 0x7f7a5c0a5230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009930 tx=0x7f7a6c043000 comp rx=0 tx=0).stop 2024-09-11T22:08:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.295+0000 7f7a7c454640 1 -- 172.21.15.152:0/1644367574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a74100e20 msgr2=0x7f7a7419aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.295+0000 7f7a7c454640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a74100e20 0x7f7a7419aed0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800e9f0 tx=0x7f7a6800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.295+0000 7f7a7c454640 1 -- 172.21.15.152:0/1644367574 shutdown_connections 2024-09-11T22:08:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.295+0000 7f7a7c454640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7a5c0a2d70 0x7f7a5c0a5230 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.295+0000 7f7a7c454640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74102ef0 0x7f7a741a2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.295+0000 7f7a7c454640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a74102570 0x7f7a7419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.295+0000 7f7a7c454640 1 --2- 172.21.15.152:0/1644367574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a74100e20 0x7f7a7419aed0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.295+0000 7f7a7c454640 1 -- 172.21.15.152:0/1644367574 >> 172.21.15.152:0/1644367574 conn(0x7f7a740fc7d0 msgr2=0x7f7a7410efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.296+0000 7f7a7c454640 1 -- 172.21.15.152:0/1644367574 shutdown_connections 2024-09-11T22:08:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:00.296+0000 7f7a7c454640 1 -- 172.21.15.152:0/1644367574 wait complete. 2024-09-11T22:08:01.231 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:08:01.232 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:08:01.516 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:01.782 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:01 smithi152 ceph-mon[31188]: pgmap v115: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 734 op/s 2024-09-11T22:08:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:01 smithi179 ceph-mon[35603]: pgmap v115: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 734 op/s 2024-09-11T22:08:01.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:01 smithi193 ceph-mon[35545]: pgmap v115: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 734 op/s 2024-09-11T22:08:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.000+0000 7fe837050640 1 -- 172.21.15.152:0/1321540344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe830106a70 msgr2=0x7fe830106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.000+0000 7fe837050640 1 --2- 172.21.15.152:0/1321540344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe830106a70 0x7fe830106e50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe828009c10 tx=0x7fe82802a6e0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.000+0000 7fe837050640 1 -- 172.21.15.152:0/1321540344 shutdown_connections 2024-09-11T22:08:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.000+0000 7fe837050640 1 --2- 172.21.15.152:0/1321540344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe830101410 0x7fe83010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.000+0000 7fe837050640 1 --2- 172.21.15.152:0/1321540344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe830100a70 0x7fe830100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.000+0000 7fe837050640 1 --2- 172.21.15.152:0/1321540344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe830106a70 0x7fe830106e50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.000+0000 7fe837050640 1 -- 172.21.15.152:0/1321540344 >> 172.21.15.152:0/1321540344 conn(0x7fe8300fc790 msgr2=0x7fe8300febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.000+0000 7fe837050640 1 -- 172.21.15.152:0/1321540344 shutdown_connections 2024-09-11T22:08:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.000+0000 7fe837050640 1 -- 172.21.15.152:0/1321540344 wait complete. 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.000+0000 7fe837050640 1 Processor -- start 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.001+0000 7fe837050640 1 -- start start 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.001+0000 7fe837050640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe830100a70 0x7fe830102b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.001+0000 7fe837050640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe830101410 0x7fe8301030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.001+0000 7fe837050640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe830106a70 0x7fe8301035e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.001+0000 7fe837050640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe830110e20 con 0x7fe830101410 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.001+0000 7fe837050640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe830110ca0 con 0x7fe830106a70 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.001+0000 7fe834dec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe830100a70 0x7fe830102b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.001+0000 7fe834dec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe830100a70 0x7fe830102b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:51506/0 (socket says 172.21.15.152:51506) 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.001+0000 7fe8355ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe830106a70 0x7fe8301035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.001+0000 7fe834dec640 1 -- 172.21.15.152:0/3530094698 learned_addr learned my addr 172.21.15.152:0/3530094698 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.001+0000 7fe837050640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe830110fa0 con 0x7fe830100a70 2024-09-11T22:08:02.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.002+0000 7fe834dec640 1 -- 172.21.15.152:0/3530094698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe830106a70 msgr2=0x7fe8301035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:02.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.002+0000 7fe834dec640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe830106a70 0x7fe8301035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.002+0000 7fe834dec640 1 -- 172.21.15.152:0/3530094698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe830101410 msgr2=0x7fe8301030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:02.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.002+0000 7fe834dec640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe830101410 0x7fe8301030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.002+0000 7fe834dec640 1 -- 172.21.15.152:0/3530094698 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8301aade0 con 0x7fe830100a70 2024-09-11T22:08:02.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.003+0000 7fe834dec640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe830100a70 0x7fe830102b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe828009d30 tx=0x7fe8280305d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:02.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.003+0000 7fe8355ed640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe830106a70 0x7fe8301035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:02.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.004+0000 7fe82dffb640 1 -- 172.21.15.152:0/3530094698 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe828041020 con 0x7fe830100a70 2024-09-11T22:08:02.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.004+0000 7fe82dffb640 1 -- 172.21.15.152:0/3530094698 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe828037040 con 0x7fe830100a70 2024-09-11T22:08:02.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.005+0000 7fe837050640 1 -- 172.21.15.152:0/3530094698 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8301aafb0 con 0x7fe830100a70 2024-09-11T22:08:02.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.005+0000 7fe82dffb640 1 -- 172.21.15.152:0/3530094698 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe828036070 con 0x7fe830100a70 2024-09-11T22:08:02.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.005+0000 7fe837050640 1 -- 172.21.15.152:0/3530094698 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8301ab460 con 0x7fe830100a70 2024-09-11T22:08:02.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.006+0000 7fe837050640 1 -- 172.21.15.152:0/3530094698 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8301021b0 con 0x7fe830100a70 2024-09-11T22:08:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.007+0000 7fe82dffb640 1 -- 172.21.15.152:0/3530094698 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe828044020 con 0x7fe830100a70 2024-09-11T22:08:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.010+0000 7fe82dffb640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe81c0a2d70 0x7fe81c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.010+0000 7fe82ffff640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe81c0a2d70 0x7fe81c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.010+0000 7fe82dffb640 1 -- 172.21.15.152:0/3530094698 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe8280f00b0 con 0x7fe830100a70 2024-09-11T22:08:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.010+0000 7fe82ffff640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe81c0a2d70 0x7fe81c0a5230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe8200058c0 tx=0x7fe820005850 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:02.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.013+0000 7fe82dffb640 1 -- 172.21.15.152:0/3530094698 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe82804b020 con 0x7fe830100a70 2024-09-11T22:08:02.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.248+0000 7fe837050640 1 -- 172.21.15.152:0/3530094698 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8301ab920 con 0x7fe830100a70 2024-09-11T22:08:02.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.249+0000 7fe82dffb640 1 -- 172.21.15.152:0/3530094698 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7fe8280bcca0 con 0x7fe830100a70 2024-09-11T22:08:02.250 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:08:02.250 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:08:02.250 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:08:02.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.251+0000 7fe837050640 1 -- 172.21.15.152:0/3530094698 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe81c0a2d70 msgr2=0x7fe81c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:02.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.251+0000 7fe837050640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe81c0a2d70 0x7fe81c0a5230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe8200058c0 tx=0x7fe820005850 comp rx=0 tx=0).stop 2024-09-11T22:08:02.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.251+0000 7fe837050640 1 -- 172.21.15.152:0/3530094698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe830100a70 msgr2=0x7fe830102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:02.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.251+0000 7fe837050640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe830100a70 0x7fe830102b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe828009d30 tx=0x7fe8280305d0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.251+0000 7fe837050640 1 -- 172.21.15.152:0/3530094698 shutdown_connections 2024-09-11T22:08:02.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.251+0000 7fe837050640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe81c0a2d70 0x7fe81c0a5230 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.251+0000 7fe837050640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe830106a70 0x7fe8301035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.251+0000 7fe837050640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe830101410 0x7fe8301030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.251+0000 7fe837050640 1 --2- 172.21.15.152:0/3530094698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe830100a70 0x7fe830102b60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.251+0000 7fe837050640 1 -- 172.21.15.152:0/3530094698 >> 172.21.15.152:0/3530094698 conn(0x7fe8300fc790 msgr2=0x7fe830104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:02.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.252+0000 7fe837050640 1 -- 172.21.15.152:0/3530094698 shutdown_connections 2024-09-11T22:08:02.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:02.252+0000 7fe837050640 1 -- 172.21.15.152:0/3530094698 wait complete. 2024-09-11T22:08:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.404+0000 7f20d041e640 1 -- 172.21.15.152:0/431940254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c8101370 msgr2=0x7f20c810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.404+0000 7f20d041e640 1 --2- 172.21.15.152:0/431940254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c8101370 0x7f20c810d8a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009cd0 tx=0x7f20c002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.404+0000 7f20d041e640 1 -- 172.21.15.152:0/431940254 shutdown_connections 2024-09-11T22:08:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.404+0000 7f20d041e640 1 --2- 172.21.15.152:0/431940254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c8101370 0x7f20c810d8a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.404+0000 7f20d041e640 1 --2- 172.21.15.152:0/431940254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81009d0 0x7f20c8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.404+0000 7f20d041e640 1 --2- 172.21.15.152:0/431940254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20c81069e0 0x7f20c8106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.404+0000 7f20d041e640 1 -- 172.21.15.152:0/431940254 >> 172.21.15.152:0/431940254 conn(0x7f20c80fc6b0 msgr2=0x7f20c80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.404+0000 7f20d041e640 1 -- 172.21.15.152:0/431940254 shutdown_connections 2024-09-11T22:08:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.404+0000 7f20d041e640 1 -- 172.21.15.152:0/431940254 wait complete. 2024-09-11T22:08:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20d041e640 1 Processor -- start 2024-09-11T22:08:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20d041e640 1 -- start start 2024-09-11T22:08:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20d041e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81009d0 0x7f20c81971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20d041e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c8101370 0x7f20c8197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20d041e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20c81069e0 0x7f20c819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20d041e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20c8110e20 con 0x7f20c8101370 2024-09-11T22:08:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20d041e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f20c8110ca0 con 0x7f20c81069e0 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20d041e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20c8110fa0 con 0x7f20c81009d0 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20cd9b9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c8101370 0x7f20c8197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20cd9b9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c8101370 0x7f20c8197730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54294/0 (socket says 172.21.15.152:54294) 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20cd9b9640 1 -- 172.21.15.152:0/1032973891 learned_addr learned my addr 172.21.15.152:0/1032973891 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81009d0 0x7f20c81971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.405+0000 7f20ce9bb640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20c81069e0 0x7f20c819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.406+0000 7f20cd9b9640 1 -- 172.21.15.152:0/1032973891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81009d0 msgr2=0x7f20c81971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.406+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81009d0 0x7f20c81971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.406+0000 7f20cd9b9640 1 -- 172.21.15.152:0/1032973891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20c81069e0 msgr2=0x7f20c819bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.406+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20c81069e0 0x7f20c819bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.406+0000 7f20cd9b9640 1 -- 172.21.15.152:0/1032973891 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c819c1e0 con 0x7f20c8101370 2024-09-11T22:08:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.406+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c8101370 0x7f20c8197730 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f20b800d770 tx=0x7f20b800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.406+0000 7f20bf7fe640 1 -- 172.21.15.152:0/1032973891 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8017070 con 0x7f20c8101370 2024-09-11T22:08:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.406+0000 7f20bf7fe640 1 -- 172.21.15.152:0/1032973891 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20b8005500 con 0x7f20c8101370 2024-09-11T22:08:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.406+0000 7f20d041e640 1 -- 172.21.15.152:0/1032973891 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c819c4d0 con 0x7f20c8101370 2024-09-11T22:08:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.406+0000 7f20bf7fe640 1 -- 172.21.15.152:0/1032973891 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8004e00 con 0x7f20c8101370 2024-09-11T22:08:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.406+0000 7f20d041e640 1 -- 172.21.15.152:0/1032973891 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c81a3d60 con 0x7f20c8101370 2024-09-11T22:08:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.408+0000 7f20bf7fe640 1 -- 172.21.15.152:0/1032973891 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f20b8004fa0 con 0x7f20c8101370 2024-09-11T22:08:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20d2dfd740 1 Processor -- start 2024-09-11T22:08:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20d2dfd740 1 -- start start 2024-09-11T22:08:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c8998d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5598c88fd2f0 con 0x5598c8998970 2024-09-11T22:08:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5598c88a5270 con 0x5598c8999290 2024-09-11T22:08:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5598c88f92b0 con 0x5598c89a5ec0 2024-09-11T22:08:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20cd9b9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20ce1ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20ce9bb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c8998d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20ce1ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35880/0 (socket says 172.21.15.152:35880) 2024-09-11T22:08:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20ce1ba640 1 -- 172.21.15.152:0/2981579505 learned_addr learned my addr 172.21.15.152:0/2981579505 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.409+0000 7f20cd9b9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:51532/0 (socket says 172.21.15.152:51532) 2024-09-11T22:08:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20ce1ba640 1 -- 172.21.15.152:0/2981579505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 msgr2=0x5598c89a82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20bf7fe640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f20b40a2da0 0x7f20b40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/2981579505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20ce1ba640 1 -- 172.21.15.152:0/2981579505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 msgr2=0x5598c8998d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/2981579505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c8998d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20ce1ba640 1 -- 172.21.15.152:0/2981579505 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c88a4340 con 0x5598c8999290 2024-09-11T22:08:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/2981579505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a5980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009c70 tx=0x7f20c4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed44f475df0ad1a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20ce9bb640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f20b40a2da0 0x7f20b40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20bf7fe640 1 -- 172.21.15.152:0/1032973891 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f20b80cee50 con 0x7f20c8101370 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20bcbfe640 1 -- 172.21.15.152:0/2981579505 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4004230 con 0x5598c8999290 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20bcbfe640 1 -- 172.21.15.152:0/2981579505 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20c40043d0 con 0x5598c8999290 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.410+0000 7f20bcbfe640 1 -- 172.21.15.152:0/2981579505 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4019800 con 0x5598c8999290 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.411+0000 7f20d2dfd740 1 -- 172.21.15.152:0/2981579505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 msgr2=0x5598c89a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.411+0000 7f20ce9bb640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f20b40a2da0 0x7f20b40a5260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f20c0004ab0 tx=0x7f20c00095c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.411+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/2981579505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a5980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009c70 tx=0x7f20c4011810 comp rx=0 tx=0).stop 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.411+0000 7f20d2dfd740 1 -- 172.21.15.152:0/2981579505 shutdown_connections 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.411+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/2981579505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.411+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/2981579505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a5980 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.411+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/2981579505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c8998d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.411+0000 7f20d2dfd740 1 -- 172.21.15.152:0/2981579505 >> 172.21.15.152:0/2981579505 conn(0x5598c8995060 msgr2=0x5598c8995440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.411+0000 7f20d2dfd740 1 -- 172.21.15.152:0/2981579505 shutdown_connections 2024-09-11T22:08:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.411+0000 7f20d2dfd740 1 -- 172.21.15.152:0/2981579505 wait complete. 2024-09-11T22:08:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20d2dfd740 1 -- start start 2024-09-11T22:08:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20d2dfd740 1 Processor -- start 2024-09-11T22:08:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5598c89a8af0 con 0x5598c8998970 2024-09-11T22:08:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5598c8886290 con 0x5598c8999290 2024-09-11T22:08:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5598c89a8c70 con 0x5598c89a5ec0 2024-09-11T22:08:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20d2dfd740 10 client.0 _ll_register_callbacks cb 0x5598c88b7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20ce1ba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20ce1ba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89a2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54304/0 (socket says 172.21.15.152:54304) 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20ce1ba640 1 -- 172.21.15.152:0/3317543688 learned_addr learned my addr 172.21.15.152:0/3317543688 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20ce9bb640 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.412+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20ce1ba640 1 -- 172.21.15.152:0/3317543688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 msgr2=0x5598c89a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20ce1ba640 1 -- 172.21.15.152:0/3317543688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 msgr2=0x5598c89a3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20ce1ba640 1 -- 172.21.15.152:0/3317543688 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c8610210 con 0x5598c8998970 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20ce9bb640 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89a2de0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f20c40038a0 tx=0x7f20c40038d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78f4e29446f5282 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20b1ffb640 1 -- 172.21.15.152:0/3317543688 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4027070 con 0x5598c8998970 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20d2dfd740 1 -- 172.21.15.152:0/3317543688 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20c40043d0 con 0x5598c8998970 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20b1ffb640 1 -- 172.21.15.152:0/3317543688 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f20c4005240 con 0x5598c8998970 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20b1ffb640 1 -- 172.21.15.152:0/3317543688 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f20c4033050 con 0x5598c8998970 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20d2dfd740 10 client.16248 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.413+0000 7f20d2dfd740 1 -- 172.21.15.152:0/3317543688 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5598c86dc620 con 0x5598c8998970 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.414+0000 7f20b1ffb640 1 -- 172.21.15.152:0/3317543688 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20c40043d0 con 0x5598c8998970 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.414+0000 7f20b1ffb640 1 -- 172.21.15.152:0/3317543688 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f20c4004cc0 con 0x5598c8998970 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.414+0000 7f20d2dfd740 10 client.16248 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.414+0000 7f20d2dfd740 10 client.16248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.414+0000 7f20d2dfd740 20 client.16248 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.414+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5598c89b5e20 0x5598c89b8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.414+0000 7f20d2dfd740 4 client.16248 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.414+0000 7f20d2dfd740 1 -- 172.21.15.152:0/3317543688 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598c890aa20 con 0x5598c89b5e20 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.414+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5598c89b5e20 0x5598c89b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.414+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5598c89b5e20 0x5598c89b8210 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b508859bb0de619 server_cookie=b0fd276db45d30e3 in_seq=0 out_seq=0 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.414+0000 7f20b1ffb640 10 client.16248 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.415+0000 7f20b1ffb640 1 -- 172.21.15.152:0/3317543688 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598c890aa20 con 0x5598c89b5e20 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.415+0000 7f20b1ffb640 10 client.16248 handle_command_reply: tid=0 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.415+0000 7f20d2dfd740 1 client.16248 shutdown 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.415+0000 7f20d2dfd740 1 -- 172.21.15.152:0/3317543688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 msgr2=0x5598c89a2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.415+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89a2de0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f20c40038a0 tx=0x7f20c40038d0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.416+0000 7f20d2dfd740 1 -- 172.21.15.152:0/3317543688 shutdown_connections 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.416+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5598c89b5e20 0x5598c89b8210 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.416+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.416+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.416+0000 7f20b1ffb640 0 client.16248 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.416+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/3317543688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89a2de0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.416+0000 7f20d2dfd740 1 -- 172.21.15.152:0/3317543688 >> 172.21.15.152:0/3317543688 conn(0x5598c8995060 msgr2=0x5598c899adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.416+0000 7f20d2dfd740 1 -- 172.21.15.152:0/3317543688 shutdown_connections 2024-09-11T22:08:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.416+0000 7f20d2dfd740 1 -- 172.21.15.152:0/3317543688 wait complete. 2024-09-11T22:08:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.416+0000 7f20d2dfd740 20 client.16248 trim_cache size 0 max 16384 2024-09-11T22:08:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20d2dfd740 1 Processor -- start 2024-09-11T22:08:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20d2dfd740 1 -- start start 2024-09-11T22:08:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8998970 0x5598c89bd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8999290 0x5598c89bde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81adf60 con 0x5598c8999290 2024-09-11T22:08:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81ab830 con 0x5598c8998970 2024-09-11T22:08:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81a9680 con 0x5598c89a5ec0 2024-09-11T22:08:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20cd9b9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8999290 0x5598c89bde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20cd9b9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8999290 0x5598c89bde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54312/0 (socket says 172.21.15.152:54312) 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20ce9bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20cd9b9640 1 -- 172.21.15.152:0/2100457057 learned_addr learned my addr 172.21.15.152:0/2100457057 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.432+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/2100457057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8998970 0x5598c89bd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.433+0000 7f20cd9b9640 1 -- 172.21.15.152:0/2100457057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 msgr2=0x5598c89a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.433+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/2100457057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.433+0000 7f20cd9b9640 1 -- 172.21.15.152:0/2100457057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8998970 msgr2=0x5598c89bd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.433+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/2100457057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8998970 0x5598c89bd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.433+0000 7f20cd9b9640 1 -- 172.21.15.152:0/2100457057 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c89a1d70 con 0x5598c8999290 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.433+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/2100457057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8998970 0x5598c89bd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.433+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/2100457057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8999290 0x5598c89bde90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f20b809b380 tx=0x7f20b8097040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca28756523cb11e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.433+0000 7f20b3fff640 1 -- 172.21.15.152:0/2100457057 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8020040 con 0x5598c8999290 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.433+0000 7f20b3fff640 1 -- 172.21.15.152:0/2100457057 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20b80046c0 con 0x5598c8999290 2024-09-11T22:08:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.433+0000 7f20b3fff640 1 -- 172.21.15.152:0/2100457057 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b80a3fb0 con 0x5598c8999290 2024-09-11T22:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 -- 172.21.15.152:0/2100457057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8999290 msgr2=0x5598c89bde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/2100457057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8999290 0x5598c89bde90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f20b809b380 tx=0x7f20b8097040 comp rx=0 tx=0).stop 2024-09-11T22:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 -- 172.21.15.152:0/2100457057 shutdown_connections 2024-09-11T22:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/2100457057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/2100457057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8999290 0x5598c89bde90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/2100457057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8998970 0x5598c89bd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 -- 172.21.15.152:0/2100457057 >> 172.21.15.152:0/2100457057 conn(0x5598c8995060 msgr2=0x5598c89a4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 -- 172.21.15.152:0/2100457057 shutdown_connections 2024-09-11T22:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 -- 172.21.15.152:0/2100457057 wait complete. 2024-09-11T22:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 -- start start 2024-09-11T22:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 Processor -- start 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81a9cf0 con 0x5598c8998970 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81ab160 con 0x5598c8999290 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.434+0000 7f20d2dfd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81aa3c0 con 0x5598c89a5ec0 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20d2dfd740 10 client.0 _ll_register_callbacks cb 0x7f20c0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20ce1ba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20ce1ba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54324/0 (socket says 172.21.15.152:54324) 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20ce1ba640 1 -- 172.21.15.152:0/4294232279 learned_addr learned my addr 172.21.15.152:0/4294232279 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20ce9bb640 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20ce1ba640 1 -- 172.21.15.152:0/4294232279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 msgr2=0x5598c89a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20ce1ba640 1 -- 172.21.15.152:0/4294232279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 msgr2=0x5598c89a97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20ce1ba640 1 -- 172.21.15.152:0/4294232279 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c89aa3a0 con 0x5598c8998970 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20ce1ba640 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89ae480 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f20c4019690 tx=0x7f20c4011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacec4326e2dee9e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20b1ffb640 1 -- 172.21.15.152:0/4294232279 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c403c060 con 0x5598c8998970 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20b1ffb640 1 -- 172.21.15.152:0/4294232279 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f20c4005330 con 0x5598c8998970 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20d2dfd740 1 -- 172.21.15.152:0/4294232279 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5598c8904d70 con 0x5598c8998970 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20b1ffb640 1 -- 172.21.15.152:0/4294232279 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f20c4027040 con 0x5598c8998970 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20d2dfd740 10 client.16254 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.435+0000 7f20d2dfd740 1 -- 172.21.15.152:0/4294232279 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5598c8a207a0 con 0x5598c8998970 2024-09-11T22:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.436+0000 7f20b1ffb640 1 -- 172.21.15.152:0/4294232279 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5598c8904d70 con 0x5598c8998970 2024-09-11T22:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.436+0000 7f20b1ffb640 1 -- 172.21.15.152:0/4294232279 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f20c4023940 con 0x5598c8998970 2024-09-11T22:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.436+0000 7f20d2dfd740 10 client.16254 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.436+0000 7f20d2dfd740 10 client.16254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.436+0000 7f20d2dfd740 20 client.16254 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.436+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5598c8a20e60 0x5598c8a23280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.436+0000 7f20d2dfd740 4 client.16254 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.436+0000 7f20d2dfd740 1 -- 172.21.15.152:0/4294232279 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5598c8881900 con 0x5598c8a20e60 2024-09-11T22:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.436+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5598c8a20e60 0x5598c8a23280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.436+0000 7f20cd9b9640 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5598c8a20e60 0x5598c8a23280 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9080cc49adf0949 server_cookie=a4f507b511c88fb7 in_seq=0 out_seq=0 2024-09-11T22:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:02.436+0000 7f20b1ffb640 10 client.16254 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:02.786 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:02 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3530094698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:02.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:02 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3530094698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:02.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:02 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3530094698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:03.139 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:08:03.413 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:03.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:03 smithi179 ceph-mon[35603]: pgmap v116: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2024-09-11T22:08:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.808+0000 7f20b1ffb640 1 -- 172.21.15.152:0/4294232279 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5598c8881900 con 0x5598c8a20e60 2024-09-11T22:08:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.808+0000 7f20b1ffb640 10 client.16254 handle_command_reply: tid=0 2024-09-11T22:08:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.808+0000 7f20d2dfd740 1 client.16254 shutdown 2024-09-11T22:08:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20d2dfd740 1 -- 172.21.15.152:0/4294232279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 msgr2=0x5598c89ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89ae480 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f20c4019690 tx=0x7f20c4011f90 comp rx=0 tx=0).stop 2024-09-11T22:08:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20d2dfd740 1 -- 172.21.15.152:0/4294232279 shutdown_connections 2024-09-11T22:08:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5598c8a20e60 0x5598c8a23280 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5598c89a5ec0 0x5598c89a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5598c8999290 0x5598c89a97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20b1ffb640 0 client.16254 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20d2dfd740 1 --2- 172.21.15.152:0/4294232279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5598c8998970 0x5598c89ae480 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20d2dfd740 1 -- 172.21.15.152:0/4294232279 >> 172.21.15.152:0/4294232279 conn(0x5598c8995060 msgr2=0x5598c89939a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20d2dfd740 1 -- 172.21.15.152:0/4294232279 shutdown_connections 2024-09-11T22:08:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20d2dfd740 1 -- 172.21.15.152:0/4294232279 wait complete. 2024-09-11T22:08:03.812 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.809+0000 7f20d2dfd740 20 client.16254 trim_cache size 0 max 16384 2024-09-11T22:08:03.812 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:08:03.812 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:08:03.812 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:08:03.812 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:08:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 -- 172.21.15.152:0/1032973891 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f20b40a2da0 msgr2=0x7f20b40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f20b40a2da0 0x7f20b40a5260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f20c0004ab0 tx=0x7f20c00095c0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 -- 172.21.15.152:0/1032973891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c8101370 msgr2=0x7f20c8197730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c8101370 0x7f20c8197730 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f20b800d770 tx=0x7f20b800dc30 comp rx=0 tx=0).stop 2024-09-11T22:08:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 -- 172.21.15.152:0/1032973891 shutdown_connections 2024-09-11T22:08:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f20b40a2da0 0x7f20b40a5260 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20c81069e0 0x7f20c819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c8101370 0x7f20c8197730 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 --2- 172.21.15.152:0/1032973891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c81009d0 0x7f20c81971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 -- 172.21.15.152:0/1032973891 >> 172.21.15.152:0/1032973891 conn(0x7f20c80fc6b0 msgr2=0x7f20c80fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 -- 172.21.15.152:0/1032973891 shutdown_connections 2024-09-11T22:08:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:03.810+0000 7f20d041e640 1 -- 172.21.15.152:0/1032973891 wait complete. 2024-09-11T22:08:03.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:03 smithi193 ceph-mon[35545]: pgmap v116: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2024-09-11T22:08:03.839 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:03 smithi152 ceph-mon[31188]: pgmap v116: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2024-09-11T22:08:03.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.932+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1280063918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd22410c180 msgr2=0x7fd22410e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.932+0000 7fd22a5a1640 1 --2- 172.21.15.152:0/1280063918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd22410c180 0x7fd22410e620 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009ca0 tx=0x7fd21c02a950 comp rx=0 tx=0).stop 2024-09-11T22:08:03.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.932+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1280063918 shutdown_connections 2024-09-11T22:08:03.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.932+0000 7fd22a5a1640 1 --2- 172.21.15.152:0/1280063918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd22410c180 0x7fd22410e620 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.932+0000 7fd22a5a1640 1 --2- 172.21.15.152:0/1280063918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd224103670 0x7fd22410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.932+0000 7fd22a5a1640 1 --2- 172.21.15.152:0/1280063918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd224102d50 0x7fd224103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.932+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1280063918 >> 172.21.15.152:0/1280063918 conn(0x7fd2240fc7d0 msgr2=0x7fd2240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.932+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1280063918 shutdown_connections 2024-09-11T22:08:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.932+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1280063918 wait complete. 2024-09-11T22:08:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.932+0000 7fd22a5a1640 1 Processor -- start 2024-09-11T22:08:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.932+0000 7fd22a5a1640 1 -- start start 2024-09-11T22:08:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd22a5a1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd224102d50 0x7fd2241009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd22a5a1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd224103670 0x7fd224100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd22a5a1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd22410c180 0x7fd224101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd22a5a1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd224111f80 con 0x7fd22410c180 2024-09-11T22:08:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd22a5a1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd224111e00 con 0x7fd224103670 2024-09-11T22:08:03.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd22a5a1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd224112100 con 0x7fd224102d50 2024-09-11T22:08:03.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd228b3e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd22410c180 0x7fd224101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd228b3e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd22410c180 0x7fd224101430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51142/0 (socket says 172.21.15.152:51142) 2024-09-11T22:08:03.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd228b3e640 1 -- 172.21.15.152:0/1362735951 learned_addr learned my addr 172.21.15.152:0/1362735951 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:03.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd2237fe640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd224103670 0x7fd224100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd223fff640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd224102d50 0x7fd2241009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd228b3e640 1 -- 172.21.15.152:0/1362735951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd224102d50 msgr2=0x7fd2241009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd228b3e640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd224102d50 0x7fd2241009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd228b3e640 1 -- 172.21.15.152:0/1362735951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd224103670 msgr2=0x7fd224100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd228b3e640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd224103670 0x7fd224100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd228b3e640 1 -- 172.21.15.152:0/1362735951 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2241a68c0 con 0x7fd22410c180 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd2237fe640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd224103670 0x7fd224100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.933+0000 7fd228b3e640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd22410c180 0x7fd224101430 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd21c004af0 tx=0x7fd21c02f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.934+0000 7fd2217fa640 1 -- 172.21.15.152:0/1362735951 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c034040 con 0x7fd22410c180 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.934+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1362735951 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2241a6b50 con 0x7fd22410c180 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.934+0000 7fd2217fa640 1 -- 172.21.15.152:0/1362735951 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd21c030920 con 0x7fd22410c180 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.934+0000 7fd2217fa640 1 -- 172.21.15.152:0/1362735951 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c004670 con 0x7fd22410c180 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.934+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1362735951 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2241a7080 con 0x7fd22410c180 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.936+0000 7fd22c97a740 1 Processor -- start 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.936+0000 7fd2217fa640 1 -- 172.21.15.152:0/1362735951 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd21c037020 con 0x7fd22410c180 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd22c97a740 1 -- start start 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e83090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e835d0 0x559c69e83a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e8e370 0x559c69e90760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd22c97a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559c69de92f0 con 0x559c69e835d0 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd22c97a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559c69d90cf0 con 0x559c69e84b40 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd22c97a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c69de52b0 con 0x559c69e8e370 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd223fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e835d0 0x559c69e83a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd2237fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e83090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd223fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e835d0 0x559c69e83a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51150/0 (socket says 172.21.15.152:51150) 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd2237fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e83090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41756/0 (socket says 172.21.15.152:41756) 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd223fff640 1 -- 172.21.15.152:0/2259864167 learned_addr learned my addr 172.21.15.152:0/2259864167 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd2237fe640 1 --2- 172.21.15.152:0/2259864167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e8e370 0x559c69e90760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd2217fa640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd20c0a2cf0 0x7fd20c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd2237fe640 1 -- 172.21.15.152:0/2259864167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e8e370 msgr2=0x559c69e90760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:03.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd2237fe640 1 --2- 172.21.15.152:0/2259864167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e8e370 0x559c69e90760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd2237fe640 1 -- 172.21.15.152:0/2259864167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e835d0 msgr2=0x559c69e83a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd2237fe640 1 --2- 172.21.15.152:0/2259864167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e835d0 0x559c69e83a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.937+0000 7fd2237fe640 1 -- 172.21.15.152:0/2259864167 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c69d753a0 con 0x559c69e84b40 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.938+0000 7fd228b3e640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd20c0a2cf0 0x7fd20c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.938+0000 7fd2237fe640 1 --2- 172.21.15.152:0/2259864167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e83090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd218009680 tx=0x7fd218009610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5b2f98afb7200ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.938+0000 7fd2217fa640 1 -- 172.21.15.152:0/1362735951 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd21c0f0070 con 0x7fd22410c180 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.938+0000 7fd20a7fc640 1 -- 172.21.15.152:0/2259864167 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218013e60 con 0x559c69e84b40 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.938+0000 7fd20a7fc640 1 -- 172.21.15.152:0/2259864167 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd21800f910 con 0x559c69e84b40 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.938+0000 7fd20a7fc640 1 -- 172.21.15.152:0/2259864167 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218003a10 con 0x559c69e84b40 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd22c97a740 1 -- 172.21.15.152:0/2259864167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 msgr2=0x559c69e83090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd22c97a740 1 --2- 172.21.15.152:0/2259864167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e83090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd218009680 tx=0x7fd218009610 comp rx=0 tx=0).stop 2024-09-11T22:08:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd228b3e640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd20c0a2cf0 0x7fd20c0a51b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0bc5a0 tx=0x7fd21c004140 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd22c97a740 1 -- 172.21.15.152:0/2259864167 shutdown_connections 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd22c97a740 1 --2- 172.21.15.152:0/2259864167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e8e370 0x559c69e90760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd22c97a740 1 --2- 172.21.15.152:0/2259864167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e835d0 0x559c69e83a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd22c97a740 1 --2- 172.21.15.152:0/2259864167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e83090 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd22c97a740 1 -- 172.21.15.152:0/2259864167 >> 172.21.15.152:0/2259864167 conn(0x559c69e4c310 msgr2=0x559c69e7fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd22c97a740 1 -- 172.21.15.152:0/2259864167 shutdown_connections 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd22c97a740 1 -- 172.21.15.152:0/2259864167 wait complete. 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd22c97a740 1 -- start start 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.939+0000 7fd22c97a740 1 Processor -- start 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e8dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e8af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e8e370 0x559c69e8b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd22c97a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559c69e910c0 con 0x559c69e8e370 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd22c97a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559c69da4060 con 0x559c69e84b40 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd22c97a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c69e91240 con 0x559c69e835d0 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd22c97a740 10 client.0 _ll_register_callbacks cb 0x559c69af78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd223fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e8af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd2237fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e8dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd223fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e8af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41758/0 (socket says 172.21.15.152:41758) 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd223fff640 1 -- 172.21.15.152:0/3675175245 learned_addr learned my addr 172.21.15.152:0/3675175245 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e8dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38886/0 (socket says 172.21.15.152:38886) 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e8e370 0x559c69e8b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd223fff640 1 -- 172.21.15.152:0/3675175245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 msgr2=0x559c69e8dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd223fff640 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e8dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd223fff640 1 -- 172.21.15.152:0/3675175245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e8e370 msgr2=0x559c69e8b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd223fff640 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e8e370 0x559c69e8b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd223fff640 1 -- 172.21.15.152:0/3675175245 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c69b5a3c0 con 0x559c69e84b40 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd223fff640 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e8af90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd214012840 tx=0x7fd214012d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f08e42e6d55f54a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.940+0000 7fd2037fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd2037fe640 1 -- 172.21.15.152:0/3675175245 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214004050 con 0x559c69e84b40 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd2037fe640 1 -- 172.21.15.152:0/3675175245 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd2140041f0 con 0x559c69e84b40 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd22c97a740 1 -- 172.21.15.152:0/3675175245 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd21800f910 con 0x559c69e84b40 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd2037fe640 1 -- 172.21.15.152:0/3675175245 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd2140043f0 con 0x559c69e84b40 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd22c97a740 10 client.25757 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd22c97a740 1 -- 172.21.15.152:0/3675175245 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559c69e9cb60 con 0x559c69e84b40 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd2037fe640 1 -- 172.21.15.152:0/3675175245 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd21800f910 con 0x559c69e84b40 2024-09-11T22:08:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd2037fe640 1 -- 172.21.15.152:0/3675175245 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd214003bb0 con 0x559c69e84b40 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd22c97a740 10 client.25757 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd22c97a740 10 client.25757 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd22c97a740 20 client.25757 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c69e9e070 0x559c69ea0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd22c97a740 4 client.25757 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.941+0000 7fd22c97a740 1 -- 172.21.15.152:0/3675175245 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c69df6860 con 0x559c69e9e070 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.942+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c69e9e070 0x559c69ea0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.942+0000 7fd2037fe640 10 client.25757 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.942+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c69e9e070 0x559c69ea0490 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=197409ed3c9fc2ea server_cookie=f9a0cdde71d83002 in_seq=0 out_seq=0 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.942+0000 7fd2037fe640 1 -- 172.21.15.152:0/3675175245 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c69df6860 con 0x559c69e9e070 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.942+0000 7fd2037fe640 10 client.25757 handle_command_reply: tid=0 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 1 client.25757 shutdown 2024-09-11T22:08:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 1 -- 172.21.15.152:0/3675175245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 msgr2=0x559c69e8af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e8af90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd214012840 tx=0x7fd214012d00 comp rx=0 tx=0).stop 2024-09-11T22:08:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 1 -- 172.21.15.152:0/3675175245 shutdown_connections 2024-09-11T22:08:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c69e9e070 0x559c69ea0490 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e8e370 0x559c69e8b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e84b40 0x559c69e8af90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3675175245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e8dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd2037fe640 0 client.25757 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:08:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 1 -- 172.21.15.152:0/3675175245 >> 172.21.15.152:0/3675175245 conn(0x559c69e4c310 msgr2=0x559c69e85930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 1 -- 172.21.15.152:0/3675175245 shutdown_connections 2024-09-11T22:08:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 1 -- 172.21.15.152:0/3675175245 wait complete. 2024-09-11T22:08:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.943+0000 7fd22c97a740 20 client.25757 trim_cache size 0 max 16384 2024-09-11T22:08:03.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd22c97a740 1 Processor -- start 2024-09-11T22:08:03.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd22c97a740 1 -- start start 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e9a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 0x559c69ea5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e8e370 0x559c69ea6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd22c97a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241b23c0 con 0x559c69e84b40 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd22c97a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241afc90 con 0x559c69e8e370 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd22c97a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241adae0 con 0x559c69e835d0 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd223fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 0x559c69ea5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd223fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 0x559c69ea5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51170/0 (socket says 172.21.15.152:51170) 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd223fff640 1 -- 172.21.15.152:0/3886465730 learned_addr learned my addr 172.21.15.152:0/3886465730 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3886465730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e9a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3886465730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e8e370 0x559c69ea6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd2237fe640 1 -- 172.21.15.152:0/3886465730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e8e370 msgr2=0x559c69ea6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3886465730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e8e370 0x559c69ea6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd2237fe640 1 -- 172.21.15.152:0/3886465730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 msgr2=0x559c69ea5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3886465730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 0x559c69ea5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd2237fe640 1 -- 172.21.15.152:0/3886465730 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c69e80960 con 0x559c69e835d0 2024-09-11T22:08:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.957+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3886465730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e9a390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x559c69ea0ce0 tx=0x7fd2180137e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75021f6368aebd87 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.958+0000 7fd209ffb640 1 -- 172.21.15.152:0/3886465730 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218013e60 con 0x559c69e835d0 2024-09-11T22:08:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.958+0000 7fd209ffb640 1 -- 172.21.15.152:0/3886465730 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd21800fb90 con 0x559c69e835d0 2024-09-11T22:08:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.958+0000 7fd209ffb640 1 -- 172.21.15.152:0/3886465730 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218003d60 con 0x559c69e835d0 2024-09-11T22:08:03.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.958+0000 7fd22c97a740 1 -- 172.21.15.152:0/3886465730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 msgr2=0x559c69e9a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.958+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3886465730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e9a390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x559c69ea0ce0 tx=0x7fd2180137e0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.958+0000 7fd22c97a740 1 -- 172.21.15.152:0/3886465730 shutdown_connections 2024-09-11T22:08:03.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.958+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3886465730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e8e370 0x559c69ea6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.958+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3886465730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 0x559c69ea5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.958+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3886465730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e9a390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.958+0000 7fd22c97a740 1 -- 172.21.15.152:0/3886465730 >> 172.21.15.152:0/3886465730 conn(0x559c69e4c310 msgr2=0x559c69e8a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.959+0000 7fd22c97a740 1 -- 172.21.15.152:0/3886465730 shutdown_connections 2024-09-11T22:08:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.959+0000 7fd22c97a740 1 -- 172.21.15.152:0/3886465730 wait complete. 2024-09-11T22:08:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.959+0000 7fd22c97a740 1 -- start start 2024-09-11T22:08:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.959+0000 7fd22c97a740 1 Processor -- start 2024-09-11T22:08:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.959+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e96a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.959+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 0x559c69e87a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.959+0000 7fd22c97a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e8e370 0x559c69e87f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.959+0000 7fd22c97a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241ae150 con 0x559c69e84b40 2024-09-11T22:08:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.959+0000 7fd22c97a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241af5c0 con 0x559c69e8e370 2024-09-11T22:08:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.959+0000 7fd22c97a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241ae820 con 0x559c69e835d0 2024-09-11T22:08:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd22c97a740 10 client.0 _ll_register_callbacks cb 0x7fd214009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:03.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2237fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e96a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd223fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 0x559c69e87a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2237fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e96a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38912/0 (socket says 172.21.15.152:38912) 2024-09-11T22:08:03.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2237fe640 1 -- 172.21.15.152:0/3972391736 learned_addr learned my addr 172.21.15.152:0/3972391736 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:03.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e8e370 0x559c69e87f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2237fe640 1 -- 172.21.15.152:0/3972391736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e8e370 msgr2=0x559c69e87f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:03.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e8e370 0x559c69e87f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2237fe640 1 -- 172.21.15.152:0/3972391736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 msgr2=0x559c69e87a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 0x559c69e87a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2237fe640 1 -- 172.21.15.152:0/3972391736 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c69e8b860 con 0x559c69e835d0 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd223fff640 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 0x559c69e87a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2237fe640 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e96a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd218003850 tx=0x7fd218003a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=649fac03cb2f32f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2037fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2037fe640 1 -- 172.21.15.152:0/3972391736 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218013e60 con 0x559c69e835d0 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd22c97a740 1 -- 172.21.15.152:0/3972391736 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd21800fb90 con 0x559c69e835d0 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2037fe640 1 -- 172.21.15.152:0/3972391736 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd218003ae0 con 0x559c69e835d0 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.960+0000 7fd2037fe640 1 -- 172.21.15.152:0/3972391736 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd2180050d0 con 0x559c69e835d0 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.961+0000 7fd22c97a740 10 client.25906 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.961+0000 7fd22c97a740 1 -- 172.21.15.152:0/3972391736 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559c69f08930 con 0x559c69e835d0 2024-09-11T22:08:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.961+0000 7fd2037fe640 1 -- 172.21.15.152:0/3972391736 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd21800fb90 con 0x559c69e835d0 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.961+0000 7fd2037fe640 1 -- 172.21.15.152:0/3972391736 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd218003ce0 con 0x559c69e835d0 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.961+0000 7fd22c97a740 10 client.25906 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.961+0000 7fd22c97a740 10 client.25906 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.961+0000 7fd22c97a740 20 client.25906 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.961+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c69f08d00 0x559c69f0b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.961+0000 7fd22c97a740 4 client.25906 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.961+0000 7fd22c97a740 1 -- 172.21.15.152:0/3972391736 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c69df0d70 con 0x559c69f08d00 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.961+0000 7fd223fff640 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c69f08d00 0x559c69f0b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd223fff640 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c69f08d00 0x559c69f0b120 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2d481543f9b8a367 server_cookie=ce3e85a79c7abcf6 in_seq=0 out_seq=0 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd2037fe640 10 client.25906 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd2037fe640 1 -- 172.21.15.152:0/3972391736 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c69df0d70 con 0x559c69f08d00 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd2037fe640 10 client.25906 handle_command_reply: tid=0 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd22c97a740 1 client.25906 shutdown 2024-09-11T22:08:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd22c97a740 1 -- 172.21.15.152:0/3972391736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 msgr2=0x559c69e96a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e96a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd218003850 tx=0x7fd218003a00 comp rx=0 tx=0).stop 2024-09-11T22:08:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd22c97a740 1 -- 172.21.15.152:0/3972391736 shutdown_connections 2024-09-11T22:08:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c69f08d00 0x559c69f0b120 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c69e8e370 0x559c69e87f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c69e84b40 0x559c69e87a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd2037fe640 0 client.25906 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:08:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd22c97a740 1 --2- 172.21.15.152:0/3972391736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c69e835d0 0x559c69e96a30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd22c97a740 1 -- 172.21.15.152:0/3972391736 >> 172.21.15.152:0/3972391736 conn(0x559c69e4c310 msgr2=0x559c69e8a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd22c97a740 1 -- 172.21.15.152:0/3972391736 shutdown_connections 2024-09-11T22:08:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.962+0000 7fd22c97a740 1 -- 172.21.15.152:0/3972391736 wait complete. 2024-09-11T22:08:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22c97a740 20 client.25906 trim_cache size 0 max 16384 2024-09-11T22:08:03.971 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:08:03.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1362735951 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd20c0a2cf0 msgr2=0x7fd20c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd20c0a2cf0 0x7fd20c0a51b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0bc5a0 tx=0x7fd21c004140 comp rx=0 tx=0).stop 2024-09-11T22:08:03.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1362735951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd22410c180 msgr2=0x7fd224101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:03.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd22410c180 0x7fd224101430 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd21c004af0 tx=0x7fd21c02f3a0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1362735951 shutdown_connections 2024-09-11T22:08:03.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd20c0a2cf0 0x7fd20c0a51b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd22410c180 0x7fd224101430 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd224103670 0x7fd224100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 --2- 172.21.15.152:0/1362735951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd224102d50 0x7fd2241009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:03.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1362735951 >> 172.21.15.152:0/1362735951 conn(0x7fd2240fc7d0 msgr2=0x7fd2240fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:03.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1362735951 shutdown_connections 2024-09-11T22:08:03.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:03.963+0000 7fd22a5a1640 1 -- 172.21.15.152:0/1362735951 wait complete. 2024-09-11T22:08:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 150.0 s, 1619.6 tps, lat 58.359 ms stddev 120.135 2024-09-11T22:08:04.928 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:08:05.398 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:05.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:05 smithi179 ceph-mon[35603]: pgmap v117: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-09-11T22:08:05.802 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:05 smithi152 ceph-mon[31188]: pgmap v117: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-09-11T22:08:05.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:05 smithi193 ceph-mon[35545]: pgmap v117: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-09-11T22:08:06.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.070+0000 7ff7c704d640 1 -- 172.21.15.152:0/2908246791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c0103ff0 msgr2=0x7ff7c01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:06.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.070+0000 7ff7c704d640 1 --2- 172.21.15.152:0/2908246791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c0103ff0 0x7ff7c01043d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009900 tx=0x7ff7b402a440 comp rx=0 tx=0).stop 2024-09-11T22:08:06.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.070+0000 7ff7c704d640 1 -- 172.21.15.152:0/2908246791 shutdown_connections 2024-09-11T22:08:06.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.070+0000 7ff7c704d640 1 --2- 172.21.15.152:0/2908246791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c0109120 0x7ff7c0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.070+0000 7ff7c704d640 1 --2- 172.21.15.152:0/2908246791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c01049a0 0x7ff7c01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.070+0000 7ff7c704d640 1 --2- 172.21.15.152:0/2908246791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c0103ff0 0x7ff7c01043d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.070+0000 7ff7c704d640 1 -- 172.21.15.152:0/2908246791 >> 172.21.15.152:0/2908246791 conn(0x7ff7c00ffa90 msgr2=0x7ff7c0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:06.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.071+0000 7ff7c704d640 1 -- 172.21.15.152:0/2908246791 shutdown_connections 2024-09-11T22:08:06.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.071+0000 7ff7c704d640 1 -- 172.21.15.152:0/2908246791 wait complete. 2024-09-11T22:08:06.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.072+0000 7ff7c704d640 1 Processor -- start 2024-09-11T22:08:06.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.072+0000 7ff7c704d640 1 -- start start 2024-09-11T22:08:06.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.072+0000 7ff7c704d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c0103ff0 0x7ff7c0110bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.072+0000 7ff7c704d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c01049a0 0x7ff7c010dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.072+0000 7ff7c704d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c0109120 0x7ff7c010e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.072+0000 7ff7c704d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c0114120 con 0x7ff7c0109120 2024-09-11T22:08:06.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.072+0000 7ff7c704d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c0113fa0 con 0x7ff7c01049a0 2024-09-11T22:08:06.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.072+0000 7ff7c704d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c01142a0 con 0x7ff7c0103ff0 2024-09-11T22:08:06.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c01049a0 0x7ff7c010dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7c4de9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c0103ff0 0x7ff7c0110bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c01049a0 0x7ff7c010dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41796/0 (socket says 172.21.15.152:41796) 2024-09-11T22:08:06.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7bffff640 1 -- 172.21.15.152:0/3202722505 learned_addr learned my addr 172.21.15.152:0/3202722505 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:06.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c0109120 0x7ff7c010e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7c4de9640 1 -- 172.21.15.152:0/3202722505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c01049a0 msgr2=0x7ff7c010dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:06.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7c4de9640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c01049a0 0x7ff7c010dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7c4de9640 1 -- 172.21.15.152:0/3202722505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c0109120 msgr2=0x7ff7c010e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:06.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7c4de9640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c0109120 0x7ff7c010e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7c4de9640 1 -- 172.21.15.152:0/3202722505 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c01b3660 con 0x7ff7c0103ff0 2024-09-11T22:08:06.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7bffff640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c01049a0 0x7ff7c010dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:06.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.073+0000 7ff7c4de9640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c0103ff0 0x7ff7c0110bc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009230 tx=0x7ff7b40055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:06.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.074+0000 7ff7bdffb640 1 -- 172.21.15.152:0/3202722505 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4040030 con 0x7ff7c0103ff0 2024-09-11T22:08:06.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.074+0000 7ff7c704d640 1 -- 172.21.15.152:0/3202722505 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c01b3830 con 0x7ff7c0103ff0 2024-09-11T22:08:06.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.074+0000 7ff7bdffb640 1 -- 172.21.15.152:0/3202722505 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7b4003ce0 con 0x7ff7c0103ff0 2024-09-11T22:08:06.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.074+0000 7ff7bdffb640 1 -- 172.21.15.152:0/3202722505 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4004230 con 0x7ff7c0103ff0 2024-09-11T22:08:06.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.074+0000 7ff7c704d640 1 -- 172.21.15.152:0/3202722505 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c01b3c80 con 0x7ff7c0103ff0 2024-09-11T22:08:06.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.079+0000 7ff7c9426740 1 Processor -- start 2024-09-11T22:08:06.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.079+0000 7ff7c9426740 1 -- start start 2024-09-11T22:08:06.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.079+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 0x558352de6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.079+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352de6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.079+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352df1370 0x558352df3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.079+0000 7ff7c9426740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558352d4c2f0 con 0x558352de7b40 2024-09-11T22:08:06.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.079+0000 7ff7c9426740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558352cf3cf0 con 0x558352df1370 2024-09-11T22:08:06.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.079+0000 7ff7c9426740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558352d482b0 con 0x558352de65d0 2024-09-11T22:08:06.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.079+0000 7ff7c55ea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 0x558352de6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.079+0000 7ff7c55ea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 0x558352de6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51204/0 (socket says 172.21.15.152:51204) 2024-09-11T22:08:06.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.080+0000 7ff7c55ea640 1 -- 172.21.15.152:0/1199285415 learned_addr learned my addr 172.21.15.152:0/1199285415 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:06.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.080+0000 7ff7bffff640 1 --2- 172.21.15.152:0/1199285415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352df1370 0x558352df3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.080+0000 7ff7c55ea640 1 -- 172.21.15.152:0/1199285415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 msgr2=0x558352de6a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:08:06.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.080+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/1199285415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352de6a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.080+0000 7ff7c55ea640 1 -- 172.21.15.152:0/1199285415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352df1370 msgr2=0x558352df3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:06.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.080+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/1199285415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352df1370 0x558352df3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.080+0000 7ff7c55ea640 1 -- 172.21.15.152:0/1199285415 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558352cd83a0 con 0x558352de7b40 2024-09-11T22:08:06.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.080+0000 7ff7bdffb640 1 -- 172.21.15.152:0/3202722505 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff7b4043030 con 0x7ff7c0103ff0 2024-09-11T22:08:06.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.080+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/1199285415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 0x558352de6090 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009e60 tx=0x7ff7b8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ecd0e57359f082b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:06.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.080+0000 7ff7a6ffd640 1 -- 172.21.15.152:0/1199285415 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8016070 con 0x558352de7b40 2024-09-11T22:08:06.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.081+0000 7ff7a6ffd640 1 -- 172.21.15.152:0/1199285415 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7b8004d20 con 0x558352de7b40 2024-09-11T22:08:06.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.081+0000 7ff7a6ffd640 1 -- 172.21.15.152:0/1199285415 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8012830 con 0x558352de7b40 2024-09-11T22:08:06.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.081+0000 7ff7bdffb640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7a80a2df0 0x7ff7a80a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.081+0000 7ff7bdffb640 1 -- 172.21.15.152:0/3202722505 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff7b40efb50 con 0x7ff7c0103ff0 2024-09-11T22:08:06.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.082+0000 7ff7c9426740 1 -- 172.21.15.152:0/1199285415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 msgr2=0x558352de6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:06.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.082+0000 7ff7c9426740 1 --2- 172.21.15.152:0/1199285415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 0x558352de6090 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009e60 tx=0x7ff7b8010740 comp rx=0 tx=0).stop 2024-09-11T22:08:06.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.082+0000 7ff7c9426740 1 -- 172.21.15.152:0/1199285415 shutdown_connections 2024-09-11T22:08:06.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.082+0000 7ff7c9426740 1 --2- 172.21.15.152:0/1199285415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352df1370 0x558352df3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.082+0000 7ff7c9426740 1 --2- 172.21.15.152:0/1199285415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352de6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.082+0000 7ff7c9426740 1 --2- 172.21.15.152:0/1199285415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 0x558352de6090 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.082+0000 7ff7c9426740 1 -- 172.21.15.152:0/1199285415 >> 172.21.15.152:0/1199285415 conn(0x558352daf310 msgr2=0x558352de2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:06.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.082+0000 7ff7c4de9640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7a80a2df0 0x7ff7a80a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.082+0000 7ff7c9426740 1 -- 172.21.15.152:0/1199285415 shutdown_connections 2024-09-11T22:08:06.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.082+0000 7ff7c9426740 1 -- 172.21.15.152:0/1199285415 wait complete. 2024-09-11T22:08:06.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.082+0000 7ff7c4de9640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7a80a2df0 0x7ff7a80a52b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x558352de3ac0 tx=0x7ff7b4009260 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:06.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.083+0000 7ff7c9426740 1 -- start start 2024-09-11T22:08:06.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.083+0000 7ff7c9426740 1 Processor -- start 2024-09-11T22:08:06.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de65d0 0x558352df0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 0x558352dee030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352df1370 0x558352dee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7c9426740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558352df4070 con 0x558352de65d0 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7c9426740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558352d07060 con 0x558352de7b40 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7c9426740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558352df41f0 con 0x558352df1370 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7c9426740 10 client.0 _ll_register_callbacks cb 0x558352a5a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7c55ea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de65d0 0x558352df0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 0x558352dee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7c55ea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de65d0 0x558352df0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51220/0 (socket says 172.21.15.152:51220) 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7c55ea640 1 -- 172.21.15.152:0/3970323418 learned_addr learned my addr 172.21.15.152:0/3970323418 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352df1370 0x558352dee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7bffff640 1 -- 172.21.15.152:0/3970323418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352df1370 msgr2=0x558352dee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7bffff640 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352df1370 0x558352dee640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7bffff640 1 -- 172.21.15.152:0/3970323418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de65d0 msgr2=0x558352df0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7bffff640 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de65d0 0x558352df0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.084+0000 7ff7bffff640 1 -- 172.21.15.152:0/3970323418 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558352abd3c0 con 0x558352de7b40 2024-09-11T22:08:06.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.085+0000 7ff7bffff640 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 0x558352dee030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7c010f430 tx=0x7ff7b000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88712a13594039fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:06.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.085+0000 7ff79ffff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:08:06.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.085+0000 7ff79ffff640 1 -- 172.21.15.152:0/3970323418 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00120d0 con 0x558352de7b40 2024-09-11T22:08:06.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.085+0000 7ff79ffff640 1 -- 172.21.15.152:0/3970323418 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff7b0004030 con 0x558352de7b40 2024-09-11T22:08:06.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.085+0000 7ff7c9426740 1 -- 172.21.15.152:0/3970323418 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7b8004d20 con 0x558352de7b40 2024-09-11T22:08:06.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.086+0000 7ff79ffff640 1 -- 172.21.15.152:0/3970323418 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff7b0012270 con 0x558352de7b40 2024-09-11T22:08:06.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.086+0000 7ff7c9426740 10 client.25775 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:06.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.086+0000 7ff7c9426740 1 -- 172.21.15.152:0/3970323418 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558352dffc20 con 0x558352de7b40 2024-09-11T22:08:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.087+0000 7ff79ffff640 1 -- 172.21.15.152:0/3970323418 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7b8004d20 con 0x558352de7b40 2024-09-11T22:08:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.087+0000 7ff79ffff640 1 -- 172.21.15.152:0/3970323418 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff7b0023070 con 0x558352de7b40 2024-09-11T22:08:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.087+0000 7ff7c9426740 10 client.25775 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.087+0000 7ff7c9426740 10 client.25775 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:08:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.087+0000 7ff7c9426740 20 client.25775 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.087+0000 7ff7c9426740 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x558352e010e0 0x558352e034d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.088+0000 7ff7c9426740 4 client.25775 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:06.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.088+0000 7ff7c9426740 1 -- 172.21.15.152:0/3970323418 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558352d59860 con 0x558352e010e0 2024-09-11T22:08:06.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.088+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x558352e010e0 0x558352e034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.088+0000 7ff79ffff640 10 client.25775 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:08:06.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.088+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x558352e010e0 0x558352e034d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d35f2d72cdce8d2 server_cookie=d6ff3611be74443a in_seq=0 out_seq=0 2024-09-11T22:08:06.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.089+0000 7ff79ffff640 1 -- 172.21.15.152:0/3970323418 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558352d59860 con 0x558352e010e0 2024-09-11T22:08:06.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.089+0000 7ff79ffff640 10 client.25775 handle_command_reply: tid=0 2024-09-11T22:08:06.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.089+0000 7ff7c9426740 1 client.25775 shutdown 2024-09-11T22:08:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.090+0000 7ff7c9426740 1 -- 172.21.15.152:0/3970323418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 msgr2=0x558352dee030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.090+0000 7ff7c9426740 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 0x558352dee030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7c010f430 tx=0x7ff7b000f790 comp rx=0 tx=0).stop 2024-09-11T22:08:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.091+0000 7ff7c9426740 1 -- 172.21.15.152:0/3970323418 shutdown_connections 2024-09-11T22:08:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.091+0000 7ff7c9426740 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x558352e010e0 0x558352e034d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.091+0000 7ff7c9426740 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352df1370 0x558352dee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.091+0000 7ff7c9426740 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 0x558352dee030 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.091+0000 7ff7c9426740 1 --2- 172.21.15.152:0/3970323418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de65d0 0x558352df0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.091+0000 7ff7c9426740 1 -- 172.21.15.152:0/3970323418 >> 172.21.15.152:0/3970323418 conn(0x558352daf310 msgr2=0x558352de8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.091+0000 7ff79ffff640 0 client.25775 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:08:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.091+0000 7ff7c9426740 1 -- 172.21.15.152:0/3970323418 shutdown_connections 2024-09-11T22:08:06.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.091+0000 7ff7c9426740 1 -- 172.21.15.152:0/3970323418 wait complete. 2024-09-11T22:08:06.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.091+0000 7ff7c9426740 20 client.25775 trim_cache size 0 max 16384 2024-09-11T22:08:06.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.114+0000 7ff7c9426740 1 Processor -- start 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.115+0000 7ff7c9426740 1 -- start start 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.115+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352de1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.115+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 0x558352de9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.115+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352df1370 0x558352de9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.115+0000 7ff7c9426740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c01bf0e0 con 0x558352de7b40 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.115+0000 7ff7c9426740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c01bc9b0 con 0x558352df1370 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.115+0000 7ff7c9426740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c01ba800 con 0x558352de65d0 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.115+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 0x558352de9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.115+0000 7ff7c55ea640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352de1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.115+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 0x558352de9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51230/0 (socket says 172.21.15.152:51230) 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.115+0000 7ff7bffff640 1 -- 172.21.15.152:0/974859437 learned_addr learned my addr 172.21.15.152:0/974859437 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:06.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.116+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/974859437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352df1370 0x558352de9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.116+0000 7ff7c55ea640 1 -- 172.21.15.152:0/974859437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352df1370 msgr2=0x558352de9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:06.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.116+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/974859437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352df1370 0x558352de9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.116+0000 7ff7c55ea640 1 -- 172.21.15.152:0/974859437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 msgr2=0x558352de9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:06.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.116+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/974859437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 0x558352de9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.116+0000 7ff7c55ea640 1 -- 172.21.15.152:0/974859437 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558352dec580 con 0x558352de65d0 2024-09-11T22:08:06.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.116+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/974859437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352de1bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x558352e03c90 tx=0x7ff7b8009760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=681f125eff639f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:06.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.116+0000 7ff7a67fc640 1 -- 172.21.15.152:0/974859437 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8016040 con 0x558352de65d0 2024-09-11T22:08:06.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.117+0000 7ff7a67fc640 1 -- 172.21.15.152:0/974859437 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7b8030070 con 0x558352de65d0 2024-09-11T22:08:06.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.117+0000 7ff7a67fc640 1 -- 172.21.15.152:0/974859437 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8012a90 con 0x558352de65d0 2024-09-11T22:08:06.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.117+0000 7ff7c9426740 1 -- 172.21.15.152:0/974859437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 msgr2=0x558352de1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:06.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.118+0000 7ff7c9426740 1 --2- 172.21.15.152:0/974859437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352de1bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x558352e03c90 tx=0x7ff7b8009760 comp rx=0 tx=0).stop 2024-09-11T22:08:06.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.118+0000 7ff7c9426740 1 -- 172.21.15.152:0/974859437 shutdown_connections 2024-09-11T22:08:06.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.118+0000 7ff7c9426740 1 --2- 172.21.15.152:0/974859437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352df1370 0x558352de9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.118+0000 7ff7c9426740 1 --2- 172.21.15.152:0/974859437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352de7b40 0x558352de9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.118+0000 7ff7c9426740 1 --2- 172.21.15.152:0/974859437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352de1bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.118+0000 7ff7c9426740 1 -- 172.21.15.152:0/974859437 >> 172.21.15.152:0/974859437 conn(0x558352daf310 msgr2=0x558352de14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:06.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.118+0000 7ff7c9426740 1 -- 172.21.15.152:0/974859437 shutdown_connections 2024-09-11T22:08:06.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.118+0000 7ff7c9426740 1 -- 172.21.15.152:0/974859437 wait complete. 2024-09-11T22:08:06.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.118+0000 7ff7c9426740 1 -- start start 2024-09-11T22:08:06.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.118+0000 7ff7c9426740 1 Processor -- start 2024-09-11T22:08:06.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.119+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352e64020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.119+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 0x558352e64560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.119+0000 7ff7c9426740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352df1370 0x558352df4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.119+0000 7ff7c9426740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c01bae70 con 0x558352df1370 2024-09-11T22:08:06.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.119+0000 7ff7c9426740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c01bc2e0 con 0x558352de7b40 2024-09-11T22:08:06.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.119+0000 7ff7c9426740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c01bb540 con 0x558352de65d0 2024-09-11T22:08:06.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.119+0000 7ff7c55ea640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352e64020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.119+0000 7ff7c55ea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352df1370 0x558352df4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.119+0000 7ff7c55ea640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352e64020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38954/0 (socket says 172.21.15.152:38954) 2024-09-11T22:08:06.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.119+0000 7ff7c55ea640 1 -- 172.21.15.152:0/2552941017 learned_addr learned my addr 172.21.15.152:0/2552941017 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:06.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.119+0000 7ff7bffff640 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 0x558352e64560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff7bffff640 1 -- 172.21.15.152:0/2552941017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 msgr2=0x558352e64020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:06.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff7bffff640 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352e64020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff7bffff640 1 -- 172.21.15.152:0/2552941017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352df1370 msgr2=0x558352df4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:06.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff7bffff640 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352df1370 0x558352df4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff7bffff640 1 -- 172.21.15.152:0/2552941017 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558352df5250 con 0x558352de7b40 2024-09-11T22:08:06.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff7bffff640 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 0x558352e64560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x558352dd7380 tx=0x7ff7b0005640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c833a3584b8e4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:06.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff7c9426740 10 client.0 _ll_register_callbacks cb 0x7ff7b0009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:06.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff7c9426740 1 -- 172.21.15.152:0/2552941017 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7b8030070 con 0x558352de7b40 2024-09-11T22:08:06.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff79ffff640 10 client.25781 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:08:06.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff79ffff640 1 -- 172.21.15.152:0/2552941017 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0034050 con 0x558352de7b40 2024-09-11T22:08:06.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff79ffff640 1 -- 172.21.15.152:0/2552941017 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff7b00127f0 con 0x558352de7b40 2024-09-11T22:08:06.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.120+0000 7ff79ffff640 1 -- 172.21.15.152:0/2552941017 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff7b0029040 con 0x558352de7b40 2024-09-11T22:08:06.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.121+0000 7ff7c9426740 10 client.25781 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:06.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.121+0000 7ff7c9426740 1 -- 172.21.15.152:0/2552941017 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=30}) -- 0x558352e6b710 con 0x558352de7b40 2024-09-11T22:08:06.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.121+0000 7ff79ffff640 1 -- 172.21.15.152:0/2552941017 <== mon.2 v2:172.21.15.179:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff7b0037020 con 0x558352de7b40 2024-09-11T22:08:06.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.122+0000 7ff7c9426740 10 client.25781 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:06.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.122+0000 7ff7c9426740 10 client.25781 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:08:06.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.122+0000 7ff7c9426740 20 client.25781 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:06.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.122+0000 7ff7c9426740 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x558352e6be00 0x558352e6e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:06.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.122+0000 7ff7c9426740 4 client.25781 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:08:06.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.122+0000 7ff7c9426740 1 -- 172.21.15.152:0/2552941017 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff7b8030070 con 0x558352e6be00 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.122+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x558352e6be00 0x558352e6e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.122+0000 7ff7c55ea640 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x558352e6be00 0x558352e6e220 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b2c1464092dc07d server_cookie=4635ff566d46611f in_seq=0 out_seq=0 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.122+0000 7ff79ffff640 10 client.25781 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.122+0000 7ff79ffff640 1 -- 172.21.15.152:0/2552941017 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff7b8030070 con 0x558352e6be00 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff79ffff640 10 client.25781 handle_command_reply: tid=0 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 1 client.25781 shutdown 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 1 -- 172.21.15.152:0/2552941017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 msgr2=0x558352e64560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 0x558352e64560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x558352dd7380 tx=0x7ff7b0005640 comp rx=0 tx=0).stop 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 1 -- 172.21.15.152:0/2552941017 shutdown_connections 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x558352e6be00 0x558352e6e220 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558352df1370 0x558352df4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558352de7b40 0x558352e64560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 1 --2- 172.21.15.152:0/2552941017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558352de65d0 0x558352e64020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 1 -- 172.21.15.152:0/2552941017 >> 172.21.15.152:0/2552941017 conn(0x558352daf310 msgr2=0x558352df00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:06.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff79ffff640 0 client.25781 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:08:06.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 1 -- 172.21.15.152:0/2552941017 shutdown_connections 2024-09-11T22:08:06.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 1 -- 172.21.15.152:0/2552941017 wait complete. 2024-09-11T22:08:06.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.123+0000 7ff7c9426740 20 client.25781 trim_cache size 0 max 16384 2024-09-11T22:08:06.129 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:08:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 -- 172.21.15.152:0/3202722505 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7a80a2df0 msgr2=0x7ff7a80a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7a80a2df0 0x7ff7a80a52b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x558352de3ac0 tx=0x7ff7b4009260 comp rx=0 tx=0).stop 2024-09-11T22:08:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 -- 172.21.15.152:0/3202722505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c0103ff0 msgr2=0x7ff7c0110bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c0103ff0 0x7ff7c0110bc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009230 tx=0x7ff7b40055a0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 -- 172.21.15.152:0/3202722505 shutdown_connections 2024-09-11T22:08:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff7a80a2df0 0x7ff7a80a52b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7c0109120 0x7ff7c010e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7c01049a0 0x7ff7c010dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 --2- 172.21.15.152:0/3202722505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c0103ff0 0x7ff7c0110bc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 -- 172.21.15.152:0/3202722505 >> 172.21.15.152:0/3202722505 conn(0x7ff7c00ffa90 msgr2=0x7ff7c0100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 -- 172.21.15.152:0/3202722505 shutdown_connections 2024-09-11T22:08:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:06.125+0000 7ff7c704d640 1 -- 172.21.15.152:0/3202722505 wait complete. 2024-09-11T22:08:07.287 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:08:07.718 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:07.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:07 smithi179 ceph-mon[35603]: pgmap v118: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-09-11T22:08:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:07 smithi193 ceph-mon[35545]: pgmap v118: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-09-11T22:08:07.852 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:07 smithi152 ceph-mon[31188]: pgmap v118: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-09-11T22:08:08.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.370+0000 7f8878733640 1 -- 172.21.15.152:0/3643917135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88701011e0 msgr2=0x7f8870105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:08.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.370+0000 7f8878733640 1 --2- 172.21.15.152:0/3643917135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88701011e0 0x7f8870105980 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8864009860 tx=0x7f886402a360 comp rx=0 tx=0).stop 2024-09-11T22:08:08.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.370+0000 7f8878733640 1 -- 172.21.15.152:0/3643917135 shutdown_connections 2024-09-11T22:08:08.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.370+0000 7f8878733640 1 --2- 172.21.15.152:0/3643917135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870105ec0 0x7f8870106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.370+0000 7f8878733640 1 --2- 172.21.15.152:0/3643917135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88701011e0 0x7f8870105980 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.370+0000 7f8878733640 1 --2- 172.21.15.152:0/3643917135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88701008c0 0x7f8870100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.370+0000 7f8878733640 1 -- 172.21.15.152:0/3643917135 >> 172.21.15.152:0/3643917135 conn(0x7f88700fc7d0 msgr2=0x7f88700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:08.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.371+0000 7f8878733640 1 -- 172.21.15.152:0/3643917135 shutdown_connections 2024-09-11T22:08:08.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.371+0000 7f8878733640 1 -- 172.21.15.152:0/3643917135 wait complete. 2024-09-11T22:08:08.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.372+0000 7f8878733640 1 Processor -- start 2024-09-11T22:08:08.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f8878733640 1 -- start start 2024-09-11T22:08:08.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f8878733640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88701008c0 0x7f88701a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f8878733640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88701011e0 0x7f88701a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f8878733640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870105ec0 0x7f887019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f8878733640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8870118700 con 0x7f88701008c0 2024-09-11T22:08:08.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f8878733640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8870118580 con 0x7f88701011e0 2024-09-11T22:08:08.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f8878733640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8870118880 con 0x7f8870105ec0 2024-09-11T22:08:08.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f88764cf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88701008c0 0x7f88701a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f8876cd0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870105ec0 0x7f887019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f8876cd0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870105ec0 0x7f887019ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38978/0 (socket says 172.21.15.152:38978) 2024-09-11T22:08:08.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f88764cf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88701008c0 0x7f88701a4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51254/0 (socket says 172.21.15.152:51254) 2024-09-11T22:08:08.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f8876cd0640 1 -- 172.21.15.152:0/1100320953 learned_addr learned my addr 172.21.15.152:0/1100320953 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:08.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.373+0000 7f8875cce640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88701011e0 0x7f88701a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.374+0000 7f8876cd0640 1 -- 172.21.15.152:0/1100320953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88701011e0 msgr2=0x7f88701a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:08.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.374+0000 7f8876cd0640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88701011e0 0x7f88701a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.374+0000 7f8876cd0640 1 -- 172.21.15.152:0/1100320953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88701008c0 msgr2=0x7f88701a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:08.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.374+0000 7f8876cd0640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88701008c0 0x7f88701a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.374+0000 7f8876cd0640 1 -- 172.21.15.152:0/1100320953 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887019f200 con 0x7f8870105ec0 2024-09-11T22:08:08.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.374+0000 7f8876cd0640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870105ec0 0x7f887019ead0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f886800e970 tx=0x7f886800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:08.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.376+0000 7f886f7fe640 1 -- 172.21.15.152:0/1100320953 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886800ccc0 con 0x7f8870105ec0 2024-09-11T22:08:08.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.376+0000 7f886f7fe640 1 -- 172.21.15.152:0/1100320953 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8868005500 con 0x7f8870105ec0 2024-09-11T22:08:08.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.376+0000 7f886f7fe640 1 -- 172.21.15.152:0/1100320953 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868010690 con 0x7f8870105ec0 2024-09-11T22:08:08.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.376+0000 7f8878733640 1 -- 172.21.15.152:0/1100320953 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887019f4f0 con 0x7f8870105ec0 2024-09-11T22:08:08.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.376+0000 7f8878733640 1 -- 172.21.15.152:0/1100320953 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88701ab7e0 con 0x7f8870105ec0 2024-09-11T22:08:08.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.380+0000 7f887ab0c740 1 Processor -- start 2024-09-11T22:08:08.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.380+0000 7f886f7fe640 1 -- 172.21.15.152:0/1100320953 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8868004e50 con 0x7f8870105ec0 2024-09-11T22:08:08.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.380+0000 7f887ab0c740 1 -- start start 2024-09-11T22:08:08.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.381+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136bbb40 0x55b2136ba090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.381+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.381+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136c5370 0x55b2136c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.381+0000 7f887ab0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b2136202f0 con 0x55b2136c5370 2024-09-11T22:08:08.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.381+0000 7f887ab0c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b2135c7cf0 con 0x55b2136bbb40 2024-09-11T22:08:08.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.381+0000 7f887ab0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b21361c2b0 con 0x55b2136ba5d0 2024-09-11T22:08:08.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.381+0000 7f8875cce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136bbb40 0x55b2136ba090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.381+0000 7f8875cce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136bbb40 0x55b2136ba090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41876/0 (socket says 172.21.15.152:41876) 2024-09-11T22:08:08.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.381+0000 7f8875cce640 1 -- 172.21.15.152:0/396758357 learned_addr learned my addr 172.21.15.152:0/396758357 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:08.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.382+0000 7f886f7fe640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88580a2dc0 0x7f88580a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.382+0000 7f8875cce640 1 --2- 172.21.15.152:0/396758357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136c5370 0x55b2136c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.382+0000 7f886f7fe640 1 -- 172.21.15.152:0/1100320953 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f88680cf6a0 con 0x7f8870105ec0 2024-09-11T22:08:08.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.382+0000 7f8876cd0640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88580a2dc0 0x7f88580a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.383+0000 7f8876cd0640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88580a2dc0 0x7f88580a5280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f88680a42d0 tx=0x7f88680bd040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.383+0000 7f8875cce640 1 -- 172.21.15.152:0/396758357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 msgr2=0x55b2136baa10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:08:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.383+0000 7f8875cce640 1 --2- 172.21.15.152:0/396758357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136baa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.383+0000 7f8875cce640 1 -- 172.21.15.152:0/396758357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136c5370 msgr2=0x55b2136c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.383+0000 7f8875cce640 1 --2- 172.21.15.152:0/396758357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136c5370 0x55b2136c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.383+0000 7f8875cce640 1 -- 172.21.15.152:0/396758357 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2135ac3a0 con 0x55b2136bbb40 2024-09-11T22:08:08.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.384+0000 7f8875cce640 1 --2- 172.21.15.152:0/396758357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136bbb40 0x55b2136ba090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8864030550 tx=0x7f8864005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59ceea51d7b9146c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:08.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.385+0000 7f886cff9640 1 -- 172.21.15.152:0/396758357 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864037040 con 0x55b2136bbb40 2024-09-11T22:08:08.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.385+0000 7f886cff9640 1 -- 172.21.15.152:0/396758357 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8864045070 con 0x55b2136bbb40 2024-09-11T22:08:08.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.385+0000 7f886cff9640 1 -- 172.21.15.152:0/396758357 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864003bf0 con 0x55b2136bbb40 2024-09-11T22:08:08.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.387+0000 7f887ab0c740 1 -- 172.21.15.152:0/396758357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136bbb40 msgr2=0x55b2136ba090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:08.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.387+0000 7f887ab0c740 1 --2- 172.21.15.152:0/396758357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136bbb40 0x55b2136ba090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8864030550 tx=0x7f8864005780 comp rx=0 tx=0).stop 2024-09-11T22:08:08.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.387+0000 7f887ab0c740 1 -- 172.21.15.152:0/396758357 shutdown_connections 2024-09-11T22:08:08.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.387+0000 7f887ab0c740 1 --2- 172.21.15.152:0/396758357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136c5370 0x55b2136c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.387+0000 7f887ab0c740 1 --2- 172.21.15.152:0/396758357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.387+0000 7f887ab0c740 1 --2- 172.21.15.152:0/396758357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136bbb40 0x55b2136ba090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.387+0000 7f887ab0c740 1 -- 172.21.15.152:0/396758357 >> 172.21.15.152:0/396758357 conn(0x55b213683310 msgr2=0x55b2136b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.387+0000 7f887ab0c740 1 -- 172.21.15.152:0/396758357 shutdown_connections 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.387+0000 7f887ab0c740 1 -- 172.21.15.152:0/396758357 wait complete. 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.387+0000 7f887ab0c740 1 -- start start 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f887ab0c740 1 Processor -- start 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 0x55b2136c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136c5370 0x55b2136c2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f887ab0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b2136c8010 con 0x55b2136bbb40 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f887ab0c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b2135db060 con 0x55b2136c5370 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f887ab0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b2136c8190 con 0x55b2136ba5d0 2024-09-11T22:08:08.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f887ab0c740 10 client.0 _ll_register_callbacks cb 0x55b21332e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:08.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f8875cce640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f8875cce640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136c4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38990/0 (socket says 172.21.15.152:38990) 2024-09-11T22:08:08.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f8875cce640 1 -- 172.21.15.152:0/1328226787 learned_addr learned my addr 172.21.15.152:0/1328226787 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:08.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f88764cf640 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 0x55b2136c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.388+0000 7f8875cce640 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136c5370 0x55b2136c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.389+0000 7f8875cce640 1 -- 172.21.15.152:0/1328226787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136c5370 msgr2=0x55b2136c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:08.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.389+0000 7f8875cce640 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136c5370 0x55b2136c2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.389+0000 7f8875cce640 1 -- 172.21.15.152:0/1328226787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 msgr2=0x55b2136c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:08.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.389+0000 7f8875cce640 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 0x55b2136c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.389+0000 7f8875cce640 1 -- 172.21.15.152:0/1328226787 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2133913c0 con 0x55b2136ba5d0 2024-09-11T22:08:08.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.389+0000 7f88764cf640 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 0x55b2136c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:08.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.389+0000 7f8855ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:08:08.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.389+0000 7f8875cce640 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136c4dd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8864035040 tx=0x7f8864005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcc6b551003c4f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:08.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.389+0000 7f8855ffb640 1 -- 172.21.15.152:0/1328226787 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864037040 con 0x55b2136ba5d0 2024-09-11T22:08:08.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.390+0000 7f887ab0c740 1 -- 172.21.15.152:0/1328226787 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8864045070 con 0x55b2136ba5d0 2024-09-11T22:08:08.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.390+0000 7f8855ffb640 1 -- 172.21.15.152:0/1328226787 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8864005030 con 0x55b2136ba5d0 2024-09-11T22:08:08.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.390+0000 7f8855ffb640 1 -- 172.21.15.152:0/1328226787 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8864037040 con 0x55b2136ba5d0 2024-09-11T22:08:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.390+0000 7f887ab0c740 10 client.25930 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.390+0000 7f887ab0c740 1 -- 172.21.15.152:0/1328226787 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b2136c8010 con 0x55b2136ba5d0 2024-09-11T22:08:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.391+0000 7f8855ffb640 1 -- 172.21.15.152:0/1328226787 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8864045070 con 0x55b2136ba5d0 2024-09-11T22:08:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.391+0000 7f8855ffb640 1 -- 172.21.15.152:0/1328226787 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8864065070 con 0x55b2136ba5d0 2024-09-11T22:08:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.391+0000 7f887ab0c740 10 client.25930 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.391+0000 7f887ab0c740 10 client.25930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.391+0000 7f887ab0c740 20 client.25930 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.391+0000 7f887ab0c740 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b2136d5160 0x55b2136d75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.391+0000 7f887ab0c740 4 client.25930 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.391+0000 7f887ab0c740 1 -- 172.21.15.152:0/1328226787 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b21362d860 con 0x55b2136d5160 2024-09-11T22:08:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.392+0000 7f88764cf640 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b2136d5160 0x55b2136d75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.392+0000 7f8855ffb640 10 client.25930 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:08.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.392+0000 7f88764cf640 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b2136d5160 0x55b2136d75a0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36bace57e99768e0 server_cookie=d6c752a814ed495c in_seq=0 out_seq=0 2024-09-11T22:08:08.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.393+0000 7f8855ffb640 1 -- 172.21.15.152:0/1328226787 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b21362d860 con 0x55b2136d5160 2024-09-11T22:08:08.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.393+0000 7f8855ffb640 10 client.25930 handle_command_reply: tid=0 2024-09-11T22:08:08.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f887ab0c740 1 client.25930 shutdown 2024-09-11T22:08:08.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f887ab0c740 1 -- 172.21.15.152:0/1328226787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 msgr2=0x55b2136c4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:08.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f887ab0c740 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136c4dd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8864035040 tx=0x7f8864005850 comp rx=0 tx=0).stop 2024-09-11T22:08:08.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f887ab0c740 1 -- 172.21.15.152:0/1328226787 shutdown_connections 2024-09-11T22:08:08.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f887ab0c740 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b2136d5160 0x55b2136d75a0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f8855ffb640 0 client.25930 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:08.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f887ab0c740 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136c5370 0x55b2136c2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f887ab0c740 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 0x55b2136c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f887ab0c740 1 --2- 172.21.15.152:0/1328226787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136c4dd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f887ab0c740 1 -- 172.21.15.152:0/1328226787 >> 172.21.15.152:0/1328226787 conn(0x55b213683310 msgr2=0x55b2136bc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:08.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f887ab0c740 1 -- 172.21.15.152:0/1328226787 shutdown_connections 2024-09-11T22:08:08.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.394+0000 7f887ab0c740 1 -- 172.21.15.152:0/1328226787 wait complete. 2024-09-11T22:08:08.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.395+0000 7f887ab0c740 20 client.25930 trim_cache size 0 max 16384 2024-09-11T22:08:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f887ab0c740 1 Processor -- start 2024-09-11T22:08:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f887ab0c740 1 -- start start 2024-09-11T22:08:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136ba5d0 0x55b2136bb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136bbb40 0x55b2136bd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136c5370 0x55b2136bd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f887ab0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f88701ae3b0 con 0x55b2136c5370 2024-09-11T22:08:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f887ab0c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f88701abc80 con 0x55b2136ba5d0 2024-09-11T22:08:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f887ab0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f887019ffc0 con 0x55b2136bbb40 2024-09-11T22:08:08.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f8875cce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136c5370 0x55b2136bd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f88764cf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136bbb40 0x55b2136bd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f8875cce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136c5370 0x55b2136bd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51284/0 (socket says 172.21.15.152:51284) 2024-09-11T22:08:08.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f88764cf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136bbb40 0x55b2136bd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:39002/0 (socket says 172.21.15.152:39002) 2024-09-11T22:08:08.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.416+0000 7f8875cce640 1 -- 172.21.15.152:0/4083004754 learned_addr learned my addr 172.21.15.152:0/4083004754 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:08.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.417+0000 7f8875cce640 1 --2- 172.21.15.152:0/4083004754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136ba5d0 0x55b2136bb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.417+0000 7f88764cf640 1 -- 172.21.15.152:0/4083004754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136ba5d0 msgr2=0x55b2136bb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:08.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.417+0000 7f88764cf640 1 --2- 172.21.15.152:0/4083004754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136ba5d0 0x55b2136bb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.417+0000 7f88764cf640 1 -- 172.21.15.152:0/4083004754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136c5370 msgr2=0x55b2136bd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:08.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.417+0000 7f88764cf640 1 --2- 172.21.15.152:0/4083004754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136c5370 0x55b2136bd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.417+0000 7f88764cf640 1 -- 172.21.15.152:0/4083004754 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2136d7c20 con 0x55b2136bbb40 2024-09-11T22:08:08.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.417+0000 7f8875cce640 1 --2- 172.21.15.152:0/4083004754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136ba5d0 0x55b2136bb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:08.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.417+0000 7f88764cf640 1 --2- 172.21.15.152:0/4083004754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136bbb40 0x55b2136bd120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55b2136d7e50 tx=0x7f886000d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73bacaf589dc0a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:08.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.417+0000 7f8857fff640 1 -- 172.21.15.152:0/4083004754 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886000abd0 con 0x55b2136bbb40 2024-09-11T22:08:08.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.417+0000 7f8857fff640 1 -- 172.21.15.152:0/4083004754 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f886001c030 con 0x55b2136bbb40 2024-09-11T22:08:08.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.417+0000 7f8857fff640 1 -- 172.21.15.152:0/4083004754 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8860021630 con 0x55b2136bbb40 2024-09-11T22:08:08.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.418+0000 7f887ab0c740 1 -- 172.21.15.152:0/4083004754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136bbb40 msgr2=0x55b2136bd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:08.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.418+0000 7f887ab0c740 1 --2- 172.21.15.152:0/4083004754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136bbb40 0x55b2136bd120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55b2136d7e50 tx=0x7f886000d040 comp rx=0 tx=0).stop 2024-09-11T22:08:08.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.419+0000 7f887ab0c740 1 -- 172.21.15.152:0/4083004754 shutdown_connections 2024-09-11T22:08:08.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.419+0000 7f887ab0c740 1 --2- 172.21.15.152:0/4083004754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136c5370 0x55b2136bd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.419+0000 7f887ab0c740 1 --2- 172.21.15.152:0/4083004754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136bbb40 0x55b2136bd120 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.419+0000 7f887ab0c740 1 --2- 172.21.15.152:0/4083004754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136ba5d0 0x55b2136bb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.419+0000 7f887ab0c740 1 -- 172.21.15.152:0/4083004754 >> 172.21.15.152:0/4083004754 conn(0x55b213683310 msgr2=0x55b2136b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:08.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.419+0000 7f887ab0c740 1 -- 172.21.15.152:0/4083004754 shutdown_connections 2024-09-11T22:08:08.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.419+0000 7f887ab0c740 1 -- 172.21.15.152:0/4083004754 wait complete. 2024-09-11T22:08:08.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.419+0000 7f887ab0c740 1 -- start start 2024-09-11T22:08:08.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f887ab0c740 1 Processor -- start 2024-09-11T22:08:08.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 0x55b2136c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f887ab0c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136c5370 0x55b21373de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f887ab0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f887010f030 con 0x55b2136bbb40 2024-09-11T22:08:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f887ab0c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f88701104a0 con 0x55b2136c5370 2024-09-11T22:08:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f887ab0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f887010f700 con 0x55b2136ba5d0 2024-09-11T22:08:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f887ab0c740 10 client.0 _ll_register_callbacks cb 0x7f88640096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f8875cce640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f88764cf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 0x55b2136c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f8875cce640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:39018/0 (socket says 172.21.15.152:39018) 2024-09-11T22:08:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.420+0000 7f8875cce640 1 -- 172.21.15.152:0/2868914780 learned_addr learned my addr 172.21.15.152:0/2868914780 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.421+0000 7f8875cce640 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136c5370 0x55b21373de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.421+0000 7f88764cf640 1 -- 172.21.15.152:0/2868914780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 msgr2=0x55b2136c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.421+0000 7f88764cf640 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.421+0000 7f88764cf640 1 -- 172.21.15.152:0/2868914780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136c5370 msgr2=0x55b21373de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.421+0000 7f88764cf640 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136c5370 0x55b21373de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.421+0000 7f88764cf640 1 -- 172.21.15.152:0/2868914780 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b21373e3b0 con 0x55b2136bbb40 2024-09-11T22:08:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.421+0000 7f88764cf640 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 0x55b2136c8d50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x55b2135c2e30 tx=0x7f886000ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e0afa46ed54ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.421+0000 7f8855ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.422+0000 7f8855ffb640 1 -- 172.21.15.152:0/2868914780 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886002f020 con 0x55b2136bbb40 2024-09-11T22:08:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.422+0000 7f8855ffb640 1 -- 172.21.15.152:0/2868914780 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8860018800 con 0x55b2136bbb40 2024-09-11T22:08:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.422+0000 7f887ab0c740 1 -- 172.21.15.152:0/2868914780 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f886001c030 con 0x55b2136bbb40 2024-09-11T22:08:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.422+0000 7f8855ffb640 1 -- 172.21.15.152:0/2868914780 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8860018a20 con 0x55b2136bbb40 2024-09-11T22:08:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.423+0000 7f887ab0c740 10 client.16308 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.423+0000 7f887ab0c740 1 -- 172.21.15.152:0/2868914780 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b21373f580 con 0x55b2136bbb40 2024-09-11T22:08:08.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.423+0000 7f8855ffb640 1 -- 172.21.15.152:0/2868914780 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f886001c030 con 0x55b2136bbb40 2024-09-11T22:08:08.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.423+0000 7f8855ffb640 1 -- 172.21.15.152:0/2868914780 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f88600224c0 con 0x55b2136bbb40 2024-09-11T22:08:08.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.423+0000 7f887ab0c740 10 client.16308 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:08.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.423+0000 7f887ab0c740 10 client.16308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:08.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.423+0000 7f887ab0c740 20 client.16308 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.424+0000 7f887ab0c740 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b21373fc40 0x55b213742060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.424+0000 7f887ab0c740 4 client.16308 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.424+0000 7f887ab0c740 1 -- 172.21.15.152:0/2868914780 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b213627d70 con 0x55b21373fc40 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.424+0000 7f8875cce640 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b21373fc40 0x55b213742060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.424+0000 7f8875cce640 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b21373fc40 0x55b213742060 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18e1bd5b3526ea20 server_cookie=967601a360f589a4 in_seq=0 out_seq=0 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.424+0000 7f8855ffb640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f8855ffb640 1 -- 172.21.15.152:0/2868914780 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b213627d70 con 0x55b21373fc40 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f8855ffb640 10 client.16308 handle_command_reply: tid=0 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f887ab0c740 1 client.16308 shutdown 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f887ab0c740 1 -- 172.21.15.152:0/2868914780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 msgr2=0x55b2136c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f887ab0c740 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 0x55b2136c8d50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x55b2135c2e30 tx=0x7f886000ac70 comp rx=0 tx=0).stop 2024-09-11T22:08:08.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f887ab0c740 1 -- 172.21.15.152:0/2868914780 shutdown_connections 2024-09-11T22:08:08.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f887ab0c740 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b21373fc40 0x55b213742060 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f8855ffb640 0 client.16308 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:08.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f887ab0c740 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2136c5370 0x55b21373de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f887ab0c740 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b2136bbb40 0x55b2136c8d50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f887ab0c740 1 --2- 172.21.15.152:0/2868914780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2136ba5d0 0x55b2136c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.425+0000 7f887ab0c740 1 -- 172.21.15.152:0/2868914780 >> 172.21.15.152:0/2868914780 conn(0x55b213683310 msgr2=0x55b2136b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:08.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.426+0000 7f887ab0c740 1 -- 172.21.15.152:0/2868914780 shutdown_connections 2024-09-11T22:08:08.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.426+0000 7f887ab0c740 1 -- 172.21.15.152:0/2868914780 wait complete. 2024-09-11T22:08:08.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.426+0000 7f887ab0c740 20 client.16308 trim_cache size 0 max 16384 2024-09-11T22:08:08.429 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:08:08.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.427+0000 7f8878733640 1 -- 172.21.15.152:0/1100320953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88580a2dc0 msgr2=0x7f88580a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:08.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.427+0000 7f8878733640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88580a2dc0 0x7f88580a5280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f88680a42d0 tx=0x7f88680bd040 comp rx=0 tx=0).stop 2024-09-11T22:08:08.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.428+0000 7f8878733640 1 -- 172.21.15.152:0/1100320953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870105ec0 msgr2=0x7f887019ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:08.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.428+0000 7f8878733640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870105ec0 0x7f887019ead0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f886800e970 tx=0x7f886800ee30 comp rx=0 tx=0).stop 2024-09-11T22:08:08.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.428+0000 7f8878733640 1 -- 172.21.15.152:0/1100320953 shutdown_connections 2024-09-11T22:08:08.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.428+0000 7f8878733640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88580a2dc0 0x7f88580a5280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.428+0000 7f8878733640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8870105ec0 0x7f887019ead0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.428+0000 7f8878733640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88701011e0 0x7f88701a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.428+0000 7f8878733640 1 --2- 172.21.15.152:0/1100320953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88701008c0 0x7f88701a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:08.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.428+0000 7f8878733640 1 -- 172.21.15.152:0/1100320953 >> 172.21.15.152:0/1100320953 conn(0x7f88700fc7d0 msgr2=0x7f8870103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:08.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.429+0000 7f8878733640 1 -- 172.21.15.152:0/1100320953 shutdown_connections 2024-09-11T22:08:08.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:08.429+0000 7f8878733640 1 -- 172.21.15.152:0/1100320953 wait complete. 2024-09-11T22:08:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:09 smithi179 ceph-mon[35603]: pgmap v119: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 47 MiB/s wr, 1.66k op/s 2024-09-11T22:08:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 155.0 s, 4364.4 tps, lat 24.126 ms stddev 47.951 2024-09-11T22:08:09.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:09 smithi193 ceph-mon[35545]: pgmap v119: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 47 MiB/s wr, 1.66k op/s 2024-09-11T22:08:09.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:09 smithi152 ceph-mon[31188]: pgmap v119: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 47 MiB/s wr, 1.66k op/s 2024-09-11T22:08:10.303 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:08:10.303 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:08:10.685 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:11.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.318+0000 7f45927ea640 1 -- 172.21.15.152:0/2633537519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f458c101df0 msgr2=0x7f458c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:11.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.318+0000 7f45927ea640 1 --2- 172.21.15.152:0/2633537519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f458c101df0 0x7f458c1021d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f457c009900 tx=0x7f457c02a420 comp rx=0 tx=0).stop 2024-09-11T22:08:11.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.318+0000 7f45927ea640 1 -- 172.21.15.152:0/2633537519 shutdown_connections 2024-09-11T22:08:11.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.318+0000 7f45927ea640 1 --2- 172.21.15.152:0/2633537519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c106f20 0x7f458c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.318+0000 7f45927ea640 1 --2- 172.21.15.152:0/2633537519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f458c1027a0 0x7f458c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.318+0000 7f45927ea640 1 --2- 172.21.15.152:0/2633537519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f458c101df0 0x7f458c1021d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.318+0000 7f45927ea640 1 -- 172.21.15.152:0/2633537519 >> 172.21.15.152:0/2633537519 conn(0x7f458c0fd8b0 msgr2=0x7f458c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:11.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.318+0000 7f45927ea640 1 -- 172.21.15.152:0/2633537519 shutdown_connections 2024-09-11T22:08:11.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.318+0000 7f45927ea640 1 -- 172.21.15.152:0/2633537519 wait complete. 2024-09-11T22:08:11.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.319+0000 7f45927ea640 1 Processor -- start 2024-09-11T22:08:11.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.320+0000 7f45927ea640 1 -- start start 2024-09-11T22:08:11.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.321+0000 7f45927ea640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c101df0 0x7f458c108ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.321+0000 7f45927ea640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f458c1027a0 0x7f458c109000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.321+0000 7f45927ea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f458c106f20 0x7f458c109540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.321+0000 7f45927ea640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f458c112090 con 0x7f458c106f20 2024-09-11T22:08:11.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.321+0000 7f45927ea640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f458c111f10 con 0x7f458c1027a0 2024-09-11T22:08:11.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.321+0000 7f45927ea640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f458c112210 con 0x7f458c101df0 2024-09-11T22:08:11.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.321+0000 7f4583fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f458c1027a0 0x7f458c109000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.321+0000 7f458bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c101df0 0x7f458c108ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.321+0000 7f4583fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f458c1027a0 0x7f458c109000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41902/0 (socket says 172.21.15.152:41902) 2024-09-11T22:08:11.474 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:08:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:08:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "6dfdfde0-104a-4931-81b7-33def5858496", 2024-09-11T22:08:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:08:11.474 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:08:11.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.321+0000 7f4583fff640 1 -- 172.21.15.152:0/2673713563 learned_addr learned my addr 172.21.15.152:0/2673713563 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:11.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.321+0000 7f4590d87640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f458c106f20 0x7f458c109540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.322+0000 7f458bfff640 1 -- 172.21.15.152:0/2673713563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f458c1027a0 msgr2=0x7f458c109000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:11.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.322+0000 7f458bfff640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f458c1027a0 0x7f458c109000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.322+0000 7f458bfff640 1 -- 172.21.15.152:0/2673713563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f458c106f20 msgr2=0x7f458c109540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:11.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.322+0000 7f458bfff640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f458c106f20 0x7f458c109540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.322+0000 7f458bfff640 1 -- 172.21.15.152:0/2673713563 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c1aae80 con 0x7f458c101df0 2024-09-11T22:08:11.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.322+0000 7f458bfff640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c101df0 0x7f458c108ac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f457c009850 tx=0x7f457c003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:11.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.322+0000 7f4589ffb640 1 -- 172.21.15.152:0/2673713563 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c03f070 con 0x7f458c101df0 2024-09-11T22:08:11.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.322+0000 7f4589ffb640 1 -- 172.21.15.152:0/2673713563 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f457c03b460 con 0x7f458c101df0 2024-09-11T22:08:11.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.322+0000 7f4589ffb640 1 -- 172.21.15.152:0/2673713563 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c035030 con 0x7f458c101df0 2024-09-11T22:08:11.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.323+0000 7f45927ea640 1 -- 172.21.15.152:0/2673713563 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c1ab110 con 0x7f458c101df0 2024-09-11T22:08:11.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.323+0000 7f45927ea640 1 -- 172.21.15.152:0/2673713563 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c1ab5a0 con 0x7f458c101df0 2024-09-11T22:08:11.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.326+0000 7f4594bc3740 1 Processor -- start 2024-09-11T22:08:11.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.326+0000 7f4589ffb640 1 -- 172.21.15.152:0/2673713563 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f457c042070 con 0x7f458c101df0 2024-09-11T22:08:11.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.327+0000 7f4594bc3740 1 -- start start 2024-09-11T22:08:11.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4ab800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4ae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f4594bc3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bbda406280 con 0x55bbda4a1480 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f4594bc3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55bbda3adb10 con 0x55bbda4a0b60 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f4594bc3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bbda402240 con 0x55bbda4abd40 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f458bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f4583fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f4583fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:39040/0 (socket says 172.21.15.152:39040) 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f4583fff640 1 -- 172.21.15.152:0/3191738599 learned_addr learned my addr 172.21.15.152:0/3191738599 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f4590d87640 1 --2- 172.21.15.152:0/3191738599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.328+0000 7f4583fff640 1 -- 172.21.15.152:0/3191738599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 msgr2=0x55bbda4a0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.329+0000 7f4583fff640 1 --2- 172.21.15.152:0/3191738599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.329+0000 7f4583fff640 1 -- 172.21.15.152:0/3191738599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 msgr2=0x55bbda4ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:11.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.329+0000 7f4583fff640 1 --2- 172.21.15.152:0/3191738599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4ab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.329+0000 7f4583fff640 1 -- 172.21.15.152:0/3191738599 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbda3ba1f0 con 0x55bbda4abd40 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.329+0000 7f4589ffb640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f45780a2e80 0x7f45780a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.329+0000 7f4590d87640 1 --2- 172.21.15.152:0/3191738599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.329+0000 7f4583fff640 1 --2- 172.21.15.152:0/3191738599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4ae130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4574009ab0 tx=0x7f4574009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a99bc749be21ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.329+0000 7f4589ffb640 1 -- 172.21.15.152:0/2673713563 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f457c0efc50 con 0x7f458c101df0 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.329+0000 7f45827fc640 1 -- 172.21.15.152:0/3191738599 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574017070 con 0x55bbda4abd40 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.329+0000 7f45827fc640 1 -- 172.21.15.152:0/3191738599 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f457400eba0 con 0x55bbda4abd40 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.329+0000 7f4590d87640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f45780a2e80 0x7f45780a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.330+0000 7f45827fc640 1 -- 172.21.15.152:0/3191738599 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574012700 con 0x55bbda4abd40 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.330+0000 7f4594bc3740 1 -- 172.21.15.152:0/3191738599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 msgr2=0x55bbda4ae130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.330+0000 7f4594bc3740 1 --2- 172.21.15.152:0/3191738599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4ae130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4574009ab0 tx=0x7f4574009f70 comp rx=0 tx=0).stop 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.330+0000 7f4590d87640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f45780a2e80 0x7f45780a5340 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f458400a510 tx=0x7f4584009650 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.330+0000 7f4594bc3740 1 -- 172.21.15.152:0/3191738599 shutdown_connections 2024-09-11T22:08:11.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.330+0000 7f4594bc3740 1 --2- 172.21.15.152:0/3191738599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4ae130 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.330+0000 7f4594bc3740 1 --2- 172.21.15.152:0/3191738599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.330+0000 7f4594bc3740 1 --2- 172.21.15.152:0/3191738599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.330+0000 7f4594bc3740 1 -- 172.21.15.152:0/3191738599 >> 172.21.15.152:0/3191738599 conn(0x55bbda49d0f0 msgr2=0x55bbda49d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.332+0000 7f4594bc3740 1 -- 172.21.15.152:0/3191738599 shutdown_connections 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.332+0000 7f4594bc3740 1 -- 172.21.15.152:0/3191738599 wait complete. 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.332+0000 7f4594bc3740 1 -- start start 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4594bc3740 1 Processor -- start 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4a9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4594bc3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bbda4ae960 con 0x55bbda4a1480 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4594bc3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55bbda3c0f10 con 0x55bbda4a0b60 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4594bc3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bbda4aeae0 con 0x55bbda4abd40 2024-09-11T22:08:11.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4594bc3740 10 client.0 _ll_register_callbacks cb 0x55bbda389a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4583fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4590d87640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4583fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51334/0 (socket says 172.21.15.152:51334) 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.333+0000 7f4583fff640 1 -- 172.21.15.152:0/2465440978 learned_addr learned my addr 172.21.15.152:0/2465440978 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.334+0000 7f4590d87640 1 -- 172.21.15.152:0/2465440978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 msgr2=0x55bbda4a8bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.334+0000 7f4590d87640 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a8bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.334+0000 7f4590d87640 1 -- 172.21.15.152:0/2465440978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 msgr2=0x55bbda4a90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.334+0000 7f4590d87640 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4a90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.334+0000 7f4590d87640 1 -- 172.21.15.152:0/2465440978 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbda1776a0 con 0x55bbda4abd40 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.334+0000 7f4583fff640 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.335+0000 7f4590d87640 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4a9630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4584019e00 tx=0x7f4584004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3be63c182151fed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.335+0000 7f456b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.335+0000 7f456b7fe640 1 -- 172.21.15.152:0/2465440978 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45840168a0 con 0x55bbda4abd40 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.335+0000 7f4594bc3740 1 -- 172.21.15.152:0/2465440978 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f457400eba0 con 0x55bbda4abd40 2024-09-11T22:08:11.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.335+0000 7f456b7fe640 1 -- 172.21.15.152:0/2465440978 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f4584016a40 con 0x55bbda4abd40 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.336+0000 7f456b7fe640 1 -- 172.21.15.152:0/2465440978 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4584016c40 con 0x55bbda4abd40 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.336+0000 7f4594bc3740 10 client.25945 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.336+0000 7f4594bc3740 1 -- 172.21.15.152:0/2465440978 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bbda4ba4b0 con 0x55bbda4abd40 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.336+0000 7f456b7fe640 1 -- 172.21.15.152:0/2465440978 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f457400eba0 con 0x55bbda4abd40 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.336+0000 7f456b7fe640 1 -- 172.21.15.152:0/2465440978 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f4584022400 con 0x55bbda4abd40 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.336+0000 7f4594bc3740 10 client.25945 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.336+0000 7f4594bc3740 10 client.25945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.336+0000 7f4594bc3740 20 client.25945 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.336+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bbda4bb970 0x55bbda4bde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.336+0000 7f4594bc3740 4 client.25945 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.336+0000 7f4594bc3740 1 -- 172.21.15.152:0/2465440978 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbda4137f0 con 0x55bbda4bb970 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.337+0000 7f458bfff640 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bbda4bb970 0x55bbda4bde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.337+0000 7f458bfff640 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bbda4bb970 0x55bbda4bde30 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71527e8478981c49 server_cookie=133503b0ae36b7df in_seq=0 out_seq=0 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.337+0000 7f456b7fe640 10 client.25945 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.340+0000 7f456b7fe640 1 -- 172.21.15.152:0/2465440978 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bbda4137f0 con 0x55bbda4bb970 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.340+0000 7f456b7fe640 10 client.25945 handle_command_reply: tid=0 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.340+0000 7f4594bc3740 1 client.25945 shutdown 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f4594bc3740 1 -- 172.21.15.152:0/2465440978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 msgr2=0x55bbda4a9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4a9630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4584019e00 tx=0x7f4584004ad0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f4594bc3740 1 -- 172.21.15.152:0/2465440978 shutdown_connections 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bbda4bb970 0x55bbda4bde30 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4a9630 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2465440978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f4594bc3740 1 -- 172.21.15.152:0/2465440978 >> 172.21.15.152:0/2465440978 conn(0x55bbda49d0f0 msgr2=0x55bbda4a2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f456b7fe640 0 client.25945 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:11.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f4594bc3740 1 -- 172.21.15.152:0/2465440978 shutdown_connections 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f4594bc3740 1 -- 172.21.15.152:0/2465440978 wait complete. 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.341+0000 7f4594bc3740 20 client.25945 trim_cache size 0 max 16384 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.365+0000 7f4594bc3740 1 Processor -- start 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.365+0000 7f4594bc3740 1 -- start start 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.366+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.366+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4c3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.366+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.366+0000 7f4594bc3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b69d0 con 0x55bbda4a1480 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.366+0000 7f4594bc3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b42a0 con 0x55bbda4a0b60 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.366+0000 7f4594bc3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b20f0 con 0x55bbda4abd40 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.366+0000 7f4583fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.366+0000 7f4583fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4c3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51346/0 (socket says 172.21.15.152:51346) 2024-09-11T22:08:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.366+0000 7f4583fff640 1 -- 172.21.15.152:0/430458797 learned_addr learned my addr 172.21.15.152:0/430458797 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.366+0000 7f4590d87640 1 --2- 172.21.15.152:0/430458797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.366+0000 7f458bfff640 1 --2- 172.21.15.152:0/430458797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.367+0000 7f458bfff640 1 -- 172.21.15.152:0/430458797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 msgr2=0x55bbda4c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.367+0000 7f458bfff640 1 --2- 172.21.15.152:0/430458797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.367+0000 7f458bfff640 1 -- 172.21.15.152:0/430458797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 msgr2=0x55bbda4c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.367+0000 7f458bfff640 1 --2- 172.21.15.152:0/430458797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.367+0000 7f458bfff640 1 -- 172.21.15.152:0/430458797 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbda4a12b0 con 0x55bbda4a0b60 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.367+0000 7f458bfff640 1 --2- 172.21.15.152:0/430458797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a7b90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f457c0ed370 tx=0x7f457c0f21d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c2becb21ed3283e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.367+0000 7f4581ffb640 1 -- 172.21.15.152:0/430458797 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c049040 con 0x55bbda4a0b60 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.367+0000 7f4581ffb640 1 -- 172.21.15.152:0/430458797 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f457c0c09e0 con 0x55bbda4a0b60 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.367+0000 7f4581ffb640 1 -- 172.21.15.152:0/430458797 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c0c4e10 con 0x55bbda4a0b60 2024-09-11T22:08:11.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.368+0000 7f4594bc3740 1 -- 172.21.15.152:0/430458797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 msgr2=0x55bbda4a7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.368+0000 7f4594bc3740 1 --2- 172.21.15.152:0/430458797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a7b90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f457c0ed370 tx=0x7f457c0f21d0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.368+0000 7f4594bc3740 1 -- 172.21.15.152:0/430458797 shutdown_connections 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.368+0000 7f4594bc3740 1 --2- 172.21.15.152:0/430458797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.368+0000 7f4594bc3740 1 --2- 172.21.15.152:0/430458797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a1480 0x55bbda4c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.368+0000 7f4594bc3740 1 --2- 172.21.15.152:0/430458797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a0b60 0x55bbda4a7b90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.368+0000 7f4594bc3740 1 -- 172.21.15.152:0/430458797 >> 172.21.15.152:0/430458797 conn(0x55bbda49d0f0 msgr2=0x55bbda4a7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.369+0000 7f4594bc3740 1 -- 172.21.15.152:0/430458797 shutdown_connections 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.369+0000 7f4594bc3740 1 -- 172.21.15.152:0/430458797 wait complete. 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.369+0000 7f4594bc3740 1 -- start start 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.369+0000 7f4594bc3740 1 Processor -- start 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a0b60 0x55bbda4b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a1480 0x55bbda4a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4594bc3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4594bc3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b2760 con 0x55bbda4a0b60 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4594bc3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b3bd0 con 0x55bbda4a1480 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4594bc3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b2e30 con 0x55bbda4abd40 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4594bc3740 10 client.0 _ll_register_callbacks cb 0x7f4584009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4583fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a1480 0x55bbda4a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4583fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a1480 0x55bbda4a56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41944/0 (socket says 172.21.15.152:41944) 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4583fff640 1 -- 172.21.15.152:0/2573594885 learned_addr learned my addr 172.21.15.152:0/2573594885 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4590d87640 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f458bfff640 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a0b60 0x55bbda4b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4583fff640 1 -- 172.21.15.152:0/2573594885 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 msgr2=0x55bbda4a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4583fff640 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4583fff640 1 -- 172.21.15.152:0/2573594885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a0b60 msgr2=0x55bbda4b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4583fff640 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a0b60 0x55bbda4b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4583fff640 1 -- 172.21.15.152:0/2573594885 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbda4a61e0 con 0x55bbda4a1480 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4590d87640 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f458bfff640 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a0b60 0x55bbda4b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f4583fff640 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a1480 0x55bbda4a56e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55bbda4a9c50 tx=0x7f4574013dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb43796fa8a837a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.370+0000 7f456b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f456b7fe640 1 -- 172.21.15.152:0/2573594885 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457402a060 con 0x55bbda4a1480 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f456b7fe640 1 -- 172.21.15.152:0/2573594885 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f457401c910 con 0x55bbda4a1480 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f4594bc3740 1 -- 172.21.15.152:0/2573594885 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f457c0c09e0 con 0x55bbda4a1480 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f456b7fe640 1 -- 172.21.15.152:0/2573594885 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4574017040 con 0x55bbda4a1480 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f4594bc3740 10 client.25805 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f4594bc3740 1 -- 172.21.15.152:0/2573594885 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bbda4b2c10 con 0x55bbda4a1480 2024-09-11T22:08:11.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f456b7fe640 1 -- 172.21.15.152:0/2573594885 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f457c0c09e0 con 0x55bbda4a1480 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f456b7fe640 1 -- 172.21.15.152:0/2573594885 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f457402da50 con 0x55bbda4a1480 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f4594bc3740 10 client.25805 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f4594bc3740 10 client.25805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f4594bc3740 20 client.25805 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.371+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bbda5379b0 0x55bbda539dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.372+0000 7f4594bc3740 4 client.25805 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.372+0000 7f4594bc3740 1 -- 172.21.15.152:0/2573594885 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bbda40dd00 con 0x55bbda5379b0 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.372+0000 7f458bfff640 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bbda5379b0 0x55bbda539dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.373+0000 7f458bfff640 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bbda5379b0 0x55bbda539dd0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cef19fc5769da45a server_cookie=38755f8761d0b0e1 in_seq=0 out_seq=0 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.373+0000 7f456b7fe640 10 client.25805 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f456b7fe640 1 -- 172.21.15.152:0/2573594885 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bbda40dd00 con 0x55bbda5379b0 2024-09-11T22:08:11.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f456b7fe640 10 client.25805 handle_command_reply: tid=0 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f4594bc3740 1 client.25805 shutdown 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f4594bc3740 1 -- 172.21.15.152:0/2573594885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a1480 msgr2=0x55bbda4a56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a1480 0x55bbda4a56e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55bbda4a9c50 tx=0x7f4574013dd0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f4594bc3740 1 -- 172.21.15.152:0/2573594885 shutdown_connections 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bbda5379b0 0x55bbda539dd0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bbda4abd40 0x55bbda4a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbda4a1480 0x55bbda4a56e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f4594bc3740 1 --2- 172.21.15.152:0/2573594885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbda4a0b60 0x55bbda4b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f4594bc3740 1 -- 172.21.15.152:0/2573594885 >> 172.21.15.152:0/2573594885 conn(0x55bbda49d0f0 msgr2=0x55bbda4a7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.374+0000 7f456b7fe640 0 client.25805 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.375+0000 7f4594bc3740 1 -- 172.21.15.152:0/2573594885 shutdown_connections 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.376+0000 7f4594bc3740 1 -- 172.21.15.152:0/2573594885 wait complete. 2024-09-11T22:08:11.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.376+0000 7f4594bc3740 20 client.25805 trim_cache size 0 max 16384 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.376+0000 7f45927ea640 1 -- 172.21.15.152:0/2673713563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f45780a2e80 msgr2=0x7f45780a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.376+0000 7f45927ea640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f45780a2e80 0x7f45780a5340 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f458400a510 tx=0x7f4584009650 comp rx=0 tx=0).stop 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.376+0000 7f45927ea640 1 -- 172.21.15.152:0/2673713563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c101df0 msgr2=0x7f458c108ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.376+0000 7f45927ea640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c101df0 0x7f458c108ac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f457c009850 tx=0x7f457c003cd0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.377+0000 7f45927ea640 1 -- 172.21.15.152:0/2673713563 shutdown_connections 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.377+0000 7f45927ea640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f45780a2e80 0x7f45780a5340 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.377+0000 7f45927ea640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f458c106f20 0x7f458c109540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.377+0000 7f45927ea640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f458c1027a0 0x7f458c109000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.377+0000 7f45927ea640 1 --2- 172.21.15.152:0/2673713563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c101df0 0x7f458c108ac0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.377+0000 7f45927ea640 1 -- 172.21.15.152:0/2673713563 >> 172.21.15.152:0/2673713563 conn(0x7f458c0fd8b0 msgr2=0x7f458c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.377+0000 7f45927ea640 1 -- 172.21.15.152:0/2673713563 shutdown_connections 2024-09-11T22:08:11.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:11.377+0000 7f45927ea640 1 -- 172.21.15.152:0/2673713563 wait complete. 2024-09-11T22:08:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:11 smithi152 ceph-mon[31188]: pgmap v120: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 43 MiB/s wr, 1.31k op/s 2024-09-11T22:08:11.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:11 smithi179 ceph-mon[35603]: pgmap v120: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 43 MiB/s wr, 1.31k op/s 2024-09-11T22:08:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:11 smithi193 ceph-mon[35545]: pgmap v120: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 43 MiB/s wr, 1.31k op/s 2024-09-11T22:08:12.381 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:08:12.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:12 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:08:12.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:12 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:12.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:12 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:08:12.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:12 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:08:12.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:12 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:12.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:12 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:12.773 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:12.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:12 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:08:12.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:12 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:12.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:12 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:08:12.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:12 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:08:12.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:12 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:12.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:12 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:12.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:12 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:08:12.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:12 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:12.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:12 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:08:12.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:12 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:08:12.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:12 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:12.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:12 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:13.410 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.3) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T22:08:13.410 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.15 2024-09-11T22:08:13.410 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:08:13.527 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:08:13.527 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:08:13.527 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:08:13.527 INFO:teuthology.orchestra.run.smithi152.stdout: "6dfdfde0-104a-4931-81b7-33def5858496": { 2024-09-11T22:08:13.527 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:08:13.527 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "6dfdfde0-104a-4931-81b7-33def5858496", 2024-09-11T22:08:13.527 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:08:13.528 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:13.528 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:13.528 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:08:13.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.326+0000 7fec6c719640 1 -- 172.21.15.152:0/3270004492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec64102ef0 msgr2=0x7fec6410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.326+0000 7fec6c719640 1 --2- 172.21.15.152:0/3270004492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec64102ef0 0x7fec6410da40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009c10 tx=0x7fec5c02a770 comp rx=0 tx=0).stop 2024-09-11T22:08:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.326+0000 7fec6c719640 1 -- 172.21.15.152:0/3270004492 shutdown_connections 2024-09-11T22:08:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.326+0000 7fec6c719640 1 --2- 172.21.15.152:0/3270004492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec64102ef0 0x7fec6410da40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.326+0000 7fec6c719640 1 --2- 172.21.15.152:0/3270004492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec64102570 0x7fec641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.326+0000 7fec6c719640 1 --2- 172.21.15.152:0/3270004492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec64100e20 0x7fec64101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.326+0000 7fec6c719640 1 -- 172.21.15.152:0/3270004492 >> 172.21.15.152:0/3270004492 conn(0x7fec640fc7d0 msgr2=0x7fec640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.326+0000 7fec6c719640 1 -- 172.21.15.152:0/3270004492 shutdown_connections 2024-09-11T22:08:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.326+0000 7fec6c719640 1 -- 172.21.15.152:0/3270004492 wait complete. 2024-09-11T22:08:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.327+0000 7fec6c719640 1 Processor -- start 2024-09-11T22:08:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.327+0000 7fec6c719640 1 -- start start 2024-09-11T22:08:13.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.327+0000 7fec6c719640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec64100e20 0x7fec64197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.327+0000 7fec6c719640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec64102570 0x7fec64197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.328+0000 7fec6c719640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec64102ef0 0x7fec6419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.328+0000 7fec6a4b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec64100e20 0x7fec64197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.328+0000 7fec6a4b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec64100e20 0x7fec64197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41958/0 (socket says 172.21.15.152:41958) 2024-09-11T22:08:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.328+0000 7fec69cb4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec64102570 0x7fec64197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.328+0000 7fec69cb4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec64102570 0x7fec64197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:39076/0 (socket says 172.21.15.152:39076) 2024-09-11T22:08:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.329+0000 7fec6a4b5640 1 -- 172.21.15.152:0/2530576367 learned_addr learned my addr 172.21.15.152:0/2530576367 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.329+0000 7fec6c719640 1 -- 172.21.15.152:0/2530576367 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec64110f80 con 0x7fec64102ef0 2024-09-11T22:08:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.329+0000 7fec6c719640 1 -- 172.21.15.152:0/2530576367 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec64110e00 con 0x7fec64100e20 2024-09-11T22:08:13.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.329+0000 7fec6c719640 1 -- 172.21.15.152:0/2530576367 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fec64111100 con 0x7fec64102570 2024-09-11T22:08:13.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.329+0000 7fec6acb6640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec64102ef0 0x7fec6419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.329+0000 7fec69cb4640 1 -- 172.21.15.152:0/2530576367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec64100e20 msgr2=0x7fec64197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:13.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.329+0000 7fec69cb4640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec64100e20 0x7fec64197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.329+0000 7fec69cb4640 1 -- 172.21.15.152:0/2530576367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec64102ef0 msgr2=0x7fec6419bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:13.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.329+0000 7fec69cb4640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec64102ef0 0x7fec6419bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.329+0000 7fec69cb4640 1 -- 172.21.15.152:0/2530576367 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6419c3f0 con 0x7fec64102570 2024-09-11T22:08:13.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.329+0000 7fec6acb6640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec64102ef0 0x7fec6419bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:13.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.330+0000 7fec69cb4640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec64102570 0x7fec64197980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec5400e9f0 tx=0x7fec5400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.331+0000 7fec5b7fe640 1 -- 172.21.15.152:0/2530576367 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5400ccc0 con 0x7fec64102570 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.331+0000 7fec5b7fe640 1 -- 172.21.15.152:0/2530576367 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec54010910 con 0x7fec64102570 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.331+0000 7fec5b7fe640 1 -- 172.21.15.152:0/2530576367 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54018960 con 0x7fec64102570 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.332+0000 7fec6c719640 1 -- 172.21.15.152:0/2530576367 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6419c6e0 con 0x7fec64102570 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.332+0000 7fec6c719640 1 -- 172.21.15.152:0/2530576367 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec64069f70 con 0x7fec64102570 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.335+0000 7fec6eaf2740 1 Processor -- start 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.336+0000 7fec6eaf2740 1 -- start start 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.336+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a9906e0 0x55681a990ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.336+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a991000 0x55681a98b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.336+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 0x55681a98bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.336+0000 7fec6eaf2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55681a8e72e0 con 0x55681a991000 2024-09-11T22:08:13.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.336+0000 7fec6eaf2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55681a88ece0 con 0x55681a98b6a0 2024-09-11T22:08:13.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.336+0000 7fec6eaf2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55681a8e32a0 con 0x55681a9906e0 2024-09-11T22:08:13.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.337+0000 7fec6a4b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a991000 0x55681a98b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.337+0000 7fec6a4b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a991000 0x55681a98b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51378/0 (socket says 172.21.15.152:51378) 2024-09-11T22:08:13.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.337+0000 7fec6a4b5640 1 -- 172.21.15.152:0/3871909452 learned_addr learned my addr 172.21.15.152:0/3871909452 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:13.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.337+0000 7fec6a4b5640 1 -- 172.21.15.152:0/3871909452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a9906e0 msgr2=0x55681a990ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:13.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.337+0000 7fec6a4b5640 1 --2- 172.21.15.152:0/3871909452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a9906e0 0x55681a990ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.337+0000 7fec6a4b5640 1 -- 172.21.15.152:0/3871909452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 msgr2=0x55681a98bb20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:08:13.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.337+0000 7fec6a4b5640 1 --2- 172.21.15.152:0/3871909452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 0x55681a98bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.337+0000 7fec6a4b5640 1 -- 172.21.15.152:0/3871909452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681a873440 con 0x55681a991000 2024-09-11T22:08:13.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.338+0000 7fec5b7fe640 1 -- 172.21.15.152:0/2530576367 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fec54010ac0 con 0x7fec64102570 2024-09-11T22:08:13.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.338+0000 7fec6a4b5640 1 --2- 172.21.15.152:0/3871909452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a991000 0x55681a98b030 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fec60009d80 tx=0x7fec60011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b86702060797af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:13.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.338+0000 7fec58ff9640 1 -- 172.21.15.152:0/3871909452 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6001e070 con 0x55681a991000 2024-09-11T22:08:13.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.338+0000 7fec58ff9640 1 -- 172.21.15.152:0/3871909452 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec60019b10 con 0x55681a991000 2024-09-11T22:08:13.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.338+0000 7fec58ff9640 1 -- 172.21.15.152:0/3871909452 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6000ebc0 con 0x55681a991000 2024-09-11T22:08:13.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.339+0000 7fec5b7fe640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec500a2e40 0x7fec500a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.339+0000 7fec6acb6640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec500a2e40 0x7fec500a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.339+0000 7fec5b7fe640 1 -- 172.21.15.152:0/2530576367 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fec540cf760 con 0x7fec64102570 2024-09-11T22:08:13.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.339+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3871909452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a991000 msgr2=0x55681a98b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:13.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.339+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3871909452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a991000 0x55681a98b030 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fec60009d80 tx=0x7fec60011810 comp rx=0 tx=0).stop 2024-09-11T22:08:13.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.340+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3871909452 shutdown_connections 2024-09-11T22:08:13.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.340+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3871909452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 0x55681a98bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.340+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3871909452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a991000 0x55681a98b030 secure :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fec60009d80 tx=0x7fec60011810 comp rx=0 tx=0).stop 2024-09-11T22:08:13.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.340+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3871909452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a9906e0 0x55681a990ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.340+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3871909452 >> 172.21.15.152:0/3871909452 conn(0x55681a97d4e0 msgr2=0x55681a97d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:13.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.340+0000 7fec6acb6640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec500a2e40 0x7fec500a5300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec5c004af0 tx=0x7fec5c0098d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:13.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.341+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3871909452 shutdown_connections 2024-09-11T22:08:13.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.341+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3871909452 wait complete. 2024-09-11T22:08:13.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.341+0000 7fec6eaf2740 1 -- start start 2024-09-11T22:08:13.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6eaf2740 1 Processor -- start 2024-09-11T22:08:13.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 0x55681a9944a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a9906e0 0x55681a9949e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 0x55681a9b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6eaf2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55681a9a8a30 con 0x55681a994f20 2024-09-11T22:08:13.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6eaf2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55681a8a2050 con 0x55681a98b6a0 2024-09-11T22:08:13.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6acb6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 0x55681a9b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6acb6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 0x55681a9b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51392/0 (socket says 172.21.15.152:51392) 2024-09-11T22:08:13.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6acb6640 1 -- 172.21.15.152:0/3649041347 learned_addr learned my addr 172.21.15.152:0/3649041347 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:13.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3649041347 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55681a9a8bb0 con 0x55681a9906e0 2024-09-11T22:08:13.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6a4b5640 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 0x55681a9944a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec69cb4640 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a9906e0 0x55681a9949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.342+0000 7fec6eaf2740 10 client.0 _ll_register_callbacks cb 0x55681a8e2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:13.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec6acb6640 1 -- 172.21.15.152:0/3649041347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a9906e0 msgr2=0x55681a9949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:13.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec6acb6640 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a9906e0 0x55681a9949e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec6acb6640 1 -- 172.21.15.152:0/3649041347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 msgr2=0x55681a9944a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec6acb6640 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 0x55681a9944a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec6acb6640 1 -- 172.21.15.152:0/3649041347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681a6583c0 con 0x55681a994f20 2024-09-11T22:08:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3649041347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec60019b10 con 0x55681a994f20 2024-09-11T22:08:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec6acb6640 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 0x55681a9b1f60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fec5c033000 tx=0x7fec5c02a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37a10ab57d45ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec4dffb640 10 client.16332 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec4dffb640 1 -- 172.21.15.152:0/3649041347 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c036050 con 0x55681a994f20 2024-09-11T22:08:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec4dffb640 1 -- 172.21.15.152:0/3649041347 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fec5c003d80 con 0x55681a994f20 2024-09-11T22:08:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec4dffb640 1 -- 172.21.15.152:0/3649041347 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fec5c004040 con 0x55681a994f20 2024-09-11T22:08:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec6eaf2740 10 client.16332 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3649041347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55681a9b4b00 con 0x55681a994f20 2024-09-11T22:08:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec4dffb640 1 -- 172.21.15.152:0/3649041347 <== mon.0 v2:172.21.15.152:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fec5c051030 con 0x55681a994f20 2024-09-11T22:08:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec6eaf2740 10 client.16332 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.343+0000 7fec6eaf2740 10 client.16332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.344+0000 7fec6eaf2740 20 client.16332 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.344+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55681a9b5eb0 0x55681a9b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.344+0000 7fec6eaf2740 4 client.16332 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:13.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.344+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3649041347 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55681a8f4850 con 0x55681a9b5eb0 2024-09-11T22:08:13.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.344+0000 7fec6a4b5640 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55681a9b5eb0 0x55681a9b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.345+0000 7fec6a4b5640 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55681a9b5eb0 0x55681a9b82a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=621133032614f4b4 server_cookie=dcea3c60389e487d in_seq=0 out_seq=0 2024-09-11T22:08:13.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.345+0000 7fec4dffb640 10 client.16332 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:13.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec4dffb640 1 -- 172.21.15.152:0/3649041347 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55681a8f4850 con 0x55681a9b5eb0 2024-09-11T22:08:13.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec4dffb640 10 client.16332 handle_command_reply: tid=0 2024-09-11T22:08:13.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 1 client.16332 shutdown 2024-09-11T22:08:13.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3649041347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 msgr2=0x55681a9b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:13.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 0x55681a9b1f60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fec5c033000 tx=0x7fec5c02a770 comp rx=0 tx=0).stop 2024-09-11T22:08:13.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3649041347 shutdown_connections 2024-09-11T22:08:13.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55681a9b5eb0 0x55681a9b82a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 0x55681a9b1f60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a9906e0 0x55681a9949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3649041347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 0x55681a9944a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3649041347 >> 172.21.15.152:0/3649041347 conn(0x55681a97d4e0 msgr2=0x55681a97cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:13.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec4dffb640 0 client.16332 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:13.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3649041347 shutdown_connections 2024-09-11T22:08:13.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3649041347 wait complete. 2024-09-11T22:08:13.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.346+0000 7fec6eaf2740 20 client.16332 trim_cache size 0 max 16384 2024-09-11T22:08:13.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.363+0000 7fec6eaf2740 1 Processor -- start 2024-09-11T22:08:13.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec6eaf2740 1 -- start start 2024-09-11T22:08:13.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 0x55681a9b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a9906e0 0x55681a98e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a994f20 0x55681a98e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec6eaf2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec641a58d0 con 0x55681a9906e0 2024-09-11T22:08:13.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec6eaf2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec64073600 con 0x55681a98b6a0 2024-09-11T22:08:13.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec6eaf2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fec64071450 con 0x55681a994f20 2024-09-11T22:08:13.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec69cb4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a9906e0 0x55681a98e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec69cb4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a9906e0 0x55681a98e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40614/0 (socket says 172.21.15.152:40614) 2024-09-11T22:08:13.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec69cb4640 1 -- 172.21.15.152:0/3464423471 learned_addr learned my addr 172.21.15.152:0/3464423471 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:13.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec6a4b5640 1 --2- 172.21.15.152:0/3464423471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 0x55681a9b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec6acb6640 1 --2- 172.21.15.152:0/3464423471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a994f20 0x55681a98e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec69cb4640 1 -- 172.21.15.152:0/3464423471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a994f20 msgr2=0x55681a98e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:13.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec69cb4640 1 --2- 172.21.15.152:0/3464423471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a994f20 0x55681a98e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec69cb4640 1 -- 172.21.15.152:0/3464423471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 msgr2=0x55681a9b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:13.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec69cb4640 1 --2- 172.21.15.152:0/3464423471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 0x55681a9b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec69cb4640 1 -- 172.21.15.152:0/3464423471 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681a9b8900 con 0x55681a9906e0 2024-09-11T22:08:13.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.364+0000 7fec69cb4640 1 --2- 172.21.15.152:0/3464423471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a9906e0 0x55681a98e0a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fec540ccf30 tx=0x7fec54010e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07559adaed30a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:13.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.365+0000 7fec4ffff640 1 -- 172.21.15.152:0/3464423471 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec540b1030 con 0x55681a9906e0 2024-09-11T22:08:13.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.365+0000 7fec4ffff640 1 -- 172.21.15.152:0/3464423471 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec540b4e50 con 0x55681a9906e0 2024-09-11T22:08:13.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.365+0000 7fec4ffff640 1 -- 172.21.15.152:0/3464423471 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5409b0a0 con 0x55681a9906e0 2024-09-11T22:08:13.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.367+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3464423471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a9906e0 msgr2=0x55681a98e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:13.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.367+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3464423471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a9906e0 0x55681a98e0a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fec540ccf30 tx=0x7fec54010e30 comp rx=0 tx=0).stop 2024-09-11T22:08:13.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.368+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3464423471 shutdown_connections 2024-09-11T22:08:13.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.368+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3464423471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a994f20 0x55681a98e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.368+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3464423471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a9906e0 0x55681a98e0a0 secure :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fec540ccf30 tx=0x7fec54010e30 comp rx=0 tx=0).stop 2024-09-11T22:08:13.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.368+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/3464423471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a98b6a0 0x55681a9b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.368+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3464423471 >> 172.21.15.152:0/3464423471 conn(0x55681a97d4e0 msgr2=0x55681a97cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:13.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.369+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3464423471 shutdown_connections 2024-09-11T22:08:13.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.369+0000 7fec6eaf2740 1 -- 172.21.15.152:0/3464423471 wait complete. 2024-09-11T22:08:13.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.369+0000 7fec6eaf2740 1 -- start start 2024-09-11T22:08:13.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.370+0000 7fec6eaf2740 1 Processor -- start 2024-09-11T22:08:13.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.370+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a98b6a0 0x55681a9ae230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.370+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 0x55681a9ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.371+0000 7fec6eaf2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a9aaff0 0x55681a9ab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.371+0000 7fec6a4b5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a98b6a0 0x55681a9ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.371+0000 7fec6a4b5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a98b6a0 0x55681a9ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43210/0 (socket says 172.21.15.152:43210) 2024-09-11T22:08:13.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.371+0000 7fec6a4b5640 1 -- 172.21.15.152:0/2169192002 learned_addr learned my addr 172.21.15.152:0/2169192002 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:13.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.371+0000 7fec6acb6640 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a9aaff0 0x55681a9ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.372+0000 7fec69cb4640 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 0x55681a9ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.372+0000 7fec6eaf2740 1 -- 172.21.15.152:0/2169192002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec64071ac0 con 0x55681a994f20 2024-09-11T22:08:13.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.372+0000 7fec6eaf2740 1 -- 172.21.15.152:0/2169192002 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec64072f30 con 0x55681a9aaff0 2024-09-11T22:08:13.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.372+0000 7fec6eaf2740 1 -- 172.21.15.152:0/2169192002 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fec64072190 con 0x55681a98b6a0 2024-09-11T22:08:13.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.372+0000 7fec6eaf2740 10 client.0 _ll_register_callbacks cb 0x7fec5c034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:13.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.372+0000 7fec69cb4640 1 -- 172.21.15.152:0/2169192002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a98b6a0 msgr2=0x55681a9ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:13.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.372+0000 7fec69cb4640 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a98b6a0 0x55681a9ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.372+0000 7fec69cb4640 1 -- 172.21.15.152:0/2169192002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a9aaff0 msgr2=0x55681a9ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:13.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.372+0000 7fec69cb4640 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a9aaff0 0x55681a9ab470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.373+0000 7fec69cb4640 1 -- 172.21.15.152:0/2169192002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681a9abca0 con 0x55681a994f20 2024-09-11T22:08:13.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.373+0000 7fec69cb4640 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 0x55681a9ae770 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fec5409ba90 tx=0x7fec540a0140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94630e839511e043 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:13.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.373+0000 7fec4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:13.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.374+0000 7fec4dffb640 1 -- 172.21.15.152:0/2169192002 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec540b1030 con 0x55681a994f20 2024-09-11T22:08:13.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.374+0000 7fec4dffb640 1 -- 172.21.15.152:0/2169192002 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fec5409b0a0 con 0x55681a994f20 2024-09-11T22:08:13.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.374+0000 7fec6eaf2740 1 -- 172.21.15.152:0/2169192002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec540b4e50 con 0x55681a994f20 2024-09-11T22:08:13.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.374+0000 7fec4dffb640 1 -- 172.21.15.152:0/2169192002 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fec5409b2a0 con 0x55681a994f20 2024-09-11T22:08:13.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.374+0000 7fec6eaf2740 10 client.16338 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:13.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.374+0000 7fec6eaf2740 1 -- 172.21.15.152:0/2169192002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55681aa21b50 con 0x55681a994f20 2024-09-11T22:08:13.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.375+0000 7fec4dffb640 1 -- 172.21.15.152:0/2169192002 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec54018b00 con 0x55681a994f20 2024-09-11T22:08:13.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.375+0000 7fec4dffb640 1 -- 172.21.15.152:0/2169192002 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fec5409ab10 con 0x55681a994f20 2024-09-11T22:08:13.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.375+0000 7fec6eaf2740 10 client.16338 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:13.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.375+0000 7fec6eaf2740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:13.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.375+0000 7fec6eaf2740 20 client.16338 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:13.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.375+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55681aa22170 0x55681aa24560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:13.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.375+0000 7fec6eaf2740 4 client.16338 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:08:13.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.375+0000 7fec6eaf2740 1 -- 172.21.15.152:0/2169192002 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fec540b4e50 con 0x55681aa22170 2024-09-11T22:08:13.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.376+0000 7fec6a4b5640 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55681aa22170 0x55681aa24560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:13.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.376+0000 7fec6a4b5640 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55681aa22170 0x55681aa24560 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcb4bc0e487d3a92 server_cookie=5b3ef881195f7e21 in_seq=0 out_seq=0 2024-09-11T22:08:13.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.376+0000 7fec4dffb640 10 client.16338 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:13.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec4dffb640 1 -- 172.21.15.152:0/2169192002 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fec540b4e50 con 0x55681aa22170 2024-09-11T22:08:13.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec4dffb640 10 client.16338 handle_command_reply: tid=0 2024-09-11T22:08:13.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec6eaf2740 1 client.16338 shutdown 2024-09-11T22:08:13.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec6eaf2740 1 -- 172.21.15.152:0/2169192002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 msgr2=0x55681a9ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:13.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 0x55681a9ae770 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fec5409ba90 tx=0x7fec540a0140 comp rx=0 tx=0).stop 2024-09-11T22:08:13.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec6eaf2740 1 -- 172.21.15.152:0/2169192002 shutdown_connections 2024-09-11T22:08:13.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55681aa22170 0x55681aa24560 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55681a9aaff0 0x55681a9ab470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55681a994f20 0x55681a9ae770 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec6eaf2740 1 --2- 172.21.15.152:0/2169192002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55681a98b6a0 0x55681a9ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec6eaf2740 1 -- 172.21.15.152:0/2169192002 >> 172.21.15.152:0/2169192002 conn(0x55681a97d4e0 msgr2=0x55681a993cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:13.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.377+0000 7fec4dffb640 0 client.16338 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:13.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.378+0000 7fec6eaf2740 1 -- 172.21.15.152:0/2169192002 shutdown_connections 2024-09-11T22:08:13.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.378+0000 7fec6eaf2740 1 -- 172.21.15.152:0/2169192002 wait complete. 2024-09-11T22:08:13.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.378+0000 7fec6eaf2740 20 client.16338 trim_cache size 0 max 16384 2024-09-11T22:08:13.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.379+0000 7fec6c719640 1 -- 172.21.15.152:0/2530576367 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec500a2e40 msgr2=0x7fec500a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:13.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.379+0000 7fec6c719640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec500a2e40 0x7fec500a5300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec5c004af0 tx=0x7fec5c0098d0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.380+0000 7fec6c719640 1 -- 172.21.15.152:0/2530576367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec64102570 msgr2=0x7fec64197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:13.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.380+0000 7fec6c719640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec64102570 0x7fec64197980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec5400e9f0 tx=0x7fec5400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.380+0000 7fec6c719640 1 -- 172.21.15.152:0/2530576367 shutdown_connections 2024-09-11T22:08:13.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.380+0000 7fec6c719640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec500a2e40 0x7fec500a5300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.380+0000 7fec6c719640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec64102ef0 0x7fec6419bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.380+0000 7fec6c719640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec64102570 0x7fec64197980 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.380+0000 7fec6c719640 1 --2- 172.21.15.152:0/2530576367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec64100e20 0x7fec64197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:13.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.380+0000 7fec6c719640 1 -- 172.21.15.152:0/2530576367 >> 172.21.15.152:0/2530576367 conn(0x7fec640fc7d0 msgr2=0x7fec64104880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:13.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.380+0000 7fec6c719640 1 -- 172.21.15.152:0/2530576367 shutdown_connections 2024-09-11T22:08:13.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:13.380+0000 7fec6c719640 1 -- 172.21.15.152:0/2530576367 wait complete. 2024-09-11T22:08:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:13 smithi152 ceph-mon[31188]: pgmap v121: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 62 MiB/s wr, 1.93k op/s 2024-09-11T22:08:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:13 smithi179 ceph-mon[35603]: pgmap v121: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 62 MiB/s wr, 1.93k op/s 2024-09-11T22:08:13.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:13 smithi193 ceph-mon[35545]: pgmap v121: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 62 MiB/s wr, 1.93k op/s 2024-09-11T22:08:14.417 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:14.448 INFO:tasks.cephfs.filesystem:scrub status for tag:6dfdfde0-104a-4931-81b7-33def5858496 - {'path': '/', 'tag': '6dfdfde0-104a-4931-81b7-33def5858496', 'options': 'recursive,force'} 2024-09-11T22:08:14.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 160.0 s, 3401.6 tps, lat 29.339 ms stddev 35.411 2024-09-11T22:08:14.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.981+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/1079719535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c9406ee10 msgr2=0x7f6c94114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:14.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.981+0000 7f6c9a6b0640 1 --2- 172.21.15.152:0/1079719535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c9406ee10 0x7f6c94114570 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009890 tx=0x7f6c8402a380 comp rx=0 tx=0).stop 2024-09-11T22:08:14.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.981+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/1079719535 shutdown_connections 2024-09-11T22:08:14.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.982+0000 7f6c9a6b0640 1 --2- 172.21.15.152:0/1079719535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c94114ab0 0x7f6c94116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:14.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.982+0000 7f6c9a6b0640 1 --2- 172.21.15.152:0/1079719535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c9406ee10 0x7f6c94114570 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:14.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.982+0000 7f6c9a6b0640 1 --2- 172.21.15.152:0/1079719535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c9406e4f0 0x7f6c9406e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:14.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.982+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/1079719535 >> 172.21.15.152:0/1079719535 conn(0x7f6c94073180 msgr2=0x7f6c94073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:14.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.982+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/1079719535 shutdown_connections 2024-09-11T22:08:14.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.982+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/1079719535 wait complete. 2024-09-11T22:08:14.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.983+0000 7f6c9a6b0640 1 Processor -- start 2024-09-11T22:08:14.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.983+0000 7f6c9a6b0640 1 -- start start 2024-09-11T22:08:14.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c9a6b0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c9406e4f0 0x7f6c941acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:14.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c9a6b0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c9406ee10 0x7f6c941ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:14.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c9a6b0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c94114ab0 0x7f6c94113920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c9a6b0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9411a550 con 0x7f6c9406e4f0 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c9a6b0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9411a3d0 con 0x7f6c94114ab0 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c9a6b0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9411a6d0 con 0x7f6c9406ee10 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c98ead640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c9406ee10 0x7f6c941ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c98ead640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c9406ee10 0x7f6c941ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43220/0 (socket says 172.21.15.152:43220) 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c98ead640 1 -- 172.21.15.152:0/3891858661 learned_addr learned my addr 172.21.15.152:0/3891858661 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c996ae640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c9406e4f0 0x7f6c941acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c99eaf640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c94114ab0 0x7f6c94113920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c98ead640 1 -- 172.21.15.152:0/3891858661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c94114ab0 msgr2=0x7f6c94113920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c98ead640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c94114ab0 0x7f6c94113920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c98ead640 1 -- 172.21.15.152:0/3891858661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c9406e4f0 msgr2=0x7f6c941acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c98ead640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c9406e4f0 0x7f6c941acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:14.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.984+0000 7f6c98ead640 1 -- 172.21.15.152:0/3891858661 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c941140f0 con 0x7f6c9406ee10 2024-09-11T22:08:14.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.985+0000 7f6c98ead640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c9406ee10 0x7f6c941ad450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c84033d90 tx=0x7f6c84033dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:14.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.985+0000 7f6c8a7fc640 1 -- 172.21.15.152:0/3891858661 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84037040 con 0x7f6c9406ee10 2024-09-11T22:08:14.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.985+0000 7f6c8a7fc640 1 -- 172.21.15.152:0/3891858661 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c84040070 con 0x7f6c9406ee10 2024-09-11T22:08:14.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.985+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/3891858661 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c94114380 con 0x7f6c9406ee10 2024-09-11T22:08:14.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.985+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/3891858661 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c941b3d30 con 0x7f6c9406ee10 2024-09-11T22:08:14.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.985+0000 7f6c8a7fc640 1 -- 172.21.15.152:0/3891858661 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c840039e0 con 0x7f6c9406ee10 2024-09-11T22:08:14.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.987+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/3891858661 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c9406e8d0 con 0x7f6c9406ee10 2024-09-11T22:08:14.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.988+0000 7f6c8a7fc640 1 -- 172.21.15.152:0/3891858661 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f6c84003c80 con 0x7f6c9406ee10 2024-09-11T22:08:14.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.989+0000 7f6c8a7fc640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c800a2e40 0x7f6c800a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:14.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.989+0000 7f6c8a7fc640 1 -- 172.21.15.152:0/3891858661 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f6c840ef400 con 0x7f6c9406ee10 2024-09-11T22:08:14.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.989+0000 7f6c996ae640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c800a2e40 0x7f6c800a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:14.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.990+0000 7f6c996ae640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c800a2e40 0x7f6c800a5300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009bd0 tx=0x7f6c90005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:14.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:14.994+0000 7f6c8a7fc640 1 -- 172.21.15.152:0/3891858661 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c840bc100 con 0x7f6c9406ee10 2024-09-11T22:08:15.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.349+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/3891858661 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c941b3f00 con 0x7f6c9406ee10 2024-09-11T22:08:15.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.351+0000 7f6c8a7fc640 1 -- 172.21.15.152:0/3891858661 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f6c840bba00 con 0x7f6c9406ee10 2024-09-11T22:08:15.351 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:08:15.352 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:08:15.352 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:08:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/3891858661 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c800a2e40 msgr2=0x7f6c800a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c800a2e40 0x7f6c800a5300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009bd0 tx=0x7f6c90005f90 comp rx=0 tx=0).stop 2024-09-11T22:08:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/3891858661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c9406ee10 msgr2=0x7f6c941ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c9406ee10 0x7f6c941ad450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c84033d90 tx=0x7f6c84033dc0 comp rx=0 tx=0).stop 2024-09-11T22:08:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/3891858661 shutdown_connections 2024-09-11T22:08:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c800a2e40 0x7f6c800a5300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c94114ab0 0x7f6c94113920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c9406ee10 0x7f6c941ad450 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 --2- 172.21.15.152:0/3891858661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c9406e4f0 0x7f6c941acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/3891858661 >> 172.21.15.152:0/3891858661 conn(0x7f6c94073180 msgr2=0x7f6c9410a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/3891858661 shutdown_connections 2024-09-11T22:08:15.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:15.356+0000 7f6c9a6b0640 1 -- 172.21.15.152:0/3891858661 wait complete. 2024-09-11T22:08:15.703 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:15 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3891858661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:15.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:15 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3891858661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:15 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3891858661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:16.125 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0' 2024-09-11T22:08:16.125 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0 2024-09-11T22:08:16.553 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:16.682 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:16 smithi152 ceph-mon[31188]: pgmap v122: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 MiB/s wr, 1.57k op/s 2024-09-11T22:08:16.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:16 smithi179 ceph-mon[35603]: pgmap v122: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 MiB/s wr, 1.57k op/s 2024-09-11T22:08:16.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:16 smithi193 ceph-mon[35545]: pgmap v122: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 MiB/s wr, 1.57k op/s 2024-09-11T22:08:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.942+0000 7f12c8944640 1 -- 172.21.15.152:0/1388170691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12c41090c0 msgr2=0x7f12c41094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.942+0000 7f12c8944640 1 --2- 172.21.15.152:0/1388170691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12c41090c0 0x7f12c41094a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009860 tx=0x7f12b402a380 comp rx=0 tx=0).stop 2024-09-11T22:08:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.942+0000 7f12c8944640 1 -- 172.21.15.152:0/1388170691 shutdown_connections 2024-09-11T22:08:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.942+0000 7f12c8944640 1 --2- 172.21.15.152:0/1388170691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c41125e0 0x7f12c41149d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.942+0000 7f12c8944640 1 --2- 172.21.15.152:0/1388170691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12c4109a70 0x7f12c41120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.942+0000 7f12c8944640 1 --2- 172.21.15.152:0/1388170691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12c41090c0 0x7f12c41094a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.942+0000 7f12c8944640 1 -- 172.21.15.152:0/1388170691 >> 172.21.15.152:0/1388170691 conn(0x7f12c4077a80 msgr2=0x7f12c4079ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.945+0000 7f12c8944640 1 -- 172.21.15.152:0/1388170691 shutdown_connections 2024-09-11T22:08:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.946+0000 7f12c8944640 1 -- 172.21.15.152:0/1388170691 wait complete. 2024-09-11T22:08:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.947+0000 7f12c8944640 1 Processor -- start 2024-09-11T22:08:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.948+0000 7f12c8944640 1 -- start start 2024-09-11T22:08:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.948+0000 7f12c8944640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12c41090c0 0x7f12c4073830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.948+0000 7f12c8944640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c4109a70 0x7f12c4073d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.948+0000 7f12c37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12c41090c0 0x7f12c4073830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.948+0000 7f12c37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12c41090c0 0x7f12c4073830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43234/0 (socket says 172.21.15.152:43234) 2024-09-11T22:08:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.948+0000 7f12c37fe640 1 -- 172.21.15.152:0/3653138084 learned_addr learned my addr 172.21.15.152:0/3653138084 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.949+0000 7f12c8944640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12c41125e0 0x7f12c406c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.949+0000 7f12c8944640 1 -- 172.21.15.152:0/3653138084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12c4118340 con 0x7f12c41125e0 2024-09-11T22:08:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.949+0000 7f12c8944640 1 -- 172.21.15.152:0/3653138084 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41181c0 con 0x7f12c4109a70 2024-09-11T22:08:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.949+0000 7f12c8944640 1 -- 172.21.15.152:0/3653138084 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41184c0 con 0x7f12c41090c0 2024-09-11T22:08:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.949+0000 7f12c3fff640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12c41125e0 0x7f12c406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.949+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c4109a70 0x7f12c4073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.950+0000 7f12c3fff640 1 -- 172.21.15.152:0/3653138084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12c41090c0 msgr2=0x7f12c4073830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.950+0000 7f12c3fff640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12c41090c0 0x7f12c4073830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.950+0000 7f12c3fff640 1 -- 172.21.15.152:0/3653138084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c4109a70 msgr2=0x7f12c4073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.950+0000 7f12c3fff640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c4109a70 0x7f12c4073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.950+0000 7f12c3fff640 1 -- 172.21.15.152:0/3653138084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c406d1f0 con 0x7f12c41125e0 2024-09-11T22:08:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.955+0000 7f12c3fff640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12c41125e0 0x7f12c406c930 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f12c4075dc0 tx=0x7f12bc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.957+0000 7f12c0ff9640 1 -- 172.21.15.152:0/3653138084 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc010630 con 0x7f12c41125e0 2024-09-11T22:08:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.957+0000 7f12c0ff9640 1 -- 172.21.15.152:0/3653138084 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12bc00ee90 con 0x7f12c41125e0 2024-09-11T22:08:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.957+0000 7f12c0ff9640 1 -- 172.21.15.152:0/3653138084 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc017b70 con 0x7f12c41125e0 2024-09-11T22:08:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.958+0000 7f12c8944640 1 -- 172.21.15.152:0/3653138084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c406d4e0 con 0x7f12c41125e0 2024-09-11T22:08:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.958+0000 7f12c8944640 1 -- 172.21.15.152:0/3653138084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c4071530 con 0x7f12c41125e0 2024-09-11T22:08:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.962+0000 7f12cca1e740 1 Processor -- start 2024-09-11T22:08:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.963+0000 7f12c0ff9640 1 -- 172.21.15.152:0/3653138084 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f12bc0107d0 con 0x7f12c41125e0 2024-09-11T22:08:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.965+0000 7f12cca1e740 1 -- start start 2024-09-11T22:08:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.965+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e31cc0 0x558663e320a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.965+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.965+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e3ce80 0x558663e3f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.965+0000 7f12cca1e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558663d962f0 con 0x558663e325e0 2024-09-11T22:08:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.965+0000 7f12cca1e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558663d3e270 con 0x558663e3ce80 2024-09-11T22:08:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.965+0000 7f12cca1e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558663d922b0 con 0x558663e31cc0 2024-09-11T22:08:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.965+0000 7f12c0ff9640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12ac0a2dc0 0x7f12ac0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.965+0000 7f12c0ff9640 1 -- 172.21.15.152:0/3653138084 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f12bc0cfc60 con 0x7f12c41125e0 2024-09-11T22:08:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.966+0000 7f12c37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.966+0000 7f12c37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40684/0 (socket says 172.21.15.152:40684) 2024-09-11T22:08:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.966+0000 7f12c37fe640 1 -- 172.21.15.152:0/2358784329 learned_addr learned my addr 172.21.15.152:0/2358784329 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.967+0000 7f12c3fff640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12ac0a2dc0 0x7f12ac0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.967+0000 7f12c37fe640 1 -- 172.21.15.152:0/2358784329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e31cc0 msgr2=0x558663e320a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:08:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.967+0000 7f12c37fe640 1 --2- 172.21.15.152:0/2358784329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e31cc0 0x558663e320a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.967+0000 7f12c37fe640 1 -- 172.21.15.152:0/2358784329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e3ce80 msgr2=0x558663e3f270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:08:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.967+0000 7f12c37fe640 1 --2- 172.21.15.152:0/2358784329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e3ce80 0x558663e3f270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.967+0000 7f12c37fe640 1 -- 172.21.15.152:0/2358784329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558663d3d340 con 0x558663e325e0 2024-09-11T22:08:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.967+0000 7f12c37fe640 1 --2- 172.21.15.152:0/2358784329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3c940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f12b4005fd0 tx=0x7f12b4009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994d45c4db0c62bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.968+0000 7f12a9ffb640 1 -- 172.21.15.152:0/2358784329 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4037040 con 0x558663e325e0 2024-09-11T22:08:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.968+0000 7f12a9ffb640 1 -- 172.21.15.152:0/2358784329 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12b4041070 con 0x558663e325e0 2024-09-11T22:08:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.968+0000 7f12a9ffb640 1 -- 172.21.15.152:0/2358784329 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b40052b0 con 0x558663e325e0 2024-09-11T22:08:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.969+0000 7f12cca1e740 1 -- 172.21.15.152:0/2358784329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 msgr2=0x558663e3c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.969+0000 7f12cca1e740 1 --2- 172.21.15.152:0/2358784329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3c940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f12b4005fd0 tx=0x7f12b4009490 comp rx=0 tx=0).stop 2024-09-11T22:08:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.973+0000 7f12cca1e740 1 -- 172.21.15.152:0/2358784329 shutdown_connections 2024-09-11T22:08:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.973+0000 7f12cca1e740 1 --2- 172.21.15.152:0/2358784329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e3ce80 0x558663e3f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.973+0000 7f12cca1e740 1 --2- 172.21.15.152:0/2358784329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3c940 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.973+0000 7f12cca1e740 1 --2- 172.21.15.152:0/2358784329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e31cc0 0x558663e320a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.973+0000 7f12cca1e740 1 -- 172.21.15.152:0/2358784329 >> 172.21.15.152:0/2358784329 conn(0x558663e2e230 msgr2=0x558663e2e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.974+0000 7f12cca1e740 1 -- 172.21.15.152:0/2358784329 shutdown_connections 2024-09-11T22:08:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.975+0000 7f12c3fff640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12ac0a2dc0 0x7f12ac0a5280 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0a4830 tx=0x7f12bc005f70 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.976+0000 7f12cca1e740 1 -- 172.21.15.152:0/2358784329 wait complete. 2024-09-11T22:08:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.976+0000 7f12cca1e740 1 -- start start 2024-09-11T22:08:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.976+0000 7f12cca1e740 1 Processor -- start 2024-09-11T22:08:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.977+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e39d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.977+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.977+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e3ce80 0x558663e3a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.977+0000 7f12cca1e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558663e3faf0 con 0x558663e325e0 2024-09-11T22:08:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.977+0000 7f12cca1e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558663d1f290 con 0x558663e31cc0 2024-09-11T22:08:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.977+0000 7f12cca1e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558663e3fc70 con 0x558663e3ce80 2024-09-11T22:08:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.977+0000 7f12cca1e740 10 client.0 _ll_register_callbacks cb 0x558663d50140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.978+0000 7f12c2ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e39d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.978+0000 7f12c2ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e39d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58646/0 (socket says 172.21.15.152:58646) 2024-09-11T22:08:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.978+0000 7f12c2ffd640 1 -- 172.21.15.152:0/840588703 learned_addr learned my addr 172.21.15.152:0/840588703 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.978+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e3ce80 0x558663e3a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.978+0000 7f12c37fe640 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.979+0000 7f12c2ffd640 1 -- 172.21.15.152:0/840588703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e3ce80 msgr2=0x558663e3a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.979+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e3ce80 0x558663e3a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.979+0000 7f12c2ffd640 1 -- 172.21.15.152:0/840588703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 msgr2=0x558663e3a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.979+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.979+0000 7f12c2ffd640 1 -- 172.21.15.152:0/840588703 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558663aa9210 con 0x558663e31cc0 2024-09-11T22:08:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.979+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e39d50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f12b8005ab0 tx=0x7f12b80096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b67eca9ca2576f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.979+0000 7f12a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:08:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.979+0000 7f12a2ffd640 1 -- 172.21.15.152:0/840588703 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b8010c30 con 0x558663e31cc0 2024-09-11T22:08:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.979+0000 7f12cca1e740 1 -- 172.21.15.152:0/840588703 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12b4041070 con 0x558663e31cc0 2024-09-11T22:08:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.979+0000 7f12a2ffd640 1 -- 172.21.15.152:0/840588703 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f12b8010dd0 con 0x558663e31cc0 2024-09-11T22:08:16.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.980+0000 7f12a2ffd640 1 -- 172.21.15.152:0/840588703 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f12b8004050 con 0x558663e31cc0 2024-09-11T22:08:16.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.980+0000 7f12cca1e740 10 client.25835 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.980+0000 7f12cca1e740 1 -- 172.21.15.152:0/840588703 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558663b75620 con 0x558663e31cc0 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.980+0000 7f12a2ffd640 1 -- 172.21.15.152:0/840588703 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12b4041070 con 0x558663e31cc0 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.980+0000 7f12a2ffd640 1 -- 172.21.15.152:0/840588703 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f12b8026070 con 0x558663e31cc0 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.980+0000 7f12cca1e740 10 client.25835 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.980+0000 7f12cca1e740 10 client.25835 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.980+0000 7f12cca1e740 20 client.25835 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.980+0000 7f12cca1e740 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558663e4cec0 0x558663e4f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.980+0000 7f12cca1e740 4 client.25835 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.980+0000 7f12cca1e740 1 -- 172.21.15.152:0/840588703 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558663da3a20 con 0x558663e4cec0 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.981+0000 7f12c37fe640 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558663e4cec0 0x558663e4f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.981+0000 7f12c37fe640 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558663e4cec0 0x558663e4f2b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=238c4cc811d93193 server_cookie=e24bab12226d6376 in_seq=0 out_seq=0 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.981+0000 7f12a2ffd640 10 client.25835 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.982+0000 7f12a2ffd640 1 -- 172.21.15.152:0/840588703 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558663da3a20 con 0x558663e4cec0 2024-09-11T22:08:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.982+0000 7f12a2ffd640 10 client.25835 handle_command_reply: tid=0 2024-09-11T22:08:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.982+0000 7f12cca1e740 1 client.25835 shutdown 2024-09-11T22:08:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.983+0000 7f12cca1e740 1 -- 172.21.15.152:0/840588703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 msgr2=0x558663e39d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.983+0000 7f12cca1e740 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e39d50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f12b8005ab0 tx=0x7f12b80096e0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.984+0000 7f12cca1e740 1 -- 172.21.15.152:0/840588703 shutdown_connections 2024-09-11T22:08:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.984+0000 7f12cca1e740 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558663e4cec0 0x558663e4f2b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.985 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.984+0000 7f12cca1e740 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e3ce80 0x558663e3a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.985 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.984+0000 7f12cca1e740 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.985 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.984+0000 7f12cca1e740 1 --2- 172.21.15.152:0/840588703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e39d50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:16.985 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.984+0000 7f12cca1e740 1 -- 172.21.15.152:0/840588703 >> 172.21.15.152:0/840588703 conn(0x558663e2e230 msgr2=0x558663e33f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:16.985 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.984+0000 7f12a2ffd640 0 client.25835 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:16.985 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.984+0000 7f12cca1e740 1 -- 172.21.15.152:0/840588703 shutdown_connections 2024-09-11T22:08:16.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.984+0000 7f12cca1e740 1 -- 172.21.15.152:0/840588703 wait complete. 2024-09-11T22:08:16.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:16.984+0000 7f12cca1e740 20 client.25835 trim_cache size 0 max 16384 2024-09-11T22:08:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.009+0000 7f12cca1e740 1 Processor -- start 2024-09-11T22:08:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.009+0000 7f12cca1e740 1 -- start start 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.009+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e31cc0 0x558663e34730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.009+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.009+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e3ce80 0x558663e54b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12cca1e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41c7650 con 0x558663e325e0 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12cca1e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41c4f20 con 0x558663e3ce80 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12cca1e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41c2d70 con 0x558663e31cc0 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12c2ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e31cc0 0x558663e34730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12c2ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e31cc0 0x558663e34730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43262/0 (socket says 172.21.15.152:43262) 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12c2ffd640 1 -- 172.21.15.152:0/2068826035 learned_addr learned my addr 172.21.15.152:0/2068826035 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/2068826035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e3ce80 0x558663e54b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12c37fe640 1 --2- 172.21.15.152:0/2068826035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12c2ffd640 1 -- 172.21.15.152:0/2068826035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e3ce80 msgr2=0x558663e54b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/2068826035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e3ce80 0x558663e54b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12c2ffd640 1 -- 172.21.15.152:0/2068826035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 msgr2=0x558663e3a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/2068826035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.010+0000 7f12c2ffd640 1 -- 172.21.15.152:0/2068826035 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558663e2c7b0 con 0x558663e31cc0 2024-09-11T22:08:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.011+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/2068826035 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e31cc0 0x558663e34730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009360 tx=0x7f12b8014040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7b3e7b6c996bb96 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.011+0000 7f12a97fa640 1 -- 172.21.15.152:0/2068826035 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b802c070 con 0x558663e31cc0 2024-09-11T22:08:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.011+0000 7f12a97fa640 1 -- 172.21.15.152:0/2068826035 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12b802d040 con 0x558663e31cc0 2024-09-11T22:08:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.011+0000 7f12a97fa640 1 -- 172.21.15.152:0/2068826035 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b8004450 con 0x558663e31cc0 2024-09-11T22:08:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.012+0000 7f12cca1e740 1 -- 172.21.15.152:0/2068826035 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e31cc0 msgr2=0x558663e34730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.013+0000 7f12cca1e740 1 --2- 172.21.15.152:0/2068826035 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e31cc0 0x558663e34730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009360 tx=0x7f12b8014040 comp rx=0 tx=0).stop 2024-09-11T22:08:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.013+0000 7f12cca1e740 1 -- 172.21.15.152:0/2068826035 shutdown_connections 2024-09-11T22:08:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.013+0000 7f12cca1e740 1 --2- 172.21.15.152:0/2068826035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e3ce80 0x558663e54b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.013+0000 7f12cca1e740 1 --2- 172.21.15.152:0/2068826035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e3a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.013+0000 7f12cca1e740 1 --2- 172.21.15.152:0/2068826035 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e31cc0 0x558663e34730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.013+0000 7f12cca1e740 1 -- 172.21.15.152:0/2068826035 >> 172.21.15.152:0/2068826035 conn(0x558663e2e230 msgr2=0x558663e3bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.014+0000 7f12cca1e740 1 -- 172.21.15.152:0/2068826035 shutdown_connections 2024-09-11T22:08:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.014+0000 7f12cca1e740 1 -- 172.21.15.152:0/2068826035 wait complete. 2024-09-11T22:08:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.015+0000 7f12cca1e740 1 -- start start 2024-09-11T22:08:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.015+0000 7f12cca1e740 1 Processor -- start 2024-09-11T22:08:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.015+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e45310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.015+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e40630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.015+0000 7f12cca1e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e3ce80 0x558663e40b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.015+0000 7f12cca1e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41c33e0 con 0x558663e325e0 2024-09-11T22:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.015+0000 7f12cca1e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41c4850 con 0x558663e31cc0 2024-09-11T22:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.015+0000 7f12cca1e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41c3ab0 con 0x558663e3ce80 2024-09-11T22:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.015+0000 7f12cca1e740 10 client.0 _ll_register_callbacks cb 0x7f12b80099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.016+0000 7f12c2ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e45310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.016+0000 7f12c2ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e45310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58650/0 (socket says 172.21.15.152:58650) 2024-09-11T22:08:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.016+0000 7f12c2ffd640 1 -- 172.21.15.152:0/3167177871 learned_addr learned my addr 172.21.15.152:0/3167177871 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.016+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e3ce80 0x558663e40b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.017+0000 7f12c2ffd640 1 -- 172.21.15.152:0/3167177871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e3ce80 msgr2=0x558663e40b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.017+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e3ce80 0x558663e40b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.017+0000 7f12c2ffd640 1 -- 172.21.15.152:0/3167177871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 msgr2=0x558663e40630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.017+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e40630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.017+0000 7f12c2ffd640 1 -- 172.21.15.152:0/3167177871 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558663e410b0 con 0x558663e31cc0 2024-09-11T22:08:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.017+0000 7f12c2ffd640 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e45310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f12b802e000 tx=0x7f12b801b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=743db8bd2f621ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.017+0000 7f12a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:08:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.018+0000 7f12a2ffd640 1 -- 172.21.15.152:0/3167177871 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b802c070 con 0x558663e31cc0 2024-09-11T22:08:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.018+0000 7f12a2ffd640 1 -- 172.21.15.152:0/3167177871 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f12b8027d60 con 0x558663e31cc0 2024-09-11T22:08:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.018+0000 7f12cca1e740 1 -- 172.21.15.152:0/3167177871 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12b802d040 con 0x558663e31cc0 2024-09-11T22:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.018+0000 7f12a2ffd640 1 -- 172.21.15.152:0/3167177871 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f12b80035f0 con 0x558663e31cc0 2024-09-11T22:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.018+0000 7f12cca1e740 10 client.25841 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.018+0000 7f12cca1e740 1 -- 172.21.15.152:0/3167177871 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558663eb77e0 con 0x558663e31cc0 2024-09-11T22:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.019+0000 7f12a2ffd640 1 -- 172.21.15.152:0/3167177871 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12b802d040 con 0x558663e31cc0 2024-09-11T22:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.020+0000 7f12a2ffd640 1 -- 172.21.15.152:0/3167177871 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f12b8026040 con 0x558663e31cc0 2024-09-11T22:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.020+0000 7f12cca1e740 10 client.25841 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.020+0000 7f12cca1e740 10 client.25841 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.020+0000 7f12cca1e740 20 client.25841 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.020+0000 7f12cca1e740 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558663eb7e40 0x558663eba260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.020+0000 7f12cca1e740 4 client.25841 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:08:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.020+0000 7f12cca1e740 1 -- 172.21.15.152:0/3167177871 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558663d9dd70 con 0x558663eb7e40 2024-09-11T22:08:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.020+0000 7f12c37fe640 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558663eb7e40 0x558663eba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.022+0000 7f12c37fe640 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558663eb7e40 0x558663eba260 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7dbf29532bd00a server_cookie=31e1cb00f626e7c1 in_seq=0 out_seq=0 2024-09-11T22:08:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.022+0000 7f12a2ffd640 10 client.25841 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:17.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.029+0000 7f12a2ffd640 1 -- 172.21.15.152:0/3167177871 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558663d9dd70 con 0x558663eb7e40 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.029+0000 7f12a2ffd640 10 client.25841 handle_command_reply: tid=0 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.029+0000 7f12cca1e740 1 client.25841 shutdown 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12cca1e740 1 -- 172.21.15.152:0/3167177871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 msgr2=0x558663e45310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12cca1e740 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e45310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f12b802e000 tx=0x7f12b801b040 comp rx=0 tx=0).stop 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12cca1e740 1 -- 172.21.15.152:0/3167177871 shutdown_connections 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12cca1e740 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558663eb7e40 0x558663eba260 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12cca1e740 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558663e3ce80 0x558663e40b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12cca1e740 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558663e325e0 0x558663e40630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12cca1e740 1 --2- 172.21.15.152:0/3167177871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558663e31cc0 0x558663e45310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12cca1e740 1 -- 172.21.15.152:0/3167177871 >> 172.21.15.152:0/3167177871 conn(0x558663e2e230 msgr2=0x558663e2ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12a2ffd640 0 client.25841 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12cca1e740 1 -- 172.21.15.152:0/3167177871 shutdown_connections 2024-09-11T22:08:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12cca1e740 1 -- 172.21.15.152:0/3167177871 wait complete. 2024-09-11T22:08:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.030+0000 7f12cca1e740 20 client.25841 trim_cache size 0 max 16384 2024-09-11T22:08:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:08:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:08:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:08:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:08:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 -- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12ac0a2dc0 msgr2=0x7f12ac0a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12ac0a2dc0 0x7f12ac0a5280 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0a4830 tx=0x7f12bc005f70 comp rx=0 tx=0).stop 2024-09-11T22:08:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 -- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12c41125e0 msgr2=0x7f12c406c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12c41125e0 0x7f12c406c930 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f12c4075dc0 tx=0x7f12bc00c6a0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 -- 172.21.15.152:0/3653138084 shutdown_connections 2024-09-11T22:08:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12ac0a2dc0 0x7f12ac0a5280 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12c41125e0 0x7f12c406c930 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c4109a70 0x7f12c4073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 --2- 172.21.15.152:0/3653138084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12c41090c0 0x7f12c4073830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 -- 172.21.15.152:0/3653138084 >> 172.21.15.152:0/3653138084 conn(0x7f12c4077a80 msgr2=0x7f12c4077e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 -- 172.21.15.152:0/3653138084 shutdown_connections 2024-09-11T22:08:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:17.031+0000 7f12c8944640 1 -- 172.21.15.152:0/3653138084 wait complete. 2024-09-11T22:08:17.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.179+0000 7fe1c9311640 1 -- 172.21.15.152:0/787775831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1c411b140 msgr2=0x7fe1c411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.179+0000 7fe1c9311640 1 --2- 172.21.15.152:0/787775831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1c411b140 0x7fe1c411d530 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009ca0 tx=0x7fe1bc02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.180+0000 7fe1c9311640 1 -- 172.21.15.152:0/787775831 shutdown_connections 2024-09-11T22:08:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.180+0000 7fe1c9311640 1 --2- 172.21.15.152:0/787775831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1c411b140 0x7fe1c411d530 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.180+0000 7fe1c9311640 1 --2- 172.21.15.152:0/787775831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1c4109830 0x7fe1c4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.180+0000 7fe1c9311640 1 --2- 172.21.15.152:0/787775831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c4109450 0x7fe1c4110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.180+0000 7fe1c9311640 1 -- 172.21.15.152:0/787775831 >> 172.21.15.152:0/787775831 conn(0x7fe1c406e140 msgr2=0x7fe1c406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.180+0000 7fe1c9311640 1 -- 172.21.15.152:0/787775831 shutdown_connections 2024-09-11T22:08:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.180+0000 7fe1c9311640 1 -- 172.21.15.152:0/787775831 wait complete. 2024-09-11T22:08:17.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.181+0000 7fe1c9311640 1 Processor -- start 2024-09-11T22:08:17.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.181+0000 7fe1c9311640 1 -- start start 2024-09-11T22:08:17.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c9311640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1c4109450 0x7fe1c41a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c9311640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1c4109830 0x7fe1c41a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c9311640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c411b140 0x7fe1c41abac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c9311640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c4120df0 con 0x7fe1c411b140 2024-09-11T22:08:17.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c9311640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c4120c70 con 0x7fe1c4109450 2024-09-11T22:08:17.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c9311640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c4120f70 con 0x7fe1c4109830 2024-09-11T22:08:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c411b140 0x7fe1c41abac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c411b140 0x7fe1c41abac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40734/0 (socket says 172.21.15.152:40734) 2024-09-11T22:08:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c37fe640 1 -- 172.21.15.152:0/2194171091 learned_addr learned my addr 172.21.15.152:0/2194171091 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c2ffd640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1c4109450 0x7fe1c41a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c37fe640 1 -- 172.21.15.152:0/2194171091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1c4109830 msgr2=0x7fe1c41a7730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:08:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.182+0000 7fe1c37fe640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1c4109830 0x7fe1c41a7730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.183+0000 7fe1c37fe640 1 -- 172.21.15.152:0/2194171091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1c4109450 msgr2=0x7fe1c41a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.183+0000 7fe1c37fe640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1c4109450 0x7fe1c41a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.183+0000 7fe1c37fe640 1 -- 172.21.15.152:0/2194171091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c41ac1a0 con 0x7fe1c411b140 2024-09-11T22:08:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.183+0000 7fe1c37fe640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c411b140 0x7fe1c41abac0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc005e30 tx=0x7fe1bc0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.183+0000 7fe1abfff640 1 -- 172.21.15.152:0/2194171091 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc030e40 con 0x7fe1c411b140 2024-09-11T22:08:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.183+0000 7fe1abfff640 1 -- 172.21.15.152:0/2194171091 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1bc003e50 con 0x7fe1c411b140 2024-09-11T22:08:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.183+0000 7fe1abfff640 1 -- 172.21.15.152:0/2194171091 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc004380 con 0x7fe1c411b140 2024-09-11T22:08:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.184+0000 7fe1c9311640 1 -- 172.21.15.152:0/2194171091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c41ac430 con 0x7fe1c411b140 2024-09-11T22:08:17.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.184+0000 7fe1c9311640 1 -- 172.21.15.152:0/2194171091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c41b3d70 con 0x7fe1c411b140 2024-09-11T22:08:17.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.187+0000 7fe1cb6ea740 1 Processor -- start 2024-09-11T22:08:17.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.188+0000 7fe1abfff640 1 -- 172.21.15.152:0/2194171091 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe1bc004520 con 0x7fe1c411b140 2024-09-11T22:08:17.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.188+0000 7fe1cb6ea740 1 -- start start 2024-09-11T22:08:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.188+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 0x55f4b3df3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.188+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df4170 0x55f4b3dfe4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.188+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 0x55f4b3e00e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.188+0000 7fe1cb6ea740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f4b3d58160 con 0x55f4b3dfea30 2024-09-11T22:08:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.188+0000 7fe1cb6ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f4b3cff720 con 0x55f4b3df3850 2024-09-11T22:08:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.188+0000 7fe1cb6ea740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f4b3d54120 con 0x55f4b3df4170 2024-09-11T22:08:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1c27fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 0x55f4b3e00e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1c27fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 0x55f4b3e00e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40746/0 (socket says 172.21.15.152:40746) 2024-09-11T22:08:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1c27fc640 1 -- 172.21.15.152:0/1219670495 learned_addr learned my addr 172.21.15.152:0/1219670495 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1c2ffd640 1 --2- 172.21.15.152:0/1219670495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df4170 0x55f4b3dfe4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/1219670495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 0x55f4b3df3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1abfff640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1ac0a2d70 0x7fe1ac0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1c27fc640 1 -- 172.21.15.152:0/1219670495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df4170 msgr2=0x55f4b3dfe4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/1219670495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df4170 0x55f4b3dfe4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1c27fc640 1 -- 172.21.15.152:0/1219670495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 msgr2=0x55f4b3df3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/1219670495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 0x55f4b3df3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1c27fc640 1 -- 172.21.15.152:0/1219670495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b3ac9ba0 con 0x55f4b3dfea30 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.189+0000 7fe1c37fe640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1ac0a2d70 0x7fe1ac0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.190+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/1219670495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 0x55f4b3e00e20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800f390 tx=0x7fe1b800d480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c28db724c3ee98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.190+0000 7fe1abfff640 1 -- 172.21.15.152:0/2194171091 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe1bc0f09d0 con 0x7fe1c411b140 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.190+0000 7fe1a97fa640 1 -- 172.21.15.152:0/1219670495 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8005220 con 0x55f4b3dfea30 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.190+0000 7fe1a97fa640 1 -- 172.21.15.152:0/1219670495 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1b8004c80 con 0x55f4b3dfea30 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.190+0000 7fe1a97fa640 1 -- 172.21.15.152:0/1219670495 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80127d0 con 0x55f4b3dfea30 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.191+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1219670495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 msgr2=0x55f4b3e00e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.191+0000 7fe1c37fe640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1ac0a2d70 0x7fe1ac0a5230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0bccd0 tx=0x7fe1bc03e040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.191+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1219670495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 0x55f4b3e00e20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800f390 tx=0x7fe1b800d480 comp rx=0 tx=0).stop 2024-09-11T22:08:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.191+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1219670495 shutdown_connections 2024-09-11T22:08:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.191+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1219670495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 0x55f4b3e00e20 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.191+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1219670495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df4170 0x55f4b3dfe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.191+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1219670495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 0x55f4b3df3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.191+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1219670495 >> 172.21.15.152:0/1219670495 conn(0x55f4b3defde0 msgr2=0x55f4b3df01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.191+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1219670495 shutdown_connections 2024-09-11T22:08:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.191+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1219670495 wait complete. 2024-09-11T22:08:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.192+0000 7fe1cb6ea740 1 -- start start 2024-09-11T22:08:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.192+0000 7fe1cb6ea740 1 Processor -- start 2024-09-11T22:08:17.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.193+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df3850 0x55f4b3dfba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.193+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df4170 0x55f4b3dfbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.193+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 0x55f4b3dfc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.193+0000 7fe1cb6ea740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f4b3e01600 con 0x55f4b3dfea30 2024-09-11T22:08:17.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.193+0000 7fe1c27fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df3850 0x55f4b3dfba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.193+0000 7fe1c27fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df3850 0x55f4b3dfba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43302/0 (socket says 172.21.15.152:43302) 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.193+0000 7fe1c27fc640 1 -- 172.21.15.152:0/1696936096 learned_addr learned my addr 172.21.15.152:0/1696936096 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.193+0000 7fe1c2ffd640 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df4170 0x55f4b3dfbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.193+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1696936096 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f4b3ce0900 con 0x55f4b3df4170 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.193+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1696936096 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f4b3e01780 con 0x55f4b3df3850 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.193+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 0x55f4b3dfc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1c27fc640 1 -- 172.21.15.152:0/1696936096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df4170 msgr2=0x55f4b3dfbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df4170 0x55f4b3dfbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1c27fc640 1 -- 172.21.15.152:0/1696936096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 msgr2=0x55f4b3dfc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 0x55f4b3dfc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1c27fc640 1 -- 172.21.15.152:0/1696936096 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b3d20c50 con 0x55f4b3df3850 2024-09-11T22:08:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1cb6ea740 10 client.0 _ll_register_callbacks cb 0x55f4b3cde780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df3850 0x55f4b3dfba00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8001eb0 tx=0x7fe1b8005710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1e8280139981f35 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1a6ff5640 10 client.25996 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1696936096 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1b8004c80 con 0x55f4b3df3850 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1a6ff5640 1 -- 172.21.15.152:0/1696936096 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8031050 con 0x55f4b3df3850 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1a6ff5640 1 -- 172.21.15.152:0/1696936096 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe1b8005000 con 0x55f4b3df3850 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1a6ff5640 1 -- 172.21.15.152:0/1696936096 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe1b8005260 con 0x55f4b3df3850 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1cb6ea740 10 client.25996 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.194+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1696936096 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55f4b3e0d1f0 con 0x55f4b3df3850 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.195+0000 7fe1a6ff5640 1 -- 172.21.15.152:0/1696936096 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe1b80046c0 con 0x55f4b3df3850 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.195+0000 7fe1cb6ea740 10 client.25996 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.195+0000 7fe1cb6ea740 10 client.25996 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.195+0000 7fe1cb6ea740 20 client.25996 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.195+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4b3e0e5a0 0x55f4b3e10990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.195+0000 7fe1cb6ea740 4 client.25996 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.195+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1696936096 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe1b8004c80 con 0x55f4b3e0e5a0 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.195+0000 7fe1c2ffd640 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4b3e0e5a0 0x55f4b3e10990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.196+0000 7fe1c2ffd640 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4b3e0e5a0 0x55f4b3e10990 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90b09049ace1b1b4 server_cookie=7abcd8cc9d895867 in_seq=0 out_seq=0 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.196+0000 7fe1a6ff5640 10 client.25996 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.196+0000 7fe1a6ff5640 1 -- 172.21.15.152:0/1696936096 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe1b8004c80 con 0x55f4b3e0e5a0 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.196+0000 7fe1a6ff5640 10 client.25996 handle_command_reply: tid=0 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.196+0000 7fe1cb6ea740 1 client.25996 shutdown 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1696936096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df3850 msgr2=0x55f4b3dfba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df3850 0x55f4b3dfba00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8001eb0 tx=0x7fe1b8005710 comp rx=0 tx=0).stop 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1696936096 shutdown_connections 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4b3e0e5a0 0x55f4b3e10990 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3dfea30 0x55f4b3dfc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df4170 0x55f4b3dfbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1696936096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3df3850 0x55f4b3dfba00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1a6ff5640 0 client.25996 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:17.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1696936096 >> 172.21.15.152:0/1696936096 conn(0x55f4b3defde0 msgr2=0x55f4b3df5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:17.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1696936096 shutdown_connections 2024-09-11T22:08:17.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1696936096 wait complete. 2024-09-11T22:08:17.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.197+0000 7fe1cb6ea740 20 client.25996 trim_cache size 0 max 16384 2024-09-11T22:08:17.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1cb6ea740 1 Processor -- start 2024-09-11T22:08:17.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1cb6ea740 1 -- start start 2024-09-11T22:08:17.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 0x55f4b3e161c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3df3850 0x55f4b3e16700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df4170 0x55f4b3df8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1cb6ea740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41bf0a0 con 0x55f4b3df3850 2024-09-11T22:08:17.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1cb6ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41bc970 con 0x55f4b3df4170 2024-09-11T22:08:17.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1cb6ea740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41ba7c0 con 0x55f4b3defde0 2024-09-11T22:08:17.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1c27fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 0x55f4b3e161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1c27fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 0x55f4b3e161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43306/0 (socket says 172.21.15.152:43306) 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1c27fc640 1 -- 172.21.15.152:0/2113096699 learned_addr learned my addr 172.21.15.152:0/2113096699 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.215+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/2113096699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df4170 0x55f4b3df8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.216+0000 7fe1c2ffd640 1 --2- 172.21.15.152:0/2113096699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3df3850 0x55f4b3e16700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.216+0000 7fe1c27fc640 1 -- 172.21.15.152:0/2113096699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df4170 msgr2=0x55f4b3df8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.216+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/2113096699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df4170 0x55f4b3df8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.216+0000 7fe1c27fc640 1 -- 172.21.15.152:0/2113096699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3df3850 msgr2=0x55f4b3e16700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.216+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/2113096699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3df3850 0x55f4b3e16700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.216+0000 7fe1c27fc640 1 -- 172.21.15.152:0/2113096699 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b3df0a70 con 0x55f4b3defde0 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.216+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/2113096699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 0x55f4b3e161c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8005780 tx=0x7fe1b8020070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddfb7fbe5d14dcc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.216+0000 7fe1a8ff9640 1 -- 172.21.15.152:0/2113096699 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8031070 con 0x55f4b3defde0 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.216+0000 7fe1a8ff9640 1 -- 172.21.15.152:0/2113096699 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1b80054a0 con 0x55f4b3defde0 2024-09-11T22:08:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.216+0000 7fe1a8ff9640 1 -- 172.21.15.152:0/2113096699 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8012930 con 0x55f4b3defde0 2024-09-11T22:08:17.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.217+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/2113096699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 msgr2=0x55f4b3e161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.217+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/2113096699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 0x55f4b3e161c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8005780 tx=0x7fe1b8020070 comp rx=0 tx=0).stop 2024-09-11T22:08:17.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.217+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/2113096699 shutdown_connections 2024-09-11T22:08:17.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.217+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/2113096699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df4170 0x55f4b3df8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.217+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/2113096699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3df3850 0x55f4b3e16700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.217+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/2113096699 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 0x55f4b3e161c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.217+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/2113096699 >> 172.21.15.152:0/2113096699 conn(0x55f4b3df73f0 msgr2=0x55f4b3dfc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:17.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.217+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/2113096699 shutdown_connections 2024-09-11T22:08:17.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.217+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/2113096699 wait complete. 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.217+0000 7fe1cb6ea740 1 -- start start 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1cb6ea740 1 Processor -- start 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 0x55f4b3e03050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 0x55f4b3e03590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1cb6ea740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3df4170 0x55f4b3e721d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1cb6ea740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41bae30 con 0x55f4b3df4170 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1c2ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 0x55f4b3e03590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1c27fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 0x55f4b3e03050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1c2ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 0x55f4b3e03590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58716/0 (socket says 172.21.15.152:58716) 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1c2ffd640 1 -- 172.21.15.152:0/1643893598 learned_addr learned my addr 172.21.15.152:0/1643893598 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3df4170 0x55f4b3e721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1cb6ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41bc2a0 con 0x55f4b3df3850 2024-09-11T22:08:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1643893598 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41bb500 con 0x55f4b3defde0 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1cb6ea740 10 client.0 _ll_register_callbacks cb 0x7fe1b40095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1c2ffd640 1 -- 172.21.15.152:0/1643893598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 msgr2=0x55f4b3e03050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1c2ffd640 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 0x55f4b3e03050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1c2ffd640 1 -- 172.21.15.152:0/1643893598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3df4170 msgr2=0x55f4b3e721d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1c2ffd640 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3df4170 0x55f4b3e721d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.218+0000 7fe1c2ffd640 1 -- 172.21.15.152:0/1643893598 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b3e72810 con 0x55f4b3df3850 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1c2ffd640 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 0x55f4b3e03590 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55f4b3dfd040 tx=0x7fe1b4014840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aee286687846dfe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1a6ff5640 1 -- 172.21.15.152:0/1643893598 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b401e620 con 0x55f4b3df3850 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1a6ff5640 1 -- 172.21.15.152:0/1643893598 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe1b401e7c0 con 0x55f4b3df3850 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1643893598 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1b80054a0 con 0x55f4b3df3850 2024-09-11T22:08:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1a6ff5640 1 -- 172.21.15.152:0/1643893598 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe1b401e9c0 con 0x55f4b3df3850 2024-09-11T22:08:17.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1cb6ea740 10 client.25856 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:17.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1643893598 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f4b3e79b30 con 0x55f4b3df3850 2024-09-11T22:08:17.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1a6ff5640 1 -- 172.21.15.152:0/1643893598 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1b80054a0 con 0x55f4b3df3850 2024-09-11T22:08:17.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1a6ff5640 1 -- 172.21.15.152:0/1643893598 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe1b400f040 con 0x55f4b3df3850 2024-09-11T22:08:17.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1cb6ea740 10 client.25856 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:17.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1cb6ea740 10 client.25856 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:08:17.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1cb6ea740 20 client.25856 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:17.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4b3dfea30 0x55f4b3e7c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:17.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1cb6ea740 4 client.25856 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}] 2024-09-11T22:08:17.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.219+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1643893598 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}) -- 0x55f4b3d65890 con 0x55f4b3dfea30 2024-09-11T22:08:17.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.220+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4b3dfea30 0x55f4b3e7c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:17.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.220+0000 7fe1a6ff5640 10 client.25856 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:17.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.220+0000 7fe1c27fc640 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4b3dfea30 0x55f4b3e7c300 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fa48be9b92b4ce1 server_cookie=94d17436b3062118 in_seq=0 out_seq=0 2024-09-11T22:08:17.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1a6ff5640 1 -- 172.21.15.152:0/1643893598 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f4b3d65890 con 0x55f4b3dfea30 2024-09-11T22:08:17.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1a6ff5640 10 client.25856 handle_command_reply: tid=0 2024-09-11T22:08:17.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 1 client.25856 shutdown 2024-09-11T22:08:17.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1643893598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 msgr2=0x55f4b3e03590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 0x55f4b3e03590 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55f4b3dfd040 tx=0x7fe1b4014840 comp rx=0 tx=0).stop 2024-09-11T22:08:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1643893598 shutdown_connections 2024-09-11T22:08:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4b3dfea30 0x55f4b3e7c300 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4b3df4170 0x55f4b3e721d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4b3df3850 0x55f4b3e03590 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1a6ff5640 0 client.25856 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 1 --2- 172.21.15.152:0/1643893598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4b3defde0 0x55f4b3e03050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1643893598 >> 172.21.15.152:0/1643893598 conn(0x55f4b3df73f0 msgr2=0x55f4b3deeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1643893598 shutdown_connections 2024-09-11T22:08:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 1 -- 172.21.15.152:0/1643893598 wait complete. 2024-09-11T22:08:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.495+0000 7fe1cb6ea740 20 client.25856 trim_cache size 0 max 16384 2024-09-11T22:08:17.498 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:08:17.498 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:08:17.498 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:08:17.498 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 14, 2024-09-11T22:08:17.498 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:08:17.498 INFO:teuthology.orchestra.run.smithi152.stdout: "cf3bb05d": { 2024-09-11T22:08:17.498 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 14, 2024-09-11T22:08:17.498 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:08:17.498 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:08:17.498 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:08:17.498 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 140.2, 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:17.500 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:17.500 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:08:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 -- 172.21.15.152:0/2194171091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1ac0a2d70 msgr2=0x7fe1ac0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1ac0a2d70 0x7fe1ac0a5230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0bccd0 tx=0x7fe1bc03e040 comp rx=0 tx=0).stop 2024-09-11T22:08:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 -- 172.21.15.152:0/2194171091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c411b140 msgr2=0x7fe1c41abac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c411b140 0x7fe1c41abac0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc005e30 tx=0x7fe1bc0093d0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 -- 172.21.15.152:0/2194171091 shutdown_connections 2024-09-11T22:08:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1ac0a2d70 0x7fe1ac0a5230 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c411b140 0x7fe1c41abac0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1c4109830 0x7fe1c41a7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 --2- 172.21.15.152:0/2194171091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1c4109450 0x7fe1c41a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 -- 172.21.15.152:0/2194171091 >> 172.21.15.152:0/2194171091 conn(0x7fe1c406e140 msgr2=0x7fe1c411c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 -- 172.21.15.152:0/2194171091 shutdown_connections 2024-09-11T22:08:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:17.496+0000 7fe1c9311640 1 -- 172.21.15.152:0/2194171091 wait complete. 2024-09-11T22:08:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:17 smithi152 ceph-mon[31188]: pgmap v123: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 MiB/s wr, 1.57k op/s 2024-09-11T22:08:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:17 smithi179 ceph-mon[35603]: pgmap v123: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 MiB/s wr, 1.57k op/s 2024-09-11T22:08:17.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:17 smithi193 ceph-mon[35545]: pgmap v123: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 MiB/s wr, 1.57k op/s 2024-09-11T22:08:18.427 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'cf3bb05d', quiesce took 5.0 seconds. Will release after: 15.149999999999999 2024-09-11T22:08:19.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:18 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:08:19.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:18 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:08:19.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:18 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:08:19.820 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 165.0 s, 1784.7 tps, lat 26.328 ms stddev 30.787 2024-09-11T22:08:20.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:19 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:08:20.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:19 smithi152 ceph-mon[31188]: pgmap v124: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 73 MiB/s wr, 1.84k op/s 2024-09-11T22:08:20.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:19 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:08:20.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:19 smithi179 ceph-mon[35603]: pgmap v124: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 73 MiB/s wr, 1.84k op/s 2024-09-11T22:08:20.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:19 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:08:20.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:19 smithi193 ceph-mon[35545]: pgmap v124: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 73 MiB/s wr, 1.84k op/s 2024-09-11T22:08:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:21 smithi179 ceph-mon[35603]: pgmap v125: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 36 MiB/s wr, 897 op/s 2024-09-11T22:08:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:21 smithi193 ceph-mon[35545]: pgmap v125: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 36 MiB/s wr, 897 op/s 2024-09-11T22:08:21.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:21 smithi152 ceph-mon[31188]: pgmap v125: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 36 MiB/s wr, 897 op/s 2024-09-11T22:08:23.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:23 smithi179 ceph-mon[35603]: pgmap v126: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 36 MiB/s wr, 900 op/s 2024-09-11T22:08:23.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:23 smithi193 ceph-mon[35545]: pgmap v126: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 36 MiB/s wr, 900 op/s 2024-09-11T22:08:23.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:23 smithi152 ceph-mon[31188]: pgmap v126: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 36 MiB/s wr, 900 op/s 2024-09-11T22:08:24.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:08:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:25 smithi179 ceph-mon[35603]: pgmap v127: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 18 MiB/s wr, 275 op/s 2024-09-11T22:08:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:25 smithi193 ceph-mon[35545]: pgmap v127: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 18 MiB/s wr, 275 op/s 2024-09-11T22:08:25.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:25 smithi152 ceph-mon[31188]: pgmap v127: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 18 MiB/s wr, 275 op/s 2024-09-11T22:08:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:27 smithi152 ceph-mon[31188]: pgmap v128: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 18 MiB/s wr, 275 op/s 2024-09-11T22:08:27.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:27 smithi179 ceph-mon[35603]: pgmap v128: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 18 MiB/s wr, 275 op/s 2024-09-11T22:08:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:27 smithi193 ceph-mon[35545]: pgmap v128: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 18 MiB/s wr, 275 op/s 2024-09-11T22:08:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:29 smithi179 ceph-mon[35603]: pgmap v129: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 18 MiB/s wr, 278 op/s 2024-09-11T22:08:29.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:08:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:29 smithi193 ceph-mon[35545]: pgmap v129: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 18 MiB/s wr, 278 op/s 2024-09-11T22:08:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:29 smithi152 ceph-mon[31188]: pgmap v129: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 18 MiB/s wr, 278 op/s 2024-09-11T22:08:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 -- 172.21.15.152:0/3663001473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb920102470 msgr2=0x7fb92010e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 --2- 172.21.15.152:0/3663001473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb920102470 0x7fb92010e9a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb918009cd0 tx=0x7fb91802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 -- 172.21.15.152:0/3663001473 shutdown_connections 2024-09-11T22:08:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 --2- 172.21.15.152:0/3663001473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb920102470 0x7fb92010e9a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 --2- 172.21.15.152:0/3663001473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb920101ad0 0x7fb920101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 --2- 172.21.15.152:0/3663001473 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb920107b70 0x7fb920107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 -- 172.21.15.152:0/3663001473 >> 172.21.15.152:0/3663001473 conn(0x7fb9200fd7d0 msgr2=0x7fb9200ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 -- 172.21.15.152:0/3663001473 shutdown_connections 2024-09-11T22:08:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 -- 172.21.15.152:0/3663001473 wait complete. 2024-09-11T22:08:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 Processor -- start 2024-09-11T22:08:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 -- start start 2024-09-11T22:08:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb920101ad0 0x7fb920198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.137+0000 7fb926723640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb920102470 0x7fb920198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb926723640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb920107b70 0x7fb92019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb926723640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb920111f20 con 0x7fb920101ad0 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb926723640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb920111da0 con 0x7fb920102470 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb926723640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201120a0 con 0x7fb920107b70 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb920101ad0 0x7fb920198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb920101ad0 0x7fb920198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60756/0 (socket says 172.21.15.152:60756) 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91ffff640 1 -- 172.21.15.152:0/1349847662 learned_addr learned my addr 172.21.15.152:0/1349847662 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb917fff640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb920102470 0x7fb920198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb924cc0640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb920107b70 0x7fb92019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91ffff640 1 -- 172.21.15.152:0/1349847662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb920107b70 msgr2=0x7fb92019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91ffff640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb920107b70 0x7fb92019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91ffff640 1 -- 172.21.15.152:0/1349847662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb920102470 msgr2=0x7fb920198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91ffff640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb920102470 0x7fb920198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91ffff640 1 -- 172.21.15.152:0/1349847662 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92019d320 con 0x7fb920101ad0 2024-09-11T22:08:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91ffff640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb920101ad0 0x7fb920198330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb91000d950 tx=0x7fb91000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91dffb640 1 -- 172.21.15.152:0/1349847662 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910017070 con 0x7fb920101ad0 2024-09-11T22:08:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91dffb640 1 -- 172.21.15.152:0/1349847662 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb910009c30 con 0x7fb920101ad0 2024-09-11T22:08:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb926723640 1 -- 172.21.15.152:0/1349847662 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92019d610 con 0x7fb920101ad0 2024-09-11T22:08:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb91dffb640 1 -- 172.21.15.152:0/1349847662 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91000f6b0 con 0x7fb920101ad0 2024-09-11T22:08:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.138+0000 7fb926723640 1 -- 172.21.15.152:0/1349847662 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9201a4ea0 con 0x7fb920101ad0 2024-09-11T22:08:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.141+0000 7fb91dffb640 1 -- 172.21.15.152:0/1349847662 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb9100109d0 con 0x7fb920101ad0 2024-09-11T22:08:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.141+0000 7fb9294bc740 1 Processor -- start 2024-09-11T22:08:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb9294bc740 1 -- start start 2024-09-11T22:08:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bccaf0 0x564a38bcced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bd7cb0 0x564a38bda0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb9294bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564a38b312f0 con 0x564a38bcd410 2024-09-11T22:08:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb9294bc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564a38ad9270 con 0x564a38bd7cb0 2024-09-11T22:08:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb9294bc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564a38b2d2b0 con 0x564a38bccaf0 2024-09-11T22:08:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb91ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb91ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60768/0 (socket says 172.21.15.152:60768) 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb91ffff640 1 -- 172.21.15.152:0/2005674824 learned_addr learned my addr 172.21.15.152:0/2005674824 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb924cc0640 1 --2- 172.21.15.152:0/2005674824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bccaf0 0x564a38bcced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb917fff640 1 --2- 172.21.15.152:0/2005674824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bd7cb0 0x564a38bda0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb91ffff640 1 -- 172.21.15.152:0/2005674824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bccaf0 msgr2=0x564a38bcced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb91ffff640 1 --2- 172.21.15.152:0/2005674824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bccaf0 0x564a38bcced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb91ffff640 1 -- 172.21.15.152:0/2005674824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bd7cb0 msgr2=0x564a38bda0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb91ffff640 1 --2- 172.21.15.152:0/2005674824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bd7cb0 0x564a38bda0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb91ffff640 1 -- 172.21.15.152:0/2005674824 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a38ad8340 con 0x564a38bcd410 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.142+0000 7fb924cc0640 1 --2- 172.21.15.152:0/2005674824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bccaf0 0x564a38bcced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.143+0000 7fb91dffb640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb90c0a2da0 0x7fb90c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.143+0000 7fb91ffff640 1 --2- 172.21.15.152:0/2005674824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd7770 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb9100cc600 tx=0x7fb9100d76f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3404a4836adce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.143+0000 7fb924cc0640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb90c0a2da0 0x7fb90c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.143+0000 7fb91dffb640 1 -- 172.21.15.152:0/1349847662 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb9100cef70 con 0x7fb920101ad0 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.143+0000 7fb9167fc640 1 -- 172.21.15.152:0/2005674824 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9100977b0 con 0x564a38bcd410 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.143+0000 7fb9167fc640 1 -- 172.21.15.152:0/2005674824 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb910009de0 con 0x564a38bcd410 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.143+0000 7fb9167fc640 1 -- 172.21.15.152:0/2005674824 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91009ae70 con 0x564a38bcd410 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb9294bc740 1 -- 172.21.15.152:0/2005674824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 msgr2=0x564a38bd7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb924cc0640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb90c0a2da0 0x7fb90c0a5260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb918004ab0 tx=0x7fb918004a40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb9294bc740 1 --2- 172.21.15.152:0/2005674824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd7770 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb9100cc600 tx=0x7fb9100d76f0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb9294bc740 1 -- 172.21.15.152:0/2005674824 shutdown_connections 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb9294bc740 1 --2- 172.21.15.152:0/2005674824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bd7cb0 0x564a38bda0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb9294bc740 1 --2- 172.21.15.152:0/2005674824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd7770 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb9294bc740 1 --2- 172.21.15.152:0/2005674824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bccaf0 0x564a38bcced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb9294bc740 1 -- 172.21.15.152:0/2005674824 >> 172.21.15.152:0/2005674824 conn(0x564a38bc9060 msgr2=0x564a38bc9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb9294bc740 1 -- 172.21.15.152:0/2005674824 shutdown_connections 2024-09-11T22:08:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb9294bc740 1 -- 172.21.15.152:0/2005674824 wait complete. 2024-09-11T22:08:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb9294bc740 1 -- start start 2024-09-11T22:08:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.144+0000 7fb9294bc740 1 Processor -- start 2024-09-11T22:08:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bccaf0 0x564a38bd4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bd7cb0 0x564a38bd55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb9294bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564a38bda880 con 0x564a38bcd410 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb9294bc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564a38aba290 con 0x564a38bd7cb0 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb9294bc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564a38bdaa00 con 0x564a38bccaf0 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb9294bc740 10 client.0 _ll_register_callbacks cb 0x564a38aeb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb917fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb917fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60784/0 (socket says 172.21.15.152:60784) 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb917fff640 1 -- 172.21.15.152:0/730510805 learned_addr learned my addr 172.21.15.152:0/730510805 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb91ffff640 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bccaf0 0x564a38bd4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb924cc0640 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bd7cb0 0x564a38bd55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb917fff640 1 -- 172.21.15.152:0/730510805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bccaf0 msgr2=0x564a38bd4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb917fff640 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bccaf0 0x564a38bd4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb917fff640 1 -- 172.21.15.152:0/730510805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bd7cb0 msgr2=0x564a38bd55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb917fff640 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bd7cb0 0x564a38bd55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb917fff640 1 -- 172.21.15.152:0/730510805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a38844210 con 0x564a38bcd410 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb917fff640 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd5080 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb90800bb00 tx=0x7fb9080044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dfb91f1c681bfc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb8ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/730510805 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908003e20 con 0x564a38bcd410 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/730510805 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb908011440 con 0x564a38bcd410 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.145+0000 7fb9294bc740 1 -- 172.21.15.152:0/730510805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb910009de0 con 0x564a38bcd410 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/730510805 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb908011660 con 0x564a38bcd410 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb9294bc740 10 client.16389 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb9294bc740 1 -- 172.21.15.152:0/730510805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564a38910620 con 0x564a38bcd410 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/730510805 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb910009de0 con 0x564a38bcd410 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/730510805 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb9080239c0 con 0x564a38bcd410 2024-09-11T22:08:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb9294bc740 10 client.16389 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb9294bc740 10 client.16389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb9294bc740 20 client.16389 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb9294bc740 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a38be7c80 0x564a38bea070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb9294bc740 4 client.16389 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb9294bc740 1 -- 172.21.15.152:0/730510805 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a38b3ea20 con 0x564a38be7c80 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.146+0000 7fb91ffff640 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a38be7c80 0x564a38bea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb8ff7fe640 10 client.16389 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb91ffff640 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a38be7c80 0x564a38bea070 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfd809e2a18528a8 server_cookie=d5e6f726853f9087 in_seq=0 out_seq=0 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/730510805 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a38b3ea20 con 0x564a38be7c80 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb8ff7fe640 10 client.16389 handle_command_reply: tid=0 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb9294bc740 1 client.16389 shutdown 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb9294bc740 1 -- 172.21.15.152:0/730510805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 msgr2=0x564a38bd5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:30.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb9294bc740 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd5080 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb90800bb00 tx=0x7fb9080044c0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb9294bc740 1 -- 172.21.15.152:0/730510805 shutdown_connections 2024-09-11T22:08:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb9294bc740 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a38be7c80 0x564a38bea070 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb9294bc740 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bd7cb0 0x564a38bd55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb9294bc740 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38bd5080 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb9294bc740 1 --2- 172.21.15.152:0/730510805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bccaf0 0x564a38bd4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.147+0000 7fb8ff7fe640 0 client.16389 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.148+0000 7fb9294bc740 1 -- 172.21.15.152:0/730510805 >> 172.21.15.152:0/730510805 conn(0x564a38bc9060 msgr2=0x564a38bced70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.148+0000 7fb9294bc740 1 -- 172.21.15.152:0/730510805 shutdown_connections 2024-09-11T22:08:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.148+0000 7fb9294bc740 1 -- 172.21.15.152:0/730510805 wait complete. 2024-09-11T22:08:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.148+0000 7fb9294bc740 20 client.16389 trim_cache size 0 max 16384 2024-09-11T22:08:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb9294bc740 1 Processor -- start 2024-09-11T22:08:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb9294bc740 1 -- start start 2024-09-11T22:08:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bccaf0 0x564a38bd53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bcd410 0x564a38bef960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bd7cb0 0x564a38befea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb9294bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201b0210 con 0x564a38bd7cb0 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb9294bc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201adae0 con 0x564a38bccaf0 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb9294bc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201ab930 con 0x564a38bcd410 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb924cc0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bd7cb0 0x564a38befea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb924cc0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bd7cb0 0x564a38befea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60796/0 (socket says 172.21.15.152:60796) 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb924cc0640 1 -- 172.21.15.152:0/3961888853 learned_addr learned my addr 172.21.15.152:0/3961888853 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb91ffff640 1 --2- 172.21.15.152:0/3961888853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bccaf0 0x564a38bd53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb917fff640 1 --2- 172.21.15.152:0/3961888853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bcd410 0x564a38bef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb924cc0640 1 -- 172.21.15.152:0/3961888853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bcd410 msgr2=0x564a38bef960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb924cc0640 1 --2- 172.21.15.152:0/3961888853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bcd410 0x564a38bef960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb924cc0640 1 -- 172.21.15.152:0/3961888853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bccaf0 msgr2=0x564a38bd53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb924cc0640 1 --2- 172.21.15.152:0/3961888853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bccaf0 0x564a38bd53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb924cc0640 1 -- 172.21.15.152:0/3961888853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a38bcd240 con 0x564a38bd7cb0 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.162+0000 7fb917fff640 1 --2- 172.21.15.152:0/3961888853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bcd410 0x564a38bef960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb924cc0640 1 --2- 172.21.15.152:0/3961888853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bd7cb0 0x564a38befea0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb918035000 tx=0x7fb918040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528908cdfb1f50ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb915ffb640 1 -- 172.21.15.152:0/3961888853 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918003bf0 con 0x564a38bd7cb0 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb915ffb640 1 -- 172.21.15.152:0/3961888853 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb918056070 con 0x564a38bd7cb0 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb915ffb640 1 -- 172.21.15.152:0/3961888853 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918030970 con 0x564a38bd7cb0 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb9294bc740 1 -- 172.21.15.152:0/3961888853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bd7cb0 msgr2=0x564a38befea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb9294bc740 1 --2- 172.21.15.152:0/3961888853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bd7cb0 0x564a38befea0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb918035000 tx=0x7fb918040000 comp rx=0 tx=0).stop 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb9294bc740 1 -- 172.21.15.152:0/3961888853 shutdown_connections 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb9294bc740 1 --2- 172.21.15.152:0/3961888853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bd7cb0 0x564a38befea0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb9294bc740 1 --2- 172.21.15.152:0/3961888853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bcd410 0x564a38bef960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb9294bc740 1 --2- 172.21.15.152:0/3961888853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bccaf0 0x564a38bd53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb9294bc740 1 -- 172.21.15.152:0/3961888853 >> 172.21.15.152:0/3961888853 conn(0x564a38bc9060 msgr2=0x564a38bd6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb9294bc740 1 -- 172.21.15.152:0/3961888853 shutdown_connections 2024-09-11T22:08:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.163+0000 7fb9294bc740 1 -- 172.21.15.152:0/3961888853 wait complete. 2024-09-11T22:08:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb9294bc740 1 -- start start 2024-09-11T22:08:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb9294bc740 1 Processor -- start 2024-09-11T22:08:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bccaf0 0x564a38be0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38be0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb9294bc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bd7cb0 0x564a38bd16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb9294bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201abfa0 con 0x564a38bcd410 2024-09-11T22:08:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb9294bc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201ad410 con 0x564a38bccaf0 2024-09-11T22:08:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb9294bc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201ac670 con 0x564a38bd7cb0 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb9294bc740 10 client.0 _ll_register_callbacks cb 0x7fb908004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb917fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38be0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb917fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38be0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60802/0 (socket says 172.21.15.152:60802) 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb917fff640 1 -- 172.21.15.152:0/2538949477 learned_addr learned my addr 172.21.15.152:0/2538949477 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.164+0000 7fb91ffff640 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bccaf0 0x564a38be0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb924cc0640 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bd7cb0 0x564a38bd16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb917fff640 1 -- 172.21.15.152:0/2538949477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bd7cb0 msgr2=0x564a38bd16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb917fff640 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bd7cb0 0x564a38bd16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb917fff640 1 -- 172.21.15.152:0/2538949477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bccaf0 msgr2=0x564a38be0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb917fff640 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bccaf0 0x564a38be0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb917fff640 1 -- 172.21.15.152:0/2538949477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a38bd1ef0 con 0x564a38bcd410 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb924cc0640 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bd7cb0 0x564a38bd16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb917fff640 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38be0580 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x564a38bd6180 tx=0x7fb908004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bef2512d31ac4fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb8ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/2538949477 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908030060 con 0x564a38bcd410 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/2538949477 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb90801b420 con 0x564a38bcd410 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb9294bc740 1 -- 172.21.15.152:0/2538949477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb918056070 con 0x564a38bcd410 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/2538949477 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb908011800 con 0x564a38bcd410 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb9294bc740 10 client.16395 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb9294bc740 1 -- 172.21.15.152:0/2538949477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564a38c52590 con 0x564a38bcd410 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/2538949477 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb918056070 con 0x564a38bcd410 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.165+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/2538949477 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb908023430 con 0x564a38bcd410 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.166+0000 7fb9294bc740 10 client.16395 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.166+0000 7fb9294bc740 10 client.16395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.166+0000 7fb9294bc740 20 client.16395 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.166+0000 7fb9294bc740 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a38c52d10 0x564a38c55130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.166+0000 7fb9294bc740 4 client.16395 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:08:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.166+0000 7fb9294bc740 1 -- 172.21.15.152:0/2538949477 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a38b38d70 con 0x564a38c52d10 2024-09-11T22:08:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.166+0000 7fb91ffff640 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a38c52d10 0x564a38c55130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.166+0000 7fb91ffff640 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a38c52d10 0x564a38c55130 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bee1868f150f24f8 server_cookie=a091684ad268f6ed in_seq=0 out_seq=0 2024-09-11T22:08:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.166+0000 7fb8ff7fe640 10 client.16395 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb8ff7fe640 1 -- 172.21.15.152:0/2538949477 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a38b38d70 con 0x564a38c52d10 2024-09-11T22:08:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb8ff7fe640 10 client.16395 handle_command_reply: tid=0 2024-09-11T22:08:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 1 client.16395 shutdown 2024-09-11T22:08:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 1 -- 172.21.15.152:0/2538949477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 msgr2=0x564a38be0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38be0580 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x564a38bd6180 tx=0x7fb908004360 comp rx=0 tx=0).stop 2024-09-11T22:08:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 1 -- 172.21.15.152:0/2538949477 shutdown_connections 2024-09-11T22:08:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a38c52d10 0x564a38c55130 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a38bd7cb0 0x564a38bd16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb8ff7fe640 0 client.16395 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a38bcd410 0x564a38be0580 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 1 --2- 172.21.15.152:0/2538949477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a38bccaf0 0x564a38be0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 1 -- 172.21.15.152:0/2538949477 >> 172.21.15.152:0/2538949477 conn(0x564a38bc9060 msgr2=0x564a38bc79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 1 -- 172.21.15.152:0/2538949477 shutdown_connections 2024-09-11T22:08:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 1 -- 172.21.15.152:0/2538949477 wait complete. 2024-09-11T22:08:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.174+0000 7fb9294bc740 20 client.16395 trim_cache size 0 max 16384 2024-09-11T22:08:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:08:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:08:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:08:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:08:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 -- 172.21.15.152:0/1349847662 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb90c0a2da0 msgr2=0x7fb90c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb90c0a2da0 0x7fb90c0a5260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb918004ab0 tx=0x7fb918004a40 comp rx=0 tx=0).stop 2024-09-11T22:08:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 -- 172.21.15.152:0/1349847662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb920101ad0 msgr2=0x7fb920198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb920101ad0 0x7fb920198330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb91000d950 tx=0x7fb91000de10 comp rx=0 tx=0).stop 2024-09-11T22:08:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 -- 172.21.15.152:0/1349847662 shutdown_connections 2024-09-11T22:08:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb90c0a2da0 0x7fb90c0a5260 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb920107b70 0x7fb92019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb920102470 0x7fb920198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 --2- 172.21.15.152:0/1349847662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb920101ad0 0x7fb920198330 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 -- 172.21.15.152:0/1349847662 >> 172.21.15.152:0/1349847662 conn(0x7fb9200fd7d0 msgr2=0x7fb9200fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 -- 172.21.15.152:0/1349847662 shutdown_connections 2024-09-11T22:08:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:30.175+0000 7fb926723640 1 -- 172.21.15.152:0/1349847662 wait complete. 2024-09-11T22:08:30.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:30 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:08:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:30 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:08:30.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:30 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:08:31.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:31 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:08:31.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:31 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:08:31.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:31 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:08:31.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:31 smithi179 ceph-mon[35603]: pgmap v130: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-11T22:08:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:31 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:08:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:31 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:08:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:31 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:08:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:31 smithi193 ceph-mon[35545]: pgmap v130: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-11T22:08:31.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:31 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:08:31.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:31 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:08:31.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:31 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:08:31.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:31 smithi152 ceph-mon[31188]: pgmap v130: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-11T22:08:33.579 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:08:33.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:33 smithi179 ceph-mon[35603]: pgmap v131: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 721 KiB/s wr, 14 op/s 2024-09-11T22:08:33.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:33 smithi193 ceph-mon[35545]: pgmap v131: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 721 KiB/s wr, 14 op/s 2024-09-11T22:08:33.841 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:33.962 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:33 smithi152 ceph-mon[31188]: pgmap v131: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 721 KiB/s wr, 14 op/s 2024-09-11T22:08:34.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.326+0000 7f3ddab75640 1 -- 172.21.15.152:0/86812648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd4102570 msgr2=0x7f3dd41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:34.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.326+0000 7f3ddab75640 1 --2- 172.21.15.152:0/86812648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd4102570 0x7f3dd41029b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009900 tx=0x7f3dc802a480 comp rx=0 tx=0).stop 2024-09-11T22:08:34.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.326+0000 7f3ddab75640 1 -- 172.21.15.152:0/86812648 shutdown_connections 2024-09-11T22:08:34.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.326+0000 7f3ddab75640 1 --2- 172.21.15.152:0/86812648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd4102ef0 0x7f3dd410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:34.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.326+0000 7f3ddab75640 1 --2- 172.21.15.152:0/86812648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd4102570 0x7f3dd41029b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:34.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.326+0000 7f3ddab75640 1 --2- 172.21.15.152:0/86812648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd4100e20 0x7f3dd4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:34.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.326+0000 7f3ddab75640 1 -- 172.21.15.152:0/86812648 >> 172.21.15.152:0/86812648 conn(0x7f3dd40fc7d0 msgr2=0x7f3dd40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:34.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.326+0000 7f3ddab75640 1 -- 172.21.15.152:0/86812648 shutdown_connections 2024-09-11T22:08:34.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.326+0000 7f3ddab75640 1 -- 172.21.15.152:0/86812648 wait complete. 2024-09-11T22:08:34.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.326+0000 7f3ddab75640 1 Processor -- start 2024-09-11T22:08:34.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.326+0000 7f3ddab75640 1 -- start start 2024-09-11T22:08:34.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3ddab75640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd4100e20 0x7f3dd4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:34.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3ddab75640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd4102570 0x7f3dd4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:34.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3ddab75640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd4102ef0 0x7f3dd41a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:34.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3ddab75640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4110f80 con 0x7f3dd4100e20 2024-09-11T22:08:34.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3ddab75640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4110e00 con 0x7f3dd4102ef0 2024-09-11T22:08:34.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3ddab75640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4111100 con 0x7f3dd4102570 2024-09-11T22:08:34.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd8911640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd4100e20 0x7f3dd4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:34.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd8911640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd4100e20 0x7f3dd4199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46562/0 (socket says 172.21.15.152:46562) 2024-09-11T22:08:34.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd8911640 1 -- 172.21.15.152:0/1183232281 learned_addr learned my addr 172.21.15.152:0/1183232281 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:34.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd3fff640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd4102570 0x7f3dd4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:34.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd9112640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd4102ef0 0x7f3dd41a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:34.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd8911640 1 -- 172.21.15.152:0/1183232281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd4102570 msgr2=0x7f3dd4199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:34.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd8911640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd4102570 0x7f3dd4199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:34.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd8911640 1 -- 172.21.15.152:0/1183232281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd4102ef0 msgr2=0x7f3dd41a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:34.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd8911640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd4102ef0 0x7f3dd41a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:34.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd8911640 1 -- 172.21.15.152:0/1183232281 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd41a4910 con 0x7f3dd4100e20 2024-09-11T22:08:34.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd9112640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd4102ef0 0x7f3dd41a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:34.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd8911640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd4100e20 0x7f3dd4199350 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400d770 tx=0x7f3dc400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:34.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd1ffb640 1 -- 172.21.15.152:0/1183232281 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4017070 con 0x7f3dd4100e20 2024-09-11T22:08:34.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd1ffb640 1 -- 172.21.15.152:0/1183232281 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc4005500 con 0x7f3dd4100e20 2024-09-11T22:08:34.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3ddab75640 1 -- 172.21.15.152:0/1183232281 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd41a4ae0 con 0x7f3dd4100e20 2024-09-11T22:08:34.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.327+0000 7f3dd1ffb640 1 -- 172.21.15.152:0/1183232281 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4004e00 con 0x7f3dd4100e20 2024-09-11T22:08:34.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.328+0000 7f3ddab75640 1 -- 172.21.15.152:0/1183232281 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd41a4fa0 con 0x7f3dd4100e20 2024-09-11T22:08:34.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.329+0000 7f3ddab75640 1 -- 172.21.15.152:0/1183232281 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd4101200 con 0x7f3dd4100e20 2024-09-11T22:08:34.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.329+0000 7f3dd1ffb640 1 -- 172.21.15.152:0/1183232281 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3dc4004fa0 con 0x7f3dd4100e20 2024-09-11T22:08:34.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.330+0000 7f3dd1ffb640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3dbc0a2cf0 0x7f3dbc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:34.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.330+0000 7f3dd3fff640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3dbc0a2cf0 0x7f3dbc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:34.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.330+0000 7f3dd1ffb640 1 -- 172.21.15.152:0/1183232281 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3dc40cef00 con 0x7f3dd4100e20 2024-09-11T22:08:34.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.331+0000 7f3dd3fff640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3dbc0a2cf0 0x7f3dbc0a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009230 tx=0x7f3dc80058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:34.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.334+0000 7f3dd1ffb640 1 -- 172.21.15.152:0/1183232281 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3dc409baf0 con 0x7f3dd4100e20 2024-09-11T22:08:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.534+0000 7f3ddab75640 1 -- 172.21.15.152:0/1183232281 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dd4109090 con 0x7f3dd4100e20 2024-09-11T22:08:34.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.535+0000 7f3dd1ffb640 1 -- 172.21.15.152:0/1183232281 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f3dc409b3f0 con 0x7f3dd4100e20 2024-09-11T22:08:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:08:34.536 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:08:34.536 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:08:34.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 -- 172.21.15.152:0/1183232281 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3dbc0a2cf0 msgr2=0x7f3dbc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3dbc0a2cf0 0x7f3dbc0a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009230 tx=0x7f3dc80058d0 comp rx=0 tx=0).stop 2024-09-11T22:08:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 -- 172.21.15.152:0/1183232281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd4100e20 msgr2=0x7f3dd4199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd4100e20 0x7f3dd4199350 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400d770 tx=0x7f3dc400dc30 comp rx=0 tx=0).stop 2024-09-11T22:08:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 -- 172.21.15.152:0/1183232281 shutdown_connections 2024-09-11T22:08:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3dbc0a2cf0 0x7f3dbc0a51b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd4102ef0 0x7f3dd41a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd4102570 0x7f3dd4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 --2- 172.21.15.152:0/1183232281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd4100e20 0x7f3dd4199350 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 -- 172.21.15.152:0/1183232281 >> 172.21.15.152:0/1183232281 conn(0x7f3dd40fc7d0 msgr2=0x7f3dd4105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 -- 172.21.15.152:0/1183232281 shutdown_connections 2024-09-11T22:08:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:34.538+0000 7f3ddab75640 1 -- 172.21.15.152:0/1183232281 wait complete. 2024-09-11T22:08:34.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:08:34.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:34 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1183232281' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:35.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:34 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1183232281' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:35.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:34 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1183232281' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:35.266 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id cf3bb05d --release --await' 2024-09-11T22:08:35.266 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id cf3bb05d --release --await 2024-09-11T22:08:35.514 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:35.974 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:35 smithi152 ceph-mon[31188]: pgmap v132: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 714 KiB/s wr, 11 op/s 2024-09-11T22:08:36.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:35 smithi179 ceph-mon[35603]: pgmap v132: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 714 KiB/s wr, 11 op/s 2024-09-11T22:08:36.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.061+0000 7f9381722640 1 -- 172.21.15.152:0/3349291640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f937c101420 msgr2=0x7f937c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:36.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.061+0000 7f9381722640 1 --2- 172.21.15.152:0/3349291640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f937c101420 0x7f937c10d950 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9374009cd0 tx=0x7f937402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.061+0000 7f9381722640 1 -- 172.21.15.152:0/3349291640 shutdown_connections 2024-09-11T22:08:36.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.061+0000 7f9381722640 1 --2- 172.21.15.152:0/3349291640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f937c101420 0x7f937c10d950 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.061+0000 7f9381722640 1 --2- 172.21.15.152:0/3349291640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f937c100a80 0x7f937c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.061+0000 7f9381722640 1 --2- 172.21.15.152:0/3349291640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937c106a80 0x7f937c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.061+0000 7f9381722640 1 -- 172.21.15.152:0/3349291640 >> 172.21.15.152:0/3349291640 conn(0x7f937c0fc7a0 msgr2=0x7f937c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:36.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.061+0000 7f9381722640 1 -- 172.21.15.152:0/3349291640 shutdown_connections 2024-09-11T22:08:36.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.061+0000 7f9381722640 1 -- 172.21.15.152:0/3349291640 wait complete. 2024-09-11T22:08:36.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.062+0000 7f9381722640 1 Processor -- start 2024-09-11T22:08:36.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.062+0000 7f9381722640 1 -- start start 2024-09-11T22:08:36.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.062+0000 7f9381722640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937c100a80 0x7f937c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.062+0000 7f9381722640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f937c101420 0x7f937c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.062+0000 7f9381722640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f937c106a80 0x7f937c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.062+0000 7f9381722640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f937c110e80 con 0x7f937c106a80 2024-09-11T22:08:36.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.062+0000 7f9381722640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f937c110d00 con 0x7f937c100a80 2024-09-11T22:08:36.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.062+0000 7f9381722640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f937c111000 con 0x7f937c101420 2024-09-11T22:08:36.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f937b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f937c106a80 0x7f937c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f937b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f937c106a80 0x7f937c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46570/0 (socket says 172.21.15.152:46570) 2024-09-11T22:08:36.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f937b7fe640 1 -- 172.21.15.152:0/1026699017 learned_addr learned my addr 172.21.15.152:0/1026699017 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:36.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f93727fc640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f937c101420 0x7f937c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f937affd640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937c100a80 0x7f937c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f937b7fe640 1 -- 172.21.15.152:0/1026699017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f937c101420 msgr2=0x7f937c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:36.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f937b7fe640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f937c101420 0x7f937c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f937b7fe640 1 -- 172.21.15.152:0/1026699017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937c100a80 msgr2=0x7f937c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:36.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f937b7fe640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937c100a80 0x7f937c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f937b7fe640 1 -- 172.21.15.152:0/1026699017 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c19d380 con 0x7f937c106a80 2024-09-11T22:08:36.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f937b7fe640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f937c106a80 0x7f937c19cca0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9374005cc0 tx=0x7f9374003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:36.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f9378ff9640 1 -- 172.21.15.152:0/1026699017 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9374004040 con 0x7f937c106a80 2024-09-11T22:08:36.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f9378ff9640 1 -- 172.21.15.152:0/1026699017 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93740046c0 con 0x7f937c106a80 2024-09-11T22:08:36.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f9381722640 1 -- 172.21.15.152:0/1026699017 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f937c19d610 con 0x7f937c106a80 2024-09-11T22:08:36.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f9378ff9640 1 -- 172.21.15.152:0/1026699017 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9374046480 con 0x7f937c106a80 2024-09-11T22:08:36.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.063+0000 7f9381722640 1 -- 172.21.15.152:0/1026699017 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f937c1a4f50 con 0x7f937c106a80 2024-09-11T22:08:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.066+0000 7f9378ff9640 1 -- 172.21.15.152:0/1026699017 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f93740305a0 con 0x7f937c106a80 2024-09-11T22:08:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.066+0000 7f9383afb740 1 Processor -- start 2024-09-11T22:08:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.066+0000 7f9383afb740 1 -- start start 2024-09-11T22:08:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f9383afb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 0x55e88cefe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f9383afb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe980 0x55e88cf08d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f9383afb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cf09240 0x55e88cf0b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f9383afb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e88ce63620 con 0x55e88cf09240 2024-09-11T22:08:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f9383afb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e88ce0ae50 con 0x55e88cefe060 2024-09-11T22:08:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f9383afb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e88ce5f5e0 con 0x55e88cefe980 2024-09-11T22:08:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f9378ff9640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93680a2d70 0x7f93680a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f93727fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cf09240 0x55e88cf0b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f93727fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 0x55e88cefe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f93727fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 0x55e88cefe440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60904/0 (socket says 172.21.15.152:60904) 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f93727fc640 1 -- 172.21.15.152:0/8339958 learned_addr learned my addr 172.21.15.152:0/8339958 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f937affd640 1 --2- 172.21.15.152:0/8339958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe980 0x55e88cf08d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f937b7fe640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93680a2d70 0x7f93680a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f9378ff9640 1 -- 172.21.15.152:0/1026699017 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f937402e030 con 0x7f937c106a80 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f93727fc640 1 -- 172.21.15.152:0/8339958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe980 msgr2=0x55e88cf08d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f93727fc640 1 --2- 172.21.15.152:0/8339958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe980 0x55e88cf08d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f93727fc640 1 -- 172.21.15.152:0/8339958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cf09240 msgr2=0x55e88cf0b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f93727fc640 1 --2- 172.21.15.152:0/8339958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cf09240 0x55e88cf0b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f93727fc640 1 -- 172.21.15.152:0/8339958 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e88cdfbd40 con 0x55e88cefe060 2024-09-11T22:08:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f93727fc640 1 --2- 172.21.15.152:0/8339958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 0x55e88cefe440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55e88cefb970 tx=0x7f936400b410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19f1a83828efe619 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.067+0000 7f937b7fe640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93680a2d70 0x7f93680a5230 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f93740ee780 tx=0x7f9374087c90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.068+0000 7f93717fa640 1 -- 172.21.15.152:0/8339958 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364004020 con 0x55e88cefe060 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.068+0000 7f93717fa640 1 -- 172.21.15.152:0/8339958 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f936400fc10 con 0x55e88cefe060 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.068+0000 7f93717fa640 1 -- 172.21.15.152:0/8339958 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93640038c0 con 0x55e88cefe060 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.068+0000 7f9383afb740 1 -- 172.21.15.152:0/8339958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 msgr2=0x55e88cefe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.068+0000 7f9383afb740 1 --2- 172.21.15.152:0/8339958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 0x55e88cefe440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55e88cefb970 tx=0x7f936400b410 comp rx=0 tx=0).stop 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.068+0000 7f9383afb740 1 -- 172.21.15.152:0/8339958 shutdown_connections 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.068+0000 7f9383afb740 1 --2- 172.21.15.152:0/8339958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cf09240 0x55e88cf0b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.068+0000 7f9383afb740 1 --2- 172.21.15.152:0/8339958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe980 0x55e88cf08d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.068+0000 7f9383afb740 1 --2- 172.21.15.152:0/8339958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 0x55e88cefe440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.068+0000 7f9383afb740 1 -- 172.21.15.152:0/8339958 >> 172.21.15.152:0/8339958 conn(0x55e88cefa5f0 msgr2=0x55e88cefa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.068+0000 7f9383afb740 1 -- 172.21.15.152:0/8339958 shutdown_connections 2024-09-11T22:08:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f9383afb740 1 -- 172.21.15.152:0/8339958 wait complete. 2024-09-11T22:08:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f9383afb740 1 -- start start 2024-09-11T22:08:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f9383afb740 1 Processor -- start 2024-09-11T22:08:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f9383afb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe060 0x55e88cf06170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f9383afb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe980 0x55e88cf066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f9383afb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cf09240 0x55e88cf06bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f9383afb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e88cf0be10 con 0x55e88cf09240 2024-09-11T22:08:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f9383afb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e88cdebf10 con 0x55e88cefe980 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f9383afb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e88cf0bf90 con 0x55e88cefe060 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f9383afb740 10 client.0 _ll_register_callbacks cb 0x55e88ce0fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f93727fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cf09240 0x55e88cf06bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f93727fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cf09240 0x55e88cf06bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46578/0 (socket says 172.21.15.152:46578) 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f93727fc640 1 -- 172.21.15.152:0/253512843 learned_addr learned my addr 172.21.15.152:0/253512843 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f937affd640 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe980 0x55e88cf066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.069+0000 7f93727fc640 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe060 0x55e88cf06170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f937affd640 1 -- 172.21.15.152:0/253512843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe060 msgr2=0x55e88cf06170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f937affd640 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe060 0x55e88cf06170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f937affd640 1 -- 172.21.15.152:0/253512843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cf09240 msgr2=0x55e88cf06bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f937affd640 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cf09240 0x55e88cf06bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f937affd640 1 -- 172.21.15.152:0/253512843 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e88cb72580 con 0x55e88cefe980 2024-09-11T22:08:36.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f93727fc640 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe060 0x55e88cf06170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f937affd640 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe980 0x55e88cf066b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f936c00b9c0 tx=0x7f936c00be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c1c6fde0d886cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f93627fc640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f93627fc640 1 -- 172.21.15.152:0/253512843 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c003e20 con 0x55e88cefe980 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f93627fc640 1 -- 172.21.15.152:0/253512843 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f936c005020 con 0x55e88cefe980 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f9383afb740 1 -- 172.21.15.152:0/253512843 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f936400fc10 con 0x55e88cefe980 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f93627fc640 1 -- 172.21.15.152:0/253512843 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f936c005220 con 0x55e88cefe980 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f9383afb740 10 client.25886 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.070+0000 7f9383afb740 1 -- 172.21.15.152:0/253512843 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e88cc3c960 con 0x55e88cefe980 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.071+0000 7f93627fc640 1 -- 172.21.15.152:0/253512843 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f936400fc10 con 0x55e88cefe980 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.071+0000 7f93627fc640 1 -- 172.21.15.152:0/253512843 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f936c022070 con 0x55e88cefe980 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.071+0000 7f9383afb740 10 client.25886 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.071+0000 7f9383afb740 10 client.25886 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.071+0000 7f9383afb740 20 client.25886 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:36.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.071+0000 7f9383afb740 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e88cf18f50 0x55e88cf1b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.071+0000 7f9383afb740 4 client.25886 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:36.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.071+0000 7f9383afb740 1 -- 172.21.15.152:0/253512843 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e88ce70b90 con 0x55e88cf18f50 2024-09-11T22:08:36.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.071+0000 7f93727fc640 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e88cf18f50 0x55e88cf1b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.078 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:35 smithi193 ceph-mon[35545]: pgmap v132: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 714 KiB/s wr, 11 op/s 2024-09-11T22:08:36.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f93727fc640 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e88cf18f50 0x55e88cf1b340 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=411036fe1ad528c2 server_cookie=6c71f7cdaac1817 in_seq=0 out_seq=0 2024-09-11T22:08:36.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f93627fc640 10 client.25886 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:36.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f93627fc640 1 -- 172.21.15.152:0/253512843 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e88ce70b90 con 0x55e88cf18f50 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f93627fc640 10 client.25886 handle_command_reply: tid=0 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f9383afb740 1 client.25886 shutdown 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f9383afb740 1 -- 172.21.15.152:0/253512843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe980 msgr2=0x55e88cf066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f9383afb740 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe980 0x55e88cf066b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f936c00b9c0 tx=0x7f936c00be80 comp rx=0 tx=0).stop 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f9383afb740 1 -- 172.21.15.152:0/253512843 shutdown_connections 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f9383afb740 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e88cf18f50 0x55e88cf1b340 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f9383afb740 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cf09240 0x55e88cf06bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f9383afb740 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe980 0x55e88cf066b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f9383afb740 1 --2- 172.21.15.152:0/253512843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe060 0x55e88cf06170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f9383afb740 1 -- 172.21.15.152:0/253512843 >> 172.21.15.152:0/253512843 conn(0x55e88cefa5f0 msgr2=0x55e88cf002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.072+0000 7f93627fc640 0 client.25886 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:36.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.073+0000 7f9383afb740 1 -- 172.21.15.152:0/253512843 shutdown_connections 2024-09-11T22:08:36.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.073+0000 7f9383afb740 1 -- 172.21.15.152:0/253512843 wait complete. 2024-09-11T22:08:36.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.073+0000 7f9383afb740 20 client.25886 trim_cache size 0 max 16384 2024-09-11T22:08:36.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.089+0000 7f9383afb740 1 Processor -- start 2024-09-11T22:08:36.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.089+0000 7f9383afb740 1 -- start start 2024-09-11T22:08:36.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f9383afb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf00ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f9383afb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe060 0x55e88cf01480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f9383afb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe980 0x55e88cef9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f9383afb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f937c1b00b0 con 0x55e88cefa5f0 2024-09-11T22:08:36.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f9383afb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f937c1ad980 con 0x55e88cefe980 2024-09-11T22:08:36.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f9383afb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f937c1ab7d0 con 0x55e88cefe060 2024-09-11T22:08:36.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f93727fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf00ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f93727fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf00ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46580/0 (socket says 172.21.15.152:46580) 2024-09-11T22:08:36.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f93727fc640 1 -- 172.21.15.152:0/2370683075 learned_addr learned my addr 172.21.15.152:0/2370683075 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:36.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f937affd640 1 --2- 172.21.15.152:0/2370683075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe060 0x55e88cf01480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f93727fc640 1 --2- 172.21.15.152:0/2370683075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe980 0x55e88cef9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f93727fc640 1 -- 172.21.15.152:0/2370683075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe060 msgr2=0x55e88cf01480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:36.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f93727fc640 1 --2- 172.21.15.152:0/2370683075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe060 0x55e88cf01480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f93727fc640 1 -- 172.21.15.152:0/2370683075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe980 msgr2=0x55e88cef9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:36.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f93727fc640 1 --2- 172.21.15.152:0/2370683075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe980 0x55e88cef9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f93727fc640 1 -- 172.21.15.152:0/2370683075 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e88cf080b0 con 0x55e88cefa5f0 2024-09-11T22:08:36.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f93727fc640 1 --2- 172.21.15.152:0/2370683075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf00ac0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9364004560 tx=0x7f936400bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbffffe857ffba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:36.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f9370ff9640 1 -- 172.21.15.152:0/2370683075 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364031070 con 0x55e88cefa5f0 2024-09-11T22:08:36.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f9370ff9640 1 -- 172.21.15.152:0/2370683075 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f936400fc10 con 0x55e88cefa5f0 2024-09-11T22:08:36.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.090+0000 7f9370ff9640 1 -- 172.21.15.152:0/2370683075 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364005560 con 0x55e88cefa5f0 2024-09-11T22:08:36.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.091+0000 7f9383afb740 1 -- 172.21.15.152:0/2370683075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 msgr2=0x55e88cf00ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.091+0000 7f9383afb740 1 --2- 172.21.15.152:0/2370683075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf00ac0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9364004560 tx=0x7f936400bbf0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.091+0000 7f9383afb740 1 -- 172.21.15.152:0/2370683075 shutdown_connections 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.091+0000 7f9383afb740 1 --2- 172.21.15.152:0/2370683075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe980 0x55e88cef9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.091+0000 7f9383afb740 1 --2- 172.21.15.152:0/2370683075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe060 0x55e88cf01480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.091+0000 7f9383afb740 1 --2- 172.21.15.152:0/2370683075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf00ac0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.091+0000 7f9383afb740 1 -- 172.21.15.152:0/2370683075 >> 172.21.15.152:0/2370683075 conn(0x55e88cf01b60 msgr2=0x55e88cef8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.091+0000 7f9383afb740 1 -- 172.21.15.152:0/2370683075 shutdown_connections 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.091+0000 7f9383afb740 1 -- 172.21.15.152:0/2370683075 wait complete. 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.091+0000 7f9383afb740 1 -- start start 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f9383afb740 1 Processor -- start 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f9383afb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf0d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f9383afb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 0x55e88cf0db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f9383afb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe980 0x55e88cf86fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f9383afb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f937c1abe40 con 0x55e88cefa5f0 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f9383afb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f937c1ad2b0 con 0x55e88cefe060 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f9383afb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f937c1ac510 con 0x55e88cefe980 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f9383afb740 10 client.0 _ll_register_callbacks cb 0x7f936c004420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f93727fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf0d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f93727fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf0d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46594/0 (socket says 172.21.15.152:46594) 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f93727fc640 1 -- 172.21.15.152:0/4119229506 learned_addr learned my addr 172.21.15.152:0/4119229506 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f937affd640 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 0x55e88cf0db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f93727fc640 1 -- 172.21.15.152:0/4119229506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe980 msgr2=0x55e88cf86fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f93727fc640 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe980 0x55e88cf86fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f93727fc640 1 -- 172.21.15.152:0/4119229506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 msgr2=0x55e88cf0db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f93727fc640 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 0x55e88cf0db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f93727fc640 1 -- 172.21.15.152:0/4119229506 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e88cefe7b0 con 0x55e88cefa5f0 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f93727fc640 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf0d5d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f936400bd50 tx=0x7f936400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59d6524aa44453e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.092+0000 7f93627fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f93627fc640 1 -- 172.21.15.152:0/4119229506 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936403b060 con 0x55e88cefa5f0 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f93627fc640 1 -- 172.21.15.152:0/4119229506 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f936400f730 con 0x55e88cefa5f0 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f9383afb740 1 -- 172.21.15.152:0/4119229506 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f936400fc10 con 0x55e88cefa5f0 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f93627fc640 1 -- 172.21.15.152:0/4119229506 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9364031070 con 0x55e88cefa5f0 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f9383afb740 10 client.16419 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f9383afb740 1 -- 172.21.15.152:0/4119229506 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e88cf88540 con 0x55e88cefa5f0 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f93627fc640 1 -- 172.21.15.152:0/4119229506 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f936400fc10 con 0x55e88cefa5f0 2024-09-11T22:08:36.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f93627fc640 1 -- 172.21.15.152:0/4119229506 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f936401f420 con 0x55e88cefa5f0 2024-09-11T22:08:36.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f9383afb740 10 client.16419 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:36.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f9383afb740 10 client.16419 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:08:36.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f9383afb740 20 client.16419 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:36.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f9383afb740 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e88cf09240 0x55e88cf8aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:36.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f9383afb740 4 client.16419 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cf3bb05d", "release": true, "await": true}] 2024-09-11T22:08:36.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f9383afb740 1 -- 172.21.15.152:0/4119229506 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cf3bb05d", "release": true, "await": true}) -- 0x55e88ce6b0a0 con 0x55e88cf09240 2024-09-11T22:08:36.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.093+0000 7f937affd640 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e88cf09240 0x55e88cf8aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:36.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.094+0000 7f93627fc640 10 client.16419 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:36.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.094+0000 7f937affd640 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e88cf09240 0x55e88cf8aa30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13c5fe70886f73f4 server_cookie=af6bbe635794b464 in_seq=0 out_seq=0 2024-09-11T22:08:36.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.150+0000 7f93627fc640 1 -- 172.21.15.152:0/4119229506 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e88ce6b0a0 con 0x55e88cf09240 2024-09-11T22:08:36.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.150+0000 7f93627fc640 10 client.16419 handle_command_reply: tid=0 2024-09-11T22:08:36.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.150+0000 7f9383afb740 1 client.16419 shutdown 2024-09-11T22:08:36.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.151+0000 7f9383afb740 1 -- 172.21.15.152:0/4119229506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 msgr2=0x55e88cf0d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:36.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.151+0000 7f9383afb740 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf0d5d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f936400bd50 tx=0x7f936400b4a0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.151+0000 7f9383afb740 1 -- 172.21.15.152:0/4119229506 shutdown_connections 2024-09-11T22:08:36.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.151+0000 7f9383afb740 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e88cf09240 0x55e88cf8aa30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.151+0000 7f9383afb740 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e88cefe980 0x55e88cf86fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.151+0000 7f9383afb740 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e88cefe060 0x55e88cf0db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.151+0000 7f9383afb740 1 --2- 172.21.15.152:0/4119229506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e88cefa5f0 0x55e88cf0d5d0 secure :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f936400bd50 tx=0x7f936400b4a0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.151+0000 7f9383afb740 1 -- 172.21.15.152:0/4119229506 >> 172.21.15.152:0/4119229506 conn(0x55e88cf01b60 msgr2=0x55e88cef9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:36.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.151+0000 7f93627fc640 0 client.16419 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:36.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.152+0000 7f9383afb740 1 -- 172.21.15.152:0/4119229506 shutdown_connections 2024-09-11T22:08:36.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.152+0000 7f9383afb740 1 -- 172.21.15.152:0/4119229506 wait complete. 2024-09-11T22:08:36.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.152+0000 7f9383afb740 20 client.16419 trim_cache size 0 max 16384 2024-09-11T22:08:36.154 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:08:36.155 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:08:36.155 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:08:36.155 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 16, 2024-09-11T22:08:36.155 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:08:36.155 INFO:teuthology.orchestra.run.smithi152.stdout: "cf3bb05d": { 2024-09-11T22:08:36.155 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 16, 2024-09-11T22:08:36.155 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:08:36.155 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:08:36.155 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:08:36.155 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:08:36.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:08:36.156 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:08:36.156 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 140.2, 2024-09-11T22:08:36.156 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:08:36.156 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:08:36.156 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:08:36.156 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:08:36.156 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:08:36.156 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:08:36.156 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:36.156 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:36.157 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:36.157 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:36.157 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:36.157 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:08:36.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.156+0000 7f9381722640 1 -- 172.21.15.152:0/1026699017 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93680a2d70 msgr2=0x7f93680a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:36.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.156+0000 7f9381722640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93680a2d70 0x7f93680a5230 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f93740ee780 tx=0x7f9374087c90 comp rx=0 tx=0).stop 2024-09-11T22:08:36.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.156+0000 7f9381722640 1 -- 172.21.15.152:0/1026699017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f937c106a80 msgr2=0x7f937c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:36.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.156+0000 7f9381722640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f937c106a80 0x7f937c19cca0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9374005cc0 tx=0x7f9374003970 comp rx=0 tx=0).stop 2024-09-11T22:08:36.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.157+0000 7f9381722640 1 -- 172.21.15.152:0/1026699017 shutdown_connections 2024-09-11T22:08:36.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.157+0000 7f9381722640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93680a2d70 0x7f93680a5230 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.157+0000 7f9381722640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f937c106a80 0x7f937c19cca0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.157+0000 7f9381722640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f937c101420 0x7f937c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.157+0000 7f9381722640 1 --2- 172.21.15.152:0/1026699017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937c100a80 0x7f937c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:36.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.157+0000 7f9381722640 1 -- 172.21.15.152:0/1026699017 >> 172.21.15.152:0/1026699017 conn(0x7f937c0fc7a0 msgr2=0x7f937c06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:36.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.161+0000 7f9381722640 1 -- 172.21.15.152:0/1026699017 shutdown_connections 2024-09-11T22:08:36.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:36.162+0000 7f9381722640 1 -- 172.21.15.152:0/1026699017 wait complete. 2024-09-11T22:08:37.118 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'cf3bb05d', total seconds elapsed: 23.7 2024-09-11T22:08:37.118 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.15 2024-09-11T22:08:37.119 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:08:37.520 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:37 smithi179 ceph-mon[35603]: pgmap v133: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 714 KiB/s wr, 11 op/s 2024-09-11T22:08:37.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:37 smithi152 ceph-mon[31188]: pgmap v133: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 714 KiB/s wr, 11 op/s 2024-09-11T22:08:37.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:37 smithi193 ceph-mon[35545]: pgmap v133: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 714 KiB/s wr, 11 op/s 2024-09-11T22:08:38.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.073+0000 7f4021015640 1 -- 172.21.15.152:0/1496552070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f401c105ec0 msgr2=0x7f401c106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:38.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.073+0000 7f4021015640 1 --2- 172.21.15.152:0/1496552070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f401c105ec0 0x7f401c106340 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4014009cd0 tx=0x7f401402a930 comp rx=0 tx=0).stop 2024-09-11T22:08:38.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.073+0000 7f4021015640 1 -- 172.21.15.152:0/1496552070 shutdown_connections 2024-09-11T22:08:38.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.073+0000 7f4021015640 1 --2- 172.21.15.152:0/1496552070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f401c105ec0 0x7f401c106340 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:38.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.073+0000 7f4021015640 1 --2- 172.21.15.152:0/1496552070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f401c1011e0 0x7f401c105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:38.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.073+0000 7f4021015640 1 --2- 172.21.15.152:0/1496552070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f401c1008c0 0x7f401c100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:38.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.073+0000 7f4021015640 1 -- 172.21.15.152:0/1496552070 >> 172.21.15.152:0/1496552070 conn(0x7f401c0fc7d0 msgr2=0x7f401c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:38.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.074+0000 7f4021015640 1 -- 172.21.15.152:0/1496552070 shutdown_connections 2024-09-11T22:08:38.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.074+0000 7f4021015640 1 -- 172.21.15.152:0/1496552070 wait complete. 2024-09-11T22:08:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.075+0000 7f4021015640 1 Processor -- start 2024-09-11T22:08:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.076+0000 7f4021015640 1 -- start start 2024-09-11T22:08:38.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.076+0000 7f4021015640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f401c1008c0 0x7f401c114df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:38.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.076+0000 7f4021015640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f401c1011e0 0x7f401c10ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:38.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.076+0000 7f4021015640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f401c105ec0 0x7f401c10f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:38.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.076+0000 7f4021015640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f401c107930 con 0x7f401c1011e0 2024-09-11T22:08:38.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.076+0000 7f4021015640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1077b0 con 0x7f401c105ec0 2024-09-11T22:08:38.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.077+0000 7f4021015640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f401c107ab0 con 0x7f401c1008c0 2024-09-11T22:08:38.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.077+0000 7f401b59e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f401c105ec0 0x7f401c10f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:38.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.077+0000 7f401b59e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f401c105ec0 0x7f401c10f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60932/0 (socket says 172.21.15.152:60932) 2024-09-11T22:08:38.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.077+0000 7f401b59e640 1 -- 172.21.15.152:0/1647502122 learned_addr learned my addr 172.21.15.152:0/1647502122 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:38.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.077+0000 7f401ad9d640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f401c1008c0 0x7f401c114df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:38.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.078+0000 7f401b59e640 1 -- 172.21.15.152:0/1647502122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f401c1008c0 msgr2=0x7f401c114df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:38.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.078+0000 7f401b59e640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f401c1008c0 0x7f401c114df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:38.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.078+0000 7f401b59e640 1 -- 172.21.15.152:0/1647502122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f401c1011e0 msgr2=0x7f401c10ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:38.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.078+0000 7f401b59e640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f401c1011e0 0x7f401c10ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:38.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.078+0000 7f401b59e640 1 -- 172.21.15.152:0/1647502122 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401c10fab0 con 0x7f401c105ec0 2024-09-11T22:08:38.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.078+0000 7f401b59e640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f401c105ec0 0x7f401c10f3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4014009620 tx=0x7f4014031690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:38.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.078+0000 7f4003fff640 1 -- 172.21.15.152:0/1647502122 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014004040 con 0x7f401c105ec0 2024-09-11T22:08:38.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.078+0000 7f4021015640 1 -- 172.21.15.152:0/1647502122 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401c1b3a50 con 0x7f401c105ec0 2024-09-11T22:08:38.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.078+0000 7f4003fff640 1 -- 172.21.15.152:0/1647502122 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f401402d070 con 0x7f401c105ec0 2024-09-11T22:08:38.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.078+0000 7f4003fff640 1 -- 172.21.15.152:0/1647502122 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401402fca0 con 0x7f401c105ec0 2024-09-11T22:08:38.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.078+0000 7f4021015640 1 -- 172.21.15.152:0/1647502122 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f401c1b3e40 con 0x7f401c105ec0 2024-09-11T22:08:38.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.081+0000 7f4021015640 1 -- 172.21.15.152:0/1647502122 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4008005290 con 0x7f401c105ec0 2024-09-11T22:08:38.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.083+0000 7f4003fff640 1 -- 172.21.15.152:0/1647502122 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f40140305f0 con 0x7f401c105ec0 2024-09-11T22:08:38.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.084+0000 7f4003fff640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40040a2e40 0x7f40040a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:38.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.084+0000 7f4003fff640 1 -- 172.21.15.152:0/1647502122 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f40140f0950 con 0x7f401c105ec0 2024-09-11T22:08:38.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.084+0000 7f401ad9d640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40040a2e40 0x7f40040a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:38.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.085+0000 7f401ad9d640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40040a2e40 0x7f40040a5300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f400c006fd0 tx=0x7f400c008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:38.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.089+0000 7f4003fff640 1 -- 172.21.15.152:0/1647502122 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f401404d390 con 0x7f401c105ec0 2024-09-11T22:08:38.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.427+0000 7f4021015640 1 -- 172.21.15.152:0/1647502122 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4008005850 con 0x7f401c105ec0 2024-09-11T22:08:38.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.427+0000 7f4003fff640 1 -- 172.21.15.152:0/1647502122 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f401402f600 con 0x7f401c105ec0 2024-09-11T22:08:38.429 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:08:38.429 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:08:38.429 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 -- 172.21.15.152:0/1647502122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40040a2e40 msgr2=0x7f40040a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40040a2e40 0x7f40040a5300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f400c006fd0 tx=0x7f400c008040 comp rx=0 tx=0).stop 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 -- 172.21.15.152:0/1647502122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f401c105ec0 msgr2=0x7f401c10f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f401c105ec0 0x7f401c10f3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4014009620 tx=0x7f4014031690 comp rx=0 tx=0).stop 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 -- 172.21.15.152:0/1647502122 shutdown_connections 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40040a2e40 0x7f40040a5300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f401c105ec0 0x7f401c10f3b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f401c1011e0 0x7f401c10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 --2- 172.21.15.152:0/1647502122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f401c1008c0 0x7f401c114df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 -- 172.21.15.152:0/1647502122 >> 172.21.15.152:0/1647502122 conn(0x7f401c0fc7d0 msgr2=0x7f401c103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 -- 172.21.15.152:0/1647502122 shutdown_connections 2024-09-11T22:08:38.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:38.431+0000 7f4021015640 1 -- 172.21.15.152:0/1647502122 wait complete. 2024-09-11T22:08:38.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:38 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1647502122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:38.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:38 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1647502122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:38.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:38 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1647502122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:39.279 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0' 2024-09-11T22:08:39.279 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0 2024-09-11T22:08:39.673 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:39 smithi179 ceph-mon[35603]: pgmap v134: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.5 MiB/s wr, 169 op/s 2024-09-11T22:08:39.803 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:39 smithi152 ceph-mon[31188]: pgmap v134: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.5 MiB/s wr, 169 op/s 2024-09-11T22:08:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 185.0 s, 2917.5 tps, lat 155.497 ms stddev 1570.917 2024-09-11T22:08:39.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:39 smithi193 ceph-mon[35545]: pgmap v134: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.5 MiB/s wr, 169 op/s 2024-09-11T22:08:40.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.361+0000 7ff6b2687640 1 -- 172.21.15.152:0/3704353381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ac1011e0 msgr2=0x7ff6ac105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:40.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.361+0000 7ff6b2687640 1 --2- 172.21.15.152:0/3704353381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ac1011e0 0x7ff6ac105980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009c10 tx=0x7ff69c02a6e0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.362+0000 7ff6b2687640 1 -- 172.21.15.152:0/3704353381 shutdown_connections 2024-09-11T22:08:40.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.362+0000 7ff6b2687640 1 --2- 172.21.15.152:0/3704353381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6ac105ec0 0x7ff6ac106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.362+0000 7ff6b2687640 1 --2- 172.21.15.152:0/3704353381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ac1011e0 0x7ff6ac105980 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009c10 tx=0x7ff69c02a6e0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.362+0000 7ff6b2687640 1 --2- 172.21.15.152:0/3704353381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6ac1008c0 0x7ff6ac100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.362+0000 7ff6b2687640 1 -- 172.21.15.152:0/3704353381 >> 172.21.15.152:0/3704353381 conn(0x7ff6ac0fc7d0 msgr2=0x7ff6ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:40.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.363+0000 7ff6b2687640 1 -- 172.21.15.152:0/3704353381 shutdown_connections 2024-09-11T22:08:40.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.365+0000 7ff6b2687640 1 -- 172.21.15.152:0/3704353381 wait complete. 2024-09-11T22:08:40.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.366+0000 7ff6b2687640 1 Processor -- start 2024-09-11T22:08:40.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.366+0000 7ff6b2687640 1 -- start start 2024-09-11T22:08:40.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.366+0000 7ff6b2687640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6ac1008c0 0x7ff6ac19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.366+0000 7ff6b2687640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6ac105ec0 0x7ff6ac19f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.366+0000 7ff6b2687640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ac1a3640 0x7ff6ac1a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.366+0000 7ff6b2687640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1185c0 con 0x7ff6ac105ec0 2024-09-11T22:08:40.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.366+0000 7ff6b2687640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac118440 con 0x7ff6ac1a3640 2024-09-11T22:08:40.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.366+0000 7ff6b2687640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac118740 con 0x7ff6ac1008c0 2024-09-11T22:08:40.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.367+0000 7ff6b0c24640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ac1a3640 0x7ff6ac1a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.367+0000 7ff6abfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6ac1008c0 0x7ff6ac19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.367+0000 7ff6b0c24640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ac1a3640 0x7ff6ac1a3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60948/0 (socket says 172.21.15.152:60948) 2024-09-11T22:08:40.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.367+0000 7ff6b0c24640 1 -- 172.21.15.152:0/4096328960 learned_addr learned my addr 172.21.15.152:0/4096328960 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:40.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.367+0000 7ff6ab7fe640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6ac105ec0 0x7ff6ac19f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.367+0000 7ff6b0c24640 1 -- 172.21.15.152:0/4096328960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6ac1008c0 msgr2=0x7ff6ac19ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:40.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.367+0000 7ff6b0c24640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6ac1008c0 0x7ff6ac19ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.367+0000 7ff6b0c24640 1 -- 172.21.15.152:0/4096328960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6ac105ec0 msgr2=0x7ff6ac19f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:40.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.367+0000 7ff6b0c24640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6ac105ec0 0x7ff6ac19f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.367+0000 7ff6b0c24640 1 -- 172.21.15.152:0/4096328960 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac1a4100 con 0x7ff6ac1a3640 2024-09-11T22:08:40.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.367+0000 7ff6abfff640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6ac1008c0 0x7ff6ac19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:40.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.368+0000 7ff6b0c24640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ac1a3640 0x7ff6ac1a3af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff69400e970 tx=0x7ff69400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:40.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.368+0000 7ff6a97fa640 1 -- 172.21.15.152:0/4096328960 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69400ccc0 con 0x7ff6ac1a3640 2024-09-11T22:08:40.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.368+0000 7ff6a97fa640 1 -- 172.21.15.152:0/4096328960 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff69400ce60 con 0x7ff6ac1a3640 2024-09-11T22:08:40.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.368+0000 7ff6a97fa640 1 -- 172.21.15.152:0/4096328960 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694010430 con 0x7ff6ac1a3640 2024-09-11T22:08:40.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.368+0000 7ff6b2687640 1 -- 172.21.15.152:0/4096328960 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ac1a43f0 con 0x7ff6ac1a3640 2024-09-11T22:08:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.368+0000 7ff6b2687640 1 -- 172.21.15.152:0/4096328960 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ac1abb80 con 0x7ff6ac1a3640 2024-09-11T22:08:40.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.372+0000 7ff6a97fa640 1 -- 172.21.15.152:0/4096328960 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff694005020 con 0x7ff6ac1a3640 2024-09-11T22:08:40.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6b4a60740 1 Processor -- start 2024-09-11T22:08:40.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6a97fa640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6980a2e40 0x7ff6980a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6b4a60740 1 -- start start 2024-09-11T22:08:40.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6ab7fe640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6980a2e40 0x7ff6980a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6a97fa640 1 -- 172.21.15.152:0/4096328960 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff6940cf630 con 0x7ff6ac1a3640 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f2c850 0x561071f2cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f374f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f37a30 0x561071f39e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561071e91160 con 0x561071f2d170 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561071e38720 con 0x561071f37a30 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561071e8d120 con 0x561071f2c850 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6ab7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6ab7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f374f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46628/0 (socket says 172.21.15.152:46628) 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6ab7fe640 1 -- 172.21.15.152:0/1631109101 learned_addr learned my addr 172.21.15.152:0/1631109101 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.373+0000 7ff6abfff640 1 --2- 172.21.15.152:0/1631109101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f2c850 0x561071f2cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.374+0000 7ff6b0c24640 1 --2- 172.21.15.152:0/1631109101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f37a30 0x561071f39e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.374+0000 7ff6abfff640 1 -- 172.21.15.152:0/1631109101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f37a30 msgr2=0x561071f39e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:40.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.374+0000 7ff6abfff640 1 --2- 172.21.15.152:0/1631109101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f37a30 0x561071f39e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.374+0000 7ff6abfff640 1 -- 172.21.15.152:0/1631109101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 msgr2=0x561071f374f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:40.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.374+0000 7ff6abfff640 1 --2- 172.21.15.152:0/1631109101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f374f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.374+0000 7ff6ab7fe640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6980a2e40 0x7ff6980a5300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac06a280 tx=0x7ff69c030c40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:40.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.374+0000 7ff6abfff640 1 -- 172.21.15.152:0/1631109101 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561071c02ba0 con 0x561071f2c850 2024-09-11T22:08:40.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.374+0000 7ff6abfff640 1 --2- 172.21.15.152:0/1631109101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f2c850 0x561071f2cc30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4011440 tx=0x7ff6a4011840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3caf9f9169a16b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:40.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.374+0000 7ff6a27fc640 1 -- 172.21.15.152:0/1631109101 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a401e070 con 0x561071f2c850 2024-09-11T22:08:40.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.374+0000 7ff6a27fc640 1 -- 172.21.15.152:0/1631109101 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6a40035f0 con 0x561071f2c850 2024-09-11T22:08:40.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.375+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1631109101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f2c850 msgr2=0x561071f2cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:40.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.375+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/1631109101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f2c850 0x561071f2cc30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4011440 tx=0x7ff6a4011840 comp rx=0 tx=0).stop 2024-09-11T22:08:40.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.376+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1631109101 shutdown_connections 2024-09-11T22:08:40.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.376+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/1631109101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f37a30 0x561071f39e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.376+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/1631109101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.376+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/1631109101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f2c850 0x561071f2cc30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.376+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1631109101 >> 172.21.15.152:0/1631109101 conn(0x561071f28de0 msgr2=0x561071f291c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.376+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1631109101 shutdown_connections 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.376+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1631109101 wait complete. 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.377+0000 7ff6b4a60740 1 -- start start 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.377+0000 7ff6b4a60740 1 Processor -- start 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.377+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f347f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.377+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f34d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.377+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 0x561071f35270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.377+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561071f3a6a0 con 0x561071f2d170 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.377+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561071e19900 con 0x561071f2c850 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.377+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561071f3a820 con 0x561071f37a30 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.377+0000 7ff6b4a60740 10 client.0 _ll_register_callbacks cb 0x561071e17780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6b0c24640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 0x561071f35270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6abfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f347f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6b0c24640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 0x561071f35270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:32876/0 (socket says 172.21.15.152:32876) 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6b0c24640 1 -- 172.21.15.152:0/1040879860 learned_addr learned my addr 172.21.15.152:0/1040879860 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6ab7fe640 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f34d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6b0c24640 1 -- 172.21.15.152:0/1040879860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 msgr2=0x561071f347f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6b0c24640 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f347f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6b0c24640 1 -- 172.21.15.152:0/1040879860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 msgr2=0x561071f34d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6b0c24640 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f34d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6b0c24640 1 -- 172.21.15.152:0/1040879860 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561071e59c50 con 0x561071f37a30 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6b0c24640 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 0x561071f35270 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff69400d010 tx=0x7ff69409c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e11548a6f47acce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff68b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff68b7fe640 1 -- 172.21.15.152:0/1040879860 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6940a4790 con 0x561071f37a30 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff68b7fe640 1 -- 172.21.15.152:0/1040879860 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff694098190 con 0x561071f37a30 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.378+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1040879860 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6a40035f0 con 0x561071f37a30 2024-09-11T22:08:40.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff68b7fe640 1 -- 172.21.15.152:0/1040879860 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff694005310 con 0x561071f37a30 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff6b4a60740 10 client.26053 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1040879860 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561071f462e0 con 0x561071f37a30 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff68b7fe640 1 -- 172.21.15.152:0/1040879860 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6a40035f0 con 0x561071f37a30 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff68b7fe640 1 -- 172.21.15.152:0/1040879860 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff6940a4300 con 0x561071f37a30 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff6b4a60740 10 client.26053 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff6b4a60740 10 client.26053 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff6b4a60740 20 client.26053 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561071f476f0 0x561071f49b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff6b4a60740 4 client.26053 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1040879860 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561071e9e890 con 0x561071f476f0 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.379+0000 7ff6abfff640 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561071f476f0 0x561071f49b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff68b7fe640 10 client.26053 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:40.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff6abfff640 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561071f476f0 0x561071f49b40 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b9eb5fb7302143f server_cookie=6caf776534d32ba in_seq=0 out_seq=0 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff68b7fe640 1 -- 172.21.15.152:0/1040879860 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561071e9e890 con 0x561071f476f0 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff68b7fe640 10 client.26053 handle_command_reply: tid=0 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff6b4a60740 1 client.26053 shutdown 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1040879860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 msgr2=0x561071f35270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 0x561071f35270 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff69400d010 tx=0x7ff69409c2e0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1040879860 shutdown_connections 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561071f476f0 0x561071f49b40 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 0x561071f35270 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff68b7fe640 0 client.26053 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f34d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.380+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/1040879860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f347f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.381+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1040879860 >> 172.21.15.152:0/1040879860 conn(0x561071f28de0 msgr2=0x561071f2eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:40.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.381+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1040879860 shutdown_connections 2024-09-11T22:08:40.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.381+0000 7ff6b4a60740 1 -- 172.21.15.152:0/1040879860 wait complete. 2024-09-11T22:08:40.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.381+0000 7ff6b4a60740 20 client.26053 trim_cache size 0 max 16384 2024-09-11T22:08:40.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6b4a60740 1 Processor -- start 2024-09-11T22:08:40.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6b4a60740 1 -- start start 2024-09-11T22:08:40.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f4f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f2d170 0x561071f4f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f37a30 0x561071f276a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1b6e30 con 0x561071f37a30 2024-09-11T22:08:40.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1b4700 con 0x561071f2c850 2024-09-11T22:08:40.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6b0c24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f37a30 0x561071f276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1b2550 con 0x561071f2d170 2024-09-11T22:08:40.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6b0c24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f37a30 0x561071f276a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46656/0 (socket says 172.21.15.152:46656) 2024-09-11T22:08:40.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6b0c24640 1 -- 172.21.15.152:0/2488400740 learned_addr learned my addr 172.21.15.152:0/2488400740 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:40.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.403+0000 7ff6ab7fe640 1 --2- 172.21.15.152:0/2488400740 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f2d170 0x561071f4f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.404+0000 7ff6abfff640 1 --2- 172.21.15.152:0/2488400740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f4f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.404+0000 7ff6b0c24640 1 -- 172.21.15.152:0/2488400740 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f2d170 msgr2=0x561071f4f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:40.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.404+0000 7ff6b0c24640 1 --2- 172.21.15.152:0/2488400740 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f2d170 0x561071f4f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.404+0000 7ff6b0c24640 1 -- 172.21.15.152:0/2488400740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 msgr2=0x561071f4f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:40.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.404+0000 7ff6b0c24640 1 --2- 172.21.15.152:0/2488400740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f4f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.404+0000 7ff6b0c24640 1 -- 172.21.15.152:0/2488400740 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561071f2cfa0 con 0x561071f37a30 2024-09-11T22:08:40.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.404+0000 7ff6b0c24640 1 --2- 172.21.15.152:0/2488400740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f37a30 0x561071f276a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff694097f80 tx=0x7ff69409a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56252e7d6d8b07bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:40.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.404+0000 7ff6a1ffb640 1 -- 172.21.15.152:0/2488400740 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6940054b0 con 0x561071f37a30 2024-09-11T22:08:40.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.405+0000 7ff6a1ffb640 1 -- 172.21.15.152:0/2488400740 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6940b3040 con 0x561071f37a30 2024-09-11T22:08:40.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.405+0000 7ff6a1ffb640 1 -- 172.21.15.152:0/2488400740 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6940ba2b0 con 0x561071f37a30 2024-09-11T22:08:40.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.406+0000 7ff6b4a60740 1 -- 172.21.15.152:0/2488400740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f37a30 msgr2=0x561071f276a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:40.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.406+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/2488400740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f37a30 0x561071f276a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff694097f80 tx=0x7ff69409a030 comp rx=0 tx=0).stop 2024-09-11T22:08:40.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.406+0000 7ff6b4a60740 1 -- 172.21.15.152:0/2488400740 shutdown_connections 2024-09-11T22:08:40.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.406+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/2488400740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f37a30 0x561071f276a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.406+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/2488400740 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f2d170 0x561071f4f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.406+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/2488400740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f4f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.406+0000 7ff6b4a60740 1 -- 172.21.15.152:0/2488400740 >> 172.21.15.152:0/2488400740 conn(0x561071f28de0 msgr2=0x561071f338e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:40.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.406+0000 7ff6b4a60740 1 -- 172.21.15.152:0/2488400740 shutdown_connections 2024-09-11T22:08:40.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.406+0000 7ff6b4a60740 1 -- 172.21.15.152:0/2488400740 wait complete. 2024-09-11T22:08:40.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.406+0000 7ff6b4a60740 1 -- start start 2024-09-11T22:08:40.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.407+0000 7ff6b4a60740 1 Processor -- start 2024-09-11T22:08:40.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.407+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f38ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.407+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f39010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.407+0000 7ff6b4a60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 0x561071f39550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.407+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1b2bc0 con 0x561071f2d170 2024-09-11T22:08:40.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.407+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1b4030 con 0x561071f2c850 2024-09-11T22:08:40.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.407+0000 7ff6b4a60740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1b3290 con 0x561071f37a30 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.407+0000 7ff6ab7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f39010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.407+0000 7ff6ab7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f39010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46666/0 (socket says 172.21.15.152:46666) 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.407+0000 7ff6ab7fe640 1 -- 172.21.15.152:0/782601398 learned_addr learned my addr 172.21.15.152:0/782601398 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.408+0000 7ff6b4a60740 10 client.0 _ll_register_callbacks cb 0x7ff69409b8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.408+0000 7ff6b0c24640 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 0x561071f39550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.408+0000 7ff6abfff640 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f38ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.408+0000 7ff6ab7fe640 1 -- 172.21.15.152:0/782601398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 msgr2=0x561071f39550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.408+0000 7ff6ab7fe640 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 0x561071f39550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.408+0000 7ff6ab7fe640 1 -- 172.21.15.152:0/782601398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 msgr2=0x561071f38ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.408+0000 7ff6ab7fe640 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f38ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.408+0000 7ff6ab7fe640 1 -- 172.21.15.152:0/782601398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561071f3dfb0 con 0x561071f2d170 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.408+0000 7ff6ab7fe640 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f39010 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009c10 tx=0x7ff69c02a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946ee00124afa716 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:40.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.408+0000 7ff68b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.409+0000 7ff68b7fe640 1 -- 172.21.15.152:0/782601398 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c003d80 con 0x561071f2d170 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.409+0000 7ff6b4a60740 1 -- 172.21.15.152:0/782601398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6940b3040 con 0x561071f2d170 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.409+0000 7ff68b7fe640 1 -- 172.21.15.152:0/782601398 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff69c0316e0 con 0x561071f2d170 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.409+0000 7ff68b7fe640 1 -- 172.21.15.152:0/782601398 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff69c0318e0 con 0x561071f2d170 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.409+0000 7ff6b4a60740 10 client.16437 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.409+0000 7ff6b4a60740 1 -- 172.21.15.152:0/782601398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561071fb26b0 con 0x561071f2d170 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.409+0000 7ff68b7fe640 1 -- 172.21.15.152:0/782601398 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6940b3040 con 0x561071f2d170 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.410+0000 7ff68b7fe640 1 -- 172.21.15.152:0/782601398 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff69c03c040 con 0x561071f2d170 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.410+0000 7ff6b4a60740 10 client.16437 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.410+0000 7ff6b4a60740 10 client.16437 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.410+0000 7ff6b4a60740 20 client.16437 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.410+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561071f476f0 0x561071fb4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.410+0000 7ff6b4a60740 4 client.16437 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}] 2024-09-11T22:08:40.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.410+0000 7ff6b4a60740 1 -- 172.21.15.152:0/782601398 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}) -- 0x561071e98be0 con 0x561071f476f0 2024-09-11T22:08:40.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.410+0000 7ff6abfff640 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561071f476f0 0x561071fb4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:40.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.410+0000 7ff68b7fe640 10 client.16437 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:40.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.410+0000 7ff6abfff640 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561071f476f0 0x561071fb4e90 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21fdd0fab54f3e13 server_cookie=fb26da5dfafd0ced in_seq=0 out_seq=0 2024-09-11T22:08:40.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.637+0000 7ff68b7fe640 1 -- 172.21.15.152:0/782601398 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561071e98be0 con 0x561071f476f0 2024-09-11T22:08:40.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.637+0000 7ff68b7fe640 10 client.16437 handle_command_reply: tid=0 2024-09-11T22:08:40.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.637+0000 7ff6b4a60740 1 client.16437 shutdown 2024-09-11T22:08:40.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.637+0000 7ff6b4a60740 1 -- 172.21.15.152:0/782601398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 msgr2=0x561071f39010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:40.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.637+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f39010 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009c10 tx=0x7ff69c02a6e0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b4a60740 1 -- 172.21.15.152:0/782601398 shutdown_connections 2024-09-11T22:08:40.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561071f476f0 0x561071fb4e90 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561071f37a30 0x561071f39550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561071f2d170 0x561071f39010 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b4a60740 1 --2- 172.21.15.152:0/782601398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561071f2c850 0x561071f38ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b4a60740 1 -- 172.21.15.152:0/782601398 >> 172.21.15.152:0/782601398 conn(0x561071f28de0 msgr2=0x561071f276a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:40.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff68b7fe640 0 client.16437 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:40.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b4a60740 1 -- 172.21.15.152:0/782601398 shutdown_connections 2024-09-11T22:08:40.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b4a60740 1 -- 172.21.15.152:0/782601398 wait complete. 2024-09-11T22:08:40.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b4a60740 20 client.16437 trim_cache size 0 max 16384 2024-09-11T22:08:40.640 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:08:40.640 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 18, 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: "f0379676": { 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 18, 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:08:40.641 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 140.2, 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:40.642 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:08:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b2687640 1 -- 172.21.15.152:0/4096328960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6980a2e40 msgr2=0x7ff6980a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b2687640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6980a2e40 0x7ff6980a5300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac06a280 tx=0x7ff69c030c40 comp rx=0 tx=0).stop 2024-09-11T22:08:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b2687640 1 -- 172.21.15.152:0/4096328960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ac1a3640 msgr2=0x7ff6ac1a3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.638+0000 7ff6b2687640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ac1a3640 0x7ff6ac1a3af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff69400e970 tx=0x7ff69400ed70 comp rx=0 tx=0).stop 2024-09-11T22:08:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.639+0000 7ff6b2687640 1 -- 172.21.15.152:0/4096328960 shutdown_connections 2024-09-11T22:08:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.639+0000 7ff6b2687640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6980a2e40 0x7ff6980a5300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.639+0000 7ff6b2687640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ac1a3640 0x7ff6ac1a3af0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.639+0000 7ff6b2687640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6ac105ec0 0x7ff6ac19f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.639+0000 7ff6b2687640 1 --2- 172.21.15.152:0/4096328960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6ac1008c0 0x7ff6ac19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:40.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.639+0000 7ff6b2687640 1 -- 172.21.15.152:0/4096328960 >> 172.21.15.152:0/4096328960 conn(0x7ff6ac0fc7d0 msgr2=0x7ff6ac10f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:40.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.639+0000 7ff6b2687640 1 -- 172.21.15.152:0/4096328960 shutdown_connections 2024-09-11T22:08:40.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:40.639+0000 7ff6b2687640 1 -- 172.21.15.152:0/4096328960 wait complete. 2024-09-11T22:08:41.681 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f0379676', quiesce took 4.6 seconds. Will release after: 15.549999999999999 2024-09-11T22:08:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:41 smithi179 ceph-mon[35603]: pgmap v135: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 165 op/s 2024-09-11T22:08:41.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:41 smithi193 ceph-mon[35545]: pgmap v135: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 165 op/s 2024-09-11T22:08:41.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:41 smithi152 ceph-mon[31188]: pgmap v135: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 165 op/s 2024-09-11T22:08:43.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.272+0000 7fc5bb99f640 1 -- 172.21.15.152:0/3799066621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5b410c0d0 msgr2=0x7fc5b410e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:43.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.272+0000 7fc5bb99f640 1 --2- 172.21.15.152:0/3799066621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5b410c0d0 0x7fc5b410e550 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009ca0 tx=0x7fc5ac02a950 comp rx=0 tx=0).stop 2024-09-11T22:08:43.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.272+0000 7fc5bb99f640 1 -- 172.21.15.152:0/3799066621 shutdown_connections 2024-09-11T22:08:43.273 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.272+0000 7fc5bb99f640 1 --2- 172.21.15.152:0/3799066621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5b410c0d0 0x7fc5b410e550 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.274 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.272+0000 7fc5bb99f640 1 --2- 172.21.15.152:0/3799066621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b41035a0 0x7fc5b410ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.274 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.272+0000 7fc5bb99f640 1 --2- 172.21.15.152:0/3799066621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b4102c80 0x7fc5b4103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.274 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.272+0000 7fc5bb99f640 1 -- 172.21.15.152:0/3799066621 >> 172.21.15.152:0/3799066621 conn(0x7fc5b4077990 msgr2=0x7fc5b40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:43.274 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.272+0000 7fc5bb99f640 1 -- 172.21.15.152:0/3799066621 shutdown_connections 2024-09-11T22:08:43.274 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.272+0000 7fc5bb99f640 1 -- 172.21.15.152:0/3799066621 wait complete. 2024-09-11T22:08:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.273+0000 7fc5bb99f640 1 Processor -- start 2024-09-11T22:08:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.273+0000 7fc5bb99f640 1 -- start start 2024-09-11T22:08:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.273+0000 7fc5bb99f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b4102c80 0x7fc5b4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.273+0000 7fc5bb99f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b41035a0 0x7fc5b41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.273+0000 7fc5bb99f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5b410c0d0 0x7fc5b419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.273+0000 7fc5bb99f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b4111eb0 con 0x7fc5b410c0d0 2024-09-11T22:08:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.273+0000 7fc5bb99f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b4111d30 con 0x7fc5b41035a0 2024-09-11T22:08:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.273+0000 7fc5bb99f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b4112030 con 0x7fc5b4102c80 2024-09-11T22:08:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.273+0000 7fc5b9f3c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5b410c0d0 0x7fc5b419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.273+0000 7fc5b9f3c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5b410c0d0 0x7fc5b419cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46680/0 (socket says 172.21.15.152:46680) 2024-09-11T22:08:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.273+0000 7fc5b9f3c640 1 -- 172.21.15.152:0/2616389024 learned_addr learned my addr 172.21.15.152:0/2616389024 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b41035a0 0x7fc5b41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5b973b640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b4102c80 0x7fc5b4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5b9f3c640 1 -- 172.21.15.152:0/2616389024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b4102c80 msgr2=0x7fc5b4198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5b9f3c640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b4102c80 0x7fc5b4198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5b9f3c640 1 -- 172.21.15.152:0/2616389024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b41035a0 msgr2=0x7fc5b41988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5b9f3c640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b41035a0 0x7fc5b41988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5b9f3c640 1 -- 172.21.15.152:0/2616389024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b419d350 con 0x7fc5b410c0d0 2024-09-11T22:08:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b41035a0 0x7fc5b41988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5b973b640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b4102c80 0x7fc5b4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5b9f3c640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5b410c0d0 0x7fc5b419cc20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac004af0 tx=0x7fc5ac02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5aa7fc640 1 -- 172.21.15.152:0/2616389024 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac034040 con 0x7fc5b410c0d0 2024-09-11T22:08:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5bb99f640 1 -- 172.21.15.152:0/2616389024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b419d5e0 con 0x7fc5b410c0d0 2024-09-11T22:08:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5aa7fc640 1 -- 172.21.15.152:0/2616389024 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5ac030920 con 0x7fc5b410c0d0 2024-09-11T22:08:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5aa7fc640 1 -- 172.21.15.152:0/2616389024 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac0047b0 con 0x7fc5b410c0d0 2024-09-11T22:08:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.274+0000 7fc5bb99f640 1 -- 172.21.15.152:0/2616389024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b41a4ed0 con 0x7fc5b410c0d0 2024-09-11T22:08:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.276+0000 7fc5aa7fc640 1 -- 172.21.15.152:0/2616389024 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fc5ac037020 con 0x7fc5b410c0d0 2024-09-11T22:08:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5be81b740 1 Processor -- start 2024-09-11T22:08:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5be81b740 1 -- start start 2024-09-11T22:08:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e94ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e95410 0x5607b6e9f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e9fcb0 0x5607b6ea20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5be81b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5607b6df92f0 con 0x5607b6e94af0 2024-09-11T22:08:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5be81b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5607b6da1270 con 0x5607b6e9fcb0 2024-09-11T22:08:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5be81b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5607b6df52b0 con 0x5607b6e95410 2024-09-11T22:08:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5aa7fc640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc5a00a2da0 0x7fc5a00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5b8f3a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e94ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5b8f3a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e94ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46684/0 (socket says 172.21.15.152:46684) 2024-09-11T22:08:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.277+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/3246397954 learned_addr learned my addr 172.21.15.152:0/3246397954 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5b9f3c640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc5a00a2da0 0x7fc5a00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5b973b640 1 --2- 172.21.15.152:0/3246397954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e95410 0x5607b6e9f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5aa7fc640 1 -- 172.21.15.152:0/2616389024 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc5ac0f01f0 con 0x7fc5b410c0d0 2024-09-11T22:08:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/3246397954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e9fcb0 0x5607b6ea20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/3246397954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e95410 msgr2=0x5607b6e9f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/3246397954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e95410 0x5607b6e9f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/3246397954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e9fcb0 msgr2=0x5607b6ea20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/3246397954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e9fcb0 0x5607b6ea20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/3246397954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607b6da0340 con 0x5607b6e94af0 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5b973b640 1 --2- 172.21.15.152:0/3246397954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e95410 0x5607b6e9f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/3246397954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e94ed0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40135d0 tx=0x7fc5a4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66efbf95f058d531 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc5b9f3c640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc5a00a2da0 0x7fc5a00a5260 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0edad0 tx=0x7fc5ac0b1c80 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc59f7fe640 1 -- 172.21.15.152:0/3246397954 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4011470 con 0x5607b6e94af0 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc59f7fe640 1 -- 172.21.15.152:0/3246397954 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5a400f980 con 0x5607b6e94af0 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.278+0000 7fc59f7fe640 1 -- 172.21.15.152:0/3246397954 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40107f0 con 0x5607b6e94af0 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.279+0000 7fc5be81b740 1 -- 172.21.15.152:0/3246397954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 msgr2=0x5607b6e94ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.279+0000 7fc5be81b740 1 --2- 172.21.15.152:0/3246397954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e94ed0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40135d0 tx=0x7fc5a4009750 comp rx=0 tx=0).stop 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.279+0000 7fc5be81b740 1 -- 172.21.15.152:0/3246397954 shutdown_connections 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.279+0000 7fc5be81b740 1 --2- 172.21.15.152:0/3246397954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e9fcb0 0x5607b6ea20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.279+0000 7fc5be81b740 1 --2- 172.21.15.152:0/3246397954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e95410 0x5607b6e9f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.279+0000 7fc5be81b740 1 --2- 172.21.15.152:0/3246397954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e94ed0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.279+0000 7fc5be81b740 1 -- 172.21.15.152:0/3246397954 >> 172.21.15.152:0/3246397954 conn(0x5607b6e91060 msgr2=0x5607b6e91440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.279+0000 7fc5be81b740 1 -- 172.21.15.152:0/3246397954 shutdown_connections 2024-09-11T22:08:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.279+0000 7fc5be81b740 1 -- 172.21.15.152:0/3246397954 wait complete. 2024-09-11T22:08:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.279+0000 7fc5be81b740 1 -- start start 2024-09-11T22:08:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5be81b740 1 Processor -- start 2024-09-11T22:08:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e94af0 0x5607b6e9cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 0x5607b6e9d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e9fcb0 0x5607b6e9d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5be81b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5607b6ea2880 con 0x5607b6e9fcb0 2024-09-11T22:08:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5be81b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5607b6d82290 con 0x5607b6e95410 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5be81b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5607b6ea2a00 con 0x5607b6e94af0 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5be81b740 10 client.0 _ll_register_callbacks cb 0x5607b6db3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5b8f3a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e9fcb0 0x5607b6e9d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5b8f3a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e9fcb0 0x5607b6e9d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46698/0 (socket says 172.21.15.152:46698) 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/257169202 learned_addr learned my addr 172.21.15.152:0/257169202 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e94af0 0x5607b6e9cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.280+0000 7fc5b973b640 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 0x5607b6e9d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/257169202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e94af0 msgr2=0x5607b6e9cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e94af0 0x5607b6e9cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/257169202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 msgr2=0x5607b6e9d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 0x5607b6e9d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/257169202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607b6b0c210 con 0x5607b6e9fcb0 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e9fcb0 0x5607b6e9d540 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400f950 tx=0x7fc5a40103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e83b785793a6a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc59cff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc59cff9640 1 -- 172.21.15.152:0/257169202 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a400fdc0 con 0x5607b6e9fcb0 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc5be81b740 1 -- 172.21.15.152:0/257169202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5a400f980 con 0x5607b6e9fcb0 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc59cff9640 1 -- 172.21.15.152:0/257169202 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc5a4005050 con 0x5607b6e9fcb0 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc59cff9640 1 -- 172.21.15.152:0/257169202 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc5a4005250 con 0x5607b6e9fcb0 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc5be81b740 10 client.16449 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc5be81b740 1 -- 172.21.15.152:0/257169202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5607b6bd8620 con 0x5607b6e9fcb0 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc59cff9640 1 -- 172.21.15.152:0/257169202 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5a400f980 con 0x5607b6e9fcb0 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.281+0000 7fc59cff9640 1 -- 172.21.15.152:0/257169202 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fc5a4010570 con 0x5607b6e9fcb0 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.282+0000 7fc5be81b740 10 client.16449 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.282+0000 7fc5be81b740 10 client.16449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.282+0000 7fc5be81b740 20 client.16449 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.282+0000 7fc5be81b740 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5607b6eafb00 0x5607b6eb1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.282+0000 7fc5be81b740 4 client.16449 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.282+0000 7fc5be81b740 1 -- 172.21.15.152:0/257169202 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607b6e06a20 con 0x5607b6eafb00 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.282+0000 7fc5b973b640 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5607b6eafb00 0x5607b6eb1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.282+0000 7fc59cff9640 10 client.16449 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.282+0000 7fc5b973b640 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5607b6eafb00 0x5607b6eb1ef0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80f5b35001ca14f3 server_cookie=a99000d0b40da8e3 in_seq=0 out_seq=0 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc59cff9640 1 -- 172.21.15.152:0/257169202 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5607b6e06a20 con 0x5607b6eafb00 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc59cff9640 10 client.16449 handle_command_reply: tid=0 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc5be81b740 1 client.16449 shutdown 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc5be81b740 1 -- 172.21.15.152:0/257169202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e9fcb0 msgr2=0x5607b6e9d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc5be81b740 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e9fcb0 0x5607b6e9d540 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400f950 tx=0x7fc5a40103d0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc5be81b740 1 -- 172.21.15.152:0/257169202 shutdown_connections 2024-09-11T22:08:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc5be81b740 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5607b6eafb00 0x5607b6eb1ef0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc5be81b740 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e9fcb0 0x5607b6e9d540 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc5be81b740 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 0x5607b6e9d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc5be81b740 1 --2- 172.21.15.152:0/257169202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e94af0 0x5607b6e9cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc59cff9640 0 client.16449 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc5be81b740 1 -- 172.21.15.152:0/257169202 >> 172.21.15.152:0/257169202 conn(0x5607b6e91060 msgr2=0x5607b6e96d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc5be81b740 1 -- 172.21.15.152:0/257169202 shutdown_connections 2024-09-11T22:08:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.283+0000 7fc5be81b740 1 -- 172.21.15.152:0/257169202 wait complete. 2024-09-11T22:08:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.284+0000 7fc5be81b740 20 client.16449 trim_cache size 0 max 16384 2024-09-11T22:08:43.299 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.298+0000 7fc5be81b740 1 Processor -- start 2024-09-11T22:08:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.298+0000 7fc5be81b740 1 -- start start 2024-09-11T22:08:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.298+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e97560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.298+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 0x5607b6e9d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.298+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e9fcb0 0x5607b6ea80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.298+0000 7fc5be81b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b41b00e0 con 0x5607b6e94af0 2024-09-11T22:08:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.298+0000 7fc5be81b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b41ad9b0 con 0x5607b6e95410 2024-09-11T22:08:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.298+0000 7fc5be81b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b41ab800 con 0x5607b6e9fcb0 2024-09-11T22:08:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.298+0000 7fc5b8f3a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e97560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.298+0000 7fc5b8f3a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e97560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46700/0 (socket says 172.21.15.152:46700) 2024-09-11T22:08:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.298+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/2105058528 learned_addr learned my addr 172.21.15.152:0/2105058528 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/2105058528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e9fcb0 msgr2=0x5607b6ea80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/2105058528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e9fcb0 0x5607b6ea80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/2105058528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 msgr2=0x5607b6e9d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/2105058528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 0x5607b6e9d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/2105058528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607b6e90e90 con 0x5607b6e94af0 2024-09-11T22:08:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/2105058528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e97560 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400f890 tx=0x7fc5a40132e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcced81e6c68bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc59effd640 1 -- 172.21.15.152:0/2105058528 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4023040 con 0x5607b6e94af0 2024-09-11T22:08:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc59effd640 1 -- 172.21.15.152:0/2105058528 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5a400f980 con 0x5607b6e94af0 2024-09-11T22:08:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc59effd640 1 -- 172.21.15.152:0/2105058528 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40053f0 con 0x5607b6e94af0 2024-09-11T22:08:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5be81b740 1 -- 172.21.15.152:0/2105058528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 msgr2=0x5607b6e97560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5be81b740 1 --2- 172.21.15.152:0/2105058528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e97560 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400f890 tx=0x7fc5a40132e0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5be81b740 1 -- 172.21.15.152:0/2105058528 shutdown_connections 2024-09-11T22:08:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5be81b740 1 --2- 172.21.15.152:0/2105058528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e9fcb0 0x5607b6ea80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5be81b740 1 --2- 172.21.15.152:0/2105058528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 0x5607b6e9d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5be81b740 1 --2- 172.21.15.152:0/2105058528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6e97560 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5be81b740 1 -- 172.21.15.152:0/2105058528 >> 172.21.15.152:0/2105058528 conn(0x5607b6e91060 msgr2=0x5607b6e9eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.299+0000 7fc5be81b740 1 -- 172.21.15.152:0/2105058528 shutdown_connections 2024-09-11T22:08:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5be81b740 1 -- 172.21.15.152:0/2105058528 wait complete. 2024-09-11T22:08:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5be81b740 1 -- start start 2024-09-11T22:08:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5be81b740 1 Processor -- start 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6eb7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 0x5607b6eb7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5be81b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e9fcb0 0x5607b6f15790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5be81b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b41abe70 con 0x5607b6e94af0 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5be81b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b41ad2e0 con 0x5607b6e95410 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5be81b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b41ac540 con 0x5607b6e9fcb0 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5be81b740 10 client.0 _ll_register_callbacks cb 0x7fc5a4013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5b8f3a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6eb7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5b8f3a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6eb7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46706/0 (socket says 172.21.15.152:46706) 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.300+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/2146635661 learned_addr learned my addr 172.21.15.152:0/2146635661 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e9fcb0 0x5607b6f15790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc5b973b640 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 0x5607b6eb7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/2146635661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e9fcb0 msgr2=0x5607b6f15790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e9fcb0 0x5607b6f15790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/2146635661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 msgr2=0x5607b6eb7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 0x5607b6eb7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc5b8f3a640 1 -- 172.21.15.152:0/2146635661 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607b6f15e30 con 0x5607b6e94af0 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc5b8f3a640 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6eb7010 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4013f20 tx=0x7fc5a4005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178000074b04326d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc59cff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc59cff9640 1 -- 172.21.15.152:0/2146635661 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4039070 con 0x5607b6e94af0 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc59cff9640 1 -- 172.21.15.152:0/2146635661 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc5a4010b60 con 0x5607b6e94af0 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc5be81b740 1 -- 172.21.15.152:0/2146635661 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5a400f980 con 0x5607b6e94af0 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc59cff9640 1 -- 172.21.15.152:0/2146635661 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc5a4046050 con 0x5607b6e94af0 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc5be81b740 10 client.16455 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc5be81b740 1 -- 172.21.15.152:0/2146635661 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5607b6f1e3d0 con 0x5607b6e94af0 2024-09-11T22:08:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.301+0000 7fc59cff9640 1 -- 172.21.15.152:0/2146635661 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5a400f980 con 0x5607b6e94af0 2024-09-11T22:08:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.302+0000 7fc59cff9640 1 -- 172.21.15.152:0/2146635661 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fc5a40424e0 con 0x5607b6e94af0 2024-09-11T22:08:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.302+0000 7fc5be81b740 10 client.16455 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.302+0000 7fc5be81b740 10 client.16455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.302+0000 7fc5be81b740 20 client.16455 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.302+0000 7fc5be81b740 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5607b6f1ea80 0x5607b6f20e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.302+0000 7fc5be81b740 4 client.16455 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:08:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.302+0000 7fc5be81b740 1 -- 172.21.15.152:0/2146635661 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5607b6e00d70 con 0x5607b6f1ea80 2024-09-11T22:08:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.302+0000 7fc5b973b640 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5607b6f1ea80 0x5607b6f20e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.302+0000 7fc59cff9640 10 client.16455 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.302+0000 7fc5b973b640 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5607b6f1ea80 0x5607b6f20e70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e2efb19e416686 server_cookie=43a64b98a6c22f92 in_seq=0 out_seq=0 2024-09-11T22:08:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc59cff9640 1 -- 172.21.15.152:0/2146635661 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5607b6e00d70 con 0x5607b6f1ea80 2024-09-11T22:08:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc59cff9640 10 client.16455 handle_command_reply: tid=0 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc5be81b740 1 client.16455 shutdown 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc5be81b740 1 -- 172.21.15.152:0/2146635661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 msgr2=0x5607b6eb7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc5be81b740 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6eb7010 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4013f20 tx=0x7fc5a4005970 comp rx=0 tx=0).stop 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc5be81b740 1 -- 172.21.15.152:0/2146635661 shutdown_connections 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc5be81b740 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5607b6f1ea80 0x5607b6f20e70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc5be81b740 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5607b6e9fcb0 0x5607b6f15790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc59cff9640 0 client.16455 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc5be81b740 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607b6e95410 0x5607b6eb7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc5be81b740 1 --2- 172.21.15.152:0/2146635661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607b6e94af0 0x5607b6eb7010 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.310+0000 7fc5be81b740 1 -- 172.21.15.152:0/2146635661 >> 172.21.15.152:0/2146635661 conn(0x5607b6e91060 msgr2=0x5607b6e8f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5be81b740 1 -- 172.21.15.152:0/2146635661 shutdown_connections 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5be81b740 1 -- 172.21.15.152:0/2146635661 wait complete. 2024-09-11T22:08:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5be81b740 20 client.16455 trim_cache size 0 max 16384 2024-09-11T22:08:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:08:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:08:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:08:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:08:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 -- 172.21.15.152:0/2616389024 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc5a00a2da0 msgr2=0x7fc5a00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc5a00a2da0 0x7fc5a00a5260 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0edad0 tx=0x7fc5ac0b1c80 comp rx=0 tx=0).stop 2024-09-11T22:08:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 -- 172.21.15.152:0/2616389024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5b410c0d0 msgr2=0x7fc5b419cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5b410c0d0 0x7fc5b419cc20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac004af0 tx=0x7fc5ac02f5b0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 -- 172.21.15.152:0/2616389024 shutdown_connections 2024-09-11T22:08:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc5a00a2da0 0x7fc5a00a5260 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5b410c0d0 0x7fc5b419cc20 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b41035a0 0x7fc5b41988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 --2- 172.21.15.152:0/2616389024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b4102c80 0x7fc5b4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 -- 172.21.15.152:0/2616389024 >> 172.21.15.152:0/2616389024 conn(0x7fc5b4077990 msgr2=0x7fc5b40fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 -- 172.21.15.152:0/2616389024 shutdown_connections 2024-09-11T22:08:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:43.311+0000 7fc5bb99f640 1 -- 172.21.15.152:0/2616389024 wait complete. 2024-09-11T22:08:43.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:43 smithi179 ceph-mon[35603]: pgmap v136: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 19 MiB/s wr, 502 op/s 2024-09-11T22:08:43.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:43 smithi193 ceph-mon[35545]: pgmap v136: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 19 MiB/s wr, 502 op/s 2024-09-11T22:08:43.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:43 smithi152 ceph-mon[31188]: pgmap v136: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 19 MiB/s wr, 502 op/s 2024-09-11T22:08:44.449 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:08:44.709 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:44.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 190.0 s, 420.2 tps, lat 25.615 ms stddev 34.309 2024-09-11T22:08:45.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.204+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1882733323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ac101420 msgr2=0x7fc4ac10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:45.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.204+0000 7fc4b37c3640 1 --2- 172.21.15.152:0/1882733323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ac101420 0x7fc4ac10d950 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009cd0 tx=0x7fc4a402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.204+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1882733323 shutdown_connections 2024-09-11T22:08:45.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.204+0000 7fc4b37c3640 1 --2- 172.21.15.152:0/1882733323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ac101420 0x7fc4ac10d950 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.204+0000 7fc4b37c3640 1 --2- 172.21.15.152:0/1882733323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4ac100a80 0x7fc4ac100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.204+0000 7fc4b37c3640 1 --2- 172.21.15.152:0/1882733323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4ac106a80 0x7fc4ac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.204+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1882733323 >> 172.21.15.152:0/1882733323 conn(0x7fc4ac0fc7c0 msgr2=0x7fc4ac0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:45.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.204+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1882733323 shutdown_connections 2024-09-11T22:08:45.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.204+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1882733323 wait complete. 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.205+0000 7fc4b37c3640 1 Processor -- start 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.205+0000 7fc4b37c3640 1 -- start start 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.205+0000 7fc4b37c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4ac100a80 0x7fc4ac1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.205+0000 7fc4b37c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4ac101420 0x7fc4ac199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.205+0000 7fc4b37c3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ac106a80 0x7fc4ac1a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.205+0000 7fc4b37c3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac110e80 con 0x7fc4ac106a80 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.205+0000 7fc4b37c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac110d00 con 0x7fc4ac100a80 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.205+0000 7fc4b37c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac111000 con 0x7fc4ac101420 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.205+0000 7fc4b1d60640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ac106a80 0x7fc4ac1a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b1d60640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ac106a80 0x7fc4ac1a4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35368/0 (socket says 172.21.15.152:35368) 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b1d60640 1 -- 172.21.15.152:0/1811409563 learned_addr learned my addr 172.21.15.152:0/1811409563 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b0d5e640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4ac101420 0x7fc4ac199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b155f640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4ac100a80 0x7fc4ac1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b1d60640 1 -- 172.21.15.152:0/1811409563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4ac101420 msgr2=0x7fc4ac199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4ac101420 0x7fc4ac199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b1d60640 1 -- 172.21.15.152:0/1811409563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4ac100a80 msgr2=0x7fc4ac1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4ac100a80 0x7fc4ac1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b1d60640 1 -- 172.21.15.152:0/1811409563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac1a4890 con 0x7fc4ac106a80 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ac106a80 0x7fc4ac1a4350 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4005cc0 tx=0x7fc4a4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc49e7fc640 1 -- 172.21.15.152:0/1811409563 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4004040 con 0x7fc4ac106a80 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc49e7fc640 1 -- 172.21.15.152:0/1811409563 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4a40046c0 con 0x7fc4ac106a80 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1811409563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ac1a4a60 con 0x7fc4ac106a80 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc49e7fc640 1 -- 172.21.15.152:0/1811409563 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4046480 con 0x7fc4ac106a80 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.206+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1811409563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ac1a4f10 con 0x7fc4ac106a80 2024-09-11T22:08:45.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc49e7fc640 1 -- 172.21.15.152:0/1811409563 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fc4a4046620 con 0x7fc4ac106a80 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b5b9c740 1 Processor -- start 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b5b9c740 1 -- start start 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f465880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f470140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f470680 0x557c0f472a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557c0f3cb2e0 con 0x557c0f465dc0 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557c0f372ce0 con 0x557c0f4654a0 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557c0f3c72a0 con 0x557c0f470680 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b155f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f470140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b155f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f470140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35380/0 (socket says 172.21.15.152:35380) 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b155f640 1 -- 172.21.15.152:0/1737932922 learned_addr learned my addr 172.21.15.152:0/1737932922 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b0d5e640 1 --2- 172.21.15.152:0/1737932922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f470680 0x557c0f472a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b0d5e640 1 --2- 172.21.15.152:0/1737932922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f465880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b0d5e640 1 -- 172.21.15.152:0/1737932922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 msgr2=0x557c0f465880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b0d5e640 1 --2- 172.21.15.152:0/1737932922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f465880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b0d5e640 1 -- 172.21.15.152:0/1737932922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 msgr2=0x557c0f470140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b0d5e640 1 --2- 172.21.15.152:0/1737932922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f470140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b0d5e640 1 -- 172.21.15.152:0/1737932922 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c0f357440 con 0x557c0f470680 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.210+0000 7fc4b155f640 1 --2- 172.21.15.152:0/1737932922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f470140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.211+0000 7fc49e7fc640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc4980a2cf0 0x7fc4980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.211+0000 7fc4b155f640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc4980a2cf0 0x7fc4980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.211+0000 7fc4b0d5e640 1 --2- 172.21.15.152:0/1737932922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f470680 0x557c0f472a70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00058c0 tx=0x7fc4a000a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d237dff75d13f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.211+0000 7fc49e7fc640 1 -- 172.21.15.152:0/1811409563 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc4a402e030 con 0x7fc4ac106a80 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.211+0000 7fc4977fe640 1 -- 172.21.15.152:0/1737932922 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0004220 con 0x557c0f470680 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.211+0000 7fc4977fe640 1 -- 172.21.15.152:0/1737932922 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4a00043c0 con 0x557c0f470680 2024-09-11T22:08:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.211+0000 7fc4977fe640 1 -- 172.21.15.152:0/1737932922 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a000f640 con 0x557c0f470680 2024-09-11T22:08:45.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1737932922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f470680 msgr2=0x557c0f472a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:45.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/1737932922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f470680 0x557c0f472a70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00058c0 tx=0x7fc4a000a6f0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b155f640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc4980a2cf0 0x7fc4980a51b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x557c0f462890 tx=0x7fc4a800b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:45.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1737932922 shutdown_connections 2024-09-11T22:08:45.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/1737932922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f470680 0x557c0f472a70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/1737932922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f470140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/1737932922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f465880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1737932922 >> 172.21.15.152:0/1737932922 conn(0x557c0f461a30 msgr2=0x557c0f461e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:45.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1737932922 shutdown_connections 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1737932922 wait complete. 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b5b9c740 1 -- start start 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.212+0000 7fc4b5b9c740 1 Processor -- start 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f46ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f465dc0 0x557c0f46d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f470680 0x557c0f46d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557c0f473250 con 0x557c0f470680 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557c0f386050 con 0x557c0f4654a0 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557c0f4733d0 con 0x557c0f465dc0 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b5b9c740 10 client.0 _ll_register_callbacks cb 0x557c0f3c6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b1d60640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f470680 0x557c0f46d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b1d60640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f470680 0x557c0f46d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35396/0 (socket says 172.21.15.152:35396) 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b1d60640 1 -- 172.21.15.152:0/2283413485 learned_addr learned my addr 172.21.15.152:0/2283413485 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b0d5e640 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f465dc0 0x557c0f46d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b155f640 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f46ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b1d60640 1 -- 172.21.15.152:0/2283413485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f465dc0 msgr2=0x557c0f46d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f465dc0 0x557c0f46d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b1d60640 1 -- 172.21.15.152:0/2283413485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 msgr2=0x557c0f46ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f46ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b1d60640 1 -- 172.21.15.152:0/2283413485 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c0f13c3c0 con 0x557c0f470680 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f470680 0x557c0f46d770 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40c5800 tx=0x7fc4a40bcd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62561eb67ea1888 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.213+0000 7fc494ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc494ff9640 1 -- 172.21.15.152:0/2283413485 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40098b0 con 0x557c0f470680 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/2283413485 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4a00043c0 con 0x557c0f470680 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc494ff9640 1 -- 172.21.15.152:0/2283413485 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc4a40b9730 con 0x557c0f470680 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc494ff9640 1 -- 172.21.15.152:0/2283413485 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc4a40bd0c0 con 0x557c0f470680 2024-09-11T22:08:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc4b5b9c740 10 client.16467 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/2283413485 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557c0f47ebc0 con 0x557c0f470680 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc494ff9640 1 -- 172.21.15.152:0/2283413485 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4a00043c0 con 0x557c0f470680 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc494ff9640 1 -- 172.21.15.152:0/2283413485 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fc4a404e070 con 0x557c0f470680 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc4b5b9c740 10 client.16467 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc4b5b9c740 10 client.16467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc4b5b9c740 20 client.16467 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557c0f480020 0x557c0f482410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc4b5b9c740 4 client.16467 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/2283413485 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c0f3d8850 con 0x557c0f480020 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.214+0000 7fc4b155f640 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557c0f480020 0x557c0f482410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.215+0000 7fc4b155f640 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557c0f480020 0x557c0f482410 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de04d15224852d93 server_cookie=1512fc4ece99f4d in_seq=0 out_seq=0 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.215+0000 7fc494ff9640 10 client.16467 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc494ff9640 1 -- 172.21.15.152:0/2283413485 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c0f3d8850 con 0x557c0f480020 2024-09-11T22:08:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc494ff9640 10 client.16467 handle_command_reply: tid=0 2024-09-11T22:08:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 1 client.16467 shutdown 2024-09-11T22:08:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/2283413485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f470680 msgr2=0x557c0f46d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f470680 0x557c0f46d770 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40c5800 tx=0x7fc4a40bcd30 comp rx=0 tx=0).stop 2024-09-11T22:08:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/2283413485 shutdown_connections 2024-09-11T22:08:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557c0f480020 0x557c0f482410 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f470680 0x557c0f46d770 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc494ff9640 0 client.16467 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f465dc0 0x557c0f46d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/2283413485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f46ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/2283413485 >> 172.21.15.152:0/2283413485 conn(0x557c0f461a30 msgr2=0x557c0f467760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:45.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/2283413485 shutdown_connections 2024-09-11T22:08:45.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/2283413485 wait complete. 2024-09-11T22:08:45.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.216+0000 7fc4b5b9c740 20 client.16467 trim_cache size 0 max 16384 2024-09-11T22:08:45.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.233+0000 7fc4b5b9c740 1 Processor -- start 2024-09-11T22:08:45.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.233+0000 7fc4b5b9c740 1 -- start start 2024-09-11T22:08:45.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f461a30 0x557c0f47c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f4654a0 0x557c0f487cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f488210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac1b00d0 con 0x557c0f465dc0 2024-09-11T22:08:45.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac1ad9a0 con 0x557c0f461a30 2024-09-11T22:08:45.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac1ab7f0 con 0x557c0f4654a0 2024-09-11T22:08:45.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b1d60640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f488210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b1d60640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f488210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35398/0 (socket says 172.21.15.152:35398) 2024-09-11T22:08:45.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b1d60640 1 -- 172.21.15.152:0/23634782 learned_addr learned my addr 172.21.15.152:0/23634782 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:45.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b1d60640 1 -- 172.21.15.152:0/23634782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f4654a0 msgr2=0x557c0f487cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:45.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/23634782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f4654a0 0x557c0f487cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b1d60640 1 -- 172.21.15.152:0/23634782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f461a30 msgr2=0x557c0f47c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:45.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b155f640 1 --2- 172.21.15.152:0/23634782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f461a30 0x557c0f47c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/23634782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f461a30 0x557c0f47c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b1d60640 1 -- 172.21.15.152:0/23634782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c0f4702f0 con 0x557c0f465dc0 2024-09-11T22:08:45.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.234+0000 7fc4b155f640 1 --2- 172.21.15.152:0/23634782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f461a30 0x557c0f47c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:45.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.235+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/23634782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f488210 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40ee3a0 tx=0x7fc4a4003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f77fa0bbda32fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:45.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.235+0000 7fc496ffd640 1 -- 172.21.15.152:0/23634782 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40098b0 con 0x557c0f465dc0 2024-09-11T22:08:45.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.235+0000 7fc496ffd640 1 -- 172.21.15.152:0/23634782 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4a4036070 con 0x557c0f465dc0 2024-09-11T22:08:45.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.235+0000 7fc496ffd640 1 -- 172.21.15.152:0/23634782 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40b9730 con 0x557c0f465dc0 2024-09-11T22:08:45.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.236+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/23634782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 msgr2=0x557c0f488210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:45.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.236+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/23634782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f488210 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40ee3a0 tx=0x7fc4a4003f70 comp rx=0 tx=0).stop 2024-09-11T22:08:45.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.236+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/23634782 shutdown_connections 2024-09-11T22:08:45.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.236+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/23634782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f488210 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.236+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/23634782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f4654a0 0x557c0f487cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.236+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/23634782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f461a30 0x557c0f47c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.236+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/23634782 >> 172.21.15.152:0/23634782 conn(0x557c0f46d8d0 msgr2=0x557c0f46bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:45.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.236+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/23634782 shutdown_connections 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.236+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/23634782 wait complete. 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.236+0000 7fc4b5b9c740 1 -- start start 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.236+0000 7fc4b5b9c740 1 Processor -- start 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f461a30 0x557c0f4743c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f474900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b5b9c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f474e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac1abe60 con 0x557c0f465dc0 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac1ad2d0 con 0x557c0f4654a0 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b5b9c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac1ac530 con 0x557c0f461a30 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b5b9c740 10 client.0 _ll_register_callbacks cb 0x7fc4a4009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b1d60640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f474e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b1d60640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f474e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35414/0 (socket says 172.21.15.152:35414) 2024-09-11T22:08:45.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b1d60640 1 -- 172.21.15.152:0/1195952399 learned_addr learned my addr 172.21.15.152:0/1195952399 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b155f640 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f461a30 0x557c0f4743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b0d5e640 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f474900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b1d60640 1 -- 172.21.15.152:0/1195952399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f461a30 msgr2=0x557c0f4743c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f461a30 0x557c0f4743c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.237+0000 7fc4b1d60640 1 -- 172.21.15.152:0/1195952399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 msgr2=0x557c0f474900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f474900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc4b1d60640 1 -- 172.21.15.152:0/1195952399 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c0f4e9cf0 con 0x557c0f465dc0 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc4b155f640 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f461a30 0x557c0f4743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc4b1d60640 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f474e40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4005e30 tx=0x7fc4a402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6de10ef3edee09f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc494ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc494ff9640 1 -- 172.21.15.152:0/1195952399 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40098b0 con 0x557c0f465dc0 2024-09-11T22:08:45.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc494ff9640 1 -- 172.21.15.152:0/1195952399 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fc4a40bd320 con 0x557c0f465dc0 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1195952399 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4a4036070 con 0x557c0f465dc0 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc494ff9640 1 -- 172.21.15.152:0/1195952399 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc4a40c5d30 con 0x557c0f465dc0 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc4b5b9c740 10 client.16473 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1195952399 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557c0f4e9cf0 con 0x557c0f465dc0 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.238+0000 7fc494ff9640 1 -- 172.21.15.152:0/1195952399 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4a4036070 con 0x557c0f465dc0 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.239+0000 7fc494ff9640 1 -- 172.21.15.152:0/1195952399 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fc4a404e070 con 0x557c0f465dc0 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.239+0000 7fc4b5b9c740 10 client.16473 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.239+0000 7fc4b5b9c740 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.239+0000 7fc4b5b9c740 20 client.16473 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.239+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557c0f470680 0x557c0f4ed260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.239+0000 7fc4b5b9c740 4 client.16473 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.239+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1195952399 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557c0f3d2d60 con 0x557c0f470680 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.239+0000 7fc4b155f640 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557c0f470680 0x557c0f4ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:45.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b155f640 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557c0f470680 0x557c0f4ed260 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f321cae5129ba0b9 server_cookie=b0bba1a519f6eb2b in_seq=0 out_seq=0 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc494ff9640 10 client.16473 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc494ff9640 1 -- 172.21.15.152:0/1195952399 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557c0f3d2d60 con 0x557c0f470680 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc494ff9640 10 client.16473 handle_command_reply: tid=0 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 1 client.16473 shutdown 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1195952399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 msgr2=0x557c0f474e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f474e40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4005e30 tx=0x7fc4a402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1195952399 shutdown_connections 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557c0f470680 0x557c0f4ed260 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c0f465dc0 0x557c0f474e40 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c0f4654a0 0x557c0f474900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 1 --2- 172.21.15.152:0/1195952399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c0f461a30 0x557c0f4743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1195952399 >> 172.21.15.152:0/1195952399 conn(0x557c0f46d8d0 msgr2=0x557c0f46f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:45.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc494ff9640 0 client.16473 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:45.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1195952399 shutdown_connections 2024-09-11T22:08:45.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 1 -- 172.21.15.152:0/1195952399 wait complete. 2024-09-11T22:08:45.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.240+0000 7fc4b5b9c740 20 client.16473 trim_cache size 0 max 16384 2024-09-11T22:08:45.248 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:08:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:08:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:08:45.249 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:08:45.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1811409563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc4980a2cf0 msgr2=0x7fc4980a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:45.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc4980a2cf0 0x7fc4980a51b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x557c0f462890 tx=0x7fc4a800b390 comp rx=0 tx=0).stop 2024-09-11T22:08:45.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1811409563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ac106a80 msgr2=0x7fc4ac1a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:45.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ac106a80 0x7fc4ac1a4350 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4005cc0 tx=0x7fc4a4003970 comp rx=0 tx=0).stop 2024-09-11T22:08:45.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1811409563 shutdown_connections 2024-09-11T22:08:45.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc4980a2cf0 0x7fc4980a51b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ac106a80 0x7fc4ac1a4350 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4ac101420 0x7fc4ac199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 --2- 172.21.15.152:0/1811409563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4ac100a80 0x7fc4ac1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:45.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1811409563 >> 172.21.15.152:0/1811409563 conn(0x7fc4ac0fc7c0 msgr2=0x7fc4ac0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:45.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1811409563 shutdown_connections 2024-09-11T22:08:45.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:45.241+0000 7fc4b37c3640 1 -- 172.21.15.152:0/1811409563 wait complete. 2024-09-11T22:08:45.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:45 smithi179 ceph-mon[35603]: pgmap v137: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 18 MiB/s wr, 494 op/s 2024-09-11T22:08:45.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:45 smithi193 ceph-mon[35545]: pgmap v137: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 18 MiB/s wr, 494 op/s 2024-09-11T22:08:45.870 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:45 smithi152 ceph-mon[31188]: pgmap v137: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 18 MiB/s wr, 494 op/s 2024-09-11T22:08:45.978 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:08:45.979 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:08:46.228 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.683+0000 7f9794d0d640 1 -- 172.21.15.152:0/2688221962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9790106f10 msgr2=0x7f979010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.683+0000 7f9794d0d640 1 --2- 172.21.15.152:0/2688221962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9790106f10 0x7f979010ea90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9780009900 tx=0x7f978002a410 comp rx=0 tx=0).stop 2024-09-11T22:08:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.683+0000 7f9794d0d640 1 -- 172.21.15.152:0/2688221962 shutdown_connections 2024-09-11T22:08:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.683+0000 7f9794d0d640 1 --2- 172.21.15.152:0/2688221962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9790106f10 0x7f979010ea90 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.683+0000 7f9794d0d640 1 --2- 172.21.15.152:0/2688221962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9790102790 0x7f97901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.683+0000 7f9794d0d640 1 --2- 172.21.15.152:0/2688221962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9790101de0 0x7f97901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.683+0000 7f9794d0d640 1 -- 172.21.15.152:0/2688221962 >> 172.21.15.152:0/2688221962 conn(0x7f97900fd8c0 msgr2=0x7f97900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.683+0000 7f9794d0d640 1 -- 172.21.15.152:0/2688221962 shutdown_connections 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.683+0000 7f9794d0d640 1 -- 172.21.15.152:0/2688221962 wait complete. 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.684+0000 7f9794d0d640 1 Processor -- start 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.684+0000 7f9794d0d640 1 -- start start 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.684+0000 7f9794d0d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9790101de0 0x7f97900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.684+0000 7f9794d0d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9790102790 0x7f9790074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.684+0000 7f9794d0d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9790106f10 0x7f9790074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.684+0000 7f9794d0d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9790111fc0 con 0x7f9790102790 2024-09-11T22:08:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.684+0000 7f9794d0d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9790111e40 con 0x7f9790101de0 2024-09-11T22:08:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.684+0000 7f9794d0d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9790112140 con 0x7f9790106f10 2024-09-11T22:08:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f978dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9790102790 0x7f9790074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f978dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9790102790 0x7f9790074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35424/0 (socket says 172.21.15.152:35424) 2024-09-11T22:08:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f978dd9b640 1 -- 172.21.15.152:0/2566548838 learned_addr learned my addr 172.21.15.152:0/2566548838 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f978e59c640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9790101de0 0x7f97900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f978ed9d640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9790106f10 0x7f9790074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f978dd9b640 1 -- 172.21.15.152:0/2566548838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9790106f10 msgr2=0x7f9790074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f978dd9b640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9790106f10 0x7f9790074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f978dd9b640 1 -- 172.21.15.152:0/2566548838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9790101de0 msgr2=0x7f97900744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f978dd9b640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9790101de0 0x7f97900744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:46.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f978dd9b640 1 -- 172.21.15.152:0/2566548838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97901a6820 con 0x7f9790102790 2024-09-11T22:08:46.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f978dd9b640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9790102790 0x7f9790074a30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f977800c970 tx=0x7f977800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:46.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f97877fe640 1 -- 172.21.15.152:0/2566548838 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778007bb0 con 0x7f9790102790 2024-09-11T22:08:46.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f97877fe640 1 -- 172.21.15.152:0/2566548838 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9778007d50 con 0x7f9790102790 2024-09-11T22:08:46.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f9794d0d640 1 -- 172.21.15.152:0/2566548838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97901a6b10 con 0x7f9790102790 2024-09-11T22:08:46.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f97877fe640 1 -- 172.21.15.152:0/2566548838 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977800f450 con 0x7f9790102790 2024-09-11T22:08:46.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.685+0000 7f9794d0d640 1 -- 172.21.15.152:0/2566548838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97901a7000 con 0x7f9790102790 2024-09-11T22:08:46.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.686+0000 7f9794d0d640 1 -- 172.21.15.152:0/2566548838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97901021c0 con 0x7f9790102790 2024-09-11T22:08:46.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.687+0000 7f97877fe640 1 -- 172.21.15.152:0/2566548838 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9778004fc0 con 0x7f9790102790 2024-09-11T22:08:46.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.688+0000 7f97877fe640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f977c0a2cf0 0x7f977c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:46.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.688+0000 7f978e59c640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f977c0a2cf0 0x7f977c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:46.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.688+0000 7f97877fe640 1 -- 172.21.15.152:0/2566548838 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f97780cf560 con 0x7f9790102790 2024-09-11T22:08:46.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.688+0000 7f978e59c640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f977c0a2cf0 0x7f977c0a51b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9788007ec0 tx=0x7f97880075b0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:46.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.691+0000 7f97877fe640 1 -- 172.21.15.152:0/2566548838 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9778014030 con 0x7f9790102790 2024-09-11T22:08:46.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.890+0000 7f9794d0d640 1 -- 172.21.15.152:0/2566548838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97901a7300 con 0x7f9790102790 2024-09-11T22:08:46.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.890+0000 7f97877fe640 1 -- 172.21.15.152:0/2566548838 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f977809c150 con 0x7f9790102790 2024-09-11T22:08:46.892 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:08:46.892 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:08:46.892 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:08:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 -- 172.21.15.152:0/2566548838 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f977c0a2cf0 msgr2=0x7f977c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f977c0a2cf0 0x7f977c0a51b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9788007ec0 tx=0x7f97880075b0 comp rx=0 tx=0).stop 2024-09-11T22:08:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 -- 172.21.15.152:0/2566548838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9790102790 msgr2=0x7f9790074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9790102790 0x7f9790074a30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f977800c970 tx=0x7f977800ce30 comp rx=0 tx=0).stop 2024-09-11T22:08:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 -- 172.21.15.152:0/2566548838 shutdown_connections 2024-09-11T22:08:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f977c0a2cf0 0x7f977c0a51b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9790106f10 0x7f9790074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9790102790 0x7f9790074a30 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 --2- 172.21.15.152:0/2566548838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9790101de0 0x7f97900744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 -- 172.21.15.152:0/2566548838 >> 172.21.15.152:0/2566548838 conn(0x7f97900fd8c0 msgr2=0x7f97900ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 -- 172.21.15.152:0/2566548838 shutdown_connections 2024-09-11T22:08:46.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:46.893+0000 7f9794d0d640 1 -- 172.21.15.152:0/2566548838 wait complete. 2024-09-11T22:08:47.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:46 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2566548838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:47.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:46 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2566548838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:47.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:46 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2566548838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:47.782 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:08:48.031 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:48.151 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:47 smithi152 ceph-mon[31188]: pgmap v138: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 18 MiB/s wr, 494 op/s 2024-09-11T22:08:48.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:47 smithi179 ceph-mon[35603]: pgmap v138: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 18 MiB/s wr, 494 op/s 2024-09-11T22:08:48.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:47 smithi193 ceph-mon[35545]: pgmap v138: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 18 MiB/s wr, 494 op/s 2024-09-11T22:08:48.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.476+0000 7f5c85d72640 1 -- 172.21.15.152:0/2135226946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c80102790 msgr2=0x7f5c801067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:48.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.476+0000 7f5c85d72640 1 --2- 172.21.15.152:0/2135226946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c80102790 0x7f5c801067e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009ca0 tx=0x7f5c6802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.476+0000 7f5c85d72640 1 -- 172.21.15.152:0/2135226946 shutdown_connections 2024-09-11T22:08:48.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.476+0000 7f5c85d72640 1 --2- 172.21.15.152:0/2135226946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c80106f10 0x7f5c8010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.476+0000 7f5c85d72640 1 --2- 172.21.15.152:0/2135226946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c80102790 0x7f5c801067e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.476+0000 7f5c85d72640 1 --2- 172.21.15.152:0/2135226946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c80101de0 0x7f5c801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.476+0000 7f5c85d72640 1 -- 172.21.15.152:0/2135226946 >> 172.21.15.152:0/2135226946 conn(0x7f5c800fd8c0 msgr2=0x7f5c800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:48.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.476+0000 7f5c85d72640 1 -- 172.21.15.152:0/2135226946 shutdown_connections 2024-09-11T22:08:48.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.476+0000 7f5c85d72640 1 -- 172.21.15.152:0/2135226946 wait complete. 2024-09-11T22:08:48.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.476+0000 7f5c85d72640 1 Processor -- start 2024-09-11T22:08:48.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c85d72640 1 -- start start 2024-09-11T22:08:48.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c85d72640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c80101de0 0x7f5c8019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c85d72640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c80102790 0x7f5c8019acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c85d72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c80106f10 0x7f5c8019dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c85d72640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5c80111f90 con 0x7f5c80101de0 2024-09-11T22:08:48.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c85d72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5c80111e10 con 0x7f5c80106f10 2024-09-11T22:08:48.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c85d72640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c80112110 con 0x7f5c80102790 2024-09-11T22:08:48.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c7f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c80101de0 0x7f5c8019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c7f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c80101de0 0x7f5c8019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35444/0 (socket says 172.21.15.152:35444) 2024-09-11T22:08:48.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/4108935747 learned_addr learned my addr 172.21.15.152:0/4108935747 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c7effd640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c80102790 0x7f5c8019acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/4108935747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c80102790 msgr2=0x7f5c8019acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c80102790 0x7f5c8019acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/4108935747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c80106f10 msgr2=0x7f5c8019dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c7ffff640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c80106f10 0x7f5c8019dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c80106f10 0x7f5c8019dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/4108935747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8019e6e0 con 0x7f5c80101de0 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.477+0000 7f5c7ffff640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c80106f10 0x7f5c8019dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.478+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c80101de0 0x7f5c8019a790 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000d950 tx=0x7f5c7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.478+0000 7f5c7cff9640 1 -- 172.21.15.152:0/4108935747 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70017030 con 0x7f5c80101de0 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.478+0000 7f5c7cff9640 1 -- 172.21.15.152:0/4108935747 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c70004020 con 0x7f5c80101de0 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.478+0000 7f5c85d72640 1 -- 172.21.15.152:0/4108935747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c8019e9d0 con 0x7f5c80101de0 2024-09-11T22:08:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.478+0000 7f5c7cff9640 1 -- 172.21.15.152:0/4108935747 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c700047a0 con 0x7f5c80101de0 2024-09-11T22:08:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.478+0000 7f5c85d72640 1 -- 172.21.15.152:0/4108935747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c801a7340 con 0x7f5c80101de0 2024-09-11T22:08:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.480+0000 7f5c7cff9640 1 -- 172.21.15.152:0/4108935747 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f5c700041d0 con 0x7f5c80101de0 2024-09-11T22:08:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.480+0000 7f5c8814b740 1 Processor -- start 2024-09-11T22:08:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.480+0000 7f5c8814b740 1 -- start start 2024-09-11T22:08:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.480+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c80b40 0x559d29c7f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c7f5d0 0x559d29c7fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c8c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c8814b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559d29be52f0 con 0x559d29c8a370 2024-09-11T22:08:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c8814b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559d29b8ccf0 con 0x559d29c80b40 2024-09-11T22:08:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c8814b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559d29be12b0 con 0x559d29c7f5d0 2024-09-11T22:08:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7cff9640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5c6c0a2cf0 0x7f5c6c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c8c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c8c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35458/0 (socket says 172.21.15.152:35458) 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7effd640 1 -- 172.21.15.152:0/1693786568 learned_addr learned my addr 172.21.15.152:0/1693786568 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c80b40 0x559d29c7f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7ffff640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5c6c0a2cf0 0x7f5c6c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7cff9640 1 -- 172.21.15.152:0/4108935747 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f5c700cef20 con 0x7f5c80101de0 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/1693786568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c7f5d0 0x559d29c7fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7effd640 1 -- 172.21.15.152:0/1693786568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c7f5d0 msgr2=0x559d29c7fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7effd640 1 --2- 172.21.15.152:0/1693786568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c7f5d0 0x559d29c7fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7effd640 1 -- 172.21.15.152:0/1693786568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c80b40 msgr2=0x559d29c7f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7effd640 1 --2- 172.21.15.152:0/1693786568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c80b40 0x559d29c7f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7effd640 1 -- 172.21.15.152:0/1693786568 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d29b713a0 con 0x559d29c8a370 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7effd640 1 --2- 172.21.15.152:0/1693786568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c8c760 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5c68005cc0 tx=0x7f5c68009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82706ba23b95542b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c7ffff640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5c6c0a2cf0 0x7f5c6c0a51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5c780154a0 tx=0x7f5c7800c450 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.481+0000 7f5c75ffb640 1 -- 172.21.15.152:0/1693786568 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68003970 con 0x559d29c8a370 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.482+0000 7f5c75ffb640 1 -- 172.21.15.152:0/1693786568 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c68036050 con 0x559d29c8a370 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.482+0000 7f5c75ffb640 1 -- 172.21.15.152:0/1693786568 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680042a0 con 0x559d29c8a370 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.482+0000 7f5c8814b740 1 -- 172.21.15.152:0/1693786568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 msgr2=0x559d29c8c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.482+0000 7f5c8814b740 1 --2- 172.21.15.152:0/1693786568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c8c760 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5c68005cc0 tx=0x7f5c68009930 comp rx=0 tx=0).stop 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.482+0000 7f5c8814b740 1 -- 172.21.15.152:0/1693786568 shutdown_connections 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.482+0000 7f5c8814b740 1 --2- 172.21.15.152:0/1693786568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c8c760 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.482+0000 7f5c8814b740 1 --2- 172.21.15.152:0/1693786568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c7f5d0 0x559d29c7fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.482+0000 7f5c8814b740 1 --2- 172.21.15.152:0/1693786568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c80b40 0x559d29c7f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.482+0000 7f5c8814b740 1 -- 172.21.15.152:0/1693786568 >> 172.21.15.152:0/1693786568 conn(0x559d29c48310 msgr2=0x559d29c7bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.482+0000 7f5c8814b740 1 -- 172.21.15.152:0/1693786568 shutdown_connections 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.482+0000 7f5c8814b740 1 -- 172.21.15.152:0/1693786568 wait complete. 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.483+0000 7f5c8814b740 1 -- start start 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.483+0000 7f5c8814b740 1 Processor -- start 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.483+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c7f5d0 0x559d29c89cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.483+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c80b40 0x559d29c86f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.483+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c874d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.483+0000 7f5c8814b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559d29c8ce90 con 0x559d29c8a370 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.483+0000 7f5c8814b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559d29ba0060 con 0x559d29c7f5d0 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.483+0000 7f5c8814b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559d29c8d010 con 0x559d29c80b40 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.483+0000 7f5c8814b740 10 client.0 _ll_register_callbacks cb 0x559d298f38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.483+0000 7f5c7ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c874d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c874d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35462/0 (socket says 172.21.15.152:35462) 2024-09-11T22:08:48.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7ffff640 1 -- 172.21.15.152:0/234461677 learned_addr learned my addr 172.21.15.152:0/234461677 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:48.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7effd640 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c80b40 0x559d29c86f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c7f5d0 0x559d29c89cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7ffff640 1 -- 172.21.15.152:0/234461677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c80b40 msgr2=0x559d29c86f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:48.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7ffff640 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c80b40 0x559d29c86f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7ffff640 1 -- 172.21.15.152:0/234461677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c7f5d0 msgr2=0x559d29c89cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:48.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7ffff640 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c7f5d0 0x559d29c89cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7ffff640 1 -- 172.21.15.152:0/234461677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d299563c0 con 0x559d29c8a370 2024-09-11T22:08:48.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7effd640 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c80b40 0x559d29c86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:48.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c7f5d0 0x559d29c89cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:48.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c7ffff640 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c874d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5c78017dc0 tx=0x7f5c7800c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81d134ab94a10ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c5effd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c5effd640 1 -- 172.21.15.152:0/234461677 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78029060 con 0x559d29c8a370 2024-09-11T22:08:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c5effd640 1 -- 172.21.15.152:0/234461677 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f5c78017df0 con 0x559d29c8a370 2024-09-11T22:08:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c8814b740 1 -- 172.21.15.152:0/234461677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c68036050 con 0x559d29c8a370 2024-09-11T22:08:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c5effd640 1 -- 172.21.15.152:0/234461677 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5c7800f040 con 0x559d29c8a370 2024-09-11T22:08:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c8814b740 10 client.16491 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.484+0000 7f5c8814b740 1 -- 172.21.15.152:0/234461677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559d29c988a0 con 0x559d29c8a370 2024-09-11T22:08:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.485+0000 7f5c5effd640 1 -- 172.21.15.152:0/234461677 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c68036050 con 0x559d29c8a370 2024-09-11T22:08:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.485+0000 7f5c5effd640 1 -- 172.21.15.152:0/234461677 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5c78016370 con 0x559d29c8a370 2024-09-11T22:08:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.485+0000 7f5c8814b740 10 client.16491 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.485+0000 7f5c8814b740 10 client.16491 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.485+0000 7f5c8814b740 20 client.16491 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.485+0000 7f5c8814b740 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559d29c99d60 0x559d29c9c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.485+0000 7f5c8814b740 4 client.16491 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.485+0000 7f5c8814b740 1 -- 172.21.15.152:0/234461677 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d29bf2860 con 0x559d29c99d60 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.485+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559d29c99d60 0x559d29c9c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.485+0000 7f5c5effd640 10 client.16491 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.485+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559d29c99d60 0x559d29c9c170 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aaf453297131030b server_cookie=23f8db69be371131 in_seq=0 out_seq=0 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.486+0000 7f5c5effd640 1 -- 172.21.15.152:0/234461677 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d29bf2860 con 0x559d29c99d60 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.486+0000 7f5c5effd640 10 client.16491 handle_command_reply: tid=0 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.486+0000 7f5c8814b740 1 client.16491 shutdown 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.486+0000 7f5c8814b740 1 -- 172.21.15.152:0/234461677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 msgr2=0x559d29c874d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.487+0000 7f5c8814b740 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c874d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5c78017dc0 tx=0x7f5c7800c130 comp rx=0 tx=0).stop 2024-09-11T22:08:48.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.487+0000 7f5c8814b740 1 -- 172.21.15.152:0/234461677 shutdown_connections 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.487+0000 7f5c8814b740 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559d29c99d60 0x559d29c9c170 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.487+0000 7f5c8814b740 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c8a370 0x559d29c874d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.487+0000 7f5c8814b740 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c80b40 0x559d29c86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.487+0000 7f5c5effd640 0 client.16491 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.487+0000 7f5c8814b740 1 --2- 172.21.15.152:0/234461677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c7f5d0 0x559d29c89cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.487+0000 7f5c8814b740 1 -- 172.21.15.152:0/234461677 >> 172.21.15.152:0/234461677 conn(0x559d29c48310 msgr2=0x559d29c81960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.487+0000 7f5c8814b740 1 -- 172.21.15.152:0/234461677 shutdown_connections 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.487+0000 7f5c8814b740 1 -- 172.21.15.152:0/234461677 wait complete. 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.487+0000 7f5c8814b740 20 client.16491 trim_cache size 0 max 16384 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c8814b740 1 Processor -- start 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c8814b740 1 -- start start 2024-09-11T22:08:48.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c96130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c80b40 0x559d29c8b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c8a370 0x559d29c8bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c8814b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5c801b23c0 con 0x559d29c7f5d0 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c8814b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5c801afc90 con 0x559d29c80b40 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c8814b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c801adae0 con 0x559d29c8a370 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c7f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c96130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c7f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c96130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35468/0 (socket says 172.21.15.152:35468) 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/984279546 learned_addr learned my addr 172.21.15.152:0/984279546 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c7effd640 1 --2- 172.21.15.152:0/984279546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c80b40 0x559d29c8b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/984279546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c8a370 msgr2=0x559d29c8bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/984279546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c8a370 0x559d29c8bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/984279546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c80b40 msgr2=0x559d29c8b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/984279546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c80b40 0x559d29c8b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/984279546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d29c7bed0 con 0x559d29c7f5d0 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.500+0000 7f5c7effd640 1 --2- 172.21.15.152:0/984279546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c80b40 0x559d29c8b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/984279546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c96130 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5c70097870 tx=0x7f5c700ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70355462399a45ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c757fa640 1 -- 172.21.15.152:0/984279546 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7009b410 con 0x559d29c7f5d0 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c757fa640 1 -- 172.21.15.152:0/984279546 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c70083070 con 0x559d29c7f5d0 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c757fa640 1 -- 172.21.15.152:0/984279546 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70097a80 con 0x559d29c7f5d0 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c8814b740 1 -- 172.21.15.152:0/984279546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 msgr2=0x559d29c96130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c8814b740 1 --2- 172.21.15.152:0/984279546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c96130 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5c70097870 tx=0x7f5c700ce040 comp rx=0 tx=0).stop 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c8814b740 1 -- 172.21.15.152:0/984279546 shutdown_connections 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c8814b740 1 --2- 172.21.15.152:0/984279546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c8a370 0x559d29c8bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c8814b740 1 --2- 172.21.15.152:0/984279546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c80b40 0x559d29c8b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c8814b740 1 --2- 172.21.15.152:0/984279546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c96130 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c8814b740 1 -- 172.21.15.152:0/984279546 >> 172.21.15.152:0/984279546 conn(0x559d29c48310 msgr2=0x559d29c85840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c8814b740 1 -- 172.21.15.152:0/984279546 shutdown_connections 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.501+0000 7f5c8814b740 1 -- 172.21.15.152:0/984279546 wait complete. 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c8814b740 1 -- start start 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c8814b740 1 Processor -- start 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c92960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c80b40 0x559d29ca12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c8814b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c8a370 0x559d29ca1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c8814b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5c801ae150 con 0x559d29c7f5d0 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c8814b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5c801af5c0 con 0x559d29c8a370 2024-09-11T22:08:48.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c8814b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c801ae820 con 0x559d29c80b40 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c8814b740 10 client.0 _ll_register_callbacks cb 0x7f5c7800c7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c7f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c92960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c7f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c92960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35472/0 (socket says 172.21.15.152:35472) 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/3666365374 learned_addr learned my addr 172.21.15.152:0/3666365374 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/3666365374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c80b40 msgr2=0x559d29ca12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/3666365374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c80b40 0x559d29ca12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/3666365374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c8a370 msgr2=0x559d29ca1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/3666365374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c8a370 0x559d29ca1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.502+0000 7f5c7f7fe640 1 -- 172.21.15.152:0/3666365374 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d29ca2030 con 0x559d29c7f5d0 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.503+0000 7f5c7f7fe640 1 --2- 172.21.15.152:0/3666365374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c92960 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5c70005fd0 tx=0x7f5c7009f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e474303cfe48e51b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.503+0000 7f5c5effd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:48.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.503+0000 7f5c5effd640 1 -- 172.21.15.152:0/3666365374 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c700b9060 con 0x559d29c7f5d0 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.503+0000 7f5c5effd640 1 -- 172.21.15.152:0/3666365374 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f5c700b4240 con 0x559d29c7f5d0 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.503+0000 7f5c8814b740 1 -- 172.21.15.152:0/3666365374 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c70083070 con 0x559d29c7f5d0 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.504+0000 7f5c5effd640 1 -- 172.21.15.152:0/3666365374 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5c70099710 con 0x559d29c7f5d0 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.504+0000 7f5c8814b740 10 client.16497 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.504+0000 7f5c8814b740 1 -- 172.21.15.152:0/3666365374 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559d29d04a10 con 0x559d29c7f5d0 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.504+0000 7f5c5effd640 1 -- 172.21.15.152:0/3666365374 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c7009b410 con 0x559d29c7f5d0 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.504+0000 7f5c5effd640 1 -- 172.21.15.152:0/3666365374 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5c700971f0 con 0x559d29c7f5d0 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.504+0000 7f5c8814b740 10 client.16497 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.504+0000 7f5c8814b740 10 client.16497 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.504+0000 7f5c8814b740 20 client.16497 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.504+0000 7f5c8814b740 1 --2- 172.21.15.152:0/3666365374 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559d29d04f20 0x559d29d07310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.504+0000 7f5c8814b740 4 client.16497 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:08:48.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.504+0000 7f5c8814b740 1 -- 172.21.15.152:0/3666365374 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5c70083070 con 0x559d29d04f20 2024-09-11T22:08:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.505+0000 7f5c7effd640 1 --2- 172.21.15.152:0/3666365374 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559d29d04f20 0x559d29d07310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.505+0000 7f5c5effd640 10 client.16497 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:08:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.505+0000 7f5c7effd640 1 --2- 172.21.15.152:0/3666365374 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559d29d04f20 0x559d29d07310 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dfef9c09d81faf15 server_cookie=55ad4e30f31d0ba5 in_seq=0 out_seq=0 2024-09-11T22:08:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.505+0000 7f5c5effd640 1 -- 172.21.15.152:0/3666365374 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5c70083070 con 0x559d29d04f20 2024-09-11T22:08:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.505+0000 7f5c5effd640 10 client.16497 handle_command_reply: tid=0 2024-09-11T22:08:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.505+0000 7f5c8814b740 1 client.16497 shutdown 2024-09-11T22:08:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.505+0000 7f5c8814b740 1 -- 172.21.15.152:0/3666365374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 msgr2=0x559d29c92960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.505+0000 7f5c8814b740 1 --2- 172.21.15.152:0/3666365374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c92960 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5c70005fd0 tx=0x7f5c7009f890 comp rx=0 tx=0).stop 2024-09-11T22:08:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c8814b740 1 -- 172.21.15.152:0/3666365374 shutdown_connections 2024-09-11T22:08:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c8814b740 1 --2- 172.21.15.152:0/3666365374 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559d29d04f20 0x559d29d07310 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c8814b740 1 --2- 172.21.15.152:0/3666365374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d29c8a370 0x559d29ca1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c8814b740 1 --2- 172.21.15.152:0/3666365374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d29c80b40 0x559d29ca12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c8814b740 1 --2- 172.21.15.152:0/3666365374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d29c7f5d0 0x559d29c92960 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c5effd640 0 client.16497 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:08:48.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c8814b740 1 -- 172.21.15.152:0/3666365374 >> 172.21.15.152:0/3666365374 conn(0x559d29c48310 msgr2=0x559d29c887d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:48.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c8814b740 1 -- 172.21.15.152:0/3666365374 shutdown_connections 2024-09-11T22:08:48.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c8814b740 1 -- 172.21.15.152:0/3666365374 wait complete. 2024-09-11T22:08:48.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c8814b740 20 client.16497 trim_cache size 0 max 16384 2024-09-11T22:08:48.526 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:08:48.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c85d72640 1 -- 172.21.15.152:0/4108935747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5c6c0a2cf0 msgr2=0x7f5c6c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:48.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c85d72640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5c6c0a2cf0 0x7f5c6c0a51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5c780154a0 tx=0x7f5c7800c450 comp rx=0 tx=0).stop 2024-09-11T22:08:48.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c85d72640 1 -- 172.21.15.152:0/4108935747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c80101de0 msgr2=0x7f5c8019a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:48.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.506+0000 7f5c85d72640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c80101de0 0x7f5c8019a790 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000d950 tx=0x7f5c7000de10 comp rx=0 tx=0).stop 2024-09-11T22:08:48.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.507+0000 7f5c85d72640 1 -- 172.21.15.152:0/4108935747 shutdown_connections 2024-09-11T22:08:48.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.507+0000 7f5c85d72640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5c6c0a2cf0 0x7f5c6c0a51b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.507+0000 7f5c85d72640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c80106f10 0x7f5c8019dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.507+0000 7f5c85d72640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c80102790 0x7f5c8019acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.507+0000 7f5c85d72640 1 --2- 172.21.15.152:0/4108935747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c80101de0 0x7f5c8019a790 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:48.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.507+0000 7f5c85d72640 1 -- 172.21.15.152:0/4108935747 >> 172.21.15.152:0/4108935747 conn(0x7f5c800fd8c0 msgr2=0x7f5c800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:48.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.507+0000 7f5c85d72640 1 -- 172.21.15.152:0/4108935747 shutdown_connections 2024-09-11T22:08:48.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:48.507+0000 7f5c85d72640 1 -- 172.21.15.152:0/4108935747 wait complete. 2024-09-11T22:08:49.308 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:08:49.559 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:49.680 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:49 smithi152 ceph-mon[31188]: pgmap v139: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 497 op/s 2024-09-11T22:08:49.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:49 smithi179 ceph-mon[35603]: pgmap v139: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 497 op/s 2024-09-11T22:08:49.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:08:49.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:49 smithi193 ceph-mon[35545]: pgmap v139: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 497 op/s 2024-09-11T22:08:50.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.027+0000 7fd6adf92640 1 -- 172.21.15.152:0/2429378107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6a8106a80 msgr2=0x7fd6a8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:50.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.027+0000 7fd6adf92640 1 --2- 172.21.15.152:0/2429378107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6a8106a80 0x7fd6a8106e60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd698009cd0 tx=0x7fd69802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.027+0000 7fd6adf92640 1 -- 172.21.15.152:0/2429378107 shutdown_connections 2024-09-11T22:08:50.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.027+0000 7fd6adf92640 1 --2- 172.21.15.152:0/2429378107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6a8101420 0x7fd6a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.027+0000 7fd6adf92640 1 --2- 172.21.15.152:0/2429378107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6a8100a80 0x7fd6a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.027+0000 7fd6adf92640 1 --2- 172.21.15.152:0/2429378107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6a8106a80 0x7fd6a8106e60 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.027+0000 7fd6adf92640 1 -- 172.21.15.152:0/2429378107 >> 172.21.15.152:0/2429378107 conn(0x7fd6a80fc7a0 msgr2=0x7fd6a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:50.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.027+0000 7fd6adf92640 1 -- 172.21.15.152:0/2429378107 shutdown_connections 2024-09-11T22:08:50.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.027+0000 7fd6adf92640 1 -- 172.21.15.152:0/2429378107 wait complete. 2024-09-11T22:08:50.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.028+0000 7fd6adf92640 1 Processor -- start 2024-09-11T22:08:50.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.028+0000 7fd6adf92640 1 -- start start 2024-09-11T22:08:50.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.028+0000 7fd6adf92640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6a8100a80 0x7fd6a8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.028+0000 7fd6adf92640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6a8101420 0x7fd6a8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.028+0000 7fd6adf92640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6a8106a80 0x7fd6a81a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.028+0000 7fd6adf92640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8110e80 con 0x7fd6a8106a80 2024-09-11T22:08:50.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.028+0000 7fd6adf92640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8110d00 con 0x7fd6a8101420 2024-09-11T22:08:50.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.028+0000 7fd6adf92640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8111000 con 0x7fd6a8100a80 2024-09-11T22:08:50.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.028+0000 7fd6a7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6a8106a80 0x7fd6a81a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.028+0000 7fd6a7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6a8106a80 0x7fd6a81a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35488/0 (socket says 172.21.15.152:35488) 2024-09-11T22:08:50.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.028+0000 7fd6a7fff640 1 -- 172.21.15.152:0/3735897789 learned_addr learned my addr 172.21.15.152:0/3735897789 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:50.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6a77fe640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6a8100a80 0x7fd6a8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6a8101420 0x7fd6a8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6a7fff640 1 -- 172.21.15.152:0/3735897789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6a8100a80 msgr2=0x7fd6a8199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:50.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6a7fff640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6a8100a80 0x7fd6a8199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6a7fff640 1 -- 172.21.15.152:0/3735897789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6a8101420 msgr2=0x7fd6a8199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:50.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6a7fff640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6a8101420 0x7fd6a8199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6a7fff640 1 -- 172.21.15.152:0/3735897789 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a81a47f0 con 0x7fd6a8106a80 2024-09-11T22:08:50.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6a7fff640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6a8106a80 0x7fd6a81a42b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000c970 tx=0x7fd6a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:50.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6a4ff9640 1 -- 172.21.15.152:0/3735897789 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0007bb0 con 0x7fd6a8106a80 2024-09-11T22:08:50.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6a4ff9640 1 -- 172.21.15.152:0/3735897789 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6a0007d50 con 0x7fd6a8106a80 2024-09-11T22:08:50.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6adf92640 1 -- 172.21.15.152:0/3735897789 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a81a49c0 con 0x7fd6a8106a80 2024-09-11T22:08:50.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6a4ff9640 1 -- 172.21.15.152:0/3735897789 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0018800 con 0x7fd6a8106a80 2024-09-11T22:08:50.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.029+0000 7fd6adf92640 1 -- 172.21.15.152:0/3735897789 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a81a4eb0 con 0x7fd6a8106a80 2024-09-11T22:08:50.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.031+0000 7fd6a4ff9640 1 -- 172.21.15.152:0/3735897789 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd6a000fa50 con 0x7fd6a8106a80 2024-09-11T22:08:50.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6b036b740 1 Processor -- start 2024-09-11T22:08:50.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6b036b740 1 -- start start 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea394a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394a5d0 0x556ea394aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 0x556ea3957760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6b036b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556ea38b02f0 con 0x556ea394bb40 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6b036b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556ea3857cf0 con 0x556ea3955370 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6b036b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556ea38ac2b0 con 0x556ea394a5d0 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6a4ff9640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6900a2cf0 0x7fd6900a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6a6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea394a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6a6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea394a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35490/0 (socket says 172.21.15.152:35490) 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/3631035660 learned_addr learned my addr 172.21.15.152:0/3631035660 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6a7fff640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6900a2cf0 0x7fd6900a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6a77fe640 1 --2- 172.21.15.152:0/3631035660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394a5d0 0x556ea394aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/3631035660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 0x556ea3957760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.032+0000 7fd6a4ff9640 1 -- 172.21.15.152:0/3735897789 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd6a00cf520 con 0x7fd6a8106a80 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.033+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/3631035660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394a5d0 msgr2=0x556ea394aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.033+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/3631035660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394a5d0 0x556ea394aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.033+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/3631035660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 msgr2=0x556ea3957760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.033+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/3631035660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 0x556ea3957760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.033+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/3631035660 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ea383c3a0 con 0x556ea394bb40 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.033+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/3631035660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea394a090 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd69c013580 tx=0x7fd69c00b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84730aaaa7b8a830 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.033+0000 7fd6a7fff640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6900a2cf0 0x7fd6900a51b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00cccf0 tx=0x7fd6a000fdf0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.033+0000 7fd68dffb640 1 -- 172.21.15.152:0/3631035660 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c019030 con 0x556ea394bb40 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.033+0000 7fd68dffb640 1 -- 172.21.15.152:0/3631035660 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd69c011920 con 0x556ea394bb40 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.033+0000 7fd68dffb640 1 -- 172.21.15.152:0/3631035660 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c00f7e0 con 0x556ea394bb40 2024-09-11T22:08:50.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.034+0000 7fd6b036b740 1 -- 172.21.15.152:0/3631035660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 msgr2=0x556ea394a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.034+0000 7fd6b036b740 1 --2- 172.21.15.152:0/3631035660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea394a090 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd69c013580 tx=0x7fd69c00b690 comp rx=0 tx=0).stop 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.034+0000 7fd6b036b740 1 -- 172.21.15.152:0/3631035660 shutdown_connections 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.034+0000 7fd6b036b740 1 --2- 172.21.15.152:0/3631035660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 0x556ea3957760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.034+0000 7fd6b036b740 1 --2- 172.21.15.152:0/3631035660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394a5d0 0x556ea394aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.034+0000 7fd6b036b740 1 --2- 172.21.15.152:0/3631035660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea394a090 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.034+0000 7fd6b036b740 1 -- 172.21.15.152:0/3631035660 >> 172.21.15.152:0/3631035660 conn(0x556ea3913310 msgr2=0x556ea3946c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.034+0000 7fd6b036b740 1 -- 172.21.15.152:0/3631035660 shutdown_connections 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.034+0000 7fd6b036b740 1 -- 172.21.15.152:0/3631035660 wait complete. 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.034+0000 7fd6b036b740 1 -- start start 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.034+0000 7fd6b036b740 1 Processor -- start 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394a5d0 0x556ea3954ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea3951f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 0x556ea39524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6b036b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556ea3958070 con 0x556ea394bb40 2024-09-11T22:08:50.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6b036b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556ea386b060 con 0x556ea3955370 2024-09-11T22:08:50.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6b036b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556ea39581f0 con 0x556ea394a5d0 2024-09-11T22:08:50.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6b036b740 10 client.0 _ll_register_callbacks cb 0x556ea35be8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:50.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea3951f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea3951f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35498/0 (socket says 172.21.15.152:35498) 2024-09-11T22:08:50.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6a77fe640 1 -- 172.21.15.152:0/1119435860 learned_addr learned my addr 172.21.15.152:0/1119435860 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:50.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394a5d0 0x556ea3954ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 0x556ea39524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6a77fe640 1 -- 172.21.15.152:0/1119435860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394a5d0 msgr2=0x556ea3954ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6a77fe640 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394a5d0 0x556ea3954ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6a77fe640 1 -- 172.21.15.152:0/1119435860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 msgr2=0x556ea39524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6a77fe640 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 0x556ea39524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6a77fe640 1 -- 172.21.15.152:0/1119435860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ea36213c0 con 0x556ea394bb40 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6a77fe640 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea3951f90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd698009cd0 tx=0x7fd698031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e6f455a1cc671f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd686ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd686ffd640 1 -- 172.21.15.152:0/1119435860 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698049060 con 0x556ea394bb40 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd686ffd640 1 -- 172.21.15.152:0/1119435860 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd698003970 con 0x556ea394bb40 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.035+0000 7fd6b036b740 1 -- 172.21.15.152:0/1119435860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd69c011920 con 0x556ea394bb40 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd686ffd640 1 -- 172.21.15.152:0/1119435860 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd698003b70 con 0x556ea394bb40 2024-09-11T22:08:50.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd6b036b740 10 client.16509 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd6b036b740 1 -- 172.21.15.152:0/1119435860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ea3963a80 con 0x556ea394bb40 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd686ffd640 1 -- 172.21.15.152:0/1119435860 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd69c011920 con 0x556ea394bb40 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd686ffd640 1 -- 172.21.15.152:0/1119435860 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd698043070 con 0x556ea394bb40 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd6b036b740 10 client.16509 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd6b036b740 10 client.16509 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd6b036b740 20 client.16509 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd6b036b740 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556ea3964f90 0x556ea39673b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd6b036b740 4 client.16509 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd6b036b740 1 -- 172.21.15.152:0/1119435860 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ea38bd860 con 0x556ea3964f90 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.036+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556ea3964f90 0x556ea39673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556ea3964f90 0x556ea39673b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=160cc60ce90a3f07 server_cookie=b8a5a784249e0465 in_seq=0 out_seq=0 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd686ffd640 10 client.16509 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:08:50.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd686ffd640 1 -- 172.21.15.152:0/1119435860 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ea38bd860 con 0x556ea3964f90 2024-09-11T22:08:50.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd686ffd640 10 client.16509 handle_command_reply: tid=0 2024-09-11T22:08:50.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd6b036b740 1 client.16509 shutdown 2024-09-11T22:08:50.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd6b036b740 1 -- 172.21.15.152:0/1119435860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 msgr2=0x556ea3951f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:50.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd6b036b740 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea3951f90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd698009cd0 tx=0x7fd698031af0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd6b036b740 1 -- 172.21.15.152:0/1119435860 shutdown_connections 2024-09-11T22:08:50.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd6b036b740 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556ea3964f90 0x556ea39673b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd6b036b740 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 0x556ea39524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd6b036b740 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394bb40 0x556ea3951f90 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd686ffd640 0 client.16509 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:08:50.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd6b036b740 1 --2- 172.21.15.152:0/1119435860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394a5d0 0x556ea3954ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.037+0000 7fd6b036b740 1 -- 172.21.15.152:0/1119435860 >> 172.21.15.152:0/1119435860 conn(0x556ea3913310 msgr2=0x556ea394c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:50.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.038+0000 7fd6b036b740 1 -- 172.21.15.152:0/1119435860 shutdown_connections 2024-09-11T22:08:50.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.038+0000 7fd6b036b740 1 -- 172.21.15.152:0/1119435860 wait complete. 2024-09-11T22:08:50.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.038+0000 7fd6b036b740 20 client.16509 trim_cache size 0 max 16384 2024-09-11T22:08:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6b036b740 1 Processor -- start 2024-09-11T22:08:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6b036b740 1 -- start start 2024-09-11T22:08:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea394a5d0 0x556ea3961310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 0x556ea396cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea3955370 0x556ea396d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6b036b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81b0160 con 0x556ea3955370 2024-09-11T22:08:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6b036b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81ada30 con 0x556ea394a5d0 2024-09-11T22:08:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6b036b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81ab880 con 0x556ea394bb40 2024-09-11T22:08:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea3955370 0x556ea396d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea3955370 0x556ea396d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35502/0 (socket says 172.21.15.152:35502) 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/2348272514 learned_addr learned my addr 172.21.15.152:0/2348272514 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/2348272514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea394a5d0 0x556ea3961310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a77fe640 1 --2- 172.21.15.152:0/2348272514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 0x556ea396cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/2348272514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 msgr2=0x556ea396cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/2348272514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 0x556ea396cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/2348272514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea394a5d0 msgr2=0x556ea3961310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/2348272514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea394a5d0 0x556ea3961310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/2348272514 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ea3947960 con 0x556ea3955370 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a77fe640 1 --2- 172.21.15.152:0/2348272514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 0x556ea396cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.051+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/2348272514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea3955370 0x556ea396d1a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd69c015010 tx=0x7fd69c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc73322cac280f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd68d7fa640 1 -- 172.21.15.152:0/2348272514 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c019040 con 0x556ea3955370 2024-09-11T22:08:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd68d7fa640 1 -- 172.21.15.152:0/2348272514 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd69c005530 con 0x556ea3955370 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd68d7fa640 1 -- 172.21.15.152:0/2348272514 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c011c10 con 0x556ea3955370 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd6b036b740 1 -- 172.21.15.152:0/2348272514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea3955370 msgr2=0x556ea396d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd6b036b740 1 --2- 172.21.15.152:0/2348272514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea3955370 0x556ea396d1a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd69c015010 tx=0x7fd69c005f30 comp rx=0 tx=0).stop 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd6b036b740 1 -- 172.21.15.152:0/2348272514 shutdown_connections 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd6b036b740 1 --2- 172.21.15.152:0/2348272514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea3955370 0x556ea396d1a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd6b036b740 1 --2- 172.21.15.152:0/2348272514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 0x556ea396cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd6b036b740 1 --2- 172.21.15.152:0/2348272514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea394a5d0 0x556ea3961310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd6b036b740 1 -- 172.21.15.152:0/2348272514 >> 172.21.15.152:0/2348272514 conn(0x556ea3913310 msgr2=0x556ea3951080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd6b036b740 1 -- 172.21.15.152:0/2348272514 shutdown_connections 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.052+0000 7fd6b036b740 1 -- 172.21.15.152:0/2348272514 wait complete. 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6b036b740 1 -- start start 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6b036b740 1 Processor -- start 2024-09-11T22:08:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394a5d0 0x556ea395d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 0x556ea395d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6b036b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 0x556ea395a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6b036b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81abef0 con 0x556ea394a5d0 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6b036b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81ad360 con 0x556ea3955370 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6b036b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81ac5c0 con 0x556ea394bb40 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6b036b740 10 client.0 _ll_register_callbacks cb 0x7fd698009820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6a6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394a5d0 0x556ea395d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6a6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394a5d0 0x556ea395d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35514/0 (socket says 172.21.15.152:35514) 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.053+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/2118830748 learned_addr learned my addr 172.21.15.152:0/2118830748 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd6a77fe640 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 0x556ea395d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/2118830748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 msgr2=0x556ea395d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 0x556ea395d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/2118830748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 msgr2=0x556ea395a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 0x556ea395a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd6a6ffd640 1 -- 172.21.15.152:0/2118830748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ea394d120 con 0x556ea394a5d0 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd6a77fe640 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 0x556ea395d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd6a6ffd640 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394a5d0 0x556ea395d480 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00b630 tx=0x7fd69c00b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a6e95c8bab1848 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd686ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd686ffd640 1 -- 172.21.15.152:0/2118830748 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c019070 con 0x556ea394a5d0 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd686ffd640 1 -- 172.21.15.152:0/2118830748 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fd69c011830 con 0x556ea394a5d0 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd6b036b740 1 -- 172.21.15.152:0/2118830748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd69c005530 con 0x556ea394a5d0 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd686ffd640 1 -- 172.21.15.152:0/2118830748 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd69c011b90 con 0x556ea394a5d0 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd6b036b740 10 client.16515 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd6b036b740 1 -- 172.21.15.152:0/2118830748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ea3952860 con 0x556ea394a5d0 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.054+0000 7fd686ffd640 1 -- 172.21.15.152:0/2118830748 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd69c005530 con 0x556ea394a5d0 2024-09-11T22:08:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.055+0000 7fd686ffd640 1 -- 172.21.15.152:0/2118830748 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd69c02d410 con 0x556ea394a5d0 2024-09-11T22:08:50.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.055+0000 7fd6b036b740 10 client.16515 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:50.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.055+0000 7fd6b036b740 10 client.16515 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:08:50.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.055+0000 7fd6b036b740 20 client.16515 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:50.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.055+0000 7fd6b036b740 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556ea39d0320 0x556ea39d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:50.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.055+0000 7fd6b036b740 4 client.16515 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:08:50.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.055+0000 7fd6b036b740 1 -- 172.21.15.152:0/2118830748 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ea38b7d70 con 0x556ea39d0320 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.055+0000 7fd6a77fe640 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556ea39d0320 0x556ea39d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.055+0000 7fd6a77fe640 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556ea39d0320 0x556ea39d2740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c54d7ff8b0e68234 server_cookie=f136c884c278a13 in_seq=0 out_seq=0 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.055+0000 7fd686ffd640 10 client.16515 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd686ffd640 1 -- 172.21.15.152:0/2118830748 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ea38b7d70 con 0x556ea39d0320 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd686ffd640 10 client.16515 handle_command_reply: tid=0 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 1 client.16515 shutdown 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 1 -- 172.21.15.152:0/2118830748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394a5d0 msgr2=0x556ea395d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394a5d0 0x556ea395d480 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00b630 tx=0x7fd69c00b470 comp rx=0 tx=0).stop 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 1 -- 172.21.15.152:0/2118830748 shutdown_connections 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x556ea39d0320 0x556ea39d2740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ea3955370 0x556ea395a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ea394bb40 0x556ea395d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd686ffd640 0 client.16515 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:08:50.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 1 --2- 172.21.15.152:0/2118830748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea394a5d0 0x556ea395d480 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 1 -- 172.21.15.152:0/2118830748 >> 172.21.15.152:0/2118830748 conn(0x556ea3913310 msgr2=0x556ea394c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:50.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 1 -- 172.21.15.152:0/2118830748 shutdown_connections 2024-09-11T22:08:50.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 1 -- 172.21.15.152:0/2118830748 wait complete. 2024-09-11T22:08:50.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.056+0000 7fd6b036b740 20 client.16515 trim_cache size 0 max 16384 2024-09-11T22:08:50.069 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:08:50.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 -- 172.21.15.152:0/3735897789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6900a2cf0 msgr2=0x7fd6900a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:50.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6900a2cf0 0x7fd6900a51b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00cccf0 tx=0x7fd6a000fdf0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 -- 172.21.15.152:0/3735897789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6a8106a80 msgr2=0x7fd6a81a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:50.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6a8106a80 0x7fd6a81a42b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000c970 tx=0x7fd6a000ce30 comp rx=0 tx=0).stop 2024-09-11T22:08:50.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 -- 172.21.15.152:0/3735897789 shutdown_connections 2024-09-11T22:08:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd6900a2cf0 0x7fd6900a51b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6a8106a80 0x7fd6a81a42b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6a8101420 0x7fd6a8199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 --2- 172.21.15.152:0/3735897789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6a8100a80 0x7fd6a8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 -- 172.21.15.152:0/3735897789 >> 172.21.15.152:0/3735897789 conn(0x7fd6a80fc7a0 msgr2=0x7fd6a80fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 -- 172.21.15.152:0/3735897789 shutdown_connections 2024-09-11T22:08:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:50.057+0000 7fd6adf92640 1 -- 172.21.15.152:0/3735897789 wait complete. 2024-09-11T22:08:50.887 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:08:51.135 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:51.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.578+0000 7fe97826a640 1 -- 172.21.15.152:0/2071242832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe970102d40 msgr2=0x7fe970103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:51.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.578+0000 7fe97826a640 1 --2- 172.21.15.152:0/2071242832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe970102d40 0x7fe970103120 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009900 tx=0x7fe96c02a480 comp rx=0 tx=0).stop 2024-09-11T22:08:51.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.578+0000 7fe97826a640 1 -- 172.21.15.152:0/2071242832 shutdown_connections 2024-09-11T22:08:51.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.578+0000 7fe97826a640 1 --2- 172.21.15.152:0/2071242832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe97010c170 0x7fe97010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.578+0000 7fe97826a640 1 --2- 172.21.15.152:0/2071242832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe970103660 0x7fe97010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.578+0000 7fe97826a640 1 --2- 172.21.15.152:0/2071242832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe970102d40 0x7fe970103120 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.578+0000 7fe97826a640 1 -- 172.21.15.152:0/2071242832 >> 172.21.15.152:0/2071242832 conn(0x7fe9700fc7a0 msgr2=0x7fe9700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.578+0000 7fe97826a640 1 -- 172.21.15.152:0/2071242832 shutdown_connections 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.578+0000 7fe97826a640 1 -- 172.21.15.152:0/2071242832 wait complete. 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe97826a640 1 Processor -- start 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe97826a640 1 -- start start 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe97826a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe970102d40 0x7fe9701009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe97826a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe970103660 0x7fe970100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe97826a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe97010c170 0x7fe970101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe97826a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe970112030 con 0x7fe970102d40 2024-09-11T22:08:51.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe97826a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe970111eb0 con 0x7fe97010c170 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe97826a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe9701121b0 con 0x7fe970103660 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe976006640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe970102d40 0x7fe9701009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe976006640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe970102d40 0x7fe9701009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35528/0 (socket says 172.21.15.152:35528) 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe976006640 1 -- 172.21.15.152:0/323619596 learned_addr learned my addr 172.21.15.152:0/323619596 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe975805640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe970103660 0x7fe970100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe976807640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe97010c170 0x7fe970101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe976006640 1 -- 172.21.15.152:0/323619596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe970103660 msgr2=0x7fe970100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe976006640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe970103660 0x7fe970100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe976006640 1 -- 172.21.15.152:0/323619596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe97010c170 msgr2=0x7fe970101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe976006640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe97010c170 0x7fe970101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe976006640 1 -- 172.21.15.152:0/323619596 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9701a6ad0 con 0x7fe970102d40 2024-09-11T22:08:51.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe975805640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe970103660 0x7fe970100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.579+0000 7fe976807640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe97010c170 0x7fe970101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.580+0000 7fe976006640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe970102d40 0x7fe9701009a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe96c005ab0 tx=0x7fe96c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.580+0000 7fe9677fe640 1 -- 172.21.15.152:0/323619596 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c03f030 con 0x7fe970102d40 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.580+0000 7fe9677fe640 1 -- 172.21.15.152:0/323619596 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe96c003ce0 con 0x7fe970102d40 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.580+0000 7fe97826a640 1 -- 172.21.15.152:0/323619596 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9701a6d60 con 0x7fe970102d40 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.580+0000 7fe9677fe640 1 -- 172.21.15.152:0/323619596 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c035070 con 0x7fe970102d40 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.580+0000 7fe97826a640 1 -- 172.21.15.152:0/323619596 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9701a71e0 con 0x7fe970102d40 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.582+0000 7fe9677fe640 1 -- 172.21.15.152:0/323619596 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe96c042030 con 0x7fe970102d40 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.582+0000 7fe97a643740 1 Processor -- start 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe97a643740 1 -- start start 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe97a643740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8ef090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe97a643740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8ef5d0 0x5603ba8efa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe97a643740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8fa370 0x5603ba8fc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe97a643740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5603ba8552f0 con 0x5603ba8f0b40 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe97a643740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5603ba7fccf0 con 0x5603ba8fa370 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe97a643740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5603ba8512b0 con 0x5603ba8ef5d0 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe976807640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe976807640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8ef090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35534/0 (socket says 172.21.15.152:35534) 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe976807640 1 -- 172.21.15.152:0/1810863256 learned_addr learned my addr 172.21.15.152:0/1810863256 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe976006640 1 --2- 172.21.15.152:0/1810863256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8ef5d0 0x5603ba8efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe975805640 1 --2- 172.21.15.152:0/1810863256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8fa370 0x5603ba8fc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe9677fe640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe95c0a2cf0 0x7fe95c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe976807640 1 -- 172.21.15.152:0/1810863256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8ef5d0 msgr2=0x5603ba8efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe976807640 1 --2- 172.21.15.152:0/1810863256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8ef5d0 0x5603ba8efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe976807640 1 -- 172.21.15.152:0/1810863256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8fa370 msgr2=0x5603ba8fc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe976807640 1 --2- 172.21.15.152:0/1810863256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8fa370 0x5603ba8fc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe976807640 1 -- 172.21.15.152:0/1810863256 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ba7e13a0 con 0x5603ba8f0b40 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe976807640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe95c0a2cf0 0x7fe95c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.583+0000 7fe9677fe640 1 -- 172.21.15.152:0/323619596 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe96c0efe40 con 0x7fe970102d40 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.584+0000 7fe976807640 1 --2- 172.21.15.152:0/1810863256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8ef090 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe96800c370 tx=0x7fe96800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5091d52bea3e7bf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.584+0000 7fe964dea640 1 -- 172.21.15.152:0/1810863256 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968016070 con 0x5603ba8f0b40 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.584+0000 7fe964dea640 1 -- 172.21.15.152:0/1810863256 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe968011d00 con 0x5603ba8f0b40 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.584+0000 7fe964dea640 1 -- 172.21.15.152:0/1810863256 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96800fba0 con 0x5603ba8f0b40 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 -- 172.21.15.152:0/1810863256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 msgr2=0x5603ba8ef090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 --2- 172.21.15.152:0/1810863256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8ef090 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe96800c370 tx=0x7fe96800c830 comp rx=0 tx=0).stop 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe976807640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe95c0a2cf0 0x7fe95c0a51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe96801d000 tx=0x7fe96801e000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:51.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 -- 172.21.15.152:0/1810863256 shutdown_connections 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 --2- 172.21.15.152:0/1810863256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8fa370 0x5603ba8fc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 --2- 172.21.15.152:0/1810863256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8ef5d0 0x5603ba8efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 --2- 172.21.15.152:0/1810863256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8ef090 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 -- 172.21.15.152:0/1810863256 >> 172.21.15.152:0/1810863256 conn(0x5603ba8b8310 msgr2=0x5603ba8ebc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 -- 172.21.15.152:0/1810863256 shutdown_connections 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 -- 172.21.15.152:0/1810863256 wait complete. 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 -- start start 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 Processor -- start 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8ef5d0 0x5603ba8f9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8fa370 0x5603ba8f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5603ba8fd070 con 0x5603ba8f0b40 2024-09-11T22:08:51.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5603ba810060 con 0x5603ba8ef5d0 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5603ba8fd1f0 con 0x5603ba8fa370 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe97a643740 10 client.0 _ll_register_callbacks cb 0x5603ba5638c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.585+0000 7fe975805640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe975805640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8f6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35544/0 (socket says 172.21.15.152:35544) 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe975805640 1 -- 172.21.15.152:0/3504744985 learned_addr learned my addr 172.21.15.152:0/3504744985 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe976006640 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8ef5d0 0x5603ba8f9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe976807640 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8fa370 0x5603ba8f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe975805640 1 -- 172.21.15.152:0/3504744985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8fa370 msgr2=0x5603ba8f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe975805640 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8fa370 0x5603ba8f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe975805640 1 -- 172.21.15.152:0/3504744985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8ef5d0 msgr2=0x5603ba8f9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe975805640 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8ef5d0 0x5603ba8f9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe975805640 1 -- 172.21.15.152:0/3504744985 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ba5c63c0 con 0x5603ba8f0b40 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe975805640 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8f6fe0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe960010500 tx=0x7fe960010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a01680e7ca83e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe959ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe959ffb640 1 -- 172.21.15.152:0/3504744985 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960018070 con 0x5603ba8f0b40 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe959ffb640 1 -- 172.21.15.152:0/3504744985 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe960014640 con 0x5603ba8f0b40 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe97a643740 1 -- 172.21.15.152:0/3504744985 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe968011d00 con 0x5603ba8f0b40 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe959ffb640 1 -- 172.21.15.152:0/3504744985 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe960024050 con 0x5603ba8f0b40 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe97a643740 10 client.16527 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.586+0000 7fe97a643740 1 -- 172.21.15.152:0/3504744985 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5603ba908b30 con 0x5603ba8f0b40 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.587+0000 7fe959ffb640 1 -- 172.21.15.152:0/3504744985 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe968011d00 con 0x5603ba8f0b40 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.587+0000 7fe959ffb640 1 -- 172.21.15.152:0/3504744985 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe9600129c0 con 0x5603ba8f0b40 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.587+0000 7fe97a643740 10 client.16527 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.587+0000 7fe97a643740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.587+0000 7fe97a643740 20 client.16527 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.587+0000 7fe97a643740 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5603ba909fe0 0x5603ba90c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.587+0000 7fe97a643740 4 client.16527 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.587+0000 7fe97a643740 1 -- 172.21.15.152:0/3504744985 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603ba862860 con 0x5603ba909fe0 2024-09-11T22:08:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.587+0000 7fe976006640 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5603ba909fe0 0x5603ba90c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe976006640 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5603ba909fe0 0x5603ba90c420 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=891b022473e9a43b server_cookie=d502e8630fc5409a in_seq=0 out_seq=0 2024-09-11T22:08:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe959ffb640 10 client.16527 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe959ffb640 1 -- 172.21.15.152:0/3504744985 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603ba862860 con 0x5603ba909fe0 2024-09-11T22:08:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe959ffb640 10 client.16527 handle_command_reply: tid=0 2024-09-11T22:08:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe97a643740 1 client.16527 shutdown 2024-09-11T22:08:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe97a643740 1 -- 172.21.15.152:0/3504744985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 msgr2=0x5603ba8f6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe97a643740 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8f6fe0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe960010500 tx=0x7fe960010900 comp rx=0 tx=0).stop 2024-09-11T22:08:51.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe97a643740 1 -- 172.21.15.152:0/3504744985 shutdown_connections 2024-09-11T22:08:51.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe97a643740 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5603ba909fe0 0x5603ba90c420 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe959ffb640 0 client.16527 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:51.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe97a643740 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8fa370 0x5603ba8f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe97a643740 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8f0b40 0x5603ba8f6fe0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe97a643740 1 --2- 172.21.15.152:0/3504744985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8ef5d0 0x5603ba8f9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe97a643740 1 -- 172.21.15.152:0/3504744985 >> 172.21.15.152:0/3504744985 conn(0x5603ba8b8310 msgr2=0x5603ba8f1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:51.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe97a643740 1 -- 172.21.15.152:0/3504744985 shutdown_connections 2024-09-11T22:08:51.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.588+0000 7fe97a643740 1 -- 172.21.15.152:0/3504744985 wait complete. 2024-09-11T22:08:51.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.589+0000 7fe97a643740 20 client.16527 trim_cache size 0 max 16384 2024-09-11T22:08:51.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.601+0000 7fe97a643740 1 Processor -- start 2024-09-11T22:08:51.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.601+0000 7fe97a643740 1 -- start start 2024-09-11T22:08:51.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.601+0000 7fe97a643740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8ef5d0 0x5603ba906310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.601+0000 7fe97a643740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8f0b40 0x5603ba8f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.601+0000 7fe97a643740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8f2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.601+0000 7fe97a643740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe9701b2540 con 0x5603ba8fa370 2024-09-11T22:08:51.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.601+0000 7fe97a643740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe9701afe10 con 0x5603ba8f0b40 2024-09-11T22:08:51.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.601+0000 7fe97a643740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe9701adc60 con 0x5603ba8ef5d0 2024-09-11T22:08:51.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe976807640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe976807640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8f2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35546/0 (socket says 172.21.15.152:35546) 2024-09-11T22:08:51.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe976807640 1 -- 172.21.15.152:0/1149092792 learned_addr learned my addr 172.21.15.152:0/1149092792 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:51.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe975805640 1 --2- 172.21.15.152:0/1149092792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8f0b40 0x5603ba8f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe976006640 1 --2- 172.21.15.152:0/1149092792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8ef5d0 0x5603ba906310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe976807640 1 -- 172.21.15.152:0/1149092792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8ef5d0 msgr2=0x5603ba906310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:51.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe976807640 1 --2- 172.21.15.152:0/1149092792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8ef5d0 0x5603ba906310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe976807640 1 -- 172.21.15.152:0/1149092792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8f0b40 msgr2=0x5603ba8f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:51.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe976807640 1 --2- 172.21.15.152:0/1149092792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8f0b40 0x5603ba8f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe976807640 1 -- 172.21.15.152:0/1149092792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ba8ec960 con 0x5603ba8fa370 2024-09-11T22:08:51.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe976006640 1 --2- 172.21.15.152:0/1149092792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8ef5d0 0x5603ba906310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:51.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe976807640 1 --2- 172.21.15.152:0/1149092792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8f2120 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe96800f750 tx=0x7fe96800f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b34ad87d2425bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:51.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe95bfff640 1 -- 172.21.15.152:0/1149092792 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968016040 con 0x5603ba8fa370 2024-09-11T22:08:51.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe95bfff640 1 -- 172.21.15.152:0/1149092792 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe96800f8b0 con 0x5603ba8fa370 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.602+0000 7fe95bfff640 1 -- 172.21.15.152:0/1149092792 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968011d60 con 0x5603ba8fa370 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.603+0000 7fe97a643740 1 -- 172.21.15.152:0/1149092792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 msgr2=0x5603ba8f2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.603+0000 7fe97a643740 1 --2- 172.21.15.152:0/1149092792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8f2120 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe96800f750 tx=0x7fe96800f780 comp rx=0 tx=0).stop 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.603+0000 7fe97a643740 1 -- 172.21.15.152:0/1149092792 shutdown_connections 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.603+0000 7fe97a643740 1 --2- 172.21.15.152:0/1149092792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8f2120 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.603+0000 7fe97a643740 1 --2- 172.21.15.152:0/1149092792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8f0b40 0x5603ba8f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.603+0000 7fe97a643740 1 --2- 172.21.15.152:0/1149092792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8ef5d0 0x5603ba906310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.603+0000 7fe97a643740 1 -- 172.21.15.152:0/1149092792 >> 172.21.15.152:0/1149092792 conn(0x5603ba8b8310 msgr2=0x5603ba8eb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.603+0000 7fe97a643740 1 -- 172.21.15.152:0/1149092792 shutdown_connections 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.603+0000 7fe97a643740 1 -- 172.21.15.152:0/1149092792 wait complete. 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.603+0000 7fe97a643740 1 -- start start 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.603+0000 7fe97a643740 1 Processor -- start 2024-09-11T22:08:51.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe97a643740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8ef5d0 0x5603ba902c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe97a643740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8f0b40 0x5603ba8fdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe97a643740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8fe4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe97a643740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe9701ae2d0 con 0x5603ba8fa370 2024-09-11T22:08:51.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe97a643740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe9701af740 con 0x5603ba8ef5d0 2024-09-11T22:08:51.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe97a643740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe9701ae9a0 con 0x5603ba8f0b40 2024-09-11T22:08:51.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe97a643740 10 client.0 _ll_register_callbacks cb 0x7fe960007510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:51.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe976807640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8fe4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe976006640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8ef5d0 0x5603ba902c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe976807640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8fe4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35548/0 (socket says 172.21.15.152:35548) 2024-09-11T22:08:51.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe976807640 1 -- 172.21.15.152:0/3383457084 learned_addr learned my addr 172.21.15.152:0/3383457084 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:51.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe975805640 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8f0b40 0x5603ba8fdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe976807640 1 -- 172.21.15.152:0/3383457084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8f0b40 msgr2=0x5603ba8fdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe976807640 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8f0b40 0x5603ba8fdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe976807640 1 -- 172.21.15.152:0/3383457084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8ef5d0 msgr2=0x5603ba902c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe976807640 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8ef5d0 0x5603ba902c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe976807640 1 -- 172.21.15.152:0/3383457084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ba8fed10 con 0x5603ba8fa370 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe976006640 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8ef5d0 0x5603ba902c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe976807640 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8fe4e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe968000f80 tx=0x7fe968004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c72d7fcbdb9a770 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe959ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.604+0000 7fe959ffb640 1 -- 172.21.15.152:0/3383457084 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968016040 con 0x5603ba8fa370 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe97a643740 1 -- 172.21.15.152:0/3383457084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe96800f8b0 con 0x5603ba8fa370 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe959ffb640 1 -- 172.21.15.152:0/3383457084 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe968011a30 con 0x5603ba8fa370 2024-09-11T22:08:51.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe959ffb640 1 -- 172.21.15.152:0/3383457084 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe968043050 con 0x5603ba8fa370 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe97a643740 10 client.16533 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe97a643740 1 -- 172.21.15.152:0/3383457084 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5603ba974cc0 con 0x5603ba8fa370 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe959ffb640 1 -- 172.21.15.152:0/3383457084 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe96800f8b0 con 0x5603ba8fa370 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe959ffb640 1 -- 172.21.15.152:0/3383457084 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe968030070 con 0x5603ba8fa370 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe97a643740 10 client.16533 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe97a643740 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe97a643740 20 client.16533 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe97a643740 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5603ba9751d0 0x5603ba9775c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe97a643740 4 client.16533 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe97a643740 1 -- 172.21.15.152:0/3383457084 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5603ba85cd70 con 0x5603ba9751d0 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.605+0000 7fe976006640 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5603ba9751d0 0x5603ba9775c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:51.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe976006640 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5603ba9751d0 0x5603ba9775c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27e4ff5436da7680 server_cookie=46e8b84215905869 in_seq=0 out_seq=0 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe959ffb640 10 client.16533 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe959ffb640 1 -- 172.21.15.152:0/3383457084 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5603ba85cd70 con 0x5603ba9751d0 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe959ffb640 10 client.16533 handle_command_reply: tid=0 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 1 client.16533 shutdown 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 1 -- 172.21.15.152:0/3383457084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 msgr2=0x5603ba8fe4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8fe4e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe968000f80 tx=0x7fe968004a40 comp rx=0 tx=0).stop 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 1 -- 172.21.15.152:0/3383457084 shutdown_connections 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5603ba9751d0 0x5603ba9775c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5603ba8fa370 0x5603ba8fe4e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba8f0b40 0x5603ba8fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 1 --2- 172.21.15.152:0/3383457084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5603ba8ef5d0 0x5603ba902c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 1 -- 172.21.15.152:0/3383457084 >> 172.21.15.152:0/3383457084 conn(0x5603ba8b8310 msgr2=0x5603ba8f8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:51.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe959ffb640 0 client.16533 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:51.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 1 -- 172.21.15.152:0/3383457084 shutdown_connections 2024-09-11T22:08:51.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 1 -- 172.21.15.152:0/3383457084 wait complete. 2024-09-11T22:08:51.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.606+0000 7fe97a643740 20 client.16533 trim_cache size 0 max 16384 2024-09-11T22:08:51.619 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:08:51.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 -- 172.21.15.152:0/323619596 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe95c0a2cf0 msgr2=0x7fe95c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:51.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe95c0a2cf0 0x7fe95c0a51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe96801d000 tx=0x7fe96801e000 comp rx=0 tx=0).stop 2024-09-11T22:08:51.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 -- 172.21.15.152:0/323619596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe970102d40 msgr2=0x7fe9701009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:51.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe970102d40 0x7fe9701009a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe96c005ab0 tx=0x7fe96c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 -- 172.21.15.152:0/323619596 shutdown_connections 2024-09-11T22:08:51.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe95c0a2cf0 0x7fe95c0a51b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe97010c170 0x7fe970101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe970103660 0x7fe970100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 --2- 172.21.15.152:0/323619596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe970102d40 0x7fe9701009a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:51.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 -- 172.21.15.152:0/323619596 >> 172.21.15.152:0/323619596 conn(0x7fe9700fc7a0 msgr2=0x7fe9700fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:51.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 -- 172.21.15.152:0/323619596 shutdown_connections 2024-09-11T22:08:51.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:51.607+0000 7fe97826a640 1 -- 172.21.15.152:0/323619596 wait complete. 2024-09-11T22:08:51.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:51 smithi179 ceph-mon[35603]: pgmap v140: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 339 op/s 2024-09-11T22:08:51.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:51 smithi193 ceph-mon[35545]: pgmap v140: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 339 op/s 2024-09-11T22:08:51.899 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:51 smithi152 ceph-mon[31188]: pgmap v140: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 339 op/s 2024-09-11T22:08:53.421 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:08:53.421 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:08:53.682 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:53.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:53 smithi152 ceph-mon[31188]: pgmap v141: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 342 op/s 2024-09-11T22:08:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:53 smithi179 ceph-mon[35603]: pgmap v141: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 342 op/s 2024-09-11T22:08:53.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:53 smithi193 ceph-mon[35545]: pgmap v141: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 342 op/s 2024-09-11T22:08:54.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.162+0000 7f59ffaa0640 1 -- 172.21.15.152:0/2065959741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f8106f10 msgr2=0x7f59f810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:54.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.162+0000 7f59ffaa0640 1 --2- 172.21.15.152:0/2065959741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f8106f10 0x7f59f810ea90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009ca0 tx=0x7f59f002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.162+0000 7f59ffaa0640 1 -- 172.21.15.152:0/2065959741 shutdown_connections 2024-09-11T22:08:54.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.162+0000 7f59ffaa0640 1 --2- 172.21.15.152:0/2065959741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f8106f10 0x7f59f810ea90 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.162+0000 7f59ffaa0640 1 --2- 172.21.15.152:0/2065959741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59f8102790 0x7f59f81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.162+0000 7f59ffaa0640 1 --2- 172.21.15.152:0/2065959741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59f8101de0 0x7f59f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.162+0000 7f59ffaa0640 1 -- 172.21.15.152:0/2065959741 >> 172.21.15.152:0/2065959741 conn(0x7f59f80fd8c0 msgr2=0x7f59f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:54.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.163+0000 7f59ffaa0640 1 -- 172.21.15.152:0/2065959741 shutdown_connections 2024-09-11T22:08:54.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.163+0000 7f59ffaa0640 1 -- 172.21.15.152:0/2065959741 wait complete. 2024-09-11T22:08:54.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59ffaa0640 1 Processor -- start 2024-09-11T22:08:54.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59ffaa0640 1 -- start start 2024-09-11T22:08:54.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59ffaa0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f8101de0 0x7f59f8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59ffaa0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59f8102790 0x7f59f81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59ffaa0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59f8106f10 0x7f59f819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59ffaa0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59f8111fb0 con 0x7f59f8101de0 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59ffaa0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f59f8111e30 con 0x7f59f8106f10 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59ffaa0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f59f8112130 con 0x7f59f8102790 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59fd83c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f8101de0 0x7f59f8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59fd83c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f8101de0 0x7f59f8198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54772/0 (socket says 172.21.15.152:54772) 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59fd83c640 1 -- 172.21.15.152:0/3866784500 learned_addr learned my addr 172.21.15.152:0/3866784500 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59fd03b640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59f8102790 0x7f59f81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59fe03d640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59f8106f10 0x7f59f819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59fd83c640 1 -- 172.21.15.152:0/3866784500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59f8102790 msgr2=0x7f59f81989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59fd83c640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59f8102790 0x7f59f81989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59fd83c640 1 -- 172.21.15.152:0/3866784500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59f8106f10 msgr2=0x7f59f819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59fd83c640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59f8106f10 0x7f59f819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59fd83c640 1 -- 172.21.15.152:0/3866784500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f819d440 con 0x7f59f8101de0 2024-09-11T22:08:54.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.164+0000 7f59fd03b640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59f8102790 0x7f59f81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:54.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.165+0000 7f59fd83c640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f8101de0 0x7f59f8198490 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c970 tx=0x7f59f400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:54.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.165+0000 7f59eeffd640 1 -- 172.21.15.152:0/3866784500 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4007bb0 con 0x7f59f8101de0 2024-09-11T22:08:54.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.165+0000 7f59eeffd640 1 -- 172.21.15.152:0/3866784500 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59f4007d50 con 0x7f59f8101de0 2024-09-11T22:08:54.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.165+0000 7f59ffaa0640 1 -- 172.21.15.152:0/3866784500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f819d730 con 0x7f59f8101de0 2024-09-11T22:08:54.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.165+0000 7f59eeffd640 1 -- 172.21.15.152:0/3866784500 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f400f450 con 0x7f59f8101de0 2024-09-11T22:08:54.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.165+0000 7f59ffaa0640 1 -- 172.21.15.152:0/3866784500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f81a5010 con 0x7f59f8101de0 2024-09-11T22:08:54.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.167+0000 7f59eeffd640 1 -- 172.21.15.152:0/3866784500 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f59f4005020 con 0x7f59f8101de0 2024-09-11T22:08:54.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f5a01e79740 1 Processor -- start 2024-09-11T22:08:54.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f5a01e79740 1 -- start start 2024-09-11T22:08:54.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d57b60 0x558e15d57f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d58480 0x558e15d62800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f59eeffd640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59e40a2d70 0x7f59e40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d62d40 0x558e15d65130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f5a01e79740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558e15cbd280 con 0x558e15d57b60 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f5a01e79740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558e15c64b10 con 0x558e15d58480 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f5a01e79740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558e15cb9240 con 0x558e15d62d40 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f59fe03d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d57b60 0x558e15d57f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f59fd03b640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59e40a2d70 0x7f59e40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f59fe03d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d57b60 0x558e15d57f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54778/0 (socket says 172.21.15.152:54778) 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f59fe03d640 1 -- 172.21.15.152:0/3409826723 learned_addr learned my addr 172.21.15.152:0/3409826723 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f59eeffd640 1 -- 172.21.15.152:0/3866784500 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f59f40cf2f0 con 0x7f59f8101de0 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f59fd83c640 1 --2- 172.21.15.152:0/3409826723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d58480 0x558e15d62800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.168+0000 7f59fe03d640 1 --2- 172.21.15.152:0/3409826723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d62d40 0x558e15d65130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.169+0000 7f59fe03d640 1 -- 172.21.15.152:0/3409826723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d62d40 msgr2=0x558e15d65130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.169+0000 7f59fe03d640 1 --2- 172.21.15.152:0/3409826723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d62d40 0x558e15d65130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.169+0000 7f59fe03d640 1 -- 172.21.15.152:0/3409826723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d58480 msgr2=0x558e15d62800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:54.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.169+0000 7f59fe03d640 1 --2- 172.21.15.152:0/3409826723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d58480 0x558e15d62800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.169+0000 7f59fe03d640 1 -- 172.21.15.152:0/3409826723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e15c711f0 con 0x558e15d57b60 2024-09-11T22:08:54.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.169+0000 7f59fd03b640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59e40a2d70 0x7f59e40a5230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f59f81088e0 tx=0x7f59e8008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:54.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.169+0000 7f59fe03d640 1 --2- 172.21.15.152:0/3409826723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d57b60 0x558e15d57f40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f59f002f540 tx=0x7f59f0009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c8c4b440b2421b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:54.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.169+0000 7f59e3fff640 1 -- 172.21.15.152:0/3409826723 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f003e070 con 0x558e15d57b60 2024-09-11T22:08:54.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.169+0000 7f59e3fff640 1 -- 172.21.15.152:0/3409826723 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59f0036050 con 0x558e15d57b60 2024-09-11T22:08:54.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.169+0000 7f59e3fff640 1 -- 172.21.15.152:0/3409826723 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0004460 con 0x558e15d57b60 2024-09-11T22:08:54.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.170+0000 7f5a01e79740 1 -- 172.21.15.152:0/3409826723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d57b60 msgr2=0x558e15d57f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:54.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.170+0000 7f5a01e79740 1 --2- 172.21.15.152:0/3409826723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d57b60 0x558e15d57f40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f59f002f540 tx=0x7f59f0009360 comp rx=0 tx=0).stop 2024-09-11T22:08:54.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.170+0000 7f5a01e79740 1 -- 172.21.15.152:0/3409826723 shutdown_connections 2024-09-11T22:08:54.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.170+0000 7f5a01e79740 1 --2- 172.21.15.152:0/3409826723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d62d40 0x558e15d65130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.170+0000 7f5a01e79740 1 --2- 172.21.15.152:0/3409826723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d58480 0x558e15d62800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.170+0000 7f5a01e79740 1 --2- 172.21.15.152:0/3409826723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d57b60 0x558e15d57f40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.170+0000 7f5a01e79740 1 -- 172.21.15.152:0/3409826723 >> 172.21.15.152:0/3409826723 conn(0x558e15d540f0 msgr2=0x558e15d544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.170+0000 7f5a01e79740 1 -- 172.21.15.152:0/3409826723 shutdown_connections 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.170+0000 7f5a01e79740 1 -- 172.21.15.152:0/3409826723 wait complete. 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.170+0000 7f5a01e79740 1 -- start start 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f5a01e79740 1 Processor -- start 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d57b60 0x558e15d5fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 0x558e15d60700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f5a01e79740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558e15d65790 con 0x558e15d58480 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f5a01e79740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558e15c77f10 con 0x558e15d62d40 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f5a01e79740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558e15d65910 con 0x558e15d57b60 2024-09-11T22:08:54.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f5a01e79740 10 client.0 _ll_register_callbacks cb 0x558e15c40a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f59fd03b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f59fd03b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54788/0 (socket says 172.21.15.152:54788) 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f59fd03b640 1 -- 172.21.15.152:0/1594773283 learned_addr learned my addr 172.21.15.152:0/1594773283 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f59fd83c640 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d57b60 0x558e15d5fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f59fe03d640 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 0x558e15d60700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f59fd03b640 1 -- 172.21.15.152:0/1594773283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d57b60 msgr2=0x558e15d5fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f59fd03b640 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d57b60 0x558e15d5fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f59fd03b640 1 -- 172.21.15.152:0/1594773283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 msgr2=0x558e15d60700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f59fd03b640 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 0x558e15d60700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f59fd03b640 1 -- 172.21.15.152:0/1594773283 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e15a2e6a0 con 0x558e15d58480 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.171+0000 7f59fe03d640 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 0x558e15d60700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f59fd03b640 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d601c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f59e800deb0 tx=0x7f59e80047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd241bc8a6c82fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f59e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f59e17fa640 1 -- 172.21.15.152:0/1594773283 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8024060 con 0x558e15d58480 2024-09-11T22:08:54.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f59e17fa640 1 -- 172.21.15.152:0/1594773283 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f59e801f400 con 0x558e15d58480 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f5a01e79740 1 -- 172.21.15.152:0/1594773283 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59f0036050 con 0x558e15d58480 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f59e17fa640 1 -- 172.21.15.152:0/1594773283 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f59e801f600 con 0x558e15d58480 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f5a01e79740 10 client.16545 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f5a01e79740 1 -- 172.21.15.152:0/1594773283 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558e15d71450 con 0x558e15d58480 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f59e17fa640 1 -- 172.21.15.152:0/1594773283 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59f0036050 con 0x558e15d58480 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f59e17fa640 1 -- 172.21.15.152:0/1594773283 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f59e8013070 con 0x558e15d58480 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f5a01e79740 10 client.16545 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f5a01e79740 10 client.16545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f5a01e79740 20 client.16545 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f5a01e79740 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558e15d72960 0x558e15d74da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f5a01e79740 4 client.16545 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:54.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.172+0000 7f5a01e79740 1 -- 172.21.15.152:0/1594773283 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e15cca7f0 con 0x558e15d72960 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.173+0000 7f59fd83c640 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558e15d72960 0x558e15d74da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.173+0000 7f59e17fa640 10 client.16545 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.173+0000 7f59fd83c640 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558e15d72960 0x558e15d74da0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18880d7ab63a315f server_cookie=65422c4ca1cda3b9 in_seq=0 out_seq=0 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f59e17fa640 1 -- 172.21.15.152:0/1594773283 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e15cca7f0 con 0x558e15d72960 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f59e17fa640 10 client.16545 handle_command_reply: tid=0 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 1 client.16545 shutdown 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 1 -- 172.21.15.152:0/1594773283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 msgr2=0x558e15d601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d601c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f59e800deb0 tx=0x7f59e80047d0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 1 -- 172.21.15.152:0/1594773283 shutdown_connections 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558e15d72960 0x558e15d74da0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 0x558e15d60700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d601c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 1 --2- 172.21.15.152:0/1594773283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d57b60 0x558e15d5fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f59e17fa640 0 client.16545 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:54.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 1 -- 172.21.15.152:0/1594773283 >> 172.21.15.152:0/1594773283 conn(0x558e15d540f0 msgr2=0x558e15d59e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:54.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 1 -- 172.21.15.152:0/1594773283 shutdown_connections 2024-09-11T22:08:54.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 1 -- 172.21.15.152:0/1594773283 wait complete. 2024-09-11T22:08:54.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.174+0000 7f5a01e79740 20 client.16545 trim_cache size 0 max 16384 2024-09-11T22:08:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.191+0000 7f5a01e79740 1 Processor -- start 2024-09-11T22:08:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.191+0000 7f5a01e79740 1 -- start start 2024-09-11T22:08:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.191+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d57b60 0x558e15d5a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.191+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d58480 0x558e15d61ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.191+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d62d40 0x558e15d7a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.191+0000 7f5a01e79740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81b02f0 con 0x558e15d62d40 2024-09-11T22:08:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.191+0000 7f5a01e79740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81adbc0 con 0x558e15d57b60 2024-09-11T22:08:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.191+0000 7f5a01e79740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81aba10 con 0x558e15d58480 2024-09-11T22:08:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.191+0000 7f59fe03d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d62d40 0x558e15d7a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.191+0000 7f59fe03d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d62d40 0x558e15d7a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54790/0 (socket says 172.21.15.152:54790) 2024-09-11T22:08:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59fe03d640 1 -- 172.21.15.152:0/37768573 learned_addr learned my addr 172.21.15.152:0/37768573 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59fd83c640 1 --2- 172.21.15.152:0/37768573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d57b60 0x558e15d5a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59fd03b640 1 --2- 172.21.15.152:0/37768573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d58480 0x558e15d61ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59fe03d640 1 -- 172.21.15.152:0/37768573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d58480 msgr2=0x558e15d61ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59fe03d640 1 --2- 172.21.15.152:0/37768573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d58480 0x558e15d61ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59fe03d640 1 -- 172.21.15.152:0/37768573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d57b60 msgr2=0x558e15d5a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59fe03d640 1 --2- 172.21.15.152:0/37768573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d57b60 0x558e15d5a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59fe03d640 1 -- 172.21.15.152:0/37768573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e15d53b90 con 0x558e15d62d40 2024-09-11T22:08:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59fe03d640 1 --2- 172.21.15.152:0/37768573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d62d40 0x558e15d7a670 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f59f0006000 tx=0x7f59f0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f081b0ebe31f7d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59e37fe640 1 -- 172.21.15.152:0/37768573 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f003e040 con 0x558e15d62d40 2024-09-11T22:08:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59e37fe640 1 -- 172.21.15.152:0/37768573 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59f0036050 con 0x558e15d62d40 2024-09-11T22:08:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.192+0000 7f59e37fe640 1 -- 172.21.15.152:0/37768573 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f00043c0 con 0x558e15d62d40 2024-09-11T22:08:54.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.193+0000 7f5a01e79740 1 -- 172.21.15.152:0/37768573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d62d40 msgr2=0x558e15d7a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:54.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.193+0000 7f5a01e79740 1 --2- 172.21.15.152:0/37768573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d62d40 0x558e15d7a670 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f59f0006000 tx=0x7f59f0000f40 comp rx=0 tx=0).stop 2024-09-11T22:08:54.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.193+0000 7f5a01e79740 1 -- 172.21.15.152:0/37768573 shutdown_connections 2024-09-11T22:08:54.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.193+0000 7f5a01e79740 1 --2- 172.21.15.152:0/37768573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d62d40 0x558e15d7a670 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.193+0000 7f5a01e79740 1 --2- 172.21.15.152:0/37768573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d58480 0x558e15d61ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.193+0000 7f5a01e79740 1 --2- 172.21.15.152:0/37768573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d57b60 0x558e15d5a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.193+0000 7f5a01e79740 1 -- 172.21.15.152:0/37768573 >> 172.21.15.152:0/37768573 conn(0x558e15d540f0 msgr2=0x558e15d613d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:54.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.193+0000 7f5a01e79740 1 -- 172.21.15.152:0/37768573 shutdown_connections 2024-09-11T22:08:54.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.193+0000 7f5a01e79740 1 -- 172.21.15.152:0/37768573 wait complete. 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.193+0000 7f5a01e79740 1 -- start start 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.193+0000 7f5a01e79740 1 Processor -- start 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d57b60 0x558e15d669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d66f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f5a01e79740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 0x558e15d67450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f5a01e79740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81ac080 con 0x558e15d58480 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f5a01e79740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81ad4f0 con 0x558e15d62d40 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f5a01e79740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81ac750 con 0x558e15d57b60 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f5a01e79740 10 client.0 _ll_register_callbacks cb 0x7f59e8009100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fd03b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d66f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fd03b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d66f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54792/0 (socket says 172.21.15.152:54792) 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fd03b640 1 -- 172.21.15.152:0/32011063 learned_addr learned my addr 172.21.15.152:0/32011063 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:54.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fd83c640 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d57b60 0x558e15d669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fe03d640 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 0x558e15d67450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fd03b640 1 -- 172.21.15.152:0/32011063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d57b60 msgr2=0x558e15d669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fd03b640 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d57b60 0x558e15d669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fd03b640 1 -- 172.21.15.152:0/32011063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 msgr2=0x558e15d67450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fd03b640 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 0x558e15d67450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fd03b640 1 -- 172.21.15.152:0/32011063 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e15ddc7a0 con 0x558e15d58480 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fe03d640 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 0x558e15d67450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59fd03b640 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d66f10 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f59e800e010 tx=0x7f59e8027670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330073d0f9662507 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59e17fa640 1 -- 172.21.15.152:0/32011063 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8034020 con 0x558e15d58480 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f59e17fa640 1 -- 172.21.15.152:0/32011063 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f59e801f400 con 0x558e15d58480 2024-09-11T22:08:54.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.194+0000 7f5a01e79740 1 -- 172.21.15.152:0/32011063 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59f0036050 con 0x558e15d58480 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f59e17fa640 1 -- 172.21.15.152:0/32011063 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f59e803f050 con 0x558e15d58480 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f5a01e79740 10 client.16551 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f5a01e79740 1 -- 172.21.15.152:0/32011063 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558e15ddda60 con 0x558e15d58480 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f59e17fa640 1 -- 172.21.15.152:0/32011063 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59f0036050 con 0x558e15d58480 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f59e17fa640 1 -- 172.21.15.152:0/32011063 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f59e8005c60 con 0x558e15d58480 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f5a01e79740 10 client.16551 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f5a01e79740 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f5a01e79740 20 client.16551 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f5a01e79740 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558e15dde1d0 0x558e15de05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f5a01e79740 4 client.16551 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f5a01e79740 1 -- 172.21.15.152:0/32011063 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558e15cc4d00 con 0x558e15dde1d0 2024-09-11T22:08:54.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.195+0000 7f59fd83c640 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558e15dde1d0 0x558e15de05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.196+0000 7f59e17fa640 10 client.16551 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.196+0000 7f59fd83c640 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558e15dde1d0 0x558e15de05f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de09c6b6af868a25 server_cookie=63d89187af141654 in_seq=0 out_seq=0 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f59e17fa640 1 -- 172.21.15.152:0/32011063 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558e15cc4d00 con 0x558e15dde1d0 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f59e17fa640 10 client.16551 handle_command_reply: tid=0 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 1 client.16551 shutdown 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 1 -- 172.21.15.152:0/32011063 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 msgr2=0x558e15d66f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d66f10 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f59e800e010 tx=0x7f59e8027670 comp rx=0 tx=0).stop 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 1 -- 172.21.15.152:0/32011063 shutdown_connections 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558e15dde1d0 0x558e15de05f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558e15d62d40 0x558e15d67450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f59e17fa640 0 client.16551 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558e15d58480 0x558e15d66f10 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 1 --2- 172.21.15.152:0/32011063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e15d57b60 0x558e15d669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 1 -- 172.21.15.152:0/32011063 >> 172.21.15.152:0/32011063 conn(0x558e15d540f0 msgr2=0x558e15d53270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:54.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 1 -- 172.21.15.152:0/32011063 shutdown_connections 2024-09-11T22:08:54.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 1 -- 172.21.15.152:0/32011063 wait complete. 2024-09-11T22:08:54.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.197+0000 7f5a01e79740 20 client.16551 trim_cache size 0 max 16384 2024-09-11T22:08:54.203 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:08:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:08:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "e9379b81-f19d-47d0-b25e-6bbd1ccf7c5b", 2024-09-11T22:08:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:08:54.203 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:08:54.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 -- 172.21.15.152:0/3866784500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59e40a2d70 msgr2=0x7f59e40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:54.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59e40a2d70 0x7f59e40a5230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f59f81088e0 tx=0x7f59e8008040 comp rx=0 tx=0).stop 2024-09-11T22:08:54.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 -- 172.21.15.152:0/3866784500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f8101de0 msgr2=0x7f59f8198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:54.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f8101de0 0x7f59f8198490 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c970 tx=0x7f59f400ce30 comp rx=0 tx=0).stop 2024-09-11T22:08:54.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 -- 172.21.15.152:0/3866784500 shutdown_connections 2024-09-11T22:08:54.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59e40a2d70 0x7f59e40a5230 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59f8106f10 0x7f59f819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59f8102790 0x7f59f81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 --2- 172.21.15.152:0/3866784500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f8101de0 0x7f59f8198490 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:54.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 -- 172.21.15.152:0/3866784500 >> 172.21.15.152:0/3866784500 conn(0x7f59f80fd8c0 msgr2=0x7f59f80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:54.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 -- 172.21.15.152:0/3866784500 shutdown_connections 2024-09-11T22:08:54.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:54.198+0000 7f59ffaa0640 1 -- 172.21.15.152:0/3866784500 wait complete. 2024-09-11T22:08:54.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:08:54.965 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:08:55.214 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:55.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:54 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:08:55.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:54 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:55.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:54 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:08:55.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:54 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:55.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:54 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:08:55.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:54 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:55.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:54 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:08:55.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:54 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:55.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:54 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:08:55.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:54 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:55.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:54 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:08:55.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:54 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:55.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.679+0000 7f837cd2e640 1 -- 172.21.15.152:0/104101785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8378100e20 msgr2=0x7f8378101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:55.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.679+0000 7f837cd2e640 1 --2- 172.21.15.152:0/104101785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8378100e20 0x7f8378101200 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8370009ca0 tx=0x7f837002a950 comp rx=0 tx=0).stop 2024-09-11T22:08:55.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.679+0000 7f837cd2e640 1 -- 172.21.15.152:0/104101785 shutdown_connections 2024-09-11T22:08:55.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.679+0000 7f837cd2e640 1 --2- 172.21.15.152:0/104101785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8378102ef0 0x7f837810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.679+0000 7f837cd2e640 1 --2- 172.21.15.152:0/104101785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8378102570 0x7f83781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.679+0000 7f837cd2e640 1 --2- 172.21.15.152:0/104101785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8378100e20 0x7f8378101200 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.679+0000 7f837cd2e640 1 -- 172.21.15.152:0/104101785 >> 172.21.15.152:0/104101785 conn(0x7f83780fc7d0 msgr2=0x7f83780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:55.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.679+0000 7f837cd2e640 1 -- 172.21.15.152:0/104101785 shutdown_connections 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.679+0000 7f837cd2e640 1 -- 172.21.15.152:0/104101785 wait complete. 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f837cd2e640 1 Processor -- start 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f837cd2e640 1 -- start start 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f837cd2e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8378100e20 0x7f8378198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f837cd2e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8378102570 0x7f8378198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f837cd2e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8378102ef0 0x7f837819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f837cd2e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8378112090 con 0x7f8378102570 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f837cd2e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8378111f10 con 0x7f8378102ef0 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f837cd2e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8378112210 con 0x7f8378100e20 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f8375d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8378102570 0x7f8378198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f8375d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8378102570 0x7f8378198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54822/0 (socket says 172.21.15.152:54822) 2024-09-11T22:08:55.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f8375d9b640 1 -- 172.21.15.152:0/1871227841 learned_addr learned my addr 172.21.15.152:0/1871227841 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f837659c640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8378100e20 0x7f8378198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.680+0000 7f8376d9d640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8378102ef0 0x7f837819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.681+0000 7f8375d9b640 1 -- 172.21.15.152:0/1871227841 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8378100e20 msgr2=0x7f8378198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.681+0000 7f8375d9b640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8378100e20 0x7f8378198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.681+0000 7f8375d9b640 1 -- 172.21.15.152:0/1871227841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8378102ef0 msgr2=0x7f837819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.681+0000 7f8375d9b640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8378102ef0 0x7f837819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.681+0000 7f8375d9b640 1 -- 172.21.15.152:0/1871227841 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837819d520 con 0x7f8378102570 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.681+0000 7f8375d9b640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8378102570 0x7f8378198ab0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f836000e9f0 tx=0x7f836000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.681+0000 7f836f7fe640 1 -- 172.21.15.152:0/1871227841 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836000cd80 con 0x7f8378102570 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.681+0000 7f836f7fe640 1 -- 172.21.15.152:0/1871227841 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8360010910 con 0x7f8378102570 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.681+0000 7f837cd2e640 1 -- 172.21.15.152:0/1871227841 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837819d810 con 0x7f8378102570 2024-09-11T22:08:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.681+0000 7f836f7fe640 1 -- 172.21.15.152:0/1871227841 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360018990 con 0x7f8378102570 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.681+0000 7f837cd2e640 1 -- 172.21.15.152:0/1871227841 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83781a50f0 con 0x7f8378102570 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.683+0000 7f836f7fe640 1 -- 172.21.15.152:0/1871227841 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8360010ac0 con 0x7f8378102570 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f837f107740 1 Processor -- start 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f837f107740 1 -- start start 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f837f107740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff23a0 0x5641e6ff2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f837f107740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e7001550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f837f107740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 0x5641e7003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f837f107740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5641e6f582e0 con 0x5641e6ff2cc0 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f837f107740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5641e6effce0 con 0x5641e7001a90 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f837f107740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5641e6f542a0 con 0x5641e6ff23a0 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f837659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e7001550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f836f7fe640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f83640a2cf0 0x7f83640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f837659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e7001550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54836/0 (socket says 172.21.15.152:54836) 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f837659c640 1 -- 172.21.15.152:0/1416175461 learned_addr learned my addr 172.21.15.152:0/1416175461 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.684+0000 7f8376d9d640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f83640a2cf0 0x7f83640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f8376d9d640 1 --2- 172.21.15.152:0/1416175461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff23a0 0x5641e6ff2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f836f7fe640 1 -- 172.21.15.152:0/1871227841 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f83600cf840 con 0x7f8378102570 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f8375d9b640 1 --2- 172.21.15.152:0/1416175461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 0x5641e7003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f837659c640 1 -- 172.21.15.152:0/1416175461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff23a0 msgr2=0x5641e6ff2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f837659c640 1 --2- 172.21.15.152:0/1416175461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff23a0 0x5641e6ff2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f837659c640 1 -- 172.21.15.152:0/1416175461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 msgr2=0x5641e7003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f837659c640 1 --2- 172.21.15.152:0/1416175461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 0x5641e7003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f837659c640 1 -- 172.21.15.152:0/1416175461 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e6ee4440 con 0x5641e6ff2cc0 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f8375d9b640 1 --2- 172.21.15.152:0/1416175461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 0x5641e7003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f837659c640 1 --2- 172.21.15.152:0/1416175461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e7001550 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8370009ca0 tx=0x7f8370009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e020ede3a358ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:55.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f8376d9d640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f83640a2cf0 0x7f83640a51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8368005fd0 tx=0x7f8368005cf0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:55.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f836cff9640 1 -- 172.21.15.152:0/1416175461 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370048070 con 0x5641e6ff2cc0 2024-09-11T22:08:55.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f836cff9640 1 -- 172.21.15.152:0/1416175461 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f837002f930 con 0x5641e6ff2cc0 2024-09-11T22:08:55.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.685+0000 7f836cff9640 1 -- 172.21.15.152:0/1416175461 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370034040 con 0x5641e6ff2cc0 2024-09-11T22:08:55.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.686+0000 7f837f107740 1 -- 172.21.15.152:0/1416175461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 msgr2=0x5641e7001550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:55.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.686+0000 7f837f107740 1 --2- 172.21.15.152:0/1416175461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e7001550 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8370009ca0 tx=0x7f8370009820 comp rx=0 tx=0).stop 2024-09-11T22:08:55.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.686+0000 7f837f107740 1 -- 172.21.15.152:0/1416175461 shutdown_connections 2024-09-11T22:08:55.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.686+0000 7f837f107740 1 --2- 172.21.15.152:0/1416175461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 0x5641e7003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.686+0000 7f837f107740 1 --2- 172.21.15.152:0/1416175461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e7001550 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.686+0000 7f837f107740 1 --2- 172.21.15.152:0/1416175461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff23a0 0x5641e6ff2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.686+0000 7f837f107740 1 -- 172.21.15.152:0/1416175461 >> 172.21.15.152:0/1416175461 conn(0x5641e6feea30 msgr2=0x5641e6feee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:55.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.686+0000 7f837f107740 1 -- 172.21.15.152:0/1416175461 shutdown_connections 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.686+0000 7f837f107740 1 -- 172.21.15.152:0/1416175461 wait complete. 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.686+0000 7f837f107740 1 -- start start 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f837f107740 1 Processor -- start 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f837f107740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 0x5641e7001420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f837f107740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 0x5641e6ffe6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f837f107740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e7001a90 0x5641e6ffec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f837f107740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5641e7004660 con 0x5641e7001a90 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f837f107740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5641e6f13050 con 0x5641e6ff23a0 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f837f107740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5641e70047e0 con 0x5641e6ff2cc0 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f837f107740 10 client.0 _ll_register_callbacks cb 0x5641e6f53160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f8376d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e7001a90 0x5641e6ffec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f8376d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e7001a90 0x5641e6ffec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54848/0 (socket says 172.21.15.152:54848) 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f8376d9d640 1 -- 172.21.15.152:0/2109560635 learned_addr learned my addr 172.21.15.152:0/2109560635 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f8375d9b640 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 0x5641e6ffe6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f837659c640 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 0x5641e7001420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f8376d9d640 1 -- 172.21.15.152:0/2109560635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 msgr2=0x5641e6ffe6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f8376d9d640 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 0x5641e6ffe6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f8376d9d640 1 -- 172.21.15.152:0/2109560635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 msgr2=0x5641e7001420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f8376d9d640 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 0x5641e7001420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f8376d9d640 1 -- 172.21.15.152:0/2109560635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e6cc93c0 con 0x5641e7001a90 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f8375d9b640 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 0x5641e6ffe6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f837659c640 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 0x5641e7001420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f8376d9d640 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e7001a90 0x5641e6ffec50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f836800cc80 tx=0x7f83680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b43fa604ac73605 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.687+0000 7f835dffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f835dffb640 1 -- 172.21.15.152:0/2109560635 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368026070 con 0x5641e7001a90 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f835dffb640 1 -- 172.21.15.152:0/2109560635 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8368020650 con 0x5641e7001a90 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f837f107740 1 -- 172.21.15.152:0/2109560635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f837002f930 con 0x5641e7001a90 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f835dffb640 1 -- 172.21.15.152:0/2109560635 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8368032050 con 0x5641e7001a90 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f837f107740 10 client.16563 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f837f107740 1 -- 172.21.15.152:0/2109560635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5641e7010050 con 0x5641e7001a90 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f835dffb640 1 -- 172.21.15.152:0/2109560635 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f837002f930 con 0x5641e7001a90 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f835dffb640 1 -- 172.21.15.152:0/2109560635 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f836800f620 con 0x5641e7001a90 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f837f107740 10 client.16563 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f837f107740 10 client.16563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f837f107740 20 client.16563 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f837f107740 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5641e7011460 0x5641e7013920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f837f107740 4 client.16563 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.688+0000 7f837f107740 1 -- 172.21.15.152:0/2109560635 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641e6f65850 con 0x5641e7011460 2024-09-11T22:08:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.689+0000 7f837659c640 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5641e7011460 0x5641e7013920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.689+0000 7f837659c640 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5641e7011460 0x5641e7013920 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62bc24f5d14dfcfc server_cookie=b973c990dba04255 in_seq=0 out_seq=0 2024-09-11T22:08:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.689+0000 7f835dffb640 10 client.16563 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f835dffb640 1 -- 172.21.15.152:0/2109560635 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641e6f65850 con 0x5641e7011460 2024-09-11T22:08:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f835dffb640 10 client.16563 handle_command_reply: tid=0 2024-09-11T22:08:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f837f107740 1 client.16563 shutdown 2024-09-11T22:08:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f837f107740 1 -- 172.21.15.152:0/2109560635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e7001a90 msgr2=0x5641e6ffec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f837f107740 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e7001a90 0x5641e6ffec50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f836800cc80 tx=0x7f83680046c0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f837f107740 1 -- 172.21.15.152:0/2109560635 shutdown_connections 2024-09-11T22:08:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f837f107740 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5641e7011460 0x5641e7013920 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f837f107740 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e7001a90 0x5641e6ffec50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f837f107740 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 0x5641e6ffe6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f835dffb640 0 client.16563 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f837f107740 1 --2- 172.21.15.152:0/2109560635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 0x5641e7001420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f837f107740 1 -- 172.21.15.152:0/2109560635 >> 172.21.15.152:0/2109560635 conn(0x5641e6feea30 msgr2=0x5641e6ff4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f837f107740 1 -- 172.21.15.152:0/2109560635 shutdown_connections 2024-09-11T22:08:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.690+0000 7f837f107740 1 -- 172.21.15.152:0/2109560635 wait complete. 2024-09-11T22:08:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.691+0000 7f837f107740 20 client.16563 trim_cache size 0 max 16384 2024-09-11T22:08:55.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.707+0000 7f837f107740 1 Processor -- start 2024-09-11T22:08:55.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.707+0000 7f837f107740 1 -- start start 2024-09-11T22:08:55.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.707+0000 7f837f107740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff23a0 0x5641e700d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.707+0000 7f837f107740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 0x5641e6ffcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.707+0000 7f837f107740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 0x5641e7019240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.707+0000 7f837f107740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f83781ae030 con 0x5641e6ff23a0 2024-09-11T22:08:55.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.707+0000 7f837f107740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f83781ab900 con 0x5641e7001a90 2024-09-11T22:08:55.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.707+0000 7f837f107740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f83781a9750 con 0x5641e6ff2cc0 2024-09-11T22:08:55.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.707+0000 7f837659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff23a0 0x5641e700d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.707+0000 7f837659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff23a0 0x5641e700d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54850/0 (socket says 172.21.15.152:54850) 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.707+0000 7f837659c640 1 -- 172.21.15.152:0/2168736519 learned_addr learned my addr 172.21.15.152:0/2168736519 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f8375d9b640 1 --2- 172.21.15.152:0/2168736519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 0x5641e6ffcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f837659c640 1 -- 172.21.15.152:0/2168736519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 msgr2=0x5641e6ffcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f837659c640 1 --2- 172.21.15.152:0/2168736519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 0x5641e6ffcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f837659c640 1 -- 172.21.15.152:0/2168736519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 msgr2=0x5641e7019240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f8376d9d640 1 --2- 172.21.15.152:0/2168736519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 0x5641e7019240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f837659c640 1 --2- 172.21.15.152:0/2168736519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 0x5641e7019240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f837659c640 1 -- 172.21.15.152:0/2168736519 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e6ffd680 con 0x5641e6ff23a0 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f8375d9b640 1 --2- 172.21.15.152:0/2168736519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 0x5641e6ffcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f8376d9d640 1 --2- 172.21.15.152:0/2168736519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 0x5641e7019240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f837659c640 1 --2- 172.21.15.152:0/2168736519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff23a0 0x5641e700d900 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8370003d10 tx=0x7f8370003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de68369b9e1ab60 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:55.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f835ffff640 1 -- 172.21.15.152:0/2168736519 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370048040 con 0x5641e6ff23a0 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f835ffff640 1 -- 172.21.15.152:0/2168736519 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f837004a040 con 0x5641e6ff23a0 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.708+0000 7f835ffff640 1 -- 172.21.15.152:0/2168736519 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370034040 con 0x5641e6ff23a0 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 -- 172.21.15.152:0/2168736519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff23a0 msgr2=0x5641e700d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 --2- 172.21.15.152:0/2168736519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff23a0 0x5641e700d900 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8370003d10 tx=0x7f8370003d40 comp rx=0 tx=0).stop 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 -- 172.21.15.152:0/2168736519 shutdown_connections 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 --2- 172.21.15.152:0/2168736519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e7001a90 0x5641e7019240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 --2- 172.21.15.152:0/2168736519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e6ff2cc0 0x5641e6ffcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 --2- 172.21.15.152:0/2168736519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff23a0 0x5641e700d900 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 -- 172.21.15.152:0/2168736519 >> 172.21.15.152:0/2168736519 conn(0x5641e6feea30 msgr2=0x5641e6ff9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 -- 172.21.15.152:0/2168736519 shutdown_connections 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 -- 172.21.15.152:0/2168736519 wait complete. 2024-09-11T22:08:55.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 -- start start 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 Processor -- start 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 0x5641e7005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e70060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e7001a90 0x5641e707b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f83781a9dc0 con 0x5641e6ff2cc0 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f83781ab230 con 0x5641e6ff23a0 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f83781aa490 con 0x5641e7001a90 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.709+0000 7f837f107740 10 client.0 _ll_register_callbacks cb 0x7f8368014590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f8375d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e70060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f8375d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e70060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54858/0 (socket says 172.21.15.152:54858) 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f8375d9b640 1 -- 172.21.15.152:0/1324257152 learned_addr learned my addr 172.21.15.152:0/1324257152 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f8376d9d640 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e7001a90 0x5641e707b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f837659c640 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 0x5641e7005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f8375d9b640 1 -- 172.21.15.152:0/1324257152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e7001a90 msgr2=0x5641e707b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f8375d9b640 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e7001a90 0x5641e707b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f8375d9b640 1 -- 172.21.15.152:0/1324257152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 msgr2=0x5641e7005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f8375d9b640 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 0x5641e7005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f8375d9b640 1 -- 172.21.15.152:0/1324257152 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e6ff2af0 con 0x5641e6ff2cc0 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f8376d9d640 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e7001a90 0x5641e707b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f837659c640 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 0x5641e7005b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f8375d9b640 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e70060a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f83600cd560 tx=0x7f836009b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857a40a7a46ebb60 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f835dffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f835dffb640 1 -- 172.21.15.152:0/1324257152 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360018d30 con 0x5641e6ff2cc0 2024-09-11T22:08:55.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f835dffb640 1 -- 172.21.15.152:0/1324257152 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f836009b180 con 0x5641e6ff2cc0 2024-09-11T22:08:55.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f837f107740 1 -- 172.21.15.152:0/1324257152 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f837004a040 con 0x5641e6ff2cc0 2024-09-11T22:08:55.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f835dffb640 1 -- 172.21.15.152:0/1324257152 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f83600a49a0 con 0x5641e6ff2cc0 2024-09-11T22:08:55.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f837f107740 10 client.16569 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:55.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.710+0000 7f837f107740 1 -- 172.21.15.152:0/1324257152 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5641e707c6a0 con 0x5641e6ff2cc0 2024-09-11T22:08:55.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.711+0000 7f835dffb640 1 -- 172.21.15.152:0/1324257152 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f837004a040 con 0x5641e6ff2cc0 2024-09-11T22:08:55.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.711+0000 7f835dffb640 1 -- 172.21.15.152:0/1324257152 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f836009abf0 con 0x5641e6ff2cc0 2024-09-11T22:08:55.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.711+0000 7f837f107740 10 client.16569 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:55.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.711+0000 7f837f107740 10 client.16569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:55.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.711+0000 7f837f107740 20 client.16569 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:55.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.711+0000 7f837f107740 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5641e707ce50 0x5641e707f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:55.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.711+0000 7f837f107740 4 client.16569 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:08:55.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.711+0000 7f837f107740 1 -- 172.21.15.152:0/1324257152 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5641e6f5fd60 con 0x5641e707ce50 2024-09-11T22:08:55.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.711+0000 7f837659c640 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5641e707ce50 0x5641e707f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:55.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.711+0000 7f837659c640 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5641e707ce50 0x5641e707f270 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9a141380d0043f8 server_cookie=ea25369f39b8e945 in_seq=0 out_seq=0 2024-09-11T22:08:55.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.711+0000 7f835dffb640 10 client.16569 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:55.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f835dffb640 1 -- 172.21.15.152:0/1324257152 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5641e6f5fd60 con 0x5641e707ce50 2024-09-11T22:08:55.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f835dffb640 10 client.16569 handle_command_reply: tid=0 2024-09-11T22:08:55.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 1 client.16569 shutdown 2024-09-11T22:08:55.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 1 -- 172.21.15.152:0/1324257152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 msgr2=0x5641e70060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:55.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e70060a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f83600cd560 tx=0x7f836009b780 comp rx=0 tx=0).stop 2024-09-11T22:08:55.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 1 -- 172.21.15.152:0/1324257152 shutdown_connections 2024-09-11T22:08:55.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5641e707ce50 0x5641e707f270 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641e7001a90 0x5641e707b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641e6ff2cc0 0x5641e70060a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 1 --2- 172.21.15.152:0/1324257152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641e6ff23a0 0x5641e7005b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 1 -- 172.21.15.152:0/1324257152 >> 172.21.15.152:0/1324257152 conn(0x5641e6feea30 msgr2=0x5641e6ff9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:55.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f835dffb640 0 client.16569 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:55.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 1 -- 172.21.15.152:0/1324257152 shutdown_connections 2024-09-11T22:08:55.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 1 -- 172.21.15.152:0/1324257152 wait complete. 2024-09-11T22:08:55.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.712+0000 7f837f107740 20 client.16569 trim_cache size 0 max 16384 2024-09-11T22:08:55.720 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:08:55.720 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:08:55.721 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:08:55.721 INFO:teuthology.orchestra.run.smithi152.stdout: "e9379b81-f19d-47d0-b25e-6bbd1ccf7c5b": { 2024-09-11T22:08:55.721 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:08:55.721 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "e9379b81-f19d-47d0-b25e-6bbd1ccf7c5b", 2024-09-11T22:08:55.721 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:08:55.721 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:55.721 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:55.721 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:08:55.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 -- 172.21.15.152:0/1871227841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f83640a2cf0 msgr2=0x7f83640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:55.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f83640a2cf0 0x7f83640a51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8368005fd0 tx=0x7f8368005cf0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 -- 172.21.15.152:0/1871227841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8378102570 msgr2=0x7f8378198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:55.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8378102570 0x7f8378198ab0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f836000e9f0 tx=0x7f836000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 -- 172.21.15.152:0/1871227841 shutdown_connections 2024-09-11T22:08:55.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f83640a2cf0 0x7f83640a51b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8378102ef0 0x7f837819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8378102570 0x7f8378198ab0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 --2- 172.21.15.152:0/1871227841 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8378100e20 0x7f8378198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 -- 172.21.15.152:0/1871227841 >> 172.21.15.152:0/1871227841 conn(0x7f83780fc7d0 msgr2=0x7f83780fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 -- 172.21.15.152:0/1871227841 shutdown_connections 2024-09-11T22:08:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:55.713+0000 7f837cd2e640 1 -- 172.21.15.152:0/1871227841 wait complete. 2024-09-11T22:08:56.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:55 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:08:56.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:55 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:56.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:55 smithi152 ceph-mon[31188]: pgmap v142: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-11T22:08:56.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:55 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:08:56.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:55 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:56.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:55 smithi179 ceph-mon[35603]: pgmap v142: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-11T22:08:56.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:55 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:08:56.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:55 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:08:56.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:55 smithi193 ceph-mon[35545]: pgmap v142: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-11T22:08:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.401+0000 7fe331f03640 1 -- 172.21.15.152:0/2060885964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe32c1069c0 msgr2=0x7fe32c106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.401+0000 7fe331f03640 1 --2- 172.21.15.152:0/2060885964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe32c1069c0 0x7fe32c106da0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009930 tx=0x7fe31c02a420 comp rx=0 tx=0).stop 2024-09-11T22:08:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.401+0000 7fe331f03640 1 -- 172.21.15.152:0/2060885964 shutdown_connections 2024-09-11T22:08:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.401+0000 7fe331f03640 1 --2- 172.21.15.152:0/2060885964 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe32c101350 0x7fe32c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.401+0000 7fe331f03640 1 --2- 172.21.15.152:0/2060885964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe32c1009b0 0x7fe32c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.401+0000 7fe331f03640 1 --2- 172.21.15.152:0/2060885964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe32c1069c0 0x7fe32c106da0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.401+0000 7fe331f03640 1 -- 172.21.15.152:0/2060885964 >> 172.21.15.152:0/2060885964 conn(0x7fe32c077990 msgr2=0x7fe32c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.401+0000 7fe331f03640 1 -- 172.21.15.152:0/2060885964 shutdown_connections 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.401+0000 7fe331f03640 1 -- 172.21.15.152:0/2060885964 wait complete. 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe331f03640 1 Processor -- start 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe331f03640 1 -- start start 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe331f03640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe32c1009b0 0x7fe32c199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe331f03640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe32c101350 0x7fe32c1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe331f03640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe32c1069c0 0x7fe32c1a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe331f03640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c110e00 con 0x7fe32c1009b0 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe331f03640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c110c80 con 0x7fe32c1069c0 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe331f03640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c110f80 con 0x7fe32c101350 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe32b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe32c1009b0 0x7fe32c199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe32b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe32c1009b0 0x7fe32c199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54872/0 (socket says 172.21.15.152:54872) 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe32b7fe640 1 -- 172.21.15.152:0/1172965009 learned_addr learned my addr 172.21.15.152:0/1172965009 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe323fff640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe32c101350 0x7fe32c1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.402+0000 7fe32bfff640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe32c1069c0 0x7fe32c1a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe32b7fe640 1 -- 172.21.15.152:0/1172965009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe32c101350 msgr2=0x7fe32c1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe32b7fe640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe32c101350 0x7fe32c1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe32b7fe640 1 -- 172.21.15.152:0/1172965009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe32c1069c0 msgr2=0x7fe32c1a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe32b7fe640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe32c1069c0 0x7fe32c1a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe32b7fe640 1 -- 172.21.15.152:0/1172965009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c1a4750 con 0x7fe32c1009b0 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe323fff640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe32c101350 0x7fe32c1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe32bfff640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe32c1069c0 0x7fe32c1a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe32b7fe640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe32c1009b0 0x7fe32c199190 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009230 tx=0x7fe31c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe3297fa640 1 -- 172.21.15.152:0/1172965009 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c03f030 con 0x7fe32c1009b0 2024-09-11T22:08:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe3297fa640 1 -- 172.21.15.152:0/1172965009 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe31c003ad0 con 0x7fe32c1009b0 2024-09-11T22:08:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe331f03640 1 -- 172.21.15.152:0/1172965009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32c1a4920 con 0x7fe32c1009b0 2024-09-11T22:08:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe3297fa640 1 -- 172.21.15.152:0/1172965009 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c035070 con 0x7fe32c1009b0 2024-09-11T22:08:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.403+0000 7fe331f03640 1 -- 172.21.15.152:0/1172965009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32c1a4d80 con 0x7fe32c1009b0 2024-09-11T22:08:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe334c9a740 1 Processor -- start 2024-09-11T22:08:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe3297fa640 1 -- 172.21.15.152:0/1172965009 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe31c042030 con 0x7fe32c1009b0 2024-09-11T22:08:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe334c9a740 1 -- start start 2024-09-11T22:08:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f80faf0 0x55d37f80fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f810410 0x55d37f81a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f81acb0 0x55d37f81d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe334c9a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d37f7742f0 con 0x55d37f80faf0 2024-09-11T22:08:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe334c9a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d37f71c270 con 0x55d37f810410 2024-09-11T22:08:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe334c9a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d37f7702b0 con 0x55d37f81acb0 2024-09-11T22:08:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe32bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f80faf0 0x55d37f80fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe32bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f80faf0 0x55d37f80fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54882/0 (socket says 172.21.15.152:54882) 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe32bfff640 1 -- 172.21.15.152:0/4161934663 learned_addr learned my addr 172.21.15.152:0/4161934663 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe323fff640 1 --2- 172.21.15.152:0/4161934663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f81acb0 0x55d37f81d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.406+0000 7fe32b7fe640 1 --2- 172.21.15.152:0/4161934663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f810410 0x55d37f81a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe32bfff640 1 -- 172.21.15.152:0/4161934663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f81acb0 msgr2=0x55d37f81d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe32bfff640 1 --2- 172.21.15.152:0/4161934663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f81acb0 0x55d37f81d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe32bfff640 1 -- 172.21.15.152:0/4161934663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f810410 msgr2=0x55d37f81a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe32bfff640 1 --2- 172.21.15.152:0/4161934663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f810410 0x55d37f81a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe32bfff640 1 -- 172.21.15.152:0/4161934663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d37f71b340 con 0x55d37f80faf0 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe3297fa640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3180a2da0 0x7fe3180a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe32bfff640 1 --2- 172.21.15.152:0/4161934663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f80faf0 0x55d37f80fed0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe324009e40 tx=0x7fe32400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad11f494375b2d7f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe32b7fe640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3180a2da0 0x7fe3180a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe321ffb640 1 -- 172.21.15.152:0/4161934663 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324004d20 con 0x55d37f80faf0 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe321ffb640 1 -- 172.21.15.152:0/4161934663 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe324005500 con 0x55d37f80faf0 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe321ffb640 1 -- 172.21.15.152:0/4161934663 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3240118e0 con 0x55d37f80faf0 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.407+0000 7fe3297fa640 1 -- 172.21.15.152:0/1172965009 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe31c0efb70 con 0x7fe32c1009b0 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 -- 172.21.15.152:0/4161934663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f80faf0 msgr2=0x55d37f80fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 --2- 172.21.15.152:0/4161934663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f80faf0 0x55d37f80fed0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe324009e40 tx=0x7fe32400f730 comp rx=0 tx=0).stop 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe32b7fe640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3180a2da0 0x7fe3180a5260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0ed340 tx=0x7fe31c009260 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 -- 172.21.15.152:0/4161934663 shutdown_connections 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 --2- 172.21.15.152:0/4161934663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f81acb0 0x55d37f81d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 --2- 172.21.15.152:0/4161934663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f810410 0x55d37f81a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 --2- 172.21.15.152:0/4161934663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f80faf0 0x55d37f80fed0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 -- 172.21.15.152:0/4161934663 >> 172.21.15.152:0/4161934663 conn(0x55d37f80c060 msgr2=0x55d37f80c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 -- 172.21.15.152:0/4161934663 shutdown_connections 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 -- 172.21.15.152:0/4161934663 wait complete. 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 -- start start 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 Processor -- start 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f80faf0 0x55d37f817bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f818100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.408+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f81acb0 0x55d37f818640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe334c9a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d37f81d880 con 0x55d37f810410 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe334c9a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d37f6fd290 con 0x55d37f80faf0 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe334c9a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d37f81da00 con 0x55d37f81acb0 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe334c9a740 10 client.0 _ll_register_callbacks cb 0x55d37f72e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe323fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f818100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe323fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f818100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54890/0 (socket says 172.21.15.152:54890) 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe323fff640 1 -- 172.21.15.152:0/1506577423 learned_addr learned my addr 172.21.15.152:0/1506577423 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe32bfff640 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f80faf0 0x55d37f817bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe32bfff640 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f81acb0 0x55d37f818640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe323fff640 1 -- 172.21.15.152:0/1506577423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f81acb0 msgr2=0x55d37f818640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe323fff640 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f81acb0 0x55d37f818640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe323fff640 1 -- 172.21.15.152:0/1506577423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f80faf0 msgr2=0x55d37f817bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe323fff640 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f80faf0 0x55d37f817bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe323fff640 1 -- 172.21.15.152:0/1506577423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d37f487210 con 0x55d37f810410 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe32bfff640 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f80faf0 0x55d37f817bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe323fff640 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f818100 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe314012700 tx=0x7fe314012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e98c73e262b128 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe30affd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe30affd640 1 -- 172.21.15.152:0/1506577423 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314004260 con 0x55d37f810410 2024-09-11T22:08:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe30affd640 1 -- 172.21.15.152:0/1506577423 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe314004400 con 0x55d37f810410 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe334c9a740 1 -- 172.21.15.152:0/1506577423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe324005500 con 0x55d37f810410 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe30affd640 1 -- 172.21.15.152:0/1506577423 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe3140119a0 con 0x55d37f810410 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe334c9a740 10 client.16581 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.409+0000 7fe334c9a740 1 -- 172.21.15.152:0/1506577423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d37f553620 con 0x55d37f810410 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.410+0000 7fe30affd640 1 -- 172.21.15.152:0/1506577423 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe324005500 con 0x55d37f810410 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.410+0000 7fe30affd640 1 -- 172.21.15.152:0/1506577423 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe31400f440 con 0x55d37f810410 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.410+0000 7fe334c9a740 10 client.16581 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.410+0000 7fe334c9a740 10 client.16581 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.410+0000 7fe334c9a740 20 client.16581 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.410+0000 7fe334c9a740 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d37f82ac80 0x55d37f82d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.410+0000 7fe334c9a740 4 client.16581 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.410+0000 7fe334c9a740 1 -- 172.21.15.152:0/1506577423 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d37f781a20 con 0x55d37f82ac80 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.410+0000 7fe32bfff640 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d37f82ac80 0x55d37f82d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.411+0000 7fe30affd640 10 client.16581 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.411+0000 7fe32bfff640 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d37f82ac80 0x55d37f82d070 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ffc45a95693488d server_cookie=eac53dc94ba57a0d in_seq=0 out_seq=0 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.411+0000 7fe30affd640 1 -- 172.21.15.152:0/1506577423 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d37f781a20 con 0x55d37f82ac80 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.411+0000 7fe30affd640 10 client.16581 handle_command_reply: tid=0 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.411+0000 7fe334c9a740 1 client.16581 shutdown 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe334c9a740 1 -- 172.21.15.152:0/1506577423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 msgr2=0x55d37f818100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe334c9a740 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f818100 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe314012700 tx=0x7fe314012bc0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe334c9a740 1 -- 172.21.15.152:0/1506577423 shutdown_connections 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe334c9a740 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d37f82ac80 0x55d37f82d070 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe334c9a740 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f81acb0 0x55d37f818640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe334c9a740 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f818100 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe334c9a740 1 --2- 172.21.15.152:0/1506577423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f80faf0 0x55d37f817bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe30affd640 0 client.16581 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe334c9a740 1 -- 172.21.15.152:0/1506577423 >> 172.21.15.152:0/1506577423 conn(0x55d37f80c060 msgr2=0x55d37f811dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe334c9a740 1 -- 172.21.15.152:0/1506577423 shutdown_connections 2024-09-11T22:08:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe334c9a740 1 -- 172.21.15.152:0/1506577423 wait complete. 2024-09-11T22:08:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.412+0000 7fe334c9a740 20 client.16581 trim_cache size 0 max 16384 2024-09-11T22:08:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe334c9a740 1 Processor -- start 2024-09-11T22:08:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe334c9a740 1 -- start start 2024-09-11T22:08:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f80faf0 0x55d37f819ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f810410 0x55d37f818470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f81acb0 0x55d37f832980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe334c9a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c1b0110 con 0x55d37f81acb0 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe334c9a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c1ad9e0 con 0x55d37f810410 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe334c9a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c1ab830 con 0x55d37f80faf0 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe32bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f81acb0 0x55d37f832980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe32bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f81acb0 0x55d37f832980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54896/0 (socket says 172.21.15.152:54896) 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe32bfff640 1 -- 172.21.15.152:0/1779062671 learned_addr learned my addr 172.21.15.152:0/1779062671 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe32bfff640 1 -- 172.21.15.152:0/1779062671 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f80faf0 msgr2=0x55d37f819ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe32bfff640 1 --2- 172.21.15.152:0/1779062671 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f80faf0 0x55d37f819ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe32bfff640 1 -- 172.21.15.152:0/1779062671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f810410 msgr2=0x55d37f818470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe32bfff640 1 --2- 172.21.15.152:0/1779062671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f810410 0x55d37f818470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe32bfff640 1 -- 172.21.15.152:0/1779062671 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d37f82d6f0 con 0x55d37f81acb0 2024-09-11T22:08:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.426+0000 7fe32bfff640 1 --2- 172.21.15.152:0/1779062671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f81acb0 0x55d37f832980 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe32400fc30 tx=0x7fe324009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c973cc15fceb9f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe3217fa640 1 -- 172.21.15.152:0/1779062671 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324022040 con 0x55d37f81acb0 2024-09-11T22:08:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe3217fa640 1 -- 172.21.15.152:0/1779062671 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3240054b0 con 0x55d37f81acb0 2024-09-11T22:08:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe3217fa640 1 -- 172.21.15.152:0/1779062671 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324011990 con 0x55d37f81acb0 2024-09-11T22:08:56.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe334c9a740 1 -- 172.21.15.152:0/1779062671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f81acb0 msgr2=0x55d37f832980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:56.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe334c9a740 1 --2- 172.21.15.152:0/1779062671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f81acb0 0x55d37f832980 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe32400fc30 tx=0x7fe324009740 comp rx=0 tx=0).stop 2024-09-11T22:08:56.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe334c9a740 1 -- 172.21.15.152:0/1779062671 shutdown_connections 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe334c9a740 1 --2- 172.21.15.152:0/1779062671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f81acb0 0x55d37f832980 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe334c9a740 1 --2- 172.21.15.152:0/1779062671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f810410 0x55d37f818470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe334c9a740 1 --2- 172.21.15.152:0/1779062671 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f80faf0 0x55d37f819ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe334c9a740 1 -- 172.21.15.152:0/1779062671 >> 172.21.15.152:0/1779062671 conn(0x55d37f80c060 msgr2=0x55d37f80b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe334c9a740 1 -- 172.21.15.152:0/1779062671 shutdown_connections 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.427+0000 7fe334c9a740 1 -- 172.21.15.152:0/1779062671 wait complete. 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe334c9a740 1 -- start start 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe334c9a740 1 Processor -- start 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f80faf0 0x55d37f8234e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f81e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe334c9a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f81acb0 0x55d37f81edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe334c9a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c1abea0 con 0x55d37f810410 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe334c9a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c1ad310 con 0x55d37f81acb0 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe334c9a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c1ac570 con 0x55d37f80faf0 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe334c9a740 10 client.0 _ll_register_callbacks cb 0x7fe314009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe323fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f81e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe323fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f81e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54906/0 (socket says 172.21.15.152:54906) 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe323fff640 1 -- 172.21.15.152:0/2464531446 learned_addr learned my addr 172.21.15.152:0/2464531446 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe32bfff640 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f80faf0 0x55d37f8234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe32bfff640 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f81acb0 0x55d37f81edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe323fff640 1 -- 172.21.15.152:0/2464531446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f80faf0 msgr2=0x55d37f8234e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe323fff640 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f80faf0 0x55d37f8234e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe323fff640 1 -- 172.21.15.152:0/2464531446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f81acb0 msgr2=0x55d37f81edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe323fff640 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f81acb0 0x55d37f81edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.428+0000 7fe323fff640 1 -- 172.21.15.152:0/2464531446 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d37f8072d0 con 0x55d37f810410 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe323fff640 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f81e800 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe31400f8e0 tx=0x7fe314009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead564e89455e7b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe30affd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe30affd640 1 -- 172.21.15.152:0/2464531446 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314033060 con 0x55d37f810410 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe30affd640 1 -- 172.21.15.152:0/2464531446 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe3140052e0 con 0x55d37f810410 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe334c9a740 1 -- 172.21.15.152:0/2464531446 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3240054b0 con 0x55d37f810410 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe30affd640 1 -- 172.21.15.152:0/2464531446 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe314028070 con 0x55d37f810410 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe334c9a740 10 client.16587 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe334c9a740 1 -- 172.21.15.152:0/2464531446 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d37f80d110 con 0x55d37f810410 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe30affd640 1 -- 172.21.15.152:0/2464531446 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3240054b0 con 0x55d37f810410 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe30affd640 1 -- 172.21.15.152:0/2464531446 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe314003b50 con 0x55d37f810410 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe334c9a740 10 client.16587 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe334c9a740 10 client.16587 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:08:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe334c9a740 20 client.16587 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe334c9a740 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d37f895e30 0x55d37f898250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe334c9a740 4 client.16587 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:08:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.429+0000 7fe334c9a740 1 -- 172.21.15.152:0/2464531446 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d37f77bd70 con 0x55d37f895e30 2024-09-11T22:08:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.430+0000 7fe32bfff640 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d37f895e30 0x55d37f898250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.430+0000 7fe30affd640 10 client.16587 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.430+0000 7fe32bfff640 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d37f895e30 0x55d37f898250 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fcf138dc8de0563 server_cookie=96ba73677af5b892 in_seq=0 out_seq=0 2024-09-11T22:08:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.437+0000 7fe30affd640 1 -- 172.21.15.152:0/2464531446 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d37f77bd70 con 0x55d37f895e30 2024-09-11T22:08:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.437+0000 7fe30affd640 10 client.16587 handle_command_reply: tid=0 2024-09-11T22:08:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.437+0000 7fe334c9a740 1 client.16587 shutdown 2024-09-11T22:08:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe334c9a740 1 -- 172.21.15.152:0/2464531446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 msgr2=0x55d37f81e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe334c9a740 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f81e800 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe31400f8e0 tx=0x7fe314009680 comp rx=0 tx=0).stop 2024-09-11T22:08:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe334c9a740 1 -- 172.21.15.152:0/2464531446 shutdown_connections 2024-09-11T22:08:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe334c9a740 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d37f895e30 0x55d37f898250 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe334c9a740 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d37f81acb0 0x55d37f81edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe30affd640 0 client.16587 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe334c9a740 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d37f810410 0x55d37f81e800 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe334c9a740 1 --2- 172.21.15.152:0/2464531446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d37f80faf0 0x55d37f8234e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe334c9a740 1 -- 172.21.15.152:0/2464531446 >> 172.21.15.152:0/2464531446 conn(0x55d37f80c060 msgr2=0x55d37f825b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe334c9a740 1 -- 172.21.15.152:0/2464531446 shutdown_connections 2024-09-11T22:08:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe334c9a740 1 -- 172.21.15.152:0/2464531446 wait complete. 2024-09-11T22:08:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe334c9a740 20 client.16587 trim_cache size 0 max 16384 2024-09-11T22:08:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:08:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:08:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:08:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:08:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.438+0000 7fe331f03640 1 -- 172.21.15.152:0/1172965009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3180a2da0 msgr2=0x7fe3180a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.439+0000 7fe331f03640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3180a2da0 0x7fe3180a5260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0ed340 tx=0x7fe31c009260 comp rx=0 tx=0).stop 2024-09-11T22:08:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.439+0000 7fe331f03640 1 -- 172.21.15.152:0/1172965009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe32c1009b0 msgr2=0x7fe32c199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.439+0000 7fe331f03640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe32c1009b0 0x7fe32c199190 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009230 tx=0x7fe31c004270 comp rx=0 tx=0).stop 2024-09-11T22:08:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.439+0000 7fe331f03640 1 -- 172.21.15.152:0/1172965009 shutdown_connections 2024-09-11T22:08:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.439+0000 7fe331f03640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3180a2da0 0x7fe3180a5260 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.439+0000 7fe331f03640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe32c1069c0 0x7fe32c1a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.439+0000 7fe331f03640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe32c101350 0x7fe32c1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.439+0000 7fe331f03640 1 --2- 172.21.15.152:0/1172965009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe32c1009b0 0x7fe32c199190 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.439+0000 7fe331f03640 1 -- 172.21.15.152:0/1172965009 >> 172.21.15.152:0/1172965009 conn(0x7fe32c077990 msgr2=0x7fe32c1037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.439+0000 7fe331f03640 1 -- 172.21.15.152:0/1172965009 shutdown_connections 2024-09-11T22:08:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:08:56.439+0000 7fe331f03640 1 -- 172.21.15.152:0/1172965009 wait complete. 2024-09-11T22:08:56.471 INFO:tasks.cephfs.filesystem:scrub status for tag:e9379b81-f19d-47d0-b25e-6bbd1ccf7c5b - {'path': '/', 'tag': 'e9379b81-f19d-47d0-b25e-6bbd1ccf7c5b', 'options': 'recursive,force'} 2024-09-11T22:08:57.232 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:08:57.487 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:57.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:57 smithi179 ceph-mon[35603]: pgmap v143: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-11T22:08:57.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:57 smithi193 ceph-mon[35545]: pgmap v143: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-11T22:08:57.847 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:57 smithi152 ceph-mon[31188]: pgmap v143: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-11T22:08:57.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.927+0000 7fdc71677640 1 -- 172.21.15.152:0/1940813592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc6c10c160 msgr2=0x7fdc6c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:57.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.927+0000 7fdc71677640 1 --2- 172.21.15.152:0/1940813592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc6c10c160 0x7fdc6c10e600 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009ca0 tx=0x7fdc6402a950 comp rx=0 tx=0).stop 2024-09-11T22:08:57.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.927+0000 7fdc71677640 1 -- 172.21.15.152:0/1940813592 shutdown_connections 2024-09-11T22:08:57.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.927+0000 7fdc71677640 1 --2- 172.21.15.152:0/1940813592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc6c10c160 0x7fdc6c10e600 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:57.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.927+0000 7fdc71677640 1 --2- 172.21.15.152:0/1940813592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc6c103650 0x7fdc6c10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:57.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.927+0000 7fdc71677640 1 --2- 172.21.15.152:0/1940813592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6c102d30 0x7fdc6c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:57.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.927+0000 7fdc71677640 1 -- 172.21.15.152:0/1940813592 >> 172.21.15.152:0/1940813592 conn(0x7fdc6c0fc790 msgr2=0x7fdc6c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.927+0000 7fdc71677640 1 -- 172.21.15.152:0/1940813592 shutdown_connections 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.927+0000 7fdc71677640 1 -- 172.21.15.152:0/1940813592 wait complete. 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.927+0000 7fdc71677640 1 Processor -- start 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc71677640 1 -- start start 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc71677640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc6c102d30 0x7fdc6c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc71677640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6c103650 0x7fdc6c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc71677640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc6c10c160 0x7fdc6c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc71677640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c111f60 con 0x7fdc6c10c160 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc71677640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c111de0 con 0x7fdc6c103650 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc71677640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c1120e0 con 0x7fdc6c102d30 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc6b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc6c10c160 0x7fdc6c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc6b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc6c10c160 0x7fdc6c19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54928/0 (socket says 172.21.15.152:54928) 2024-09-11T22:08:57.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc627fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6c103650 0x7fdc6c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:57.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc6b7fe640 1 -- 172.21.15.152:0/460468841 learned_addr learned my addr 172.21.15.152:0/460468841 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:57.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc6affd640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc6c102d30 0x7fdc6c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:57.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc6b7fe640 1 -- 172.21.15.152:0/460468841 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc6c102d30 msgr2=0x7fdc6c1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:57.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc6b7fe640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc6c102d30 0x7fdc6c1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:57.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc6b7fe640 1 -- 172.21.15.152:0/460468841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6c103650 msgr2=0x7fdc6c198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:57.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc6b7fe640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6c103650 0x7fdc6c198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:57.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc6b7fe640 1 -- 172.21.15.152:0/460468841 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6c19d370 con 0x7fdc6c10c160 2024-09-11T22:08:57.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.928+0000 7fdc627fc640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6c103650 0x7fdc6c198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:08:57.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.929+0000 7fdc6b7fe640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc6c10c160 0x7fdc6c19cc90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdc6402ae70 tx=0x7fdc6402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:57.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.929+0000 7fdc68ff9640 1 -- 172.21.15.152:0/460468841 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64034040 con 0x7fdc6c10c160 2024-09-11T22:08:57.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.929+0000 7fdc68ff9640 1 -- 172.21.15.152:0/460468841 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc64030920 con 0x7fdc6c10c160 2024-09-11T22:08:57.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.929+0000 7fdc71677640 1 -- 172.21.15.152:0/460468841 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc6c19d600 con 0x7fdc6c10c160 2024-09-11T22:08:57.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.929+0000 7fdc68ff9640 1 -- 172.21.15.152:0/460468841 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64045480 con 0x7fdc6c10c160 2024-09-11T22:08:57.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.929+0000 7fdc71677640 1 -- 172.21.15.152:0/460468841 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc6c1a4f40 con 0x7fdc6c10c160 2024-09-11T22:08:57.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.930+0000 7fdc71677640 1 -- 172.21.15.152:0/460468841 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc6c06b070 con 0x7fdc6c10c160 2024-09-11T22:08:57.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.931+0000 7fdc68ff9640 1 -- 172.21.15.152:0/460468841 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fdc64037020 con 0x7fdc6c10c160 2024-09-11T22:08:57.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.932+0000 7fdc68ff9640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdc580a2cf0 0x7fdc580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:57.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.932+0000 7fdc6affd640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdc580a2cf0 0x7fdc580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:57.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.932+0000 7fdc68ff9640 1 -- 172.21.15.152:0/460468841 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fdc640f0220 con 0x7fdc6c10c160 2024-09-11T22:08:57.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.932+0000 7fdc6affd640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdc580a2cf0 0x7fdc580a51b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00bbe0 tx=0x7fdc5c00b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:57.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:57.936+0000 7fdc68ff9640 1 -- 172.21.15.152:0/460468841 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc640bcf20 con 0x7fdc6c10c160 2024-09-11T22:08:58.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.139+0000 7fdc71677640 1 -- 172.21.15.152:0/460468841 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc6c1071d0 con 0x7fdc6c10c160 2024-09-11T22:08:58.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.140+0000 7fdc68ff9640 1 -- 172.21.15.152:0/460468841 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7fdc640bc820 con 0x7fdc6c10c160 2024-09-11T22:08:58.141 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:08:58.141 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:08:58.141 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:08:58.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.142+0000 7fdc71677640 1 -- 172.21.15.152:0/460468841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdc580a2cf0 msgr2=0x7fdc580a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:58.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.142+0000 7fdc71677640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdc580a2cf0 0x7fdc580a51b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00bbe0 tx=0x7fdc5c00b390 comp rx=0 tx=0).stop 2024-09-11T22:08:58.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.142+0000 7fdc71677640 1 -- 172.21.15.152:0/460468841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc6c10c160 msgr2=0x7fdc6c19cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:58.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.142+0000 7fdc71677640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc6c10c160 0x7fdc6c19cc90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdc6402ae70 tx=0x7fdc6402f5b0 comp rx=0 tx=0).stop 2024-09-11T22:08:58.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.142+0000 7fdc71677640 1 -- 172.21.15.152:0/460468841 shutdown_connections 2024-09-11T22:08:58.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.142+0000 7fdc71677640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdc580a2cf0 0x7fdc580a51b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:58.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.142+0000 7fdc71677640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc6c10c160 0x7fdc6c19cc90 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:58.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.142+0000 7fdc71677640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6c103650 0x7fdc6c198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:58.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.143+0000 7fdc71677640 1 --2- 172.21.15.152:0/460468841 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc6c102d30 0x7fdc6c1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:58.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.143+0000 7fdc71677640 1 -- 172.21.15.152:0/460468841 >> 172.21.15.152:0/460468841 conn(0x7fdc6c0fc790 msgr2=0x7fdc6c0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:58.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.143+0000 7fdc71677640 1 -- 172.21.15.152:0/460468841 shutdown_connections 2024-09-11T22:08:58.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:58.143+0000 7fdc71677640 1 -- 172.21.15.152:0/460468841 wait complete. 2024-09-11T22:08:58.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:58 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/460468841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:58.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:58 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/460468841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:58.936 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:58 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/460468841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:08:58.965 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id f0379676 --release --await' 2024-09-11T22:08:58.966 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id f0379676 --release --await 2024-09-11T22:08:59.212 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:08:59.590 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:08:59 smithi152 ceph-mon[31188]: pgmap v144: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-09-11T22:08:59.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.676+0000 7f1bc76f1640 1 -- 172.21.15.152:0/17566853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bc01027a0 msgr2=0x7f1bc01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:59.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.676+0000 7f1bc76f1640 1 --2- 172.21.15.152:0/17566853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bc01027a0 0x7f1bc01067f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009900 tx=0x7f1bb002a410 comp rx=0 tx=0).stop 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.676+0000 7f1bc76f1640 1 -- 172.21.15.152:0/17566853 shutdown_connections 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.676+0000 7f1bc76f1640 1 --2- 172.21.15.152:0/17566853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc0106f20 0x7f1bc010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.676+0000 7f1bc76f1640 1 --2- 172.21.15.152:0/17566853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bc01027a0 0x7f1bc01067f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.676+0000 7f1bc76f1640 1 --2- 172.21.15.152:0/17566853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bc0101df0 0x7f1bc01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.676+0000 7f1bc76f1640 1 -- 172.21.15.152:0/17566853 >> 172.21.15.152:0/17566853 conn(0x7f1bc00fd8f0 msgr2=0x7f1bc00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.676+0000 7f1bc76f1640 1 -- 172.21.15.152:0/17566853 shutdown_connections 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.676+0000 7f1bc76f1640 1 -- 172.21.15.152:0/17566853 wait complete. 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc76f1640 1 Processor -- start 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc76f1640 1 -- start start 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc76f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bc0101df0 0x7f1bc0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc76f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc01027a0 0x7f1bc01988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc76f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bc0106f20 0x7f1bc019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc76f1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0111f80 con 0x7f1bc0101df0 2024-09-11T22:08:59.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc76f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0111e00 con 0x7f1bc0106f20 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc76f1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0112100 con 0x7f1bc01027a0 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc548d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bc0101df0 0x7f1bc0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc548d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bc0101df0 0x7f1bc0198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54946/0 (socket says 172.21.15.152:54946) 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc548d640 1 -- 172.21.15.152:0/1810309778 learned_addr learned my addr 172.21.15.152:0/1810309778 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bc0106f20 0x7f1bc019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc4c8c640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc01027a0 0x7f1bc01988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc548d640 1 -- 172.21.15.152:0/1810309778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc01027a0 msgr2=0x7f1bc01988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc548d640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc01027a0 0x7f1bc01988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.677+0000 7f1bc548d640 1 -- 172.21.15.152:0/1810309778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bc0106f20 msgr2=0x7f1bc019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.678+0000 7f1bc548d640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bc0106f20 0x7f1bc019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.678+0000 7f1bc548d640 1 -- 172.21.15.152:0/1810309778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc019d330 con 0x7f1bc0101df0 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.678+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bc0106f20 0x7f1bc019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.678+0000 7f1bc4c8c640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc01027a0 0x7f1bc01988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:08:59.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.678+0000 7f1bc548d640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bc0101df0 0x7f1bc0198380 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c920 tx=0x7f1bbc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:59.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.678+0000 7f1bb67fc640 1 -- 172.21.15.152:0/1810309778 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc007c70 con 0x7f1bc0101df0 2024-09-11T22:08:59.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.678+0000 7f1bc76f1640 1 -- 172.21.15.152:0/1810309778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc019d620 con 0x7f1bc0101df0 2024-09-11T22:08:59.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.678+0000 7f1bb67fc640 1 -- 172.21.15.152:0/1810309778 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bbc007e10 con 0x7f1bc0101df0 2024-09-11T22:08:59.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.678+0000 7f1bb67fc640 1 -- 172.21.15.152:0/1810309778 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc018890 con 0x7f1bc0101df0 2024-09-11T22:08:59.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.678+0000 7f1bc76f1640 1 -- 172.21.15.152:0/1810309778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc01a4f00 con 0x7f1bc0101df0 2024-09-11T22:08:59.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.680+0000 7f1bb67fc640 1 -- 172.21.15.152:0/1810309778 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f1bbc018a70 con 0x7f1bc0101df0 2024-09-11T22:08:59.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.681+0000 7f1bc9aca740 1 Processor -- start 2024-09-11T22:08:59.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.681+0000 7f1bb67fc640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1bac0a2cf0 0x7f1bac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.681+0000 7f1bb67fc640 1 -- 172.21.15.152:0/1810309778 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1bbc0cf6e0 con 0x7f1bc0101df0 2024-09-11T22:08:59.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.681+0000 7f1bc9aca740 1 -- start start 2024-09-11T22:08:59.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.681+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1bac0a2cf0 0x7f1bac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d060 0x559d98a9d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d980 0x559d98aa7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98aa8240 0x559d98aaa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559d98a02620 con 0x559d98a9d060 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559d989a9e50 con 0x559d98aa8240 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559d989fe5e0 con 0x559d98a9d980 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc548d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d060 0x559d98a9d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1bac0a2cf0 0x7f1bac0a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80092f0 tx=0x7f1bb8009280 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc548d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d060 0x559d98a9d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54960/0 (socket says 172.21.15.152:54960) 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc548d640 1 -- 172.21.15.152:0/1583746746 learned_addr learned my addr 172.21.15.152:0/1583746746 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc4c8c640 1 --2- 172.21.15.152:0/1583746746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d980 0x559d98aa7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/1583746746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98aa8240 0x559d98aaa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc548d640 1 -- 172.21.15.152:0/1583746746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d980 msgr2=0x559d98aa7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:59.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc548d640 1 --2- 172.21.15.152:0/1583746746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d980 0x559d98aa7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc548d640 1 -- 172.21.15.152:0/1583746746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98aa8240 msgr2=0x559d98aaa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc548d640 1 --2- 172.21.15.152:0/1583746746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98aa8240 0x559d98aaa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc548d640 1 -- 172.21.15.152:0/1583746746 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d9899ad40 con 0x559d98a9d060 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.682+0000 7f1bc548d640 1 --2- 172.21.15.152:0/1583746746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d060 0x559d98a9d440 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc098540 tx=0x7f1bbc09c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23af8b7d2552343 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.683+0000 7f1bab7fe640 1 -- 172.21.15.152:0/1583746746 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0a47e0 con 0x559d98a9d060 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.683+0000 7f1bab7fe640 1 -- 172.21.15.152:0/1583746746 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bbc018d60 con 0x559d98a9d060 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.683+0000 7f1bab7fe640 1 -- 172.21.15.152:0/1583746746 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0a4350 con 0x559d98a9d060 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.683+0000 7f1bc9aca740 1 -- 172.21.15.152:0/1583746746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d060 msgr2=0x559d98a9d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.683+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/1583746746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d060 0x559d98a9d440 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc098540 tx=0x7f1bbc09c330 comp rx=0 tx=0).stop 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.683+0000 7f1bc9aca740 1 -- 172.21.15.152:0/1583746746 shutdown_connections 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.683+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/1583746746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98aa8240 0x559d98aaa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.683+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/1583746746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d980 0x559d98aa7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.683+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/1583746746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d060 0x559d98a9d440 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.683+0000 7f1bc9aca740 1 -- 172.21.15.152:0/1583746746 >> 172.21.15.152:0/1583746746 conn(0x559d98a995f0 msgr2=0x559d98a999d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.683+0000 7f1bc9aca740 1 -- 172.21.15.152:0/1583746746 shutdown_connections 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.684+0000 7f1bc9aca740 1 -- 172.21.15.152:0/1583746746 wait complete. 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.684+0000 7f1bc9aca740 1 -- start start 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.684+0000 7f1bc9aca740 1 Processor -- start 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.684+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d060 0x559d98aa5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.684+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d980 0x559d98aa5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.684+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aa5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.684+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559d98aaae10 con 0x559d98aa8240 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.684+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559d9898af10 con 0x559d98a9d980 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.684+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559d98aaaf90 con 0x559d98a9d060 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.684+0000 7f1bc9aca740 10 client.0 _ll_register_callbacks cb 0x559d989aedb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc5c8e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aa5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc5c8e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aa5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54970/0 (socket says 172.21.15.152:54970) 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc5c8e640 1 -- 172.21.15.152:0/3763297608 learned_addr learned my addr 172.21.15.152:0/3763297608 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc548d640 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d060 0x559d98aa5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc4c8c640 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d980 0x559d98aa5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc5c8e640 1 -- 172.21.15.152:0/3763297608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d060 msgr2=0x559d98aa5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d060 0x559d98aa5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc5c8e640 1 -- 172.21.15.152:0/3763297608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d980 msgr2=0x559d98aa5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d980 0x559d98aa5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc5c8e640 1 -- 172.21.15.152:0/3763297608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d98711580 con 0x559d98aa8240 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aa5b80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80127d0 tx=0x7f1bb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245dbaa9799d5a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1ba8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/3763297608 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8011b60 con 0x559d98aa8240 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/3763297608 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1bb8011d00 con 0x559d98aa8240 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc9aca740 1 -- 172.21.15.152:0/3763297608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bbc018d60 con 0x559d98aa8240 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/3763297608 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1bb8020430 con 0x559d98aa8240 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc9aca740 10 client.16605 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.685+0000 7f1bc9aca740 1 -- 172.21.15.152:0/3763297608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559d987db960 con 0x559d98aa8240 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.686+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/3763297608 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bbc018d60 con 0x559d98aa8240 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.686+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/3763297608 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f1bb802f070 con 0x559d98aa8240 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.686+0000 7f1bc9aca740 10 client.16605 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.686+0000 7f1bc9aca740 10 client.16605 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.686+0000 7f1bc9aca740 20 client.16605 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.686+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559d98ab7d30 0x559d98aba120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.686+0000 7f1bc9aca740 4 client.16605 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.686+0000 7f1bc9aca740 1 -- 172.21.15.152:0/3763297608 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d98a0fb90 con 0x559d98ab7d30 2024-09-11T22:08:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.686+0000 7f1bc548d640 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559d98ab7d30 0x559d98aba120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1bc548d640 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559d98ab7d30 0x559d98aba120 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92d5256883c3abdd server_cookie=9cf8da5a37adda38 in_seq=0 out_seq=0 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1ba8ff9640 10 client.16605 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/3763297608 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d98a0fb90 con 0x559d98ab7d30 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1ba8ff9640 10 client.16605 handle_command_reply: tid=0 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1bc9aca740 1 client.16605 shutdown 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1bc9aca740 1 -- 172.21.15.152:0/3763297608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 msgr2=0x559d98aa5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aa5b80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80127d0 tx=0x7f1bb8004a40 comp rx=0 tx=0).stop 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1bc9aca740 1 -- 172.21.15.152:0/3763297608 shutdown_connections 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559d98ab7d30 0x559d98aba120 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aa5b80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d980 0x559d98aa5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1ba8ff9640 0 client.16605 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/3763297608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d060 0x559d98aa5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.687+0000 7f1bc9aca740 1 -- 172.21.15.152:0/3763297608 >> 172.21.15.152:0/3763297608 conn(0x559d98a995f0 msgr2=0x559d98a9f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:59.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.688+0000 7f1bc9aca740 1 -- 172.21.15.152:0/3763297608 shutdown_connections 2024-09-11T22:08:59.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.688+0000 7f1bc9aca740 1 -- 172.21.15.152:0/3763297608 wait complete. 2024-09-11T22:08:59.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.688+0000 7f1bc9aca740 20 client.16605 trim_cache size 0 max 16384 2024-09-11T22:08:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.704+0000 7f1bc9aca740 1 Processor -- start 2024-09-11T22:08:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.704+0000 7f1bc9aca740 1 -- start start 2024-09-11T22:08:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.704+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d060 0x559d98aa6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.704+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d980 0x559d98a9fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.704+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98aa8240 0x559d98abf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.704+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01ae020 con 0x559d98a9d980 2024-09-11T22:08:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01ab8f0 con 0x559d98a9d060 2024-09-11T22:08:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01a9740 con 0x559d98aa8240 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc4c8c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d980 0x559d98a9fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc4c8c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d980 0x559d98a9fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54978/0 (socket says 172.21.15.152:54978) 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc4c8c640 1 -- 172.21.15.152:0/1258890487 learned_addr learned my addr 172.21.15.152:0/1258890487 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc548d640 1 --2- 172.21.15.152:0/1258890487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d060 0x559d98aa6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/1258890487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98aa8240 0x559d98abf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc4c8c640 1 -- 172.21.15.152:0/1258890487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98aa8240 msgr2=0x559d98abf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc4c8c640 1 --2- 172.21.15.152:0/1258890487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98aa8240 0x559d98abf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc4c8c640 1 -- 172.21.15.152:0/1258890487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d060 msgr2=0x559d98aa6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc4c8c640 1 --2- 172.21.15.152:0/1258890487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d060 0x559d98aa6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc4c8c640 1 -- 172.21.15.152:0/1258890487 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d98aba490 con 0x559d98a9d980 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1bc4c8c640 1 --2- 172.21.15.152:0/1258890487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d980 0x559d98a9fac0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009900 tx=0x7f1bb0032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d16c14f6d8aa3d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1baaffd640 1 -- 172.21.15.152:0/1258890487 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0035040 con 0x559d98a9d980 2024-09-11T22:08:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1baaffd640 1 -- 172.21.15.152:0/1258890487 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bb0004030 con 0x559d98a9d980 2024-09-11T22:08:59.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.705+0000 7f1baaffd640 1 -- 172.21.15.152:0/1258890487 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb003d760 con 0x559d98a9d980 2024-09-11T22:08:59.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.706+0000 7f1bc9aca740 1 -- 172.21.15.152:0/1258890487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d980 msgr2=0x559d98a9fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:59.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.706+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/1258890487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d980 0x559d98a9fac0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009900 tx=0x7f1bb0032f20 comp rx=0 tx=0).stop 2024-09-11T22:08:59.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.706+0000 7f1bc9aca740 1 -- 172.21.15.152:0/1258890487 shutdown_connections 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.706+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/1258890487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98aa8240 0x559d98abf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.706+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/1258890487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98a9d980 0x559d98a9fac0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.706+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/1258890487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d060 0x559d98aa6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.706+0000 7f1bc9aca740 1 -- 172.21.15.152:0/1258890487 >> 172.21.15.152:0/1258890487 conn(0x559d98a995f0 msgr2=0x559d98a98750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.706+0000 7f1bc9aca740 1 -- 172.21.15.152:0/1258890487 shutdown_connections 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.706+0000 7f1bc9aca740 1 -- 172.21.15.152:0/1258890487 wait complete. 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.706+0000 7f1bc9aca740 1 -- start start 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.706+0000 7f1bc9aca740 1 Processor -- start 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d060 0x559d98ab03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d980 0x559d98ab0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc9aca740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01a9db0 con 0x559d98aa8240 2024-09-11T22:08:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01ab220 con 0x559d98a9d060 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc9aca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01aa480 con 0x559d98a9d980 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc9aca740 10 client.0 _ll_register_callbacks cb 0x7f1bb8012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc5c8e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc5c8e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54982/0 (socket says 172.21.15.152:54982) 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc5c8e640 1 -- 172.21.15.152:0/2753701030 learned_addr learned my addr 172.21.15.152:0/2753701030 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc548d640 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d060 0x559d98ab03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc4c8c640 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d980 0x559d98ab0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc5c8e640 1 -- 172.21.15.152:0/2753701030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d980 msgr2=0x559d98ab0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d980 0x559d98ab0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc5c8e640 1 -- 172.21.15.152:0/2753701030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d060 msgr2=0x559d98ab03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d060 0x559d98ab03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc5c8e640 1 -- 172.21.15.152:0/2753701030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d98aad9e0 con 0x559d98aa8240 2024-09-11T22:08:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1bc5c8e640 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aad1b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8031800 tx=0x7f1bb8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9955e22945ba906 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.707+0000 7f1ba8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/2753701030 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8041060 con 0x559d98aa8240 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/2753701030 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1bb80319f0 con 0x559d98aa8240 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1bc9aca740 1 -- 172.21.15.152:0/2753701030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bb0004030 con 0x559d98aa8240 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/2753701030 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1bb8031bf0 con 0x559d98aa8240 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1bc9aca740 10 client.16611 fetch_fsmap learned FSMap version 30 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1bc9aca740 1 -- 172.21.15.152:0/2753701030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559d98b234e0 con 0x559d98aa8240 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/2753701030 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bb0004030 con 0x559d98aa8240 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/2753701030 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f1bb802f040 con 0x559d98aa8240 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1bc9aca740 10 client.16611 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1bc9aca740 10 client.16611 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1bc9aca740 20 client.16611 populate_metadata read hostname 'smithi152' 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559d98b23c60 0x559d98b26080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1bc9aca740 4 client.16611 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f0379676", "release": true, "await": true}] 2024-09-11T22:08:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.708+0000 7f1bc9aca740 1 -- 172.21.15.152:0/2753701030 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f0379676", "release": true, "await": true}) -- 0x559d98a94950 con 0x559d98b23c60 2024-09-11T22:08:59.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.709+0000 7f1bc548d640 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559d98b23c60 0x559d98b26080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:08:59.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.709+0000 7f1bc548d640 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559d98b23c60 0x559d98b26080 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40e9cb436699538c server_cookie=d176252f81317593 in_seq=0 out_seq=0 2024-09-11T22:08:59.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.709+0000 7f1ba8ff9640 10 client.16611 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.765+0000 7f1ba8ff9640 1 -- 172.21.15.152:0/2753701030 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559d98a94950 con 0x559d98b23c60 2024-09-11T22:08:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.765+0000 7f1ba8ff9640 10 client.16611 handle_command_reply: tid=0 2024-09-11T22:08:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.765+0000 7f1bc9aca740 1 client.16611 shutdown 2024-09-11T22:08:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.765+0000 7f1bc9aca740 1 -- 172.21.15.152:0/2753701030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 msgr2=0x559d98aad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.765+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aad1b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8031800 tx=0x7f1bb8013000 comp rx=0 tx=0).stop 2024-09-11T22:08:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.765+0000 7f1bc9aca740 1 -- 172.21.15.152:0/2753701030 shutdown_connections 2024-09-11T22:08:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.765+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559d98b23c60 0x559d98b26080 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.766+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d98aa8240 0x559d98aad1b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.766+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559d98a9d980 0x559d98ab0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.766+0000 7f1ba8ff9640 0 client.16611 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:08:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.766+0000 7f1bc9aca740 1 --2- 172.21.15.152:0/2753701030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d98a9d060 0x559d98ab03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.766+0000 7f1bc9aca740 1 -- 172.21.15.152:0/2753701030 >> 172.21.15.152:0/2753701030 conn(0x559d98a995f0 msgr2=0x559d98aa50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.766+0000 7f1bc9aca740 1 -- 172.21.15.152:0/2753701030 shutdown_connections 2024-09-11T22:08:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.766+0000 7f1bc9aca740 1 -- 172.21.15.152:0/2753701030 wait complete. 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 20, 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout: "f0379676": { 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 20, 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:08:59.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 140.2, 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:08:59.770 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:08:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.766+0000 7f1bc9aca740 20 client.16611 trim_cache size 0 max 16384 2024-09-11T22:08:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.768+0000 7f1bc76f1640 1 -- 172.21.15.152:0/1810309778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1bac0a2cf0 msgr2=0x7f1bac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.768+0000 7f1bc76f1640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1bac0a2cf0 0x7f1bac0a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80092f0 tx=0x7f1bb8009280 comp rx=0 tx=0).stop 2024-09-11T22:08:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.768+0000 7f1bc76f1640 1 -- 172.21.15.152:0/1810309778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bc0101df0 msgr2=0x7f1bc0198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:08:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.768+0000 7f1bc76f1640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bc0101df0 0x7f1bc0198380 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c920 tx=0x7f1bbc00cde0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.772+0000 7f1bc76f1640 1 -- 172.21.15.152:0/1810309778 shutdown_connections 2024-09-11T22:08:59.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.772+0000 7f1bc76f1640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1bac0a2cf0 0x7f1bac0a51b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.772+0000 7f1bc76f1640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bc0106f20 0x7f1bc019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.772+0000 7f1bc76f1640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc01027a0 0x7f1bc01988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.772+0000 7f1bc76f1640 1 --2- 172.21.15.152:0/1810309778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bc0101df0 0x7f1bc0198380 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:08:59.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.772+0000 7f1bc76f1640 1 -- 172.21.15.152:0/1810309778 >> 172.21.15.152:0/1810309778 conn(0x7f1bc00fd8f0 msgr2=0x7f1bc00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:08:59.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.773+0000 7f1bc76f1640 1 -- 172.21.15.152:0/1810309778 shutdown_connections 2024-09-11T22:08:59.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:08:59.775+0000 7f1bc76f1640 1 -- 172.21.15.152:0/1810309778 wait complete. 2024-09-11T22:08:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:08:59 smithi179 ceph-mon[35603]: pgmap v144: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-09-11T22:08:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 205.0 s, 14.4 tps, lat 15407.036 ms stddev 7899.108 2024-09-11T22:08:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:08:59 smithi193 ceph-mon[35545]: pgmap v144: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-09-11T22:09:00.584 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f0379676', total seconds elapsed: 23.5 2024-09-11T22:09:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:01 smithi179 ceph-mon[35603]: pgmap v145: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2024-09-11T22:09:01.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:01 smithi193 ceph-mon[35545]: pgmap v145: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2024-09-11T22:09:01.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:01 smithi152 ceph-mon[31188]: pgmap v145: 97 pgs: 97 active+clean; 2.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2024-09-11T22:09:03.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:03 smithi179 ceph-mon[35603]: pgmap v146: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:09:03.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:03 smithi193 ceph-mon[35545]: pgmap v146: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:09:03.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:03 smithi152 ceph-mon[31188]: pgmap v146: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:09:04.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:04 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:09:04.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:04 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:09:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 210.0 s, 3136.6 tps, lat 85.170 ms stddev 1021.069 2024-09-11T22:09:04.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:04 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:09:04.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:04 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:09:04.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:04 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:09:04.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:04 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:09:05.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:05 smithi179 ceph-mon[35603]: pgmap v147: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:09:05.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:05 smithi193 ceph-mon[35545]: pgmap v147: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:09:05.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:05 smithi152 ceph-mon[31188]: pgmap v147: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:09:07.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:07 smithi179 ceph-mon[35603]: pgmap v148: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:09:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:07 smithi193 ceph-mon[35545]: pgmap v148: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:09:07.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:07 smithi152 ceph-mon[31188]: pgmap v148: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:09:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.571+0000 7fbce26eb640 1 -- 172.21.15.152:0/4286053106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcdc101070 msgr2=0x7fbcdc1014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.571+0000 7fbce26eb640 1 --2- 172.21.15.152:0/4286053106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcdc101070 0x7fbcdc1014f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009860 tx=0x7fbcd002a340 comp rx=0 tx=0).stop 2024-09-11T22:09:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.571+0000 7fbce26eb640 1 -- 172.21.15.152:0/4286053106 shutdown_connections 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.571+0000 7fbce26eb640 1 --2- 172.21.15.152:0/4286053106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc101a30 0x7fbcdc10d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.571+0000 7fbce26eb640 1 --2- 172.21.15.152:0/4286053106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcdc101070 0x7fbcdc1014f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.571+0000 7fbce26eb640 1 --2- 172.21.15.152:0/4286053106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbcdc1029b0 0x7fbcdc102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.571+0000 7fbce26eb640 1 -- 172.21.15.152:0/4286053106 >> 172.21.15.152:0/4286053106 conn(0x7fbcdc0770f0 msgr2=0x7fbcdc0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.571+0000 7fbce26eb640 1 -- 172.21.15.152:0/4286053106 shutdown_connections 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.572+0000 7fbce26eb640 1 -- 172.21.15.152:0/4286053106 wait complete. 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.572+0000 7fbce26eb640 1 Processor -- start 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.572+0000 7fbce26eb640 1 -- start start 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.572+0000 7fbce26eb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc101070 0x7fbcdc1961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.572+0000 7fbce26eb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbcdc101a30 0x7fbcdc1966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.572+0000 7fbce26eb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcdc1029b0 0x7fbcdc19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbce26eb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc10fdd0 con 0x7fbcdc1029b0 2024-09-11T22:09:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbce26eb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc10fc50 con 0x7fbcdc101070 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbce26eb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc10ff50 con 0x7fbcdc101a30 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc101070 0x7fbcdc1961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc101070 0x7fbcdc1961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:38408/0 (socket says 172.21.15.152:38408) 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbce0c88640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcdc1029b0 0x7fbcdc19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbcdbfff640 1 -- 172.21.15.152:0/3801202975 learned_addr learned my addr 172.21.15.152:0/3801202975 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbcdb7fe640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbcdc101a30 0x7fbcdc1966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbcdbfff640 1 -- 172.21.15.152:0/3801202975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbcdc101a30 msgr2=0x7fbcdc1966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbcdc101a30 0x7fbcdc1966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbcdbfff640 1 -- 172.21.15.152:0/3801202975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcdc1029b0 msgr2=0x7fbcdc19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcdc1029b0 0x7fbcdc19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbcdbfff640 1 -- 172.21.15.152:0/3801202975 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc19b190 con 0x7fbcdc101070 2024-09-11T22:09:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.573+0000 7fbce0c88640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcdc1029b0 0x7fbcdc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:09:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.574+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc101070 0x7fbcdc1961a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00e9c0 tx=0x7fbccc00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.574+0000 7fbcd97fa640 1 -- 172.21.15.152:0/3801202975 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00cd80 con 0x7fbcdc101070 2024-09-11T22:09:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.574+0000 7fbcd97fa640 1 -- 172.21.15.152:0/3801202975 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbccc0035f0 con 0x7fbcdc101070 2024-09-11T22:09:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.574+0000 7fbcd97fa640 1 -- 172.21.15.152:0/3801202975 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc010670 con 0x7fbcdc101070 2024-09-11T22:09:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.574+0000 7fbce26eb640 1 -- 172.21.15.152:0/3801202975 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc19b480 con 0x7fbcdc101070 2024-09-11T22:09:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.575+0000 7fbce26eb640 1 -- 172.21.15.152:0/3801202975 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcdc1a2d10 con 0x7fbcdc101070 2024-09-11T22:09:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.578+0000 7fbcd97fa640 1 -- 172.21.15.152:0/3801202975 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fbccc0037a0 con 0x7fbcdc101070 2024-09-11T22:09:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.578+0000 7fbce548a740 1 Processor -- start 2024-09-11T22:09:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.579+0000 7fbcd97fa640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcc40a2ea0 0x7fbcc40a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.579+0000 7fbce548a740 1 -- start start 2024-09-11T22:09:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.579+0000 7fbcd97fa640 1 -- 172.21.15.152:0/3801202975 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fbccc0cf680 con 0x7fbcdc101070 2024-09-11T22:09:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.579+0000 7fbce548a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 0x5573bf570ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.579+0000 7fbce548a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf57b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.579+0000 7fbce548a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf57bcb0 0x5573bf57e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.579+0000 7fbce548a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5573bf4d52f0 con 0x5573bf570af0 2024-09-11T22:09:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.579+0000 7fbce548a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5573bf47d270 con 0x5573bf57bcb0 2024-09-11T22:09:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.579+0000 7fbce548a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5573bf4d12b0 con 0x5573bf571410 2024-09-11T22:09:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.579+0000 7fbce0c88640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcc40a2ea0 0x7fbcc40a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.580+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 0x5573bf570ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.580+0000 7fbce0c88640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf57bcb0 0x5573bf57e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.580+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 0x5573bf570ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51924/0 (socket says 172.21.15.152:51924) 2024-09-11T22:09:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.580+0000 7fbce0c88640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf57bcb0 0x5573bf57e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:38412/0 (socket says 172.21.15.152:38412) 2024-09-11T22:09:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.580+0000 7fbcdbfff640 1 -- 172.21.15.152:0/1122537662 learned_addr learned my addr 172.21.15.152:0/1122537662 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.580+0000 7fbcdbfff640 1 -- 172.21.15.152:0/1122537662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 msgr2=0x5573bf57b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.580+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/1122537662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf57b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.580+0000 7fbcdbfff640 1 -- 172.21.15.152:0/1122537662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf57bcb0 msgr2=0x5573bf57e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.580+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/1122537662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf57bcb0 0x5573bf57e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.580+0000 7fbcdbfff640 1 -- 172.21.15.152:0/1122537662 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573bf47c340 con 0x5573bf570af0 2024-09-11T22:09:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.581+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/1122537662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 0x5573bf570ed0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0984e0 tx=0x7fbccc09b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9877a65d4cba5777 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.581+0000 7fbce0c88640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcc40a2ea0 0x7fbcc40a5360 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005fd0 tx=0x7fbcd4010580 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.581+0000 7fbcc27fc640 1 -- 172.21.15.152:0/1122537662 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc09fec0 con 0x5573bf570af0 2024-09-11T22:09:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.581+0000 7fbcc27fc640 1 -- 172.21.15.152:0/1122537662 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbccc0a4780 con 0x5573bf570af0 2024-09-11T22:09:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.581+0000 7fbcc27fc640 1 -- 172.21.15.152:0/1122537662 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0a42f0 con 0x5573bf570af0 2024-09-11T22:09:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.582+0000 7fbce548a740 1 -- 172.21.15.152:0/1122537662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 msgr2=0x5573bf570ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.582+0000 7fbce548a740 1 --2- 172.21.15.152:0/1122537662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 0x5573bf570ed0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0984e0 tx=0x7fbccc09b710 comp rx=0 tx=0).stop 2024-09-11T22:09:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.582+0000 7fbce548a740 1 -- 172.21.15.152:0/1122537662 shutdown_connections 2024-09-11T22:09:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.582+0000 7fbce548a740 1 --2- 172.21.15.152:0/1122537662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf57bcb0 0x5573bf57e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.582+0000 7fbce548a740 1 --2- 172.21.15.152:0/1122537662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf57b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.582+0000 7fbce548a740 1 --2- 172.21.15.152:0/1122537662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 0x5573bf570ed0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.582+0000 7fbce548a740 1 -- 172.21.15.152:0/1122537662 >> 172.21.15.152:0/1122537662 conn(0x5573bf56d060 msgr2=0x5573bf56d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.582+0000 7fbce548a740 1 -- 172.21.15.152:0/1122537662 shutdown_connections 2024-09-11T22:09:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.582+0000 7fbce548a740 1 -- 172.21.15.152:0/1122537662 wait complete. 2024-09-11T22:09:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.583+0000 7fbce548a740 1 -- start start 2024-09-11T22:09:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.583+0000 7fbce548a740 1 Processor -- start 2024-09-11T22:09:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.584+0000 7fbce548a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf578c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.584+0000 7fbce548a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf579190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.584+0000 7fbce548a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 0x5573bf5796d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.584+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf578c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.584+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf578c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:38422/0 (socket says 172.21.15.152:38422) 2024-09-11T22:09:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.584+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf579190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.584+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf579190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:39168/0 (socket says 172.21.15.152:39168) 2024-09-11T22:09:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.584+0000 7fbce0c88640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 0x5573bf5796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.584+0000 7fbce0c88640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 0x5573bf5796d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51940/0 (socket says 172.21.15.152:51940) 2024-09-11T22:09:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.584+0000 7fbce548a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5573bf57e820 con 0x5573bf57bcb0 2024-09-11T22:09:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.585+0000 7fbce548a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5573bf45e290 con 0x5573bf570af0 2024-09-11T22:09:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.585+0000 7fbce548a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5573bf57e9a0 con 0x5573bf571410 2024-09-11T22:09:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.585+0000 7fbce548a740 10 client.0 _ll_register_callbacks cb 0x5573bf48f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.585+0000 7fbcdbfff640 1 -- 172.21.15.152:0/2706599631 learned_addr learned my addr 172.21.15.152:0/2706599631 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.585+0000 7fbcdbfff640 1 -- 172.21.15.152:0/2706599631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 msgr2=0x5573bf579190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.585+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/2706599631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf579190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.586+0000 7fbcdbfff640 1 -- 172.21.15.152:0/2706599631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 msgr2=0x5573bf5796d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.586+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/2706599631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 0x5573bf5796d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.586+0000 7fbcdbfff640 1 -- 172.21.15.152:0/2706599631 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573bf1e8210 con 0x5573bf570af0 2024-09-11T22:09:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.586+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/2706599631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf578c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbccc005cc0 tx=0x7fbccc09bbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4d0ec5e0d5b236c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.586+0000 7fbcbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:09:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.586+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/2706599631 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0b8020 con 0x5573bf570af0 2024-09-11T22:09:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.586+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/2706599631 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fbccc0ba2c0 con 0x5573bf570af0 2024-09-11T22:09:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.586+0000 7fbce548a740 1 -- 172.21.15.152:0/2706599631 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbccc0a4780 con 0x5573bf570af0 2024-09-11T22:09:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.586+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/2706599631 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbccc09fec0 con 0x5573bf570af0 2024-09-11T22:09:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.586+0000 7fbce548a740 10 client.26039 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.586+0000 7fbce548a740 1 -- 172.21.15.152:0/2706599631 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5573bf2b4620 con 0x5573bf570af0 2024-09-11T22:09:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.587+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/2706599631 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbccc0a4780 con 0x5573bf570af0 2024-09-11T22:09:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.587+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/2706599631 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fbccc09a9d0 con 0x5573bf570af0 2024-09-11T22:09:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.587+0000 7fbce548a740 10 client.26039 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.587+0000 7fbce548a740 10 client.26039 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.587+0000 7fbce548a740 20 client.26039 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.587+0000 7fbce548a740 1 --2- 172.21.15.152:0/2706599631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5573bf58bd30 0x5573bf58e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.587+0000 7fbce548a740 4 client.26039 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:09:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.587+0000 7fbce548a740 1 -- 172.21.15.152:0/2706599631 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573bf4e2a20 con 0x5573bf58bd30 2024-09-11T22:09:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.588+0000 7fbcdb7fe640 1 --2- 172.21.15.152:0/2706599631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5573bf58bd30 0x5573bf58e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.589+0000 7fbcdb7fe640 1 --2- 172.21.15.152:0/2706599631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5573bf58bd30 0x5573bf58e140 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=271a1f6d2ba287ea server_cookie=d4f17d25a0dbc841 in_seq=0 out_seq=0 2024-09-11T22:09:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.589+0000 7fbcbb7fe640 10 client.26039 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.590+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/2706599631 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573bf4e2a20 con 0x5573bf58bd30 2024-09-11T22:09:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.590+0000 7fbcbb7fe640 10 client.26039 handle_command_reply: tid=0 2024-09-11T22:09:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.590+0000 7fbce548a740 1 client.26039 shutdown 2024-09-11T22:09:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.590+0000 7fbce548a740 1 -- 172.21.15.152:0/2706599631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 msgr2=0x5573bf578c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.590+0000 7fbce548a740 1 --2- 172.21.15.152:0/2706599631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf578c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbccc005cc0 tx=0x7fbccc09bbd0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.590+0000 7fbce548a740 1 -- 172.21.15.152:0/2706599631 shutdown_connections 2024-09-11T22:09:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.590+0000 7fbce548a740 1 --2- 172.21.15.152:0/2706599631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5573bf58bd30 0x5573bf58e140 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.591+0000 7fbce548a740 1 --2- 172.21.15.152:0/2706599631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 0x5573bf5796d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.591+0000 7fbce548a740 1 --2- 172.21.15.152:0/2706599631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf579190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.591+0000 7fbce548a740 1 --2- 172.21.15.152:0/2706599631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf578c50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.591+0000 7fbce548a740 1 -- 172.21.15.152:0/2706599631 >> 172.21.15.152:0/2706599631 conn(0x5573bf56d060 msgr2=0x5573bf572d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.591+0000 7fbcbb7fe640 0 client.26039 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.591+0000 7fbce548a740 1 -- 172.21.15.152:0/2706599631 shutdown_connections 2024-09-11T22:09:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.591+0000 7fbce548a740 1 -- 172.21.15.152:0/2706599631 wait complete. 2024-09-11T22:09:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.591+0000 7fbce548a740 20 client.26039 trim_cache size 0 max 16384 2024-09-11T22:09:09.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.617+0000 7fbce548a740 1 Processor -- start 2024-09-11T22:09:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.617+0000 7fbce548a740 1 -- start start 2024-09-11T22:09:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbce548a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf573fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbce548a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf579500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbce548a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 0x5573bf593a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbce548a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1adf90 con 0x5573bf57bcb0 2024-09-11T22:09:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbce548a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1ab860 con 0x5573bf570af0 2024-09-11T22:09:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbce548a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1a96b0 con 0x5573bf571410 2024-09-11T22:09:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf573fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf573fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:38438/0 (socket says 172.21.15.152:38438) 2024-09-11T22:09:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbcdbfff640 1 -- 172.21.15.152:0/3556745178 learned_addr learned my addr 172.21.15.152:0/3556745178 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbcdb7fe640 1 --2- 172.21.15.152:0/3556745178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf579500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbce0c88640 1 --2- 172.21.15.152:0/3556745178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 0x5573bf593a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbcdbfff640 1 -- 172.21.15.152:0/3556745178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 msgr2=0x5573bf579500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/3556745178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf579500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbcdbfff640 1 -- 172.21.15.152:0/3556745178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 msgr2=0x5573bf593a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/3556745178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 0x5573bf593a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.618+0000 7fbcdbfff640 1 -- 172.21.15.152:0/3556745178 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573bf579a40 con 0x5573bf570af0 2024-09-11T22:09:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.619+0000 7fbce0c88640 1 --2- 172.21.15.152:0/3556745178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 0x5573bf593a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:09:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.619+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/3556745178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf573fd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbccc09baa0 tx=0x7fbccc003d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2e6a7bf7e86e4ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.619+0000 7fbcc1ffb640 1 -- 172.21.15.152:0/3556745178 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0b8070 con 0x5573bf570af0 2024-09-11T22:09:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.619+0000 7fbcc1ffb640 1 -- 172.21.15.152:0/3556745178 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbccc0a1050 con 0x5573bf570af0 2024-09-11T22:09:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.619+0000 7fbcc1ffb640 1 -- 172.21.15.152:0/3556745178 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc09a9d0 con 0x5573bf570af0 2024-09-11T22:09:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.620+0000 7fbce548a740 1 -- 172.21.15.152:0/3556745178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 msgr2=0x5573bf573fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.620+0000 7fbce548a740 1 --2- 172.21.15.152:0/3556745178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf573fd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbccc09baa0 tx=0x7fbccc003d20 comp rx=0 tx=0).stop 2024-09-11T22:09:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.620+0000 7fbce548a740 1 -- 172.21.15.152:0/3556745178 shutdown_connections 2024-09-11T22:09:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.620+0000 7fbce548a740 1 --2- 172.21.15.152:0/3556745178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf57bcb0 0x5573bf593a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.620+0000 7fbce548a740 1 --2- 172.21.15.152:0/3556745178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf579500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.620+0000 7fbce548a740 1 --2- 172.21.15.152:0/3556745178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf570af0 0x5573bf573fd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.620+0000 7fbce548a740 1 -- 172.21.15.152:0/3556745178 >> 172.21.15.152:0/3556745178 conn(0x5573bf56d060 msgr2=0x5573bf57acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.620+0000 7fbce548a740 1 -- 172.21.15.152:0/3556745178 shutdown_connections 2024-09-11T22:09:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.620+0000 7fbce548a740 1 -- 172.21.15.152:0/3556745178 wait complete. 2024-09-11T22:09:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.621+0000 7fbce548a740 1 -- start start 2024-09-11T22:09:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.621+0000 7fbce548a740 1 Processor -- start 2024-09-11T22:09:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbce548a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 0x5573bf5f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbce548a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf583c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbce548a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf57bcb0 0x5573bf584170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbce548a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1a9d20 con 0x5573bf570af0 2024-09-11T22:09:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbce548a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1ab190 con 0x5573bf57bcb0 2024-09-11T22:09:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbce548a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1aa3f0 con 0x5573bf571410 2024-09-11T22:09:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbce548a740 10 client.0 _ll_register_callbacks cb 0x7fbcd4010a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf583c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf583c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:39194/0 (socket says 172.21.15.152:39194) 2024-09-11T22:09:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbcdb7fe640 1 -- 172.21.15.152:0/3981952175 learned_addr learned my addr 172.21.15.152:0/3981952175 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 0x5573bf5f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbce0c88640 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf57bcb0 0x5573bf584170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbcdb7fe640 1 -- 172.21.15.152:0/3981952175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf57bcb0 msgr2=0x5573bf584170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbcdb7fe640 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf57bcb0 0x5573bf584170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbcdb7fe640 1 -- 172.21.15.152:0/3981952175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 msgr2=0x5573bf5f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbcdb7fe640 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 0x5573bf5f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.622+0000 7fbcdb7fe640 1 -- 172.21.15.152:0/3981952175 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573bf5846b0 con 0x5573bf571410 2024-09-11T22:09:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.623+0000 7fbcdb7fe640 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf583c30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0005e00 tx=0x7fbcd0030d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab9542ea7a66147a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.623+0000 7fbcbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:09:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.623+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/3981952175 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd004a020 con 0x5573bf571410 2024-09-11T22:09:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.623+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/3981952175 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fbcd0030780 con 0x5573bf571410 2024-09-11T22:09:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.624+0000 7fbce548a740 1 -- 172.21.15.152:0/3981952175 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbccc0a1050 con 0x5573bf571410 2024-09-11T22:09:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.624+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/3981952175 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbcd0037040 con 0x5573bf571410 2024-09-11T22:09:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.624+0000 7fbce548a740 10 client.26209 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.624+0000 7fbce548a740 1 -- 172.21.15.152:0/3981952175 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5573bf610210 con 0x5573bf571410 2024-09-11T22:09:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.625+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/3981952175 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbccc0a1050 con 0x5573bf571410 2024-09-11T22:09:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.625+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/3981952175 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fbcd0003b90 con 0x5573bf571410 2024-09-11T22:09:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.625+0000 7fbce548a740 10 client.26209 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.625+0000 7fbce548a740 10 client.26209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.625+0000 7fbce548a740 20 client.26209 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.625+0000 7fbce548a740 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5573bf610900 0x5573bf612d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.625+0000 7fbce548a740 4 client.26209 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:09:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.625+0000 7fbce548a740 1 -- 172.21.15.152:0/3981952175 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5573bf4dcd70 con 0x5573bf610900 2024-09-11T22:09:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.626+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5573bf610900 0x5573bf612d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.627+0000 7fbcbb7fe640 10 client.26209 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.627+0000 7fbcdbfff640 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5573bf610900 0x5573bf612d20 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41b3374cb31b6b9a server_cookie=4b13d5b35a17f3ff in_seq=0 out_seq=0 2024-09-11T22:09:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.634+0000 7fbcbb7fe640 1 -- 172.21.15.152:0/3981952175 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5573bf4dcd70 con 0x5573bf610900 2024-09-11T22:09:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.634+0000 7fbcbb7fe640 10 client.26209 handle_command_reply: tid=0 2024-09-11T22:09:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.634+0000 7fbce548a740 1 client.26209 shutdown 2024-09-11T22:09:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.634+0000 7fbce548a740 1 -- 172.21.15.152:0/3981952175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 msgr2=0x5573bf583c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.634+0000 7fbce548a740 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf583c30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0005e00 tx=0x7fbcd0030d10 comp rx=0 tx=0).stop 2024-09-11T22:09:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.635+0000 7fbce548a740 1 -- 172.21.15.152:0/3981952175 shutdown_connections 2024-09-11T22:09:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.635+0000 7fbce548a740 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5573bf610900 0x5573bf612d20 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.635+0000 7fbce548a740 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573bf57bcb0 0x5573bf584170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.635+0000 7fbce548a740 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573bf571410 0x5573bf583c30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.635+0000 7fbce548a740 1 --2- 172.21.15.152:0/3981952175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573bf570af0 0x5573bf5f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.635+0000 7fbcbb7fe640 0 client.26209 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.635+0000 7fbce548a740 1 -- 172.21.15.152:0/3981952175 >> 172.21.15.152:0/3981952175 conn(0x5573bf56d060 msgr2=0x5573bf56b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.635+0000 7fbce548a740 1 -- 172.21.15.152:0/3981952175 shutdown_connections 2024-09-11T22:09:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.635+0000 7fbce548a740 1 -- 172.21.15.152:0/3981952175 wait complete. 2024-09-11T22:09:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.635+0000 7fbce548a740 20 client.26209 trim_cache size 0 max 16384 2024-09-11T22:09:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:09:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:09:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:09:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:09:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 -- 172.21.15.152:0/3801202975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcc40a2ea0 msgr2=0x7fbcc40a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcc40a2ea0 0x7fbcc40a5360 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005fd0 tx=0x7fbcd4010580 comp rx=0 tx=0).stop 2024-09-11T22:09:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 -- 172.21.15.152:0/3801202975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc101070 msgr2=0x7fbcdc1961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc101070 0x7fbcdc1961a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00e9c0 tx=0x7fbccc00edc0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 -- 172.21.15.152:0/3801202975 shutdown_connections 2024-09-11T22:09:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcc40a2ea0 0x7fbcc40a5360 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcdc1029b0 0x7fbcdc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbcdc101a30 0x7fbcdc1966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 --2- 172.21.15.152:0/3801202975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc101070 0x7fbcdc1961a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 -- 172.21.15.152:0/3801202975 >> 172.21.15.152:0/3801202975 conn(0x7fbcdc0770f0 msgr2=0x7fbcdc0fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 -- 172.21.15.152:0/3801202975 shutdown_connections 2024-09-11T22:09:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:09.636+0000 7fbce26eb640 1 -- 172.21.15.152:0/3801202975 wait complete. 2024-09-11T22:09:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:09 smithi179 ceph-mon[35603]: pgmap v149: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 52 MiB/s wr, 2.66k op/s 2024-09-11T22:09:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 215.0 s, 4267.4 tps, lat 23.498 ms stddev 39.179 2024-09-11T22:09:09.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:09 smithi193 ceph-mon[35545]: pgmap v149: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 52 MiB/s wr, 2.66k op/s 2024-09-11T22:09:09.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:09 smithi152 ceph-mon[31188]: pgmap v149: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 52 MiB/s wr, 2.66k op/s 2024-09-11T22:09:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:11 smithi179 ceph-mon[35603]: pgmap v150: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 52 MiB/s wr, 2.66k op/s 2024-09-11T22:09:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:11 smithi193 ceph-mon[35545]: pgmap v150: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 52 MiB/s wr, 2.66k op/s 2024-09-11T22:09:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:11 smithi152 ceph-mon[31188]: pgmap v150: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 52 MiB/s wr, 2.66k op/s 2024-09-11T22:09:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:13 smithi179 ceph-mon[35603]: pgmap v151: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 61 MiB/s wr, 3.30k op/s 2024-09-11T22:09:13.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:13 smithi193 ceph-mon[35545]: pgmap v151: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 61 MiB/s wr, 3.30k op/s 2024-09-11T22:09:13.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:13 smithi152 ceph-mon[31188]: pgmap v151: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 61 MiB/s wr, 3.30k op/s 2024-09-11T22:09:14.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 220.0 s, 4600.4 tps, lat 21.633 ms stddev 26.086 2024-09-11T22:09:15.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:15 smithi152 ceph-mon[31188]: pgmap v152: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 36 MiB/s wr, 2.07k op/s 2024-09-11T22:09:15.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:15 smithi179 ceph-mon[35603]: pgmap v152: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 36 MiB/s wr, 2.07k op/s 2024-09-11T22:09:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:15 smithi193 ceph-mon[35545]: pgmap v152: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 36 MiB/s wr, 2.07k op/s 2024-09-11T22:09:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:17 smithi179 ceph-mon[35603]: pgmap v153: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 36 MiB/s wr, 2.07k op/s 2024-09-11T22:09:17.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:17 smithi193 ceph-mon[35545]: pgmap v153: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 36 MiB/s wr, 2.07k op/s 2024-09-11T22:09:17.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:17 smithi152 ceph-mon[31188]: pgmap v153: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 36 MiB/s wr, 2.07k op/s 2024-09-11T22:09:19.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:19 smithi179 ceph-mon[35603]: pgmap v154: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 41 MiB/s wr, 2.41k op/s 2024-09-11T22:09:19.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 225.0 s, 4147.8 tps, lat 24.157 ms stddev 27.423 2024-09-11T22:09:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:19 smithi193 ceph-mon[35545]: pgmap v154: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 41 MiB/s wr, 2.41k op/s 2024-09-11T22:09:19.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:19 smithi152 ceph-mon[31188]: pgmap v154: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 41 MiB/s wr, 2.41k op/s 2024-09-11T22:09:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:21 smithi179 ceph-mon[35603]: pgmap v155: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 15 MiB/s wr, 985 op/s 2024-09-11T22:09:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:21 smithi193 ceph-mon[35545]: pgmap v155: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 15 MiB/s wr, 985 op/s 2024-09-11T22:09:21.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:21 smithi152 ceph-mon[31188]: pgmap v155: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 15 MiB/s wr, 985 op/s 2024-09-11T22:09:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.772+0000 7f53595e8640 1 -- 172.21.15.152:0/1918523238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5354103aa0 msgr2=0x7f5354103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.772+0000 7f53595e8640 1 --2- 172.21.15.152:0/1918523238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5354103aa0 0x7f5354103e80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5344009900 tx=0x7f534402a400 comp rx=0 tx=0).stop 2024-09-11T22:09:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.773+0000 7f53595e8640 1 -- 172.21.15.152:0/1918523238 shutdown_connections 2024-09-11T22:09:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.773+0000 7f53595e8640 1 --2- 172.21.15.152:0/1918523238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5354100a00 0x7f535410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.773+0000 7f53595e8640 1 --2- 172.21.15.152:0/1918523238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5354100060 0x7f53541004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.773+0000 7f53595e8640 1 --2- 172.21.15.152:0/1918523238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5354103aa0 0x7f5354103e80 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.773+0000 7f53595e8640 1 -- 172.21.15.152:0/1918523238 >> 172.21.15.152:0/1918523238 conn(0x7f53540770f0 msgr2=0x7f53540fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.773+0000 7f53595e8640 1 -- 172.21.15.152:0/1918523238 shutdown_connections 2024-09-11T22:09:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.773+0000 7f53595e8640 1 -- 172.21.15.152:0/1918523238 wait complete. 2024-09-11T22:09:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.774+0000 7f53595e8640 1 Processor -- start 2024-09-11T22:09:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.774+0000 7f53595e8640 1 -- start start 2024-09-11T22:09:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.774+0000 7f53595e8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5354100060 0x7f535410e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f53595e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5354100a00 0x7f535410b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f53595e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5354103aa0 0x7f535410bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f53595e8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f53541029b0 con 0x7f5354100a00 2024-09-11T22:09:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f5352ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5354100060 0x7f535410e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f53595e8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5354102830 con 0x7f5354100060 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f5352ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5354100060 0x7f535410e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41592/0 (socket says 172.21.15.152:41592) 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f5352ffd640 1 -- 172.21.15.152:0/761873866 learned_addr learned my addr 172.21.15.152:0/761873866 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f53595e8640 1 -- 172.21.15.152:0/761873866 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5354102b30 con 0x7f5354103aa0 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f53537fe640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5354103aa0 0x7f535410bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f534bfff640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5354100a00 0x7f535410b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f53537fe640 1 -- 172.21.15.152:0/761873866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5354100060 msgr2=0x7f535410e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f53537fe640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5354100060 0x7f535410e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f53537fe640 1 -- 172.21.15.152:0/761873866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5354100a00 msgr2=0x7f535410b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f53537fe640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5354100a00 0x7f535410b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f53537fe640 1 -- 172.21.15.152:0/761873866 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535410c450 con 0x7f5354103aa0 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f5352ffd640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5354100060 0x7f535410e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:09:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.775+0000 7f534bfff640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5354100a00 0x7f535410b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:09:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.776+0000 7f53537fe640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5354103aa0 0x7f535410bd20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f534c009fd0 tx=0x7f534c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.776+0000 7f5350ff9640 1 -- 172.21.15.152:0/761873866 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c00ce20 con 0x7f5354103aa0 2024-09-11T22:09:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.776+0000 7f5350ff9640 1 -- 172.21.15.152:0/761873866 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f534c005020 con 0x7f5354103aa0 2024-09-11T22:09:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.776+0000 7f5350ff9640 1 -- 172.21.15.152:0/761873866 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c010720 con 0x7f5354103aa0 2024-09-11T22:09:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.776+0000 7f53595e8640 1 -- 172.21.15.152:0/761873866 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53541ab190 con 0x7f5354103aa0 2024-09-11T22:09:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.776+0000 7f53595e8640 1 -- 172.21.15.152:0/761873866 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53541ab5a0 con 0x7f5354103aa0 2024-09-11T22:09:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.781+0000 7f535c45f740 1 Processor -- start 2024-09-11T22:09:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.782+0000 7f5350ff9640 1 -- 172.21.15.152:0/761873866 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f534c005540 con 0x7f5354103aa0 2024-09-11T22:09:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.782+0000 7f535c45f740 1 -- start start 2024-09-11T22:09:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.782+0000 7f535c45f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0cfaf0 0x55a50d0cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.782+0000 7f535c45f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0d0410 0x55a50d0da770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.782+0000 7f535c45f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d0dd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.782+0000 7f535c45f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a50d0342f0 con 0x55a50d0cfaf0 2024-09-11T22:09:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.782+0000 7f535c45f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a50cfdc270 con 0x55a50d0dacb0 2024-09-11T22:09:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.782+0000 7f535c45f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a50d0302b0 con 0x55a50d0d0410 2024-09-11T22:09:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.782+0000 7f534bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0cfaf0 0x55a50d0cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.782+0000 7f534bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0cfaf0 0x55a50d0cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46356/0 (socket says 172.21.15.152:46356) 2024-09-11T22:09:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.782+0000 7f534bfff640 1 -- 172.21.15.152:0/1113101748 learned_addr learned my addr 172.21.15.152:0/1113101748 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.783+0000 7f5352ffd640 1 --2- 172.21.15.152:0/1113101748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0d0410 0x55a50d0da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.783+0000 7f534bfff640 1 --2- 172.21.15.152:0/1113101748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d0dd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.783+0000 7f5350ff9640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f53400a2ea0 0x7f53400a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.783+0000 7f5350ff9640 1 -- 172.21.15.152:0/761873866 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f534c0cfad0 con 0x7f5354103aa0 2024-09-11T22:09:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.783+0000 7f5352ffd640 1 -- 172.21.15.152:0/1113101748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 msgr2=0x55a50d0dd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.783+0000 7f5352ffd640 1 --2- 172.21.15.152:0/1113101748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d0dd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.783+0000 7f5352ffd640 1 -- 172.21.15.152:0/1113101748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0cfaf0 msgr2=0x55a50d0cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.783+0000 7f5352ffd640 1 --2- 172.21.15.152:0/1113101748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0cfaf0 0x55a50d0cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.783+0000 7f5352ffd640 1 -- 172.21.15.152:0/1113101748 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a50cfdb340 con 0x55a50d0d0410 2024-09-11T22:09:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.784+0000 7f5352ffd640 1 --2- 172.21.15.152:0/1113101748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0d0410 0x55a50d0da770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5344031550 tx=0x7f5344005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=843c1b00fb33a479 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.784+0000 7f53537fe640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f53400a2ea0 0x7f53400a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.784+0000 7f53497fa640 1 -- 172.21.15.152:0/1113101748 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344040070 con 0x55a50d0d0410 2024-09-11T22:09:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.784+0000 7f53497fa640 1 -- 172.21.15.152:0/1113101748 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53440047a0 con 0x55a50d0d0410 2024-09-11T22:09:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.784+0000 7f53497fa640 1 -- 172.21.15.152:0/1113101748 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344035040 con 0x55a50d0d0410 2024-09-11T22:09:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.785+0000 7f535c45f740 1 -- 172.21.15.152:0/1113101748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0d0410 msgr2=0x55a50d0da770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.785+0000 7f535c45f740 1 --2- 172.21.15.152:0/1113101748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0d0410 0x55a50d0da770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5344031550 tx=0x7f5344005e80 comp rx=0 tx=0).stop 2024-09-11T22:09:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.785+0000 7f53537fe640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f53400a2ea0 0x7f53400a5360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f534c0a46a0 tx=0x7f534c005f70 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.786+0000 7f535c45f740 1 -- 172.21.15.152:0/1113101748 shutdown_connections 2024-09-11T22:09:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.786+0000 7f535c45f740 1 --2- 172.21.15.152:0/1113101748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d0dd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.786+0000 7f535c45f740 1 --2- 172.21.15.152:0/1113101748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0d0410 0x55a50d0da770 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.786+0000 7f535c45f740 1 --2- 172.21.15.152:0/1113101748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0cfaf0 0x55a50d0cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.786+0000 7f535c45f740 1 -- 172.21.15.152:0/1113101748 >> 172.21.15.152:0/1113101748 conn(0x55a50d0cc060 msgr2=0x55a50d0cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.787+0000 7f535c45f740 1 -- 172.21.15.152:0/1113101748 shutdown_connections 2024-09-11T22:09:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.787+0000 7f535c45f740 1 -- 172.21.15.152:0/1113101748 wait complete. 2024-09-11T22:09:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.787+0000 7f535c45f740 1 -- start start 2024-09-11T22:09:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.788+0000 7f535c45f740 1 Processor -- start 2024-09-11T22:09:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.788+0000 7f535c45f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d0d7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.788+0000 7f535c45f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0d0410 0x55a50d0d8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.788+0000 7f535c45f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0dacb0 0x55a50d0d86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.788+0000 7f535c45f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a50d0dd880 con 0x55a50d0dacb0 2024-09-11T22:09:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.788+0000 7f535c45f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a50cfbd290 con 0x55a50d0d0410 2024-09-11T22:09:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.788+0000 7f535c45f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a50d0dda00 con 0x55a50d0cfaf0 2024-09-11T22:09:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.788+0000 7f535c45f740 10 client.0 _ll_register_callbacks cb 0x55a50cfee140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.789+0000 7f5352ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0d0410 0x55a50d0d8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.789+0000 7f5352ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0d0410 0x55a50d0d8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41602/0 (socket says 172.21.15.152:41602) 2024-09-11T22:09:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.789+0000 7f5352ffd640 1 -- 172.21.15.152:0/3054116980 learned_addr learned my addr 172.21.15.152:0/3054116980 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.789+0000 7f534bfff640 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d0d7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.789+0000 7f534bfff640 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0dacb0 0x55a50d0d86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.789+0000 7f5352ffd640 1 -- 172.21.15.152:0/3054116980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 msgr2=0x55a50d0d7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.789+0000 7f5352ffd640 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d0d7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.789+0000 7f5352ffd640 1 -- 172.21.15.152:0/3054116980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0dacb0 msgr2=0x55a50d0d86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.789+0000 7f5352ffd640 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0dacb0 0x55a50d0d86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.789+0000 7f5352ffd640 1 -- 172.21.15.152:0/3054116980 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a50cd47210 con 0x55a50d0d0410 2024-09-11T22:09:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.789+0000 7f534bfff640 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0dacb0 0x55a50d0d86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:09:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.790+0000 7f5352ffd640 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0d0410 0x55a50d0d8190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5344000c00 tx=0x7f5344009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b062b41b7ec06ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.790+0000 7f533a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:09:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.790+0000 7f533a7fc640 1 -- 172.21.15.152:0/3054116980 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534404c020 con 0x55a50d0d0410 2024-09-11T22:09:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.791+0000 7f533a7fc640 1 -- 172.21.15.152:0/3054116980 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f53440315b0 con 0x55a50d0d0410 2024-09-11T22:09:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.791+0000 7f535c45f740 1 -- 172.21.15.152:0/3054116980 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53440047a0 con 0x55a50d0d0410 2024-09-11T22:09:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.791+0000 7f533a7fc640 1 -- 172.21.15.152:0/3054116980 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5344057050 con 0x55a50d0d0410 2024-09-11T22:09:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.791+0000 7f535c45f740 10 client.26057 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.791+0000 7f535c45f740 1 -- 172.21.15.152:0/3054116980 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a50ce13620 con 0x55a50d0d0410 2024-09-11T22:09:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.792+0000 7f533a7fc640 1 -- 172.21.15.152:0/3054116980 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53440047a0 con 0x55a50d0d0410 2024-09-11T22:09:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.792+0000 7f533a7fc640 1 -- 172.21.15.152:0/3054116980 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f534403c970 con 0x55a50d0d0410 2024-09-11T22:09:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.792+0000 7f535c45f740 10 client.26057 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.792+0000 7f535c45f740 10 client.26057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.792+0000 7f535c45f740 20 client.26057 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.792+0000 7f535c45f740 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a50d0fbb50 0x55a50d0fdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.792+0000 7f535c45f740 4 client.26057 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:09:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.792+0000 7f535c45f740 1 -- 172.21.15.152:0/3054116980 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a50d041a20 con 0x55a50d0fbb50 2024-09-11T22:09:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.792+0000 7f534bfff640 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a50d0fbb50 0x55a50d0fdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.793+0000 7f534bfff640 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a50d0fbb50 0x55a50d0fdf40 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c46db4f86b5491a9 server_cookie=93947769a207e3eb in_seq=0 out_seq=0 2024-09-11T22:09:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.793+0000 7f533a7fc640 10 client.26057 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.793+0000 7f533a7fc640 1 -- 172.21.15.152:0/3054116980 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a50d041a20 con 0x55a50d0fbb50 2024-09-11T22:09:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.793+0000 7f533a7fc640 10 client.26057 handle_command_reply: tid=0 2024-09-11T22:09:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 1 client.26057 shutdown 2024-09-11T22:09:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 1 -- 172.21.15.152:0/3054116980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0d0410 msgr2=0x55a50d0d8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0d0410 0x55a50d0d8190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5344000c00 tx=0x7f5344009260 comp rx=0 tx=0).stop 2024-09-11T22:09:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 1 -- 172.21.15.152:0/3054116980 shutdown_connections 2024-09-11T22:09:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a50d0fbb50 0x55a50d0fdf40 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0dacb0 0x55a50d0d86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0d0410 0x55a50d0d8190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 1 --2- 172.21.15.152:0/3054116980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d0d7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 1 -- 172.21.15.152:0/3054116980 >> 172.21.15.152:0/3054116980 conn(0x55a50d0cc060 msgr2=0x55a50d0d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f533a7fc640 0 client.26057 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 1 -- 172.21.15.152:0/3054116980 shutdown_connections 2024-09-11T22:09:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 1 -- 172.21.15.152:0/3054116980 wait complete. 2024-09-11T22:09:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.794+0000 7f535c45f740 20 client.26057 trim_cache size 0 max 16384 2024-09-11T22:09:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.819+0000 7f535c45f740 1 Processor -- start 2024-09-11T22:09:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.820+0000 7f535c45f740 1 -- start start 2024-09-11T22:09:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.820+0000 7f535c45f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d0d6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.820+0000 7f535c45f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d0d8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.820+0000 7f535c45f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d100b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.820+0000 7f535c45f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f53541ae010 con 0x55a50d0d0410 2024-09-11T22:09:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.820+0000 7f535c45f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f53541ab910 con 0x55a50d0dacb0 2024-09-11T22:09:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.820+0000 7f535c45f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f53541033c0 con 0x55a50d0cfaf0 2024-09-11T22:09:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.821+0000 7f5352ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d0d8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.821+0000 7f5352ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d0d8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46386/0 (socket says 172.21.15.152:46386) 2024-09-11T22:09:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.821+0000 7f5352ffd640 1 -- 172.21.15.152:0/3445716323 learned_addr learned my addr 172.21.15.152:0/3445716323 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.821+0000 7f534bfff640 1 --2- 172.21.15.152:0/3445716323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d0d6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.821+0000 7f534bfff640 1 --2- 172.21.15.152:0/3445716323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d100b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.821+0000 7f5352ffd640 1 -- 172.21.15.152:0/3445716323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 msgr2=0x55a50d0d6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.821+0000 7f5352ffd640 1 --2- 172.21.15.152:0/3445716323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d0d6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.821+0000 7f5352ffd640 1 -- 172.21.15.152:0/3445716323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 msgr2=0x55a50d100b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.821+0000 7f5352ffd640 1 --2- 172.21.15.152:0/3445716323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d100b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.821+0000 7f5352ffd640 1 -- 172.21.15.152:0/3445716323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a50d0d6180 con 0x55a50d0d0410 2024-09-11T22:09:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.822+0000 7f5352ffd640 1 --2- 172.21.15.152:0/3445716323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d0d8500 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f534402a9f0 tx=0x7f5344005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42275cf943f5956e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.822+0000 7f5348ff9640 1 -- 172.21.15.152:0/3445716323 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534404c070 con 0x55a50d0d0410 2024-09-11T22:09:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.822+0000 7f5348ff9640 1 -- 172.21.15.152:0/3445716323 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5344005500 con 0x55a50d0d0410 2024-09-11T22:09:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.822+0000 7f5348ff9640 1 -- 172.21.15.152:0/3445716323 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344000e60 con 0x55a50d0d0410 2024-09-11T22:09:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.823+0000 7f535c45f740 1 -- 172.21.15.152:0/3445716323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 msgr2=0x55a50d0d8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.823+0000 7f535c45f740 1 --2- 172.21.15.152:0/3445716323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d0d8500 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f534402a9f0 tx=0x7f5344005e80 comp rx=0 tx=0).stop 2024-09-11T22:09:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.823+0000 7f535c45f740 1 -- 172.21.15.152:0/3445716323 shutdown_connections 2024-09-11T22:09:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.823+0000 7f535c45f740 1 --2- 172.21.15.152:0/3445716323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.823+0000 7f535c45f740 1 --2- 172.21.15.152:0/3445716323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d0d8500 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.823+0000 7f535c45f740 1 --2- 172.21.15.152:0/3445716323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d0d6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.823+0000 7f535c45f740 1 -- 172.21.15.152:0/3445716323 >> 172.21.15.152:0/3445716323 conn(0x55a50d0cc060 msgr2=0x55a50d0d9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.824+0000 7f535c45f740 1 -- 172.21.15.152:0/3445716323 shutdown_connections 2024-09-11T22:09:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.824+0000 7f535c45f740 1 -- 172.21.15.152:0/3445716323 wait complete. 2024-09-11T22:09:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.824+0000 7f535c45f740 1 -- start start 2024-09-11T22:09:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.825+0000 7f535c45f740 1 Processor -- start 2024-09-11T22:09:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.825+0000 7f535c45f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d100f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.825+0000 7f535c45f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d1014c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.825+0000 7f535c45f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d0fe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.825+0000 7f535c45f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5354072920 con 0x55a50d0d0410 2024-09-11T22:09:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.825+0000 7f535c45f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5354073d70 con 0x55a50d0dacb0 2024-09-11T22:09:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.825+0000 7f535c45f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5354072fd0 con 0x55a50d0cfaf0 2024-09-11T22:09:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.825+0000 7f535c45f740 10 client.0 _ll_register_callbacks cb 0x7f533c009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.825+0000 7f5352ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d1014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.825+0000 7f5352ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d1014c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46398/0 (socket says 172.21.15.152:46398) 2024-09-11T22:09:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.825+0000 7f5352ffd640 1 -- 172.21.15.152:0/2251829594 learned_addr learned my addr 172.21.15.152:0/2251829594 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.826+0000 7f534bfff640 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d0fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.826+0000 7f534bfff640 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.827+0000 7f5352ffd640 1 -- 172.21.15.152:0/2251829594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 msgr2=0x55a50d100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.827+0000 7f5352ffd640 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.827+0000 7f5352ffd640 1 -- 172.21.15.152:0/2251829594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 msgr2=0x55a50d0fe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.827+0000 7f5352ffd640 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d0fe510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.827+0000 7f5352ffd640 1 -- 172.21.15.152:0/2251829594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a50d0fed40 con 0x55a50d0d0410 2024-09-11T22:09:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.827+0000 7f5352ffd640 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d1014c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5344004650 tx=0x7f5344004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644c8956a868a5a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.827+0000 7f533a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:09:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.827+0000 7f533a7fc640 1 -- 172.21.15.152:0/2251829594 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344060060 con 0x55a50d0d0410 2024-09-11T22:09:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.827+0000 7f535c45f740 1 -- 172.21.15.152:0/2251829594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5344005500 con 0x55a50d0d0410 2024-09-11T22:09:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.827+0000 7f533a7fc640 1 -- 172.21.15.152:0/2251829594 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f5344004990 con 0x55a50d0d0410 2024-09-11T22:09:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.828+0000 7f533a7fc640 1 -- 172.21.15.152:0/2251829594 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f534404c070 con 0x55a50d0d0410 2024-09-11T22:09:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.828+0000 7f535c45f740 10 client.16644 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.828+0000 7f535c45f740 1 -- 172.21.15.152:0/2251829594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a50d166150 con 0x55a50d0d0410 2024-09-11T22:09:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.828+0000 7f533a7fc640 1 -- 172.21.15.152:0/2251829594 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5344005500 con 0x55a50d0d0410 2024-09-11T22:09:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.829+0000 7f533a7fc640 1 -- 172.21.15.152:0/2251829594 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5344004b90 con 0x55a50d0d0410 2024-09-11T22:09:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.829+0000 7f535c45f740 10 client.16644 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.829+0000 7f535c45f740 10 client.16644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.829+0000 7f535c45f740 20 client.16644 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.829+0000 7f535c45f740 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a50d1667e0 0x55a50d168c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.829+0000 7f535c45f740 4 client.16644 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:09:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.829+0000 7f535c45f740 1 -- 172.21.15.152:0/2251829594 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a50d03bd70 con 0x55a50d1667e0 2024-09-11T22:09:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.829+0000 7f534bfff640 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a50d1667e0 0x55a50d168c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.830+0000 7f533a7fc640 10 client.16644 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.830+0000 7f534bfff640 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a50d1667e0 0x55a50d168c00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d44d05b2c8579d0 server_cookie=7849683855915e0 in_seq=0 out_seq=0 2024-09-11T22:09:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.837+0000 7f533a7fc640 1 -- 172.21.15.152:0/2251829594 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a50d03bd70 con 0x55a50d1667e0 2024-09-11T22:09:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.837+0000 7f533a7fc640 10 client.16644 handle_command_reply: tid=0 2024-09-11T22:09:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.837+0000 7f535c45f740 1 client.16644 shutdown 2024-09-11T22:09:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.838+0000 7f535c45f740 1 -- 172.21.15.152:0/2251829594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 msgr2=0x55a50d1014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.838+0000 7f535c45f740 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d1014c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5344004650 tx=0x7f5344004770 comp rx=0 tx=0).stop 2024-09-11T22:09:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.839+0000 7f535c45f740 1 -- 172.21.15.152:0/2251829594 shutdown_connections 2024-09-11T22:09:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.839+0000 7f535c45f740 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a50d1667e0 0x55a50d168c00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.839+0000 7f535c45f740 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50d0dacb0 0x55a50d0fe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.839+0000 7f535c45f740 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a50d0d0410 0x55a50d1014c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.839+0000 7f535c45f740 1 --2- 172.21.15.152:0/2251829594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50d0cfaf0 0x55a50d100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.839+0000 7f535c45f740 1 -- 172.21.15.152:0/2251829594 >> 172.21.15.152:0/2251829594 conn(0x55a50d0cc060 msgr2=0x55a50d0e5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.839+0000 7f533a7fc640 0 client.16644 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.839+0000 7f535c45f740 1 -- 172.21.15.152:0/2251829594 shutdown_connections 2024-09-11T22:09:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.839+0000 7f535c45f740 1 -- 172.21.15.152:0/2251829594 wait complete. 2024-09-11T22:09:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.840+0000 7f535c45f740 20 client.16644 trim_cache size 0 max 16384 2024-09-11T22:09:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:09:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:09:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:09:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:09:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.840+0000 7f53595e8640 1 -- 172.21.15.152:0/761873866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f53400a2ea0 msgr2=0x7f53400a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.840+0000 7f53595e8640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f53400a2ea0 0x7f53400a5360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f534c0a46a0 tx=0x7f534c005f70 comp rx=0 tx=0).stop 2024-09-11T22:09:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.840+0000 7f53595e8640 1 -- 172.21.15.152:0/761873866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5354103aa0 msgr2=0x7f535410bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.840+0000 7f53595e8640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5354103aa0 0x7f535410bd20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f534c009fd0 tx=0x7f534c00ef10 comp rx=0 tx=0).stop 2024-09-11T22:09:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.841+0000 7f53595e8640 1 -- 172.21.15.152:0/761873866 shutdown_connections 2024-09-11T22:09:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.841+0000 7f53595e8640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f53400a2ea0 0x7f53400a5360 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.841+0000 7f53595e8640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5354103aa0 0x7f535410bd20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.841+0000 7f53595e8640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5354100a00 0x7f535410b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.841+0000 7f53595e8640 1 --2- 172.21.15.152:0/761873866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5354100060 0x7f535410e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.841+0000 7f53595e8640 1 -- 172.21.15.152:0/761873866 >> 172.21.15.152:0/761873866 conn(0x7f53540770f0 msgr2=0x7f5354105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.841+0000 7f53595e8640 1 -- 172.21.15.152:0/761873866 shutdown_connections 2024-09-11T22:09:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:22.841+0000 7f53595e8640 1 -- 172.21.15.152:0/761873866 wait complete. 2024-09-11T22:09:23.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:23 smithi179 ceph-mon[35603]: pgmap v156: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 20 MiB/s wr, 1.33k op/s 2024-09-11T22:09:23.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:23 smithi193 ceph-mon[35545]: pgmap v156: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 20 MiB/s wr, 1.33k op/s 2024-09-11T22:09:23.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:23 smithi152 ceph-mon[31188]: pgmap v156: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 20 MiB/s wr, 1.33k op/s 2024-09-11T22:09:24.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 230.0 s, 4113.0 tps, lat 24.264 ms stddev 27.122 2024-09-11T22:09:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:25 smithi179 ceph-mon[35603]: pgmap v157: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-09-11T22:09:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:25 smithi193 ceph-mon[35545]: pgmap v157: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-09-11T22:09:25.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:25 smithi152 ceph-mon[31188]: pgmap v157: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-09-11T22:09:26.473 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:09:26.857 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:09:27.666 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:27 smithi152 ceph-mon[31188]: pgmap v158: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-09-11T22:09:27.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:27 smithi179 ceph-mon[35603]: pgmap v158: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-09-11T22:09:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.801+0000 7fbcebdf5640 1 -- 172.21.15.152:0/1001448712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbce4101dd0 msgr2=0x7fbce41021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:27.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.801+0000 7fbcebdf5640 1 --2- 172.21.15.152:0/1001448712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbce4101dd0 0x7fbce41021b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009900 tx=0x7fbce002a3f0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.803+0000 7fbcebdf5640 1 -- 172.21.15.152:0/1001448712 shutdown_connections 2024-09-11T22:09:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.803+0000 7fbcebdf5640 1 --2- 172.21.15.152:0/1001448712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4106f00 0x7fbce410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.803+0000 7fbcebdf5640 1 --2- 172.21.15.152:0/1001448712 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce4102780 0x7fbce41067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.803+0000 7fbcebdf5640 1 --2- 172.21.15.152:0/1001448712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbce4101dd0 0x7fbce41021b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.803+0000 7fbcebdf5640 1 -- 172.21.15.152:0/1001448712 >> 172.21.15.152:0/1001448712 conn(0x7fbce40fd8b0 msgr2=0x7fbce40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.803+0000 7fbcebdf5640 1 -- 172.21.15.152:0/1001448712 shutdown_connections 2024-09-11T22:09:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.803+0000 7fbcebdf5640 1 -- 172.21.15.152:0/1001448712 wait complete. 2024-09-11T22:09:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.804+0000 7fbcebdf5640 1 Processor -- start 2024-09-11T22:09:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.804+0000 7fbcebdf5640 1 -- start start 2024-09-11T22:09:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.805+0000 7fbcebdf5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4101dd0 0x7fbce4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.805+0000 7fbce9b91640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4101dd0 0x7fbce4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.805+0000 7fbce9b91640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4101dd0 0x7fbce4198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60368/0 (socket says 172.21.15.152:60368) 2024-09-11T22:09:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.805+0000 7fbcebdf5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce4102780 0x7fbce4198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbce9b91640 1 -- 172.21.15.152:0/2440631960 learned_addr learned my addr 172.21.15.152:0/2440631960 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:27.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbcebdf5640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbce4106f00 0x7fbce419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbcebdf5640 1 -- 172.21.15.152:0/2440631960 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4111f60 con 0x7fbce4106f00 2024-09-11T22:09:27.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbcebdf5640 1 -- 172.21.15.152:0/2440631960 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4111de0 con 0x7fbce4101dd0 2024-09-11T22:09:27.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbce9390640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce4102780 0x7fbce4198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbcebdf5640 1 -- 172.21.15.152:0/2440631960 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41120e0 con 0x7fbce4102780 2024-09-11T22:09:27.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbcea392640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbce4106f00 0x7fbce419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbce9390640 1 -- 172.21.15.152:0/2440631960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4101dd0 msgr2=0x7fbce4198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:27.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbce9390640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4101dd0 0x7fbce4198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbce9390640 1 -- 172.21.15.152:0/2440631960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbce4106f00 msgr2=0x7fbce419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:27.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbce9390640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbce4106f00 0x7fbce419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.806+0000 7fbce9390640 1 -- 172.21.15.152:0/2440631960 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce419d4d0 con 0x7fbce4102780 2024-09-11T22:09:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.807+0000 7fbce9390640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce4102780 0x7fbce4198a60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400d720 tx=0x7fbcd400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:27.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.807+0000 7fbcdaffd640 1 -- 172.21.15.152:0/2440631960 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4017070 con 0x7fbce4102780 2024-09-11T22:09:27.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.807+0000 7fbcdaffd640 1 -- 172.21.15.152:0/2440631960 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd400de30 con 0x7fbce4102780 2024-09-11T22:09:27.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.807+0000 7fbcdaffd640 1 -- 172.21.15.152:0/2440631960 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40047a0 con 0x7fbce4102780 2024-09-11T22:09:27.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.807+0000 7fbcebdf5640 1 -- 172.21.15.152:0/2440631960 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce419d7c0 con 0x7fbce4102780 2024-09-11T22:09:27.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.807+0000 7fbcebdf5640 1 -- 172.21.15.152:0/2440631960 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce419dc20 con 0x7fbce4102780 2024-09-11T22:09:27.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.811+0000 7fbcdaffd640 1 -- 172.21.15.152:0/2440631960 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fbcd40099d0 con 0x7fbce4102780 2024-09-11T22:09:27.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.812+0000 7fbcdaffd640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcd00a2d70 0x7fbcd00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.812+0000 7fbce9b91640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcd00a2d70 0x7fbcd00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.813+0000 7fbcee1ce740 1 Processor -- start 2024-09-11T22:09:27.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.813+0000 7fbcdaffd640 1 -- 172.21.15.152:0/2440631960 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fbcd40cefb0 con 0x7fbce4102780 2024-09-11T22:09:27.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.813+0000 7fbce9b91640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcd00a2d70 0x7fbcd00a5230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbce00096c0 tx=0x7fbce0005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:27.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.813+0000 7fbcee1ce740 1 -- start start 2024-09-11T22:09:27.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.813+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef424a0 0x55743ef42880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.813+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef4d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef4d680 0x55743ef4fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55743eea82e0 con 0x55743ef42dc0 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55743ee4fce0 con 0x55743ef4d680 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55743eea42a0 con 0x55743ef424a0 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcea392640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef4d680 0x55743ef4fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcea392640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef4d680 0x55743ef4fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60384/0 (socket says 172.21.15.152:60384) 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcea392640 1 -- 172.21.15.152:0/3618816151 learned_addr learned my addr 172.21.15.152:0/3618816151 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbce9390640 1 --2- 172.21.15.152:0/3618816151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef4d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbce9b91640 1 --2- 172.21.15.152:0/3618816151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef424a0 0x55743ef42880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcea392640 1 -- 172.21.15.152:0/3618816151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef424a0 msgr2=0x55743ef42880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcea392640 1 --2- 172.21.15.152:0/3618816151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef424a0 0x55743ef42880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcea392640 1 -- 172.21.15.152:0/3618816151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 msgr2=0x55743ef4d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcea392640 1 --2- 172.21.15.152:0/3618816151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef4d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcea392640 1 -- 172.21.15.152:0/3618816151 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55743ee34440 con 0x55743ef4d680 2024-09-11T22:09:27.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.814+0000 7fbcea392640 1 --2- 172.21.15.152:0/3618816151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef4d680 0x55743ef4fa70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009f50 tx=0x7fbcdc0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f66cd90d6e8c754f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:27.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.815+0000 7fbccffff640 1 -- 172.21.15.152:0/3618816151 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc004d20 con 0x55743ef4d680 2024-09-11T22:09:27.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.815+0000 7fbccffff640 1 -- 172.21.15.152:0/3618816151 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcdc004050 con 0x55743ef4d680 2024-09-11T22:09:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.815+0000 7fbccffff640 1 -- 172.21.15.152:0/3618816151 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc005280 con 0x55743ef4d680 2024-09-11T22:09:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.816+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3618816151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef4d680 msgr2=0x55743ef4fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.816+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/3618816151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef4d680 0x55743ef4fa70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009f50 tx=0x7fbcdc0118d0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.816+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3618816151 shutdown_connections 2024-09-11T22:09:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.816+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/3618816151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef4d680 0x55743ef4fa70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.816+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/3618816151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef4d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.816+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/3618816151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef424a0 0x55743ef42880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.816+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3618816151 >> 172.21.15.152:0/3618816151 conn(0x55743ef3ea30 msgr2=0x55743ef3ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.817+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3618816151 shutdown_connections 2024-09-11T22:09:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.817+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3618816151 wait complete. 2024-09-11T22:09:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.817+0000 7fbcee1ce740 1 -- start start 2024-09-11T22:09:27.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.817+0000 7fbcee1ce740 1 Processor -- start 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.818+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef4d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.818+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef42dc0 0x55743ef4a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.818+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef4d680 0x55743ef4a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.818+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55743ef50250 con 0x55743ef4d680 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.818+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55743ee63050 con 0x55743ef424a0 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.818+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55743ef503d0 con 0x55743ef42dc0 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.818+0000 7fbcee1ce740 10 client.0 _ll_register_callbacks cb 0x55743eea3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.818+0000 7fbce9b91640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef4d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.818+0000 7fbcea392640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef4d680 0x55743ef4a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.818+0000 7fbcea392640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef4d680 0x55743ef4a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58820/0 (socket says 172.21.15.152:58820) 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.818+0000 7fbcea392640 1 -- 172.21.15.152:0/3690501612 learned_addr learned my addr 172.21.15.152:0/3690501612 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.819+0000 7fbce9390640 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef42dc0 0x55743ef4a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.819+0000 7fbcea392640 1 -- 172.21.15.152:0/3690501612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef42dc0 msgr2=0x55743ef4a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.819+0000 7fbcea392640 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef42dc0 0x55743ef4a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.819+0000 7fbcea392640 1 -- 172.21.15.152:0/3690501612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 msgr2=0x55743ef4d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.819+0000 7fbcea392640 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef4d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.819+0000 7fbcea392640 1 -- 172.21.15.152:0/3690501612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55743ec193c0 con 0x55743ef4d680 2024-09-11T22:09:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.820+0000 7fbcea392640 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef4d680 0x55743ef4a8e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009250 tx=0x7fbcdc003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564ac69e3541e46e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.820+0000 7fbccd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:09:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.820+0000 7fbccd7fa640 1 -- 172.21.15.152:0/3690501612 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc004c10 con 0x55743ef4d680 2024-09-11T22:09:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.820+0000 7fbccd7fa640 1 -- 172.21.15.152:0/3690501612 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fbcdc004db0 con 0x55743ef4d680 2024-09-11T22:09:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.820+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3690501612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcdc004050 con 0x55743ef4d680 2024-09-11T22:09:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbccd7fa640 1 -- 172.21.15.152:0/3690501612 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbcdc031050 con 0x55743ef4d680 2024-09-11T22:09:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbcee1ce740 10 client.16656 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3690501612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55743ef5bc70 con 0x55743ef4d680 2024-09-11T22:09:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbccd7fa640 1 -- 172.21.15.152:0/3690501612 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcdc004050 con 0x55743ef4d680 2024-09-11T22:09:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbccd7fa640 1 -- 172.21.15.152:0/3690501612 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fbcdc024510 con 0x55743ef4d680 2024-09-11T22:09:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbcee1ce740 10 client.16656 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbcee1ce740 10 client.16656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbcee1ce740 20 client.16656 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55743ef5d020 0x55743ef5f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbcee1ce740 4 client.16656 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:09:27.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3690501612 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55743eeb5850 con 0x55743ef5d020 2024-09-11T22:09:27.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.821+0000 7fbce9b91640 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55743ef5d020 0x55743ef5f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:27 smithi193 ceph-mon[35545]: pgmap v158: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-09-11T22:09:27.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.822+0000 7fbce9b91640 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55743ef5d020 0x55743ef5f410 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9050dede996ea764 server_cookie=d28e807648f12e39 in_seq=0 out_seq=0 2024-09-11T22:09:27.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.822+0000 7fbccd7fa640 10 client.16656 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:27.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.823+0000 7fbccd7fa640 1 -- 172.21.15.152:0/3690501612 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55743eeb5850 con 0x55743ef5d020 2024-09-11T22:09:27.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.823+0000 7fbccd7fa640 10 client.16656 handle_command_reply: tid=0 2024-09-11T22:09:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.823+0000 7fbcee1ce740 1 client.16656 shutdown 2024-09-11T22:09:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.823+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3690501612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef4d680 msgr2=0x55743ef4a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.823+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef4d680 0x55743ef4a8e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009250 tx=0x7fbcdc003f60 comp rx=0 tx=0).stop 2024-09-11T22:09:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.824+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3690501612 shutdown_connections 2024-09-11T22:09:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.824+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55743ef5d020 0x55743ef5f410 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.824+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef4d680 0x55743ef4a8e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.824+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef42dc0 0x55743ef4a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.824+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/3690501612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef4d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.824+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3690501612 >> 172.21.15.152:0/3690501612 conn(0x55743ef3ea30 msgr2=0x55743ef44760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:27.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.824+0000 7fbccd7fa640 0 client.16656 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:27.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.824+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3690501612 shutdown_connections 2024-09-11T22:09:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.824+0000 7fbcee1ce740 1 -- 172.21.15.152:0/3690501612 wait complete. 2024-09-11T22:09:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.824+0000 7fbcee1ce740 20 client.16656 trim_cache size 0 max 16384 2024-09-11T22:09:27.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.852+0000 7fbcee1ce740 1 Processor -- start 2024-09-11T22:09:27.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.852+0000 7fbcee1ce740 1 -- start start 2024-09-11T22:09:27.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.852+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef45b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.852+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef4d680 0x55743ef64b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41b6950 con 0x55743ef42dc0 2024-09-11T22:09:27.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41b4220 con 0x55743ef424a0 2024-09-11T22:09:27.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41b2070 con 0x55743ef4d680 2024-09-11T22:09:27.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbce9390640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbce9390640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58822/0 (socket says 172.21.15.152:58822) 2024-09-11T22:09:27.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbce9390640 1 -- 172.21.15.152:0/38815765 learned_addr learned my addr 172.21.15.152:0/38815765 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:27.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbce9b91640 1 --2- 172.21.15.152:0/38815765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef45b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbcea392640 1 --2- 172.21.15.152:0/38815765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef4d680 0x55743ef64b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbce9390640 1 -- 172.21.15.152:0/38815765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef4d680 msgr2=0x55743ef64b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:27.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbce9390640 1 --2- 172.21.15.152:0/38815765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef4d680 0x55743ef64b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbce9390640 1 -- 172.21.15.152:0/38815765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 msgr2=0x55743ef45b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:27.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbce9390640 1 --2- 172.21.15.152:0/38815765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef45b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbce9390640 1 -- 172.21.15.152:0/38815765 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55743ede31e0 con 0x55743ef42dc0 2024-09-11T22:09:27.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.853+0000 7fbce9390640 1 --2- 172.21.15.152:0/38815765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef594b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40cccd0 tx=0x7fbcd40ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5c1a17f3fa83bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:27.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.854+0000 7fbccf7fe640 1 -- 172.21.15.152:0/38815765 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd409f850 con 0x55743ef42dc0 2024-09-11T22:09:27.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.854+0000 7fbccf7fe640 1 -- 172.21.15.152:0/38815765 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd40a4110 con 0x55743ef42dc0 2024-09-11T22:09:27.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.854+0000 7fbccf7fe640 1 -- 172.21.15.152:0/38815765 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40b4290 con 0x55743ef42dc0 2024-09-11T22:09:27.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.855+0000 7fbcee1ce740 1 -- 172.21.15.152:0/38815765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 msgr2=0x55743ef594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:27.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.855+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/38815765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef594b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40cccd0 tx=0x7fbcd40ce040 comp rx=0 tx=0).stop 2024-09-11T22:09:27.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.856+0000 7fbcee1ce740 1 -- 172.21.15.152:0/38815765 shutdown_connections 2024-09-11T22:09:27.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.856+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/38815765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef4d680 0x55743ef64b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.856+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/38815765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef594b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.856+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/38815765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef45b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.856+0000 7fbcee1ce740 1 -- 172.21.15.152:0/38815765 >> 172.21.15.152:0/38815765 conn(0x55743ef3ea30 msgr2=0x55743ef3db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:27.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.856+0000 7fbcee1ce740 1 -- 172.21.15.152:0/38815765 shutdown_connections 2024-09-11T22:09:27.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.856+0000 7fbcee1ce740 1 -- 172.21.15.152:0/38815765 wait complete. 2024-09-11T22:09:27.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.856+0000 7fbcee1ce740 1 -- start start 2024-09-11T22:09:27.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.857+0000 7fbcee1ce740 1 Processor -- start 2024-09-11T22:09:27.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.857+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef55af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.857+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef50e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbcee1ce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef4d680 0x55743ef51360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41b26e0 con 0x55743ef42dc0 2024-09-11T22:09:27.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbce9b91640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef55af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41b3b50 con 0x55743ef424a0 2024-09-11T22:09:27.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbcee1ce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41b2db0 con 0x55743ef4d680 2024-09-11T22:09:27.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbce9b91640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef55af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60410/0 (socket says 172.21.15.152:60410) 2024-09-11T22:09:27.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbce9b91640 1 -- 172.21.15.152:0/2234665445 learned_addr learned my addr 172.21.15.152:0/2234665445 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:27.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbcee1ce740 10 client.0 _ll_register_callbacks cb 0x7fbcd4097080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:27.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbce9390640 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef50e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbce9b91640 1 -- 172.21.15.152:0/2234665445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef4d680 msgr2=0x55743ef51360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:09:27.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbce9b91640 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef4d680 0x55743ef51360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbce9b91640 1 -- 172.21.15.152:0/2234665445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 msgr2=0x55743ef50e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:27.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbce9b91640 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef50e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbce9b91640 1 -- 172.21.15.152:0/2234665445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55743ef51920 con 0x55743ef424a0 2024-09-11T22:09:27.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.858+0000 7fbce9390640 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef50e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:09:27.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.859+0000 7fbce9b91640 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef55af0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbce0031550 tx=0x7fbce003d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=151ef573f28da6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:27.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.859+0000 7fbccd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:09:27.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.859+0000 7fbccd7fa640 1 -- 172.21.15.152:0/2234665445 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0035040 con 0x55743ef424a0 2024-09-11T22:09:27.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.859+0000 7fbccd7fa640 1 -- 172.21.15.152:0/2234665445 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fbce0005250 con 0x55743ef424a0 2024-09-11T22:09:27.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.860+0000 7fbcee1ce740 1 -- 172.21.15.152:0/2234665445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcd40a4110 con 0x55743ef424a0 2024-09-11T22:09:27.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.860+0000 7fbccd7fa640 1 -- 172.21.15.152:0/2234665445 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbce0060050 con 0x55743ef424a0 2024-09-11T22:09:27.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.860+0000 7fbcee1ce740 10 client.26081 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:27.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.860+0000 7fbcee1ce740 1 -- 172.21.15.152:0/2234665445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55743efc78b0 con 0x55743ef424a0 2024-09-11T22:09:27.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.860+0000 7fbccd7fa640 1 -- 172.21.15.152:0/2234665445 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd40a4110 con 0x55743ef424a0 2024-09-11T22:09:27.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.861+0000 7fbccd7fa640 1 -- 172.21.15.152:0/2234665445 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fbce00035f0 con 0x55743ef424a0 2024-09-11T22:09:27.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.861+0000 7fbcee1ce740 10 client.26081 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:27.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.861+0000 7fbcee1ce740 10 client.26081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:27.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.861+0000 7fbcee1ce740 20 client.26081 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:27.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.861+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55743efc7f80 0x55743efca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:27.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.861+0000 7fbcee1ce740 4 client.26081 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:09:27.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.861+0000 7fbcee1ce740 1 -- 172.21.15.152:0/2234665445 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55743eeafd60 con 0x55743efc7f80 2024-09-11T22:09:27.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.863+0000 7fbce9390640 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55743efc7f80 0x55743efca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:27.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.863+0000 7fbce9390640 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55743efc7f80 0x55743efca3e0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24fea65700bb4365 server_cookie=e00683dd175fecd0 in_seq=0 out_seq=0 2024-09-11T22:09:27.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbccd7fa640 10 client.26081 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:27.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbccd7fa640 1 -- 172.21.15.152:0/2234665445 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55743eeafd60 con 0x55743efc7f80 2024-09-11T22:09:27.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbccd7fa640 10 client.26081 handle_command_reply: tid=0 2024-09-11T22:09:27.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbcee1ce740 1 client.26081 shutdown 2024-09-11T22:09:27.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbcee1ce740 1 -- 172.21.15.152:0/2234665445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 msgr2=0x55743ef55af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:27.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef55af0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbce0031550 tx=0x7fbce003d000 comp rx=0 tx=0).stop 2024-09-11T22:09:27.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbcee1ce740 1 -- 172.21.15.152:0/2234665445 shutdown_connections 2024-09-11T22:09:27.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55743efc7f80 0x55743efca3e0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55743ef4d680 0x55743ef51360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55743ef42dc0 0x55743ef50e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbccd7fa640 0 client.26081 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:27.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbcee1ce740 1 --2- 172.21.15.152:0/2234665445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55743ef424a0 0x55743ef55af0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbcee1ce740 1 -- 172.21.15.152:0/2234665445 >> 172.21.15.152:0/2234665445 conn(0x55743ef3ea30 msgr2=0x55743ef43e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbcee1ce740 1 -- 172.21.15.152:0/2234665445 shutdown_connections 2024-09-11T22:09:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.864+0000 7fbcee1ce740 1 -- 172.21.15.152:0/2234665445 wait complete. 2024-09-11T22:09:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcee1ce740 20 client.26081 trim_cache size 0 max 16384 2024-09-11T22:09:27.883 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:09:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:09:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:09:27.883 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:09:27.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcebdf5640 1 -- 172.21.15.152:0/2440631960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcd00a2d70 msgr2=0x7fbcd00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:27.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcebdf5640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcd00a2d70 0x7fbcd00a5230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbce00096c0 tx=0x7fbce0005a20 comp rx=0 tx=0).stop 2024-09-11T22:09:27.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcebdf5640 1 -- 172.21.15.152:0/2440631960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce4102780 msgr2=0x7fbce4198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:27.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcebdf5640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce4102780 0x7fbce4198a60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400d720 tx=0x7fbcd400dbe0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcebdf5640 1 -- 172.21.15.152:0/2440631960 shutdown_connections 2024-09-11T22:09:27.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcebdf5640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbcd00a2d70 0x7fbcd00a5230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcebdf5640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbce4106f00 0x7fbce419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcebdf5640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce4102780 0x7fbce4198a60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcebdf5640 1 --2- 172.21.15.152:0/2440631960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4101dd0 0x7fbce4198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:27.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcebdf5640 1 -- 172.21.15.152:0/2440631960 >> 172.21.15.152:0/2440631960 conn(0x7fbce40fd8b0 msgr2=0x7fbce40feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:27.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.865+0000 7fbcebdf5640 1 -- 172.21.15.152:0/2440631960 shutdown_connections 2024-09-11T22:09:27.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:27.866+0000 7fbcebdf5640 1 -- 172.21.15.152:0/2440631960 wait complete. 2024-09-11T22:09:28.820 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:09:28.821 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:09:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:09:29.635 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:29 smithi152 ceph-mon[31188]: pgmap v159: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 15 MiB/s wr, 1.03k op/s 2024-09-11T22:09:29.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.763+0000 7f365b695640 1 -- 172.21.15.152:0/2047954389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3654108450 msgr2=0x7f3654108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:29.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.763+0000 7f365b695640 1 --2- 172.21.15.152:0/2047954389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3654108450 0x7f3654108830 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3650009860 tx=0x7f365002a340 comp rx=0 tx=0).stop 2024-09-11T22:09:29.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.763+0000 7f365b695640 1 -- 172.21.15.152:0/2047954389 shutdown_connections 2024-09-11T22:09:29.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.763+0000 7f365b695640 1 --2- 172.21.15.152:0/2047954389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f365410d530 0x7f36541150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:29.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.763+0000 7f365b695640 1 --2- 172.21.15.152:0/2047954389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3654108e00 0x7f365410ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:29.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.763+0000 7f365b695640 1 --2- 172.21.15.152:0/2047954389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3654108450 0x7f3654108830 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3650009860 tx=0x7f365002a340 comp rx=0 tx=0).stop 2024-09-11T22:09:29.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.763+0000 7f365b695640 1 -- 172.21.15.152:0/2047954389 >> 172.21.15.152:0/2047954389 conn(0x7f3654077ba0 msgr2=0x7f3654079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:29.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.763+0000 7f365b695640 1 -- 172.21.15.152:0/2047954389 shutdown_connections 2024-09-11T22:09:29.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.763+0000 7f365b695640 1 -- 172.21.15.152:0/2047954389 wait complete. 2024-09-11T22:09:29.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.764+0000 7f365b695640 1 Processor -- start 2024-09-11T22:09:29.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.764+0000 7f365b695640 1 -- start start 2024-09-11T22:09:29.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f365b695640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3654108e00 0x7f365419ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:29.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f365b695640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f365410d530 0x7f365419f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:29.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f365b695640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36541a35e0 0x7f36541a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:29.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f365b695640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3654118580 con 0x7f3654108e00 2024-09-11T22:09:29.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f365b695640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3654118400 con 0x7f365410d530 2024-09-11T22:09:29.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f365b695640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3654118700 con 0x7f36541a35e0 2024-09-11T22:09:29.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f3659c32640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36541a35e0 0x7f36541a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:29.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f3659c32640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36541a35e0 0x7f36541a3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:35886/0 (socket says 172.21.15.152:35886) 2024-09-11T22:09:29.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f3659c32640 1 -- 172.21.15.152:0/874982507 learned_addr learned my addr 172.21.15.152:0/874982507 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:29.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f3658c30640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f365410d530 0x7f365419f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:29.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f3659431640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3654108e00 0x7f365419ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:29.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f3659c32640 1 -- 172.21.15.152:0/874982507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f365410d530 msgr2=0x7f365419f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:29.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f3659c32640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f365410d530 0x7f365419f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:29.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f3659c32640 1 -- 172.21.15.152:0/874982507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3654108e00 msgr2=0x7f365419ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:29.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f3659c32640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3654108e00 0x7f365419ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:29.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.765+0000 7f3659c32640 1 -- 172.21.15.152:0/874982507 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36541a40a0 con 0x7f36541a35e0 2024-09-11T22:09:29.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.766+0000 7f3659c32640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36541a35e0 0x7f36541a3a90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f364c00ef00 tx=0x7f364c00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:29.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.766+0000 7f364a7fc640 1 -- 172.21.15.152:0/874982507 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c003970 con 0x7f36541a35e0 2024-09-11T22:09:29.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.766+0000 7f365b695640 1 -- 172.21.15.152:0/874982507 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36541a4390 con 0x7f36541a35e0 2024-09-11T22:09:29.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.766+0000 7f365b695640 1 -- 172.21.15.152:0/874982507 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365407ad20 con 0x7f36541a35e0 2024-09-11T22:09:29.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.767+0000 7f364a7fc640 1 -- 172.21.15.152:0/874982507 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f364c009880 con 0x7f36541a35e0 2024-09-11T22:09:29.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.767+0000 7f364a7fc640 1 -- 172.21.15.152:0/874982507 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c00b7b0 con 0x7f36541a35e0 2024-09-11T22:09:29.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.768+0000 7f365b695640 1 -- 172.21.15.152:0/874982507 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3638005290 con 0x7f36541a35e0 2024-09-11T22:09:29.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.770+0000 7f364a7fc640 1 -- 172.21.15.152:0/874982507 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f364c01d020 con 0x7f36541a35e0 2024-09-11T22:09:29.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.771+0000 7f364a7fc640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f36400b3dd0 0x7f36400b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:29.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.771+0000 7f364a7fc640 1 -- 172.21.15.152:0/874982507 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f364c0cf440 con 0x7f36541a35e0 2024-09-11T22:09:29.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.771+0000 7f3659431640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f36400b3dd0 0x7f36400b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:29.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.772+0000 7f3659431640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f36400b3dd0 0x7f36400b6290 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f365002a8b0 tx=0x7f3650000bc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:29.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:29.774+0000 7f364a7fc640 1 -- 172.21.15.152:0/874982507 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f364c09c030 con 0x7f36541a35e0 2024-09-11T22:09:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:29 smithi179 ceph-mon[35603]: pgmap v159: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 15 MiB/s wr, 1.03k op/s 2024-09-11T22:09:29.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 235.0 s, 5087.2 tps, lat 19.732 ms stddev 22.032 2024-09-11T22:09:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:29 smithi193 ceph-mon[35545]: pgmap v159: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 15 MiB/s wr, 1.03k op/s 2024-09-11T22:09:30.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.125+0000 7f365b695640 1 -- 172.21.15.152:0/874982507 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3638005580 con 0x7f36541a35e0 2024-09-11T22:09:30.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.127+0000 7f364a7fc640 1 -- 172.21.15.152:0/874982507 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f364c09b930 con 0x7f36541a35e0 2024-09-11T22:09:30.128 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:09:30.128 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:09:30.128 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 -- 172.21.15.152:0/874982507 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f36400b3dd0 msgr2=0x7f36400b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f36400b3dd0 0x7f36400b6290 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f365002a8b0 tx=0x7f3650000bc0 comp rx=0 tx=0).stop 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 -- 172.21.15.152:0/874982507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36541a35e0 msgr2=0x7f36541a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36541a35e0 0x7f36541a3a90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f364c00ef00 tx=0x7f364c00c740 comp rx=0 tx=0).stop 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 -- 172.21.15.152:0/874982507 shutdown_connections 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f36400b3dd0 0x7f36400b6290 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36541a35e0 0x7f36541a3a90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f365410d530 0x7f365419f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 --2- 172.21.15.152:0/874982507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3654108e00 0x7f365419ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 -- 172.21.15.152:0/874982507 >> 172.21.15.152:0/874982507 conn(0x7f3654077ba0 msgr2=0x7f3654078f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 -- 172.21.15.152:0/874982507 shutdown_connections 2024-09-11T22:09:30.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:30.131+0000 7f365b695640 1 -- 172.21.15.152:0/874982507 wait complete. 2024-09-11T22:09:30.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:30 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/874982507' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:09:30.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:30 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/874982507' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:09:30.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:30 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/874982507' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:09:31.649 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:09:31.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:31 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:09:31.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:31 smithi179 ceph-mon[35603]: pgmap v160: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.6 MiB/s wr, 686 op/s 2024-09-11T22:09:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:31 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:09:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:31 smithi193 ceph-mon[35545]: pgmap v160: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.6 MiB/s wr, 686 op/s 2024-09-11T22:09:31.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:31 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:09:31.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:31 smithi152 ceph-mon[31188]: pgmap v160: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.6 MiB/s wr, 686 op/s 2024-09-11T22:09:32.059 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:09:32.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.636+0000 7f7e591f2640 1 -- 172.21.15.152:0/2028171406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e54100e20 msgr2=0x7f7e54101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:32.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.636+0000 7f7e591f2640 1 --2- 172.21.15.152:0/2028171406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e54100e20 0x7f7e54101200 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009890 tx=0x7f7e4802a420 comp rx=0 tx=0).stop 2024-09-11T22:09:32.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.638+0000 7f7e591f2640 1 -- 172.21.15.152:0/2028171406 shutdown_connections 2024-09-11T22:09:32.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.638+0000 7f7e591f2640 1 --2- 172.21.15.152:0/2028171406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e54102ef0 0x7f7e5410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.638+0000 7f7e591f2640 1 --2- 172.21.15.152:0/2028171406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e54102570 0x7f7e541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.638+0000 7f7e591f2640 1 --2- 172.21.15.152:0/2028171406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e54100e20 0x7f7e54101200 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.638+0000 7f7e591f2640 1 -- 172.21.15.152:0/2028171406 >> 172.21.15.152:0/2028171406 conn(0x7f7e540fc7d0 msgr2=0x7f7e540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:32.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.640+0000 7f7e591f2640 1 -- 172.21.15.152:0/2028171406 shutdown_connections 2024-09-11T22:09:32.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.644+0000 7f7e591f2640 1 -- 172.21.15.152:0/2028171406 wait complete. 2024-09-11T22:09:32.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.645+0000 7f7e591f2640 1 Processor -- start 2024-09-11T22:09:32.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.647+0000 7f7e591f2640 1 -- start start 2024-09-11T22:09:32.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.647+0000 7f7e591f2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e54100e20 0x7f7e541984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.648+0000 7f7e591f2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e54102570 0x7f7e541989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.648+0000 7f7e591f2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e54102ef0 0x7f7e5419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.648+0000 7f7e52d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e54100e20 0x7f7e541984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.648+0000 7f7e52d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e54100e20 0x7f7e541984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:60446/0 (socket says 172.21.15.152:60446) 2024-09-11T22:09:32.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.648+0000 7f7e52d9d640 1 -- 172.21.15.152:0/2927672433 learned_addr learned my addr 172.21.15.152:0/2927672433 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:32.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.648+0000 7f7e591f2640 1 -- 172.21.15.152:0/2927672433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7e54110f80 con 0x7f7e54102570 2024-09-11T22:09:32.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.648+0000 7f7e5359e640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e54102ef0 0x7f7e5419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.648+0000 7f7e591f2640 1 -- 172.21.15.152:0/2927672433 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7e54110e00 con 0x7f7e54100e20 2024-09-11T22:09:32.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.648+0000 7f7e591f2640 1 -- 172.21.15.152:0/2927672433 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7e54111100 con 0x7f7e54102ef0 2024-09-11T22:09:32.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.650+0000 7f7e5259c640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e54102570 0x7f7e541989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.650+0000 7f7e52d9d640 1 -- 172.21.15.152:0/2927672433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e54102ef0 msgr2=0x7f7e5419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:32.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.650+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e54102ef0 0x7f7e5419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.650+0000 7f7e52d9d640 1 -- 172.21.15.152:0/2927672433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e54102570 msgr2=0x7f7e541989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:32.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.650+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e54102570 0x7f7e541989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.650+0000 7f7e52d9d640 1 -- 172.21.15.152:0/2927672433 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5419d460 con 0x7f7e54100e20 2024-09-11T22:09:32.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.650+0000 7f7e5359e640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e54102ef0 0x7f7e5419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:09:32.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.650+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e54100e20 0x7f7e541984b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7e48000c00 tx=0x7f7e480042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:32.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.651+0000 7f7e3bfff640 1 -- 172.21.15.152:0/2927672433 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48040070 con 0x7f7e54100e20 2024-09-11T22:09:32.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.651+0000 7f7e3bfff640 1 -- 172.21.15.152:0/2927672433 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e48030a50 con 0x7f7e54100e20 2024-09-11T22:09:32.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.651+0000 7f7e591f2640 1 -- 172.21.15.152:0/2927672433 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5419d6f0 con 0x7f7e54100e20 2024-09-11T22:09:32.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.651+0000 7f7e3bfff640 1 -- 172.21.15.152:0/2927672433 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48031600 con 0x7f7e54100e20 2024-09-11T22:09:32.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.651+0000 7f7e591f2640 1 -- 172.21.15.152:0/2927672433 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e5419db80 con 0x7f7e54100e20 2024-09-11T22:09:32.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.655+0000 7f7e5b5cb740 1 Processor -- start 2024-09-11T22:09:32.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.655+0000 7f7e3bfff640 1 -- 172.21.15.152:0/2927672433 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f7e48039040 con 0x7f7e54100e20 2024-09-11T22:09:32.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.656+0000 7f7e3bfff640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e3c0a2cf0 0x7f7e3c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.657+0000 7f7e3bfff640 1 -- 172.21.15.152:0/2927672433 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f7e480f0420 con 0x7f7e54100e20 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.657+0000 7f7e5b5cb740 1 -- start start 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.657+0000 7f7e5359e640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e3c0a2cf0 0x7f7e3c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.657+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38b0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.657+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0df0 0x563ce38b5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.657+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b5a40 0x563ce38b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.657+0000 7f7e5b5cb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563ce380c2f0 con 0x563ce38b5a40 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.657+0000 7f7e5b5cb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563ce37b3cf0 con 0x563ce38b0df0 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.657+0000 7f7e5b5cb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563ce38082b0 con 0x563ce38b0440 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.658+0000 7f7e5259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0df0 0x563ce38b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.658+0000 7f7e5359e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b5a40 0x563ce38b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.658+0000 7f7e52d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.658+0000 7f7e5359e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b5a40 0x563ce38b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58882/0 (socket says 172.21.15.152:58882) 2024-09-11T22:09:32.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.658+0000 7f7e5359e640 1 -- 172.21.15.152:0/1800189114 learned_addr learned my addr 172.21.15.152:0/1800189114 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:32.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.658+0000 7f7e5259c640 1 -- 172.21.15.152:0/1800189114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 msgr2=0x563ce38b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:32.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.658+0000 7f7e5259c640 1 --2- 172.21.15.152:0/1800189114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.658+0000 7f7e5259c640 1 -- 172.21.15.152:0/1800189114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b5a40 msgr2=0x563ce38b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:32.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.658+0000 7f7e5259c640 1 --2- 172.21.15.152:0/1800189114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b5a40 0x563ce38b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.658+0000 7f7e5259c640 1 -- 172.21.15.152:0/1800189114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ce37983a0 con 0x563ce38b0df0 2024-09-11T22:09:32.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.660+0000 7f7e5259c640 1 --2- 172.21.15.152:0/1800189114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0df0 0x563ce38b5470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009b40 tx=0x7f7e440113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c14dfa9247c67af9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:32.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.660+0000 7f7e5359e640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e3c0a2cf0 0x7f7e3c0a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00ec10 tx=0x7f7e4c00d7b0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:32.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.660+0000 7f7e397fa640 1 -- 172.21.15.152:0/1800189114 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44011e10 con 0x563ce38b0df0 2024-09-11T22:09:32.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.660+0000 7f7e397fa640 1 -- 172.21.15.152:0/1800189114 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e44012930 con 0x563ce38b0df0 2024-09-11T22:09:32.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.660+0000 7f7e397fa640 1 -- 172.21.15.152:0/1800189114 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4400fac0 con 0x563ce38b0df0 2024-09-11T22:09:32.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.661+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1800189114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0df0 msgr2=0x563ce38b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:32.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.661+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/1800189114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0df0 0x563ce38b5470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009b40 tx=0x7f7e440113e0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.662+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1800189114 shutdown_connections 2024-09-11T22:09:32.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.662+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/1800189114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b5a40 0x563ce38b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.662+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/1800189114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0df0 0x563ce38b5470 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009b40 tx=0x7f7e440113e0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.662+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/1800189114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.662+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1800189114 >> 172.21.15.152:0/1800189114 conn(0x563ce386f310 msgr2=0x563ce38a26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:32.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.663+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1800189114 shutdown_connections 2024-09-11T22:09:32.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.663+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1800189114 wait complete. 2024-09-11T22:09:32.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.663+0000 7f7e5b5cb740 1 -- start start 2024-09-11T22:09:32.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.663+0000 7f7e5b5cb740 1 Processor -- start 2024-09-11T22:09:32.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0440 0x563ce38b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b5a40 0x563ce38b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38d6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e5b5cb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563ce38cd8e0 con 0x563ce38b3230 2024-09-11T22:09:32.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e5b5cb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563ce37c7060 con 0x563ce38b0440 2024-09-11T22:09:32.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e5b5cb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563ce38cda60 con 0x563ce38b5a40 2024-09-11T22:09:32.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e5b5cb740 10 client.0 _ll_register_callbacks cb 0x563ce351a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:32.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e5359e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38d6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e5359e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38d6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58888/0 (socket says 172.21.15.152:58888) 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e5359e640 1 -- 172.21.15.152:0/4117771747 learned_addr learned my addr 172.21.15.152:0/4117771747 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e5259c640 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b5a40 0x563ce38b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.664+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0440 0x563ce38b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.665+0000 7f7e52d9d640 1 -- 172.21.15.152:0/4117771747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b5a40 msgr2=0x563ce38b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.665+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b5a40 0x563ce38b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.665+0000 7f7e52d9d640 1 -- 172.21.15.152:0/4117771747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 msgr2=0x563ce38d6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.665+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38d6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.665+0000 7f7e52d9d640 1 -- 172.21.15.152:0/4117771747 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ce357d3c0 con 0x563ce38b0440 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.665+0000 7f7e5359e640 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38d6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.665+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0440 0x563ce38b27b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7e480edb40 tx=0x7f7e480045a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98ee48862434832 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.665+0000 7f7e36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:09:32.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.665+0000 7f7e36ff5640 1 -- 172.21.15.152:0/4117771747 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480c0cc0 con 0x563ce38b0440 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.665+0000 7f7e36ff5640 1 -- 172.21.15.152:0/4117771747 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f7e480bac10 con 0x563ce38b0440 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.665+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/4117771747 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e44012930 con 0x563ce38b0440 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e36ff5640 1 -- 172.21.15.152:0/4117771747 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7e480c5580 con 0x563ce38b0440 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e5b5cb740 10 client.26099 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/4117771747 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563ce38d98e0 con 0x563ce38b0440 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e36ff5640 1 -- 172.21.15.152:0/4117771747 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e44012930 con 0x563ce38b0440 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e36ff5640 1 -- 172.21.15.152:0/4117771747 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7e4804d030 con 0x563ce38b0440 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e5b5cb740 10 client.26099 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e5b5cb740 10 client.26099 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e5b5cb740 20 client.26099 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563ce38daf20 0x563ce38dd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e5b5cb740 4 client.26099 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:09:32.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/4117771747 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ce3819860 con 0x563ce38daf20 2024-09-11T22:09:32.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.666+0000 7f7e5259c640 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563ce38daf20 0x563ce38dd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.667+0000 7f7e5259c640 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563ce38daf20 0x563ce38dd330 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba2dc4d23cf56883 server_cookie=17a37958fc59f8a0 in_seq=0 out_seq=0 2024-09-11T22:09:32.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.667+0000 7f7e36ff5640 10 client.26099 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:09:32.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e36ff5640 1 -- 172.21.15.152:0/4117771747 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ce3819860 con 0x563ce38daf20 2024-09-11T22:09:32.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e36ff5640 10 client.26099 handle_command_reply: tid=0 2024-09-11T22:09:32.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e5b5cb740 1 client.26099 shutdown 2024-09-11T22:09:32.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/4117771747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0440 msgr2=0x563ce38b27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:32.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0440 0x563ce38b27b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7e480edb40 tx=0x7f7e480045a0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/4117771747 shutdown_connections 2024-09-11T22:09:32.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563ce38daf20 0x563ce38dd330 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38d6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b5a40 0x563ce38b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/4117771747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b0440 0x563ce38b27b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/4117771747 >> 172.21.15.152:0/4117771747 conn(0x563ce386f310 msgr2=0x563ce38a1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:32.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e36ff5640 0 client.26099 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:09:32.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/4117771747 shutdown_connections 2024-09-11T22:09:32.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.668+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/4117771747 wait complete. 2024-09-11T22:09:32.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.669+0000 7f7e5b5cb740 20 client.26099 trim_cache size 0 max 16384 2024-09-11T22:09:32.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.694+0000 7f7e5b5cb740 1 Processor -- start 2024-09-11T22:09:32.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.694+0000 7f7e5b5cb740 1 -- start start 2024-09-11T22:09:32.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b5a40 0x563ce38d6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e5b5cb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7e541a5690 con 0x563ce38b3230 2024-09-11T22:09:32.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e5b5cb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7e540722e0 con 0x563ce38b5a40 2024-09-11T22:09:32.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e5b5cb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7e54070130 con 0x563ce38b0440 2024-09-11T22:09:32.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e52d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e52d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38b2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:35940/0 (socket says 172.21.15.152:35940) 2024-09-11T22:09:32.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e52d9d640 1 -- 172.21.15.152:0/3377341683 learned_addr learned my addr 172.21.15.152:0/3377341683 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:32.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e5359e640 1 --2- 172.21.15.152:0/3377341683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b5a40 0x563ce38d6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e5259c640 1 --2- 172.21.15.152:0/3377341683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e52d9d640 1 -- 172.21.15.152:0/3377341683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b5a40 msgr2=0x563ce38d6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:32.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/3377341683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b5a40 0x563ce38d6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e52d9d640 1 -- 172.21.15.152:0/3377341683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 msgr2=0x563ce38b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:32.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/3377341683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38b6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.695+0000 7f7e52d9d640 1 -- 172.21.15.152:0/3377341683 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ce38b0a60 con 0x563ce38b0440 2024-09-11T22:09:32.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.696+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/3377341683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38b2b40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e480b8d70 tx=0x7f7e480bca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27b61abf2a54243e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:32.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.696+0000 7f7e38ff9640 1 -- 172.21.15.152:0/3377341683 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480b8bb0 con 0x563ce38b0440 2024-09-11T22:09:32.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.696+0000 7f7e38ff9640 1 -- 172.21.15.152:0/3377341683 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e480a5e50 con 0x563ce38b0440 2024-09-11T22:09:32.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.696+0000 7f7e38ff9640 1 -- 172.21.15.152:0/3377341683 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480305b0 con 0x563ce38b0440 2024-09-11T22:09:32.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.697+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/3377341683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 msgr2=0x563ce38b2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:32.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.697+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/3377341683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38b2b40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e480b8d70 tx=0x7f7e480bca90 comp rx=0 tx=0).stop 2024-09-11T22:09:32.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.697+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/3377341683 shutdown_connections 2024-09-11T22:09:32.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.697+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/3377341683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b5a40 0x563ce38d6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.697+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/3377341683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.698+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/3377341683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38b2b40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.698+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/3377341683 >> 172.21.15.152:0/3377341683 conn(0x563ce386f310 msgr2=0x563ce38b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:32.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.698+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/3377341683 shutdown_connections 2024-09-11T22:09:32.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.698+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/3377341683 wait complete. 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.699+0000 7f7e5b5cb740 1 -- start start 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.699+0000 7f7e5b5cb740 1 Processor -- start 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e52d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e5b5cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b5a40 0x563ce38b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e52d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38d2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:35946/0 (socket says 172.21.15.152:35946) 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e5259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e5259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38d3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58904/0 (socket says 172.21.15.152:58904) 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e52d9d640 1 -- 172.21.15.152:0/1556067437 learned_addr learned my addr 172.21.15.152:0/1556067437 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1556067437 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7e540707a0 con 0x563ce38b3230 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1556067437 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7e54071c10 con 0x563ce38b5a40 2024-09-11T22:09:32.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1556067437 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7e54070e70 con 0x563ce38b0440 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e5359e640 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b5a40 0x563ce38b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e52d9d640 1 -- 172.21.15.152:0/1556067437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b5a40 msgr2=0x563ce38b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b5a40 0x563ce38b7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e52d9d640 1 -- 172.21.15.152:0/1556067437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 msgr2=0x563ce38d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.700+0000 7f7e52d9d640 1 -- 172.21.15.152:0/1556067437 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ce38b8280 con 0x563ce38b0440 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.701+0000 7f7e5b5cb740 10 client.0 _ll_register_callbacks cb 0x7f7e480bc540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.701+0000 7f7e52d9d640 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38d2d20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e4803f040 tx=0x7f7e480307c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23e5c430f3d3852 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.701+0000 7f7e36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.701+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1556067437 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e480a5e50 con 0x563ce38b0440 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.701+0000 7f7e36ff5640 1 -- 172.21.15.152:0/1556067437 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480b8bb0 con 0x563ce38b0440 2024-09-11T22:09:32.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.701+0000 7f7e36ff5640 1 -- 172.21.15.152:0/1556067437 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f7e480bbf70 con 0x563ce38b0440 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.701+0000 7f7e36ff5640 1 -- 172.21.15.152:0/1556067437 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7e480c5350 con 0x563ce38b0440 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.701+0000 7f7e5b5cb740 10 client.26263 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.701+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1556067437 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) -- 0x563ce3944f20 con 0x563ce38b0440 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.702+0000 7f7e36ff5640 1 -- 172.21.15.152:0/1556067437 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7e4804d070 con 0x563ce38b0440 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.702+0000 7f7e5b5cb740 10 client.26263 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.702+0000 7f7e5b5cb740 10 client.26263 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.702+0000 7f7e5b5cb740 20 client.26263 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.702+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563ce39451c0 0x563ce3947620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.702+0000 7f7e5b5cb740 4 client.26263 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.702+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1556067437 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7e480a5e50 con 0x563ce39451c0 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.702+0000 7f7e5259c640 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563ce39451c0 0x563ce3947620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e5259c640 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563ce39451c0 0x563ce3947620 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=692b6bfe1ed1e58b server_cookie=7ff10580517e2420 in_seq=0 out_seq=0 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e36ff5640 10 client.26263 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e36ff5640 1 -- 172.21.15.152:0/1556067437 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7e480a5e50 con 0x563ce39451c0 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e36ff5640 10 client.26263 handle_command_reply: tid=0 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e5b5cb740 1 client.26263 shutdown 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1556067437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 msgr2=0x563ce38d2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38d2d20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e4803f040 tx=0x7f7e480307c0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1556067437 shutdown_connections 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563ce39451c0 0x563ce3947620 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563ce38b5a40 0x563ce38b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ce38b3230 0x563ce38d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e36ff5640 0 client.26263 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e5b5cb740 1 --2- 172.21.15.152:0/1556067437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563ce38b0440 0x563ce38d2d20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.703+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1556067437 >> 172.21.15.152:0/1556067437 conn(0x563ce386f310 msgr2=0x563ce38b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:32.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.704+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1556067437 shutdown_connections 2024-09-11T22:09:32.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.704+0000 7f7e5b5cb740 1 -- 172.21.15.152:0/1556067437 wait complete. 2024-09-11T22:09:32.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.704+0000 7f7e5b5cb740 20 client.26263 trim_cache size 0 max 16384 2024-09-11T22:09:32.711 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:09:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.705+0000 7f7e591f2640 1 -- 172.21.15.152:0/2927672433 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e3c0a2cf0 msgr2=0x7f7e3c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.705+0000 7f7e591f2640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e3c0a2cf0 0x7f7e3c0a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00ec10 tx=0x7f7e4c00d7b0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.705+0000 7f7e591f2640 1 -- 172.21.15.152:0/2927672433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e54100e20 msgr2=0x7f7e541984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.705+0000 7f7e591f2640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e54100e20 0x7f7e541984b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7e48000c00 tx=0x7f7e480042f0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.706+0000 7f7e591f2640 1 -- 172.21.15.152:0/2927672433 shutdown_connections 2024-09-11T22:09:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.706+0000 7f7e591f2640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e3c0a2cf0 0x7f7e3c0a51b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.706+0000 7f7e591f2640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e54102ef0 0x7f7e5419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.706+0000 7f7e591f2640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e54102570 0x7f7e541989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.706+0000 7f7e591f2640 1 --2- 172.21.15.152:0/2927672433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e54100e20 0x7f7e541984b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:32.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.706+0000 7f7e591f2640 1 -- 172.21.15.152:0/2927672433 >> 172.21.15.152:0/2927672433 conn(0x7f7e540fc7d0 msgr2=0x7f7e54105690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:32.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.706+0000 7f7e591f2640 1 -- 172.21.15.152:0/2927672433 shutdown_connections 2024-09-11T22:09:32.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:32.706+0000 7f7e591f2640 1 -- 172.21.15.152:0/2927672433 wait complete. 2024-09-11T22:09:32.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:32 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:09:32.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:32 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:09:32.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:32 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:09:32.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:32 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:09:32.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:32 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:09:32.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:32 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:09:32.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:32 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:09:32.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:32 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:09:32.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:32 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:09:33.554 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:09:33.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:33 smithi179 ceph-mon[35603]: pgmap v161: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2024-09-11T22:09:33.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:33 smithi193 ceph-mon[35545]: pgmap v161: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2024-09-11T22:09:33.939 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:09:33.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:33 smithi152 ceph-mon[31188]: pgmap v161: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2024-09-11T22:09:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.538+0000 7f1128112640 1 -- 172.21.15.152:0/2227138416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1120102db0 msgr2=0x7f1120103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.538+0000 7f1128112640 1 --2- 172.21.15.152:0/2227138416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1120102db0 0x7f1120103190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f111c013f60 tx=0x7f111c032950 comp rx=0 tx=0).stop 2024-09-11T22:09:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.539+0000 7f1128112640 1 -- 172.21.15.152:0/2227138416 shutdown_connections 2024-09-11T22:09:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.539+0000 7f1128112640 1 --2- 172.21.15.152:0/2227138416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f112010c190 0x7f112010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.539+0000 7f1128112640 1 --2- 172.21.15.152:0/2227138416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11201036d0 0x7f112010bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.539+0000 7f1128112640 1 --2- 172.21.15.152:0/2227138416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1120102db0 0x7f1120103190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.539+0000 7f1128112640 1 -- 172.21.15.152:0/2227138416 >> 172.21.15.152:0/2227138416 conn(0x7f11200fc790 msgr2=0x7f11200febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:34.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.541+0000 7f1128112640 1 -- 172.21.15.152:0/2227138416 shutdown_connections 2024-09-11T22:09:34.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.541+0000 7f1128112640 1 -- 172.21.15.152:0/2227138416 wait complete. 2024-09-11T22:09:34.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.542+0000 7f1128112640 1 Processor -- start 2024-09-11T22:09:34.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.542+0000 7f1128112640 1 -- start start 2024-09-11T22:09:34.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.543+0000 7f1128112640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1120102db0 0x7f1120196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.543+0000 7f1128112640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11201036d0 0x7f1120196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.543+0000 7f1128112640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f112010c190 0x7f112019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.543+0000 7f1128112640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f112010fd50 con 0x7f11201036d0 2024-09-11T22:09:34.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.543+0000 7f1128112640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f112010fbd0 con 0x7f1120102db0 2024-09-11T22:09:34.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.543+0000 7f1128112640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f112010fed0 con 0x7f112010c190 2024-09-11T22:09:34.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.543+0000 7f11256ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11201036d0 0x7f1120196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.543+0000 7f11256ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11201036d0 0x7f1120196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33044/0 (socket says 172.21.15.152:33044) 2024-09-11T22:09:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.543+0000 7f11256ad640 1 -- 172.21.15.152:0/64920744 learned_addr learned my addr 172.21.15.152:0/64920744 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.544+0000 7f11256ad640 1 -- 172.21.15.152:0/64920744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f112010c190 msgr2=0x7f112019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.544+0000 7f11256ad640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f112010c190 0x7f112019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.544+0000 7f11256ad640 1 -- 172.21.15.152:0/64920744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1120102db0 msgr2=0x7f1120196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.544+0000 7f11256ad640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1120102db0 0x7f1120196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.544+0000 7f11256ad640 1 -- 172.21.15.152:0/64920744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112019b1e0 con 0x7f11201036d0 2024-09-11T22:09:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.544+0000 7f11256ad640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11201036d0 0x7f1120196770 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f111800ffa0 tx=0x7f111800e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.546+0000 7f1116ffd640 1 -- 172.21.15.152:0/64920744 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111801c070 con 0x7f11201036d0 2024-09-11T22:09:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.546+0000 7f1128112640 1 -- 172.21.15.152:0/64920744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112019b4d0 con 0x7f11201036d0 2024-09-11T22:09:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.546+0000 7f1128112640 1 -- 172.21.15.152:0/64920744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11201a2db0 con 0x7f11201036d0 2024-09-11T22:09:34.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.546+0000 7f1116ffd640 1 -- 172.21.15.152:0/64920744 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f111800cac0 con 0x7f11201036d0 2024-09-11T22:09:34.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.546+0000 7f1116ffd640 1 -- 172.21.15.152:0/64920744 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118017bc0 con 0x7f11201036d0 2024-09-11T22:09:34.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.551+0000 7f112a4eb740 1 Processor -- start 2024-09-11T22:09:34.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.555+0000 7f112a4eb740 1 -- start start 2024-09-11T22:09:34.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.555+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 0x5614c9236090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.555+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c92365d0 0x5614c9236a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.555+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 0x5614c9243760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.555+0000 7f112a4eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5614c919c2f0 con 0x5614c92365d0 2024-09-11T22:09:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.555+0000 7f112a4eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5614c9143cf0 con 0x5614c9237b40 2024-09-11T22:09:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.555+0000 7f112a4eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5614c91982b0 con 0x5614c9241370 2024-09-11T22:09:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.556+0000 7f11266af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 0x5614c9236090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.556+0000 7f1116ffd640 1 -- 172.21.15.152:0/64920744 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f111801f070 con 0x7f11201036d0 2024-09-11T22:09:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.558+0000 7f1116ffd640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f110c0a2ec0 0x7f110c0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.558+0000 7f1116ffd640 1 -- 172.21.15.152:0/64920744 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f11180cf910 con 0x7f11201036d0 2024-09-11T22:09:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.558+0000 7f11266af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 0x5614c9236090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33702/0 (socket says 172.21.15.152:33702) 2024-09-11T22:09:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.558+0000 7f11266af640 1 -- 172.21.15.152:0/2480213930 learned_addr learned my addr 172.21.15.152:0/2480213930 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.558+0000 7f11256ad640 1 --2- 172.21.15.152:0/2480213930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 0x5614c9243760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.559+0000 7f11266af640 1 -- 172.21.15.152:0/2480213930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 msgr2=0x5614c9243760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.559+0000 7f11266af640 1 --2- 172.21.15.152:0/2480213930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 0x5614c9243760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.559+0000 7f11266af640 1 -- 172.21.15.152:0/2480213930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c92365d0 msgr2=0x5614c9236a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.559+0000 7f11266af640 1 --2- 172.21.15.152:0/2480213930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c92365d0 0x5614c9236a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.559+0000 7f11266af640 1 -- 172.21.15.152:0/2480213930 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614c91283a0 con 0x5614c9237b40 2024-09-11T22:09:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.559+0000 7f11266af640 1 --2- 172.21.15.152:0/2480213930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 0x5614c9236090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1110009ce0 tx=0x7f1110010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34eee3c88b9e2b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.560+0000 7f11266af640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f110c0a2ec0 0x7f110c0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.560+0000 7f110bfff640 1 -- 172.21.15.152:0/2480213930 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110005020 con 0x5614c9237b40 2024-09-11T22:09:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.560+0000 7f110bfff640 1 -- 172.21.15.152:0/2480213930 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11100047a0 con 0x5614c9237b40 2024-09-11T22:09:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.560+0000 7f110bfff640 1 -- 172.21.15.152:0/2480213930 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11100127c0 con 0x5614c9237b40 2024-09-11T22:09:34.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.563+0000 7f11266af640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f110c0a2ec0 0x7f110c0a5380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f111001a000 tx=0x7f1110012b70 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:34.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.563+0000 7f112a4eb740 1 -- 172.21.15.152:0/2480213930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 msgr2=0x5614c9236090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:34.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.563+0000 7f112a4eb740 1 --2- 172.21.15.152:0/2480213930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 0x5614c9236090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1110009ce0 tx=0x7f1110010740 comp rx=0 tx=0).stop 2024-09-11T22:09:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.564+0000 7f112a4eb740 1 -- 172.21.15.152:0/2480213930 shutdown_connections 2024-09-11T22:09:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.564+0000 7f112a4eb740 1 --2- 172.21.15.152:0/2480213930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 0x5614c9243760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.564+0000 7f112a4eb740 1 --2- 172.21.15.152:0/2480213930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c92365d0 0x5614c9236a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.564+0000 7f112a4eb740 1 --2- 172.21.15.152:0/2480213930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 0x5614c9236090 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.564+0000 7f112a4eb740 1 -- 172.21.15.152:0/2480213930 >> 172.21.15.152:0/2480213930 conn(0x5614c91ff310 msgr2=0x5614c9232c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:34.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.565+0000 7f112a4eb740 1 -- 172.21.15.152:0/2480213930 shutdown_connections 2024-09-11T22:09:34.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.567+0000 7f112a4eb740 1 -- 172.21.15.152:0/2480213930 wait complete. 2024-09-11T22:09:34.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.567+0000 7f112a4eb740 1 -- start start 2024-09-11T22:09:34.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.567+0000 7f112a4eb740 1 Processor -- start 2024-09-11T22:09:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.568+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c92365d0 0x5614c9240dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.568+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9237b40 0x5614c923e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.568+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9241370 0x5614c923e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.568+0000 7f112a4eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5614c9255080 con 0x5614c9241370 2024-09-11T22:09:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.568+0000 7f112a4eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5614c9157060 con 0x5614c92365d0 2024-09-11T22:09:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.568+0000 7f112a4eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5614c9255200 con 0x5614c9237b40 2024-09-11T22:09:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.568+0000 7f112a4eb740 10 client.0 _ll_register_callbacks cb 0x5614c8eaa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.568+0000 7f1125eae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c92365d0 0x5614c9240dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.568+0000 7f1125eae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c92365d0 0x5614c9240dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33712/0 (socket says 172.21.15.152:33712) 2024-09-11T22:09:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.568+0000 7f1125eae640 1 -- 172.21.15.152:0/240056628 learned_addr learned my addr 172.21.15.152:0/240056628 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.569+0000 7f11266af640 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9241370 0x5614c923e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.569+0000 7f1125eae640 1 -- 172.21.15.152:0/240056628 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9237b40 msgr2=0x5614c923e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.569+0000 7f1125eae640 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9237b40 0x5614c923e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.569+0000 7f1125eae640 1 -- 172.21.15.152:0/240056628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9241370 msgr2=0x5614c923e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.569+0000 7f1125eae640 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9241370 0x5614c923e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.569+0000 7f1125eae640 1 -- 172.21.15.152:0/240056628 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614c8f0d3c0 con 0x5614c92365d0 2024-09-11T22:09:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.569+0000 7f11266af640 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9241370 0x5614c923e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:09:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.569+0000 7f1125eae640 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c92365d0 0x5614c9240dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f111c037d40 tx=0x7f111c005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1d86a7e27100609 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.569+0000 7f11097fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:09:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.570+0000 7f11097fa640 1 -- 172.21.15.152:0/240056628 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c03c070 con 0x5614c92365d0 2024-09-11T22:09:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.570+0000 7f112a4eb740 1 -- 172.21.15.152:0/240056628 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11100047a0 con 0x5614c92365d0 2024-09-11T22:09:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.570+0000 7f11097fa640 1 -- 172.21.15.152:0/240056628 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f111c0375a0 con 0x5614c92365d0 2024-09-11T22:09:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.570+0000 7f11097fa640 1 -- 172.21.15.152:0/240056628 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f111c037e80 con 0x5614c92365d0 2024-09-11T22:09:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.570+0000 7f112a4eb740 10 client.26114 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.570+0000 7f112a4eb740 1 -- 172.21.15.152:0/240056628 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5614c9260bf0 con 0x5614c92365d0 2024-09-11T22:09:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.571+0000 7f11097fa640 1 -- 172.21.15.152:0/240056628 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11100047a0 con 0x5614c92365d0 2024-09-11T22:09:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.571+0000 7f11097fa640 1 -- 172.21.15.152:0/240056628 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f111c038440 con 0x5614c92365d0 2024-09-11T22:09:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.571+0000 7f112a4eb740 10 client.26114 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.571+0000 7f112a4eb740 10 client.26114 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:09:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.571+0000 7f112a4eb740 20 client.26114 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.571+0000 7f112a4eb740 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5614c92624f0 0x5614c9264990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.571+0000 7f112a4eb740 4 client.26114 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:09:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.571+0000 7f112a4eb740 1 -- 172.21.15.152:0/240056628 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614c91a9860 con 0x5614c92624f0 2024-09-11T22:09:34.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.571+0000 7f11256ad640 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5614c92624f0 0x5614c9264990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.572+0000 7f11097fa640 10 client.26114 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.572+0000 7f11256ad640 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5614c92624f0 0x5614c9264990 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0759adc5040ad7f server_cookie=95b63fa40941b684 in_seq=0 out_seq=0 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.573+0000 7f11097fa640 1 -- 172.21.15.152:0/240056628 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614c91a9860 con 0x5614c92624f0 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.573+0000 7f11097fa640 10 client.26114 handle_command_reply: tid=0 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.573+0000 7f112a4eb740 1 client.26114 shutdown 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.573+0000 7f112a4eb740 1 -- 172.21.15.152:0/240056628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c92365d0 msgr2=0x5614c9240dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.573+0000 7f112a4eb740 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c92365d0 0x5614c9240dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f111c037d40 tx=0x7f111c005c90 comp rx=0 tx=0).stop 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.574+0000 7f112a4eb740 1 -- 172.21.15.152:0/240056628 shutdown_connections 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.574+0000 7f112a4eb740 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5614c92624f0 0x5614c9264990 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.574+0000 7f112a4eb740 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9241370 0x5614c923e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.574+0000 7f112a4eb740 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9237b40 0x5614c923e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.574+0000 7f11097fa640 0 client.26114 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:09:34.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.574+0000 7f112a4eb740 1 --2- 172.21.15.152:0/240056628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c92365d0 0x5614c9240dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.574+0000 7f112a4eb740 1 -- 172.21.15.152:0/240056628 >> 172.21.15.152:0/240056628 conn(0x5614c91ff310 msgr2=0x5614c9238930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:34.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.574+0000 7f112a4eb740 1 -- 172.21.15.152:0/240056628 shutdown_connections 2024-09-11T22:09:34.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.574+0000 7f112a4eb740 1 -- 172.21.15.152:0/240056628 wait complete. 2024-09-11T22:09:34.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.574+0000 7f112a4eb740 20 client.26114 trim_cache size 0 max 16384 2024-09-11T22:09:34.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f112a4eb740 1 Processor -- start 2024-09-11T22:09:34.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f112a4eb740 1 -- start start 2024-09-11T22:09:34.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c92365d0 0x5614c9232e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9237b40 0x5614c92369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9241370 0x5614c923d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f112a4eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f11040111a0 con 0x5614c9237b40 2024-09-11T22:09:34.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f112a4eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f110400ea70 con 0x5614c9241370 2024-09-11T22:09:34.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f112a4eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f110400c8c0 con 0x5614c92365d0 2024-09-11T22:09:34.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f11266af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9241370 0x5614c923d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f11266af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9241370 0x5614c923d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33718/0 (socket says 172.21.15.152:33718) 2024-09-11T22:09:34.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f11256ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9237b40 0x5614c92369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f11266af640 1 -- 172.21.15.152:0/2076545027 learned_addr learned my addr 172.21.15.152:0/2076545027 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.595+0000 7f1125eae640 1 --2- 172.21.15.152:0/2076545027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c92365d0 0x5614c9232e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.596+0000 7f11266af640 1 -- 172.21.15.152:0/2076545027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c92365d0 msgr2=0x5614c9232e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.596+0000 7f11266af640 1 --2- 172.21.15.152:0/2076545027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c92365d0 0x5614c9232e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.596+0000 7f11266af640 1 -- 172.21.15.152:0/2076545027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9237b40 msgr2=0x5614c92369b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.596+0000 7f11266af640 1 --2- 172.21.15.152:0/2076545027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9237b40 0x5614c92369b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.596+0000 7f11266af640 1 -- 172.21.15.152:0/2076545027 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614c923eb70 con 0x5614c9241370 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.596+0000 7f11256ad640 1 --2- 172.21.15.152:0/2076545027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9237b40 0x5614c92369b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.596+0000 7f11266af640 1 --2- 172.21.15.152:0/2076545027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9241370 0x5614c923d900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1110010c40 tx=0x7f1110024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8336cff97a471cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.596+0000 7f110b7fe640 1 -- 172.21.15.152:0/2076545027 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110035070 con 0x5614c9241370 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.596+0000 7f110b7fe640 1 -- 172.21.15.152:0/2076545027 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f111002b070 con 0x5614c9241370 2024-09-11T22:09:34.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.596+0000 7f110b7fe640 1 -- 172.21.15.152:0/2076545027 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110012450 con 0x5614c9241370 2024-09-11T22:09:34.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.597+0000 7f112a4eb740 1 -- 172.21.15.152:0/2076545027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9241370 msgr2=0x5614c923d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:34.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.597+0000 7f112a4eb740 1 --2- 172.21.15.152:0/2076545027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9241370 0x5614c923d900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1110010c40 tx=0x7f1110024000 comp rx=0 tx=0).stop 2024-09-11T22:09:34.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.597+0000 7f112a4eb740 1 -- 172.21.15.152:0/2076545027 shutdown_connections 2024-09-11T22:09:34.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.597+0000 7f112a4eb740 1 --2- 172.21.15.152:0/2076545027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9241370 0x5614c923d900 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.597+0000 7f112a4eb740 1 --2- 172.21.15.152:0/2076545027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c9237b40 0x5614c92369b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.597+0000 7f112a4eb740 1 --2- 172.21.15.152:0/2076545027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c92365d0 0x5614c9232e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.597+0000 7f112a4eb740 1 -- 172.21.15.152:0/2076545027 >> 172.21.15.152:0/2076545027 conn(0x5614c91ff310 msgr2=0x5614c9232700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:34.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.600+0000 7f112a4eb740 1 -- 172.21.15.152:0/2076545027 shutdown_connections 2024-09-11T22:09:34.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.600+0000 7f112a4eb740 1 -- 172.21.15.152:0/2076545027 wait complete. 2024-09-11T22:09:34.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.600+0000 7f112a4eb740 1 -- start start 2024-09-11T22:09:34.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.601+0000 7f112a4eb740 1 Processor -- start 2024-09-11T22:09:34.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.601+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c92365d0 0x5614c92c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.601+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 0x5614c92c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.602+0000 7f112a4eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 0x5614c92594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.602+0000 7f1125eae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c92365d0 0x5614c92c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.602+0000 7f11256ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 0x5614c92c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.602+0000 7f11266af640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 0x5614c92594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.602+0000 7f1125eae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c92365d0 0x5614c92c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33086/0 (socket says 172.21.15.152:33086) 2024-09-11T22:09:34.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.602+0000 7f1125eae640 1 -- 172.21.15.152:0/1814084968 learned_addr learned my addr 172.21.15.152:0/1814084968 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:34.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.602+0000 7f11266af640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 0x5614c92594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:49752/0 (socket says 172.21.15.152:49752) 2024-09-11T22:09:34.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.602+0000 7f112a4eb740 1 -- 172.21.15.152:0/1814084968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f110400cf30 con 0x5614c92365d0 2024-09-11T22:09:34.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.602+0000 7f112a4eb740 1 -- 172.21.15.152:0/1814084968 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f110400e3a0 con 0x5614c9237b40 2024-09-11T22:09:34.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.602+0000 7f112a4eb740 1 -- 172.21.15.152:0/1814084968 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f110400d600 con 0x5614c9241370 2024-09-11T22:09:34.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.602+0000 7f112a4eb740 10 client.0 _ll_register_callbacks cb 0x7f1118009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:34.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.603+0000 7f11266af640 1 -- 172.21.15.152:0/1814084968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 msgr2=0x5614c92c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:34.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.603+0000 7f11266af640 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 0x5614c92c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.603+0000 7f11266af640 1 -- 172.21.15.152:0/1814084968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c92365d0 msgr2=0x5614c92c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.603+0000 7f11266af640 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c92365d0 0x5614c92c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.603+0000 7f11266af640 1 -- 172.21.15.152:0/1814084968 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614c9259a20 con 0x5614c9241370 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.603+0000 7f1125eae640 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c92365d0 0x5614c92c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.603+0000 7f11256ad640 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 0x5614c92c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.604+0000 7f11266af640 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 0x5614c92594e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1110004700 tx=0x7f1110009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9898f3fae1125fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.604+0000 7f11097fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.604+0000 7f11097fa640 1 -- 172.21.15.152:0/1814084968 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111003d020 con 0x5614c9241370 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.604+0000 7f11097fa640 1 -- 172.21.15.152:0/1814084968 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f1110024680 con 0x5614c9241370 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.604+0000 7f112a4eb740 1 -- 172.21.15.152:0/1814084968 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f111002b070 con 0x5614c9241370 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.604+0000 7f11097fa640 1 -- 172.21.15.152:0/1814084968 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1110035040 con 0x5614c9241370 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.604+0000 7f112a4eb740 10 client.26275 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.604+0000 7f112a4eb740 1 -- 172.21.15.152:0/1814084968 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5614c925ad20 con 0x5614c9241370 2024-09-11T22:09:34.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.605+0000 7f11097fa640 1 -- 172.21.15.152:0/1814084968 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f111002b070 con 0x5614c9241370 2024-09-11T22:09:34.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.605+0000 7f11097fa640 1 -- 172.21.15.152:0/1814084968 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f1110041990 con 0x5614c9241370 2024-09-11T22:09:34.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.605+0000 7f112a4eb740 10 client.26275 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:34.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.605+0000 7f112a4eb740 10 client.26275 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:09:34.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.605+0000 7f112a4eb740 20 client.26275 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:34.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.605+0000 7f112a4eb740 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5614c92de280 0x5614c92e0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:34.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.605+0000 7f112a4eb740 4 client.26275 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:09:34.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.605+0000 7f112a4eb740 1 -- 172.21.15.152:0/1814084968 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5614c91a3d70 con 0x5614c92de280 2024-09-11T22:09:34.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.605+0000 7f1125eae640 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5614c92de280 0x5614c92e0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:34.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.606+0000 7f1125eae640 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5614c92de280 0x5614c92e0670 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3b7de19b1cd689c6 server_cookie=4adf87c507186158 in_seq=0 out_seq=0 2024-09-11T22:09:34.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.606+0000 7f11097fa640 10 client.26275 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:09:34.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.606+0000 7f11097fa640 1 -- 172.21.15.152:0/1814084968 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5614c91a3d70 con 0x5614c92de280 2024-09-11T22:09:34.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.606+0000 7f11097fa640 10 client.26275 handle_command_reply: tid=0 2024-09-11T22:09:34.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.606+0000 7f112a4eb740 1 client.26275 shutdown 2024-09-11T22:09:34.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.606+0000 7f112a4eb740 1 -- 172.21.15.152:0/1814084968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 msgr2=0x5614c92594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:34.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.606+0000 7f112a4eb740 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 0x5614c92594e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1110004700 tx=0x7f1110009640 comp rx=0 tx=0).stop 2024-09-11T22:09:34.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.607+0000 7f112a4eb740 1 -- 172.21.15.152:0/1814084968 shutdown_connections 2024-09-11T22:09:34.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.607+0000 7f112a4eb740 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5614c92de280 0x5614c92e0670 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.607+0000 7f112a4eb740 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5614c9241370 0x5614c92594e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.607+0000 7f112a4eb740 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5614c9237b40 0x5614c92c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.607+0000 7f11097fa640 0 client.26275 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:09:34.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.607+0000 7f112a4eb740 1 --2- 172.21.15.152:0/1814084968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5614c92365d0 0x5614c92c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.607+0000 7f112a4eb740 1 -- 172.21.15.152:0/1814084968 >> 172.21.15.152:0/1814084968 conn(0x5614c91ff310 msgr2=0x5614c923d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:34.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.607+0000 7f112a4eb740 1 -- 172.21.15.152:0/1814084968 shutdown_connections 2024-09-11T22:09:34.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.607+0000 7f112a4eb740 1 -- 172.21.15.152:0/1814084968 wait complete. 2024-09-11T22:09:34.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.607+0000 7f112a4eb740 20 client.26275 trim_cache size 0 max 16384 2024-09-11T22:09:34.611 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:09:34.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.609+0000 7f1128112640 1 -- 172.21.15.152:0/64920744 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f110c0a2ec0 msgr2=0x7f110c0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:34.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.609+0000 7f1128112640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f110c0a2ec0 0x7f110c0a5380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f111001a000 tx=0x7f1110012b70 comp rx=0 tx=0).stop 2024-09-11T22:09:34.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.609+0000 7f1128112640 1 -- 172.21.15.152:0/64920744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11201036d0 msgr2=0x7f1120196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:34.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.609+0000 7f1128112640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11201036d0 0x7f1120196770 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f111800ffa0 tx=0x7f111800e820 comp rx=0 tx=0).stop 2024-09-11T22:09:34.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.610+0000 7f1128112640 1 -- 172.21.15.152:0/64920744 shutdown_connections 2024-09-11T22:09:34.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.610+0000 7f1128112640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f110c0a2ec0 0x7f110c0a5380 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.610+0000 7f1128112640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f112010c190 0x7f112019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.610+0000 7f1128112640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11201036d0 0x7f1120196770 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.610+0000 7f1128112640 1 --2- 172.21.15.152:0/64920744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1120102db0 0x7f1120196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:34.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.610+0000 7f1128112640 1 -- 172.21.15.152:0/64920744 >> 172.21.15.152:0/64920744 conn(0x7f11200fc790 msgr2=0x7f11200fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:34.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.610+0000 7f1128112640 1 -- 172.21.15.152:0/64920744 shutdown_connections 2024-09-11T22:09:34.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:34.610+0000 7f1128112640 1 -- 172.21.15.152:0/64920744 wait complete. 2024-09-11T22:09:34.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 240.0 s, 4236.0 tps, lat 23.538 ms stddev 25.191 2024-09-11T22:09:35.427 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:09:35.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:35 smithi179 ceph-mon[35603]: pgmap v162: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.8 MiB/s wr, 689 op/s 2024-09-11T22:09:35.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:35 smithi193 ceph-mon[35545]: pgmap v162: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.8 MiB/s wr, 689 op/s 2024-09-11T22:09:35.826 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:09:35.957 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:35 smithi152 ceph-mon[31188]: pgmap v162: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.8 MiB/s wr, 689 op/s 2024-09-11T22:09:35.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.985+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/1433653353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b88100520 msgr2=0x7f3b8810e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:35.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.985+0000 7f3b8e3c4640 1 --2- 172.21.15.152:0/1433653353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b88100520 0x7f3b8810e9a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3b80008200 tx=0x7f3b80032c70 comp rx=0 tx=0).stop 2024-09-11T22:09:35.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.985+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/1433653353 shutdown_connections 2024-09-11T22:09:35.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.985+0000 7f3b8e3c4640 1 --2- 172.21.15.152:0/1433653353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b88100520 0x7f3b8810e9a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:35.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.985+0000 7f3b8e3c4640 1 --2- 172.21.15.152:0/1433653353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b880ffb80 0x7f3b880fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:35.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.985+0000 7f3b8e3c4640 1 --2- 172.21.15.152:0/1433653353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b88106b10 0x7f3b88106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:35.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.985+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/1433653353 >> 172.21.15.152:0/1433653353 conn(0x7f3b880fba30 msgr2=0x7f3b880fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:35.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.986+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/1433653353 shutdown_connections 2024-09-11T22:09:35.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.986+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/1433653353 wait complete. 2024-09-11T22:09:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.987+0000 7f3b8e3c4640 1 Processor -- start 2024-09-11T22:09:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.987+0000 7f3b8e3c4640 1 -- start start 2024-09-11T22:09:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.987+0000 7f3b8e3c4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b880ffb80 0x7f3b88073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.987+0000 7f3b8e3c4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b88100520 0x7f3b88073c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.987+0000 7f3b8e3c4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b88106b10 0x7f3b8806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.987+0000 7f3b8e3c4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8806c330 con 0x7f3b88100520 2024-09-11T22:09:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.987+0000 7f3b8e3c4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8806c1b0 con 0x7f3b88106b10 2024-09-11T22:09:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.987+0000 7f3b8e3c4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8806c4b0 con 0x7f3b880ffb80 2024-09-11T22:09:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.987+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b880ffb80 0x7f3b88073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.987+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b880ffb80 0x7f3b88073750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:49770/0 (socket says 172.21.15.152:49770) 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.987+0000 7f3b87fff640 1 -- 172.21.15.152:0/2000441366 learned_addr learned my addr 172.21.15.152:0/2000441366 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.988+0000 7f3b8c961640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b88106b10 0x7f3b8806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.988+0000 7f3b877fe640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b88100520 0x7f3b88073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.988+0000 7f3b87fff640 1 -- 172.21.15.152:0/2000441366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b88106b10 msgr2=0x7f3b8806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.988+0000 7f3b87fff640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b88106b10 0x7f3b8806d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.988+0000 7f3b87fff640 1 -- 172.21.15.152:0/2000441366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b88100520 msgr2=0x7f3b88073c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.988+0000 7f3b87fff640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b88100520 0x7f3b88073c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.988+0000 7f3b87fff640 1 -- 172.21.15.152:0/2000441366 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8806e060 con 0x7f3b880ffb80 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.988+0000 7f3b8c961640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b88106b10 0x7f3b8806d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.988+0000 7f3b877fe640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b88100520 0x7f3b88073c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:09:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.988+0000 7f3b87fff640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b880ffb80 0x7f3b88073750 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000e9c0 tx=0x7f3b7000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.988+0000 7f3b857fa640 1 -- 172.21.15.152:0/2000441366 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000ccc0 con 0x7f3b880ffb80 2024-09-11T22:09:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.989+0000 7f3b857fa640 1 -- 172.21.15.152:0/2000441366 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b70005500 con 0x7f3b880ffb80 2024-09-11T22:09:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.989+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/2000441366 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8806e350 con 0x7f3b880ffb80 2024-09-11T22:09:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.989+0000 7f3b857fa640 1 -- 172.21.15.152:0/2000441366 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70010430 con 0x7f3b880ffb80 2024-09-11T22:09:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.989+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/2000441366 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b881ab4c0 con 0x7f3b880ffb80 2024-09-11T22:09:35.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.991+0000 7f3b857fa640 1 -- 172.21.15.152:0/2000441366 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3b700046c0 con 0x7f3b880ffb80 2024-09-11T22:09:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.993+0000 7f3b9123b740 1 Processor -- start 2024-09-11T22:09:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.993+0000 7f3b857fa640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b740a2ed0 0x7f3b740a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.993+0000 7f3b9123b740 1 -- start start 2024-09-11T22:09:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.993+0000 7f3b857fa640 1 -- 172.21.15.152:0/2000441366 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3b700cf870 con 0x7f3b880ffb80 2024-09-11T22:09:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.993+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69ced1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.993+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cedc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.993+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69cedf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.993+0000 7f3b8c961640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b740a2ed0 0x7f3b740a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.993+0000 7f3b9123b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f69ce362f0 con 0x55f69ced1af0 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b9123b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f69cdde270 con 0x55f69ced2410 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b9123b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f69ce322b0 con 0x55f69cedccb0 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69ced1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69ced1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33120/0 (socket says 172.21.15.152:33120) 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b87fff640 1 -- 172.21.15.152:0/796727531 learned_addr learned my addr 172.21.15.152:0/796727531 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b877fe640 1 --2- 172.21.15.152:0/796727531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cedc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b8c961640 1 --2- 172.21.15.152:0/796727531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69cedf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b877fe640 1 -- 172.21.15.152:0/796727531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 msgr2=0x55f69cedf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b877fe640 1 --2- 172.21.15.152:0/796727531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69cedf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b877fe640 1 -- 172.21.15.152:0/796727531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 msgr2=0x55f69ced1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b877fe640 1 --2- 172.21.15.152:0/796727531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69ced1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b877fe640 1 -- 172.21.15.152:0/796727531 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69cddd340 con 0x55f69ced2410 2024-09-11T22:09:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b87fff640 1 --2- 172.21.15.152:0/796727531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69ced1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:09:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b8c961640 1 --2- 172.21.15.152:0/796727531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69cedf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:09:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.994+0000 7f3b877fe640 1 --2- 172.21.15.152:0/796727531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cedc770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3b8806f010 tx=0x7f3b78010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e74aa0500bc2286 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.995+0000 7f3b7e7fc640 1 -- 172.21.15.152:0/796727531 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b78004030 con 0x55f69ced2410 2024-09-11T22:09:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.995+0000 7f3b8c961640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b740a2ed0 0x7f3b740a5390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b80006010 tx=0x7f3b80033640 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.995+0000 7f3b7e7fc640 1 -- 172.21.15.152:0/796727531 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b780041d0 con 0x55f69ced2410 2024-09-11T22:09:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.995+0000 7f3b7e7fc640 1 -- 172.21.15.152:0/796727531 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b78012690 con 0x55f69ced2410 2024-09-11T22:09:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.996+0000 7f3b9123b740 1 -- 172.21.15.152:0/796727531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 msgr2=0x55f69cedc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.996+0000 7f3b9123b740 1 --2- 172.21.15.152:0/796727531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cedc770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3b8806f010 tx=0x7f3b78010740 comp rx=0 tx=0).stop 2024-09-11T22:09:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.997+0000 7f3b9123b740 1 -- 172.21.15.152:0/796727531 shutdown_connections 2024-09-11T22:09:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.997+0000 7f3b9123b740 1 --2- 172.21.15.152:0/796727531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69cedf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.997+0000 7f3b9123b740 1 --2- 172.21.15.152:0/796727531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cedc770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.997+0000 7f3b9123b740 1 --2- 172.21.15.152:0/796727531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69ced1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.997+0000 7f3b9123b740 1 -- 172.21.15.152:0/796727531 >> 172.21.15.152:0/796727531 conn(0x55f69cece060 msgr2=0x55f69cece440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.997+0000 7f3b9123b740 1 -- 172.21.15.152:0/796727531 shutdown_connections 2024-09-11T22:09:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.997+0000 7f3b9123b740 1 -- 172.21.15.152:0/796727531 wait complete. 2024-09-11T22:09:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.998+0000 7f3b9123b740 1 -- start start 2024-09-11T22:09:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.998+0000 7f3b9123b740 1 Processor -- start 2024-09-11T22:09:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.998+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced1af0 0x55f69ced9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.998+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced2410 0x55f69ceda170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.998+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69ceda6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.998+0000 7f3b9123b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f69cef0890 con 0x55f69ced2410 2024-09-11T22:09:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.998+0000 7f3b9123b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f69cdbf290 con 0x55f69ced1af0 2024-09-11T22:09:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.998+0000 7f3b9123b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f69cef0a10 con 0x55f69cedccb0 2024-09-11T22:09:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.998+0000 7f3b9123b740 10 client.0 _ll_register_callbacks cb 0x55f69cdf0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced1af0 0x55f69ced9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced1af0 0x55f69ced9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33758/0 (socket says 172.21.15.152:33758) 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b87fff640 1 -- 172.21.15.152:0/2688000312 learned_addr learned my addr 172.21.15.152:0/2688000312 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b877fe640 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced2410 0x55f69ceda170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b8c961640 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69ceda6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b87fff640 1 -- 172.21.15.152:0/2688000312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 msgr2=0x55f69ceda6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b87fff640 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69ceda6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b87fff640 1 -- 172.21.15.152:0/2688000312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced2410 msgr2=0x55f69ceda170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b87fff640 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced2410 0x55f69ceda170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b87fff640 1 -- 172.21.15.152:0/2688000312 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f69cb49210 con 0x55f69ced1af0 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b87fff640 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced1af0 0x55f69ced9c30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b700ccf90 tx=0x7f3b7009c570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37405150e234b063 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b677fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:09:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b677fe640 1 -- 172.21.15.152:0/2688000312 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b700a44e0 con 0x55f69ced1af0 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b677fe640 1 -- 172.21.15.152:0/2688000312 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3b700a4680 con 0x55f69ced1af0 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:35.999+0000 7f3b9123b740 1 -- 172.21.15.152:0/2688000312 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b780041d0 con 0x55f69ced1af0 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b677fe640 1 -- 172.21.15.152:0/2688000312 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3b70081050 con 0x55f69ced1af0 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b9123b740 10 client.26129 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b9123b740 1 -- 172.21.15.152:0/2688000312 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f69cc15620 con 0x55f69ced1af0 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b677fe640 1 -- 172.21.15.152:0/2688000312 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b780041d0 con 0x55f69ced1af0 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b677fe640 1 -- 172.21.15.152:0/2688000312 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3b70097a50 con 0x55f69ced1af0 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b9123b740 10 client.26129 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b9123b740 10 client.26129 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b9123b740 20 client.26129 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b9123b740 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f69cefdc20 0x55f69cf00030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b9123b740 4 client.26129 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b9123b740 1 -- 172.21.15.152:0/2688000312 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f69ce43a20 con 0x55f69cefdc20 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.000+0000 7f3b877fe640 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f69cefdc20 0x55f69cf00030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.001+0000 7f3b877fe640 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f69cefdc20 0x55f69cf00030 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70ccc76ce5402875 server_cookie=a651d3b97301d7ea in_seq=0 out_seq=0 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.001+0000 7f3b677fe640 10 client.26129 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.002+0000 7f3b677fe640 1 -- 172.21.15.152:0/2688000312 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f69ce43a20 con 0x55f69cefdc20 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.002+0000 7f3b677fe640 10 client.26129 handle_command_reply: tid=0 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.002+0000 7f3b9123b740 1 client.26129 shutdown 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.003+0000 7f3b9123b740 1 -- 172.21.15.152:0/2688000312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced1af0 msgr2=0x55f69ced9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.003+0000 7f3b9123b740 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced1af0 0x55f69ced9c30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b700ccf90 tx=0x7f3b7009c570 comp rx=0 tx=0).stop 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.003+0000 7f3b9123b740 1 -- 172.21.15.152:0/2688000312 shutdown_connections 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.003+0000 7f3b9123b740 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f69cefdc20 0x55f69cf00030 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.003+0000 7f3b9123b740 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69ceda6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.003+0000 7f3b9123b740 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced2410 0x55f69ceda170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.003+0000 7f3b9123b740 1 --2- 172.21.15.152:0/2688000312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced1af0 0x55f69ced9c30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.003+0000 7f3b9123b740 1 -- 172.21.15.152:0/2688000312 >> 172.21.15.152:0/2688000312 conn(0x55f69cece060 msgr2=0x55f69ced3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.003+0000 7f3b677fe640 0 client.26129 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.003+0000 7f3b9123b740 1 -- 172.21.15.152:0/2688000312 shutdown_connections 2024-09-11T22:09:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.003+0000 7f3b9123b740 1 -- 172.21.15.152:0/2688000312 wait complete. 2024-09-11T22:09:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.004+0000 7f3b9123b740 20 client.26129 trim_cache size 0 max 16384 2024-09-11T22:09:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.032+0000 7f3b9123b740 1 Processor -- start 2024-09-11T22:09:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.033+0000 7f3b9123b740 1 -- start start 2024-09-11T22:09:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.033+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69cedbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.033+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cf05960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.033+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69cf05ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.033+0000 7f3b9123b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b881b6710 con 0x55f69ced1af0 2024-09-11T22:09:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.033+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69cedbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.033+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69cedbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33140/0 (socket says 172.21.15.152:33140) 2024-09-11T22:09:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.033+0000 7f3b87fff640 1 -- 172.21.15.152:0/3167602829 learned_addr learned my addr 172.21.15.152:0/3167602829 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.034+0000 7f3b9123b740 1 -- 172.21.15.152:0/3167602829 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b881b3fe0 con 0x55f69ced2410 2024-09-11T22:09:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.034+0000 7f3b9123b740 1 -- 172.21.15.152:0/3167602829 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b881b1e30 con 0x55f69cedccb0 2024-09-11T22:09:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.035+0000 7f3b87fff640 1 -- 172.21.15.152:0/3167602829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 msgr2=0x55f69cf05ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:09:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.035+0000 7f3b87fff640 1 --2- 172.21.15.152:0/3167602829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69cf05ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.035+0000 7f3b87fff640 1 -- 172.21.15.152:0/3167602829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 msgr2=0x55f69cf05960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:09:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.035+0000 7f3b87fff640 1 --2- 172.21.15.152:0/3167602829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cf05960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.035+0000 7f3b87fff640 1 -- 172.21.15.152:0/3167602829 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69cefa670 con 0x55f69ced1af0 2024-09-11T22:09:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.036+0000 7f3b87fff640 1 --2- 172.21.15.152:0/3167602829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69cedbba0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3b700058c0 tx=0x7f3b7009be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4488a55ebc2075b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.039+0000 7f3b7dffb640 1 -- 172.21.15.152:0/3167602829 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b700a9070 con 0x55f69ced1af0 2024-09-11T22:09:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.039+0000 7f3b7dffb640 1 -- 172.21.15.152:0/3167602829 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b7009af60 con 0x55f69ced1af0 2024-09-11T22:09:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.040+0000 7f3b9123b740 1 -- 172.21.15.152:0/3167602829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 msgr2=0x55f69cedbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.040+0000 7f3b9123b740 1 --2- 172.21.15.152:0/3167602829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69cedbba0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3b700058c0 tx=0x7f3b7009be80 comp rx=0 tx=0).stop 2024-09-11T22:09:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.045+0000 7f3b9123b740 1 -- 172.21.15.152:0/3167602829 shutdown_connections 2024-09-11T22:09:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.045+0000 7f3b9123b740 1 --2- 172.21.15.152:0/3167602829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69cedccb0 0x55f69cf05ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.045+0000 7f3b9123b740 1 --2- 172.21.15.152:0/3167602829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cf05960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.045+0000 7f3b9123b740 1 --2- 172.21.15.152:0/3167602829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69ced1af0 0x55f69cedbba0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.045+0000 7f3b9123b740 1 -- 172.21.15.152:0/3167602829 >> 172.21.15.152:0/3167602829 conn(0x55f69cece060 msgr2=0x55f69cedb490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.048+0000 7f3b9123b740 1 -- 172.21.15.152:0/3167602829 shutdown_connections 2024-09-11T22:09:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.048+0000 7f3b9123b740 1 -- 172.21.15.152:0/3167602829 wait complete. 2024-09-11T22:09:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.049+0000 7f3b9123b740 1 -- start start 2024-09-11T22:09:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.049+0000 7f3b9123b740 1 Processor -- start 2024-09-11T22:09:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.050+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69ced1af0 0x55f69cef1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.050+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cef1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.050+0000 7f3b9123b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69cedccb0 0x55f69cef23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.050+0000 7f3b9123b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b881b24a0 con 0x55f69cedccb0 2024-09-11T22:09:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.050+0000 7f3b9123b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b881b3910 con 0x55f69ced2410 2024-09-11T22:09:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.050+0000 7f3b9123b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b881b2b70 con 0x55f69ced1af0 2024-09-11T22:09:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.050+0000 7f3b9123b740 10 client.0 _ll_register_callbacks cb 0x7f3b7000ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.050+0000 7f3b8c961640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69cedccb0 0x55f69cef23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.050+0000 7f3b8c961640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69cedccb0 0x55f69cef23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33146/0 (socket says 172.21.15.152:33146) 2024-09-11T22:09:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.050+0000 7f3b8c961640 1 -- 172.21.15.152:0/4038955463 learned_addr learned my addr 172.21.15.152:0/4038955463 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.051+0000 7f3b877fe640 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cef1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.051+0000 7f3b8c961640 1 -- 172.21.15.152:0/4038955463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69ced1af0 msgr2=0x55f69cef1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.051+0000 7f3b8c961640 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69ced1af0 0x55f69cef1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.051+0000 7f3b8c961640 1 -- 172.21.15.152:0/4038955463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 msgr2=0x55f69cef1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.051+0000 7f3b8c961640 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cef1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.051+0000 7f3b8c961640 1 -- 172.21.15.152:0/4038955463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f69cf67930 con 0x55f69cedccb0 2024-09-11T22:09:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.051+0000 7f3b8c961640 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69cedccb0 0x55f69cef23e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3b80008200 tx=0x7f3b80032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8938737f8da1c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.051+0000 7f3b677fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.052+0000 7f3b677fe640 1 -- 172.21.15.152:0/4038955463 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8004b030 con 0x55f69cedccb0 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.052+0000 7f3b9123b740 1 -- 172.21.15.152:0/4038955463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b7009af60 con 0x55f69cedccb0 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.052+0000 7f3b677fe640 1 -- 172.21.15.152:0/4038955463 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f3b80042050 con 0x55f69cedccb0 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.052+0000 7f3b677fe640 1 -- 172.21.15.152:0/4038955463 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3b80033940 con 0x55f69cedccb0 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.052+0000 7f3b9123b740 10 client.16710 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.052+0000 7f3b9123b740 1 -- 172.21.15.152:0/4038955463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f69cf68b40 con 0x55f69cedccb0 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.052+0000 7f3b677fe640 1 -- 172.21.15.152:0/4038955463 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b7009af60 con 0x55f69cedccb0 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.052+0000 7f3b677fe640 1 -- 172.21.15.152:0/4038955463 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3b80044050 con 0x55f69cedccb0 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.053+0000 7f3b9123b740 10 client.16710 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.053+0000 7f3b9123b740 10 client.16710 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.053+0000 7f3b9123b740 20 client.16710 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.053+0000 7f3b9123b740 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f69cf692c0 0x55f69cf6b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.053+0000 7f3b9123b740 4 client.16710 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:09:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.053+0000 7f3b9123b740 1 -- 172.21.15.152:0/4038955463 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f69ce3dd70 con 0x55f69cf692c0 2024-09-11T22:09:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.054+0000 7f3b87fff640 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f69cf692c0 0x55f69cf6b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.054+0000 7f3b87fff640 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f69cf692c0 0x55f69cf6b6e0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b558bd14d4a210 server_cookie=1fc2560420318d08 in_seq=0 out_seq=0 2024-09-11T22:09:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.054+0000 7f3b677fe640 10 client.16710 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b677fe640 1 -- 172.21.15.152:0/4038955463 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f69ce3dd70 con 0x55f69cf692c0 2024-09-11T22:09:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b677fe640 10 client.16710 handle_command_reply: tid=0 2024-09-11T22:09:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 1 client.16710 shutdown 2024-09-11T22:09:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 1 -- 172.21.15.152:0/4038955463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69cedccb0 msgr2=0x55f69cef23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69cedccb0 0x55f69cef23e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3b80008200 tx=0x7f3b80032c70 comp rx=0 tx=0).stop 2024-09-11T22:09:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 1 -- 172.21.15.152:0/4038955463 shutdown_connections 2024-09-11T22:09:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f69cf692c0 0x55f69cf6b6e0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f69cedccb0 0x55f69cef23e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b677fe640 0 client.16710 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f69ced2410 0x55f69cef1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 1 --2- 172.21.15.152:0/4038955463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f69ced1af0 0x55f69cef1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 1 -- 172.21.15.152:0/4038955463 >> 172.21.15.152:0/4038955463 conn(0x55f69cece060 msgr2=0x55f69cecd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 1 -- 172.21.15.152:0/4038955463 shutdown_connections 2024-09-11T22:09:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 1 -- 172.21.15.152:0/4038955463 wait complete. 2024-09-11T22:09:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.063+0000 7f3b9123b740 20 client.16710 trim_cache size 0 max 16384 2024-09-11T22:09:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:09:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:09:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:09:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:09:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/2000441366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b740a2ed0 msgr2=0x7f3b740a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b740a2ed0 0x7f3b740a5390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b80006010 tx=0x7f3b80033640 comp rx=0 tx=0).stop 2024-09-11T22:09:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/2000441366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b880ffb80 msgr2=0x7f3b88073750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b880ffb80 0x7f3b88073750 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000e9c0 tx=0x7f3b7000ee80 comp rx=0 tx=0).stop 2024-09-11T22:09:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/2000441366 shutdown_connections 2024-09-11T22:09:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3b740a2ed0 0x7f3b740a5390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b88106b10 0x7f3b8806d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b88100520 0x7f3b88073c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 --2- 172.21.15.152:0/2000441366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b880ffb80 0x7f3b88073750 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/2000441366 >> 172.21.15.152:0/2000441366 conn(0x7f3b880fba30 msgr2=0x7f3b880fc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/2000441366 shutdown_connections 2024-09-11T22:09:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:36.064+0000 7f3b8e3c4640 1 -- 172.21.15.152:0/2000441366 wait complete. 2024-09-11T22:09:36.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.615+0000 7fab713a9640 1 -- 172.21.15.152:0/408981908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c108290 msgr2=0x7fab6c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.615+0000 7fab713a9640 1 --2- 172.21.15.152:0/408981908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c108290 0x7fab6c10ec30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fab64009ca0 tx=0x7fab6402a8b0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.615+0000 7fab713a9640 1 -- 172.21.15.152:0/408981908 shutdown_connections 2024-09-11T22:09:36.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.615+0000 7fab713a9640 1 --2- 172.21.15.152:0/408981908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c108290 0x7fab6c10ec30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.615+0000 7fab713a9640 1 --2- 172.21.15.152:0/408981908 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab6c103740 0x7fab6c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.615+0000 7fab713a9640 1 --2- 172.21.15.152:0/408981908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab6c102d90 0x7fab6c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.615+0000 7fab713a9640 1 -- 172.21.15.152:0/408981908 >> 172.21.15.152:0/408981908 conn(0x7fab6c0fc7d0 msgr2=0x7fab6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:36.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.615+0000 7fab713a9640 1 -- 172.21.15.152:0/408981908 shutdown_connections 2024-09-11T22:09:36.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.616+0000 7fab713a9640 1 -- 172.21.15.152:0/408981908 wait complete. 2024-09-11T22:09:36.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.616+0000 7fab713a9640 1 Processor -- start 2024-09-11T22:09:36.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.618+0000 7fab713a9640 1 -- start start 2024-09-11T22:09:36.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.618+0000 7fab713a9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab6c102d90 0x7fab6c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.618+0000 7fab713a9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab6c103740 0x7fab6c19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.618+0000 7fab713a9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c108290 0x7fab6c19e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.618+0000 7fab713a9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c1142b0 con 0x7fab6c103740 2024-09-11T22:09:36.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.618+0000 7fab6affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab6c102d90 0x7fab6c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.618+0000 7fab713a9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c114130 con 0x7fab6c108290 2024-09-11T22:09:36.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab713a9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c114430 con 0x7fab6c102d90 2024-09-11T22:09:36.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab6affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab6c102d90 0x7fab6c19a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:49848/0 (socket says 172.21.15.152:49848) 2024-09-11T22:09:36.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab6affd640 1 -- 172.21.15.152:0/1691798200 learned_addr learned my addr 172.21.15.152:0/1691798200 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:36.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab6b7fe640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c108290 0x7fab6c19e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab6a7fc640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab6c103740 0x7fab6c19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab6affd640 1 -- 172.21.15.152:0/1691798200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c108290 msgr2=0x7fab6c19e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab6affd640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c108290 0x7fab6c19e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab6affd640 1 -- 172.21.15.152:0/1691798200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab6c103740 msgr2=0x7fab6c19ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab6affd640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab6c103740 0x7fab6c19ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab6affd640 1 -- 172.21.15.152:0/1691798200 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c19e740 con 0x7fab6c102d90 2024-09-11T22:09:36.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab6a7fc640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab6c103740 0x7fab6c19ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:09:36.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab6affd640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab6c102d90 0x7fab6c19a7f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fab6000e9f0 tx=0x7fab6000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:36.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.619+0000 7fab53fff640 1 -- 172.21.15.152:0/1691798200 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6000cd80 con 0x7fab6c102d90 2024-09-11T22:09:36.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.620+0000 7fab53fff640 1 -- 172.21.15.152:0/1691798200 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab60010910 con 0x7fab6c102d90 2024-09-11T22:09:36.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.620+0000 7fab53fff640 1 -- 172.21.15.152:0/1691798200 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab60018990 con 0x7fab6c102d90 2024-09-11T22:09:36.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.620+0000 7fab713a9640 1 -- 172.21.15.152:0/1691798200 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6c19ea30 con 0x7fab6c102d90 2024-09-11T22:09:36.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.620+0000 7fab713a9640 1 -- 172.21.15.152:0/1691798200 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6c1a73a0 con 0x7fab6c102d90 2024-09-11T22:09:36.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.622+0000 7fab53fff640 1 -- 172.21.15.152:0/1691798200 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fab60018b30 con 0x7fab6c102d90 2024-09-11T22:09:36.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.625+0000 7fab73782740 1 Processor -- start 2024-09-11T22:09:36.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.625+0000 7fab73782740 1 -- start start 2024-09-11T22:09:36.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.625+0000 7fab73782740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 0x56274e683090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.625+0000 7fab73782740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e6835d0 0x56274e683a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.625+0000 7fab73782740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e696b80 0x56274e698f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.625+0000 7fab73782740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56274e5e92f0 con 0x56274e696b80 2024-09-11T22:09:36.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.625+0000 7fab73782740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56274e590cf0 con 0x56274e684b40 2024-09-11T22:09:36.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.625+0000 7fab73782740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56274e5e52b0 con 0x56274e6835d0 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.626+0000 7fab6b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 0x56274e683090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.626+0000 7fab6b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 0x56274e683090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33794/0 (socket says 172.21.15.152:33794) 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.626+0000 7fab6b7fe640 1 -- 172.21.15.152:0/1876520309 learned_addr learned my addr 172.21.15.152:0/1876520309 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.626+0000 7fab6affd640 1 --2- 172.21.15.152:0/1876520309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e6835d0 0x56274e683a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.626+0000 7fab6a7fc640 1 --2- 172.21.15.152:0/1876520309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e696b80 0x56274e698f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.626+0000 7fab6affd640 1 -- 172.21.15.152:0/1876520309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 msgr2=0x56274e683090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.626+0000 7fab6affd640 1 --2- 172.21.15.152:0/1876520309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 0x56274e683090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.626+0000 7fab6affd640 1 -- 172.21.15.152:0/1876520309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e696b80 msgr2=0x56274e698f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.626+0000 7fab6affd640 1 --2- 172.21.15.152:0/1876520309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e696b80 0x56274e698f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.626+0000 7fab6affd640 1 -- 172.21.15.152:0/1876520309 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56274e5753a0 con 0x56274e6835d0 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.626+0000 7fab6affd640 1 --2- 172.21.15.152:0/1876520309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e6835d0 0x56274e683a10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fab600ccfd0 tx=0x7fab600d7690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4e7c1d023306af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.627+0000 7fab517fa640 1 -- 172.21.15.152:0/1876520309 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab600de070 con 0x56274e6835d0 2024-09-11T22:09:36.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.627+0000 7fab517fa640 1 -- 172.21.15.152:0/1876520309 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab600dab20 con 0x56274e6835d0 2024-09-11T22:09:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.627+0000 7fab53fff640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab540a2d70 0x7fab540a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.628+0000 7fab53fff640 1 -- 172.21.15.152:0/1691798200 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fab600cf8b0 con 0x7fab6c102d90 2024-09-11T22:09:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.627+0000 7fab517fa640 1 -- 172.21.15.152:0/1876520309 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab600d9ab0 con 0x56274e6835d0 2024-09-11T22:09:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.628+0000 7fab73782740 1 -- 172.21.15.152:0/1876520309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e6835d0 msgr2=0x56274e683a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.628+0000 7fab73782740 1 --2- 172.21.15.152:0/1876520309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e6835d0 0x56274e683a10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fab600ccfd0 tx=0x7fab600d7690 comp rx=0 tx=0).stop 2024-09-11T22:09:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.628+0000 7fab73782740 1 -- 172.21.15.152:0/1876520309 shutdown_connections 2024-09-11T22:09:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.628+0000 7fab73782740 1 --2- 172.21.15.152:0/1876520309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e696b80 0x56274e698f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.628+0000 7fab73782740 1 --2- 172.21.15.152:0/1876520309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e6835d0 0x56274e683a10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.628+0000 7fab73782740 1 --2- 172.21.15.152:0/1876520309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 0x56274e683090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.629+0000 7fab73782740 1 -- 172.21.15.152:0/1876520309 >> 172.21.15.152:0/1876520309 conn(0x56274e64c310 msgr2=0x56274e67fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.629+0000 7fab6b7fe640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab540a2d70 0x7fab540a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.629+0000 7fab73782740 1 -- 172.21.15.152:0/1876520309 shutdown_connections 2024-09-11T22:09:36.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.630+0000 7fab73782740 1 -- 172.21.15.152:0/1876520309 wait complete. 2024-09-11T22:09:36.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.630+0000 7fab73782740 1 -- start start 2024-09-11T22:09:36.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.630+0000 7fab73782740 1 Processor -- start 2024-09-11T22:09:36.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab6b7fe640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab540a2d70 0x7fab540a5230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab64004af0 tx=0x7fab64004a40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab73782740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 0x56274e6905a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab73782740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e684b40 0x56274e690ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab73782740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e696b80 0x56274e6962b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab73782740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56274e686730 con 0x56274e684b40 2024-09-11T22:09:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab73782740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56274e5a4060 con 0x56274e6835d0 2024-09-11T22:09:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab73782740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56274e6868b0 con 0x56274e696b80 2024-09-11T22:09:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab73782740 10 client.0 _ll_register_callbacks cb 0x56274e2f78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab6b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e696b80 0x56274e6962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab6b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e696b80 0x56274e6962b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:49874/0 (socket says 172.21.15.152:49874) 2024-09-11T22:09:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab6affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 0x56274e6905a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab6b7fe640 1 -- 172.21.15.152:0/2254696078 learned_addr learned my addr 172.21.15.152:0/2254696078 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.632+0000 7fab6a7fc640 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e684b40 0x56274e690ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.633+0000 7fab6affd640 1 -- 172.21.15.152:0/2254696078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e696b80 msgr2=0x56274e6962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.633+0000 7fab6affd640 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e696b80 0x56274e6962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.633+0000 7fab6affd640 1 -- 172.21.15.152:0/2254696078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e684b40 msgr2=0x56274e690ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.633+0000 7fab6affd640 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e684b40 0x56274e690ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.633+0000 7fab6affd640 1 -- 172.21.15.152:0/2254696078 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56274e35a3c0 con 0x56274e6835d0 2024-09-11T22:09:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.633+0000 7fab6a7fc640 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e684b40 0x56274e690ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:09:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.633+0000 7fab6affd640 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 0x56274e6905a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fab600cd030 tx=0x7fab600d9590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aea83997921beca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.633+0000 7fab4eff5640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:09:36.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.633+0000 7fab4eff5640 1 -- 172.21.15.152:0/2254696078 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab600de070 con 0x56274e6835d0 2024-09-11T22:09:36.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.633+0000 7fab73782740 1 -- 172.21.15.152:0/2254696078 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab600dab20 con 0x56274e6835d0 2024-09-11T22:09:36.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.633+0000 7fab4eff5640 1 -- 172.21.15.152:0/2254696078 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fab60010430 con 0x56274e6835d0 2024-09-11T22:09:36.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.634+0000 7fab4eff5640 1 -- 172.21.15.152:0/2254696078 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fab6009f020 con 0x56274e6835d0 2024-09-11T22:09:36.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.634+0000 7fab73782740 10 client.26144 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:36.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.634+0000 7fab73782740 1 -- 172.21.15.152:0/2254696078 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56274e6adbe0 con 0x56274e6835d0 2024-09-11T22:09:36.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.634+0000 7fab4eff5640 1 -- 172.21.15.152:0/2254696078 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab600dab20 con 0x56274e6835d0 2024-09-11T22:09:36.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.634+0000 7fab4eff5640 1 -- 172.21.15.152:0/2254696078 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fab60098410 con 0x56274e6835d0 2024-09-11T22:09:36.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.634+0000 7fab73782740 10 client.26144 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:36.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.634+0000 7fab73782740 10 client.26144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:36.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.634+0000 7fab73782740 20 client.26144 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:36.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.635+0000 7fab73782740 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56274e6af1d0 0x56274e6b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.635+0000 7fab73782740 4 client.26144 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:09:36.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.635+0000 7fab73782740 1 -- 172.21.15.152:0/2254696078 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56274e5f6860 con 0x56274e6af1d0 2024-09-11T22:09:36.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.635+0000 7fab6a7fc640 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56274e6af1d0 0x56274e6b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.637+0000 7fab4eff5640 10 client.26144 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:36.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.637+0000 7fab6a7fc640 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56274e6af1d0 0x56274e6b1610 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9e086ccffe499b3 server_cookie=f31899735ba64161 in_seq=0 out_seq=0 2024-09-11T22:09:36.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab4eff5640 1 -- 172.21.15.152:0/2254696078 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56274e5f6860 con 0x56274e6af1d0 2024-09-11T22:09:36.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab4eff5640 10 client.26144 handle_command_reply: tid=0 2024-09-11T22:09:36.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 1 client.26144 shutdown 2024-09-11T22:09:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 1 -- 172.21.15.152:0/2254696078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 msgr2=0x56274e6905a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 0x56274e6905a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fab600cd030 tx=0x7fab600d9590 comp rx=0 tx=0).stop 2024-09-11T22:09:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 1 -- 172.21.15.152:0/2254696078 shutdown_connections 2024-09-11T22:09:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56274e6af1d0 0x56274e6b1610 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e696b80 0x56274e6962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e684b40 0x56274e690ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 1 --2- 172.21.15.152:0/2254696078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 0x56274e6905a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab4eff5640 0 client.26144 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 1 -- 172.21.15.152:0/2254696078 >> 172.21.15.152:0/2254696078 conn(0x56274e64c310 msgr2=0x56274e685960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 1 -- 172.21.15.152:0/2254696078 shutdown_connections 2024-09-11T22:09:36.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 1 -- 172.21.15.152:0/2254696078 wait complete. 2024-09-11T22:09:36.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.638+0000 7fab73782740 20 client.26144 trim_cache size 0 max 16384 2024-09-11T22:09:36.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.664+0000 7fab73782740 1 Processor -- start 2024-09-11T22:09:36.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.664+0000 7fab73782740 1 -- start start 2024-09-11T22:09:36.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.664+0000 7fab73782740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 0x56274e696220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.665+0000 7fab73782740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e684b40 0x56274e6b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.665+0000 7fab73782740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e696b80 0x56274e6b7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.665+0000 7fab73782740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c1ae260 con 0x56274e696b80 2024-09-11T22:09:36.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.665+0000 7fab73782740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c1abb30 con 0x56274e6835d0 2024-09-11T22:09:36.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.665+0000 7fab73782740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c1a99a0 con 0x56274e684b40 2024-09-11T22:09:36.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.665+0000 7fab6affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 0x56274e696220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.666+0000 7fab6affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 0x56274e696220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33820/0 (socket says 172.21.15.152:33820) 2024-09-11T22:09:36.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.666+0000 7fab6affd640 1 -- 172.21.15.152:0/475391663 learned_addr learned my addr 172.21.15.152:0/475391663 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:36.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.667+0000 7fab6b7fe640 1 --2- 172.21.15.152:0/475391663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e696b80 0x56274e6b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.667+0000 7fab6affd640 1 -- 172.21.15.152:0/475391663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e684b40 msgr2=0x56274e6b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.667+0000 7fab6affd640 1 --2- 172.21.15.152:0/475391663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e684b40 0x56274e6b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.667+0000 7fab6affd640 1 -- 172.21.15.152:0/475391663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e696b80 msgr2=0x56274e6b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.667+0000 7fab6affd640 1 --2- 172.21.15.152:0/475391663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e696b80 0x56274e6b7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.667+0000 7fab6affd640 1 -- 172.21.15.152:0/475391663 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56274e6865c0 con 0x56274e6835d0 2024-09-11T22:09:36.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.669+0000 7fab6affd640 1 --2- 172.21.15.152:0/475391663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 0x56274e696220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab6000e9c0 tx=0x7fab60018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b65e937b1cd15acf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:36.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.669+0000 7fab50ff9640 1 -- 172.21.15.152:0/475391663 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab600de050 con 0x56274e6835d0 2024-09-11T22:09:36.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.670+0000 7fab50ff9640 1 -- 172.21.15.152:0/475391663 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab600a0150 con 0x56274e6835d0 2024-09-11T22:09:36.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.670+0000 7fab50ff9640 1 -- 172.21.15.152:0/475391663 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6009bb70 con 0x56274e6835d0 2024-09-11T22:09:36.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.671+0000 7fab73782740 1 -- 172.21.15.152:0/475391663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 msgr2=0x56274e696220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.671+0000 7fab73782740 1 --2- 172.21.15.152:0/475391663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 0x56274e696220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab6000e9c0 tx=0x7fab60018420 comp rx=0 tx=0).stop 2024-09-11T22:09:36.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.671+0000 7fab73782740 1 -- 172.21.15.152:0/475391663 shutdown_connections 2024-09-11T22:09:36.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.671+0000 7fab73782740 1 --2- 172.21.15.152:0/475391663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e696b80 0x56274e6b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.671+0000 7fab73782740 1 --2- 172.21.15.152:0/475391663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e684b40 0x56274e6b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.671+0000 7fab73782740 1 --2- 172.21.15.152:0/475391663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e6835d0 0x56274e696220 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.671+0000 7fab73782740 1 -- 172.21.15.152:0/475391663 >> 172.21.15.152:0/475391663 conn(0x56274e64c310 msgr2=0x56274e68a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:36.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.671+0000 7fab73782740 1 -- 172.21.15.152:0/475391663 shutdown_connections 2024-09-11T22:09:36.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.671+0000 7fab73782740 1 -- 172.21.15.152:0/475391663 wait complete. 2024-09-11T22:09:36.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.671+0000 7fab73782740 1 -- start start 2024-09-11T22:09:36.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.671+0000 7fab73782740 1 Processor -- start 2024-09-11T22:09:36.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab73782740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e6835d0 0x56274e7156b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab73782740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 0x56274e6c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab73782740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e696b80 0x56274e6c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab73782740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c1a9ff0 con 0x56274e6835d0 2024-09-11T22:09:36.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab73782740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c1ab460 con 0x56274e684b40 2024-09-11T22:09:36.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab73782740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c1aa6c0 con 0x56274e696b80 2024-09-11T22:09:36.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab73782740 10 client.0 _ll_register_callbacks cb 0x7fab600d5a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:36.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab6affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e6835d0 0x56274e7156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab6a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 0x56274e6c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab6a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 0x56274e6c2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33828/0 (socket says 172.21.15.152:33828) 2024-09-11T22:09:36.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab6affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e6835d0 0x56274e7156b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33204/0 (socket says 172.21.15.152:33204) 2024-09-11T22:09:36.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab6a7fc640 1 -- 172.21.15.152:0/239386771 learned_addr learned my addr 172.21.15.152:0/239386771 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:36.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab6b7fe640 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e696b80 0x56274e6c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab6affd640 1 -- 172.21.15.152:0/239386771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e696b80 msgr2=0x56274e6c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab6affd640 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e696b80 0x56274e6c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab6affd640 1 -- 172.21.15.152:0/239386771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 msgr2=0x56274e6c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:36.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.672+0000 7fab6affd640 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 0x56274e6c2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.673+0000 7fab6affd640 1 -- 172.21.15.152:0/239386771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56274e67f4f0 con 0x56274e6835d0 2024-09-11T22:09:36.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.673+0000 7fab6a7fc640 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 0x56274e6c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:09:36.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.673+0000 7fab6affd640 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e6835d0 0x56274e7156b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fab60098770 tx=0x7fab600d5680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4465d59ee1c12812 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:36.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.673+0000 7fab4eff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:09:36.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.674+0000 7fab4eff5640 1 -- 172.21.15.152:0/239386771 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab600de070 con 0x56274e6835d0 2024-09-11T22:09:36.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.674+0000 7fab4eff5640 1 -- 172.21.15.152:0/239386771 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fab60098410 con 0x56274e6835d0 2024-09-11T22:09:36.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.674+0000 7fab73782740 1 -- 172.21.15.152:0/239386771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab600a0150 con 0x56274e6835d0 2024-09-11T22:09:36.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.675+0000 7fab4eff5640 1 -- 172.21.15.152:0/239386771 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fab6009bb70 con 0x56274e6835d0 2024-09-11T22:09:36.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.675+0000 7fab73782740 10 client.16725 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:36.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.675+0000 7fab73782740 1 -- 172.21.15.152:0/239386771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56274e680960 con 0x56274e6835d0 2024-09-11T22:09:36.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.675+0000 7fab4eff5640 1 -- 172.21.15.152:0/239386771 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab600a0150 con 0x56274e6835d0 2024-09-11T22:09:36.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.675+0000 7fab4eff5640 1 -- 172.21.15.152:0/239386771 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fab600a4580 con 0x56274e6835d0 2024-09-11T22:09:36.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.675+0000 7fab73782740 10 client.16725 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:36.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.675+0000 7fab73782740 10 client.16725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:36.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.675+0000 7fab73782740 20 client.16725 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:36.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.675+0000 7fab73782740 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56274e72ae60 0x56274e72d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:36.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.675+0000 7fab73782740 4 client.16725 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:09:36.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.675+0000 7fab73782740 1 -- 172.21.15.152:0/239386771 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56274e5f0d70 con 0x56274e72ae60 2024-09-11T22:09:36.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.676+0000 7fab6a7fc640 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56274e72ae60 0x56274e72d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:36.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.676+0000 7fab4eff5640 10 client.16725 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:36.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab6a7fc640 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56274e72ae60 0x56274e72d250 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d44f83a18f5b1b73 server_cookie=e425ac16b9f6fe29 in_seq=0 out_seq=0 2024-09-11T22:09:36.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab4eff5640 1 -- 172.21.15.152:0/239386771 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56274e5f0d70 con 0x56274e72ae60 2024-09-11T22:09:36.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab4eff5640 10 client.16725 handle_command_reply: tid=0 2024-09-11T22:09:36.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab73782740 1 client.16725 shutdown 2024-09-11T22:09:36.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab73782740 1 -- 172.21.15.152:0/239386771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e6835d0 msgr2=0x56274e7156b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab73782740 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e6835d0 0x56274e7156b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fab60098770 tx=0x7fab600d5680 comp rx=0 tx=0).stop 2024-09-11T22:09:36.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab73782740 1 -- 172.21.15.152:0/239386771 shutdown_connections 2024-09-11T22:09:36.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab73782740 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56274e72ae60 0x56274e72d250 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab73782740 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56274e696b80 0x56274e6c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab73782740 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56274e684b40 0x56274e6c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab73782740 1 --2- 172.21.15.152:0/239386771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56274e6835d0 0x56274e7156b0 secure :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fab60098770 tx=0x7fab600d5680 comp rx=0 tx=0).stop 2024-09-11T22:09:36.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab73782740 1 -- 172.21.15.152:0/239386771 >> 172.21.15.152:0/239386771 conn(0x56274e64c310 msgr2=0x56274e67e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:36.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.677+0000 7fab4eff5640 0 client.16725 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:36.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.678+0000 7fab73782740 1 -- 172.21.15.152:0/239386771 shutdown_connections 2024-09-11T22:09:36.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.678+0000 7fab73782740 1 -- 172.21.15.152:0/239386771 wait complete. 2024-09-11T22:09:36.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.678+0000 7fab73782740 20 client.16725 trim_cache size 0 max 16384 2024-09-11T22:09:36.682 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:09:36.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.679+0000 7fab713a9640 1 -- 172.21.15.152:0/1691798200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab540a2d70 msgr2=0x7fab540a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.679+0000 7fab713a9640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab540a2d70 0x7fab540a5230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab64004af0 tx=0x7fab64004a40 comp rx=0 tx=0).stop 2024-09-11T22:09:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.679+0000 7fab713a9640 1 -- 172.21.15.152:0/1691798200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab6c102d90 msgr2=0x7fab6c19a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.679+0000 7fab713a9640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab6c102d90 0x7fab6c19a7f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fab6000e9f0 tx=0x7fab6000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.679+0000 7fab713a9640 1 -- 172.21.15.152:0/1691798200 shutdown_connections 2024-09-11T22:09:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.679+0000 7fab713a9640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fab540a2d70 0x7fab540a5230 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.680+0000 7fab713a9640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c108290 0x7fab6c19e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.680+0000 7fab713a9640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab6c103740 0x7fab6c19ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.680+0000 7fab713a9640 1 --2- 172.21.15.152:0/1691798200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab6c102d90 0x7fab6c19a7f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.680+0000 7fab713a9640 1 -- 172.21.15.152:0/1691798200 >> 172.21.15.152:0/1691798200 conn(0x7fab6c0fc7d0 msgr2=0x7fab6c105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.680+0000 7fab713a9640 1 -- 172.21.15.152:0/1691798200 shutdown_connections 2024-09-11T22:09:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:36.680+0000 7fab713a9640 1 -- 172.21.15.152:0/1691798200 wait complete. 2024-09-11T22:09:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:37 smithi179 ceph-mon[35603]: pgmap v163: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.8 MiB/s wr, 689 op/s 2024-09-11T22:09:37.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:37 smithi193 ceph-mon[35545]: pgmap v163: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.8 MiB/s wr, 689 op/s 2024-09-11T22:09:37.960 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:37 smithi152 ceph-mon[31188]: pgmap v163: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.8 MiB/s wr, 689 op/s 2024-09-11T22:09:38.560 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:09:38.560 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:09:38.967 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:09:39.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.554+0000 7fa3deb7c640 1 -- 172.21.15.152:0/2067493051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d810a560 msgr2=0x7fa3d810a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:39.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.554+0000 7fa3deb7c640 1 --2- 172.21.15.152:0/2067493051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d810a560 0x7fa3d810a940 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009900 tx=0x7fa3c802a3f0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.554+0000 7fa3deb7c640 1 -- 172.21.15.152:0/2067493051 shutdown_connections 2024-09-11T22:09:39.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.554+0000 7fa3deb7c640 1 --2- 172.21.15.152:0/2067493051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3d81139e0 0x7fa3d8115e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.554+0000 7fa3deb7c640 1 --2- 172.21.15.152:0/2067493051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3d810ae80 0x7fa3d8113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.554+0000 7fa3deb7c640 1 --2- 172.21.15.152:0/2067493051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d810a560 0x7fa3d810a940 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.554+0000 7fa3deb7c640 1 -- 172.21.15.152:0/2067493051 >> 172.21.15.152:0/2067493051 conn(0x7fa3d806e2d0 msgr2=0x7fa3d806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:39.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.554+0000 7fa3deb7c640 1 -- 172.21.15.152:0/2067493051 shutdown_connections 2024-09-11T22:09:39.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.554+0000 7fa3deb7c640 1 -- 172.21.15.152:0/2067493051 wait complete. 2024-09-11T22:09:39.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.555+0000 7fa3deb7c640 1 Processor -- start 2024-09-11T22:09:39.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3deb7c640 1 -- start start 2024-09-11T22:09:39.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3deb7c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d810a560 0x7fa3d80708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3deb7c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3d810ae80 0x7fa3d8070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3deb7c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3d81139e0 0x7fa3d8071340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3deb7c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d8119740 con 0x7fa3d810ae80 2024-09-11T22:09:39.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3deb7c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81195c0 con 0x7fa3d810a560 2024-09-11T22:09:39.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3deb7c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81198c0 con 0x7fa3d81139e0 2024-09-11T22:09:39.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3dd119640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3d81139e0 0x7fa3d8071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3dd119640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3d81139e0 0x7fa3d8071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:49912/0 (socket says 172.21.15.152:49912) 2024-09-11T22:09:39.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3dd119640 1 -- 172.21.15.152:0/3586364915 learned_addr learned my addr 172.21.15.152:0/3586364915 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:39.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3dc918640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d810a560 0x7fa3d80708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3d7fff640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3d810ae80 0x7fa3d8070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3dd119640 1 -- 172.21.15.152:0/3586364915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d810a560 msgr2=0x7fa3d80708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3dd119640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d810a560 0x7fa3d80708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3dd119640 1 -- 172.21.15.152:0/3586364915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3d810ae80 msgr2=0x7fa3d8070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.556+0000 7fa3dd119640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3d810ae80 0x7fa3d8070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.557+0000 7fa3dd119640 1 -- 172.21.15.152:0/3586364915 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d81af230 con 0x7fa3d81139e0 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.557+0000 7fa3dd119640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3d81139e0 0x7fa3d8071340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000eb10 tx=0x7fa3d000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.557+0000 7fa3d5ffb640 1 -- 172.21.15.152:0/3586364915 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0004b20 con 0x7fa3d81139e0 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.557+0000 7fa3d5ffb640 1 -- 172.21.15.152:0/3586364915 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d0004cc0 con 0x7fa3d81139e0 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.557+0000 7fa3d5ffb640 1 -- 172.21.15.152:0/3586364915 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0010760 con 0x7fa3d81139e0 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.557+0000 7fa3deb7c640 1 -- 172.21.15.152:0/3586364915 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d81af520 con 0x7fa3d81139e0 2024-09-11T22:09:39.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.557+0000 7fa3deb7c640 1 -- 172.21.15.152:0/3586364915 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d81afa10 con 0x7fa3d81139e0 2024-09-11T22:09:39.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.561+0000 7fa3e0f55740 1 Processor -- start 2024-09-11T22:09:39.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.562+0000 7fa3d5ffb640 1 -- 172.21.15.152:0/3586364915 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa3d0005020 con 0x7fa3d81139e0 2024-09-11T22:09:39.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.562+0000 7fa3e0f55740 1 -- start start 2024-09-11T22:09:39.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.562+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a74b60 0x55ef89a74f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.562+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a75480 0x55ef89a7f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 0x55ef89a82130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ef899da280 con 0x55ef89a7fd40 2024-09-11T22:09:39.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ef89981b10 con 0x55ef89a75480 2024-09-11T22:09:39.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ef899d6240 con 0x55ef89a74b60 2024-09-11T22:09:39.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3d7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a74b60 0x55ef89a74f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3d7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a74b60 0x55ef89a74f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:49914/0 (socket says 172.21.15.152:49914) 2024-09-11T22:09:39.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3d7fff640 1 -- 172.21.15.152:0/1541867531 learned_addr learned my addr 172.21.15.152:0/1541867531 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:39.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3dc918640 1 --2- 172.21.15.152:0/1541867531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a75480 0x55ef89a7f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3d7fff640 1 --2- 172.21.15.152:0/1541867531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 0x55ef89a82130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3d7fff640 1 -- 172.21.15.152:0/1541867531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a75480 msgr2=0x55ef89a7f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:39.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3d7fff640 1 --2- 172.21.15.152:0/1541867531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a75480 0x55ef89a7f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3d7fff640 1 -- 172.21.15.152:0/1541867531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 msgr2=0x55ef89a82130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:39.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3d7fff640 1 --2- 172.21.15.152:0/1541867531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 0x55ef89a82130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.563+0000 7fa3d7fff640 1 -- 172.21.15.152:0/1541867531 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef8998e1f0 con 0x55ef89a74b60 2024-09-11T22:09:39.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.564+0000 7fa3d7fff640 1 --2- 172.21.15.152:0/1541867531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a74b60 0x55ef89a74f40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc006e10 tx=0x7fa3cc00c320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d49f1fb0e34675e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:39.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.564+0000 7fa3beffd640 1 -- 172.21.15.152:0/1541867531 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00f040 con 0x55ef89a74b60 2024-09-11T22:09:39.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.564+0000 7fa3beffd640 1 -- 172.21.15.152:0/1541867531 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3cc019070 con 0x55ef89a74b60 2024-09-11T22:09:39.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.564+0000 7fa3beffd640 1 -- 172.21.15.152:0/1541867531 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0133a0 con 0x55ef89a74b60 2024-09-11T22:09:39.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.564+0000 7fa3d5ffb640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3c00a2d70 0x7fa3c00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.564+0000 7fa3dc918640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3c00a2d70 0x7fa3c00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.565+0000 7fa3d5ffb640 1 -- 172.21.15.152:0/3586364915 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa3d00cfb80 con 0x7fa3d81139e0 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.565+0000 7fa3e0f55740 1 -- 172.21.15.152:0/1541867531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a74b60 msgr2=0x55ef89a74f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.565+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/1541867531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a74b60 0x55ef89a74f40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc006e10 tx=0x7fa3cc00c320 comp rx=0 tx=0).stop 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.565+0000 7fa3e0f55740 1 -- 172.21.15.152:0/1541867531 shutdown_connections 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.565+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/1541867531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 0x55ef89a82130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.565+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/1541867531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a75480 0x55ef89a7f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.565+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/1541867531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a74b60 0x55ef89a74f40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.565+0000 7fa3e0f55740 1 -- 172.21.15.152:0/1541867531 >> 172.21.15.152:0/1541867531 conn(0x55ef89a710f0 msgr2=0x55ef89a714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.565+0000 7fa3e0f55740 1 -- 172.21.15.152:0/1541867531 shutdown_connections 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.565+0000 7fa3dc918640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3c00a2d70 0x7fa3c00a5230 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55ef89a71f50 tx=0x7fa3c80058b0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:39.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.565+0000 7fa3e0f55740 1 -- 172.21.15.152:0/1541867531 wait complete. 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.566+0000 7fa3e0f55740 1 -- start start 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.566+0000 7fa3e0f55740 1 Processor -- start 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a74b60 0x55ef89a7cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 0x55ef89a7d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a7fd40 0x55ef89a7d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ef89a8b120 con 0x55ef89a74b60 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ef89994f10 con 0x55ef89a7fd40 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ef89a8b2a0 con 0x55ef89a75480 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3e0f55740 10 client.0 _ll_register_callbacks cb 0x55ef8995da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3d7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 0x55ef89a7d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3dd119640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a7fd40 0x55ef89a7d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3d7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 0x55ef89a7d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:49916/0 (socket says 172.21.15.152:49916) 2024-09-11T22:09:39.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3d7fff640 1 -- 172.21.15.152:0/4267613003 learned_addr learned my addr 172.21.15.152:0/4267613003 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:39.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3dc918640 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a74b60 0x55ef89a7cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3dd119640 1 -- 172.21.15.152:0/4267613003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 msgr2=0x55ef89a7d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:39.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3dd119640 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 0x55ef89a7d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3dd119640 1 -- 172.21.15.152:0/4267613003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a74b60 msgr2=0x55ef89a7cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:39.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3dd119640 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a74b60 0x55ef89a7cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.567+0000 7fa3dd119640 1 -- 172.21.15.152:0/4267613003 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef8974b6a0 con 0x55ef89a7fd40 2024-09-11T22:09:39.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.568+0000 7fa3dd119640 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a7fd40 0x55ef89a7d670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00cd240 tx=0x7fa3d009ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f7589e41da277b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:39.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.568+0000 7fa3b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:09:39.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.568+0000 7fa3b7fff640 1 -- 172.21.15.152:0/4267613003 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00a03c0 con 0x55ef89a7fd40 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.568+0000 7fa3b7fff640 1 -- 172.21.15.152:0/4267613003 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa3d0098680 con 0x55ef89a7fd40 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.568+0000 7fa3e0f55740 1 -- 172.21.15.152:0/4267613003 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3cc019070 con 0x55ef89a7fd40 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.568+0000 7fa3b7fff640 1 -- 172.21.15.152:0/4267613003 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa3d00a4c80 con 0x55ef89a7fd40 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.568+0000 7fa3e0f55740 10 client.26162 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.568+0000 7fa3e0f55740 1 -- 172.21.15.152:0/4267613003 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ef89a96d20 con 0x55ef89a7fd40 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.569+0000 7fa3b7fff640 1 -- 172.21.15.152:0/4267613003 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3cc019070 con 0x55ef89a7fd40 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.569+0000 7fa3b7fff640 1 -- 172.21.15.152:0/4267613003 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa3d0005310 con 0x55ef89a7fd40 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.569+0000 7fa3e0f55740 10 client.26162 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.569+0000 7fa3e0f55740 10 client.26162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.569+0000 7fa3e0f55740 20 client.26162 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.569+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ef89a981e0 0x55ef89a9a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.569+0000 7fa3e0f55740 4 client.26162 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.569+0000 7fa3e0f55740 1 -- 172.21.15.152:0/4267613003 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef899e77f0 con 0x55ef89a981e0 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.570+0000 7fa3dc918640 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ef89a981e0 0x55ef89a9a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.570+0000 7fa3dc918640 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ef89a981e0 0x55ef89a9a640 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8363851567e08962 server_cookie=67f956c0a579480a in_seq=0 out_seq=0 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.571+0000 7fa3b7fff640 10 client.26162 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.571+0000 7fa3b7fff640 1 -- 172.21.15.152:0/4267613003 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef899e77f0 con 0x55ef89a981e0 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.571+0000 7fa3b7fff640 10 client.26162 handle_command_reply: tid=0 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.571+0000 7fa3e0f55740 1 client.26162 shutdown 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.572+0000 7fa3e0f55740 1 -- 172.21.15.152:0/4267613003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a7fd40 msgr2=0x55ef89a7d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.572+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a7fd40 0x55ef89a7d670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00cd240 tx=0x7fa3d009ba30 comp rx=0 tx=0).stop 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.572+0000 7fa3e0f55740 1 -- 172.21.15.152:0/4267613003 shutdown_connections 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.572+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ef89a981e0 0x55ef89a9a640 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.572+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a7fd40 0x55ef89a7d670 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.572+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 0x55ef89a7d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.572+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/4267613003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a74b60 0x55ef89a7cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.572+0000 7fa3e0f55740 1 -- 172.21.15.152:0/4267613003 >> 172.21.15.152:0/4267613003 conn(0x55ef89a710f0 msgr2=0x55ef89a76dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:39.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.572+0000 7fa3b7fff640 0 client.26162 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:39.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.573+0000 7fa3e0f55740 1 -- 172.21.15.152:0/4267613003 shutdown_connections 2024-09-11T22:09:39.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.573+0000 7fa3e0f55740 1 -- 172.21.15.152:0/4267613003 wait complete. 2024-09-11T22:09:39.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.574+0000 7fa3e0f55740 20 client.26162 trim_cache size 0 max 16384 2024-09-11T22:09:39.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.605+0000 7fa3e0f55740 1 Processor -- start 2024-09-11T22:09:39.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.605+0000 7fa3e0f55740 1 -- start start 2024-09-11T22:09:39.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.605+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a74b60 0x55ef89a775c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.605+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 0x55ef89a7ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.605+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 0x55ef89a9ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.605+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81b67a0 con 0x55ef89a7fd40 2024-09-11T22:09:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.605+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81b4070 con 0x55ef89a74b60 2024-09-11T22:09:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.605+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81b1ee0 con 0x55ef89a75480 2024-09-11T22:09:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3dd119640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 0x55ef89a9ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3dd119640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 0x55ef89a9ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33242/0 (socket says 172.21.15.152:33242) 2024-09-11T22:09:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3dd119640 1 -- 172.21.15.152:0/1769246839 learned_addr learned my addr 172.21.15.152:0/1769246839 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:39.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3dc918640 1 --2- 172.21.15.152:0/1769246839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a74b60 0x55ef89a775c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3d7fff640 1 --2- 172.21.15.152:0/1769246839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 0x55ef89a7ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3dd119640 1 -- 172.21.15.152:0/1769246839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 msgr2=0x55ef89a7ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:39.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3dd119640 1 --2- 172.21.15.152:0/1769246839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 0x55ef89a7ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3dd119640 1 -- 172.21.15.152:0/1769246839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a74b60 msgr2=0x55ef89a775c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:39.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3dd119640 1 --2- 172.21.15.152:0/1769246839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a74b60 0x55ef89a775c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3dd119640 1 -- 172.21.15.152:0/1769246839 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef89a752b0 con 0x55ef89a7fd40 2024-09-11T22:09:39.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3d7fff640 1 --2- 172.21.15.152:0/1769246839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 0x55ef89a7ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:09:39.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.606+0000 7fa3dc918640 1 --2- 172.21.15.152:0/1769246839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a74b60 0x55ef89a775c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:09:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.607+0000 7fa3dd119640 1 --2- 172.21.15.152:0/1769246839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 0x55ef89a9ff60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0004af0 tx=0x7fa3d009c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba946dece32ada15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.608+0000 7fa3be7fc640 1 -- 172.21.15.152:0/1769246839 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d007e070 con 0x55ef89a7fd40 2024-09-11T22:09:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.608+0000 7fa3be7fc640 1 -- 172.21.15.152:0/1769246839 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d00a03c0 con 0x55ef89a7fd40 2024-09-11T22:09:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.608+0000 7fa3be7fc640 1 -- 172.21.15.152:0/1769246839 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0098680 con 0x55ef89a7fd40 2024-09-11T22:09:39.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.609+0000 7fa3e0f55740 1 -- 172.21.15.152:0/1769246839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 msgr2=0x55ef89a9ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:39.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.609+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/1769246839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 0x55ef89a9ff60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0004af0 tx=0x7fa3d009c190 comp rx=0 tx=0).stop 2024-09-11T22:09:39.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.609+0000 7fa3e0f55740 1 -- 172.21.15.152:0/1769246839 shutdown_connections 2024-09-11T22:09:39.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.609+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/1769246839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a7fd40 0x55ef89a9ff60 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.609+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/1769246839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a75480 0x55ef89a7ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.609+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/1769246839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a74b60 0x55ef89a775c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.609+0000 7fa3e0f55740 1 -- 172.21.15.152:0/1769246839 >> 172.21.15.152:0/1769246839 conn(0x55ef89a710f0 msgr2=0x55ef89a7e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:39.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.610+0000 7fa3e0f55740 1 -- 172.21.15.152:0/1769246839 shutdown_connections 2024-09-11T22:09:39.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.610+0000 7fa3e0f55740 1 -- 172.21.15.152:0/1769246839 wait complete. 2024-09-11T22:09:39.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.611+0000 7fa3e0f55740 1 -- start start 2024-09-11T22:09:39.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.611+0000 7fa3e0f55740 1 Processor -- start 2024-09-11T22:09:39.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.611+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a74b60 0x55ef89a90520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.611+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a75480 0x55ef89a90a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.611+0000 7fa3e0f55740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a7fd40 0x55ef89a8d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.611+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81b2530 con 0x55ef89a74b60 2024-09-11T22:09:39.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.611+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81b39a0 con 0x55ef89a75480 2024-09-11T22:09:39.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.611+0000 7fa3e0f55740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81b2c00 con 0x55ef89a7fd40 2024-09-11T22:09:39.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.612+0000 7fa3e0f55740 10 client.0 _ll_register_callbacks cb 0x7fa3d0004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:39.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.612+0000 7fa3dd119640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a7fd40 0x55ef89a8d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.612+0000 7fa3dd119640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a7fd40 0x55ef89a8d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:49938/0 (socket says 172.21.15.152:49938) 2024-09-11T22:09:39.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.612+0000 7fa3dd119640 1 -- 172.21.15.152:0/2773490490 learned_addr learned my addr 172.21.15.152:0/2773490490 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:39.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.612+0000 7fa3dc918640 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a74b60 0x55ef89a90520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.612+0000 7fa3dd119640 1 -- 172.21.15.152:0/2773490490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a75480 msgr2=0x55ef89a90a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:09:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.612+0000 7fa3dd119640 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a75480 0x55ef89a90a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.612+0000 7fa3dd119640 1 -- 172.21.15.152:0/2773490490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a74b60 msgr2=0x55ef89a90520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:39.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.612+0000 7fa3dd119640 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a74b60 0x55ef89a90520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.612+0000 7fa3dd119640 1 -- 172.21.15.152:0/2773490490 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef89a8da60 con 0x55ef89a7fd40 2024-09-11T22:09:39.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.612+0000 7fa3dd119640 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a7fd40 0x55ef89a8d4f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0005770 tx=0x7fa3d00988b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21594322512b03e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:39.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.613+0000 7fa3b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:09:39.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.613+0000 7fa3b7fff640 1 -- 172.21.15.152:0/2773490490 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d007e040 con 0x55ef89a7fd40 2024-09-11T22:09:39.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.613+0000 7fa3b7fff640 1 -- 172.21.15.152:0/2773490490 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa3d00a47f0 con 0x55ef89a7fd40 2024-09-11T22:09:39.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.613+0000 7fa3e0f55740 1 -- 172.21.15.152:0/2773490490 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3d00a03c0 con 0x55ef89a7fd40 2024-09-11T22:09:39.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.613+0000 7fa3b7fff640 1 -- 172.21.15.152:0/2773490490 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa3d009bb50 con 0x55ef89a7fd40 2024-09-11T22:09:39.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.613+0000 7fa3e0f55740 10 client.26317 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:39.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.613+0000 7fa3e0f55740 1 -- 172.21.15.152:0/2773490490 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ef89a8da60 con 0x55ef89a7fd40 2024-09-11T22:09:39.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.613+0000 7fa3b7fff640 1 -- 172.21.15.152:0/2773490490 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d00a49f0 con 0x55ef89a7fd40 2024-09-11T22:09:39.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.614+0000 7fa3b7fff640 1 -- 172.21.15.152:0/2773490490 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa3d009aff0 con 0x55ef89a7fd40 2024-09-11T22:09:39.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.614+0000 7fa3e0f55740 10 client.26317 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:39.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.614+0000 7fa3e0f55740 10 client.26317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:39.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.614+0000 7fa3e0f55740 20 client.26317 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:39.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.614+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ef89b03a30 0x55ef89b05e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:39.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.614+0000 7fa3e0f55740 4 client.26317 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:09:39.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.614+0000 7fa3e0f55740 1 -- 172.21.15.152:0/2773490490 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fa3d00a03c0 con 0x55ef89b03a30 2024-09-11T22:09:39.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.614+0000 7fa3dc918640 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ef89b03a30 0x55ef89b05e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:39.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.615+0000 7fa3dc918640 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ef89b03a30 0x55ef89b05e20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e6ea679cb2eeae9 server_cookie=9c9ac33a76a5ca97 in_seq=0 out_seq=0 2024-09-11T22:09:39.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.615+0000 7fa3b7fff640 10 client.26317 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:39.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.616+0000 7fa3b7fff640 1 -- 172.21.15.152:0/2773490490 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fa3d00a03c0 con 0x55ef89b03a30 2024-09-11T22:09:39.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.616+0000 7fa3b7fff640 10 client.26317 handle_command_reply: tid=0 2024-09-11T22:09:39.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.616+0000 7fa3e0f55740 1 client.26317 shutdown 2024-09-11T22:09:39.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.617+0000 7fa3e0f55740 1 -- 172.21.15.152:0/2773490490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a7fd40 msgr2=0x55ef89a8d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:39.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.617+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a7fd40 0x55ef89a8d4f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0005770 tx=0x7fa3d00988b0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.617+0000 7fa3e0f55740 1 -- 172.21.15.152:0/2773490490 shutdown_connections 2024-09-11T22:09:39.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.617+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ef89b03a30 0x55ef89b05e20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.617+0000 7fa3b7fff640 0 client.26317 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:39.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.617+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef89a7fd40 0x55ef89a8d4f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.617+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ef89a75480 0x55ef89a90a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.617+0000 7fa3e0f55740 1 --2- 172.21.15.152:0/2773490490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ef89a74b60 0x55ef89a90520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.617+0000 7fa3e0f55740 1 -- 172.21.15.152:0/2773490490 >> 172.21.15.152:0/2773490490 conn(0x55ef89a710f0 msgr2=0x55ef89a7d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:39.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.618+0000 7fa3e0f55740 1 -- 172.21.15.152:0/2773490490 shutdown_connections 2024-09-11T22:09:39.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.618+0000 7fa3e0f55740 1 -- 172.21.15.152:0/2773490490 wait complete. 2024-09-11T22:09:39.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.618+0000 7fa3e0f55740 20 client.26317 trim_cache size 0 max 16384 2024-09-11T22:09:39.620 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:09:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:09:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "dac81146-1d17-4020-91fc-f5dcde0e5951", 2024-09-11T22:09:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:09:39.620 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:09:39.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 -- 172.21.15.152:0/3586364915 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3c00a2d70 msgr2=0x7fa3c00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:39.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3c00a2d70 0x7fa3c00a5230 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55ef89a71f50 tx=0x7fa3c80058b0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 -- 172.21.15.152:0/3586364915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3d81139e0 msgr2=0x7fa3d8071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:39.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3d81139e0 0x7fa3d8071340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000eb10 tx=0x7fa3d000c2d0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 -- 172.21.15.152:0/3586364915 shutdown_connections 2024-09-11T22:09:39.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3c00a2d70 0x7fa3c00a5230 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3d81139e0 0x7fa3d8071340 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3d810ae80 0x7fa3d8070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 --2- 172.21.15.152:0/3586364915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d810a560 0x7fa3d80708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:39.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 -- 172.21.15.152:0/3586364915 >> 172.21.15.152:0/3586364915 conn(0x7fa3d806e2d0 msgr2=0x7fa3d81094d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:39.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 -- 172.21.15.152:0/3586364915 shutdown_connections 2024-09-11T22:09:39.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:39.619+0000 7fa3deb7c640 1 -- 172.21.15.152:0/3586364915 wait complete. 2024-09-11T22:09:39.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:39 smithi152 ceph-mon[31188]: pgmap v164: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-09-11T22:09:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:39 smithi179 ceph-mon[35603]: pgmap v164: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-09-11T22:09:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 245.0 s, 4457.0 tps, lat 22.493 ms stddev 24.328 2024-09-11T22:09:39.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:39 smithi193 ceph-mon[35545]: pgmap v164: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-09-11T22:09:40.461 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:09:40.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:40 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:09:40.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:40 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:09:40.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:40 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:09:40.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:40 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:09:40.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:40 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:09:40.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:40 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:09:40.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:40 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:09:40.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:40 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:09:40.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:40 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:09:40.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:40 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:09:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:40 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:09:40.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:40 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:09:40.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:40 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:09:40.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:40 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:09:40.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:40 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:09:40.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:40 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:09:40.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:40 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:09:40.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:40 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:09:40.868 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:09:41.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.415+0000 7f951b6ee640 1 -- 172.21.15.152:0/748733296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95141008c0 msgr2=0x7f9514100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:41.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.415+0000 7f951b6ee640 1 --2- 172.21.15.152:0/748733296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95141008c0 0x7f9514100ca0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9510009900 tx=0x7f951002a410 comp rx=0 tx=0).stop 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.416+0000 7f951b6ee640 1 -- 172.21.15.152:0/748733296 shutdown_connections 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.416+0000 7f951b6ee640 1 --2- 172.21.15.152:0/748733296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9514105ec0 0x7f9514106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.416+0000 7f951b6ee640 1 --2- 172.21.15.152:0/748733296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95141011e0 0x7f9514105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.416+0000 7f951b6ee640 1 --2- 172.21.15.152:0/748733296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95141008c0 0x7f9514100ca0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.416+0000 7f951b6ee640 1 -- 172.21.15.152:0/748733296 >> 172.21.15.152:0/748733296 conn(0x7f95140fc7d0 msgr2=0x7f95140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.417+0000 7f951b6ee640 1 -- 172.21.15.152:0/748733296 shutdown_connections 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.417+0000 7f951b6ee640 1 -- 172.21.15.152:0/748733296 wait complete. 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f951b6ee640 1 Processor -- start 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f951b6ee640 1 -- start start 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f951b6ee640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95141008c0 0x7f951419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f951b6ee640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95141011e0 0x7f951419f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f951b6ee640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9514105ec0 0x7f95141a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f951b6ee640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9514118610 con 0x7f9514105ec0 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f951b6ee640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9514118490 con 0x7f95141008c0 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f951b6ee640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9514118790 con 0x7f95141011e0 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f9519c8b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9514105ec0 0x7f95141a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f951948a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95141008c0 0x7f951419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f9519c8b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9514105ec0 0x7f95141a33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33262/0 (socket says 172.21.15.152:33262) 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f9519c8b640 1 -- 172.21.15.152:0/1827548398 learned_addr learned my addr 172.21.15.152:0/1827548398 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.418+0000 7f9518c89640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95141011e0 0x7f951419f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.419+0000 7f9519c8b640 1 -- 172.21.15.152:0/1827548398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95141011e0 msgr2=0x7f951419f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.419+0000 7f9519c8b640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95141011e0 0x7f951419f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.419+0000 7f9519c8b640 1 -- 172.21.15.152:0/1827548398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95141008c0 msgr2=0x7f951419eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.419+0000 7f9519c8b640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95141008c0 0x7f951419eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.419+0000 7f9519c8b640 1 -- 172.21.15.152:0/1827548398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95141a3b20 con 0x7f9514105ec0 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.419+0000 7f9519c8b640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9514105ec0 0x7f95141a33f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f950c00cad0 tx=0x7f950c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.419+0000 7f950a7fc640 1 -- 172.21.15.152:0/1827548398 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c00ad60 con 0x7f9514105ec0 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.419+0000 7f950a7fc640 1 -- 172.21.15.152:0/1827548398 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f950c005020 con 0x7f9514105ec0 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.419+0000 7f950a7fc640 1 -- 172.21.15.152:0/1827548398 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c00f6b0 con 0x7f9514105ec0 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.419+0000 7f951b6ee640 1 -- 172.21.15.152:0/1827548398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95141a3e10 con 0x7f9514105ec0 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.419+0000 7f951b6ee640 1 -- 172.21.15.152:0/1827548398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95141ab6a0 con 0x7f9514105ec0 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.423+0000 7f951dac7740 1 Processor -- start 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.424+0000 7f950a7fc640 1 -- 172.21.15.152:0/1827548398 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f950c005560 con 0x7f9514105ec0 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.425+0000 7f950a7fc640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f95000a2d70 0x7f95000a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.425+0000 7f950a7fc640 1 -- 172.21.15.152:0/1827548398 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f950c0cf380 con 0x7f9514105ec0 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.425+0000 7f9518c89640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f95000a2d70 0x7f95000a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.426+0000 7f951dac7740 1 -- start start 2024-09-11T22:09:41.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.426+0000 7f951dac7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd2f24a0 0x55a6fd2f2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.426+0000 7f951dac7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2fd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.426+0000 7f951dac7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd30e690 0x55a6fd310a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.426+0000 7f951dac7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a6fd2582e0 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.426+0000 7f951dac7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a6fd1ffce0 con 0x55a6fd30e690 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.426+0000 7f951dac7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a6fd2542a0 con 0x55a6fd2f24a0 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.426+0000 7f951948a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd2f24a0 0x55a6fd2f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.426+0000 7f951948a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd2f24a0 0x55a6fd2f2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:49946/0 (socket says 172.21.15.152:49946) 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.426+0000 7f951948a640 1 -- 172.21.15.152:0/1986636162 learned_addr learned my addr 172.21.15.152:0/1986636162 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.426+0000 7f9519c8b640 1 --2- 172.21.15.152:0/1986636162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd30e690 0x55a6fd310a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.427+0000 7f9518c89640 1 --2- 172.21.15.152:0/1986636162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.427+0000 7f9518c89640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f95000a2d70 0x7f95000a5230 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f95140ffc70 tx=0x7f950400f3c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.427+0000 7f9518c89640 1 -- 172.21.15.152:0/1986636162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd2f24a0 msgr2=0x55a6fd2f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:41.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.427+0000 7f9518c89640 1 --2- 172.21.15.152:0/1986636162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd2f24a0 0x55a6fd2f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.427+0000 7f9518c89640 1 -- 172.21.15.152:0/1986636162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd30e690 msgr2=0x55a6fd310a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.427+0000 7f9518c89640 1 --2- 172.21.15.152:0/1986636162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd30e690 0x55a6fd310a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.427+0000 7f9518c89640 1 -- 172.21.15.152:0/1986636162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fd1e4440 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.427+0000 7f9518c89640 1 --2- 172.21.15.152:0/1986636162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2fd140 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f95141a00d0 tx=0x7f9504018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4554af6463ae54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.428+0000 7f94ff7fe640 1 -- 172.21.15.152:0/1986636162 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504018070 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.428+0000 7f94ff7fe640 1 -- 172.21.15.152:0/1986636162 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9504010b10 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.428+0000 7f94ff7fe640 1 -- 172.21.15.152:0/1986636162 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950401c940 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.428+0000 7f9519c8b640 1 --2- 172.21.15.152:0/1986636162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd30e690 0x55a6fd310a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.429+0000 7f951dac7740 1 -- 172.21.15.152:0/1986636162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 msgr2=0x55a6fd2fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.429+0000 7f951dac7740 1 --2- 172.21.15.152:0/1986636162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2fd140 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f95141a00d0 tx=0x7f9504018000 comp rx=0 tx=0).stop 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.429+0000 7f951dac7740 1 -- 172.21.15.152:0/1986636162 shutdown_connections 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.429+0000 7f951dac7740 1 --2- 172.21.15.152:0/1986636162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd30e690 0x55a6fd310a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.429+0000 7f951dac7740 1 --2- 172.21.15.152:0/1986636162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2fd140 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.429+0000 7f951dac7740 1 --2- 172.21.15.152:0/1986636162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd2f24a0 0x55a6fd2f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.429+0000 7f951dac7740 1 -- 172.21.15.152:0/1986636162 >> 172.21.15.152:0/1986636162 conn(0x55a6fd2eea30 msgr2=0x55a6fd2eee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.429+0000 7f951dac7740 1 -- 172.21.15.152:0/1986636162 shutdown_connections 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.429+0000 7f951dac7740 1 -- 172.21.15.152:0/1986636162 wait complete. 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.430+0000 7f951dac7740 1 -- start start 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.430+0000 7f951dac7740 1 Processor -- start 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.431+0000 7f951dac7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f24a0 0x55a6fd2fcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.431+0000 7f951dac7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2fa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.431+0000 7f951dac7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 0x55a6fd2fa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.431+0000 7f951dac7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a6fd311260 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.431+0000 7f951dac7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a6fd213050 con 0x55a6fd2f24a0 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.431+0000 7f951dac7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a6fd3113e0 con 0x55a6fd30e690 2024-09-11T22:09:41.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.431+0000 7f951dac7740 10 client.0 _ll_register_callbacks cb 0x55a6fd253160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:41.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.431+0000 7f9519c8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 0x55a6fd2fa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.431+0000 7f9519c8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 0x55a6fd2fa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:49958/0 (socket says 172.21.15.152:49958) 2024-09-11T22:09:41.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.431+0000 7f9519c8b640 1 -- 172.21.15.152:0/1235342655 learned_addr learned my addr 172.21.15.152:0/1235342655 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:41.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.432+0000 7f9519c8b640 1 -- 172.21.15.152:0/1235342655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f24a0 msgr2=0x55a6fd2fcf50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:09:41.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.432+0000 7f9519c8b640 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f24a0 0x55a6fd2fcf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.432+0000 7f9519c8b640 1 -- 172.21.15.152:0/1235342655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 msgr2=0x55a6fd2fa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:41.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.432+0000 7f9518c89640 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2fa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.432+0000 7f9519c8b640 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2fa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.432+0000 7f9519c8b640 1 -- 172.21.15.152:0/1235342655 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6fcfc93c0 con 0x55a6fd30e690 2024-09-11T22:09:41.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.432+0000 7f9518c89640 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2fa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:09:41.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.432+0000 7f9519c8b640 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 0x55a6fd2fa740 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f950c09b570 tx=0x7f950c09b4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6caa36d88370ed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.432+0000 7f94fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.433+0000 7f94fcff9640 1 -- 172.21.15.152:0/1235342655 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c01d040 con 0x55a6fd30e690 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.433+0000 7f951dac7740 1 -- 172.21.15.152:0/1235342655 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9504010b10 con 0x55a6fd30e690 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.433+0000 7f94fcff9640 1 -- 172.21.15.152:0/1235342655 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f950c097ee0 con 0x55a6fd30e690 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.433+0000 7f94fcff9640 1 -- 172.21.15.152:0/1235342655 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f950c09fc20 con 0x55a6fd30e690 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.433+0000 7f951dac7740 10 client.26326 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.433+0000 7f951dac7740 1 -- 172.21.15.152:0/1235342655 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a6fd31cc30 con 0x55a6fd30e690 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.433+0000 7f94fcff9640 1 -- 172.21.15.152:0/1235342655 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9504010b10 con 0x55a6fd30e690 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.433+0000 7f94fcff9640 1 -- 172.21.15.152:0/1235342655 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f950c09cba0 con 0x55a6fd30e690 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.434+0000 7f951dac7740 10 client.26326 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.434+0000 7f951dac7740 10 client.26326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.434+0000 7f951dac7740 20 client.26326 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:41.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.434+0000 7f951dac7740 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a6fd31e500 0x55a6fd3209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.434+0000 7f951dac7740 4 client.26326 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.434+0000 7f951dac7740 1 -- 172.21.15.152:0/1235342655 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6fd265850 con 0x55a6fd31e500 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.434+0000 7f951948a640 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a6fd31e500 0x55a6fd3209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.435+0000 7f951948a640 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a6fd31e500 0x55a6fd3209c0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eca5a6a12c41a87 server_cookie=c203f2b39a5959e3 in_seq=0 out_seq=0 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.435+0000 7f94fcff9640 10 client.26326 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.435+0000 7f94fcff9640 1 -- 172.21.15.152:0/1235342655 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a6fd265850 con 0x55a6fd31e500 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.435+0000 7f94fcff9640 10 client.26326 handle_command_reply: tid=0 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.435+0000 7f951dac7740 1 client.26326 shutdown 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f951dac7740 1 -- 172.21.15.152:0/1235342655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 msgr2=0x55a6fd2fa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f951dac7740 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 0x55a6fd2fa740 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f950c09b570 tx=0x7f950c09b4a0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f951dac7740 1 -- 172.21.15.152:0/1235342655 shutdown_connections 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f951dac7740 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a6fd31e500 0x55a6fd3209c0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f951dac7740 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 0x55a6fd2fa740 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f951dac7740 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2fa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f951dac7740 1 --2- 172.21.15.152:0/1235342655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f24a0 0x55a6fd2fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f951dac7740 1 -- 172.21.15.152:0/1235342655 >> 172.21.15.152:0/1235342655 conn(0x55a6fd2eea30 msgr2=0x55a6fd2edb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f94fcff9640 0 client.26326 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f951dac7740 1 -- 172.21.15.152:0/1235342655 shutdown_connections 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f951dac7740 1 -- 172.21.15.152:0/1235342655 wait complete. 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.436+0000 7f951dac7740 20 client.26326 trim_cache size 0 max 16384 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f951dac7740 1 Processor -- start 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f951dac7740 1 -- start start 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f951dac7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd2f24a0 0x55a6fd31a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f951dac7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2f8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f951dac7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd30e690 0x55a6fd2f9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f951dac7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f95141ae000 con 0x55a6fd30e690 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f951dac7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f95141ab8d0 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f951dac7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9514105980 con 0x55a6fd2f24a0 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f9519c8b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd30e690 0x55a6fd2f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f9519c8b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd30e690 0x55a6fd2f9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33284/0 (socket says 172.21.15.152:33284) 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f9519c8b640 1 -- 172.21.15.152:0/3357173044 learned_addr learned my addr 172.21.15.152:0/3357173044 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f9518c89640 1 --2- 172.21.15.152:0/3357173044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2f8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f951948a640 1 --2- 172.21.15.152:0/3357173044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd2f24a0 0x55a6fd31a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f9519c8b640 1 -- 172.21.15.152:0/3357173044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd2f24a0 msgr2=0x55a6fd31a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f9519c8b640 1 --2- 172.21.15.152:0/3357173044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd2f24a0 0x55a6fd31a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f9519c8b640 1 -- 172.21.15.152:0/3357173044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f2dc0 msgr2=0x55a6fd2f8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:41.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f9519c8b640 1 --2- 172.21.15.152:0/3357173044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2f8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f9519c8b640 1 -- 172.21.15.152:0/3357173044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fd2fd2c0 con 0x55a6fd30e690 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.463+0000 7f9519c8b640 1 --2- 172.21.15.152:0/3357173044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd30e690 0x55a6fd2f9010 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f950c098240 tx=0x7f950c09b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6be2bae0358b80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.464+0000 7f94feffd640 1 -- 172.21.15.152:0/3357173044 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c01d030 con 0x55a6fd30e690 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.465+0000 7f94feffd640 1 -- 172.21.15.152:0/3357173044 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f950c0a44e0 con 0x55a6fd30e690 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.465+0000 7f94feffd640 1 -- 172.21.15.152:0/3357173044 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c0ba080 con 0x55a6fd30e690 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.465+0000 7f951dac7740 1 -- 172.21.15.152:0/3357173044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd30e690 msgr2=0x55a6fd2f9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.465+0000 7f951dac7740 1 --2- 172.21.15.152:0/3357173044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd30e690 0x55a6fd2f9010 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f950c098240 tx=0x7f950c09b9f0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.466+0000 7f951dac7740 1 -- 172.21.15.152:0/3357173044 shutdown_connections 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.466+0000 7f951dac7740 1 --2- 172.21.15.152:0/3357173044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd30e690 0x55a6fd2f9010 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.466+0000 7f951dac7740 1 --2- 172.21.15.152:0/3357173044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd2f8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.466+0000 7f951dac7740 1 --2- 172.21.15.152:0/3357173044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd2f24a0 0x55a6fd31a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.466+0000 7f951dac7740 1 -- 172.21.15.152:0/3357173044 >> 172.21.15.152:0/3357173044 conn(0x55a6fd2eea30 msgr2=0x55a6fd2fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:41.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.466+0000 7f951dac7740 1 -- 172.21.15.152:0/3357173044 shutdown_connections 2024-09-11T22:09:41.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.466+0000 7f951dac7740 1 -- 172.21.15.152:0/3357173044 wait complete. 2024-09-11T22:09:41.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.466+0000 7f951dac7740 1 -- start start 2024-09-11T22:09:41.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.466+0000 7f951dac7740 1 Processor -- start 2024-09-11T22:09:41.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f951dac7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f24a0 0x55a6fd316e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f951dac7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd311620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f951dac7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 0x55a6fd311ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f951948a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f24a0 0x55a6fd316e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f951948a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f24a0 0x55a6fd316e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33950/0 (socket says 172.21.15.152:33950) 2024-09-11T22:09:41.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f951948a640 1 -- 172.21.15.152:0/2082800167 learned_addr learned my addr 172.21.15.152:0/2082800167 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f951dac7740 1 -- 172.21.15.152:0/2082800167 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f951410dbe0 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f951dac7740 1 -- 172.21.15.152:0/2082800167 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f951410f050 con 0x55a6fd2f24a0 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f9519c8b640 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 0x55a6fd311ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f951dac7740 1 -- 172.21.15.152:0/2082800167 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f951410e2b0 con 0x55a6fd30e690 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f9518c89640 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd311620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.467+0000 7f951dac7740 10 client.0 _ll_register_callbacks cb 0x7f950c09b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.468+0000 7f9518c89640 1 -- 172.21.15.152:0/2082800167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 msgr2=0x55a6fd311ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.468+0000 7f9518c89640 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 0x55a6fd311ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.468+0000 7f9518c89640 1 -- 172.21.15.152:0/2082800167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f24a0 msgr2=0x55a6fd316e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.468+0000 7f9518c89640 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f24a0 0x55a6fd316e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.468+0000 7f9518c89640 1 -- 172.21.15.152:0/2082800167 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6fd3123d0 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.468+0000 7f951948a640 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f24a0 0x55a6fd316e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:09:41.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.468+0000 7f9518c89640 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd311620 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x55a6fd2fb840 tx=0x7f9504004910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d42dcdf0c5fa76 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.469+0000 7f94fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.469+0000 7f94fcff9640 1 -- 172.21.15.152:0/2082800167 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504032020 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.469+0000 7f94fcff9640 1 -- 172.21.15.152:0/2082800167 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f9504010430 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.469+0000 7f951dac7740 1 -- 172.21.15.152:0/2082800167 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f950c0a44e0 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.469+0000 7f94fcff9640 1 -- 172.21.15.152:0/2082800167 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f950400a830 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.470+0000 7f951dac7740 10 client.16749 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.470+0000 7f951dac7740 1 -- 172.21.15.152:0/2082800167 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a6fd388340 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.470+0000 7f94fcff9640 1 -- 172.21.15.152:0/2082800167 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9504005be0 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.470+0000 7f94fcff9640 1 -- 172.21.15.152:0/2082800167 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f950402d440 con 0x55a6fd2f2dc0 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.470+0000 7f951dac7740 10 client.16749 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.470+0000 7f951dac7740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:41.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.470+0000 7f951dac7740 20 client.16749 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.470+0000 7f951dac7740 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a6fd388730 0x55a6fd38ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.470+0000 7f951dac7740 4 client.16749 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.470+0000 7f951dac7740 1 -- 172.21.15.152:0/2082800167 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f950c0a44e0 con 0x55a6fd388730 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.470+0000 7f951948a640 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a6fd388730 0x55a6fd38ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.471+0000 7f951948a640 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a6fd388730 0x55a6fd38ab20 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e43c644ae19b14 server_cookie=60e9921009441447 in_seq=0 out_seq=0 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.471+0000 7f94fcff9640 10 client.16749 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.471+0000 7f94fcff9640 1 -- 172.21.15.152:0/2082800167 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f950c0a44e0 con 0x55a6fd388730 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.471+0000 7f94fcff9640 10 client.16749 handle_command_reply: tid=0 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.471+0000 7f951dac7740 1 client.16749 shutdown 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f951dac7740 1 -- 172.21.15.152:0/2082800167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 msgr2=0x55a6fd311620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f951dac7740 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd311620 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x55a6fd2fb840 tx=0x7f9504004910 comp rx=0 tx=0).stop 2024-09-11T22:09:41.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f951dac7740 1 -- 172.21.15.152:0/2082800167 shutdown_connections 2024-09-11T22:09:41.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f951dac7740 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a6fd388730 0x55a6fd38ab20 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f951dac7740 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a6fd30e690 0x55a6fd311ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f951dac7740 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a6fd2f2dc0 0x55a6fd311620 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.502 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:09:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:09:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:09:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: "dac81146-1d17-4020-91fc-f5dcde0e5951": { 2024-09-11T22:09:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:09:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "dac81146-1d17-4020-91fc-f5dcde0e5951", 2024-09-11T22:09:41.503 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:09:41.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:09:41.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:09:41.503 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:09:41.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f951dac7740 1 --2- 172.21.15.152:0/2082800167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a6fd2f24a0 0x55a6fd316e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f951dac7740 1 -- 172.21.15.152:0/2082800167 >> 172.21.15.152:0/2082800167 conn(0x55a6fd2eea30 msgr2=0x55a6fd2fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:41.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f94fcff9640 0 client.16749 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:41.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f951dac7740 1 -- 172.21.15.152:0/2082800167 shutdown_connections 2024-09-11T22:09:41.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f951dac7740 1 -- 172.21.15.152:0/2082800167 wait complete. 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.472+0000 7f951dac7740 20 client.16749 trim_cache size 0 max 16384 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 -- 172.21.15.152:0/1827548398 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f95000a2d70 msgr2=0x7f95000a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f95000a2d70 0x7f95000a5230 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f95140ffc70 tx=0x7f950400f3c0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 -- 172.21.15.152:0/1827548398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9514105ec0 msgr2=0x7f95141a33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9514105ec0 0x7f95141a33f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f950c00cad0 tx=0x7f950c00ced0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 -- 172.21.15.152:0/1827548398 shutdown_connections 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f95000a2d70 0x7f95000a5230 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9514105ec0 0x7f95141a33f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95141011e0 0x7f951419f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 --2- 172.21.15.152:0/1827548398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95141008c0 0x7f951419eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 -- 172.21.15.152:0/1827548398 >> 172.21.15.152:0/1827548398 conn(0x7f95140fc7d0 msgr2=0x7f951410f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 -- 172.21.15.152:0/1827548398 shutdown_connections 2024-09-11T22:09:41.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:09:41.474+0000 7f951b6ee640 1 -- 172.21.15.152:0/1827548398 wait complete. 2024-09-11T22:09:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:41 smithi179 ceph-mon[35603]: pgmap v165: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 688 op/s 2024-09-11T22:09:41.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:41 smithi193 ceph-mon[35545]: pgmap v165: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 688 op/s 2024-09-11T22:09:41.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:41 smithi152 ceph-mon[31188]: pgmap v165: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 688 op/s 2024-09-11T22:09:42.313 INFO:tasks.cephfs.filesystem:scrub status for tag:dac81146-1d17-4020-91fc-f5dcde0e5951 - {'path': '/', 'tag': 'dac81146-1d17-4020-91fc-f5dcde0e5951', 'options': 'recursive,force'} 2024-09-11T22:09:43.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:43 smithi179 ceph-mon[35603]: pgmap v166: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-11T22:09:43.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:43 smithi193 ceph-mon[35545]: pgmap v166: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-11T22:09:43.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:43 smithi152 ceph-mon[31188]: pgmap v166: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-11T22:09:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 250.0 s, 4623.2 tps, lat 21.580 ms stddev 23.387 2024-09-11T22:09:45.781 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:45 smithi152 ceph-mon[31188]: pgmap v167: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.5 MiB/s wr, 755 op/s 2024-09-11T22:09:45.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:45 smithi179 ceph-mon[35603]: pgmap v167: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.5 MiB/s wr, 755 op/s 2024-09-11T22:09:45.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:45 smithi193 ceph-mon[35545]: pgmap v167: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.5 MiB/s wr, 755 op/s 2024-09-11T22:09:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:47 smithi179 ceph-mon[35603]: pgmap v168: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.5 MiB/s wr, 755 op/s 2024-09-11T22:09:47.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:47 smithi193 ceph-mon[35545]: pgmap v168: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.5 MiB/s wr, 755 op/s 2024-09-11T22:09:47.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:47 smithi152 ceph-mon[31188]: pgmap v168: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.5 MiB/s wr, 755 op/s 2024-09-11T22:09:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.205+0000 7f679e85e640 1 -- 172.21.15.152:0/3643939116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f679810d4b0 msgr2=0x7f6798115000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.205+0000 7f679e85e640 1 --2- 172.21.15.152:0/3643939116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f679810d4b0 0x7f6798115000 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6790009ca0 tx=0x7f679002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.205+0000 7f679e85e640 1 -- 172.21.15.152:0/3643939116 shutdown_connections 2024-09-11T22:09:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.205+0000 7f679e85e640 1 --2- 172.21.15.152:0/3643939116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f679810d4b0 0x7f6798115000 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.205+0000 7f679e85e640 1 --2- 172.21.15.152:0/3643939116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6798108d10 0x7f679810cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.205+0000 7f679e85e640 1 --2- 172.21.15.152:0/3643939116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6798108360 0x7f6798108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.205+0000 7f679e85e640 1 -- 172.21.15.152:0/3643939116 >> 172.21.15.152:0/3643939116 conn(0x7f6798077ad0 msgr2=0x7f6798079ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.205+0000 7f679e85e640 1 -- 172.21.15.152:0/3643939116 shutdown_connections 2024-09-11T22:09:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.205+0000 7f679e85e640 1 -- 172.21.15.152:0/3643939116 wait complete. 2024-09-11T22:09:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.206+0000 7f679e85e640 1 Processor -- start 2024-09-11T22:09:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.206+0000 7f679e85e640 1 -- start start 2024-09-11T22:09:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.206+0000 7f679e85e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6798108360 0x7f67981a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f679e85e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f679810d4b0 0x7f67981a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f679e85e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f679819e740 0x7f679819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f679e85e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f67981184e0 con 0x7f679810d4b0 2024-09-11T22:09:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f679e85e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6798118360 con 0x7f679819e740 2024-09-11T22:09:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f679e85e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6798118660 con 0x7f6798108360 2024-09-11T22:09:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f67977fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f679810d4b0 0x7f67981a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f6797fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6798108360 0x7f67981a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f6797fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6798108360 0x7f67981a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50312/0 (socket says 172.21.15.152:50312) 2024-09-11T22:09:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f6797fff640 1 -- 172.21.15.152:0/3682031231 learned_addr learned my addr 172.21.15.152:0/3682031231 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f67977fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f679810d4b0 0x7f67981a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35840/0 (socket says 172.21.15.152:35840) 2024-09-11T22:09:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f6797fff640 1 -- 172.21.15.152:0/3682031231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f679819e740 msgr2=0x7f679819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f6797fff640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f679819e740 0x7f679819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f6797fff640 1 -- 172.21.15.152:0/3682031231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f679810d4b0 msgr2=0x7f67981a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f6797fff640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f679810d4b0 0x7f67981a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.207+0000 7f6797fff640 1 -- 172.21.15.152:0/3682031231 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679819f340 con 0x7f6798108360 2024-09-11T22:09:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.208+0000 7f6797fff640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6798108360 0x7f67981a4680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f678c00e970 tx=0x7f678c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.209+0000 7f67957fa640 1 -- 172.21.15.152:0/3682031231 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c00ccc0 con 0x7f6798108360 2024-09-11T22:09:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.209+0000 7f67957fa640 1 -- 172.21.15.152:0/3682031231 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f678c010910 con 0x7f6798108360 2024-09-11T22:09:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.209+0000 7f67957fa640 1 -- 172.21.15.152:0/3682031231 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c018860 con 0x7f6798108360 2024-09-11T22:09:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.209+0000 7f679e85e640 1 -- 172.21.15.152:0/3682031231 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67981ab420 con 0x7f6798108360 2024-09-11T22:09:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.209+0000 7f679e85e640 1 -- 172.21.15.152:0/3682031231 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67981ab7d0 con 0x7f6798108360 2024-09-11T22:09:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.212+0000 7f67957fa640 1 -- 172.21.15.152:0/3682031231 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f678c010ac0 con 0x7f6798108360 2024-09-11T22:09:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.212+0000 7f67a15fd740 1 Processor -- start 2024-09-11T22:09:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.212+0000 7f67a15fd740 1 -- start start 2024-09-11T22:09:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.212+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a97bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.212+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97c410 0x55a52a986770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.212+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a986cb0 0x55a52a9890a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.212+0000 7f67a15fd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a52a8e02f0 con 0x55a52a986cb0 2024-09-11T22:09:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.212+0000 7f67a15fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a52a888270 con 0x55a52a97baf0 2024-09-11T22:09:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.212+0000 7f67a15fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a52a8dc2b0 con 0x55a52a97c410 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f6797fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97c410 0x55a52a986770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f6797fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97c410 0x55a52a986770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50328/0 (socket says 172.21.15.152:50328) 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f6797fff640 1 -- 172.21.15.152:0/1396097816 learned_addr learned my addr 172.21.15.152:0/1396097816 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f67977fe640 1 --2- 172.21.15.152:0/1396097816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a986cb0 0x55a52a9890a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f679cdfb640 1 --2- 172.21.15.152:0/1396097816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a97bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f6797fff640 1 -- 172.21.15.152:0/1396097816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 msgr2=0x55a52a97bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f6797fff640 1 --2- 172.21.15.152:0/1396097816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a97bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f6797fff640 1 -- 172.21.15.152:0/1396097816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a986cb0 msgr2=0x55a52a9890a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f6797fff640 1 --2- 172.21.15.152:0/1396097816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a986cb0 0x55a52a9890a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f6797fff640 1 -- 172.21.15.152:0/1396097816 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52a887340 con 0x55a52a97c410 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f679cdfb640 1 --2- 172.21.15.152:0/1396097816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a97bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:09:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.213+0000 7f6797fff640 1 --2- 172.21.15.152:0/1396097816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97c410 0x55a52a986770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f678c0cce60 tx=0x7f678c0d7670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df0047d79adbc1ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.214+0000 7f67827fc640 1 -- 172.21.15.152:0/1396097816 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c0de070 con 0x55a52a97c410 2024-09-11T22:09:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.214+0000 7f67827fc640 1 -- 172.21.15.152:0/1396097816 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f678c0d17b0 con 0x55a52a97c410 2024-09-11T22:09:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.214+0000 7f67827fc640 1 -- 172.21.15.152:0/1396097816 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c0dab40 con 0x55a52a97c410 2024-09-11T22:09:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.214+0000 7f67957fa640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67880a2e70 0x7f67880a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.214+0000 7f679cdfb640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67880a2e70 0x7f67880a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.214+0000 7f67957fa640 1 -- 172.21.15.152:0/3682031231 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f678c0cf860 con 0x7f6798108360 2024-09-11T22:09:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.215+0000 7f67a15fd740 1 -- 172.21.15.152:0/1396097816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97c410 msgr2=0x55a52a986770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.215+0000 7f67a15fd740 1 --2- 172.21.15.152:0/1396097816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97c410 0x55a52a986770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f678c0cce60 tx=0x7f678c0d7670 comp rx=0 tx=0).stop 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.215+0000 7f679cdfb640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67880a2e70 0x7f67880a5330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6790009bf0 tx=0x7f679002f440 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.215+0000 7f67a15fd740 1 -- 172.21.15.152:0/1396097816 shutdown_connections 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.215+0000 7f67a15fd740 1 --2- 172.21.15.152:0/1396097816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a986cb0 0x55a52a9890a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.215+0000 7f67a15fd740 1 --2- 172.21.15.152:0/1396097816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97c410 0x55a52a986770 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.215+0000 7f67a15fd740 1 --2- 172.21.15.152:0/1396097816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a97bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.215+0000 7f67a15fd740 1 -- 172.21.15.152:0/1396097816 >> 172.21.15.152:0/1396097816 conn(0x55a52a978060 msgr2=0x55a52a978440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.215+0000 7f67a15fd740 1 -- 172.21.15.152:0/1396097816 shutdown_connections 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.215+0000 7f67a15fd740 1 -- 172.21.15.152:0/1396097816 wait complete. 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.216+0000 7f67a15fd740 1 -- start start 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.216+0000 7f67a15fd740 1 Processor -- start 2024-09-11T22:09:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.216+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a983b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.216+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 0x55a52a9840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.216+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a986cb0 0x55a52a984610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.216+0000 7f67a15fd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a52a989880 con 0x55a52a97c410 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.216+0000 7f67a15fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a52a869290 con 0x55a52a97baf0 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.216+0000 7f67a15fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a52a989a00 con 0x55a52a986cb0 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.216+0000 7f67a15fd740 10 client.0 _ll_register_callbacks cb 0x55a52a89a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f6797fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a983b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f67977fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 0x55a52a9840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f6797fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a983b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:48088/0 (socket says 172.21.15.152:48088) 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f6797fff640 1 -- 172.21.15.152:0/117501092 learned_addr learned my addr 172.21.15.152:0/117501092 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f67977fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 0x55a52a9840d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35860/0 (socket says 172.21.15.152:35860) 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f679cdfb640 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a986cb0 0x55a52a984610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f6797fff640 1 -- 172.21.15.152:0/117501092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a986cb0 msgr2=0x55a52a984610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f6797fff640 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a986cb0 0x55a52a984610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f6797fff640 1 -- 172.21.15.152:0/117501092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 msgr2=0x55a52a9840d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f6797fff640 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 0x55a52a9840d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f6797fff640 1 -- 172.21.15.152:0/117501092 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a52a5f3210 con 0x55a52a97baf0 2024-09-11T22:09:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f6797fff640 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a983b90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f678c0986c0 tx=0x7f678c0da420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2e24a71e185542b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.217+0000 7f67777fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.218+0000 7f67777fe640 1 -- 172.21.15.152:0/117501092 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c0de070 con 0x55a52a97baf0 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.218+0000 7f67777fe640 1 -- 172.21.15.152:0/117501092 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f678c0d1960 con 0x55a52a97baf0 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.218+0000 7f67a15fd740 1 -- 172.21.15.152:0/117501092 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f678c0d17b0 con 0x55a52a97baf0 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.218+0000 7f67777fe640 1 -- 172.21.15.152:0/117501092 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f678c097f90 con 0x55a52a97baf0 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.218+0000 7f67a15fd740 10 client.26186 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.218+0000 7f67a15fd740 1 -- 172.21.15.152:0/117501092 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a52a6bf620 con 0x55a52a97baf0 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.218+0000 7f67777fe640 1 -- 172.21.15.152:0/117501092 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f678c0d17b0 con 0x55a52a97baf0 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.219+0000 7f67777fe640 1 -- 172.21.15.152:0/117501092 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f678c0cd1a0 con 0x55a52a97baf0 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.219+0000 7f67a15fd740 10 client.26186 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.219+0000 7f67a15fd740 10 client.26186 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.219+0000 7f67a15fd740 20 client.26186 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.219+0000 7f67a15fd740 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a52a996ab0 0x55a52a998ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.219+0000 7f67a15fd740 4 client.26186 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:09:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.219+0000 7f67a15fd740 1 -- 172.21.15.152:0/117501092 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a52a8eda20 con 0x55a52a996ab0 2024-09-11T22:09:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.220+0000 7f67977fe640 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a52a996ab0 0x55a52a998ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.220+0000 7f67777fe640 10 client.26186 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.220+0000 7f67977fe640 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a52a996ab0 0x55a52a998ea0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c21b8caf34f78f2e server_cookie=a2052ab5fa5c2dfe in_seq=0 out_seq=0 2024-09-11T22:09:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.221+0000 7f67777fe640 1 -- 172.21.15.152:0/117501092 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a52a8eda20 con 0x55a52a996ab0 2024-09-11T22:09:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.221+0000 7f67777fe640 10 client.26186 handle_command_reply: tid=0 2024-09-11T22:09:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.221+0000 7f67a15fd740 1 client.26186 shutdown 2024-09-11T22:09:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.221+0000 7f67a15fd740 1 -- 172.21.15.152:0/117501092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 msgr2=0x55a52a983b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.221+0000 7f67a15fd740 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a983b90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f678c0986c0 tx=0x7f678c0da420 comp rx=0 tx=0).stop 2024-09-11T22:09:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.222+0000 7f67a15fd740 1 -- 172.21.15.152:0/117501092 shutdown_connections 2024-09-11T22:09:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.222+0000 7f67a15fd740 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a52a996ab0 0x55a52a998ea0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.222+0000 7f67a15fd740 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a986cb0 0x55a52a984610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.222+0000 7f67a15fd740 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 0x55a52a9840d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.222+0000 7f67a15fd740 1 --2- 172.21.15.152:0/117501092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a983b90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.222+0000 7f67a15fd740 1 -- 172.21.15.152:0/117501092 >> 172.21.15.152:0/117501092 conn(0x55a52a978060 msgr2=0x55a52a97dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.222+0000 7f67777fe640 0 client.26186 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.222+0000 7f67a15fd740 1 -- 172.21.15.152:0/117501092 shutdown_connections 2024-09-11T22:09:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.222+0000 7f67a15fd740 1 -- 172.21.15.152:0/117501092 wait complete. 2024-09-11T22:09:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.222+0000 7f67a15fd740 20 client.26186 trim_cache size 0 max 16384 2024-09-11T22:09:49.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:48 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:09:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.242+0000 7f67a15fd740 1 Processor -- start 2024-09-11T22:09:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.242+0000 7f67a15fd740 1 -- start start 2024-09-11T22:09:49.243 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.242+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97baf0 0x55a52a984440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.243 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.242+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97c410 0x55a52a99bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.242+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a986cb0 0x55a52a99c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.242+0000 7f67a15fd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f67981b6890 con 0x55a52a986cb0 2024-09-11T22:09:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.242+0000 7f6797fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97baf0 0x55a52a984440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.242+0000 7f6797fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97baf0 0x55a52a984440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50356/0 (socket says 172.21.15.152:50356) 2024-09-11T22:09:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.242+0000 7f6797fff640 1 -- 172.21.15.152:0/1933709664 learned_addr learned my addr 172.21.15.152:0/1933709664 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.242+0000 7f67a15fd740 1 -- 172.21.15.152:0/1933709664 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f67981b4160 con 0x55a52a97c410 2024-09-11T22:09:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f67a15fd740 1 -- 172.21.15.152:0/1933709664 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f67981b1fb0 con 0x55a52a97baf0 2024-09-11T22:09:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f67977fe640 1 --2- 172.21.15.152:0/1933709664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97c410 0x55a52a99bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f679cdfb640 1 --2- 172.21.15.152:0/1933709664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a986cb0 0x55a52a99c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f6797fff640 1 -- 172.21.15.152:0/1933709664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97c410 msgr2=0x55a52a99bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f6797fff640 1 --2- 172.21.15.152:0/1933709664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97c410 0x55a52a99bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f6797fff640 1 -- 172.21.15.152:0/1933709664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a986cb0 msgr2=0x55a52a99c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f6797fff640 1 --2- 172.21.15.152:0/1933709664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a986cb0 0x55a52a99c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f6797fff640 1 -- 172.21.15.152:0/1933709664 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52a989940 con 0x55a52a97baf0 2024-09-11T22:09:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f6797fff640 1 --2- 172.21.15.152:0/1933709664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97baf0 0x55a52a984440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f678c098670 tx=0x7f678c09a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68ab29a6d7cbf13c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f6781ffb640 1 -- 172.21.15.152:0/1933709664 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c0de070 con 0x55a52a97baf0 2024-09-11T22:09:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f6781ffb640 1 -- 172.21.15.152:0/1933709664 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f678c09c3f0 con 0x55a52a97baf0 2024-09-11T22:09:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.243+0000 7f6781ffb640 1 -- 172.21.15.152:0/1933709664 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c09b650 con 0x55a52a97baf0 2024-09-11T22:09:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.244+0000 7f67a15fd740 1 -- 172.21.15.152:0/1933709664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97baf0 msgr2=0x55a52a984440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.244+0000 7f67a15fd740 1 --2- 172.21.15.152:0/1933709664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97baf0 0x55a52a984440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f678c098670 tx=0x7f678c09a200 comp rx=0 tx=0).stop 2024-09-11T22:09:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.244+0000 7f67a15fd740 1 -- 172.21.15.152:0/1933709664 shutdown_connections 2024-09-11T22:09:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.244+0000 7f67a15fd740 1 --2- 172.21.15.152:0/1933709664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a986cb0 0x55a52a99c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.244+0000 7f67a15fd740 1 --2- 172.21.15.152:0/1933709664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97c410 0x55a52a99bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.244+0000 7f67a15fd740 1 --2- 172.21.15.152:0/1933709664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a97baf0 0x55a52a984440 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.244+0000 7f67a15fd740 1 -- 172.21.15.152:0/1933709664 >> 172.21.15.152:0/1933709664 conn(0x55a52a978060 msgr2=0x55a52a985c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.244+0000 7f67a15fd740 1 -- 172.21.15.152:0/1933709664 shutdown_connections 2024-09-11T22:09:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.244+0000 7f67a15fd740 1 -- 172.21.15.152:0/1933709664 wait complete. 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67a15fd740 1 -- start start 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67a15fd740 1 Processor -- start 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a99c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 0x55a52a9994e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67a15fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a986cb0 0x55a52a999a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67a15fd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f67981b2620 con 0x55a52a97c410 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67a15fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f67981b3a90 con 0x55a52a97baf0 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67a15fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f67981b2cf0 con 0x55a52a986cb0 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67a15fd740 10 client.0 _ll_register_callbacks cb 0x7f6784009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67977fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 0x55a52a9994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f6797fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a99c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67977fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 0x55a52a9994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35874/0 (socket says 172.21.15.152:35874) 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f6797fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a99c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:48112/0 (socket says 172.21.15.152:48112) 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f679cdfb640 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a986cb0 0x55a52a999a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.245+0000 7f67977fe640 1 -- 172.21.15.152:0/926754051 learned_addr learned my addr 172.21.15.152:0/926754051 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f6797fff640 1 -- 172.21.15.152:0/926754051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a986cb0 msgr2=0x55a52a999a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f6797fff640 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a986cb0 0x55a52a999a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f6797fff640 1 -- 172.21.15.152:0/926754051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 msgr2=0x55a52a9994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f6797fff640 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 0x55a52a9994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f6797fff640 1 -- 172.21.15.152:0/926754051 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a52a9732d0 con 0x55a52a97baf0 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f67977fe640 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 0x55a52a9994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f679cdfb640 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a986cb0 0x55a52a999a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f6797fff640 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a99c1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f678c09bc80 tx=0x7f678c009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5413820f4932e3d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:09:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f67777fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f67777fe640 1 -- 172.21.15.152:0/926754051 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c0de070 con 0x55a52a97baf0 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f67777fe640 1 -- 172.21.15.152:0/926754051 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f678c0da420 con 0x55a52a97baf0 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f67a15fd740 1 -- 172.21.15.152:0/926754051 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f678c09c3f0 con 0x55a52a97baf0 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f67777fe640 1 -- 172.21.15.152:0/926754051 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f678c09b830 con 0x55a52a97baf0 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f67a15fd740 10 client.26192 fetch_fsmap learned FSMap version 30 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f67a15fd740 1 -- 172.21.15.152:0/926754051 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a52a9732d0 con 0x55a52a97baf0 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.246+0000 7f67777fe640 1 -- 172.21.15.152:0/926754051 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f678c09c3f0 con 0x55a52a97baf0 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.247+0000 7f67777fe640 1 -- 172.21.15.152:0/926754051 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f678c0a44d0 con 0x55a52a97baf0 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.247+0000 7f67a15fd740 10 client.26192 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.247+0000 7f67a15fd740 10 client.26192 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.247+0000 7f67a15fd740 20 client.26192 populate_metadata read hostname 'smithi152' 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.247+0000 7f67a15fd740 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a52aa01500 0x55a52aa038f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:09:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.247+0000 7f67a15fd740 4 client.26192 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:09:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.247+0000 7f67a15fd740 1 -- 172.21.15.152:0/926754051 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a52a8e7d70 con 0x55a52aa01500 2024-09-11T22:09:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.247+0000 7f67977fe640 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a52aa01500 0x55a52aa038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:09:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.248+0000 7f67977fe640 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a52aa01500 0x55a52aa038f0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6c229978f6c4b21 server_cookie=94788dde9b7441a7 in_seq=0 out_seq=0 2024-09-11T22:09:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.248+0000 7f67777fe640 10 client.26192 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.255+0000 7f67777fe640 1 -- 172.21.15.152:0/926754051 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a52a8e7d70 con 0x55a52aa01500 2024-09-11T22:09:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.255+0000 7f67777fe640 10 client.26192 handle_command_reply: tid=0 2024-09-11T22:09:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.255+0000 7f67a15fd740 1 client.26192 shutdown 2024-09-11T22:09:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.255+0000 7f67a15fd740 1 -- 172.21.15.152:0/926754051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 msgr2=0x55a52a99c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.255+0000 7f67a15fd740 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a99c1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f678c09bc80 tx=0x7f678c009700 comp rx=0 tx=0).stop 2024-09-11T22:09:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.255+0000 7f67a15fd740 1 -- 172.21.15.152:0/926754051 shutdown_connections 2024-09-11T22:09:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.255+0000 7f67a15fd740 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a52aa01500 0x55a52aa038f0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.256+0000 7f67777fe640 0 client.26192 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:09:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.256+0000 7f67a15fd740 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a52a986cb0 0x55a52a999a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.256+0000 7f67a15fd740 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a52a97c410 0x55a52a9994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.256+0000 7f67a15fd740 1 --2- 172.21.15.152:0/926754051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a52a97baf0 0x55a52a99c1a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.256+0000 7f67a15fd740 1 -- 172.21.15.152:0/926754051 >> 172.21.15.152:0/926754051 conn(0x55a52a978060 msgr2=0x55a52a97d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.256+0000 7f67a15fd740 1 -- 172.21.15.152:0/926754051 shutdown_connections 2024-09-11T22:09:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.256+0000 7f67a15fd740 1 -- 172.21.15.152:0/926754051 wait complete. 2024-09-11T22:09:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.256+0000 7f67a15fd740 20 client.26192 trim_cache size 0 max 16384 2024-09-11T22:09:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:09:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:09:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:09:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.257+0000 7f679e85e640 1 -- 172.21.15.152:0/3682031231 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67880a2e70 msgr2=0x7f67880a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.257+0000 7f679e85e640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67880a2e70 0x7f67880a5330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6790009bf0 tx=0x7f679002f440 comp rx=0 tx=0).stop 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.257+0000 7f679e85e640 1 -- 172.21.15.152:0/3682031231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6798108360 msgr2=0x7f67981a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.257+0000 7f679e85e640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6798108360 0x7f67981a4680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f678c00e970 tx=0x7f678c00ee30 comp rx=0 tx=0).stop 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.257+0000 7f679e85e640 1 -- 172.21.15.152:0/3682031231 shutdown_connections 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.257+0000 7f679e85e640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67880a2e70 0x7f67880a5330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.257+0000 7f679e85e640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f679819e740 0x7f679819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.257+0000 7f679e85e640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f679810d4b0 0x7f67981a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.257+0000 7f679e85e640 1 --2- 172.21.15.152:0/3682031231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6798108360 0x7f67981a4680 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.257+0000 7f679e85e640 1 -- 172.21.15.152:0/3682031231 >> 172.21.15.152:0/3682031231 conn(0x7f6798077ad0 msgr2=0x7f6798078600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.258+0000 7f679e85e640 1 -- 172.21.15.152:0/3682031231 shutdown_connections 2024-09-11T22:09:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:09:49.258+0000 7f679e85e640 1 -- 172.21.15.152:0/3682031231 wait complete. 2024-09-11T22:09:49.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:48 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:09:49.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:48 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:09:49.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 255.0 s, 4605.0 tps, lat 21.556 ms stddev 24.594 2024-09-11T22:09:50.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:49 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:09:50.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:49 smithi152 ceph-mon[31188]: pgmap v169: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-11T22:09:50.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:49 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:09:50.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:49 smithi179 ceph-mon[35603]: pgmap v169: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-11T22:09:50.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:49 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:09:50.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:49 smithi193 ceph-mon[35545]: pgmap v169: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-11T22:09:51.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:51 smithi179 ceph-mon[35603]: pgmap v170: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.7 MiB/s wr, 781 op/s 2024-09-11T22:09:51.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:51 smithi193 ceph-mon[35545]: pgmap v170: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.7 MiB/s wr, 781 op/s 2024-09-11T22:09:51.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:51 smithi152 ceph-mon[31188]: pgmap v170: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.7 MiB/s wr, 781 op/s 2024-09-11T22:09:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:53 smithi179 ceph-mon[35603]: pgmap v171: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2024-09-11T22:09:53.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:53 smithi193 ceph-mon[35545]: pgmap v171: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2024-09-11T22:09:53.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:53 smithi152 ceph-mon[31188]: pgmap v171: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2024-09-11T22:09:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 260.0 s, 4208.4 tps, lat 23.983 ms stddev 28.861 2024-09-11T22:09:55.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:55 smithi179 ceph-mon[35603]: pgmap v172: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.5 MiB/s wr, 693 op/s 2024-09-11T22:09:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:55 smithi193 ceph-mon[35545]: pgmap v172: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.5 MiB/s wr, 693 op/s 2024-09-11T22:09:55.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:55 smithi152 ceph-mon[31188]: pgmap v172: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.5 MiB/s wr, 693 op/s 2024-09-11T22:09:57.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:57 smithi179 ceph-mon[35603]: pgmap v173: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.5 MiB/s wr, 693 op/s 2024-09-11T22:09:57.820 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:57 smithi152 ceph-mon[31188]: pgmap v173: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.5 MiB/s wr, 693 op/s 2024-09-11T22:09:57.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:57 smithi193 ceph-mon[35545]: pgmap v173: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.5 MiB/s wr, 693 op/s 2024-09-11T22:09:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:09:59 smithi179 ceph-mon[35603]: pgmap v174: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 1.05k op/s 2024-09-11T22:09:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 265.0 s, 4120.2 tps, lat 24.195 ms stddev 27.779 2024-09-11T22:09:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:09:59 smithi193 ceph-mon[35545]: pgmap v174: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 1.05k op/s 2024-09-11T22:09:59.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:09:59 smithi152 ceph-mon[31188]: pgmap v174: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 1.05k op/s 2024-09-11T22:10:00.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:00 smithi179 ceph-mon[35603]: overall HEALTH_OK 2024-09-11T22:10:00.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:00 smithi193 ceph-mon[35545]: overall HEALTH_OK 2024-09-11T22:10:00.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:00 smithi152 ceph-mon[31188]: overall HEALTH_OK 2024-09-11T22:10:01.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:01 smithi193 ceph-mon[35545]: pgmap v175: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 MiB/s wr, 678 op/s 2024-09-11T22:10:01.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:01 smithi152 ceph-mon[31188]: pgmap v175: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 MiB/s wr, 678 op/s 2024-09-11T22:10:02.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:01 smithi179 ceph-mon[35603]: pgmap v175: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 MiB/s wr, 678 op/s 2024-09-11T22:10:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.391+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/650032371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf18102480 msgr2=0x7fcf1810e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.391+0000 7fcf1e6ac640 1 --2- 172.21.15.152:0/650032371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf18102480 0x7fcf1810e9b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009be0 tx=0x7fcf1002a6c0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.391+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/650032371 shutdown_connections 2024-09-11T22:10:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.391+0000 7fcf1e6ac640 1 --2- 172.21.15.152:0/650032371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf18102480 0x7fcf1810e9b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.391+0000 7fcf1e6ac640 1 --2- 172.21.15.152:0/650032371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf18101ae0 0x7fcf18101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.391+0000 7fcf1e6ac640 1 --2- 172.21.15.152:0/650032371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf18107b80 0x7fcf18107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.391+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/650032371 >> 172.21.15.152:0/650032371 conn(0x7fcf180fd7e0 msgr2=0x7fcf180ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.391+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/650032371 shutdown_connections 2024-09-11T22:10:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.391+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/650032371 wait complete. 2024-09-11T22:10:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.392+0000 7fcf1e6ac640 1 Processor -- start 2024-09-11T22:10:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.392+0000 7fcf1e6ac640 1 -- start start 2024-09-11T22:10:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1e6ac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf18101ae0 0x7fcf1810baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1e6ac640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf18102480 0x7fcf1810bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1e6ac640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf18107b80 0x7fcf181a3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1e6ac640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18111ea0 con 0x7fcf18101ae0 2024-09-11T22:10:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1e6ac640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18111d20 con 0x7fcf18107b80 2024-09-11T22:10:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1e6ac640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18112020 con 0x7fcf18102480 2024-09-11T22:10:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf177fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf18102480 0x7fcf1810bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf177fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf18102480 0x7fcf1810bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54412/0 (socket says 172.21.15.152:54412) 2024-09-11T22:10:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf177fe640 1 -- 172.21.15.152:0/1225360942 learned_addr learned my addr 172.21.15.152:0/1225360942 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1cc49640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf18107b80 0x7fcf181a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1cc49640 1 -- 172.21.15.152:0/1225360942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf18102480 msgr2=0x7fcf1810bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1cc49640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf18102480 0x7fcf1810bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1cc49640 1 -- 172.21.15.152:0/1225360942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf18101ae0 msgr2=0x7fcf1810baa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:10:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1cc49640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf18101ae0 0x7fcf1810baa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.393+0000 7fcf1cc49640 1 -- 172.21.15.152:0/1225360942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf181a38a0 con 0x7fcf18107b80 2024-09-11T22:10:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.394+0000 7fcf177fe640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf18102480 0x7fcf1810bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:10:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.394+0000 7fcf1cc49640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf18107b80 0x7fcf181a3170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcf10034040 tx=0x7fcf10030c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.394+0000 7fcf157fa640 1 -- 172.21.15.152:0/1225360942 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10041020 con 0x7fcf18107b80 2024-09-11T22:10:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.394+0000 7fcf157fa640 1 -- 172.21.15.152:0/1225360942 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf10037040 con 0x7fcf18107b80 2024-09-11T22:10:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.394+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/1225360942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf181a3b30 con 0x7fcf18107b80 2024-09-11T22:10:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.394+0000 7fcf157fa640 1 -- 172.21.15.152:0/1225360942 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10036070 con 0x7fcf18107b80 2024-09-11T22:10:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.395+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/1225360942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf181ab420 con 0x7fcf18107b80 2024-09-11T22:10:02.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.398+0000 7fcf2144b740 1 Processor -- start 2024-09-11T22:10:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.399+0000 7fcf157fa640 1 -- 172.21.15.152:0/1225360942 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fcf10044020 con 0x7fcf18107b80 2024-09-11T22:10:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.399+0000 7fcf2144b740 1 -- start start 2024-09-11T22:10:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.399+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e976ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.399+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 0x56445e981770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.399+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e981cb0 0x56445e9840a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.399+0000 7fcf2144b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56445e8db2f0 con 0x56445e977410 2024-09-11T22:10:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.399+0000 7fcf2144b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56445e883270 con 0x56445e981cb0 2024-09-11T22:10:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.399+0000 7fcf2144b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56445e8d72b0 con 0x56445e976af0 2024-09-11T22:10:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.400+0000 7fcf177fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e981cb0 0x56445e9840a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.400+0000 7fcf177fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e981cb0 0x56445e9840a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52804/0 (socket says 172.21.15.152:52804) 2024-09-11T22:10:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.400+0000 7fcf177fe640 1 -- 172.21.15.152:0/3365696807 learned_addr learned my addr 172.21.15.152:0/3365696807 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.400+0000 7fcf17fff640 1 --2- 172.21.15.152:0/3365696807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 0x56445e981770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.401+0000 7fcf177fe640 1 --2- 172.21.15.152:0/3365696807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e976ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.401+0000 7fcf157fa640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf000a2f00 0x7fcf000a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.401+0000 7fcf17fff640 1 -- 172.21.15.152:0/3365696807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 msgr2=0x56445e976ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.401+0000 7fcf17fff640 1 --2- 172.21.15.152:0/3365696807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e976ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.401+0000 7fcf17fff640 1 -- 172.21.15.152:0/3365696807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e981cb0 msgr2=0x56445e9840a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.401+0000 7fcf17fff640 1 --2- 172.21.15.152:0/3365696807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e981cb0 0x56445e9840a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.401+0000 7fcf17fff640 1 -- 172.21.15.152:0/3365696807 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56445e882340 con 0x56445e977410 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.401+0000 7fcf157fa640 1 -- 172.21.15.152:0/1225360942 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcf100eff70 con 0x7fcf18107b80 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.401+0000 7fcf17fff640 1 --2- 172.21.15.152:0/3365696807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 0x56445e981770 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcf08005940 tx=0x7fcf0800ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8912b1743037ffad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.402+0000 7fcefe7fc640 1 -- 172.21.15.152:0/3365696807 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800ccc0 con 0x56445e977410 2024-09-11T22:10:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.402+0000 7fcefe7fc640 1 -- 172.21.15.152:0/3365696807 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf080035f0 con 0x56445e977410 2024-09-11T22:10:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.403+0000 7fcefe7fc640 1 -- 172.21.15.152:0/3365696807 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800ce60 con 0x56445e977410 2024-09-11T22:10:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.403+0000 7fcf1cc49640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf000a2f00 0x7fcf000a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.403+0000 7fcf2144b740 1 -- 172.21.15.152:0/3365696807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 msgr2=0x56445e981770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.403+0000 7fcf2144b740 1 --2- 172.21.15.152:0/3365696807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 0x56445e981770 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcf08005940 tx=0x7fcf0800ad80 comp rx=0 tx=0).stop 2024-09-11T22:10:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.403+0000 7fcf2144b740 1 -- 172.21.15.152:0/3365696807 shutdown_connections 2024-09-11T22:10:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.403+0000 7fcf2144b740 1 --2- 172.21.15.152:0/3365696807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e981cb0 0x56445e9840a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.403+0000 7fcf2144b740 1 --2- 172.21.15.152:0/3365696807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 0x56445e981770 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.403+0000 7fcf2144b740 1 --2- 172.21.15.152:0/3365696807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e976ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.403+0000 7fcf2144b740 1 -- 172.21.15.152:0/3365696807 >> 172.21.15.152:0/3365696807 conn(0x56445e973060 msgr2=0x56445e973440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.403+0000 7fcf1cc49640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf000a2f00 0x7fcf000a53c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcf100b8e30 tx=0x7fcf1002a6c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.404+0000 7fcf2144b740 1 -- 172.21.15.152:0/3365696807 shutdown_connections 2024-09-11T22:10:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.404+0000 7fcf2144b740 1 -- 172.21.15.152:0/3365696807 wait complete. 2024-09-11T22:10:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.404+0000 7fcf2144b740 1 -- start start 2024-09-11T22:10:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.405+0000 7fcf2144b740 1 Processor -- start 2024-09-11T22:10:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.405+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e97eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.405+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 0x56445e97f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.405+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e981cb0 0x56445e97f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.405+0000 7fcf177fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e97eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf17fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 0x56445e97f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf177fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e97eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54428/0 (socket says 172.21.15.152:54428) 2024-09-11T22:10:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf177fe640 1 -- 172.21.15.152:0/2179912772 learned_addr learned my addr 172.21.15.152:0/2179912772 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf2144b740 1 -- 172.21.15.152:0/2179912772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56445e984920 con 0x56445e977410 2024-09-11T22:10:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf2144b740 1 -- 172.21.15.152:0/2179912772 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56445e864290 con 0x56445e981cb0 2024-09-11T22:10:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf2144b740 1 -- 172.21.15.152:0/2179912772 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56445e984aa0 con 0x56445e976af0 2024-09-11T22:10:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf177fe640 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e981cb0 0x56445e97f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf2144b740 10 client.0 _ll_register_callbacks cb 0x56445e895140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf17fff640 1 -- 172.21.15.152:0/2179912772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 msgr2=0x56445e97eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf17fff640 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e97eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf17fff640 1 -- 172.21.15.152:0/2179912772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e981cb0 msgr2=0x56445e97f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf17fff640 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e981cb0 0x56445e97f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf17fff640 1 -- 172.21.15.152:0/2179912772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56445e5ee210 con 0x56445e977410 2024-09-11T22:10:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf177fe640 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e97eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcf17fff640 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 0x56445e97f020 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fcf08003fd0 tx=0x7fcf0800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abc9d6f5f174676 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.406+0000 7fcef77fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.407+0000 7fcef77fe640 1 -- 172.21.15.152:0/2179912772 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800a510 con 0x56445e977410 2024-09-11T22:10:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.407+0000 7fcef77fe640 1 -- 172.21.15.152:0/2179912772 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcf080037a0 con 0x56445e977410 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.408+0000 7fcf2144b740 1 -- 172.21.15.152:0/2179912772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf080035f0 con 0x56445e977410 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.408+0000 7fcef77fe640 1 -- 172.21.15.152:0/2179912772 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcf080039a0 con 0x56445e977410 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.408+0000 7fcf2144b740 10 client.16776 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.408+0000 7fcf2144b740 1 -- 172.21.15.152:0/2179912772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56445e6ba620 con 0x56445e977410 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.409+0000 7fcef77fe640 1 -- 172.21.15.152:0/2179912772 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf08003b40 con 0x56445e977410 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.409+0000 7fcef77fe640 1 -- 172.21.15.152:0/2179912772 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fcf08004bb0 con 0x56445e977410 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.409+0000 7fcf2144b740 10 client.16776 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.409+0000 7fcf2144b740 10 client.16776 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.409+0000 7fcf2144b740 20 client.16776 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.409+0000 7fcf2144b740 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56445e991c70 0x56445e994060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.409+0000 7fcf2144b740 4 client.16776 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.409+0000 7fcf2144b740 1 -- 172.21.15.152:0/2179912772 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcf080035f0 con 0x56445e991c70 2024-09-11T22:10:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.409+0000 7fcf177fe640 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56445e991c70 0x56445e994060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.410+0000 7fcef77fe640 10 client.16776 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.410+0000 7fcf177fe640 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56445e991c70 0x56445e994060 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8090e7175025e111 server_cookie=b64193cf3d9ab09f in_seq=0 out_seq=0 2024-09-11T22:10:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.410+0000 7fcef77fe640 1 -- 172.21.15.152:0/2179912772 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fcf080035f0 con 0x56445e991c70 2024-09-11T22:10:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.410+0000 7fcef77fe640 10 client.16776 handle_command_reply: tid=0 2024-09-11T22:10:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.411+0000 7fcf2144b740 1 client.16776 shutdown 2024-09-11T22:10:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.411+0000 7fcf2144b740 1 -- 172.21.15.152:0/2179912772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 msgr2=0x56445e97f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.411+0000 7fcf2144b740 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 0x56445e97f020 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fcf08003fd0 tx=0x7fcf0800ccf0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.411+0000 7fcf2144b740 1 -- 172.21.15.152:0/2179912772 shutdown_connections 2024-09-11T22:10:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.411+0000 7fcf2144b740 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56445e991c70 0x56445e994060 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.411+0000 7fcf2144b740 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e981cb0 0x56445e97f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.411+0000 7fcf2144b740 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e977410 0x56445e97f020 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.411+0000 7fcf2144b740 1 --2- 172.21.15.152:0/2179912772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e97eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.411+0000 7fcef77fe640 0 client.16776 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.411+0000 7fcf2144b740 1 -- 172.21.15.152:0/2179912772 >> 172.21.15.152:0/2179912772 conn(0x56445e973060 msgr2=0x56445e978d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.411+0000 7fcf2144b740 1 -- 172.21.15.152:0/2179912772 shutdown_connections 2024-09-11T22:10:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.412+0000 7fcf2144b740 1 -- 172.21.15.152:0/2179912772 wait complete. 2024-09-11T22:10:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.412+0000 7fcf2144b740 20 client.16776 trim_cache size 0 max 16384 2024-09-11T22:10:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf2144b740 1 Processor -- start 2024-09-11T22:10:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf2144b740 1 -- start start 2024-09-11T22:10:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e97d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 0x56445e97f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e981cb0 0x56445e999780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf2144b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181b6730 con 0x56445e981cb0 2024-09-11T22:10:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf2144b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181b4000 con 0x56445e977410 2024-09-11T22:10:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf2144b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181b1e50 con 0x56445e976af0 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e981cb0 0x56445e999780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf17fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 0x56445e97f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf17fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 0x56445e97f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52836/0 (socket says 172.21.15.152:52836) 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e981cb0 0x56445e999780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56568/0 (socket says 172.21.15.152:56568) 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf17fff640 1 -- 172.21.15.152:0/2528258368 learned_addr learned my addr 172.21.15.152:0/2528258368 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.433+0000 7fcf177fe640 1 --2- 172.21.15.152:0/2528258368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e97d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.434+0000 7fcf17fff640 1 -- 172.21.15.152:0/2528258368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 msgr2=0x56445e97d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.434+0000 7fcf17fff640 1 --2- 172.21.15.152:0/2528258368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e97d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.434+0000 7fcf17fff640 1 -- 172.21.15.152:0/2528258368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e981cb0 msgr2=0x56445e999780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.434+0000 7fcf17fff640 1 --2- 172.21.15.152:0/2528258368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e981cb0 0x56445e999780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.434+0000 7fcf17fff640 1 -- 172.21.15.152:0/2528258368 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56445e972e90 con 0x56445e977410 2024-09-11T22:10:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.434+0000 7fcf177fe640 1 --2- 172.21.15.152:0/2528258368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e981cb0 0x56445e999780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.434+0000 7fcf17fff640 1 --2- 172.21.15.152:0/2528258368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 0x56445e97f390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800f620 tx=0x7fcf0800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1790ec25f8ee105 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.434+0000 7fcefdffb640 1 -- 172.21.15.152:0/2528258368 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08030030 con 0x56445e977410 2024-09-11T22:10:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.434+0000 7fcefdffb640 1 -- 172.21.15.152:0/2528258368 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf0801c070 con 0x56445e977410 2024-09-11T22:10:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.434+0000 7fcefdffb640 1 -- 172.21.15.152:0/2528258368 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08003b40 con 0x56445e977410 2024-09-11T22:10:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.435+0000 7fcf2144b740 1 -- 172.21.15.152:0/2528258368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 msgr2=0x56445e97f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.435+0000 7fcf2144b740 1 --2- 172.21.15.152:0/2528258368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 0x56445e97f390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800f620 tx=0x7fcf0800c6a0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.436+0000 7fcf2144b740 1 -- 172.21.15.152:0/2528258368 shutdown_connections 2024-09-11T22:10:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.436+0000 7fcf2144b740 1 --2- 172.21.15.152:0/2528258368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e981cb0 0x56445e999780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.436+0000 7fcf2144b740 1 --2- 172.21.15.152:0/2528258368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 0x56445e97f390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.436+0000 7fcf2144b740 1 --2- 172.21.15.152:0/2528258368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e976af0 0x56445e97d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.436+0000 7fcf2144b740 1 -- 172.21.15.152:0/2528258368 >> 172.21.15.152:0/2528258368 conn(0x56445e973060 msgr2=0x56445e980b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.437+0000 7fcf2144b740 1 -- 172.21.15.152:0/2528258368 shutdown_connections 2024-09-11T22:10:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.437+0000 7fcf2144b740 1 -- 172.21.15.152:0/2528258368 wait complete. 2024-09-11T22:10:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.437+0000 7fcf2144b740 1 -- start start 2024-09-11T22:10:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.437+0000 7fcf2144b740 1 Processor -- start 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e976af0 0x56445e989fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 0x56445e98a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf2144b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e981cb0 0x56445e97b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf2144b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181b24c0 con 0x56445e976af0 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf2144b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181b3930 con 0x56445e977410 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf2144b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181b2b90 con 0x56445e981cb0 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf2144b740 10 client.0 _ll_register_callbacks cb 0x7fcf0c009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e976af0 0x56445e989fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e976af0 0x56445e989fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56580/0 (socket says 172.21.15.152:56580) 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf177fe640 1 -- 172.21.15.152:0/357458056 learned_addr learned my addr 172.21.15.152:0/357458056 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf17fff640 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 0x56445e98a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf177fe640 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e981cb0 0x56445e97b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf17fff640 1 -- 172.21.15.152:0/357458056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e981cb0 msgr2=0x56445e97b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf17fff640 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e981cb0 0x56445e97b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf17fff640 1 -- 172.21.15.152:0/357458056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e976af0 msgr2=0x56445e989fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf17fff640 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e976af0 0x56445e989fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.438+0000 7fcf17fff640 1 -- 172.21.15.152:0/357458056 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56445e97ba50 con 0x56445e977410 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.439+0000 7fcf17fff640 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 0x56445e98a510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800f620 tx=0x7fcf080035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cfc300acd7de057 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.439+0000 7fcef77fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.439+0000 7fcef77fe640 1 -- 172.21.15.152:0/357458056 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0803a060 con 0x56445e977410 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.439+0000 7fcef77fe640 1 -- 172.21.15.152:0/357458056 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcf080051e0 con 0x56445e977410 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.439+0000 7fcf2144b740 1 -- 172.21.15.152:0/357458056 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf0801c070 con 0x56445e977410 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.440+0000 7fcef77fe640 1 -- 172.21.15.152:0/357458056 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcf080037d0 con 0x56445e977410 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.440+0000 7fcf2144b740 10 client.26210 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.440+0000 7fcf2144b740 1 -- 172.21.15.152:0/357458056 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56445e9fc1a0 con 0x56445e977410 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.440+0000 7fcef77fe640 1 -- 172.21.15.152:0/357458056 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf08003e50 con 0x56445e977410 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.440+0000 7fcef77fe640 1 -- 172.21.15.152:0/357458056 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fcf08004b40 con 0x56445e977410 2024-09-11T22:10:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.440+0000 7fcf2144b740 10 client.26210 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.440+0000 7fcf2144b740 10 client.26210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.440+0000 7fcf2144b740 20 client.26210 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.440+0000 7fcf2144b740 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56445e9fc800 0x56445e9fec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.440+0000 7fcf2144b740 4 client.26210 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:10:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.440+0000 7fcf2144b740 1 -- 172.21.15.152:0/357458056 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fcf0801c070 con 0x56445e9fc800 2024-09-11T22:10:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.441+0000 7fcf177fe640 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56445e9fc800 0x56445e9fec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.441+0000 7fcef77fe640 10 client.26210 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:02.441+0000 7fcf177fe640 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56445e9fc800 0x56445e9fec20 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=633f8f38b6aafde1 server_cookie=52cf9f032e63db68 in_seq=0 out_seq=0 2024-09-11T22:10:03.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:03 smithi179 ceph-mon[35603]: pgmap v176: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 MiB/s wr, 1.66k op/s 2024-09-11T22:10:03.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:03 smithi193 ceph-mon[35545]: pgmap v176: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 MiB/s wr, 1.66k op/s 2024-09-11T22:10:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.831+0000 7fcef77fe640 1 -- 172.21.15.152:0/357458056 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fcf0801c070 con 0x56445e9fc800 2024-09-11T22:10:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.831+0000 7fcef77fe640 10 client.26210 handle_command_reply: tid=0 2024-09-11T22:10:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.831+0000 7fcf2144b740 1 client.26210 shutdown 2024-09-11T22:10:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf2144b740 1 -- 172.21.15.152:0/357458056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 msgr2=0x56445e98a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf2144b740 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 0x56445e98a510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800f620 tx=0x7fcf080035f0 comp rx=0 tx=0).stop 2024-09-11T22:10:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf2144b740 1 -- 172.21.15.152:0/357458056 shutdown_connections 2024-09-11T22:10:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf2144b740 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56445e9fc800 0x56445e9fec20 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf2144b740 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56445e981cb0 0x56445e97b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcef77fe640 0 client.26210 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf2144b740 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56445e977410 0x56445e98a510 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf2144b740 1 --2- 172.21.15.152:0/357458056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56445e976af0 0x56445e989fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf2144b740 1 -- 172.21.15.152:0/357458056 >> 172.21.15.152:0/357458056 conn(0x56445e973060 msgr2=0x56445e9784c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf2144b740 1 -- 172.21.15.152:0/357458056 shutdown_connections 2024-09-11T22:10:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf2144b740 1 -- 172.21.15.152:0/357458056 wait complete. 2024-09-11T22:10:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf2144b740 20 client.26210 trim_cache size 0 max 16384 2024-09-11T22:10:03.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:10:03.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:10:03.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:10:03.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:10:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/1225360942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf000a2f00 msgr2=0x7fcf000a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf1e6ac640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf000a2f00 0x7fcf000a53c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcf100b8e30 tx=0x7fcf1002a6c0 comp rx=0 tx=0).stop 2024-09-11T22:10:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/1225360942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf18107b80 msgr2=0x7fcf181a3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.832+0000 7fcf1e6ac640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf18107b80 0x7fcf181a3170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcf10034040 tx=0x7fcf10030c50 comp rx=0 tx=0).stop 2024-09-11T22:10:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.833+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/1225360942 shutdown_connections 2024-09-11T22:10:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.833+0000 7fcf1e6ac640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf000a2f00 0x7fcf000a53c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.833+0000 7fcf1e6ac640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf18107b80 0x7fcf181a3170 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:03.837 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.833+0000 7fcf1e6ac640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf18102480 0x7fcf1810bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:03.837 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.833+0000 7fcf1e6ac640 1 --2- 172.21.15.152:0/1225360942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf18101ae0 0x7fcf1810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:03.837 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.833+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/1225360942 >> 172.21.15.152:0/1225360942 conn(0x7fcf180fd7e0 msgr2=0x7fcf1810d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:03.837 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.833+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/1225360942 shutdown_connections 2024-09-11T22:10:03.837 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:03.833+0000 7fcf1e6ac640 1 -- 172.21.15.152:0/1225360942 wait complete. 2024-09-11T22:10:03.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:03 smithi152 ceph-mon[31188]: pgmap v176: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 MiB/s wr, 1.66k op/s 2024-09-11T22:10:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 270.0 s, 2460.6 tps, lat 40.719 ms stddev 137.472 2024-09-11T22:10:05.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:05 smithi179 ceph-mon[35603]: pgmap v177: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 1.34k op/s 2024-09-11T22:10:05.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:05 smithi193 ceph-mon[35545]: pgmap v177: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 1.34k op/s 2024-09-11T22:10:05.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:05 smithi152 ceph-mon[31188]: pgmap v177: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 1.34k op/s 2024-09-11T22:10:07.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:07 smithi179 ceph-mon[35603]: pgmap v178: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 1.34k op/s 2024-09-11T22:10:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:07 smithi193 ceph-mon[35545]: pgmap v178: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 1.34k op/s 2024-09-11T22:10:07.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:07 smithi152 ceph-mon[31188]: pgmap v178: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 1.34k op/s 2024-09-11T22:10:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:09 smithi179 ceph-mon[35603]: pgmap v179: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 43 MiB/s wr, 1.69k op/s 2024-09-11T22:10:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 275.0 s, 4412.2 tps, lat 22.611 ms stddev 24.311 2024-09-11T22:10:09.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:09 smithi193 ceph-mon[35545]: pgmap v179: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 43 MiB/s wr, 1.69k op/s 2024-09-11T22:10:09.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:09 smithi152 ceph-mon[31188]: pgmap v179: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 43 MiB/s wr, 1.69k op/s 2024-09-11T22:10:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:11 smithi179 ceph-mon[35603]: pgmap v180: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 39 MiB/s wr, 1.34k op/s 2024-09-11T22:10:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:11 smithi193 ceph-mon[35545]: pgmap v180: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 39 MiB/s wr, 1.34k op/s 2024-09-11T22:10:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:11 smithi152 ceph-mon[31188]: pgmap v180: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 39 MiB/s wr, 1.34k op/s 2024-09-11T22:10:12.315 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:10:12.683 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:13.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.267+0000 7f949a0ed640 1 -- 172.21.15.152:0/2037056759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9494100b40 msgr2=0x7f9494100f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:13.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.267+0000 7f949a0ed640 1 --2- 172.21.15.152:0/2037056759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9494100b40 0x7f9494100f20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9484009ca0 tx=0x7f948402a940 comp rx=0 tx=0).stop 2024-09-11T22:10:13.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.267+0000 7f949a0ed640 1 -- 172.21.15.152:0/2037056759 shutdown_connections 2024-09-11T22:10:13.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.267+0000 7f949a0ed640 1 --2- 172.21.15.152:0/2037056759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9494105f50 0x7f94941063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.267+0000 7f949a0ed640 1 --2- 172.21.15.152:0/2037056759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9494101460 0x7f9494105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.267+0000 7f949a0ed640 1 --2- 172.21.15.152:0/2037056759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9494100b40 0x7f9494100f20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.267+0000 7f949a0ed640 1 -- 172.21.15.152:0/2037056759 >> 172.21.15.152:0/2037056759 conn(0x7f94940fc7d0 msgr2=0x7f94940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:13.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.267+0000 7f949a0ed640 1 -- 172.21.15.152:0/2037056759 shutdown_connections 2024-09-11T22:10:13.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.267+0000 7f949a0ed640 1 -- 172.21.15.152:0/2037056759 wait complete. 2024-09-11T22:10:13.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f949a0ed640 1 Processor -- start 2024-09-11T22:10:13.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f949a0ed640 1 -- start start 2024-09-11T22:10:13.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f949a0ed640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9494100b40 0x7f94941a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f949a0ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9494101460 0x7f94941a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f949a0ed640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9494105f50 0x7f949419e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f949a0ed640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f94941185d0 con 0x7f9494105f50 2024-09-11T22:10:13.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f949a0ed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9494118450 con 0x7f9494101460 2024-09-11T22:10:13.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f949a0ed640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9494118750 con 0x7f9494100b40 2024-09-11T22:10:13.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f94937fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9494100b40 0x7f94941a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f94937fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9494100b40 0x7f94941a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:44964/0 (socket says 172.21.15.152:44964) 2024-09-11T22:10:13.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f94937fe640 1 -- 172.21.15.152:0/959816072 learned_addr learned my addr 172.21.15.152:0/959816072 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:13.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f9493fff640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9494105f50 0x7f949419e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.268+0000 7f9492ffd640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9494101460 0x7f94941a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.269+0000 7f94937fe640 1 -- 172.21.15.152:0/959816072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9494101460 msgr2=0x7f94941a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.269+0000 7f94937fe640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9494101460 0x7f94941a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.269+0000 7f94937fe640 1 -- 172.21.15.152:0/959816072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9494105f50 msgr2=0x7f949419e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.269+0000 7f94937fe640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9494105f50 0x7f949419e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.269+0000 7f94937fe640 1 -- 172.21.15.152:0/959816072 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949419eff0 con 0x7f9494100b40 2024-09-11T22:10:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.270+0000 7f94937fe640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9494100b40 0x7f94941a4700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f948402aeb0 tx=0x7f948402f630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.270+0000 7f9490ff9640 1 -- 172.21.15.152:0/959816072 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484034040 con 0x7f9494100b40 2024-09-11T22:10:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.270+0000 7f9490ff9640 1 -- 172.21.15.152:0/959816072 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f948402fe10 con 0x7f9494100b40 2024-09-11T22:10:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.270+0000 7f9490ff9640 1 -- 172.21.15.152:0/959816072 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94840045b0 con 0x7f9494100b40 2024-09-11T22:10:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.271+0000 7f949a0ed640 1 -- 172.21.15.152:0/959816072 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949419f280 con 0x7f9494100b40 2024-09-11T22:10:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.271+0000 7f949a0ed640 1 -- 172.21.15.152:0/959816072 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94941ab5d0 con 0x7f9494100b40 2024-09-11T22:10:13.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.274+0000 7f9490ff9640 1 -- 172.21.15.152:0/959816072 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9484037020 con 0x7f9494100b40 2024-09-11T22:10:13.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.275+0000 7f9490ff9640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f94800a2dc0 0x7f94800a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.275+0000 7f9490ff9640 1 -- 172.21.15.152:0/959816072 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f94840f1130 con 0x7f9494100b40 2024-09-11T22:10:13.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.275+0000 7f9492ffd640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f94800a2dc0 0x7f94800a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.275+0000 7f949c4c6740 1 Processor -- start 2024-09-11T22:10:13.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.275+0000 7f949c4c6740 1 -- start start 2024-09-11T22:10:13.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f949c4c6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a8494a0 0x55c02a849880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f949c4c6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 0x55c02a854140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f949c4c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a854680 0x55c02a856a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f949c4c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c02a7af2e0 con 0x55c02a854680 2024-09-11T22:10:13.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f949c4c6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c02a756ce0 con 0x55c02a8494a0 2024-09-11T22:10:13.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f949c4c6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c02a7ab2a0 con 0x55c02a849dc0 2024-09-11T22:10:13.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f9492ffd640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f94800a2dc0 0x7f94800a5280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f947c0095f0 tx=0x7f947c005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:13.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f9492ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 0x55c02a854140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f94937fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a8494a0 0x55c02a849880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f9492ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 0x55c02a854140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:44970/0 (socket says 172.21.15.152:44970) 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f9492ffd640 1 -- 172.21.15.152:0/2170300037 learned_addr learned my addr 172.21.15.152:0/2170300037 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f9493fff640 1 --2- 172.21.15.152:0/2170300037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a854680 0x55c02a856a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f9492ffd640 1 -- 172.21.15.152:0/2170300037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a8494a0 msgr2=0x55c02a849880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f9492ffd640 1 --2- 172.21.15.152:0/2170300037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a8494a0 0x55c02a849880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f9492ffd640 1 -- 172.21.15.152:0/2170300037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a854680 msgr2=0x55c02a856a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f9492ffd640 1 --2- 172.21.15.152:0/2170300037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a854680 0x55c02a856a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f9492ffd640 1 -- 172.21.15.152:0/2170300037 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02a73b440 con 0x55c02a849dc0 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.276+0000 7f9493fff640 1 --2- 172.21.15.152:0/2170300037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a854680 0x55c02a856a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.277+0000 7f9492ffd640 1 --2- 172.21.15.152:0/2170300037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 0x55c02a854140 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f947c00e620 tx=0x7f947c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e72fc180c3d66feb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.277+0000 7f9489ffb640 1 -- 172.21.15.152:0/2170300037 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c004020 con 0x55c02a849dc0 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.277+0000 7f9489ffb640 1 -- 172.21.15.152:0/2170300037 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947c0041c0 con 0x55c02a849dc0 2024-09-11T22:10:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.277+0000 7f9489ffb640 1 -- 172.21.15.152:0/2170300037 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c01d810 con 0x55c02a849dc0 2024-09-11T22:10:13.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.278+0000 7f949c4c6740 1 -- 172.21.15.152:0/2170300037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 msgr2=0x55c02a854140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:13.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.278+0000 7f949c4c6740 1 --2- 172.21.15.152:0/2170300037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 0x55c02a854140 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f947c00e620 tx=0x7f947c014000 comp rx=0 tx=0).stop 2024-09-11T22:10:13.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.280+0000 7f949c4c6740 1 -- 172.21.15.152:0/2170300037 shutdown_connections 2024-09-11T22:10:13.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.280+0000 7f949c4c6740 1 --2- 172.21.15.152:0/2170300037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a854680 0x55c02a856a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.280+0000 7f949c4c6740 1 --2- 172.21.15.152:0/2170300037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 0x55c02a854140 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.280+0000 7f949c4c6740 1 --2- 172.21.15.152:0/2170300037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a8494a0 0x55c02a849880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.280+0000 7f949c4c6740 1 -- 172.21.15.152:0/2170300037 >> 172.21.15.152:0/2170300037 conn(0x55c02a845a30 msgr2=0x55c02a845e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:13.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.280+0000 7f949c4c6740 1 -- 172.21.15.152:0/2170300037 shutdown_connections 2024-09-11T22:10:13.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.280+0000 7f949c4c6740 1 -- 172.21.15.152:0/2170300037 wait complete. 2024-09-11T22:10:13.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.281+0000 7f949c4c6740 1 -- start start 2024-09-11T22:10:13.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.281+0000 7f949c4c6740 1 Processor -- start 2024-09-11T22:10:13.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f949c4c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a8494a0 0x55c02a853e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f949c4c6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 0x55c02a851110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f94937fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a8494a0 0x55c02a853e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f94937fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a8494a0 0x55c02a853e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44684/0 (socket says 172.21.15.152:44684) 2024-09-11T22:10:13.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f94937fe640 1 -- 172.21.15.152:0/394375940 learned_addr learned my addr 172.21.15.152:0/394375940 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f949c4c6740 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a854680 0x55c02a851650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f9492ffd640 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 0x55c02a851110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f949c4c6740 1 -- 172.21.15.152:0/394375940 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c02a857250 con 0x55c02a8494a0 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f949c4c6740 1 -- 172.21.15.152:0/394375940 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c02a76a050 con 0x55c02a854680 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f949c4c6740 1 -- 172.21.15.152:0/394375940 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c02a8573d0 con 0x55c02a849dc0 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f9493fff640 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a854680 0x55c02a851650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f9492ffd640 1 -- 172.21.15.152:0/394375940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a854680 msgr2=0x55c02a851650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f9492ffd640 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a854680 0x55c02a851650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f9492ffd640 1 -- 172.21.15.152:0/394375940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a8494a0 msgr2=0x55c02a853e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f9492ffd640 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a8494a0 0x55c02a853e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.282+0000 7f9492ffd640 1 -- 172.21.15.152:0/394375940 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02a5203c0 con 0x55c02a849dc0 2024-09-11T22:10:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.283+0000 7f949c4c6740 10 client.0 _ll_register_callbacks cb 0x55c02a7aa160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.283+0000 7f949c4c6740 1 -- 172.21.15.152:0/394375940 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f947c0041c0 con 0x55c02a849dc0 2024-09-11T22:10:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.283+0000 7f9492ffd640 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 0x55c02a851110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f947c003eb0 tx=0x7f947c003cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cff7c76fe8b2e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.283+0000 7f9472ffd640 10 client.26377 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:10:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.283+0000 7f9472ffd640 1 -- 172.21.15.152:0/394375940 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c01db10 con 0x55c02a849dc0 2024-09-11T22:10:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.283+0000 7f9472ffd640 1 -- 172.21.15.152:0/394375940 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f947c01dcb0 con 0x55c02a849dc0 2024-09-11T22:10:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.283+0000 7f9472ffd640 1 -- 172.21.15.152:0/394375940 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f947c01d510 con 0x55c02a849dc0 2024-09-11T22:10:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.283+0000 7f949c4c6740 10 client.26377 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.283+0000 7f949c4c6740 1 -- 172.21.15.152:0/394375940 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c02a8629d0 con 0x55c02a849dc0 2024-09-11T22:10:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.283+0000 7f9472ffd640 1 -- 172.21.15.152:0/394375940 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f947c02e070 con 0x55c02a849dc0 2024-09-11T22:10:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.284+0000 7f949c4c6740 10 client.26377 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.284+0000 7f949c4c6740 10 client.26377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.284+0000 7f949c4c6740 20 client.26377 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.284+0000 7f949c4c6740 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c02a863d20 0x55c02a866110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.284+0000 7f949c4c6740 4 client.26377 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.284+0000 7f949c4c6740 1 -- 172.21.15.152:0/394375940 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c02a7bc850 con 0x55c02a863d20 2024-09-11T22:10:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.284+0000 7f94937fe640 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c02a863d20 0x55c02a866110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.284+0000 7f9472ffd640 10 client.26377 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.284+0000 7f94937fe640 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c02a863d20 0x55c02a866110 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18bb2c086da36efa server_cookie=3bfab32820264408 in_seq=0 out_seq=0 2024-09-11T22:10:13.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.285+0000 7f9472ffd640 1 -- 172.21.15.152:0/394375940 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c02a7bc850 con 0x55c02a863d20 2024-09-11T22:10:13.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.285+0000 7f9472ffd640 10 client.26377 handle_command_reply: tid=0 2024-09-11T22:10:13.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.285+0000 7f949c4c6740 1 client.26377 shutdown 2024-09-11T22:10:13.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.286+0000 7f949c4c6740 1 -- 172.21.15.152:0/394375940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 msgr2=0x55c02a851110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:13.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.286+0000 7f949c4c6740 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 0x55c02a851110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f947c003eb0 tx=0x7f947c003cf0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.286+0000 7f949c4c6740 1 -- 172.21.15.152:0/394375940 shutdown_connections 2024-09-11T22:10:13.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.287+0000 7f949c4c6740 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c02a863d20 0x55c02a866110 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.287+0000 7f949c4c6740 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a854680 0x55c02a851650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.287+0000 7f9472ffd640 0 client.26377 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:13.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.287+0000 7f949c4c6740 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a849dc0 0x55c02a851110 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.287+0000 7f949c4c6740 1 --2- 172.21.15.152:0/394375940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a8494a0 0x55c02a853e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.287+0000 7f949c4c6740 1 -- 172.21.15.152:0/394375940 >> 172.21.15.152:0/394375940 conn(0x55c02a845a30 msgr2=0x55c02a84b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:13.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.287+0000 7f949c4c6740 1 -- 172.21.15.152:0/394375940 shutdown_connections 2024-09-11T22:10:13.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.287+0000 7f949c4c6740 1 -- 172.21.15.152:0/394375940 wait complete. 2024-09-11T22:10:13.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.287+0000 7f949c4c6740 20 client.26377 trim_cache size 0 max 16384 2024-09-11T22:10:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f949c4c6740 1 Processor -- start 2024-09-11T22:10:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f949c4c6740 1 -- start start 2024-09-11T22:10:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f949c4c6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a8494a0 0x55c02a84f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f949c4c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a849dc0 0x55c02a86b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f949c4c6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a854680 0x55c02a86bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f949c4c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9474011050 con 0x55c02a849dc0 2024-09-11T22:10:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f949c4c6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f947400e920 con 0x55c02a854680 2024-09-11T22:10:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f949c4c6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f947400c770 con 0x55c02a8494a0 2024-09-11T22:10:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f94937fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a8494a0 0x55c02a84f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f94937fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a8494a0 0x55c02a84f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:44988/0 (socket says 172.21.15.152:44988) 2024-09-11T22:10:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f9493fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a854680 0x55c02a86bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f94937fe640 1 -- 172.21.15.152:0/1880313625 learned_addr learned my addr 172.21.15.152:0/1880313625 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.314+0000 7f9492ffd640 1 --2- 172.21.15.152:0/1880313625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a849dc0 0x55c02a86b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.315+0000 7f9493fff640 1 -- 172.21.15.152:0/1880313625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a8494a0 msgr2=0x55c02a84f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.315+0000 7f9493fff640 1 --2- 172.21.15.152:0/1880313625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a8494a0 0x55c02a84f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.315+0000 7f9493fff640 1 -- 172.21.15.152:0/1880313625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a849dc0 msgr2=0x55c02a86b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.315+0000 7f9493fff640 1 --2- 172.21.15.152:0/1880313625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a849dc0 0x55c02a86b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.315+0000 7f9493fff640 1 -- 172.21.15.152:0/1880313625 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02a849bf0 con 0x55c02a854680 2024-09-11T22:10:13.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.315+0000 7f9492ffd640 1 --2- 172.21.15.152:0/1880313625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a849dc0 0x55c02a86b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:13.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.315+0000 7f9493fff640 1 --2- 172.21.15.152:0/1880313625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a854680 0x55c02a86bd00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f948c009d00 tx=0x7f948c010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=430c4591a926dbee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:13.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.316+0000 7f94897fa640 1 -- 172.21.15.152:0/1880313625 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c021070 con 0x55c02a854680 2024-09-11T22:10:13.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.316+0000 7f94897fa640 1 -- 172.21.15.152:0/1880313625 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f948c0035f0 con 0x55c02a854680 2024-09-11T22:10:13.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.316+0000 7f94897fa640 1 -- 172.21.15.152:0/1880313625 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c01c650 con 0x55c02a854680 2024-09-11T22:10:13.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.317+0000 7f949c4c6740 1 -- 172.21.15.152:0/1880313625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a854680 msgr2=0x55c02a86bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:13.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.317+0000 7f949c4c6740 1 --2- 172.21.15.152:0/1880313625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a854680 0x55c02a86bd00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f948c009d00 tx=0x7f948c010800 comp rx=0 tx=0).stop 2024-09-11T22:10:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.317+0000 7f949c4c6740 1 -- 172.21.15.152:0/1880313625 shutdown_connections 2024-09-11T22:10:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.317+0000 7f949c4c6740 1 --2- 172.21.15.152:0/1880313625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a854680 0x55c02a86bd00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.317+0000 7f949c4c6740 1 --2- 172.21.15.152:0/1880313625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a849dc0 0x55c02a86b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.317+0000 7f949c4c6740 1 --2- 172.21.15.152:0/1880313625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a8494a0 0x55c02a84f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.317+0000 7f949c4c6740 1 -- 172.21.15.152:0/1880313625 >> 172.21.15.152:0/1880313625 conn(0x55c02a845a30 msgr2=0x55c02a844b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.317+0000 7f949c4c6740 1 -- 172.21.15.152:0/1880313625 shutdown_connections 2024-09-11T22:10:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.317+0000 7f949c4c6740 1 -- 172.21.15.152:0/1880313625 wait complete. 2024-09-11T22:10:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.317+0000 7f949c4c6740 1 -- start start 2024-09-11T22:10:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f949c4c6740 1 Processor -- start 2024-09-11T22:10:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f949c4c6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a8494a0 0x55c02a85c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f949c4c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a849dc0 0x55c02a85cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f949c4c6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a854680 0x55c02a857670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f949c4c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f947400cde0 con 0x55c02a849dc0 2024-09-11T22:10:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f949c4c6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f947400e250 con 0x55c02a8494a0 2024-09-11T22:10:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f949c4c6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f947400d4b0 con 0x55c02a854680 2024-09-11T22:10:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f949c4c6740 10 client.0 _ll_register_callbacks cb 0x7f947c009390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f9493fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a854680 0x55c02a857670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f94937fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a8494a0 0x55c02a85c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f9493fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a854680 0x55c02a857670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:44994/0 (socket says 172.21.15.152:44994) 2024-09-11T22:10:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f9493fff640 1 -- 172.21.15.152:0/3575144512 learned_addr learned my addr 172.21.15.152:0/3575144512 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.318+0000 7f9492ffd640 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a849dc0 0x55c02a85cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.319+0000 7f9493fff640 1 -- 172.21.15.152:0/3575144512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a8494a0 msgr2=0x55c02a85c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.319+0000 7f9493fff640 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a8494a0 0x55c02a85c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.319+0000 7f9493fff640 1 -- 172.21.15.152:0/3575144512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a849dc0 msgr2=0x55c02a85cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.319+0000 7f9493fff640 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a849dc0 0x55c02a85cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.319+0000 7f9493fff640 1 -- 172.21.15.152:0/3575144512 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02a85d310 con 0x55c02a854680 2024-09-11T22:10:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.319+0000 7f9493fff640 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a854680 0x55c02a857670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f948c005890 tx=0x7f948c004230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d708e035b36a06d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.319+0000 7f9472ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:10:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.319+0000 7f9472ffd640 1 -- 172.21.15.152:0/3575144512 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c02b060 con 0x55c02a854680 2024-09-11T22:10:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.320+0000 7f9472ffd640 1 -- 172.21.15.152:0/3575144512 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f948c0039a0 con 0x55c02a854680 2024-09-11T22:10:13.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.320+0000 7f949c4c6740 1 -- 172.21.15.152:0/3575144512 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f948c0035f0 con 0x55c02a854680 2024-09-11T22:10:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.320+0000 7f9472ffd640 1 -- 172.21.15.152:0/3575144512 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f948c021040 con 0x55c02a854680 2024-09-11T22:10:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.320+0000 7f949c4c6740 10 client.26383 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.320+0000 7f949c4c6740 1 -- 172.21.15.152:0/3575144512 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c02a8cedd0 con 0x55c02a854680 2024-09-11T22:10:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.320+0000 7f9472ffd640 1 -- 172.21.15.152:0/3575144512 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f948c0099c0 con 0x55c02a854680 2024-09-11T22:10:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.321+0000 7f9472ffd640 1 -- 172.21.15.152:0/3575144512 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f948c01b030 con 0x55c02a854680 2024-09-11T22:10:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.321+0000 7f949c4c6740 10 client.26383 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.321+0000 7f949c4c6740 10 client.26383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.321+0000 7f949c4c6740 20 client.26383 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.321+0000 7f949c4c6740 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c02a863d20 0x55c02a8d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:13.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.321+0000 7f949c4c6740 4 client.26383 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.321+0000 7f949c4c6740 1 -- 172.21.15.152:0/3575144512 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f948c0035f0 con 0x55c02a863d20 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.321+0000 7f94937fe640 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c02a863d20 0x55c02a8d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.322+0000 7f94937fe640 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c02a863d20 0x55c02a8d13b0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c8981d79d3275f5 server_cookie=d7de57f0ad492c95 in_seq=0 out_seq=0 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.322+0000 7f9472ffd640 10 client.26383 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.323+0000 7f9472ffd640 1 -- 172.21.15.152:0/3575144512 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f948c0035f0 con 0x55c02a863d20 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.323+0000 7f9472ffd640 10 client.26383 handle_command_reply: tid=0 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.323+0000 7f949c4c6740 1 client.26383 shutdown 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.323+0000 7f949c4c6740 1 -- 172.21.15.152:0/3575144512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a854680 msgr2=0x55c02a857670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.323+0000 7f949c4c6740 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a854680 0x55c02a857670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f948c005890 tx=0x7f948c004230 comp rx=0 tx=0).stop 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949c4c6740 1 -- 172.21.15.152:0/3575144512 shutdown_connections 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949c4c6740 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c02a863d20 0x55c02a8d13b0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949c4c6740 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c02a854680 0x55c02a857670 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949c4c6740 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c02a849dc0 0x55c02a85cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f9472ffd640 0 client.26383 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:13.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949c4c6740 1 --2- 172.21.15.152:0/3575144512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c02a8494a0 0x55c02a85c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949c4c6740 1 -- 172.21.15.152:0/3575144512 >> 172.21.15.152:0/3575144512 conn(0x55c02a845a30 msgr2=0x55c02a852970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:13.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949c4c6740 1 -- 172.21.15.152:0/3575144512 shutdown_connections 2024-09-11T22:10:13.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949c4c6740 1 -- 172.21.15.152:0/3575144512 wait complete. 2024-09-11T22:10:13.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949c4c6740 20 client.26383 trim_cache size 0 max 16384 2024-09-11T22:10:13.328 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:10:13.328 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:10:13.328 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:10:13.329 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:10:13.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949a0ed640 1 -- 172.21.15.152:0/959816072 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f94800a2dc0 msgr2=0x7f94800a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:13.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949a0ed640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f94800a2dc0 0x7f94800a5280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f947c0095f0 tx=0x7f947c005f90 comp rx=0 tx=0).stop 2024-09-11T22:10:13.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949a0ed640 1 -- 172.21.15.152:0/959816072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9494100b40 msgr2=0x7f94941a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:13.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.324+0000 7f949a0ed640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9494100b40 0x7f94941a4700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f948402aeb0 tx=0x7f948402f630 comp rx=0 tx=0).stop 2024-09-11T22:10:13.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.325+0000 7f949a0ed640 1 -- 172.21.15.152:0/959816072 shutdown_connections 2024-09-11T22:10:13.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.325+0000 7f949a0ed640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f94800a2dc0 0x7f94800a5280 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.325+0000 7f949a0ed640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9494105f50 0x7f949419e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.325+0000 7f949a0ed640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9494101460 0x7f94941a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.325+0000 7f949a0ed640 1 --2- 172.21.15.152:0/959816072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9494100b40 0x7f94941a4700 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:13.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.325+0000 7f949a0ed640 1 -- 172.21.15.152:0/959816072 >> 172.21.15.152:0/959816072 conn(0x7f94940fc7d0 msgr2=0x7f9494103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:13.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.325+0000 7f949a0ed640 1 -- 172.21.15.152:0/959816072 shutdown_connections 2024-09-11T22:10:13.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:13.325+0000 7f949a0ed640 1 -- 172.21.15.152:0/959816072 wait complete. 2024-09-11T22:10:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:13 smithi179 ceph-mon[35603]: pgmap v181: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 46 MiB/s wr, 1.81k op/s 2024-09-11T22:10:13.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:13 smithi193 ceph-mon[35545]: pgmap v181: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 46 MiB/s wr, 1.81k op/s 2024-09-11T22:10:13.848 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:13 smithi152 ceph-mon[31188]: pgmap v181: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 46 MiB/s wr, 1.81k op/s 2024-09-11T22:10:14.159 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:10:14.159 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:10:14.536 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:14.821 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 280.0 s, 3503.4 tps, lat 28.572 ms stddev 33.096 2024-09-11T22:10:15.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.139+0000 7f5613362640 1 -- 172.21.15.152:0/3761022618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c1008c0 msgr2=0x7f560c100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.139+0000 7f5613362640 1 --2- 172.21.15.152:0/3761022618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c1008c0 0x7f560c100ca0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009900 tx=0x7f55fc02a420 comp rx=0 tx=0).stop 2024-09-11T22:10:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.140+0000 7f5613362640 1 -- 172.21.15.152:0/3761022618 shutdown_connections 2024-09-11T22:10:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.140+0000 7f5613362640 1 --2- 172.21.15.152:0/3761022618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c105ec0 0x7f560c106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.140+0000 7f5613362640 1 --2- 172.21.15.152:0/3761022618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f560c1011e0 0x7f560c105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.140+0000 7f5613362640 1 --2- 172.21.15.152:0/3761022618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c1008c0 0x7f560c100ca0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.140+0000 7f5613362640 1 -- 172.21.15.152:0/3761022618 >> 172.21.15.152:0/3761022618 conn(0x7f560c0fc7d0 msgr2=0x7f560c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.140+0000 7f5613362640 1 -- 172.21.15.152:0/3761022618 shutdown_connections 2024-09-11T22:10:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.140+0000 7f5613362640 1 -- 172.21.15.152:0/3761022618 wait complete. 2024-09-11T22:10:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.141+0000 7f5613362640 1 Processor -- start 2024-09-11T22:10:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.141+0000 7f5613362640 1 -- start start 2024-09-11T22:10:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.141+0000 7f5613362640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c1008c0 0x7f560c19ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.141+0000 7f5613362640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f560c1011e0 0x7f560c19f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.141+0000 7f5613362640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c105ec0 0x7f560c1a3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.141+0000 7f5613362640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f560c118700 con 0x7f560c105ec0 2024-09-11T22:10:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.141+0000 7f5613362640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f560c118580 con 0x7f560c1008c0 2024-09-11T22:10:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.141+0000 7f5613362640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f560c118880 con 0x7f560c1011e0 2024-09-11T22:10:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.142+0000 7f56118ff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c105ec0 0x7f560c1a3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.142+0000 7f56118ff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c105ec0 0x7f560c1a3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48156/0 (socket says 172.21.15.152:48156) 2024-09-11T22:10:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.142+0000 7f56118ff640 1 -- 172.21.15.152:0/2172941637 learned_addr learned my addr 172.21.15.152:0/2172941637 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.142+0000 7f56110fe640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c1008c0 0x7f560c19ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.142+0000 7f56108fd640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f560c1011e0 0x7f560c19f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.142+0000 7f56118ff640 1 -- 172.21.15.152:0/2172941637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f560c1011e0 msgr2=0x7f560c19f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.142+0000 7f56118ff640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f560c1011e0 0x7f560c19f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.142+0000 7f56118ff640 1 -- 172.21.15.152:0/2172941637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c1008c0 msgr2=0x7f560c19ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.142+0000 7f56118ff640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c1008c0 0x7f560c19ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.143+0000 7f56118ff640 1 -- 172.21.15.152:0/2172941637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c1a3c30 con 0x7f560c105ec0 2024-09-11T22:10:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.143+0000 7f56118ff640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c105ec0 0x7f560c1a3500 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f560800e970 tx=0x7f560800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.144+0000 7f56027fc640 1 -- 172.21.15.152:0/2172941637 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560800ccc0 con 0x7f560c105ec0 2024-09-11T22:10:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.144+0000 7f56027fc640 1 -- 172.21.15.152:0/2172941637 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f560800ce60 con 0x7f560c105ec0 2024-09-11T22:10:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.144+0000 7f56027fc640 1 -- 172.21.15.152:0/2172941637 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608010490 con 0x7f560c105ec0 2024-09-11T22:10:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.144+0000 7f5613362640 1 -- 172.21.15.152:0/2172941637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560c1a3f20 con 0x7f560c105ec0 2024-09-11T22:10:15.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.144+0000 7f5613362640 1 -- 172.21.15.152:0/2172941637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f560c1ab7b0 con 0x7f560c105ec0 2024-09-11T22:10:15.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.145+0000 7f5613362640 1 -- 172.21.15.152:0/2172941637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f560c06a850 con 0x7f560c105ec0 2024-09-11T22:10:15.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.147+0000 7f56027fc640 1 -- 172.21.15.152:0/2172941637 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f5608005000 con 0x7f560c105ec0 2024-09-11T22:10:15.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.147+0000 7f56027fc640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55f80a2e40 0x7f55f80a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:15.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.148+0000 7f56027fc640 1 -- 172.21.15.152:0/2172941637 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f56080cfb00 con 0x7f560c105ec0 2024-09-11T22:10:15.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.148+0000 7f56110fe640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55f80a2e40 0x7f55f80a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:15.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.148+0000 7f56110fe640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55f80a2e40 0x7f55f80a5300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f55fc000c00 tx=0x7f55fc005a00 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:15.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.153+0000 7f56027fc640 1 -- 172.21.15.152:0/2172941637 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56080541b0 con 0x7f560c105ec0 2024-09-11T22:10:15.428 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.1 2024-09-11T22:10:15.428 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:10:15.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.515+0000 7f5613362640 1 -- 172.21.15.152:0/2172941637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f560c105980 con 0x7f560c105ec0 2024-09-11T22:10:15.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.516+0000 7f56027fc640 1 -- 172.21.15.152:0/2172941637 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f560809c710 con 0x7f560c105ec0 2024-09-11T22:10:15.517 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:10:15.517 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:10:15.517 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:10:15.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.518+0000 7f5613362640 1 -- 172.21.15.152:0/2172941637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55f80a2e40 msgr2=0x7f55f80a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:15.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.518+0000 7f5613362640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55f80a2e40 0x7f55f80a5300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f55fc000c00 tx=0x7f55fc005a00 comp rx=0 tx=0).stop 2024-09-11T22:10:15.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.518+0000 7f5613362640 1 -- 172.21.15.152:0/2172941637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c105ec0 msgr2=0x7f560c1a3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:15.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.518+0000 7f5613362640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c105ec0 0x7f560c1a3500 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f560800e970 tx=0x7f560800ed70 comp rx=0 tx=0).stop 2024-09-11T22:10:15.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.518+0000 7f5613362640 1 -- 172.21.15.152:0/2172941637 shutdown_connections 2024-09-11T22:10:15.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.518+0000 7f5613362640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f55f80a2e40 0x7f55f80a5300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:15.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.518+0000 7f5613362640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c105ec0 0x7f560c1a3500 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:15.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.518+0000 7f5613362640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f560c1011e0 0x7f560c19f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:15.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.518+0000 7f5613362640 1 --2- 172.21.15.152:0/2172941637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c1008c0 0x7f560c19ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:15.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.518+0000 7f5613362640 1 -- 172.21.15.152:0/2172941637 >> 172.21.15.152:0/2172941637 conn(0x7f560c0fc7d0 msgr2=0x7f560c10f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:15.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.519+0000 7f5613362640 1 -- 172.21.15.152:0/2172941637 shutdown_connections 2024-09-11T22:10:15.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:15.519+0000 7f5613362640 1 -- 172.21.15.152:0/2172941637 wait complete. 2024-09-11T22:10:15.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:15 smithi152 ceph-mon[31188]: pgmap v182: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 825 op/s 2024-09-11T22:10:15.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:15 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2172941637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:10:15.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:15 smithi179 ceph-mon[35603]: pgmap v182: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 825 op/s 2024-09-11T22:10:15.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:15 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2172941637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:10:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:15 smithi193 ceph-mon[35545]: pgmap v182: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 825 op/s 2024-09-11T22:10:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:15 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2172941637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:10:16.177 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:10:16.273 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:16.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.867+0000 7f8ce849c640 1 -- 172.21.15.152:0/962608533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ce0106a80 msgr2=0x7f8ce0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:16.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.867+0000 7f8ce849c640 1 --2- 172.21.15.152:0/962608533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ce0106a80 0x7f8ce0106e60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009860 tx=0x7f8cd002a340 comp rx=0 tx=0).stop 2024-09-11T22:10:16.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.867+0000 7f8ce849c640 1 -- 172.21.15.152:0/962608533 shutdown_connections 2024-09-11T22:10:16.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.867+0000 7f8ce849c640 1 --2- 172.21.15.152:0/962608533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ce0101420 0x7f8ce006a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:16.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.867+0000 7f8ce849c640 1 --2- 172.21.15.152:0/962608533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce0100a80 0x7f8ce0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:16.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.867+0000 7f8ce849c640 1 --2- 172.21.15.152:0/962608533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ce0106a80 0x7f8ce0106e60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:16.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.867+0000 7f8ce849c640 1 -- 172.21.15.152:0/962608533 >> 172.21.15.152:0/962608533 conn(0x7f8ce00fc7a0 msgr2=0x7f8ce00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:16.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.868+0000 7f8ce849c640 1 -- 172.21.15.152:0/962608533 shutdown_connections 2024-09-11T22:10:16.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.868+0000 7f8ce849c640 1 -- 172.21.15.152:0/962608533 wait complete. 2024-09-11T22:10:16.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.869+0000 7f8ce849c640 1 Processor -- start 2024-09-11T22:10:16.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.869+0000 7f8ce849c640 1 -- start start 2024-09-11T22:10:16.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.869+0000 7f8ce849c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce0100a80 0x7f8ce0073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:16.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.869+0000 7f8ce849c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ce0101420 0x7f8ce006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:16.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.869+0000 7f8ce849c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ce0106a80 0x7f8ce006c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:16.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.869+0000 7f8ce849c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce0111f90 con 0x7f8ce0100a80 2024-09-11T22:10:16.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.869+0000 7f8ce849c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce0111e10 con 0x7f8ce0106a80 2024-09-11T22:10:16.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.869+0000 7f8ce849c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce0112110 con 0x7f8ce0101420 2024-09-11T22:10:16.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.870+0000 7f8ce6a39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ce0106a80 0x7f8ce006c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:16.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.870+0000 7f8ce6a39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ce0106a80 0x7f8ce006c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41906/0 (socket says 172.21.15.152:41906) 2024-09-11T22:10:16.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.870+0000 7f8ce6a39640 1 -- 172.21.15.152:0/2558772599 learned_addr learned my addr 172.21.15.152:0/2558772599 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.870+0000 7f8ce5a37640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ce0101420 0x7f8ce006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.870+0000 7f8ce6238640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce0100a80 0x7f8ce0073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.870+0000 7f8ce6a39640 1 -- 172.21.15.152:0/2558772599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ce0101420 msgr2=0x7f8ce006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.870+0000 7f8ce6a39640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ce0101420 0x7f8ce006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.870+0000 7f8ce6a39640 1 -- 172.21.15.152:0/2558772599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce0100a80 msgr2=0x7f8ce0073ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.870+0000 7f8ce6a39640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce0100a80 0x7f8ce0073ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.870+0000 7f8ce6a39640 1 -- 172.21.15.152:0/2558772599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce006ca40 con 0x7f8ce0106a80 2024-09-11T22:10:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.870+0000 7f8ce6238640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce0100a80 0x7f8ce0073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.871+0000 7f8ce6a39640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ce0106a80 0x7f8ce006c220 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009fd0 tx=0x7f8cd800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.871+0000 7f8cd77fe640 1 -- 172.21.15.152:0/2558772599 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8004b20 con 0x7f8ce0106a80 2024-09-11T22:10:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.871+0000 7f8cd77fe640 1 -- 172.21.15.152:0/2558772599 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cd8003e50 con 0x7f8ce0106a80 2024-09-11T22:10:16.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.871+0000 7f8ce849c640 1 -- 172.21.15.152:0/2558772599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce01ad290 con 0x7f8ce0106a80 2024-09-11T22:10:16.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.871+0000 7f8ce849c640 1 -- 172.21.15.152:0/2558772599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce01ad7d0 con 0x7f8ce0106a80 2024-09-11T22:10:16.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.872+0000 7f8cd77fe640 1 -- 172.21.15.152:0/2558772599 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800b630 con 0x7f8ce0106a80 2024-09-11T22:10:16.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.873+0000 7f8ce849c640 1 -- 172.21.15.152:0/2558772599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce006a790 con 0x7f8ce0106a80 2024-09-11T22:10:16.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.873+0000 7f8cd77fe640 1 -- 172.21.15.152:0/2558772599 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8cd801d020 con 0x7f8ce0106a80 2024-09-11T22:10:16.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.874+0000 7f8cd77fe640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ccc0a2d70 0x7f8ccc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:16.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.875+0000 7f8cd77fe640 1 -- 172.21.15.152:0/2558772599 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8cd80cf500 con 0x7f8ce0106a80 2024-09-11T22:10:16.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.875+0000 7f8ce6238640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ccc0a2d70 0x7f8ccc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:16.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.878+0000 7f8ce6238640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ccc0a2d70 0x7f8ccc0a5230 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0005b60 tx=0x7f8cd0000bc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:16.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:16.882+0000 7f8cd77fe640 1 -- 172.21.15.152:0/2558772599 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8cd801d310 con 0x7f8ce0106a80 2024-09-11T22:10:16.921 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.982+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/1114649912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c881095d0 msgr2=0x7f9c88109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.982+0000 7f9c8eb6d640 1 --2- 172.21.15.152:0/1114649912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c881095d0 0x7f9c88109a10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009930 tx=0x7f9c7c02a420 comp rx=0 tx=0).stop 2024-09-11T22:10:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.982+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/1114649912 shutdown_connections 2024-09-11T22:10:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.982+0000 7f9c8eb6d640 1 --2- 172.21.15.152:0/1114649912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c8811b140 0x7f9c8811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.982+0000 7f9c8eb6d640 1 --2- 172.21.15.152:0/1114649912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c881095d0 0x7f9c88109a10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.982+0000 7f9c8eb6d640 1 --2- 172.21.15.152:0/1114649912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c881091f0 0x7f9c88110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.982+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/1114649912 >> 172.21.15.152:0/1114649912 conn(0x7f9c8806ce00 msgr2=0x7f9c8806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.983+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/1114649912 shutdown_connections 2024-09-11T22:10:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.983+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/1114649912 wait complete. 2024-09-11T22:10:16.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.984+0000 7f9c8eb6d640 1 Processor -- start 2024-09-11T22:10:16.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.984+0000 7f9c8eb6d640 1 -- start start 2024-09-11T22:10:16.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.984+0000 7f9c8eb6d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c881091f0 0x7f9c881a7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:16.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.984+0000 7f9c8eb6d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c881095d0 0x7f9c881a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:16.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.984+0000 7f9c8eb6d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8811b140 0x7f9c881ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:16.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.984+0000 7f9c8eb6d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88120ca0 con 0x7f9c881095d0 2024-09-11T22:10:16.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.984+0000 7f9c8c909640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c881091f0 0x7f9c881a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:16.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.984+0000 7f9c8eb6d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88120b20 con 0x7f9c8811b140 2024-09-11T22:10:16.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.984+0000 7f9c8c909640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c881091f0 0x7f9c881a7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:34872/0 (socket says 172.21.15.152:34872) 2024-09-11T22:10:16.987 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.984+0000 7f9c8c909640 1 -- 172.21.15.152:0/4231155158 learned_addr learned my addr 172.21.15.152:0/4231155158 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.984+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/4231155158 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88120e20 con 0x7f9c881091f0 2024-09-11T22:10:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.985+0000 7f9c8d10a640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8811b140 0x7f9c881ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.985+0000 7f9c8c909640 1 -- 172.21.15.152:0/4231155158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8811b140 msgr2=0x7f9c881ab990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.985+0000 7f9c8c909640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8811b140 0x7f9c881ab990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.985+0000 7f9c8c909640 1 -- 172.21.15.152:0/4231155158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c881095d0 msgr2=0x7f9c881a76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.985+0000 7f9c8c909640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c881095d0 0x7f9c881a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.985+0000 7f9c8c909640 1 -- 172.21.15.152:0/4231155158 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c881ac0c0 con 0x7f9c881091f0 2024-09-11T22:10:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.985+0000 7f9c8c909640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c881091f0 0x7f9c881a7170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400d950 tx=0x7f9c7400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.987+0000 7f9c85ffb640 1 -- 172.21.15.152:0/4231155158 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74017070 con 0x7f9c881091f0 2024-09-11T22:10:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.987+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/4231155158 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c881ac3b0 con 0x7f9c881091f0 2024-09-11T22:10:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.987+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/4231155158 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c88112930 con 0x7f9c881091f0 2024-09-11T22:10:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.987+0000 7f9c85ffb640 1 -- 172.21.15.152:0/4231155158 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c74009c30 con 0x7f9c881091f0 2024-09-11T22:10:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.988+0000 7f9c85ffb640 1 -- 172.21.15.152:0/4231155158 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400f6b0 con 0x7f9c881091f0 2024-09-11T22:10:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.992+0000 7f9c919eb740 1 Processor -- start 2024-09-11T22:10:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.995+0000 7f9c85ffb640 1 -- 172.21.15.152:0/4231155158 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9c7400f850 con 0x7f9c881091f0 2024-09-11T22:10:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.995+0000 7f9c919eb740 1 -- start start 2024-09-11T22:10:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.996+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209dbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.996+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209dc410 0x5609209e6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.996+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209e6cb0 0x5609209e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.996+0000 7f9c919eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5609209402f0 con 0x5609209dc410 2024-09-11T22:10:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.996+0000 7f9c919eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5609208e8270 con 0x5609209dbaf0 2024-09-11T22:10:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.996+0000 7f9c919eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56092093c2b0 con 0x5609209e6cb0 2024-09-11T22:10:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.996+0000 7f9c85ffb640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c780a2e50 0x7f9c780a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.996+0000 7f9c87fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209e6cb0 0x5609209e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.996+0000 7f9c8d10a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209dbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.996+0000 7f9c8d10a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209dbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41924/0 (socket says 172.21.15.152:41924) 2024-09-11T22:10:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.996+0000 7f9c8d10a640 1 -- 172.21.15.152:0/3564327400 learned_addr learned my addr 172.21.15.152:0/3564327400 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.997+0000 7f9c85ffb640 1 -- 172.21.15.152:0/4231155158 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f9c740ced20 con 0x7f9c881091f0 2024-09-11T22:10:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.997+0000 7f9c8d10a640 1 -- 172.21.15.152:0/3564327400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209e6cb0 msgr2=0x5609209e90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.997+0000 7f9c8d10a640 1 --2- 172.21.15.152:0/3564327400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209e6cb0 0x5609209e90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.997+0000 7f9c8d10a640 1 -- 172.21.15.152:0/3564327400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209dc410 msgr2=0x5609209e6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.997+0000 7f9c8d10a640 1 --2- 172.21.15.152:0/3564327400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209dc410 0x5609209e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.997+0000 7f9c8d10a640 1 -- 172.21.15.152:0/3564327400 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609208e7340 con 0x5609209dbaf0 2024-09-11T22:10:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.997+0000 7f9c8d10a640 1 --2- 172.21.15.152:0/3564327400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209dbed0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009fd0 tx=0x7f9c800139f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5377f4ba8322b94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.998+0000 7f9c72ffd640 1 -- 172.21.15.152:0/3564327400 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c80004b20 con 0x5609209dbaf0 2024-09-11T22:10:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.998+0000 7f9c8d10a640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c780a2e50 0x7f9c780a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.998+0000 7f9c72ffd640 1 -- 172.21.15.152:0/3564327400 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c80003e50 con 0x5609209dbaf0 2024-09-11T22:10:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.998+0000 7f9c72ffd640 1 -- 172.21.15.152:0/3564327400 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000f5e0 con 0x5609209dbaf0 2024-09-11T22:10:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.999+0000 7f9c8d10a640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c780a2e50 0x7f9c780a5310 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c8001d040 tx=0x7f9c8000f9a0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.999+0000 7f9c919eb740 1 -- 172.21.15.152:0/3564327400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 msgr2=0x5609209dbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.999+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3564327400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209dbed0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009fd0 tx=0x7f9c800139f0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.999+0000 7f9c919eb740 1 -- 172.21.15.152:0/3564327400 shutdown_connections 2024-09-11T22:10:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.999+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3564327400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209e6cb0 0x5609209e90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.999+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3564327400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209dc410 0x5609209e6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.999+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3564327400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209dbed0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:16.999+0000 7f9c919eb740 1 -- 172.21.15.152:0/3564327400 >> 172.21.15.152:0/3564327400 conn(0x5609209d8060 msgr2=0x5609209d8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.000+0000 7f9c919eb740 1 -- 172.21.15.152:0/3564327400 shutdown_connections 2024-09-11T22:10:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.000+0000 7f9c919eb740 1 -- 172.21.15.152:0/3564327400 wait complete. 2024-09-11T22:10:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.000+0000 7f9c919eb740 1 -- start start 2024-09-11T22:10:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.000+0000 7f9c919eb740 1 Processor -- start 2024-09-11T22:10:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.001+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dbaf0 0x5609209e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.001+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dc410 0x5609209e40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.001+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209e6cb0 0x5609209e4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.001+0000 7f9c87fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dc410 0x5609209e40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.001+0000 7f9c87fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dc410 0x5609209e40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41932/0 (socket says 172.21.15.152:41932) 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.001+0000 7f9c8d10a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209e6cb0 0x5609209e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.001+0000 7f9c8c909640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dbaf0 0x5609209e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.001+0000 7f9c8c909640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dbaf0 0x5609209e3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:34892/0 (socket says 172.21.15.152:34892) 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.001+0000 7f9c87fff640 1 -- 172.21.15.152:0/2727433595 learned_addr learned my addr 172.21.15.152:0/2727433595 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c919eb740 1 -- 172.21.15.152:0/2727433595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5609209e9880 con 0x5609209e6cb0 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c919eb740 1 -- 172.21.15.152:0/2727433595 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5609208c9290 con 0x5609209dc410 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c919eb740 1 -- 172.21.15.152:0/2727433595 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5609209e9a00 con 0x5609209dbaf0 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c919eb740 10 client.0 _ll_register_callbacks cb 0x5609208fa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c87fff640 1 -- 172.21.15.152:0/2727433595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dbaf0 msgr2=0x5609209e3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c87fff640 1 --2- 172.21.15.152:0/2727433595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dbaf0 0x5609209e3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c87fff640 1 -- 172.21.15.152:0/2727433595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209e6cb0 msgr2=0x5609209e4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c87fff640 1 --2- 172.21.15.152:0/2727433595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209e6cb0 0x5609209e4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c87fff640 1 -- 172.21.15.152:0/2727433595 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560920653210 con 0x5609209dc410 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c87fff640 1 --2- 172.21.15.152:0/2727433595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dc410 0x5609209e40e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009930 tx=0x7f9c7c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfcad109799bbf4a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c67fff640 10 client.26252 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.002+0000 7f9c919eb740 1 -- 172.21.15.152:0/2727433595 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c80003e50 con 0x5609209dc410 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c67fff640 1 -- 172.21.15.152:0/2727433595 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c04b050 con 0x5609209dc410 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c67fff640 1 -- 172.21.15.152:0/2727433595 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f9c7c0314d0 con 0x5609209dc410 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c67fff640 1 -- 172.21.15.152:0/2727433595 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9c7c041070 con 0x5609209dc410 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c919eb740 10 client.26252 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c919eb740 1 -- 172.21.15.152:0/2727433595 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56092071f620 con 0x5609209dc410 2024-09-11T22:10:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c67fff640 1 -- 172.21.15.152:0/2727433595 <== mon.2 v2:172.21.15.179:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9c7c04e020 con 0x5609209dc410 2024-09-11T22:10:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c919eb740 10 client.26252 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c919eb740 10 client.26252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c919eb740 20 client.26252 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c919eb740 1 --2- 172.21.15.152:0/2727433595 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560920a18ae0 0x560920a1aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c919eb740 4 client.26252 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.003+0000 7f9c919eb740 1 -- 172.21.15.152:0/2727433595 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9c80003e50 con 0x560920a18ae0 2024-09-11T22:10:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.004+0000 7f9c8c909640 1 --2- 172.21.15.152:0/2727433595 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560920a18ae0 0x560920a1aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.004+0000 7f9c8c909640 1 --2- 172.21.15.152:0/2727433595 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560920a18ae0 0x560920a1aed0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cd8c5aba3d24217 server_cookie=a2885cdd42f2a2ca in_seq=0 out_seq=0 2024-09-11T22:10:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.004+0000 7f9c67fff640 10 client.26252 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c67fff640 1 -- 172.21.15.152:0/2727433595 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f9c80003e50 con 0x560920a18ae0 2024-09-11T22:10:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c67fff640 10 client.26252 handle_command_reply: tid=0 2024-09-11T22:10:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c919eb740 1 client.26252 shutdown 2024-09-11T22:10:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c919eb740 1 -- 172.21.15.152:0/2727433595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dc410 msgr2=0x5609209e40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c919eb740 1 --2- 172.21.15.152:0/2727433595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dc410 0x5609209e40e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009930 tx=0x7f9c7c004270 comp rx=0 tx=0).stop 2024-09-11T22:10:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c919eb740 1 -- 172.21.15.152:0/2727433595 shutdown_connections 2024-09-11T22:10:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c919eb740 1 --2- 172.21.15.152:0/2727433595 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560920a18ae0 0x560920a1aed0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c67fff640 0 client.26252 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c919eb740 1 --2- 172.21.15.152:0/2727433595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209e6cb0 0x5609209e4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c919eb740 1 --2- 172.21.15.152:0/2727433595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dc410 0x5609209e40e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c919eb740 1 --2- 172.21.15.152:0/2727433595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dbaf0 0x5609209e3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.005+0000 7f9c919eb740 1 -- 172.21.15.152:0/2727433595 >> 172.21.15.152:0/2727433595 conn(0x5609209d8060 msgr2=0x5609209dddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.006+0000 7f9c919eb740 1 -- 172.21.15.152:0/2727433595 shutdown_connections 2024-09-11T22:10:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.006+0000 7f9c919eb740 1 -- 172.21.15.152:0/2727433595 wait complete. 2024-09-11T22:10:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.006+0000 7f9c919eb740 20 client.26252 trim_cache size 0 max 16384 2024-09-11T22:10:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.028+0000 7f9c919eb740 1 Processor -- start 2024-09-11T22:10:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.028+0000 7f9c919eb740 1 -- start start 2024-09-11T22:10:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.028+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209dbaf0 0x5609209e5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dc410 0x5609209e4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209e6cb0 0x560920a207e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c919eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c011190 con 0x5609209dbaf0 2024-09-11T22:10:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c919eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c00ea60 con 0x5609209e6cb0 2024-09-11T22:10:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c919eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c00c8b0 con 0x5609209dc410 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c8c909640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209dbaf0 0x5609209e5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c8d10a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209e6cb0 0x560920a207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c8d10a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209e6cb0 0x560920a207e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41938/0 (socket says 172.21.15.152:41938) 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c8d10a640 1 -- 172.21.15.152:0/3778453563 learned_addr learned my addr 172.21.15.152:0/3778453563 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c87fff640 1 --2- 172.21.15.152:0/3778453563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dc410 0x5609209e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c87fff640 1 -- 172.21.15.152:0/3778453563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209e6cb0 msgr2=0x560920a207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c87fff640 1 --2- 172.21.15.152:0/3778453563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209e6cb0 0x560920a207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c87fff640 1 -- 172.21.15.152:0/3778453563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209dbaf0 msgr2=0x5609209e5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c87fff640 1 --2- 172.21.15.152:0/3778453563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209dbaf0 0x5609209e5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c87fff640 1 -- 172.21.15.152:0/3778453563 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609209d8d50 con 0x5609209dc410 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.029+0000 7f9c8d10a640 1 --2- 172.21.15.152:0/3778453563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209e6cb0 0x560920a207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.030+0000 7f9c87fff640 1 --2- 172.21.15.152:0/3778453563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dc410 0x5609209e4450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c005ab0 tx=0x7f9c7c03b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=257a25ab56960e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.030+0000 7f9c727fc640 1 -- 172.21.15.152:0/3778453563 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c04b040 con 0x5609209dc410 2024-09-11T22:10:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.030+0000 7f9c727fc640 1 -- 172.21.15.152:0/3778453563 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c7c031e30 con 0x5609209dc410 2024-09-11T22:10:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.030+0000 7f9c727fc640 1 -- 172.21.15.152:0/3778453563 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c035020 con 0x5609209dc410 2024-09-11T22:10:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.031+0000 7f9c919eb740 1 -- 172.21.15.152:0/3778453563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dc410 msgr2=0x5609209e4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.031+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3778453563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dc410 0x5609209e4450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c005ab0 tx=0x7f9c7c03b000 comp rx=0 tx=0).stop 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.031+0000 7f9c919eb740 1 -- 172.21.15.152:0/3778453563 shutdown_connections 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.031+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3778453563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209e6cb0 0x560920a207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.031+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3778453563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dc410 0x5609209e4450 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.031+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3778453563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209dbaf0 0x5609209e5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.031+0000 7f9c919eb740 1 -- 172.21.15.152:0/3778453563 >> 172.21.15.152:0/3778453563 conn(0x5609209d8060 msgr2=0x5609209d7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.032+0000 7f9c919eb740 1 -- 172.21.15.152:0/3778453563 shutdown_connections 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.032+0000 7f9c919eb740 1 -- 172.21.15.152:0/3778453563 wait complete. 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.032+0000 7f9c919eb740 1 -- start start 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.032+0000 7f9c919eb740 1 Processor -- start 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209eacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dc410 0x5609209eb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c919eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209e6cb0 0x5609209eb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c919eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c00cf20 con 0x5609209e6cb0 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c919eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c00e390 con 0x5609209dbaf0 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c919eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c00d5f0 con 0x5609209dc410 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c8c909640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209eacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c8c909640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209eacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41946/0 (socket says 172.21.15.152:41946) 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c8c909640 1 -- 172.21.15.152:0/3297474992 learned_addr learned my addr 172.21.15.152:0/3297474992 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c87fff640 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dc410 0x5609209eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c8d10a640 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209e6cb0 0x5609209eb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c919eb740 10 client.0 _ll_register_callbacks cb 0x7f9c800093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c8c909640 1 -- 172.21.15.152:0/3297474992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dc410 msgr2=0x5609209eb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c8c909640 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dc410 0x5609209eb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c8c909640 1 -- 172.21.15.152:0/3297474992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209e6cb0 msgr2=0x5609209eb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c8c909640 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209e6cb0 0x5609209eb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.033+0000 7f9c8c909640 1 -- 172.21.15.152:0/3297474992 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560920a82a50 con 0x5609209dbaf0 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.034+0000 7f9c8c909640 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209eacf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c740cf050 tx=0x7f9c740ce040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82320bfd3e9bfda server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.034+0000 7f9c67fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.034+0000 7f9c67fff640 1 -- 172.21.15.152:0/3297474992 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c740b8070 con 0x5609209dbaf0 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.034+0000 7f9c67fff640 1 -- 172.21.15.152:0/3297474992 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f9c740978a0 con 0x5609209dbaf0 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.034+0000 7f9c919eb740 1 -- 172.21.15.152:0/3297474992 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c7c031e30 con 0x5609209dbaf0 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.034+0000 7f9c67fff640 1 -- 172.21.15.152:0/3297474992 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9c7409b230 con 0x5609209dbaf0 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.034+0000 7f9c919eb740 10 client.26258 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.034+0000 7f9c919eb740 1 -- 172.21.15.152:0/3297474992 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560920a83da0 con 0x5609209dbaf0 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.035+0000 7f9c67fff640 1 -- 172.21.15.152:0/3297474992 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c7c031e30 con 0x5609209dbaf0 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.035+0000 7f9c67fff640 1 -- 172.21.15.152:0/3297474992 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9c740ccb30 con 0x5609209dbaf0 2024-09-11T22:10:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.035+0000 7f9c919eb740 10 client.26258 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:17.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.035+0000 7f9c919eb740 10 client.26258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:17.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.035+0000 7f9c919eb740 20 client.26258 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:17.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.035+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560920a18ae0 0x560920a86510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.035+0000 7f9c919eb740 4 client.26258 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:10:17.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.035+0000 7f9c919eb740 1 -- 172.21.15.152:0/3297474992 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56092094da20 con 0x560920a18ae0 2024-09-11T22:10:17.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.035+0000 7f9c87fff640 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560920a18ae0 0x560920a86510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.036+0000 7f9c67fff640 10 client.26258 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:17.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.036+0000 7f9c87fff640 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560920a18ae0 0x560920a86510 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ed18d6783f13475 server_cookie=e3a466cb6e235351 in_seq=0 out_seq=0 2024-09-11T22:10:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.044+0000 7f9c67fff640 1 -- 172.21.15.152:0/3297474992 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56092094da20 con 0x560920a18ae0 2024-09-11T22:10:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.045+0000 7f9c67fff640 10 client.26258 handle_command_reply: tid=0 2024-09-11T22:10:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.046+0000 7f9c919eb740 1 client.26258 shutdown 2024-09-11T22:10:17.048 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.046+0000 7f9c919eb740 1 -- 172.21.15.152:0/3297474992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 msgr2=0x5609209eacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.048 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.046+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209eacf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c740cf050 tx=0x7f9c740ce040 comp rx=0 tx=0).stop 2024-09-11T22:10:17.048 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.046+0000 7f9c919eb740 1 -- 172.21.15.152:0/3297474992 shutdown_connections 2024-09-11T22:10:17.048 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.046+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560920a18ae0 0x560920a86510 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.047+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609209e6cb0 0x5609209eb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.047+0000 7f9c67fff640 0 client.26258 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.047+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5609209dc410 0x5609209eb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.047+0000 7f9c919eb740 1 --2- 172.21.15.152:0/3297474992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609209dbaf0 0x5609209eacf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.047+0000 7f9c919eb740 1 -- 172.21.15.152:0/3297474992 >> 172.21.15.152:0/3297474992 conn(0x5609209d8060 msgr2=0x5609209e5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.047+0000 7f9c919eb740 1 -- 172.21.15.152:0/3297474992 shutdown_connections 2024-09-11T22:10:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.047+0000 7f9c919eb740 1 -- 172.21.15.152:0/3297474992 wait complete. 2024-09-11T22:10:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.047+0000 7f9c919eb740 20 client.26258 trim_cache size 0 max 16384 2024-09-11T22:10:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:10:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:10:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:10:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:10:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/4231155158 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c780a2e50 msgr2=0x7f9c780a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c780a2e50 0x7f9c780a5310 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c8001d040 tx=0x7f9c8000f9a0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/4231155158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c881091f0 msgr2=0x7f9c881a7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c881091f0 0x7f9c881a7170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400d950 tx=0x7f9c7400de10 comp rx=0 tx=0).stop 2024-09-11T22:10:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/4231155158 shutdown_connections 2024-09-11T22:10:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c780a2e50 0x7f9c780a5310 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8811b140 0x7f9c881ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c881095d0 0x7f9c881a76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 --2- 172.21.15.152:0/4231155158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c881091f0 0x7f9c881a7170 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/4231155158 >> 172.21.15.152:0/4231155158 conn(0x7f9c8806ce00 msgr2=0x7f9c8811b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/4231155158 shutdown_connections 2024-09-11T22:10:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:17.050+0000 7f9c8eb6d640 1 -- 172.21.15.152:0/4231155158 wait complete. 2024-09-11T22:10:17.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.250+0000 7f8ce849c640 1 -- 172.21.15.152:0/2558772599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ce01ada80 con 0x7f8ce0106a80 2024-09-11T22:10:17.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.251+0000 7f8cd77fe640 1 -- 172.21.15.152:0/2558772599 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f8cd809c090 con 0x7f8ce0106a80 2024-09-11T22:10:17.252 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:10:17.252 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:10:17.253 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:10:17.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.254+0000 7f8ce849c640 1 -- 172.21.15.152:0/2558772599 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ccc0a2d70 msgr2=0x7f8ccc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.254+0000 7f8ce849c640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ccc0a2d70 0x7f8ccc0a5230 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0005b60 tx=0x7f8cd0000bc0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.254+0000 7f8ce849c640 1 -- 172.21.15.152:0/2558772599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ce0106a80 msgr2=0x7f8ce006c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.254+0000 7f8ce849c640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ce0106a80 0x7f8ce006c220 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009fd0 tx=0x7f8cd800c800 comp rx=0 tx=0).stop 2024-09-11T22:10:17.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.255+0000 7f8ce849c640 1 -- 172.21.15.152:0/2558772599 shutdown_connections 2024-09-11T22:10:17.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.255+0000 7f8ce849c640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ccc0a2d70 0x7f8ccc0a5230 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.255+0000 7f8ce849c640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ce0106a80 0x7f8ce006c220 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.255+0000 7f8ce849c640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ce0101420 0x7f8ce006bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.255+0000 7f8ce849c640 1 --2- 172.21.15.152:0/2558772599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce0100a80 0x7f8ce0073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.255+0000 7f8ce849c640 1 -- 172.21.15.152:0/2558772599 >> 172.21.15.152:0/2558772599 conn(0x7f8ce00fc7a0 msgr2=0x7f8ce010e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.255+0000 7f8ce849c640 1 -- 172.21.15.152:0/2558772599 shutdown_connections 2024-09-11T22:10:17.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.255+0000 7f8ce849c640 1 -- 172.21.15.152:0/2558772599 wait complete. 2024-09-11T22:10:17.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:17 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2558772599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:10:17.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:17 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2558772599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:10:17.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.708+0000 7ffa8edbc640 1 -- 172.21.15.152:0/3971324681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa881049b0 msgr2=0x7ffa88108a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.708+0000 7ffa8edbc640 1 --2- 172.21.15.152:0/3971324681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa881049b0 0x7ffa88108a00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009900 tx=0x7ffa7402a400 comp rx=0 tx=0).stop 2024-09-11T22:10:17.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.709+0000 7ffa8edbc640 1 -- 172.21.15.152:0/3971324681 shutdown_connections 2024-09-11T22:10:17.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.709+0000 7ffa8edbc640 1 --2- 172.21.15.152:0/3971324681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa88109130 0x7ffa88110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.709+0000 7ffa8edbc640 1 --2- 172.21.15.152:0/3971324681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa881049b0 0x7ffa88108a00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.709+0000 7ffa8edbc640 1 --2- 172.21.15.152:0/3971324681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88104000 0x7ffa881043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.709+0000 7ffa8edbc640 1 -- 172.21.15.152:0/3971324681 >> 172.21.15.152:0/3971324681 conn(0x7ffa880ffa20 msgr2=0x7ffa88101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.709+0000 7ffa8edbc640 1 -- 172.21.15.152:0/3971324681 shutdown_connections 2024-09-11T22:10:17.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.709+0000 7ffa8edbc640 1 -- 172.21.15.152:0/3971324681 wait complete. 2024-09-11T22:10:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.710+0000 7ffa8edbc640 1 Processor -- start 2024-09-11T22:10:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.710+0000 7ffa8edbc640 1 -- start start 2024-09-11T22:10:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.710+0000 7ffa8edbc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88104000 0x7ffa88073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8edbc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa881049b0 0x7ffa8806cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8edbc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa88109130 0x7ffa8806d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8edbc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88114130 con 0x7ffa88109130 2024-09-11T22:10:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8edbc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88113fb0 con 0x7ffa88104000 2024-09-11T22:10:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8edbc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881142b0 con 0x7ffa881049b0 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8cb58640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88104000 0x7ffa88073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8cb58640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88104000 0x7ffa88073a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41954/0 (socket says 172.21.15.152:41954) 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8cb58640 1 -- 172.21.15.152:0/1753278688 learned_addr learned my addr 172.21.15.152:0/1753278688 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8d359640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa88109130 0x7ffa8806d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa87fff640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa881049b0 0x7ffa8806cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8cb58640 1 -- 172.21.15.152:0/1753278688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa881049b0 msgr2=0x7ffa8806cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8cb58640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa881049b0 0x7ffa8806cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8cb58640 1 -- 172.21.15.152:0/1753278688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa88109130 msgr2=0x7ffa8806d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8cb58640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa88109130 0x7ffa8806d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.711+0000 7ffa8cb58640 1 -- 172.21.15.152:0/1753278688 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8806d720 con 0x7ffa88104000 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.712+0000 7ffa8cb58640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88104000 0x7ffa88073a90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00d950 tx=0x7ffa7c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.712+0000 7ffa85ffb640 1 -- 172.21.15.152:0/1753278688 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c017070 con 0x7ffa88104000 2024-09-11T22:10:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.712+0000 7ffa85ffb640 1 -- 172.21.15.152:0/1753278688 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa7c009c30 con 0x7ffa88104000 2024-09-11T22:10:17.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.713+0000 7ffa85ffb640 1 -- 172.21.15.152:0/1753278688 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00f6b0 con 0x7ffa88104000 2024-09-11T22:10:17.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.713+0000 7ffa8edbc640 1 -- 172.21.15.152:0/1753278688 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa880715c0 con 0x7ffa88104000 2024-09-11T22:10:17.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.713+0000 7ffa8edbc640 1 -- 172.21.15.152:0/1753278688 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa880719c0 con 0x7ffa88104000 2024-09-11T22:10:17.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.717+0000 7ffa85ffb640 1 -- 172.21.15.152:0/1753278688 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ffa7c00f850 con 0x7ffa88104000 2024-09-11T22:10:17.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.717+0000 7ffa91195740 1 Processor -- start 2024-09-11T22:10:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.717+0000 7ffa91195740 1 -- start start 2024-09-11T22:10:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.717+0000 7ffa91195740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 0x5575b13cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.717+0000 7ffa91195740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.717+0000 7ffa91195740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13d9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.717+0000 7ffa91195740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5575b13322f0 con 0x5575b13cc5d0 2024-09-11T22:10:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.717+0000 7ffa91195740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5575b12d9cf0 con 0x5575b13d7370 2024-09-11T22:10:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.717+0000 7ffa91195740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5575b132e2b0 con 0x5575b13cdb40 2024-09-11T22:10:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa8cb58640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa8cb58640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48258/0 (socket says 172.21.15.152:48258) 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa8cb58640 1 -- 172.21.15.152:0/3763493614 learned_addr learned my addr 172.21.15.152:0/3763493614 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa8d359640 1 --2- 172.21.15.152:0/3763493614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 0x5575b13cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa87fff640 1 --2- 172.21.15.152:0/3763493614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa8d359640 1 -- 172.21.15.152:0/3763493614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 msgr2=0x5575b13d9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa8d359640 1 --2- 172.21.15.152:0/3763493614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13d9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa8d359640 1 -- 172.21.15.152:0/3763493614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 msgr2=0x5575b13cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa8d359640 1 --2- 172.21.15.152:0/3763493614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa8d359640 1 -- 172.21.15.152:0/3763493614 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b12be3a0 con 0x5575b13cdb40 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa85ffb640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffa780a2d20 0x7ffa780a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.718+0000 7ffa8cb58640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffa780a2d20 0x7ffa780a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.719+0000 7ffa8d359640 1 --2- 172.21.15.152:0/3763493614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 0x5575b13cc090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009eb0 tx=0x7ffa80010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=103a87452423bb3e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.719+0000 7ffa85ffb640 1 -- 172.21.15.152:0/1753278688 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ffa7c0cec70 con 0x7ffa88104000 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.719+0000 7ffa72ffd640 1 -- 172.21.15.152:0/3763493614 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80016070 con 0x5575b13cdb40 2024-09-11T22:10:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.719+0000 7ffa72ffd640 1 -- 172.21.15.152:0/3763493614 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa80004d20 con 0x5575b13cdb40 2024-09-11T22:10:17.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.719+0000 7ffa72ffd640 1 -- 172.21.15.152:0/3763493614 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80012810 con 0x5575b13cdb40 2024-09-11T22:10:17.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.720+0000 7ffa91195740 1 -- 172.21.15.152:0/3763493614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 msgr2=0x5575b13cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.720+0000 7ffa91195740 1 --2- 172.21.15.152:0/3763493614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 0x5575b13cc090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009eb0 tx=0x7ffa80010740 comp rx=0 tx=0).stop 2024-09-11T22:10:17.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.720+0000 7ffa8cb58640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffa780a2d20 0x7ffa780a51e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0a38c0 tx=0x7ffa7c0d2720 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:17.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.720+0000 7ffa91195740 1 -- 172.21.15.152:0/3763493614 shutdown_connections 2024-09-11T22:10:17.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.720+0000 7ffa91195740 1 --2- 172.21.15.152:0/3763493614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13d9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.720+0000 7ffa91195740 1 --2- 172.21.15.152:0/3763493614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.720+0000 7ffa91195740 1 --2- 172.21.15.152:0/3763493614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 0x5575b13cc090 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.720+0000 7ffa91195740 1 -- 172.21.15.152:0/3763493614 >> 172.21.15.152:0/3763493614 conn(0x5575b1395310 msgr2=0x5575b13c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.720+0000 7ffa91195740 1 -- 172.21.15.152:0/3763493614 shutdown_connections 2024-09-11T22:10:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.720+0000 7ffa91195740 1 -- 172.21.15.152:0/3763493614 wait complete. 2024-09-11T22:10:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.721+0000 7ffa91195740 1 -- start start 2024-09-11T22:10:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.721+0000 7ffa91195740 1 Processor -- start 2024-09-11T22:10:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.721+0000 7ffa91195740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13d6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.721+0000 7ffa91195740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 0x5575b13d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.721+0000 7ffa91195740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13d4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.721+0000 7ffa91195740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5575b13da070 con 0x5575b13cc5d0 2024-09-11T22:10:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.721+0000 7ffa91195740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5575b12ed060 con 0x5575b13d7370 2024-09-11T22:10:17.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.721+0000 7ffa91195740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5575b13da1f0 con 0x5575b13cdb40 2024-09-11T22:10:17.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa8d359640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13d6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa8d359640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13d6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48260/0 (socket says 172.21.15.152:48260) 2024-09-11T22:10:17.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa8d359640 1 -- 172.21.15.152:0/1113693711 learned_addr learned my addr 172.21.15.152:0/1113693711 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:17.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa87fff640 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 0x5575b13d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa8d359640 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13d4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa91195740 10 client.0 _ll_register_callbacks cb 0x5575b10408c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:17.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa87fff640 1 -- 172.21.15.152:0/1113693711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 msgr2=0x5575b13d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa87fff640 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13d4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa87fff640 1 -- 172.21.15.152:0/1113693711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 msgr2=0x5575b13d6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa87fff640 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13d6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa87fff640 1 -- 172.21.15.152:0/1113693711 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575b10a33c0 con 0x5575b13cdb40 2024-09-11T22:10:17.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa8d359640 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13d6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:17.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa91195740 1 -- 172.21.15.152:0/1113693711 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa80004d20 con 0x5575b13cdb40 2024-09-11T22:10:17.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa87fff640 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 0x5575b13d4040 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffa74005940 tx=0x7ffa74031920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64d101a3184291c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:17.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.722+0000 7ffa67fff640 10 client.26422 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:10:17.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.723+0000 7ffa67fff640 1 -- 172.21.15.152:0/1113693711 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74035040 con 0x5575b13cdb40 2024-09-11T22:10:17.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.723+0000 7ffa67fff640 1 -- 172.21.15.152:0/1113693711 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ffa74004240 con 0x5575b13cdb40 2024-09-11T22:10:17.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.723+0000 7ffa67fff640 1 -- 172.21.15.152:0/1113693711 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffa74004480 con 0x5575b13cdb40 2024-09-11T22:10:17.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.723+0000 7ffa91195740 10 client.26422 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:17.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.723+0000 7ffa91195740 1 -- 172.21.15.152:0/1113693711 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5575b13e5a40 con 0x5575b13cdb40 2024-09-11T22:10:17.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.724+0000 7ffa67fff640 1 -- 172.21.15.152:0/1113693711 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ffa740035f0 con 0x5575b13cdb40 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.724+0000 7ffa91195740 10 client.26422 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.724+0000 7ffa91195740 10 client.26422 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.724+0000 7ffa91195740 20 client.26422 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.724+0000 7ffa91195740 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5575b13e6df0 0x5575b13e91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.724+0000 7ffa91195740 4 client.26422 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.724+0000 7ffa91195740 1 -- 172.21.15.152:0/1113693711 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575b133f860 con 0x5575b13e6df0 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.724+0000 7ffa8d359640 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5575b13e6df0 0x5575b13e91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.725+0000 7ffa67fff640 10 client.26422 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.725+0000 7ffa8d359640 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5575b13e6df0 0x5575b13e91e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=56c3da71cd66da8d server_cookie=d4530b81dee843dc in_seq=0 out_seq=0 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.725+0000 7ffa67fff640 1 -- 172.21.15.152:0/1113693711 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575b133f860 con 0x5575b13e6df0 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.725+0000 7ffa67fff640 10 client.26422 handle_command_reply: tid=0 2024-09-11T22:10:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.725+0000 7ffa91195740 1 client.26422 shutdown 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.725+0000 7ffa91195740 1 -- 172.21.15.152:0/1113693711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 msgr2=0x5575b13d4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.725+0000 7ffa91195740 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 0x5575b13d4040 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffa74005940 tx=0x7ffa74031920 comp rx=0 tx=0).stop 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.725+0000 7ffa91195740 1 -- 172.21.15.152:0/1113693711 shutdown_connections 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.726+0000 7ffa91195740 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5575b13e6df0 0x5575b13e91e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.726+0000 7ffa67fff640 0 client.26422 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.726+0000 7ffa91195740 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13d4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.726+0000 7ffa91195740 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cdb40 0x5575b13d4040 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.726+0000 7ffa91195740 1 --2- 172.21.15.152:0/1113693711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13d6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.726+0000 7ffa91195740 1 -- 172.21.15.152:0/1113693711 >> 172.21.15.152:0/1113693711 conn(0x5575b1395310 msgr2=0x5575b13ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.726+0000 7ffa91195740 1 -- 172.21.15.152:0/1113693711 shutdown_connections 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.726+0000 7ffa91195740 1 -- 172.21.15.152:0/1113693711 wait complete. 2024-09-11T22:10:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.726+0000 7ffa91195740 20 client.26422 trim_cache size 0 max 16384 2024-09-11T22:10:17.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.747+0000 7ffa91195740 1 Processor -- start 2024-09-11T22:10:17.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.747+0000 7ffa91195740 1 -- start start 2024-09-11T22:10:17.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa91195740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cc5d0 0x5575b13e3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa91195740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cdb40 0x5575b13eea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa91195740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13eef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa91195740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881baa40 con 0x5575b13cdb40 2024-09-11T22:10:17.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa91195740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881b8310 con 0x5575b13d7370 2024-09-11T22:10:17.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa91195740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881b6160 con 0x5575b13cc5d0 2024-09-11T22:10:17.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa87fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cdb40 0x5575b13eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa87fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cdb40 0x5575b13eea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48266/0 (socket says 172.21.15.152:48266) 2024-09-11T22:10:17.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa87fff640 1 -- 172.21.15.152:0/1751329988 learned_addr learned my addr 172.21.15.152:0/1751329988 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:17.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa8d359640 1 --2- 172.21.15.152:0/1751329988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa8d359640 1 --2- 172.21.15.152:0/1751329988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cc5d0 0x5575b13e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa8d359640 1 -- 172.21.15.152:0/1751329988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cc5d0 msgr2=0x5575b13e3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa8d359640 1 --2- 172.21.15.152:0/1751329988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cc5d0 0x5575b13e3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa8d359640 1 -- 172.21.15.152:0/1751329988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cdb40 msgr2=0x5575b13eea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa8d359640 1 --2- 172.21.15.152:0/1751329988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cdb40 0x5575b13eea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.748+0000 7ffa8d359640 1 -- 172.21.15.152:0/1751329988 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b13d9ad0 con 0x5575b13d7370 2024-09-11T22:10:17.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.751+0000 7ffa8d359640 1 --2- 172.21.15.152:0/1751329988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13eef80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffa80010c40 tx=0x7ffa80014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=693cdf9692045932 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:17.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.752+0000 7ffa727fc640 1 -- 172.21.15.152:0/1751329988 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80016070 con 0x5575b13d7370 2024-09-11T22:10:17.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.752+0000 7ffa727fc640 1 -- 172.21.15.152:0/1751329988 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa80025040 con 0x5575b13d7370 2024-09-11T22:10:17.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.752+0000 7ffa727fc640 1 -- 172.21.15.152:0/1751329988 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8002da00 con 0x5575b13d7370 2024-09-11T22:10:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.753+0000 7ffa91195740 1 -- 172.21.15.152:0/1751329988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 msgr2=0x5575b13eef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.753+0000 7ffa91195740 1 --2- 172.21.15.152:0/1751329988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13eef80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffa80010c40 tx=0x7ffa80014040 comp rx=0 tx=0).stop 2024-09-11T22:10:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.753+0000 7ffa91195740 1 -- 172.21.15.152:0/1751329988 shutdown_connections 2024-09-11T22:10:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.753+0000 7ffa91195740 1 --2- 172.21.15.152:0/1751329988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13d7370 0x5575b13eef80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.753+0000 7ffa91195740 1 --2- 172.21.15.152:0/1751329988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cdb40 0x5575b13eea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.753+0000 7ffa91195740 1 --2- 172.21.15.152:0/1751329988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13cc5d0 0x5575b13e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.753+0000 7ffa91195740 1 -- 172.21.15.152:0/1751329988 >> 172.21.15.152:0/1751329988 conn(0x5575b1395310 msgr2=0x5575b13cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.754+0000 7ffa91195740 1 -- 172.21.15.152:0/1751329988 shutdown_connections 2024-09-11T22:10:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.754+0000 7ffa91195740 1 -- 172.21.15.152:0/1751329988 wait complete. 2024-09-11T22:10:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.754+0000 7ffa91195740 1 -- start start 2024-09-11T22:10:17.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.755+0000 7ffa91195740 1 Processor -- start 2024-09-11T22:10:17.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.756+0000 7ffa91195740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13db1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.756+0000 7ffa91195740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13cdb40 0x5575b13db700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.756+0000 7ffa91195740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13d7370 0x5575b13dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.756+0000 7ffa91195740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881b67d0 con 0x5575b13cc5d0 2024-09-11T22:10:17.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.756+0000 7ffa91195740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881b7c40 con 0x5575b13cdb40 2024-09-11T22:10:17.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.756+0000 7ffa91195740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881b6ea0 con 0x5575b13d7370 2024-09-11T22:10:17.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.757+0000 7ffa91195740 10 client.0 _ll_register_callbacks cb 0x7ffa74009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:17.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.757+0000 7ffa8d359640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13db1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.758+0000 7ffa8d359640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13db1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48282/0 (socket says 172.21.15.152:48282) 2024-09-11T22:10:17.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.758+0000 7ffa8d359640 1 -- 172.21.15.152:0/941270001 learned_addr learned my addr 172.21.15.152:0/941270001 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:17.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.758+0000 7ffa8d359640 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13d7370 0x5575b13dbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.758+0000 7ffa87fff640 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13cdb40 0x5575b13db700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.759+0000 7ffa87fff640 1 -- 172.21.15.152:0/941270001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13d7370 msgr2=0x5575b13dbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.759+0000 7ffa87fff640 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13d7370 0x5575b13dbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.759+0000 7ffa87fff640 1 -- 172.21.15.152:0/941270001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 msgr2=0x5575b13db1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:17.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.759+0000 7ffa87fff640 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13db1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.759+0000 7ffa87fff640 1 -- 172.21.15.152:0/941270001 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575b1450a10 con 0x5575b13cdb40 2024-09-11T22:10:17.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.759+0000 7ffa87fff640 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13cdb40 0x5575b13db700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffa7402a920 tx=0x7ffa74009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed760cfa8cc7b59f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:17.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.759+0000 7ffa67fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:10:17.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.759+0000 7ffa67fff640 1 -- 172.21.15.152:0/941270001 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74035070 con 0x5575b13cdb40 2024-09-11T22:10:17.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.759+0000 7ffa91195740 1 -- 172.21.15.152:0/941270001 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa80025040 con 0x5575b13cdb40 2024-09-11T22:10:17.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.759+0000 7ffa67fff640 1 -- 172.21.15.152:0/941270001 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ffa74003ef0 con 0x5575b13cdb40 2024-09-11T22:10:17.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.760+0000 7ffa67fff640 1 -- 172.21.15.152:0/941270001 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffa74062050 con 0x5575b13cdb40 2024-09-11T22:10:17.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.760+0000 7ffa91195740 10 client.26276 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:17.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.760+0000 7ffa91195740 1 -- 172.21.15.152:0/941270001 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5575b1451cd0 con 0x5575b13cdb40 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.760+0000 7ffa67fff640 1 -- 172.21.15.152:0/941270001 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa80025040 con 0x5575b13cdb40 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.760+0000 7ffa67fff640 1 -- 172.21.15.152:0/941270001 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ffa74005510 con 0x5575b13cdb40 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.760+0000 7ffa91195740 10 client.26276 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.760+0000 7ffa91195740 10 client.26276 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.760+0000 7ffa91195740 20 client.26276 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.760+0000 7ffa91195740 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5575b13e6df0 0x5575b1454430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.760+0000 7ffa91195740 4 client.26276 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.760+0000 7ffa91195740 1 -- 172.21.15.152:0/941270001 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5575b1339d70 con 0x5575b13e6df0 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa8d359640 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5575b13e6df0 0x5575b1454430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa67fff640 10 client.26276 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa8d359640 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5575b13e6df0 0x5575b1454430 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e97ed2716483224 server_cookie=84136f831fb097e3 in_seq=0 out_seq=0 2024-09-11T22:10:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa67fff640 1 -- 172.21.15.152:0/941270001 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5575b1339d70 con 0x5575b13e6df0 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa67fff640 10 client.26276 handle_command_reply: tid=0 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa91195740 1 client.26276 shutdown 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa91195740 1 -- 172.21.15.152:0/941270001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13cdb40 msgr2=0x5575b13db700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa91195740 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13cdb40 0x5575b13db700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffa7402a920 tx=0x7ffa74009260 comp rx=0 tx=0).stop 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa91195740 1 -- 172.21.15.152:0/941270001 shutdown_connections 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa91195740 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5575b13e6df0 0x5575b1454430 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa91195740 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575b13d7370 0x5575b13dbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa91195740 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575b13cdb40 0x5575b13db700 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa91195740 1 --2- 172.21.15.152:0/941270001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5575b13cc5d0 0x5575b13db1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa91195740 1 -- 172.21.15.152:0/941270001 >> 172.21.15.152:0/941270001 conn(0x5575b1395310 msgr2=0x5575b13d58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.761+0000 7ffa67fff640 0 client.26276 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:10:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.762+0000 7ffa91195740 1 -- 172.21.15.152:0/941270001 shutdown_connections 2024-09-11T22:10:17.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.762+0000 7ffa91195740 1 -- 172.21.15.152:0/941270001 wait complete. 2024-09-11T22:10:17.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.762+0000 7ffa91195740 20 client.26276 trim_cache size 0 max 16384 2024-09-11T22:10:17.766 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:10:17.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.762+0000 7ffa8edbc640 1 -- 172.21.15.152:0/1753278688 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffa780a2d20 msgr2=0x7ffa780a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.762+0000 7ffa8edbc640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffa780a2d20 0x7ffa780a51e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0a38c0 tx=0x7ffa7c0d2720 comp rx=0 tx=0).stop 2024-09-11T22:10:17.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.762+0000 7ffa8edbc640 1 -- 172.21.15.152:0/1753278688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88104000 msgr2=0x7ffa88073a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:17.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.762+0000 7ffa8edbc640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88104000 0x7ffa88073a90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00d950 tx=0x7ffa7c00de10 comp rx=0 tx=0).stop 2024-09-11T22:10:17.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.763+0000 7ffa8edbc640 1 -- 172.21.15.152:0/1753278688 shutdown_connections 2024-09-11T22:10:17.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.763+0000 7ffa8edbc640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffa780a2d20 0x7ffa780a51e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.763+0000 7ffa8edbc640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa88109130 0x7ffa8806d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.763+0000 7ffa8edbc640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa881049b0 0x7ffa8806cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.763+0000 7ffa8edbc640 1 --2- 172.21.15.152:0/1753278688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88104000 0x7ffa88073a90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:17.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.763+0000 7ffa8edbc640 1 -- 172.21.15.152:0/1753278688 >> 172.21.15.152:0/1753278688 conn(0x7ffa880ffa20 msgr2=0x7ffa88100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:17.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.763+0000 7ffa8edbc640 1 -- 172.21.15.152:0/1753278688 shutdown_connections 2024-09-11T22:10:17.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:17.763+0000 7ffa8edbc640 1 -- 172.21.15.152:0/1753278688 wait complete. 2024-09-11T22:10:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:17 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2558772599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:10:18.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:18 smithi152 ceph-mon[31188]: pgmap v183: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 825 op/s 2024-09-11T22:10:18.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:18 smithi193 ceph-mon[35545]: pgmap v183: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 825 op/s 2024-09-11T22:10:18.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:18 smithi179 ceph-mon[35603]: pgmap v183: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 825 op/s 2024-09-11T22:10:19.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:10:19.306 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 140.1 --await-for 45.0' 2024-09-11T22:10:19.307 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 140.1 --await-for 45.0 2024-09-11T22:10:19.580 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:19.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:19 smithi179 ceph-mon[35603]: pgmap v184: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-11T22:10:19.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 285.0 s, 3538.6 tps, lat 28.283 ms stddev 30.455 2024-09-11T22:10:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:19 smithi193 ceph-mon[35545]: pgmap v184: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-11T22:10:19.862 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:19 smithi152 ceph-mon[31188]: pgmap v184: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-11T22:10:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.149+0000 7ff526ac7640 1 -- 172.21.15.152:0/4238601601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff52010ddc0 msgr2=0x7ff520115940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.149+0000 7ff526ac7640 1 --2- 172.21.15.152:0/4238601601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff52010ddc0 0x7ff520115940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff514009900 tx=0x7ff51402a410 comp rx=0 tx=0).stop 2024-09-11T22:10:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.149+0000 7ff526ac7640 1 -- 172.21.15.152:0/4238601601 shutdown_connections 2024-09-11T22:10:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.149+0000 7ff526ac7640 1 --2- 172.21.15.152:0/4238601601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff52010ddc0 0x7ff520115940 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.149+0000 7ff526ac7640 1 --2- 172.21.15.152:0/4238601601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff520109e00 0x7ff52010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.149+0000 7ff526ac7640 1 --2- 172.21.15.152:0/4238601601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff520109450 0x7ff520109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.149+0000 7ff526ac7640 1 -- 172.21.15.152:0/4238601601 >> 172.21.15.152:0/4238601601 conn(0x7ff52006e140 msgr2=0x7ff52006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:20.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.152+0000 7ff526ac7640 1 -- 172.21.15.152:0/4238601601 shutdown_connections 2024-09-11T22:10:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.154+0000 7ff526ac7640 1 -- 172.21.15.152:0/4238601601 wait complete. 2024-09-11T22:10:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.154+0000 7ff526ac7640 1 Processor -- start 2024-09-11T22:10:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.155+0000 7ff526ac7640 1 -- start start 2024-09-11T22:10:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.155+0000 7ff526ac7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff520109450 0x7ff5201a6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.155+0000 7ff526ac7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff520109e00 0x7ff5201a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.155+0000 7ff526ac7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff52010ddc0 0x7ff5201a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.155+0000 7ff526ac7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff52011a7a0 con 0x7ff520109450 2024-09-11T22:10:20.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.155+0000 7ff526ac7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff52011a620 con 0x7ff520109e00 2024-09-11T22:10:20.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.155+0000 7ff526ac7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff52011a920 con 0x7ff52010ddc0 2024-09-11T22:10:20.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.155+0000 7ff525064640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff52010ddc0 0x7ff5201a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.155+0000 7ff525064640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff52010ddc0 0x7ff5201a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:34964/0 (socket says 172.21.15.152:34964) 2024-09-11T22:10:20.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.156+0000 7ff525064640 1 -- 172.21.15.152:0/2819055065 learned_addr learned my addr 172.21.15.152:0/2819055065 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:20.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.156+0000 7ff525064640 1 -- 172.21.15.152:0/2819055065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff520109e00 msgr2=0x7ff5201a6d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:10:20.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.156+0000 7ff525064640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff520109e00 0x7ff5201a6d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.156+0000 7ff525064640 1 -- 172.21.15.152:0/2819055065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff520109450 msgr2=0x7ff5201a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.156+0000 7ff525064640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff520109450 0x7ff5201a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.156+0000 7ff525064640 1 -- 172.21.15.152:0/2819055065 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5201a10f0 con 0x7ff52010ddc0 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.157+0000 7ff525064640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff52010ddc0 0x7ff5201a09c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5140045c0 tx=0x7ff5140045f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.157+0000 7ff51dffb640 1 -- 172.21.15.152:0/2819055065 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff514040070 con 0x7ff52010ddc0 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.158+0000 7ff526ac7640 1 -- 172.21.15.152:0/2819055065 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5201a1380 con 0x7ff52010ddc0 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.158+0000 7ff526ac7640 1 -- 172.21.15.152:0/2819055065 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5201ad6d0 con 0x7ff52010ddc0 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.158+0000 7ff51dffb640 1 -- 172.21.15.152:0/2819055065 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff514031c80 con 0x7ff52010ddc0 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.158+0000 7ff51dffb640 1 -- 172.21.15.152:0/2819055065 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff514035020 con 0x7ff52010ddc0 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.162+0000 7ff528ea0740 1 Processor -- start 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.162+0000 7ff528ea0740 1 -- start start 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.164+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359577b40 0x55a359576090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.164+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3595765d0 0x55a359576a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.164+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359581370 0x55a359583760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.164+0000 7ff528ea0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a3594dc2f0 con 0x55a3595765d0 2024-09-11T22:10:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.164+0000 7ff528ea0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a359483cf0 con 0x55a359577b40 2024-09-11T22:10:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.164+0000 7ff528ea0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a3594d82b0 con 0x55a359581370 2024-09-11T22:10:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.166+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359577b40 0x55a359576090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.166+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359577b40 0x55a359576090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41982/0 (socket says 172.21.15.152:41982) 2024-09-11T22:10:20.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.166+0000 7ff51ffff640 1 -- 172.21.15.152:0/3186445882 learned_addr learned my addr 172.21.15.152:0/3186445882 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:20.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.166+0000 7ff524863640 1 --2- 172.21.15.152:0/3186445882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3595765d0 0x55a359576a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.169+0000 7ff51ffff640 1 --2- 172.21.15.152:0/3186445882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359581370 0x55a359583760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.172+0000 7ff51ffff640 1 -- 172.21.15.152:0/3186445882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359577b40 msgr2=0x55a359576090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.172+0000 7ff51ffff640 1 --2- 172.21.15.152:0/3186445882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359577b40 0x55a359576090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.172+0000 7ff51ffff640 1 -- 172.21.15.152:0/3186445882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3595765d0 msgr2=0x55a359576a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.172+0000 7ff51ffff640 1 --2- 172.21.15.152:0/3186445882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3595765d0 0x55a359576a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.172+0000 7ff51ffff640 1 -- 172.21.15.152:0/3186445882 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3594683a0 con 0x55a359581370 2024-09-11T22:10:20.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.172+0000 7ff51dffb640 1 -- 172.21.15.152:0/2819055065 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff514043070 con 0x7ff52010ddc0 2024-09-11T22:10:20.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.175+0000 7ff51dffb640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5080a2ec0 0x7ff5080a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.175+0000 7ff51dffb640 1 -- 172.21.15.152:0/2819055065 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff5140efe20 con 0x7ff52010ddc0 2024-09-11T22:10:20.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.174+0000 7ff51ffff640 1 --2- 172.21.15.152:0/3186445882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359581370 0x55a359583760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff518013a50 tx=0x7ff518009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ffca0914531a37e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.175+0000 7ff524863640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5080a2ec0 0x7ff5080a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.176+0000 7ff506ffd640 1 -- 172.21.15.152:0/3186445882 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518004b20 con 0x55a359581370 2024-09-11T22:10:20.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.176+0000 7ff506ffd640 1 -- 172.21.15.152:0/3186445882 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff518013530 con 0x55a359581370 2024-09-11T22:10:20.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.176+0000 7ff506ffd640 1 -- 172.21.15.152:0/3186445882 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518005580 con 0x55a359581370 2024-09-11T22:10:20.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.176+0000 7ff524863640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5080a2ec0 0x7ff5080a5380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55a359573ac0 tx=0x7ff510009620 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.179+0000 7ff528ea0740 1 -- 172.21.15.152:0/3186445882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359581370 msgr2=0x55a359583760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.179+0000 7ff528ea0740 1 --2- 172.21.15.152:0/3186445882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359581370 0x55a359583760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff518013a50 tx=0x7ff518009500 comp rx=0 tx=0).stop 2024-09-11T22:10:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.181+0000 7ff528ea0740 1 -- 172.21.15.152:0/3186445882 shutdown_connections 2024-09-11T22:10:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.181+0000 7ff528ea0740 1 --2- 172.21.15.152:0/3186445882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359581370 0x55a359583760 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.181+0000 7ff528ea0740 1 --2- 172.21.15.152:0/3186445882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3595765d0 0x55a359576a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.181+0000 7ff528ea0740 1 --2- 172.21.15.152:0/3186445882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359577b40 0x55a359576090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.181+0000 7ff528ea0740 1 -- 172.21.15.152:0/3186445882 >> 172.21.15.152:0/3186445882 conn(0x55a35953f310 msgr2=0x55a359572c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.182+0000 7ff528ea0740 1 -- 172.21.15.152:0/3186445882 shutdown_connections 2024-09-11T22:10:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.182+0000 7ff528ea0740 1 -- 172.21.15.152:0/3186445882 wait complete. 2024-09-11T22:10:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.183+0000 7ff528ea0740 1 -- start start 2024-09-11T22:10:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.183+0000 7ff528ea0740 1 Processor -- start 2024-09-11T22:10:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.184+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3595765d0 0x55a359580cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.184+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 0x55a35957dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.184+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359581370 0x55a35957e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.185+0000 7ff528ea0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a359584070 con 0x55a359581370 2024-09-11T22:10:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.185+0000 7ff528ea0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a359497060 con 0x55a3595765d0 2024-09-11T22:10:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.185+0000 7ff528ea0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a3595841f0 con 0x55a359577b40 2024-09-11T22:10:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.185+0000 7ff528ea0740 10 client.0 _ll_register_callbacks cb 0x55a3591ea8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.185+0000 7ff525064640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359581370 0x55a35957e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.185+0000 7ff525064640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359581370 0x55a35957e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48332/0 (socket says 172.21.15.152:48332) 2024-09-11T22:10:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.185+0000 7ff525064640 1 -- 172.21.15.152:0/3752023995 learned_addr learned my addr 172.21.15.152:0/3752023995 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.187+0000 7ff51ffff640 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 0x55a35957dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.185+0000 7ff524863640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3595765d0 0x55a359580cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.188+0000 7ff525064640 1 -- 172.21.15.152:0/3752023995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 msgr2=0x55a35957dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.188+0000 7ff525064640 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 0x55a35957dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.188+0000 7ff525064640 1 -- 172.21.15.152:0/3752023995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3595765d0 msgr2=0x55a359580cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.188+0000 7ff525064640 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3595765d0 0x55a359580cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.188+0000 7ff525064640 1 -- 172.21.15.152:0/3752023995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a35924d3c0 con 0x55a359581370 2024-09-11T22:10:20.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.188+0000 7ff51ffff640 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 0x55a35957dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:10:20.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.188+0000 7ff524863640 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3595765d0 0x55a359580cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:10:20.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.190+0000 7ff525064640 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359581370 0x55a35957e520 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff5140b8c80 tx=0x7ff5140bbc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12299f818ca7b437 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.190+0000 7ff4fffff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:20.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.190+0000 7ff4fffff640 1 -- 172.21.15.152:0/3752023995 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5140d5060 con 0x55a359581370 2024-09-11T22:10:20.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.191+0000 7ff4fffff640 1 -- 172.21.15.152:0/3752023995 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff5140ed760 con 0x55a359581370 2024-09-11T22:10:20.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.191+0000 7ff528ea0740 1 -- 172.21.15.152:0/3752023995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff518013530 con 0x55a359581370 2024-09-11T22:10:20.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.191+0000 7ff4fffff640 1 -- 172.21.15.152:0/3752023995 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff5140da050 con 0x55a359581370 2024-09-11T22:10:20.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.191+0000 7ff528ea0740 10 client.16842 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:20.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.191+0000 7ff528ea0740 1 -- 172.21.15.152:0/3752023995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a35958fb30 con 0x55a359581370 2024-09-11T22:10:20.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.192+0000 7ff4fffff640 1 -- 172.21.15.152:0/3752023995 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff518013530 con 0x55a359581370 2024-09-11T22:10:20.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.192+0000 7ff4fffff640 1 -- 172.21.15.152:0/3752023995 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff51403a040 con 0x55a359581370 2024-09-11T22:10:20.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.193+0000 7ff528ea0740 10 client.16842 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:20.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.193+0000 7ff528ea0740 10 client.16842 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:10:20.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.193+0000 7ff528ea0740 20 client.16842 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:20.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.193+0000 7ff528ea0740 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a359590ff0 0x55a359593470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.193+0000 7ff528ea0740 4 client.16842 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:20.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.193+0000 7ff528ea0740 1 -- 172.21.15.152:0/3752023995 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3594e9860 con 0x55a359590ff0 2024-09-11T22:10:20.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.196+0000 7ff524863640 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a359590ff0 0x55a359593470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.199+0000 7ff4fffff640 10 client.16842 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:10:20.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.199+0000 7ff524863640 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a359590ff0 0x55a359593470 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c8ed8581a009480 server_cookie=8e87e22fbc080df9 in_seq=0 out_seq=0 2024-09-11T22:10:20.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.200+0000 7ff4fffff640 1 -- 172.21.15.152:0/3752023995 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3594e9860 con 0x55a359590ff0 2024-09-11T22:10:20.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.200+0000 7ff4fffff640 10 client.16842 handle_command_reply: tid=0 2024-09-11T22:10:20.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.201+0000 7ff528ea0740 1 client.16842 shutdown 2024-09-11T22:10:20.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.201+0000 7ff528ea0740 1 -- 172.21.15.152:0/3752023995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359581370 msgr2=0x55a35957e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.201+0000 7ff528ea0740 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359581370 0x55a35957e520 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff5140b8c80 tx=0x7ff5140bbc10 comp rx=0 tx=0).stop 2024-09-11T22:10:20.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.202+0000 7ff528ea0740 1 -- 172.21.15.152:0/3752023995 shutdown_connections 2024-09-11T22:10:20.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.202+0000 7ff528ea0740 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a359590ff0 0x55a359593470 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.202+0000 7ff528ea0740 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359581370 0x55a35957e520 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.202+0000 7ff4fffff640 0 client.16842 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:10:20.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.202+0000 7ff528ea0740 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 0x55a35957dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.202+0000 7ff528ea0740 1 --2- 172.21.15.152:0/3752023995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3595765d0 0x55a359580cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.202+0000 7ff528ea0740 1 -- 172.21.15.152:0/3752023995 >> 172.21.15.152:0/3752023995 conn(0x55a35953f310 msgr2=0x55a359578930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:20.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.204+0000 7ff528ea0740 1 -- 172.21.15.152:0/3752023995 shutdown_connections 2024-09-11T22:10:20.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.206+0000 7ff528ea0740 1 -- 172.21.15.152:0/3752023995 wait complete. 2024-09-11T22:10:20.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.206+0000 7ff528ea0740 20 client.16842 trim_cache size 0 max 16384 2024-09-11T22:10:20.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.232+0000 7ff528ea0740 1 Processor -- start 2024-09-11T22:10:20.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.232+0000 7ff528ea0740 1 -- start start 2024-09-11T22:10:20.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3595765d0 0x55a359572e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 0x55a35958d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359581370 0x55a359598d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff528ea0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c011090 con 0x55a3595765d0 2024-09-11T22:10:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff528ea0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c00e960 con 0x55a359581370 2024-09-11T22:10:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff528ea0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c00c7b0 con 0x55a359577b40 2024-09-11T22:10:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 0x55a35958d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 0x55a35958d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:34978/0 (socket says 172.21.15.152:34978) 2024-09-11T22:10:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff51ffff640 1 -- 172.21.15.152:0/1150590793 learned_addr learned my addr 172.21.15.152:0/1150590793 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff525064640 1 --2- 172.21.15.152:0/1150590793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359581370 0x55a359598d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff51ffff640 1 -- 172.21.15.152:0/1150590793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359581370 msgr2=0x55a359598d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff51ffff640 1 --2- 172.21.15.152:0/1150590793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359581370 0x55a359598d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff51ffff640 1 -- 172.21.15.152:0/1150590793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3595765d0 msgr2=0x55a359572e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff51ffff640 1 --2- 172.21.15.152:0/1150590793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3595765d0 0x55a359572e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.233+0000 7ff51ffff640 1 -- 172.21.15.152:0/1150590793 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a359581060 con 0x55a359577b40 2024-09-11T22:10:20.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.234+0000 7ff525064640 1 --2- 172.21.15.152:0/1150590793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359581370 0x55a359598d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:20.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.234+0000 7ff51ffff640 1 --2- 172.21.15.152:0/1150590793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 0x55a35958d3a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff5180139f0 tx=0x7ff518013750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b58be3c490002bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.234+0000 7ff5067fc640 1 -- 172.21.15.152:0/1150590793 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518003970 con 0x55a359577b40 2024-09-11T22:10:20.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.235+0000 7ff5067fc640 1 -- 172.21.15.152:0/1150590793 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff518009e80 con 0x55a359577b40 2024-09-11T22:10:20.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.235+0000 7ff5067fc640 1 -- 172.21.15.152:0/1150590793 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518005030 con 0x55a359577b40 2024-09-11T22:10:20.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.236+0000 7ff528ea0740 1 -- 172.21.15.152:0/1150590793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 msgr2=0x55a35958d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.236+0000 7ff528ea0740 1 --2- 172.21.15.152:0/1150590793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 0x55a35958d3a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff5180139f0 tx=0x7ff518013750 comp rx=0 tx=0).stop 2024-09-11T22:10:20.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.236+0000 7ff528ea0740 1 -- 172.21.15.152:0/1150590793 shutdown_connections 2024-09-11T22:10:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.236+0000 7ff528ea0740 1 --2- 172.21.15.152:0/1150590793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359581370 0x55a359598d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.236+0000 7ff528ea0740 1 --2- 172.21.15.152:0/1150590793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a359577b40 0x55a35958d3a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.236+0000 7ff528ea0740 1 --2- 172.21.15.152:0/1150590793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3595765d0 0x55a359572e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.236+0000 7ff528ea0740 1 -- 172.21.15.152:0/1150590793 >> 172.21.15.152:0/1150590793 conn(0x55a35953f310 msgr2=0x55a359572700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.236+0000 7ff528ea0740 1 -- 172.21.15.152:0/1150590793 shutdown_connections 2024-09-11T22:10:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.236+0000 7ff528ea0740 1 -- 172.21.15.152:0/1150590793 wait complete. 2024-09-11T22:10:20.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.237+0000 7ff528ea0740 1 -- start start 2024-09-11T22:10:20.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.237+0000 7ff528ea0740 1 Processor -- start 2024-09-11T22:10:20.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.238+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3595765d0 0x55a35957b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.238+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359577b40 0x55a35957b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.238+0000 7ff528ea0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359581370 0x55a35957bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.238+0000 7ff524863640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3595765d0 0x55a35957b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.238+0000 7ff528ea0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c00ce20 con 0x55a359577b40 2024-09-11T22:10:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.238+0000 7ff528ea0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c00e290 con 0x55a359581370 2024-09-11T22:10:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.238+0000 7ff528ea0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c00d4f0 con 0x55a3595765d0 2024-09-11T22:10:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.238+0000 7ff524863640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3595765d0 0x55a35957b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:34986/0 (socket says 172.21.15.152:34986) 2024-09-11T22:10:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.238+0000 7ff524863640 1 -- 172.21.15.152:0/1128124595 learned_addr learned my addr 172.21.15.152:0/1128124595 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.238+0000 7ff528ea0740 10 client.0 _ll_register_callbacks cb 0x7ff514031e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.238+0000 7ff51ffff640 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359577b40 0x55a35957b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.239+0000 7ff525064640 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359581370 0x55a35957bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.239+0000 7ff524863640 1 -- 172.21.15.152:0/1128124595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359581370 msgr2=0x55a35957bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.239+0000 7ff524863640 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359581370 0x55a35957bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.239+0000 7ff524863640 1 -- 172.21.15.152:0/1128124595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359577b40 msgr2=0x55a35957b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.239+0000 7ff524863640 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359577b40 0x55a35957b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.239+0000 7ff524863640 1 -- 172.21.15.152:0/1128124595 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a359603660 con 0x55a3595765d0 2024-09-11T22:10:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.239+0000 7ff524863640 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3595765d0 0x55a35957b120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff510009f10 tx=0x7ff510005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd30ba6cdf7f1de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.239+0000 7ff4fffff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:10:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.239+0000 7ff4fffff640 1 -- 172.21.15.152:0/1128124595 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510003970 con 0x55a3595765d0 2024-09-11T22:10:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.239+0000 7ff4fffff640 1 -- 172.21.15.152:0/1128124595 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff510003b10 con 0x55a3595765d0 2024-09-11T22:10:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.239+0000 7ff528ea0740 1 -- 172.21.15.152:0/1128124595 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3594e3d70 con 0x55a3595765d0 2024-09-11T22:10:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.240+0000 7ff4fffff640 1 -- 172.21.15.152:0/1128124595 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff510036050 con 0x55a3595765d0 2024-09-11T22:10:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.240+0000 7ff528ea0740 10 client.26446 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.240+0000 7ff528ea0740 1 -- 172.21.15.152:0/1128124595 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a359604910 con 0x55a3595765d0 2024-09-11T22:10:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.240+0000 7ff4fffff640 1 -- 172.21.15.152:0/1128124595 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff510003d10 con 0x55a3595765d0 2024-09-11T22:10:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.240+0000 7ff4fffff640 1 -- 172.21.15.152:0/1128124595 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff51001d4b0 con 0x55a3595765d0 2024-09-11T22:10:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.240+0000 7ff528ea0740 10 client.26446 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.240+0000 7ff528ea0740 10 client.26446 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:10:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.240+0000 7ff528ea0740 20 client.26446 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.240+0000 7ff528ea0740 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a359590ff0 0x55a3596070e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.241+0000 7ff528ea0740 4 client.26446 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:10:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.241+0000 7ff528ea0740 1 -- 172.21.15.152:0/1128124595 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a3594e3d70 con 0x55a359590ff0 2024-09-11T22:10:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.241+0000 7ff51ffff640 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a359590ff0 0x55a3596070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.242+0000 7ff51ffff640 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a359590ff0 0x55a3596070e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e1b6044de2d4a08f server_cookie=5b50719d0f6592a5 in_seq=0 out_seq=0 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.242+0000 7ff4fffff640 10 client.26446 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff4fffff640 1 -- 172.21.15.152:0/1128124595 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a3594e3d70 con 0x55a359590ff0 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff4fffff640 10 client.26446 handle_command_reply: tid=0 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff528ea0740 1 client.26446 shutdown 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff528ea0740 1 -- 172.21.15.152:0/1128124595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3595765d0 msgr2=0x55a35957b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff528ea0740 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3595765d0 0x55a35957b120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff510009f10 tx=0x7ff510005f90 comp rx=0 tx=0).stop 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff528ea0740 1 -- 172.21.15.152:0/1128124595 shutdown_connections 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff528ea0740 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a359590ff0 0x55a3596070e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff528ea0740 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a359581370 0x55a35957bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff4fffff640 0 client.26446 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff528ea0740 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a359577b40 0x55a35957b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff528ea0740 1 --2- 172.21.15.152:0/1128124595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3595765d0 0x55a35957b120 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff528ea0740 1 -- 172.21.15.152:0/1128124595 >> 172.21.15.152:0/1128124595 conn(0x55a35953f310 msgr2=0x55a359571d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff528ea0740 1 -- 172.21.15.152:0/1128124595 shutdown_connections 2024-09-11T22:10:20.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.243+0000 7ff528ea0740 1 -- 172.21.15.152:0/1128124595 wait complete. 2024-09-11T22:10:20.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff528ea0740 20 client.26446 trim_cache size 0 max 16384 2024-09-11T22:10:20.247 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:10:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff526ac7640 1 -- 172.21.15.152:0/2819055065 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5080a2ec0 msgr2=0x7ff5080a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff526ac7640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5080a2ec0 0x7ff5080a5380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55a359573ac0 tx=0x7ff510009620 comp rx=0 tx=0).stop 2024-09-11T22:10:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff526ac7640 1 -- 172.21.15.152:0/2819055065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff52010ddc0 msgr2=0x7ff5201a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff526ac7640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff52010ddc0 0x7ff5201a09c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5140045c0 tx=0x7ff5140045f0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff526ac7640 1 -- 172.21.15.152:0/2819055065 shutdown_connections 2024-09-11T22:10:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff526ac7640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5080a2ec0 0x7ff5080a5380 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff526ac7640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff52010ddc0 0x7ff5201a09c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff526ac7640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff520109e00 0x7ff5201a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff526ac7640 1 --2- 172.21.15.152:0/2819055065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff520109450 0x7ff5201a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff526ac7640 1 -- 172.21.15.152:0/2819055065 >> 172.21.15.152:0/2819055065 conn(0x7ff52006e140 msgr2=0x7ff520071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.244+0000 7ff526ac7640 1 -- 172.21.15.152:0/2819055065 shutdown_connections 2024-09-11T22:10:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.245+0000 7ff526ac7640 1 -- 172.21.15.152:0/2819055065 wait complete. 2024-09-11T22:10:20.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.903+0000 7fcad2e36640 1 -- 172.21.15.152:0/3407503116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcacc102d30 msgr2=0x7fcacc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.903+0000 7fcad2e36640 1 --2- 172.21.15.152:0/3407503116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcacc102d30 0x7fcacc103110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009860 tx=0x7fcac002a3d0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.904+0000 7fcad2e36640 1 -- 172.21.15.152:0/3407503116 shutdown_connections 2024-09-11T22:10:20.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.904+0000 7fcad2e36640 1 --2- 172.21.15.152:0/3407503116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcacc10c160 0x7fcacc10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.904+0000 7fcad2e36640 1 --2- 172.21.15.152:0/3407503116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc103650 0x7fcacc10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.904+0000 7fcad2e36640 1 --2- 172.21.15.152:0/3407503116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcacc102d30 0x7fcacc103110 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.904+0000 7fcad2e36640 1 -- 172.21.15.152:0/3407503116 >> 172.21.15.152:0/3407503116 conn(0x7fcacc0fc790 msgr2=0x7fcacc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:20.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.904+0000 7fcad2e36640 1 -- 172.21.15.152:0/3407503116 shutdown_connections 2024-09-11T22:10:20.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.904+0000 7fcad2e36640 1 -- 172.21.15.152:0/3407503116 wait complete. 2024-09-11T22:10:20.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.905+0000 7fcad2e36640 1 Processor -- start 2024-09-11T22:10:20.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.905+0000 7fcad2e36640 1 -- start start 2024-09-11T22:10:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.905+0000 7fcad2e36640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcacc102d30 0x7fcacc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.905+0000 7fcad2e36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc103650 0x7fcacc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.905+0000 7fcad2e36640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcacc10c160 0x7fcacc19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.905+0000 7fcad2e36640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc111f60 con 0x7fcacc103650 2024-09-11T22:10:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad2e36640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc111de0 con 0x7fcacc102d30 2024-09-11T22:10:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad2e36640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1120e0 con 0x7fcacc10c160 2024-09-11T22:10:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad0bd2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcacc102d30 0x7fcacc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcacbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc103650 0x7fcacc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad0bd2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcacc102d30 0x7fcacc198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:42016/0 (socket says 172.21.15.152:42016) 2024-09-11T22:10:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad0bd2640 1 -- 172.21.15.152:0/1098824116 learned_addr learned my addr 172.21.15.152:0/1098824116 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:20.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad13d3640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcacc10c160 0x7fcacc19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad13d3640 1 -- 172.21.15.152:0/1098824116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcacc102d30 msgr2=0x7fcacc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad13d3640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcacc102d30 0x7fcacc198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad13d3640 1 -- 172.21.15.152:0/1098824116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc103650 msgr2=0x7fcacc198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad13d3640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc103650 0x7fcacc198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad13d3640 1 -- 172.21.15.152:0/1098824116 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcacc19d3d0 con 0x7fcacc10c160 2024-09-11T22:10:20.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad0bd2640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcacc102d30 0x7fcacc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:20.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.906+0000 7fcad13d3640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcacc10c160 0x7fcacc19ccf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009fd0 tx=0x7fcac400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.907+0000 7fcac9ffb640 1 -- 172.21.15.152:0/1098824116 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac400ce20 con 0x7fcacc10c160 2024-09-11T22:10:20.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.907+0000 7fcac9ffb640 1 -- 172.21.15.152:0/1098824116 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac40137d0 con 0x7fcacc10c160 2024-09-11T22:10:20.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.907+0000 7fcad2e36640 1 -- 172.21.15.152:0/1098824116 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcacc19d6c0 con 0x7fcacc10c160 2024-09-11T22:10:20.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.907+0000 7fcac9ffb640 1 -- 172.21.15.152:0/1098824116 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40055e0 con 0x7fcacc10c160 2024-09-11T22:10:20.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.908+0000 7fcad2e36640 1 -- 172.21.15.152:0/1098824116 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcacc1008c0 con 0x7fcacc10c160 2024-09-11T22:10:20.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.911+0000 7fcad520f740 1 Processor -- start 2024-09-11T22:10:20.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.911+0000 7fcac9ffb640 1 -- 172.21.15.152:0/1098824116 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fcac40058a0 con 0x7fcacc10c160 2024-09-11T22:10:20.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.911+0000 7fcad520f740 1 -- start start 2024-09-11T22:10:20.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.912+0000 7fcad520f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e531b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.912+0000 7fcad520f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e532080 0x55d01e53c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.912+0000 7fcad520f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 0x55d01e53ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.912+0000 7fcad520f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d01e4972a0 con 0x55d01e531760 2024-09-11T22:10:20.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.912+0000 7fcad520f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d01e43eb10 con 0x55d01e53c940 2024-09-11T22:10:20.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.912+0000 7fcad520f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d01e493260 con 0x55d01e532080 2024-09-11T22:10:20.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.912+0000 7fcad0bd2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e532080 0x55d01e53c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.912+0000 7fcad0bd2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e532080 0x55d01e53c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:35014/0 (socket says 172.21.15.152:35014) 2024-09-11T22:10:20.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.912+0000 7fcad0bd2640 1 -- 172.21.15.152:0/2797339581 learned_addr learned my addr 172.21.15.152:0/2797339581 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:20.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.913+0000 7fcacbfff640 1 --2- 172.21.15.152:0/2797339581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 0x55d01e53ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.913+0000 7fcacbfff640 1 --2- 172.21.15.152:0/2797339581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e531b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.913+0000 7fcacbfff640 1 -- 172.21.15.152:0/2797339581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e532080 msgr2=0x55d01e53c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.913+0000 7fcacbfff640 1 --2- 172.21.15.152:0/2797339581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e532080 0x55d01e53c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.913+0000 7fcacbfff640 1 -- 172.21.15.152:0/2797339581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 msgr2=0x55d01e531b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.913+0000 7fcacbfff640 1 --2- 172.21.15.152:0/2797339581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e531b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.913+0000 7fcacbfff640 1 -- 172.21.15.152:0/2797339581 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01e208b90 con 0x55d01e53c940 2024-09-11T22:10:20.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.913+0000 7fcad0bd2640 1 --2- 172.21.15.152:0/2797339581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e532080 0x55d01e53c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.913+0000 7fcacbfff640 1 --2- 172.21.15.152:0/2797339581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 0x55d01e53ed30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcab8005fd0 tx=0x7fcab80095a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed0e2fcf48948421 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.914+0000 7fcab6ffd640 1 -- 172.21.15.152:0/2797339581 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8004020 con 0x55d01e53c940 2024-09-11T22:10:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.914+0000 7fcab6ffd640 1 -- 172.21.15.152:0/2797339581 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcab8005500 con 0x55d01e53c940 2024-09-11T22:10:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.914+0000 7fcac9ffb640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcabc0a2ec0 0x7fcabc0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.914+0000 7fcad0bd2640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcabc0a2ec0 0x7fcabc0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.914+0000 7fcac9ffb640 1 -- 172.21.15.152:0/1098824116 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcac40d3a10 con 0x7fcacc10c160 2024-09-11T22:10:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.915+0000 7fcad520f740 1 -- 172.21.15.152:0/2797339581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 msgr2=0x55d01e53ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.915+0000 7fcad520f740 1 --2- 172.21.15.152:0/2797339581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 0x55d01e53ed30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcab8005fd0 tx=0x7fcab80095a0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.915+0000 7fcad520f740 1 -- 172.21.15.152:0/2797339581 shutdown_connections 2024-09-11T22:10:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.915+0000 7fcad520f740 1 --2- 172.21.15.152:0/2797339581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 0x55d01e53ed30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.915+0000 7fcad520f740 1 --2- 172.21.15.152:0/2797339581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e532080 0x55d01e53c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.915+0000 7fcad520f740 1 --2- 172.21.15.152:0/2797339581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e531b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.915+0000 7fcad520f740 1 -- 172.21.15.152:0/2797339581 >> 172.21.15.152:0/2797339581 conn(0x55d01e52dcf0 msgr2=0x55d01e52e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:20.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.915+0000 7fcad0bd2640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcabc0a2ec0 0x7fcabc0a5380 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55d01e52eb50 tx=0x7fcac00058b0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.915+0000 7fcad520f740 1 -- 172.21.15.152:0/2797339581 shutdown_connections 2024-09-11T22:10:20.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.915+0000 7fcad520f740 1 -- 172.21.15.152:0/2797339581 wait complete. 2024-09-11T22:10:20.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.917+0000 7fcad520f740 1 -- start start 2024-09-11T22:10:20.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.917+0000 7fcad520f740 1 Processor -- start 2024-09-11T22:10:20.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcad520f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e5396f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcad520f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e532080 0x55d01e539c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcad520f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e53c940 0x55d01e53a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcad520f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d01e53f5b0 con 0x55d01e531760 2024-09-11T22:10:20.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcad520f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d01e41f6e0 con 0x55d01e532080 2024-09-11T22:10:20.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcad520f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d01e53f730 con 0x55d01e53c940 2024-09-11T22:10:20.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcad520f740 10 client.0 _ll_register_callbacks cb 0x55d01e443a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:20.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcacbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e532080 0x55d01e539c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcad0bd2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e5396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcad0bd2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e5396f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48402/0 (socket says 172.21.15.152:48402) 2024-09-11T22:10:20.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcad0bd2640 1 -- 172.21.15.152:0/2889614640 learned_addr learned my addr 172.21.15.152:0/2889614640 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:20.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcad13d3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e53c940 0x55d01e53a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcacbfff640 1 -- 172.21.15.152:0/2889614640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e53c940 msgr2=0x55d01e53a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcacbfff640 1 --2- 172.21.15.152:0/2889614640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e53c940 0x55d01e53a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcacbfff640 1 -- 172.21.15.152:0/2889614640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 msgr2=0x55d01e5396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcacbfff640 1 --2- 172.21.15.152:0/2889614640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e5396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.918+0000 7fcacbfff640 1 -- 172.21.15.152:0/2889614640 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d01e548a70 con 0x55d01e532080 2024-09-11T22:10:20.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.919+0000 7fcacbfff640 1 --2- 172.21.15.152:0/2889614640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e532080 0x55d01e539c30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcab8005fd0 tx=0x7fcab8004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98b31f4ecccee203 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.919+0000 7fcaabfff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:10:20.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.919+0000 7fcaabfff640 1 -- 172.21.15.152:0/2889614640 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab801e680 con 0x55d01e532080 2024-09-11T22:10:20.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.919+0000 7fcaabfff640 1 -- 172.21.15.152:0/2889614640 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcab801e820 con 0x55d01e532080 2024-09-11T22:10:20.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.919+0000 7fcad520f740 1 -- 172.21.15.152:0/2889614640 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcab8005500 con 0x55d01e532080 2024-09-11T22:10:20.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.920+0000 7fcaabfff640 1 -- 172.21.15.152:0/2889614640 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcab801ea20 con 0x55d01e532080 2024-09-11T22:10:20.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.920+0000 7fcad520f740 10 client.26300 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:20.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.920+0000 7fcad520f740 1 -- 172.21.15.152:0/2889614640 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d01e54b360 con 0x55d01e532080 2024-09-11T22:10:20.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.920+0000 7fcaabfff640 1 -- 172.21.15.152:0/2889614640 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcab8005500 con 0x55d01e532080 2024-09-11T22:10:20.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.921+0000 7fcaabfff640 1 -- 172.21.15.152:0/2889614640 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fcab8032ad0 con 0x55d01e532080 2024-09-11T22:10:20.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.921+0000 7fcad520f740 10 client.26300 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:20.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.921+0000 7fcad520f740 10 client.26300 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:10:20.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.921+0000 7fcad520f740 20 client.26300 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:20.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.921+0000 7fcad520f740 1 --2- 172.21.15.152:0/2889614640 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d01e54c770 0x55d01e54eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.921+0000 7fcad520f740 4 client.26300 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:20.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.921+0000 7fcad520f740 1 -- 172.21.15.152:0/2889614640 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d01e4a49d0 con 0x55d01e54c770 2024-09-11T22:10:20.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.921+0000 7fcad0bd2640 1 --2- 172.21.15.152:0/2889614640 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d01e54c770 0x55d01e54eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.921+0000 7fcaabfff640 10 client.26300 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:20.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.921+0000 7fcad0bd2640 1 --2- 172.21.15.152:0/2889614640 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d01e54c770 0x55d01e54eb60 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1545188a81bd22a server_cookie=867cb247af4874a9 in_seq=0 out_seq=0 2024-09-11T22:10:20.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.922+0000 7fcaabfff640 1 -- 172.21.15.152:0/2889614640 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d01e4a49d0 con 0x55d01e54c770 2024-09-11T22:10:20.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.922+0000 7fcaabfff640 10 client.26300 handle_command_reply: tid=0 2024-09-11T22:10:20.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.922+0000 7fcad520f740 1 client.26300 shutdown 2024-09-11T22:10:20.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcad520f740 1 -- 172.21.15.152:0/2889614640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e532080 msgr2=0x55d01e539c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcad520f740 1 --2- 172.21.15.152:0/2889614640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e532080 0x55d01e539c30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcab8005fd0 tx=0x7fcab8004f90 comp rx=0 tx=0).stop 2024-09-11T22:10:20.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcad520f740 1 -- 172.21.15.152:0/2889614640 shutdown_connections 2024-09-11T22:10:20.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcad520f740 1 --2- 172.21.15.152:0/2889614640 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d01e54c770 0x55d01e54eb60 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcad520f740 1 --2- 172.21.15.152:0/2889614640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e53c940 0x55d01e53a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcad520f740 1 --2- 172.21.15.152:0/2889614640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e532080 0x55d01e539c30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcad520f740 1 --2- 172.21.15.152:0/2889614640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e5396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcaabfff640 0 client.26300 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:20.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcad520f740 1 -- 172.21.15.152:0/2889614640 >> 172.21.15.152:0/2889614640 conn(0x55d01e52dcf0 msgr2=0x55d01e533a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:20.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcad520f740 1 -- 172.21.15.152:0/2889614640 shutdown_connections 2024-09-11T22:10:20.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcad520f740 1 -- 172.21.15.152:0/2889614640 wait complete. 2024-09-11T22:10:20.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.924+0000 7fcad520f740 20 client.26300 trim_cache size 0 max 16384 2024-09-11T22:10:20.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.950+0000 7fcad520f740 1 Processor -- start 2024-09-11T22:10:20.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad520f740 1 -- start start 2024-09-11T22:10:20.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad520f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e539fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad520f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e532080 0x55d01e5339d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad520f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 0x55d01e5542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad520f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1ae030 con 0x55d01e531760 2024-09-11T22:10:20.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad520f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1ab900 con 0x55d01e53c940 2024-09-11T22:10:20.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad520f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1a9750 con 0x55d01e532080 2024-09-11T22:10:20.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad13d3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 0x55d01e5542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad13d3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 0x55d01e5542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:42038/0 (socket says 172.21.15.152:42038) 2024-09-11T22:10:20.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad13d3640 1 -- 172.21.15.152:0/1691031046 learned_addr learned my addr 172.21.15.152:0/1691031046 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:20.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad0bd2640 1 --2- 172.21.15.152:0/1691031046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e539fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad13d3640 1 -- 172.21.15.152:0/1691031046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e532080 msgr2=0x55d01e5339d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad13d3640 1 --2- 172.21.15.152:0/1691031046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e532080 0x55d01e5339d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad13d3640 1 -- 172.21.15.152:0/1691031046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 msgr2=0x55d01e539fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad13d3640 1 --2- 172.21.15.152:0/1691031046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e539fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.951+0000 7fcad13d3640 1 -- 172.21.15.152:0/1691031046 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01e52db20 con 0x55d01e53c940 2024-09-11T22:10:20.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.952+0000 7fcad13d3640 1 --2- 172.21.15.152:0/1691031046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 0x55d01e5542a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcac400c760 tx=0x7fcac409f9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0ceef39803e55ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.952+0000 7fcab67fc640 1 -- 172.21.15.152:0/1691031046 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40a4360 con 0x55d01e53c940 2024-09-11T22:10:20.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.952+0000 7fcab67fc640 1 -- 172.21.15.152:0/1691031046 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac40a8c20 con 0x55d01e53c940 2024-09-11T22:10:20.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.952+0000 7fcab67fc640 1 -- 172.21.15.152:0/1691031046 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40d1350 con 0x55d01e53c940 2024-09-11T22:10:20.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.953+0000 7fcad520f740 1 -- 172.21.15.152:0/1691031046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 msgr2=0x55d01e5542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:20.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.953+0000 7fcad520f740 1 --2- 172.21.15.152:0/1691031046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 0x55d01e5542a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcac400c760 tx=0x7fcac409f9d0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.953+0000 7fcad520f740 1 -- 172.21.15.152:0/1691031046 shutdown_connections 2024-09-11T22:10:20.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.953+0000 7fcad520f740 1 --2- 172.21.15.152:0/1691031046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e53c940 0x55d01e5542a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.953+0000 7fcad520f740 1 --2- 172.21.15.152:0/1691031046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e532080 0x55d01e5339d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.953+0000 7fcad520f740 1 --2- 172.21.15.152:0/1691031046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e531760 0x55d01e539fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.953+0000 7fcad520f740 1 -- 172.21.15.152:0/1691031046 >> 172.21.15.152:0/1691031046 conn(0x55d01e52dcf0 msgr2=0x55d01e53b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.954+0000 7fcad520f740 1 -- 172.21.15.152:0/1691031046 shutdown_connections 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.954+0000 7fcad520f740 1 -- 172.21.15.152:0/1691031046 wait complete. 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.954+0000 7fcad520f740 1 -- start start 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.955+0000 7fcad520f740 1 Processor -- start 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.955+0000 7fcad520f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e531760 0x55d01e5449d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.955+0000 7fcad520f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e532080 0x55d01e544f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.955+0000 7fcad520f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e53c940 0x55d01e53dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.955+0000 7fcad520f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1a9dc0 con 0x55d01e53c940 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.955+0000 7fcad520f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1ab230 con 0x55d01e532080 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.955+0000 7fcad520f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1aa490 con 0x55d01e531760 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.955+0000 7fcad520f740 10 client.0 _ll_register_callbacks cb 0x7fcab8009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:20.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.955+0000 7fcad0bd2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e531760 0x55d01e5449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.955+0000 7fcacbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e532080 0x55d01e544f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.955+0000 7fcad0bd2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e531760 0x55d01e5449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:35050/0 (socket says 172.21.15.152:35050) 2024-09-11T22:10:20.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcad13d3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e53c940 0x55d01e53dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcad0bd2640 1 -- 172.21.15.152:0/3958721637 learned_addr learned my addr 172.21.15.152:0/3958721637 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:20.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcad0bd2640 1 -- 172.21.15.152:0/3958721637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e532080 msgr2=0x55d01e544f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcad0bd2640 1 --2- 172.21.15.152:0/3958721637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e532080 0x55d01e544f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcad0bd2640 1 -- 172.21.15.152:0/3958721637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e53c940 msgr2=0x55d01e53dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:20.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcad0bd2640 1 --2- 172.21.15.152:0/3958721637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e53c940 0x55d01e53dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:20.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcad0bd2640 1 -- 172.21.15.152:0/3958721637 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d01e529260 con 0x55d01e531760 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcad0bd2640 1 --2- 172.21.15.152:0/3958721637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e531760 0x55d01e5449d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005e00 tx=0x7fcac002a3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73359bdebc43e9e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcaabfff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcaabfff640 1 -- 172.21.15.152:0/3958721637 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0005510 con 0x55d01e531760 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcaabfff640 1 -- 172.21.15.152:0/3958721637 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcac00046c0 con 0x55d01e531760 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.956+0000 7fcad520f740 1 -- 172.21.15.152:0/3958721637 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcac40a8c20 con 0x55d01e531760 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.957+0000 7fcaabfff640 1 -- 172.21.15.152:0/3958721637 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcac0061050 con 0x55d01e531760 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.957+0000 7fcad520f740 10 client.26461 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.957+0000 7fcad520f740 1 -- 172.21.15.152:0/3958721637 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d01e52e980 con 0x55d01e531760 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.957+0000 7fcaabfff640 1 -- 172.21.15.152:0/3958721637 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac40a8c20 con 0x55d01e531760 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.958+0000 7fcaabfff640 1 -- 172.21.15.152:0/3958721637 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fcac002fa20 con 0x55d01e531760 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.958+0000 7fcad520f740 10 client.26461 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.958+0000 7fcad520f740 10 client.26461 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:10:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.958+0000 7fcad520f740 20 client.26461 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:20.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.958+0000 7fcad520f740 1 --2- 172.21.15.152:0/3958721637 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d01e5c03d0 0x55d01e5c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:20.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.958+0000 7fcad520f740 4 client.26461 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.1, "await_for": 45.0}] 2024-09-11T22:10:20.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.958+0000 7fcad520f740 1 -- 172.21.15.152:0/3958721637 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.1, "await_for": 45.0}) -- 0x55d01e49ed20 con 0x55d01e5c03d0 2024-09-11T22:10:20.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.958+0000 7fcacbfff640 1 --2- 172.21.15.152:0/3958721637 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d01e5c03d0 0x55d01e5c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:20.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.959+0000 7fcaabfff640 10 client.26461 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:20.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:20.959+0000 7fcacbfff640 1 --2- 172.21.15.152:0/3958721637 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d01e5c03d0 0x55d01e5c27f0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77fb15afaaaf1831 server_cookie=c0b907286428dfbc in_seq=0 out_seq=0 2024-09-11T22:10:21.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcaabfff640 1 -- 172.21.15.152:0/3958721637 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d01e49ed20 con 0x55d01e5c03d0 2024-09-11T22:10:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcaabfff640 10 client.26461 handle_command_reply: tid=0 2024-09-11T22:10:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 1 client.26461 shutdown 2024-09-11T22:10:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 1 -- 172.21.15.152:0/3958721637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e531760 msgr2=0x55d01e5449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 1 --2- 172.21.15.152:0/3958721637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e531760 0x55d01e5449d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005e00 tx=0x7fcac002a3d0 comp rx=0 tx=0).stop 2024-09-11T22:10:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 1 -- 172.21.15.152:0/3958721637 shutdown_connections 2024-09-11T22:10:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 1 --2- 172.21.15.152:0/3958721637 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d01e5c03d0 0x55d01e5c27f0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 1 --2- 172.21.15.152:0/3958721637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d01e53c940 0x55d01e53dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 1 --2- 172.21.15.152:0/3958721637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d01e532080 0x55d01e544f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 1 --2- 172.21.15.152:0/3958721637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d01e531760 0x55d01e5449d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcaabfff640 0 client.26461 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:21.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 1 -- 172.21.15.152:0/3958721637 >> 172.21.15.152:0/3958721637 conn(0x55d01e52dcf0 msgr2=0x55d01e52ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:21.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 1 -- 172.21.15.152:0/3958721637 shutdown_connections 2024-09-11T22:10:21.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 1 -- 172.21.15.152:0/3958721637 wait complete. 2024-09-11T22:10:21.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.267+0000 7fcad520f740 20 client.26461 trim_cache size 0 max 16384 2024-09-11T22:10:21.270 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:10:21.270 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:10:21.270 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:10:21.270 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 22, 2024-09-11T22:10:21.271 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:10:21.271 INFO:teuthology.orchestra.run.smithi152.stdout: "84ae6d10": { 2024-09-11T22:10:21.271 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 22, 2024-09-11T22:10:21.271 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:10:21.271 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:10:21.271 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:10:21.271 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:10:21.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:10:21.271 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:10:21.271 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 140.1, 2024-09-11T22:10:21.271 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:10:21.272 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:10:21.272 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:10:21.272 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:10:21.272 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:10:21.272 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:10:21.272 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:21.272 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:21.272 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:21.272 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:21.272 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:21.272 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:10:21.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 -- 172.21.15.152:0/1098824116 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcabc0a2ec0 msgr2=0x7fcabc0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:21.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcabc0a2ec0 0x7fcabc0a5380 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55d01e52eb50 tx=0x7fcac00058b0 comp rx=0 tx=0).stop 2024-09-11T22:10:21.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 -- 172.21.15.152:0/1098824116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcacc10c160 msgr2=0x7fcacc19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:21.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcacc10c160 0x7fcacc19ccf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009fd0 tx=0x7fcac400ef10 comp rx=0 tx=0).stop 2024-09-11T22:10:21.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 -- 172.21.15.152:0/1098824116 shutdown_connections 2024-09-11T22:10:21.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcabc0a2ec0 0x7fcabc0a5380 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:21.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcacc10c160 0x7fcacc19ccf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:21.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc103650 0x7fcacc198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:21.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 --2- 172.21.15.152:0/1098824116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcacc102d30 0x7fcacc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:21.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 -- 172.21.15.152:0/1098824116 >> 172.21.15.152:0/1098824116 conn(0x7fcacc0fc790 msgr2=0x7fcacc0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:21.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 -- 172.21.15.152:0/1098824116 shutdown_connections 2024-09-11T22:10:21.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:21.268+0000 7fcad2e36640 1 -- 172.21.15.152:0/1098824116 wait complete. 2024-09-11T22:10:21.342 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:10:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:21 smithi179 ceph-mon[35603]: pgmap v185: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.7 MiB/s wr, 776 op/s 2024-09-11T22:10:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:21 smithi193 ceph-mon[35545]: pgmap v185: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.7 MiB/s wr, 776 op/s 2024-09-11T22:10:21.867 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:21 smithi152 ceph-mon[31188]: pgmap v185: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.7 MiB/s wr, 776 op/s 2024-09-11T22:10:21.894 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '84ae6d10', quiesce took 6.5 seconds. Will release after: 13.600000000000001 2024-09-11T22:10:22.020 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:22.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.509+0000 7fec97dca640 1 -- 172.21.15.152:0/4013809478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec90106a80 msgr2=0x7fec90106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:22.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.509+0000 7fec97dca640 1 --2- 172.21.15.152:0/4013809478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec90106a80 0x7fec90106e60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009930 tx=0x7fec8c02a420 comp rx=0 tx=0).stop 2024-09-11T22:10:22.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.509+0000 7fec97dca640 1 -- 172.21.15.152:0/4013809478 shutdown_connections 2024-09-11T22:10:22.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.509+0000 7fec97dca640 1 --2- 172.21.15.152:0/4013809478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec90101420 0x7fec9010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.509+0000 7fec97dca640 1 --2- 172.21.15.152:0/4013809478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec90100a80 0x7fec90100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.509+0000 7fec97dca640 1 --2- 172.21.15.152:0/4013809478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec90106a80 0x7fec90106e60 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.509+0000 7fec97dca640 1 -- 172.21.15.152:0/4013809478 >> 172.21.15.152:0/4013809478 conn(0x7fec900fc7a0 msgr2=0x7fec900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:22.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.509+0000 7fec97dca640 1 -- 172.21.15.152:0/4013809478 shutdown_connections 2024-09-11T22:10:22.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.509+0000 7fec97dca640 1 -- 172.21.15.152:0/4013809478 wait complete. 2024-09-11T22:10:22.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec97dca640 1 Processor -- start 2024-09-11T22:10:22.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec97dca640 1 -- start start 2024-09-11T22:10:22.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec97dca640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec90100a80 0x7fec900fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec97dca640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec90101420 0x7fec900fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec97dca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec90106a80 0x7fec900fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec97dca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec90110e80 con 0x7fec90106a80 2024-09-11T22:10:22.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec97dca640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec90110d00 con 0x7fec90101420 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec97dca640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fec90111000 con 0x7fec90100a80 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec96367640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec90106a80 0x7fec900fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec96367640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec90106a80 0x7fec900fd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48446/0 (socket says 172.21.15.152:48446) 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec96367640 1 -- 172.21.15.152:0/3932572657 learned_addr learned my addr 172.21.15.152:0/3932572657 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec95b66640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec90100a80 0x7fec900fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.510+0000 7fec95365640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec90101420 0x7fec900fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.511+0000 7fec96367640 1 -- 172.21.15.152:0/3932572657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec90100a80 msgr2=0x7fec900fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.511+0000 7fec96367640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec90100a80 0x7fec900fcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.511+0000 7fec96367640 1 -- 172.21.15.152:0/3932572657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec90101420 msgr2=0x7fec900fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.511+0000 7fec96367640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec90101420 0x7fec900fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.511+0000 7fec96367640 1 -- 172.21.15.152:0/3932572657 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec901a6930 con 0x7fec90106a80 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.511+0000 7fec96367640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec90106a80 0x7fec900fd7c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fec8800cad0 tx=0x7fec8800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:22.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.511+0000 7fec86ffd640 1 -- 172.21.15.152:0/3932572657 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8800ae20 con 0x7fec90106a80 2024-09-11T22:10:22.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.511+0000 7fec97dca640 1 -- 172.21.15.152:0/3932572657 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec901a6c20 con 0x7fec90106a80 2024-09-11T22:10:22.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.511+0000 7fec86ffd640 1 -- 172.21.15.152:0/3932572657 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec88005020 con 0x7fec90106a80 2024-09-11T22:10:22.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.511+0000 7fec86ffd640 1 -- 172.21.15.152:0/3932572657 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8800f6f0 con 0x7fec90106a80 2024-09-11T22:10:22.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.511+0000 7fec97dca640 1 -- 172.21.15.152:0/3932572657 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec901a71b0 con 0x7fec90106a80 2024-09-11T22:10:22.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.513+0000 7fec86ffd640 1 -- 172.21.15.152:0/3932572657 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fec880051d0 con 0x7fec90106a80 2024-09-11T22:10:22.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.514+0000 7fec9a1a3740 1 Processor -- start 2024-09-11T22:10:22.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.514+0000 7fec9a1a3740 1 -- start start 2024-09-11T22:10:22.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.514+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab51d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.514+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab51da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.514+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab52a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.514+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5591ab4832f0 con 0x5591ab51d5d0 2024-09-11T22:10:22.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.514+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5591ab42acf0 con 0x5591ab528370 2024-09-11T22:10:22.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.514+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5591ab47f2b0 con 0x5591ab51eb40 2024-09-11T22:10:22.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95b66640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab51da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95b66640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab51da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48462/0 (socket says 172.21.15.152:48462) 2024-09-11T22:10:22.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95b66640 1 -- 172.21.15.152:0/1265245859 learned_addr learned my addr 172.21.15.152:0/1265245859 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec86ffd640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec7c0a2d70 0x7fec7c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95365640 1 --2- 172.21.15.152:0/1265245859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab52a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95365640 1 --2- 172.21.15.152:0/1265245859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab51d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec96367640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec7c0a2d70 0x7fec7c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95b66640 1 -- 172.21.15.152:0/1265245859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 msgr2=0x5591ab51d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95b66640 1 --2- 172.21.15.152:0/1265245859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab51d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95b66640 1 -- 172.21.15.152:0/1265245859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 msgr2=0x5591ab52a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95b66640 1 --2- 172.21.15.152:0/1265245859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab52a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec86ffd640 1 -- 172.21.15.152:0/3932572657 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fec880cf7f0 con 0x7fec90106a80 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95b66640 1 -- 172.21.15.152:0/1265245859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591ab40f3a0 con 0x5591ab51d5d0 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95365640 1 --2- 172.21.15.152:0/1265245859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab51d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec95b66640 1 --2- 172.21.15.152:0/1265245859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab51da10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fec8c005ab0 tx=0x7fec8c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18c3a6b74715d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:22.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec96367640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec7c0a2d70 0x7fec7c0a5230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec88098650 tx=0x7fec8806dc40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec7bfff640 1 -- 172.21.15.152:0/1265245859 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c03f070 con 0x5591ab51d5d0 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec7bfff640 1 -- 172.21.15.152:0/1265245859 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8c031a20 con 0x5591ab51d5d0 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.515+0000 7fec7bfff640 1 -- 172.21.15.152:0/1265245859 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c035070 con 0x5591ab51d5d0 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.516+0000 7fec9a1a3740 1 -- 172.21.15.152:0/1265245859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 msgr2=0x5591ab51da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.516+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/1265245859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab51da10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fec8c005ab0 tx=0x7fec8c031630 comp rx=0 tx=0).stop 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.516+0000 7fec9a1a3740 1 -- 172.21.15.152:0/1265245859 shutdown_connections 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.516+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/1265245859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab52a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.516+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/1265245859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab51da10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.516+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/1265245859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab51d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.516+0000 7fec9a1a3740 1 -- 172.21.15.152:0/1265245859 >> 172.21.15.152:0/1265245859 conn(0x5591ab4e6310 msgr2=0x5591ab519c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.516+0000 7fec9a1a3740 1 -- 172.21.15.152:0/1265245859 shutdown_connections 2024-09-11T22:10:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.516+0000 7fec9a1a3740 1 -- 172.21.15.152:0/1265245859 wait complete. 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec9a1a3740 1 -- start start 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec9a1a3740 1 Processor -- start 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab527cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab524f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab5254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5591ab52b010 con 0x5591ab51d5d0 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5591ab43e060 con 0x5591ab528370 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5591ab52b190 con 0x5591ab51eb40 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec9a1a3740 10 client.0 _ll_register_callbacks cb 0x5591ab1918c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec95365640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab527cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec95365640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab527cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48466/0 (socket says 172.21.15.152:48466) 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.517+0000 7fec95365640 1 -- 172.21.15.152:0/2935936721 learned_addr learned my addr 172.21.15.152:0/2935936721 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:22.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec95b66640 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab524f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec95365640 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab5254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec95365640 1 -- 172.21.15.152:0/2935936721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 msgr2=0x5591ab524f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec95365640 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab524f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec95365640 1 -- 172.21.15.152:0/2935936721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 msgr2=0x5591ab5254d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec95365640 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab5254d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec95365640 1 -- 172.21.15.152:0/2935936721 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591ab1f43c0 con 0x5591ab51d5d0 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec95365640 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab527cc0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fec8000e400 tx=0x7fec80015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e83907684f5bce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec797fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec797fa640 1 -- 172.21.15.152:0/2935936721 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8000f7d0 con 0x5591ab51d5d0 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec797fa640 1 -- 172.21.15.152:0/2935936721 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fec8000f970 con 0x5591ab51d5d0 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec9a1a3740 1 -- 172.21.15.152:0/2935936721 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec8c031a20 con 0x5591ab51d5d0 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec797fa640 1 -- 172.21.15.152:0/2935936721 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fec80026050 con 0x5591ab51d5d0 2024-09-11T22:10:22.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec9a1a3740 10 client.16875 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:22.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec9a1a3740 1 -- 172.21.15.152:0/2935936721 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5591ab536ae0 con 0x5591ab51d5d0 2024-09-11T22:10:22.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.518+0000 7fec797fa640 1 -- 172.21.15.152:0/2935936721 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8c031a20 con 0x5591ab51d5d0 2024-09-11T22:10:22.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.519+0000 7fec797fa640 1 -- 172.21.15.152:0/2935936721 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fec8001ebd0 con 0x5591ab51d5d0 2024-09-11T22:10:22.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.519+0000 7fec9a1a3740 10 client.16875 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:22.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.519+0000 7fec9a1a3740 10 client.16875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:22.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.519+0000 7fec9a1a3740 20 client.16875 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:22.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.519+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591ab537ef0 0x5591ab53a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.519+0000 7fec9a1a3740 4 client.16875 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:22.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.519+0000 7fec9a1a3740 1 -- 172.21.15.152:0/2935936721 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591ab490860 con 0x5591ab537ef0 2024-09-11T22:10:22.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.519+0000 7fec95b66640 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591ab537ef0 0x5591ab53a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.519+0000 7fec797fa640 10 client.16875 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:22.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.519+0000 7fec95b66640 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591ab537ef0 0x5591ab53a2e0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d5735bf5bb850ab server_cookie=73a34f4dfee3f3 in_seq=0 out_seq=0 2024-09-11T22:10:22.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec797fa640 1 -- 172.21.15.152:0/2935936721 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591ab490860 con 0x5591ab537ef0 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec797fa640 10 client.16875 handle_command_reply: tid=0 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec9a1a3740 1 client.16875 shutdown 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec9a1a3740 1 -- 172.21.15.152:0/2935936721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 msgr2=0x5591ab527cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab527cc0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fec8000e400 tx=0x7fec80015040 comp rx=0 tx=0).stop 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec9a1a3740 1 -- 172.21.15.152:0/2935936721 shutdown_connections 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591ab537ef0 0x5591ab53a2e0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab5254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab524f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec797fa640 0 client.16875 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/2935936721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab527cc0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec9a1a3740 1 -- 172.21.15.152:0/2935936721 >> 172.21.15.152:0/2935936721 conn(0x5591ab4e6310 msgr2=0x5591ab51f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec9a1a3740 1 -- 172.21.15.152:0/2935936721 shutdown_connections 2024-09-11T22:10:22.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.520+0000 7fec9a1a3740 1 -- 172.21.15.152:0/2935936721 wait complete. 2024-09-11T22:10:22.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.521+0000 7fec9a1a3740 20 client.16875 trim_cache size 0 max 16384 2024-09-11T22:10:22.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.533+0000 7fec9a1a3740 1 Processor -- start 2024-09-11T22:10:22.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.533+0000 7fec9a1a3740 1 -- start start 2024-09-11T22:10:22.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab523ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab534310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab518bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec901b23b0 con 0x5591ab51d5d0 2024-09-11T22:10:22.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec901afc80 con 0x5591ab528370 2024-09-11T22:10:22.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fec901adad0 con 0x5591ab51eb40 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95365640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab523ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95365640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab523ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48482/0 (socket says 172.21.15.152:48482) 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95365640 1 -- 172.21.15.152:0/4166439369 learned_addr learned my addr 172.21.15.152:0/4166439369 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95365640 1 --2- 172.21.15.152:0/4166439369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab518bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95b66640 1 --2- 172.21.15.152:0/4166439369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab534310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95365640 1 -- 172.21.15.152:0/4166439369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 msgr2=0x5591ab534310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95365640 1 --2- 172.21.15.152:0/4166439369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab534310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95365640 1 -- 172.21.15.152:0/4166439369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 msgr2=0x5591ab518bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95365640 1 --2- 172.21.15.152:0/4166439369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab518bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95365640 1 -- 172.21.15.152:0/4166439369 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591ab5234e0 con 0x5591ab51d5d0 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95b66640 1 --2- 172.21.15.152:0/4166439369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab534310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:22.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec95365640 1 --2- 172.21.15.152:0/4166439369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab523ed0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fec80014040 tx=0x7fec80005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b4f69c4284233d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:22.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec7b7fe640 1 -- 172.21.15.152:0/4166439369 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec800050d0 con 0x5591ab51d5d0 2024-09-11T22:10:22.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec7b7fe640 1 -- 172.21.15.152:0/4166439369 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8001d8a0 con 0x5591ab51d5d0 2024-09-11T22:10:22.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.534+0000 7fec7b7fe640 1 -- 172.21.15.152:0/4166439369 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8000f830 con 0x5591ab51d5d0 2024-09-11T22:10:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.535+0000 7fec9a1a3740 1 -- 172.21.15.152:0/4166439369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 msgr2=0x5591ab523ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.535+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/4166439369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab523ed0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fec80014040 tx=0x7fec80005b50 comp rx=0 tx=0).stop 2024-09-11T22:10:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.535+0000 7fec9a1a3740 1 -- 172.21.15.152:0/4166439369 shutdown_connections 2024-09-11T22:10:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.535+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/4166439369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab528370 0x5591ab518bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.535+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/4166439369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab51eb40 0x5591ab534310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.535+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/4166439369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51d5d0 0x5591ab523ed0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.535+0000 7fec9a1a3740 1 -- 172.21.15.152:0/4166439369 >> 172.21.15.152:0/4166439369 conn(0x5591ab4e6310 msgr2=0x5591ab5184e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.535+0000 7fec9a1a3740 1 -- 172.21.15.152:0/4166439369 shutdown_connections 2024-09-11T22:10:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.535+0000 7fec9a1a3740 1 -- 172.21.15.152:0/4166439369 wait complete. 2024-09-11T22:10:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.535+0000 7fec9a1a3740 1 -- start start 2024-09-11T22:10:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.535+0000 7fec9a1a3740 1 Processor -- start 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab51d5d0 0x5591ab522150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51eb40 0x5591ab522690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec9a1a3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab528370 0x5591ab522bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec901ae140 con 0x5591ab51eb40 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec901af5b0 con 0x5591ab51d5d0 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec9a1a3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fec901ae810 con 0x5591ab528370 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec9a1a3740 10 client.0 _ll_register_callbacks cb 0x7fec8000e350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec95b66640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51eb40 0x5591ab522690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec95b66640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51eb40 0x5591ab522690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48490/0 (socket says 172.21.15.152:48490) 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec95b66640 1 -- 172.21.15.152:0/3237669596 learned_addr learned my addr 172.21.15.152:0/3237669596 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec95365640 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab51d5d0 0x5591ab522150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec95365640 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab528370 0x5591ab522bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec95b66640 1 -- 172.21.15.152:0/3237669596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab528370 msgr2=0x5591ab522bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec95b66640 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab528370 0x5591ab522bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec95b66640 1 -- 172.21.15.152:0/3237669596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab51d5d0 msgr2=0x5591ab522150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec95b66640 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab51d5d0 0x5591ab522150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec95b66640 1 -- 172.21.15.152:0/3237669596 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591ab5a1ce0 con 0x5591ab51eb40 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.536+0000 7fec95b66640 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51eb40 0x5591ab522690 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fec8c006010 tx=0x7fec8c031720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e6fda2e891086b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec797fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec797fa640 1 -- 172.21.15.152:0/3237669596 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c035040 con 0x5591ab51eb40 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec797fa640 1 -- 172.21.15.152:0/3237669596 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fec8c031a20 con 0x5591ab51eb40 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec9a1a3740 1 -- 172.21.15.152:0/3237669596 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec8001d8a0 con 0x5591ab51eb40 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec797fa640 1 -- 172.21.15.152:0/3237669596 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fec8c03f040 con 0x5591ab51eb40 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec9a1a3740 10 client.16881 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec9a1a3740 1 -- 172.21.15.152:0/3237669596 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5591ab5a2f30 con 0x5591ab51eb40 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec797fa640 1 -- 172.21.15.152:0/3237669596 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8001d8a0 con 0x5591ab51eb40 2024-09-11T22:10:22.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec797fa640 1 -- 172.21.15.152:0/3237669596 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fec8c03b5d0 con 0x5591ab51eb40 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec9a1a3740 10 client.16881 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec9a1a3740 10 client.16881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec9a1a3740 20 client.16881 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591ab5a3230 0x5591ab5a5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec9a1a3740 4 client.16881 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.537+0000 7fec9a1a3740 1 -- 172.21.15.152:0/3237669596 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5591ab48ad70 con 0x5591ab5a3230 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec95365640 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591ab5a3230 0x5591ab5a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec95365640 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591ab5a3230 0x5591ab5a5650 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74498242bae9afe5 server_cookie=a1eab8c9ea6b3a05 in_seq=0 out_seq=0 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec797fa640 10 client.16881 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec797fa640 1 -- 172.21.15.152:0/3237669596 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5591ab48ad70 con 0x5591ab5a3230 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec797fa640 10 client.16881 handle_command_reply: tid=0 2024-09-11T22:10:22.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec9a1a3740 1 client.16881 shutdown 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec9a1a3740 1 -- 172.21.15.152:0/3237669596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51eb40 msgr2=0x5591ab522690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51eb40 0x5591ab522690 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fec8c006010 tx=0x7fec8c031720 comp rx=0 tx=0).stop 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec9a1a3740 1 -- 172.21.15.152:0/3237669596 shutdown_connections 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5591ab5a3230 0x5591ab5a5650 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5591ab528370 0x5591ab522bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5591ab51eb40 0x5591ab522690 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec797fa640 0 client.16881 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.538+0000 7fec9a1a3740 1 --2- 172.21.15.152:0/3237669596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591ab51d5d0 0x5591ab522150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec9a1a3740 1 -- 172.21.15.152:0/3237669596 >> 172.21.15.152:0/3237669596 conn(0x5591ab4e6310 msgr2=0x5591ab518d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec9a1a3740 1 -- 172.21.15.152:0/3237669596 shutdown_connections 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec9a1a3740 1 -- 172.21.15.152:0/3237669596 wait complete. 2024-09-11T22:10:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec9a1a3740 20 client.16881 trim_cache size 0 max 16384 2024-09-11T22:10:22.546 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:10:22.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 -- 172.21.15.152:0/3932572657 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec7c0a2d70 msgr2=0x7fec7c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:22.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec7c0a2d70 0x7fec7c0a5230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec88098650 tx=0x7fec8806dc40 comp rx=0 tx=0).stop 2024-09-11T22:10:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 -- 172.21.15.152:0/3932572657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec90106a80 msgr2=0x7fec900fd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec90106a80 0x7fec900fd7c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fec8800cad0 tx=0x7fec8800cf90 comp rx=0 tx=0).stop 2024-09-11T22:10:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 -- 172.21.15.152:0/3932572657 shutdown_connections 2024-09-11T22:10:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fec7c0a2d70 0x7fec7c0a5230 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec90106a80 0x7fec900fd7c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec90101420 0x7fec900fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 --2- 172.21.15.152:0/3932572657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec90100a80 0x7fec900fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 -- 172.21.15.152:0/3932572657 >> 172.21.15.152:0/3932572657 conn(0x7fec900fc7a0 msgr2=0x7fec9006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 -- 172.21.15.152:0/3932572657 shutdown_connections 2024-09-11T22:10:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:22.539+0000 7fec97dca640 1 -- 172.21.15.152:0/3932572657 wait complete. 2024-09-11T22:10:23.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:23 smithi179 ceph-mon[35603]: pgmap v186: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 962 op/s 2024-09-11T22:10:23.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:23 smithi193 ceph-mon[35545]: pgmap v186: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 962 op/s 2024-09-11T22:10:23.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:23 smithi152 ceph-mon[31188]: pgmap v186: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 962 op/s 2024-09-11T22:10:24.211 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:10:24.211 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:10:24.472 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 290.0 s, 1137.5 tps, lat 20.596 ms stddev 20.686 2024-09-11T22:10:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.960+0000 7f93a0d28640 1 -- 172.21.15.152:0/1839439127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f939c1027a0 msgr2=0x7f939c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.960+0000 7f93a0d28640 1 --2- 172.21.15.152:0/1839439127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f939c1027a0 0x7f939c1067f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9384009900 tx=0x7f938402a410 comp rx=0 tx=0).stop 2024-09-11T22:10:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.960+0000 7f93a0d28640 1 -- 172.21.15.152:0/1839439127 shutdown_connections 2024-09-11T22:10:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.960+0000 7f93a0d28640 1 --2- 172.21.15.152:0/1839439127 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f939c106f20 0x7f939c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.960+0000 7f93a0d28640 1 --2- 172.21.15.152:0/1839439127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f939c1027a0 0x7f939c1067f0 secure :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9384009900 tx=0x7f938402a410 comp rx=0 tx=0).stop 2024-09-11T22:10:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.960+0000 7f93a0d28640 1 --2- 172.21.15.152:0/1839439127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f939c101df0 0x7f939c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.960+0000 7f93a0d28640 1 -- 172.21.15.152:0/1839439127 >> 172.21.15.152:0/1839439127 conn(0x7f939c0fd8b0 msgr2=0x7f939c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.961+0000 7f93a0d28640 1 -- 172.21.15.152:0/1839439127 shutdown_connections 2024-09-11T22:10:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.961+0000 7f93a0d28640 1 -- 172.21.15.152:0/1839439127 wait complete. 2024-09-11T22:10:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f93a0d28640 1 Processor -- start 2024-09-11T22:10:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f93a0d28640 1 -- start start 2024-09-11T22:10:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f93a0d28640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f939c101df0 0x7f939c1a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f93a0d28640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f939c106f20 0x7f939c1a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f93a0d28640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f939c10de50 0x7f939c10e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f93a0d28640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f939c111f40 con 0x7f939c10de50 2024-09-11T22:10:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f93a0d28640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f939c111dc0 con 0x7f939c106f20 2024-09-11T22:10:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f93a0d28640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f939c1120c0 con 0x7f939c101df0 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f939ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f939c10de50 0x7f939c10e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f939ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f939c10de50 0x7f939c10e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43248/0 (socket says 172.21.15.152:43248) 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f939ad9d640 1 -- 172.21.15.152:0/1366897258 learned_addr learned my addr 172.21.15.152:0/1366897258 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f939a59c640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f939c101df0 0x7f939c1a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f9391d9b640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f939c106f20 0x7f939c1a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f939ad9d640 1 -- 172.21.15.152:0/1366897258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f939c101df0 msgr2=0x7f939c1a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f939ad9d640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f939c101df0 0x7f939c1a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f939ad9d640 1 -- 172.21.15.152:0/1366897258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f939c106f20 msgr2=0x7f939c1a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.962+0000 7f939ad9d640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f939c106f20 0x7f939c1a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.963+0000 7f939ad9d640 1 -- 172.21.15.152:0/1366897258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c10ea30 con 0x7f939c10de50 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.963+0000 7f9391d9b640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f939c106f20 0x7f939c1a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.963+0000 7f939ad9d640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f939c10de50 0x7f939c10e300 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f939400eaa0 tx=0x7f939400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.963+0000 7f9393fff640 1 -- 172.21.15.152:0/1366897258 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939400cdb0 con 0x7f939c10de50 2024-09-11T22:10:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.963+0000 7f9393fff640 1 -- 172.21.15.152:0/1366897258 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9394005020 con 0x7f939c10de50 2024-09-11T22:10:24.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.963+0000 7f93a0d28640 1 -- 172.21.15.152:0/1366897258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939c1a7300 con 0x7f939c10de50 2024-09-11T22:10:24.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.963+0000 7f9393fff640 1 -- 172.21.15.152:0/1366897258 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93940116b0 con 0x7f939c10de50 2024-09-11T22:10:24.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.963+0000 7f93a0d28640 1 -- 172.21.15.152:0/1366897258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939c1a76a0 con 0x7f939c10de50 2024-09-11T22:10:24.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.965+0000 7f9393fff640 1 -- 172.21.15.152:0/1366897258 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9394011850 con 0x7f939c10de50 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.965+0000 7f93a3101740 1 Processor -- start 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f93a3101740 1 -- start start 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f93a3101740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee5b60 0x564afdee5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f93a3101740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee6480 0x564afdef0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f93a3101740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdef3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f93a3101740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564afde4b280 con 0x564afdef0d40 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f93a3101740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564afddf2b10 con 0x564afdee5b60 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f93a3101740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564afde47240 con 0x564afdee6480 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f9391d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdef3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f9391d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdef3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43262/0 (socket says 172.21.15.152:43262) 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f9391d9b640 1 -- 172.21.15.152:0/61458405 learned_addr learned my addr 172.21.15.152:0/61458405 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f939a59c640 1 --2- 172.21.15.152:0/61458405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee6480 0x564afdef0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f9391d9b640 1 --2- 172.21.15.152:0/61458405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee5b60 0x564afdee5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f9393fff640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93880a2cf0 0x7f93880a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f9391d9b640 1 -- 172.21.15.152:0/61458405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee6480 msgr2=0x564afdef0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f9391d9b640 1 --2- 172.21.15.152:0/61458405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee6480 0x564afdef0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f9391d9b640 1 -- 172.21.15.152:0/61458405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee5b60 msgr2=0x564afdee5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f9391d9b640 1 --2- 172.21.15.152:0/61458405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee5b60 0x564afdee5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.966+0000 7f9391d9b640 1 -- 172.21.15.152:0/61458405 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564afddff1f0 con 0x564afdef0d40 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.967+0000 7f939ad9d640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93880a2cf0 0x7f93880a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.967+0000 7f9393fff640 1 -- 172.21.15.152:0/1366897258 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f93940cf6d0 con 0x7f939c10de50 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.967+0000 7f9391d9b640 1 --2- 172.21.15.152:0/61458405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdef3130 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f93840057c0 tx=0x7f9384000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5153afdcd53046e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.967+0000 7f9390d99640 1 -- 172.21.15.152:0/61458405 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384045070 con 0x564afdef0d40 2024-09-11T22:10:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.967+0000 7f9390d99640 1 -- 172.21.15.152:0/61458405 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93840035f0 con 0x564afdef0d40 2024-09-11T22:10:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.967+0000 7f9390d99640 1 -- 172.21.15.152:0/61458405 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384035040 con 0x564afdef0d40 2024-09-11T22:10:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 -- 172.21.15.152:0/61458405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 msgr2=0x564afdef3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f939ad9d640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93880a2cf0 0x7f93880a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9394098590 tx=0x7f939406db80 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 --2- 172.21.15.152:0/61458405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdef3130 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f93840057c0 tx=0x7f9384000bc0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 -- 172.21.15.152:0/61458405 shutdown_connections 2024-09-11T22:10:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 --2- 172.21.15.152:0/61458405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdef3130 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 --2- 172.21.15.152:0/61458405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee6480 0x564afdef0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 --2- 172.21.15.152:0/61458405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee5b60 0x564afdee5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 -- 172.21.15.152:0/61458405 >> 172.21.15.152:0/61458405 conn(0x564afdee20f0 msgr2=0x564afdee24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 -- 172.21.15.152:0/61458405 shutdown_connections 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 -- 172.21.15.152:0/61458405 wait complete. 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 -- start start 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 Processor -- start 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.968+0000 7f93a3101740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee5b60 0x564afdeedbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f93a3101740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee6480 0x564afdeee110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f93a3101740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdef0d40 0x564afdeee650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f93a3101740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564afdef3910 con 0x564afdee6480 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f93a3101740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564afde05f10 con 0x564afdef0d40 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f93a3101740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564afdef3a90 con 0x564afdee5b60 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f93a3101740 10 client.0 _ll_register_callbacks cb 0x564afddcea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f939a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee6480 0x564afdeee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f939a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee6480 0x564afdeee110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43266/0 (socket says 172.21.15.152:43266) 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f939a59c640 1 -- 172.21.15.152:0/2338069938 learned_addr learned my addr 172.21.15.152:0/2338069938 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f9391d9b640 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdef0d40 0x564afdeee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f9391d9b640 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee5b60 0x564afdeedbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f939a59c640 1 -- 172.21.15.152:0/2338069938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee5b60 msgr2=0x564afdeedbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f939a59c640 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee5b60 0x564afdeedbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f939a59c640 1 -- 172.21.15.152:0/2338069938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdef0d40 msgr2=0x564afdeee650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f939a59c640 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdef0d40 0x564afdeee650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f939a59c640 1 -- 172.21.15.152:0/2338069938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564afdbbc6a0 con 0x564afdee6480 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f9391d9b640 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee5b60 0x564afdeedbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f939a59c640 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee6480 0x564afdeee110 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f938c00bf60 tx=0x7f938c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a3418f59bdb4b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f9381ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f9381ffb640 1 -- 172.21.15.152:0/2338069938 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c004230 con 0x564afdee6480 2024-09-11T22:10:24.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f9381ffb640 1 -- 172.21.15.152:0/2338069938 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f938c0043d0 con 0x564afdee6480 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f93a3101740 1 -- 172.21.15.152:0/2338069938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93840035f0 con 0x564afdee6480 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.969+0000 7f9381ffb640 1 -- 172.21.15.152:0/2338069938 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f938c0106a0 con 0x564afdee6480 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.970+0000 7f93a3101740 10 client.16893 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.970+0000 7f93a3101740 1 -- 172.21.15.152:0/2338069938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564afdeff550 con 0x564afdee6480 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.970+0000 7f9381ffb640 1 -- 172.21.15.152:0/2338069938 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93840035f0 con 0x564afdee6480 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.970+0000 7f9381ffb640 1 -- 172.21.15.152:0/2338069938 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f938c019070 con 0x564afdee6480 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.970+0000 7f93a3101740 10 client.16893 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.970+0000 7f93a3101740 10 client.16893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.970+0000 7f93a3101740 20 client.16893 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.970+0000 7f93a3101740 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564afdf00ab0 0x564afdf02ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.970+0000 7f93a3101740 4 client.16893 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.970+0000 7f93a3101740 1 -- 172.21.15.152:0/2338069938 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564afde587f0 con 0x564afdf00ab0 2024-09-11T22:10:24.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.970+0000 7f9391d9b640 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564afdf00ab0 0x564afdf02ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.971+0000 7f9381ffb640 10 client.16893 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.971+0000 7f9391d9b640 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564afdf00ab0 0x564afdf02ef0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e22df597e5f93e6e server_cookie=195f9b05c1f73d6a in_seq=0 out_seq=0 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.971+0000 7f9381ffb640 1 -- 172.21.15.152:0/2338069938 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564afde587f0 con 0x564afdf00ab0 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.971+0000 7f9381ffb640 10 client.16893 handle_command_reply: tid=0 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.971+0000 7f93a3101740 1 client.16893 shutdown 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f93a3101740 1 -- 172.21.15.152:0/2338069938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee6480 msgr2=0x564afdeee110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f93a3101740 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee6480 0x564afdeee110 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f938c00bf60 tx=0x7f938c00bf90 comp rx=0 tx=0).stop 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f93a3101740 1 -- 172.21.15.152:0/2338069938 shutdown_connections 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f93a3101740 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564afdf00ab0 0x564afdf02ef0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f93a3101740 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdef0d40 0x564afdeee650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f93a3101740 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee6480 0x564afdeee110 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f9381ffb640 0 client.16893 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:24.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f93a3101740 1 --2- 172.21.15.152:0/2338069938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee5b60 0x564afdeedbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f93a3101740 1 -- 172.21.15.152:0/2338069938 >> 172.21.15.152:0/2338069938 conn(0x564afdee20f0 msgr2=0x564afdee7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:24.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f93a3101740 1 -- 172.21.15.152:0/2338069938 shutdown_connections 2024-09-11T22:10:24.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f93a3101740 1 -- 172.21.15.152:0/2338069938 wait complete. 2024-09-11T22:10:24.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.972+0000 7f93a3101740 20 client.16893 trim_cache size 0 max 16384 2024-09-11T22:10:24.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f93a3101740 1 Processor -- start 2024-09-11T22:10:24.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f93a3101740 1 -- start start 2024-09-11T22:10:24.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f93a3101740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee5b60 0x564afdee9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f93a3101740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee6480 0x564afdee1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f93a3101740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdf087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f93a3101740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f939c1b2a10 con 0x564afdef0d40 2024-09-11T22:10:24.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f93a3101740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f939c1b02e0 con 0x564afdee5b60 2024-09-11T22:10:24.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f93a3101740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f939c1ae130 con 0x564afdee6480 2024-09-11T22:10:24.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f9391d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdf087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f9391d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdf087c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43272/0 (socket says 172.21.15.152:43272) 2024-09-11T22:10:24.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f9391d9b640 1 -- 172.21.15.152:0/3232720573 learned_addr learned my addr 172.21.15.152:0/3232720573 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:24.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f9391d9b640 1 --2- 172.21.15.152:0/3232720573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee5b60 0x564afdee9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f939a59c640 1 --2- 172.21.15.152:0/3232720573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee6480 0x564afdee1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f9391d9b640 1 -- 172.21.15.152:0/3232720573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee6480 msgr2=0x564afdee1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:24.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f9391d9b640 1 --2- 172.21.15.152:0/3232720573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee6480 0x564afdee1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f9391d9b640 1 -- 172.21.15.152:0/3232720573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee5b60 msgr2=0x564afdee9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:24.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f9391d9b640 1 --2- 172.21.15.152:0/3232720573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee5b60 0x564afdee9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f9391d9b640 1 -- 172.21.15.152:0/3232720573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564afdee1f20 con 0x564afdef0d40 2024-09-11T22:10:24.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f9391d9b640 1 --2- 172.21.15.152:0/3232720573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdf087c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f93840057c0 tx=0x7f9384000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b643bf1c5a639be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:24.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.989+0000 7f9383fff640 1 -- 172.21.15.152:0/3232720573 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384035040 con 0x564afdef0d40 2024-09-11T22:10:24.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f9383fff640 1 -- 172.21.15.152:0/3232720573 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9384031d60 con 0x564afdef0d40 2024-09-11T22:10:24.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f9383fff640 1 -- 172.21.15.152:0/3232720573 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384045040 con 0x564afdef0d40 2024-09-11T22:10:24.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f93a3101740 1 -- 172.21.15.152:0/3232720573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 msgr2=0x564afdf087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:24.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f93a3101740 1 --2- 172.21.15.152:0/3232720573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdf087c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f93840057c0 tx=0x7f9384000bc0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f93a3101740 1 -- 172.21.15.152:0/3232720573 shutdown_connections 2024-09-11T22:10:24.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f93a3101740 1 --2- 172.21.15.152:0/3232720573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdef0d40 0x564afdf087c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f93a3101740 1 --2- 172.21.15.152:0/3232720573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdee6480 0x564afdee1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f93a3101740 1 --2- 172.21.15.152:0/3232720573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee5b60 0x564afdee9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f93a3101740 1 -- 172.21.15.152:0/3232720573 >> 172.21.15.152:0/3232720573 conn(0x564afdee20f0 msgr2=0x564afdee0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f93a3101740 1 -- 172.21.15.152:0/3232720573 shutdown_connections 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f93a3101740 1 -- 172.21.15.152:0/3232720573 wait complete. 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f93a3101740 1 -- start start 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.990+0000 7f93a3101740 1 Processor -- start 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f93a3101740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee5b60 0x564afdef49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f93a3101740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee6480 0x564afdef4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f93a3101740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdef0d40 0x564afdef5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f93a3101740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f939c1ae7a0 con 0x564afdee5b60 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f93a3101740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f939c1afc10 con 0x564afdee6480 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f93a3101740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f939c1aee70 con 0x564afdef0d40 2024-09-11T22:10:24.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f93a3101740 10 client.0 _ll_register_callbacks cb 0x7f938c00b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f9391d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee5b60 0x564afdef49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f9391d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee5b60 0x564afdef49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43276/0 (socket says 172.21.15.152:43276) 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f9391d9b640 1 -- 172.21.15.152:0/3852795267 learned_addr learned my addr 172.21.15.152:0/3852795267 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f939a59c640 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee6480 0x564afdef4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f9391d9b640 1 -- 172.21.15.152:0/3852795267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdef0d40 msgr2=0x564afdef5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f9391d9b640 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdef0d40 0x564afdef5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f9391d9b640 1 -- 172.21.15.152:0/3852795267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee6480 msgr2=0x564afdef4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f9391d9b640 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee6480 0x564afdef4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f9391d9b640 1 -- 172.21.15.152:0/3852795267 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564afdf6a790 con 0x564afdee5b60 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f939a59c640 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee6480 0x564afdef4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f9391d9b640 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee5b60 0x564afdef49e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9384006010 tx=0x7f9384003660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465a92e62f5b773f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:24.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.991+0000 7f9381ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f9381ffb640 1 -- 172.21.15.152:0/3852795267 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384035070 con 0x564afdee5b60 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f9381ffb640 1 -- 172.21.15.152:0/3852795267 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f9384031880 con 0x564afdee5b60 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f93a3101740 1 -- 172.21.15.152:0/3852795267 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9384031d60 con 0x564afdee5b60 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f9381ffb640 1 -- 172.21.15.152:0/3852795267 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9384045030 con 0x564afdee5b60 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f93a3101740 10 client.16899 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f93a3101740 1 -- 172.21.15.152:0/3852795267 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564afdf6ba30 con 0x564afdee5b60 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f9381ffb640 1 -- 172.21.15.152:0/3852795267 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9384031d60 con 0x564afdee5b60 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f9381ffb640 1 -- 172.21.15.152:0/3852795267 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f938403a040 con 0x564afdee5b60 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f93a3101740 10 client.16899 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f93a3101740 10 client.16899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f93a3101740 20 client.16899 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f93a3101740 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564afdf00ab0 0x564afdf6dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f93a3101740 4 client.16899 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.992+0000 7f93a3101740 1 -- 172.21.15.152:0/3852795267 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564afde52d00 con 0x564afdf00ab0 2024-09-11T22:10:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.993+0000 7f939a59c640 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564afdf00ab0 0x564afdf6dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.993+0000 7f939a59c640 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564afdf00ab0 0x564afdf6dd10 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc326c4833ff34b1 server_cookie=530463b7be4d56f1 in_seq=0 out_seq=0 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.993+0000 7f9381ffb640 10 client.16899 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f9381ffb640 1 -- 172.21.15.152:0/3852795267 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564afde52d00 con 0x564afdf00ab0 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f9381ffb640 10 client.16899 handle_command_reply: tid=0 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 1 client.16899 shutdown 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 1 -- 172.21.15.152:0/3852795267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee5b60 msgr2=0x564afdef49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee5b60 0x564afdef49e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9384006010 tx=0x7f9384003660 comp rx=0 tx=0).stop 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 1 -- 172.21.15.152:0/3852795267 shutdown_connections 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564afdf00ab0 0x564afdf6dd10 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564afdef0d40 0x564afdef5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564afdee6480 0x564afdef4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f9381ffb640 0 client.16899 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 1 --2- 172.21.15.152:0/3852795267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564afdee5b60 0x564afdef49e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 1 -- 172.21.15.152:0/3852795267 >> 172.21.15.152:0/3852795267 conn(0x564afdee20f0 msgr2=0x564afdee7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 1 -- 172.21.15.152:0/3852795267 shutdown_connections 2024-09-11T22:10:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 1 -- 172.21.15.152:0/3852795267 wait complete. 2024-09-11T22:10:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.994+0000 7f93a3101740 20 client.16899 trim_cache size 0 max 16384 2024-09-11T22:10:25.001 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:10:25.001 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:10:25.001 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "41d20d28-2787-4739-91f3-ab88e8c99d59", 2024-09-11T22:10:25.001 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:10:25.001 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:10:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 -- 172.21.15.152:0/1366897258 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93880a2cf0 msgr2=0x7f93880a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93880a2cf0 0x7f93880a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9394098590 tx=0x7f939406db80 comp rx=0 tx=0).stop 2024-09-11T22:10:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 -- 172.21.15.152:0/1366897258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f939c10de50 msgr2=0x7f939c10e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f939c10de50 0x7f939c10e300 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f939400eaa0 tx=0x7f939400ef60 comp rx=0 tx=0).stop 2024-09-11T22:10:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 -- 172.21.15.152:0/1366897258 shutdown_connections 2024-09-11T22:10:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f93880a2cf0 0x7f93880a51b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f939c10de50 0x7f939c10e300 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f939c106f20 0x7f939c1a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 --2- 172.21.15.152:0/1366897258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f939c101df0 0x7f939c1a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:25.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 -- 172.21.15.152:0/1366897258 >> 172.21.15.152:0/1366897258 conn(0x7f939c0fd8b0 msgr2=0x7f939c074810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:25.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 -- 172.21.15.152:0/1366897258 shutdown_connections 2024-09-11T22:10:25.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:24.995+0000 7f93a0d28640 1 -- 172.21.15.152:0/1366897258 wait complete. 2024-09-11T22:10:25.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:25 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:10:25.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:25 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:10:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:25 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:10:25.642 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:10:25.890 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:26.268 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:26 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:10:26.268 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:26 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:10:26.268 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:26 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:10:26.268 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:26 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:10:26.268 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:26 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:10:26.268 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:26 smithi152 ceph-mon[31188]: pgmap v187: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 490 op/s 2024-09-11T22:10:26.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.348+0000 7fb7baa40640 1 -- 172.21.15.152:0/2927226744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b4101de0 msgr2=0x7fb7b41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:26.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.348+0000 7fb7baa40640 1 --2- 172.21.15.152:0/2927226744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b4101de0 0x7fb7b41021c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009900 tx=0x7fb7a402a410 comp rx=0 tx=0).stop 2024-09-11T22:10:26.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.348+0000 7fb7baa40640 1 -- 172.21.15.152:0/2927226744 shutdown_connections 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.348+0000 7fb7baa40640 1 --2- 172.21.15.152:0/2927226744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7b4106f10 0x7fb7b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.348+0000 7fb7baa40640 1 --2- 172.21.15.152:0/2927226744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7b4102790 0x7fb7b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.348+0000 7fb7baa40640 1 --2- 172.21.15.152:0/2927226744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b4101de0 0x7fb7b41021c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.348+0000 7fb7baa40640 1 -- 172.21.15.152:0/2927226744 >> 172.21.15.152:0/2927226744 conn(0x7fb7b40fd8c0 msgr2=0x7fb7b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.348+0000 7fb7baa40640 1 -- 172.21.15.152:0/2927226744 shutdown_connections 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.348+0000 7fb7baa40640 1 -- 172.21.15.152:0/2927226744 wait complete. 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.349+0000 7fb7baa40640 1 Processor -- start 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.349+0000 7fb7baa40640 1 -- start start 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.349+0000 7fb7baa40640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7b4101de0 0x7fb7b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.349+0000 7fb7baa40640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7b4102790 0x7fb7b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.349+0000 7fb7baa40640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b4106f10 0x7fb7b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.349+0000 7fb7baa40640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b4111f70 con 0x7fb7b4106f10 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.349+0000 7fb7baa40640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b4111df0 con 0x7fb7b4102790 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.349+0000 7fb7baa40640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b41120f0 con 0x7fb7b4101de0 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.349+0000 7fb7b8fdd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b4106f10 0x7fb7b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.349+0000 7fb7b8fdd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b4106f10 0x7fb7b4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43300/0 (socket says 172.21.15.152:43300) 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.349+0000 7fb7b8fdd640 1 -- 172.21.15.152:0/1559888114 learned_addr learned my addr 172.21.15.152:0/1559888114 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7b4102790 0x7fb7b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7b4101de0 0x7fb7b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7b8fdd640 1 -- 172.21.15.152:0/1559888114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7b4101de0 msgr2=0x7fb7b40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7b8fdd640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7b4101de0 0x7fb7b40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7b8fdd640 1 -- 172.21.15.152:0/1559888114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7b4102790 msgr2=0x7fb7b4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7b8fdd640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7b4102790 0x7fb7b4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7b8fdd640 1 -- 172.21.15.152:0/1559888114 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b41a6990 con 0x7fb7b4106f10 2024-09-11T22:10:26.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7b8fdd640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b4106f10 0x7fb7b4074f70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00eaa0 tx=0x7fb7ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:26.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7b17fa640 1 -- 172.21.15.152:0/1559888114 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac00cdb0 con 0x7fb7b4106f10 2024-09-11T22:10:26.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7b17fa640 1 -- 172.21.15.152:0/1559888114 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7ac005020 con 0x7fb7b4106f10 2024-09-11T22:10:26.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7baa40640 1 -- 172.21.15.152:0/1559888114 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b41a6c80 con 0x7fb7b4106f10 2024-09-11T22:10:26.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7b17fa640 1 -- 172.21.15.152:0/1559888114 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0116b0 con 0x7fb7b4106f10 2024-09-11T22:10:26.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.350+0000 7fb7baa40640 1 -- 172.21.15.152:0/1559888114 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b41a7170 con 0x7fb7b4106f10 2024-09-11T22:10:26.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7b17fa640 1 -- 172.21.15.152:0/1559888114 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb7ac005560 con 0x7fb7b4106f10 2024-09-11T22:10:26.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7bce19740 1 Processor -- start 2024-09-11T22:10:26.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7bce19740 1 -- start start 2024-09-11T22:10:26.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c514880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c514dc0 0x55f31c51f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c51f680 0x55f31c521a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7bce19740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f31c47a2e0 con 0x55f31c5144a0 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7bce19740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f31c421ce0 con 0x55f31c514dc0 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7bce19740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f31c4762a0 con 0x55f31c51f680 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7b37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c514880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7b37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c514880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43308/0 (socket says 172.21.15.152:43308) 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7b37fe640 1 -- 172.21.15.152:0/1265327610 learned_addr learned my addr 172.21.15.152:0/1265327610 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/1265327610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c51f680 0x55f31c521a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.353+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/1265327610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c514dc0 0x55f31c51f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb7b37fe640 1 -- 172.21.15.152:0/1265327610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c51f680 msgr2=0x55f31c521a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:26.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/1265327610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c51f680 0x55f31c521a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb7b37fe640 1 -- 172.21.15.152:0/1265327610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c514dc0 msgr2=0x55f31c51f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/1265327610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c514dc0 0x55f31c51f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb7b37fe640 1 -- 172.21.15.152:0/1265327610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f31c406440 con 0x55f31c5144a0 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb7b17fa640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb79c0a2cf0 0x7fb79c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/1265327610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c514880 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800a500 tx=0x7fb7a800a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1344961eaaa555bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb79c0a2cf0 0x7fb79c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb7b17fa640 1 -- 172.21.15.152:0/1559888114 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb7ac0cf690 con 0x7fb7b4106f10 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb79a7fc640 1 -- 172.21.15.152:0/1265327610 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8019030 con 0x55f31c5144a0 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb79a7fc640 1 -- 172.21.15.152:0/1265327610 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7a8005500 con 0x55f31c5144a0 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.354+0000 7fb79a7fc640 1 -- 172.21.15.152:0/1265327610 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80116b0 con 0x55f31c5144a0 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.355+0000 7fb7bce19740 1 -- 172.21.15.152:0/1265327610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 msgr2=0x55f31c514880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.355+0000 7fb7bce19740 1 --2- 172.21.15.152:0/1265327610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c514880 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800a500 tx=0x7fb7a800a780 comp rx=0 tx=0).stop 2024-09-11T22:10:26.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.355+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb79c0a2cf0 0x7fb79c0a51b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55f31c511890 tx=0x7fb7a40058b0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.355+0000 7fb7bce19740 1 -- 172.21.15.152:0/1265327610 shutdown_connections 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.355+0000 7fb7bce19740 1 --2- 172.21.15.152:0/1265327610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c51f680 0x55f31c521a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.355+0000 7fb7bce19740 1 --2- 172.21.15.152:0/1265327610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c514dc0 0x55f31c51f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.355+0000 7fb7bce19740 1 --2- 172.21.15.152:0/1265327610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c514880 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.355+0000 7fb7bce19740 1 -- 172.21.15.152:0/1265327610 >> 172.21.15.152:0/1265327610 conn(0x55f31c510a30 msgr2=0x55f31c510e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.355+0000 7fb7bce19740 1 -- 172.21.15.152:0/1265327610 shutdown_connections 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.355+0000 7fb7bce19740 1 -- 172.21.15.152:0/1265327610 wait complete. 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.355+0000 7fb7bce19740 1 -- start start 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7bce19740 1 Processor -- start 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c514dc0 0x55f31c51c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c51f680 0x55f31c51c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7bce19740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f31c522250 con 0x55f31c5144a0 2024-09-11T22:10:26.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7bce19740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f31c435050 con 0x55f31c51f680 2024-09-11T22:10:26.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7bce19740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f31c5223d0 con 0x55f31c514dc0 2024-09-11T22:10:26.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7bce19740 10 client.0 _ll_register_callbacks cb 0x55f31c475160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:26.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43314/0 (socket says 172.21.15.152:43314) 2024-09-11T22:10:26.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b3fff640 1 -- 172.21.15.152:0/315860683 learned_addr learned my addr 172.21.15.152:0/315860683 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:26.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b8fdd640 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c51f680 0x55f31c51c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c514dc0 0x55f31c51c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b3fff640 1 -- 172.21.15.152:0/315860683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c514dc0 msgr2=0x55f31c51c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:26.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c514dc0 0x55f31c51c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b3fff640 1 -- 172.21.15.152:0/315860683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c51f680 msgr2=0x55f31c51c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c51f680 0x55f31c51c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b3fff640 1 -- 172.21.15.152:0/315860683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f31c1eb3c0 con 0x55f31c5144a0 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b8fdd640 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c51f680 0x55f31c51c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7937fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.356+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51f020 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4033000 tx=0x7fb7a4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeaba783545976df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7937fe640 1 -- 172.21.15.152:0/315860683 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a404b070 con 0x55f31c5144a0 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7937fe640 1 -- 172.21.15.152:0/315860683 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb7a4005460 con 0x55f31c5144a0 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7bce19740 1 -- 172.21.15.152:0/315860683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7a8005500 con 0x55f31c5144a0 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7937fe640 1 -- 172.21.15.152:0/315860683 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb7a4057050 con 0x55f31c5144a0 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7bce19740 10 client.16911 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7bce19740 1 -- 172.21.15.152:0/315860683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f31c52dc90 con 0x55f31c5144a0 2024-09-11T22:10:26.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7937fe640 1 -- 172.21.15.152:0/315860683 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7a8005500 con 0x55f31c5144a0 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7937fe640 1 -- 172.21.15.152:0/315860683 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb7a4003710 con 0x55f31c5144a0 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7bce19740 10 client.16911 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7bce19740 10 client.16911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7bce19740 20 client.16911 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7bce19740 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f31c52f0a0 0x55f31c531520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7bce19740 4 client.16911 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.357+0000 7fb7bce19740 1 -- 172.21.15.152:0/315860683 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f31c487850 con 0x55f31c52f0a0 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.358+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f31c52f0a0 0x55f31c531520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.358+0000 7fb7937fe640 10 client.16911 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.358+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f31c52f0a0 0x55f31c531520 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8b82aec8336281e server_cookie=da69ebd0564d4c4c in_seq=0 out_seq=0 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7937fe640 1 -- 172.21.15.152:0/315860683 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f31c487850 con 0x55f31c52f0a0 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7937fe640 10 client.16911 handle_command_reply: tid=0 2024-09-11T22:10:26.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 1 client.16911 shutdown 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 1 -- 172.21.15.152:0/315860683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 msgr2=0x55f31c51f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51f020 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4033000 tx=0x7fb7a4009260 comp rx=0 tx=0).stop 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 1 -- 172.21.15.152:0/315860683 shutdown_connections 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f31c52f0a0 0x55f31c531520 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c51f680 0x55f31c51c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c514dc0 0x55f31c51c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7937fe640 0 client.16911 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 1 --2- 172.21.15.152:0/315860683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51f020 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 1 -- 172.21.15.152:0/315860683 >> 172.21.15.152:0/315860683 conn(0x55f31c510a30 msgr2=0x55f31c516760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 1 -- 172.21.15.152:0/315860683 shutdown_connections 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 1 -- 172.21.15.152:0/315860683 wait complete. 2024-09-11T22:10:26.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.359+0000 7fb7bce19740 20 client.16911 trim_cache size 0 max 16384 2024-09-11T22:10:26.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.376+0000 7fb7bce19740 1 Processor -- start 2024-09-11T22:10:26.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.376+0000 7fb7bce19740 1 -- start start 2024-09-11T22:10:26.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.376+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.376+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c514dc0 0x55f31c536df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.376+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c51f680 0x55f31c537330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.376+0000 7fb7bce19740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b41b2380 con 0x55f31c5144a0 2024-09-11T22:10:26.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.376+0000 7fb7bce19740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b41afc50 con 0x55f31c51f680 2024-09-11T22:10:26.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.376+0000 7fb7bce19740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b41adaa0 con 0x55f31c514dc0 2024-09-11T22:10:26.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.376+0000 7fb7b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.376+0000 7fb7b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43324/0 (socket says 172.21.15.152:43324) 2024-09-11T22:10:26.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.376+0000 7fb7b3fff640 1 -- 172.21.15.152:0/2987907675 learned_addr learned my addr 172.21.15.152:0/2987907675 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:26.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.377+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/2987907675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c514dc0 0x55f31c536df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.377+0000 7fb7b3fff640 1 -- 172.21.15.152:0/2987907675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c514dc0 msgr2=0x55f31c536df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:26.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.377+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/2987907675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c514dc0 0x55f31c536df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.377+0000 7fb7b8fdd640 1 --2- 172.21.15.152:0/2987907675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c51f680 0x55f31c537330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.377+0000 7fb7b3fff640 1 -- 172.21.15.152:0/2987907675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c51f680 msgr2=0x55f31c537330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:26.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.377+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/2987907675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c51f680 0x55f31c537330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.377+0000 7fb7b3fff640 1 -- 172.21.15.152:0/2987907675 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f31c51b280 con 0x55f31c5144a0 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.377+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/2987907675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51aba0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb7a402a930 tx=0x7fb7a40474a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48302c18847e993a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.377+0000 7fb799ffb640 1 -- 172.21.15.152:0/2987907675 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a404b070 con 0x55f31c5144a0 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.377+0000 7fb799ffb640 1 -- 172.21.15.152:0/2987907675 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7a4003d20 con 0x55f31c5144a0 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.377+0000 7fb799ffb640 1 -- 172.21.15.152:0/2987907675 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4035050 con 0x55f31c5144a0 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.378+0000 7fb7bce19740 1 -- 172.21.15.152:0/2987907675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 msgr2=0x55f31c51aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.378+0000 7fb7bce19740 1 --2- 172.21.15.152:0/2987907675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51aba0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb7a402a930 tx=0x7fb7a40474a0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.378+0000 7fb7bce19740 1 -- 172.21.15.152:0/2987907675 shutdown_connections 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.378+0000 7fb7bce19740 1 --2- 172.21.15.152:0/2987907675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c51f680 0x55f31c537330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.378+0000 7fb7bce19740 1 --2- 172.21.15.152:0/2987907675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c514dc0 0x55f31c536df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.378+0000 7fb7bce19740 1 --2- 172.21.15.152:0/2987907675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c51aba0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.378+0000 7fb7bce19740 1 -- 172.21.15.152:0/2987907675 >> 172.21.15.152:0/2987907675 conn(0x55f31c510a30 msgr2=0x55f31c50fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:26.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.378+0000 7fb7bce19740 1 -- 172.21.15.152:0/2987907675 shutdown_connections 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.378+0000 7fb7bce19740 1 -- 172.21.15.152:0/2987907675 wait complete. 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.378+0000 7fb7bce19740 1 -- start start 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.378+0000 7fb7bce19740 1 Processor -- start 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c525700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c514dc0 0x55f31c525c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7bce19740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c51f680 0x55f31c5261a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7bce19740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b41ae110 con 0x55f31c5144a0 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7bce19740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b41af580 con 0x55f31c514dc0 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7bce19740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b41ae7e0 con 0x55f31c51f680 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7bce19740 10 client.0 _ll_register_callbacks cb 0x7fb7a4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c525700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c525700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43340/0 (socket says 172.21.15.152:43340) 2024-09-11T22:10:26.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b3fff640 1 -- 172.21.15.152:0/1983750255 learned_addr learned my addr 172.21.15.152:0/1983750255 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:26.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c514dc0 0x55f31c525c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b8fdd640 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c51f680 0x55f31c5261a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b3fff640 1 -- 172.21.15.152:0/1983750255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c51f680 msgr2=0x55f31c5261a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:26.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c51f680 0x55f31c5261a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b3fff640 1 -- 172.21.15.152:0/1983750255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c514dc0 msgr2=0x55f31c525c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:26.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c514dc0 0x55f31c525c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b3fff640 1 -- 172.21.15.152:0/1983750255 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f31c5990a0 con 0x55f31c5144a0 2024-09-11T22:10:26.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b8fdd640 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c51f680 0x55f31c5261a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:26.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7b3fff640 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c525700 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4003b30 tx=0x7fb7a4032fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0eba39ef8fef69 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:26.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7937fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7937fe640 1 -- 172.21.15.152:0/1983750255 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4035070 con 0x55f31c5144a0 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7937fe640 1 -- 172.21.15.152:0/1983750255 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fb7a4005260 con 0x55f31c5144a0 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7bce19740 1 -- 172.21.15.152:0/1983750255 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7a4003d20 con 0x55f31c5144a0 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7937fe640 1 -- 172.21.15.152:0/1983750255 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb7a4073050 con 0x55f31c5144a0 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.379+0000 7fb7bce19740 10 client.16917 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.380+0000 7fb7bce19740 1 -- 172.21.15.152:0/1983750255 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f31c59a3b0 con 0x55f31c5144a0 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.380+0000 7fb7937fe640 1 -- 172.21.15.152:0/1983750255 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7a4003d20 con 0x55f31c5144a0 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.380+0000 7fb7937fe640 1 -- 172.21.15.152:0/1983750255 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb7a4047810 con 0x55f31c5144a0 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.380+0000 7fb7bce19740 10 client.16917 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.380+0000 7fb7bce19740 10 client.16917 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.380+0000 7fb7bce19740 20 client.16917 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:26.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.380+0000 7fb7bce19740 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f31c59aa00 0x55f31c59cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.380+0000 7fb7bce19740 4 client.16917 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.380+0000 7fb7bce19740 1 -- 172.21.15.152:0/1983750255 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f31c481d60 con 0x55f31c59aa00 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.380+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f31c59aa00 0x55f31c59cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7b37fe640 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f31c59aa00 0x55f31c59cdf0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1906ab4b259581a6 server_cookie=6f99fbdf8e67e7d3 in_seq=0 out_seq=0 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7937fe640 10 client.16917 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7937fe640 1 -- 172.21.15.152:0/1983750255 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f31c481d60 con 0x55f31c59aa00 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7937fe640 10 client.16917 handle_command_reply: tid=0 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 1 client.16917 shutdown 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 1 -- 172.21.15.152:0/1983750255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 msgr2=0x55f31c525700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c525700 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4003b30 tx=0x7fb7a4032fa0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 1 -- 172.21.15.152:0/1983750255 shutdown_connections 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f31c59aa00 0x55f31c59cdf0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f31c51f680 0x55f31c5261a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7937fe640 0 client.16917 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:26.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f31c514dc0 0x55f31c525c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 1 --2- 172.21.15.152:0/1983750255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f31c5144a0 0x55f31c525700 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 1 -- 172.21.15.152:0/1983750255 >> 172.21.15.152:0/1983750255 conn(0x55f31c510a30 msgr2=0x55f31c50fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:26.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 1 -- 172.21.15.152:0/1983750255 shutdown_connections 2024-09-11T22:10:26.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 1 -- 172.21.15.152:0/1983750255 wait complete. 2024-09-11T22:10:26.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.381+0000 7fb7bce19740 20 client.16917 trim_cache size 0 max 16384 2024-09-11T22:10:26.391 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:10:26.391 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:10:26.391 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:10:26.391 INFO:teuthology.orchestra.run.smithi152.stdout: "41d20d28-2787-4739-91f3-ab88e8c99d59": { 2024-09-11T22:10:26.391 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:10:26.392 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "41d20d28-2787-4739-91f3-ab88e8c99d59", 2024-09-11T22:10:26.392 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:10:26.392 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:26.392 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:26.392 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:10:26.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 -- 172.21.15.152:0/1559888114 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb79c0a2cf0 msgr2=0x7fb79c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:26.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb79c0a2cf0 0x7fb79c0a51b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55f31c511890 tx=0x7fb7a40058b0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 -- 172.21.15.152:0/1559888114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b4106f10 msgr2=0x7fb7b4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:26.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b4106f10 0x7fb7b4074f70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00eaa0 tx=0x7fb7ac00ef60 comp rx=0 tx=0).stop 2024-09-11T22:10:26.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 -- 172.21.15.152:0/1559888114 shutdown_connections 2024-09-11T22:10:26.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb79c0a2cf0 0x7fb79c0a51b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b4106f10 0x7fb7b4074f70 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7b4102790 0x7fb7b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 --2- 172.21.15.152:0/1559888114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7b4101de0 0x7fb7b40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:26.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 -- 172.21.15.152:0/1559888114 >> 172.21.15.152:0/1559888114 conn(0x7fb7b40fd8c0 msgr2=0x7fb7b40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:26.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 -- 172.21.15.152:0/1559888114 shutdown_connections 2024-09-11T22:10:26.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:26.382+0000 7fb7baa40640 1 -- 172.21.15.152:0/1559888114 wait complete. 2024-09-11T22:10:26.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:26 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:10:26.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:26 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:10:26.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:26 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:10:26.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:26 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:10:26.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:26 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:10:26.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:26 smithi179 ceph-mon[35603]: pgmap v187: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 490 op/s 2024-09-11T22:10:26.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:26 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:10:26.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:26 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:10:26.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:26 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:10:26.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:26 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:10:26.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:26 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:10:26.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:26 smithi193 ceph-mon[35545]: pgmap v187: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 490 op/s 2024-09-11T22:10:27.127 INFO:tasks.cephfs.filesystem:scrub status for tag:41d20d28-2787-4739-91f3-ab88e8c99d59 - {'path': '/', 'tag': '41d20d28-2787-4739-91f3-ab88e8c99d59', 'options': 'recursive,force'} 2024-09-11T22:10:27.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:27 smithi179 ceph-mon[35603]: pgmap v188: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 490 op/s 2024-09-11T22:10:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:27 smithi193 ceph-mon[35545]: pgmap v188: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 490 op/s 2024-09-11T22:10:27.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:27 smithi152 ceph-mon[31188]: pgmap v188: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 490 op/s 2024-09-11T22:10:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:29 smithi179 ceph-mon[35603]: pgmap v189: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 494 op/s 2024-09-11T22:10:29.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:10:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:29 smithi193 ceph-mon[35545]: pgmap v189: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 494 op/s 2024-09-11T22:10:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:29 smithi152 ceph-mon[31188]: pgmap v189: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 494 op/s 2024-09-11T22:10:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.152+0000 7fe319b66640 1 -- 172.21.15.152:0/3882620385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe314102470 msgr2=0x7fe31410e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.152+0000 7fe319b66640 1 --2- 172.21.15.152:0/3882620385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe314102470 0x7fe31410e9a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009930 tx=0x7fe30c02a420 comp rx=0 tx=0).stop 2024-09-11T22:10:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.152+0000 7fe319b66640 1 -- 172.21.15.152:0/3882620385 shutdown_connections 2024-09-11T22:10:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.152+0000 7fe319b66640 1 --2- 172.21.15.152:0/3882620385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe314102470 0x7fe31410e9a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.152+0000 7fe319b66640 1 --2- 172.21.15.152:0/3882620385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe314101ad0 0x7fe314101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.152+0000 7fe319b66640 1 --2- 172.21.15.152:0/3882620385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe314107b70 0x7fe314107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.152+0000 7fe319b66640 1 -- 172.21.15.152:0/3882620385 >> 172.21.15.152:0/3882620385 conn(0x7fe3140fd7d0 msgr2=0x7fe3140ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.152+0000 7fe319b66640 1 -- 172.21.15.152:0/3882620385 shutdown_connections 2024-09-11T22:10:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.152+0000 7fe319b66640 1 -- 172.21.15.152:0/3882620385 wait complete. 2024-09-11T22:10:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.153+0000 7fe319b66640 1 Processor -- start 2024-09-11T22:10:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.153+0000 7fe319b66640 1 -- start start 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.153+0000 7fe319b66640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe314101ad0 0x7fe3141983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe319b66640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe314102470 0x7fe314198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe319b66640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe314107b70 0x7fe31419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe319b66640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe314111ee0 con 0x7fe314107b70 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe319b66640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe314111d60 con 0x7fe314101ad0 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe319b66640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe314112060 con 0x7fe314102470 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe313fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe314107b70 0x7fe31419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe313fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe314107b70 0x7fe31419cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43360/0 (socket says 172.21.15.152:43360) 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe313fff640 1 -- 172.21.15.152:0/3947764620 learned_addr learned my addr 172.21.15.152:0/3947764620 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe3137fe640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe314101ad0 0x7fe3141983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe312ffd640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe314102470 0x7fe314198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe313fff640 1 -- 172.21.15.152:0/3947764620 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe314102470 msgr2=0x7fe314198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe313fff640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe314102470 0x7fe314198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe313fff640 1 -- 172.21.15.152:0/3947764620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe314101ad0 msgr2=0x7fe3141983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe313fff640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe314101ad0 0x7fe3141983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe313fff640 1 -- 172.21.15.152:0/3947764620 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31419d3c0 con 0x7fe314107b70 2024-09-11T22:10:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe313fff640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe314107b70 0x7fe31419cc90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe30c005ab0 tx=0x7fe30c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe310ff9640 1 -- 172.21.15.152:0/3947764620 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c03f030 con 0x7fe314107b70 2024-09-11T22:10:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe310ff9640 1 -- 172.21.15.152:0/3947764620 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe30c0044c0 con 0x7fe314107b70 2024-09-11T22:10:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe319b66640 1 -- 172.21.15.152:0/3947764620 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31419d650 con 0x7fe314107b70 2024-09-11T22:10:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.154+0000 7fe310ff9640 1 -- 172.21.15.152:0/3947764620 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c035070 con 0x7fe314107b70 2024-09-11T22:10:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.155+0000 7fe319b66640 1 -- 172.21.15.152:0/3947764620 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3141a4f40 con 0x7fe314107b70 2024-09-11T22:10:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.157+0000 7fe310ff9640 1 -- 172.21.15.152:0/3947764620 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe30c042030 con 0x7fe314107b70 2024-09-11T22:10:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe31c9dc740 1 Processor -- start 2024-09-11T22:10:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe310ff9640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3000a2da0 0x7fe3000a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe31c9dc740 1 -- start start 2024-09-11T22:10:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe312ffd640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3000a2da0 0x7fe3000a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe310ff9640 1 -- 172.21.15.152:0/3947764620 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe30c0ef7f0 con 0x7fe314107b70 2024-09-11T22:10:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e02f00 0x560db5e032e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e03820 0x560db5e0db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e0e0c0 0x560db5e104b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560db5d632f0 con 0x560db5e03820 2024-09-11T22:10:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560db5d0b270 con 0x560db5e0e0c0 2024-09-11T22:10:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560db5d5f2b0 con 0x560db5e02f00 2024-09-11T22:10:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe312ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e03820 0x560db5e0db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe312ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e03820 0x560db5e0db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43372/0 (socket says 172.21.15.152:43372) 2024-09-11T22:10:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe312ffd640 1 -- 172.21.15.152:0/3685951972 learned_addr learned my addr 172.21.15.152:0/3685951972 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe3137fe640 1 --2- 172.21.15.152:0/3685951972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e02f00 0x560db5e032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe313fff640 1 --2- 172.21.15.152:0/3685951972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e0e0c0 0x560db5e104b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe312ffd640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3000a2da0 0x7fe3000a5260 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00bb00 tx=0x7fe2fc00bf00 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe3137fe640 1 -- 172.21.15.152:0/3685951972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e0e0c0 msgr2=0x560db5e104b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe3137fe640 1 --2- 172.21.15.152:0/3685951972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e0e0c0 0x560db5e104b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe3137fe640 1 -- 172.21.15.152:0/3685951972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e03820 msgr2=0x560db5e0db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe3137fe640 1 --2- 172.21.15.152:0/3685951972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e03820 0x560db5e0db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe3137fe640 1 -- 172.21.15.152:0/3685951972 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db5d0a340 con 0x560db5e02f00 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.158+0000 7fe312ffd640 1 --2- 172.21.15.152:0/3685951972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e03820 0x560db5e0db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.159+0000 7fe3137fe640 1 --2- 172.21.15.152:0/3685951972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e02f00 0x560db5e032e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe304009fa0 tx=0x7fe3040118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77ebcd58543f6856 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.159+0000 7fe309ffb640 1 -- 172.21.15.152:0/3685951972 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304003c30 con 0x560db5e02f00 2024-09-11T22:10:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.159+0000 7fe309ffb640 1 -- 172.21.15.152:0/3685951972 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe304003dd0 con 0x560db5e02f00 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.159+0000 7fe309ffb640 1 -- 172.21.15.152:0/3685951972 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30400fa20 con 0x560db5e02f00 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.159+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3685951972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e02f00 msgr2=0x560db5e032e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.159+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/3685951972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e02f00 0x560db5e032e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe304009fa0 tx=0x7fe3040118d0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.160+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3685951972 shutdown_connections 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.160+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/3685951972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e0e0c0 0x560db5e104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.160+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/3685951972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e03820 0x560db5e0db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.160+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/3685951972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e02f00 0x560db5e032e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.160+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3685951972 >> 172.21.15.152:0/3685951972 conn(0x560db5dff470 msgr2=0x560db5dff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.160+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3685951972 shutdown_connections 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.160+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3685951972 wait complete. 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.160+0000 7fe31c9dc740 1 -- start start 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.160+0000 7fe31c9dc740 1 Processor -- start 2024-09-11T22:10:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.160+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.160+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e03820 0x560db5e0b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e0e0c0 0x560db5e0ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560db5e10c90 con 0x560db5e02f00 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560db5cec290 con 0x560db5e03820 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560db5e10e10 con 0x560db5e0e0c0 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe31c9dc740 10 client.0 _ll_register_callbacks cb 0x560db5d1d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe3137fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe3137fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43386/0 (socket says 172.21.15.152:43386) 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe3137fe640 1 -- 172.21.15.152:0/1065018110 learned_addr learned my addr 172.21.15.152:0/1065018110 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe313fff640 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e0e0c0 0x560db5e0ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe312ffd640 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e03820 0x560db5e0b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe3137fe640 1 -- 172.21.15.152:0/1065018110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e0e0c0 msgr2=0x560db5e0ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe3137fe640 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e0e0c0 0x560db5e0ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe3137fe640 1 -- 172.21.15.152:0/1065018110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e03820 msgr2=0x560db5e0b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe3137fe640 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e03820 0x560db5e0b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe3137fe640 1 -- 172.21.15.152:0/1065018110 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db5a76210 con 0x560db5e02f00 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe3137fe640 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0af90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe30401b040 tx=0x7fe304004cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfdf6790c8b9587 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe2f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/1065018110 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304028020 con 0x560db5e02f00 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/1065018110 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe30400f9d0 con 0x560db5e02f00 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe31c9dc740 1 -- 172.21.15.152:0/1065018110 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe304003dd0 con 0x560db5e02f00 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.161+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/1065018110 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe304033050 con 0x560db5e02f00 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.162+0000 7fe31c9dc740 10 client.16929 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.162+0000 7fe31c9dc740 1 -- 172.21.15.152:0/1065018110 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560db5b42620 con 0x560db5e02f00 2024-09-11T22:10:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.162+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/1065018110 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe304003dd0 con 0x560db5e02f00 2024-09-11T22:10:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.162+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/1065018110 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe3040045e0 con 0x560db5e02f00 2024-09-11T22:10:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.162+0000 7fe31c9dc740 10 client.16929 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.162+0000 7fe31c9dc740 10 client.16929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.162+0000 7fe31c9dc740 20 client.16929 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.162+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560db5e1dfa0 0x560db5e20390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.162+0000 7fe31c9dc740 4 client.16929 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.162+0000 7fe31c9dc740 1 -- 172.21.15.152:0/1065018110 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560db5d70a20 con 0x560db5e1dfa0 2024-09-11T22:10:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.162+0000 7fe312ffd640 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560db5e1dfa0 0x560db5e20390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.163+0000 7fe2f2ffd640 10 client.16929 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.163+0000 7fe312ffd640 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560db5e1dfa0 0x560db5e20390 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9c52661b5a45c23 server_cookie=f1a3fc4ec38725d6 in_seq=0 out_seq=0 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.163+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/1065018110 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560db5d70a20 con 0x560db5e1dfa0 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.163+0000 7fe2f2ffd640 10 client.16929 handle_command_reply: tid=0 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.163+0000 7fe31c9dc740 1 client.16929 shutdown 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.163+0000 7fe31c9dc740 1 -- 172.21.15.152:0/1065018110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 msgr2=0x560db5e0af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.163+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0af90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe30401b040 tx=0x7fe304004cd0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.164+0000 7fe31c9dc740 1 -- 172.21.15.152:0/1065018110 shutdown_connections 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.164+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560db5e1dfa0 0x560db5e20390 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.164+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e0e0c0 0x560db5e0ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.164+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e03820 0x560db5e0b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.164+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/1065018110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0af90 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.164+0000 7fe2f2ffd640 0 client.16929 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.164+0000 7fe31c9dc740 1 -- 172.21.15.152:0/1065018110 >> 172.21.15.152:0/1065018110 conn(0x560db5dff470 msgr2=0x560db5dfa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.164+0000 7fe31c9dc740 1 -- 172.21.15.152:0/1065018110 shutdown_connections 2024-09-11T22:10:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.164+0000 7fe31c9dc740 1 -- 172.21.15.152:0/1065018110 wait complete. 2024-09-11T22:10:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.164+0000 7fe31c9dc740 20 client.16929 trim_cache size 0 max 16384 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.178+0000 7fe31c9dc740 1 Processor -- start 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.178+0000 7fe31c9dc740 1 -- start start 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.178+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.178+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e03820 0x560db5e25b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.178+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e0e0c0 0x560db5e26060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.178+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe3141adf90 con 0x560db5e02f00 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.178+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3141ab860 con 0x560db5e03820 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.178+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3141a96d0 con 0x560db5e0e0c0 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.178+0000 7fe3137fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.178+0000 7fe3137fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43402/0 (socket says 172.21.15.152:43402) 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.178+0000 7fe3137fe640 1 -- 172.21.15.152:0/2994644510 learned_addr learned my addr 172.21.15.152:0/2994644510 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe3137fe640 1 -- 172.21.15.152:0/2994644510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e0e0c0 msgr2=0x560db5e26060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe3137fe640 1 --2- 172.21.15.152:0/2994644510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e0e0c0 0x560db5e26060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe3137fe640 1 -- 172.21.15.152:0/2994644510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e03820 msgr2=0x560db5e25b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe3137fe640 1 --2- 172.21.15.152:0/2994644510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e03820 0x560db5e25b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe3137fe640 1 -- 172.21.15.152:0/2994644510 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db5dff2a0 con 0x560db5e02f00 2024-09-11T22:10:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe3137fe640 1 --2- 172.21.15.152:0/2994644510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0cf00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe304005d10 tx=0x7fe30400f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69617eb45a06705e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe3097fa640 1 -- 172.21.15.152:0/2994644510 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30403c070 con 0x560db5e02f00 2024-09-11T22:10:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe3097fa640 1 -- 172.21.15.152:0/2994644510 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe304003dd0 con 0x560db5e02f00 2024-09-11T22:10:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe3097fa640 1 -- 172.21.15.152:0/2994644510 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304028040 con 0x560db5e02f00 2024-09-11T22:10:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe31c9dc740 1 -- 172.21.15.152:0/2994644510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 msgr2=0x560db5e0cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/2994644510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0cf00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe304005d10 tx=0x7fe30400f700 comp rx=0 tx=0).stop 2024-09-11T22:10:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe31c9dc740 1 -- 172.21.15.152:0/2994644510 shutdown_connections 2024-09-11T22:10:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/2994644510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e0e0c0 0x560db5e26060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/2994644510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e03820 0x560db5e25b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.179+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/2994644510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e0cf00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 1 -- 172.21.15.152:0/2994644510 >> 172.21.15.152:0/2994644510 conn(0x560db5dff470 msgr2=0x560db5e0c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 1 -- 172.21.15.152:0/2994644510 shutdown_connections 2024-09-11T22:10:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 1 -- 172.21.15.152:0/2994644510 wait complete. 2024-09-11T22:10:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 1 -- start start 2024-09-11T22:10:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 1 Processor -- start 2024-09-11T22:10:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e16600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e03820 0x560db5e11970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e0e0c0 0x560db5e11eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe3141a9d20 con 0x560db5e02f00 2024-09-11T22:10:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3141ab190 con 0x560db5e0e0c0 2024-09-11T22:10:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3141aa3f0 con 0x560db5e03820 2024-09-11T22:10:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe31c9dc740 10 client.0 _ll_register_callbacks cb 0x7fe2fc004460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe3137fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e16600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe3137fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e16600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43410/0 (socket says 172.21.15.152:43410) 2024-09-11T22:10:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.180+0000 7fe3137fe640 1 -- 172.21.15.152:0/3374387105 learned_addr learned my addr 172.21.15.152:0/3374387105 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe312ffd640 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e03820 0x560db5e11970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe313fff640 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e0e0c0 0x560db5e11eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe3137fe640 1 -- 172.21.15.152:0/3374387105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e03820 msgr2=0x560db5e11970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe3137fe640 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e03820 0x560db5e11970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe3137fe640 1 -- 172.21.15.152:0/3374387105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e0e0c0 msgr2=0x560db5e11eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe3137fe640 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e0e0c0 0x560db5e11eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe3137fe640 1 -- 172.21.15.152:0/3374387105 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db5e0ad60 con 0x560db5e02f00 2024-09-11T22:10:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe312ffd640 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e03820 0x560db5e11970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe3137fe640 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e16600 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe30403a040 tx=0x7fe304005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6c5ff58a7214c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe2f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/3374387105 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30403c070 con 0x560db5e02f00 2024-09-11T22:10:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/3374387105 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fe3040056b0 con 0x560db5e02f00 2024-09-11T22:10:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3374387105 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe304003dd0 con 0x560db5e02f00 2024-09-11T22:10:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/3374387105 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe3040058b0 con 0x560db5e02f00 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe31c9dc740 10 client.16935 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3374387105 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560db5e88740 con 0x560db5e02f00 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.181+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/3374387105 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe304003dd0 con 0x560db5e02f00 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.182+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/3374387105 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe304047070 con 0x560db5e02f00 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.182+0000 7fe31c9dc740 10 client.16935 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.182+0000 7fe31c9dc740 10 client.16935 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.182+0000 7fe31c9dc740 20 client.16935 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.182+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560db5e88cf0 0x560db5e8b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.182+0000 7fe31c9dc740 4 client.16935 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.182+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3374387105 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560db5e06b70 con 0x560db5e88cf0 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.182+0000 7fe312ffd640 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560db5e88cf0 0x560db5e8b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.182+0000 7fe2f2ffd640 10 client.16935 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.182+0000 7fe312ffd640 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560db5e88cf0 0x560db5e8b0e0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63ae60ae8be2ec6f server_cookie=6d9003a7dd81bf31 in_seq=0 out_seq=0 2024-09-11T22:10:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.190+0000 7fe2f2ffd640 1 -- 172.21.15.152:0/3374387105 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560db5e06b70 con 0x560db5e88cf0 2024-09-11T22:10:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.190+0000 7fe2f2ffd640 10 client.16935 handle_command_reply: tid=0 2024-09-11T22:10:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.190+0000 7fe31c9dc740 1 client.16935 shutdown 2024-09-11T22:10:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.190+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3374387105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 msgr2=0x560db5e16600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.190+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e16600 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe30403a040 tx=0x7fe304005360 comp rx=0 tx=0).stop 2024-09-11T22:10:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3374387105 shutdown_connections 2024-09-11T22:10:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560db5e88cf0 0x560db5e8b0e0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560db5e0e0c0 0x560db5e11eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe2f2ffd640 0 client.16935 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560db5e03820 0x560db5e11970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe31c9dc740 1 --2- 172.21.15.152:0/3374387105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560db5e02f00 0x560db5e16600 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3374387105 >> 172.21.15.152:0/3374387105 conn(0x560db5dff470 msgr2=0x560db5dfa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3374387105 shutdown_connections 2024-09-11T22:10:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe31c9dc740 1 -- 172.21.15.152:0/3374387105 wait complete. 2024-09-11T22:10:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe31c9dc740 20 client.16935 trim_cache size 0 max 16384 2024-09-11T22:10:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:10:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:10:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:10:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:10:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe319b66640 1 -- 172.21.15.152:0/3947764620 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3000a2da0 msgr2=0x7fe3000a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe319b66640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3000a2da0 0x7fe3000a5260 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00bb00 tx=0x7fe2fc00bf00 comp rx=0 tx=0).stop 2024-09-11T22:10:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe319b66640 1 -- 172.21.15.152:0/3947764620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe314107b70 msgr2=0x7fe31419cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe319b66640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe314107b70 0x7fe31419cc90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe30c005ab0 tx=0x7fe30c0040c0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe319b66640 1 -- 172.21.15.152:0/3947764620 shutdown_connections 2024-09-11T22:10:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe319b66640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3000a2da0 0x7fe3000a5260 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe319b66640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe314107b70 0x7fe31419cc90 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe319b66640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe314102470 0x7fe314198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe319b66640 1 --2- 172.21.15.152:0/3947764620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe314101ad0 0x7fe3141983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe319b66640 1 -- 172.21.15.152:0/3947764620 >> 172.21.15.152:0/3947764620 conn(0x7fe3140fd7d0 msgr2=0x7fe3140fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.191+0000 7fe319b66640 1 -- 172.21.15.152:0/3947764620 shutdown_connections 2024-09-11T22:10:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:30.192+0000 7fe319b66640 1 -- 172.21.15.152:0/3947764620 wait complete. 2024-09-11T22:10:31.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:31 smithi179 ceph-mon[35603]: pgmap v190: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 190 op/s 2024-09-11T22:10:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:31 smithi193 ceph-mon[35545]: pgmap v190: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 190 op/s 2024-09-11T22:10:31.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:31 smithi152 ceph-mon[31188]: pgmap v190: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 190 op/s 2024-09-11T22:10:32.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:32 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:10:32.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:32 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:10:32.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:32 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:10:32.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:32 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:10:32.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:32 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:10:32.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:32 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:10:32.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:32 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:10:32.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:32 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:10:32.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:32 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:10:32.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:32 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:10:32.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:32 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:10:32.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:32 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:10:33.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:33 smithi179 ceph-mon[35603]: pgmap v191: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 1.9 MiB/s wr, 195 op/s 2024-09-11T22:10:33.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:33 smithi193 ceph-mon[35545]: pgmap v191: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 1.9 MiB/s wr, 195 op/s 2024-09-11T22:10:33.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:33 smithi152 ceph-mon[31188]: pgmap v191: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 1.9 MiB/s wr, 195 op/s 2024-09-11T22:10:34.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:34 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:10:34.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:34 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:10:34.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:10:34.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:34 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:10:34.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:34 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:10:34.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:34 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:10:34.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:34 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:10:35.496 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:10:35.759 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:35.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:35 smithi193 ceph-mon[35545]: pgmap v192: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 KiB/s wr, 9 op/s 2024-09-11T22:10:35.879 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:35 smithi152 ceph-mon[31188]: pgmap v192: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 KiB/s wr, 9 op/s 2024-09-11T22:10:36.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:35 smithi179 ceph-mon[35603]: pgmap v192: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 KiB/s wr, 9 op/s 2024-09-11T22:10:36.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.222+0000 7ffb9da43640 1 -- 172.21.15.152:0/205587111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb98102570 msgr2=0x7ffb981029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.222+0000 7ffb9da43640 1 --2- 172.21.15.152:0/205587111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb98102570 0x7ffb981029b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009900 tx=0x7ffb8002a480 comp rx=0 tx=0).stop 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.222+0000 7ffb9da43640 1 -- 172.21.15.152:0/205587111 shutdown_connections 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.222+0000 7ffb9da43640 1 --2- 172.21.15.152:0/205587111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb98102ef0 0x7ffb9810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.222+0000 7ffb9da43640 1 --2- 172.21.15.152:0/205587111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb98102570 0x7ffb981029b0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.222+0000 7ffb9da43640 1 --2- 172.21.15.152:0/205587111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb98100e20 0x7ffb98101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.222+0000 7ffb9da43640 1 -- 172.21.15.152:0/205587111 >> 172.21.15.152:0/205587111 conn(0x7ffb980fc7d0 msgr2=0x7ffb980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.222+0000 7ffb9da43640 1 -- 172.21.15.152:0/205587111 shutdown_connections 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.222+0000 7ffb9da43640 1 -- 172.21.15.152:0/205587111 wait complete. 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.222+0000 7ffb9da43640 1 Processor -- start 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb9da43640 1 -- start start 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb9da43640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb98100e20 0x7ffb98198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb9da43640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb98102570 0x7ffb981989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb9da43640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb98102ef0 0x7ffb9819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb9da43640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffb981120a0 con 0x7ffb98102570 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb9da43640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98111f20 con 0x7ffb98100e20 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb9da43640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98112220 con 0x7ffb98102ef0 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb8e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb98102570 0x7ffb981989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb8e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb98102570 0x7ffb981989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51398/0 (socket says 172.21.15.152:51398) 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb8e7fc640 1 -- 172.21.15.152:0/1530445301 learned_addr learned my addr 172.21.15.152:0/1530445301 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb96ffd640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb98100e20 0x7ffb98198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb977fe640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb98102ef0 0x7ffb9819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb8e7fc640 1 -- 172.21.15.152:0/1530445301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb98102ef0 msgr2=0x7ffb9819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb8e7fc640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb98102ef0 0x7ffb9819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb8e7fc640 1 -- 172.21.15.152:0/1530445301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb98100e20 msgr2=0x7ffb98198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:36.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb8e7fc640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb98100e20 0x7ffb98198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb8e7fc640 1 -- 172.21.15.152:0/1530445301 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9819d430 con 0x7ffb98102570 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.223+0000 7ffb8e7fc640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb98102570 0x7ffb981989c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ffb80006010 tx=0x7ffb80003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.224+0000 7ffb9ca41640 1 -- 172.21.15.152:0/1530445301 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8003f070 con 0x7ffb98102570 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.224+0000 7ffb9da43640 1 -- 172.21.15.152:0/1530445301 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9819d6c0 con 0x7ffb98102570 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.224+0000 7ffb9ca41640 1 -- 172.21.15.152:0/1530445301 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb80031c30 con 0x7ffb98102570 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.224+0000 7ffb9ca41640 1 -- 172.21.15.152:0/1530445301 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80035030 con 0x7ffb98102570 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.224+0000 7ffb9da43640 1 -- 172.21.15.152:0/1530445301 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb981a5000 con 0x7ffb98102570 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.225+0000 7ffb9da43640 1 -- 172.21.15.152:0/1530445301 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb981021b0 con 0x7ffb98102570 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.226+0000 7ffb9ca41640 1 -- 172.21.15.152:0/1530445301 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ffb80042070 con 0x7ffb98102570 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.226+0000 7ffb9ca41640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffb840a2cf0 0x7ffb840a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.227+0000 7ffb96ffd640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffb840a2cf0 0x7ffb840a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.227+0000 7ffb9ca41640 1 -- 172.21.15.152:0/1530445301 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ffb800efc30 con 0x7ffb98102570 2024-09-11T22:10:36.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.227+0000 7ffb96ffd640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffb840a2cf0 0x7ffb840a51b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffb88005e10 tx=0x7ffb88005da0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:36.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.231+0000 7ffb9ca41640 1 -- 172.21.15.152:0/1530445301 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb800bc820 con 0x7ffb98102570 2024-09-11T22:10:36.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.429+0000 7ffb9da43640 1 -- 172.21.15.152:0/1530445301 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb981a51d0 con 0x7ffb98102570 2024-09-11T22:10:36.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.430+0000 7ffb9ca41640 1 -- 172.21.15.152:0/1530445301 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7ffb800bc120 con 0x7ffb98102570 2024-09-11T22:10:36.432 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:10:36.432 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:10:36.433 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:10:36.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 -- 172.21.15.152:0/1530445301 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffb840a2cf0 msgr2=0x7ffb840a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:36.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffb840a2cf0 0x7ffb840a51b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffb88005e10 tx=0x7ffb88005da0 comp rx=0 tx=0).stop 2024-09-11T22:10:36.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 -- 172.21.15.152:0/1530445301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb98102570 msgr2=0x7ffb981989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:36.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb98102570 0x7ffb981989c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ffb80006010 tx=0x7ffb80003c10 comp rx=0 tx=0).stop 2024-09-11T22:10:36.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 -- 172.21.15.152:0/1530445301 shutdown_connections 2024-09-11T22:10:36.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ffb840a2cf0 0x7ffb840a51b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:36.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb98102ef0 0x7ffb9819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:36.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb98102570 0x7ffb981989c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:36.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 --2- 172.21.15.152:0/1530445301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb98100e20 0x7ffb98198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:36.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 -- 172.21.15.152:0/1530445301 >> 172.21.15.152:0/1530445301 conn(0x7ffb980fc7d0 msgr2=0x7ffb98106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:36.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 -- 172.21.15.152:0/1530445301 shutdown_connections 2024-09-11T22:10:36.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:36.433+0000 7ffb9da43640 1 -- 172.21.15.152:0/1530445301 wait complete. 2024-09-11T22:10:36.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:36 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1530445301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:10:36.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:36 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1530445301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:10:37.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:36 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1530445301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:10:37.178 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 84ae6d10 --release --await' 2024-09-11T22:10:37.178 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 84ae6d10 --release --await 2024-09-11T22:10:37.428 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:37.800 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:37 smithi152 ceph-mon[31188]: pgmap v193: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 KiB/s wr, 9 op/s 2024-09-11T22:10:37.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:37 smithi193 ceph-mon[35545]: pgmap v193: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 KiB/s wr, 9 op/s 2024-09-11T22:10:38.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.001+0000 7f68dfbe6640 1 -- 172.21.15.152:0/3953151906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d8106f10 msgr2=0x7f68d810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:38.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.001+0000 7f68dfbe6640 1 --2- 172.21.15.152:0/3953151906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d8106f10 0x7f68d810ea90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009ca0 tx=0x7f68d002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.001+0000 7f68dfbe6640 1 -- 172.21.15.152:0/3953151906 shutdown_connections 2024-09-11T22:10:38.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.001+0000 7f68dfbe6640 1 --2- 172.21.15.152:0/3953151906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d8106f10 0x7f68d810ea90 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.001+0000 7f68dfbe6640 1 --2- 172.21.15.152:0/3953151906 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f68d8102790 0x7f68d81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.001+0000 7f68dfbe6640 1 --2- 172.21.15.152:0/3953151906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68d8101de0 0x7f68d81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.001+0000 7f68dfbe6640 1 -- 172.21.15.152:0/3953151906 >> 172.21.15.152:0/3953151906 conn(0x7f68d80fd8c0 msgr2=0x7f68d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:38.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68dfbe6640 1 -- 172.21.15.152:0/3953151906 shutdown_connections 2024-09-11T22:10:38.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68dfbe6640 1 -- 172.21.15.152:0/3953151906 wait complete. 2024-09-11T22:10:38.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68dfbe6640 1 Processor -- start 2024-09-11T22:10:38.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68dfbe6640 1 -- start start 2024-09-11T22:10:38.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68dfbe6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68d8101de0 0x7f68d81982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68dfbe6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f68d8102790 0x7f68d8198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68dfbe6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d8106f10 0x7f68d819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68dfbe6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8111f70 con 0x7f68d8106f10 2024-09-11T22:10:38.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68dfbe6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8111df0 con 0x7f68d8101de0 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68dfbe6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81120f0 con 0x7f68d8102790 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68de183640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d8106f10 0x7f68d819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68de183640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d8106f10 0x7f68d819cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51412/0 (socket says 172.21.15.152:51412) 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68de183640 1 -- 172.21.15.152:0/2855729018 learned_addr learned my addr 172.21.15.152:0/2855729018 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.002+0000 7f68dd181640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f68d8102790 0x7f68d8198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68dd982640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68d8101de0 0x7f68d81982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68de183640 1 -- 172.21.15.152:0/2855729018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f68d8102790 msgr2=0x7f68d8198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68de183640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f68d8102790 0x7f68d8198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68de183640 1 -- 172.21.15.152:0/2855729018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68d8101de0 msgr2=0x7f68d81982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68de183640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68d8101de0 0x7f68d81982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68de183640 1 -- 172.21.15.152:0/2855729018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d819d270 con 0x7f68d8106f10 2024-09-11T22:10:38.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68dd982640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68d8101de0 0x7f68d81982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:10:38.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68de183640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d8106f10 0x7f68d819cb90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f68d0031a20 tx=0x7f68d0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:38.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68ceffd640 1 -- 172.21.15.152:0/2855729018 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0003c30 con 0x7f68d8106f10 2024-09-11T22:10:38.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68ceffd640 1 -- 172.21.15.152:0/2855729018 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68d0003dd0 con 0x7f68d8106f10 2024-09-11T22:10:38.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68dfbe6640 1 -- 172.21.15.152:0/2855729018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d819d500 con 0x7f68d8106f10 2024-09-11T22:10:38.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68ceffd640 1 -- 172.21.15.152:0/2855729018 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d002fcf0 con 0x7f68d8106f10 2024-09-11T22:10:38.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.003+0000 7f68dfbe6640 1 -- 172.21.15.152:0/2855729018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d81a4e40 con 0x7f68d8106f10 2024-09-11T22:10:38.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.005+0000 7f68ceffd640 1 -- 172.21.15.152:0/2855729018 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f68d0004050 con 0x7f68d8106f10 2024-09-11T22:10:38.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68e1fbf740 1 Processor -- start 2024-09-11T22:10:38.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68e1fbf740 1 -- start start 2024-09-11T22:10:38.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045060 0x5562c1045440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045980 0x5562c104fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1050240 0x5562c1052630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5562c0faa620 con 0x5562c1045060 2024-09-11T22:10:38.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5562c0f51e50 con 0x5562c1050240 2024-09-11T22:10:38.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5562c0fa65e0 con 0x5562c1045980 2024-09-11T22:10:38.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68dd181640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045060 0x5562c1045440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68ceffd640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68c40a2d70 0x7f68c40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68dd181640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045060 0x5562c1045440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51416/0 (socket says 172.21.15.152:51416) 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68dd181640 1 -- 172.21.15.152:0/3076606405 learned_addr learned my addr 172.21.15.152:0/3076606405 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68dd982640 1 --2- 172.21.15.152:0/3076606405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045980 0x5562c104fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.006+0000 7f68de183640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68c40a2d70 0x7f68c40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68dd181640 1 --2- 172.21.15.152:0/3076606405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1050240 0x5562c1052630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68dd181640 1 -- 172.21.15.152:0/3076606405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045980 msgr2=0x5562c104fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68dd181640 1 --2- 172.21.15.152:0/3076606405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045980 0x5562c104fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68dd181640 1 -- 172.21.15.152:0/3076606405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1050240 msgr2=0x5562c1052630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68dd181640 1 --2- 172.21.15.152:0/3076606405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1050240 0x5562c1052630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68dd181640 1 -- 172.21.15.152:0/3076606405 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c0f42d40 con 0x5562c1045060 2024-09-11T22:10:38.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68ceffd640 1 -- 172.21.15.152:0/2855729018 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f68d00f0820 con 0x7f68d8106f10 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68dd181640 1 --2- 172.21.15.152:0/3076606405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045060 0x5562c1045440 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f68c800bf70 tx=0x7f68c800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8114683c413f254a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68de183640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68c40a2d70 0x7f68c40a5230 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f68d00bcc70 tx=0x7f68d008f050 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68c3fff640 1 -- 172.21.15.152:0/3076606405 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c8005020 con 0x5562c1045060 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68c3fff640 1 -- 172.21.15.152:0/3076606405 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68c80047a0 con 0x5562c1045060 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.007+0000 7f68c3fff640 1 -- 172.21.15.152:0/3076606405 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c800f6a0 con 0x5562c1045060 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.008+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3076606405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045060 msgr2=0x5562c1045440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.008+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3076606405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045060 0x5562c1045440 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f68c800bf70 tx=0x7f68c800b7e0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.008+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3076606405 shutdown_connections 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.008+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3076606405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1050240 0x5562c1052630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.008+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3076606405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045980 0x5562c104fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.008+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3076606405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045060 0x5562c1045440 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.008+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3076606405 >> 172.21.15.152:0/3076606405 conn(0x5562c10415f0 msgr2=0x5562c10419d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.008+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3076606405 shutdown_connections 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.008+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3076606405 wait complete. 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.008+0000 7f68e1fbf740 1 -- start start 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.008+0000 7f68e1fbf740 1 Processor -- start 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045060 0x5562c104d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045980 0x5562c104d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1050240 0x5562c104db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5562c1052e10 con 0x5562c1045980 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5562c0f32f10 con 0x5562c1050240 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5562c1052f90 con 0x5562c1045060 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68e1fbf740 10 client.0 _ll_register_callbacks cb 0x5562c0f56db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:38.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68dd982640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045980 0x5562c104d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68dd982640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045980 0x5562c104d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51426/0 (socket says 172.21.15.152:51426) 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68dd982640 1 -- 172.21.15.152:0/3448148669 learned_addr learned my addr 172.21.15.152:0/3448148669 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68dd181640 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045060 0x5562c104d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68dd982640 1 -- 172.21.15.152:0/3448148669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045060 msgr2=0x5562c104d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68dd982640 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045060 0x5562c104d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68dd982640 1 -- 172.21.15.152:0/3448148669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1050240 msgr2=0x5562c104db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68dd982640 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1050240 0x5562c104db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68dd982640 1 -- 172.21.15.152:0/3448148669 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562c0cb9580 con 0x5562c1045980 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68dd181640 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045060 0x5562c104d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68dd982640 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045980 0x5562c104d5f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f68d4011880 tx=0x7f68d4011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafc26309471f0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.009+0000 7f68c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:38.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68c17fa640 1 -- 172.21.15.152:0/3448148669 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d400f9a0 con 0x5562c1045980 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68c17fa640 1 -- 172.21.15.152:0/3448148669 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f68d400fb40 con 0x5562c1045980 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3448148669 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68c80047a0 con 0x5562c1045980 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68c17fa640 1 -- 172.21.15.152:0/3448148669 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f68d400fd40 con 0x5562c1045980 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68e1fbf740 10 client.16953 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3448148669 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5562c0d83960 con 0x5562c1045980 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68c17fa640 1 -- 172.21.15.152:0/3448148669 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68c80047a0 con 0x5562c1045980 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68c17fa640 1 -- 172.21.15.152:0/3448148669 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f68d4020070 con 0x5562c1045980 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68e1fbf740 10 client.16953 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68e1fbf740 10 client.16953 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68e1fbf740 20 client.16953 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5562c105fde0 0x5562c1062200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68e1fbf740 4 client.16953 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:38.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.010+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3448148669 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562c0fb7b90 con 0x5562c105fde0 2024-09-11T22:10:38.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.011+0000 7f68dd181640 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5562c105fde0 0x5562c1062200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.011+0000 7f68dd181640 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5562c105fde0 0x5562c1062200 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57440f7c8d9a8f99 server_cookie=334641f3c6112e6 in_seq=0 out_seq=0 2024-09-11T22:10:38.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.011+0000 7f68c17fa640 10 client.16953 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68c17fa640 1 -- 172.21.15.152:0/3448148669 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5562c0fb7b90 con 0x5562c105fde0 2024-09-11T22:10:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68c17fa640 10 client.16953 handle_command_reply: tid=0 2024-09-11T22:10:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 1 client.16953 shutdown 2024-09-11T22:10:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3448148669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045980 msgr2=0x5562c104d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045980 0x5562c104d5f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f68d4011880 tx=0x7f68d4011d40 comp rx=0 tx=0).stop 2024-09-11T22:10:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3448148669 shutdown_connections 2024-09-11T22:10:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5562c105fde0 0x5562c1062200 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1050240 0x5562c104db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1045980 0x5562c104d5f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3448148669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045060 0x5562c104d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68c17fa640 0 client.16953 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:38.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3448148669 >> 172.21.15.152:0/3448148669 conn(0x5562c10415f0 msgr2=0x5562c10472d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:38.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3448148669 shutdown_connections 2024-09-11T22:10:38.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3448148669 wait complete. 2024-09-11T22:10:38.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.012+0000 7f68e1fbf740 20 client.16953 trim_cache size 0 max 16384 2024-09-11T22:10:38.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 Processor -- start 2024-09-11T22:10:38.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 -- start start 2024-09-11T22:10:38.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045060 0x5562c1047ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1045980 0x5562c1040640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c1067ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81b0150 con 0x5562c1050240 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81ada20 con 0x5562c1045980 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81ab870 con 0x5562c1045060 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd181640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c1067ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd181640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c1067ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51440/0 (socket says 172.21.15.152:51440) 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd181640 1 -- 172.21.15.152:0/3612153721 learned_addr learned my addr 172.21.15.152:0/3612153721 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd181640 1 --2- 172.21.15.152:0/3612153721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045060 0x5562c1047ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd982640 1 --2- 172.21.15.152:0/3612153721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1045980 0x5562c1040640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd181640 1 -- 172.21.15.152:0/3612153721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045060 msgr2=0x5562c1047ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd181640 1 --2- 172.21.15.152:0/3612153721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045060 0x5562c1047ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd181640 1 -- 172.21.15.152:0/3612153721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1045980 msgr2=0x5562c1040640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd181640 1 --2- 172.21.15.152:0/3612153721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1045980 0x5562c1040640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd181640 1 -- 172.21.15.152:0/3612153721 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c1044e70 con 0x5562c1050240 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd982640 1 --2- 172.21.15.152:0/3612153721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1045980 0x5562c1040640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68dd181640 1 --2- 172.21.15.152:0/3612153721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c1067ad0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f68c8006010 tx=0x7f68c8020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07932f94821cef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68c37fe640 1 -- 172.21.15.152:0/3612153721 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c8004220 con 0x5562c1050240 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68c37fe640 1 -- 172.21.15.152:0/3612153721 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68c800bca0 con 0x5562c1050240 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68c37fe640 1 -- 172.21.15.152:0/3612153721 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c80049c0 con 0x5562c1050240 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3612153721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 msgr2=0x5562c1067ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3612153721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c1067ad0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f68c8006010 tx=0x7f68c8020040 comp rx=0 tx=0).stop 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3612153721 shutdown_connections 2024-09-11T22:10:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3612153721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c1067ad0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3612153721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1045980 0x5562c1040640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/3612153721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045060 0x5562c1047ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3612153721 >> 172.21.15.152:0/3612153721 conn(0x5562c10415f0 msgr2=0x5562c103ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:38.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3612153721 shutdown_connections 2024-09-11T22:10:38.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.030+0000 7f68e1fbf740 1 -- 172.21.15.152:0/3612153721 wait complete. 2024-09-11T22:10:38.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68e1fbf740 1 -- start start 2024-09-11T22:10:38.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68e1fbf740 1 Processor -- start 2024-09-11T22:10:38.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1045060 0x5562c104a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045980 0x5562c104a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68e1fbf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c104ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81abee0 con 0x5562c1050240 2024-09-11T22:10:38.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81ad350 con 0x5562c1045060 2024-09-11T22:10:38.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68e1fbf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81ac5b0 con 0x5562c1045980 2024-09-11T22:10:38.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68e1fbf740 10 client.0 _ll_register_callbacks cb 0x7f68d4008cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:38.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68dd181640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c104ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68dd181640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c104ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51448/0 (socket says 172.21.15.152:51448) 2024-09-11T22:10:38.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68dd181640 1 -- 172.21.15.152:0/1327445418 learned_addr learned my addr 172.21.15.152:0/1327445418 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:38.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.031+0000 7f68dd181640 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1045060 0x5562c104a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68dd982640 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045980 0x5562c104a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68dd181640 1 -- 172.21.15.152:0/1327445418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045980 msgr2=0x5562c104a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:38.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68dd181640 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045980 0x5562c104a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68dd181640 1 -- 172.21.15.152:0/1327445418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1045060 msgr2=0x5562c104a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68dd181640 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1045060 0x5562c104a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68dd181640 1 -- 172.21.15.152:0/1327445418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562c10c9ca0 con 0x5562c1050240 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68dd181640 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c104ad30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f68c800bf40 tx=0x7f68c8012520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446136f9833f2c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68c17fa640 1 -- 172.21.15.152:0/1327445418 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c80037f0 con 0x5562c1050240 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68c17fa640 1 -- 172.21.15.152:0/1327445418 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f68c8003990 con 0x5562c1050240 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68e1fbf740 1 -- 172.21.15.152:0/1327445418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68c800bca0 con 0x5562c1050240 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68c17fa640 1 -- 172.21.15.152:0/1327445418 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f68c8003b90 con 0x5562c1050240 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68e1fbf740 10 client.16959 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68e1fbf740 1 -- 172.21.15.152:0/1327445418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5562c10caef0 con 0x5562c1050240 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68c17fa640 1 -- 172.21.15.152:0/1327445418 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68c800bca0 con 0x5562c1050240 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.032+0000 7f68c17fa640 1 -- 172.21.15.152:0/1327445418 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f68c8010460 con 0x5562c1050240 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.033+0000 7f68e1fbf740 10 client.16959 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:38.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.033+0000 7f68e1fbf740 10 client.16959 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:10:38.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.033+0000 7f68e1fbf740 20 client.16959 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:38.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.033+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5562c10cb360 0x5562c10cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:38.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.033+0000 7f68e1fbf740 4 client.16959 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "84ae6d10", "release": true, "await": true}] 2024-09-11T22:10:38.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.033+0000 7f68e1fbf740 1 -- 172.21.15.152:0/1327445418 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "84ae6d10", "release": true, "await": true}) -- 0x5562c0fb20a0 con 0x5562c10cb360 2024-09-11T22:10:38.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.033+0000 7f68dd982640 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5562c10cb360 0x5562c10cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:38.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.033+0000 7f68dd982640 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5562c10cb360 0x5562c10cd750 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a803c6427f8e1041 server_cookie=4f9e6d039595a5c7 in_seq=0 out_seq=0 2024-09-11T22:10:38.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.033+0000 7f68c17fa640 10 client.16959 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:38.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:37 smithi179 ceph-mon[35603]: pgmap v193: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 KiB/s wr, 9 op/s 2024-09-11T22:10:38.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.081+0000 7f68c17fa640 1 -- 172.21.15.152:0/1327445418 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5562c0fb20a0 con 0x5562c10cb360 2024-09-11T22:10:38.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.081+0000 7f68c17fa640 10 client.16959 handle_command_reply: tid=0 2024-09-11T22:10:38.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 1 client.16959 shutdown 2024-09-11T22:10:38.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 1 -- 172.21.15.152:0/1327445418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 msgr2=0x5562c104ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:38.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c104ad30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f68c800bf40 tx=0x7f68c8012520 comp rx=0 tx=0).stop 2024-09-11T22:10:38.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 1 -- 172.21.15.152:0/1327445418 shutdown_connections 2024-09-11T22:10:38.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5562c10cb360 0x5562c10cd750 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562c1050240 0x5562c104ad30 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562c1045980 0x5562c104a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68c17fa640 0 client.16959 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:38.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 1 --2- 172.21.15.152:0/1327445418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5562c1045060 0x5562c104a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 1 -- 172.21.15.152:0/1327445418 >> 172.21.15.152:0/1327445418 conn(0x5562c10415f0 msgr2=0x5562c1040750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:38.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 1 -- 172.21.15.152:0/1327445418 shutdown_connections 2024-09-11T22:10:38.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 1 -- 172.21.15.152:0/1327445418 wait complete. 2024-09-11T22:10:38.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.082+0000 7f68e1fbf740 20 client.16959 trim_cache size 0 max 16384 2024-09-11T22:10:38.085 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:10:38.085 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:10:38.085 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 24, 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "84ae6d10": { 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 24, 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 140.1, 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:10:38.086 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:10:38.087 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:10:38.087 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:10:38.087 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:10:38.087 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:10:38.087 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:38.087 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:38.087 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:38.087 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:38.087 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:10:38.087 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:10:38.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.083+0000 7f68dfbe6640 1 -- 172.21.15.152:0/2855729018 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68c40a2d70 msgr2=0x7f68c40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:38.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.083+0000 7f68dfbe6640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68c40a2d70 0x7f68c40a5230 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f68d00bcc70 tx=0x7f68d008f050 comp rx=0 tx=0).stop 2024-09-11T22:10:38.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.083+0000 7f68dfbe6640 1 -- 172.21.15.152:0/2855729018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d8106f10 msgr2=0x7f68d819cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:38.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.083+0000 7f68dfbe6640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d8106f10 0x7f68d819cb90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f68d0031a20 tx=0x7f68d0031a50 comp rx=0 tx=0).stop 2024-09-11T22:10:38.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.083+0000 7f68dfbe6640 1 -- 172.21.15.152:0/2855729018 shutdown_connections 2024-09-11T22:10:38.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.083+0000 7f68dfbe6640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68c40a2d70 0x7f68c40a5230 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.083+0000 7f68dfbe6640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d8106f10 0x7f68d819cb90 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.083+0000 7f68dfbe6640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f68d8102790 0x7f68d8198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.083+0000 7f68dfbe6640 1 --2- 172.21.15.152:0/2855729018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68d8101de0 0x7f68d81982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:38.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.083+0000 7f68dfbe6640 1 -- 172.21.15.152:0/2855729018 >> 172.21.15.152:0/2855729018 conn(0x7f68d80fd8c0 msgr2=0x7f68d80fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:38.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.084+0000 7f68dfbe6640 1 -- 172.21.15.152:0/2855729018 shutdown_connections 2024-09-11T22:10:38.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:38.084+0000 7f68dfbe6640 1 -- 172.21.15.152:0/2855729018 wait complete. 2024-09-11T22:10:39.026 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '84ae6d10', total seconds elapsed: 23.6 2024-09-11T22:10:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:39 smithi179 ceph-mon[35603]: pgmap v194: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 334 KiB/s wr, 36 op/s 2024-09-11T22:10:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 305.0 s, 1324.2 tps, lat 284.484 ms stddev 2087.018 2024-09-11T22:10:39.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:39 smithi193 ceph-mon[35545]: pgmap v194: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 334 KiB/s wr, 36 op/s 2024-09-11T22:10:39.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:39 smithi152 ceph-mon[31188]: pgmap v194: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 334 KiB/s wr, 36 op/s 2024-09-11T22:10:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:41 smithi179 ceph-mon[35603]: pgmap v195: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 328 KiB/s wr, 31 op/s 2024-09-11T22:10:41.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:41 smithi193 ceph-mon[35545]: pgmap v195: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 328 KiB/s wr, 31 op/s 2024-09-11T22:10:41.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:41 smithi152 ceph-mon[31188]: pgmap v195: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 328 KiB/s wr, 31 op/s 2024-09-11T22:10:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.337+0000 7fa0c35e4640 1 -- 172.21.15.152:0/829356217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0bc077040 msgr2=0x7fa0bc112450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.337+0000 7fa0c35e4640 1 --2- 172.21.15.152:0/829356217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0bc077040 0x7fa0bc112450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009900 tx=0x7fa0ac02a400 comp rx=0 tx=0).stop 2024-09-11T22:10:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.337+0000 7fa0c35e4640 1 -- 172.21.15.152:0/829356217 shutdown_connections 2024-09-11T22:10:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.337+0000 7fa0c35e4640 1 --2- 172.21.15.152:0/829356217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0bc112990 0x7fa0bc114d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.337+0000 7fa0c35e4640 1 --2- 172.21.15.152:0/829356217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0bc077040 0x7fa0bc112450 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.337+0000 7fa0c35e4640 1 --2- 172.21.15.152:0/829356217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0bc076720 0x7fa0bc076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.337+0000 7fa0c35e4640 1 -- 172.21.15.152:0/829356217 >> 172.21.15.152:0/829356217 conn(0x7fa0bc0ff9b0 msgr2=0x7fa0bc101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.338+0000 7fa0c35e4640 1 -- 172.21.15.152:0/829356217 shutdown_connections 2024-09-11T22:10:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.338+0000 7fa0c35e4640 1 -- 172.21.15.152:0/829356217 wait complete. 2024-09-11T22:10:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.339+0000 7fa0c35e4640 1 Processor -- start 2024-09-11T22:10:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.339+0000 7fa0c35e4640 1 -- start start 2024-09-11T22:10:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.339+0000 7fa0c35e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0bc076720 0x7fa0bc1a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.339+0000 7fa0c35e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0bc077040 0x7fa0bc1a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.339+0000 7fa0c35e4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0bc112990 0x7fa0bc19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.339+0000 7fa0c35e4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc118530 con 0x7fa0bc112990 2024-09-11T22:10:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.339+0000 7fa0c35e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc1183b0 con 0x7fa0bc076720 2024-09-11T22:10:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.339+0000 7fa0c35e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc1186b0 con 0x7fa0bc077040 2024-09-11T22:10:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.340+0000 7fa0c1380640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0bc076720 0x7fa0bc1a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.340+0000 7fa0c0b7f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0bc077040 0x7fa0bc1a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.340+0000 7fa0c1380640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0bc076720 0x7fa0bc1a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:49718/0 (socket says 172.21.15.152:49718) 2024-09-11T22:10:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.340+0000 7fa0c1380640 1 -- 172.21.15.152:0/502565218 learned_addr learned my addr 172.21.15.152:0/502565218 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.340+0000 7fa0c1b81640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0bc112990 0x7fa0bc19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.340+0000 7fa0c1380640 1 -- 172.21.15.152:0/502565218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0bc077040 msgr2=0x7fa0bc1a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.340+0000 7fa0c1380640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0bc077040 0x7fa0bc1a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.340+0000 7fa0c1380640 1 -- 172.21.15.152:0/502565218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0bc112990 msgr2=0x7fa0bc19e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.340+0000 7fa0c1380640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0bc112990 0x7fa0bc19e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.340+0000 7fa0c1380640 1 -- 172.21.15.152:0/502565218 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0bc19ef90 con 0x7fa0bc076720 2024-09-11T22:10:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.340+0000 7fa0c1380640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0bc076720 0x7fa0bc1a4650 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800d950 tx=0x7fa0b800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.341+0000 7fa0b27fc640 1 -- 172.21.15.152:0/502565218 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8017070 con 0x7fa0bc076720 2024-09-11T22:10:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.341+0000 7fa0b27fc640 1 -- 172.21.15.152:0/502565218 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b8009c30 con 0x7fa0bc076720 2024-09-11T22:10:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.341+0000 7fa0b27fc640 1 -- 172.21.15.152:0/502565218 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800f6b0 con 0x7fa0bc076720 2024-09-11T22:10:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.341+0000 7fa0c35e4640 1 -- 172.21.15.152:0/502565218 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0bc19f280 con 0x7fa0bc076720 2024-09-11T22:10:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.341+0000 7fa0c35e4640 1 -- 172.21.15.152:0/502565218 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0bc1ab4a0 con 0x7fa0bc076720 2024-09-11T22:10:43.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.344+0000 7fa0b27fc640 1 -- 172.21.15.152:0/502565218 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa0b80109d0 con 0x7fa0bc076720 2024-09-11T22:10:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.345+0000 7fa0b27fc640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa0a80a2ef0 0x7fa0a80a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.346+0000 7fa0b27fc640 1 -- 172.21.15.152:0/502565218 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa0b80cf030 con 0x7fa0bc076720 2024-09-11T22:10:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.348+0000 7fa0c645c740 1 Processor -- start 2024-09-11T22:10:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.348+0000 7fa0c645c740 1 -- start start 2024-09-11T22:10:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.349+0000 7fa0c645c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5017ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.349+0000 7fa0c645c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5018410 0x5583e5022770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.349+0000 7fa0c645c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5022cb0 0x5583e50250a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.349+0000 7fa0c645c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5583e4f7c2f0 con 0x5583e5017af0 2024-09-11T22:10:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.349+0000 7fa0c645c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5583e4f24270 con 0x5583e5022cb0 2024-09-11T22:10:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.349+0000 7fa0c645c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5583e4f782b0 con 0x5583e5018410 2024-09-11T22:10:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.350+0000 7fa0c1380640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5017ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.350+0000 7fa0c1380640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5017ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51470/0 (socket says 172.21.15.152:51470) 2024-09-11T22:10:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.350+0000 7fa0c1380640 1 -- 172.21.15.152:0/979546929 learned_addr learned my addr 172.21.15.152:0/979546929 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.351+0000 7fa0c1380640 1 -- 172.21.15.152:0/979546929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5018410 msgr2=0x5583e5022770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:10:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.351+0000 7fa0c1380640 1 --2- 172.21.15.152:0/979546929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5018410 0x5583e5022770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.351+0000 7fa0c1380640 1 -- 172.21.15.152:0/979546929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5022cb0 msgr2=0x5583e50250a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:10:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.351+0000 7fa0c1380640 1 --2- 172.21.15.152:0/979546929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5022cb0 0x5583e50250a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.351+0000 7fa0c1380640 1 -- 172.21.15.152:0/979546929 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e4f23340 con 0x5583e5017af0 2024-09-11T22:10:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.351+0000 7fa0c1380640 1 --2- 172.21.15.152:0/979546929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5017ed0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009610 tx=0x7fa0b8009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7787aee2fbb87978 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.352+0000 7fa0c0b7f640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa0a80a2ef0 0x7fa0a80a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.356+0000 7fa0a77fe640 1 -- 172.21.15.152:0/979546929 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8020040 con 0x5583e5017af0 2024-09-11T22:10:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.356+0000 7fa0a77fe640 1 -- 172.21.15.152:0/979546929 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b80a4130 con 0x5583e5017af0 2024-09-11T22:10:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.357+0000 7fa0c645c740 1 -- 172.21.15.152:0/979546929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 msgr2=0x5583e5017ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.357+0000 7fa0c645c740 1 --2- 172.21.15.152:0/979546929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5017ed0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009610 tx=0x7fa0b8009de0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.358+0000 7fa0c645c740 1 -- 172.21.15.152:0/979546929 shutdown_connections 2024-09-11T22:10:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.358+0000 7fa0c645c740 1 --2- 172.21.15.152:0/979546929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5022cb0 0x5583e50250a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.358+0000 7fa0c645c740 1 --2- 172.21.15.152:0/979546929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5018410 0x5583e5022770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.358+0000 7fa0c645c740 1 --2- 172.21.15.152:0/979546929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5017ed0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.358+0000 7fa0c645c740 1 -- 172.21.15.152:0/979546929 >> 172.21.15.152:0/979546929 conn(0x5583e5014060 msgr2=0x5583e5014440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.361+0000 7fa0c0b7f640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa0a80a2ef0 0x7fa0a80a53b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac005ab0 tx=0x7fa0ac02a900 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.363+0000 7fa0c645c740 1 -- 172.21.15.152:0/979546929 shutdown_connections 2024-09-11T22:10:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.365+0000 7fa0c645c740 1 -- 172.21.15.152:0/979546929 wait complete. 2024-09-11T22:10:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.365+0000 7fa0c645c740 1 -- start start 2024-09-11T22:10:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.365+0000 7fa0c645c740 1 Processor -- start 2024-09-11T22:10:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.366+0000 7fa0c645c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5017af0 0x5583e501fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.366+0000 7fa0c645c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5018410 0x5583e50200b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.366+0000 7fa0c645c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5022cb0 0x5583e50205f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.366+0000 7fa0c645c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5583e50368d0 con 0x5583e5022cb0 2024-09-11T22:10:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.366+0000 7fa0c645c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5583e4f05290 con 0x5583e5018410 2024-09-11T22:10:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.366+0000 7fa0c645c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5583e5036a50 con 0x5583e5017af0 2024-09-11T22:10:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.366+0000 7fa0c645c740 10 client.0 _ll_register_callbacks cb 0x5583e4f36140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.366+0000 7fa0c1380640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5017af0 0x5583e501fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.366+0000 7fa0c1380640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5017af0 0x5583e501fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52360/0 (socket says 172.21.15.152:52360) 2024-09-11T22:10:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.366+0000 7fa0c1380640 1 -- 172.21.15.152:0/617177593 learned_addr learned my addr 172.21.15.152:0/617177593 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.366+0000 7fa0c1b81640 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5022cb0 0x5583e50205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.367+0000 7fa0c0b7f640 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5018410 0x5583e50200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.367+0000 7fa0c1380640 1 -- 172.21.15.152:0/617177593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5018410 msgr2=0x5583e50200b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.367+0000 7fa0c1380640 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5018410 0x5583e50200b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.367+0000 7fa0c1380640 1 -- 172.21.15.152:0/617177593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5022cb0 msgr2=0x5583e50205f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.367+0000 7fa0c1380640 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5022cb0 0x5583e50205f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.367+0000 7fa0c1380640 1 -- 172.21.15.152:0/617177593 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583e4c8f210 con 0x5583e5017af0 2024-09-11T22:10:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.367+0000 7fa0c1380640 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5017af0 0x5583e501fb70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8097f40 tx=0x7fa0b800dfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba7d2732f33f3a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.367+0000 7fa0a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:10:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.367+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/617177593 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8020070 con 0x5583e5017af0 2024-09-11T22:10:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.368+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/617177593 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa0b80974c0 con 0x5583e5017af0 2024-09-11T22:10:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.370+0000 7fa0c645c740 1 -- 172.21.15.152:0/617177593 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0b80a4130 con 0x5583e5017af0 2024-09-11T22:10:43.371 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.370+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/617177593 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa0b80b4200 con 0x5583e5017af0 2024-09-11T22:10:43.371 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.370+0000 7fa0c645c740 10 client.26536 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:43.371 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.370+0000 7fa0c645c740 1 -- 172.21.15.152:0/617177593 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5583e4d5b620 con 0x5583e5017af0 2024-09-11T22:10:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.371+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/617177593 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b80a4130 con 0x5583e5017af0 2024-09-11T22:10:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.371+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/617177593 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa0b80a0a00 con 0x5583e5017af0 2024-09-11T22:10:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.371+0000 7fa0c645c740 10 client.26536 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.371+0000 7fa0c645c740 10 client.26536 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.371+0000 7fa0c645c740 20 client.26536 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.371+0000 7fa0c645c740 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5583e5039760 0x5583e503bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.371+0000 7fa0c645c740 4 client.26536 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.371+0000 7fa0c645c740 1 -- 172.21.15.152:0/617177593 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583e4f89a20 con 0x5583e5039760 2024-09-11T22:10:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.372+0000 7fa0c0b7f640 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5583e5039760 0x5583e503bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.373+0000 7fa0c0b7f640 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5583e5039760 0x5583e503bb50 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=376b446369016b68 server_cookie=a9a1ad6cc47d620d in_seq=0 out_seq=0 2024-09-11T22:10:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.373+0000 7fa0a4ff9640 10 client.26536 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.374+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/617177593 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583e4f89a20 con 0x5583e5039760 2024-09-11T22:10:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.374+0000 7fa0a4ff9640 10 client.26536 handle_command_reply: tid=0 2024-09-11T22:10:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.374+0000 7fa0c645c740 1 client.26536 shutdown 2024-09-11T22:10:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.374+0000 7fa0c645c740 1 -- 172.21.15.152:0/617177593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5017af0 msgr2=0x5583e501fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.374+0000 7fa0c645c740 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5017af0 0x5583e501fb70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8097f40 tx=0x7fa0b800dfa0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.375+0000 7fa0c645c740 1 -- 172.21.15.152:0/617177593 shutdown_connections 2024-09-11T22:10:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.375+0000 7fa0c645c740 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5583e5039760 0x5583e503bb50 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.375+0000 7fa0c645c740 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5022cb0 0x5583e50205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.375+0000 7fa0c645c740 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5018410 0x5583e50200b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.375+0000 7fa0c645c740 1 --2- 172.21.15.152:0/617177593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5017af0 0x5583e501fb70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.375+0000 7fa0c645c740 1 -- 172.21.15.152:0/617177593 >> 172.21.15.152:0/617177593 conn(0x5583e5014060 msgr2=0x5583e5019d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.375+0000 7fa0a4ff9640 0 client.26536 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.375+0000 7fa0c645c740 1 -- 172.21.15.152:0/617177593 shutdown_connections 2024-09-11T22:10:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.375+0000 7fa0c645c740 1 -- 172.21.15.152:0/617177593 wait complete. 2024-09-11T22:10:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.376+0000 7fa0c645c740 20 client.26536 trim_cache size 0 max 16384 2024-09-11T22:10:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.402+0000 7fa0c645c740 1 Processor -- start 2024-09-11T22:10:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.402+0000 7fa0c645c740 1 -- start start 2024-09-11T22:10:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.402+0000 7fa0c645c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5021ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.402+0000 7fa0c645c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5018410 0x5583e50203f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.402+0000 7fa0c1380640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5021ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.402+0000 7fa0c1380640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5021ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36406/0 (socket says 172.21.15.152:36406) 2024-09-11T22:10:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.402+0000 7fa0c1380640 1 -- 172.21.15.152:0/927381321 learned_addr learned my addr 172.21.15.152:0/927381321 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.402+0000 7fa0c645c740 1 --2- 172.21.15.152:0/927381321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5022cb0 0x5583e501cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.402+0000 7fa0c645c740 1 -- 172.21.15.152:0/927381321 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc1077a0 con 0x5583e5017af0 2024-09-11T22:10:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.402+0000 7fa0c0b7f640 1 --2- 172.21.15.152:0/927381321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5018410 0x5583e50203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.402+0000 7fa0c645c740 1 -- 172.21.15.152:0/927381321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc105070 con 0x5583e5018410 2024-09-11T22:10:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.403+0000 7fa0c645c740 1 -- 172.21.15.152:0/927381321 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc076b00 con 0x5583e5022cb0 2024-09-11T22:10:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.403+0000 7fa0c1b81640 1 --2- 172.21.15.152:0/927381321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5022cb0 0x5583e501cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.404+0000 7fa0c1380640 1 -- 172.21.15.152:0/927381321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5022cb0 msgr2=0x5583e501cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.404+0000 7fa0c1380640 1 --2- 172.21.15.152:0/927381321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5022cb0 0x5583e501cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.404+0000 7fa0c1380640 1 -- 172.21.15.152:0/927381321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5018410 msgr2=0x5583e50203f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.404+0000 7fa0c1380640 1 --2- 172.21.15.152:0/927381321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5018410 0x5583e50203f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.404+0000 7fa0c1380640 1 -- 172.21.15.152:0/927381321 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e5013e90 con 0x5583e5017af0 2024-09-11T22:10:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.404+0000 7fa0c0b7f640 1 --2- 172.21.15.152:0/927381321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5018410 0x5583e50203f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.404+0000 7fa0c1380640 1 --2- 172.21.15.152:0/927381321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5021ea0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa0b809b500 tx=0x7fa0b8099a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0af2eb5178dd7ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.404+0000 7fa0a6ffd640 1 -- 172.21.15.152:0/927381321 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8020070 con 0x5583e5017af0 2024-09-11T22:10:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.404+0000 7fa0a6ffd640 1 -- 172.21.15.152:0/927381321 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b80a4130 con 0x5583e5017af0 2024-09-11T22:10:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.404+0000 7fa0a6ffd640 1 -- 172.21.15.152:0/927381321 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80106c0 con 0x5583e5017af0 2024-09-11T22:10:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.405+0000 7fa0c645c740 1 -- 172.21.15.152:0/927381321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 msgr2=0x5583e5021ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:43.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.405+0000 7fa0c645c740 1 --2- 172.21.15.152:0/927381321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5021ea0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa0b809b500 tx=0x7fa0b8099a80 comp rx=0 tx=0).stop 2024-09-11T22:10:43.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.407+0000 7fa0c645c740 1 -- 172.21.15.152:0/927381321 shutdown_connections 2024-09-11T22:10:43.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.407+0000 7fa0c645c740 1 --2- 172.21.15.152:0/927381321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5022cb0 0x5583e501cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.407+0000 7fa0c645c740 1 --2- 172.21.15.152:0/927381321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5018410 0x5583e50203f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.407+0000 7fa0c645c740 1 --2- 172.21.15.152:0/927381321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e5021ea0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.407+0000 7fa0c645c740 1 -- 172.21.15.152:0/927381321 >> 172.21.15.152:0/927381321 conn(0x5583e5014060 msgr2=0x5583e5019d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.407+0000 7fa0c645c740 1 -- 172.21.15.152:0/927381321 shutdown_connections 2024-09-11T22:10:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.407+0000 7fa0c645c740 1 -- 172.21.15.152:0/927381321 wait complete. 2024-09-11T22:10:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.407+0000 7fa0c645c740 1 -- start start 2024-09-11T22:10:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.407+0000 7fa0c645c740 1 Processor -- start 2024-09-11T22:10:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.408+0000 7fa0c645c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e503edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.408+0000 7fa0c645c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5018410 0x5583e503c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.408+0000 7fa0c645c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5022cb0 0x5583e503c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.408+0000 7fa0c645c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc073d50 con 0x5583e5017af0 2024-09-11T22:10:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.408+0000 7fa0c645c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc1049a0 con 0x5583e5022cb0 2024-09-11T22:10:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.408+0000 7fa0c645c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc103c00 con 0x5583e5018410 2024-09-11T22:10:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.408+0000 7fa0c645c740 10 client.0 _ll_register_callbacks cb 0x7fa0b809aed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.408+0000 7fa0c0b7f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5018410 0x5583e503c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.409+0000 7fa0c0b7f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5018410 0x5583e503c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52388/0 (socket says 172.21.15.152:52388) 2024-09-11T22:10:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.409+0000 7fa0c0b7f640 1 -- 172.21.15.152:0/3259409241 learned_addr learned my addr 172.21.15.152:0/3259409241 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.409+0000 7fa0c1b81640 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5022cb0 0x5583e503c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.409+0000 7fa0c1380640 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e503edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.409+0000 7fa0c0b7f640 1 -- 172.21.15.152:0/3259409241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5022cb0 msgr2=0x5583e503c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.409+0000 7fa0c0b7f640 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5022cb0 0x5583e503c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.409+0000 7fa0c0b7f640 1 -- 172.21.15.152:0/3259409241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 msgr2=0x5583e503edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.409+0000 7fa0c0b7f640 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e503edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.409+0000 7fa0c0b7f640 1 -- 172.21.15.152:0/3259409241 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583e500f2d0 con 0x5583e5018410 2024-09-11T22:10:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.409+0000 7fa0c0b7f640 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5018410 0x5583e503c160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009230 tx=0x7fa0ac03d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd08188948e949ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.410+0000 7fa0a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:10:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.410+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/3259409241 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac035040 con 0x5583e5018410 2024-09-11T22:10:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.410+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/3259409241 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fa0ac0048c0 con 0x5583e5018410 2024-09-11T22:10:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.410+0000 7fa0c645c740 1 -- 172.21.15.152:0/3259409241 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0b80a4130 con 0x5583e5018410 2024-09-11T22:10:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.411+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/3259409241 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa0ac004ac0 con 0x5583e5018410 2024-09-11T22:10:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.411+0000 7fa0c645c740 10 client.26542 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.411+0000 7fa0c645c740 1 -- 172.21.15.152:0/3259409241 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5583e5022700 con 0x5583e5018410 2024-09-11T22:10:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.411+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/3259409241 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b80a4130 con 0x5583e5018410 2024-09-11T22:10:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.411+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/3259409241 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa0ac060070 con 0x5583e5018410 2024-09-11T22:10:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.411+0000 7fa0c645c740 10 client.26542 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.411+0000 7fa0c645c740 10 client.26542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.411+0000 7fa0c645c740 20 client.26542 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.411+0000 7fa0c645c740 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5583e50d05d0 0x5583e50d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.411+0000 7fa0c645c740 4 client.26542 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:10:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.411+0000 7fa0c645c740 1 -- 172.21.15.152:0/3259409241 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5583e4f83d70 con 0x5583e50d05d0 2024-09-11T22:10:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.412+0000 7fa0c1380640 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5583e50d05d0 0x5583e50d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.413+0000 7fa0c1380640 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5583e50d05d0 0x5583e50d29f0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28fb36ff65c351b1 server_cookie=d62bc6a1cf4fbd01 in_seq=0 out_seq=0 2024-09-11T22:10:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.413+0000 7fa0a4ff9640 10 client.26542 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.416+0000 7fa0a4ff9640 1 -- 172.21.15.152:0/3259409241 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5583e4f83d70 con 0x5583e50d05d0 2024-09-11T22:10:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.416+0000 7fa0a4ff9640 10 client.26542 handle_command_reply: tid=0 2024-09-11T22:10:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.417+0000 7fa0c645c740 1 client.26542 shutdown 2024-09-11T22:10:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.417+0000 7fa0c645c740 1 -- 172.21.15.152:0/3259409241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5018410 msgr2=0x5583e503c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.417+0000 7fa0c645c740 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5018410 0x5583e503c160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009230 tx=0x7fa0ac03d000 comp rx=0 tx=0).stop 2024-09-11T22:10:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.418+0000 7fa0c645c740 1 -- 172.21.15.152:0/3259409241 shutdown_connections 2024-09-11T22:10:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.418+0000 7fa0c645c740 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5583e50d05d0 0x5583e50d29f0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.418+0000 7fa0c645c740 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5583e5022cb0 0x5583e503c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.418+0000 7fa0c645c740 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5583e5018410 0x5583e503c160 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.418+0000 7fa0c645c740 1 --2- 172.21.15.152:0/3259409241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583e5017af0 0x5583e503edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.418+0000 7fa0c645c740 1 -- 172.21.15.152:0/3259409241 >> 172.21.15.152:0/3259409241 conn(0x5583e5014060 msgr2=0x5583e5019550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.418+0000 7fa0a4ff9640 0 client.26542 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.420+0000 7fa0c645c740 1 -- 172.21.15.152:0/3259409241 shutdown_connections 2024-09-11T22:10:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.420+0000 7fa0c645c740 1 -- 172.21.15.152:0/3259409241 wait complete. 2024-09-11T22:10:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:10:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:10:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:10:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:10:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.420+0000 7fa0c645c740 20 client.26542 trim_cache size 0 max 16384 2024-09-11T22:10:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.423+0000 7fa0c35e4640 1 -- 172.21.15.152:0/502565218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa0a80a2ef0 msgr2=0x7fa0a80a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.423+0000 7fa0c35e4640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa0a80a2ef0 0x7fa0a80a53b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac005ab0 tx=0x7fa0ac02a900 comp rx=0 tx=0).stop 2024-09-11T22:10:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.423+0000 7fa0c35e4640 1 -- 172.21.15.152:0/502565218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0bc076720 msgr2=0x7fa0bc1a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.423+0000 7fa0c35e4640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0bc076720 0x7fa0bc1a4650 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800d950 tx=0x7fa0b800de10 comp rx=0 tx=0).stop 2024-09-11T22:10:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.423+0000 7fa0c35e4640 1 -- 172.21.15.152:0/502565218 shutdown_connections 2024-09-11T22:10:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.423+0000 7fa0c35e4640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa0a80a2ef0 0x7fa0a80a53b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.423+0000 7fa0c35e4640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0bc112990 0x7fa0bc19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.423+0000 7fa0c35e4640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0bc077040 0x7fa0bc1a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.423+0000 7fa0c35e4640 1 --2- 172.21.15.152:0/502565218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0bc076720 0x7fa0bc1a4650 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.423+0000 7fa0c35e4640 1 -- 172.21.15.152:0/502565218 >> 172.21.15.152:0/502565218 conn(0x7fa0bc0ff9b0 msgr2=0x7fa0bc101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.425+0000 7fa0c35e4640 1 -- 172.21.15.152:0/502565218 shutdown_connections 2024-09-11T22:10:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:43.425+0000 7fa0c35e4640 1 -- 172.21.15.152:0/502565218 wait complete. 2024-09-11T22:10:43.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:43 smithi179 ceph-mon[35603]: pgmap v196: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 406 op/s 2024-09-11T22:10:43.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:43 smithi193 ceph-mon[35545]: pgmap v196: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 406 op/s 2024-09-11T22:10:43.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:43 smithi152 ceph-mon[31188]: pgmap v196: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 406 op/s 2024-09-11T22:10:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 310.0 s, 4773.2 tps, lat 20.995 ms stddev 25.101 2024-09-11T22:10:45.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:45 smithi179 ceph-mon[35603]: pgmap v197: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 401 op/s 2024-09-11T22:10:45.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:45 smithi193 ceph-mon[35545]: pgmap v197: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 401 op/s 2024-09-11T22:10:45.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:45 smithi152 ceph-mon[31188]: pgmap v197: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 401 op/s 2024-09-11T22:10:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:47 smithi179 ceph-mon[35603]: pgmap v198: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 401 op/s 2024-09-11T22:10:47.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:47 smithi193 ceph-mon[35545]: pgmap v198: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 401 op/s 2024-09-11T22:10:47.982 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:47 smithi152 ceph-mon[31188]: pgmap v198: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 401 op/s 2024-09-11T22:10:49.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 315.0 s, 3694.6 tps, lat 26.985 ms stddev 29.325 2024-09-11T22:10:50.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:50 smithi179 ceph-mon[35603]: pgmap v199: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.6 MiB/s wr, 741 op/s 2024-09-11T22:10:50.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:50 smithi193 ceph-mon[35545]: pgmap v199: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.6 MiB/s wr, 741 op/s 2024-09-11T22:10:50.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:50 smithi152 ceph-mon[31188]: pgmap v199: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.6 MiB/s wr, 741 op/s 2024-09-11T22:10:52.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:52 smithi179 ceph-mon[35603]: pgmap v200: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 MiB/s wr, 714 op/s 2024-09-11T22:10:52.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:52 smithi193 ceph-mon[35545]: pgmap v200: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 MiB/s wr, 714 op/s 2024-09-11T22:10:52.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:52 smithi152 ceph-mon[31188]: pgmap v200: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 MiB/s wr, 714 op/s 2024-09-11T22:10:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 320.0 s, 4879.0 tps, lat 20.559 ms stddev 23.607 2024-09-11T22:10:54.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:54 smithi193 ceph-mon[35545]: pgmap v201: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-09-11T22:10:54.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:54 smithi152 ceph-mon[31188]: pgmap v201: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-09-11T22:10:55.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:54 smithi179 ceph-mon[35603]: pgmap v201: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-09-11T22:10:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.570+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/1121090012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a24109bc0 msgr2=0x7f8a241120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.570+0000 7f8a2b5c4640 1 --2- 172.21.15.152:0/1121090012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a24109bc0 0x7f8a241120a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009900 tx=0x7f8a1402a4b0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.571+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/1121090012 shutdown_connections 2024-09-11T22:10:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.571+0000 7f8a2b5c4640 1 --2- 172.21.15.152:0/1121090012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a241126f0 0x7f8a24114b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.571+0000 7f8a2b5c4640 1 --2- 172.21.15.152:0/1121090012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a24109bc0 0x7f8a241120a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.571+0000 7f8a2b5c4640 1 --2- 172.21.15.152:0/1121090012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a241092a0 0x7f8a24109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.571+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/1121090012 >> 172.21.15.152:0/1121090012 conn(0x7f8a24077ac0 msgr2=0x7f8a24079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.571+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/1121090012 shutdown_connections 2024-09-11T22:10:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.571+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/1121090012 wait complete. 2024-09-11T22:10:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.572+0000 7f8a2b5c4640 1 Processor -- start 2024-09-11T22:10:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.572+0000 7f8a2b5c4640 1 -- start start 2024-09-11T22:10:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.573+0000 7f8a2b5c4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a241092a0 0x7f8a240846e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.573+0000 7f8a2b5c4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a24109bc0 0x7f8a24084c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.573+0000 7f8a2b5c4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a241126f0 0x7f8a2407d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.573+0000 7f8a2b5c4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8a24118580 con 0x7f8a24109bc0 2024-09-11T22:10:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.573+0000 7f8a2b5c4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a24118400 con 0x7f8a241092a0 2024-09-11T22:10:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.573+0000 7f8a2b5c4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8a24118700 con 0x7f8a241126f0 2024-09-11T22:10:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.574+0000 7f8a29360640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a241092a0 0x7f8a240846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.574+0000 7f8a28b5f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a24109bc0 0x7f8a24084c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.574+0000 7f8a28b5f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a24109bc0 0x7f8a24084c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49408/0 (socket says 172.21.15.152:49408) 2024-09-11T22:10:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.574+0000 7f8a28b5f640 1 -- 172.21.15.152:0/2514360716 learned_addr learned my addr 172.21.15.152:0/2514360716 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.574+0000 7f8a29b61640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a241126f0 0x7f8a2407d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.574+0000 7f8a28b5f640 1 -- 172.21.15.152:0/2514360716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a241126f0 msgr2=0x7f8a2407d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.574+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a241126f0 0x7f8a2407d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.574+0000 7f8a28b5f640 1 -- 172.21.15.152:0/2514360716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a241092a0 msgr2=0x7f8a240846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.574+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a241092a0 0x7f8a240846e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.574+0000 7f8a28b5f640 1 -- 172.21.15.152:0/2514360716 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2407e0f0 con 0x7f8a24109bc0 2024-09-11T22:10:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.575+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a24109bc0 0x7f8a24084c20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8a1402aa20 tx=0x7f8a14003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.576+0000 7f8a1a7fc640 1 -- 172.21.15.152:0/2514360716 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1403f070 con 0x7f8a24109bc0 2024-09-11T22:10:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.576+0000 7f8a1a7fc640 1 -- 172.21.15.152:0/2514360716 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a14031c90 con 0x7f8a24109bc0 2024-09-11T22:10:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.576+0000 7f8a1a7fc640 1 -- 172.21.15.152:0/2514360716 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14035030 con 0x7f8a24109bc0 2024-09-11T22:10:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.578+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/2514360716 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2407e380 con 0x7f8a24109bc0 2024-09-11T22:10:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.578+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/2514360716 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a240823e0 con 0x7f8a24109bc0 2024-09-11T22:10:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.582+0000 7f8a2e43e740 1 Processor -- start 2024-09-11T22:10:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.582+0000 7f8a2e43e740 1 -- start start 2024-09-11T22:10:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.582+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ec1af0 0x565113ec1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.582+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec2410 0x565113ecc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.582+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ecccb0 0x565113ecf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.582+0000 7f8a2e43e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x565113e262f0 con 0x565113ec2410 2024-09-11T22:10:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.582+0000 7f8a2e43e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x565113dce270 con 0x565113ec1af0 2024-09-11T22:10:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.582+0000 7f8a2e43e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x565113e222b0 con 0x565113ecccb0 2024-09-11T22:10:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.583+0000 7f8a29360640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec2410 0x565113ecc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.583+0000 7f8a29360640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec2410 0x565113ecc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49416/0 (socket says 172.21.15.152:49416) 2024-09-11T22:10:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.583+0000 7f8a29360640 1 -- 172.21.15.152:0/2802300384 learned_addr learned my addr 172.21.15.152:0/2802300384 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.583+0000 7f8a1a7fc640 1 -- 172.21.15.152:0/2514360716 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8a14042070 con 0x7f8a24109bc0 2024-09-11T22:10:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.583+0000 7f8a29360640 1 -- 172.21.15.152:0/2802300384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ecccb0 msgr2=0x565113ecf0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:10:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.583+0000 7f8a29360640 1 --2- 172.21.15.152:0/2802300384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ecccb0 0x565113ecf0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.583+0000 7f8a29360640 1 -- 172.21.15.152:0/2802300384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ec1af0 msgr2=0x565113ec1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.583+0000 7f8a29360640 1 --2- 172.21.15.152:0/2802300384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ec1af0 0x565113ec1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.583+0000 7f8a29360640 1 -- 172.21.15.152:0/2802300384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565113dcd340 con 0x565113ec2410 2024-09-11T22:10:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.583+0000 7f8a29360640 1 --2- 172.21.15.152:0/2802300384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec2410 0x565113ecc770 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009f30 tx=0x7f8a1c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3242ad0525d0494c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.584+0000 7f8a0f7fe640 1 -- 172.21.15.152:0/2802300384 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c011640 con 0x565113ec2410 2024-09-11T22:10:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.584+0000 7f8a0f7fe640 1 -- 172.21.15.152:0/2802300384 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a1c011cc0 con 0x565113ec2410 2024-09-11T22:10:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.584+0000 7f8a0f7fe640 1 -- 172.21.15.152:0/2802300384 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c01bda0 con 0x565113ec2410 2024-09-11T22:10:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.584+0000 7f8a1a7fc640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a100a2f50 0x7f8a100a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.584+0000 7f8a1a7fc640 1 -- 172.21.15.152:0/2514360716 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8a140efc40 con 0x7f8a24109bc0 2024-09-11T22:10:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.584+0000 7f8a29b61640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a100a2f50 0x7f8a100a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.585+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2802300384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec2410 msgr2=0x565113ecc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.585+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2802300384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec2410 0x565113ecc770 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009f30 tx=0x7f8a1c00f7f0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.585+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2802300384 shutdown_connections 2024-09-11T22:10:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.586+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2802300384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ecccb0 0x565113ecf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.586+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2802300384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec2410 0x565113ecc770 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.586+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2802300384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ec1af0 0x565113ec1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.586+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2802300384 >> 172.21.15.152:0/2802300384 conn(0x565113ebe060 msgr2=0x565113ebe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.586+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2802300384 shutdown_connections 2024-09-11T22:10:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.587+0000 7f8a29b61640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a100a2f50 0x7f8a100a5410 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8a20005940 tx=0x7f8a20005ce0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.587+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2802300384 wait complete. 2024-09-11T22:10:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.588+0000 7f8a2e43e740 1 -- start start 2024-09-11T22:10:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.588+0000 7f8a2e43e740 1 Processor -- start 2024-09-11T22:10:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec1af0 0x565113ec9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ec2410 0x565113eca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ecccb0 0x565113eca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a2e43e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x565113ecf8d0 con 0x565113ecccb0 2024-09-11T22:10:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a2e43e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x565113daf290 con 0x565113ec2410 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a2e43e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x565113ecfa50 con 0x565113ec1af0 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a2e43e740 10 client.0 _ll_register_callbacks cb 0x565113de0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a29360640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec1af0 0x565113ec9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a29360640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec1af0 0x565113ec9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:42430/0 (socket says 172.21.15.152:42430) 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a29360640 1 -- 172.21.15.152:0/2691592253 learned_addr learned my addr 172.21.15.152:0/2691592253 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a29b61640 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ecccb0 0x565113eca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.589+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ec2410 0x565113eca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a29b61640 1 -- 172.21.15.152:0/2691592253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec1af0 msgr2=0x565113ec9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a29b61640 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec1af0 0x565113ec9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a29b61640 1 -- 172.21.15.152:0/2691592253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ec2410 msgr2=0x565113eca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a29b61640 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ec2410 0x565113eca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a29b61640 1 -- 172.21.15.152:0/2691592253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565113b39210 con 0x565113ecccb0 2024-09-11T22:10:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ec2410 0x565113eca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a29b61640 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ecccb0 0x565113eca640 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000e720 tx=0x7f8a20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9315462c671170c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:10:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a0cff9640 1 -- 172.21.15.152:0/2691592253 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a20020070 con 0x565113ecccb0 2024-09-11T22:10:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a0cff9640 1 -- 172.21.15.152:0/2691592253 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8a2000f910 con 0x565113ecccb0 2024-09-11T22:10:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2691592253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a1c011cc0 con 0x565113ecccb0 2024-09-11T22:10:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a0cff9640 1 -- 172.21.15.152:0/2691592253 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8a2000fb10 con 0x565113ecccb0 2024-09-11T22:10:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a2e43e740 10 client.16989 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2691592253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x565113c05620 con 0x565113ecccb0 2024-09-11T22:10:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.590+0000 7f8a0cff9640 1 -- 172.21.15.152:0/2691592253 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a1c011cc0 con 0x565113ecccb0 2024-09-11T22:10:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.591+0000 7f8a0cff9640 1 -- 172.21.15.152:0/2691592253 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8a2001c420 con 0x565113ecccb0 2024-09-11T22:10:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.591+0000 7f8a2e43e740 10 client.16989 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.591+0000 7f8a2e43e740 10 client.16989 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.591+0000 7f8a2e43e740 20 client.16989 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.591+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565113edccd0 0x565113edf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.591+0000 7f8a2e43e740 4 client.16989 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.591+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2691592253 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565113e33a20 con 0x565113edccd0 2024-09-11T22:10:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.591+0000 7f8a29360640 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565113edccd0 0x565113edf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.592+0000 7f8a0cff9640 10 client.16989 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.592+0000 7f8a29360640 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565113edccd0 0x565113edf0c0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b99d630534e251 server_cookie=b7c8c053da755dfd in_seq=0 out_seq=0 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.593+0000 7f8a0cff9640 1 -- 172.21.15.152:0/2691592253 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565113e33a20 con 0x565113edccd0 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.593+0000 7f8a0cff9640 10 client.16989 handle_command_reply: tid=0 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.593+0000 7f8a2e43e740 1 client.16989 shutdown 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.593+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2691592253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ecccb0 msgr2=0x565113eca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.593+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ecccb0 0x565113eca640 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000e720 tx=0x7f8a20004730 comp rx=0 tx=0).stop 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.593+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2691592253 shutdown_connections 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.594+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565113edccd0 0x565113edf0c0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.594+0000 7f8a0cff9640 0 client.16989 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.594+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ecccb0 0x565113eca640 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.594+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ec2410 0x565113eca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.594+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2691592253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec1af0 0x565113ec9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.594+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2691592253 >> 172.21.15.152:0/2691592253 conn(0x565113ebe060 msgr2=0x565113ec3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.594+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2691592253 shutdown_connections 2024-09-11T22:10:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.594+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2691592253 wait complete. 2024-09-11T22:10:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.594+0000 7f8a2e43e740 20 client.16989 trim_cache size 0 max 16384 2024-09-11T22:10:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.617+0000 7f8a2e43e740 1 Processor -- start 2024-09-11T22:10:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.617+0000 7f8a2e43e740 1 -- start start 2024-09-11T22:10:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.617+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 0x565113eca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.617+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 0x565113ee4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.617+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ecccb0 0x565113ee4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a29360640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 0x565113eca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a29360640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 0x565113eca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49436/0 (socket says 172.21.15.152:49436) 2024-09-11T22:10:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a29360640 1 -- 172.21.15.152:0/2173443412 learned_addr learned my addr 172.21.15.152:0/2173443412 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/2173443412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 0x565113ee4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2173443412 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8a241c7750 con 0x565113ec1af0 2024-09-11T22:10:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2173443412 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a24073990 con 0x565113ecccb0 2024-09-11T22:10:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2173443412 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8a240717e0 con 0x565113ec2410 2024-09-11T22:10:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a29b61640 1 --2- 172.21.15.152:0/2173443412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ecccb0 0x565113ee4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a28b5f640 1 -- 172.21.15.152:0/2173443412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ecccb0 msgr2=0x565113ee4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/2173443412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ecccb0 0x565113ee4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a28b5f640 1 -- 172.21.15.152:0/2173443412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 msgr2=0x565113eca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/2173443412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 0x565113eca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a28b5f640 1 -- 172.21.15.152:0/2173443412 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565113ebde90 con 0x565113ec2410 2024-09-11T22:10:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a29360640 1 --2- 172.21.15.152:0/2173443412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 0x565113eca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/2173443412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 0x565113ee4960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8a140ed300 tx=0x7f8a14009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26b2e54dbb0d9be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a0effd640 1 -- 172.21.15.152:0/2173443412 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140c4d40 con 0x565113ec2410 2024-09-11T22:10:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a0effd640 1 -- 172.21.15.152:0/2173443412 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a1403b460 con 0x565113ec2410 2024-09-11T22:10:56.622 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.618+0000 7f8a0effd640 1 -- 172.21.15.152:0/2173443412 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140ed580 con 0x565113ec2410 2024-09-11T22:10:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.619+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2173443412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 msgr2=0x565113ee4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.619+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2173443412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 0x565113ee4960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8a140ed300 tx=0x7f8a14009260 comp rx=0 tx=0).stop 2024-09-11T22:10:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.620+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2173443412 shutdown_connections 2024-09-11T22:10:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.620+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2173443412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ecccb0 0x565113ee4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.620+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2173443412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 0x565113ee4960 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.620+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/2173443412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 0x565113eca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.620+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2173443412 >> 172.21.15.152:0/2173443412 conn(0x565113ebe060 msgr2=0x565113ecbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.620+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2173443412 shutdown_connections 2024-09-11T22:10:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.620+0000 7f8a2e43e740 1 -- 172.21.15.152:0/2173443412 wait complete. 2024-09-11T22:10:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.620+0000 7f8a2e43e740 1 -- start start 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.620+0000 7f8a2e43e740 1 Processor -- start 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 0x565113ed4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 0x565113ed5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a2e43e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ecccb0 0x565113ed0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a2e43e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8a24071e50 con 0x565113ec1af0 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a2e43e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a240732c0 con 0x565113ecccb0 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a2e43e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8a24072520 con 0x565113ec2410 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a2e43e740 10 client.0 _ll_register_callbacks cb 0x7f8a20014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a29360640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 0x565113ed4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a29b61640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ecccb0 0x565113ed0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a28b5f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 0x565113ed5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a29360640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 0x565113ed4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49448/0 (socket says 172.21.15.152:49448) 2024-09-11T22:10:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a29360640 1 -- 172.21.15.152:0/708919541 learned_addr learned my addr 172.21.15.152:0/708919541 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a28b5f640 1 -- 172.21.15.152:0/708919541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ecccb0 msgr2=0x565113ed0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/708919541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ecccb0 0x565113ed0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a28b5f640 1 -- 172.21.15.152:0/708919541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 msgr2=0x565113ed4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/708919541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 0x565113ed4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a28b5f640 1 -- 172.21.15.152:0/708919541 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565113ed0ab0 con 0x565113ec2410 2024-09-11T22:10:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a28b5f640 1 --2- 172.21.15.152:0/708919541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 0x565113ed5410 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8a140ed300 tx=0x7f8a14031490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91583300a59a6046 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.621+0000 7f8a0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:10:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a0cff9640 1 -- 172.21.15.152:0/708919541 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140d4070 con 0x565113ec2410 2024-09-11T22:10:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a0cff9640 1 -- 172.21.15.152:0/708919541 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f8a140bc330 con 0x565113ec2410 2024-09-11T22:10:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a2e43e740 1 -- 172.21.15.152:0/708919541 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a1403b460 con 0x565113ec2410 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a0cff9640 1 -- 172.21.15.152:0/708919541 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8a140ed780 con 0x565113ec2410 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a2e43e740 10 client.26554 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a2e43e740 1 -- 172.21.15.152:0/708919541 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x565113f47470 con 0x565113ec2410 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a0cff9640 1 -- 172.21.15.152:0/708919541 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a1403b460 con 0x565113ec2410 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a0cff9640 1 -- 172.21.15.152:0/708919541 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8a140bb5b0 con 0x565113ec2410 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a2e43e740 10 client.26554 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a2e43e740 10 client.26554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a2e43e740 20 client.26554 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/708919541 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565113edccd0 0x565113f49a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a2e43e740 4 client.26554 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a2e43e740 1 -- 172.21.15.152:0/708919541 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565113e2dd70 con 0x565113edccd0 2024-09-11T22:10:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.622+0000 7f8a29360640 1 --2- 172.21.15.152:0/708919541 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565113edccd0 0x565113f49a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:56.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.623+0000 7f8a29360640 1 --2- 172.21.15.152:0/708919541 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565113edccd0 0x565113f49a40 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7219967c1368b120 server_cookie=b42c7405d43b61bd in_seq=0 out_seq=0 2024-09-11T22:10:56.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.623+0000 7f8a0cff9640 10 client.26554 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:56.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.629+0000 7f8a0cff9640 1 -- 172.21.15.152:0/708919541 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565113e2dd70 con 0x565113edccd0 2024-09-11T22:10:56.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a0cff9640 10 client.26554 handle_command_reply: tid=0 2024-09-11T22:10:56.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 1 client.26554 shutdown 2024-09-11T22:10:56.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 1 -- 172.21.15.152:0/708919541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 msgr2=0x565113ed5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:56.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/708919541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 0x565113ed5410 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8a140ed300 tx=0x7f8a14031490 comp rx=0 tx=0).stop 2024-09-11T22:10:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 1 -- 172.21.15.152:0/708919541 shutdown_connections 2024-09-11T22:10:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/708919541 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x565113edccd0 0x565113f49a40 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/708919541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565113ecccb0 0x565113ed0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/708919541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x565113ec2410 0x565113ed5410 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a0cff9640 0 client.26554 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 1 --2- 172.21.15.152:0/708919541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565113ec1af0 0x565113ed4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 1 -- 172.21.15.152:0/708919541 >> 172.21.15.152:0/708919541 conn(0x565113ebe060 msgr2=0x565113ec3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 1 -- 172.21.15.152:0/708919541 shutdown_connections 2024-09-11T22:10:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 1 -- 172.21.15.152:0/708919541 wait complete. 2024-09-11T22:10:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.630+0000 7f8a2e43e740 20 client.26554 trim_cache size 0 max 16384 2024-09-11T22:10:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:10:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:10:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:10:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/2514360716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a100a2f50 msgr2=0x7f8a100a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a100a2f50 0x7f8a100a5410 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8a20005940 tx=0x7f8a20005ce0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/2514360716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a24109bc0 msgr2=0x7f8a24084c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a24109bc0 0x7f8a24084c20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8a1402aa20 tx=0x7f8a14003b90 comp rx=0 tx=0).stop 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/2514360716 shutdown_connections 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8a100a2f50 0x7f8a100a5410 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a241126f0 0x7f8a2407d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a24109bc0 0x7f8a24084c20 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 --2- 172.21.15.152:0/2514360716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a241092a0 0x7f8a240846e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/2514360716 >> 172.21.15.152:0/2514360716 conn(0x7f8a24077ac0 msgr2=0x7f8a24077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/2514360716 shutdown_connections 2024-09-11T22:10:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:10:56.631+0000 7f8a2b5c4640 1 -- 172.21.15.152:0/2514360716 wait complete. 2024-09-11T22:10:56.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:56 smithi193 ceph-mon[35545]: pgmap v202: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.2 MiB/s wr, 691 op/s 2024-09-11T22:10:56.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:56 smithi152 ceph-mon[31188]: pgmap v202: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.2 MiB/s wr, 691 op/s 2024-09-11T22:10:57.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:56 smithi179 ceph-mon[35603]: pgmap v202: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.2 MiB/s wr, 691 op/s 2024-09-11T22:10:57.128 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:10:57.501 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:10:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.250+0000 7f412e123640 1 -- 172.21.15.152:0/138890613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4128114ab0 msgr2=0x7f4128116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.250+0000 7f412e123640 1 --2- 172.21.15.152:0/138890613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4128114ab0 0x7f4128116ea0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4124009900 tx=0x7f412402a420 comp rx=0 tx=0).stop 2024-09-11T22:10:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.250+0000 7f412e123640 1 -- 172.21.15.152:0/138890613 shutdown_connections 2024-09-11T22:10:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.250+0000 7f412e123640 1 --2- 172.21.15.152:0/138890613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4128114ab0 0x7f4128116ea0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.250+0000 7f412e123640 1 --2- 172.21.15.152:0/138890613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f412806ee10 0x7f4128114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.250+0000 7f412e123640 1 --2- 172.21.15.152:0/138890613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f412806e4f0 0x7f412806e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.250+0000 7f412e123640 1 -- 172.21.15.152:0/138890613 >> 172.21.15.152:0/138890613 conn(0x7f4128073180 msgr2=0x7f4128073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:58.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.250+0000 7f412e123640 1 -- 172.21.15.152:0/138890613 shutdown_connections 2024-09-11T22:10:58.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.253+0000 7f412e123640 1 -- 172.21.15.152:0/138890613 wait complete. 2024-09-11T22:10:58.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.254+0000 7f412e123640 1 Processor -- start 2024-09-11T22:10:58.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.254+0000 7f412e123640 1 -- start start 2024-09-11T22:10:58.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.254+0000 7f412e123640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f412806e4f0 0x7f41281abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.254+0000 7f412e123640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f412806ee10 0x7f41281ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.254+0000 7f412e123640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128114ab0 0x7f4128113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.254+0000 7f412e123640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f412811a640 con 0x7f412806e4f0 2024-09-11T22:10:58.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.254+0000 7f412e123640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f412811a4c0 con 0x7f4128114ab0 2024-09-11T22:10:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.254+0000 7f412e123640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f412811a7c0 con 0x7f412806ee10 2024-09-11T22:10:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.254+0000 7f412c920640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f412806ee10 0x7f41281ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.255+0000 7f412c920640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f412806ee10 0x7f41281ac220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:42464/0 (socket says 172.21.15.152:42464) 2024-09-11T22:10:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.255+0000 7f412c920640 1 -- 172.21.15.152:0/2402851032 learned_addr learned my addr 172.21.15.152:0/2402851032 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.255+0000 7f412d922640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128114ab0 0x7f4128113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.255+0000 7f412d121640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f412806e4f0 0x7f41281abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.255+0000 7f412c920640 1 -- 172.21.15.152:0/2402851032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128114ab0 msgr2=0x7f4128113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.255+0000 7f412c920640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128114ab0 0x7f4128113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.255+0000 7f412c920640 1 -- 172.21.15.152:0/2402851032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f412806e4f0 msgr2=0x7f41281abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.255+0000 7f412c920640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f412806e4f0 0x7f41281abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.255+0000 7f412c920640 1 -- 172.21.15.152:0/2402851032 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4128113e00 con 0x7f412806ee10 2024-09-11T22:10:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.255+0000 7f412c920640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f412806ee10 0x7f41281ac220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f412000eab0 tx=0x7f412000ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.255+0000 7f411e7fc640 1 -- 172.21.15.152:0/2402851032 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412000ce40 con 0x7f412806ee10 2024-09-11T22:10:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.256+0000 7f411e7fc640 1 -- 172.21.15.152:0/2402851032 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4120011950 con 0x7f412806ee10 2024-09-11T22:10:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.256+0000 7f411e7fc640 1 -- 172.21.15.152:0/2402851032 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120010ae0 con 0x7f412806ee10 2024-09-11T22:10:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.256+0000 7f412e123640 1 -- 172.21.15.152:0/2402851032 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41281140f0 con 0x7f412806ee10 2024-09-11T22:10:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.256+0000 7f412e123640 1 -- 172.21.15.152:0/2402851032 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41281b3c10 con 0x7f412806ee10 2024-09-11T22:10:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.260+0000 7f413175e740 1 Processor -- start 2024-09-11T22:10:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.260+0000 7f413175e740 1 -- start start 2024-09-11T22:10:58.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.260+0000 7f411e7fc640 1 -- 172.21.15.152:0/2402851032 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f4120011b00 con 0x7f412806ee10 2024-09-11T22:10:58.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.260+0000 7f413175e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4670 0x55eb5b6e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.260+0000 7f413175e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ef310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.260+0000 7f412d922640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4670 0x55eb5b6e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.260+0000 7f412d922640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4670 0x55eb5b6e4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:42476/0 (socket says 172.21.15.152:42476) 2024-09-11T22:10:58.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f413175e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6ef850 0x55eb5b6f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f412d121640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f412d121640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ef310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49478/0 (socket says 172.21.15.152:49478) 2024-09-11T22:10:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f412d922640 1 -- 172.21.15.152:0/2299996440 learned_addr learned my addr 172.21.15.152:0/2299996440 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f413175e740 1 -- 172.21.15.152:0/2299996440 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b64a2e0 con 0x55eb5b6e4f90 2024-09-11T22:10:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f413175e740 1 -- 172.21.15.152:0/2299996440 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b5f1ce0 con 0x55eb5b6ef850 2024-09-11T22:10:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f412c920640 1 --2- 172.21.15.152:0/2299996440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6ef850 0x55eb5b6f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f413175e740 1 -- 172.21.15.152:0/2299996440 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b6462a0 con 0x55eb5b6e4670 2024-09-11T22:10:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f411e7fc640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41140a2cf0 0x7f41140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f411e7fc640 1 -- 172.21.15.152:0/2402851032 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f41200cfac0 con 0x7f412806ee10 2024-09-11T22:10:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f412d922640 1 -- 172.21.15.152:0/2299996440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6ef850 msgr2=0x55eb5b6f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f412d922640 1 --2- 172.21.15.152:0/2299996440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6ef850 0x55eb5b6f1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f412d922640 1 -- 172.21.15.152:0/2299996440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 msgr2=0x55eb5b6ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f412d922640 1 --2- 172.21.15.152:0/2299996440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f412d922640 1 -- 172.21.15.152:0/2299996440 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb5b5d6440 con 0x55eb5b6e4670 2024-09-11T22:10:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f412d922640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41140a2cf0 0x7f41140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.261+0000 7f412d922640 1 --2- 172.21.15.152:0/2299996440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4670 0x55eb5b6e4a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4124009900 tx=0x7f41240041f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e8ff3987f44db2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.262+0000 7f41137fe640 1 -- 172.21.15.152:0/2299996440 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412404c070 con 0x55eb5b6e4670 2024-09-11T22:10:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.262+0000 7f41137fe640 1 -- 172.21.15.152:0/2299996440 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4124003e90 con 0x55eb5b6e4670 2024-09-11T22:10:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.262+0000 7f41137fe640 1 -- 172.21.15.152:0/2299996440 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124035040 con 0x55eb5b6e4670 2024-09-11T22:10:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.262+0000 7f412c920640 1 --2- 172.21.15.152:0/2299996440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6ef850 0x55eb5b6f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.262+0000 7f412d121640 1 --2- 172.21.15.152:0/2299996440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:58.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.263+0000 7f413175e740 1 -- 172.21.15.152:0/2299996440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4670 msgr2=0x55eb5b6e4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:58.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.263+0000 7f412d922640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41140a2cf0 0x7f41140a51b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4124049000 tx=0x7f41240465c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:58.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.263+0000 7f413175e740 1 --2- 172.21.15.152:0/2299996440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4670 0x55eb5b6e4a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4124009900 tx=0x7f41240041f0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.263+0000 7f413175e740 1 -- 172.21.15.152:0/2299996440 shutdown_connections 2024-09-11T22:10:58.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.263+0000 7f413175e740 1 --2- 172.21.15.152:0/2299996440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6ef850 0x55eb5b6f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.263+0000 7f413175e740 1 --2- 172.21.15.152:0/2299996440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.263+0000 7f413175e740 1 --2- 172.21.15.152:0/2299996440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4670 0x55eb5b6e4a50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.263+0000 7f413175e740 1 -- 172.21.15.152:0/2299996440 >> 172.21.15.152:0/2299996440 conn(0x55eb5b6e0c00 msgr2=0x55eb5b6e0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:58.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.263+0000 7f413175e740 1 -- 172.21.15.152:0/2299996440 shutdown_connections 2024-09-11T22:10:58.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.263+0000 7f413175e740 1 -- 172.21.15.152:0/2299996440 wait complete. 2024-09-11T22:10:58.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.264+0000 7f413175e740 1 -- start start 2024-09-11T22:10:58.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.264+0000 7f413175e740 1 Processor -- start 2024-09-11T22:10:58.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.265+0000 7f413175e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 0x55eb5b6ef130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.265+0000 7f413175e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ec430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.265+0000 7f413175e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 0x55eb5b6ec970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.265+0000 7f413175e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b6f2420 con 0x55eb5b6e4f90 2024-09-11T22:10:58.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.265+0000 7f413175e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b605050 con 0x55eb5b6e4670 2024-09-11T22:10:58.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.265+0000 7f413175e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b6f25a0 con 0x55eb5b6ef850 2024-09-11T22:10:58.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.265+0000 7f413175e740 10 client.0 _ll_register_callbacks cb 0x55eb5b645160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:58.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.265+0000 7f412d922640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 0x55eb5b6ec970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.265+0000 7f412d121640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 0x55eb5b6ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.265+0000 7f412d121640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 0x55eb5b6ef130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:56564/0 (socket says 172.21.15.152:56564) 2024-09-11T22:10:58.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.265+0000 7f412d121640 1 -- 172.21.15.152:0/1106286723 learned_addr learned my addr 172.21.15.152:0/1106286723 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:58.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.266+0000 7f412d922640 1 -- 172.21.15.152:0/1106286723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 msgr2=0x55eb5b6ef130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.266+0000 7f412d922640 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 0x55eb5b6ef130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.266+0000 7f412d922640 1 -- 172.21.15.152:0/1106286723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 msgr2=0x55eb5b6ec430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.266+0000 7f412d922640 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.266+0000 7f412d922640 1 -- 172.21.15.152:0/1106286723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb5b3bb3c0 con 0x55eb5b6ef850 2024-09-11T22:10:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.266+0000 7f412d922640 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 0x55eb5b6ec970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f412404a040 tx=0x7f4124038000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32ca8e615569c415 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.266+0000 7f4110ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:10:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.266+0000 7f412d121640 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 0x55eb5b6ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.266+0000 7f4110ff9640 1 -- 172.21.15.152:0/1106286723 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412404c040 con 0x55eb5b6ef850 2024-09-11T22:10:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.266+0000 7f4110ff9640 1 -- 172.21.15.152:0/1106286723 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f4124003730 con 0x55eb5b6ef850 2024-09-11T22:10:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.266+0000 7f413175e740 1 -- 172.21.15.152:0/1106286723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4124003e90 con 0x55eb5b6ef850 2024-09-11T22:10:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.267+0000 7f4110ff9640 1 -- 172.21.15.152:0/1106286723 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f412405f050 con 0x55eb5b6ef850 2024-09-11T22:10:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.267+0000 7f413175e740 10 client.26563 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.267+0000 7f413175e740 1 -- 172.21.15.152:0/1106286723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55eb5b6f2420 con 0x55eb5b6ef850 2024-09-11T22:10:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.267+0000 7f4110ff9640 1 -- 172.21.15.152:0/1106286723 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4124003e90 con 0x55eb5b6ef850 2024-09-11T22:10:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.267+0000 7f4110ff9640 1 -- 172.21.15.152:0/1106286723 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f4124050700 con 0x55eb5b6ef850 2024-09-11T22:10:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.267+0000 7f413175e740 10 client.26563 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.267+0000 7f413175e740 10 client.26563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.267+0000 7f413175e740 20 client.26563 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.267+0000 7f413175e740 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55eb5b6feec0 0x55eb5b7012b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.268+0000 7f413175e740 4 client.26563 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:10:58.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.268+0000 7f413175e740 1 -- 172.21.15.152:0/1106286723 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb5b657850 con 0x55eb5b6feec0 2024-09-11T22:10:58.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.268+0000 7f412d121640 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55eb5b6feec0 0x55eb5b7012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.270+0000 7f412d121640 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55eb5b6feec0 0x55eb5b7012b0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=663d2f685cf39d2d server_cookie=d2eef656c1252301 in_seq=0 out_seq=0 2024-09-11T22:10:58.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.270+0000 7f4110ff9640 10 client.26563 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:58.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f4110ff9640 1 -- 172.21.15.152:0/1106286723 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb5b657850 con 0x55eb5b6feec0 2024-09-11T22:10:58.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f4110ff9640 10 client.26563 handle_command_reply: tid=0 2024-09-11T22:10:58.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 1 client.26563 shutdown 2024-09-11T22:10:58.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 1 -- 172.21.15.152:0/1106286723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 msgr2=0x55eb5b6ec970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 0x55eb5b6ec970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f412404a040 tx=0x7f4124038000 comp rx=0 tx=0).stop 2024-09-11T22:10:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 1 -- 172.21.15.152:0/1106286723 shutdown_connections 2024-09-11T22:10:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55eb5b6feec0 0x55eb5b7012b0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f4110ff9640 0 client.26563 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 0x55eb5b6ec970 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ec430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 1 --2- 172.21.15.152:0/1106286723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 0x55eb5b6ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 1 -- 172.21.15.152:0/1106286723 >> 172.21.15.152:0/1106286723 conn(0x55eb5b6e0c00 msgr2=0x55eb5b6e6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 1 -- 172.21.15.152:0/1106286723 shutdown_connections 2024-09-11T22:10:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 1 -- 172.21.15.152:0/1106286723 wait complete. 2024-09-11T22:10:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.271+0000 7f413175e740 20 client.26563 trim_cache size 0 max 16384 2024-09-11T22:10:58.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f413175e740 1 Processor -- start 2024-09-11T22:10:58.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f413175e740 1 -- start start 2024-09-11T22:10:58.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f413175e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 0x55eb5b6fb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f413175e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f413175e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 0x55eb5b7069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f412c920640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f413175e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41281beff0 con 0x55eb5b6e4f90 2024-09-11T22:10:58.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f413175e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f41281bc8c0 con 0x55eb5b6e4670 2024-09-11T22:10:58.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f412c920640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ebd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49492/0 (socket says 172.21.15.152:49492) 2024-09-11T22:10:58.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f413175e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f41281ba710 con 0x55eb5b6ef850 2024-09-11T22:10:58.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f412c920640 1 -- 172.21.15.152:0/1148121001 learned_addr learned my addr 172.21.15.152:0/1148121001 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:58.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f412d121640 1 --2- 172.21.15.152:0/1148121001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 0x55eb5b6fb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.294+0000 7f412d922640 1 --2- 172.21.15.152:0/1148121001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 0x55eb5b7069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.295+0000 7f412c920640 1 -- 172.21.15.152:0/1148121001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 msgr2=0x55eb5b7069f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:58.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.295+0000 7f412c920640 1 --2- 172.21.15.152:0/1148121001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 0x55eb5b7069f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.295+0000 7f412c920640 1 -- 172.21.15.152:0/1148121001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 msgr2=0x55eb5b6fb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:58.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.295+0000 7f412c920640 1 --2- 172.21.15.152:0/1148121001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 0x55eb5b6fb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.295+0000 7f412c920640 1 -- 172.21.15.152:0/1148121001 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb5b6ea980 con 0x55eb5b6e4f90 2024-09-11T22:10:58.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.295+0000 7f412d922640 1 --2- 172.21.15.152:0/1148121001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 0x55eb5b7069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:10:58.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.295+0000 7f412c920640 1 --2- 172.21.15.152:0/1148121001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ebd10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f41200cd240 tx=0x7f4120011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332029b8bca67238 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:58.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.295+0000 7f4112ffd640 1 -- 172.21.15.152:0/1148121001 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412009c6b0 con 0x55eb5b6e4f90 2024-09-11T22:10:58.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.295+0000 7f4112ffd640 1 -- 172.21.15.152:0/1148121001 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41200bc070 con 0x55eb5b6e4f90 2024-09-11T22:10:58.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.295+0000 7f4112ffd640 1 -- 172.21.15.152:0/1148121001 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412009c210 con 0x55eb5b6e4f90 2024-09-11T22:10:58.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.296+0000 7f413175e740 1 -- 172.21.15.152:0/1148121001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 msgr2=0x55eb5b6ebd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:58.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.296+0000 7f413175e740 1 --2- 172.21.15.152:0/1148121001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ebd10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f41200cd240 tx=0x7f4120011f10 comp rx=0 tx=0).stop 2024-09-11T22:10:58.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.296+0000 7f413175e740 1 -- 172.21.15.152:0/1148121001 shutdown_connections 2024-09-11T22:10:58.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.296+0000 7f413175e740 1 --2- 172.21.15.152:0/1148121001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6ef850 0x55eb5b7069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.296+0000 7f413175e740 1 --2- 172.21.15.152:0/1148121001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6ebd10 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.296+0000 7f413175e740 1 --2- 172.21.15.152:0/1148121001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6e4670 0x55eb5b6fb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.296+0000 7f413175e740 1 -- 172.21.15.152:0/1148121001 >> 172.21.15.152:0/1148121001 conn(0x55eb5b6e0c00 msgr2=0x55eb5b6ee4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:58.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.296+0000 7f413175e740 1 -- 172.21.15.152:0/1148121001 shutdown_connections 2024-09-11T22:10:58.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.296+0000 7f413175e740 1 -- 172.21.15.152:0/1148121001 wait complete. 2024-09-11T22:10:58.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.296+0000 7f413175e740 1 -- start start 2024-09-11T22:10:58.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.296+0000 7f413175e740 1 Processor -- start 2024-09-11T22:10:58.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f413175e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4670 0x55eb5b6f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f413175e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f413175e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6ef850 0x55eb5b6f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f413175e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41281bad80 con 0x55eb5b6e4670 2024-09-11T22:10:58.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f413175e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f41281bc1f0 con 0x55eb5b6ef850 2024-09-11T22:10:58.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f413175e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f41281bb450 con 0x55eb5b6e4f90 2024-09-11T22:10:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f413175e740 10 client.0 _ll_register_callbacks cb 0x7f412404a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:10:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f412d121640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4670 0x55eb5b6f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f412d121640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4670 0x55eb5b6f77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49506/0 (socket says 172.21.15.152:49506) 2024-09-11T22:10:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f412d121640 1 -- 172.21.15.152:0/3415039766 learned_addr learned my addr 172.21.15.152:0/3415039766 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:10:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f412c920640 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f412d922640 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6ef850 0x55eb5b6f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f412c920640 1 -- 172.21.15.152:0/3415039766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6ef850 msgr2=0x55eb5b6f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f412c920640 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6ef850 0x55eb5b6f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f412c920640 1 -- 172.21.15.152:0/3415039766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4670 msgr2=0x55eb5b6f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f412c920640 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4670 0x55eb5b6f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f412c920640 1 -- 172.21.15.152:0/3415039766 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb5b6f4d00 con 0x55eb5b6e4f90 2024-09-11T22:10:58.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.297+0000 7f412d121640 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4670 0x55eb5b6f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:58.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.298+0000 7f412c920640 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6f7d30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f41200a0520 tx=0x7f412009c020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd780816d0d97ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:58.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.298+0000 7f4110ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:10:58.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.299+0000 7f4110ff9640 1 -- 172.21.15.152:0/3415039766 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41200b4070 con 0x55eb5b6e4f90 2024-09-11T22:10:58.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.299+0000 7f4110ff9640 1 -- 172.21.15.152:0/3415039766 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f412009c210 con 0x55eb5b6e4f90 2024-09-11T22:10:58.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.299+0000 7f413175e740 1 -- 172.21.15.152:0/3415039766 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41200bc070 con 0x55eb5b6e4f90 2024-09-11T22:10:58.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.299+0000 7f4110ff9640 1 -- 172.21.15.152:0/3415039766 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f412009c6b0 con 0x55eb5b6e4f90 2024-09-11T22:10:58.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.299+0000 7f413175e740 10 client.26569 fetch_fsmap learned FSMap version 30 2024-09-11T22:10:58.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.299+0000 7f413175e740 1 -- 172.21.15.152:0/3415039766 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55eb5b76a0f0 con 0x55eb5b6e4f90 2024-09-11T22:10:58.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.299+0000 7f4110ff9640 1 -- 172.21.15.152:0/3415039766 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41200a4c20 con 0x55eb5b6e4f90 2024-09-11T22:10:58.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.300+0000 7f4110ff9640 1 -- 172.21.15.152:0/3415039766 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f412000f040 con 0x55eb5b6e4f90 2024-09-11T22:10:58.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.300+0000 7f413175e740 10 client.26569 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:10:58.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.300+0000 7f413175e740 10 client.26569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:10:58.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.300+0000 7f413175e740 20 client.26569 populate_metadata read hostname 'smithi152' 2024-09-11T22:10:58.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.300+0000 7f413175e740 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55eb5b6feec0 0x55eb5b76c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:58.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.300+0000 7f413175e740 4 client.26569 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:10:58.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.300+0000 7f413175e740 1 -- 172.21.15.152:0/3415039766 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f41200bc070 con 0x55eb5b6feec0 2024-09-11T22:10:58.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.300+0000 7f412d121640 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55eb5b6feec0 0x55eb5b76c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:58.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f4110ff9640 10 client.26569 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f412d121640 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55eb5b6feec0 0x55eb5b76c6b0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de70edc09651f173 server_cookie=153a8b3c982c8c6a in_seq=0 out_seq=0 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f4110ff9640 1 -- 172.21.15.152:0/3415039766 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f41200bc070 con 0x55eb5b6feec0 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f4110ff9640 10 client.26569 handle_command_reply: tid=0 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 1 client.26569 shutdown 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 1 -- 172.21.15.152:0/3415039766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4f90 msgr2=0x55eb5b6f7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6f7d30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f41200a0520 tx=0x7f412009c020 comp rx=0 tx=0).stop 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 1 -- 172.21.15.152:0/3415039766 shutdown_connections 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55eb5b6feec0 0x55eb5b76c6b0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb5b6ef850 0x55eb5b6f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f4110ff9640 0 client.26569 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb5b6e4f90 0x55eb5b6f7d30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 1 --2- 172.21.15.152:0/3415039766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eb5b6e4670 0x55eb5b6f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 1 -- 172.21.15.152:0/3415039766 >> 172.21.15.152:0/3415039766 conn(0x55eb5b6e0c00 msgr2=0x55eb5b6e7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:58.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 1 -- 172.21.15.152:0/3415039766 shutdown_connections 2024-09-11T22:10:58.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 1 -- 172.21.15.152:0/3415039766 wait complete. 2024-09-11T22:10:58.308 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:10:58.308 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:10:58.308 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:10:58.308 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:10:58.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.301+0000 7f413175e740 20 client.26569 trim_cache size 0 max 16384 2024-09-11T22:10:58.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 -- 172.21.15.152:0/2402851032 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41140a2cf0 msgr2=0x7f41140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:58.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41140a2cf0 0x7f41140a51b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4124049000 tx=0x7f41240465c0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 -- 172.21.15.152:0/2402851032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f412806ee10 msgr2=0x7f41281ac220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:58.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f412806ee10 0x7f41281ac220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f412000eab0 tx=0x7f412000ef70 comp rx=0 tx=0).stop 2024-09-11T22:10:58.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 -- 172.21.15.152:0/2402851032 shutdown_connections 2024-09-11T22:10:58.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41140a2cf0 0x7f41140a51b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128114ab0 0x7f4128113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f412806ee10 0x7f41281ac220 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 --2- 172.21.15.152:0/2402851032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f412806e4f0 0x7f41281abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:58.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 -- 172.21.15.152:0/2402851032 >> 172.21.15.152:0/2402851032 conn(0x7f4128073180 msgr2=0x7f412806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:58.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 -- 172.21.15.152:0/2402851032 shutdown_connections 2024-09-11T22:10:58.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:10:58.302+0000 7f412e123640 1 -- 172.21.15.152:0/2402851032 wait complete. 2024-09-11T22:10:58.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:58 smithi193 ceph-mon[35545]: pgmap v203: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.2 MiB/s wr, 691 op/s 2024-09-11T22:10:58.842 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:58 smithi152 ceph-mon[31188]: pgmap v203: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.2 MiB/s wr, 691 op/s 2024-09-11T22:10:59.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:58 smithi179 ceph-mon[35603]: pgmap v203: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.2 MiB/s wr, 691 op/s 2024-09-11T22:10:59.462 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:10:59.462 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:10:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:10:59 smithi152 ceph-mon[31188]: pgmap v204: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2024-09-11T22:10:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 325.0 s, 3444.0 tps, lat 29.014 ms stddev 31.501 2024-09-11T22:10:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:10:59 smithi193 ceph-mon[35545]: pgmap v204: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2024-09-11T22:10:59.875 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:00.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:10:59 smithi179 ceph-mon[35603]: pgmap v204: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2024-09-11T22:11:00.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.554+0000 7f22e0cb7640 1 -- 172.21.15.152:0/4202607593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22dc101410 msgr2=0x7f22dc10d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:00.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.554+0000 7f22e0cb7640 1 --2- 172.21.15.152:0/4202607593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22dc101410 0x7f22dc10d940 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009cd0 tx=0x7f22d402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:11:00.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.554+0000 7f22e0cb7640 1 -- 172.21.15.152:0/4202607593 shutdown_connections 2024-09-11T22:11:00.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.554+0000 7f22e0cb7640 1 --2- 172.21.15.152:0/4202607593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22dc101410 0x7f22dc10d940 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:00.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.554+0000 7f22e0cb7640 1 --2- 172.21.15.152:0/4202607593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22dc100a70 0x7f22dc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:00.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.554+0000 7f22e0cb7640 1 --2- 172.21.15.152:0/4202607593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc106a70 0x7f22dc106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:00.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.554+0000 7f22e0cb7640 1 -- 172.21.15.152:0/4202607593 >> 172.21.15.152:0/4202607593 conn(0x7f22dc0fc790 msgr2=0x7f22dc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:00.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.554+0000 7f22e0cb7640 1 -- 172.21.15.152:0/4202607593 shutdown_connections 2024-09-11T22:11:00.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.554+0000 7f22e0cb7640 1 -- 172.21.15.152:0/4202607593 wait complete. 2024-09-11T22:11:00.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22e0cb7640 1 Processor -- start 2024-09-11T22:11:00.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22e0cb7640 1 -- start start 2024-09-11T22:11:00.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22e0cb7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc100a70 0x7f22dc1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22e0cb7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22dc101410 0x7f22dc1975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22e0cb7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22dc106a70 0x7f22dc197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22e0cb7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc110e70 con 0x7f22dc106a70 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22e0cb7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc110cf0 con 0x7f22dc100a70 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22e0cb7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc110ff0 con 0x7f22dc101410 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22dad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22dc106a70 0x7f22dc197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22da59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc100a70 0x7f22dc1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22dad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22dc106a70 0x7f22dc197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49526/0 (socket says 172.21.15.152:49526) 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22dc101410 0x7f22dc1975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22da59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc100a70 0x7f22dc1970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:56582/0 (socket says 172.21.15.152:56582) 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22dad9d640 1 -- 172.21.15.152:0/2889732983 learned_addr learned my addr 172.21.15.152:0/2889732983 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22dad9d640 1 -- 172.21.15.152:0/2889732983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22dc101410 msgr2=0x7f22dc1975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22dad9d640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22dc101410 0x7f22dc1975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:00.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22dad9d640 1 -- 172.21.15.152:0/2889732983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc100a70 msgr2=0x7f22dc1970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22dad9d640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc100a70 0x7f22dc1970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22dad9d640 1 -- 172.21.15.152:0/2889732983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc1a6910 con 0x7f22dc106a70 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22d9d9b640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22dc101410 0x7f22dc1975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.555+0000 7f22da59c640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc100a70 0x7f22dc1970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.556+0000 7f22dad9d640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22dc106a70 0x7f22dc197b20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f22d4005cc0 tx=0x7f22d40093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.556+0000 7f22cb7fe640 1 -- 172.21.15.152:0/2889732983 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4003e00 con 0x7f22dc106a70 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.556+0000 7f22cb7fe640 1 -- 172.21.15.152:0/2889732983 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22d4004520 con 0x7f22dc106a70 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.556+0000 7f22e0cb7640 1 -- 172.21.15.152:0/2889732983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22dc1a6ba0 con 0x7f22dc106a70 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.556+0000 7f22cb7fe640 1 -- 172.21.15.152:0/2889732983 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4030db0 con 0x7f22dc106a70 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.556+0000 7f22e0cb7640 1 -- 172.21.15.152:0/2889732983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22dc1a70e0 con 0x7f22dc106a70 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.557+0000 7f22e0cb7640 1 -- 172.21.15.152:0/2889732983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22dc100ed0 con 0x7f22dc106a70 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.558+0000 7f22cb7fe640 1 -- 172.21.15.152:0/2889732983 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f22d40046d0 con 0x7f22dc106a70 2024-09-11T22:11:00.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.559+0000 7f22cb7fe640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22c40a2cf0 0x7f22c40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:00.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.559+0000 7f22da59c640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22c40a2cf0 0x7f22c40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:00.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.559+0000 7f22cb7fe640 1 -- 172.21.15.152:0/2889732983 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f22d402e030 con 0x7f22dc106a70 2024-09-11T22:11:00.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.559+0000 7f22da59c640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22c40a2cf0 0x7f22c40a51b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009f40 tx=0x7f22cc005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:00.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.563+0000 7f22cb7fe640 1 -- 172.21.15.152:0/2889732983 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f22d404b060 con 0x7f22dc106a70 2024-09-11T22:11:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.820+0000 7f22e0cb7640 1 -- 172.21.15.152:0/2889732983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22dc02d7c0 con 0x7f22dc106a70 2024-09-11T22:11:00.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.824+0000 7f22cb7fe640 1 -- 172.21.15.152:0/2889732983 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f22d40bd6d0 con 0x7f22dc106a70 2024-09-11T22:11:00.826 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:11:00.826 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:11:00.827 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:11:00.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.830+0000 7f22e0cb7640 1 -- 172.21.15.152:0/2889732983 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22c40a2cf0 msgr2=0x7f22c40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:00.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.830+0000 7f22e0cb7640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22c40a2cf0 0x7f22c40a51b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009f40 tx=0x7f22cc005f90 comp rx=0 tx=0).stop 2024-09-11T22:11:00.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.830+0000 7f22e0cb7640 1 -- 172.21.15.152:0/2889732983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22dc106a70 msgr2=0x7f22dc197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:00.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.830+0000 7f22e0cb7640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22dc106a70 0x7f22dc197b20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f22d4005cc0 tx=0x7f22d40093d0 comp rx=0 tx=0).stop 2024-09-11T22:11:00.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.830+0000 7f22e0cb7640 1 -- 172.21.15.152:0/2889732983 shutdown_connections 2024-09-11T22:11:00.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.830+0000 7f22e0cb7640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22c40a2cf0 0x7f22c40a51b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:00.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.830+0000 7f22e0cb7640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22dc106a70 0x7f22dc197b20 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:00.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.830+0000 7f22e0cb7640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22dc101410 0x7f22dc1975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:00.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.830+0000 7f22e0cb7640 1 --2- 172.21.15.152:0/2889732983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc100a70 0x7f22dc1970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:00.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.830+0000 7f22e0cb7640 1 -- 172.21.15.152:0/2889732983 >> 172.21.15.152:0/2889732983 conn(0x7f22dc0fc790 msgr2=0x7f22dc0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:00.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.833+0000 7f22e0cb7640 1 -- 172.21.15.152:0/2889732983 shutdown_connections 2024-09-11T22:11:00.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:00.836+0000 7f22e0cb7640 1 -- 172.21.15.152:0/2889732983 wait complete. 2024-09-11T22:11:01.221 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:00 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2889732983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:01.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:00 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2889732983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:01.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:00 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2889732983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:01.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:11:02.083 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.651+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1653913135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf740a0f10 msgr2=0x7fcf740a8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.651+0000 7fcf7bfff640 1 --2- 172.21.15.152:0/1653913135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf740a0f10 0x7fcf740a8a90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c050280 tx=0x7fcf7c096c30 comp rx=0 tx=0).stop 2024-09-11T22:11:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.652+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1653913135 shutdown_connections 2024-09-11T22:11:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.652+0000 7fcf7bfff640 1 --2- 172.21.15.152:0/1653913135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf740a0f10 0x7fcf740a8a90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.652+0000 7fcf7bfff640 1 --2- 172.21.15.152:0/1653913135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7409c790 0x7fcf740a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.652+0000 7fcf7bfff640 1 --2- 172.21.15.152:0/1653913135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf7409bde0 0x7fcf7409c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.652+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1653913135 >> 172.21.15.152:0/1653913135 conn(0x7fcf7400c220 msgr2=0x7fcf7409a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.652+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1653913135 shutdown_connections 2024-09-11T22:11:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.652+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1653913135 wait complete. 2024-09-11T22:11:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.653+0000 7fcf7bfff640 1 Processor -- start 2024-09-11T22:11:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.653+0000 7fcf7bfff640 1 -- start start 2024-09-11T22:11:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.654+0000 7fcf7bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf7409bde0 0x7fcf74132430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.654+0000 7fcf7bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7409c790 0x7fcf74132970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.654+0000 7fcf7bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf740a0f10 0x7fcf74136d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.654+0000 7fcf7a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7409c790 0x7fcf74132970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.655+0000 7fcf7a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7409c790 0x7fcf74132970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:56596/0 (socket says 172.21.15.152:56596) 2024-09-11T22:11:02.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.655+0000 7fcf7a7fc640 1 -- 172.21.15.152:0/1129528539 learned_addr learned my addr 172.21.15.152:0/1129528539 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:02.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.655+0000 7fcf7b7fe640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf740a0f10 0x7fcf74136d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.655+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1129528539 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcf740abf10 con 0x7fcf7409bde0 2024-09-11T22:11:02.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.655+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1129528539 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcf740abd90 con 0x7fcf7409c790 2024-09-11T22:11:02.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.655+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1129528539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf740ac090 con 0x7fcf740a0f10 2024-09-11T22:11:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.655+0000 7fcf7b7fe640 1 -- 172.21.15.152:0/1129528539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7409c790 msgr2=0x7fcf74132970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.655+0000 7fcf7b7fe640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7409c790 0x7fcf74132970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.655+0000 7fcf7b7fe640 1 -- 172.21.15.152:0/1129528539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf7409bde0 msgr2=0x7fcf74132430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.655+0000 7fcf7b7fe640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf7409bde0 0x7fcf74132430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.655+0000 7fcf7b7fe640 1 -- 172.21.15.152:0/1129528539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf741373e0 con 0x7fcf740a0f10 2024-09-11T22:11:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.656+0000 7fcf7b7fe640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf740a0f10 0x7fcf74136d00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0518b0 tx=0x7fcf7c0a06c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.656+0000 7fcf63fff640 1 -- 172.21.15.152:0/1129528539 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0ad070 con 0x7fcf740a0f10 2024-09-11T22:11:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.656+0000 7fcf63fff640 1 -- 172.21.15.152:0/1129528539 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf7c0a0cc0 con 0x7fcf740a0f10 2024-09-11T22:11:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.656+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1129528539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf74137670 con 0x7fcf740a0f10 2024-09-11T22:11:02.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.656+0000 7fcf63fff640 1 -- 172.21.15.152:0/1129528539 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0a86b0 con 0x7fcf740a0f10 2024-09-11T22:11:02.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.656+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1129528539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf74137ac0 con 0x7fcf740a0f10 2024-09-11T22:11:02.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.659+0000 7fcf63fff640 1 -- 172.21.15.152:0/1129528539 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fcf7c0b0070 con 0x7fcf740a0f10 2024-09-11T22:11:02.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.660+0000 7fcf63fff640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf640a2e50 0x7fcf640a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.661+0000 7fcf83a7b740 1 Processor -- start 2024-09-11T22:11:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.661+0000 7fcf83a7b740 1 -- start start 2024-09-11T22:11:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.661+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f5cf0 0x5646969f4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.661+0000 7fcf7affd640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf640a2e50 0x7fcf640a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.661+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f4780 0x5646969f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.661+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969ff520 0x564696a01910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.661+0000 7fcf83a7b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56469695a2f0 con 0x5646969f4780 2024-09-11T22:11:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.661+0000 7fcf83a7b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564696901cf0 con 0x5646969ff520 2024-09-11T22:11:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.661+0000 7fcf83a7b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5646969562b0 con 0x5646969f5cf0 2024-09-11T22:11:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.661+0000 7fcf63fff640 1 -- 172.21.15.152:0/1129528539 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcf7c15d0b0 con 0x7fcf740a0f10 2024-09-11T22:11:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f5cf0 0x5646969f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f5cf0 0x5646969f4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:42576/0 (socket says 172.21.15.152:42576) 2024-09-11T22:11:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7affd640 1 -- 172.21.15.152:0/2990081815 learned_addr learned my addr 172.21.15.152:0/2990081815 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7b7fe640 1 --2- 172.21.15.152:0/2990081815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969ff520 0x564696a01910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7a7fc640 1 --2- 172.21.15.152:0/2990081815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f4780 0x5646969f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7affd640 1 -- 172.21.15.152:0/2990081815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969ff520 msgr2=0x564696a01910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7affd640 1 --2- 172.21.15.152:0/2990081815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969ff520 0x564696a01910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7affd640 1 -- 172.21.15.152:0/2990081815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f4780 msgr2=0x5646969f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7affd640 1 --2- 172.21.15.152:0/2990081815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f4780 0x5646969f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7affd640 1 -- 172.21.15.152:0/2990081815 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646968e63a0 con 0x5646969f5cf0 2024-09-11T22:11:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7b7fe640 1 --2- 172.21.15.152:0/2990081815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969ff520 0x564696a01910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.662+0000 7fcf7a7fc640 1 --2- 172.21.15.152:0/2990081815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f4780 0x5646969f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.663+0000 7fcf7affd640 1 --2- 172.21.15.152:0/2990081815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f5cf0 0x5646969f4240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0135c0 tx=0x7fcf6c013a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31d6051eecae4af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.663+0000 7fcf7affd640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf640a2e50 0x7fcf640a5310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c01a000 tx=0x7fcf6c01c000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.663+0000 7fcf617fa640 1 -- 172.21.15.152:0/2990081815 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0114a0 con 0x5646969f5cf0 2024-09-11T22:11:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.663+0000 7fcf617fa640 1 -- 172.21.15.152:0/2990081815 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf6c011b20 con 0x5646969f5cf0 2024-09-11T22:11:02.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.665+0000 7fcf617fa640 1 -- 172.21.15.152:0/2990081815 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c01dbf0 con 0x5646969f5cf0 2024-09-11T22:11:02.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.666+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2990081815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f5cf0 msgr2=0x5646969f4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:02.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.666+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/2990081815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f5cf0 0x5646969f4240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0135c0 tx=0x7fcf6c013a80 comp rx=0 tx=0).stop 2024-09-11T22:11:02.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.667+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2990081815 shutdown_connections 2024-09-11T22:11:02.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.667+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/2990081815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969ff520 0x564696a01910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.667+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/2990081815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f4780 0x5646969f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.667+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/2990081815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f5cf0 0x5646969f4240 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.667+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2990081815 >> 172.21.15.152:0/2990081815 conn(0x5646969bd310 msgr2=0x5646969f0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:02.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.667+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2990081815 shutdown_connections 2024-09-11T22:11:02.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.667+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2990081815 wait complete. 2024-09-11T22:11:02.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.668+0000 7fcf83a7b740 1 -- start start 2024-09-11T22:11:02.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.668+0000 7fcf83a7b740 1 Processor -- start 2024-09-11T22:11:02.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.669+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f4780 0x5646969fee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.669+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 0x5646969fc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.669+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969ff520 0x5646969fc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.669+0000 7fcf83a7b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564696a02260 con 0x5646969f4780 2024-09-11T22:11:02.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.669+0000 7fcf83a7b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564696915060 con 0x5646969f5cf0 2024-09-11T22:11:02.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.669+0000 7fcf83a7b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564696a023e0 con 0x5646969ff520 2024-09-11T22:11:02.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.669+0000 7fcf83a7b740 10 client.0 _ll_register_callbacks cb 0x5646966688c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.669+0000 7fcf7b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969ff520 0x5646969fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.669+0000 7fcf7a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 0x5646969fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.669+0000 7fcf7b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969ff520 0x5646969fc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:42578/0 (socket says 172.21.15.152:42578) 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.669+0000 7fcf7b7fe640 1 -- 172.21.15.152:0/1982873625 learned_addr learned my addr 172.21.15.152:0/1982873625 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.670+0000 7fcf7affd640 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f4780 0x5646969fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.670+0000 7fcf7a7fc640 1 -- 172.21.15.152:0/1982873625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969ff520 msgr2=0x5646969fc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.670+0000 7fcf7a7fc640 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969ff520 0x5646969fc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.670+0000 7fcf7a7fc640 1 -- 172.21.15.152:0/1982873625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f4780 msgr2=0x5646969fee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.670+0000 7fcf7a7fc640 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f4780 0x5646969fee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.670+0000 7fcf7a7fc640 1 -- 172.21.15.152:0/1982873625 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646966cb3c0 con 0x5646969f5cf0 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.671+0000 7fcf7a7fc640 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 0x5646969fc100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400a300 tx=0x7fcf70010900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=149d4fa4753a89d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:02.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.671+0000 7fcf5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:11:02.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.671+0000 7fcf5eff5640 1 -- 172.21.15.152:0/1982873625 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70018070 con 0x5646969f5cf0 2024-09-11T22:11:02.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.671+0000 7fcf5eff5640 1 -- 172.21.15.152:0/1982873625 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcf70014800 con 0x5646969f5cf0 2024-09-11T22:11:02.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.671+0000 7fcf83a7b740 1 -- 172.21.15.152:0/1982873625 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf6c011b20 con 0x5646969f5cf0 2024-09-11T22:11:02.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.672+0000 7fcf5eff5640 1 -- 172.21.15.152:0/1982873625 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcf70024050 con 0x5646969f5cf0 2024-09-11T22:11:02.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.672+0000 7fcf83a7b740 10 client.26426 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:02.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.672+0000 7fcf83a7b740 1 -- 172.21.15.152:0/1982873625 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564696a1ecb0 con 0x5646969f5cf0 2024-09-11T22:11:02.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.672+0000 7fcf5eff5640 1 -- 172.21.15.152:0/1982873625 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf6c011b20 con 0x5646969f5cf0 2024-09-11T22:11:02.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.672+0000 7fcf5eff5640 1 -- 172.21.15.152:0/1982873625 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fcf7001cae0 con 0x5646969f5cf0 2024-09-11T22:11:02.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.672+0000 7fcf83a7b740 10 client.26426 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:02.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.672+0000 7fcf83a7b740 10 client.26426 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:11:02.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.672+0000 7fcf83a7b740 20 client.26426 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:02.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.673+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x564696a20530 0x564696a22990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.673+0000 7fcf83a7b740 4 client.26426 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:02.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.673+0000 7fcf83a7b740 1 -- 172.21.15.152:0/1982873625 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564696967860 con 0x564696a20530 2024-09-11T22:11:02.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.673+0000 7fcf7affd640 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x564696a20530 0x564696a22990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.674+0000 7fcf5eff5640 10 client.26426 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:11:02.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.674+0000 7fcf7affd640 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x564696a20530 0x564696a22990 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=81e44b0a5e661fab server_cookie=d05980c506c76e26 in_seq=0 out_seq=0 2024-09-11T22:11:02.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.675+0000 7fcf5eff5640 1 -- 172.21.15.152:0/1982873625 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564696967860 con 0x564696a20530 2024-09-11T22:11:02.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.675+0000 7fcf5eff5640 10 client.26426 handle_command_reply: tid=0 2024-09-11T22:11:02.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.675+0000 7fcf83a7b740 1 client.26426 shutdown 2024-09-11T22:11:02.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.676+0000 7fcf83a7b740 1 -- 172.21.15.152:0/1982873625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 msgr2=0x5646969fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:02.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.676+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 0x5646969fc100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400a300 tx=0x7fcf70010900 comp rx=0 tx=0).stop 2024-09-11T22:11:02.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.676+0000 7fcf83a7b740 1 -- 172.21.15.152:0/1982873625 shutdown_connections 2024-09-11T22:11:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.676+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x564696a20530 0x564696a22990 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.677+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969ff520 0x5646969fc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.677+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 0x5646969fc100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.677+0000 7fcf5eff5640 0 client.26426 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:11:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.677+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/1982873625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f4780 0x5646969fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.677+0000 7fcf83a7b740 1 -- 172.21.15.152:0/1982873625 >> 172.21.15.152:0/1982873625 conn(0x5646969bd310 msgr2=0x5646969f6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.677+0000 7fcf83a7b740 1 -- 172.21.15.152:0/1982873625 shutdown_connections 2024-09-11T22:11:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.677+0000 7fcf83a7b740 1 -- 172.21.15.152:0/1982873625 wait complete. 2024-09-11T22:11:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.677+0000 7fcf83a7b740 20 client.26426 trim_cache size 0 max 16384 2024-09-11T22:11:02.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.707+0000 7fcf83a7b740 1 Processor -- start 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.707+0000 7fcf83a7b740 1 -- start start 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.707+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 0x5646969f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.707+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 0x5646969f7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.707+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969ff520 0x564696a282a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.708+0000 7fcf7affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 0x5646969f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.708+0000 7fcf7b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969ff520 0x564696a282a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.708+0000 7fcf7affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 0x5646969f72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:42592/0 (socket says 172.21.15.152:42592) 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.708+0000 7fcf7affd640 1 -- 172.21.15.152:0/3723962717 learned_addr learned my addr 172.21.15.152:0/3723962717 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.708+0000 7fcf7a7fc640 1 --2- 172.21.15.152:0/3723962717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 0x5646969f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.708+0000 7fcf83a7b740 1 -- 172.21.15.152:0/3723962717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7414a160 con 0x5646969ff520 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.708+0000 7fcf83a7b740 1 -- 172.21.15.152:0/3723962717 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74147a30 con 0x5646969f5cf0 2024-09-11T22:11:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.708+0000 7fcf83a7b740 1 -- 172.21.15.152:0/3723962717 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74145880 con 0x5646969f4780 2024-09-11T22:11:02.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.709+0000 7fcf7a7fc640 1 -- 172.21.15.152:0/3723962717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 msgr2=0x5646969f72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:02.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.709+0000 7fcf7a7fc640 1 --2- 172.21.15.152:0/3723962717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 0x5646969f72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.709+0000 7fcf7a7fc640 1 -- 172.21.15.152:0/3723962717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969ff520 msgr2=0x564696a282a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.709+0000 7fcf7a7fc640 1 --2- 172.21.15.152:0/3723962717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969ff520 0x564696a282a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.709+0000 7fcf7a7fc640 1 -- 172.21.15.152:0/3723962717 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564696a23010 con 0x5646969f5cf0 2024-09-11T22:11:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.709+0000 7fcf7a7fc640 1 --2- 172.21.15.152:0/3723962717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 0x5646969f7810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf70001eb0 tx=0x7fcf70009520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f1a3eee2bcb0078 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.709+0000 7fcf60ff9640 1 -- 172.21.15.152:0/3723962717 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7002d070 con 0x5646969f5cf0 2024-09-11T22:11:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.709+0000 7fcf60ff9640 1 -- 172.21.15.152:0/3723962717 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf70012660 con 0x5646969f5cf0 2024-09-11T22:11:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.710+0000 7fcf60ff9640 1 -- 172.21.15.152:0/3723962717 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70021070 con 0x5646969f5cf0 2024-09-11T22:11:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.710+0000 7fcf83a7b740 1 -- 172.21.15.152:0/3723962717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 msgr2=0x5646969f7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.710+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/3723962717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 0x5646969f7810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf70001eb0 tx=0x7fcf70009520 comp rx=0 tx=0).stop 2024-09-11T22:11:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.711+0000 7fcf83a7b740 1 -- 172.21.15.152:0/3723962717 shutdown_connections 2024-09-11T22:11:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.711+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/3723962717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969ff520 0x564696a282a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.711+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/3723962717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969f5cf0 0x5646969f7810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.711+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/3723962717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 0x5646969f72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.711+0000 7fcf83a7b740 1 -- 172.21.15.152:0/3723962717 >> 172.21.15.152:0/3723962717 conn(0x5646969bd310 msgr2=0x5646969fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.711+0000 7fcf83a7b740 1 -- 172.21.15.152:0/3723962717 shutdown_connections 2024-09-11T22:11:02.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.711+0000 7fcf83a7b740 1 -- 172.21.15.152:0/3723962717 wait complete. 2024-09-11T22:11:02.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.712+0000 7fcf83a7b740 1 -- start start 2024-09-11T22:11:02.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.712+0000 7fcf83a7b740 1 Processor -- start 2024-09-11T22:11:02.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.712+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 0x564696a07b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.712+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f5cf0 0x5646969f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.712+0000 7fcf83a7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969ff520 0x5646969f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.712+0000 7fcf83a7b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74145ef0 con 0x5646969f5cf0 2024-09-11T22:11:02.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.712+0000 7fcf83a7b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74147360 con 0x5646969ff520 2024-09-11T22:11:02.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.712+0000 7fcf83a7b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf741465c0 con 0x5646969f4780 2024-09-11T22:11:02.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.712+0000 7fcf83a7b740 10 client.0 _ll_register_callbacks cb 0x7fcf70009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.712+0000 7fcf7affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 0x564696a07b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.713+0000 7fcf7a7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f5cf0 0x5646969f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.713+0000 7fcf7affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 0x564696a07b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:42598/0 (socket says 172.21.15.152:42598) 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.713+0000 7fcf7affd640 1 -- 172.21.15.152:0/2860102668 learned_addr learned my addr 172.21.15.152:0/2860102668 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.713+0000 7fcf7b7fe640 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969ff520 0x5646969f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.713+0000 7fcf7affd640 1 -- 172.21.15.152:0/2860102668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969ff520 msgr2=0x5646969f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.713+0000 7fcf7affd640 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969ff520 0x5646969f90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.713+0000 7fcf7affd640 1 -- 172.21.15.152:0/2860102668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f5cf0 msgr2=0x5646969f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.713+0000 7fcf7affd640 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f5cf0 0x5646969f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.713+0000 7fcf7affd640 1 -- 172.21.15.152:0/2860102668 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646969f9660 con 0x5646969f4780 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.713+0000 7fcf7affd640 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 0x564696a07b20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c013fc0 tx=0x7fcf6c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c793c8cc507bcc2c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:02.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.713+0000 7fcf5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:02.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.714+0000 7fcf5eff5640 1 -- 172.21.15.152:0/2860102668 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c035030 con 0x5646969f4780 2024-09-11T22:11:02.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.714+0000 7fcf5eff5640 1 -- 172.21.15.152:0/2860102668 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7fcf6c019040 con 0x5646969f4780 2024-09-11T22:11:02.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.714+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2860102668 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf70012660 con 0x5646969f4780 2024-09-11T22:11:02.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.715+0000 7fcf5eff5640 1 -- 172.21.15.152:0/2860102668 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcf6c03f050 con 0x5646969f4780 2024-09-11T22:11:02.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.715+0000 7fcf83a7b740 10 client.26593 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:02.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.715+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2860102668 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564696a8b030 con 0x5646969f4780 2024-09-11T22:11:02.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.716+0000 7fcf5eff5640 1 -- 172.21.15.152:0/2860102668 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf6c01dce0 con 0x5646969f4780 2024-09-11T22:11:02.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.716+0000 7fcf5eff5640 1 -- 172.21.15.152:0/2860102668 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fcf6c0054e0 con 0x5646969f4780 2024-09-11T22:11:02.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.716+0000 7fcf83a7b740 10 client.26593 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:02.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.716+0000 7fcf83a7b740 10 client.26593 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:11:02.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.716+0000 7fcf83a7b740 20 client.26593 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:02.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.716+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x564696a8b650 0x564696a8da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:02.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.716+0000 7fcf83a7b740 4 client.26593 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.716+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2860102668 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcf70012660 con 0x564696a8b650 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.716+0000 7fcf7a7fc640 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x564696a8b650 0x564696a8da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.717+0000 7fcf7a7fc640 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x564696a8b650 0x564696a8da70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c4c9ee45b74fcaef server_cookie=6c39fd1ef54bbf38 in_seq=0 out_seq=0 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.717+0000 7fcf5eff5640 10 client.26593 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf5eff5640 1 -- 172.21.15.152:0/2860102668 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcf70012660 con 0x564696a8b650 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf5eff5640 10 client.26593 handle_command_reply: tid=0 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 1 client.26593 shutdown 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2860102668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 msgr2=0x564696a07b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 0x564696a07b20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c013fc0 tx=0x7fcf6c005fd0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2860102668 shutdown_connections 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x564696a8b650 0x564696a8da70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646969ff520 0x5646969f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646969f5cf0 0x5646969f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 1 --2- 172.21.15.152:0/2860102668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646969f4780 0x564696a07b20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2860102668 >> 172.21.15.152:0/2860102668 conn(0x5646969bd310 msgr2=0x5646969ef690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:02.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf5eff5640 0 client.26593 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:11:02.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2860102668 shutdown_connections 2024-09-11T22:11:02.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 1 -- 172.21.15.152:0/2860102668 wait complete. 2024-09-11T22:11:02.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.718+0000 7fcf83a7b740 20 client.26593 trim_cache size 0 max 16384 2024-09-11T22:11:02.721 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:11:02.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.719+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1129528539 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf640a2e50 msgr2=0x7fcf640a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:02.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.719+0000 7fcf7bfff640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf640a2e50 0x7fcf640a5310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c01a000 tx=0x7fcf6c01c000 comp rx=0 tx=0).stop 2024-09-11T22:11:02.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.720+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1129528539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf740a0f10 msgr2=0x7fcf74136d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:02.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.720+0000 7fcf7bfff640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf740a0f10 0x7fcf74136d00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0518b0 tx=0x7fcf7c0a06c0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.720+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1129528539 shutdown_connections 2024-09-11T22:11:02.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.720+0000 7fcf7bfff640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcf640a2e50 0x7fcf640a5310 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.720+0000 7fcf7bfff640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf740a0f10 0x7fcf74136d00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.720+0000 7fcf7bfff640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7409c790 0x7fcf74132970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.720+0000 7fcf7bfff640 1 --2- 172.21.15.152:0/1129528539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf7409bde0 0x7fcf74132430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:02.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.720+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1129528539 >> 172.21.15.152:0/1129528539 conn(0x7fcf7400c220 msgr2=0x7fcf74008a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:02.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.720+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1129528539 shutdown_connections 2024-09-11T22:11:02.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:02.720+0000 7fcf7bfff640 1 -- 172.21.15.152:0/1129528539 wait complete. 2024-09-11T22:11:03.228 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:02 smithi152 ceph-mon[31188]: pgmap v205: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.8 MiB/s wr, 674 op/s 2024-09-11T22:11:03.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:02 smithi179 ceph-mon[35603]: pgmap v205: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.8 MiB/s wr, 674 op/s 2024-09-11T22:11:03.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:02 smithi193 ceph-mon[35545]: pgmap v205: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.8 MiB/s wr, 674 op/s 2024-09-11T22:11:03.598 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:11:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:04.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.630+0000 7f788a5d2640 1 -- 172.21.15.152:0/329759708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7884101800 msgr2=0x7f7884101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:04.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.630+0000 7f788a5d2640 1 --2- 172.21.15.152:0/329759708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7884101800 0x7f7884101be0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f78740099b0 tx=0x7f787402c650 comp rx=0 tx=0).stop 2024-09-11T22:11:04.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.630+0000 7f788a5d2640 1 -- 172.21.15.152:0/329759708 shutdown_connections 2024-09-11T22:11:04.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.630+0000 7f788a5d2640 1 --2- 172.21.15.152:0/329759708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7884105e00 0x7f788410d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.630+0000 7f788a5d2640 1 --2- 172.21.15.152:0/329759708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78841021b0 0x7f78841056f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.630+0000 7f788a5d2640 1 --2- 172.21.15.152:0/329759708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7884101800 0x7f7884101be0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.630+0000 7f788a5d2640 1 -- 172.21.15.152:0/329759708 >> 172.21.15.152:0/329759708 conn(0x7f78840fba90 msgr2=0x7f78840fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:04.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.632+0000 7f788a5d2640 1 -- 172.21.15.152:0/329759708 shutdown_connections 2024-09-11T22:11:04.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.632+0000 7f788a5d2640 1 -- 172.21.15.152:0/329759708 wait complete. 2024-09-11T22:11:04.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.633+0000 7f788a5d2640 1 Processor -- start 2024-09-11T22:11:04.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.633+0000 7f788a5d2640 1 -- start start 2024-09-11T22:11:04.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.633+0000 7f788a5d2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7884101800 0x7f788419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f788a5d2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78841021b0 0x7f788419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f788a5d2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7884105e00 0x7f788419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f7883fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7884101800 0x7f788419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f78837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78841021b0 0x7f788419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f7883fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7884101800 0x7f788419a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54744/0 (socket says 172.21.15.152:54744) 2024-09-11T22:11:04.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f78837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78841021b0 0x7f788419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55364/0 (socket says 172.21.15.152:55364) 2024-09-11T22:11:04.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f788a5d2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f788410fd50 con 0x7f78841021b0 2024-09-11T22:11:04.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f788a5d2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f788410fbd0 con 0x7f7884105e00 2024-09-11T22:11:04.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f788a5d2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f788410fed0 con 0x7f7884101800 2024-09-11T22:11:04.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f7883fff640 1 -- 172.21.15.152:0/1786288860 learned_addr learned my addr 172.21.15.152:0/1786288860 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:04.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f7888b6f640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7884105e00 0x7f788419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f7888b6f640 1 -- 172.21.15.152:0/1786288860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7884101800 msgr2=0x7f788419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:04.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f7888b6f640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7884101800 0x7f788419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f7888b6f640 1 -- 172.21.15.152:0/1786288860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78841021b0 msgr2=0x7f788419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:04.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f7888b6f640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78841021b0 0x7f788419ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.634+0000 7f7888b6f640 1 -- 172.21.15.152:0/1786288860 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788419f6f0 con 0x7f7884105e00 2024-09-11T22:11:04.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.635+0000 7f7888b6f640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7884105e00 0x7f788419f010 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f787c009fd0 tx=0x7f787c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:04.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.635+0000 7f78817fa640 1 -- 172.21.15.152:0/1786288860 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c00ce20 con 0x7f7884105e00 2024-09-11T22:11:04.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.635+0000 7f78817fa640 1 -- 172.21.15.152:0/1786288860 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f787c005020 con 0x7f7884105e00 2024-09-11T22:11:04.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.635+0000 7f78817fa640 1 -- 172.21.15.152:0/1786288860 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c010720 con 0x7f7884105e00 2024-09-11T22:11:04.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.635+0000 7f788a5d2640 1 -- 172.21.15.152:0/1786288860 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788419f9e0 con 0x7f7884105e00 2024-09-11T22:11:04.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.635+0000 7f788a5d2640 1 -- 172.21.15.152:0/1786288860 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f788419fe40 con 0x7f7884105e00 2024-09-11T22:11:04.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.637+0000 7f78817fa640 1 -- 172.21.15.152:0/1786288860 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f787c005540 con 0x7f7884105e00 2024-09-11T22:11:04.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.638+0000 7f788c9ab740 1 Processor -- start 2024-09-11T22:11:04.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.638+0000 7f78817fa640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f786c0a2d70 0x7f786c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.639+0000 7f78817fa640 1 -- 172.21.15.152:0/1786288860 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f787c0cfb50 con 0x7f7884105e00 2024-09-11T22:11:04.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.639+0000 7f78837fe640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f786c0a2d70 0x7f786c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.639+0000 7f788c9ab740 1 -- start start 2024-09-11T22:11:04.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 0x55b4e9ca1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9cae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f788c9ab740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b4e9c072f0 con 0x55b4e9ca15d0 2024-09-11T22:11:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f788c9ab740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b4e9baecf0 con 0x55b4e9cac370 2024-09-11T22:11:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f788c9ab740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b4e9c032b0 con 0x55b4e9ca2b40 2024-09-11T22:11:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f78837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 0x55b4e9ca1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f7883fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f78837fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 0x55b4e9ca1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55374/0 (socket says 172.21.15.152:55374) 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f78837fe640 1 -- 172.21.15.152:0/1953880563 learned_addr learned my addr 172.21.15.152:0/1953880563 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f7888b6f640 1 --2- 172.21.15.152:0/1953880563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9cae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f78837fe640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f786c0a2d70 0x7f786c0a5230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7884105730 tx=0x7f7878011440 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f7883fff640 1 -- 172.21.15.152:0/1953880563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 msgr2=0x55b4e9cae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f7883fff640 1 --2- 172.21.15.152:0/1953880563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9cae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f7883fff640 1 -- 172.21.15.152:0/1953880563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 msgr2=0x55b4e9ca1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f7883fff640 1 --2- 172.21.15.152:0/1953880563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 0x55b4e9ca1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f7883fff640 1 -- 172.21.15.152:0/1953880563 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4e9b933a0 con 0x55b4e9ca2b40 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f7888b6f640 1 --2- 172.21.15.152:0/1953880563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9cae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.640+0000 7f78837fe640 1 --2- 172.21.15.152:0/1953880563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 0x55b4e9ca1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:04.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.641+0000 7f7883fff640 1 --2- 172.21.15.152:0/1953880563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca1090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7874000c00 tx=0x7f7874033510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3809c199310e0c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:04.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.641+0000 7f786a7fc640 1 -- 172.21.15.152:0/1953880563 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7874037040 con 0x55b4e9ca2b40 2024-09-11T22:11:04.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.641+0000 7f786a7fc640 1 -- 172.21.15.152:0/1953880563 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7874004030 con 0x55b4e9ca2b40 2024-09-11T22:11:04.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.641+0000 7f786a7fc640 1 -- 172.21.15.152:0/1953880563 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7874005630 con 0x55b4e9ca2b40 2024-09-11T22:11:04.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.642+0000 7f788c9ab740 1 -- 172.21.15.152:0/1953880563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 msgr2=0x55b4e9ca1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:04.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.642+0000 7f788c9ab740 1 --2- 172.21.15.152:0/1953880563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca1090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7874000c00 tx=0x7f7874033510 comp rx=0 tx=0).stop 2024-09-11T22:11:04.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.642+0000 7f788c9ab740 1 -- 172.21.15.152:0/1953880563 shutdown_connections 2024-09-11T22:11:04.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.642+0000 7f788c9ab740 1 --2- 172.21.15.152:0/1953880563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9cae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.642+0000 7f788c9ab740 1 --2- 172.21.15.152:0/1953880563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 0x55b4e9ca1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.642+0000 7f788c9ab740 1 --2- 172.21.15.152:0/1953880563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca1090 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.642+0000 7f788c9ab740 1 -- 172.21.15.152:0/1953880563 >> 172.21.15.152:0/1953880563 conn(0x55b4e9c6a310 msgr2=0x55b4e9c9dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:04.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.642+0000 7f788c9ab740 1 -- 172.21.15.152:0/1953880563 shutdown_connections 2024-09-11T22:11:04.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.642+0000 7f788c9ab740 1 -- 172.21.15.152:0/1953880563 wait complete. 2024-09-11T22:11:04.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.642+0000 7f788c9ab740 1 -- start start 2024-09-11T22:11:04.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f788c9ab740 1 Processor -- start 2024-09-11T22:11:04.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca15d0 0x55b4e9cabc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9cac370 0x55b4e9ca9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f788c9ab740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b4e9caf060 con 0x55b4e9cac370 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f788c9ab740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b4e9bc2060 con 0x55b4e9ca2b40 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f788c9ab740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b4e9caf1e0 con 0x55b4e9ca15d0 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f788c9ab740 10 client.0 _ll_register_callbacks cb 0x55b4e99158c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f7883fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca15d0 0x55b4e9cabc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f7888b6f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9cac370 0x55b4e9ca9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f7883fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca15d0 0x55b4e9cabc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54776/0 (socket says 172.21.15.152:54776) 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f7883fff640 1 -- 172.21.15.152:0/52762330 learned_addr learned my addr 172.21.15.152:0/52762330 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.643+0000 7f78837fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.644+0000 7f7888b6f640 1 -- 172.21.15.152:0/52762330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca15d0 msgr2=0x55b4e9cabc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.644+0000 7f7888b6f640 1 --2- 172.21.15.152:0/52762330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca15d0 0x55b4e9cabc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.644+0000 7f7888b6f640 1 -- 172.21.15.152:0/52762330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9ca2b40 msgr2=0x55b4e9ca8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.644+0000 7f7888b6f640 1 --2- 172.21.15.152:0/52762330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.644+0000 7f7888b6f640 1 -- 172.21.15.152:0/52762330 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4e99783c0 con 0x55b4e9cac370 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.645+0000 7f7888b6f640 1 --2- 172.21.15.152:0/52762330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9cac370 0x55b4e9ca9480 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f787c0cd210 tx=0x7f787c09ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bc2d02076e58c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.645+0000 7f78637fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.645+0000 7f78637fe640 1 -- 172.21.15.152:0/52762330 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c0b4070 con 0x55b4e9cac370 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.645+0000 7f78637fe640 1 -- 172.21.15.152:0/52762330 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f787c09c240 con 0x55b4e9cac370 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.645+0000 7f788c9ab740 1 -- 172.21.15.152:0/52762330 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7874004030 con 0x55b4e9cac370 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.646+0000 7f78637fe640 1 -- 172.21.15.152:0/52762330 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f787c081050 con 0x55b4e9cac370 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.646+0000 7f788c9ab740 10 client.17037 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.646+0000 7f788c9ab740 1 -- 172.21.15.152:0/52762330 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b4e9cbaa80 con 0x55b4e9cac370 2024-09-11T22:11:04.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.646+0000 7f78637fe640 1 -- 172.21.15.152:0/52762330 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7874004030 con 0x55b4e9cac370 2024-09-11T22:11:04.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.646+0000 7f78637fe640 1 -- 172.21.15.152:0/52762330 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f787c096b50 con 0x55b4e9cac370 2024-09-11T22:11:04.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.647+0000 7f788c9ab740 10 client.17037 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:04.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.647+0000 7f788c9ab740 10 client.17037 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:11:04.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.647+0000 7f788c9ab740 20 client.17037 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:04.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.647+0000 7f788c9ab740 1 --2- 172.21.15.152:0/52762330 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55b4e9cbc2a0 0x55b4e9cbe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.647+0000 7f788c9ab740 4 client.17037 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:04.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.647+0000 7f788c9ab740 1 -- 172.21.15.152:0/52762330 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4e9c14860 con 0x55b4e9cbc2a0 2024-09-11T22:11:04.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.647+0000 7f7883fff640 1 --2- 172.21.15.152:0/52762330 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55b4e9cbc2a0 0x55b4e9cbe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.647+0000 7f7883fff640 1 --2- 172.21.15.152:0/52762330 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55b4e9cbc2a0 0x55b4e9cbe690 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1060b6b1b971f642 server_cookie=d12f814946e762cf in_seq=0 out_seq=0 2024-09-11T22:11:04.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.647+0000 7f78637fe640 10 client.17037 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.648+0000 7f78637fe640 1 -- 172.21.15.152:0/52762330 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4e9c14860 con 0x55b4e9cbc2a0 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.648+0000 7f78637fe640 10 client.17037 handle_command_reply: tid=0 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.648+0000 7f788c9ab740 1 client.17037 shutdown 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f788c9ab740 1 -- 172.21.15.152:0/52762330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9cac370 msgr2=0x55b4e9ca9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f788c9ab740 1 --2- 172.21.15.152:0/52762330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9cac370 0x55b4e9ca9480 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f787c0cd210 tx=0x7f787c09ba70 comp rx=0 tx=0).stop 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f788c9ab740 1 -- 172.21.15.152:0/52762330 shutdown_connections 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f788c9ab740 1 --2- 172.21.15.152:0/52762330 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55b4e9cbc2a0 0x55b4e9cbe690 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f788c9ab740 1 --2- 172.21.15.152:0/52762330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9cac370 0x55b4e9ca9480 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f788c9ab740 1 --2- 172.21.15.152:0/52762330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f788c9ab740 1 --2- 172.21.15.152:0/52762330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca15d0 0x55b4e9cabc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f788c9ab740 1 -- 172.21.15.152:0/52762330 >> 172.21.15.152:0/52762330 conn(0x55b4e9c6a310 msgr2=0x55b4e9ca3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:04.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f78637fe640 0 client.17037 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:11:04.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f788c9ab740 1 -- 172.21.15.152:0/52762330 shutdown_connections 2024-09-11T22:11:04.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f788c9ab740 1 -- 172.21.15.152:0/52762330 wait complete. 2024-09-11T22:11:04.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.649+0000 7f788c9ab740 20 client.17037 trim_cache size 0 max 16384 2024-09-11T22:11:04.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.666+0000 7f788c9ab740 1 Processor -- start 2024-09-11T22:11:04.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.666+0000 7f788c9ab740 1 -- start start 2024-09-11T22:11:04.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.667+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca15d0 0x55b4e9caaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.667+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.667+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9ca4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.667+0000 7f788c9ab740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f78841b6860 con 0x55b4e9ca2b40 2024-09-11T22:11:04.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.667+0000 7f788c9ab740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78841b4130 con 0x55b4e9cac370 2024-09-11T22:11:04.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.667+0000 7f788c9ab740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78841b1fa0 con 0x55b4e9ca15d0 2024-09-11T22:11:04.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.667+0000 7f7888b6f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9ca4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.667+0000 7f7888b6f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9ca4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35570/0 (socket says 172.21.15.152:35570) 2024-09-11T22:11:04.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.667+0000 7f7888b6f640 1 -- 172.21.15.152:0/3710840468 learned_addr learned my addr 172.21.15.152:0/3710840468 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:04.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.668+0000 7f78837fe640 1 --2- 172.21.15.152:0/3710840468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.668+0000 7f7888b6f640 1 -- 172.21.15.152:0/3710840468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca15d0 msgr2=0x55b4e9caaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:04.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.668+0000 7f7888b6f640 1 --2- 172.21.15.152:0/3710840468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca15d0 0x55b4e9caaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.668+0000 7f7888b6f640 1 -- 172.21.15.152:0/3710840468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca2b40 msgr2=0x55b4e9ca4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:04.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.668+0000 7f7888b6f640 1 --2- 172.21.15.152:0/3710840468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.668+0000 7f7888b6f640 1 -- 172.21.15.152:0/3710840468 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4e9c9d4f0 con 0x55b4e9cac370 2024-09-11T22:11:04.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.668+0000 7f7888b6f640 1 --2- 172.21.15.152:0/3710840468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9ca4660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f787c0989b0 tx=0x7f787c0a0510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17259466ebcdf42b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:04.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.669+0000 7f7869ffb640 1 -- 172.21.15.152:0/3710840468 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c0b4070 con 0x55b4e9cac370 2024-09-11T22:11:04.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.669+0000 7f7869ffb640 1 -- 172.21.15.152:0/3710840468 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f787c09b530 con 0x55b4e9cac370 2024-09-11T22:11:04.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.669+0000 7f7869ffb640 1 -- 172.21.15.152:0/3710840468 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c09c240 con 0x55b4e9cac370 2024-09-11T22:11:04.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.669+0000 7f788c9ab740 1 -- 172.21.15.152:0/3710840468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 msgr2=0x55b4e9ca4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:04.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.669+0000 7f788c9ab740 1 --2- 172.21.15.152:0/3710840468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9ca4660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f787c0989b0 tx=0x7f787c0a0510 comp rx=0 tx=0).stop 2024-09-11T22:11:04.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.670+0000 7f788c9ab740 1 -- 172.21.15.152:0/3710840468 shutdown_connections 2024-09-11T22:11:04.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.670+0000 7f788c9ab740 1 --2- 172.21.15.152:0/3710840468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9ca4660 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.670+0000 7f788c9ab740 1 --2- 172.21.15.152:0/3710840468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca2b40 0x55b4e9ca4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.670+0000 7f788c9ab740 1 --2- 172.21.15.152:0/3710840468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca15d0 0x55b4e9caaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.670+0000 7f788c9ab740 1 -- 172.21.15.152:0/3710840468 >> 172.21.15.152:0/3710840468 conn(0x55b4e9c6a310 msgr2=0x55b4e9caa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:04.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.670+0000 7f788c9ab740 1 -- 172.21.15.152:0/3710840468 shutdown_connections 2024-09-11T22:11:04.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.670+0000 7f788c9ab740 1 -- 172.21.15.152:0/3710840468 wait complete. 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.670+0000 7f788c9ab740 1 -- start start 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.670+0000 7f788c9ab740 1 Processor -- start 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 0x55b4e9cc1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 0x55b4e9cbe9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f788c9ab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9cbeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f788c9ab740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f78841b25f0 con 0x55b4e9ca15d0 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f788c9ab740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78841b3a60 con 0x55b4e9cac370 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f788c9ab740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78841b2cc0 con 0x55b4e9ca2b40 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f788c9ab740 10 client.0 _ll_register_callbacks cb 0x7f787c09b940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f78837fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 0x55b4e9cbe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f78837fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 0x55b4e9cbe9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54800/0 (socket says 172.21.15.152:54800) 2024-09-11T22:11:04.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f78837fe640 1 -- 172.21.15.152:0/2480128480 learned_addr learned my addr 172.21.15.152:0/2480128480 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:04.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f7883fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 0x55b4e9cc1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f7888b6f640 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9cbeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f78837fe640 1 -- 172.21.15.152:0/2480128480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 msgr2=0x55b4e9cbeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:04.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f78837fe640 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9cbeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f78837fe640 1 -- 172.21.15.152:0/2480128480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 msgr2=0x55b4e9cc1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:04.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f78837fe640 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 0x55b4e9cc1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f78837fe640 1 -- 172.21.15.152:0/2480128480 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4e9cbf420 con 0x55b4e9ca2b40 2024-09-11T22:11:04.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f78837fe640 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 0x55b4e9cbe9a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f787801b000 tx=0x7f7878004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=286ff935fce55863 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:04.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.671+0000 7f78637fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:04.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.672+0000 7f78637fe640 1 -- 172.21.15.152:0/2480128480 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878017040 con 0x55b4e9ca2b40 2024-09-11T22:11:04.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.672+0000 7f788c9ab740 1 -- 172.21.15.152:0/2480128480 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f787c09b530 con 0x55b4e9ca2b40 2024-09-11T22:11:04.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.672+0000 7f78637fe640 1 -- 172.21.15.152:0/2480128480 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7f7878009040 con 0x55b4e9ca2b40 2024-09-11T22:11:04.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.672+0000 7f78637fe640 1 -- 172.21.15.152:0/2480128480 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7878005020 con 0x55b4e9ca2b40 2024-09-11T22:11:04.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.672+0000 7f788c9ab740 10 client.26608 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:04.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.672+0000 7f788c9ab740 1 -- 172.21.15.152:0/2480128480 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b4e9d268e0 con 0x55b4e9ca2b40 2024-09-11T22:11:04.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.673+0000 7f78637fe640 1 -- 172.21.15.152:0/2480128480 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7878019050 con 0x55b4e9ca2b40 2024-09-11T22:11:04.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.673+0000 7f78637fe640 1 -- 172.21.15.152:0/2480128480 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7878027070 con 0x55b4e9ca2b40 2024-09-11T22:11:04.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.674+0000 7f788c9ab740 10 client.26608 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.674+0000 7f788c9ab740 10 client.26608 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.674+0000 7f788c9ab740 20 client.26608 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.674+0000 7f788c9ab740 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55b4e9d27100 0x55b4e9d29520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.674+0000 7f788c9ab740 4 client.26608 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.674+0000 7f788c9ab740 1 -- 172.21.15.152:0/2480128480 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f787c09b530 con 0x55b4e9d27100 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.674+0000 7f7883fff640 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55b4e9d27100 0x55b4e9d29520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.675+0000 7f7883fff640 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55b4e9d27100 0x55b4e9d29520 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4748a1d845d1a027 server_cookie=3952a6ea5d4efd62 in_seq=0 out_seq=0 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.675+0000 7f78637fe640 10 client.26608 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.675+0000 7f78637fe640 1 -- 172.21.15.152:0/2480128480 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f787c09b530 con 0x55b4e9d27100 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.675+0000 7f78637fe640 10 client.26608 handle_command_reply: tid=0 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.675+0000 7f788c9ab740 1 client.26608 shutdown 2024-09-11T22:11:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788c9ab740 1 -- 172.21.15.152:0/2480128480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 msgr2=0x55b4e9cbe9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788c9ab740 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 0x55b4e9cbe9a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f787801b000 tx=0x7f7878004730 comp rx=0 tx=0).stop 2024-09-11T22:11:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788c9ab740 1 -- 172.21.15.152:0/2480128480 shutdown_connections 2024-09-11T22:11:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788c9ab740 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55b4e9d27100 0x55b4e9d29520 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788c9ab740 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4e9cac370 0x55b4e9cbeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788c9ab740 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4e9ca2b40 0x55b4e9cbe9a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788c9ab740 1 --2- 172.21.15.152:0/2480128480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4e9ca15d0 0x55b4e9cc1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788c9ab740 1 -- 172.21.15.152:0/2480128480 >> 172.21.15.152:0/2480128480 conn(0x55b4e9c6a310 msgr2=0x55b4e9caafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f78637fe640 0 client.26608 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:11:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788c9ab740 1 -- 172.21.15.152:0/2480128480 shutdown_connections 2024-09-11T22:11:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788c9ab740 1 -- 172.21.15.152:0/2480128480 wait complete. 2024-09-11T22:11:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788c9ab740 20 client.26608 trim_cache size 0 max 16384 2024-09-11T22:11:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:11:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788a5d2640 1 -- 172.21.15.152:0/1786288860 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f786c0a2d70 msgr2=0x7f786c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788a5d2640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f786c0a2d70 0x7f786c0a5230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7884105730 tx=0x7f7878011440 comp rx=0 tx=0).stop 2024-09-11T22:11:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788a5d2640 1 -- 172.21.15.152:0/1786288860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7884105e00 msgr2=0x7f788419f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.676+0000 7f788a5d2640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7884105e00 0x7f788419f010 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f787c009fd0 tx=0x7f787c00ef10 comp rx=0 tx=0).stop 2024-09-11T22:11:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.677+0000 7f788a5d2640 1 -- 172.21.15.152:0/1786288860 shutdown_connections 2024-09-11T22:11:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.677+0000 7f788a5d2640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f786c0a2d70 0x7f786c0a5230 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.677+0000 7f788a5d2640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7884105e00 0x7f788419f010 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.677+0000 7f788a5d2640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78841021b0 0x7f788419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.677+0000 7f788a5d2640 1 --2- 172.21.15.152:0/1786288860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7884101800 0x7f788419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:04.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.677+0000 7f788a5d2640 1 -- 172.21.15.152:0/1786288860 >> 172.21.15.152:0/1786288860 conn(0x7f78840fba90 msgr2=0x7f78840fbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:04.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.677+0000 7f788a5d2640 1 -- 172.21.15.152:0/1786288860 shutdown_connections 2024-09-11T22:11:04.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:04.677+0000 7f788a5d2640 1 -- 172.21.15.152:0/1786288860 wait complete. 2024-09-11T22:11:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 330.0 s, 3460.6 tps, lat 28.716 ms stddev 71.101 2024-09-11T22:11:05.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:04 smithi152 ceph-mon[31188]: pgmap v206: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 37 MiB/s wr, 1.59k op/s 2024-09-11T22:11:05.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:04 smithi179 ceph-mon[35603]: pgmap v206: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 37 MiB/s wr, 1.59k op/s 2024-09-11T22:11:05.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:04 smithi193 ceph-mon[35545]: pgmap v206: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 37 MiB/s wr, 1.59k op/s 2024-09-11T22:11:06.105 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:11:06.532 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:06.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:06 smithi152 ceph-mon[31188]: pgmap v207: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 1.39k op/s 2024-09-11T22:11:07.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.168+0000 7ff6c1fce640 1 -- 172.21.15.152:0/238645240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6bc074eb0 msgr2=0x7ff6bc112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.168+0000 7ff6c1fce640 1 --2- 172.21.15.152:0/238645240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6bc074eb0 0x7ff6bc112660 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009860 tx=0x7ff6a402a3d0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.168+0000 7ff6c1fce640 1 -- 172.21.15.152:0/238645240 shutdown_connections 2024-09-11T22:11:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.168+0000 7ff6c1fce640 1 --2- 172.21.15.152:0/238645240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6bc112ba0 0x7ff6bc114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.168+0000 7ff6c1fce640 1 --2- 172.21.15.152:0/238645240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6bc074eb0 0x7ff6bc112660 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.168+0000 7ff6c1fce640 1 --2- 172.21.15.152:0/238645240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6bc074590 0x7ff6bc074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.168+0000 7ff6c1fce640 1 -- 172.21.15.152:0/238645240 >> 172.21.15.152:0/238645240 conn(0x7ff6bc0fd8b0 msgr2=0x7ff6bc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.168+0000 7ff6c1fce640 1 -- 172.21.15.152:0/238645240 shutdown_connections 2024-09-11T22:11:07.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.168+0000 7ff6c1fce640 1 -- 172.21.15.152:0/238645240 wait complete. 2024-09-11T22:11:07.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.168+0000 7ff6c1fce640 1 Processor -- start 2024-09-11T22:11:07.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.169+0000 7ff6c1fce640 1 -- start start 2024-09-11T22:11:07.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.169+0000 7ff6c1fce640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6bc074590 0x7ff6bc1a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.169+0000 7ff6c1fce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6bc074eb0 0x7ff6bc1a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.169+0000 7ff6c1fce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6bc112ba0 0x7ff6bc19e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.169+0000 7ff6c1fce640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc118550 con 0x7ff6bc112ba0 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.169+0000 7ff6c1fce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc1183d0 con 0x7ff6bc074eb0 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.169+0000 7ff6c1fce640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc1186d0 con 0x7ff6bc074590 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.169+0000 7ff6bb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6bc074590 0x7ff6bc1a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.169+0000 7ff6bb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6bc074590 0x7ff6bc1a4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54822/0 (socket says 172.21.15.152:54822) 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.169+0000 7ff6bb7fe640 1 -- 172.21.15.152:0/1942308358 learned_addr learned my addr 172.21.15.152:0/1942308358 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.170+0000 7ff6bb7fe640 1 -- 172.21.15.152:0/1942308358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6bc074eb0 msgr2=0x7ff6bc1a4c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.170+0000 7ff6bb7fe640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6bc074eb0 0x7ff6bc1a4c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.170+0000 7ff6bb7fe640 1 -- 172.21.15.152:0/1942308358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6bc112ba0 msgr2=0x7ff6bc19e900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.170+0000 7ff6bb7fe640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6bc112ba0 0x7ff6bc19e900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.170+0000 7ff6bb7fe640 1 -- 172.21.15.152:0/1942308358 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc19f030 con 0x7ff6bc074590 2024-09-11T22:11:07.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.170+0000 7ff6bb7fe640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6bc074590 0x7ff6bc1a4740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00d950 tx=0x7ff6ac00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:07.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.171+0000 7ff6b97fa640 1 -- 172.21.15.152:0/1942308358 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac017070 con 0x7ff6bc074590 2024-09-11T22:11:07.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.171+0000 7ff6c1fce640 1 -- 172.21.15.152:0/1942308358 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6bc19f320 con 0x7ff6bc074590 2024-09-11T22:11:07.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.171+0000 7ff6c1fce640 1 -- 172.21.15.152:0/1942308358 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6bc1ab610 con 0x7ff6bc074590 2024-09-11T22:11:07.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.171+0000 7ff6b97fa640 1 -- 172.21.15.152:0/1942308358 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6ac009c30 con 0x7ff6bc074590 2024-09-11T22:11:07.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.171+0000 7ff6b97fa640 1 -- 172.21.15.152:0/1942308358 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00f6b0 con 0x7ff6bc074590 2024-09-11T22:11:07.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.174+0000 7ff6c43a7740 1 Processor -- start 2024-09-11T22:11:07.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.174+0000 7ff6c43a7740 1 -- start start 2024-09-11T22:11:07.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879707b40 0x55a879706090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a8797065d0 0x55a879706a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 0x55a879713760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a87966c2f0 con 0x55a8797065d0 2024-09-11T22:11:07.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a879613cf0 con 0x55a879711370 2024-09-11T22:11:07.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a8796682b0 con 0x55a879707b40 2024-09-11T22:11:07.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6b3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 0x55a879713760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6bbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879707b40 0x55a879706090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6b3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 0x55a879713760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35594/0 (socket says 172.21.15.152:35594) 2024-09-11T22:11:07.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6b3fff640 1 -- 172.21.15.152:0/3549715019 learned_addr learned my addr 172.21.15.152:0/3549715019 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:07.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6b97fa640 1 -- 172.21.15.152:0/1942308358 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff6ac0109d0 con 0x7ff6bc074590 2024-09-11T22:11:07.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6b3fff640 1 -- 172.21.15.152:0/3549715019 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879707b40 msgr2=0x55a879706090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:07.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6b3fff640 1 --2- 172.21.15.152:0/3549715019 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879707b40 0x55a879706090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6b3fff640 1 -- 172.21.15.152:0/3549715019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a8797065d0 msgr2=0x55a879706a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:11:07.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6b3fff640 1 --2- 172.21.15.152:0/3549715019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a8797065d0 0x55a879706a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6b3fff640 1 -- 172.21.15.152:0/3549715019 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8795f83a0 con 0x55a879711370 2024-09-11T22:11:07.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.175+0000 7ff6bbfff640 1 --2- 172.21.15.152:0/3549715019 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879707b40 0x55a879706090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:07.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.176+0000 7ff6b3fff640 1 --2- 172.21.15.152:0/3549715019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 0x55a879713760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4005dd0 tx=0x7ff6a402f300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa49aab7ebaa3d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:07.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.176+0000 7ff6b1ffb640 1 -- 172.21.15.152:0/3549715019 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4030cb0 con 0x55a879711370 2024-09-11T22:11:07.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.176+0000 7ff6b1ffb640 1 -- 172.21.15.152:0/3549715019 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6a4030e50 con 0x55a879711370 2024-09-11T22:11:07.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.176+0000 7ff6b1ffb640 1 -- 172.21.15.152:0/3549715019 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4004900 con 0x55a879711370 2024-09-11T22:11:07.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.177+0000 7ff6b97fa640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6a80a2ef0 0x7ff6a80a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.177+0000 7ff6b97fa640 1 -- 172.21.15.152:0/1942308358 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff6ac00f450 con 0x7ff6bc074590 2024-09-11T22:11:07.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.178+0000 7ff6bbfff640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6a80a2ef0 0x7ff6a80a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.178+0000 7ff6bbfff640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6a80a2ef0 0x7ff6a80a53b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc076600 tx=0x7ff6b4010040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:07.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.178+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3549715019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 msgr2=0x55a879713760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:07.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.178+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/3549715019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 0x55a879713760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4005dd0 tx=0x7ff6a402f300 comp rx=0 tx=0).stop 2024-09-11T22:11:07.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.178+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3549715019 shutdown_connections 2024-09-11T22:11:07.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.178+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/3549715019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 0x55a879713760 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.178+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/3549715019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a8797065d0 0x55a879706a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.178+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/3549715019 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879707b40 0x55a879706090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.178+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3549715019 >> 172.21.15.152:0/3549715019 conn(0x55a8796cf310 msgr2=0x55a879702c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:07.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.179+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3549715019 shutdown_connections 2024-09-11T22:11:07.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.179+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3549715019 wait complete. 2024-09-11T22:11:07.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.179+0000 7ff6c43a7740 1 -- start start 2024-09-11T22:11:07.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.179+0000 7ff6c43a7740 1 Processor -- start 2024-09-11T22:11:07.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.179+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 0x55a879710df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.179+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879707b40 0x55a87970e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.179+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879711370 0x55a87970e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.179+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a879714010 con 0x55a879711370 2024-09-11T22:11:07.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.179+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a879627060 con 0x55a8797065d0 2024-09-11T22:11:07.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a879714190 con 0x55a879707b40 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6c43a7740 10 client.0 _ll_register_callbacks cb 0x55a87937a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6bbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879711370 0x55a87970e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6bb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 0x55a879710df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6bbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879711370 0x55a87970e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55416/0 (socket says 172.21.15.152:55416) 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6bbfff640 1 -- 172.21.15.152:0/3312189320 learned_addr learned my addr 172.21.15.152:0/3312189320 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6b3fff640 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879707b40 0x55a87970e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6bbfff640 1 -- 172.21.15.152:0/3312189320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879707b40 msgr2=0x55a87970e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6bbfff640 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879707b40 0x55a87970e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6bbfff640 1 -- 172.21.15.152:0/3312189320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 msgr2=0x55a879710df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6bbfff640 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 0x55a879710df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6bbfff640 1 -- 172.21.15.152:0/3312189320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8793dd3c0 con 0x55a879711370 2024-09-11T22:11:07.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6bb7fe640 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 0x55a879710df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:07.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff6bbfff640 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879711370 0x55a87970e7e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009590 tx=0x7ff6b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2d34e51d263c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:07.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.180+0000 7ff69affd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:11:07.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.181+0000 7ff69affd640 1 -- 172.21.15.152:0/3312189320 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40235f0 con 0x55a879711370 2024-09-11T22:11:07.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.181+0000 7ff69affd640 1 -- 172.21.15.152:0/3312189320 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff6b4023790 con 0x55a879711370 2024-09-11T22:11:07.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.181+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3312189320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6a4030e50 con 0x55a879711370 2024-09-11T22:11:07.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.181+0000 7ff69affd640 1 -- 172.21.15.152:0/3312189320 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff6b4031050 con 0x55a879711370 2024-09-11T22:11:07.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.181+0000 7ff6c43a7740 10 client.17049 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:07.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.181+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3312189320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a87971fba0 con 0x55a879711370 2024-09-11T22:11:07.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.181+0000 7ff69affd640 1 -- 172.21.15.152:0/3312189320 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6a4030e50 con 0x55a879711370 2024-09-11T22:11:07.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.181+0000 7ff69affd640 1 -- 172.21.15.152:0/3312189320 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff6b400b040 con 0x55a879711370 2024-09-11T22:11:07.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.182+0000 7ff6c43a7740 10 client.17049 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:07.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.182+0000 7ff6c43a7740 10 client.17049 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:07.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.182+0000 7ff6c43a7740 20 client.17049 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:07.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.182+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a8797210b0 0x55a8797234e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.182+0000 7ff6c43a7740 4 client.17049 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:07.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.182+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3312189320 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a879679860 con 0x55a8797210b0 2024-09-11T22:11:07.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.182+0000 7ff6bb7fe640 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a8797210b0 0x55a8797234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.183+0000 7ff69affd640 10 client.17049 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:07.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.183+0000 7ff6bb7fe640 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a8797210b0 0x55a8797234e0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e25a698db229a5b8 server_cookie=73fa8caabc6b31f in_seq=0 out_seq=0 2024-09-11T22:11:07.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff69affd640 1 -- 172.21.15.152:0/3312189320 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a879679860 con 0x55a8797210b0 2024-09-11T22:11:07.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff69affd640 10 client.17049 handle_command_reply: tid=0 2024-09-11T22:11:07.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff6c43a7740 1 client.17049 shutdown 2024-09-11T22:11:07.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3312189320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879711370 msgr2=0x55a87970e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:07.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879711370 0x55a87970e7e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009590 tx=0x7ff6b4004a40 comp rx=0 tx=0).stop 2024-09-11T22:11:07.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3312189320 shutdown_connections 2024-09-11T22:11:07.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a8797210b0 0x55a8797234e0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879711370 0x55a87970e7e0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff69affd640 0 client.17049 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:07.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879707b40 0x55a87970e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/3312189320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 0x55a879710df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.184+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3312189320 >> 172.21.15.152:0/3312189320 conn(0x55a8796cf310 msgr2=0x55a879708960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:07.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.185+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3312189320 shutdown_connections 2024-09-11T22:11:07.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.185+0000 7ff6c43a7740 1 -- 172.21.15.152:0/3312189320 wait complete. 2024-09-11T22:11:07.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.185+0000 7ff6c43a7740 20 client.17049 trim_cache size 0 max 16384 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.204+0000 7ff6c43a7740 1 Processor -- start 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6c43a7740 1 -- start start 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a8797065d0 0x55a87971d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879707b40 0x55a879709120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 0x55a879709660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc1b6930 con 0x55a879707b40 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc1b4200 con 0x55a879711370 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc1b2050 con 0x55a8797065d0 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879707b40 0x55a879709120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6bb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a8797065d0 0x55a87971d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6bbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 0x55a879709660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6bb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a8797065d0 0x55a87971d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54838/0 (socket says 172.21.15.152:54838) 2024-09-11T22:11:07.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.205+0000 7ff6bb7fe640 1 -- 172.21.15.152:0/1618117743 learned_addr learned my addr 172.21.15.152:0/1618117743 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:07.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.206+0000 7ff6b3fff640 1 -- 172.21.15.152:0/1618117743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a8797065d0 msgr2=0x55a87971d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:07.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.206+0000 7ff6b3fff640 1 --2- 172.21.15.152:0/1618117743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a8797065d0 0x55a87971d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.206+0000 7ff6b3fff640 1 -- 172.21.15.152:0/1618117743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 msgr2=0x55a879709660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:07.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.206+0000 7ff6b3fff640 1 --2- 172.21.15.152:0/1618117743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 0x55a879709660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.206+0000 7ff6b3fff640 1 -- 172.21.15.152:0/1618117743 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a879703960 con 0x55a879707b40 2024-09-11T22:11:07.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.206+0000 7ff6bb7fe640 1 --2- 172.21.15.152:0/1618117743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a8797065d0 0x55a87971d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:07.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.206+0000 7ff6b3fff640 1 --2- 172.21.15.152:0/1618117743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879707b40 0x55a879709120 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff6a402a8f0 tx=0x7ff6a402a3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c138a0f5d7143b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:07.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.207+0000 7ff6b17fa640 1 -- 172.21.15.152:0/1618117743 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4030cb0 con 0x55a879707b40 2024-09-11T22:11:07.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.207+0000 7ff6b17fa640 1 -- 172.21.15.152:0/1618117743 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6a4030e50 con 0x55a879707b40 2024-09-11T22:11:07.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.207+0000 7ff6b17fa640 1 -- 172.21.15.152:0/1618117743 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a402fea0 con 0x55a879707b40 2024-09-11T22:11:07.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.208+0000 7ff6c43a7740 1 -- 172.21.15.152:0/1618117743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879707b40 msgr2=0x55a879709120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:07.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.208+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/1618117743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879707b40 0x55a879709120 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff6a402a8f0 tx=0x7ff6a402a3d0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.209+0000 7ff6c43a7740 1 -- 172.21.15.152:0/1618117743 shutdown_connections 2024-09-11T22:11:07.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.209+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/1618117743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a879711370 0x55a879709660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.209+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/1618117743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879707b40 0x55a879709120 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.209+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/1618117743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a8797065d0 0x55a87971d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.209+0000 7ff6c43a7740 1 -- 172.21.15.152:0/1618117743 >> 172.21.15.152:0/1618117743 conn(0x55a8796cf310 msgr2=0x55a879710120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:07.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.209+0000 7ff6c43a7740 1 -- 172.21.15.152:0/1618117743 shutdown_connections 2024-09-11T22:11:07.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.209+0000 7ff6c43a7740 1 -- 172.21.15.152:0/1618117743 wait complete. 2024-09-11T22:11:07.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.209+0000 7ff6c43a7740 1 -- start start 2024-09-11T22:11:07.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.210+0000 7ff6c43a7740 1 Processor -- start 2024-09-11T22:11:07.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.210+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 0x55a87970b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.210+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879707b40 0x55a87970b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6c43a7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879711370 0x55a87970bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc1b26c0 con 0x55a879707b40 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc1b3b30 con 0x55a8797065d0 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6c43a7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc1b2d90 con 0x55a879711370 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6c43a7740 10 client.0 _ll_register_callbacks cb 0x7ff6b4009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6bb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 0x55a87970b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6bb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 0x55a87970b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35610/0 (socket says 172.21.15.152:35610) 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6bbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879711370 0x55a87970bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6bb7fe640 1 -- 172.21.15.152:0/606017753 learned_addr learned my addr 172.21.15.152:0/606017753 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6b3fff640 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879707b40 0x55a87970b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6bbfff640 1 -- 172.21.15.152:0/606017753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 msgr2=0x55a87970b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6bbfff640 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 0x55a87970b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6bbfff640 1 -- 172.21.15.152:0/606017753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879707b40 msgr2=0x55a87970b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6bbfff640 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879707b40 0x55a87970b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6bbfff640 1 -- 172.21.15.152:0/606017753 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a87978ad80 con 0x55a879711370 2024-09-11T22:11:07.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6bb7fe640 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 0x55a87970b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:07.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff6bbfff640 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879711370 0x55a87970bb30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009560 tx=0x7ff6b400df50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=915e83d9e2cd0bac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:07.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.211+0000 7ff69affd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:07.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.212+0000 7ff69affd640 1 -- 172.21.15.152:0/606017753 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4004cb0 con 0x55a879711370 2024-09-11T22:11:07.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.212+0000 7ff69affd640 1 -- 172.21.15.152:0/606017753 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8570+0+0 (secure 0 0 0) 0x7ff6b402c3b0 con 0x55a879711370 2024-09-11T22:11:07.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.212+0000 7ff6c43a7740 1 -- 172.21.15.152:0/606017753 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6a4030e50 con 0x55a879711370 2024-09-11T22:11:07.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.213+0000 7ff69affd640 1 -- 172.21.15.152:0/606017753 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff6b4004e50 con 0x55a879711370 2024-09-11T22:11:07.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.213+0000 7ff6c43a7740 10 client.26626 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:07.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.213+0000 7ff6c43a7740 1 -- 172.21.15.152:0/606017753 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a87978c040 con 0x55a879711370 2024-09-11T22:11:07.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.213+0000 7ff69affd640 1 -- 172.21.15.152:0/606017753 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6a4030e50 con 0x55a879711370 2024-09-11T22:11:07.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.213+0000 7ff69affd640 1 -- 172.21.15.152:0/606017753 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff6b4035430 con 0x55a879711370 2024-09-11T22:11:07.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.213+0000 7ff6c43a7740 10 client.26626 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:07.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.213+0000 7ff6c43a7740 10 client.26626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:07.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.213+0000 7ff6c43a7740 20 client.26626 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:07.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.213+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a8797210b0 0x55a87978e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:07.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.213+0000 7ff6c43a7740 4 client.26626 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:11:07.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.213+0000 7ff6c43a7740 1 -- 172.21.15.152:0/606017753 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a879673d70 con 0x55a8797210b0 2024-09-11T22:11:07.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.214+0000 7ff6bb7fe640 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a8797210b0 0x55a87978e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:07.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.214+0000 7ff69affd640 10 client.26626 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:07.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.214+0000 7ff6bb7fe640 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a8797210b0 0x55a87978e740 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c957689a6dceab2d server_cookie=38f59d76a6942720 in_seq=0 out_seq=0 2024-09-11T22:11:07.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.214+0000 7ff69affd640 1 -- 172.21.15.152:0/606017753 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a879673d70 con 0x55a8797210b0 2024-09-11T22:11:07.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.214+0000 7ff69affd640 10 client.26626 handle_command_reply: tid=0 2024-09-11T22:11:07.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.215+0000 7ff6c43a7740 1 client.26626 shutdown 2024-09-11T22:11:07.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff6c43a7740 1 -- 172.21.15.152:0/606017753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879711370 msgr2=0x55a87970bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:07.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879711370 0x55a87970bb30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009560 tx=0x7ff6b400df50 comp rx=0 tx=0).stop 2024-09-11T22:11:07.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff6c43a7740 1 -- 172.21.15.152:0/606017753 shutdown_connections 2024-09-11T22:11:07.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a8797210b0 0x55a87978e740 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a879711370 0x55a87970bb30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff69affd640 0 client.26626 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:07.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a879707b40 0x55a87970b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff6c43a7740 1 --2- 172.21.15.152:0/606017753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8797065d0 0x55a87970b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff6c43a7740 1 -- 172.21.15.152:0/606017753 >> 172.21.15.152:0/606017753 conn(0x55a8796cf310 msgr2=0x55a8797014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff6c43a7740 1 -- 172.21.15.152:0/606017753 shutdown_connections 2024-09-11T22:11:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff6c43a7740 1 -- 172.21.15.152:0/606017753 wait complete. 2024-09-11T22:11:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.216+0000 7ff6c43a7740 20 client.26626 trim_cache size 0 max 16384 2024-09-11T22:11:07.219 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:11:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.217+0000 7ff6c1fce640 1 -- 172.21.15.152:0/1942308358 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6a80a2ef0 msgr2=0x7ff6a80a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.217+0000 7ff6c1fce640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6a80a2ef0 0x7ff6a80a53b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc076600 tx=0x7ff6b4010040 comp rx=0 tx=0).stop 2024-09-11T22:11:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.217+0000 7ff6c1fce640 1 -- 172.21.15.152:0/1942308358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6bc074590 msgr2=0x7ff6bc1a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.217+0000 7ff6c1fce640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6bc074590 0x7ff6bc1a4740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00d950 tx=0x7ff6ac00de10 comp rx=0 tx=0).stop 2024-09-11T22:11:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.217+0000 7ff6c1fce640 1 -- 172.21.15.152:0/1942308358 shutdown_connections 2024-09-11T22:11:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.217+0000 7ff6c1fce640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff6a80a2ef0 0x7ff6a80a53b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.217+0000 7ff6c1fce640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6bc112ba0 0x7ff6bc19e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.217+0000 7ff6c1fce640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6bc074eb0 0x7ff6bc1a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.217+0000 7ff6c1fce640 1 --2- 172.21.15.152:0/1942308358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6bc074590 0x7ff6bc1a4740 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.217+0000 7ff6c1fce640 1 -- 172.21.15.152:0/1942308358 >> 172.21.15.152:0/1942308358 conn(0x7ff6bc0fd8b0 msgr2=0x7ff6bc0ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:07.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.219+0000 7ff6c1fce640 1 -- 172.21.15.152:0/1942308358 shutdown_connections 2024-09-11T22:11:07.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:07.219+0000 7ff6c1fce640 1 -- 172.21.15.152:0/1942308358 wait complete. 2024-09-11T22:11:07.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:06 smithi179 ceph-mon[35603]: pgmap v207: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 1.39k op/s 2024-09-11T22:11:07.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:06 smithi193 ceph-mon[35545]: pgmap v207: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 1.39k op/s 2024-09-11T22:11:08.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:08 smithi152 ceph-mon[31188]: pgmap v208: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 1.36k op/s 2024-09-11T22:11:08.985 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:11:08.985 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:11:09.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:08 smithi179 ceph-mon[35603]: pgmap v208: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 1.36k op/s 2024-09-11T22:11:09.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:08 smithi193 ceph-mon[35545]: pgmap v208: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 1.36k op/s 2024-09-11T22:11:09.361 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:09.763 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.763+0000 7f14d0fe8640 1 -- 172.21.15.152:0/1351555255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc10c0e0 msgr2=0x7f14cc10e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.763+0000 7f14d0fe8640 1 --2- 172.21.15.152:0/1351555255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc10c0e0 0x7f14cc10e560 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009be0 tx=0x7f14c402a750 comp rx=0 tx=0).stop 2024-09-11T22:11:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.764+0000 7f14d0fe8640 1 -- 172.21.15.152:0/1351555255 shutdown_connections 2024-09-11T22:11:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.764+0000 7f14d0fe8640 1 --2- 172.21.15.152:0/1351555255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc10c0e0 0x7f14cc10e560 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.764+0000 7f14d0fe8640 1 --2- 172.21.15.152:0/1351555255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14cc1035b0 0x7f14cc10ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.764+0000 7f14d0fe8640 1 --2- 172.21.15.152:0/1351555255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14cc102c90 0x7f14cc103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.764+0000 7f14d0fe8640 1 -- 172.21.15.152:0/1351555255 >> 172.21.15.152:0/1351555255 conn(0x7f14cc0fc700 msgr2=0x7f14cc0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.764+0000 7f14d0fe8640 1 -- 172.21.15.152:0/1351555255 shutdown_connections 2024-09-11T22:11:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.764+0000 7f14d0fe8640 1 -- 172.21.15.152:0/1351555255 wait complete. 2024-09-11T22:11:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.765+0000 7f14d0fe8640 1 Processor -- start 2024-09-11T22:11:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.765+0000 7f14d0fe8640 1 -- start start 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14d0fe8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc102c90 0x7f14cc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14d0fe8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14cc1035b0 0x7f14cc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14d0fe8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14cc10c0e0 0x7f14cc19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14d0fe8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc111f00 con 0x7f14cc10c0e0 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14d0fe8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc111d80 con 0x7f14cc102c90 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14d0fe8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc112080 con 0x7f14cc1035b0 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14ca59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc102c90 0x7f14cc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14ca59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc102c90 0x7f14cc19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35624/0 (socket says 172.21.15.152:35624) 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14ca59c640 1 -- 172.21.15.152:0/205720582 learned_addr learned my addr 172.21.15.152:0/205720582 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14c9d9b640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14cc1035b0 0x7f14cc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14cad9d640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14cc10c0e0 0x7f14cc19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14ca59c640 1 -- 172.21.15.152:0/205720582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14cc1035b0 msgr2=0x7f14cc19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14ca59c640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14cc1035b0 0x7f14cc19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14ca59c640 1 -- 172.21.15.152:0/205720582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14cc10c0e0 msgr2=0x7f14cc19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14ca59c640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14cc10c0e0 0x7f14cc19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14ca59c640 1 -- 172.21.15.152:0/205720582 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc19f5f0 con 0x7f14cc102c90 2024-09-11T22:11:09.768 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14cad9d640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14cc10c0e0 0x7f14cc19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14ca59c640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc102c90 0x7f14cc19a600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00e9c0 tx=0x7f14bc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14bb7fe640 1 -- 172.21.15.152:0/205720582 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00ccc0 con 0x7f14cc102c90 2024-09-11T22:11:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.766+0000 7f14bb7fe640 1 -- 172.21.15.152:0/205720582 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14bc005500 con 0x7f14cc102c90 2024-09-11T22:11:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.767+0000 7f14bb7fe640 1 -- 172.21.15.152:0/205720582 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc010430 con 0x7f14cc102c90 2024-09-11T22:11:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.767+0000 7f14d0fe8640 1 -- 172.21.15.152:0/205720582 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14cc19f8e0 con 0x7f14cc102c90 2024-09-11T22:11:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.767+0000 7f14d0fe8640 1 -- 172.21.15.152:0/205720582 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14cc1a7170 con 0x7f14cc102c90 2024-09-11T22:11:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.770+0000 7f14d3e60740 1 Processor -- start 2024-09-11T22:11:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.770+0000 7f14d3e60740 1 -- start start 2024-09-11T22:11:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.770+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 0x55f6d1cdded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.770+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1ce8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ceb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14d3e60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f6d1c422f0 con 0x55f6d1cddaf0 2024-09-11T22:11:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14d3e60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f6d1bea270 con 0x55f6d1cde410 2024-09-11T22:11:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14d3e60740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f6d1c3e2b0 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14cad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 0x55f6d1cdded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14cad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 0x55f6d1cdded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55464/0 (socket says 172.21.15.152:55464) 2024-09-11T22:11:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14cad9d640 1 -- 172.21.15.152:0/3883185713 learned_addr learned my addr 172.21.15.152:0/3883185713 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14c9d9b640 1 --2- 172.21.15.152:0/3883185713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ceb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14cad9d640 1 -- 172.21.15.152:0/3883185713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 msgr2=0x55f6d1ceb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14cad9d640 1 --2- 172.21.15.152:0/3883185713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ceb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14cad9d640 1 -- 172.21.15.152:0/3883185713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 msgr2=0x55f6d1ce8770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:11:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14cad9d640 1 --2- 172.21.15.152:0/3883185713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1ce8770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.771+0000 7f14cad9d640 1 -- 172.21.15.152:0/3883185713 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d1be9340 con 0x55f6d1cddaf0 2024-09-11T22:11:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.772+0000 7f14c9d9b640 1 --2- 172.21.15.152:0/3883185713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ceb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.772+0000 7f14cad9d640 1 --2- 172.21.15.152:0/3883185713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 0x55f6d1cdded0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009be0 tx=0x7f14c4030c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963b1eacadcbcaa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.772+0000 7f14bb7fe640 1 -- 172.21.15.152:0/205720582 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f14bc0046c0 con 0x7f14cc102c90 2024-09-11T22:11:09.775 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.772+0000 7f14b8ff9640 1 -- 172.21.15.152:0/3883185713 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4040030 con 0x55f6d1cddaf0 2024-09-11T22:11:09.775 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.772+0000 7f14b8ff9640 1 -- 172.21.15.152:0/3883185713 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14c4030e40 con 0x55f6d1cddaf0 2024-09-11T22:11:09.775 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.772+0000 7f14b8ff9640 1 -- 172.21.15.152:0/3883185713 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4036040 con 0x55f6d1cddaf0 2024-09-11T22:11:09.775 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.773+0000 7f14d3e60740 1 -- 172.21.15.152:0/3883185713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 msgr2=0x55f6d1cdded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.775 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.773+0000 7f14d3e60740 1 --2- 172.21.15.152:0/3883185713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 0x55f6d1cdded0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009be0 tx=0x7f14c4030c50 comp rx=0 tx=0).stop 2024-09-11T22:11:09.775 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.773+0000 7f14d3e60740 1 -- 172.21.15.152:0/3883185713 shutdown_connections 2024-09-11T22:11:09.775 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.773+0000 7f14d3e60740 1 --2- 172.21.15.152:0/3883185713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ceb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.773+0000 7f14bb7fe640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14b40a2ef0 0x7f14b40a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.773+0000 7f14d3e60740 1 --2- 172.21.15.152:0/3883185713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1ce8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.773+0000 7f14d3e60740 1 --2- 172.21.15.152:0/3883185713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 0x55f6d1cdded0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.773+0000 7f14d3e60740 1 -- 172.21.15.152:0/3883185713 >> 172.21.15.152:0/3883185713 conn(0x55f6d1cda060 msgr2=0x55f6d1cda440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.774+0000 7f14cad9d640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14b40a2ef0 0x7f14b40a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.774+0000 7f14bb7fe640 1 -- 172.21.15.152:0/205720582 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8658+0+0 (secure 0 0 0) 0x7f14bc0cf840 con 0x7f14cc102c90 2024-09-11T22:11:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.774+0000 7f14d3e60740 1 -- 172.21.15.152:0/3883185713 shutdown_connections 2024-09-11T22:11:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.774+0000 7f14d3e60740 1 -- 172.21.15.152:0/3883185713 wait complete. 2024-09-11T22:11:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.774+0000 7f14cad9d640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14b40a2ef0 0x7f14b40a53b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f14c402ad40 tx=0x7f14c402a750 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.774+0000 7f14d3e60740 1 -- start start 2024-09-11T22:11:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.774+0000 7f14d3e60740 1 Processor -- start 2024-09-11T22:11:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.775+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1cddaf0 0x55f6d1ce5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.775+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cde410 0x55f6d1ce6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.775+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ce6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.775+0000 7f14d3e60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f6d1ceb880 con 0x55f6d1cde410 2024-09-11T22:11:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.775+0000 7f14cad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ce6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.775+0000 7f14cad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ce6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35632/0 (socket says 172.21.15.152:35632) 2024-09-11T22:11:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.775+0000 7f14cad9d640 1 -- 172.21.15.152:0/1464382099 learned_addr learned my addr 172.21.15.152:0/1464382099 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.775+0000 7f14d3e60740 1 -- 172.21.15.152:0/1464382099 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f6d1bcb290 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.775+0000 7f14d3e60740 1 -- 172.21.15.152:0/1464382099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f6d1ceba00 con 0x55f6d1cddaf0 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.775+0000 7f14d3e60740 10 client.0 _ll_register_callbacks cb 0x55f6d1bfc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.776+0000 7f14ca59c640 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1cddaf0 0x55f6d1ce5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.776+0000 7f14c9d9b640 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cde410 0x55f6d1ce6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.777+0000 7f14ca59c640 1 -- 172.21.15.152:0/1464382099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1ce8cb0 msgr2=0x55f6d1ce6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.777+0000 7f14ca59c640 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ce6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.777+0000 7f14ca59c640 1 -- 172.21.15.152:0/1464382099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cde410 msgr2=0x55f6d1ce6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.777+0000 7f14ca59c640 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cde410 0x55f6d1ce6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.777+0000 7f14ca59c640 1 -- 172.21.15.152:0/1464382099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6d1955210 con 0x55f6d1cddaf0 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.777+0000 7f14ca59c640 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1cddaf0 0x55f6d1ce5c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0cce70 tx=0x7f14bc005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=840ed401c2c9e9e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.777+0000 7f14b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.777+0000 7f14b1ffb640 1 -- 172.21.15.152:0/1464382099 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc0cd330 con 0x55f6d1cddaf0 2024-09-11T22:11:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.777+0000 7f14b1ffb640 1 -- 172.21.15.152:0/1464382099 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8658+0+0 (secure 0 0 0) 0x7f14bc0a4650 con 0x55f6d1cddaf0 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.777+0000 7f14d3e60740 1 -- 172.21.15.152:0/1464382099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14c4030e40 con 0x55f6d1cddaf0 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.778+0000 7f14b1ffb640 1 -- 172.21.15.152:0/1464382099 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f14bc0a48e0 con 0x55f6d1cddaf0 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.778+0000 7f14d3e60740 10 client.26632 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.778+0000 7f14d3e60740 1 -- 172.21.15.152:0/1464382099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f6d1a21620 con 0x55f6d1cddaf0 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.778+0000 7f14b1ffb640 1 -- 172.21.15.152:0/1464382099 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14bc0ba3a0 con 0x55f6d1cddaf0 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.778+0000 7f14b1ffb640 1 -- 172.21.15.152:0/1464382099 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f14bc0979c0 con 0x55f6d1cddaf0 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.778+0000 7f14d3e60740 10 client.26632 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.778+0000 7f14d3e60740 10 client.26632 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.778+0000 7f14d3e60740 20 client.26632 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.778+0000 7f14d3e60740 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6d1d017e0 0x55f6d1d03c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.778+0000 7f14d3e60740 4 client.26632 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.778+0000 7f14d3e60740 1 -- 172.21.15.152:0/1464382099 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f14c4030e40 con 0x55f6d1d017e0 2024-09-11T22:11:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.779+0000 7f14c9d9b640 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6d1d017e0 0x55f6d1d03c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.780+0000 7f14c9d9b640 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6d1d017e0 0x55f6d1d03c10 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ff849d14b8dfab1 server_cookie=c9d10cddd0067007 in_seq=0 out_seq=0 2024-09-11T22:11:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.780+0000 7f14b1ffb640 10 client.26632 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.780+0000 7f14b1ffb640 1 -- 172.21.15.152:0/1464382099 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f14c4030e40 con 0x55f6d1d017e0 2024-09-11T22:11:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.780+0000 7f14b1ffb640 10 client.26632 handle_command_reply: tid=0 2024-09-11T22:11:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.780+0000 7f14d3e60740 1 client.26632 shutdown 2024-09-11T22:11:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.780+0000 7f14d3e60740 1 -- 172.21.15.152:0/1464382099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1cddaf0 msgr2=0x55f6d1ce5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.781+0000 7f14d3e60740 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1cddaf0 0x55f6d1ce5c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0cce70 tx=0x7f14bc005770 comp rx=0 tx=0).stop 2024-09-11T22:11:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.781+0000 7f14d3e60740 1 -- 172.21.15.152:0/1464382099 shutdown_connections 2024-09-11T22:11:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.781+0000 7f14d3e60740 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6d1d017e0 0x55f6d1d03c10 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.781+0000 7f14d3e60740 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ce6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.781+0000 7f14d3e60740 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cde410 0x55f6d1ce6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.781+0000 7f14d3e60740 1 --2- 172.21.15.152:0/1464382099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1cddaf0 0x55f6d1ce5c10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.781+0000 7f14d3e60740 1 -- 172.21.15.152:0/1464382099 >> 172.21.15.152:0/1464382099 conn(0x55f6d1cda060 msgr2=0x55f6d1cdfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.781+0000 7f14b1ffb640 0 client.26632 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.781+0000 7f14d3e60740 1 -- 172.21.15.152:0/1464382099 shutdown_connections 2024-09-11T22:11:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.781+0000 7f14d3e60740 1 -- 172.21.15.152:0/1464382099 wait complete. 2024-09-11T22:11:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.781+0000 7f14d3e60740 20 client.26632 trim_cache size 0 max 16384 2024-09-11T22:11:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14d3e60740 1 Processor -- start 2024-09-11T22:11:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14d3e60740 1 -- start start 2024-09-11T22:11:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1cddaf0 0x55f6d1ce7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1d09520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1d09a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14d3e60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc1ae120 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14d3e60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc1ab9f0 con 0x55f6d1cde410 2024-09-11T22:11:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14d3e60740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc1a9880 con 0x55f6d1cddaf0 2024-09-11T22:11:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14cad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1d09a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14ca59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1cddaf0 0x55f6d1ce7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14cad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1d09a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55472/0 (socket says 172.21.15.152:55472) 2024-09-11T22:11:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14cad9d640 1 -- 172.21.15.152:0/3049159432 learned_addr learned my addr 172.21.15.152:0/3049159432 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14c9d9b640 1 --2- 172.21.15.152:0/3049159432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1d09520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14c9d9b640 1 -- 172.21.15.152:0/3049159432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1cddaf0 msgr2=0x55f6d1ce7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14c9d9b640 1 --2- 172.21.15.152:0/3049159432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1cddaf0 0x55f6d1ce7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14c9d9b640 1 -- 172.21.15.152:0/3049159432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1ce8cb0 msgr2=0x55f6d1d09a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14c9d9b640 1 --2- 172.21.15.152:0/3049159432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1d09a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.807+0000 7f14c9d9b640 1 -- 172.21.15.152:0/3049159432 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d1ce4c40 con 0x55f6d1cde410 2024-09-11T22:11:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.808+0000 7f14c9d9b640 1 --2- 172.21.15.152:0/3049159432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1d09520 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55f6d1ce7250 tx=0x7f14c0008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f913ce9b22771d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.809+0000 7f14b3fff640 1 -- 172.21.15.152:0/3049159432 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c000f040 con 0x55f6d1cde410 2024-09-11T22:11:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.809+0000 7f14b3fff640 1 -- 172.21.15.152:0/3049159432 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14c0021030 con 0x55f6d1cde410 2024-09-11T22:11:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.809+0000 7f14b3fff640 1 -- 172.21.15.152:0/3049159432 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c001d250 con 0x55f6d1cde410 2024-09-11T22:11:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.810+0000 7f14d3e60740 1 -- 172.21.15.152:0/3049159432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 msgr2=0x55f6d1d09520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.810+0000 7f14d3e60740 1 --2- 172.21.15.152:0/3049159432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1d09520 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55f6d1ce7250 tx=0x7f14c0008040 comp rx=0 tx=0).stop 2024-09-11T22:11:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.810+0000 7f14d3e60740 1 -- 172.21.15.152:0/3049159432 shutdown_connections 2024-09-11T22:11:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.810+0000 7f14d3e60740 1 --2- 172.21.15.152:0/3049159432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1d09a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.810+0000 7f14d3e60740 1 --2- 172.21.15.152:0/3049159432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1d09520 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.810+0000 7f14d3e60740 1 --2- 172.21.15.152:0/3049159432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1cddaf0 0x55f6d1ce7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.810+0000 7f14d3e60740 1 -- 172.21.15.152:0/3049159432 >> 172.21.15.152:0/3049159432 conn(0x55f6d1cda060 msgr2=0x55f6d1ce7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.810+0000 7f14d3e60740 1 -- 172.21.15.152:0/3049159432 shutdown_connections 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.810+0000 7f14d3e60740 1 -- 172.21.15.152:0/3049159432 wait complete. 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.810+0000 7f14d3e60740 1 -- start start 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.810+0000 7f14d3e60740 1 Processor -- start 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 0x55f6d1cf9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1ce2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14d3e60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ce3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14d3e60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc1a9ed0 con 0x55f6d1cddaf0 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14ca59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 0x55f6d1cf9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14cad9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ce3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14ca59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 0x55f6d1cf9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55482/0 (socket says 172.21.15.152:55482) 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14cad9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ce3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54890/0 (socket says 172.21.15.152:54890) 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14ca59c640 1 -- 172.21.15.152:0/991944173 learned_addr learned my addr 172.21.15.152:0/991944173 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14d3e60740 1 -- 172.21.15.152:0/991944173 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc1ab320 con 0x55f6d1cde410 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14d3e60740 1 -- 172.21.15.152:0/991944173 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc1aa580 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14d3e60740 10 client.0 _ll_register_callbacks cb 0x7f14bc004a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.811+0000 7f14c9d9b640 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1ce2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.812+0000 7f14cad9d640 1 -- 172.21.15.152:0/991944173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 msgr2=0x55f6d1ce2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.812+0000 7f14cad9d640 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1ce2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.812+0000 7f14cad9d640 1 -- 172.21.15.152:0/991944173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 msgr2=0x55f6d1cf9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.812+0000 7f14cad9d640 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 0x55f6d1cf9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.812+0000 7f14cad9d640 1 -- 172.21.15.152:0/991944173 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6d1ce3870 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.812+0000 7f14cad9d640 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ce3070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f14c4000f80 tx=0x7f14c4003e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e958da7beb805d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.812+0000 7f14b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.812+0000 7f14b1ffb640 1 -- 172.21.15.152:0/991944173 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c405f060 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.812+0000 7f14b1ffb640 1 -- 172.21.15.152:0/991944173 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8658+0+0 (secure 0 0 0) 0x7f14c40303a0 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.813+0000 7f14d3e60740 1 -- 172.21.15.152:0/991944173 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14c0021030 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.813+0000 7f14b1ffb640 1 -- 172.21.15.152:0/991944173 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f14c4040040 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.813+0000 7f14d3e60740 10 client.26638 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.813+0000 7f14d3e60740 1 -- 172.21.15.152:0/991944173 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f6d1d6c5c0 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.813+0000 7f14b1ffb640 1 -- 172.21.15.152:0/991944173 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14c4003b30 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.813+0000 7f14b1ffb640 1 -- 172.21.15.152:0/991944173 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f14c4032450 con 0x55f6d1ce8cb0 2024-09-11T22:11:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.814+0000 7f14d3e60740 10 client.26638 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.814+0000 7f14d3e60740 10 client.26638 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.814+0000 7f14d3e60740 20 client.26638 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.814+0000 7f14d3e60740 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6d1d6c850 0x55f6d1d6ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.814+0000 7f14d3e60740 4 client.26638 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:11:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.814+0000 7f14d3e60740 1 -- 172.21.15.152:0/991944173 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f14c0021030 con 0x55f6d1d6c850 2024-09-11T22:11:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.814+0000 7f14ca59c640 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6d1d6c850 0x55f6d1d6ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.814+0000 7f14b1ffb640 10 client.26638 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.814+0000 7f14ca59c640 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6d1d6c850 0x55f6d1d6ec40 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b961bd121a03a88c server_cookie=8543fd0cd026df5a in_seq=0 out_seq=0 2024-09-11T22:11:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 335.0 s, 2958.2 tps, lat 33.968 ms stddev 37.712 2024-09-11T22:11:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14b1ffb640 1 -- 172.21.15.152:0/991944173 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f14c0021030 con 0x55f6d1d6c850 2024-09-11T22:11:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14b1ffb640 10 client.26638 handle_command_reply: tid=0 2024-09-11T22:11:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 1 client.26638 shutdown 2024-09-11T22:11:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 1 -- 172.21.15.152:0/991944173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 msgr2=0x55f6d1ce3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ce3070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f14c4000f80 tx=0x7f14c4003e80 comp rx=0 tx=0).stop 2024-09-11T22:11:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 1 -- 172.21.15.152:0/991944173 shutdown_connections 2024-09-11T22:11:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6d1d6c850 0x55f6d1d6ec40 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6d1ce8cb0 0x55f6d1ce3070 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14b1ffb640 0 client.26638 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6d1cde410 0x55f6d1ce2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 1 --2- 172.21.15.152:0/991944173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6d1cddaf0 0x55f6d1cf9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 1 -- 172.21.15.152:0/991944173 >> 172.21.15.152:0/991944173 conn(0x55f6d1cda060 msgr2=0x55f6d1cd91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 1 -- 172.21.15.152:0/991944173 shutdown_connections 2024-09-11T22:11:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 1 -- 172.21.15.152:0/991944173 wait complete. 2024-09-11T22:11:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.822+0000 7f14d3e60740 20 client.26638 trim_cache size 0 max 16384 2024-09-11T22:11:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:11:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:11:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:11:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:11:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 -- 172.21.15.152:0/205720582 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14b40a2ef0 msgr2=0x7f14b40a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14b40a2ef0 0x7f14b40a53b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f14c402ad40 tx=0x7f14c402a750 comp rx=0 tx=0).stop 2024-09-11T22:11:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 -- 172.21.15.152:0/205720582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc102c90 msgr2=0x7f14cc19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc102c90 0x7f14cc19a600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00e9c0 tx=0x7f14bc00ee80 comp rx=0 tx=0).stop 2024-09-11T22:11:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 -- 172.21.15.152:0/205720582 shutdown_connections 2024-09-11T22:11:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14b40a2ef0 0x7f14b40a53b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14cc10c0e0 0x7f14cc19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14cc1035b0 0x7f14cc19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 --2- 172.21.15.152:0/205720582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc102c90 0x7f14cc19a600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 -- 172.21.15.152:0/205720582 >> 172.21.15.152:0/205720582 conn(0x7f14cc0fc700 msgr2=0x7f14cc10d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 -- 172.21.15.152:0/205720582 shutdown_connections 2024-09-11T22:11:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:09.823+0000 7f14d0fe8640 1 -- 172.21.15.152:0/205720582 wait complete. 2024-09-11T22:11:09.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.956+0000 7f57fd443640 1 -- 172.21.15.152:0/6011359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f8102570 msgr2=0x7f57f81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.956+0000 7f57fd443640 1 --2- 172.21.15.152:0/6011359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f8102570 0x7f57f81029b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009900 tx=0x7f57ec02a480 comp rx=0 tx=0).stop 2024-09-11T22:11:09.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.956+0000 7f57fd443640 1 -- 172.21.15.152:0/6011359 shutdown_connections 2024-09-11T22:11:09.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.956+0000 7f57fd443640 1 --2- 172.21.15.152:0/6011359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f8102ef0 0x7f57f810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.956+0000 7f57fd443640 1 --2- 172.21.15.152:0/6011359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f8102570 0x7f57f81029b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.956+0000 7f57fd443640 1 --2- 172.21.15.152:0/6011359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57f8100e20 0x7f57f8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.956+0000 7f57fd443640 1 -- 172.21.15.152:0/6011359 >> 172.21.15.152:0/6011359 conn(0x7f57f80fc7d0 msgr2=0x7f57f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:09.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.956+0000 7f57fd443640 1 -- 172.21.15.152:0/6011359 shutdown_connections 2024-09-11T22:11:09.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.956+0000 7f57fd443640 1 -- 172.21.15.152:0/6011359 wait complete. 2024-09-11T22:11:09.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.957+0000 7f57fd443640 1 Processor -- start 2024-09-11T22:11:09.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.958+0000 7f57fd443640 1 -- start start 2024-09-11T22:11:09.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.959+0000 7f57fd443640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f8100e20 0x7f57f8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.959+0000 7f57fd443640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57f8102570 0x7f57f8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.959+0000 7f57fd443640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f8102ef0 0x7f57f819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.959+0000 7f57f6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f8100e20 0x7f57f8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.959+0000 7f57f6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f8100e20 0x7f57f8198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55512/0 (socket says 172.21.15.152:55512) 2024-09-11T22:11:09.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.959+0000 7f57f6ffd640 1 -- 172.21.15.152:0/2358838337 learned_addr learned my addr 172.21.15.152:0/2358838337 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:09.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.959+0000 7f57fd443640 1 -- 172.21.15.152:0/2358838337 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8110fd0 con 0x7f57f8100e20 2024-09-11T22:11:09.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.959+0000 7f57fd443640 1 -- 172.21.15.152:0/2358838337 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8110e50 con 0x7f57f8102ef0 2024-09-11T22:11:09.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.959+0000 7f57fd443640 1 -- 172.21.15.152:0/2358838337 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8111150 con 0x7f57f8102570 2024-09-11T22:11:09.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.959+0000 7f57f77fe640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f8102ef0 0x7f57f819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57f67fc640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57f8102570 0x7f57f8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57f6ffd640 1 -- 172.21.15.152:0/2358838337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57f8102570 msgr2=0x7f57f8198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57f6ffd640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57f8102570 0x7f57f8198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57f6ffd640 1 -- 172.21.15.152:0/2358838337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f8102ef0 msgr2=0x7f57f819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57f6ffd640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f8102ef0 0x7f57f819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57f6ffd640 1 -- 172.21.15.152:0/2358838337 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f819d4b0 con 0x7f57f8100e20 2024-09-11T22:11:09.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57f67fc640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57f8102570 0x7f57f8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:09.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57f6ffd640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f8100e20 0x7f57f8198500 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f57e800e9f0 tx=0x7f57e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:09.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57dffff640 1 -- 172.21.15.152:0/2358838337 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e800ccc0 con 0x7f57f8100e20 2024-09-11T22:11:09.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57dffff640 1 -- 172.21.15.152:0/2358838337 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57e800ce60 con 0x7f57f8100e20 2024-09-11T22:11:09.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57dffff640 1 -- 172.21.15.152:0/2358838337 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8010690 con 0x7f57f8100e20 2024-09-11T22:11:09.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.960+0000 7f57fd443640 1 -- 172.21.15.152:0/2358838337 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f819d7a0 con 0x7f57f8100e20 2024-09-11T22:11:09.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.961+0000 7f57fd443640 1 -- 172.21.15.152:0/2358838337 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f81a5080 con 0x7f57f8100e20 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.964+0000 7f57ff81c740 1 Processor -- start 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.964+0000 7f57ff81c740 1 -- start start 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.964+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b78cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.964+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b78d480 0x563f0b797800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b797d40 0x563f0b79a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57ff81c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563f0b6f2280 con 0x563f0b78cb60 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57ff81c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563f0b699b10 con 0x563f0b797d40 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57ff81c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563f0b6ee240 con 0x563f0b78d480 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b78cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b78cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55520/0 (socket says 172.21.15.152:55520) 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57f77fe640 1 -- 172.21.15.152:0/1096472478 learned_addr learned my addr 172.21.15.152:0/1096472478 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:09.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57f67fc640 1 --2- 172.21.15.152:0/1096472478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b797d40 0x563f0b79a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57dffff640 1 -- 172.21.15.152:0/2358838337 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f57e8004ea0 con 0x7f57f8100e20 2024-09-11T22:11:09.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57f77fe640 1 -- 172.21.15.152:0/1096472478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b78d480 msgr2=0x563f0b797800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:11:09.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57f77fe640 1 --2- 172.21.15.152:0/1096472478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b78d480 0x563f0b797800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57f77fe640 1 -- 172.21.15.152:0/1096472478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b797d40 msgr2=0x563f0b79a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:09.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57f77fe640 1 --2- 172.21.15.152:0/1096472478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b797d40 0x563f0b79a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57f77fe640 1 -- 172.21.15.152:0/1096472478 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f0b6a61f0 con 0x563f0b78cb60 2024-09-11T22:11:09.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.965+0000 7f57f77fe640 1 --2- 172.21.15.152:0/1096472478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b78cf40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f57f0011440 tx=0x7f57f0011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc971fa459197f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:09.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.966+0000 7f57dd7fa640 1 -- 172.21.15.152:0/1096472478 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0003c30 con 0x563f0b78cb60 2024-09-11T22:11:09.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.966+0000 7f57dd7fa640 1 -- 172.21.15.152:0/1096472478 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f0003dd0 con 0x563f0b78cb60 2024-09-11T22:11:09.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.966+0000 7f57dd7fa640 1 -- 172.21.15.152:0/1096472478 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f000fb10 con 0x563f0b78cb60 2024-09-11T22:11:09.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.966+0000 7f57dffff640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57e00a2dc0 0x7f57e00a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.966+0000 7f57dffff640 1 -- 172.21.15.152:0/2358838337 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8658+0+0 (secure 0 0 0) 0x7f57e80cf910 con 0x7f57f8100e20 2024-09-11T22:11:09.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.966+0000 7f57f6ffd640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57e00a2dc0 0x7f57e00a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.967+0000 7f57ff81c740 1 -- 172.21.15.152:0/1096472478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 msgr2=0x563f0b78cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.967+0000 7f57ff81c740 1 --2- 172.21.15.152:0/1096472478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b78cf40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f57f0011440 tx=0x7f57f0011900 comp rx=0 tx=0).stop 2024-09-11T22:11:09.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.967+0000 7f57f6ffd640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57e00a2dc0 0x7f57e00a5280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x563f0b789f50 tx=0x7f57e8005720 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:09.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.968+0000 7f57ff81c740 1 -- 172.21.15.152:0/1096472478 shutdown_connections 2024-09-11T22:11:09.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.968+0000 7f57ff81c740 1 --2- 172.21.15.152:0/1096472478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b797d40 0x563f0b79a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.968+0000 7f57ff81c740 1 --2- 172.21.15.152:0/1096472478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b78d480 0x563f0b797800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.968+0000 7f57ff81c740 1 --2- 172.21.15.152:0/1096472478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b78cf40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.968+0000 7f57ff81c740 1 -- 172.21.15.152:0/1096472478 >> 172.21.15.152:0/1096472478 conn(0x563f0b7890f0 msgr2=0x563f0b7894d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:09.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.969+0000 7f57ff81c740 1 -- 172.21.15.152:0/1096472478 shutdown_connections 2024-09-11T22:11:09.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.969+0000 7f57ff81c740 1 -- 172.21.15.152:0/1096472478 wait complete. 2024-09-11T22:11:09.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.969+0000 7f57ff81c740 1 -- start start 2024-09-11T22:11:09.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.969+0000 7f57ff81c740 1 Processor -- start 2024-09-11T22:11:09.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78cb60 0x563f0b794c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78d480 0x563f0b795150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b797d40 0x563f0b795690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57ff81c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563f0b79a960 con 0x563f0b78d480 2024-09-11T22:11:09.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78cb60 0x563f0b794c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57ff81c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563f0b6acf10 con 0x563f0b78cb60 2024-09-11T22:11:09.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78cb60 0x563f0b794c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35676/0 (socket says 172.21.15.152:35676) 2024-09-11T22:11:09.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57f77fe640 1 -- 172.21.15.152:0/2661054094 learned_addr learned my addr 172.21.15.152:0/2661054094 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:09.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57ff81c740 1 -- 172.21.15.152:0/2661054094 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563f0b79aae0 con 0x563f0b797d40 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57f67fc640 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78d480 0x563f0b795150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57f77fe640 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b797d40 0x563f0b795690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57ff81c740 10 client.0 _ll_register_callbacks cb 0x563f0b675a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57f77fe640 1 -- 172.21.15.152:0/2661054094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b797d40 msgr2=0x563f0b795690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57f77fe640 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b797d40 0x563f0b795690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57f77fe640 1 -- 172.21.15.152:0/2661054094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78d480 msgr2=0x563f0b795150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57f77fe640 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78d480 0x563f0b795150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.970+0000 7f57f77fe640 1 -- 172.21.15.152:0/2661054094 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f0b4636a0 con 0x563f0b78cb60 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.971+0000 7f57f77fe640 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78cb60 0x563f0b794c10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f57f000a010 tx=0x7f57f000f6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3031c20564ab9ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.971+0000 7f57daff5640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.971+0000 7f57daff5640 1 -- 172.21.15.152:0/2661054094 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f000fb20 con 0x563f0b78cb60 2024-09-11T22:11:09.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.971+0000 7f57daff5640 1 -- 172.21.15.152:0/2661054094 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8658+0+0 (secure 0 0 0) 0x7f57f000fcc0 con 0x563f0b78cb60 2024-09-11T22:11:09.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.971+0000 7f57ff81c740 1 -- 172.21.15.152:0/2661054094 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57f0003dd0 con 0x563f0b78cb60 2024-09-11T22:11:09.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.972+0000 7f57daff5640 1 -- 172.21.15.152:0/2661054094 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f57f0036050 con 0x563f0b78cb60 2024-09-11T22:11:09.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.972+0000 7f57ff81c740 10 client.26492 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:09.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.972+0000 7f57ff81c740 1 -- 172.21.15.152:0/2661054094 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563f0b7aed60 con 0x563f0b78cb60 2024-09-11T22:11:09.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.973+0000 7f57daff5640 1 -- 172.21.15.152:0/2661054094 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f0003dd0 con 0x563f0b78cb60 2024-09-11T22:11:09.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.973+0000 7f57daff5640 1 -- 172.21.15.152:0/2661054094 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f57f0025040 con 0x563f0b78cb60 2024-09-11T22:11:09.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.973+0000 7f57ff81c740 10 client.26492 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:09.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.973+0000 7f57ff81c740 10 client.26492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:09.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.973+0000 7f57ff81c740 20 client.26492 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:09.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.973+0000 7f57ff81c740 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563f0b7b01c0 0x563f0b7b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:09.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.973+0000 7f57ff81c740 4 client.26492 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:09.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.973+0000 7f57ff81c740 1 -- 172.21.15.152:0/2661054094 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f0b6ff7f0 con 0x563f0b7b01c0 2024-09-11T22:11:09.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.974+0000 7f57f67fc640 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563f0b7b01c0 0x563f0b7b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:09.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.974+0000 7f57daff5640 10 client.26492 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:09.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.974+0000 7f57f67fc640 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563f0b7b01c0 0x563f0b7b25b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b78b7e0d6fdf9ee server_cookie=7d7cd3a2a6635f15 in_seq=0 out_seq=0 2024-09-11T22:11:09.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57daff5640 1 -- 172.21.15.152:0/2661054094 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f0b6ff7f0 con 0x563f0b7b01c0 2024-09-11T22:11:09.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57daff5640 10 client.26492 handle_command_reply: tid=0 2024-09-11T22:11:09.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 1 client.26492 shutdown 2024-09-11T22:11:09.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 1 -- 172.21.15.152:0/2661054094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78cb60 msgr2=0x563f0b794c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78cb60 0x563f0b794c10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f57f000a010 tx=0x7f57f000f6f0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 1 -- 172.21.15.152:0/2661054094 shutdown_connections 2024-09-11T22:11:09.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563f0b7b01c0 0x563f0b7b25b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b797d40 0x563f0b795690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57daff5640 0 client.26492 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:09.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78d480 0x563f0b795150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 1 --2- 172.21.15.152:0/2661054094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78cb60 0x563f0b794c10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 1 -- 172.21.15.152:0/2661054094 >> 172.21.15.152:0/2661054094 conn(0x563f0b7890f0 msgr2=0x563f0b78edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:09.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 1 -- 172.21.15.152:0/2661054094 shutdown_connections 2024-09-11T22:11:09.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 1 -- 172.21.15.152:0/2661054094 wait complete. 2024-09-11T22:11:09.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:09.975+0000 7f57ff81c740 20 client.26492 trim_cache size 0 max 16384 2024-09-11T22:11:10.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.003+0000 7f57ff81c740 1 Processor -- start 2024-09-11T22:11:10.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.003+0000 7f57ff81c740 1 -- start start 2024-09-11T22:11:10.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.003+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b7890f0 0x563f0b7b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:10.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.003+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b7b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:10.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.003+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78d480 0x563f0b796360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:10.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.003+0000 7f57ff81c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81ae150 con 0x563f0b78cb60 2024-09-11T22:11:10.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.003+0000 7f57ff81c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81aba20 con 0x563f0b78d480 2024-09-11T22:11:10.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.003+0000 7f57ff81c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81a9890 con 0x563f0b7890f0 2024-09-11T22:11:10.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.003+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78d480 0x563f0b796360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:10.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.003+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78d480 0x563f0b796360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35680/0 (socket says 172.21.15.152:35680) 2024-09-11T22:11:10.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.003+0000 7f57f77fe640 1 -- 172.21.15.152:0/2378919961 learned_addr learned my addr 172.21.15.152:0/2378919961 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:10.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.004+0000 7f57f67fc640 1 --2- 172.21.15.152:0/2378919961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b7b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:10.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.004+0000 7f57f77fe640 1 --2- 172.21.15.152:0/2378919961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b7890f0 0x563f0b7b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:10.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.004+0000 7f57f77fe640 1 -- 172.21.15.152:0/2378919961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b7890f0 msgr2=0x563f0b7b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:10.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.004+0000 7f57f77fe640 1 --2- 172.21.15.152:0/2378919961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b7890f0 0x563f0b7b7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.004+0000 7f57f77fe640 1 -- 172.21.15.152:0/2378919961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 msgr2=0x563f0b7b81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:10.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.004+0000 7f57f77fe640 1 --2- 172.21.15.152:0/2378919961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b7b81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.004+0000 7f57f77fe640 1 -- 172.21.15.152:0/2378919961 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f0b793160 con 0x563f0b78d480 2024-09-11T22:11:10.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.004+0000 7f57f67fc640 1 --2- 172.21.15.152:0/2378919961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b7b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:10.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.004+0000 7f57f77fe640 1 --2- 172.21.15.152:0/2378919961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78d480 0x563f0b796360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009fe0 tx=0x7f57f0011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb8d77ca1b351434 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:10.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.005+0000 7f57dcff9640 1 -- 172.21.15.152:0/2378919961 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f000f540 con 0x563f0b78d480 2024-09-11T22:11:10.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.005+0000 7f57dcff9640 1 -- 172.21.15.152:0/2378919961 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f0003da0 con 0x563f0b78d480 2024-09-11T22:11:10.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.005+0000 7f57dcff9640 1 -- 172.21.15.152:0/2378919961 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f00043d0 con 0x563f0b78d480 2024-09-11T22:11:10.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.006+0000 7f57ff81c740 1 -- 172.21.15.152:0/2378919961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78d480 msgr2=0x563f0b796360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:10.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.006+0000 7f57ff81c740 1 --2- 172.21.15.152:0/2378919961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78d480 0x563f0b796360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009fe0 tx=0x7f57f0011900 comp rx=0 tx=0).stop 2024-09-11T22:11:10.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.007+0000 7f57ff81c740 1 -- 172.21.15.152:0/2378919961 shutdown_connections 2024-09-11T22:11:10.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.007+0000 7f57ff81c740 1 --2- 172.21.15.152:0/2378919961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b78d480 0x563f0b796360 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.007+0000 7f57ff81c740 1 --2- 172.21.15.152:0/2378919961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b7b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.007+0000 7f57ff81c740 1 --2- 172.21.15.152:0/2378919961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b7890f0 0x563f0b7b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.007+0000 7f57ff81c740 1 -- 172.21.15.152:0/2378919961 >> 172.21.15.152:0/2378919961 conn(0x563f0b790600 msgr2=0x563f0b78edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:10.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.007+0000 7f57ff81c740 1 -- 172.21.15.152:0/2378919961 shutdown_connections 2024-09-11T22:11:10.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.007+0000 7f57ff81c740 1 -- 172.21.15.152:0/2378919961 wait complete. 2024-09-11T22:11:10.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.007+0000 7f57ff81c740 1 -- start start 2024-09-11T22:11:10.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.007+0000 7f57ff81c740 1 Processor -- start 2024-09-11T22:11:10.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.008+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b7890f0 0x563f0b7a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:10.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.008+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b7a4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:10.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.008+0000 7f57ff81c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b78d480 0x563f0b7a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:10.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.008+0000 7f57ff81c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81a9ee0 con 0x563f0b78cb60 2024-09-11T22:11:10.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.008+0000 7f57ff81c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81ab350 con 0x563f0b7890f0 2024-09-11T22:11:10.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.008+0000 7f57ff81c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81aa5b0 con 0x563f0b78d480 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.008+0000 7f57ff81c740 10 client.0 _ll_register_callbacks cb 0x7f57f00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.008+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b7890f0 0x563f0b7a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.008+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b7890f0 0x563f0b7a8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35682/0 (socket says 172.21.15.152:35682) 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.008+0000 7f57f77fe640 1 -- 172.21.15.152:0/62548414 learned_addr learned my addr 172.21.15.152:0/62548414 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.008+0000 7f57f77fe640 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b78d480 0x563f0b7a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.009+0000 7f57f77fe640 1 -- 172.21.15.152:0/62548414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b78d480 msgr2=0x563f0b7a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.009+0000 7f57f77fe640 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b78d480 0x563f0b7a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.009+0000 7f57f77fe640 1 -- 172.21.15.152:0/62548414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 msgr2=0x563f0b7a4140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.009+0000 7f57f77fe640 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b7a4140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.009+0000 7f57f77fe640 1 -- 172.21.15.152:0/62548414 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f0b7a4f10 con 0x563f0b7890f0 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.009+0000 7f57f77fe640 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b7890f0 0x563f0b7a8e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f57f0004fd0 tx=0x7f57f0000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14568363a63e3bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.010+0000 7f57daff5640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:11:10.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.010+0000 7f57daff5640 1 -- 172.21.15.152:0/62548414 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f000f750 con 0x563f0b7890f0 2024-09-11T22:11:10.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.010+0000 7f57daff5640 1 -- 172.21.15.152:0/62548414 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8658+0+0 (secure 0 0 0) 0x7f57f0011e00 con 0x563f0b7890f0 2024-09-11T22:11:10.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.010+0000 7f57ff81c740 1 -- 172.21.15.152:0/62548414 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57f0003da0 con 0x563f0b7890f0 2024-09-11T22:11:10.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57daff5640 1 -- 172.21.15.152:0/62548414 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f57f000fb20 con 0x563f0b7890f0 2024-09-11T22:11:10.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57ff81c740 10 client.26498 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:10.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57ff81c740 1 -- 172.21.15.152:0/62548414 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563f0b79af10 con 0x563f0b7890f0 2024-09-11T22:11:10.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57daff5640 1 -- 172.21.15.152:0/62548414 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f0003da0 con 0x563f0b7890f0 2024-09-11T22:11:10.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57daff5640 1 -- 172.21.15.152:0/62548414 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f57f0046030 con 0x563f0b7890f0 2024-09-11T22:11:10.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57ff81c740 10 client.26498 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:10.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57ff81c740 10 client.26498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:10.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57ff81c740 20 client.26498 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:10.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57ff81c740 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563f0b797d40 0x563f0b79d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:10.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57ff81c740 4 client.26498 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57ff81c740 1 -- 172.21.15.152:0/62548414 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563f0b6f9d00 con 0x563f0b797d40 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.011+0000 7f57f67fc640 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563f0b797d40 0x563f0b79d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.012+0000 7f57f67fc640 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563f0b797d40 0x563f0b79d320 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8846a1c209335f68 server_cookie=703756a8c1594334 in_seq=0 out_seq=0 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.012+0000 7f57daff5640 10 client.26498 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.013+0000 7f57daff5640 1 -- 172.21.15.152:0/62548414 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563f0b6f9d00 con 0x563f0b797d40 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.013+0000 7f57daff5640 10 client.26498 handle_command_reply: tid=0 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.013+0000 7f57ff81c740 1 client.26498 shutdown 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57ff81c740 1 -- 172.21.15.152:0/62548414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b7890f0 msgr2=0x563f0b7a8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57ff81c740 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b7890f0 0x563f0b7a8e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f57f0004fd0 tx=0x7f57f0000f40 comp rx=0 tx=0).stop 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57ff81c740 1 -- 172.21.15.152:0/62548414 shutdown_connections 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57ff81c740 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563f0b797d40 0x563f0b79d320 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57ff81c740 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563f0b78d480 0x563f0b7a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57ff81c740 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0b78cb60 0x563f0b7a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57ff81c740 1 --2- 172.21.15.152:0/62548414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563f0b7890f0 0x563f0b7a8e10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57ff81c740 1 -- 172.21.15.152:0/62548414 >> 172.21.15.152:0/62548414 conn(0x563f0b790600 msgr2=0x563f0b7933b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:10.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57daff5640 0 client.26498 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:10.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57ff81c740 1 -- 172.21.15.152:0/62548414 shutdown_connections 2024-09-11T22:11:10.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57ff81c740 1 -- 172.21.15.152:0/62548414 wait complete. 2024-09-11T22:11:10.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.014+0000 7f57ff81c740 20 client.26498 trim_cache size 0 max 16384 2024-09-11T22:11:10.017 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:11:10.017 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:11:10.017 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "6b1e28d1-b4c1-41ae-a71c-ac72534d3661", 2024-09-11T22:11:10.018 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:11:10.018 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:11:10.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 -- 172.21.15.152:0/2358838337 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57e00a2dc0 msgr2=0x7f57e00a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:10.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57e00a2dc0 0x7f57e00a5280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x563f0b789f50 tx=0x7f57e8005720 comp rx=0 tx=0).stop 2024-09-11T22:11:10.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 -- 172.21.15.152:0/2358838337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f8100e20 msgr2=0x7f57f8198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:10.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f8100e20 0x7f57f8198500 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f57e800e9f0 tx=0x7f57e800edf0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 -- 172.21.15.152:0/2358838337 shutdown_connections 2024-09-11T22:11:10.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57e00a2dc0 0x7f57e00a5280 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f8102ef0 0x7f57f819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57f8102570 0x7f57f8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 --2- 172.21.15.152:0/2358838337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f8100e20 0x7f57f8198500 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:10.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 -- 172.21.15.152:0/2358838337 >> 172.21.15.152:0/2358838337 conn(0x7f57f80fc7d0 msgr2=0x7f57f8103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:10.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 -- 172.21.15.152:0/2358838337 shutdown_connections 2024-09-11T22:11:10.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:10.015+0000 7f57fd443640 1 -- 172.21.15.152:0/2358838337 wait complete. 2024-09-11T22:11:10.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:09 smithi152 ceph-mon[31188]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T22:11:10.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:09 smithi179 ceph-mon[35603]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T22:11:10.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:09 smithi193 ceph-mon[35545]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T22:11:10.888 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:11:11.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:10 smithi152 ceph-mon[31188]: pgmap v210: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 53 MiB/s wr, 1.72k op/s 2024-09-11T22:11:11.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:10 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:11:11.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:10 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:11.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:10 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:11:11.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:10 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:11:11.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:10 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:11.278 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:11.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:10 smithi179 ceph-mon[35603]: pgmap v210: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 53 MiB/s wr, 1.72k op/s 2024-09-11T22:11:11.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:10 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:11:11.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:10 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:11.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:10 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:11:11.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:10 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:11:11.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:10 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:11.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:10 smithi193 ceph-mon[35545]: pgmap v210: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 53 MiB/s wr, 1.72k op/s 2024-09-11T22:11:11.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:10 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:11:11.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:10 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:11.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:10 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:11:11.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:10 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:11:11.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:10 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:11.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.794+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2826659712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4c109830 msgr2=0x7fdf4c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.794+0000 7fdf50a3d640 1 --2- 172.21.15.152:0/2826659712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4c109830 0x7fdf4c109c90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009900 tx=0x7fdf4002a440 comp rx=0 tx=0).stop 2024-09-11T22:11:11.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.795+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2826659712 shutdown_connections 2024-09-11T22:11:11.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.795+0000 7fdf50a3d640 1 --2- 172.21.15.152:0/2826659712 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf4c11b140 0x7fdf4c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.795+0000 7fdf50a3d640 1 --2- 172.21.15.152:0/2826659712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4c109830 0x7fdf4c109c90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.795+0000 7fdf50a3d640 1 --2- 172.21.15.152:0/2826659712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4c109450 0x7fdf4c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.795+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2826659712 >> 172.21.15.152:0/2826659712 conn(0x7fdf4c06e140 msgr2=0x7fdf4c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:11.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.796+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2826659712 shutdown_connections 2024-09-11T22:11:11.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.796+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2826659712 wait complete. 2024-09-11T22:11:11.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.797+0000 7fdf50a3d640 1 Processor -- start 2024-09-11T22:11:11.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.798+0000 7fdf50a3d640 1 -- start start 2024-09-11T22:11:11.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.798+0000 7fdf50a3d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4c109450 0x7fdf4c1a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.798+0000 7fdf50a3d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf4c109830 0x7fdf4c1a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.798+0000 7fdf50a3d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4c11b140 0x7fdf4c1abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.798+0000 7fdf50a3d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c120e90 con 0x7fdf4c11b140 2024-09-11T22:11:11.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.798+0000 7fdf50a3d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c120d10 con 0x7fdf4c109450 2024-09-11T22:11:11.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.798+0000 7fdf50a3d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c121010 con 0x7fdf4c109830 2024-09-11T22:11:11.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.798+0000 7fdf4a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4c109450 0x7fdf4c1a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.798+0000 7fdf4a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4c109450 0x7fdf4c1a7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35702/0 (socket says 172.21.15.152:35702) 2024-09-11T22:11:11.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.798+0000 7fdf4a59c640 1 -- 172.21.15.152:0/2479621778 learned_addr learned my addr 172.21.15.152:0/2479621778 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:11.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.799+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf4c109830 0x7fdf4c1a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.799+0000 7fdf49d9b640 1 -- 172.21.15.152:0/2479621778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4c109450 msgr2=0x7fdf4c1a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.799+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4c109450 0x7fdf4c1a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.799+0000 7fdf49d9b640 1 -- 172.21.15.152:0/2479621778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4c11b140 msgr2=0x7fdf4c1abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.799+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4c11b140 0x7fdf4c1abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.799+0000 7fdf49d9b640 1 -- 172.21.15.152:0/2479621778 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4c1ac320 con 0x7fdf4c109830 2024-09-11T22:11:11.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.800+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf4c109830 0x7fdf4c1a78b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009850 tx=0x7fdf40005230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.800+0000 7fdf3b7fe640 1 -- 172.21.15.152:0/2479621778 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40040070 con 0x7fdf4c109830 2024-09-11T22:11:11.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.800+0000 7fdf3b7fe640 1 -- 172.21.15.152:0/2479621778 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf40005630 con 0x7fdf4c109830 2024-09-11T22:11:11.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.801+0000 7fdf3b7fe640 1 -- 172.21.15.152:0/2479621778 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4003cba0 con 0x7fdf4c109830 2024-09-11T22:11:11.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.801+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2479621778 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4c1ac5b0 con 0x7fdf4c109830 2024-09-11T22:11:11.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.801+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2479621778 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf4c1aca10 con 0x7fdf4c109830 2024-09-11T22:11:11.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.804+0000 7fdf52e16740 1 Processor -- start 2024-09-11T22:11:11.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.805+0000 7fdf52e16740 1 -- start start 2024-09-11T22:11:11.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.805+0000 7fdf52e16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 0x55f51158f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.805+0000 7fdf52e16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 0x55f51159a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.806+0000 7fdf52e16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 0x55f51159ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.806+0000 7fdf52e16740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f5114f52e0 con 0x55f51158f4a0 2024-09-11T22:11:11.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.806+0000 7fdf52e16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f51149cce0 con 0x55f51158fdc0 2024-09-11T22:11:11.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.806+0000 7fdf52e16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f5114f12a0 con 0x55f51159a680 2024-09-11T22:11:11.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.807+0000 7fdf3b7fe640 1 -- 172.21.15.152:0/2479621778 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fdf4003a040 con 0x7fdf4c109830 2024-09-11T22:11:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.808+0000 7fdf4a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 0x55f51159a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.808+0000 7fdf49d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 0x55f51159ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.808+0000 7fdf49d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 0x55f51159ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54962/0 (socket says 172.21.15.152:54962) 2024-09-11T22:11:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.808+0000 7fdf49d9b640 1 -- 172.21.15.152:0/1367962242 learned_addr learned my addr 172.21.15.152:0/1367962242 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:11.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.809+0000 7fdf3b7fe640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf340a2e80 0x7fdf340a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.810+0000 7fdf3b7fe640 1 -- 172.21.15.152:0/2479621778 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8658+0+0 (secure 0 0 0) 0x7fdf400f1ee0 con 0x7fdf4c109830 2024-09-11T22:11:11.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.810+0000 7fdf49d9b640 1 -- 172.21.15.152:0/1367962242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 msgr2=0x55f51159a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:11.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.810+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/1367962242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 0x55f51159a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.810+0000 7fdf49d9b640 1 -- 172.21.15.152:0/1367962242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 msgr2=0x55f51158f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:11.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.809+0000 7fdf4ad9d640 1 --2- 172.21.15.152:0/1367962242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 0x55f51158f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.810+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/1367962242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 0x55f51158f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.810+0000 7fdf49d9b640 1 -- 172.21.15.152:0/1367962242 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f511481440 con 0x55f51159a680 2024-09-11T22:11:11.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.810+0000 7fdf4ad9d640 1 --2- 172.21.15.152:0/1367962242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 0x55f51158f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:11.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.811+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/1367962242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 0x55f51159ca70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdf400ef510 tx=0x7fdf4002a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87235d41a8f3cf98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.811+0000 7fdf4ad9d640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf340a2e80 0x7fdf340a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.811+0000 7fdf38ff9640 1 -- 172.21.15.152:0/1367962242 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf400bdcd0 con 0x55f51159a680 2024-09-11T22:11:11.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.811+0000 7fdf38ff9640 1 -- 172.21.15.152:0/1367962242 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf400bea70 con 0x55f51159a680 2024-09-11T22:11:11.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.811+0000 7fdf38ff9640 1 -- 172.21.15.152:0/1367962242 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4003cd40 con 0x55f51159a680 2024-09-11T22:11:11.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.812+0000 7fdf52e16740 1 -- 172.21.15.152:0/1367962242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 msgr2=0x55f51159ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.812+0000 7fdf52e16740 1 --2- 172.21.15.152:0/1367962242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 0x55f51159ca70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdf400ef510 tx=0x7fdf4002a440 comp rx=0 tx=0).stop 2024-09-11T22:11:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.812+0000 7fdf4ad9d640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf340a2e80 0x7fdf340a5340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf44002140 tx=0x7fdf440012f0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.814+0000 7fdf52e16740 1 -- 172.21.15.152:0/1367962242 shutdown_connections 2024-09-11T22:11:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.814+0000 7fdf52e16740 1 --2- 172.21.15.152:0/1367962242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 0x55f51159ca70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.814+0000 7fdf52e16740 1 --2- 172.21.15.152:0/1367962242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 0x55f51159a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.814+0000 7fdf52e16740 1 --2- 172.21.15.152:0/1367962242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 0x55f51158f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.814+0000 7fdf52e16740 1 -- 172.21.15.152:0/1367962242 >> 172.21.15.152:0/1367962242 conn(0x55f51158ba30 msgr2=0x55f51158be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.814+0000 7fdf52e16740 1 -- 172.21.15.152:0/1367962242 shutdown_connections 2024-09-11T22:11:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.814+0000 7fdf52e16740 1 -- 172.21.15.152:0/1367962242 wait complete. 2024-09-11T22:11:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.815+0000 7fdf52e16740 1 -- start start 2024-09-11T22:11:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.815+0000 7fdf52e16740 1 Processor -- start 2024-09-11T22:11:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.815+0000 7fdf52e16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158f4a0 0x55f511599ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.815+0000 7fdf52e16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 0x55f5115972a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.815+0000 7fdf52e16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51159a680 0x55f511597800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.815+0000 7fdf52e16740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f5114f12a0 con 0x55f51159a680 2024-09-11T22:11:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.815+0000 7fdf52e16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f5114b0050 con 0x55f51158fdc0 2024-09-11T22:11:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.815+0000 7fdf52e16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f5115ae020 con 0x55f51158f4a0 2024-09-11T22:11:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.815+0000 7fdf52e16740 10 client.0 _ll_register_callbacks cb 0x55f5114f0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.816+0000 7fdf4a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158f4a0 0x55f511599ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.816+0000 7fdf4a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158f4a0 0x55f511599ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54966/0 (socket says 172.21.15.152:54966) 2024-09-11T22:11:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.816+0000 7fdf4a59c640 1 -- 172.21.15.152:0/2899605553 learned_addr learned my addr 172.21.15.152:0/2899605553 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.816+0000 7fdf4ad9d640 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51159a680 0x55f511597800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.816+0000 7fdf4a59c640 1 -- 172.21.15.152:0/2899605553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 msgr2=0x55f5115972a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:11:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.816+0000 7fdf4a59c640 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 0x55f5115972a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.816+0000 7fdf4a59c640 1 -- 172.21.15.152:0/2899605553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51159a680 msgr2=0x55f511597800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.816+0000 7fdf4a59c640 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51159a680 0x55f511597800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.816+0000 7fdf4a59c640 1 -- 172.21.15.152:0/2899605553 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5112663c0 con 0x55f51158f4a0 2024-09-11T22:11:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.816+0000 7fdf4a59c640 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158f4a0 0x55f511599ff0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0104a0 tx=0x7fdf3c010960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bbe1657aa629015 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.817+0000 7fdf31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.817+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2899605553 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c018070 con 0x55f51158f4a0 2024-09-11T22:11:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.817+0000 7fdf52e16740 1 -- 172.21.15.152:0/2899605553 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf400bea70 con 0x55f51158f4a0 2024-09-11T22:11:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.817+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2899605553 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8658+0+0 (secure 0 0 0) 0x7fdf3c014800 con 0x55f51158f4a0 2024-09-11T22:11:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.819+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2899605553 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdf3c022050 con 0x55f51158f4a0 2024-09-11T22:11:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.819+0000 7fdf52e16740 10 client.26659 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.819+0000 7fdf52e16740 1 -- 172.21.15.152:0/2899605553 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f5115b97b0 con 0x55f51158f4a0 2024-09-11T22:11:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.820+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2899605553 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf400bea70 con 0x55f51158f4a0 2024-09-11T22:11:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.820+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2899605553 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fdf3c01c3b0 con 0x55f51158f4a0 2024-09-11T22:11:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.820+0000 7fdf52e16740 10 client.26659 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.820+0000 7fdf52e16740 10 client.26659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.820+0000 7fdf52e16740 20 client.26659 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.820+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f5115bac70 0x55f5115bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.820+0000 7fdf52e16740 4 client.26659 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.820+0000 7fdf52e16740 1 -- 172.21.15.152:0/2899605553 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f511502850 con 0x55f5115bac70 2024-09-11T22:11:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.821+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f5115bac70 0x55f5115bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.822+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f5115bac70 0x55f5115bd0a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4213dc7b4391f6ee server_cookie=e686b90013a03899 in_seq=0 out_seq=0 2024-09-11T22:11:11.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.823+0000 7fdf31ffb640 10 client.26659 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:11.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.823+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2899605553 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f511502850 con 0x55f5115bac70 2024-09-11T22:11:11.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.823+0000 7fdf31ffb640 10 client.26659 handle_command_reply: tid=0 2024-09-11T22:11:11.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.823+0000 7fdf52e16740 1 client.26659 shutdown 2024-09-11T22:11:11.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.824+0000 7fdf52e16740 1 -- 172.21.15.152:0/2899605553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158f4a0 msgr2=0x55f511599ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.824+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158f4a0 0x55f511599ff0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0104a0 tx=0x7fdf3c010960 comp rx=0 tx=0).stop 2024-09-11T22:11:11.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.824+0000 7fdf52e16740 1 -- 172.21.15.152:0/2899605553 shutdown_connections 2024-09-11T22:11:11.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.824+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f5115bac70 0x55f5115bd0a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.824+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51159a680 0x55f511597800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.824+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 0x55f5115972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.824+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2899605553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158f4a0 0x55f511599ff0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.824+0000 7fdf31ffb640 0 client.26659 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:11.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.824+0000 7fdf52e16740 1 -- 172.21.15.152:0/2899605553 >> 172.21.15.152:0/2899605553 conn(0x55f51158ba30 msgr2=0x55f511591760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:11.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.825+0000 7fdf52e16740 1 -- 172.21.15.152:0/2899605553 shutdown_connections 2024-09-11T22:11:11.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.825+0000 7fdf52e16740 1 -- 172.21.15.152:0/2899605553 wait complete. 2024-09-11T22:11:11.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.826+0000 7fdf52e16740 20 client.26659 trim_cache size 0 max 16384 2024-09-11T22:11:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.850+0000 7fdf52e16740 1 Processor -- start 2024-09-11T22:11:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.850+0000 7fdf52e16740 1 -- start start 2024-09-11T22:11:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.850+0000 7fdf52e16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 0x55f5115b7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf52e16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 0x55f511596ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf4a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 0x55f5115b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf4a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 0x55f5115b7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55604/0 (socket says 172.21.15.152:55604) 2024-09-11T22:11:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf4a59c640 1 -- 172.21.15.152:0/1672874009 learned_addr learned my addr 172.21.15.152:0/1672874009 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:11.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf52e16740 1 --2- 172.21.15.152:0/1672874009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 0x55f5115c2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf52e16740 1 -- 172.21.15.152:0/1672874009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c1b6af0 con 0x55f51158f4a0 2024-09-11T22:11:11.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf52e16740 1 -- 172.21.15.152:0/1672874009 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c1b43c0 con 0x55f51158fdc0 2024-09-11T22:11:11.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf52e16740 1 -- 172.21.15.152:0/1672874009 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c1173a0 con 0x55f51159a680 2024-09-11T22:11:11.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/1672874009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 0x55f511596ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf4ad9d640 1 --2- 172.21.15.152:0/1672874009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 0x55f5115c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf4a59c640 1 -- 172.21.15.152:0/1672874009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 msgr2=0x55f5115c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:11.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf4a59c640 1 --2- 172.21.15.152:0/1672874009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 0x55f5115c2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf4a59c640 1 -- 172.21.15.152:0/1672874009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 msgr2=0x55f511596ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:11.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf4a59c640 1 --2- 172.21.15.152:0/1672874009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 0x55f511596ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf4a59c640 1 -- 172.21.15.152:0/1672874009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f511596250 con 0x55f51158f4a0 2024-09-11T22:11:11.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.851+0000 7fdf4a59c640 1 --2- 172.21.15.152:0/1672874009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 0x55f5115b7000 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c001eb0 tx=0x7fdf3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c38502b994f2653 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.852+0000 7fdf33fff640 1 -- 172.21.15.152:0/1672874009 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c018040 con 0x55f51158f4a0 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.852+0000 7fdf33fff640 1 -- 172.21.15.152:0/1672874009 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf3c01c9f0 con 0x55f51158f4a0 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.852+0000 7fdf33fff640 1 -- 172.21.15.152:0/1672874009 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c00f040 con 0x55f51158f4a0 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.853+0000 7fdf52e16740 1 -- 172.21.15.152:0/1672874009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 msgr2=0x55f5115b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.853+0000 7fdf52e16740 1 --2- 172.21.15.152:0/1672874009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 0x55f5115b7000 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c001eb0 tx=0x7fdf3c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.853+0000 7fdf52e16740 1 -- 172.21.15.152:0/1672874009 shutdown_connections 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.853+0000 7fdf52e16740 1 --2- 172.21.15.152:0/1672874009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51159a680 0x55f5115c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.853+0000 7fdf52e16740 1 --2- 172.21.15.152:0/1672874009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158fdc0 0x55f511596ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.853+0000 7fdf52e16740 1 --2- 172.21.15.152:0/1672874009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51158f4a0 0x55f5115b7000 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.853+0000 7fdf52e16740 1 -- 172.21.15.152:0/1672874009 >> 172.21.15.152:0/1672874009 conn(0x55f51158ba30 msgr2=0x55f5115967e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.853+0000 7fdf52e16740 1 -- 172.21.15.152:0/1672874009 shutdown_connections 2024-09-11T22:11:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.853+0000 7fdf52e16740 1 -- 172.21.15.152:0/1672874009 wait complete. 2024-09-11T22:11:11.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf52e16740 1 -- start start 2024-09-11T22:11:11.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf52e16740 1 Processor -- start 2024-09-11T22:11:11.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf52e16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158f4a0 0x55f5115b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf52e16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158fdc0 0x55f5115aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf52e16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51159a680 0x55f5115af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf52e16740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c1179f0 con 0x55f51159a680 2024-09-11T22:11:11.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf52e16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c118e60 con 0x55f51158f4a0 2024-09-11T22:11:11.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf52e16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c1180c0 con 0x55f51158fdc0 2024-09-11T22:11:11.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf52e16740 10 client.0 _ll_register_callbacks cb 0x7fdf3c0094f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:11.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf4a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158f4a0 0x55f5115b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf4a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158f4a0 0x55f5115b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35746/0 (socket says 172.21.15.152:35746) 2024-09-11T22:11:11.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf4a59c640 1 -- 172.21.15.152:0/2733541955 learned_addr learned my addr 172.21.15.152:0/2733541955 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:11.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.854+0000 7fdf4ad9d640 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51159a680 0x55f5115af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.855+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158fdc0 0x55f5115aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.855+0000 7fdf4a59c640 1 -- 172.21.15.152:0/2733541955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158fdc0 msgr2=0x55f5115aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:11.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.855+0000 7fdf4a59c640 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158fdc0 0x55f5115aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.855+0000 7fdf4a59c640 1 -- 172.21.15.152:0/2733541955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51159a680 msgr2=0x55f5115af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:11.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.855+0000 7fdf4a59c640 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51159a680 0x55f5115af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.855+0000 7fdf4a59c640 1 -- 172.21.15.152:0/2733541955 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5115afaf0 con 0x55f51158f4a0 2024-09-11T22:11:11.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.855+0000 7fdf4ad9d640 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51159a680 0x55f5115af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:11.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.856+0000 7fdf4a59c640 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158f4a0 0x55f5115b39c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c01c800 tx=0x7fdf3c005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10bed16e7c54eba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.856+0000 7fdf31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:11:11.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.856+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2733541955 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c018070 con 0x55f51158f4a0 2024-09-11T22:11:11.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.856+0000 7fdf52e16740 1 -- 172.21.15.152:0/2733541955 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf3c01c9f0 con 0x55f51158f4a0 2024-09-11T22:11:11.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.856+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2733541955 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8658+0+0 (secure 0 0 0) 0x7fdf3c014a40 con 0x55f51158f4a0 2024-09-11T22:11:11.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.857+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2733541955 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdf3c03f050 con 0x55f51158f4a0 2024-09-11T22:11:11.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.857+0000 7fdf52e16740 10 client.26510 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:11.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.857+0000 7fdf52e16740 1 -- 172.21.15.152:0/2733541955 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f511625a50 con 0x55f51158f4a0 2024-09-11T22:11:11.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.858+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2733541955 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf3c01c9f0 con 0x55f51158f4a0 2024-09-11T22:11:11.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.858+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2733541955 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fdf3c01d440 con 0x55f51158f4a0 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.858+0000 7fdf52e16740 10 client.26510 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.858+0000 7fdf52e16740 10 client.26510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.858+0000 7fdf52e16740 20 client.26510 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.858+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f5116260b0 0x55f5116284a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.858+0000 7fdf52e16740 4 client.26510 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.858+0000 7fdf52e16740 1 -- 172.21.15.152:0/2733541955 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f5114fcd60 con 0x55f5116260b0 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.858+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f5116260b0 0x55f5116284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.858+0000 7fdf31ffb640 10 client.26510 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.858+0000 7fdf49d9b640 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f5116260b0 0x55f5116284a0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eac95c14e86019c server_cookie=eda0de500246f902 in_seq=0 out_seq=0 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.859+0000 7fdf31ffb640 1 -- 172.21.15.152:0/2733541955 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f5114fcd60 con 0x55f5116260b0 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.859+0000 7fdf31ffb640 10 client.26510 handle_command_reply: tid=0 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.859+0000 7fdf52e16740 1 client.26510 shutdown 2024-09-11T22:11:11.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf52e16740 1 -- 172.21.15.152:0/2733541955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158f4a0 msgr2=0x55f5115b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158f4a0 0x55f5115b39c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c01c800 tx=0x7fdf3c005bd0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf52e16740 1 -- 172.21.15.152:0/2733541955 shutdown_connections 2024-09-11T22:11:11.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f5116260b0 0x55f5116284a0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f51159a680 0x55f5115af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f51158fdc0 0x55f5115aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf31ffb640 0 client.26510 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:11.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf52e16740 1 --2- 172.21.15.152:0/2733541955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f51158f4a0 0x55f5115b39c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf52e16740 1 -- 172.21.15.152:0/2733541955 >> 172.21.15.152:0/2733541955 conn(0x55f51158ba30 msgr2=0x55f511591760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:11.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf52e16740 1 -- 172.21.15.152:0/2733541955 shutdown_connections 2024-09-11T22:11:11.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf52e16740 1 -- 172.21.15.152:0/2733541955 wait complete. 2024-09-11T22:11:11.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.860+0000 7fdf52e16740 20 client.26510 trim_cache size 0 max 16384 2024-09-11T22:11:11.865 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:11:11.865 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:11:11.865 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:11:11.865 INFO:teuthology.orchestra.run.smithi152.stdout: "6b1e28d1-b4c1-41ae-a71c-ac72534d3661": { 2024-09-11T22:11:11.866 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:11:11.866 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "6b1e28d1-b4c1-41ae-a71c-ac72534d3661", 2024-09-11T22:11:11.866 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:11:11.866 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:11.866 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:11.866 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:11:11.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2479621778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf340a2e80 msgr2=0x7fdf340a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf340a2e80 0x7fdf340a5340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf44002140 tx=0x7fdf440012f0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2479621778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf4c109830 msgr2=0x7fdf4c1a78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf4c109830 0x7fdf4c1a78b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009850 tx=0x7fdf40005230 comp rx=0 tx=0).stop 2024-09-11T22:11:11.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2479621778 shutdown_connections 2024-09-11T22:11:11.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdf340a2e80 0x7fdf340a5340 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4c11b140 0x7fdf4c1abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf4c109830 0x7fdf4c1a78b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 --2- 172.21.15.152:0/2479621778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4c109450 0x7fdf4c1a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2479621778 >> 172.21.15.152:0/2479621778 conn(0x7fdf4c06e140 msgr2=0x7fdf4c11bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:11.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2479621778 shutdown_connections 2024-09-11T22:11:11.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:11.861+0000 7fdf50a3d640 1 -- 172.21.15.152:0/2479621778 wait complete. 2024-09-11T22:11:12.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:11 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:12.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:11 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:12.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:11 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:12.603 INFO:tasks.cephfs.filesystem:scrub status for tag:6b1e28d1-b4c1-41ae-a71c-ac72534d3661 - {'path': '/', 'tag': '6b1e28d1-b4c1-41ae-a71c-ac72534d3661', 'options': 'recursive,force'} 2024-09-11T22:11:13.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:12 smithi152 ceph-mon[31188]: pgmap v211: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 53 MiB/s wr, 1.72k op/s 2024-09-11T22:11:13.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:12 smithi179 ceph-mon[35603]: pgmap v211: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 53 MiB/s wr, 1.72k op/s 2024-09-11T22:11:13.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:12 smithi193 ceph-mon[35545]: pgmap v211: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 53 MiB/s wr, 1.72k op/s 2024-09-11T22:11:14.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 340.0 s, 3059.8 tps, lat 32.506 ms stddev 35.070 2024-09-11T22:11:15.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:14 smithi152 ceph-mon[31188]: pgmap v212: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 29 MiB/s wr, 1.13k op/s 2024-09-11T22:11:15.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:14 smithi179 ceph-mon[35603]: pgmap v212: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 29 MiB/s wr, 1.13k op/s 2024-09-11T22:11:15.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:14 smithi193 ceph-mon[35545]: pgmap v212: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 29 MiB/s wr, 1.13k op/s 2024-09-11T22:11:16.355 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-11T22:11:16.356 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:11:16.755 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:17.040 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:16 smithi152 ceph-mon[31188]: pgmap v213: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 24 MiB/s wr, 1.06k op/s 2024-09-11T22:11:17.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:16 smithi179 ceph-mon[35603]: pgmap v213: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 24 MiB/s wr, 1.06k op/s 2024-09-11T22:11:17.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:16 smithi193 ceph-mon[35545]: pgmap v213: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 24 MiB/s wr, 1.06k op/s 2024-09-11T22:11:17.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.332+0000 7f7145336640 1 -- 172.21.15.152:0/1656612302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f714010c180 msgr2=0x7f714010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.332+0000 7f7145336640 1 --2- 172.21.15.152:0/1656612302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f714010c180 0x7f714010e610 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7138009860 tx=0x7f713802a3f0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.332+0000 7f7145336640 1 -- 172.21.15.152:0/1656612302 shutdown_connections 2024-09-11T22:11:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.332+0000 7f7145336640 1 --2- 172.21.15.152:0/1656612302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f714010c180 0x7f714010e610 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.332+0000 7f7145336640 1 --2- 172.21.15.152:0/1656612302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7140103700 0x7f714010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.332+0000 7f7145336640 1 --2- 172.21.15.152:0/1656612302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140102de0 0x7f71401031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.332+0000 7f7145336640 1 -- 172.21.15.152:0/1656612302 >> 172.21.15.152:0/1656612302 conn(0x7f71400fc7c0 msgr2=0x7f71400febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.332+0000 7f7145336640 1 -- 172.21.15.152:0/1656612302 shutdown_connections 2024-09-11T22:11:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.332+0000 7f7145336640 1 -- 172.21.15.152:0/1656612302 wait complete. 2024-09-11T22:11:17.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.333+0000 7f7145336640 1 Processor -- start 2024-09-11T22:11:17.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.334+0000 7f7145336640 1 -- start start 2024-09-11T22:11:17.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.334+0000 7f7145336640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7140102de0 0x7f714010b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.334+0000 7f7145336640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140103700 0x7f7140100970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.335+0000 7f7145336640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714010c180 0x7f7140100eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.335+0000 7f713e7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140103700 0x7f7140100970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.335+0000 7f713e7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140103700 0x7f7140100970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:47278/0 (socket says 172.21.15.152:47278) 2024-09-11T22:11:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.335+0000 7f713effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7140102de0 0x7f714010b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.335+0000 7f713effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7140102de0 0x7f714010b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58824/0 (socket says 172.21.15.152:58824) 2024-09-11T22:11:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.335+0000 7f713e7fc640 1 -- 172.21.15.152:0/4162144845 learned_addr learned my addr 172.21.15.152:0/4162144845 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.335+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f714006c660 con 0x7f7140102de0 2024-09-11T22:11:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.335+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f714006c4e0 con 0x7f714010c180 2024-09-11T22:11:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.335+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f714006c7e0 con 0x7f7140103700 2024-09-11T22:11:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.335+0000 7f713f7fe640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714010c180 0x7f7140100eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.336+0000 7f713e7fc640 1 -- 172.21.15.152:0/4162144845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714010c180 msgr2=0x7f7140100eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.336+0000 7f713e7fc640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714010c180 0x7f7140100eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.336+0000 7f713e7fc640 1 -- 172.21.15.152:0/4162144845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7140102de0 msgr2=0x7f714010b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.336+0000 7f713e7fc640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7140102de0 0x7f714010b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.336+0000 7f713e7fc640 1 -- 172.21.15.152:0/4162144845 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714010bf00 con 0x7f7140103700 2024-09-11T22:11:17.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.336+0000 7f713e7fc640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140103700 0x7f7140100970 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f713400d950 tx=0x7f713400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.336+0000 7f7127fff640 1 -- 172.21.15.152:0/4162144845 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134017070 con 0x7f7140103700 2024-09-11T22:11:17.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.336+0000 7f7127fff640 1 -- 172.21.15.152:0/4162144845 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7134009c30 con 0x7f7140103700 2024-09-11T22:11:17.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.336+0000 7f7127fff640 1 -- 172.21.15.152:0/4162144845 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713400f620 con 0x7f7140103700 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.336+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71401014b0 con 0x7f7140103700 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.337+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71401b3ad0 con 0x7f7140103700 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.338+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7140101e50 con 0x7f7140103700 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.339+0000 7f7127fff640 1 -- 172.21.15.152:0/4162144845 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f7134010460 con 0x7f7140103700 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.339+0000 7f7127fff640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f71280a2f00 0x7f71280a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.340+0000 7f7127fff640 1 -- 172.21.15.152:0/4162144845 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8658+0+0 (secure 0 0 0) 0x7f71340cef70 con 0x7f7140103700 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.340+0000 7f713effd640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f71280a2f00 0x7f71280a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.341+0000 7f713effd640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f71280a2f00 0x7f71280a53c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7130005fd0 tx=0x7f7130009500 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.344+0000 7f7127fff640 1 -- 172.21.15.152:0/4162144845 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7134009de0 con 0x7f7140103700 2024-09-11T22:11:17.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.712+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71401b3fc0 con 0x7f7140103700 2024-09-11T22:11:17.714 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:11:17.715 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:11:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:11:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.713+0000 7f7127fff640 1 -- 172.21.15.152:0/4162144845 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f713409b450 con 0x7f7140103700 2024-09-11T22:11:17.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.716+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f71280a2f00 msgr2=0x7f71280a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.716+0000 7f7145336640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f71280a2f00 0x7f71280a53c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7130005fd0 tx=0x7f7130009500 comp rx=0 tx=0).stop 2024-09-11T22:11:17.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.716+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140103700 msgr2=0x7f7140100970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.717+0000 7f7145336640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140103700 0x7f7140100970 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f713400d950 tx=0x7f713400de10 comp rx=0 tx=0).stop 2024-09-11T22:11:17.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.717+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 shutdown_connections 2024-09-11T22:11:17.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.717+0000 7f7145336640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f71280a2f00 0x7f71280a53c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.717+0000 7f7145336640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714010c180 0x7f7140100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.717+0000 7f7145336640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140103700 0x7f7140100970 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.717+0000 7f7145336640 1 --2- 172.21.15.152:0/4162144845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7140102de0 0x7f714010b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.717+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 >> 172.21.15.152:0/4162144845 conn(0x7f71400fc7c0 msgr2=0x7f714010db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:17.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.717+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 shutdown_connections 2024-09-11T22:11:17.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:17.717+0000 7f7145336640 1 -- 172.21.15.152:0/4162144845 wait complete. 2024-09-11T22:11:18.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:17 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/4162144845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:18.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:17 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/4162144845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:18.466 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:17 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/4162144845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:18.510 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-11T22:11:18.510 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-11T22:11:18.884 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:19.288 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:18 smithi152 ceph-mon[31188]: pgmap v214: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 24 MiB/s wr, 1.06k op/s 2024-09-11T22:11:19.289 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:18 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:11:19.289 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:18 smithi152 ceph-mon[31188]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T22:11:19.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:18 smithi179 ceph-mon[35603]: pgmap v214: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 24 MiB/s wr, 1.06k op/s 2024-09-11T22:11:19.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:18 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:11:19.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:18 smithi179 ceph-mon[35603]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T22:11:19.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:18 smithi193 ceph-mon[35545]: pgmap v214: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 24 MiB/s wr, 1.06k op/s 2024-09-11T22:11:19.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:18 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:11:19.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:18 smithi193 ceph-mon[35545]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T22:11:19.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.582+0000 7f3774587640 1 -- 172.21.15.152:0/2363066621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c100de0 msgr2=0x7f376c104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.582+0000 7f3774587640 1 --2- 172.21.15.152:0/2363066621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c100de0 0x7f376c104e30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f375c009900 tx=0x7f375c02a3f0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.583+0000 7f3774587640 1 -- 172.21.15.152:0/2363066621 shutdown_connections 2024-09-11T22:11:19.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.583+0000 7f3774587640 1 --2- 172.21.15.152:0/2363066621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c105560 0x7f376c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.583+0000 7f3774587640 1 --2- 172.21.15.152:0/2363066621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c100de0 0x7f376c104e30 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.583+0000 7f3774587640 1 --2- 172.21.15.152:0/2363066621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c100430 0x7f376c100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.583+0000 7f3774587640 1 -- 172.21.15.152:0/2363066621 >> 172.21.15.152:0/2363066621 conn(0x7f376c077230 msgr2=0x7f376c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:19.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.583+0000 7f3774587640 1 -- 172.21.15.152:0/2363066621 shutdown_connections 2024-09-11T22:11:19.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.583+0000 7f3774587640 1 -- 172.21.15.152:0/2363066621 wait complete. 2024-09-11T22:11:19.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.583+0000 7f3774587640 1 Processor -- start 2024-09-11T22:11:19.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.583+0000 7f3774587640 1 -- start start 2024-09-11T22:11:19.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.584+0000 7f3774587640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c100430 0x7f376c196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.584+0000 7f3774587640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c100de0 0x7f376c196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.584+0000 7f3774587640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c105560 0x7f376c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.584+0000 7f3774587640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f376c10fd90 con 0x7f376c105560 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.584+0000 7f3774587640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f376c10fc10 con 0x7f376c100430 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.584+0000 7f3774587640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f376c10ff10 con 0x7f376c100de0 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.584+0000 7f3772b24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c105560 0x7f376c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.584+0000 7f3772b24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c105560 0x7f376c19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58850/0 (socket says 172.21.15.152:58850) 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.584+0000 7f3772b24640 1 -- 172.21.15.152:0/38274243 learned_addr learned my addr 172.21.15.152:0/38274243 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.584+0000 7f3771b22640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c100de0 0x7f376c196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.584+0000 7f3772323640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c100430 0x7f376c196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.585+0000 7f3771b22640 1 -- 172.21.15.152:0/38274243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c100430 msgr2=0x7f376c196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.585+0000 7f3771b22640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c100430 0x7f376c196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.585+0000 7f3771b22640 1 -- 172.21.15.152:0/38274243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c105560 msgr2=0x7f376c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.585+0000 7f3771b22640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c105560 0x7f376c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.585+0000 7f3771b22640 1 -- 172.21.15.152:0/38274243 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376c19b1c0 con 0x7f376c100de0 2024-09-11T22:11:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.585+0000 7f3771b22640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c100de0 0x7f376c196750 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f375c02a9e0 tx=0x7f375c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.586+0000 7f37637fe640 1 -- 172.21.15.152:0/38274243 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c035030 con 0x7f376c100de0 2024-09-11T22:11:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.587+0000 7f37637fe640 1 -- 172.21.15.152:0/38274243 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f375c041070 con 0x7f376c100de0 2024-09-11T22:11:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.587+0000 7f37637fe640 1 -- 172.21.15.152:0/38274243 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c046470 con 0x7f376c100de0 2024-09-11T22:11:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.587+0000 7f3774587640 1 -- 172.21.15.152:0/38274243 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376c19b450 con 0x7f376c100de0 2024-09-11T22:11:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.587+0000 7f3774587640 1 -- 172.21.15.152:0/38274243 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376c19b7f0 con 0x7f376c100de0 2024-09-11T22:11:19.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.589+0000 7f37637fe640 1 -- 172.21.15.152:0/38274243 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f375c031640 con 0x7f376c100de0 2024-09-11T22:11:19.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.590+0000 7f37637fe640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37580a2e80 0x7f37580a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.590+0000 7f37637fe640 1 -- 172.21.15.152:0/38274243 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f375c0f3d90 con 0x7f376c100de0 2024-09-11T22:11:19.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.590+0000 7f3776960740 1 Processor -- start 2024-09-11T22:11:19.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3772323640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37580a2e80 0x7f37580a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3776960740 1 -- start start 2024-09-11T22:11:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3776960740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b665350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3776960740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b665890 0x56034b66fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3776960740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b672540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3776960740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56034b5c22a0 con 0x56034b670150 2024-09-11T22:11:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3776960740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56034b569b10 con 0x56034b665890 2024-09-11T22:11:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3776960740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56034b5be260 con 0x56034b664f70 2024-09-11T22:11:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3772b24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b672540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3772323640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b665350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3772b24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b672540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58856/0 (socket says 172.21.15.152:58856) 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3772b24640 1 -- 172.21.15.152:0/744758710 learned_addr learned my addr 172.21.15.152:0/744758710 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3771b22640 1 --2- 172.21.15.152:0/744758710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b665890 0x56034b66fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.591+0000 7f3772323640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37580a2e80 0x7f37580a5340 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3768005fd0 tx=0x7f3768005850 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.592+0000 7f3772323640 1 -- 172.21.15.152:0/744758710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b665890 msgr2=0x56034b66fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.592+0000 7f3772323640 1 --2- 172.21.15.152:0/744758710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b665890 0x56034b66fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.592+0000 7f3772323640 1 -- 172.21.15.152:0/744758710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 msgr2=0x56034b672540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.592+0000 7f3772323640 1 --2- 172.21.15.152:0/744758710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b672540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.592+0000 7f3772323640 1 -- 172.21.15.152:0/744758710 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56034b333b90 con 0x56034b664f70 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.592+0000 7f3772b24640 1 --2- 172.21.15.152:0/744758710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b672540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.592+0000 7f3772323640 1 --2- 172.21.15.152:0/744758710 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b665350 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f376800dda0 tx=0x7f3768012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6283099b07ccc519 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.592+0000 7f3760ff9640 1 -- 172.21.15.152:0/744758710 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376800ddd0 con 0x56034b664f70 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.592+0000 7f3760ff9640 1 -- 172.21.15.152:0/744758710 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3768024960 con 0x56034b664f70 2024-09-11T22:11:19.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.592+0000 7f3760ff9640 1 -- 172.21.15.152:0/744758710 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768018a90 con 0x56034b664f70 2024-09-11T22:11:19.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.593+0000 7f3776960740 1 -- 172.21.15.152:0/744758710 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 msgr2=0x56034b665350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.593+0000 7f3776960740 1 --2- 172.21.15.152:0/744758710 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b665350 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f376800dda0 tx=0x7f3768012000 comp rx=0 tx=0).stop 2024-09-11T22:11:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.593+0000 7f3776960740 1 -- 172.21.15.152:0/744758710 shutdown_connections 2024-09-11T22:11:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.593+0000 7f3776960740 1 --2- 172.21.15.152:0/744758710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b672540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.593+0000 7f3776960740 1 --2- 172.21.15.152:0/744758710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b665890 0x56034b66fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.593+0000 7f3776960740 1 --2- 172.21.15.152:0/744758710 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b665350 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.593+0000 7f3776960740 1 -- 172.21.15.152:0/744758710 >> 172.21.15.152:0/744758710 conn(0x56034b661500 msgr2=0x56034b6618e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.594+0000 7f3776960740 1 -- 172.21.15.152:0/744758710 shutdown_connections 2024-09-11T22:11:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.594+0000 7f3776960740 1 -- 172.21.15.152:0/744758710 wait complete. 2024-09-11T22:11:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.594+0000 7f3776960740 1 -- start start 2024-09-11T22:11:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.594+0000 7f3776960740 1 Processor -- start 2024-09-11T22:11:19.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.595+0000 7f3776960740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b66d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.595+0000 7f3776960740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b665890 0x56034b66d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3776960740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b670150 0x56034b66daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3776960740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56034b672d20 con 0x56034b665890 2024-09-11T22:11:19.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3776960740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56034b54a6e0 con 0x56034b670150 2024-09-11T22:11:19.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3776960740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56034b672ea0 con 0x56034b664f70 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3776960740 10 client.0 _ll_register_callbacks cb 0x56034b56ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3772323640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b66d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3772323640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b66d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:47326/0 (socket says 172.21.15.152:47326) 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3772323640 1 -- 172.21.15.152:0/534896751 learned_addr learned my addr 172.21.15.152:0/534896751 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3771b22640 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b665890 0x56034b66d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3772b24640 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b670150 0x56034b66daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3772323640 1 -- 172.21.15.152:0/534896751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b670150 msgr2=0x56034b66daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3772323640 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b670150 0x56034b66daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3772323640 1 -- 172.21.15.152:0/534896751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b665890 msgr2=0x56034b66d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3772323640 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b665890 0x56034b66d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.596+0000 7f3772323640 1 -- 172.21.15.152:0/534896751 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56034b67c240 con 0x56034b664f70 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.597+0000 7f3772323640 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b66d070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f37680097f0 tx=0x7f37680183f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55d292a98fec8020 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.597+0000 7f3755ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.597+0000 7f3755ffb640 1 -- 172.21.15.152:0/534896751 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768024680 con 0x56034b664f70 2024-09-11T22:11:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.597+0000 7f3755ffb640 1 -- 172.21.15.152:0/534896751 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f3768005040 con 0x56034b664f70 2024-09-11T22:11:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.597+0000 7f3776960740 1 -- 172.21.15.152:0/534896751 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3768024960 con 0x56034b664f70 2024-09-11T22:11:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.597+0000 7f3755ffb640 1 -- 172.21.15.152:0/534896751 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3768005240 con 0x56034b664f70 2024-09-11T22:11:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.597+0000 7f3776960740 10 client.26683 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.597+0000 7f3776960740 1 -- 172.21.15.152:0/534896751 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56034b67ebd0 con 0x56034b664f70 2024-09-11T22:11:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.598+0000 7f3755ffb640 1 -- 172.21.15.152:0/534896751 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3768018cb0 con 0x56034b664f70 2024-09-11T22:11:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.598+0000 7f3755ffb640 1 -- 172.21.15.152:0/534896751 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f376802b070 con 0x56034b664f70 2024-09-11T22:11:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.598+0000 7f3776960740 10 client.26683 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.598+0000 7f3776960740 10 client.26683 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:11:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.598+0000 7f3776960740 20 client.26683 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.598+0000 7f3776960740 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56034b67ff70 0x56034b682360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.598+0000 7f3776960740 4 client.26683 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.598+0000 7f3776960740 1 -- 172.21.15.152:0/534896751 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3768024960 con 0x56034b67ff70 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.598+0000 7f3771b22640 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56034b67ff70 0x56034b682360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.599+0000 7f3771b22640 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56034b67ff70 0x56034b682360 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=482684d8912152e server_cookie=2d97484a97b9b719 in_seq=0 out_seq=0 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.599+0000 7f3755ffb640 10 client.26683 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.600+0000 7f3755ffb640 1 -- 172.21.15.152:0/534896751 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3768024960 con 0x56034b67ff70 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.600+0000 7f3755ffb640 10 client.26683 handle_command_reply: tid=0 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.600+0000 7f3776960740 1 client.26683 shutdown 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.600+0000 7f3776960740 1 -- 172.21.15.152:0/534896751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 msgr2=0x56034b66d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.600+0000 7f3776960740 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b66d070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f37680097f0 tx=0x7f37680183f0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.601+0000 7f3776960740 1 -- 172.21.15.152:0/534896751 shutdown_connections 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.601+0000 7f3776960740 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56034b67ff70 0x56034b682360 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.601+0000 7f3755ffb640 0 client.26683 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:19.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.601+0000 7f3776960740 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b670150 0x56034b66daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.601+0000 7f3776960740 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b665890 0x56034b66d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.601+0000 7f3776960740 1 --2- 172.21.15.152:0/534896751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b66d070 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.601+0000 7f3776960740 1 -- 172.21.15.152:0/534896751 >> 172.21.15.152:0/534896751 conn(0x56034b661500 msgr2=0x56034b657e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:19.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.601+0000 7f3776960740 1 -- 172.21.15.152:0/534896751 shutdown_connections 2024-09-11T22:11:19.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.601+0000 7f3776960740 1 -- 172.21.15.152:0/534896751 wait complete. 2024-09-11T22:11:19.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.601+0000 7f3776960740 20 client.26683 trim_cache size 0 max 16384 2024-09-11T22:11:19.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.631+0000 7f3776960740 1 Processor -- start 2024-09-11T22:11:19.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3776960740 1 -- start start 2024-09-11T22:11:19.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3776960740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b664f70 0x56034b66d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3776960740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b665890 0x56034b66dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3776960740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b687b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3776960740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1ae030 con 0x56034b670150 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3776960740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1ab900 con 0x56034b664f70 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3776960740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1a9770 con 0x56034b665890 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3771b22640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b665890 0x56034b66dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3772b24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b687b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3771b22640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b665890 0x56034b66dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:47330/0 (socket says 172.21.15.152:47330) 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3772b24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b687b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58882/0 (socket says 172.21.15.152:58882) 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3771b22640 1 -- 172.21.15.152:0/2271097689 learned_addr learned my addr 172.21.15.152:0/2271097689 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3772323640 1 --2- 172.21.15.152:0/2271097689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b664f70 0x56034b66d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3771b22640 1 -- 172.21.15.152:0/2271097689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b664f70 msgr2=0x56034b66d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3771b22640 1 --2- 172.21.15.152:0/2271097689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b664f70 0x56034b66d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3771b22640 1 -- 172.21.15.152:0/2271097689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 msgr2=0x56034b687b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3771b22640 1 --2- 172.21.15.152:0/2271097689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b687b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3771b22640 1 -- 172.21.15.152:0/2271097689 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56034b661330 con 0x56034b665890 2024-09-11T22:11:19.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.632+0000 7f3772b24640 1 --2- 172.21.15.152:0/2271097689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b687b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:19.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.633+0000 7f3771b22640 1 --2- 172.21.15.152:0/2271097689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b665890 0x56034b66dc80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f375c0c0060 tx=0x7f375c0c3040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13e3eb206133eef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:19.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.633+0000 7f3757fff640 1 -- 172.21.15.152:0/2271097689 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c0c0360 con 0x56034b665890 2024-09-11T22:11:19.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.633+0000 7f3757fff640 1 -- 172.21.15.152:0/2271097689 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f375c0c4710 con 0x56034b665890 2024-09-11T22:11:19.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.633+0000 7f3757fff640 1 -- 172.21.15.152:0/2271097689 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c0f1e30 con 0x56034b665890 2024-09-11T22:11:19.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.634+0000 7f3776960740 1 -- 172.21.15.152:0/2271097689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b665890 msgr2=0x56034b66dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.634+0000 7f3776960740 1 --2- 172.21.15.152:0/2271097689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b665890 0x56034b66dc80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f375c0c0060 tx=0x7f375c0c3040 comp rx=0 tx=0).stop 2024-09-11T22:11:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.634+0000 7f3776960740 1 -- 172.21.15.152:0/2271097689 shutdown_connections 2024-09-11T22:11:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.634+0000 7f3776960740 1 --2- 172.21.15.152:0/2271097689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b687b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.634+0000 7f3776960740 1 --2- 172.21.15.152:0/2271097689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b665890 0x56034b66dc80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.634+0000 7f3776960740 1 --2- 172.21.15.152:0/2271097689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b664f70 0x56034b66d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.634+0000 7f3776960740 1 -- 172.21.15.152:0/2271097689 >> 172.21.15.152:0/2271097689 conn(0x56034b661500 msgr2=0x56034b66d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.635+0000 7f3776960740 1 -- 172.21.15.152:0/2271097689 shutdown_connections 2024-09-11T22:11:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.635+0000 7f3776960740 1 -- 172.21.15.152:0/2271097689 wait complete. 2024-09-11T22:11:19.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.635+0000 7f3776960740 1 -- start start 2024-09-11T22:11:19.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.635+0000 7f3776960740 1 Processor -- start 2024-09-11T22:11:19.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3776960740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b6782d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3776960740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b665890 0x56034b678810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3776960740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b6750c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3772323640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b6782d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3776960740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1a9dc0 con 0x56034b670150 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3776960740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1ab230 con 0x56034b665890 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3776960740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1aa490 con 0x56034b664f70 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3772323640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b6782d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:47338/0 (socket says 172.21.15.152:47338) 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3772323640 1 -- 172.21.15.152:0/3268533951 learned_addr learned my addr 172.21.15.152:0/3268533951 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3771b22640 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b665890 0x56034b678810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3776960740 10 client.0 _ll_register_callbacks cb 0x7f376800dca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3772b24640 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b6750c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3771b22640 1 -- 172.21.15.152:0/3268533951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 msgr2=0x56034b6782d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:19.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3771b22640 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b6782d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3771b22640 1 -- 172.21.15.152:0/3268533951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 msgr2=0x56034b6750c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3771b22640 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b6750c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3771b22640 1 -- 172.21.15.152:0/3268533951 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56034b662190 con 0x56034b665890 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3771b22640 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b665890 0x56034b678810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f375c0be8b0 tx=0x7f375c0f1530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95f59e3188f5742c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.636+0000 7f3755ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3755ffb640 1 -- 172.21.15.152:0/3268533951 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c0dd020 con 0x56034b665890 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3755ffb640 1 -- 172.21.15.152:0/3268533951 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f375c0bc9d0 con 0x56034b665890 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3776960740 1 -- 172.21.15.152:0/3268533951 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f375c0c4710 con 0x56034b665890 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3755ffb640 1 -- 172.21.15.152:0/3268533951 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f375c0c0360 con 0x56034b665890 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3776960740 10 client.26534 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3776960740 1 -- 172.21.15.152:0/3268533951 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56034b654260 con 0x56034b665890 2024-09-11T22:11:19.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3755ffb640 1 -- 172.21.15.152:0/3268533951 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f375c0c4710 con 0x56034b665890 2024-09-11T22:11:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3755ffb640 1 -- 172.21.15.152:0/3268533951 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f375c04e030 con 0x56034b665890 2024-09-11T22:11:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3776960740 10 client.26534 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3776960740 10 client.26534 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:11:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3776960740 20 client.26534 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.637+0000 7f3776960740 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56034b67ff70 0x56034b6ed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.638+0000 7f3776960740 4 client.26534 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-11T22:11:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.638+0000 7f3776960740 1 -- 172.21.15.152:0/3268533951 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x56034b5cf9d0 con 0x56034b67ff70 2024-09-11T22:11:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.638+0000 7f3772323640 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56034b67ff70 0x56034b6ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.638+0000 7f3772323640 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56034b67ff70 0x56034b6ed880 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f20e75d75e973c3 server_cookie=aa3a640d16164e8f in_seq=0 out_seq=0 2024-09-11T22:11:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.638+0000 7f3755ffb640 10 client.26534 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:19.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 345.0 s, 2946.7 tps, lat 32.951 ms stddev 36.317 2024-09-11T22:11:19.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3755ffb640 1 -- 172.21.15.152:0/3268533951 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56034b5cf9d0 con 0x56034b67ff70 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3755ffb640 10 client.26534 handle_command_reply: tid=0 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3776960740 1 client.26534 shutdown 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3776960740 1 -- 172.21.15.152:0/3268533951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b665890 msgr2=0x56034b678810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3776960740 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b665890 0x56034b678810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f375c0be8b0 tx=0x7f375c0f1530 comp rx=0 tx=0).stop 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3776960740 1 -- 172.21.15.152:0/3268533951 shutdown_connections 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3776960740 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56034b67ff70 0x56034b6ed880 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3776960740 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56034b670150 0x56034b6750c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3776960740 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56034b665890 0x56034b678810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3755ffb640 0 client.26534 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3776960740 1 --2- 172.21.15.152:0/3268533951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56034b664f70 0x56034b6782d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3776960740 1 -- 172.21.15.152:0/3268533951 >> 172.21.15.152:0/3268533951 conn(0x56034b661500 msgr2=0x56034b6671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3776960740 1 -- 172.21.15.152:0/3268533951 shutdown_connections 2024-09-11T22:11:19.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.961+0000 7f3776960740 1 -- 172.21.15.152:0/3268533951 wait complete. 2024-09-11T22:11:19.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3776960740 20 client.26534 trim_cache size 0 max 16384 2024-09-11T22:11:19.964 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:11:19.964 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:11:19.964 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:11:19.964 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 26, 2024-09-11T22:11:19.964 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:11:19.964 INFO:teuthology.orchestra.run.smithi152.stdout: "7d735a34": { 2024-09-11T22:11:19.964 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 26, 2024-09-11T22:11:19.964 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:11:19.964 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 136.6, 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:19.965 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:19.966 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:19.966 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:19.966 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:19.966 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:11:19.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 -- 172.21.15.152:0/38274243 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37580a2e80 msgr2=0x7f37580a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37580a2e80 0x7f37580a5340 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3768005fd0 tx=0x7f3768005850 comp rx=0 tx=0).stop 2024-09-11T22:11:19.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 -- 172.21.15.152:0/38274243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c100de0 msgr2=0x7f376c196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c100de0 0x7f376c196750 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f375c02a9e0 tx=0x7f375c0045e0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 -- 172.21.15.152:0/38274243 shutdown_connections 2024-09-11T22:11:19.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f37580a2e80 0x7f37580a5340 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f376c105560 0x7f376c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f376c100de0 0x7f376c196750 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 --2- 172.21.15.152:0/38274243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c100430 0x7f376c196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 -- 172.21.15.152:0/38274243 >> 172.21.15.152:0/38274243 conn(0x7f376c077230 msgr2=0x7f376c103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:19.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 -- 172.21.15.152:0/38274243 shutdown_connections 2024-09-11T22:11:19.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:19.962+0000 7f3774587640 1 -- 172.21.15.152:0/38274243 wait complete. 2024-09-11T22:11:20.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:19 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:11:20.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:19 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:11:20.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:19 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:11:20.722 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7d735a34', quiesce took 4.4 seconds. Will release after: 12.200000000000001 2024-09-11T22:11:21.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:20 smithi179 ceph-mon[35603]: pgmap v216: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 953 op/s 2024-09-11T22:11:21.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:20 smithi193 ceph-mon[35545]: pgmap v216: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 953 op/s 2024-09-11T22:11:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:20 smithi152 ceph-mon[31188]: pgmap v216: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 953 op/s 2024-09-11T22:11:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.927+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/125681916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb18107b80 msgr2=0x7fcb18107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.927+0000 7fcb1fc5e640 1 --2- 172.21.15.152:0/125681916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb18107b80 0x7fcb18107f60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009930 tx=0x7fcb1402a420 comp rx=0 tx=0).stop 2024-09-11T22:11:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.927+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/125681916 shutdown_connections 2024-09-11T22:11:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.927+0000 7fcb1fc5e640 1 --2- 172.21.15.152:0/125681916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb18102480 0x7fcb1810e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.927+0000 7fcb1fc5e640 1 --2- 172.21.15.152:0/125681916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb18101ae0 0x7fcb18101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.927+0000 7fcb1fc5e640 1 --2- 172.21.15.152:0/125681916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb18107b80 0x7fcb18107f60 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.927+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/125681916 >> 172.21.15.152:0/125681916 conn(0x7fcb180fd7e0 msgr2=0x7fcb180ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.927+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/125681916 shutdown_connections 2024-09-11T22:11:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.927+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/125681916 wait complete. 2024-09-11T22:11:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.927+0000 7fcb1fc5e640 1 Processor -- start 2024-09-11T22:11:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1fc5e640 1 -- start start 2024-09-11T22:11:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1fc5e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb18101ae0 0x7fcb18198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1fc5e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb18102480 0x7fcb18198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1fc5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb18107b80 0x7fcb1819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1fc5e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18111f30 con 0x7fcb18102480 2024-09-11T22:11:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1fc5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18111db0 con 0x7fcb18107b80 2024-09-11T22:11:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1fc5e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181120b0 con 0x7fcb18101ae0 2024-09-11T22:11:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1d1f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb18102480 0x7fcb18198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1d1f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb18102480 0x7fcb18198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58922/0 (socket says 172.21.15.152:58922) 2024-09-11T22:11:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1d1f9640 1 -- 172.21.15.152:0/165819842 learned_addr learned my addr 172.21.15.152:0/165819842 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb18101ae0 0x7fcb18198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb18107b80 0x7fcb1819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1d1f9640 1 -- 172.21.15.152:0/165819842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb18101ae0 msgr2=0x7fcb18198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1d1f9640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb18101ae0 0x7fcb18198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1d1f9640 1 -- 172.21.15.152:0/165819842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb18107b80 msgr2=0x7fcb1819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1d1f9640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb18107b80 0x7fcb1819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1d1f9640 1 -- 172.21.15.152:0/165819842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1819d340 con 0x7fcb18102480 2024-09-11T22:11:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.928+0000 7fcb1d1f9640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb18102480 0x7fcb18198890 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800d950 tx=0x7fcb0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.929+0000 7fcb0effd640 1 -- 172.21.15.152:0/165819842 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08017070 con 0x7fcb18102480 2024-09-11T22:11:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.929+0000 7fcb0effd640 1 -- 172.21.15.152:0/165819842 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb08009c30 con 0x7fcb18102480 2024-09-11T22:11:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.929+0000 7fcb0effd640 1 -- 172.21.15.152:0/165819842 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0800f6b0 con 0x7fcb18102480 2024-09-11T22:11:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.929+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/165819842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1819d630 con 0x7fcb18102480 2024-09-11T22:11:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.929+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/165819842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb181a4ec0 con 0x7fcb18102480 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.931+0000 7fcb0effd640 1 -- 172.21.15.152:0/165819842 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fcb080109d0 con 0x7fcb18102480 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.931+0000 7fcb229f6740 1 Processor -- start 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb229f6740 1 -- start start 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b4410 0x562c785be770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb229f6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562c785182f0 con 0x562c785becb0 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb229f6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562c784c0270 con 0x562c785b3af0 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb229f6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562c785142b0 con 0x562c785b4410 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb0effd640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcb040a2da0 0x7fcb040a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb1d1f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb1d1f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785c10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58932/0 (socket says 172.21.15.152:58932) 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb1d1f9640 1 -- 172.21.15.152:0/1838966971 learned_addr learned my addr 172.21.15.152:0/1838966971 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/1838966971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b4410 0x562c785be770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/1838966971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcb040a2da0 0x7fcb040a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.932+0000 7fcb0effd640 1 -- 172.21.15.152:0/165819842 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fcb080cf050 con 0x7fcb18102480 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.933+0000 7fcb1d9fa640 1 -- 172.21.15.152:0/1838966971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 msgr2=0x562c785b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.933+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/1838966971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.933+0000 7fcb1d9fa640 1 -- 172.21.15.152:0/1838966971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 msgr2=0x562c785c10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.933+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/1838966971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785c10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.933+0000 7fcb1d9fa640 1 -- 172.21.15.152:0/1838966971 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c784bf340 con 0x562c785b4410 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.933+0000 7fcb1d1f9640 1 --2- 172.21.15.152:0/1838966971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785c10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.933+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcb040a2da0 0x7fcb040a5260 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009fd0 tx=0x7fcb10009600 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.933+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/1838966971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b4410 0x562c785be770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb14005940 tx=0x7fcb14005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a93e1d8bb515e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.933+0000 7fcb03fff640 1 -- 172.21.15.152:0/1838966971 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14040070 con 0x562c785b4410 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.933+0000 7fcb03fff640 1 -- 172.21.15.152:0/1838966971 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb140319f0 con 0x562c785b4410 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.933+0000 7fcb03fff640 1 -- 172.21.15.152:0/1838966971 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14035040 con 0x562c785b4410 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.934+0000 7fcb229f6740 1 -- 172.21.15.152:0/1838966971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b4410 msgr2=0x562c785be770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.934+0000 7fcb229f6740 1 --2- 172.21.15.152:0/1838966971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b4410 0x562c785be770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb14005940 tx=0x7fcb14005c00 comp rx=0 tx=0).stop 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.934+0000 7fcb229f6740 1 -- 172.21.15.152:0/1838966971 shutdown_connections 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.934+0000 7fcb229f6740 1 --2- 172.21.15.152:0/1838966971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785c10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.934+0000 7fcb229f6740 1 --2- 172.21.15.152:0/1838966971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b4410 0x562c785be770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.934+0000 7fcb229f6740 1 --2- 172.21.15.152:0/1838966971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.934+0000 7fcb229f6740 1 -- 172.21.15.152:0/1838966971 >> 172.21.15.152:0/1838966971 conn(0x562c785b0060 msgr2=0x562c785b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.934+0000 7fcb229f6740 1 -- 172.21.15.152:0/1838966971 shutdown_connections 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.934+0000 7fcb229f6740 1 -- 172.21.15.152:0/1838966971 wait complete. 2024-09-11T22:11:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.934+0000 7fcb229f6740 1 -- start start 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.934+0000 7fcb229f6740 1 Processor -- start 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b3af0 0x562c785bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b4410 0x562c785bc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb229f6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562c785c1880 con 0x562c785becb0 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb229f6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562c784a1290 con 0x562c785b4410 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb229f6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562c785c1a00 con 0x562c785b3af0 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb229f6740 10 client.0 _ll_register_callbacks cb 0x562c784d2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb1e1fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb1e1fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785bc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58944/0 (socket says 172.21.15.152:58944) 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb1e1fb640 1 -- 172.21.15.152:0/203683236 learned_addr learned my addr 172.21.15.152:0/203683236 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb1d1f9640 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b4410 0x562c785bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b3af0 0x562c785bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb1e1fb640 1 -- 172.21.15.152:0/203683236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b3af0 msgr2=0x562c785bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b3af0 0x562c785bbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb1e1fb640 1 -- 172.21.15.152:0/203683236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b4410 msgr2=0x562c785bc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b4410 0x562c785bc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.935+0000 7fcb1e1fb640 1 -- 172.21.15.152:0/203683236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7822b210 con 0x562c785becb0 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785bc580 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000abc0 tx=0x7fcb10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557331a625b5aa3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb017fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb017fa640 1 -- 172.21.15.152:0/203683236 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1001edc0 con 0x562c785becb0 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb229f6740 1 -- 172.21.15.152:0/203683236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb140319f0 con 0x562c785becb0 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb017fa640 1 -- 172.21.15.152:0/203683236 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fcb10004b20 con 0x562c785becb0 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb017fa640 1 -- 172.21.15.152:0/203683236 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcb10004d20 con 0x562c785becb0 2024-09-11T22:11:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb229f6740 10 client.17130 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb229f6740 1 -- 172.21.15.152:0/203683236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562c782f7620 con 0x562c785becb0 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb017fa640 1 -- 172.21.15.152:0/203683236 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb140319f0 con 0x562c785becb0 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb017fa640 1 -- 172.21.15.152:0/203683236 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fcb1000f040 con 0x562c785becb0 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb229f6740 10 client.17130 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb229f6740 10 client.17130 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb229f6740 20 client.17130 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb229f6740 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562c785cebc0 0x562c785d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb229f6740 4 client.17130 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.936+0000 7fcb229f6740 1 -- 172.21.15.152:0/203683236 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c78525a20 con 0x562c785cebc0 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.937+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562c785cebc0 0x562c785d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.937+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562c785cebc0 0x562c785d1030 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d355405db6b1400 server_cookie=2f814ecf66b5aa82 in_seq=0 out_seq=0 2024-09-11T22:11:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.937+0000 7fcb017fa640 10 client.17130 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb017fa640 1 -- 172.21.15.152:0/203683236 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c78525a20 con 0x562c785cebc0 2024-09-11T22:11:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb017fa640 10 client.17130 handle_command_reply: tid=0 2024-09-11T22:11:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 1 client.17130 shutdown 2024-09-11T22:11:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 1 -- 172.21.15.152:0/203683236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 msgr2=0x562c785bc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785bc580 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000abc0 tx=0x7fcb10004a40 comp rx=0 tx=0).stop 2024-09-11T22:11:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 1 -- 172.21.15.152:0/203683236 shutdown_connections 2024-09-11T22:11:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562c785cebc0 0x562c785d1030 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c785bc580 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb017fa640 0 client.17130 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b4410 0x562c785bc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 1 --2- 172.21.15.152:0/203683236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b3af0 0x562c785bbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 1 -- 172.21.15.152:0/203683236 >> 172.21.15.152:0/203683236 conn(0x562c785b0060 msgr2=0x562c785b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 1 -- 172.21.15.152:0/203683236 shutdown_connections 2024-09-11T22:11:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 1 -- 172.21.15.152:0/203683236 wait complete. 2024-09-11T22:11:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.938+0000 7fcb229f6740 20 client.17130 trim_cache size 0 max 16384 2024-09-11T22:11:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb229f6740 1 Processor -- start 2024-09-11T22:11:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb229f6740 1 -- start start 2024-09-11T22:11:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785b4410 0x562c785bc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785becb0 0x562c785c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb229f6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181b0210 con 0x562c785b4410 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb229f6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181adae0 con 0x562c785b3af0 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb229f6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181ab950 con 0x562c785becb0 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1d1f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785b4410 0x562c785bc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1d1f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785b4410 0x562c785bc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58950/0 (socket says 172.21.15.152:58950) 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1d1f9640 1 -- 172.21.15.152:0/731514116 learned_addr learned my addr 172.21.15.152:0/731514116 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/731514116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1d1f9640 1 -- 172.21.15.152:0/731514116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785becb0 msgr2=0x562c785c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/731514116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785becb0 0x562c785c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1d1f9640 1 --2- 172.21.15.152:0/731514116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785becb0 0x562c785c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1d1f9640 1 -- 172.21.15.152:0/731514116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 msgr2=0x562c785b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1d1f9640 1 --2- 172.21.15.152:0/731514116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1d1f9640 1 -- 172.21.15.152:0/731514116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c785b0cf0 con 0x562c785b4410 2024-09-11T22:11:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/731514116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785becb0 0x562c785c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/731514116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.953+0000 7fcb1d1f9640 1 --2- 172.21.15.152:0/731514116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785b4410 0x562c785bc3b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fcb08097f90 tx=0x7fcb0809b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb78791a56cf653e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb037fe640 1 -- 172.21.15.152:0/731514116 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08020040 con 0x562c785b4410 2024-09-11T22:11:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb037fe640 1 -- 172.21.15.152:0/731514116 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb08009de0 con 0x562c785b4410 2024-09-11T22:11:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb037fe640 1 -- 172.21.15.152:0/731514116 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb080d1350 con 0x562c785b4410 2024-09-11T22:11:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb229f6740 1 -- 172.21.15.152:0/731514116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785b4410 msgr2=0x562c785bc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb229f6740 1 --2- 172.21.15.152:0/731514116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785b4410 0x562c785bc3b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fcb08097f90 tx=0x7fcb0809b4c0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb229f6740 1 -- 172.21.15.152:0/731514116 shutdown_connections 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb229f6740 1 --2- 172.21.15.152:0/731514116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785becb0 0x562c785c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb229f6740 1 --2- 172.21.15.152:0/731514116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785b4410 0x562c785bc3b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb229f6740 1 --2- 172.21.15.152:0/731514116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb229f6740 1 -- 172.21.15.152:0/731514116 >> 172.21.15.152:0/731514116 conn(0x562c785b0060 msgr2=0x562c785bdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb229f6740 1 -- 172.21.15.152:0/731514116 shutdown_connections 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.954+0000 7fcb229f6740 1 -- 172.21.15.152:0/731514116 wait complete. 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.955+0000 7fcb229f6740 1 -- start start 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.955+0000 7fcb229f6740 1 Processor -- start 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b4410 0x562c785b8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb229f6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c7863c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb229f6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181abfa0 con 0x562c785becb0 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb229f6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181ad410 con 0x562c785b3af0 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb229f6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181ac670 con 0x562c785b4410 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb229f6740 10 client.0 _ll_register_callbacks cb 0x7fcb1000a840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb1e1fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c7863c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb1e1fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c7863c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58952/0 (socket says 172.21.15.152:58952) 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb1e1fb640 1 -- 172.21.15.152:0/1668085794 learned_addr learned my addr 172.21.15.152:0/1668085794 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb1d1f9640 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b4410 0x562c785b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb1e1fb640 1 -- 172.21.15.152:0/1668085794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b4410 msgr2=0x562c785b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b4410 0x562c785b8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb1e1fb640 1 -- 172.21.15.152:0/1668085794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 msgr2=0x562c785b7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb1e1fb640 1 -- 172.21.15.152:0/1668085794 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7863ceb0 con 0x562c785becb0 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb1e1fb640 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c7863c940 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000a750 tx=0x7fcb10009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36eda18f7a5ddd9f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb017fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb017fa640 1 -- 172.21.15.152:0/1668085794 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb100129a0 con 0x562c785becb0 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb229f6740 1 -- 172.21.15.152:0/1668085794 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb08009de0 con 0x562c785becb0 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb017fa640 1 -- 172.21.15.152:0/1668085794 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fcb10028bb0 con 0x562c785becb0 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb017fa640 1 -- 172.21.15.152:0/1668085794 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcb10028db0 con 0x562c785becb0 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb229f6740 10 client.17136 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.956+0000 7fcb229f6740 1 -- 172.21.15.152:0/1668085794 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562c7863e0d0 con 0x562c785becb0 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.957+0000 7fcb017fa640 1 -- 172.21.15.152:0/1668085794 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb08009de0 con 0x562c785becb0 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.957+0000 7fcb017fa640 1 -- 172.21.15.152:0/1668085794 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fcb10037030 con 0x562c785becb0 2024-09-11T22:11:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.957+0000 7fcb229f6740 10 client.17136 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.957+0000 7fcb229f6740 10 client.17136 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.957+0000 7fcb229f6740 20 client.17136 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.957+0000 7fcb229f6740 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562c7863e7b0 0x562c78640bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.957+0000 7fcb229f6740 4 client.17136 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:11:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.957+0000 7fcb229f6740 1 -- 172.21.15.152:0/1668085794 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562c7851fd70 con 0x562c7863e7b0 2024-09-11T22:11:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.957+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562c7863e7b0 0x562c78640bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.958+0000 7fcb017fa640 10 client.17136 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.957+0000 7fcb1d9fa640 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562c7863e7b0 0x562c78640bd0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a35dbf9832625e server_cookie=e038b6d455f70d69 in_seq=0 out_seq=0 2024-09-11T22:11:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.965+0000 7fcb017fa640 1 -- 172.21.15.152:0/1668085794 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562c7851fd70 con 0x562c7863e7b0 2024-09-11T22:11:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.965+0000 7fcb017fa640 10 client.17136 handle_command_reply: tid=0 2024-09-11T22:11:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.965+0000 7fcb229f6740 1 client.17136 shutdown 2024-09-11T22:11:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb229f6740 1 -- 172.21.15.152:0/1668085794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 msgr2=0x562c7863c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb229f6740 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c7863c940 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000a750 tx=0x7fcb10009960 comp rx=0 tx=0).stop 2024-09-11T22:11:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb229f6740 1 -- 172.21.15.152:0/1668085794 shutdown_connections 2024-09-11T22:11:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb229f6740 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562c7863e7b0 0x562c78640bd0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb229f6740 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c785becb0 0x562c7863c940 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb229f6740 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562c785b4410 0x562c785b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb017fa640 0 client.17136 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb229f6740 1 --2- 172.21.15.152:0/1668085794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c785b3af0 0x562c785b7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb229f6740 1 -- 172.21.15.152:0/1668085794 >> 172.21.15.152:0/1668085794 conn(0x562c785b0060 msgr2=0x562c785ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb229f6740 1 -- 172.21.15.152:0/1668085794 shutdown_connections 2024-09-11T22:11:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb229f6740 1 -- 172.21.15.152:0/1668085794 wait complete. 2024-09-11T22:11:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb229f6740 20 client.17136 trim_cache size 0 max 16384 2024-09-11T22:11:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:11:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:11:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:11:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:11:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/165819842 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcb040a2da0 msgr2=0x7fcb040a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb1fc5e640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcb040a2da0 0x7fcb040a5260 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009fd0 tx=0x7fcb10009600 comp rx=0 tx=0).stop 2024-09-11T22:11:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/165819842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb18102480 msgr2=0x7fcb18198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.966+0000 7fcb1fc5e640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb18102480 0x7fcb18198890 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800d950 tx=0x7fcb0800de10 comp rx=0 tx=0).stop 2024-09-11T22:11:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.967+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/165819842 shutdown_connections 2024-09-11T22:11:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.967+0000 7fcb1fc5e640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcb040a2da0 0x7fcb040a5260 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.967+0000 7fcb1fc5e640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb18107b80 0x7fcb1819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.967+0000 7fcb1fc5e640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb18102480 0x7fcb18198890 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.967+0000 7fcb1fc5e640 1 --2- 172.21.15.152:0/165819842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb18101ae0 0x7fcb18198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.967+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/165819842 >> 172.21.15.152:0/165819842 conn(0x7fcb180fd7e0 msgr2=0x7fcb180fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.967+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/165819842 shutdown_connections 2024-09-11T22:11:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:22.967+0000 7fcb1fc5e640 1 -- 172.21.15.152:0/165819842 wait complete. 2024-09-11T22:11:23.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:22 smithi179 ceph-mon[35603]: pgmap v217: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 953 op/s 2024-09-11T22:11:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:22 smithi193 ceph-mon[35545]: pgmap v217: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 953 op/s 2024-09-11T22:11:23.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:22 smithi152 ceph-mon[31188]: pgmap v217: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 953 op/s 2024-09-11T22:11:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:11:25.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:25 smithi179 ceph-mon[35603]: pgmap v218: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 15 MiB/s wr, 536 op/s 2024-09-11T22:11:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:25 smithi193 ceph-mon[35545]: pgmap v218: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 15 MiB/s wr, 536 op/s 2024-09-11T22:11:25.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:25 smithi152 ceph-mon[31188]: pgmap v218: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 15 MiB/s wr, 536 op/s 2024-09-11T22:11:27.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:27 smithi179 ceph-mon[35603]: pgmap v219: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 468 op/s 2024-09-11T22:11:27.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:27 smithi193 ceph-mon[35545]: pgmap v219: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 468 op/s 2024-09-11T22:11:27.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:27 smithi152 ceph-mon[31188]: pgmap v219: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 468 op/s 2024-09-11T22:11:29.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:29 smithi179 ceph-mon[35603]: pgmap v220: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 468 op/s 2024-09-11T22:11:29.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:29 smithi193 ceph-mon[35545]: pgmap v220: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 468 op/s 2024-09-11T22:11:29.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:29 smithi152 ceph-mon[31188]: pgmap v220: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 468 op/s 2024-09-11T22:11:29.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:11:31.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:31 smithi179 ceph-mon[35603]: pgmap v221: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 24 MiB/s wr, 1.39k op/s 2024-09-11T22:11:31.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:31 smithi193 ceph-mon[35545]: pgmap v221: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 24 MiB/s wr, 1.39k op/s 2024-09-11T22:11:31.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:31 smithi152 ceph-mon[31188]: pgmap v221: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 24 MiB/s wr, 1.39k op/s 2024-09-11T22:11:32.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:11:33.179 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:33.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:33 smithi152 ceph-mon[31188]: pgmap v222: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 1.22k op/s 2024-09-11T22:11:33.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:33 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:11:33.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:33 smithi179 ceph-mon[35603]: pgmap v222: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 1.22k op/s 2024-09-11T22:11:33.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:33 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:11:33.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:33 smithi193 ceph-mon[35545]: pgmap v222: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 1.22k op/s 2024-09-11T22:11:33.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:33 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:11:33.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 -- 172.21.15.152:0/3238022899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdccc100e20 msgr2=0x7fdccc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:33.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 --2- 172.21.15.152:0/3238022899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdccc100e20 0x7fdccc101200 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009900 tx=0x7fdcc002a480 comp rx=0 tx=0).stop 2024-09-11T22:11:33.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 -- 172.21.15.152:0/3238022899 shutdown_connections 2024-09-11T22:11:33.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 --2- 172.21.15.152:0/3238022899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdccc102ef0 0x7fdccc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 --2- 172.21.15.152:0/3238022899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdccc102570 0x7fdccc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 --2- 172.21.15.152:0/3238022899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdccc100e20 0x7fdccc101200 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 -- 172.21.15.152:0/3238022899 >> 172.21.15.152:0/3238022899 conn(0x7fdccc0fc7d0 msgr2=0x7fdccc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:33.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 -- 172.21.15.152:0/3238022899 shutdown_connections 2024-09-11T22:11:33.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 -- 172.21.15.152:0/3238022899 wait complete. 2024-09-11T22:11:33.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 Processor -- start 2024-09-11T22:11:33.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 -- start start 2024-09-11T22:11:33.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdccc100e20 0x7fdccc1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:33.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.643+0000 7fdcd2af5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdccc102570 0x7fdccc199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:33.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdcd2af5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdccc102ef0 0x7fdccc1a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:33.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdcd2af5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc110f50 con 0x7fdccc102570 2024-09-11T22:11:33.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdcd2af5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc110dd0 con 0x7fdccc100e20 2024-09-11T22:11:33.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdcd2af5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc1110d0 con 0x7fdccc102ef0 2024-09-11T22:11:33.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdccc102570 0x7fdccc199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:33.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdccc102570 0x7fdccc199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43488/0 (socket says 172.21.15.152:43488) 2024-09-11T22:11:33.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdccbfff640 1 -- 172.21.15.152:0/1821501601 learned_addr learned my addr 172.21.15.152:0/1821501601 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:33.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdcd1092640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdccc102ef0 0x7fdccc1a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:33.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdcd0891640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdccc100e20 0x7fdccc1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:33.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdccbfff640 1 -- 172.21.15.152:0/1821501601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdccc102ef0 msgr2=0x7fdccc1a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:33.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdccbfff640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdccc102ef0 0x7fdccc1a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdccbfff640 1 -- 172.21.15.152:0/1821501601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdccc100e20 msgr2=0x7fdccc1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:33.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdccbfff640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdccc100e20 0x7fdccc1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdccbfff640 1 -- 172.21.15.152:0/1821501601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc1a4980 con 0x7fdccc102570 2024-09-11T22:11:33.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdccbfff640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdccc102570 0x7fdccc199900 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800d950 tx=0x7fdcb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:33.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdcc9ffb640 1 -- 172.21.15.152:0/1821501601 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8017070 con 0x7fdccc102570 2024-09-11T22:11:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdcc9ffb640 1 -- 172.21.15.152:0/1821501601 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcb8009c30 con 0x7fdccc102570 2024-09-11T22:11:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdcc9ffb640 1 -- 172.21.15.152:0/1821501601 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800f6b0 con 0x7fdccc102570 2024-09-11T22:11:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.644+0000 7fdcd2af5640 1 -- 172.21.15.152:0/1821501601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc1a4b50 con 0x7fdccc102570 2024-09-11T22:11:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.645+0000 7fdcd2af5640 1 -- 172.21.15.152:0/1821501601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc1a5090 con 0x7fdccc102570 2024-09-11T22:11:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.646+0000 7fdcd2af5640 1 -- 172.21.15.152:0/1821501601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdccc101200 con 0x7fdccc102570 2024-09-11T22:11:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.647+0000 7fdcc9ffb640 1 -- 172.21.15.152:0/1821501601 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fdcb80109d0 con 0x7fdccc102570 2024-09-11T22:11:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.648+0000 7fdcc9ffb640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdcbc0a2d70 0x7fdcbc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.648+0000 7fdcd0891640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdcbc0a2d70 0x7fdcbc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.648+0000 7fdcc9ffb640 1 -- 172.21.15.152:0/1821501601 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fdcb80ceff0 con 0x7fdccc102570 2024-09-11T22:11:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.648+0000 7fdcd0891640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdcbc0a2d70 0x7fdcbc0a5230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009230 tx=0x7fdcc00058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.652+0000 7fdcc9ffb640 1 -- 172.21.15.152:0/1821501601 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdcb8009de0 con 0x7fdccc102570 2024-09-11T22:11:33.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.883+0000 7fdcd2af5640 1 -- 172.21.15.152:0/1821501601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdccc109090 con 0x7fdccc102570 2024-09-11T22:11:33.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.884+0000 7fdcc9ffb640 1 -- 172.21.15.152:0/1821501601 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7fdcb809b500 con 0x7fdccc102570 2024-09-11T22:11:33.885 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:11:33.885 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:11:33.885 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:11:33.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 -- 172.21.15.152:0/1821501601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdcbc0a2d70 msgr2=0x7fdcbc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:33.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdcbc0a2d70 0x7fdcbc0a5230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009230 tx=0x7fdcc00058d0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 -- 172.21.15.152:0/1821501601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdccc102570 msgr2=0x7fdccc199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:33.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdccc102570 0x7fdccc199900 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800d950 tx=0x7fdcb800de10 comp rx=0 tx=0).stop 2024-09-11T22:11:33.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 -- 172.21.15.152:0/1821501601 shutdown_connections 2024-09-11T22:11:33.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdcbc0a2d70 0x7fdcbc0a5230 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdccc102ef0 0x7fdccc1a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdccc102570 0x7fdccc199900 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 --2- 172.21.15.152:0/1821501601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdccc100e20 0x7fdccc1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 -- 172.21.15.152:0/1821501601 >> 172.21.15.152:0/1821501601 conn(0x7fdccc0fc7d0 msgr2=0x7fdccc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:33.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 -- 172.21.15.152:0/1821501601 shutdown_connections 2024-09-11T22:11:33.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:33.887+0000 7fdcd2af5640 1 -- 172.21.15.152:0/1821501601 wait complete. 2024-09-11T22:11:34.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:34 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:11:34.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:34 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:11:34.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:34 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:11:34.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:34 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1821501601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:34.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:34 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:11:34.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:34 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:11:34.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:34 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:11:34.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:34 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1821501601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:34.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:34 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:11:34.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:34 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:11:34.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:34 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:11:34.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:34 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1821501601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:34.625 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 7d735a34 --release --await' 2024-09-11T22:11:34.625 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 7d735a34 --release --await 2024-09-11T22:11:34.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:11:34.880 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:35.284 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:35 smithi152 ceph-mon[31188]: pgmap v223: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 21 MiB/s wr, 1.23k op/s 2024-09-11T22:11:35.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.371+0000 7fe9cfb56640 1 -- 172.21.15.152:0/4222419542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9c8106f10 msgr2=0x7fe9c810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.371+0000 7fe9cfb56640 1 --2- 172.21.15.152:0/4222419542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9c8106f10 0x7fe9c810ea90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009ca0 tx=0x7fe9c002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.371+0000 7fe9cfb56640 1 -- 172.21.15.152:0/4222419542 shutdown_connections 2024-09-11T22:11:35.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.371+0000 7fe9cfb56640 1 --2- 172.21.15.152:0/4222419542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9c8106f10 0x7fe9c810ea90 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.371+0000 7fe9cfb56640 1 --2- 172.21.15.152:0/4222419542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9c8102790 0x7fe9c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.371+0000 7fe9cfb56640 1 --2- 172.21.15.152:0/4222419542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c8101de0 0x7fe9c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.371+0000 7fe9cfb56640 1 -- 172.21.15.152:0/4222419542 >> 172.21.15.152:0/4222419542 conn(0x7fe9c80fd8c0 msgr2=0x7fe9c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:35.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.371+0000 7fe9cfb56640 1 -- 172.21.15.152:0/4222419542 shutdown_connections 2024-09-11T22:11:35.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.371+0000 7fe9cfb56640 1 -- 172.21.15.152:0/4222419542 wait complete. 2024-09-11T22:11:35.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.372+0000 7fe9cfb56640 1 Processor -- start 2024-09-11T22:11:35.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.372+0000 7fe9cfb56640 1 -- start start 2024-09-11T22:11:35.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.372+0000 7fe9cfb56640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9c8101de0 0x7fe9c81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.372+0000 7fe9cfb56640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c8102790 0x7fe9c8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.372+0000 7fe9cfb56640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9c8106f10 0x7fe9c819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.372+0000 7fe9cfb56640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c8111f70 con 0x7fe9c8106f10 2024-09-11T22:11:35.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.372+0000 7fe9cfb56640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c8111df0 con 0x7fe9c8102790 2024-09-11T22:11:35.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.372+0000 7fe9cfb56640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81120f0 con 0x7fe9c8101de0 2024-09-11T22:11:35.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.372+0000 7fe9ce0f3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9c8106f10 0x7fe9c819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.372+0000 7fe9ce0f3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9c8106f10 0x7fe9c819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43514/0 (socket says 172.21.15.152:43514) 2024-09-11T22:11:35.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.372+0000 7fe9ce0f3640 1 -- 172.21.15.152:0/3125507571 learned_addr learned my addr 172.21.15.152:0/3125507571 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:35.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c8102790 0x7fe9c8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9cd8f2640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9c8101de0 0x7fe9c81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9ce0f3640 1 -- 172.21.15.152:0/3125507571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9c8101de0 msgr2=0x7fe9c81983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9ce0f3640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9c8101de0 0x7fe9c81983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9ce0f3640 1 -- 172.21.15.152:0/3125507571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c8102790 msgr2=0x7fe9c8198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9ce0f3640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c8102790 0x7fe9c8198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9ce0f3640 1 -- 172.21.15.152:0/3125507571 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c819d380 con 0x7fe9c8106f10 2024-09-11T22:11:35.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c8102790 0x7fe9c8198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:35.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9ce0f3640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9c8106f10 0x7fe9c819cca0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0031a20 tx=0x7fe9c0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:35.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9beffd640 1 -- 172.21.15.152:0/3125507571 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0003c30 con 0x7fe9c8106f10 2024-09-11T22:11:35.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9beffd640 1 -- 172.21.15.152:0/3125507571 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9c0003dd0 con 0x7fe9c8106f10 2024-09-11T22:11:35.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9cfb56640 1 -- 172.21.15.152:0/3125507571 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c819d610 con 0x7fe9c8106f10 2024-09-11T22:11:35.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9beffd640 1 -- 172.21.15.152:0/3125507571 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c002fcf0 con 0x7fe9c8106f10 2024-09-11T22:11:35.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.373+0000 7fe9cfb56640 1 -- 172.21.15.152:0/3125507571 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c81a4f50 con 0x7fe9c8106f10 2024-09-11T22:11:35.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.375+0000 7fe9beffd640 1 -- 172.21.15.152:0/3125507571 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe9c0004050 con 0x7fe9c8106f10 2024-09-11T22:11:35.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.376+0000 7fe9d1f2f740 1 Processor -- start 2024-09-11T22:11:35.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.376+0000 7fe9d1f2f740 1 -- start start 2024-09-11T22:11:35.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.376+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 0x564e33815440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.376+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815980 0x564e3381fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.376+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 0x564e33822630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.376+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564e3377a620 con 0x564e33820240 2024-09-11T22:11:35.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.376+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e33721e50 con 0x564e33815060 2024-09-11T22:11:35.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.376+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564e337765e0 con 0x564e33815980 2024-09-11T22:11:35.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.376+0000 7fe9beffd640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe9b40a2d70 0x7fe9b40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.376+0000 7fe9cd0f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 0x564e33815440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9cd0f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 0x564e33815440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54956/0 (socket says 172.21.15.152:54956) 2024-09-11T22:11:35.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/3295699469 learned_addr learned my addr 172.21.15.152:0/3295699469 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:35.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/3295699469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 0x564e33822630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9ce0f3640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe9b40a2d70 0x7fe9b40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9cd8f2640 1 --2- 172.21.15.152:0/3295699469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815980 0x564e3381fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9beffd640 1 -- 172.21.15.152:0/3125507571 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fe9c00f06b0 con 0x7fe9c8106f10 2024-09-11T22:11:35.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/3295699469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815980 msgr2=0x564e3381fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:35.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/3295699469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815980 0x564e3381fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/3295699469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 msgr2=0x564e33822630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:35.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/3295699469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 0x564e33822630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/3295699469 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e33712d40 con 0x564e33815060 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/3295699469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 0x564e33815440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80149a0 tx=0x7fe9b800c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aecaeeee5ef3b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9ce0f3640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe9b40a2d70 0x7fe9b40a5230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00319f0 tx=0x7fe9c0033040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9b3fff640 1 -- 172.21.15.152:0/3295699469 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80142d0 con 0x564e33815060 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9b3fff640 1 -- 172.21.15.152:0/3295699469 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b800fc40 con 0x564e33815060 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.377+0000 7fe9b3fff640 1 -- 172.21.15.152:0/3295699469 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8012ad0 con 0x564e33815060 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.378+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/3295699469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 msgr2=0x564e33815440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.378+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/3295699469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 0x564e33815440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80149a0 tx=0x7fe9b800c4f0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.378+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/3295699469 shutdown_connections 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.378+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/3295699469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 0x564e33822630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.378+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/3295699469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815980 0x564e3381fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.378+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/3295699469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 0x564e33815440 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.378+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/3295699469 >> 172.21.15.152:0/3295699469 conn(0x564e338115f0 msgr2=0x564e338119d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.378+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/3295699469 shutdown_connections 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.378+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/3295699469 wait complete. 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9d1f2f740 1 -- start start 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9d1f2f740 1 Processor -- start 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815060 0x564e3381d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815980 0x564e3381d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33820240 0x564e3381dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564e33822e60 con 0x564e33815980 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e33702f10 con 0x564e33820240 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564e33822fe0 con 0x564e33815060 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9d1f2f740 10 client.0 _ll_register_callbacks cb 0x564e33726db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:35.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9cd8f2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815980 0x564e3381d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9cd8f2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815980 0x564e3381d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43534/0 (socket says 172.21.15.152:43534) 2024-09-11T22:11:35.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9cd8f2640 1 -- 172.21.15.152:0/1857420801 learned_addr learned my addr 172.21.15.152:0/1857420801 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:35.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.379+0000 7fe9cd0f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815060 0x564e3381d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33820240 0x564e3381dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9cd8f2640 1 -- 172.21.15.152:0/1857420801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815060 msgr2=0x564e3381d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:35.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9cd8f2640 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815060 0x564e3381d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9cd8f2640 1 -- 172.21.15.152:0/1857420801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33820240 msgr2=0x564e3381dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:35.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9cd8f2640 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33820240 0x564e3381dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9cd8f2640 1 -- 172.21.15.152:0/1857420801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e33489580 con 0x564e33815980 2024-09-11T22:11:35.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33820240 0x564e3381dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9cd8f2640 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815980 0x564e3381d690 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400ba20 tx=0x7fe9c400bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576ab26fde2844a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9b17fa640 1 -- 172.21.15.152:0/1857420801 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c401b640 con 0x564e33815980 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9b17fa640 1 -- 172.21.15.152:0/1857420801 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fe9c401b7e0 con 0x564e33815980 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/1857420801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b800fc40 con 0x564e33815980 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9b17fa640 1 -- 172.21.15.152:0/1857420801 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe9c401b9e0 con 0x564e33815980 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9d1f2f740 10 client.17154 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/1857420801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e33553960 con 0x564e33815980 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.380+0000 7fe9b17fa640 1 -- 172.21.15.152:0/1857420801 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b800fc40 con 0x564e33815980 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.381+0000 7fe9b17fa640 1 -- 172.21.15.152:0/1857420801 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe9c4019020 con 0x564e33815980 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.381+0000 7fe9d1f2f740 10 client.17154 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.381+0000 7fe9d1f2f740 10 client.17154 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.381+0000 7fe9d1f2f740 20 client.17154 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.381+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e338342f0 0x564e33836710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.381+0000 7fe9d1f2f740 4 client.17154 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.381+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/1857420801 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e33787b90 con 0x564e338342f0 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.381+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e338342f0 0x564e33836710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.381+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e338342f0 0x564e33836710 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2762d57c75d11730 server_cookie=e4990d3b6606c0ac in_seq=0 out_seq=0 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.381+0000 7fe9b17fa640 10 client.17154 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9b17fa640 1 -- 172.21.15.152:0/1857420801 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e33787b90 con 0x564e338342f0 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9b17fa640 10 client.17154 handle_command_reply: tid=0 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9d1f2f740 1 client.17154 shutdown 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/1857420801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815980 msgr2=0x564e3381d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815980 0x564e3381d690 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400ba20 tx=0x7fe9c400bee0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/1857420801 shutdown_connections 2024-09-11T22:11:35.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e338342f0 0x564e33836710 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33820240 0x564e3381dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815980 0x564e3381d690 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/1857420801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815060 0x564e3381d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9b17fa640 0 client.17154 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:35.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.382+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/1857420801 >> 172.21.15.152:0/1857420801 conn(0x564e338115f0 msgr2=0x564e338172d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:35.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.383+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/1857420801 shutdown_connections 2024-09-11T22:11:35.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.383+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/1857420801 wait complete. 2024-09-11T22:11:35.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.383+0000 7fe9d1f2f740 20 client.17154 trim_cache size 0 max 16384 2024-09-11T22:11:35.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.399+0000 7fe9d1f2f740 1 Processor -- start 2024-09-11T22:11:35.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9d1f2f740 1 -- start start 2024-09-11T22:11:35.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815060 0x564e33810640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815980 0x564e3383bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33820240 0x564e3383c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81ae000 con 0x564e33815060 2024-09-11T22:11:35.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81ab8d0 con 0x564e33815980 2024-09-11T22:11:35.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81a9740 con 0x564e33820240 2024-09-11T22:11:35.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9cd0f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815060 0x564e33810640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9cd0f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815060 0x564e33810640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43536/0 (socket says 172.21.15.152:43536) 2024-09-11T22:11:35.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/56219337 learned_addr learned my addr 172.21.15.152:0/56219337 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:35.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/56219337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33820240 0x564e3383c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9cd8f2640 1 --2- 172.21.15.152:0/56219337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815980 0x564e3383bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/56219337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33820240 msgr2=0x564e3383c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:35.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/56219337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33820240 0x564e3383c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/56219337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815980 msgr2=0x564e3383bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:35.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/56219337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815980 0x564e3383bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/56219337 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e33811090 con 0x564e33815060 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/56219337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815060 0x564e33810640 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800c4c0 tx=0x7fe9b8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29463ac0de99eae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.400+0000 7fe9b37fe640 1 -- 172.21.15.152:0/56219337 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b802b040 con 0x564e33815060 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9b37fe640 1 -- 172.21.15.152:0/56219337 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b8005500 con 0x564e33815060 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9b37fe640 1 -- 172.21.15.152:0/56219337 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800f730 con 0x564e33815060 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/56219337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815060 msgr2=0x564e33810640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/56219337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815060 0x564e33810640 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800c4c0 tx=0x7fe9b8016040 comp rx=0 tx=0).stop 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/56219337 shutdown_connections 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/56219337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33820240 0x564e3383c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/56219337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815980 0x564e3383bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/56219337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33815060 0x564e33810640 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/56219337 >> 172.21.15.152:0/56219337 conn(0x564e338115f0 msgr2=0x564e3380ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:35.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/56219337 shutdown_connections 2024-09-11T22:11:35.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/56219337 wait complete. 2024-09-11T22:11:35.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.401+0000 7fe9d1f2f740 1 -- start start 2024-09-11T22:11:35.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9d1f2f740 1 Processor -- start 2024-09-11T22:11:35.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 0x564e33898220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815980 0x564e33898760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9d1f2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 0x564e33824800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81a9d90 con 0x564e33820240 2024-09-11T22:11:35.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81ab200 con 0x564e33815060 2024-09-11T22:11:35.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9d1f2f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81aa460 con 0x564e33815980 2024-09-11T22:11:35.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9d1f2f740 10 client.0 _ll_register_callbacks cb 0x7fe9c40044c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9cd0f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 0x564e33824800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9cd0f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 0x564e33824800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43546/0 (socket says 172.21.15.152:43546) 2024-09-11T22:11:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/959985869 learned_addr learned my addr 172.21.15.152:0/959985869 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9cd8f2640 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815980 0x564e33898760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 0x564e33898220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/959985869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815980 msgr2=0x564e33898760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.402+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815980 0x564e33898760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/959985869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 msgr2=0x564e33898220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 0x564e33898220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9cd0f1640 1 -- 172.21.15.152:0/959985869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e33824ef0 con 0x564e33820240 2024-09-11T22:11:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9cd8f2640 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815980 0x564e33898760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9cd0f1640 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 0x564e33824800 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8012c20 tx=0x7fe9b8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a316afedc0bd46b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9b17fa640 1 -- 172.21.15.152:0/959985869 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8014390 con 0x564e33820240 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9b17fa640 1 -- 172.21.15.152:0/959985869 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fe9b8012670 con 0x564e33820240 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/959985869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b8005500 con 0x564e33820240 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9b17fa640 1 -- 172.21.15.152:0/959985869 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe9b8012870 con 0x564e33820240 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9d1f2f740 10 client.17160 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/959985869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e3389fac0 con 0x564e33820240 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9b17fa640 1 -- 172.21.15.152:0/959985869 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b8005500 con 0x564e33820240 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9b17fa640 1 -- 172.21.15.152:0/959985869 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe9b802e570 con 0x564e33820240 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9d1f2f740 10 client.17160 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9d1f2f740 10 client.17160 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9d1f2f740 20 client.17160 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:35.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e3389fee0 0x564e338a22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9d1f2f740 4 client.17160 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7d735a34", "release": true, "await": true}] 2024-09-11T22:11:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.403+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/959985869 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7d735a34", "release": true, "await": true}) -- 0x564e337820a0 con 0x564e3389fee0 2024-09-11T22:11:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.404+0000 7fe9cd8f2640 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e3389fee0 0x564e338a22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.404+0000 7fe9b17fa640 10 client.17160 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.404+0000 7fe9cd8f2640 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e3389fee0 0x564e338a22d0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ae1510c119bf549 server_cookie=b079e31ae2753904 in_seq=0 out_seq=0 2024-09-11T22:11:35.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.462+0000 7fe9b17fa640 1 -- 172.21.15.152:0/959985869 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564e337820a0 con 0x564e3389fee0 2024-09-11T22:11:35.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.462+0000 7fe9b17fa640 10 client.17160 handle_command_reply: tid=0 2024-09-11T22:11:35.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.462+0000 7fe9d1f2f740 1 client.17160 shutdown 2024-09-11T22:11:35.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.462+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/959985869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 msgr2=0x564e33824800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.462+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 0x564e33824800 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8012c20 tx=0x7fe9b8000bc0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.463+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/959985869 shutdown_connections 2024-09-11T22:11:35.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.463+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e3389fee0 0x564e338a22d0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.463+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e33820240 0x564e33824800 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.463+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e33815980 0x564e33898760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.463+0000 7fe9d1f2f740 1 --2- 172.21.15.152:0/959985869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e33815060 0x564e33898220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.463+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/959985869 >> 172.21.15.152:0/959985869 conn(0x564e338115f0 msgr2=0x564e338172d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:35.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.463+0000 7fe9b17fa640 0 client.17160 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:35.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.463+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/959985869 shutdown_connections 2024-09-11T22:11:35.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.463+0000 7fe9d1f2f740 1 -- 172.21.15.152:0/959985869 wait complete. 2024-09-11T22:11:35.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.463+0000 7fe9d1f2f740 20 client.17160 trim_cache size 0 max 16384 2024-09-11T22:11:35.466 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:11:35.466 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:11:35.466 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:11:35.466 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 28, 2024-09-11T22:11:35.466 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: "7d735a34": { 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 28, 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 136.6, 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:11:35.467 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:11:35.468 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:11:35.468 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:11:35.468 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:11:35.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:35.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:35.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:35.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:35.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:35.468 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:11:35.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.465+0000 7fe9cfb56640 1 -- 172.21.15.152:0/3125507571 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe9b40a2d70 msgr2=0x7fe9b40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.465+0000 7fe9cfb56640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe9b40a2d70 0x7fe9b40a5230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00319f0 tx=0x7fe9c0033040 comp rx=0 tx=0).stop 2024-09-11T22:11:35.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.465+0000 7fe9cfb56640 1 -- 172.21.15.152:0/3125507571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9c8106f10 msgr2=0x7fe9c819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.465+0000 7fe9cfb56640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9c8106f10 0x7fe9c819cca0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0031a20 tx=0x7fe9c0031a50 comp rx=0 tx=0).stop 2024-09-11T22:11:35.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.466+0000 7fe9cfb56640 1 -- 172.21.15.152:0/3125507571 shutdown_connections 2024-09-11T22:11:35.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.466+0000 7fe9cfb56640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe9b40a2d70 0x7fe9b40a5230 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.466+0000 7fe9cfb56640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9c8106f10 0x7fe9c819cca0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.466+0000 7fe9cfb56640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c8102790 0x7fe9c8198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.466+0000 7fe9cfb56640 1 --2- 172.21.15.152:0/3125507571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9c8101de0 0x7fe9c81983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.466+0000 7fe9cfb56640 1 -- 172.21.15.152:0/3125507571 >> 172.21.15.152:0/3125507571 conn(0x7fe9c80fd8c0 msgr2=0x7fe9c80fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:35.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.466+0000 7fe9cfb56640 1 -- 172.21.15.152:0/3125507571 shutdown_connections 2024-09-11T22:11:35.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:35.466+0000 7fe9cfb56640 1 -- 172.21.15.152:0/3125507571 wait complete. 2024-09-11T22:11:35.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:35 smithi179 ceph-mon[35603]: pgmap v223: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 21 MiB/s wr, 1.23k op/s 2024-09-11T22:11:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:35 smithi193 ceph-mon[35545]: pgmap v223: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 21 MiB/s wr, 1.23k op/s 2024-09-11T22:11:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.096+0000 7fdef7fff640 1 -- 172.21.15.152:0/1302320251 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc030920 con 0x7fdf001069e0 2024-09-11T22:11:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.096+0000 7fdf075d8640 1 -- 172.21.15.152:0/1302320251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf001069e0 msgr2=0x7fdf00106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.096+0000 7fdf075d8640 1 --2- 172.21.15.152:0/1302320251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf001069e0 0x7fdf00106dc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009860 tx=0x7fdefc02a360 comp rx=0 tx=0).stop 2024-09-11T22:11:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.096+0000 7fdf075d8640 1 -- 172.21.15.152:0/1302320251 shutdown_connections 2024-09-11T22:11:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.096+0000 7fdf075d8640 1 --2- 172.21.15.152:0/1302320251 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf00101370 0x7fdf0010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.096+0000 7fdf075d8640 1 --2- 172.21.15.152:0/1302320251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf001009d0 0x7fdf00100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.096+0000 7fdf075d8640 1 --2- 172.21.15.152:0/1302320251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf001069e0 0x7fdf00106dc0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.096+0000 7fdf075d8640 1 -- 172.21.15.152:0/1302320251 >> 172.21.15.152:0/1302320251 conn(0x7fdf000fc6b0 msgr2=0x7fdf000fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.097+0000 7fdf075d8640 1 -- 172.21.15.152:0/1302320251 shutdown_connections 2024-09-11T22:11:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.097+0000 7fdf075d8640 1 -- 172.21.15.152:0/1302320251 wait complete. 2024-09-11T22:11:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.097+0000 7fdf075d8640 1 Processor -- start 2024-09-11T22:11:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf075d8640 1 -- start start 2024-09-11T22:11:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf075d8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf001009d0 0x7fdf0019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf075d8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf00101370 0x7fdf0019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf075d8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf001069e0 0x7fdf0010b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf075d8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf00111f60 con 0x7fdf00101370 2024-09-11T22:11:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf075d8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf00111de0 con 0x7fdf001009d0 2024-09-11T22:11:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf075d8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf001120e0 con 0x7fdf001069e0 2024-09-11T22:11:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf04b73640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf00101370 0x7fdf0019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf04b73640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf00101370 0x7fdf0019f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43554/0 (socket says 172.21.15.152:43554) 2024-09-11T22:11:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf05b75640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf001069e0 0x7fdf0010b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf04b73640 1 -- 172.21.15.152:0/2892147009 learned_addr learned my addr 172.21.15.152:0/2892147009 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.098+0000 7fdf05374640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf001009d0 0x7fdf0019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.099+0000 7fdf04b73640 1 -- 172.21.15.152:0/2892147009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf001069e0 msgr2=0x7fdf0010b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.099+0000 7fdf04b73640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf001069e0 0x7fdf0010b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.099+0000 7fdf04b73640 1 -- 172.21.15.152:0/2892147009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf001009d0 msgr2=0x7fdf0019efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.099+0000 7fdf04b73640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf001009d0 0x7fdf0019efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.099+0000 7fdf04b73640 1 -- 172.21.15.152:0/2892147009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0010c1f0 con 0x7fdf00101370 2024-09-11T22:11:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.099+0000 7fdf04b73640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf00101370 0x7fdf0019f520 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdef000e9c0 tx=0x7fdef000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.099+0000 7fdef67fc640 1 -- 172.21.15.152:0/2892147009 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef000cde0 con 0x7fdf00101370 2024-09-11T22:11:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.099+0000 7fdef67fc640 1 -- 172.21.15.152:0/2892147009 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdef00035f0 con 0x7fdf00101370 2024-09-11T22:11:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.099+0000 7fdf075d8640 1 -- 172.21.15.152:0/2892147009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0010c4e0 con 0x7fdf00101370 2024-09-11T22:11:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.099+0000 7fdef67fc640 1 -- 172.21.15.152:0/2892147009 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0010690 con 0x7fdf00101370 2024-09-11T22:11:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.099+0000 7fdf075d8640 1 -- 172.21.15.152:0/2892147009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0019ac70 con 0x7fdf00101370 2024-09-11T22:11:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.102+0000 7fdf0a449740 1 Processor -- start 2024-09-11T22:11:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.102+0000 7fdf0a449740 1 -- start start 2024-09-11T22:11:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdef67fc640 1 -- 172.21.15.152:0/2892147009 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fdef00037a0 con 0x7fdf00101370 2024-09-11T22:11:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c3410 0x5628c36cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf0a449740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5628c36272f0 con 0x5628c36c3410 2024-09-11T22:11:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf0a449740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5628c35cf270 con 0x5628c36cdcb0 2024-09-11T22:11:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf0a449740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5628c36232b0 con 0x5628c36c2af0 2024-09-11T22:11:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf05b75640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf04b73640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf05374640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c3410 0x5628c36cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf04b73640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36d00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55000/0 (socket says 172.21.15.152:55000) 2024-09-11T22:11:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf05b75640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54686/0 (socket says 172.21.15.152:54686) 2024-09-11T22:11:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf04b73640 1 -- 172.21.15.152:0/3904613922 learned_addr learned my addr 172.21.15.152:0/3904613922 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.103+0000 7fdf05374640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c3410 0x5628c36cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43566/0 (socket says 172.21.15.152:43566) 2024-09-11T22:11:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.104+0000 7fdf05b75640 1 -- 172.21.15.152:0/3904613922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 msgr2=0x5628c36d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.104+0000 7fdf05b75640 1 --2- 172.21.15.152:0/3904613922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.104+0000 7fdf05b75640 1 -- 172.21.15.152:0/3904613922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c3410 msgr2=0x5628c36cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.104+0000 7fdf05b75640 1 --2- 172.21.15.152:0/3904613922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c3410 0x5628c36cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.104+0000 7fdf05b75640 1 -- 172.21.15.152:0/3904613922 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628c35ce340 con 0x5628c36c2af0 2024-09-11T22:11:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.104+0000 7fdf05b75640 1 --2- 172.21.15.152:0/3904613922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36c2ed0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009f00 tx=0x7fdef8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d335be030dc7df01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.104+0000 7fdef67fc640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdeec0a2f50 0x7fdeec0a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdeeb7fe640 1 -- 172.21.15.152:0/3904613922 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8004d20 con 0x5628c36c2af0 2024-09-11T22:11:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdeeb7fe640 1 -- 172.21.15.152:0/3904613922 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdef8004050 con 0x5628c36c2af0 2024-09-11T22:11:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdeeb7fe640 1 -- 172.21.15.152:0/3904613922 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8005280 con 0x5628c36c2af0 2024-09-11T22:11:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdf05374640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdeec0a2f50 0x7fdeec0a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdef67fc640 1 -- 172.21.15.152:0/2892147009 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fdef00cf700 con 0x7fdf00101370 2024-09-11T22:11:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdf0a449740 1 -- 172.21.15.152:0/3904613922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 msgr2=0x5628c36c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdf0a449740 1 --2- 172.21.15.152:0/3904613922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36c2ed0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009f00 tx=0x7fdef8011810 comp rx=0 tx=0).stop 2024-09-11T22:11:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdf05374640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdeec0a2f50 0x7fdeec0a5410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdefc02a950 tx=0x7fdefc02a860 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdf0a449740 1 -- 172.21.15.152:0/3904613922 shutdown_connections 2024-09-11T22:11:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdf0a449740 1 --2- 172.21.15.152:0/3904613922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdf0a449740 1 --2- 172.21.15.152:0/3904613922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c3410 0x5628c36cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdf0a449740 1 --2- 172.21.15.152:0/3904613922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36c2ed0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.105+0000 7fdf0a449740 1 -- 172.21.15.152:0/3904613922 >> 172.21.15.152:0/3904613922 conn(0x5628c36bf060 msgr2=0x5628c36bf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.106+0000 7fdf0a449740 1 -- 172.21.15.152:0/3904613922 shutdown_connections 2024-09-11T22:11:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.106+0000 7fdf0a449740 1 -- 172.21.15.152:0/3904613922 wait complete. 2024-09-11T22:11:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.106+0000 7fdf0a449740 1 -- start start 2024-09-11T22:11:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.106+0000 7fdf0a449740 1 Processor -- start 2024-09-11T22:11:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c2af0 0x5628c36cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c3410 0x5628c36cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf0a449740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5628c36d0880 con 0x5628c36c2af0 2024-09-11T22:11:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf0a449740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5628c35b0290 con 0x5628c36cdcb0 2024-09-11T22:11:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf0a449740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5628c36d0a00 con 0x5628c36c3410 2024-09-11T22:11:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf05374640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c2af0 0x5628c36cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf0a449740 10 client.0 _ll_register_callbacks cb 0x5628c35e1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf05b75640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf05374640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c2af0 0x5628c36cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43576/0 (socket says 172.21.15.152:43576) 2024-09-11T22:11:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf05b75640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55002/0 (socket says 172.21.15.152:55002) 2024-09-11T22:11:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf05374640 1 -- 172.21.15.152:0/1101140447 learned_addr learned my addr 172.21.15.152:0/1101140447 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf04b73640 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c3410 0x5628c36cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf05b75640 1 -- 172.21.15.152:0/1101140447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c3410 msgr2=0x5628c36cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf05b75640 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c3410 0x5628c36cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf05b75640 1 -- 172.21.15.152:0/1101140447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c2af0 msgr2=0x5628c36cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf05b75640 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c2af0 0x5628c36cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.107+0000 7fdf05b75640 1 -- 172.21.15.152:0/1101140447 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628c333a210 con 0x5628c36cdcb0 2024-09-11T22:11:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.109+0000 7fdf05b75640 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36cb670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009f00 tx=0x7fdef8003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18ace3089a2754eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.109+0000 7fdee8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:11:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.109+0000 7fdee8ff9640 1 -- 172.21.15.152:0/1101140447 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8029020 con 0x5628c36cdcb0 2024-09-11T22:11:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.109+0000 7fdf0a449740 1 -- 172.21.15.152:0/1101140447 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdef8004050 con 0x5628c36cdcb0 2024-09-11T22:11:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdee8ff9640 1 -- 172.21.15.152:0/1101140447 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fdef8004610 con 0x5628c36cdcb0 2024-09-11T22:11:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdee8ff9640 1 -- 172.21.15.152:0/1101140447 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdef8034050 con 0x5628c36cdcb0 2024-09-11T22:11:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdf0a449740 10 client.26582 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdf0a449740 1 -- 172.21.15.152:0/1101140447 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5628c3406620 con 0x5628c36cdcb0 2024-09-11T22:11:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdee8ff9640 1 -- 172.21.15.152:0/1101140447 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdef8004050 con 0x5628c36cdcb0 2024-09-11T22:11:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdee8ff9640 1 -- 172.21.15.152:0/1101140447 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fdef8019680 con 0x5628c36cdcb0 2024-09-11T22:11:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdf0a449740 10 client.26582 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdf0a449740 10 client.26582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdf0a449740 20 client.26582 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdf0a449740 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5628c36ddc00 0x5628c36dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdf0a449740 4 client.26582 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.110+0000 7fdf0a449740 1 -- 172.21.15.152:0/1101140447 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628c3634a20 con 0x5628c36ddc00 2024-09-11T22:11:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.111+0000 7fdf05374640 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5628c36ddc00 0x5628c36dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.111+0000 7fdf05374640 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5628c36ddc00 0x5628c36dfff0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbf5e5ff69c9ac78 server_cookie=bc6c002b3b511d8a in_seq=0 out_seq=0 2024-09-11T22:11:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.111+0000 7fdee8ff9640 10 client.26582 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.112+0000 7fdee8ff9640 1 -- 172.21.15.152:0/1101140447 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628c3634a20 con 0x5628c36ddc00 2024-09-11T22:11:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.112+0000 7fdee8ff9640 10 client.26582 handle_command_reply: tid=0 2024-09-11T22:11:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.112+0000 7fdf0a449740 1 client.26582 shutdown 2024-09-11T22:11:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.112+0000 7fdf0a449740 1 -- 172.21.15.152:0/1101140447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 msgr2=0x5628c36cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.112+0000 7fdf0a449740 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36cb670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009f00 tx=0x7fdef8003ce0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.112+0000 7fdf0a449740 1 -- 172.21.15.152:0/1101140447 shutdown_connections 2024-09-11T22:11:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.112+0000 7fdf0a449740 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5628c36ddc00 0x5628c36dfff0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.112+0000 7fdee8ff9640 0 client.26582 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.112+0000 7fdf0a449740 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36cb670 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.112+0000 7fdf0a449740 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c3410 0x5628c36cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.112+0000 7fdf0a449740 1 --2- 172.21.15.152:0/1101140447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c2af0 0x5628c36cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.113+0000 7fdf0a449740 1 -- 172.21.15.152:0/1101140447 >> 172.21.15.152:0/1101140447 conn(0x5628c36bf060 msgr2=0x5628c36c4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.113+0000 7fdf0a449740 1 -- 172.21.15.152:0/1101140447 shutdown_connections 2024-09-11T22:11:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.113+0000 7fdf0a449740 1 -- 172.21.15.152:0/1101140447 wait complete. 2024-09-11T22:11:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.113+0000 7fdf0a449740 20 client.26582 trim_cache size 0 max 16384 2024-09-11T22:11:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.136+0000 7fdf0a449740 1 Processor -- start 2024-09-11T22:11:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.137+0000 7fdf0a449740 1 -- start start 2024-09-11T22:11:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.137+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.137+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c3410 0x5628c36cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.137+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36e5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.137+0000 7fdf0a449740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf001befa0 con 0x5628c36c3410 2024-09-11T22:11:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.137+0000 7fdf0a449740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf001bc870 con 0x5628c36cdcb0 2024-09-11T22:11:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.137+0000 7fdf0a449740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf001ba6e0 con 0x5628c36c2af0 2024-09-11T22:11:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.137+0000 7fdf05b75640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.137+0000 7fdf05b75640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36e5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55004/0 (socket says 172.21.15.152:55004) 2024-09-11T22:11:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.137+0000 7fdf05b75640 1 -- 172.21.15.152:0/1415070174 learned_addr learned my addr 172.21.15.152:0/1415070174 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.137+0000 7fdf05374640 1 --2- 172.21.15.152:0/1415070174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.138+0000 7fdf04b73640 1 --2- 172.21.15.152:0/1415070174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c3410 0x5628c36cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.138+0000 7fdf05b75640 1 -- 172.21.15.152:0/1415070174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 msgr2=0x5628c36c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.138+0000 7fdf05b75640 1 --2- 172.21.15.152:0/1415070174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.138+0000 7fdf05b75640 1 -- 172.21.15.152:0/1415070174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c3410 msgr2=0x5628c36cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.138+0000 7fdf05b75640 1 --2- 172.21.15.152:0/1415070174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c3410 0x5628c36cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.138+0000 7fdf05b75640 1 -- 172.21.15.152:0/1415070174 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628c36d0410 con 0x5628c36cdcb0 2024-09-11T22:11:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.138+0000 7fdf05b75640 1 --2- 172.21.15.152:0/1415070174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36e5710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdef8005c40 tx=0x7fdef8011dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14042cf8ec38c129 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.138+0000 7fdeeaffd640 1 -- 172.21.15.152:0/1415070174 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8029040 con 0x5628c36cdcb0 2024-09-11T22:11:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.138+0000 7fdeeaffd640 1 -- 172.21.15.152:0/1415070174 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdef8009b30 con 0x5628c36cdcb0 2024-09-11T22:11:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.138+0000 7fdeeaffd640 1 -- 172.21.15.152:0/1415070174 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8023980 con 0x5628c36cdcb0 2024-09-11T22:11:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.139+0000 7fdf0a449740 1 -- 172.21.15.152:0/1415070174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 msgr2=0x5628c36e5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.139+0000 7fdf0a449740 1 --2- 172.21.15.152:0/1415070174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36e5710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdef8005c40 tx=0x7fdef8011dc0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.139+0000 7fdf0a449740 1 -- 172.21.15.152:0/1415070174 shutdown_connections 2024-09-11T22:11:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.139+0000 7fdf0a449740 1 --2- 172.21.15.152:0/1415070174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36cdcb0 0x5628c36e5710 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.139+0000 7fdf0a449740 1 --2- 172.21.15.152:0/1415070174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36c3410 0x5628c36cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.139+0000 7fdf0a449740 1 --2- 172.21.15.152:0/1415070174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.139+0000 7fdf0a449740 1 -- 172.21.15.152:0/1415070174 >> 172.21.15.152:0/1415070174 conn(0x5628c36bf060 msgr2=0x5628c36ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.140+0000 7fdf0a449740 1 -- 172.21.15.152:0/1415070174 shutdown_connections 2024-09-11T22:11:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.140+0000 7fdf0a449740 1 -- 172.21.15.152:0/1415070174 wait complete. 2024-09-11T22:11:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.140+0000 7fdf0a449740 1 -- start start 2024-09-11T22:11:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.140+0000 7fdf0a449740 1 Processor -- start 2024-09-11T22:11:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.140+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36d6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.140+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36c3410 0x5628c36c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.140+0000 7fdf0a449740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36cdcb0 0x5628c36c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.140+0000 7fdf0a449740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf001bad30 con 0x5628c36cdcb0 2024-09-11T22:11:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.140+0000 7fdf0a449740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf001bc1a0 con 0x5628c36c3410 2024-09-11T22:11:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.140+0000 7fdf0a449740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf001bb400 con 0x5628c36c2af0 2024-09-11T22:11:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.140+0000 7fdf0a449740 10 client.0 _ll_register_callbacks cb 0x7fdef0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.141+0000 7fdf05374640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36d6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.141+0000 7fdf05374640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36d6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54704/0 (socket says 172.21.15.152:54704) 2024-09-11T22:11:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.141+0000 7fdf05374640 1 -- 172.21.15.152:0/521067770 learned_addr learned my addr 172.21.15.152:0/521067770 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.141+0000 7fdf04b73640 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36c3410 0x5628c36c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.141+0000 7fdf05b75640 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36cdcb0 0x5628c36c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.141+0000 7fdf05374640 1 -- 172.21.15.152:0/521067770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36c3410 msgr2=0x5628c36c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.141+0000 7fdf05374640 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36c3410 0x5628c36c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.141+0000 7fdf05374640 1 -- 172.21.15.152:0/521067770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36cdcb0 msgr2=0x5628c36c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.141+0000 7fdf05374640 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36cdcb0 0x5628c36c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.141+0000 7fdf05374640 1 -- 172.21.15.152:0/521067770 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628c36c8300 con 0x5628c36c2af0 2024-09-11T22:11:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.142+0000 7fdf05374640 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36d6200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdefc02a8d0 tx=0x7fdefc005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd13536a0b49721 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.142+0000 7fdee8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.142+0000 7fdee8ff9640 1 -- 172.21.15.152:0/521067770 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc059030 con 0x5628c36c2af0 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.142+0000 7fdee8ff9640 1 -- 172.21.15.152:0/521067770 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fdefc030880 con 0x5628c36c2af0 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.142+0000 7fdf0a449740 1 -- 172.21.15.152:0/521067770 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdef8009b30 con 0x5628c36c2af0 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.142+0000 7fdee8ff9640 1 -- 172.21.15.152:0/521067770 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdefc037040 con 0x5628c36c2af0 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.143+0000 7fdf0a449740 10 client.26743 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.143+0000 7fdf0a449740 1 -- 172.21.15.152:0/521067770 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5628c3748560 con 0x5628c36c2af0 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.143+0000 7fdee8ff9640 1 -- 172.21.15.152:0/521067770 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdef8009b30 con 0x5628c36c2af0 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.143+0000 7fdee8ff9640 1 -- 172.21.15.152:0/521067770 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fdefc048040 con 0x5628c36c2af0 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.143+0000 7fdf0a449740 10 client.26743 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.143+0000 7fdf0a449740 10 client.26743 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.143+0000 7fdf0a449740 20 client.26743 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.143+0000 7fdf0a449740 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5628c3748ce0 0x5628c374b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.143+0000 7fdf0a449740 4 client.26743 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:11:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.143+0000 7fdf0a449740 1 -- 172.21.15.152:0/521067770 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5628c362ed70 con 0x5628c3748ce0 2024-09-11T22:11:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.144+0000 7fdf04b73640 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5628c3748ce0 0x5628c374b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.144+0000 7fdee8ff9640 10 client.26743 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.144+0000 7fdf04b73640 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5628c3748ce0 0x5628c374b100 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d5e26958af6fdac server_cookie=47fff33ec9769c04 in_seq=0 out_seq=0 2024-09-11T22:11:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.151+0000 7fdee8ff9640 1 -- 172.21.15.152:0/521067770 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5628c362ed70 con 0x5628c3748ce0 2024-09-11T22:11:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.151+0000 7fdee8ff9640 10 client.26743 handle_command_reply: tid=0 2024-09-11T22:11:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.151+0000 7fdf0a449740 1 client.26743 shutdown 2024-09-11T22:11:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf0a449740 1 -- 172.21.15.152:0/521067770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 msgr2=0x5628c36d6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf0a449740 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36d6200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdefc02a8d0 tx=0x7fdefc005f90 comp rx=0 tx=0).stop 2024-09-11T22:11:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf0a449740 1 -- 172.21.15.152:0/521067770 shutdown_connections 2024-09-11T22:11:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf0a449740 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5628c3748ce0 0x5628c374b100 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf0a449740 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628c36cdcb0 0x5628c36c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdee8ff9640 0 client.26743 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf0a449740 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5628c36c3410 0x5628c36c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf0a449740 1 --2- 172.21.15.152:0/521067770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628c36c2af0 0x5628c36d6200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf0a449740 1 -- 172.21.15.152:0/521067770 >> 172.21.15.152:0/521067770 conn(0x5628c36bf060 msgr2=0x5628c36cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf0a449740 1 -- 172.21.15.152:0/521067770 shutdown_connections 2024-09-11T22:11:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf0a449740 1 -- 172.21.15.152:0/521067770 wait complete. 2024-09-11T22:11:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf0a449740 20 client.26743 trim_cache size 0 max 16384 2024-09-11T22:11:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:11:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:11:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:11:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:11:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf075d8640 1 -- 172.21.15.152:0/2892147009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdeec0a2f50 msgr2=0x7fdeec0a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf075d8640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdeec0a2f50 0x7fdeec0a5410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdefc02a950 tx=0x7fdefc02a860 comp rx=0 tx=0).stop 2024-09-11T22:11:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf075d8640 1 -- 172.21.15.152:0/2892147009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf00101370 msgr2=0x7fdf0019f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf075d8640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf00101370 0x7fdf0019f520 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdef000e9c0 tx=0x7fdef000ee80 comp rx=0 tx=0).stop 2024-09-11T22:11:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf075d8640 1 -- 172.21.15.152:0/2892147009 shutdown_connections 2024-09-11T22:11:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf075d8640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdeec0a2f50 0x7fdeec0a5410 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf075d8640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf001069e0 0x7fdf0010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf075d8640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf00101370 0x7fdf0019f520 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf075d8640 1 --2- 172.21.15.152:0/2892147009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf001009d0 0x7fdf0019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.152+0000 7fdf075d8640 1 -- 172.21.15.152:0/2892147009 >> 172.21.15.152:0/2892147009 conn(0x7fdf000fc6b0 msgr2=0x7fdf0010df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.153+0000 7fdf075d8640 1 -- 172.21.15.152:0/2892147009 shutdown_connections 2024-09-11T22:11:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:36.153+0000 7fdf075d8640 1 -- 172.21.15.152:0/2892147009 wait complete. 2024-09-11T22:11:36.204 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7d735a34', total seconds elapsed: 19.8 2024-09-11T22:11:37.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:37 smithi152 ceph-mon[31188]: pgmap v224: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 1.15k op/s 2024-09-11T22:11:37.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:37 smithi179 ceph-mon[35603]: pgmap v224: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 1.15k op/s 2024-09-11T22:11:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:37 smithi193 ceph-mon[35545]: pgmap v224: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 1.15k op/s 2024-09-11T22:11:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:39 smithi152 ceph-mon[31188]: pgmap v225: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 1.14k op/s 2024-09-11T22:11:39.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:39 smithi179 ceph-mon[35603]: pgmap v225: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 1.14k op/s 2024-09-11T22:11:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:39 smithi193 ceph-mon[35545]: pgmap v225: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 1.14k op/s 2024-09-11T22:11:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 365.0 s, 2590.3 tps, lat 155.806 ms stddev 1388.155 2024-09-11T22:11:41.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:41 smithi152 ceph-mon[31188]: pgmap v226: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 1.32k op/s 2024-09-11T22:11:41.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:41 smithi179 ceph-mon[35603]: pgmap v226: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 1.32k op/s 2024-09-11T22:11:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:41 smithi193 ceph-mon[35545]: pgmap v226: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 1.32k op/s 2024-09-11T22:11:42.604 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:11:42.950 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:43.429 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:43 smithi152 ceph-mon[31188]: pgmap v227: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 186 op/s 2024-09-11T22:11:43.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:43 smithi179 ceph-mon[35603]: pgmap v227: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 186 op/s 2024-09-11T22:11:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:43 smithi193 ceph-mon[35545]: pgmap v227: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 186 op/s 2024-09-11T22:11:43.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.712+0000 7fb24c30a640 1 -- 172.21.15.152:0/3616765076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb244074f00 msgr2=0x7fb24410ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.712+0000 7fb24c30a640 1 --2- 172.21.15.152:0/3616765076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb244074f00 0x7fb24410ded0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb234009860 tx=0x7fb23402a410 comp rx=0 tx=0).stop 2024-09-11T22:11:43.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.712+0000 7fb24c30a640 1 -- 172.21.15.152:0/3616765076 shutdown_connections 2024-09-11T22:11:43.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.712+0000 7fb24c30a640 1 --2- 172.21.15.152:0/3616765076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb24410e410 0x7fb244110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.712+0000 7fb24c30a640 1 --2- 172.21.15.152:0/3616765076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb244074f00 0x7fb24410ded0 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb234009860 tx=0x7fb23402a410 comp rx=0 tx=0).stop 2024-09-11T22:11:43.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.712+0000 7fb24c30a640 1 --2- 172.21.15.152:0/3616765076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2440745e0 0x7fb2440749c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.712+0000 7fb24c30a640 1 -- 172.21.15.152:0/3616765076 >> 172.21.15.152:0/3616765076 conn(0x7fb2440fd8f0 msgr2=0x7fb2440ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.713+0000 7fb24c30a640 1 -- 172.21.15.152:0/3616765076 shutdown_connections 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.713+0000 7fb24c30a640 1 -- 172.21.15.152:0/3616765076 wait complete. 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.714+0000 7fb24c30a640 1 Processor -- start 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.714+0000 7fb24c30a640 1 -- start start 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.714+0000 7fb24c30a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2440745e0 0x7fb244107760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.714+0000 7fb24c30a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb24410e410 0x7fb244107ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.715+0000 7fb24c30a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24410d480 0x7fb24410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.715+0000 7fb24a0a6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2440745e0 0x7fb244107760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.715+0000 7fb24a0a6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2440745e0 0x7fb244107760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43062/0 (socket says 172.21.15.152:43062) 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.715+0000 7fb24a0a6640 1 -- 172.21.15.152:0/3146146626 learned_addr learned my addr 172.21.15.152:0/3146146626 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.715+0000 7fb24c30a640 1 -- 172.21.15.152:0/3146146626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb244114160 con 0x7fb24410d480 2024-09-11T22:11:43.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.715+0000 7fb24c30a640 1 -- 172.21.15.152:0/3146146626 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb244113fe0 con 0x7fb24410e410 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.715+0000 7fb24c30a640 1 -- 172.21.15.152:0/3146146626 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441142e0 con 0x7fb2440745e0 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.716+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24410d480 0x7fb24410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.716+0000 7fb24a0a6640 1 -- 172.21.15.152:0/3146146626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb24410e410 msgr2=0x7fb244107ca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.716+0000 7fb24a0a6640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb24410e410 0x7fb244107ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.716+0000 7fb24a0a6640 1 -- 172.21.15.152:0/3146146626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24410d480 msgr2=0x7fb24410d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.716+0000 7fb24a0a6640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24410d480 0x7fb24410d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.716+0000 7fb24a0a6640 1 -- 172.21.15.152:0/3146146626 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24410e1f0 con 0x7fb2440745e0 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.717+0000 7fb24a0a6640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2440745e0 0x7fb244107760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb24000e9c0 tx=0x7fb24000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.718+0000 7fb23b7fe640 1 -- 172.21.15.152:0/3146146626 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24000ccc0 con 0x7fb2440745e0 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.718+0000 7fb24c30a640 1 -- 172.21.15.152:0/3146146626 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2441028e0 con 0x7fb2440745e0 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.718+0000 7fb23b7fe640 1 -- 172.21.15.152:0/3146146626 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb240005500 con 0x7fb2440745e0 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.718+0000 7fb24c30a640 1 -- 172.21.15.152:0/3146146626 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb244102dd0 con 0x7fb2440745e0 2024-09-11T22:11:43.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.719+0000 7fb23b7fe640 1 -- 172.21.15.152:0/3146146626 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240010490 con 0x7fb2440745e0 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.721+0000 7fb23b7fe640 1 -- 172.21.15.152:0/3146146626 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb240004680 con 0x7fb2440745e0 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.724+0000 7fb24e6e3740 1 Processor -- start 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24e6e3740 1 -- start start 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24e6e3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b234a0 0x5563d8b23880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24e6e3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b23dc0 0x5563d8b2e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24e6e3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b2e680 0x5563d8b30a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24e6e3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5563d8a892e0 con 0x5563d8b23dc0 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24e6e3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5563d8a30ce0 con 0x5563d8b2e680 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb23b7fe640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb2300a2ca0 0x7fb2300a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24e6e3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5563d8a852a0 con 0x5563d8b234a0 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24a0a6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b234a0 0x5563d8b23880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb23b7fe640 1 -- 172.21.15.152:0/3146146626 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb2400cf810 con 0x7fb2440745e0 2024-09-11T22:11:43.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24a8a7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b2e680 0x5563d8b30a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24a8a7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b2e680 0x5563d8b30a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52290/0 (socket says 172.21.15.152:52290) 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24a8a7640 1 -- 172.21.15.152:0/3486356950 learned_addr learned my addr 172.21.15.152:0/3486356950 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.725+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb2300a2ca0 0x7fb2300a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.726+0000 7fb24a8a7640 1 -- 172.21.15.152:0/3486356950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b234a0 msgr2=0x5563d8b23880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.726+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/3486356950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b234a0 0x5563d8b23880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.726+0000 7fb24a8a7640 1 -- 172.21.15.152:0/3486356950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b23dc0 msgr2=0x5563d8b2e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.726+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/3486356950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b23dc0 0x5563d8b2e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.726+0000 7fb24a8a7640 1 -- 172.21.15.152:0/3486356950 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d8a15440 con 0x5563d8b2e680 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.726+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/3486356950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b2e680 0x5563d8b30a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb23c013d40 tx=0x7fb23c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=697aa600c067f215 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.726+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb2300a2ca0 0x7fb2300a5160 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00afd0 tx=0x7fb23c00d000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.726+0000 7fb238dea640 1 -- 172.21.15.152:0/3486356950 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c00aa90 con 0x5563d8b2e680 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.726+0000 7fb238dea640 1 -- 172.21.15.152:0/3486356950 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb23c00cb90 con 0x5563d8b2e680 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.726+0000 7fb238dea640 1 -- 172.21.15.152:0/3486356950 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c004280 con 0x5563d8b2e680 2024-09-11T22:11:43.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.727+0000 7fb24e6e3740 1 -- 172.21.15.152:0/3486356950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b2e680 msgr2=0x5563d8b30a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.727+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/3486356950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b2e680 0x5563d8b30a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb23c013d40 tx=0x7fb23c0107a0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.728+0000 7fb24e6e3740 1 -- 172.21.15.152:0/3486356950 shutdown_connections 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.728+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/3486356950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b2e680 0x5563d8b30a70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.728+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/3486356950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b23dc0 0x5563d8b2e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.728+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/3486356950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b234a0 0x5563d8b23880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.728+0000 7fb24e6e3740 1 -- 172.21.15.152:0/3486356950 >> 172.21.15.152:0/3486356950 conn(0x5563d8b1fa30 msgr2=0x5563d8b1fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.728+0000 7fb24e6e3740 1 -- 172.21.15.152:0/3486356950 shutdown_connections 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.728+0000 7fb24e6e3740 1 -- 172.21.15.152:0/3486356950 wait complete. 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.729+0000 7fb24e6e3740 1 -- start start 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.729+0000 7fb24e6e3740 1 Processor -- start 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.730+0000 7fb24e6e3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b2e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.730+0000 7fb24e6e3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b2b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.731+0000 7fb24a0a6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b2e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.731+0000 7fb24a0a6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b2e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52298/0 (socket says 172.21.15.152:52298) 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.731+0000 7fb24a0a6640 1 -- 172.21.15.152:0/863198657 learned_addr learned my addr 172.21.15.152:0/863198657 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.731+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b3a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.731+0000 7fb24e6e3740 1 -- 172.21.15.152:0/863198657 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5563d8b31250 con 0x5563d8b2e680 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.731+0000 7fb24e6e3740 1 -- 172.21.15.152:0/863198657 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5563d8a44050 con 0x5563d8b234a0 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.732+0000 7fb24e6e3740 1 -- 172.21.15.152:0/863198657 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5563d8b313d0 con 0x5563d8b2bac0 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.732+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b3a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.732+0000 7fb24e6e3740 10 client.0 _ll_register_callbacks cb 0x5563d8a84160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.732+0000 7fb24a8a7640 1 -- 172.21.15.152:0/863198657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 msgr2=0x5563d8b2e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.732+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b2e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.732+0000 7fb24a8a7640 1 -- 172.21.15.152:0/863198657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 msgr2=0x5563d8b2b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.732+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b2b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.732+0000 7fb24a8a7640 1 -- 172.21.15.152:0/863198657 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563d87fa3c0 con 0x5563d8b2bac0 2024-09-11T22:11:43.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.732+0000 7fb24e6e3740 1 -- 172.21.15.152:0/863198657 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb23c00cb90 con 0x5563d8b2bac0 2024-09-11T22:11:43.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.733+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b3a6f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb23c013d40 tx=0x7fb23c00cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=285abab117c336db server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.733+0000 7fb22dffb640 10 client.26755 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:43.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.733+0000 7fb22dffb640 1 -- 172.21.15.152:0/863198657 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c02d020 con 0x5563d8b2bac0 2024-09-11T22:11:43.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.733+0000 7fb22dffb640 1 -- 172.21.15.152:0/863198657 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb23c013250 con 0x5563d8b2bac0 2024-09-11T22:11:43.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.734+0000 7fb22dffb640 1 -- 172.21.15.152:0/863198657 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb23c00aa90 con 0x5563d8b2bac0 2024-09-11T22:11:43.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.734+0000 7fb24e6e3740 10 client.26755 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:43.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.734+0000 7fb24e6e3740 1 -- 172.21.15.152:0/863198657 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5563d8b3d0b0 con 0x5563d8b2bac0 2024-09-11T22:11:43.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.735+0000 7fb22dffb640 1 -- 172.21.15.152:0/863198657 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb23c01c070 con 0x5563d8b2bac0 2024-09-11T22:11:43.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.735+0000 7fb24e6e3740 10 client.26755 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:43.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.735+0000 7fb24e6e3740 10 client.26755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:43.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.735+0000 7fb24e6e3740 20 client.26755 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.735+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5563d8b3e460 0x5563d8b40850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.735+0000 7fb24e6e3740 4 client.26755 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.735+0000 7fb24e6e3740 1 -- 172.21.15.152:0/863198657 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563d8a96850 con 0x5563d8b3e460 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.735+0000 7fb24a0a6640 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5563d8b3e460 0x5563d8b40850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.736+0000 7fb24a0a6640 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5563d8b3e460 0x5563d8b40850 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=106b71893a283f18 server_cookie=c8e74f3e706d4222 in_seq=0 out_seq=0 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.736+0000 7fb22dffb640 10 client.26755 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.737+0000 7fb22dffb640 1 -- 172.21.15.152:0/863198657 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563d8a96850 con 0x5563d8b3e460 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.737+0000 7fb22dffb640 10 client.26755 handle_command_reply: tid=0 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.737+0000 7fb24e6e3740 1 client.26755 shutdown 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.737+0000 7fb24e6e3740 1 -- 172.21.15.152:0/863198657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 msgr2=0x5563d8b3a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.737+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b3a6f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb23c013d40 tx=0x7fb23c00cf70 comp rx=0 tx=0).stop 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.737+0000 7fb24e6e3740 1 -- 172.21.15.152:0/863198657 shutdown_connections 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.737+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5563d8b3e460 0x5563d8b40850 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.738+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b3a6f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.738+0000 7fb22dffb640 0 client.26755 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.738+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b2b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.738+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/863198657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b2e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.738+0000 7fb24e6e3740 1 -- 172.21.15.152:0/863198657 >> 172.21.15.152:0/863198657 conn(0x5563d8b1fa30 msgr2=0x5563d8b25760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.738+0000 7fb24e6e3740 1 -- 172.21.15.152:0/863198657 shutdown_connections 2024-09-11T22:11:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.738+0000 7fb24e6e3740 1 -- 172.21.15.152:0/863198657 wait complete. 2024-09-11T22:11:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.738+0000 7fb24e6e3740 20 client.26755 trim_cache size 0 max 16384 2024-09-11T22:11:43.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.776+0000 7fb24e6e3740 1 Processor -- start 2024-09-11T22:11:43.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.776+0000 7fb24e6e3740 1 -- start start 2024-09-11T22:11:43.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.776+0000 7fb24e6e3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b2acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.776+0000 7fb24e6e3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b3a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.777+0000 7fb24e6e3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b3aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.777+0000 7fb24e6e3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441bf490 con 0x5563d8b2e680 2024-09-11T22:11:43.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.777+0000 7fb24e6e3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441bcd60 con 0x5563d8b234a0 2024-09-11T22:11:43.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.777+0000 7fb24e6e3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441babd0 con 0x5563d8b2bac0 2024-09-11T22:11:43.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.777+0000 7fb2498a5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b3a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.777+0000 7fb2498a5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b3a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43086/0 (socket says 172.21.15.152:43086) 2024-09-11T22:11:43.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.777+0000 7fb2498a5640 1 -- 172.21.15.152:0/1983941694 learned_addr learned my addr 172.21.15.152:0/1983941694 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:43.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.777+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/1983941694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b3aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.777+0000 7fb24a0a6640 1 --2- 172.21.15.152:0/1983941694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b2acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.778+0000 7fb24a8a7640 1 -- 172.21.15.152:0/1983941694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 msgr2=0x5563d8b3a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:43.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.778+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/1983941694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b3a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.778+0000 7fb24a8a7640 1 -- 172.21.15.152:0/1983941694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 msgr2=0x5563d8b2acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:43.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.778+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/1983941694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b2acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.778+0000 7fb24a8a7640 1 -- 172.21.15.152:0/1983941694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d8b23220 con 0x5563d8b2e680 2024-09-11T22:11:43.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.778+0000 7fb2498a5640 1 --2- 172.21.15.152:0/1983941694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b3a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:43.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.778+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/1983941694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b3aa20 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb23c013a50 tx=0x7fb23c027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadf711a3b7ac292 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.778+0000 7fb22ffff640 1 -- 172.21.15.152:0/1983941694 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c040070 con 0x5563d8b2e680 2024-09-11T22:11:43.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.779+0000 7fb22ffff640 1 -- 172.21.15.152:0/1983941694 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb23c00cb90 con 0x5563d8b2e680 2024-09-11T22:11:43.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.779+0000 7fb22ffff640 1 -- 172.21.15.152:0/1983941694 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c02d040 con 0x5563d8b2e680 2024-09-11T22:11:43.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.780+0000 7fb24e6e3740 1 -- 172.21.15.152:0/1983941694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 msgr2=0x5563d8b3aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.780+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/1983941694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b3aa20 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb23c013a50 tx=0x7fb23c027000 comp rx=0 tx=0).stop 2024-09-11T22:11:43.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.780+0000 7fb24e6e3740 1 -- 172.21.15.152:0/1983941694 shutdown_connections 2024-09-11T22:11:43.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.780+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/1983941694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b3aa20 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.780+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/1983941694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b3a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.780+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/1983941694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b2acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.780+0000 7fb24e6e3740 1 -- 172.21.15.152:0/1983941694 >> 172.21.15.152:0/1983941694 conn(0x5563d8b1fa30 msgr2=0x5563d8b1eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.780+0000 7fb24e6e3740 1 -- 172.21.15.152:0/1983941694 shutdown_connections 2024-09-11T22:11:43.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.780+0000 7fb24e6e3740 1 -- 172.21.15.152:0/1983941694 wait complete. 2024-09-11T22:11:43.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.781+0000 7fb24e6e3740 1 -- start start 2024-09-11T22:11:43.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.781+0000 7fb24e6e3740 1 Processor -- start 2024-09-11T22:11:43.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.781+0000 7fb24e6e3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b32580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.782+0000 7fb24e6e3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b32ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.782+0000 7fb24a0a6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b32580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.782+0000 7fb24a0a6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b32580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52312/0 (socket says 172.21.15.152:52312) 2024-09-11T22:11:43.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.782+0000 7fb24a0a6640 1 -- 172.21.15.152:0/714157531 learned_addr learned my addr 172.21.15.152:0/714157531 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:43.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.782+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b33000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.782+0000 7fb2498a5640 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b32ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.783+0000 7fb24a8a7640 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b33000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.783+0000 7fb24e6e3740 1 -- 172.21.15.152:0/714157531 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441bb220 con 0x5563d8b2e680 2024-09-11T22:11:43.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.783+0000 7fb24e6e3740 1 -- 172.21.15.152:0/714157531 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441bc690 con 0x5563d8b234a0 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.783+0000 7fb24e6e3740 1 -- 172.21.15.152:0/714157531 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441bb8f0 con 0x5563d8b2bac0 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.783+0000 7fb24e6e3740 10 client.0 _ll_register_callbacks cb 0x7fb23c013b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb24a0a6640 1 -- 172.21.15.152:0/714157531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 msgr2=0x5563d8b32ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb24a0a6640 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b32ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb24a0a6640 1 -- 172.21.15.152:0/714157531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 msgr2=0x5563d8b33000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb24a0a6640 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b33000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb24a0a6640 1 -- 172.21.15.152:0/714157531 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563d8ba8120 con 0x5563d8b234a0 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb24e6e3740 1 -- 172.21.15.152:0/714157531 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb23c00cb90 con 0x5563d8b234a0 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb24a0a6640 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b32580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb240098130 tx=0x7fb24009bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9712c55a469f055 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb22dffb640 10 client.26600 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb22dffb640 1 -- 172.21.15.152:0/714157531 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2400a4940 con 0x5563d8b234a0 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb22dffb640 1 -- 172.21.15.152:0/714157531 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb2400cd180 con 0x5563d8b234a0 2024-09-11T22:11:43.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb22dffb640 1 -- 172.21.15.152:0/714157531 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb240098340 con 0x5563d8b234a0 2024-09-11T22:11:43.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb24e6e3740 10 client.26600 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:43.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.784+0000 7fb24e6e3740 1 -- 172.21.15.152:0/714157531 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5563d8ba9220 con 0x5563d8b234a0 2024-09-11T22:11:43.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.785+0000 7fb22dffb640 1 -- 172.21.15.152:0/714157531 <== mon.2 v2:172.21.15.179:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb2400a44b0 con 0x5563d8b234a0 2024-09-11T22:11:43.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.785+0000 7fb24e6e3740 10 client.26600 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:43.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.785+0000 7fb24e6e3740 10 client.26600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:43.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.785+0000 7fb24e6e3740 20 client.26600 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:43.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.785+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5563d8b3e460 0x5563d8bab840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.785+0000 7fb24e6e3740 4 client.26600 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:11:43.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.785+0000 7fb24e6e3740 1 -- 172.21.15.152:0/714157531 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5563d8a90d60 con 0x5563d8b3e460 2024-09-11T22:11:43.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.785+0000 7fb2498a5640 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5563d8b3e460 0x5563d8bab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.786+0000 7fb2498a5640 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5563d8b3e460 0x5563d8bab840 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce48098afdb84743 server_cookie=8661cfa5e58a0bb9 in_seq=0 out_seq=0 2024-09-11T22:11:43.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.786+0000 7fb22dffb640 10 client.26600 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:43.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.786+0000 7fb22dffb640 1 -- 172.21.15.152:0/714157531 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5563d8a90d60 con 0x5563d8b3e460 2024-09-11T22:11:43.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.786+0000 7fb22dffb640 10 client.26600 handle_command_reply: tid=0 2024-09-11T22:11:43.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.786+0000 7fb24e6e3740 1 client.26600 shutdown 2024-09-11T22:11:43.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.787+0000 7fb24e6e3740 1 -- 172.21.15.152:0/714157531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 msgr2=0x5563d8b32580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.787+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b32580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb240098130 tx=0x7fb24009bd90 comp rx=0 tx=0).stop 2024-09-11T22:11:43.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.787+0000 7fb24e6e3740 1 -- 172.21.15.152:0/714157531 shutdown_connections 2024-09-11T22:11:43.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.787+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5563d8b3e460 0x5563d8bab840 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.787+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563d8b2e680 0x5563d8b33000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.787+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5563d8b2bac0 0x5563d8b32ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.787+0000 7fb24e6e3740 1 --2- 172.21.15.152:0/714157531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5563d8b234a0 0x5563d8b32580 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.787+0000 7fb24e6e3740 1 -- 172.21.15.152:0/714157531 >> 172.21.15.152:0/714157531 conn(0x5563d8b1fa30 msgr2=0x5563d8b26050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.788+0000 7fb22dffb640 0 client.26600 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:43.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.788+0000 7fb24e6e3740 1 -- 172.21.15.152:0/714157531 shutdown_connections 2024-09-11T22:11:43.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.788+0000 7fb24e6e3740 1 -- 172.21.15.152:0/714157531 wait complete. 2024-09-11T22:11:43.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.788+0000 7fb24e6e3740 20 client.26600 trim_cache size 0 max 16384 2024-09-11T22:11:43.791 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:11:43.791 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:11:43.791 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:11:43.791 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:11:43.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.789+0000 7fb24c30a640 1 -- 172.21.15.152:0/3146146626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb2300a2ca0 msgr2=0x7fb2300a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.789+0000 7fb24c30a640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb2300a2ca0 0x7fb2300a5160 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00afd0 tx=0x7fb23c00d000 comp rx=0 tx=0).stop 2024-09-11T22:11:43.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.789+0000 7fb24c30a640 1 -- 172.21.15.152:0/3146146626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2440745e0 msgr2=0x7fb244107760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.789+0000 7fb24c30a640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2440745e0 0x7fb244107760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb24000e9c0 tx=0x7fb24000ee80 comp rx=0 tx=0).stop 2024-09-11T22:11:43.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.790+0000 7fb24c30a640 1 -- 172.21.15.152:0/3146146626 shutdown_connections 2024-09-11T22:11:43.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.790+0000 7fb24c30a640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb2300a2ca0 0x7fb2300a5160 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.790+0000 7fb24c30a640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24410d480 0x7fb24410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.790+0000 7fb24c30a640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb24410e410 0x7fb244107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.790+0000 7fb24c30a640 1 --2- 172.21.15.152:0/3146146626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2440745e0 0x7fb244107760 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.790+0000 7fb24c30a640 1 -- 172.21.15.152:0/3146146626 >> 172.21.15.152:0/3146146626 conn(0x7fb2440fd8f0 msgr2=0x7fb2440ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.790+0000 7fb24c30a640 1 -- 172.21.15.152:0/3146146626 shutdown_connections 2024-09-11T22:11:43.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:43.790+0000 7fb24c30a640 1 -- 172.21.15.152:0/3146146626 wait complete. 2024-09-11T22:11:44.630 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:11:44.631 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:11:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 370.0 s, 3154.8 tps, lat 31.800 ms stddev 38.258 2024-09-11T22:11:45.099 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:45.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:45 smithi152 ceph-mon[31188]: pgmap v228: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.1 MiB/s wr, 372 op/s 2024-09-11T22:11:45.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:45 smithi179 ceph-mon[35603]: pgmap v228: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.1 MiB/s wr, 372 op/s 2024-09-11T22:11:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:45 smithi193 ceph-mon[35545]: pgmap v228: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.1 MiB/s wr, 372 op/s 2024-09-11T22:11:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.715+0000 7f7893a25640 1 -- 172.21.15.152:0/3637241612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c100a80 msgr2=0x7f788c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.715+0000 7f7893a25640 1 --2- 172.21.15.152:0/3637241612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c100a80 0x7f788c100ee0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f787c009860 tx=0x7f787c02a360 comp rx=0 tx=0).stop 2024-09-11T22:11:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.715+0000 7f7893a25640 1 -- 172.21.15.152:0/3637241612 shutdown_connections 2024-09-11T22:11:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.715+0000 7f7893a25640 1 --2- 172.21.15.152:0/3637241612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f788c101420 0x7f788c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.715+0000 7f7893a25640 1 --2- 172.21.15.152:0/3637241612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c100a80 0x7f788c100ee0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.715+0000 7f7893a25640 1 --2- 172.21.15.152:0/3637241612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f788c106a80 0x7f788c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.715+0000 7f7893a25640 1 -- 172.21.15.152:0/3637241612 >> 172.21.15.152:0/3637241612 conn(0x7f788c0fc7a0 msgr2=0x7f788c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.715+0000 7f7893a25640 1 -- 172.21.15.152:0/3637241612 shutdown_connections 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.715+0000 7f7893a25640 1 -- 172.21.15.152:0/3637241612 wait complete. 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.716+0000 7f7893a25640 1 Processor -- start 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.716+0000 7f7893a25640 1 -- start start 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f7893a25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c100a80 0x7f788c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f7893a25640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f788c101420 0x7f788c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f7893a25640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f788c106a80 0x7f788c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f78917c1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c100a80 0x7f788c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f7893a25640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f788c06b090 con 0x7f788c106a80 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f7890fc0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f788c101420 0x7f788c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f7890fc0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f788c101420 0x7f788c1989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43116/0 (socket says 172.21.15.152:43116) 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f7891fc2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f788c106a80 0x7f788c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f7890fc0640 1 -- 172.21.15.152:0/2344191984 learned_addr learned my addr 172.21.15.152:0/2344191984 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f788c06af10 con 0x7f788c100a80 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f788c06b210 con 0x7f788c101420 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f78917c1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c100a80 0x7f788c1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52322/0 (socket says 172.21.15.152:52322) 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f78917c1640 1 -- 172.21.15.152:0/2344191984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f788c101420 msgr2=0x7f788c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f78917c1640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f788c101420 0x7f788c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f78917c1640 1 -- 172.21.15.152:0/2344191984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f788c106a80 msgr2=0x7f788c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f78917c1640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f788c106a80 0x7f788c19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.717+0000 7f78917c1640 1 -- 172.21.15.152:0/2344191984 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788c19d460 con 0x7f788c100a80 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.718+0000 7f78917c1640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c100a80 0x7f788c1984b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7888009fd0 tx=0x7f788800b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.718+0000 7f78827fc640 1 -- 172.21.15.152:0/2344191984 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7888015020 con 0x7f788c100a80 2024-09-11T22:11:45.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.718+0000 7f78827fc640 1 -- 172.21.15.152:0/2344191984 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7888011d10 con 0x7f788c100a80 2024-09-11T22:11:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.718+0000 7f78827fc640 1 -- 172.21.15.152:0/2344191984 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7888015020 con 0x7f788c100a80 2024-09-11T22:11:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.718+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788c19d750 con 0x7f788c100a80 2024-09-11T22:11:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.718+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f788c1105c0 con 0x7f788c100a80 2024-09-11T22:11:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.720+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f788c1021c0 con 0x7f788c100a80 2024-09-11T22:11:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.722+0000 7f78827fc640 1 -- 172.21.15.152:0/2344191984 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f7888018020 con 0x7f788c100a80 2024-09-11T22:11:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.723+0000 7f78827fc640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78780a30f0 0x7f78780a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.723+0000 7f78827fc640 1 -- 172.21.15.152:0/2344191984 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f7888011630 con 0x7f788c100a80 2024-09-11T22:11:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.723+0000 7f7890fc0640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78780a30f0 0x7f78780a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.724+0000 7f7890fc0640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78780a30f0 0x7f78780a55b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f787c0095f0 tx=0x7f787c0056d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:45.729+0000 7f78827fc640 1 -- 172.21.15.152:0/2344191984 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f788801f020 con 0x7f788c100a80 2024-09-11T22:11:46.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.079+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f788c110880 con 0x7f788c100a80 2024-09-11T22:11:46.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.080+0000 7f78827fc640 1 -- 172.21.15.152:0/2344191984 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f788809b210 con 0x7f788c100a80 2024-09-11T22:11:46.081 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:11:46.081 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:11:46.081 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:11:46.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.083+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78780a30f0 msgr2=0x7f78780a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:46.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.083+0000 7f7893a25640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78780a30f0 0x7f78780a55b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f787c0095f0 tx=0x7f787c0056d0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.083+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c100a80 msgr2=0x7f788c1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:46.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.083+0000 7f7893a25640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c100a80 0x7f788c1984b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7888009fd0 tx=0x7f788800b870 comp rx=0 tx=0).stop 2024-09-11T22:11:46.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.083+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 shutdown_connections 2024-09-11T22:11:46.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.083+0000 7f7893a25640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78780a30f0 0x7f78780a55b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.083+0000 7f7893a25640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f788c106a80 0x7f788c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.083+0000 7f7893a25640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f788c101420 0x7f788c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.083+0000 7f7893a25640 1 --2- 172.21.15.152:0/2344191984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c100a80 0x7f788c1984b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.083+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 >> 172.21.15.152:0/2344191984 conn(0x7f788c0fc7a0 msgr2=0x7f788c0fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:46.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.084+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 shutdown_connections 2024-09-11T22:11:46.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:46.084+0000 7f7893a25640 1 -- 172.21.15.152:0/2344191984 wait complete. 2024-09-11T22:11:46.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:46 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2344191984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:46.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:46 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2344191984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:46.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:46 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2344191984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:11:46.926 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:11:47.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:47 smithi152 ceph-mon[31188]: pgmap v229: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 489 op/s 2024-09-11T22:11:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:47 smithi179 ceph-mon[35603]: pgmap v229: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 489 op/s 2024-09-11T22:11:47.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:47 smithi193 ceph-mon[35545]: pgmap v229: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 489 op/s 2024-09-11T22:11:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.820+0000 7f81f8063640 1 -- 172.21.15.152:0/1110746557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81f0100e20 msgr2=0x7f81f0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.821+0000 7f81f8063640 1 --2- 172.21.15.152:0/1110746557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81f0100e20 0x7f81f0101200 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009900 tx=0x7f81e002a480 comp rx=0 tx=0).stop 2024-09-11T22:11:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.821+0000 7f81f8063640 1 -- 172.21.15.152:0/1110746557 shutdown_connections 2024-09-11T22:11:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.821+0000 7f81f8063640 1 --2- 172.21.15.152:0/1110746557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81f0102ef0 0x7f81f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.821+0000 7f81f8063640 1 --2- 172.21.15.152:0/1110746557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f0102570 0x7f81f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.821+0000 7f81f8063640 1 --2- 172.21.15.152:0/1110746557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81f0100e20 0x7f81f0101200 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.821+0000 7f81f8063640 1 -- 172.21.15.152:0/1110746557 >> 172.21.15.152:0/1110746557 conn(0x7f81f00fc7d0 msgr2=0x7f81f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.821+0000 7f81f8063640 1 -- 172.21.15.152:0/1110746557 shutdown_connections 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.821+0000 7f81f8063640 1 -- 172.21.15.152:0/1110746557 wait complete. 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.822+0000 7f81f8063640 1 Processor -- start 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.822+0000 7f81f8063640 1 -- start start 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.822+0000 7f81f8063640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81f0100e20 0x7f81f01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.822+0000 7f81f8063640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f0102570 0x7f81f0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.822+0000 7f81f8063640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81f0102ef0 0x7f81f019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.822+0000 7f81f8063640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f81f0110f80 con 0x7f81f0102ef0 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.822+0000 7f81f8063640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f81f0110e00 con 0x7f81f0102570 2024-09-11T22:11:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.822+0000 7f81f8063640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81f0111100 con 0x7f81f0100e20 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f6600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81f0102ef0 0x7f81f019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f5dff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81f0100e20 0x7f81f01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f5dff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81f0100e20 0x7f81f01985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43136/0 (socket says 172.21.15.152:43136) 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f55fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f0102570 0x7f81f0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f6600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81f0102ef0 0x7f81f019ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39748/0 (socket says 172.21.15.152:39748) 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f5dff640 1 -- 172.21.15.152:0/1599722874 learned_addr learned my addr 172.21.15.152:0/1599722874 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f5dff640 1 -- 172.21.15.152:0/1599722874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f0102570 msgr2=0x7f81f0198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f5dff640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f0102570 0x7f81f0198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f5dff640 1 -- 172.21.15.152:0/1599722874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81f0102ef0 msgr2=0x7f81f019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f5dff640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81f0102ef0 0x7f81f019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f5dff640 1 -- 172.21.15.152:0/1599722874 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f019d550 con 0x7f81f0100e20 2024-09-11T22:11:48.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f6600640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81f0102ef0 0x7f81f019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f55fe640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f0102570 0x7f81f0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f5dff640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81f0100e20 0x7f81f01985a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f81e0006010 tx=0x7f81e0003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81eeffd640 1 -- 172.21.15.152:0/1599722874 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e003f070 con 0x7f81f0100e20 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81f8063640 1 -- 172.21.15.152:0/1599722874 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f019d7e0 con 0x7f81f0100e20 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81eeffd640 1 -- 172.21.15.152:0/1599722874 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e0031c30 con 0x7f81f0100e20 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.823+0000 7f81eeffd640 1 -- 172.21.15.152:0/1599722874 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0035030 con 0x7f81f0100e20 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.824+0000 7f81f8063640 1 -- 172.21.15.152:0/1599722874 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f01a5120 con 0x7f81f0100e20 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.827+0000 7f81fa43c740 1 Processor -- start 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.827+0000 7f81fa43c740 1 -- start start 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.827+0000 7f81eeffd640 1 -- 172.21.15.152:0/1599722874 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f81e0042070 con 0x7f81f0100e20 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.827+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.827+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 0x55c05a1b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81fa43c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c05a10a2f0 con 0x55c05a1b3780 2024-09-11T22:11:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81fa43c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c05a0b1cf0 con 0x55c05a1a45d0 2024-09-11T22:11:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81fa43c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c05a1062b0 con 0x55c05a1a5b40 2024-09-11T22:11:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f5dff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f55fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 0x55c05a1b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f5dff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52358/0 (socket says 172.21.15.152:52358) 2024-09-11T22:11:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f5dff640 1 -- 172.21.15.152:0/1590093150 learned_addr learned my addr 172.21.15.152:0/1590093150 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f6600640 1 --2- 172.21.15.152:0/1590093150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f55fe640 1 -- 172.21.15.152:0/1590093150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 msgr2=0x55c05a1a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f55fe640 1 --2- 172.21.15.152:0/1590093150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f55fe640 1 -- 172.21.15.152:0/1590093150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 msgr2=0x55c05a1a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f55fe640 1 --2- 172.21.15.152:0/1590093150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f55fe640 1 -- 172.21.15.152:0/1590093150 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05a0963a0 con 0x55c05a1b3780 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f5dff640 1 --2- 172.21.15.152:0/1590093150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81eeffd640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81d80a2cf0 0x7f81d80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.828+0000 7f81f55fe640 1 --2- 172.21.15.152:0/1590093150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 0x55c05a1b5b70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009fa0 tx=0x7f81e40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6d09146f2c875f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.829+0000 7f81f6600640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81d80a2cf0 0x7f81d80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.829+0000 7f81d7fff640 1 -- 172.21.15.152:0/1590093150 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4004030 con 0x55c05a1b3780 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.829+0000 7f81d7fff640 1 -- 172.21.15.152:0/1590093150 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e4005500 con 0x55c05a1b3780 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.829+0000 7f81d7fff640 1 -- 172.21.15.152:0/1590093150 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4004e10 con 0x55c05a1b3780 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.829+0000 7f81eeffd640 1 -- 172.21.15.152:0/1599722874 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f81e00efb10 con 0x7f81f0100e20 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.830+0000 7f81fa43c740 1 -- 172.21.15.152:0/1590093150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 msgr2=0x55c05a1b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.830+0000 7f81fa43c740 1 --2- 172.21.15.152:0/1590093150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 0x55c05a1b5b70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009fa0 tx=0x7f81e40118d0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.830+0000 7f81f6600640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81d80a2cf0 0x7f81d80a51b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009fd0 tx=0x7f81e8009500 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.830+0000 7f81fa43c740 1 -- 172.21.15.152:0/1590093150 shutdown_connections 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.830+0000 7f81fa43c740 1 --2- 172.21.15.152:0/1590093150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 0x55c05a1b5b70 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.830+0000 7f81fa43c740 1 --2- 172.21.15.152:0/1590093150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.830+0000 7f81fa43c740 1 --2- 172.21.15.152:0/1590093150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.830+0000 7f81fa43c740 1 -- 172.21.15.152:0/1590093150 >> 172.21.15.152:0/1590093150 conn(0x55c05a16d310 msgr2=0x55c05a1a0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.830+0000 7f81fa43c740 1 -- 172.21.15.152:0/1590093150 shutdown_connections 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.830+0000 7f81fa43c740 1 -- 172.21.15.152:0/1590093150 wait complete. 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81fa43c740 1 -- start start 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81fa43c740 1 Processor -- start 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a45d0 0x55c05a1ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1acc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1b3780 0x55c05a1ad170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81fa43c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c05a1a74f0 con 0x55c05a1a45d0 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81fa43c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c05a0c5060 con 0x55c05a1b3780 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81fa43c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c05a1a7670 con 0x55c05a1a5b40 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81fa43c740 10 client.0 _ll_register_callbacks cb 0x55c059e188c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81f5dff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a45d0 0x55c05a1ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81f5dff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a45d0 0x55c05a1ac6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39770/0 (socket says 172.21.15.152:39770) 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81f5dff640 1 -- 172.21.15.152:0/794165392 learned_addr learned my addr 172.21.15.152:0/794165392 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81f55fe640 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.831+0000 7f81f6600640 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1b3780 0x55c05a1ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81f5dff640 1 -- 172.21.15.152:0/794165392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 msgr2=0x55c05a1acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81f5dff640 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1acc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81f5dff640 1 -- 172.21.15.152:0/794165392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1b3780 msgr2=0x55c05a1ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81f5dff640 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1b3780 0x55c05a1ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81f5dff640 1 -- 172.21.15.152:0/794165392 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c059e7b3c0 con 0x55c05a1a45d0 2024-09-11T22:11:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81f55fe640 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81f6600640 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1b3780 0x55c05a1ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81f5dff640 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a45d0 0x55c05a1ac6f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f81e00c4710 tx=0x7f81e0005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33788e001183c418 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:11:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81d57fa640 1 -- 172.21.15.152:0/794165392 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0049030 con 0x55c05a1a45d0 2024-09-11T22:11:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81fa43c740 1 -- 172.21.15.152:0/794165392 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81e4005500 con 0x55c05a1a45d0 2024-09-11T22:11:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81d57fa640 1 -- 172.21.15.152:0/794165392 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f81e00b86f0 con 0x55c05a1a45d0 2024-09-11T22:11:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81d57fa640 1 -- 172.21.15.152:0/794165392 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f81e00f4040 con 0x55c05a1a45d0 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81fa43c740 10 client.17208 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81fa43c740 1 -- 172.21.15.152:0/794165392 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c05a1c6350 con 0x55c05a1a45d0 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.832+0000 7f81d57fa640 1 -- 172.21.15.152:0/794165392 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e4005500 con 0x55c05a1a45d0 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.833+0000 7f81d57fa640 1 -- 172.21.15.152:0/794165392 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f81e00c47b0 con 0x55c05a1a45d0 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.833+0000 7f81fa43c740 10 client.17208 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.833+0000 7f81fa43c740 10 client.17208 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.833+0000 7f81fa43c740 20 client.17208 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.833+0000 7f81fa43c740 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c05a1c7990 0x55c05a1c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.833+0000 7f81fa43c740 4 client.17208 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.833+0000 7f81fa43c740 1 -- 172.21.15.152:0/794165392 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c05a117860 con 0x55c05a1c7990 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.833+0000 7f81f55fe640 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c05a1c7990 0x55c05a1c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.834+0000 7f81f55fe640 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c05a1c7990 0x55c05a1c9de0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=374da9cb3a56f35a server_cookie=7f35e4c559a6fc6 in_seq=0 out_seq=0 2024-09-11T22:11:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.835+0000 7f81d57fa640 10 client.17208 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:11:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.835+0000 7f81d57fa640 1 -- 172.21.15.152:0/794165392 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c05a117860 con 0x55c05a1c7990 2024-09-11T22:11:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.835+0000 7f81d57fa640 10 client.17208 handle_command_reply: tid=0 2024-09-11T22:11:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.835+0000 7f81fa43c740 1 client.17208 shutdown 2024-09-11T22:11:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81fa43c740 1 -- 172.21.15.152:0/794165392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a45d0 msgr2=0x55c05a1ac6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81fa43c740 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a45d0 0x55c05a1ac6f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f81e00c4710 tx=0x7f81e0005c90 comp rx=0 tx=0).stop 2024-09-11T22:11:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81fa43c740 1 -- 172.21.15.152:0/794165392 shutdown_connections 2024-09-11T22:11:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81fa43c740 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c05a1c7990 0x55c05a1c9de0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81fa43c740 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1b3780 0x55c05a1ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81fa43c740 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81fa43c740 1 --2- 172.21.15.152:0/794165392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a45d0 0x55c05a1ac6f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81fa43c740 1 -- 172.21.15.152:0/794165392 >> 172.21.15.152:0/794165392 conn(0x55c05a16d310 msgr2=0x55c05a1a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81d57fa640 0 client.17208 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81fa43c740 1 -- 172.21.15.152:0/794165392 shutdown_connections 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81fa43c740 1 -- 172.21.15.152:0/794165392 wait complete. 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.836+0000 7f81fa43c740 20 client.17208 trim_cache size 0 max 16384 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.852+0000 7f81fa43c740 1 Processor -- start 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.852+0000 7f81fa43c740 1 -- start start 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a5b40 0x55c05a1acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1b3780 0x55c05a1ad180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81fa43c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f81f01ae120 con 0x55c05a1a5b40 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81fa43c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f81f01ab9f0 con 0x55c05a1a45d0 2024-09-11T22:11:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81fa43c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81f01a9860 con 0x55c05a1b3780 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f55fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a5b40 0x55c05a1acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f55fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a5b40 0x55c05a1acc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39772/0 (socket says 172.21.15.152:39772) 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f5dff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f55fe640 1 -- 172.21.15.152:0/258295581 learned_addr learned my addr 172.21.15.152:0/258295581 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f6600640 1 --2- 172.21.15.152:0/258295581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1b3780 0x55c05a1ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f5dff640 1 -- 172.21.15.152:0/258295581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1b3780 msgr2=0x55c05a1ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f5dff640 1 --2- 172.21.15.152:0/258295581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1b3780 0x55c05a1ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f5dff640 1 -- 172.21.15.152:0/258295581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a5b40 msgr2=0x55c05a1acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f5dff640 1 --2- 172.21.15.152:0/258295581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a5b40 0x55c05a1acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f5dff640 1 -- 172.21.15.152:0/258295581 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05a1a7120 con 0x55c05a1a45d0 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f55fe640 1 --2- 172.21.15.152:0/258295581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a5b40 0x55c05a1acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81f5dff640 1 --2- 172.21.15.152:0/258295581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1b0670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f81e00bc010 tx=0x7f81e00c4b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a66eb73cc3ed574 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81d77fe640 1 -- 172.21.15.152:0/258295581 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0049070 con 0x55c05a1a45d0 2024-09-11T22:11:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81d77fe640 1 -- 172.21.15.152:0/258295581 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e00c0380 con 0x55c05a1a45d0 2024-09-11T22:11:48.079 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:11:48.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.853+0000 7f81d77fe640 1 -- 172.21.15.152:0/258295581 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e00c47b0 con 0x55c05a1a45d0 2024-09-11T22:11:48.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.854+0000 7f81fa43c740 1 -- 172.21.15.152:0/258295581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 msgr2=0x55c05a1b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.854+0000 7f81fa43c740 1 --2- 172.21.15.152:0/258295581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1b0670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f81e00bc010 tx=0x7f81e00c4b70 comp rx=0 tx=0).stop 2024-09-11T22:11:48.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.854+0000 7f81fa43c740 1 -- 172.21.15.152:0/258295581 shutdown_connections 2024-09-11T22:11:48.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.854+0000 7f81fa43c740 1 --2- 172.21.15.152:0/258295581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1b3780 0x55c05a1ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.854+0000 7f81fa43c740 1 --2- 172.21.15.152:0/258295581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1a5b40 0x55c05a1acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.854+0000 7f81fa43c740 1 --2- 172.21.15.152:0/258295581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1b0670 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.854+0000 7f81fa43c740 1 -- 172.21.15.152:0/258295581 >> 172.21.15.152:0/258295581 conn(0x55c05a16d310 msgr2=0x55c05a1aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.856+0000 7f81fa43c740 1 -- 172.21.15.152:0/258295581 shutdown_connections 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.856+0000 7f81fa43c740 1 -- 172.21.15.152:0/258295581 wait complete. 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.856+0000 7f81fa43c740 1 -- start start 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.856+0000 7f81fa43c740 1 Processor -- start 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81fa43c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 0x55c05a230650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81fa43c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f81f01a9eb0 con 0x55c05a1b3780 2024-09-11T22:11:48.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81fa43c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f81f01ab320 con 0x55c05a1a45d0 2024-09-11T22:11:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81fa43c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81f01aa580 con 0x55c05a1a5b40 2024-09-11T22:11:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81fa43c740 10 client.0 _ll_register_callbacks cb 0x7f81e00f3350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f6600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 0x55c05a230650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f55fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f5dff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f6600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 0x55c05a230650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39780/0 (socket says 172.21.15.152:39780) 2024-09-11T22:11:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f55fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43180/0 (socket says 172.21.15.152:43180) 2024-09-11T22:11:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f6600640 1 -- 172.21.15.152:0/2034639792 learned_addr learned my addr 172.21.15.152:0/2034639792 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f6600640 1 -- 172.21.15.152:0/2034639792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 msgr2=0x55c05a1bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f6600640 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f6600640 1 -- 172.21.15.152:0/2034639792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 msgr2=0x55c05a1bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f6600640 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1bf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f6600640 1 -- 172.21.15.152:0/2034639792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05a230b90 con 0x55c05a1b3780 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f55fe640 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f5dff640 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81f6600640 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 0x55c05a230650 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f81e8005fd0 tx=0x7f81e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c4d61c5c78dace server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.857+0000 7f81d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81d57fa640 1 -- 172.21.15.152:0/2034639792 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e8012020 con 0x55c05a1b3780 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81d57fa640 1 -- 172.21.15.152:0/2034639792 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f81e80121c0 con 0x55c05a1b3780 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81fa43c740 1 -- 172.21.15.152:0/2034639792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81e00c0380 con 0x55c05a1b3780 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81d57fa640 1 -- 172.21.15.152:0/2034639792 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f81e8004b20 con 0x55c05a1b3780 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81fa43c740 10 client.17214 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81fa43c740 1 -- 172.21.15.152:0/2034639792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c05a231df0 con 0x55c05a1b3780 2024-09-11T22:11:48.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81d57fa640 1 -- 172.21.15.152:0/2034639792 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e00c0380 con 0x55c05a1b3780 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81d57fa640 1 -- 172.21.15.152:0/2034639792 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f81e80326d0 con 0x55c05a1b3780 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81fa43c740 10 client.17214 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81fa43c740 10 client.17214 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81fa43c740 20 client.17214 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81fa43c740 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c05a2325c0 0x55c05a2349e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81fa43c740 4 client.17214 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81fa43c740 1 -- 172.21.15.152:0/2034639792 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c05a111d70 con 0x55c05a2325c0 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.858+0000 7f81f5dff640 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c05a2325c0 0x55c05a2349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.859+0000 7f81f5dff640 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c05a2325c0 0x55c05a2349e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bd8780941ff9f807 server_cookie=16844057af27fa30 in_seq=0 out_seq=0 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.859+0000 7f81d57fa640 10 client.17214 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.859+0000 7f81d57fa640 1 -- 172.21.15.152:0/2034639792 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c05a111d70 con 0x55c05a2325c0 2024-09-11T22:11:48.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.859+0000 7f81d57fa640 10 client.17214 handle_command_reply: tid=0 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.859+0000 7f81fa43c740 1 client.17214 shutdown 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81fa43c740 1 -- 172.21.15.152:0/2034639792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 msgr2=0x55c05a230650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81fa43c740 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 0x55c05a230650 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f81e8005fd0 tx=0x7f81e8004a40 comp rx=0 tx=0).stop 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81fa43c740 1 -- 172.21.15.152:0/2034639792 shutdown_connections 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81fa43c740 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55c05a2325c0 0x55c05a2349e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81fa43c740 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c05a1b3780 0x55c05a230650 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81fa43c740 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c05a1a5b40 0x55c05a1bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81fa43c740 1 --2- 172.21.15.152:0/2034639792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c05a1a45d0 0x55c05a1bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81d57fa640 0 client.17214 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81fa43c740 1 -- 172.21.15.152:0/2034639792 >> 172.21.15.152:0/2034639792 conn(0x55c05a16d310 msgr2=0x55c05a1a6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81fa43c740 1 -- 172.21.15.152:0/2034639792 shutdown_connections 2024-09-11T22:11:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81fa43c740 1 -- 172.21.15.152:0/2034639792 wait complete. 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.860+0000 7f81fa43c740 20 client.17214 trim_cache size 0 max 16384 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 -- 172.21.15.152:0/1599722874 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81d80a2cf0 msgr2=0x7f81d80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81d80a2cf0 0x7f81d80a51b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009fd0 tx=0x7f81e8009500 comp rx=0 tx=0).stop 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 -- 172.21.15.152:0/1599722874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81f0100e20 msgr2=0x7f81f01985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81f0100e20 0x7f81f01985a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f81e0006010 tx=0x7f81e0003c10 comp rx=0 tx=0).stop 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 -- 172.21.15.152:0/1599722874 shutdown_connections 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81d80a2cf0 0x7f81d80a51b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81f0102ef0 0x7f81f019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f0102570 0x7f81f0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 --2- 172.21.15.152:0/1599722874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81f0100e20 0x7f81f01985a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 -- 172.21.15.152:0/1599722874 >> 172.21.15.152:0/1599722874 conn(0x7f81f00fc7d0 msgr2=0x7f81f0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 -- 172.21.15.152:0/1599722874 shutdown_connections 2024-09-11T22:11:48.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:47.861+0000 7f81f8063640 1 -- 172.21.15.152:0/1599722874 wait complete. 2024-09-11T22:11:48.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:11:49.184 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.274+0000 7f006e247640 1 -- 172.21.15.152:0/2332504393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0068102d00 msgr2=0x7f00681030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.274+0000 7f006e247640 1 --2- 172.21.15.152:0/2332504393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0068102d00 0x7f00681030e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0058009900 tx=0x7f005802a480 comp rx=0 tx=0).stop 2024-09-11T22:11:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.274+0000 7f006e247640 1 -- 172.21.15.152:0/2332504393 shutdown_connections 2024-09-11T22:11:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.274+0000 7f006e247640 1 --2- 172.21.15.152:0/2332504393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f006810c0d0 0x7f006810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.274+0000 7f006e247640 1 --2- 172.21.15.152:0/2332504393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0068103620 0x7f006810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.274+0000 7f006e247640 1 --2- 172.21.15.152:0/2332504393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0068102d00 0x7f00681030e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.274+0000 7f006e247640 1 -- 172.21.15.152:0/2332504393 >> 172.21.15.152:0/2332504393 conn(0x7f00680fc6b0 msgr2=0x7f00680fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.274+0000 7f006e247640 1 -- 172.21.15.152:0/2332504393 shutdown_connections 2024-09-11T22:11:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.274+0000 7f006e247640 1 -- 172.21.15.152:0/2332504393 wait complete. 2024-09-11T22:11:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.275+0000 7f006e247640 1 Processor -- start 2024-09-11T22:11:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.275+0000 7f006e247640 1 -- start start 2024-09-11T22:11:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.275+0000 7f006e247640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0068102d00 0x7f0068196160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.275+0000 7f006e247640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0068103620 0x7f00681966a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.275+0000 7f006e247640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f006810c0d0 0x7f006819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.275+0000 7f006e247640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f006810fd30 con 0x7f0068102d00 2024-09-11T22:11:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.275+0000 7f006e247640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f006810fbb0 con 0x7f0068103620 2024-09-11T22:11:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.275+0000 7f006e247640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f006810feb0 con 0x7f006810c0d0 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f00677fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0068102d00 0x7f0068196160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f00677fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0068102d00 0x7f0068196160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39798/0 (socket says 172.21.15.152:39798) 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f00677fe640 1 -- 172.21.15.152:0/3250764618 learned_addr learned my addr 172.21.15.152:0/3250764618 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f0067fff640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f006810c0d0 0x7f006819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f0066ffd640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0068103620 0x7f00681966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f00677fe640 1 -- 172.21.15.152:0/3250764618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f006810c0d0 msgr2=0x7f006819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f00677fe640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f006810c0d0 0x7f006819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f00677fe640 1 -- 172.21.15.152:0/3250764618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0068103620 msgr2=0x7f00681966a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f00677fe640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0068103620 0x7f00681966a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f00677fe640 1 -- 172.21.15.152:0/3250764618 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006819b150 con 0x7f0068102d00 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f0067fff640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f006810c0d0 0x7f006819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f00677fe640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0068102d00 0x7f0068196160 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f005802a9f0 tx=0x7f0058003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f0064ff9640 1 -- 172.21.15.152:0/3250764618 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005803f070 con 0x7f0068102d00 2024-09-11T22:11:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f0064ff9640 1 -- 172.21.15.152:0/3250764618 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0058031c90 con 0x7f0068102d00 2024-09-11T22:11:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f006e247640 1 -- 172.21.15.152:0/3250764618 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006819b3e0 con 0x7f0068102d00 2024-09-11T22:11:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f0064ff9640 1 -- 172.21.15.152:0/3250764618 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058035030 con 0x7f0068102d00 2024-09-11T22:11:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.276+0000 7f006e247640 1 -- 172.21.15.152:0/3250764618 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00681a2cd0 con 0x7f0068102d00 2024-09-11T22:11:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0064ff9640 1 -- 172.21.15.152:0/3250764618 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0058042070 con 0x7f0068102d00 2024-09-11T22:11:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0070fe0740 1 Processor -- start 2024-09-11T22:11:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0070fe0740 1 -- start start 2024-09-11T22:11:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 0x56363bf8aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf95770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 0x56363bf980a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0070fe0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56363beef2f0 con 0x56363bf8b410 2024-09-11T22:11:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0070fe0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56363be97270 con 0x56363bf8aaf0 2024-09-11T22:11:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0070fe0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56363beeb2b0 con 0x56363bf95cb0 2024-09-11T22:11:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0067fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 0x56363bf8aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0066ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 0x56363bf980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0067fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 0x56363bf8aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52424/0 (socket says 172.21.15.152:52424) 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f00677fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf95770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.280+0000 7f0067fff640 1 -- 172.21.15.152:0/292629385 learned_addr learned my addr 172.21.15.152:0/292629385 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f0064ff9640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00500a7280 0x7f00500a9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f0066ffd640 1 -- 172.21.15.152:0/292629385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 msgr2=0x56363bf8aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f0066ffd640 1 --2- 172.21.15.152:0/292629385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 0x56363bf8aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f0066ffd640 1 -- 172.21.15.152:0/292629385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 msgr2=0x56363bf95770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f0066ffd640 1 --2- 172.21.15.152:0/292629385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf95770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f0066ffd640 1 -- 172.21.15.152:0/292629385 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56363be96340 con 0x56363bf95cb0 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f0067fff640 1 --2- 172.21.15.152:0/292629385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 0x56363bf8aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f0067fff640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00500a7280 0x7f00500a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f0064ff9640 1 -- 172.21.15.152:0/3250764618 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f00580efb50 con 0x7f0068102d00 2024-09-11T22:11:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f0066ffd640 1 --2- 172.21.15.152:0/292629385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 0x56363bf980a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f005c005d00 tx=0x7f005c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a89382e436a13c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f004dffb640 1 -- 172.21.15.152:0/292629385 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c01c480 con 0x56363bf95cb0 2024-09-11T22:11:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f004dffb640 1 -- 172.21.15.152:0/292629385 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f005c01cb00 con 0x56363bf95cb0 2024-09-11T22:11:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.281+0000 7f004dffb640 1 -- 172.21.15.152:0/292629385 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c011c50 con 0x56363bf95cb0 2024-09-11T22:11:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.282+0000 7f0067fff640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00500a7280 0x7f00500a9740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0060009fd0 tx=0x7f0060004a40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.282+0000 7f0070fe0740 1 -- 172.21.15.152:0/292629385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 msgr2=0x56363bf980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.282+0000 7f0070fe0740 1 --2- 172.21.15.152:0/292629385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 0x56363bf980a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f005c005d00 tx=0x7f005c0107a0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.282+0000 7f0070fe0740 1 -- 172.21.15.152:0/292629385 shutdown_connections 2024-09-11T22:11:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.282+0000 7f0070fe0740 1 --2- 172.21.15.152:0/292629385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 0x56363bf980a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.282+0000 7f0070fe0740 1 --2- 172.21.15.152:0/292629385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf95770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.282+0000 7f0070fe0740 1 --2- 172.21.15.152:0/292629385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 0x56363bf8aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.282+0000 7f0070fe0740 1 -- 172.21.15.152:0/292629385 >> 172.21.15.152:0/292629385 conn(0x56363bf87060 msgr2=0x56363bf87440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.282+0000 7f0070fe0740 1 -- 172.21.15.152:0/292629385 shutdown_connections 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.282+0000 7f0070fe0740 1 -- 172.21.15.152:0/292629385 wait complete. 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0070fe0740 1 -- start start 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0070fe0740 1 Processor -- start 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 0x56363bf92b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf93040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf95cb0 0x56363bf93580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0070fe0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56363bf98880 con 0x56363bf8b410 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0070fe0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56363be78290 con 0x56363bf95cb0 2024-09-11T22:11:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0070fe0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56363bf98a00 con 0x56363bf8aaf0 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0070fe0740 10 client.0 _ll_register_callbacks cb 0x56363bea9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0066ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf93040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f00677fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 0x56363bf92b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0066ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf93040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39816/0 (socket says 172.21.15.152:39816) 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.283+0000 7f0066ffd640 1 -- 172.21.15.152:0/1794155265 learned_addr learned my addr 172.21.15.152:0/1794155265 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.284+0000 7f0067fff640 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf95cb0 0x56363bf93580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.284+0000 7f00677fe640 1 -- 172.21.15.152:0/1794155265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf95cb0 msgr2=0x56363bf93580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.284+0000 7f00677fe640 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf95cb0 0x56363bf93580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.284+0000 7f00677fe640 1 -- 172.21.15.152:0/1794155265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 msgr2=0x56363bf93040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.284+0000 7f00677fe640 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf93040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.284+0000 7f00677fe640 1 -- 172.21.15.152:0/1794155265 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363bc02210 con 0x56363bf8aaf0 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.284+0000 7f0066ffd640 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf93040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.285+0000 7f00677fe640 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 0x56363bf92b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00580ed240 tx=0x7f0058003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a795f12babc3b22a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.285+0000 7f0046ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.285+0000 7f0046ffd640 1 -- 172.21.15.152:0/1794155265 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058049070 con 0x56363bf8aaf0 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.285+0000 7f0046ffd640 1 -- 172.21.15.152:0/1794155265 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f00580ed4c0 con 0x56363bf8aaf0 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.285+0000 7f0070fe0740 1 -- 172.21.15.152:0/1794155265 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f005c01cb00 con 0x56363bf8aaf0 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0046ffd640 1 -- 172.21.15.152:0/1794155265 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0058031e40 con 0x56363bf8aaf0 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0070fe0740 10 client.26791 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0070fe0740 1 -- 172.21.15.152:0/1794155265 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56363bcce620 con 0x56363bf8aaf0 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0046ffd640 1 -- 172.21.15.152:0/1794155265 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f005c01cb00 con 0x56363bf8aaf0 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0046ffd640 1 -- 172.21.15.152:0/1794155265 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f00580bc320 con 0x56363bf8aaf0 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0070fe0740 10 client.26791 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0070fe0740 10 client.26791 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0070fe0740 20 client.26791 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56363bfa5bb0 0x56363bfa8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0070fe0740 4 client.26791 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0070fe0740 1 -- 172.21.15.152:0/1794155265 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56363befca20 con 0x56363bfa5bb0 2024-09-11T22:11:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.286+0000 7f0066ffd640 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56363bfa5bb0 0x56363bfa8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.287+0000 7f0046ffd640 10 client.26791 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.287+0000 7f0066ffd640 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56363bfa5bb0 0x56363bfa8020 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=671120ec8ece3bd4 server_cookie=97c7c34a18afb89f in_seq=0 out_seq=0 2024-09-11T22:11:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.287+0000 7f0046ffd640 1 -- 172.21.15.152:0/1794155265 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56363befca20 con 0x56363bfa5bb0 2024-09-11T22:11:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.287+0000 7f0046ffd640 10 client.26791 handle_command_reply: tid=0 2024-09-11T22:11:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.287+0000 7f0070fe0740 1 client.26791 shutdown 2024-09-11T22:11:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.287+0000 7f0070fe0740 1 -- 172.21.15.152:0/1794155265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 msgr2=0x56363bf92b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.287+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 0x56363bf92b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00580ed240 tx=0x7f0058003f90 comp rx=0 tx=0).stop 2024-09-11T22:11:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.288+0000 7f0070fe0740 1 -- 172.21.15.152:0/1794155265 shutdown_connections 2024-09-11T22:11:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.288+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56363bfa5bb0 0x56363bfa8020 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.288+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf95cb0 0x56363bf93580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.288+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf93040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.288+0000 7f0046ffd640 0 client.26791 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.288+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1794155265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 0x56363bf92b00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.288+0000 7f0070fe0740 1 -- 172.21.15.152:0/1794155265 >> 172.21.15.152:0/1794155265 conn(0x56363bf87060 msgr2=0x56363bf8cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.288+0000 7f0070fe0740 1 -- 172.21.15.152:0/1794155265 shutdown_connections 2024-09-11T22:11:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.288+0000 7f0070fe0740 1 -- 172.21.15.152:0/1794155265 wait complete. 2024-09-11T22:11:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.288+0000 7f0070fe0740 20 client.26791 trim_cache size 0 max 16384 2024-09-11T22:11:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0070fe0740 1 Processor -- start 2024-09-11T22:11:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0070fe0740 1 -- start start 2024-09-11T22:11:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 0x56363bf8d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf933b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 0x56363bfad930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0070fe0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f00681adf40 con 0x56363bf8b410 2024-09-11T22:11:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0070fe0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f00681ab810 con 0x56363bf8aaf0 2024-09-11T22:11:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0070fe0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f00681a9680 con 0x56363bf95cb0 2024-09-11T22:11:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0066ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf933b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f00677fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 0x56363bf8d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0066ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf933b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39822/0 (socket says 172.21.15.152:39822) 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0066ffd640 1 -- 172.21.15.152:0/1121388056 learned_addr learned my addr 172.21.15.152:0/1121388056 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.307+0000 7f0067fff640 1 --2- 172.21.15.152:0/1121388056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 0x56363bfad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.308+0000 7f00677fe640 1 -- 172.21.15.152:0/1121388056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 msgr2=0x56363bfad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.308+0000 7f00677fe640 1 --2- 172.21.15.152:0/1121388056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 0x56363bfad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.308+0000 7f00677fe640 1 -- 172.21.15.152:0/1121388056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 msgr2=0x56363bf933b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.308+0000 7f00677fe640 1 --2- 172.21.15.152:0/1121388056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf933b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.308+0000 7f00677fe640 1 -- 172.21.15.152:0/1121388056 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56363bf86e90 con 0x56363bf8aaf0 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.308+0000 7f0066ffd640 1 --2- 172.21.15.152:0/1121388056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf933b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.308+0000 7f0067fff640 1 --2- 172.21.15.152:0/1121388056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 0x56363bfad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.308+0000 7f00677fe640 1 --2- 172.21.15.152:0/1121388056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 0x56363bf8d560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00580b8a90 tx=0x7f005803b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da55a65070e0b537 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.308+0000 7f004d7fa640 1 -- 172.21.15.152:0/1121388056 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058049070 con 0x56363bf8aaf0 2024-09-11T22:11:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.308+0000 7f004d7fa640 1 -- 172.21.15.152:0/1121388056 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00580bc0c0 con 0x56363bf8aaf0 2024-09-11T22:11:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.308+0000 7f004d7fa640 1 -- 172.21.15.152:0/1121388056 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00580ed4c0 con 0x56363bf8aaf0 2024-09-11T22:11:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.309+0000 7f0070fe0740 1 -- 172.21.15.152:0/1121388056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 msgr2=0x56363bf8d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.309+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1121388056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 0x56363bf8d560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00580b8a90 tx=0x7f005803b720 comp rx=0 tx=0).stop 2024-09-11T22:11:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.309+0000 7f0070fe0740 1 -- 172.21.15.152:0/1121388056 shutdown_connections 2024-09-11T22:11:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.309+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1121388056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf95cb0 0x56363bfad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.309+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1121388056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf933b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.309+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1121388056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf8aaf0 0x56363bf8d560 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.309+0000 7f0070fe0740 1 -- 172.21.15.152:0/1121388056 >> 172.21.15.152:0/1121388056 conn(0x56363bf87060 msgr2=0x56363bf94b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.309+0000 7f0070fe0740 1 -- 172.21.15.152:0/1121388056 shutdown_connections 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.309+0000 7f0070fe0740 1 -- 172.21.15.152:0/1121388056 wait complete. 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.309+0000 7f0070fe0740 1 -- start start 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.309+0000 7f0070fe0740 1 Processor -- start 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 0x56363bf99a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf99fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0070fe0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf95cb0 0x56363bf9a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0070fe0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f00681a9cd0 con 0x56363bf8b410 2024-09-11T22:11:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0070fe0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f00681ab140 con 0x56363bf95cb0 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0070fe0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f00681aa3a0 con 0x56363bf8aaf0 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0070fe0740 10 client.0 _ll_register_callbacks cb 0x7f00580f3390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0066ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf99fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f00677fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 0x56363bf99a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0066ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf99fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39836/0 (socket says 172.21.15.152:39836) 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0066ffd640 1 -- 172.21.15.152:0/1677329593 learned_addr learned my addr 172.21.15.152:0/1677329593 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0067fff640 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf95cb0 0x56363bf9a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f00677fe640 1 -- 172.21.15.152:0/1677329593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf95cb0 msgr2=0x56363bf9a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f00677fe640 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf95cb0 0x56363bf9a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f00677fe640 1 -- 172.21.15.152:0/1677329593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 msgr2=0x56363bf99fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f00677fe640 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf99fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f00677fe640 1 -- 172.21.15.152:0/1677329593 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363bf87cf0 con 0x56363bf8aaf0 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f00677fe640 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 0x56363bf99a60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f00580bbdc0 tx=0x7f005802a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b25e2f5c4178ca64 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.310+0000 7f0046ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.311+0000 7f0046ffd640 1 -- 172.21.15.152:0/1677329593 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058049070 con 0x56363bf8aaf0 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.311+0000 7f0070fe0740 1 -- 172.21.15.152:0/1677329593 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00580bc0c0 con 0x56363bf8aaf0 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.311+0000 7f0046ffd640 1 -- 172.21.15.152:0/1677329593 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f00580bb510 con 0x56363bf8aaf0 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.311+0000 7f0046ffd640 1 -- 172.21.15.152:0/1677329593 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f00580bbe90 con 0x56363bf8aaf0 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.311+0000 7f0070fe0740 10 client.26797 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.311+0000 7f0070fe0740 1 -- 172.21.15.152:0/1677329593 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56363bf87cf0 con 0x56363bf8aaf0 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.312+0000 7f0046ffd640 1 -- 172.21.15.152:0/1677329593 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00580bc0c0 con 0x56363bf8aaf0 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.312+0000 7f0046ffd640 1 -- 172.21.15.152:0/1677329593 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f00580b7ea0 con 0x56363bf8aaf0 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.312+0000 7f0070fe0740 10 client.26797 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.312+0000 7f0070fe0740 10 client.26797 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.312+0000 7f0070fe0740 20 client.26797 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.312+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56363c010e20 0x56363c013240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.312+0000 7f0070fe0740 4 client.26797 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:11:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.312+0000 7f0070fe0740 1 -- 172.21.15.152:0/1677329593 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56363bef6d70 con 0x56363c010e20 2024-09-11T22:11:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.312+0000 7f0066ffd640 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56363c010e20 0x56363c013240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.313+0000 7f0046ffd640 10 client.26797 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.313+0000 7f0066ffd640 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56363c010e20 0x56363c013240 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b167d23b6899fadd server_cookie=7ea2bdb7e221c954 in_seq=0 out_seq=0 2024-09-11T22:11:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.319+0000 7f0046ffd640 1 -- 172.21.15.152:0/1677329593 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56363bef6d70 con 0x56363c010e20 2024-09-11T22:11:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.319+0000 7f0046ffd640 10 client.26797 handle_command_reply: tid=0 2024-09-11T22:11:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.319+0000 7f0070fe0740 1 client.26797 shutdown 2024-09-11T22:11:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0070fe0740 1 -- 172.21.15.152:0/1677329593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 msgr2=0x56363bf99a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 0x56363bf99a60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f00580bbdc0 tx=0x7f005802a480 comp rx=0 tx=0).stop 2024-09-11T22:11:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0070fe0740 1 -- 172.21.15.152:0/1677329593 shutdown_connections 2024-09-11T22:11:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56363c010e20 0x56363c013240 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56363bf95cb0 0x56363bf9a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56363bf8b410 0x56363bf99fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0046ffd640 0 client.26797 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0070fe0740 1 --2- 172.21.15.152:0/1677329593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56363bf8aaf0 0x56363bf99a60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0070fe0740 1 -- 172.21.15.152:0/1677329593 >> 172.21.15.152:0/1677329593 conn(0x56363bf87060 msgr2=0x56363bf859a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0070fe0740 1 -- 172.21.15.152:0/1677329593 shutdown_connections 2024-09-11T22:11:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0070fe0740 1 -- 172.21.15.152:0/1677329593 wait complete. 2024-09-11T22:11:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.320+0000 7f0070fe0740 20 client.26797 trim_cache size 0 max 16384 2024-09-11T22:11:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:11:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:11:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:11:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:11:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 -- 172.21.15.152:0/3250764618 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00500a7280 msgr2=0x7f00500a9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00500a7280 0x7f00500a9740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0060009fd0 tx=0x7f0060004a40 comp rx=0 tx=0).stop 2024-09-11T22:11:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 -- 172.21.15.152:0/3250764618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0068102d00 msgr2=0x7f0068196160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0068102d00 0x7f0068196160 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f005802a9f0 tx=0x7f0058003b90 comp rx=0 tx=0).stop 2024-09-11T22:11:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 -- 172.21.15.152:0/3250764618 shutdown_connections 2024-09-11T22:11:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00500a7280 0x7f00500a9740 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f006810c0d0 0x7f006819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0068103620 0x7f00681966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 --2- 172.21.15.152:0/3250764618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0068102d00 0x7f0068196160 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 -- 172.21.15.152:0/3250764618 >> 172.21.15.152:0/3250764618 conn(0x7f00680fc6b0 msgr2=0x7f00680fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 -- 172.21.15.152:0/3250764618 shutdown_connections 2024-09-11T22:11:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:11:49.321+0000 7f006e247640 1 -- 172.21.15.152:0/3250764618 wait complete. 2024-09-11T22:11:49.455 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:49 smithi152 ceph-mon[31188]: pgmap v230: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 489 op/s 2024-09-11T22:11:49.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:49 smithi179 ceph-mon[35603]: pgmap v230: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 489 op/s 2024-09-11T22:11:49.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:49 smithi193 ceph-mon[35545]: pgmap v230: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 489 op/s 2024-09-11T22:11:49.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.714+0000 7f5f35ee5640 1 -- 172.21.15.152:0/530857811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f301027a0 msgr2=0x7f5f301067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.714+0000 7f5f35ee5640 1 --2- 172.21.15.152:0/530857811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f301027a0 0x7f5f301067f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009900 tx=0x7f5f2402a410 comp rx=0 tx=0).stop 2024-09-11T22:11:49.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.714+0000 7f5f35ee5640 1 -- 172.21.15.152:0/530857811 shutdown_connections 2024-09-11T22:11:49.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.714+0000 7f5f35ee5640 1 --2- 172.21.15.152:0/530857811 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f30106f20 0x7f5f3010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.714+0000 7f5f35ee5640 1 --2- 172.21.15.152:0/530857811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f301027a0 0x7f5f301067f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.714+0000 7f5f35ee5640 1 --2- 172.21.15.152:0/530857811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f30101df0 0x7f5f301021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.714+0000 7f5f35ee5640 1 -- 172.21.15.152:0/530857811 >> 172.21.15.152:0/530857811 conn(0x7f5f300fd8f0 msgr2=0x7f5f300ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.714+0000 7f5f35ee5640 1 -- 172.21.15.152:0/530857811 shutdown_connections 2024-09-11T22:11:49.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.714+0000 7f5f35ee5640 1 -- 172.21.15.152:0/530857811 wait complete. 2024-09-11T22:11:49.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.714+0000 7f5f35ee5640 1 Processor -- start 2024-09-11T22:11:49.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.715+0000 7f5f35ee5640 1 -- start start 2024-09-11T22:11:49.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.715+0000 7f5f35ee5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f30101df0 0x7f5f30198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.715+0000 7f5f35ee5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f301027a0 0x7f5f30198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.716+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f30101df0 0x7f5f30198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.716+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f30101df0 0x7f5f30198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52466/0 (socket says 172.21.15.152:52466) 2024-09-11T22:11:49.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.716+0000 7f5f2f7fe640 1 -- 172.21.15.152:0/1641433069 learned_addr learned my addr 172.21.15.152:0/1641433069 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:49.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.716+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f301027a0 0x7f5f30198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.716+0000 7f5f35ee5640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f30106f20 0x7f5f3019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.717+0000 7f5f2ffff640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f30106f20 0x7f5f3019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.717+0000 7f5f35ee5640 1 -- 172.21.15.152:0/1641433069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5f30111f80 con 0x7f5f30106f20 2024-09-11T22:11:49.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.717+0000 7f5f35ee5640 1 -- 172.21.15.152:0/1641433069 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5f30111e00 con 0x7f5f30101df0 2024-09-11T22:11:49.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.717+0000 7f5f35ee5640 1 -- 172.21.15.152:0/1641433069 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f30112100 con 0x7f5f301027a0 2024-09-11T22:11:49.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.717+0000 7f5f2effd640 1 -- 172.21.15.152:0/1641433069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f30101df0 msgr2=0x7f5f30198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.717+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f30101df0 0x7f5f30198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.717+0000 7f5f2effd640 1 -- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f30106f20 msgr2=0x7f5f3019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.717+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f30106f20 0x7f5f3019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.717+0000 7f5f2effd640 1 -- 172.21.15.152:0/1641433069 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3019d3d0 con 0x7f5f301027a0 2024-09-11T22:11:49.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.717+0000 7f5f2ffff640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f30106f20 0x7f5f3019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:49.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.718+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f301027a0 0x7f5f30198960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5f24005940 tx=0x7f5f240040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.718+0000 7f5f2cff9640 1 -- 172.21.15.152:0/1641433069 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2403f030 con 0x7f5f301027a0 2024-09-11T22:11:49.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.718+0000 7f5f2cff9640 1 -- 172.21.15.152:0/1641433069 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f240044c0 con 0x7f5f301027a0 2024-09-11T22:11:49.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.718+0000 7f5f35ee5640 1 -- 172.21.15.152:0/1641433069 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3019d660 con 0x7f5f301027a0 2024-09-11T22:11:49.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.718+0000 7f5f2cff9640 1 -- 172.21.15.152:0/1641433069 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f24035070 con 0x7f5f301027a0 2024-09-11T22:11:49.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.718+0000 7f5f35ee5640 1 -- 172.21.15.152:0/1641433069 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f301a4fa0 con 0x7f5f301027a0 2024-09-11T22:11:49.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.720+0000 7f5f2cff9640 1 -- 172.21.15.152:0/1641433069 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f5f24042030 con 0x7f5f301027a0 2024-09-11T22:11:49.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.721+0000 7f5f382be740 1 Processor -- start 2024-09-11T22:11:49.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.721+0000 7f5f382be740 1 -- start start 2024-09-11T22:11:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f382be740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 0x5612f53cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f382be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f382be740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53d9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f382be740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5612f53322f0 con 0x5612f53cdb40 2024-09-11T22:11:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f382be740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5612f52d9cf0 con 0x5612f53d7370 2024-09-11T22:11:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f382be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5612f532e2b0 con 0x5612f53cc5d0 2024-09-11T22:11:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f2ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 0x5612f53cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53d9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52480/0 (socket says 172.21.15.152:52480) 2024-09-11T22:11:49.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f2effd640 1 -- 172.21.15.152:0/1644281129 learned_addr learned my addr 172.21.15.152:0/1644281129 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:49.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f2f7fe640 1 --2- 172.21.15.152:0/1644281129 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f2cff9640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5f180a2cf0 0x7f5f180a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f2effd640 1 -- 172.21.15.152:0/1644281129 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 msgr2=0x5612f53cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.722+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1644281129 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.723+0000 7f5f2effd640 1 -- 172.21.15.152:0/1644281129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 msgr2=0x5612f53cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.723+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1644281129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 0x5612f53cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.723+0000 7f5f2effd640 1 -- 172.21.15.152:0/1644281129 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612f52be3a0 con 0x5612f53d7370 2024-09-11T22:11:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.723+0000 7f5f2ffff640 1 --2- 172.21.15.152:0/1644281129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 0x5612f53cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.723+0000 7f5f2cff9640 1 -- 172.21.15.152:0/1641433069 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5f240ef7b0 con 0x7f5f301027a0 2024-09-11T22:11:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.723+0000 7f5f2ffff640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5f180a2cf0 0x7f5f180a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.723+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1644281129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53d9760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5f240ecd80 tx=0x7f5f24000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11b07b43ec17c174 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.723+0000 7f5f15ffb640 1 -- 172.21.15.152:0/1644281129 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f24049070 con 0x5612f53d7370 2024-09-11T22:11:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.723+0000 7f5f15ffb640 1 -- 172.21.15.152:0/1644281129 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f240bca20 con 0x5612f53d7370 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.723+0000 7f5f15ffb640 1 -- 172.21.15.152:0/1644281129 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f240bcd00 con 0x5612f53d7370 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.724+0000 7f5f382be740 1 -- 172.21.15.152:0/1644281129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 msgr2=0x5612f53d9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.724+0000 7f5f2ffff640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5f180a2cf0 0x7f5f180a51b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009fd0 tx=0x7f5f28004a40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.724+0000 7f5f382be740 1 --2- 172.21.15.152:0/1644281129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53d9760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5f240ecd80 tx=0x7f5f24000bc0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.724+0000 7f5f382be740 1 -- 172.21.15.152:0/1644281129 shutdown_connections 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.724+0000 7f5f382be740 1 --2- 172.21.15.152:0/1644281129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53d9760 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.724+0000 7f5f382be740 1 --2- 172.21.15.152:0/1644281129 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.724+0000 7f5f382be740 1 --2- 172.21.15.152:0/1644281129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 0x5612f53cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.724+0000 7f5f382be740 1 -- 172.21.15.152:0/1644281129 >> 172.21.15.152:0/1644281129 conn(0x5612f5395310 msgr2=0x5612f53c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.724+0000 7f5f382be740 1 -- 172.21.15.152:0/1644281129 shutdown_connections 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.724+0000 7f5f382be740 1 -- 172.21.15.152:0/1644281129 wait complete. 2024-09-11T22:11:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.725+0000 7f5f382be740 1 -- start start 2024-09-11T22:11:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.725+0000 7f5f382be740 1 Processor -- start 2024-09-11T22:11:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.725+0000 7f5f382be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53d6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.725+0000 7f5f382be740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53cdb40 0x5612f53cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.725+0000 7f5f382be740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53d7370 0x5612f53d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.725+0000 7f5f382be740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5612f53d9ca0 con 0x5612f53d7370 2024-09-11T22:11:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.725+0000 7f5f382be740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5612f52ed060 con 0x5612f53cdb40 2024-09-11T22:11:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.725+0000 7f5f382be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5612f53d9e20 con 0x5612f53cc5d0 2024-09-11T22:11:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.725+0000 7f5f382be740 10 client.0 _ll_register_callbacks cb 0x5612f50408c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.725+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53d6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.726+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53d6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43286/0 (socket says 172.21.15.152:43286) 2024-09-11T22:11:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.726+0000 7f5f2f7fe640 1 -- 172.21.15.152:0/1204219012 learned_addr learned my addr 172.21.15.152:0/1204219012 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.726+0000 7f5f2ffff640 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53d7370 0x5612f53d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.726+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53cdb40 0x5612f53cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.726+0000 7f5f2f7fe640 1 -- 172.21.15.152:0/1204219012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53cdb40 msgr2=0x5612f53cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.726+0000 7f5f2f7fe640 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53cdb40 0x5612f53cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.726+0000 7f5f2f7fe640 1 -- 172.21.15.152:0/1204219012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53d7370 msgr2=0x5612f53d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.726+0000 7f5f2f7fe640 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53d7370 0x5612f53d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.726+0000 7f5f2f7fe640 1 -- 172.21.15.152:0/1204219012 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612f50a33c0 con 0x5612f53cc5d0 2024-09-11T22:11:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.726+0000 7f5f2f7fe640 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53d6ca0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5f20012810 tx=0x7f5f20012cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76226cd9c3a8c670 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.726+0000 7f5f0effd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.727+0000 7f5f0effd640 1 -- 172.21.15.152:0/1204219012 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20004050 con 0x5612f53cc5d0 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.728+0000 7f5f382be740 1 -- 172.21.15.152:0/1204219012 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5612f533f860 con 0x5612f53cc5d0 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.728+0000 7f5f0effd640 1 -- 172.21.15.152:0/1204219012 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5f200041f0 con 0x5612f53cc5d0 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.728+0000 7f5f0effd640 1 -- 172.21.15.152:0/1204219012 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5f200043f0 con 0x5612f53cc5d0 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.728+0000 7f5f382be740 10 client.26809 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.728+0000 7f5f382be740 1 -- 172.21.15.152:0/1204219012 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5612f53ee0d0 con 0x5612f53cc5d0 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.728+0000 7f5f0effd640 1 -- 172.21.15.152:0/1204219012 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5612f533f860 con 0x5612f53cc5d0 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.728+0000 7f5f0effd640 1 -- 172.21.15.152:0/1204219012 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5f20003c70 con 0x5612f53cc5d0 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.729+0000 7f5f382be740 10 client.26809 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.729+0000 7f5f382be740 10 client.26809 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.729+0000 7f5f382be740 20 client.26809 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.729+0000 7f5f382be740 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5612f53ef4d0 0x5612f53f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.729+0000 7f5f382be740 4 client.26809 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.729+0000 7f5f382be740 1 -- 172.21.15.152:0/1204219012 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612f5339d70 con 0x5612f53ef4d0 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.729+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5612f53ef4d0 0x5612f53f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.729+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5612f53ef4d0 0x5612f53f18c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=54b870645ed5480d server_cookie=10e8c89601ef105b in_seq=0 out_seq=0 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.729+0000 7f5f0effd640 10 client.26809 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f0effd640 1 -- 172.21.15.152:0/1204219012 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612f5339d70 con 0x5612f53ef4d0 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f0effd640 10 client.26809 handle_command_reply: tid=0 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 1 client.26809 shutdown 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 1 -- 172.21.15.152:0/1204219012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 msgr2=0x5612f53d6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53d6ca0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5f20012810 tx=0x7f5f20012cd0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 1 -- 172.21.15.152:0/1204219012 shutdown_connections 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5612f53ef4d0 0x5612f53f18c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53d7370 0x5612f53d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53cdb40 0x5612f53cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f0effd640 0 client.26809 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:11:49.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 1 --2- 172.21.15.152:0/1204219012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53d6ca0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 1 -- 172.21.15.152:0/1204219012 >> 172.21.15.152:0/1204219012 conn(0x5612f5395310 msgr2=0x5612f53ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 1 -- 172.21.15.152:0/1204219012 shutdown_connections 2024-09-11T22:11:49.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 1 -- 172.21.15.152:0/1204219012 wait complete. 2024-09-11T22:11:49.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.730+0000 7f5f382be740 20 client.26809 trim_cache size 0 max 16384 2024-09-11T22:11:49.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.747+0000 7f5f382be740 1 Processor -- start 2024-09-11T22:11:49.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.747+0000 7f5f382be740 1 -- start start 2024-09-11T22:11:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.747+0000 7f5f382be740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cc5d0 0x5612f53f7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.747+0000 7f5f382be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cdb40 0x5612f53f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.747+0000 7f5f382be740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53dbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.747+0000 7f5f382be740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301ae1a0 con 0x5612f53cc5d0 2024-09-11T22:11:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.748+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cdb40 0x5612f53f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.748+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cdb40 0x5612f53f76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43302/0 (socket says 172.21.15.152:43302) 2024-09-11T22:11:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.748+0000 7f5f2effd640 1 -- 172.21.15.152:0/1573623184 learned_addr learned my addr 172.21.15.152:0/1573623184 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.748+0000 7f5f382be740 1 -- 172.21.15.152:0/1573623184 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301aba70 con 0x5612f53d7370 2024-09-11T22:11:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.748+0000 7f5f382be740 1 -- 172.21.15.152:0/1573623184 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301a98e0 con 0x5612f53cdb40 2024-09-11T22:11:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.748+0000 7f5f2f7fe640 1 --2- 172.21.15.152:0/1573623184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cc5d0 0x5612f53f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.748+0000 7f5f2effd640 1 -- 172.21.15.152:0/1573623184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 msgr2=0x5612f53dbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.748+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1573623184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53dbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.748+0000 7f5f2effd640 1 -- 172.21.15.152:0/1573623184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cc5d0 msgr2=0x5612f53f7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.748+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1573623184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cc5d0 0x5612f53f7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.748+0000 7f5f2effd640 1 -- 172.21.15.152:0/1573623184 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612f53da920 con 0x5612f53cdb40 2024-09-11T22:11:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.749+0000 7f5f2effd640 1 --2- 172.21.15.152:0/1573623184 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cdb40 0x5612f53f76d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f2402a930 tx=0x7f5f2402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff272446c8e4a962 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.749+0000 7f5f157fa640 1 -- 172.21.15.152:0/1573623184 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f24049040 con 0x5612f53cdb40 2024-09-11T22:11:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.749+0000 7f5f157fa640 1 -- 172.21.15.152:0/1573623184 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f240d2070 con 0x5612f53cdb40 2024-09-11T22:11:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.749+0000 7f5f157fa640 1 -- 172.21.15.152:0/1573623184 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f240b9df0 con 0x5612f53cdb40 2024-09-11T22:11:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.750+0000 7f5f382be740 1 -- 172.21.15.152:0/1573623184 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cdb40 msgr2=0x5612f53f76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.750+0000 7f5f382be740 1 --2- 172.21.15.152:0/1573623184 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cdb40 0x5612f53f76d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f2402a930 tx=0x7f5f2402a410 comp rx=0 tx=0).stop 2024-09-11T22:11:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.750+0000 7f5f382be740 1 -- 172.21.15.152:0/1573623184 shutdown_connections 2024-09-11T22:11:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.750+0000 7f5f382be740 1 --2- 172.21.15.152:0/1573623184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53dbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.750+0000 7f5f382be740 1 --2- 172.21.15.152:0/1573623184 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cdb40 0x5612f53f76d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.750+0000 7f5f382be740 1 --2- 172.21.15.152:0/1573623184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cc5d0 0x5612f53f7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.750+0000 7f5f382be740 1 -- 172.21.15.152:0/1573623184 >> 172.21.15.152:0/1573623184 conn(0x5612f5395310 msgr2=0x5612f53d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.750+0000 7f5f382be740 1 -- 172.21.15.152:0/1573623184 shutdown_connections 2024-09-11T22:11:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.750+0000 7f5f382be740 1 -- 172.21.15.152:0/1573623184 wait complete. 2024-09-11T22:11:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.750+0000 7f5f382be740 1 -- start start 2024-09-11T22:11:49.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f382be740 1 Processor -- start 2024-09-11T22:11:49.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f382be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53e78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f382be740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 0x5612f53e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f382be740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53e8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f382be740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301a9f30 con 0x5612f53cdb40 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f382be740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301ab3a0 con 0x5612f53d7370 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f382be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301aa600 con 0x5612f53cc5d0 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f382be740 10 client.0 _ll_register_callbacks cb 0x7f5f200099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 0x5612f53e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 0x5612f53e7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39900/0 (socket says 172.21.15.152:39900) 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f2effd640 1 -- 172.21.15.152:0/390557378 learned_addr learned my addr 172.21.15.152:0/390557378 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f2ffff640 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.751+0000 7f5f2f7fe640 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f2ffff640 1 -- 172.21.15.152:0/390557378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 msgr2=0x5612f53e78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f2ffff640 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53e78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f2ffff640 1 -- 172.21.15.152:0/390557378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 msgr2=0x5612f53e7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f2ffff640 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 0x5612f53e7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f2ffff640 1 -- 172.21.15.152:0/390557378 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612f5459160 con 0x5612f53d7370 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f2f7fe640 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53e78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f2ffff640 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53e8320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5612f53d7340 tx=0x7f5f28009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10ba59c3b1cd4fd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f0effd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f0effd640 1 -- 172.21.15.152:0/390557378 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2802c020 con 0x5612f53d7370 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f382be740 1 -- 172.21.15.152:0/390557378 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f240d2070 con 0x5612f53d7370 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f0effd640 1 -- 172.21.15.152:0/390557378 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5f2800e740 con 0x5612f53d7370 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f0effd640 1 -- 172.21.15.152:0/390557378 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5f28037050 con 0x5612f53d7370 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f382be740 10 client.26657 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f382be740 1 -- 172.21.15.152:0/390557378 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5612f545a430 con 0x5612f53d7370 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.752+0000 7f5f0effd640 1 -- 172.21.15.152:0/390557378 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f240d2070 con 0x5612f53d7370 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.753+0000 7f5f0effd640 1 -- 172.21.15.152:0/390557378 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5f28028b20 con 0x5612f53d7370 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.753+0000 7f5f382be740 10 client.26657 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.753+0000 7f5f382be740 10 client.26657 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.753+0000 7f5f382be740 20 client.26657 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.753+0000 7f5f382be740 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5612f545ab80 0x5612f545cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.753+0000 7f5f382be740 4 client.26657 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.753+0000 7f5f382be740 1 -- 172.21.15.152:0/390557378 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5612f52b6170 con 0x5612f545ab80 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.753+0000 7f5f2f7fe640 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5612f545ab80 0x5612f545cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.753+0000 7f5f2f7fe640 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5612f545ab80 0x5612f545cfa0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f354347c6d5b9aa server_cookie=1c737fa6d3b5ba1c in_seq=0 out_seq=0 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f0effd640 10 client.26657 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:11:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f0effd640 1 -- 172.21.15.152:0/390557378 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5612f52b6170 con 0x5612f545ab80 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f0effd640 10 client.26657 handle_command_reply: tid=0 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f382be740 1 client.26657 shutdown 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f382be740 1 -- 172.21.15.152:0/390557378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 msgr2=0x5612f53e8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f382be740 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53e8320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5612f53d7340 tx=0x7f5f28009500 comp rx=0 tx=0).stop 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f382be740 1 -- 172.21.15.152:0/390557378 shutdown_connections 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f382be740 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5612f545ab80 0x5612f545cfa0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f382be740 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612f53d7370 0x5612f53e8320 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f382be740 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612f53cdb40 0x5612f53e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f382be740 1 --2- 172.21.15.152:0/390557378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612f53cc5d0 0x5612f53e78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f382be740 1 -- 172.21.15.152:0/390557378 >> 172.21.15.152:0/390557378 conn(0x5612f5395310 msgr2=0x5612f53c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.754+0000 7f5f0effd640 0 client.26657 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:11:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.755+0000 7f5f382be740 1 -- 172.21.15.152:0/390557378 shutdown_connections 2024-09-11T22:11:49.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.755+0000 7f5f382be740 1 -- 172.21.15.152:0/390557378 wait complete. 2024-09-11T22:11:49.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.755+0000 7f5f382be740 20 client.26657 trim_cache size 0 max 16384 2024-09-11T22:11:49.762 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:11:49.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 -- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5f180a2cf0 msgr2=0x7f5f180a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5f180a2cf0 0x7f5f180a51b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009fd0 tx=0x7f5f28004a40 comp rx=0 tx=0).stop 2024-09-11T22:11:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 -- 172.21.15.152:0/1641433069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f301027a0 msgr2=0x7f5f30198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f301027a0 0x7f5f30198960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5f24005940 tx=0x7f5f240040c0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 -- 172.21.15.152:0/1641433069 shutdown_connections 2024-09-11T22:11:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5f180a2cf0 0x7f5f180a51b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f30106f20 0x7f5f3019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f301027a0 0x7f5f30198960 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 --2- 172.21.15.152:0/1641433069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f30101df0 0x7f5f30198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 -- 172.21.15.152:0/1641433069 >> 172.21.15.152:0/1641433069 conn(0x7f5f300fd8f0 msgr2=0x7f5f300fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 -- 172.21.15.152:0/1641433069 shutdown_connections 2024-09-11T22:11:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:49.756+0000 7f5f35ee5640 1 -- 172.21.15.152:0/1641433069 wait complete. 2024-09-11T22:11:49.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 375.0 s, 2360.8 tps, lat 41.801 ms stddev 69.537 2024-09-11T22:11:50.653 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:11:51.046 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:51.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:51 smithi152 ceph-mon[31188]: pgmap v231: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 28 MiB/s wr, 1.84k op/s 2024-09-11T22:11:51.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:51 smithi179 ceph-mon[35603]: pgmap v231: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 28 MiB/s wr, 1.84k op/s 2024-09-11T22:11:51.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:51 smithi193 ceph-mon[35545]: pgmap v231: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 28 MiB/s wr, 1.84k op/s 2024-09-11T22:11:51.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.679+0000 7faf8bd46640 1 -- 172.21.15.152:0/2111260377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf841049a0 msgr2=0x7faf841089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.679+0000 7faf8bd46640 1 --2- 172.21.15.152:0/2111260377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf841049a0 0x7faf841089f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faf74009860 tx=0x7faf7402a360 comp rx=0 tx=0).stop 2024-09-11T22:11:51.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.682+0000 7faf8bd46640 1 -- 172.21.15.152:0/2111260377 shutdown_connections 2024-09-11T22:11:51.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.682+0000 7faf8bd46640 1 --2- 172.21.15.152:0/2111260377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf84109120 0x7faf84110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.682+0000 7faf8bd46640 1 --2- 172.21.15.152:0/2111260377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf841049a0 0x7faf841089f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.682+0000 7faf8bd46640 1 --2- 172.21.15.152:0/2111260377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf84103ff0 0x7faf841043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.682+0000 7faf8bd46640 1 -- 172.21.15.152:0/2111260377 >> 172.21.15.152:0/2111260377 conn(0x7faf840ffab0 msgr2=0x7faf84101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.682+0000 7faf8bd46640 1 -- 172.21.15.152:0/2111260377 shutdown_connections 2024-09-11T22:11:51.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.682+0000 7faf8bd46640 1 -- 172.21.15.152:0/2111260377 wait complete. 2024-09-11T22:11:51.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.683+0000 7faf8bd46640 1 Processor -- start 2024-09-11T22:11:51.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.683+0000 7faf8bd46640 1 -- start start 2024-09-11T22:11:51.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.683+0000 7faf8bd46640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf84103ff0 0x7faf84076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.683+0000 7faf8bd46640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf841049a0 0x7faf84076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.683+0000 7faf8bd46640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf84109120 0x7faf84077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.683+0000 7faf8bd46640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf84114120 con 0x7faf84103ff0 2024-09-11T22:11:51.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.683+0000 7faf8bd46640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faf84113fa0 con 0x7faf84109120 2024-09-11T22:11:51.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.683+0000 7faf8bd46640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faf841142a0 con 0x7faf841049a0 2024-09-11T22:11:51.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.683+0000 7faf89ae2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf84103ff0 0x7faf84076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.684+0000 7faf89ae2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf84103ff0 0x7faf84076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39906/0 (socket says 172.21.15.152:39906) 2024-09-11T22:11:51.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.684+0000 7faf89ae2640 1 -- 172.21.15.152:0/1910147361 learned_addr learned my addr 172.21.15.152:0/1910147361 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:51.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.684+0000 7faf892e1640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf841049a0 0x7faf84076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.684+0000 7faf8a2e3640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf84109120 0x7faf84077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.684+0000 7faf892e1640 1 -- 172.21.15.152:0/1910147361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf84109120 msgr2=0x7faf84077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.684+0000 7faf892e1640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf84109120 0x7faf84077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.684+0000 7faf892e1640 1 -- 172.21.15.152:0/1910147361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf84103ff0 msgr2=0x7faf84076700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.684+0000 7faf892e1640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf84103ff0 0x7faf84076700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.684+0000 7faf892e1640 1 -- 172.21.15.152:0/1910147361 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf841aab40 con 0x7faf841049a0 2024-09-11T22:11:51.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.684+0000 7faf892e1640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf841049a0 0x7faf84076c40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faf74009780 tx=0x7faf74033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.685+0000 7faf7affd640 1 -- 172.21.15.152:0/1910147361 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74037040 con 0x7faf841049a0 2024-09-11T22:11:51.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.685+0000 7faf8bd46640 1 -- 172.21.15.152:0/1910147361 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf841aadd0 con 0x7faf841049a0 2024-09-11T22:11:51.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.685+0000 7faf7affd640 1 -- 172.21.15.152:0/1910147361 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf74042070 con 0x7faf841049a0 2024-09-11T22:11:51.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.685+0000 7faf7affd640 1 -- 172.21.15.152:0/1910147361 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74003970 con 0x7faf841049a0 2024-09-11T22:11:51.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.685+0000 7faf8bd46640 1 -- 172.21.15.152:0/1910147361 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf841ab1c0 con 0x7faf841049a0 2024-09-11T22:11:51.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.688+0000 7faf7affd640 1 -- 172.21.15.152:0/1910147361 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7faf74030520 con 0x7faf841049a0 2024-09-11T22:11:51.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.689+0000 7faf7affd640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faf700a2df0 0x7faf700a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.690+0000 7faf7affd640 1 -- 172.21.15.152:0/1910147361 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7faf740ef430 con 0x7faf841049a0 2024-09-11T22:11:51.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.690+0000 7faf8e11f740 1 Processor -- start 2024-09-11T22:11:51.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.690+0000 7faf89ae2640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faf700a2df0 0x7faf700a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.690+0000 7faf8e11f740 1 -- start start 2024-09-11T22:11:51.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf89ae2640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faf700a2df0 0x7faf700a52b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faf800058c0 tx=0x7faf8000a380 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fd7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fd7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9fe4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf8e11f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fdf9f3d2f0 con 0x55fdf9fd75d0 2024-09-11T22:11:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf8e11f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fdf9ee4cf0 con 0x55fdf9fe2370 2024-09-11T22:11:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf8e11f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fdf9f392b0 con 0x55fdf9fd8b40 2024-09-11T22:11:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf892e1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fd7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf892e1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fd7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39908/0 (socket says 172.21.15.152:39908) 2024-09-11T22:11:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf892e1640 1 -- 172.21.15.152:0/3733900977 learned_addr learned my addr 172.21.15.152:0/3733900977 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf89ae2640 1 --2- 172.21.15.152:0/3733900977 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fd7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf892e1640 1 -- 172.21.15.152:0/3733900977 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd8b40 msgr2=0x55fdf9fd7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf892e1640 1 --2- 172.21.15.152:0/3733900977 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fd7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf892e1640 1 -- 172.21.15.152:0/3733900977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 msgr2=0x55fdf9fe4760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:11:51.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf892e1640 1 --2- 172.21.15.152:0/3733900977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9fe4760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.691+0000 7faf892e1640 1 -- 172.21.15.152:0/3733900977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdf9ec93a0 con 0x55fdf9fd75d0 2024-09-11T22:11:51.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.692+0000 7faf892e1640 1 --2- 172.21.15.152:0/3733900977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fd7a10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faf740b7e00 tx=0x7faf740045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a041e6700bfa9df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.692+0000 7faf6ffff640 1 -- 172.21.15.152:0/3733900977 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf740bb300 con 0x55fdf9fd75d0 2024-09-11T22:11:51.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.692+0000 7faf6ffff640 1 -- 172.21.15.152:0/3733900977 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf7400b0b0 con 0x55fdf9fd75d0 2024-09-11T22:11:51.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.692+0000 7faf6ffff640 1 -- 172.21.15.152:0/3733900977 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74004240 con 0x55fdf9fd75d0 2024-09-11T22:11:51.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.693+0000 7faf8e11f740 1 -- 172.21.15.152:0/3733900977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd75d0 msgr2=0x55fdf9fd7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.693+0000 7faf8e11f740 1 --2- 172.21.15.152:0/3733900977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fd7a10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faf740b7e00 tx=0x7faf740045d0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.694+0000 7faf8e11f740 1 -- 172.21.15.152:0/3733900977 shutdown_connections 2024-09-11T22:11:51.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.694+0000 7faf8e11f740 1 --2- 172.21.15.152:0/3733900977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9fe4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.694+0000 7faf8e11f740 1 --2- 172.21.15.152:0/3733900977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fd7a10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.694+0000 7faf8e11f740 1 --2- 172.21.15.152:0/3733900977 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fd7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.694+0000 7faf8e11f740 1 -- 172.21.15.152:0/3733900977 >> 172.21.15.152:0/3733900977 conn(0x55fdf9fa0310 msgr2=0x55fdf9fd3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.694+0000 7faf8e11f740 1 -- 172.21.15.152:0/3733900977 shutdown_connections 2024-09-11T22:11:51.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.695+0000 7faf8e11f740 1 -- 172.21.15.152:0/3733900977 wait complete. 2024-09-11T22:11:51.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.695+0000 7faf8e11f740 1 -- start start 2024-09-11T22:11:51.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.695+0000 7faf8e11f740 1 Processor -- start 2024-09-11T22:11:51.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fdf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fdf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9fdfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8e11f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fdf9fe4e30 con 0x55fdf9fd8b40 2024-09-11T22:11:51.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8e11f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fdf9ef8060 con 0x55fdf9fe2370 2024-09-11T22:11:51.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8e11f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fdf9fe4fb0 con 0x55fdf9fd75d0 2024-09-11T22:11:51.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8a2e3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9fdfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8a2e3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9fdfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52540/0 (socket says 172.21.15.152:52540) 2024-09-11T22:11:51.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8a2e3640 1 -- 172.21.15.152:0/1033362906 learned_addr learned my addr 172.21.15.152:0/1033362906 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:51.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf892e1640 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fdf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf89ae2640 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fdf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8e11f740 10 client.0 _ll_register_callbacks cb 0x55fdf9c4b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:51.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8a2e3640 1 -- 172.21.15.152:0/1033362906 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 msgr2=0x55fdf9fdf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8a2e3640 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fdf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8a2e3640 1 -- 172.21.15.152:0/1033362906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd8b40 msgr2=0x55fdf9fdf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8a2e3640 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fdf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.696+0000 7faf8a2e3640 1 -- 172.21.15.152:0/1033362906 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdf9cae3c0 con 0x55fdf9fe2370 2024-09-11T22:11:51.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.697+0000 7faf8a2e3640 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9fdfb70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00fb10 tx=0x7faf7c00c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d66f35a7e49de702 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.697+0000 7faf6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:11:51.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.697+0000 7faf6d7fa640 1 -- 172.21.15.152:0/1033362906 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00cc80 con 0x55fdf9fe2370 2024-09-11T22:11:51.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.697+0000 7faf6d7fa640 1 -- 172.21.15.152:0/1033362906 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7faf7c003970 con 0x55fdf9fe2370 2024-09-11T22:11:51.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.697+0000 7faf8e11f740 1 -- 172.21.15.152:0/1033362906 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf7400b0b0 con 0x55fdf9fe2370 2024-09-11T22:11:51.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.697+0000 7faf6d7fa640 1 -- 172.21.15.152:0/1033362906 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faf7c00ce20 con 0x55fdf9fe2370 2024-09-11T22:11:51.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.697+0000 7faf8e11f740 10 client.26666 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:51.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.697+0000 7faf8e11f740 1 -- 172.21.15.152:0/1033362906 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fdf9ff0940 con 0x55fdf9fe2370 2024-09-11T22:11:51.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.697+0000 7faf6d7fa640 1 -- 172.21.15.152:0/1033362906 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf7400b0b0 con 0x55fdf9fe2370 2024-09-11T22:11:51.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.698+0000 7faf6d7fa640 1 -- 172.21.15.152:0/1033362906 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7faf7c00b040 con 0x55fdf9fe2370 2024-09-11T22:11:51.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.698+0000 7faf8e11f740 10 client.26666 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:51.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.698+0000 7faf8e11f740 10 client.26666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:51.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.698+0000 7faf8e11f740 20 client.26666 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:51.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.698+0000 7faf8e11f740 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fdf9ff1ea0 0x55fdf9ff4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.698+0000 7faf8e11f740 4 client.26666 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:51.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.698+0000 7faf8e11f740 1 -- 172.21.15.152:0/1033362906 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdf9f4a860 con 0x55fdf9ff1ea0 2024-09-11T22:11:51.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.698+0000 7faf89ae2640 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fdf9ff1ea0 0x55fdf9ff4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.699+0000 7faf6d7fa640 10 client.26666 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:51.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.699+0000 7faf89ae2640 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fdf9ff1ea0 0x55fdf9ff4300 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=961d83557ebf1cbd server_cookie=df6d6708915cd946 in_seq=0 out_seq=0 2024-09-11T22:11:51.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.699+0000 7faf6d7fa640 1 -- 172.21.15.152:0/1033362906 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fdf9f4a860 con 0x55fdf9ff1ea0 2024-09-11T22:11:51.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.699+0000 7faf6d7fa640 10 client.26666 handle_command_reply: tid=0 2024-09-11T22:11:51.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.699+0000 7faf8e11f740 1 client.26666 shutdown 2024-09-11T22:11:51.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.700+0000 7faf8e11f740 1 -- 172.21.15.152:0/1033362906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 msgr2=0x55fdf9fdfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.700+0000 7faf8e11f740 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9fdfb70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00fb10 tx=0x7faf7c00c370 comp rx=0 tx=0).stop 2024-09-11T22:11:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.700+0000 7faf8e11f740 1 -- 172.21.15.152:0/1033362906 shutdown_connections 2024-09-11T22:11:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.700+0000 7faf8e11f740 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fdf9ff1ea0 0x55fdf9ff4300 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.700+0000 7faf8e11f740 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9fdfb70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.700+0000 7faf8e11f740 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fdf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.700+0000 7faf8e11f740 1 --2- 172.21.15.152:0/1033362906 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fdf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.700+0000 7faf8e11f740 1 -- 172.21.15.152:0/1033362906 >> 172.21.15.152:0/1033362906 conn(0x55fdf9fa0310 msgr2=0x55fdf9fd9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.700+0000 7faf6d7fa640 0 client.26666 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.704+0000 7faf8e11f740 1 -- 172.21.15.152:0/1033362906 shutdown_connections 2024-09-11T22:11:51.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.706+0000 7faf8e11f740 1 -- 172.21.15.152:0/1033362906 wait complete. 2024-09-11T22:11:51.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.709+0000 7faf8e11f740 20 client.26666 trim_cache size 0 max 16384 2024-09-11T22:11:51.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.745+0000 7faf8e11f740 1 Processor -- start 2024-09-11T22:11:51.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.745+0000 7faf8e11f740 1 -- start start 2024-09-11T22:11:51.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.745+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fdf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.745+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd8b40 0x55fdf9ff9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.746+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9ffa110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.746+0000 7faf8e11f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf68011160 con 0x55fdf9fd8b40 2024-09-11T22:11:51.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.746+0000 7faf8e11f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faf6800ea30 con 0x55fdf9fe2370 2024-09-11T22:11:51.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.746+0000 7faf8e11f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faf6800c8a0 con 0x55fdf9fd75d0 2024-09-11T22:11:51.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.746+0000 7faf8a2e3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9ffa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.746+0000 7faf89ae2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fdf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.746+0000 7faf89ae2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fdf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43358/0 (socket says 172.21.15.152:43358) 2024-09-11T22:11:51.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.746+0000 7faf8a2e3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9ffa110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52546/0 (socket says 172.21.15.152:52546) 2024-09-11T22:11:51.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.746+0000 7faf89ae2640 1 -- 172.21.15.152:0/2621792556 learned_addr learned my addr 172.21.15.152:0/2621792556 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:51.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.746+0000 7faf892e1640 1 --2- 172.21.15.152:0/2621792556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd8b40 0x55fdf9ff9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.747+0000 7faf892e1640 1 -- 172.21.15.152:0/2621792556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 msgr2=0x55fdf9fdf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.747+0000 7faf892e1640 1 --2- 172.21.15.152:0/2621792556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fdf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.747+0000 7faf892e1640 1 -- 172.21.15.152:0/2621792556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 msgr2=0x55fdf9ffa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.747+0000 7faf892e1640 1 --2- 172.21.15.152:0/2621792556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9ffa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.747+0000 7faf892e1640 1 -- 172.21.15.152:0/2621792556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdf9fdd640 con 0x55fdf9fd8b40 2024-09-11T22:11:51.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.748+0000 7faf892e1640 1 --2- 172.21.15.152:0/2621792556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd8b40 0x55fdf9ff9bd0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7faf740b8320 tx=0x7faf740ef350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0bc456eadfa598 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.748+0000 7faf6f7fe640 1 -- 172.21.15.152:0/2621792556 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf740d3070 con 0x55fdf9fd8b40 2024-09-11T22:11:51.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.748+0000 7faf6f7fe640 1 -- 172.21.15.152:0/2621792556 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf7400b0b0 con 0x55fdf9fd8b40 2024-09-11T22:11:51.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.748+0000 7faf6f7fe640 1 -- 172.21.15.152:0/2621792556 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74004240 con 0x55fdf9fd8b40 2024-09-11T22:11:51.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.749+0000 7faf8e11f740 1 -- 172.21.15.152:0/2621792556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd8b40 msgr2=0x55fdf9ff9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.749+0000 7faf8e11f740 1 --2- 172.21.15.152:0/2621792556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd8b40 0x55fdf9ff9bd0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7faf740b8320 tx=0x7faf740ef350 comp rx=0 tx=0).stop 2024-09-11T22:11:51.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.749+0000 7faf8e11f740 1 -- 172.21.15.152:0/2621792556 shutdown_connections 2024-09-11T22:11:51.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.749+0000 7faf8e11f740 1 --2- 172.21.15.152:0/2621792556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fe2370 0x55fdf9ffa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.749+0000 7faf8e11f740 1 --2- 172.21.15.152:0/2621792556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fd8b40 0x55fdf9ff9bd0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.749+0000 7faf8e11f740 1 --2- 172.21.15.152:0/2621792556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fdf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.749+0000 7faf8e11f740 1 -- 172.21.15.152:0/2621792556 >> 172.21.15.152:0/2621792556 conn(0x55fdf9fa0310 msgr2=0x55fdf9fde1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.750+0000 7faf8e11f740 1 -- 172.21.15.152:0/2621792556 shutdown_connections 2024-09-11T22:11:51.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.750+0000 7faf8e11f740 1 -- 172.21.15.152:0/2621792556 wait complete. 2024-09-11T22:11:51.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.750+0000 7faf8e11f740 1 -- start start 2024-09-11T22:11:51.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.751+0000 7faf8e11f740 1 Processor -- start 2024-09-11T22:11:51.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.751+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fe5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.751+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fe5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.751+0000 7faf8e11f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fe2370 0x55fdfa05ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.751+0000 7faf8e11f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf6800cef0 con 0x55fdf9fe2370 2024-09-11T22:11:51.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.751+0000 7faf8e11f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faf6800e360 con 0x55fdf9fd8b40 2024-09-11T22:11:51.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.751+0000 7faf8e11f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faf6800d5c0 con 0x55fdf9fd75d0 2024-09-11T22:11:51.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.751+0000 7faf8e11f740 10 client.0 _ll_register_callbacks cb 0x7faf7c009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:51.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.751+0000 7faf89ae2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fe5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.751+0000 7faf89ae2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fe5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:43370/0 (socket says 172.21.15.152:43370) 2024-09-11T22:11:51.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.751+0000 7faf89ae2640 1 -- 172.21.15.152:0/292919788 learned_addr learned my addr 172.21.15.152:0/292919788 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:51.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.753+0000 7faf8a2e3640 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fe2370 0x55fdfa05ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.754+0000 7faf8a2e3640 1 -- 172.21.15.152:0/292919788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 msgr2=0x55fdf9fe5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.754+0000 7faf8a2e3640 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fe5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.754+0000 7faf892e1640 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fe5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.754+0000 7faf8a2e3640 1 -- 172.21.15.152:0/292919788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fd8b40 msgr2=0x55fdf9fe5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.754+0000 7faf8a2e3640 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fe5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.754+0000 7faf8a2e3640 1 -- 172.21.15.152:0/292919788 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdfa05b0d0 con 0x55fdf9fe2370 2024-09-11T22:11:51.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.754+0000 7faf892e1640 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fe5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:51.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.754+0000 7faf8a2e3640 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fe2370 0x55fdfa05ab90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0186f0 tx=0x7faf7c004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd6ed9ff1bc4ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.754+0000 7faf6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:11:51.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.755+0000 7faf6d7fa640 1 -- 172.21.15.152:0/292919788 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00f240 con 0x55fdf9fe2370 2024-09-11T22:11:51.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.755+0000 7faf6d7fa640 1 -- 172.21.15.152:0/292919788 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7faf7c00e440 con 0x55fdf9fe2370 2024-09-11T22:11:51.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.755+0000 7faf8e11f740 1 -- 172.21.15.152:0/292919788 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf7400b0b0 con 0x55fdf9fe2370 2024-09-11T22:11:51.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.755+0000 7faf6d7fa640 1 -- 172.21.15.152:0/292919788 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faf7c00e640 con 0x55fdf9fe2370 2024-09-11T22:11:51.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.755+0000 7faf8e11f740 10 client.17268 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:51.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.755+0000 7faf8e11f740 1 -- 172.21.15.152:0/292919788 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fdfa05c3a0 con 0x55fdf9fe2370 2024-09-11T22:11:51.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.755+0000 7faf6d7fa640 1 -- 172.21.15.152:0/292919788 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf7c00ecc0 con 0x55fdf9fe2370 2024-09-11T22:11:51.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.756+0000 7faf6d7fa640 1 -- 172.21.15.152:0/292919788 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7faf7c029070 con 0x55fdf9fe2370 2024-09-11T22:11:51.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.756+0000 7faf8e11f740 10 client.17268 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:51.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.756+0000 7faf8e11f740 10 client.17268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:51.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.756+0000 7faf8e11f740 20 client.17268 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:51.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.756+0000 7faf8e11f740 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fdfa05cb10 0x55fdfa05ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.756+0000 7faf8e11f740 4 client.17268 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:11:51.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.756+0000 7faf8e11f740 1 -- 172.21.15.152:0/292919788 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7faf7400b0b0 con 0x55fdfa05cb10 2024-09-11T22:11:51.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.756+0000 7faf89ae2640 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fdfa05cb10 0x55fdfa05ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf89ae2640 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fdfa05cb10 0x55fdfa05ef30 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e4abeff2158657e server_cookie=38ce6c478d14a0bc in_seq=0 out_seq=0 2024-09-11T22:11:51.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf6d7fa640 10 client.17268 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:51.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf6d7fa640 1 -- 172.21.15.152:0/292919788 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7faf7400b0b0 con 0x55fdfa05cb10 2024-09-11T22:11:51.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf6d7fa640 10 client.17268 handle_command_reply: tid=0 2024-09-11T22:11:51.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf8e11f740 1 client.17268 shutdown 2024-09-11T22:11:51.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf8e11f740 1 -- 172.21.15.152:0/292919788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fe2370 msgr2=0x55fdfa05ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf8e11f740 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fe2370 0x55fdfa05ab90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0186f0 tx=0x7faf7c004d70 comp rx=0 tx=0).stop 2024-09-11T22:11:51.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf8e11f740 1 -- 172.21.15.152:0/292919788 shutdown_connections 2024-09-11T22:11:51.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf8e11f740 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fdfa05cb10 0x55fdfa05ef30 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf8e11f740 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdf9fe2370 0x55fdfa05ab90 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf8e11f740 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fdf9fd8b40 0x55fdf9fe5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf8e11f740 1 --2- 172.21.15.152:0/292919788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fdf9fd75d0 0x55fdf9fe5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf6d7fa640 0 client.17268 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:51.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.758+0000 7faf8e11f740 1 -- 172.21.15.152:0/292919788 >> 172.21.15.152:0/292919788 conn(0x55fdf9fa0310 msgr2=0x55fdf9fed080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.759+0000 7faf8e11f740 1 -- 172.21.15.152:0/292919788 shutdown_connections 2024-09-11T22:11:51.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.759+0000 7faf8e11f740 1 -- 172.21.15.152:0/292919788 wait complete. 2024-09-11T22:11:51.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.759+0000 7faf8e11f740 20 client.17268 trim_cache size 0 max 16384 2024-09-11T22:11:51.762 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:11:51.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.759+0000 7faf8bd46640 1 -- 172.21.15.152:0/1910147361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faf700a2df0 msgr2=0x7faf700a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.759+0000 7faf8bd46640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faf700a2df0 0x7faf700a52b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faf800058c0 tx=0x7faf8000a380 comp rx=0 tx=0).stop 2024-09-11T22:11:51.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.759+0000 7faf8bd46640 1 -- 172.21.15.152:0/1910147361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf841049a0 msgr2=0x7faf84076c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.759+0000 7faf8bd46640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf841049a0 0x7faf84076c40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faf74009780 tx=0x7faf74033d90 comp rx=0 tx=0).stop 2024-09-11T22:11:51.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.760+0000 7faf8bd46640 1 -- 172.21.15.152:0/1910147361 shutdown_connections 2024-09-11T22:11:51.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.760+0000 7faf8bd46640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faf700a2df0 0x7faf700a52b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.760+0000 7faf8bd46640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf84109120 0x7faf84077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.760+0000 7faf8bd46640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf841049a0 0x7faf84076c40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.760+0000 7faf8bd46640 1 --2- 172.21.15.152:0/1910147361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf84103ff0 0x7faf84076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.760+0000 7faf8bd46640 1 -- 172.21.15.152:0/1910147361 >> 172.21.15.152:0/1910147361 conn(0x7faf840ffab0 msgr2=0x7faf84100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.760+0000 7faf8bd46640 1 -- 172.21.15.152:0/1910147361 shutdown_connections 2024-09-11T22:11:51.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:51.760+0000 7faf8bd46640 1 -- 172.21.15.152:0/1910147361 wait complete. 2024-09-11T22:11:53.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:53 smithi152 ceph-mon[31188]: pgmap v232: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 24 MiB/s wr, 1.66k op/s 2024-09-11T22:11:53.491 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:11:53.492 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:11:53.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:53 smithi179 ceph-mon[35603]: pgmap v232: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 24 MiB/s wr, 1.66k op/s 2024-09-11T22:11:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:53 smithi193 ceph-mon[35545]: pgmap v232: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 24 MiB/s wr, 1.66k op/s 2024-09-11T22:11:53.872 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.461+0000 7f92afd76640 1 -- 172.21.15.152:0/30373034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a8109830 msgr2=0x7f92a8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.461+0000 7f92afd76640 1 --2- 172.21.15.152:0/30373034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a8109830 0x7f92a8109c90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9298009860 tx=0x7f929802a340 comp rx=0 tx=0).stop 2024-09-11T22:11:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.461+0000 7f92afd76640 1 -- 172.21.15.152:0/30373034 shutdown_connections 2024-09-11T22:11:54.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.461+0000 7f92afd76640 1 --2- 172.21.15.152:0/30373034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a811b140 0x7f92a811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.461+0000 7f92afd76640 1 --2- 172.21.15.152:0/30373034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a8109830 0x7f92a8109c90 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.461+0000 7f92afd76640 1 --2- 172.21.15.152:0/30373034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92a8109450 0x7f92a8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.461+0000 7f92afd76640 1 -- 172.21.15.152:0/30373034 >> 172.21.15.152:0/30373034 conn(0x7f92a806e140 msgr2=0x7f92a806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:54.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.461+0000 7f92afd76640 1 -- 172.21.15.152:0/30373034 shutdown_connections 2024-09-11T22:11:54.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.461+0000 7f92afd76640 1 -- 172.21.15.152:0/30373034 wait complete. 2024-09-11T22:11:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.463+0000 7f92afd76640 1 Processor -- start 2024-09-11T22:11:54.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.464+0000 7f92afd76640 1 -- start start 2024-09-11T22:11:54.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.464+0000 7f92afd76640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a8109450 0x7f92a811a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.464+0000 7f92afd76640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92a8109830 0x7f92a8116830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.464+0000 7f92afd76640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a811b140 0x7f92a8116d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.464+0000 7f92afd76640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f92a81132b0 con 0x7f92a811b140 2024-09-11T22:11:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.464+0000 7f92afd76640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8113130 con 0x7f92a8109450 2024-09-11T22:11:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.465+0000 7f92ae313640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a811b140 0x7f92a8116d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.465+0000 7f92ae313640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a811b140 0x7f92a8116d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40312/0 (socket says 172.21.15.152:40312) 2024-09-11T22:11:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.465+0000 7f92ae313640 1 -- 172.21.15.152:0/3356809417 learned_addr learned my addr 172.21.15.152:0/3356809417 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.465+0000 7f92adb12640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a8109450 0x7f92a811a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.465+0000 7f92ad311640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92a8109830 0x7f92a8116830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.465+0000 7f92afd76640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8113430 con 0x7f92a8109830 2024-09-11T22:11:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.465+0000 7f92adb12640 1 -- 172.21.15.152:0/3356809417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92a8109830 msgr2=0x7f92a8116830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.465+0000 7f92adb12640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92a8109830 0x7f92a8116830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.465+0000 7f92adb12640 1 -- 172.21.15.152:0/3356809417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a811b140 msgr2=0x7f92a8116d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.465+0000 7f92adb12640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a811b140 0x7f92a8116d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.465+0000 7f92adb12640 1 -- 172.21.15.152:0/3356809417 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a8117360 con 0x7f92a8109450 2024-09-11T22:11:54.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.466+0000 7f92adb12640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a8109450 0x7f92a811a790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f92a401f9e0 tx=0x7f92a401fea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:54.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.466+0000 7f929effd640 1 -- 172.21.15.152:0/3356809417 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a401dbc0 con 0x7f92a8109450 2024-09-11T22:11:54.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.466+0000 7f929effd640 1 -- 172.21.15.152:0/3356809417 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92a401dd60 con 0x7f92a8109450 2024-09-11T22:11:54.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.466+0000 7f929effd640 1 -- 172.21.15.152:0/3356809417 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a4029840 con 0x7f92a8109450 2024-09-11T22:11:54.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.466+0000 7f92afd76640 1 -- 172.21.15.152:0/3356809417 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a8117650 con 0x7f92a8109450 2024-09-11T22:11:54.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.466+0000 7f92afd76640 1 -- 172.21.15.152:0/3356809417 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a81ab460 con 0x7f92a8109450 2024-09-11T22:11:54.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.469+0000 7f929effd640 1 -- 172.21.15.152:0/3356809417 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f92a40299e0 con 0x7f92a8109450 2024-09-11T22:11:54.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.469+0000 7f92b214f740 1 Processor -- start 2024-09-11T22:11:54.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92b214f740 1 -- start start 2024-09-11T22:11:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92b214f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x5586350f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92b214f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5586350fa480 0x558635104800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92b214f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558635104d40 0x558635107130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92b214f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55863505f280 con 0x5586350f9b60 2024-09-11T22:11:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92b214f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558635006b10 con 0x558635104d40 2024-09-11T22:11:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92b214f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55863505b240 con 0x5586350fa480 2024-09-11T22:11:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92ae313640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x5586350f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92ae313640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x5586350f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40328/0 (socket says 172.21.15.152:40328) 2024-09-11T22:11:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92adb12640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5586350fa480 0x558635104800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92ae313640 1 -- 172.21.15.152:0/1472285700 learned_addr learned my addr 172.21.15.152:0/1472285700 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:54.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.470+0000 7f92ad311640 1 --2- 172.21.15.152:0/1472285700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558635104d40 0x558635107130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f92ad311640 1 -- 172.21.15.152:0/1472285700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5586350fa480 msgr2=0x558635104800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:54.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f92ad311640 1 --2- 172.21.15.152:0/1472285700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5586350fa480 0x558635104800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f92ad311640 1 -- 172.21.15.152:0/1472285700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 msgr2=0x5586350f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:54.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f92ad311640 1 --2- 172.21.15.152:0/1472285700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x5586350f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f92ad311640 1 -- 172.21.15.152:0/1472285700 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586350131f0 con 0x558635104d40 2024-09-11T22:11:54.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f92ae313640 1 --2- 172.21.15.152:0/1472285700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x5586350f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:54.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f929effd640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92940a2d70 0x7f92940a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f92ad311640 1 --2- 172.21.15.152:0/1472285700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558635104d40 0x558635107130 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9298035040 tx=0x7f9298009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d7165f789f57fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f92ae313640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92940a2d70 0x7f92940a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f929effd640 1 -- 172.21.15.152:0/3356809417 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f92a40e05a0 con 0x7f92a8109450 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f9293fff640 1 -- 172.21.15.152:0/1472285700 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298041020 con 0x558635104d40 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f9293fff640 1 -- 172.21.15.152:0/1472285700 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9298030e50 con 0x558635104d40 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.471+0000 7f9293fff640 1 -- 172.21.15.152:0/1472285700 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298037040 con 0x558635104d40 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.472+0000 7f92ae313640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92940a2d70 0x7f92940a5230 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f92a0012880 tx=0x7f92a0009500 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.472+0000 7f92b214f740 1 -- 172.21.15.152:0/1472285700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558635104d40 msgr2=0x558635107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.472+0000 7f92b214f740 1 --2- 172.21.15.152:0/1472285700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558635104d40 0x558635107130 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9298035040 tx=0x7f9298009510 comp rx=0 tx=0).stop 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.473+0000 7f92b214f740 1 -- 172.21.15.152:0/1472285700 shutdown_connections 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.473+0000 7f92b214f740 1 --2- 172.21.15.152:0/1472285700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558635104d40 0x558635107130 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.473+0000 7f92b214f740 1 --2- 172.21.15.152:0/1472285700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5586350fa480 0x558635104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.473+0000 7f92b214f740 1 --2- 172.21.15.152:0/1472285700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x5586350f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.473+0000 7f92b214f740 1 -- 172.21.15.152:0/1472285700 >> 172.21.15.152:0/1472285700 conn(0x5586350f60f0 msgr2=0x5586350f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:54.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.473+0000 7f92b214f740 1 -- 172.21.15.152:0/1472285700 shutdown_connections 2024-09-11T22:11:54.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.473+0000 7f92b214f740 1 -- 172.21.15.152:0/1472285700 wait complete. 2024-09-11T22:11:54.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.473+0000 7f92b214f740 1 -- start start 2024-09-11T22:11:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.473+0000 7f92b214f740 1 Processor -- start 2024-09-11T22:11:54.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.474+0000 7f92b214f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x558635101ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.474+0000 7f92b214f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 0x5586351020e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.474+0000 7f92b214f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x558635102620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.474+0000 7f92b214f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558635107910 con 0x5586350f9b60 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.474+0000 7f92b214f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558635019f10 con 0x5586350fa480 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.474+0000 7f92b214f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558635107a90 con 0x558635104d40 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.474+0000 7f92b214f740 10 client.0 _ll_register_callbacks cb 0x558634fe2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.474+0000 7f92ad311640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 0x5586351020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.474+0000 7f92ad311640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 0x5586351020e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:38878/0 (socket says 172.21.15.152:38878) 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.474+0000 7f92ad311640 1 -- 172.21.15.152:0/430418833 learned_addr learned my addr 172.21.15.152:0/430418833 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.474+0000 7f92ae313640 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x558635102620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.475+0000 7f92ad311640 1 -- 172.21.15.152:0/430418833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 msgr2=0x558635102620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:54.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.475+0000 7f92ad311640 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x558635102620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.475+0000 7f92ad311640 1 -- 172.21.15.152:0/430418833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 msgr2=0x558635101ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:54.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.475+0000 7f92adb12640 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x558635101ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.475+0000 7f92ad311640 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x558635101ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.475+0000 7f92ad311640 1 -- 172.21.15.152:0/430418833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558634dd06a0 con 0x5586350fa480 2024-09-11T22:11:54.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.475+0000 7f92adb12640 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x558635101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:54.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.475+0000 7f92ad311640 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 0x5586351020e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9298005e00 tx=0x7f9298030970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dedc3bd31e5a22a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:54.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.475+0000 7f92917fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:11:54.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.476+0000 7f92917fa640 1 -- 172.21.15.152:0/430418833 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929804d070 con 0x5586350fa480 2024-09-11T22:11:54.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.476+0000 7f92b214f740 1 -- 172.21.15.152:0/430418833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9298030e50 con 0x5586350fa480 2024-09-11T22:11:54.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.477+0000 7f92917fa640 1 -- 172.21.15.152:0/430418833 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f9298004250 con 0x5586350fa480 2024-09-11T22:11:54.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.477+0000 7f92917fa640 1 -- 172.21.15.152:0/430418833 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9298059050 con 0x5586350fa480 2024-09-11T22:11:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.477+0000 7f92b214f740 10 client.26681 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.477+0000 7f92b214f740 1 -- 172.21.15.152:0/430418833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5586351134d0 con 0x5586350fa480 2024-09-11T22:11:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.478+0000 7f92917fa640 1 -- 172.21.15.152:0/430418833 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9298004490 con 0x5586350fa480 2024-09-11T22:11:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.478+0000 7f92917fa640 1 -- 172.21.15.152:0/430418833 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f929803d890 con 0x5586350fa480 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.478+0000 7f92b214f740 10 client.26681 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.478+0000 7f92b214f740 10 client.26681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.478+0000 7f92b214f740 20 client.26681 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.478+0000 7f92b214f740 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558635114820 0x558635116c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.478+0000 7f92b214f740 4 client.26681 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.478+0000 7f92b214f740 1 -- 172.21.15.152:0/430418833 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9298030e50 con 0x558635114820 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.478+0000 7f92adb12640 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558635114820 0x558635116c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.479+0000 7f92917fa640 10 client.26681 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.479+0000 7f92adb12640 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558635114820 0x558635116c10 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a540fae0052bdb73 server_cookie=5a7a547cc099c68a in_seq=0 out_seq=0 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92917fa640 1 -- 172.21.15.152:0/430418833 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f9298030e50 con 0x558635114820 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92917fa640 10 client.26681 handle_command_reply: tid=0 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92b214f740 1 client.26681 shutdown 2024-09-11T22:11:54.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92b214f740 1 -- 172.21.15.152:0/430418833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 msgr2=0x5586351020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92b214f740 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 0x5586351020e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9298005e00 tx=0x7f9298030970 comp rx=0 tx=0).stop 2024-09-11T22:11:54.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92b214f740 1 -- 172.21.15.152:0/430418833 shutdown_connections 2024-09-11T22:11:54.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92b214f740 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558635114820 0x558635116c10 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92b214f740 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x558635102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92b214f740 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 0x5586351020e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92917fa640 0 client.26681 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:54.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92b214f740 1 --2- 172.21.15.152:0/430418833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x558635101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.480+0000 7f92b214f740 1 -- 172.21.15.152:0/430418833 >> 172.21.15.152:0/430418833 conn(0x5586350f60f0 msgr2=0x5586350fbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:54.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.481+0000 7f92b214f740 1 -- 172.21.15.152:0/430418833 shutdown_connections 2024-09-11T22:11:54.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.481+0000 7f92b214f740 1 -- 172.21.15.152:0/430418833 wait complete. 2024-09-11T22:11:54.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.481+0000 7f92b214f740 20 client.26681 trim_cache size 0 max 16384 2024-09-11T22:11:54.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92b214f740 1 Processor -- start 2024-09-11T22:11:54.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92b214f740 1 -- start start 2024-09-11T22:11:54.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92b214f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350f9b60 0x5586350f5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92b214f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350fa480 0x558635119c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92b214f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x55863511a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92b214f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f928c011230 con 0x5586350fa480 2024-09-11T22:11:54.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92b214f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f928c00eb00 con 0x5586350f9b60 2024-09-11T22:11:54.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92b214f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f928c00c970 con 0x558635104d40 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92adb12640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350f9b60 0x5586350f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92ae313640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x55863511a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92ae313640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x55863511a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46760/0 (socket says 172.21.15.152:46760) 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.511+0000 7f92ae313640 1 -- 172.21.15.152:0/3170898249 learned_addr learned my addr 172.21.15.152:0/3170898249 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.512+0000 7f92ae313640 1 -- 172.21.15.152:0/3170898249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350f9b60 msgr2=0x5586350f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.512+0000 7f92ae313640 1 --2- 172.21.15.152:0/3170898249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350f9b60 0x5586350f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.512+0000 7f92ae313640 1 -- 172.21.15.152:0/3170898249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350fa480 msgr2=0x558635119c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.512+0000 7f92ae313640 1 --2- 172.21.15.152:0/3170898249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350fa480 0x558635119c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.512+0000 7f92ae313640 1 -- 172.21.15.152:0/3170898249 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586350fa2b0 con 0x558635104d40 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.512+0000 7f92ae313640 1 --2- 172.21.15.152:0/3170898249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x55863511a170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009420 tx=0x7f92a0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c457cc4c2eef4bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.512+0000 7f92937fe640 1 -- 172.21.15.152:0/3170898249 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a001d410 con 0x558635104d40 2024-09-11T22:11:54.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.513+0000 7f92937fe640 1 -- 172.21.15.152:0/3170898249 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92a002d070 con 0x558635104d40 2024-09-11T22:11:54.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.513+0000 7f92937fe640 1 -- 172.21.15.152:0/3170898249 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0028af0 con 0x558635104d40 2024-09-11T22:11:54.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.514+0000 7f92b214f740 1 -- 172.21.15.152:0/3170898249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 msgr2=0x55863511a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.514+0000 7f92b214f740 1 --2- 172.21.15.152:0/3170898249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x55863511a170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009420 tx=0x7f92a0017000 comp rx=0 tx=0).stop 2024-09-11T22:11:54.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.514+0000 7f92b214f740 1 -- 172.21.15.152:0/3170898249 shutdown_connections 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.514+0000 7f92b214f740 1 --2- 172.21.15.152:0/3170898249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x55863511a170 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.514+0000 7f92b214f740 1 --2- 172.21.15.152:0/3170898249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350fa480 0x558635119c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.514+0000 7f92b214f740 1 --2- 172.21.15.152:0/3170898249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350f9b60 0x5586350f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.514+0000 7f92b214f740 1 -- 172.21.15.152:0/3170898249 >> 172.21.15.152:0/3170898249 conn(0x5586350f60f0 msgr2=0x5586350f4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.514+0000 7f92b214f740 1 -- 172.21.15.152:0/3170898249 shutdown_connections 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.514+0000 7f92b214f740 1 -- 172.21.15.152:0/3170898249 wait complete. 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.514+0000 7f92b214f740 1 -- start start 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.515+0000 7f92b214f740 1 Processor -- start 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.515+0000 7f92b214f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x5586351178f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.515+0000 7f92b214f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 0x558635117e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.515+0000 7f92b214f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x558635118370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.515+0000 7f92b214f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f928c00cfc0 con 0x5586350f9b60 2024-09-11T22:11:54.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.515+0000 7f92b214f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f928c00e430 con 0x5586350fa480 2024-09-11T22:11:54.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.515+0000 7f92b214f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f928c00d690 con 0x558635104d40 2024-09-11T22:11:54.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.515+0000 7f92b214f740 10 client.0 _ll_register_callbacks cb 0x7f92a40e3f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:54.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.515+0000 7f92ae313640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x558635118370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.516+0000 7f92ae313640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x558635118370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46776/0 (socket says 172.21.15.152:46776) 2024-09-11T22:11:54.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.516+0000 7f92ae313640 1 -- 172.21.15.152:0/3003111467 learned_addr learned my addr 172.21.15.152:0/3003111467 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:54.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.516+0000 7f92ad311640 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 0x558635117e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.516+0000 7f92adb12640 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x5586351178f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.516+0000 7f92ae313640 1 -- 172.21.15.152:0/3003111467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 msgr2=0x558635117e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:54.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.516+0000 7f92ae313640 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 0x558635117e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.516+0000 7f92ae313640 1 -- 172.21.15.152:0/3003111467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 msgr2=0x5586351178f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.516+0000 7f92ae313640 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x5586351178f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.516+0000 7f92ae313640 1 -- 172.21.15.152:0/3003111467 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863517e160 con 0x558635104d40 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.516+0000 7f92ae313640 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x558635118370 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f92a0019040 tx=0x7f92a0009a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=250ae30bc7552d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.516+0000 7f92917fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.517+0000 7f92917fa640 1 -- 172.21.15.152:0/3003111467 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0035020 con 0x558635104d40 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.517+0000 7f92917fa640 1 -- 172.21.15.152:0/3003111467 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f92a0028c80 con 0x558635104d40 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.517+0000 7f92b214f740 1 -- 172.21.15.152:0/3003111467 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92a002d070 con 0x558635104d40 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.517+0000 7f92917fa640 1 -- 172.21.15.152:0/3003111467 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f92a0040050 con 0x558635104d40 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.517+0000 7f92b214f740 10 client.26848 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.517+0000 7f92b214f740 1 -- 172.21.15.152:0/3003111467 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55863517f3c0 con 0x558635104d40 2024-09-11T22:11:54.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.517+0000 7f92917fa640 1 -- 172.21.15.152:0/3003111467 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92a002d070 con 0x558635104d40 2024-09-11T22:11:54.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.517+0000 7f92917fa640 1 -- 172.21.15.152:0/3003111467 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f92a001d4a0 con 0x558635104d40 2024-09-11T22:11:54.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.518+0000 7f92b214f740 10 client.26848 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:54.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.518+0000 7f92b214f740 10 client.26848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:54.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.518+0000 7f92b214f740 20 client.26848 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:54.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.518+0000 7f92b214f740 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558635114820 0x558635181a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.518+0000 7f92b214f740 4 client.26848 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:11:54.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.518+0000 7f92b214f740 1 -- 172.21.15.152:0/3003111467 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55863506c7f0 con 0x558635114820 2024-09-11T22:11:54.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.518+0000 7f92adb12640 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558635114820 0x558635181a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.519+0000 7f92adb12640 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558635114820 0x558635181a10 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=927fb979b4d72b6f server_cookie=2d9d8817cc2e5107 in_seq=0 out_seq=0 2024-09-11T22:11:54.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.519+0000 7f92917fa640 10 client.26848 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:54.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.520+0000 7f92917fa640 1 -- 172.21.15.152:0/3003111467 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55863506c7f0 con 0x558635114820 2024-09-11T22:11:54.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.520+0000 7f92917fa640 10 client.26848 handle_command_reply: tid=0 2024-09-11T22:11:54.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.520+0000 7f92b214f740 1 client.26848 shutdown 2024-09-11T22:11:54.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.520+0000 7f92b214f740 1 -- 172.21.15.152:0/3003111467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 msgr2=0x558635118370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.520+0000 7f92b214f740 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x558635118370 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f92a0019040 tx=0x7f92a0009a40 comp rx=0 tx=0).stop 2024-09-11T22:11:54.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.521+0000 7f92b214f740 1 -- 172.21.15.152:0/3003111467 shutdown_connections 2024-09-11T22:11:54.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.521+0000 7f92b214f740 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558635114820 0x558635181a10 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.521+0000 7f92b214f740 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558635104d40 0x558635118370 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.521+0000 7f92b214f740 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5586350fa480 0x558635117e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.521+0000 7f92b214f740 1 --2- 172.21.15.152:0/3003111467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5586350f9b60 0x5586351178f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.521+0000 7f92b214f740 1 -- 172.21.15.152:0/3003111467 >> 172.21.15.152:0/3003111467 conn(0x5586350f60f0 msgr2=0x5586350f5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:54.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.521+0000 7f92917fa640 0 client.26848 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:54.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.522+0000 7f92b214f740 1 -- 172.21.15.152:0/3003111467 shutdown_connections 2024-09-11T22:11:54.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.522+0000 7f92b214f740 1 -- 172.21.15.152:0/3003111467 wait complete. 2024-09-11T22:11:54.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.522+0000 7f92b214f740 20 client.26848 trim_cache size 0 max 16384 2024-09-11T22:11:54.528 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:11:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:11:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "3f4e69e7-e46b-4500-b608-1e7855b27423", 2024-09-11T22:11:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:11:54.528 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:11:54.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 -- 172.21.15.152:0/3356809417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92940a2d70 msgr2=0x7f92940a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92940a2d70 0x7f92940a5230 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f92a0012880 tx=0x7f92a0009500 comp rx=0 tx=0).stop 2024-09-11T22:11:54.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 -- 172.21.15.152:0/3356809417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a8109450 msgr2=0x7f92a811a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a8109450 0x7f92a811a790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f92a401f9e0 tx=0x7f92a401fea0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 -- 172.21.15.152:0/3356809417 shutdown_connections 2024-09-11T22:11:54.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92940a2d70 0x7f92940a5230 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a811b140 0x7f92a8116d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92a8109830 0x7f92a8116830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 --2- 172.21.15.152:0/3356809417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a8109450 0x7f92a811a790 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f92a401f9e0 tx=0x7f92a401fea0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 -- 172.21.15.152:0/3356809417 >> 172.21.15.152:0/3356809417 conn(0x7f92a806e140 msgr2=0x7f92a8070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:54.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 -- 172.21.15.152:0/3356809417 shutdown_connections 2024-09-11T22:11:54.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:54.523+0000 7f92afd76640 1 -- 172.21.15.152:0/3356809417 wait complete. 2024-09-11T22:11:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 380.0 s, 3376.2 tps, lat 29.974 ms stddev 36.425 2024-09-11T22:11:55.230 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:11:55.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:55 smithi152 ceph-mon[31188]: pgmap v233: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 27 MiB/s wr, 1.86k op/s 2024-09-11T22:11:55.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:55 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:11:55.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:55 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:55.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:55 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:11:55.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:55 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:11:55.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:55 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:55.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:55 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:55.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:55 smithi179 ceph-mon[35603]: pgmap v233: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 27 MiB/s wr, 1.86k op/s 2024-09-11T22:11:55.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:55 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:11:55.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:55 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:55.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:55 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:11:55.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:55 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:11:55.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:55 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:55.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:55 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:55.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:55 smithi193 ceph-mon[35545]: pgmap v233: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 27 MiB/s wr, 1.86k op/s 2024-09-11T22:11:55.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:55 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:11:55.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:55 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:55.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:55 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:11:55.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:55 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:11:55.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:55 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:55.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:55 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:11:55.613 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:11:56.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.206+0000 7f0ea44ad640 1 -- 172.21.15.152:0/2361942995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e9c106a70 msgr2=0x7f0e9c106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:56.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.206+0000 7f0ea44ad640 1 --2- 172.21.15.152:0/2361942995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e9c106a70 0x7f0e9c106e50 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009930 tx=0x7f0e8c02a420 comp rx=0 tx=0).stop 2024-09-11T22:11:56.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.206+0000 7f0ea44ad640 1 -- 172.21.15.152:0/2361942995 shutdown_connections 2024-09-11T22:11:56.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.206+0000 7f0ea44ad640 1 --2- 172.21.15.152:0/2361942995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e9c101410 0x7f0e9c10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.206+0000 7f0ea44ad640 1 --2- 172.21.15.152:0/2361942995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e9c100a70 0x7f0e9c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.206+0000 7f0ea44ad640 1 --2- 172.21.15.152:0/2361942995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e9c106a70 0x7f0e9c106e50 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.206+0000 7f0ea44ad640 1 -- 172.21.15.152:0/2361942995 >> 172.21.15.152:0/2361942995 conn(0x7f0e9c0fc7d0 msgr2=0x7f0e9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:56.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.206+0000 7f0ea44ad640 1 -- 172.21.15.152:0/2361942995 shutdown_connections 2024-09-11T22:11:56.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.206+0000 7f0ea44ad640 1 -- 172.21.15.152:0/2361942995 wait complete. 2024-09-11T22:11:56.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.207+0000 7f0ea44ad640 1 Processor -- start 2024-09-11T22:11:56.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.207+0000 7f0ea44ad640 1 -- start start 2024-09-11T22:11:56.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.208+0000 7f0ea44ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e9c100a70 0x7f0e9c1973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.208+0000 7f0ea44ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e9c101410 0x7f0e9c197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.208+0000 7f0ea44ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e9c106a70 0x7f0e9c19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.208+0000 7f0ea44ad640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c110ec0 con 0x7f0e9c106a70 2024-09-11T22:11:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.208+0000 7f0ea44ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c110d40 con 0x7f0e9c101410 2024-09-11T22:11:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.208+0000 7f0ea44ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c111040 con 0x7f0e9c100a70 2024-09-11T22:11:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.208+0000 7f0ea2249640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e9c100a70 0x7f0e9c1973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.208+0000 7f0ea2249640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e9c100a70 0x7f0e9c1973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46794/0 (socket says 172.21.15.152:46794) 2024-09-11T22:11:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.208+0000 7f0ea2249640 1 -- 172.21.15.152:0/3170675412 learned_addr learned my addr 172.21.15.152:0/3170675412 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.208+0000 7f0ea1a48640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e9c101410 0x7f0e9c197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.208+0000 7f0ea2a4a640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e9c106a70 0x7f0e9c19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.209+0000 7f0ea1a48640 1 -- 172.21.15.152:0/3170675412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e9c100a70 msgr2=0x7f0e9c1973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:56.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.209+0000 7f0ea1a48640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e9c100a70 0x7f0e9c1973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.209+0000 7f0ea1a48640 1 -- 172.21.15.152:0/3170675412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e9c106a70 msgr2=0x7f0e9c19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:56.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.209+0000 7f0ea1a48640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e9c106a70 0x7f0e9c19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.210+0000 7f0ea1a48640 1 -- 172.21.15.152:0/3170675412 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9c19c370 con 0x7f0e9c101410 2024-09-11T22:11:56.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.210+0000 7f0ea1a48640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e9c101410 0x7f0e9c197900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009fd0 tx=0x7f0e9000ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:56.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.211+0000 7f0e9b7fe640 1 -- 172.21.15.152:0/3170675412 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90004b20 con 0x7f0e9c101410 2024-09-11T22:11:56.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.211+0000 7f0e9b7fe640 1 -- 172.21.15.152:0/3170675412 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e90004cc0 con 0x7f0e9c101410 2024-09-11T22:11:56.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.211+0000 7f0ea44ad640 1 -- 172.21.15.152:0/3170675412 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9c19c660 con 0x7f0e9c101410 2024-09-11T22:11:56.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.211+0000 7f0e9b7fe640 1 -- 172.21.15.152:0/3170675412 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900107b0 con 0x7f0e9c101410 2024-09-11T22:11:56.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.211+0000 7f0ea44ad640 1 -- 172.21.15.152:0/3170675412 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9c1a3f40 con 0x7f0e9c101410 2024-09-11T22:11:56.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.213+0000 7f0e9b7fe640 1 -- 172.21.15.152:0/3170675412 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0e90005020 con 0x7f0e9c101410 2024-09-11T22:11:56.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.214+0000 7f0e9b7fe640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0e840a2dc0 0x7f0e840a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.214+0000 7f0e9b7fe640 1 -- 172.21.15.152:0/3170675412 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0e900cfc00 con 0x7f0e9c101410 2024-09-11T22:11:56.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.214+0000 7f0ea6886740 1 Processor -- start 2024-09-11T22:11:56.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.214+0000 7f0ea2249640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0e840a2dc0 0x7f0e840a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea6886740 1 -- start start 2024-09-11T22:11:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae8794a0 0x5568ae879880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae879dc0 0x5568ae884140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae884680 0x5568ae886a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea6886740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5568ae7df2e0 con 0x5568ae879dc0 2024-09-11T22:11:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea6886740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5568ae786ce0 con 0x5568ae884680 2024-09-11T22:11:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea6886740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5568ae7db2a0 con 0x5568ae8794a0 2024-09-11T22:11:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea2249640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0e840a2dc0 0x7f0e840a5280 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0096c0 tx=0x7f0e8c02a920 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea2249640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae8794a0 0x5568ae879880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea1a48640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae879dc0 0x5568ae884140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea2a4a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae884680 0x5568ae886a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea2a4a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae884680 0x5568ae886a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:38904/0 (socket says 172.21.15.152:38904) 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea1a48640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae879dc0 0x5568ae884140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40380/0 (socket says 172.21.15.152:40380) 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.215+0000 7f0ea2a4a640 1 -- 172.21.15.152:0/652252844 learned_addr learned my addr 172.21.15.152:0/652252844 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.216+0000 7f0ea2249640 1 -- 172.21.15.152:0/652252844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae884680 msgr2=0x5568ae886a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.216+0000 7f0ea2249640 1 --2- 172.21.15.152:0/652252844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae884680 0x5568ae886a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.216+0000 7f0ea2249640 1 -- 172.21.15.152:0/652252844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae879dc0 msgr2=0x5568ae884140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.216+0000 7f0ea2249640 1 --2- 172.21.15.152:0/652252844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae879dc0 0x5568ae884140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.216+0000 7f0ea2249640 1 -- 172.21.15.152:0/652252844 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ae76b440 con 0x5568ae8794a0 2024-09-11T22:11:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.216+0000 7f0ea2a4a640 1 --2- 172.21.15.152:0/652252844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae884680 0x5568ae886a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:56.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.218+0000 7f0ea2249640 1 --2- 172.21.15.152:0/652252844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae8794a0 0x5568ae879880 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c006010 tx=0x7f0e8c03d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94057be517fe6292 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:56.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.219+0000 7f0e98ff9640 1 -- 172.21.15.152:0/652252844 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c035040 con 0x5568ae8794a0 2024-09-11T22:11:56.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.219+0000 7f0e98ff9640 1 -- 172.21.15.152:0/652252844 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e8c04f070 con 0x5568ae8794a0 2024-09-11T22:11:56.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.219+0000 7f0e98ff9640 1 -- 172.21.15.152:0/652252844 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c004e50 con 0x5568ae8794a0 2024-09-11T22:11:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.220+0000 7f0ea6886740 1 -- 172.21.15.152:0/652252844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae8794a0 msgr2=0x5568ae879880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.220+0000 7f0ea6886740 1 --2- 172.21.15.152:0/652252844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae8794a0 0x5568ae879880 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c006010 tx=0x7f0e8c03d000 comp rx=0 tx=0).stop 2024-09-11T22:11:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.220+0000 7f0ea6886740 1 -- 172.21.15.152:0/652252844 shutdown_connections 2024-09-11T22:11:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.220+0000 7f0ea6886740 1 --2- 172.21.15.152:0/652252844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae884680 0x5568ae886a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.220+0000 7f0ea6886740 1 --2- 172.21.15.152:0/652252844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae879dc0 0x5568ae884140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.220+0000 7f0ea6886740 1 --2- 172.21.15.152:0/652252844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae8794a0 0x5568ae879880 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.220+0000 7f0ea6886740 1 -- 172.21.15.152:0/652252844 >> 172.21.15.152:0/652252844 conn(0x5568ae875a30 msgr2=0x5568ae875e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.220+0000 7f0ea6886740 1 -- 172.21.15.152:0/652252844 shutdown_connections 2024-09-11T22:11:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.220+0000 7f0ea6886740 1 -- 172.21.15.152:0/652252844 wait complete. 2024-09-11T22:11:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.220+0000 7f0ea6886740 1 -- start start 2024-09-11T22:11:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.220+0000 7f0ea6886740 1 Processor -- start 2024-09-11T22:11:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 0x5568ae884080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae879dc0 0x5568ae881330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 0x5568ae881920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea6886740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5568ae887250 con 0x5568ae884680 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea6886740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5568ae79a050 con 0x5568ae8794a0 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea6886740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5568ae8873d0 con 0x5568ae879dc0 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea6886740 10 client.0 _ll_register_callbacks cb 0x5568ae7da160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea2249640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 0x5568ae884080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea2249640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 0x5568ae884080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:38910/0 (socket says 172.21.15.152:38910) 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea2a4a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 0x5568ae881920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea2249640 1 -- 172.21.15.152:0/1261950356 learned_addr learned my addr 172.21.15.152:0/1261950356 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea2a4a640 1 -- 172.21.15.152:0/1261950356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae879dc0 msgr2=0x5568ae881330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea2a4a640 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae879dc0 0x5568ae881330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea2a4a640 1 -- 172.21.15.152:0/1261950356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 msgr2=0x5568ae884080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea2a4a640 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 0x5568ae884080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea2a4a640 1 -- 172.21.15.152:0/1261950356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ae5503c0 con 0x5568ae884680 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.221+0000 7f0ea2249640 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 0x5568ae884080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.222+0000 7f0ea2a4a640 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 0x5568ae881920 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0e940126d0 tx=0x7f0e94012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e422d7d1ca68cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.222+0000 7f0e81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.222+0000 7f0e81ffb640 1 -- 172.21.15.152:0/1261950356 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94004050 con 0x5568ae884680 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.222+0000 7f0e81ffb640 1 -- 172.21.15.152:0/1261950356 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0e940041f0 con 0x5568ae884680 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.222+0000 7f0ea6886740 1 -- 172.21.15.152:0/1261950356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e8c04f070 con 0x5568ae884680 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.222+0000 7f0e81ffb640 1 -- 172.21.15.152:0/1261950356 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0e940043f0 con 0x5568ae884680 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.222+0000 7f0ea6886740 10 client.17292 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:56.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.222+0000 7f0ea6886740 1 -- 172.21.15.152:0/1261950356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5568ae89b520 con 0x5568ae884680 2024-09-11T22:11:56.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.222+0000 7f0e81ffb640 1 -- 172.21.15.152:0/1261950356 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e8c04f070 con 0x5568ae884680 2024-09-11T22:11:56.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.223+0000 7f0e81ffb640 1 -- 172.21.15.152:0/1261950356 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f0e94003ac0 con 0x5568ae884680 2024-09-11T22:11:56.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.223+0000 7f0ea6886740 10 client.17292 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:56.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.223+0000 7f0ea6886740 10 client.17292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:56.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.223+0000 7f0ea6886740 20 client.17292 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:56.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.223+0000 7f0ea6886740 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ae89c9e0 0x5568ae89ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.223+0000 7f0ea6886740 4 client.17292 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:56.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.223+0000 7f0ea6886740 1 -- 172.21.15.152:0/1261950356 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568ae7ec850 con 0x5568ae89c9e0 2024-09-11T22:11:56.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.223+0000 7f0ea2249640 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ae89c9e0 0x5568ae89ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.225+0000 7f0ea2249640 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ae89c9e0 0x5568ae89ee30 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85a8eafd1315b8c7 server_cookie=4f5f63b0c1977a88 in_seq=0 out_seq=0 2024-09-11T22:11:56.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.225+0000 7f0e81ffb640 10 client.17292 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:56.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.225+0000 7f0e81ffb640 1 -- 172.21.15.152:0/1261950356 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568ae7ec850 con 0x5568ae89c9e0 2024-09-11T22:11:56.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.225+0000 7f0e81ffb640 10 client.17292 handle_command_reply: tid=0 2024-09-11T22:11:56.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.225+0000 7f0ea6886740 1 client.17292 shutdown 2024-09-11T22:11:56.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.226+0000 7f0ea6886740 1 -- 172.21.15.152:0/1261950356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 msgr2=0x5568ae881920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:56.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.226+0000 7f0ea6886740 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 0x5568ae881920 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0e940126d0 tx=0x7f0e94012b90 comp rx=0 tx=0).stop 2024-09-11T22:11:56.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.226+0000 7f0ea6886740 1 -- 172.21.15.152:0/1261950356 shutdown_connections 2024-09-11T22:11:56.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.226+0000 7f0ea6886740 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ae89c9e0 0x5568ae89ee30 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.226+0000 7f0ea6886740 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 0x5568ae881920 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.226+0000 7f0ea6886740 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae879dc0 0x5568ae881330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.226+0000 7f0ea6886740 1 --2- 172.21.15.152:0/1261950356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 0x5568ae884080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.226+0000 7f0ea6886740 1 -- 172.21.15.152:0/1261950356 >> 172.21.15.152:0/1261950356 conn(0x5568ae875a30 msgr2=0x5568ae87b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:56.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.226+0000 7f0e81ffb640 0 client.17292 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:56.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.226+0000 7f0ea6886740 1 -- 172.21.15.152:0/1261950356 shutdown_connections 2024-09-11T22:11:56.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.226+0000 7f0ea6886740 1 -- 172.21.15.152:0/1261950356 wait complete. 2024-09-11T22:11:56.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.227+0000 7f0ea6886740 20 client.17292 trim_cache size 0 max 16384 2024-09-11T22:11:56.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea6886740 1 Processor -- start 2024-09-11T22:11:56.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea6886740 1 -- start start 2024-09-11T22:11:56.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae8794a0 0x5568ae898d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae879dc0 0x5568ae89e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae884680 0x5568ae87c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea6886740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1ae110 con 0x5568ae8794a0 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea6886740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1ab9e0 con 0x5568ae879dc0 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea6886740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1a9850 con 0x5568ae884680 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea2249640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae8794a0 0x5568ae898d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea2249640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae8794a0 0x5568ae898d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40404/0 (socket says 172.21.15.152:40404) 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea2249640 1 -- 172.21.15.152:0/1682475406 learned_addr learned my addr 172.21.15.152:0/1682475406 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.252+0000 7f0ea1a48640 1 --2- 172.21.15.152:0/1682475406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae879dc0 0x5568ae89e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.253+0000 7f0ea1a48640 1 -- 172.21.15.152:0/1682475406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae884680 msgr2=0x5568ae87c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.253+0000 7f0ea1a48640 1 --2- 172.21.15.152:0/1682475406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae884680 0x5568ae87c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.253+0000 7f0ea1a48640 1 -- 172.21.15.152:0/1682475406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae8794a0 msgr2=0x5568ae898d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.253+0000 7f0ea1a48640 1 --2- 172.21.15.152:0/1682475406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae8794a0 0x5568ae898d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.253+0000 7f0ea1a48640 1 -- 172.21.15.152:0/1682475406 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ae8802e0 con 0x5568ae879dc0 2024-09-11T22:11:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.253+0000 7f0ea1a48640 1 --2- 172.21.15.152:0/1682475406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae879dc0 0x5568ae89e9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0e900cd290 tx=0x7f0e9009ba80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a20a05ebf7f02d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.253+0000 7f0e83fff640 1 -- 172.21.15.152:0/1682475406 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900a0410 con 0x5568ae879dc0 2024-09-11T22:11:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.253+0000 7f0e83fff640 1 -- 172.21.15.152:0/1682475406 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e900a4cd0 con 0x5568ae879dc0 2024-09-11T22:11:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.253+0000 7f0e83fff640 1 -- 172.21.15.152:0/1682475406 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900986d0 con 0x5568ae879dc0 2024-09-11T22:11:56.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.254+0000 7f0ea6886740 1 -- 172.21.15.152:0/1682475406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae879dc0 msgr2=0x5568ae89e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:56.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.254+0000 7f0ea6886740 1 --2- 172.21.15.152:0/1682475406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae879dc0 0x5568ae89e9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0e900cd290 tx=0x7f0e9009ba80 comp rx=0 tx=0).stop 2024-09-11T22:11:56.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.254+0000 7f0ea6886740 1 -- 172.21.15.152:0/1682475406 shutdown_connections 2024-09-11T22:11:56.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.254+0000 7f0ea6886740 1 --2- 172.21.15.152:0/1682475406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae884680 0x5568ae87c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.254+0000 7f0ea6886740 1 --2- 172.21.15.152:0/1682475406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae879dc0 0x5568ae89e9f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.254+0000 7f0ea6886740 1 --2- 172.21.15.152:0/1682475406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae8794a0 0x5568ae898d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.254+0000 7f0ea6886740 1 -- 172.21.15.152:0/1682475406 >> 172.21.15.152:0/1682475406 conn(0x5568ae875a30 msgr2=0x5568ae87c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:56.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.255+0000 7f0ea6886740 1 -- 172.21.15.152:0/1682475406 shutdown_connections 2024-09-11T22:11:56.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.256+0000 7f0ea6886740 1 -- 172.21.15.152:0/1682475406 wait complete. 2024-09-11T22:11:56.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.256+0000 7f0ea6886740 1 -- start start 2024-09-11T22:11:56.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea6886740 1 Processor -- start 2024-09-11T22:11:56.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 0x5568ae895410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae879dc0 0x5568ae890740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea6886740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 0x5568ae890c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea6886740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1a9ea0 con 0x5568ae884680 2024-09-11T22:11:56.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea6886740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1ab310 con 0x5568ae8794a0 2024-09-11T22:11:56.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea6886740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1aa570 con 0x5568ae879dc0 2024-09-11T22:11:56.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea6886740 10 client.0 _ll_register_callbacks cb 0x7f0e94009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:56.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea2a4a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 0x5568ae890c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea1a48640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae879dc0 0x5568ae890740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea2a4a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 0x5568ae890c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40420/0 (socket says 172.21.15.152:40420) 2024-09-11T22:11:56.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea1a48640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae879dc0 0x5568ae890740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46834/0 (socket says 172.21.15.152:46834) 2024-09-11T22:11:56.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.257+0000 7f0ea2a4a640 1 -- 172.21.15.152:0/2032833975 learned_addr learned my addr 172.21.15.152:0/2032833975 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:11:56.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0ea2249640 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 0x5568ae895410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0ea2a4a640 1 -- 172.21.15.152:0/2032833975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae879dc0 msgr2=0x5568ae890740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:56.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0ea2a4a640 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae879dc0 0x5568ae890740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0ea2a4a640 1 -- 172.21.15.152:0/2032833975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 msgr2=0x5568ae895410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:56.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0ea2a4a640 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 0x5568ae895410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0ea2a4a640 1 -- 172.21.15.152:0/2032833975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ae8912c0 con 0x5568ae884680 2024-09-11T22:11:56.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0ea1a48640 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae879dc0 0x5568ae890740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:56.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0ea2a4a640 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 0x5568ae890c80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0e94005e00 tx=0x7f0e94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda52603d434df78 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:56.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0e81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:11:56.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0e81ffb640 1 -- 172.21.15.152:0/2032833975 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94028070 con 0x5568ae884680 2024-09-11T22:11:56.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0ea6886740 1 -- 172.21.15.152:0/2032833975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e900a4cd0 con 0x5568ae884680 2024-09-11T22:11:56.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.258+0000 7f0e81ffb640 1 -- 172.21.15.152:0/2032833975 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0e94011c70 con 0x5568ae884680 2024-09-11T22:11:56.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0e81ffb640 1 -- 172.21.15.152:0/2032833975 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0e94011eb0 con 0x5568ae884680 2024-09-11T22:11:56.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0ea6886740 10 client.17298 fetch_fsmap learned FSMap version 30 2024-09-11T22:11:56.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0ea6886740 1 -- 172.21.15.152:0/2032833975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5568ae9074f0 con 0x5568ae884680 2024-09-11T22:11:56.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0e81ffb640 1 -- 172.21.15.152:0/2032833975 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e900a4cd0 con 0x5568ae884680 2024-09-11T22:11:56.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0e81ffb640 1 -- 172.21.15.152:0/2032833975 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f0e94005040 con 0x5568ae884680 2024-09-11T22:11:56.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0ea6886740 10 client.17298 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0ea6886740 10 client.17298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0ea6886740 20 client.17298 populate_metadata read hostname 'smithi152' 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0ea6886740 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ae907c60 0x5568ae90a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0ea6886740 4 client.17298 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0ea6886740 1 -- 172.21.15.152:0/2032833975 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5568ae89f1c0 con 0x5568ae907c60 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.259+0000 7f0ea2249640 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ae907c60 0x5568ae90a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0e81ffb640 10 client.17298 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea2249640 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ae907c60 0x5568ae90a050 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c6d85a6430f41a1 server_cookie=8f6a609f6433eb42 in_seq=0 out_seq=0 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0e81ffb640 1 -- 172.21.15.152:0/2032833975 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5568ae89f1c0 con 0x5568ae907c60 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0e81ffb640 10 client.17298 handle_command_reply: tid=0 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 1 client.17298 shutdown 2024-09-11T22:11:56.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 1 -- 172.21.15.152:0/2032833975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 msgr2=0x5568ae890c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:56.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 0x5568ae890c80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0e94005e00 tx=0x7f0e94004270 comp rx=0 tx=0).stop 2024-09-11T22:11:56.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 1 -- 172.21.15.152:0/2032833975 shutdown_connections 2024-09-11T22:11:56.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ae907c60 0x5568ae90a050 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0e81ffb640 0 client.17298 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:11:56.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ae884680 0x5568ae890c80 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ae879dc0 0x5568ae890740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 1 --2- 172.21.15.152:0/2032833975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ae8794a0 0x5568ae895410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 1 -- 172.21.15.152:0/2032833975 >> 172.21.15.152:0/2032833975 conn(0x5568ae875a30 msgr2=0x5568ae882b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:56.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 1 -- 172.21.15.152:0/2032833975 shutdown_connections 2024-09-11T22:11:56.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 1 -- 172.21.15.152:0/2032833975 wait complete. 2024-09-11T22:11:56.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.260+0000 7f0ea6886740 20 client.17298 trim_cache size 0 max 16384 2024-09-11T22:11:56.266 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:11:56.266 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:11:56.266 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:11:56.266 INFO:teuthology.orchestra.run.smithi152.stdout: "3f4e69e7-e46b-4500-b608-1e7855b27423": { 2024-09-11T22:11:56.266 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:11:56.266 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "3f4e69e7-e46b-4500-b608-1e7855b27423", 2024-09-11T22:11:56.266 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:11:56.266 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:56.266 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:11:56.266 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:11:56.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.261+0000 7f0ea44ad640 1 -- 172.21.15.152:0/3170675412 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0e840a2dc0 msgr2=0x7f0e840a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:56.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.261+0000 7f0ea44ad640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0e840a2dc0 0x7f0e840a5280 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0096c0 tx=0x7f0e8c02a920 comp rx=0 tx=0).stop 2024-09-11T22:11:56.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.261+0000 7f0ea44ad640 1 -- 172.21.15.152:0/3170675412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e9c101410 msgr2=0x7f0e9c197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:56.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.261+0000 7f0ea44ad640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e9c101410 0x7f0e9c197900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009fd0 tx=0x7f0e9000ef90 comp rx=0 tx=0).stop 2024-09-11T22:11:56.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.262+0000 7f0ea44ad640 1 -- 172.21.15.152:0/3170675412 shutdown_connections 2024-09-11T22:11:56.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.262+0000 7f0ea44ad640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0e840a2dc0 0x7f0e840a5280 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.262+0000 7f0ea44ad640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e9c106a70 0x7f0e9c19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.262+0000 7f0ea44ad640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e9c101410 0x7f0e9c197900 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.262+0000 7f0ea44ad640 1 --2- 172.21.15.152:0/3170675412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e9c100a70 0x7f0e9c1973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.262+0000 7f0ea44ad640 1 -- 172.21.15.152:0/3170675412 >> 172.21.15.152:0/3170675412 conn(0x7f0e9c0fc7d0 msgr2=0x7f0e9c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:56.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.262+0000 7f0ea44ad640 1 -- 172.21.15.152:0/3170675412 shutdown_connections 2024-09-11T22:11:56.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:11:56.263+0000 7f0ea44ad640 1 -- 172.21.15.152:0/3170675412 wait complete. 2024-09-11T22:11:56.942 INFO:tasks.cephfs.filesystem:scrub status for tag:3f4e69e7-e46b-4500-b608-1e7855b27423 - {'path': '/', 'tag': '3f4e69e7-e46b-4500-b608-1e7855b27423', 'options': 'recursive,force'} 2024-09-11T22:11:57.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:57 smithi152 ceph-mon[31188]: pgmap v234: 97 pgs: 97 active+clean; 4.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 25 MiB/s wr, 1.78k op/s 2024-09-11T22:11:57.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:57 smithi179 ceph-mon[35603]: pgmap v234: 97 pgs: 97 active+clean; 4.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 25 MiB/s wr, 1.78k op/s 2024-09-11T22:11:57.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:57 smithi193 ceph-mon[35545]: pgmap v234: 97 pgs: 97 active+clean; 4.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 25 MiB/s wr, 1.78k op/s 2024-09-11T22:11:59.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:11:59 smithi152 ceph-mon[31188]: pgmap v235: 97 pgs: 97 active+clean; 4.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 22 MiB/s wr, 1.66k op/s 2024-09-11T22:11:59.549 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:11:59 smithi179 ceph-mon[35603]: pgmap v235: 97 pgs: 97 active+clean; 4.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 22 MiB/s wr, 1.66k op/s 2024-09-11T22:11:59.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:11:59 smithi193 ceph-mon[35545]: pgmap v235: 97 pgs: 97 active+clean; 4.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 22 MiB/s wr, 1.66k op/s 2024-09-11T22:11:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 385.0 s, 3408.8 tps, lat 29.278 ms stddev 31.492 2024-09-11T22:12:01.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:01 smithi152 ceph-mon[31188]: pgmap v236: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 27 MiB/s wr, 1.97k op/s 2024-09-11T22:12:01.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:01 smithi179 ceph-mon[35603]: pgmap v236: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 27 MiB/s wr, 1.97k op/s 2024-09-11T22:12:01.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:01 smithi193 ceph-mon[35545]: pgmap v236: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 27 MiB/s wr, 1.97k op/s 2024-09-11T22:12:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.415+0000 7f4bd95e4640 1 -- 172.21.15.152:0/3679265763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd410c0d0 msgr2=0x7f4bd410e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.415+0000 7f4bd95e4640 1 --2- 172.21.15.152:0/3679265763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd410c0d0 0x7f4bd410e590 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009900 tx=0x7f4bc402a480 comp rx=0 tx=0).stop 2024-09-11T22:12:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.415+0000 7f4bd95e4640 1 -- 172.21.15.152:0/3679265763 shutdown_connections 2024-09-11T22:12:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.415+0000 7f4bd95e4640 1 --2- 172.21.15.152:0/3679265763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd410c0d0 0x7f4bd410e590 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.415+0000 7f4bd95e4640 1 --2- 172.21.15.152:0/3679265763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bd41035d0 0x7f4bd410bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.415+0000 7f4bd95e4640 1 --2- 172.21.15.152:0/3679265763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bd4102cb0 0x7f4bd4103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.415+0000 7f4bd95e4640 1 -- 172.21.15.152:0/3679265763 >> 172.21.15.152:0/3679265763 conn(0x7f4bd40fc6c0 msgr2=0x7f4bd40feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.415+0000 7f4bd95e4640 1 -- 172.21.15.152:0/3679265763 shutdown_connections 2024-09-11T22:12:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.415+0000 7f4bd95e4640 1 -- 172.21.15.152:0/3679265763 wait complete. 2024-09-11T22:12:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd95e4640 1 Processor -- start 2024-09-11T22:12:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd95e4640 1 -- start start 2024-09-11T22:12:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd95e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bd4102cb0 0x7f4bd4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd95e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bd41035d0 0x7f4bd4198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd95e4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd410c0d0 0x7f4bd419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd95e4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd4111ef0 con 0x7f4bd410c0d0 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd95e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd4111d70 con 0x7f4bd4102cb0 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd95e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd4112070 con 0x7f4bd41035d0 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd410c0d0 0x7f4bd419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bd4102cb0 0x7f4bd4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd410c0d0 0x7f4bd419cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40442/0 (socket says 172.21.15.152:40442) 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bd4102cb0 0x7f4bd4198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:38950/0 (socket says 172.21.15.152:38950) 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd37fe640 1 -- 172.21.15.152:0/2155069652 learned_addr learned my addr 172.21.15.152:0/2155069652 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.416+0000 7f4bd27fc640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bd41035d0 0x7f4bd4198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/2155069652 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bd41035d0 msgr2=0x7f4bd4198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bd41035d0 0x7f4bd4198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/2155069652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd410c0d0 msgr2=0x7f4bd419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd410c0d0 0x7f4bd419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/2155069652 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd419d2f0 con 0x7f4bd4102cb0 2024-09-11T22:12:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bd37fe640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd410c0d0 0x7f4bd419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bd4102cb0 0x7f4bd4198300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00eb00 tx=0x7f4bcc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bcbfff640 1 -- 172.21.15.152:0/2155069652 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc010430 con 0x7f4bd4102cb0 2024-09-11T22:12:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bcbfff640 1 -- 172.21.15.152:0/2155069652 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bcc010ab0 con 0x7f4bd4102cb0 2024-09-11T22:12:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bd95e4640 1 -- 172.21.15.152:0/2155069652 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd419d5e0 con 0x7f4bd4102cb0 2024-09-11T22:12:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bcbfff640 1 -- 172.21.15.152:0/2155069652 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc017bb0 con 0x7f4bd4102cb0 2024-09-11T22:12:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.417+0000 7f4bd95e4640 1 -- 172.21.15.152:0/2155069652 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd41a4e70 con 0x7f4bd4102cb0 2024-09-11T22:12:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.419+0000 7f4bcbfff640 1 -- 172.21.15.152:0/2155069652 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f4bcc010c60 con 0x7f4bd4102cb0 2024-09-11T22:12:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.420+0000 7f4bcbfff640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4bc00a2da0 0x7f4bc00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.420+0000 7f4bd27fc640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4bc00a2da0 0x7f4bc00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.420+0000 7f4bdc459740 1 Processor -- start 2024-09-11T22:12:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.420+0000 7f4bcbfff640 1 -- 172.21.15.152:0/2155069652 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f4bcc0cfe60 con 0x7f4bd4102cb0 2024-09-11T22:12:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.420+0000 7f4bdc459740 1 -- start start 2024-09-11T22:12:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd27fc640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4bc00a2da0 0x7f4bc00a5260 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4bd410d380 tx=0x7f4bbc005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 0x561717b09ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b0a410 0x561717b14770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b14cb0 0x561717b170a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bdc459740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561717a6e2f0 con 0x561717b0a410 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bdc459740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561717a16270 con 0x561717b14cb0 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bdc459740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561717a6a2b0 con 0x561717b09af0 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd27fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b0a410 0x561717b14770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 0x561717b09ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd27fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b0a410 0x561717b14770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40454/0 (socket says 172.21.15.152:40454) 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd27fc640 1 -- 172.21.15.152:0/2399550407 learned_addr learned my addr 172.21.15.152:0/2399550407 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd37fe640 1 --2- 172.21.15.152:0/2399550407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b14cb0 0x561717b170a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/2399550407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b14cb0 msgr2=0x561717b170a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/2399550407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b14cb0 0x561717b170a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/2399550407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b0a410 msgr2=0x561717b14770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/2399550407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b0a410 0x561717b14770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/2399550407 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561717a15340 con 0x561717b09af0 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd37fe640 1 --2- 172.21.15.152:0/2399550407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b14cb0 0x561717b170a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/2399550407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 0x561717b09ed0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0cd550 tx=0x7f4bcc0986f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=581e925e1dbdca28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bc97fa640 1 -- 172.21.15.152:0/2399550407 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0b5070 con 0x561717b09af0 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bc97fa640 1 -- 172.21.15.152:0/2399550407 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bcc0a06d0 con 0x561717b09af0 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.421+0000 7f4bc97fa640 1 -- 172.21.15.152:0/2399550407 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc098990 con 0x561717b09af0 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.422+0000 7f4bdc459740 1 -- 172.21.15.152:0/2399550407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 msgr2=0x561717b09ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.422+0000 7f4bdc459740 1 --2- 172.21.15.152:0/2399550407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 0x561717b09ed0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0cd550 tx=0x7f4bcc0986f0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.422+0000 7f4bdc459740 1 -- 172.21.15.152:0/2399550407 shutdown_connections 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.422+0000 7f4bdc459740 1 --2- 172.21.15.152:0/2399550407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b14cb0 0x561717b170a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.422+0000 7f4bdc459740 1 --2- 172.21.15.152:0/2399550407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b0a410 0x561717b14770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.422+0000 7f4bdc459740 1 --2- 172.21.15.152:0/2399550407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 0x561717b09ed0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.422+0000 7f4bdc459740 1 -- 172.21.15.152:0/2399550407 >> 172.21.15.152:0/2399550407 conn(0x561717b06060 msgr2=0x561717b06440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.422+0000 7f4bdc459740 1 -- 172.21.15.152:0/2399550407 shutdown_connections 2024-09-11T22:12:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.422+0000 7f4bdc459740 1 -- 172.21.15.152:0/2399550407 wait complete. 2024-09-11T22:12:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bdc459740 1 -- start start 2024-09-11T22:12:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bdc459740 1 Processor -- start 2024-09-11T22:12:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 0x561717b11bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b0a410 0x561717b12130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b14cb0 0x561717b12670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bdc459740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561717b17880 con 0x561717b14cb0 2024-09-11T22:12:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bdc459740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5617179f7290 con 0x561717b0a410 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bdc459740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561717b17a00 con 0x561717b09af0 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bdc459740 10 client.0 _ll_register_callbacks cb 0x561717a28140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 0x561717b11bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bd37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b14cb0 0x561717b12670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 0x561717b11bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:46848/0 (socket says 172.21.15.152:46848) 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/1372812464 learned_addr learned my addr 172.21.15.152:0/1372812464 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.423+0000 7f4bd27fc640 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b0a410 0x561717b12130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/1372812464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b0a410 msgr2=0x561717b12130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b0a410 0x561717b12130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/1372812464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b14cb0 msgr2=0x561717b12670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b14cb0 0x561717b12670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/1372812464 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561717781210 con 0x561717b09af0 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 0x561717b11bf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0cd600 tx=0x7f4bcc09c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6213830ed5b5fa89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bba7fc640 1 -- 172.21.15.152:0/1372812464 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0b5040 con 0x561717b09af0 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bba7fc640 1 -- 172.21.15.152:0/1372812464 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f4bcc098990 con 0x561717b09af0 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bdc459740 1 -- 172.21.15.152:0/1372812464 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bcc0a06d0 con 0x561717b09af0 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bba7fc640 1 -- 172.21.15.152:0/1372812464 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4bcc09b770 con 0x561717b09af0 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bdc459740 10 client.26872 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bdc459740 1 -- 172.21.15.152:0/1372812464 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56171784d620 con 0x561717b09af0 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bba7fc640 1 -- 172.21.15.152:0/1372812464 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bcc0a06d0 con 0x561717b09af0 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.424+0000 7f4bba7fc640 1 -- 172.21.15.152:0/1372812464 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f4bcc0a0170 con 0x561717b09af0 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.425+0000 7f4bdc459740 10 client.26872 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.425+0000 7f4bdc459740 10 client.26872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.425+0000 7f4bdc459740 20 client.26872 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.425+0000 7f4bdc459740 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561717b24ae0 0x561717b26ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.425+0000 7f4bdc459740 4 client.26872 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.425+0000 7f4bdc459740 1 -- 172.21.15.152:0/1372812464 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561717a7ba20 con 0x561717b24ae0 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.425+0000 7f4bd27fc640 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561717b24ae0 0x561717b26ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.425+0000 7f4bba7fc640 10 client.26872 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.425+0000 7f4bd27fc640 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561717b24ae0 0x561717b26ed0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c7b3dc2ec3b544b server_cookie=eafc025ee2130fa2 in_seq=0 out_seq=0 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bba7fc640 1 -- 172.21.15.152:0/1372812464 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561717a7ba20 con 0x561717b24ae0 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bba7fc640 10 client.26872 handle_command_reply: tid=0 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 1 client.26872 shutdown 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 1 -- 172.21.15.152:0/1372812464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 msgr2=0x561717b11bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 0x561717b11bf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0cd600 tx=0x7f4bcc09c4a0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 1 -- 172.21.15.152:0/1372812464 shutdown_connections 2024-09-11T22:12:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561717b24ae0 0x561717b26ed0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b14cb0 0x561717b12670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bba7fc640 0 client.26872 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b0a410 0x561717b12130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 1 --2- 172.21.15.152:0/1372812464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b09af0 0x561717b11bf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 1 -- 172.21.15.152:0/1372812464 >> 172.21.15.152:0/1372812464 conn(0x561717b06060 msgr2=0x561717b0bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 1 -- 172.21.15.152:0/1372812464 shutdown_connections 2024-09-11T22:12:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 1 -- 172.21.15.152:0/1372812464 wait complete. 2024-09-11T22:12:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.426+0000 7f4bdc459740 20 client.26872 trim_cache size 0 max 16384 2024-09-11T22:12:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bdc459740 1 Processor -- start 2024-09-11T22:12:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bdc459740 1 -- start start 2024-09-11T22:12:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b13f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b0a410 0x561717b124a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b14cb0 0x561717b2c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bdc459740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd41b0240 con 0x561717b09af0 2024-09-11T22:12:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bdc459740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd41adb10 con 0x561717b0a410 2024-09-11T22:12:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bdc459740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd41ab980 con 0x561717b14cb0 2024-09-11T22:12:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b13f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b13f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40486/0 (socket says 172.21.15.152:40486) 2024-09-11T22:12:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/1948329212 learned_addr learned my addr 172.21.15.152:0/1948329212 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bd27fc640 1 --2- 172.21.15.152:0/1948329212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b0a410 0x561717b124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.445+0000 7f4bd37fe640 1 --2- 172.21.15.152:0/1948329212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b14cb0 0x561717b2c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.446+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/1948329212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b14cb0 msgr2=0x561717b2c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.446+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/1948329212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b14cb0 0x561717b2c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.446+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/1948329212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b0a410 msgr2=0x561717b124a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.446+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/1948329212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b0a410 0x561717b124a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.446+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/1948329212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561717b06cf0 con 0x561717b09af0 2024-09-11T22:12:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.446+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/1948329212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b13f20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc09c2b0 tx=0x7f4bcc0cd7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ba647e174ecf6a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.446+0000 7f4bc8ff9640 1 -- 172.21.15.152:0/1948329212 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0b5040 con 0x561717b09af0 2024-09-11T22:12:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.446+0000 7f4bc8ff9640 1 -- 172.21.15.152:0/1948329212 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bcc0a06d0 con 0x561717b09af0 2024-09-11T22:12:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.446+0000 7f4bc8ff9640 1 -- 172.21.15.152:0/1948329212 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0982d0 con 0x561717b09af0 2024-09-11T22:12:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.447+0000 7f4bdc459740 1 -- 172.21.15.152:0/1948329212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 msgr2=0x561717b13f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.447+0000 7f4bdc459740 1 --2- 172.21.15.152:0/1948329212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b13f20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc09c2b0 tx=0x7f4bcc0cd7d0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.447+0000 7f4bdc459740 1 -- 172.21.15.152:0/1948329212 shutdown_connections 2024-09-11T22:12:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.447+0000 7f4bdc459740 1 --2- 172.21.15.152:0/1948329212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b14cb0 0x561717b2c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.447+0000 7f4bdc459740 1 --2- 172.21.15.152:0/1948329212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b0a410 0x561717b124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.447+0000 7f4bdc459740 1 --2- 172.21.15.152:0/1948329212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b13f20 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.447+0000 7f4bdc459740 1 -- 172.21.15.152:0/1948329212 >> 172.21.15.152:0/1948329212 conn(0x561717b06060 msgr2=0x561717b051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.447+0000 7f4bdc459740 1 -- 172.21.15.152:0/1948329212 shutdown_connections 2024-09-11T22:12:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.447+0000 7f4bdc459740 1 -- 172.21.15.152:0/1948329212 wait complete. 2024-09-11T22:12:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.447+0000 7f4bdc459740 1 -- start start 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.447+0000 7f4bdc459740 1 Processor -- start 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b1d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b0a410 0x561717b0e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bdc459740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b14cb0 0x561717b0ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bdc459740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd41abfd0 con 0x561717b09af0 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bdc459740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd41ad440 con 0x561717b14cb0 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bdc459740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd41ac6a0 con 0x561717b0a410 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bdc459740 10 client.0 _ll_register_callbacks cb 0x7f4bcc0b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b1d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b1d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40500/0 (socket says 172.21.15.152:40500) 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/948378754 learned_addr learned my addr 172.21.15.152:0/948378754 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bd27fc640 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b0a410 0x561717b0e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bd37fe640 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b14cb0 0x561717b0ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/948378754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b0a410 msgr2=0x561717b0e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b0a410 0x561717b0e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/948378754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b14cb0 msgr2=0x561717b0ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b14cb0 0x561717b0ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bd2ffd640 1 -- 172.21.15.152:0/948378754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561717b0f200 con 0x561717b09af0 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bd2ffd640 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b1d170 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0a4a60 tx=0x7f4bcc09bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d104d627e518e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bba7fc640 1 -- 172.21.15.152:0/948378754 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0b5040 con 0x561717b09af0 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bba7fc640 1 -- 172.21.15.152:0/948378754 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f4bcc0a0170 con 0x561717b09af0 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.448+0000 7f4bdc459740 1 -- 172.21.15.152:0/948378754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bcc0a06d0 con 0x561717b09af0 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bba7fc640 1 -- 172.21.15.152:0/948378754 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4bcc0a0370 con 0x561717b09af0 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bdc459740 10 client.17316 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bdc459740 1 -- 172.21.15.152:0/948378754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561717b0f200 con 0x561717b09af0 2024-09-11T22:12:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bba7fc640 1 -- 172.21.15.152:0/948378754 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bcc0a06d0 con 0x561717b09af0 2024-09-11T22:12:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bba7fc640 1 -- 172.21.15.152:0/948378754 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f4bcc09b1e0 con 0x561717b09af0 2024-09-11T22:12:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bdc459740 10 client.17316 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bdc459740 10 client.17316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bdc459740 20 client.17316 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bdc459740 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561717b8f530 0x561717b91920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bdc459740 4 client.17316 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:12:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bdc459740 1 -- 172.21.15.152:0/948378754 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561717a75d70 con 0x561717b8f530 2024-09-11T22:12:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.449+0000 7f4bd27fc640 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561717b8f530 0x561717b91920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.450+0000 7f4bd27fc640 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561717b8f530 0x561717b91920 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fae7f64bba19e979 server_cookie=fffa47f5112f462c in_seq=0 out_seq=0 2024-09-11T22:12:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:02.450+0000 7f4bba7fc640 10 client.17316 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:03.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:03 smithi152 ceph-mon[31188]: pgmap v237: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.7 MiB/s wr, 621 op/s 2024-09-11T22:12:03.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:03 smithi179 ceph-mon[35603]: pgmap v237: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.7 MiB/s wr, 621 op/s 2024-09-11T22:12:03.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:03 smithi193 ceph-mon[35545]: pgmap v237: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.7 MiB/s wr, 621 op/s 2024-09-11T22:12:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bba7fc640 1 -- 172.21.15.152:0/948378754 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561717a75d70 con 0x561717b8f530 2024-09-11T22:12:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bba7fc640 10 client.17316 handle_command_reply: tid=0 2024-09-11T22:12:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bdc459740 1 client.17316 shutdown 2024-09-11T22:12:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bdc459740 1 -- 172.21.15.152:0/948378754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 msgr2=0x561717b1d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bdc459740 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b1d170 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0a4a60 tx=0x7f4bcc09bb40 comp rx=0 tx=0).stop 2024-09-11T22:12:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bdc459740 1 -- 172.21.15.152:0/948378754 shutdown_connections 2024-09-11T22:12:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bdc459740 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561717b8f530 0x561717b91920 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bdc459740 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561717b14cb0 0x561717b0ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bba7fc640 0 client.17316 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bdc459740 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561717b0a410 0x561717b0e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bdc459740 1 --2- 172.21.15.152:0/948378754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561717b09af0 0x561717b1d170 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bdc459740 1 -- 172.21.15.152:0/948378754 >> 172.21.15.152:0/948378754 conn(0x561717b06060 msgr2=0x561717b0b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bdc459740 1 -- 172.21.15.152:0/948378754 shutdown_connections 2024-09-11T22:12:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.966+0000 7f4bdc459740 1 -- 172.21.15.152:0/948378754 wait complete. 2024-09-11T22:12:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.967+0000 7f4bdc459740 20 client.17316 trim_cache size 0 max 16384 2024-09-11T22:12:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:12:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:12:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:12:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:12:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 -- 172.21.15.152:0/2155069652 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4bc00a2da0 msgr2=0x7f4bc00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4bc00a2da0 0x7f4bc00a5260 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4bd410d380 tx=0x7f4bbc005f90 comp rx=0 tx=0).stop 2024-09-11T22:12:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 -- 172.21.15.152:0/2155069652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bd4102cb0 msgr2=0x7f4bd4198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bd4102cb0 0x7f4bd4198300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00eb00 tx=0x7f4bcc00c2d0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 -- 172.21.15.152:0/2155069652 shutdown_connections 2024-09-11T22:12:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f4bc00a2da0 0x7f4bc00a5260 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd410c0d0 0x7f4bd419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bd41035d0 0x7f4bd4198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 --2- 172.21.15.152:0/2155069652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bd4102cb0 0x7f4bd4198300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 -- 172.21.15.152:0/2155069652 >> 172.21.15.152:0/2155069652 conn(0x7f4bd40fc6c0 msgr2=0x7f4bd40fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 -- 172.21.15.152:0/2155069652 shutdown_connections 2024-09-11T22:12:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:03.968+0000 7f4bd95e4640 1 -- 172.21.15.152:0/2155069652 wait complete. 2024-09-11T22:12:04.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:04 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:12:04.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:04 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:12:04.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:04 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:12:04.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:04 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:12:04.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:04 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:12:04.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:04 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:12:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 390.0 s, 1170.2 tps, lat 85.227 ms stddev 163.384 2024-09-11T22:12:05.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:05 smithi152 ceph-mon[31188]: pgmap v238: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 12 MiB/s wr, 852 op/s 2024-09-11T22:12:05.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:05 smithi152 ceph-mon[31188]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T22:12:05.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:05 smithi179 ceph-mon[35603]: pgmap v238: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 12 MiB/s wr, 852 op/s 2024-09-11T22:12:05.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:05 smithi179 ceph-mon[35603]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T22:12:05.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:05 smithi193 ceph-mon[35545]: pgmap v238: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 12 MiB/s wr, 852 op/s 2024-09-11T22:12:05.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:05 smithi193 ceph-mon[35545]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T22:12:07.034 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T22:12:07.035 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.4 2024-09-11T22:12:07.035 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:12:07.387 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:07.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:07 smithi152 ceph-mon[31188]: pgmap v240: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 9.2 MiB/s wr, 713 op/s 2024-09-11T22:12:07.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:07 smithi179 ceph-mon[35603]: pgmap v240: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 9.2 MiB/s wr, 713 op/s 2024-09-11T22:12:07.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:07 smithi193 ceph-mon[35545]: pgmap v240: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 9.2 MiB/s wr, 713 op/s 2024-09-11T22:12:07.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.910+0000 7f8160516640 1 -- 172.21.15.152:0/143160529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8158102570 msgr2=0x7f81581029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:07.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.910+0000 7f8160516640 1 --2- 172.21.15.152:0/143160529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8158102570 0x7f81581029b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f814800d990 tx=0x7f814802a160 comp rx=0 tx=0).stop 2024-09-11T22:12:07.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.911+0000 7f8160516640 1 -- 172.21.15.152:0/143160529 shutdown_connections 2024-09-11T22:12:07.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.911+0000 7f8160516640 1 --2- 172.21.15.152:0/143160529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8158102ef0 0x7f815810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:07.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.911+0000 7f8160516640 1 --2- 172.21.15.152:0/143160529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8158102570 0x7f81581029b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:07.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.911+0000 7f8160516640 1 --2- 172.21.15.152:0/143160529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8158100e20 0x7f8158101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:07.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.911+0000 7f8160516640 1 -- 172.21.15.152:0/143160529 >> 172.21.15.152:0/143160529 conn(0x7f81580fc7d0 msgr2=0x7f81580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:07.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.911+0000 7f8160516640 1 -- 172.21.15.152:0/143160529 shutdown_connections 2024-09-11T22:12:07.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.911+0000 7f8160516640 1 -- 172.21.15.152:0/143160529 wait complete. 2024-09-11T22:12:07.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.911+0000 7f8160516640 1 Processor -- start 2024-09-11T22:12:07.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.911+0000 7f8160516640 1 -- start start 2024-09-11T22:12:07.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f8160516640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8158100e20 0x7f8158196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:07.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f8160516640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8158102570 0x7f8158196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:07.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f8160516640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8158102ef0 0x7f815819ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:07.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f8160516640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f815810fe40 con 0x7f8158102ef0 2024-09-11T22:12:07.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f8160516640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f815810fcc0 con 0x7f8158100e20 2024-09-11T22:12:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f8160516640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f815810ffc0 con 0x7f8158102570 2024-09-11T22:12:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f815eab3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8158102ef0 0x7f815819ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f815dab1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8158102570 0x7f8158196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f815e2b2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8158100e20 0x7f8158196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f815dab1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8158102570 0x7f8158196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:51202/0 (socket says 172.21.15.152:51202) 2024-09-11T22:12:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f815dab1640 1 -- 172.21.15.152:0/133534595 learned_addr learned my addr 172.21.15.152:0/133534595 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f815dab1640 1 -- 172.21.15.152:0/133534595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8158100e20 msgr2=0x7f8158196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f815dab1640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8158100e20 0x7f8158196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f815dab1640 1 -- 172.21.15.152:0/133534595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8158102ef0 msgr2=0x7f815819ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f815dab1640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8158102ef0 0x7f815819ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f815dab1640 1 -- 172.21.15.152:0/133534595 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815819b3e0 con 0x7f8158102570 2024-09-11T22:12:07.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.912+0000 7f815dab1640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8158102570 0x7f8158196970 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f814800d960 tx=0x7f8148003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:07.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.913+0000 7f814f7fe640 1 -- 172.21.15.152:0/133534595 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814803f020 con 0x7f8158102570 2024-09-11T22:12:07.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.913+0000 7f8160516640 1 -- 172.21.15.152:0/133534595 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815819b670 con 0x7f8158102570 2024-09-11T22:12:07.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.913+0000 7f814f7fe640 1 -- 172.21.15.152:0/133534595 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8148003e30 con 0x7f8158102570 2024-09-11T22:12:07.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.913+0000 7f814f7fe640 1 -- 172.21.15.152:0/133534595 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148037040 con 0x7f8158102570 2024-09-11T22:12:07.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.913+0000 7f8160516640 1 -- 172.21.15.152:0/133534595 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81581a2fb0 con 0x7f8158102570 2024-09-11T22:12:07.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.916+0000 7f814f7fe640 1 -- 172.21.15.152:0/133534595 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8148042020 con 0x7f8158102570 2024-09-11T22:12:07.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.916+0000 7f814d7fa640 1 -- 172.21.15.152:0/133534595 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8158101200 con 0x7f8158102570 2024-09-11T22:12:07.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.917+0000 7f814f7fe640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81440a2d70 0x7f81440a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:07.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.917+0000 7f814f7fe640 1 -- 172.21.15.152:0/133534595 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8658+0+0 (secure 0 0 0) 0x7f81480eef10 con 0x7f8158102570 2024-09-11T22:12:07.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.917+0000 7f815e2b2640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81440a2d70 0x7f81440a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.918+0000 7f815e2b2640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81440a2d70 0x7f81440a5230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f81540045f0 tx=0x7f815400b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:07.923+0000 7f814f7fe640 1 -- 172.21.15.152:0/133534595 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8148049020 con 0x7f8158102570 2024-09-11T22:12:08.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.230+0000 7f814d7fa640 1 -- 172.21.15.152:0/133534595 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8158062df0 con 0x7f8158102570 2024-09-11T22:12:08.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.235+0000 7f814f7fe640 1 -- 172.21.15.152:0/133534595 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f81480bbb50 con 0x7f8158102570 2024-09-11T22:12:08.236 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:12:08.236 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:12:08.236 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:12:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.238+0000 7f814d7fa640 1 -- 172.21.15.152:0/133534595 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81440a2d70 msgr2=0x7f81440a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.238+0000 7f814d7fa640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81440a2d70 0x7f81440a5230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f81540045f0 tx=0x7f815400b390 comp rx=0 tx=0).stop 2024-09-11T22:12:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.238+0000 7f814d7fa640 1 -- 172.21.15.152:0/133534595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8158102570 msgr2=0x7f8158196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.238+0000 7f814d7fa640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8158102570 0x7f8158196970 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f814800d960 tx=0x7f8148003c10 comp rx=0 tx=0).stop 2024-09-11T22:12:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.238+0000 7f814d7fa640 1 -- 172.21.15.152:0/133534595 shutdown_connections 2024-09-11T22:12:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.238+0000 7f814d7fa640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f81440a2d70 0x7f81440a5230 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.238+0000 7f814d7fa640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8158102ef0 0x7f815819ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.238+0000 7f814d7fa640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8158102570 0x7f8158196970 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.238+0000 7f814d7fa640 1 --2- 172.21.15.152:0/133534595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8158100e20 0x7f8158196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.239+0000 7f814d7fa640 1 -- 172.21.15.152:0/133534595 >> 172.21.15.152:0/133534595 conn(0x7f81580fc7d0 msgr2=0x7f8158104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:08.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.243+0000 7f814d7fa640 1 -- 172.21.15.152:0/133534595 shutdown_connections 2024-09-11T22:12:08.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:08.243+0000 7f814d7fa640 1 -- 172.21.15.152:0/133534595 wait complete. 2024-09-11T22:12:08.982 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 139.4 --await-for 45.0' 2024-09-11T22:12:08.982 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 139.4 --await-for 45.0 2024-09-11T22:12:09.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:09 smithi152 ceph-mon[31188]: pgmap v241: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 9.2 MiB/s wr, 713 op/s 2024-09-11T22:12:09.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:09 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/133534595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:09.420 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:09.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:09 smithi179 ceph-mon[35603]: pgmap v241: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 9.2 MiB/s wr, 713 op/s 2024-09-11T22:12:09.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:09 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/133534595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:09 smithi193 ceph-mon[35545]: pgmap v241: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 9.2 MiB/s wr, 713 op/s 2024-09-11T22:12:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:09 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/133534595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 395.0 s, 2812.8 tps, lat 35.412 ms stddev 42.623 2024-09-11T22:12:10.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.084+0000 7fd45ebcf640 1 -- 172.21.15.152:0/382463058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd450095510 msgr2=0x7fd450099120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:10.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.084+0000 7fd45ebcf640 1 --2- 172.21.15.152:0/382463058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd450095510 0x7fd450099120 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd448009930 tx=0x7fd44802a420 comp rx=0 tx=0).stop 2024-09-11T22:12:10.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.084+0000 7fd45ebcf640 1 -- 172.21.15.152:0/382463058 shutdown_connections 2024-09-11T22:12:10.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.084+0000 7fd45ebcf640 1 --2- 172.21.15.152:0/382463058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd450099880 0x7fd4500a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.085+0000 7fd45ebcf640 1 --2- 172.21.15.152:0/382463058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd450095510 0x7fd450099120 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.085+0000 7fd45ebcf640 1 --2- 172.21.15.152:0/382463058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd450094b60 0x7fd450094f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.085+0000 7fd45ebcf640 1 -- 172.21.15.152:0/382463058 >> 172.21.15.152:0/382463058 conn(0x7fd45000a1b0 msgr2=0x7fd45000a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:10.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.085+0000 7fd45ebcf640 1 -- 172.21.15.152:0/382463058 shutdown_connections 2024-09-11T22:12:10.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.085+0000 7fd45ebcf640 1 -- 172.21.15.152:0/382463058 wait complete. 2024-09-11T22:12:10.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.086+0000 7fd45ebcf640 1 Processor -- start 2024-09-11T22:12:10.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.086+0000 7fd45ebcf640 1 -- start start 2024-09-11T22:12:10.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.086+0000 7fd45ebcf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd450094b60 0x7fd45009b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.086+0000 7fd45ebcf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd450095510 0x7fd45009b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.086+0000 7fd45ebcf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd450099880 0x7fd45009bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.086+0000 7fd45ebcf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd4500a59d0 con 0x7fd450095510 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.086+0000 7fd45ebcf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd4500a5850 con 0x7fd450094b60 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.086+0000 7fd45ebcf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd4500a5b50 con 0x7fd450099880 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.086+0000 7fd45d3cc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd450095510 0x7fd45009b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45d3cc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd450095510 0x7fd45009b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50276/0 (socket says 172.21.15.152:50276) 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45d3cc640 1 -- 172.21.15.152:0/788856174 learned_addr learned my addr 172.21.15.152:0/788856174 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45e3ce640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd450099880 0x7fd45009bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45dbcd640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd450094b60 0x7fd45009b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45d3cc640 1 -- 172.21.15.152:0/788856174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd450099880 msgr2=0x7fd45009bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:10.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd450099880 0x7fd45009bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45d3cc640 1 -- 172.21.15.152:0/788856174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd450094b60 msgr2=0x7fd45009b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:10.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd450094b60 0x7fd45009b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45d3cc640 1 -- 172.21.15.152:0/788856174 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45013e6d0 con 0x7fd450095510 2024-09-11T22:12:10.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd450095510 0x7fd45009b8b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd448009900 tx=0x7fd448003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:10.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd44effd640 1 -- 172.21.15.152:0/788856174 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44803f070 con 0x7fd450095510 2024-09-11T22:12:10.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd44effd640 1 -- 172.21.15.152:0/788856174 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd448031c90 con 0x7fd450095510 2024-09-11T22:12:10.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd44effd640 1 -- 172.21.15.152:0/788856174 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448035030 con 0x7fd450095510 2024-09-11T22:12:10.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45ebcf640 1 -- 172.21.15.152:0/788856174 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45013e960 con 0x7fd450095510 2024-09-11T22:12:10.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.087+0000 7fd45ebcf640 1 -- 172.21.15.152:0/788856174 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd45013ee90 con 0x7fd450095510 2024-09-11T22:12:10.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.091+0000 7fd44effd640 1 -- 172.21.15.152:0/788856174 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd448042070 con 0x7fd450095510 2024-09-11T22:12:10.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.092+0000 7fd44effd640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd4440a2dc0 0x7fd4440a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.092+0000 7fd44effd640 1 -- 172.21.15.152:0/788856174 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8658+0+0 (secure 0 0 0) 0x7fd4480efb10 con 0x7fd450095510 2024-09-11T22:12:10.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.092+0000 7fd45dbcd640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd4440a2dc0 0x7fd4440a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.093+0000 7fd45dbcd640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd4440a2dc0 0x7fd4440a5280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd454009b60 tx=0x7fd454005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:10.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd46220a740 1 Processor -- start 2024-09-11T22:12:10.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd46220a740 1 -- start start 2024-09-11T22:12:10.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd46220a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75767c0 0x5556c7576ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd46220a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75770e0 0x5556c75925b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd46220a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c7594ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd46220a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5556c74dc2a0 con 0x5556c75767c0 2024-09-11T22:12:10.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd46220a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5556c7483b10 con 0x5556c7592af0 2024-09-11T22:12:10.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd46220a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5556c74d8260 con 0x5556c75770e0 2024-09-11T22:12:10.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd45dbcd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75767c0 0x5556c7576ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd45dbcd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75767c0 0x5556c7576ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50280/0 (socket says 172.21.15.152:50280) 2024-09-11T22:12:10.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd45e3ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c7594ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.095+0000 7fd45dbcd640 1 -- 172.21.15.152:0/330692765 learned_addr learned my addr 172.21.15.152:0/330692765 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:10.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.096+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/330692765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75770e0 0x5556c75925b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.096+0000 7fd45e3ce640 1 -- 172.21.15.152:0/330692765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75770e0 msgr2=0x5556c75925b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:10.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.096+0000 7fd45e3ce640 1 --2- 172.21.15.152:0/330692765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75770e0 0x5556c75925b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.096+0000 7fd45e3ce640 1 -- 172.21.15.152:0/330692765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75767c0 msgr2=0x5556c7576ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:10.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.096+0000 7fd45e3ce640 1 --2- 172.21.15.152:0/330692765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75767c0 0x5556c7576ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.096+0000 7fd45e3ce640 1 -- 172.21.15.152:0/330692765 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556c724db90 con 0x5556c7592af0 2024-09-11T22:12:10.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.096+0000 7fd45e3ce640 1 --2- 172.21.15.152:0/330692765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c7594ee0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd458050280 tx=0x7fd45806b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56f76285baee6c8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:10.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.096+0000 7fd443fff640 1 -- 172.21.15.152:0/330692765 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458074620 con 0x5556c7592af0 2024-09-11T22:12:10.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.097+0000 7fd443fff640 1 -- 172.21.15.152:0/330692765 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd458074ca0 con 0x5556c7592af0 2024-09-11T22:12:10.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.097+0000 7fd443fff640 1 -- 172.21.15.152:0/330692765 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45807dd80 con 0x5556c7592af0 2024-09-11T22:12:10.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.097+0000 7fd46220a740 1 -- 172.21.15.152:0/330692765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 msgr2=0x5556c7594ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:10.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.097+0000 7fd46220a740 1 --2- 172.21.15.152:0/330692765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c7594ee0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd458050280 tx=0x7fd45806b6e0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.097+0000 7fd46220a740 1 -- 172.21.15.152:0/330692765 shutdown_connections 2024-09-11T22:12:10.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.097+0000 7fd46220a740 1 --2- 172.21.15.152:0/330692765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c7594ee0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.097+0000 7fd46220a740 1 --2- 172.21.15.152:0/330692765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75770e0 0x5556c75925b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.097+0000 7fd46220a740 1 --2- 172.21.15.152:0/330692765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75767c0 0x5556c7576ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.097+0000 7fd46220a740 1 -- 172.21.15.152:0/330692765 >> 172.21.15.152:0/330692765 conn(0x5556c7572e90 msgr2=0x5556c7573270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:10.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.098+0000 7fd46220a740 1 -- 172.21.15.152:0/330692765 shutdown_connections 2024-09-11T22:12:10.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.098+0000 7fd46220a740 1 -- 172.21.15.152:0/330692765 wait complete. 2024-09-11T22:12:10.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.098+0000 7fd46220a740 1 -- start start 2024-09-11T22:12:10.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.099+0000 7fd46220a740 1 Processor -- start 2024-09-11T22:12:10.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.100+0000 7fd46220a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c75767c0 0x5556c758fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.100+0000 7fd46220a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75770e0 0x5556c758ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.100+0000 7fd46220a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c7592af0 0x5556c7590480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.100+0000 7fd46220a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5556c75956c0 con 0x5556c7592af0 2024-09-11T22:12:10.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.100+0000 7fd46220a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5556c74646e0 con 0x5556c75767c0 2024-09-11T22:12:10.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.100+0000 7fd46220a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5556c7595840 con 0x5556c75770e0 2024-09-11T22:12:10.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.100+0000 7fd46220a740 10 client.0 _ll_register_callbacks cb 0x5556c7488a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:10.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.100+0000 7fd45dbcd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c75767c0 0x5556c758fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.100+0000 7fd45dbcd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c75767c0 0x5556c758fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:57014/0 (socket says 172.21.15.152:57014) 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.100+0000 7fd45dbcd640 1 -- 172.21.15.152:0/1576641188 learned_addr learned my addr 172.21.15.152:0/1576641188 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.100+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75770e0 0x5556c758ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.101+0000 7fd45e3ce640 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c7592af0 0x5556c7590480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.101+0000 7fd45d3cc640 1 -- 172.21.15.152:0/1576641188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c75767c0 msgr2=0x5556c758fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.101+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c75767c0 0x5556c758fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.101+0000 7fd45d3cc640 1 -- 172.21.15.152:0/1576641188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c7592af0 msgr2=0x5556c7590480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.101+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c7592af0 0x5556c7590480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.101+0000 7fd45d3cc640 1 -- 172.21.15.152:0/1576641188 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556c759ec80 con 0x5556c75770e0 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.101+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75770e0 0x5556c758ff40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd4480ed1a0 tx=0x7fd448009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ef72fe6b0fdf94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.101+0000 7fd4417fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:12:10.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.102+0000 7fd4417fa640 1 -- 172.21.15.152:0/1576641188 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448049040 con 0x5556c75770e0 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.102+0000 7fd46220a740 1 -- 172.21.15.152:0/1576641188 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd458074ca0 con 0x5556c75770e0 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.102+0000 7fd4417fa640 1 -- 172.21.15.152:0/1576641188 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8658+0+0 (secure 0 0 0) 0x7fd4480b8610 con 0x5556c75770e0 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.102+0000 7fd4417fa640 1 -- 172.21.15.152:0/1576641188 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd4480bbfa0 con 0x5556c75770e0 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.102+0000 7fd46220a740 10 client.26896 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.102+0000 7fd46220a740 1 -- 172.21.15.152:0/1576641188 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5556c7595770 con 0x5556c75770e0 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.102+0000 7fd4417fa640 1 -- 172.21.15.152:0/1576641188 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd458074ca0 con 0x5556c75770e0 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.103+0000 7fd4417fa640 1 -- 172.21.15.152:0/1576641188 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd4480bc200 con 0x5556c75770e0 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.103+0000 7fd46220a740 10 client.26896 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.103+0000 7fd46220a740 10 client.26896 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.103+0000 7fd46220a740 20 client.26896 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.103+0000 7fd46220a740 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5556c75a2d30 0x5556c75a5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.103+0000 7fd46220a740 4 client.26896 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.103+0000 7fd46220a740 1 -- 172.21.15.152:0/1576641188 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556c74e99d0 con 0x5556c75a2d30 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.104+0000 7fd45dbcd640 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5556c75a2d30 0x5556c75a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.104+0000 7fd45dbcd640 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5556c75a2d30 0x5556c75a5190 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd30355e1b423c31 server_cookie=f95baf367f2d5b2b in_seq=0 out_seq=0 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.104+0000 7fd4417fa640 10 client.26896 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.105+0000 7fd4417fa640 1 -- 172.21.15.152:0/1576641188 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556c74e99d0 con 0x5556c75a2d30 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.105+0000 7fd4417fa640 10 client.26896 handle_command_reply: tid=0 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.105+0000 7fd46220a740 1 client.26896 shutdown 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd46220a740 1 -- 172.21.15.152:0/1576641188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75770e0 msgr2=0x5556c758ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd46220a740 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75770e0 0x5556c758ff40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd4480ed1a0 tx=0x7fd448009260 comp rx=0 tx=0).stop 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd46220a740 1 -- 172.21.15.152:0/1576641188 shutdown_connections 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd46220a740 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5556c75a2d30 0x5556c75a5190 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd46220a740 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c7592af0 0x5556c7590480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd46220a740 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75770e0 0x5556c758ff40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd46220a740 1 --2- 172.21.15.152:0/1576641188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c75767c0 0x5556c758fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd46220a740 1 -- 172.21.15.152:0/1576641188 >> 172.21.15.152:0/1576641188 conn(0x5556c7572e90 msgr2=0x5556c7578bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:10.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd4417fa640 0 client.26896 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:10.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd46220a740 1 -- 172.21.15.152:0/1576641188 shutdown_connections 2024-09-11T22:12:10.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd46220a740 1 -- 172.21.15.152:0/1576641188 wait complete. 2024-09-11T22:12:10.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.106+0000 7fd46220a740 20 client.26896 trim_cache size 0 max 16384 2024-09-11T22:12:10.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.135+0000 7fd46220a740 1 Processor -- start 2024-09-11T22:12:10.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.135+0000 7fd46220a740 1 -- start start 2024-09-11T22:12:10.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.135+0000 7fd46220a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75767c0 0x5556c75789c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.135+0000 7fd46220a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c75aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.136+0000 7fd46220a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c75aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.136+0000 7fd46220a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd450141ae0 con 0x5556c75770e0 2024-09-11T22:12:10.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.136+0000 7fd46220a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd45013f3b0 con 0x5556c7592af0 2024-09-11T22:12:10.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.136+0000 7fd46220a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd450095be0 con 0x5556c75767c0 2024-09-11T22:12:10.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.136+0000 7fd45dbcd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75767c0 0x5556c75789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.136+0000 7fd45d3cc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c75aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.136+0000 7fd45d3cc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c75aaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50296/0 (socket says 172.21.15.152:50296) 2024-09-11T22:12:10.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.136+0000 7fd45d3cc640 1 -- 172.21.15.152:0/668013500 learned_addr learned my addr 172.21.15.152:0/668013500 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:10.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.137+0000 7fd45d3cc640 1 -- 172.21.15.152:0/668013500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75767c0 msgr2=0x5556c75789c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:10.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.137+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/668013500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75767c0 0x5556c75789c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.137+0000 7fd45d3cc640 1 -- 172.21.15.152:0/668013500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 msgr2=0x5556c75aafe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:12:10.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.137+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/668013500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c75aafe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.137+0000 7fd45d3cc640 1 -- 172.21.15.152:0/668013500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556c75955a0 con 0x5556c75770e0 2024-09-11T22:12:10.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.137+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/668013500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c75aaaa0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd4480bbca0 tx=0x7fd4480ba4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31f3e71c3ff27e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:10.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.138+0000 7fd4437fe640 1 -- 172.21.15.152:0/668013500 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4480bbae0 con 0x5556c75770e0 2024-09-11T22:12:10.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.138+0000 7fd4437fe640 1 -- 172.21.15.152:0/668013500 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4480c4c10 con 0x5556c75770e0 2024-09-11T22:12:10.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.139+0000 7fd46220a740 1 -- 172.21.15.152:0/668013500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 msgr2=0x5556c75aaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:10.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.139+0000 7fd46220a740 1 --2- 172.21.15.152:0/668013500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c75aaaa0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd4480bbca0 tx=0x7fd4480ba4b0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.144+0000 7fd46220a740 1 -- 172.21.15.152:0/668013500 shutdown_connections 2024-09-11T22:12:10.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.144+0000 7fd46220a740 1 --2- 172.21.15.152:0/668013500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c75aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.144+0000 7fd46220a740 1 --2- 172.21.15.152:0/668013500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c75aaaa0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.144+0000 7fd46220a740 1 --2- 172.21.15.152:0/668013500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75767c0 0x5556c75789c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.144+0000 7fd46220a740 1 -- 172.21.15.152:0/668013500 >> 172.21.15.152:0/668013500 conn(0x5556c7572e90 msgr2=0x5556c75782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:10.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.147+0000 7fd46220a740 1 -- 172.21.15.152:0/668013500 shutdown_connections 2024-09-11T22:12:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.152+0000 7fd46220a740 1 -- 172.21.15.152:0/668013500 wait complete. 2024-09-11T22:12:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.152+0000 7fd46220a740 1 -- start start 2024-09-11T22:12:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.152+0000 7fd46220a740 1 Processor -- start 2024-09-11T22:12:10.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.153+0000 7fd46220a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75767c0 0x5556c759b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.153+0000 7fd46220a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c7596760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.153+0000 7fd46220a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c7596ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.153+0000 7fd46220a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd450134ca0 con 0x5556c75770e0 2024-09-11T22:12:10.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.153+0000 7fd46220a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd4501360f0 con 0x5556c7592af0 2024-09-11T22:12:10.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.153+0000 7fd46220a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd450135350 con 0x5556c75767c0 2024-09-11T22:12:10.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.153+0000 7fd46220a740 10 client.0 _ll_register_callbacks cb 0x7fd4480b8240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.154+0000 7fd45d3cc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c7596760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.154+0000 7fd45d3cc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c7596760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50298/0 (socket says 172.21.15.152:50298) 2024-09-11T22:12:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.154+0000 7fd45d3cc640 1 -- 172.21.15.152:0/734608215 learned_addr learned my addr 172.21.15.152:0/734608215 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.155+0000 7fd45e3ce640 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c7596ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.155+0000 7fd45dbcd640 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75767c0 0x5556c759b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.155+0000 7fd45d3cc640 1 -- 172.21.15.152:0/734608215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75767c0 msgr2=0x5556c759b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.155+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75767c0 0x5556c759b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.155+0000 7fd45d3cc640 1 -- 172.21.15.152:0/734608215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 msgr2=0x5556c7596ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.155+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c7596ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.155+0000 7fd45d3cc640 1 -- 172.21.15.152:0/734608215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556c761da80 con 0x5556c75770e0 2024-09-11T22:12:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.156+0000 7fd45d3cc640 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c7596760 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd4480daf30 tx=0x7fd44802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2264339cb760a750 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.156+0000 7fd4417fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.157+0000 7fd4417fa640 1 -- 172.21.15.152:0/734608215 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4480bbae0 con 0x5556c75770e0 2024-09-11T22:12:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.157+0000 7fd4417fa640 1 -- 172.21.15.152:0/734608215 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8658+0+0 (secure 0 0 0) 0x7fd4480bc200 con 0x5556c75770e0 2024-09-11T22:12:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.157+0000 7fd46220a740 1 -- 172.21.15.152:0/734608215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5556c74e3d20 con 0x5556c75770e0 2024-09-11T22:12:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.158+0000 7fd4417fa640 1 -- 172.21.15.152:0/734608215 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd4480c4c10 con 0x5556c75770e0 2024-09-11T22:12:10.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.158+0000 7fd46220a740 10 client.17340 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:10.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.158+0000 7fd46220a740 1 -- 172.21.15.152:0/734608215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5556c761da80 con 0x5556c75770e0 2024-09-11T22:12:10.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.159+0000 7fd4417fa640 1 -- 172.21.15.152:0/734608215 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5556c74e3d20 con 0x5556c75770e0 2024-09-11T22:12:10.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.160+0000 7fd4417fa640 1 -- 172.21.15.152:0/734608215 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd4480bb500 con 0x5556c75770e0 2024-09-11T22:12:10.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.161+0000 7fd46220a740 10 client.17340 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:10.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.161+0000 7fd46220a740 10 client.17340 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:12:10.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.161+0000 7fd46220a740 20 client.17340 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:10.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.161+0000 7fd46220a740 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5556c761ef50 0x5556c7621340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:10.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.161+0000 7fd46220a740 4 client.17340 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.4, "await_for": 45.0}] 2024-09-11T22:12:10.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.161+0000 7fd46220a740 1 -- 172.21.15.152:0/734608215 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.4, "await_for": 45.0}) -- 0x5556c745fec0 con 0x5556c761ef50 2024-09-11T22:12:10.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.165+0000 7fd45dbcd640 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5556c761ef50 0x5556c7621340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:10.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.168+0000 7fd45dbcd640 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5556c761ef50 0x5556c7621340 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82fe28fb6c729b76 server_cookie=b8c26f13670de0d8 in_seq=0 out_seq=0 2024-09-11T22:12:10.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.168+0000 7fd4417fa640 10 client.17340 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:10.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd4417fa640 1 -- 172.21.15.152:0/734608215 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5556c745fec0 con 0x5556c761ef50 2024-09-11T22:12:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd4417fa640 10 client.17340 handle_command_reply: tid=0 2024-09-11T22:12:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 1 client.17340 shutdown 2024-09-11T22:12:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 1 -- 172.21.15.152:0/734608215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 msgr2=0x5556c7596760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c7596760 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd4480daf30 tx=0x7fd44802a420 comp rx=0 tx=0).stop 2024-09-11T22:12:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 1 -- 172.21.15.152:0/734608215 shutdown_connections 2024-09-11T22:12:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5556c761ef50 0x5556c7621340 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5556c7592af0 0x5556c7596ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556c75770e0 0x5556c7596760 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 1 --2- 172.21.15.152:0/734608215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5556c75767c0 0x5556c759b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd4417fa640 0 client.17340 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 1 -- 172.21.15.152:0/734608215 >> 172.21.15.152:0/734608215 conn(0x5556c7572e90 msgr2=0x5556c75901e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:10.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 1 -- 172.21.15.152:0/734608215 shutdown_connections 2024-09-11T22:12:10.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 1 -- 172.21.15.152:0/734608215 wait complete. 2024-09-11T22:12:10.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.466+0000 7fd46220a740 20 client.17340 trim_cache size 0 max 16384 2024-09-11T22:12:10.469 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:12:10.469 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:12:10.469 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:12:10.469 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 30, 2024-09-11T22:12:10.469 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: "e63398c8": { 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 30, 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 139.4, 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:12:10.470 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:12:10.471 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:12:10.471 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:12:10.471 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:12:10.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:10.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:10.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:10.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:10.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:10.471 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:12:10.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 -- 172.21.15.152:0/788856174 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd4440a2dc0 msgr2=0x7fd4440a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:10.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd4440a2dc0 0x7fd4440a5280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd454009b60 tx=0x7fd454005f90 comp rx=0 tx=0).stop 2024-09-11T22:12:10.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 -- 172.21.15.152:0/788856174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd450095510 msgr2=0x7fd45009b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:10.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd450095510 0x7fd45009b8b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd448009900 tx=0x7fd448003b90 comp rx=0 tx=0).stop 2024-09-11T22:12:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 -- 172.21.15.152:0/788856174 shutdown_connections 2024-09-11T22:12:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd4440a2dc0 0x7fd4440a5280 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd450099880 0x7fd45009bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd450095510 0x7fd45009b8b0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 --2- 172.21.15.152:0/788856174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd450094b60 0x7fd45009b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 -- 172.21.15.152:0/788856174 >> 172.21.15.152:0/788856174 conn(0x7fd45000a1b0 msgr2=0x7fd450092db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 -- 172.21.15.152:0/788856174 shutdown_connections 2024-09-11T22:12:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:10.467+0000 7fd45ebcf640 1 -- 172.21.15.152:0/788856174 wait complete. 2024-09-11T22:12:11.108 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e63398c8', quiesce took 4.1 seconds. Will release after: 15.299999999999999 2024-09-11T22:12:11.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:11 smithi152 ceph-mon[31188]: pgmap v242: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 29 MiB/s wr, 2.06k op/s 2024-09-11T22:12:11.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:11 smithi179 ceph-mon[35603]: pgmap v242: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 29 MiB/s wr, 2.06k op/s 2024-09-11T22:12:11.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:11 smithi193 ceph-mon[35545]: pgmap v242: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 29 MiB/s wr, 2.06k op/s 2024-09-11T22:12:13.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:13 smithi152 ceph-mon[31188]: pgmap v243: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 29 MiB/s wr, 2.06k op/s 2024-09-11T22:12:13.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:13 smithi179 ceph-mon[35603]: pgmap v243: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 29 MiB/s wr, 2.06k op/s 2024-09-11T22:12:13.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:13 smithi193 ceph-mon[35545]: pgmap v243: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 29 MiB/s wr, 2.06k op/s 2024-09-11T22:12:14.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 400.0 s, 156.3 tps, lat 45.523 ms stddev 47.113 2024-09-11T22:12:15.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:14 smithi152 ceph-mon[31188]: pgmap v244: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 26 MiB/s wr, 1.87k op/s 2024-09-11T22:12:15.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:14 smithi152 ceph-mon[31188]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T22:12:15.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:14 smithi179 ceph-mon[35603]: pgmap v244: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 26 MiB/s wr, 1.87k op/s 2024-09-11T22:12:15.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:14 smithi179 ceph-mon[35603]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T22:12:15.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:14 smithi193 ceph-mon[35545]: pgmap v244: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 26 MiB/s wr, 1.87k op/s 2024-09-11T22:12:15.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:14 smithi193 ceph-mon[35545]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T22:12:17.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.072+0000 7f26a84d0640 1 -- 172.21.15.152:0/1194195772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0101370 msgr2=0x7f26a010d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:17.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.072+0000 7f26a84d0640 1 --2- 172.21.15.152:0/1194195772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0101370 0x7f26a010d8a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2698009ca0 tx=0x7f269802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.072+0000 7f26a84d0640 1 -- 172.21.15.152:0/1194195772 shutdown_connections 2024-09-11T22:12:17.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.072+0000 7f26a84d0640 1 --2- 172.21.15.152:0/1194195772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0101370 0x7f26a010d8a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.072+0000 7f26a84d0640 1 --2- 172.21.15.152:0/1194195772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a01009d0 0x7f26a0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.072+0000 7f26a84d0640 1 --2- 172.21.15.152:0/1194195772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26a01069e0 0x7f26a0106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.072+0000 7f26a84d0640 1 -- 172.21.15.152:0/1194195772 >> 172.21.15.152:0/1194195772 conn(0x7f26a00fc6b0 msgr2=0x7f26a00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:17.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.072+0000 7f26a84d0640 1 -- 172.21.15.152:0/1194195772 shutdown_connections 2024-09-11T22:12:17.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.072+0000 7f26a84d0640 1 -- 172.21.15.152:0/1194195772 wait complete. 2024-09-11T22:12:17.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a84d0640 1 Processor -- start 2024-09-11T22:12:17.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a84d0640 1 -- start start 2024-09-11T22:12:17.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a84d0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26a01009d0 0x7f26a0198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a84d0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a0101370 0x7f26a0198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a84d0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a01069e0 0x7f26a019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a84d0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f26a0110e20 con 0x7f26a01009d0 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a84d0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f26a0110ca0 con 0x7f26a01069e0 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a84d0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f26a0110fa0 con 0x7f26a0101370 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a626c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26a01009d0 0x7f26a0198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a626c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26a01009d0 0x7f26a0198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51660/0 (socket says 172.21.15.152:51660) 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a626c640 1 -- 172.21.15.152:0/3338898552 learned_addr learned my addr 172.21.15.152:0/3338898552 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a0101370 0x7f26a0198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a6a6d640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a01069e0 0x7f26a019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a626c640 1 -- 172.21.15.152:0/3338898552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a0101370 msgr2=0x7f26a0198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a626c640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a0101370 0x7f26a0198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a626c640 1 -- 172.21.15.152:0/3338898552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a01069e0 msgr2=0x7f26a019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a626c640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a01069e0 0x7f26a019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a626c640 1 -- 172.21.15.152:0/3338898552 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a019d330 con 0x7f26a01009d0 2024-09-11T22:12:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a0101370 0x7f26a0198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a6a6d640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a01069e0 0x7f26a019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.073+0000 7f26a626c640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26a01009d0 0x7f26a0198340 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f269c00ea60 tx=0x7f269c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.074+0000 7f26977fe640 1 -- 172.21.15.152:0/3338898552 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c00cde0 con 0x7f26a01009d0 2024-09-11T22:12:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.074+0000 7f26a84d0640 1 -- 172.21.15.152:0/3338898552 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a019d620 con 0x7f26a01009d0 2024-09-11T22:12:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.074+0000 7f26977fe640 1 -- 172.21.15.152:0/3338898552 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f269c0035f0 con 0x7f26a01009d0 2024-09-11T22:12:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.074+0000 7f26a84d0640 1 -- 172.21.15.152:0/3338898552 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a01a4eb0 con 0x7f26a01009d0 2024-09-11T22:12:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.074+0000 7f26977fe640 1 -- 172.21.15.152:0/3338898552 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c018690 con 0x7f26a01009d0 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.076+0000 7f26977fe640 1 -- 172.21.15.152:0/3338898552 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f269c003a80 con 0x7f26a01009d0 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26ab267740 1 Processor -- start 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26ab267740 1 -- start start 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26ab267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26ab267740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26ab267740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26ab267740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55670912e2f0 con 0x5567091ca310 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26ab267740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5567090d6270 con 0x5567091d90c0 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26ab267740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55670912a2b0 con 0x5567091c99f0 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26977fe640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f268c0a2da0 0x7f268c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26a626c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26a626c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51672/0 (socket says 172.21.15.152:51672) 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26a626c640 1 -- 172.21.15.152:0/334075538 learned_addr learned my addr 172.21.15.152:0/334075538 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.077+0000 7f26a6a6d640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f268c0a2da0 0x7f268c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/334075538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f26a6a6d640 1 --2- 172.21.15.152:0/334075538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f26977fe640 1 -- 172.21.15.152:0/3338898552 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f269c0cf8d0 con 0x7f26a01009d0 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f26a626c640 1 -- 172.21.15.152:0/334075538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 msgr2=0x5567091c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f26a626c640 1 --2- 172.21.15.152:0/334075538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f26a626c640 1 -- 172.21.15.152:0/334075538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 msgr2=0x5567091db4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f26a626c640 1 --2- 172.21.15.152:0/334075538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091db4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f26a626c640 1 -- 172.21.15.152:0/334075538 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567090d5340 con 0x5567091ca310 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/334075538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091db4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f26a6a6d640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f268c0a2da0 0x7f268c0a5260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2698005e30 tx=0x7f269802f3d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f26a626c640 1 --2- 172.21.15.152:0/334075538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d8b80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f269c00d010 tx=0x7f269c06ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab0b21ca23abd9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f2694bfe640 1 -- 172.21.15.152:0/334075538 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c06ddc0 con 0x5567091ca310 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f2694bfe640 1 -- 172.21.15.152:0/334075538 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f269c09c490 con 0x5567091ca310 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.078+0000 7f2694bfe640 1 -- 172.21.15.152:0/334075538 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c098400 con 0x5567091ca310 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.079+0000 7f26ab267740 1 -- 172.21.15.152:0/334075538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 msgr2=0x5567091d8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.079+0000 7f26ab267740 1 --2- 172.21.15.152:0/334075538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d8b80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f269c00d010 tx=0x7f269c06ee00 comp rx=0 tx=0).stop 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.079+0000 7f26ab267740 1 -- 172.21.15.152:0/334075538 shutdown_connections 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.079+0000 7f26ab267740 1 --2- 172.21.15.152:0/334075538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091db4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.079+0000 7f26ab267740 1 --2- 172.21.15.152:0/334075538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d8b80 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.079+0000 7f26ab267740 1 --2- 172.21.15.152:0/334075538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.079+0000 7f26ab267740 1 -- 172.21.15.152:0/334075538 >> 172.21.15.152:0/334075538 conn(0x5567091c6060 msgr2=0x5567091c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.079+0000 7f26ab267740 1 -- 172.21.15.152:0/334075538 shutdown_connections 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.079+0000 7f26ab267740 1 -- 172.21.15.152:0/334075538 wait complete. 2024-09-11T22:12:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.079+0000 7f26ab267740 1 -- start start 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26ab267740 1 Processor -- start 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26ab267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091d6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26ab267740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26ab267740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091d6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26ab267740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5567091dbcc0 con 0x5567091ca310 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26ab267740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5567090b7290 con 0x5567091d90c0 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26ab267740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5567091dbe40 con 0x5567091c99f0 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26ab267740 10 client.0 _ll_register_callbacks cb 0x5567090e8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a5a6b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a5a6b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51686/0 (socket says 172.21.15.152:51686) 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a5a6b640 1 -- 172.21.15.152:0/3806122168 learned_addr learned my addr 172.21.15.152:0/3806122168 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a6a6d640 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091d6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a626c640 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091d6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a5a6b640 1 -- 172.21.15.152:0/3806122168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 msgr2=0x5567091d6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091d6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a5a6b640 1 -- 172.21.15.152:0/3806122168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 msgr2=0x5567091d6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091d6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a5a6b640 1 -- 172.21.15.152:0/3806122168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556708e41210 con 0x5567091ca310 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a6a6d640 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091d6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.080+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d6540 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f26900136e0 tx=0x7f2690013ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3454bd3c7d5561f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f2689ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f2689ffb640 1 -- 172.21.15.152:0/3806122168 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690011e90 con 0x5567091ca310 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f2689ffb640 1 -- 172.21.15.152:0/3806122168 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f2690004030 con 0x5567091ca310 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f26ab267740 1 -- 172.21.15.152:0/3806122168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f269c09c490 con 0x5567091ca310 2024-09-11T22:12:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f2689ffb640 1 -- 172.21.15.152:0/3806122168 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2690004230 con 0x5567091ca310 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f26ab267740 10 client.17352 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f26ab267740 1 -- 172.21.15.152:0/3806122168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556708f0d620 con 0x5567091ca310 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f2689ffb640 1 -- 172.21.15.152:0/3806122168 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f269c09c490 con 0x5567091ca310 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f2689ffb640 1 -- 172.21.15.152:0/3806122168 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f269000f040 con 0x5567091ca310 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f26ab267740 10 client.17352 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f26ab267740 10 client.17352 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f26ab267740 20 client.17352 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f26ab267740 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567091e9140 0x5567091eb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f26ab267740 4 client.17352 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.081+0000 7f26ab267740 1 -- 172.21.15.152:0/3806122168 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55670913ba20 con 0x5567091e9140 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.082+0000 7f26a626c640 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567091e9140 0x5567091eb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.082+0000 7f2689ffb640 10 client.17352 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.082+0000 7f26a626c640 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567091e9140 0x5567091eb530 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d192d2a1b63ceea4 server_cookie=c4db67b12d7ee694 in_seq=0 out_seq=0 2024-09-11T22:12:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f2689ffb640 1 -- 172.21.15.152:0/3806122168 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55670913ba20 con 0x5567091e9140 2024-09-11T22:12:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f2689ffb640 10 client.17352 handle_command_reply: tid=0 2024-09-11T22:12:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 1 client.17352 shutdown 2024-09-11T22:12:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 1 -- 172.21.15.152:0/3806122168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 msgr2=0x5567091d6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d6540 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f26900136e0 tx=0x7f2690013ba0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 1 -- 172.21.15.152:0/3806122168 shutdown_connections 2024-09-11T22:12:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567091e9140 0x5567091eb530 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091d6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f2689ffb640 0 client.17352 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091d6540 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 1 --2- 172.21.15.152:0/3806122168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091d6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 1 -- 172.21.15.152:0/3806122168 >> 172.21.15.152:0/3806122168 conn(0x5567091c6060 msgr2=0x5567091cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 1 -- 172.21.15.152:0/3806122168 shutdown_connections 2024-09-11T22:12:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 1 -- 172.21.15.152:0/3806122168 wait complete. 2024-09-11T22:12:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.083+0000 7f26ab267740 20 client.17352 trim_cache size 0 max 16384 2024-09-11T22:12:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.097+0000 7f26ab267740 1 Processor -- start 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.097+0000 7f26ab267740 1 -- start start 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26ab267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091d7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26ab267740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26ab267740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091f1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26ab267740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01ae050 con 0x5567091ca310 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26ab267740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01ab920 con 0x5567091d90c0 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26ab267740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01a9790 con 0x5567091c99f0 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a5a6b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a5a6b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091f0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51700/0 (socket says 172.21.15.152:51700) 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a5a6b640 1 -- 172.21.15.152:0/3765912889 learned_addr learned my addr 172.21.15.152:0/3765912889 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a6a6d640 1 --2- 172.21.15.152:0/3765912889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a626c640 1 --2- 172.21.15.152:0/3765912889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091d7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a5a6b640 1 -- 172.21.15.152:0/3765912889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 msgr2=0x5567091d7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/3765912889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091d7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a5a6b640 1 -- 172.21.15.152:0/3765912889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 msgr2=0x5567091f1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/3765912889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091f1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a5a6b640 1 -- 172.21.15.152:0/3765912889 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567091eb8a0 con 0x5567091ca310 2024-09-11T22:12:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a626c640 1 --2- 172.21.15.152:0/3765912889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091d7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a6a6d640 1 --2- 172.21.15.152:0/3765912889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091f1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/3765912889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091f0e20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2690000c00 tx=0x7f269001dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40408dda1b40d785 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f268bfff640 1 -- 172.21.15.152:0/3765912889 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690031070 con 0x5567091ca310 2024-09-11T22:12:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f268bfff640 1 -- 172.21.15.152:0/3765912889 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2690005450 con 0x5567091ca310 2024-09-11T22:12:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.098+0000 7f268bfff640 1 -- 172.21.15.152:0/3765912889 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269002c910 con 0x5567091ca310 2024-09-11T22:12:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.099+0000 7f26ab267740 1 -- 172.21.15.152:0/3765912889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 msgr2=0x5567091f0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.099+0000 7f26ab267740 1 --2- 172.21.15.152:0/3765912889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091f0e20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2690000c00 tx=0x7f269001dde0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.099+0000 7f26ab267740 1 -- 172.21.15.152:0/3765912889 shutdown_connections 2024-09-11T22:12:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.099+0000 7f26ab267740 1 --2- 172.21.15.152:0/3765912889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091d90c0 0x5567091f1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.099+0000 7f26ab267740 1 --2- 172.21.15.152:0/3765912889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091ca310 0x5567091f0e20 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.099+0000 7f26ab267740 1 --2- 172.21.15.152:0/3765912889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091c99f0 0x5567091d7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.099+0000 7f26ab267740 1 -- 172.21.15.152:0/3765912889 >> 172.21.15.152:0/3765912889 conn(0x5567091c6060 msgr2=0x5567091d7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.099+0000 7f26ab267740 1 -- 172.21.15.152:0/3765912889 shutdown_connections 2024-09-11T22:12:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.099+0000 7f26ab267740 1 -- 172.21.15.152:0/3765912889 wait complete. 2024-09-11T22:12:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.099+0000 7f26ab267740 1 -- start start 2024-09-11T22:12:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.099+0000 7f26ab267740 1 Processor -- start 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26ab267740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091c99f0 0x5567091e15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26ab267740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091ca310 0x5567091dc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26ab267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091d90c0 0x5567091dce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26ab267740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01a9de0 con 0x5567091c99f0 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26ab267740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01ab250 con 0x5567091ca310 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26ab267740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01aa4b0 con 0x5567091d90c0 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26ab267740 10 client.0 _ll_register_callbacks cb 0x7f2690005870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26a626c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091c99f0 0x5567091e15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26a626c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091c99f0 0x5567091e15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51706/0 (socket says 172.21.15.152:51706) 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26a626c640 1 -- 172.21.15.152:0/1206963448 learned_addr learned my addr 172.21.15.152:0/1206963448 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091ca310 0x5567091dc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26a6a6d640 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091d90c0 0x5567091dce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26a626c640 1 -- 172.21.15.152:0/1206963448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091d90c0 msgr2=0x5567091dce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26a626c640 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091d90c0 0x5567091dce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26a626c640 1 -- 172.21.15.152:0/1206963448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091ca310 msgr2=0x5567091dc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26a626c640 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091ca310 0x5567091dc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26a626c640 1 -- 172.21.15.152:0/1206963448 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567091dd3d0 con 0x5567091c99f0 2024-09-11T22:12:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26a626c640 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091c99f0 0x5567091e15b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f269c0981f0 tx=0x7f269c003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e0b23b4e2a5cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f2689ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f2689ffb640 1 -- 172.21.15.152:0/1206963448 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c09c490 con 0x5567091c99f0 2024-09-11T22:12:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f2689ffb640 1 -- 172.21.15.152:0/1206963448 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f269c098400 con 0x5567091c99f0 2024-09-11T22:12:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26ab267740 1 -- 172.21.15.152:0/1206963448 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2690005450 con 0x5567091c99f0 2024-09-11T22:12:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f2689ffb640 1 -- 172.21.15.152:0/1206963448 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f269c09a090 con 0x5567091c99f0 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26ab267740 10 client.17358 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.100+0000 7f26ab267740 1 -- 172.21.15.152:0/1206963448 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556709253b60 con 0x5567091c99f0 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.101+0000 7f2689ffb640 1 -- 172.21.15.152:0/1206963448 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2690005450 con 0x5567091c99f0 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.101+0000 7f2689ffb640 1 -- 172.21.15.152:0/1206963448 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f269c09b1e0 con 0x5567091c99f0 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.101+0000 7f26ab267740 10 client.17358 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.101+0000 7f26ab267740 10 client.17358 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.101+0000 7f26ab267740 20 client.17358 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.101+0000 7f26ab267740 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556709253e50 0x556709256240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.101+0000 7f26ab267740 4 client.17358 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.101+0000 7f26ab267740 1 -- 172.21.15.152:0/1206963448 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556709135d70 con 0x556709253e50 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.101+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556709253e50 0x556709256240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.101+0000 7f2689ffb640 10 client.17358 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.101+0000 7f26a5a6b640 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556709253e50 0x556709256240 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a073e5e5b40199 server_cookie=a0774aa96db2c1a3 in_seq=0 out_seq=0 2024-09-11T22:12:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f2689ffb640 1 -- 172.21.15.152:0/1206963448 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556709135d70 con 0x556709253e50 2024-09-11T22:12:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f2689ffb640 10 client.17358 handle_command_reply: tid=0 2024-09-11T22:12:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 1 client.17358 shutdown 2024-09-11T22:12:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 1 -- 172.21.15.152:0/1206963448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091c99f0 msgr2=0x5567091e15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091c99f0 0x5567091e15b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f269c0981f0 tx=0x7f269c003e20 comp rx=0 tx=0).stop 2024-09-11T22:12:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 1 -- 172.21.15.152:0/1206963448 shutdown_connections 2024-09-11T22:12:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556709253e50 0x556709256240 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567091d90c0 0x5567091dce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567091ca310 0x5567091dc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 1 --2- 172.21.15.152:0/1206963448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567091c99f0 0x5567091e15b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f2689ffb640 0 client.17358 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 1 -- 172.21.15.152:0/1206963448 >> 172.21.15.152:0/1206963448 conn(0x5567091c6060 msgr2=0x5567091cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 1 -- 172.21.15.152:0/1206963448 shutdown_connections 2024-09-11T22:12:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 1 -- 172.21.15.152:0/1206963448 wait complete. 2024-09-11T22:12:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.110+0000 7f26ab267740 20 client.17358 trim_cache size 0 max 16384 2024-09-11T22:12:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:12:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:12:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:12:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 -- 172.21.15.152:0/3338898552 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f268c0a2da0 msgr2=0x7f268c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f268c0a2da0 0x7f268c0a5260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2698005e30 tx=0x7f269802f3d0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 -- 172.21.15.152:0/3338898552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26a01009d0 msgr2=0x7f26a0198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26a01009d0 0x7f26a0198340 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f269c00ea60 tx=0x7f269c00ef20 comp rx=0 tx=0).stop 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 -- 172.21.15.152:0/3338898552 shutdown_connections 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f268c0a2da0 0x7f268c0a5260 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a01069e0 0x7f26a019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26a0101370 0x7f26a0198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 --2- 172.21.15.152:0/3338898552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26a01009d0 0x7f26a0198340 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 -- 172.21.15.152:0/3338898552 >> 172.21.15.152:0/3338898552 conn(0x7f26a00fc6b0 msgr2=0x7f26a006a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 -- 172.21.15.152:0/3338898552 shutdown_connections 2024-09-11T22:12:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:17.111+0000 7f26a84d0640 1 -- 172.21.15.152:0/3338898552 wait complete. 2024-09-11T22:12:17.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:16 smithi179 ceph-mon[35603]: pgmap v246: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 27 MiB/s wr, 1.86k op/s 2024-09-11T22:12:17.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:16 smithi193 ceph-mon[35545]: pgmap v246: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 27 MiB/s wr, 1.86k op/s 2024-09-11T22:12:17.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:16 smithi152 ceph-mon[31188]: pgmap v246: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 27 MiB/s wr, 1.86k op/s 2024-09-11T22:12:19.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:18 smithi179 ceph-mon[35603]: pgmap v247: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 27 MiB/s wr, 1.86k op/s 2024-09-11T22:12:19.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:18 smithi193 ceph-mon[35545]: pgmap v247: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 27 MiB/s wr, 1.86k op/s 2024-09-11T22:12:19.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:18 smithi152 ceph-mon[31188]: pgmap v247: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 27 MiB/s wr, 1.86k op/s 2024-09-11T22:12:19.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:12:21.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:20 smithi179 ceph-mon[35603]: pgmap v248: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 3.2 MiB/s wr, 302 op/s 2024-09-11T22:12:21.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:20 smithi193 ceph-mon[35545]: pgmap v248: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 3.2 MiB/s wr, 302 op/s 2024-09-11T22:12:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:20 smithi152 ceph-mon[31188]: pgmap v248: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 3.2 MiB/s wr, 302 op/s 2024-09-11T22:12:23.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:22 smithi179 ceph-mon[35603]: pgmap v249: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 3.2 MiB/s wr, 302 op/s 2024-09-11T22:12:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:22 smithi193 ceph-mon[35545]: pgmap v249: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 3.2 MiB/s wr, 302 op/s 2024-09-11T22:12:23.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:22 smithi152 ceph-mon[31188]: pgmap v249: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 3.2 MiB/s wr, 302 op/s 2024-09-11T22:12:24.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:12:25.278 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:24 smithi152 ceph-mon[31188]: pgmap v250: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.5 MiB/s wr, 221 op/s 2024-09-11T22:12:25.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:24 smithi179 ceph-mon[35603]: pgmap v250: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.5 MiB/s wr, 221 op/s 2024-09-11T22:12:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:24 smithi193 ceph-mon[35545]: pgmap v250: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.5 MiB/s wr, 221 op/s 2024-09-11T22:12:26.409 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:12:26.671 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:26.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:12:27.039 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:26 smithi152 ceph-mon[31188]: pgmap v251: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 1.5 MiB/s wr, 148 op/s 2024-09-11T22:12:27.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.123+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/2318190498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1bc100a80 msgr2=0x7fd1bc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:27.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.123+0000 7fd1c0bd4640 1 --2- 172.21.15.152:0/2318190498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1bc100a80 0x7fd1bc100ee0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009930 tx=0x7fd1a402a420 comp rx=0 tx=0).stop 2024-09-11T22:12:27.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.123+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/2318190498 shutdown_connections 2024-09-11T22:12:27.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.123+0000 7fd1c0bd4640 1 --2- 172.21.15.152:0/2318190498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1bc101420 0x7fd1bc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:27.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.123+0000 7fd1c0bd4640 1 --2- 172.21.15.152:0/2318190498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1bc100a80 0x7fd1bc100ee0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:27.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.123+0000 7fd1c0bd4640 1 --2- 172.21.15.152:0/2318190498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1bc106a80 0x7fd1bc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:27.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.123+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/2318190498 >> 172.21.15.152:0/2318190498 conn(0x7fd1bc0fc7a0 msgr2=0x7fd1bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:27.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.123+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/2318190498 shutdown_connections 2024-09-11T22:12:27.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.123+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/2318190498 wait complete. 2024-09-11T22:12:27.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.123+0000 7fd1c0bd4640 1 Processor -- start 2024-09-11T22:12:27.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1c0bd4640 1 -- start start 2024-09-11T22:12:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1c0bd4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1bc100a80 0x7fd1bc1970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1c0bd4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1bc101420 0x7fd1bc197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1c0bd4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1bc106a80 0x7fd1bc197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1c0bd4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc110ed0 con 0x7fd1bc106a80 2024-09-11T22:12:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1c0bd4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc110d50 con 0x7fd1bc101420 2024-09-11T22:12:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1c0bd4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc111050 con 0x7fd1bc100a80 2024-09-11T22:12:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1bad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1bc106a80 0x7fd1bc197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1bad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1bc106a80 0x7fd1bc197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43010/0 (socket says 172.21.15.152:43010) 2024-09-11T22:12:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1bad9d640 1 -- 172.21.15.152:0/3472744347 learned_addr learned my addr 172.21.15.152:0/3472744347 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1ba59c640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1bc100a80 0x7fd1bc1970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1bad9d640 1 -- 172.21.15.152:0/3472744347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1bc100a80 msgr2=0x7fd1bc1970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1bad9d640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1bc100a80 0x7fd1bc1970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1bad9d640 1 -- 172.21.15.152:0/3472744347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1bc101420 msgr2=0x7fd1bc197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1b9d9b640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1bc101420 0x7fd1bc197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1bad9d640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1bc101420 0x7fd1bc197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.124+0000 7fd1bad9d640 1 -- 172.21.15.152:0/3472744347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1bc1a6940 con 0x7fd1bc106a80 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.125+0000 7fd1b9d9b640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1bc101420 0x7fd1bc197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.125+0000 7fd1bad9d640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1bc106a80 0x7fd1bc197b50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400eaa0 tx=0x7fd1b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.125+0000 7fd1b37fe640 1 -- 172.21.15.152:0/3472744347 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400cdb0 con 0x7fd1bc106a80 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.125+0000 7fd1b37fe640 1 -- 172.21.15.152:0/3472744347 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1b4005020 con 0x7fd1bc106a80 2024-09-11T22:12:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.125+0000 7fd1b37fe640 1 -- 172.21.15.152:0/3472744347 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40116b0 con 0x7fd1bc106a80 2024-09-11T22:12:27.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.125+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/3472744347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1bc1a6c30 con 0x7fd1bc106a80 2024-09-11T22:12:27.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.125+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/3472744347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1bc1a71c0 con 0x7fd1bc106a80 2024-09-11T22:12:27.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.126+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/3472744347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1bc100ee0 con 0x7fd1bc106a80 2024-09-11T22:12:27.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.127+0000 7fd1b37fe640 1 -- 172.21.15.152:0/3472744347 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd1b4004b20 con 0x7fd1bc106a80 2024-09-11T22:12:27.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.128+0000 7fd1b37fe640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1a80a2d70 0x7fd1a80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:27.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.128+0000 7fd1ba59c640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1a80a2d70 0x7fd1a80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:27.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.128+0000 7fd1b37fe640 1 -- 172.21.15.152:0/3472744347 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fd1b40cf620 con 0x7fd1bc106a80 2024-09-11T22:12:27.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.129+0000 7fd1ba59c640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1a80a2d70 0x7fd1a80a5230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00bb60 tx=0x7fd1ac00b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:27.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.133+0000 7fd1b37fe640 1 -- 172.21.15.152:0/3472744347 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1b4016030 con 0x7fd1bc106a80 2024-09-11T22:12:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:27.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:26 smithi179 ceph-mon[35603]: pgmap v251: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 1.5 MiB/s wr, 148 op/s 2024-09-11T22:12:27.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:26 smithi193 ceph-mon[35545]: pgmap v251: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 1.5 MiB/s wr, 148 op/s 2024-09-11T22:12:27.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.356+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/3472744347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1bc02d7c0 con 0x7fd1bc106a80 2024-09-11T22:12:27.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.357+0000 7fd1b37fe640 1 -- 172.21.15.152:0/3472744347 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7fd1b409c1e0 con 0x7fd1bc106a80 2024-09-11T22:12:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:12:27.358 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:12:27.359 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:12:27.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/3472744347 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1a80a2d70 msgr2=0x7fd1a80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:27.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1a80a2d70 0x7fd1a80a5230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00bb60 tx=0x7fd1ac00b390 comp rx=0 tx=0).stop 2024-09-11T22:12:27.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/3472744347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1bc106a80 msgr2=0x7fd1bc197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:27.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1bc106a80 0x7fd1bc197b50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400eaa0 tx=0x7fd1b400ef60 comp rx=0 tx=0).stop 2024-09-11T22:12:27.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/3472744347 shutdown_connections 2024-09-11T22:12:27.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1a80a2d70 0x7fd1a80a5230 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:27.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1bc106a80 0x7fd1bc197b50 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:27.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1bc101420 0x7fd1bc197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:27.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 --2- 172.21.15.152:0/3472744347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1bc100a80 0x7fd1bc1970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:27.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/3472744347 >> 172.21.15.152:0/3472744347 conn(0x7fd1bc0fc7a0 msgr2=0x7fd1bc0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:27.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/3472744347 shutdown_connections 2024-09-11T22:12:27.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:27.359+0000 7fd1c0bd4640 1 -- 172.21.15.152:0/3472744347 wait complete. 2024-09-11T22:12:28.182 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id e63398c8 --release --await' 2024-09-11T22:12:28.182 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id e63398c8 --release --await 2024-09-11T22:12:28.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:28 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3472744347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:28.313 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:28 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3472744347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:28.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:28 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3472744347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.399+0000 7fcd73e3c640 1 -- 172.21.15.152:0/2080012208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd6c106a70 msgr2=0x7fcd6c106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.399+0000 7fcd73e3c640 1 --2- 172.21.15.152:0/2080012208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd6c106a70 0x7fcd6c106e50 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009930 tx=0x7fcd6802a420 comp rx=0 tx=0).stop 2024-09-11T22:12:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.399+0000 7fcd73e3c640 1 -- 172.21.15.152:0/2080012208 shutdown_connections 2024-09-11T22:12:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.399+0000 7fcd73e3c640 1 --2- 172.21.15.152:0/2080012208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd6c101410 0x7fcd6c10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.399+0000 7fcd73e3c640 1 --2- 172.21.15.152:0/2080012208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd6c100a70 0x7fcd6c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.399+0000 7fcd73e3c640 1 --2- 172.21.15.152:0/2080012208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd6c106a70 0x7fcd6c106e50 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.399+0000 7fcd73e3c640 1 -- 172.21.15.152:0/2080012208 >> 172.21.15.152:0/2080012208 conn(0x7fcd6c0fc790 msgr2=0x7fcd6c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:28.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.399+0000 7fcd73e3c640 1 -- 172.21.15.152:0/2080012208 shutdown_connections 2024-09-11T22:12:28.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.399+0000 7fcd73e3c640 1 -- 172.21.15.152:0/2080012208 wait complete. 2024-09-11T22:12:28.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd73e3c640 1 Processor -- start 2024-09-11T22:12:28.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd73e3c640 1 -- start start 2024-09-11T22:12:28.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd73e3c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd6c100a70 0x7fcd6c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd73e3c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd6c101410 0x7fcd6c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd73e3c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd6c106a70 0x7fcd6c19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd73e3c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c110e30 con 0x7fcd6c106a70 2024-09-11T22:12:28.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd73e3c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c110cb0 con 0x7fcd6c100a70 2024-09-11T22:12:28.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd73e3c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c110fb0 con 0x7fcd6c101410 2024-09-11T22:12:28.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd723d9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd6c106a70 0x7fcd6c19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd71bd8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd6c100a70 0x7fcd6c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd71bd8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd6c100a70 0x7fcd6c19a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54546/0 (socket says 172.21.15.152:54546) 2024-09-11T22:12:28.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.400+0000 7fcd723d9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd6c106a70 0x7fcd6c19eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43030/0 (socket says 172.21.15.152:43030) 2024-09-11T22:12:28.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd723d9640 1 -- 172.21.15.152:0/84587775 learned_addr learned my addr 172.21.15.152:0/84587775 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd713d7640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd6c101410 0x7fcd6c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd723d9640 1 -- 172.21.15.152:0/84587775 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd6c101410 msgr2=0x7fcd6c19ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd723d9640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd6c101410 0x7fcd6c19ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd723d9640 1 -- 172.21.15.152:0/84587775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd6c100a70 msgr2=0x7fcd6c19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd723d9640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd6c100a70 0x7fcd6c19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd723d9640 1 -- 172.21.15.152:0/84587775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6c19f580 con 0x7fcd6c106a70 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd723d9640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd6c106a70 0x7fcd6c19eea0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400eaa0 tx=0x7fcd6400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd5effd640 1 -- 172.21.15.152:0/84587775 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd64004d20 con 0x7fcd6c106a70 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd73e3c640 1 -- 172.21.15.152:0/84587775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6c19f870 con 0x7fcd6c106a70 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd5effd640 1 -- 172.21.15.152:0/84587775 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd64005020 con 0x7fcd6c106a70 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd5effd640 1 -- 172.21.15.152:0/84587775 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd640116d0 con 0x7fcd6c106a70 2024-09-11T22:12:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.401+0000 7fcd73e3c640 1 -- 172.21.15.152:0/84587775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6c1a7150 con 0x7fcd6c106a70 2024-09-11T22:12:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.404+0000 7fcd76215740 1 Processor -- start 2024-09-11T22:12:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.405+0000 7fcd5effd640 1 -- 172.21.15.152:0/84587775 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fcd640051d0 con 0x7fcd6c106a70 2024-09-11T22:12:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.405+0000 7fcd76215740 1 -- start start 2024-09-11T22:12:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.405+0000 7fcd76215740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4d4a0 0x561fb4a4d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.405+0000 7fcd76215740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4ddc0 0x561fb4a58140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.405+0000 7fcd76215740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a5aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.405+0000 7fcd76215740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561fb49b32e0 con 0x561fb4a4ddc0 2024-09-11T22:12:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.405+0000 7fcd76215740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561fb495ace0 con 0x561fb4a4d4a0 2024-09-11T22:12:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.405+0000 7fcd76215740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561fb49af2a0 con 0x561fb4a58680 2024-09-11T22:12:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd713d7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4d4a0 0x561fb4a4d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd71bd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4ddc0 0x561fb4a58140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd713d7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4d4a0 0x561fb4a4d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54552/0 (socket says 172.21.15.152:54552) 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd713d7640 1 -- 172.21.15.152:0/1013325606 learned_addr learned my addr 172.21.15.152:0/1013325606 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/1013325606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4ddc0 0x561fb4a58140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43040/0 (socket says 172.21.15.152:43040) 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd713d7640 1 --2- 172.21.15.152:0/1013325606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a5aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd713d7640 1 -- 172.21.15.152:0/1013325606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 msgr2=0x561fb4a5aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd713d7640 1 --2- 172.21.15.152:0/1013325606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a5aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd713d7640 1 -- 172.21.15.152:0/1013325606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4ddc0 msgr2=0x561fb4a58140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd713d7640 1 --2- 172.21.15.152:0/1013325606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4ddc0 0x561fb4a58140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd713d7640 1 -- 172.21.15.152:0/1013325606 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb493f440 con 0x561fb4a4d4a0 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/1013325606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4ddc0 0x561fb4a58140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd5effd640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd580a2d70 0x7fcd580a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd580a2d70 0x7fcd580a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd713d7640 1 --2- 172.21.15.152:0/1013325606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4d4a0 0x561fb4a4d880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000a5c0 tx=0x7fcd6000a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d22da4029c22184d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.406+0000 7fcd5effd640 1 -- 172.21.15.152:0/84587775 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fcd640cf590 con 0x7fcd6c106a70 2024-09-11T22:12:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.407+0000 7fcd57fff640 1 -- 172.21.15.152:0/1013325606 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd60005020 con 0x561fb4a4d4a0 2024-09-11T22:12:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.407+0000 7fcd57fff640 1 -- 172.21.15.152:0/1013325606 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd600047a0 con 0x561fb4a4d4a0 2024-09-11T22:12:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.407+0000 7fcd57fff640 1 -- 172.21.15.152:0/1013325606 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6000fb40 con 0x561fb4a4d4a0 2024-09-11T22:12:28.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.407+0000 7fcd76215740 1 -- 172.21.15.152:0/1013325606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4d4a0 msgr2=0x561fb4a4d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:28.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.407+0000 7fcd76215740 1 --2- 172.21.15.152:0/1013325606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4d4a0 0x561fb4a4d880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000a5c0 tx=0x7fcd6000a760 comp rx=0 tx=0).stop 2024-09-11T22:12:28.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.407+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd580a2d70 0x7fcd580a5230 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009900 tx=0x7fcd680058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:28.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.408+0000 7fcd76215740 1 -- 172.21.15.152:0/1013325606 shutdown_connections 2024-09-11T22:12:28.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.408+0000 7fcd76215740 1 --2- 172.21.15.152:0/1013325606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a5aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.408+0000 7fcd76215740 1 --2- 172.21.15.152:0/1013325606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4ddc0 0x561fb4a58140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.408+0000 7fcd76215740 1 --2- 172.21.15.152:0/1013325606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4d4a0 0x561fb4a4d880 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.408+0000 7fcd76215740 1 -- 172.21.15.152:0/1013325606 >> 172.21.15.152:0/1013325606 conn(0x561fb4a49a30 msgr2=0x561fb4a49e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:28.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.408+0000 7fcd76215740 1 -- 172.21.15.152:0/1013325606 shutdown_connections 2024-09-11T22:12:28.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.408+0000 7fcd76215740 1 -- 172.21.15.152:0/1013325606 wait complete. 2024-09-11T22:12:28.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.408+0000 7fcd76215740 1 -- start start 2024-09-11T22:12:28.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.408+0000 7fcd76215740 1 Processor -- start 2024-09-11T22:12:28.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd76215740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a58060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd76215740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a4ddc0 0x561fb4a55310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd76215740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a58680 0x561fb4a558e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd76215740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561fb4a5b250 con 0x561fb4a4d4a0 2024-09-11T22:12:28.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd76215740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561fb496e050 con 0x561fb4a58680 2024-09-11T22:12:28.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd76215740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561fb4a5b3d0 con 0x561fb4a4ddc0 2024-09-11T22:12:28.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd76215740 10 client.0 _ll_register_callbacks cb 0x561fb49ae160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:28.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd71bd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a58060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd71bd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a58060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43050/0 (socket says 172.21.15.152:43050) 2024-09-11T22:12:28.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd71bd8640 1 -- 172.21.15.152:0/1023223054 learned_addr learned my addr 172.21.15.152:0/1023223054 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:28.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd723d9640 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a58680 0x561fb4a558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd713d7640 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a4ddc0 0x561fb4a55310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd71bd8640 1 -- 172.21.15.152:0/1023223054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a4ddc0 msgr2=0x561fb4a55310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:28.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a4ddc0 0x561fb4a55310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd71bd8640 1 -- 172.21.15.152:0/1023223054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a58680 msgr2=0x561fb4a558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:28.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a58680 0x561fb4a558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.409+0000 7fcd71bd8640 1 -- 172.21.15.152:0/1023223054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb47243c0 con 0x561fb4a4d4a0 2024-09-11T22:12:28.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.410+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a58060 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcd68033000 tx=0x7fcd68009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412fe1515824dde0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:28.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.410+0000 7fcd557fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.410+0000 7fcd557fa640 1 -- 172.21.15.152:0/1023223054 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6804e070 con 0x561fb4a4d4a0 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.410+0000 7fcd557fa640 1 -- 172.21.15.152:0/1023223054 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fcd6804a450 con 0x561fb4a4d4a0 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.410+0000 7fcd76215740 1 -- 172.21.15.152:0/1023223054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd600047a0 con 0x561fb4a4d4a0 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.410+0000 7fcd557fa640 1 -- 172.21.15.152:0/1023223054 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcd6805a050 con 0x561fb4a4d4a0 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.410+0000 7fcd76215740 10 client.17376 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.410+0000 7fcd76215740 1 -- 172.21.15.152:0/1023223054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561fb4a66c90 con 0x561fb4a4d4a0 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.410+0000 7fcd557fa640 1 -- 172.21.15.152:0/1023223054 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd600047a0 con 0x561fb4a4d4a0 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.411+0000 7fcd557fa640 1 -- 172.21.15.152:0/1023223054 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fcd6803d690 con 0x561fb4a4d4a0 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.411+0000 7fcd76215740 10 client.17376 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.411+0000 7fcd76215740 10 client.17376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.411+0000 7fcd76215740 20 client.17376 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.411+0000 7fcd76215740 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561fb4a680f0 0x561fb4a6a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.411+0000 7fcd76215740 4 client.17376 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.411+0000 7fcd76215740 1 -- 172.21.15.152:0/1023223054 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fb49c0850 con 0x561fb4a680f0 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.411+0000 7fcd713d7640 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561fb4a680f0 0x561fb4a6a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.411+0000 7fcd557fa640 10 client.17376 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.411+0000 7fcd713d7640 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561fb4a680f0 0x561fb4a6a550 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=831168704b7bd25c server_cookie=e63543ddcd23b4cc in_seq=0 out_seq=0 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.412+0000 7fcd557fa640 1 -- 172.21.15.152:0/1023223054 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fb49c0850 con 0x561fb4a680f0 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.412+0000 7fcd557fa640 10 client.17376 handle_command_reply: tid=0 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.412+0000 7fcd76215740 1 client.17376 shutdown 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd76215740 1 -- 172.21.15.152:0/1023223054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 msgr2=0x561fb4a58060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd76215740 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a58060 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcd68033000 tx=0x7fcd68009260 comp rx=0 tx=0).stop 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd76215740 1 -- 172.21.15.152:0/1023223054 shutdown_connections 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd76215740 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561fb4a680f0 0x561fb4a6a550 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd76215740 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a58680 0x561fb4a558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd557fa640 0 client.17376 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:28.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd76215740 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a4ddc0 0x561fb4a55310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd76215740 1 --2- 172.21.15.152:0/1023223054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a58060 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd76215740 1 -- 172.21.15.152:0/1023223054 >> 172.21.15.152:0/1023223054 conn(0x561fb4a49a30 msgr2=0x561fb4a48b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:28.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd76215740 1 -- 172.21.15.152:0/1023223054 shutdown_connections 2024-09-11T22:12:28.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd76215740 1 -- 172.21.15.152:0/1023223054 wait complete. 2024-09-11T22:12:28.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.413+0000 7fcd76215740 20 client.17376 trim_cache size 0 max 16384 2024-09-11T22:12:28.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.431+0000 7fcd76215740 1 Processor -- start 2024-09-11T22:12:28.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.431+0000 7fcd76215740 1 -- start start 2024-09-11T22:12:28.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.431+0000 7fcd76215740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a53be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.431+0000 7fcd76215740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4ddc0 0x561fb4a6fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.431+0000 7fcd76215740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a70360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.431+0000 7fcd76215740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c1b23f0 con 0x561fb4a4d4a0 2024-09-11T22:12:28.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.431+0000 7fcd76215740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c1afcc0 con 0x561fb4a4ddc0 2024-09-11T22:12:28.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.431+0000 7fcd76215740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c1adb30 con 0x561fb4a58680 2024-09-11T22:12:28.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.431+0000 7fcd71bd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a53be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.431+0000 7fcd71bd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a53be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43054/0 (socket says 172.21.15.152:43054) 2024-09-11T22:12:28.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.431+0000 7fcd71bd8640 1 -- 172.21.15.152:0/1849893858 learned_addr learned my addr 172.21.15.152:0/1849893858 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:28.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.432+0000 7fcd723d9640 1 --2- 172.21.15.152:0/1849893858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a70360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.432+0000 7fcd713d7640 1 --2- 172.21.15.152:0/1849893858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4ddc0 0x561fb4a6fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.432+0000 7fcd71bd8640 1 -- 172.21.15.152:0/1849893858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 msgr2=0x561fb4a70360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.432+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/1849893858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a70360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.432+0000 7fcd71bd8640 1 -- 172.21.15.152:0/1849893858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4ddc0 msgr2=0x561fb4a6fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.432+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/1849893858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4ddc0 0x561fb4a6fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.432+0000 7fcd71bd8640 1 -- 172.21.15.152:0/1849893858 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb4a542c0 con 0x561fb4a4d4a0 2024-09-11T22:12:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.432+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/1849893858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a53be0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcd6803da60 tx=0x7fcd680039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d80adc76021bf45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.432+0000 7fcd577fe640 1 -- 172.21.15.152:0/1849893858 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6804e070 con 0x561fb4a4d4a0 2024-09-11T22:12:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.432+0000 7fcd577fe640 1 -- 172.21.15.152:0/1849893858 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd68063070 con 0x561fb4a4d4a0 2024-09-11T22:12:28.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.432+0000 7fcd577fe640 1 -- 172.21.15.152:0/1849893858 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd68035040 con 0x561fb4a4d4a0 2024-09-11T22:12:28.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.433+0000 7fcd76215740 1 -- 172.21.15.152:0/1849893858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 msgr2=0x561fb4a53be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.433+0000 7fcd76215740 1 --2- 172.21.15.152:0/1849893858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a53be0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcd6803da60 tx=0x7fcd680039c0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.433+0000 7fcd76215740 1 -- 172.21.15.152:0/1849893858 shutdown_connections 2024-09-11T22:12:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.433+0000 7fcd76215740 1 --2- 172.21.15.152:0/1849893858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a70360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.433+0000 7fcd76215740 1 --2- 172.21.15.152:0/1849893858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4ddc0 0x561fb4a6fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.433+0000 7fcd76215740 1 --2- 172.21.15.152:0/1849893858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a53be0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.433+0000 7fcd76215740 1 -- 172.21.15.152:0/1849893858 >> 172.21.15.152:0/1849893858 conn(0x561fb4a49a30 msgr2=0x561fb4a48b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.433+0000 7fcd76215740 1 -- 172.21.15.152:0/1849893858 shutdown_connections 2024-09-11T22:12:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.433+0000 7fcd76215740 1 -- 172.21.15.152:0/1849893858 wait complete. 2024-09-11T22:12:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.433+0000 7fcd76215740 1 -- start start 2024-09-11T22:12:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.433+0000 7fcd76215740 1 Processor -- start 2024-09-11T22:12:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd76215740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a5e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd76215740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4ddc0 0x561fb4a5eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd76215740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a5f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd76215740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c1ae180 con 0x561fb4a4d4a0 2024-09-11T22:12:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd76215740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c1af5f0 con 0x561fb4a4ddc0 2024-09-11T22:12:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd76215740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c1ae850 con 0x561fb4a58680 2024-09-11T22:12:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd71bd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a5e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd71bd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a5e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43062/0 (socket says 172.21.15.152:43062) 2024-09-11T22:12:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd71bd8640 1 -- 172.21.15.152:0/47735416 learned_addr learned my addr 172.21.15.152:0/47735416 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd76215740 10 client.0 _ll_register_callbacks cb 0x7fcd68009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:28.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd713d7640 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4ddc0 0x561fb4a5eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd723d9640 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a5f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd71bd8640 1 -- 172.21.15.152:0/47735416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 msgr2=0x561fb4a5f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:28.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a5f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd71bd8640 1 -- 172.21.15.152:0/47735416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4ddc0 msgr2=0x561fb4a5eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:28.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4ddc0 0x561fb4a5eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd71bd8640 1 -- 172.21.15.152:0/47735416 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb4a4dbf0 con 0x561fb4a4d4a0 2024-09-11T22:12:28.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd723d9640 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a5f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:28.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.434+0000 7fcd713d7640 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4ddc0 0x561fb4a5eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:28.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd71bd8640 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a5e5a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcd680059d0 tx=0x7fcd68003a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8aee5c54225fac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:28.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd557fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd557fa640 1 -- 172.21.15.152:0/47735416 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6804e040 con 0x561fb4a4d4a0 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd557fa640 1 -- 172.21.15.152:0/47735416 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fcd6803d650 con 0x561fb4a4d4a0 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd76215740 1 -- 172.21.15.152:0/47735416 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd68063070 con 0x561fb4a4d4a0 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd557fa640 1 -- 172.21.15.152:0/47735416 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcd68075050 con 0x561fb4a4d4a0 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd76215740 10 client.17382 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd76215740 1 -- 172.21.15.152:0/47735416 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561fb4a55c50 con 0x561fb4a4d4a0 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd557fa640 1 -- 172.21.15.152:0/47735416 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd68063070 con 0x561fb4a4d4a0 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd557fa640 1 -- 172.21.15.152:0/47735416 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fcd68067610 con 0x561fb4a4d4a0 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd76215740 10 client.17382 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.435+0000 7fcd76215740 10 client.17382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.436+0000 7fcd76215740 20 client.17382 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:28.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.436+0000 7fcd76215740 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561fb4a680f0 0x561fb4ad5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.436+0000 7fcd76215740 4 client.17382 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:12:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.436+0000 7fcd76215740 1 -- 172.21.15.152:0/47735416 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561fb49bad60 con 0x561fb4a680f0 2024-09-11T22:12:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.436+0000 7fcd713d7640 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561fb4a680f0 0x561fb4ad5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.436+0000 7fcd557fa640 10 client.17382 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.436+0000 7fcd713d7640 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561fb4a680f0 0x561fb4ad5560 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e988c6187eeb8e44 server_cookie=41fa59592e17a900 in_seq=0 out_seq=0 2024-09-11T22:12:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.436+0000 7fcd557fa640 1 -- 172.21.15.152:0/47735416 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561fb49bad60 con 0x561fb4a680f0 2024-09-11T22:12:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.436+0000 7fcd557fa640 10 client.17382 handle_command_reply: tid=0 2024-09-11T22:12:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.436+0000 7fcd76215740 1 client.17382 shutdown 2024-09-11T22:12:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd76215740 1 -- 172.21.15.152:0/47735416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 msgr2=0x561fb4a5e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd76215740 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a5e5a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcd680059d0 tx=0x7fcd68003a30 comp rx=0 tx=0).stop 2024-09-11T22:12:28.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd76215740 1 -- 172.21.15.152:0/47735416 shutdown_connections 2024-09-11T22:12:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd76215740 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x561fb4a680f0 0x561fb4ad5560 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd76215740 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561fb4a58680 0x561fb4a5f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd76215740 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fb4a4ddc0 0x561fb4a5eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd76215740 1 --2- 172.21.15.152:0/47735416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fb4a4d4a0 0x561fb4a5e5a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd76215740 1 -- 172.21.15.152:0/47735416 >> 172.21.15.152:0/47735416 conn(0x561fb4a49a30 msgr2=0x561fb4a48b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd557fa640 0 client.17382 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd76215740 1 -- 172.21.15.152:0/47735416 shutdown_connections 2024-09-11T22:12:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd76215740 1 -- 172.21.15.152:0/47735416 wait complete. 2024-09-11T22:12:28.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.437+0000 7fcd76215740 20 client.17382 trim_cache size 0 max 16384 2024-09-11T22:12:28.447 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:12:28.447 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:12:28.447 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:12:28.447 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:12:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 -- 172.21.15.152:0/84587775 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd580a2d70 msgr2=0x7fcd580a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd580a2d70 0x7fcd580a5230 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009900 tx=0x7fcd680058d0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 -- 172.21.15.152:0/84587775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd6c106a70 msgr2=0x7fcd6c19eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd6c106a70 0x7fcd6c19eea0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400eaa0 tx=0x7fcd6400eea0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 -- 172.21.15.152:0/84587775 shutdown_connections 2024-09-11T22:12:28.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fcd580a2d70 0x7fcd580a5230 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd6c106a70 0x7fcd6c19eea0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd6c101410 0x7fcd6c19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 --2- 172.21.15.152:0/84587775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd6c100a70 0x7fcd6c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 -- 172.21.15.152:0/84587775 >> 172.21.15.152:0/84587775 conn(0x7fcd6c0fc790 msgr2=0x7fcd6c06a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 -- 172.21.15.152:0/84587775 shutdown_connections 2024-09-11T22:12:28.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:28.438+0000 7fcd73e3c640 1 -- 172.21.15.152:0/84587775 wait complete. 2024-09-11T22:12:29.146 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:12:29.147 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:12:29.192 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:29.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:29 smithi179 ceph-mon[35603]: pgmap v252: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-09-11T22:12:29.313 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:29 smithi152 ceph-mon[31188]: pgmap v252: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-09-11T22:12:29.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:29 smithi193 ceph-mon[35545]: pgmap v252: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-09-11T22:12:29.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.666+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/2380926545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d58102790 msgr2=0x7f9d581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:29.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.666+0000 7f9d5fa0e640 1 --2- 172.21.15.152:0/2380926545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d58102790 0x7f9d581067e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009900 tx=0x7f9d5402a410 comp rx=0 tx=0).stop 2024-09-11T22:12:29.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.666+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/2380926545 shutdown_connections 2024-09-11T22:12:29.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.666+0000 7f9d5fa0e640 1 --2- 172.21.15.152:0/2380926545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d58106f10 0x7f9d5810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.666+0000 7f9d5fa0e640 1 --2- 172.21.15.152:0/2380926545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d58102790 0x7f9d581067e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.666+0000 7f9d5fa0e640 1 --2- 172.21.15.152:0/2380926545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d58101de0 0x7f9d581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.666+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/2380926545 >> 172.21.15.152:0/2380926545 conn(0x7f9d580fd8c0 msgr2=0x7f9d580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.666+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/2380926545 shutdown_connections 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.666+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/2380926545 wait complete. 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5fa0e640 1 Processor -- start 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5fa0e640 1 -- start start 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5fa0e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d58101de0 0x7f9d580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5fa0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d58102790 0x7f9d58074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5fa0e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d58106f10 0x7f9d58074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5fa0e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9d58111fb0 con 0x7f9d58106f10 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5fa0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9d58111e30 con 0x7f9d58102790 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5fa0e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9d58112130 con 0x7f9d58101de0 2024-09-11T22:12:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5dfab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d58106f10 0x7f9d58074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5dfab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d58106f10 0x7f9d58074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43078/0 (socket says 172.21.15.152:43078) 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5dfab640 1 -- 172.21.15.152:0/3114534625 learned_addr learned my addr 172.21.15.152:0/3114534625 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d58101de0 0x7f9d580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5cfa9640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d58102790 0x7f9d58074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5dfab640 1 -- 172.21.15.152:0/3114534625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d58101de0 msgr2=0x7f9d580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5dfab640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d58101de0 0x7f9d580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5dfab640 1 -- 172.21.15.152:0/3114534625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d58102790 msgr2=0x7f9d58074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5dfab640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d58102790 0x7f9d58074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5dfab640 1 -- 172.21.15.152:0/3114534625 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d581a6970 con 0x7f9d58106f10 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.667+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d58101de0 0x7f9d580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.668+0000 7f9d5dfab640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d58106f10 0x7f9d58074f70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000b970 tx=0x7f9d5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.668+0000 7f9d4a7fc640 1 -- 172.21.15.152:0/3114534625 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50019070 con 0x7f9d58106f10 2024-09-11T22:12:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.668+0000 7f9d4a7fc640 1 -- 172.21.15.152:0/3114534625 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d5000cb40 con 0x7f9d58106f10 2024-09-11T22:12:29.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.668+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/3114534625 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d581a6c60 con 0x7f9d58106f10 2024-09-11T22:12:29.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.668+0000 7f9d4a7fc640 1 -- 172.21.15.152:0/3114534625 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50007650 con 0x7f9d58106f10 2024-09-11T22:12:29.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.668+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/3114534625 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d581a7150 con 0x7f9d58106f10 2024-09-11T22:12:29.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.670+0000 7f9d4a7fc640 1 -- 172.21.15.152:0/3114534625 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9d5001c070 con 0x7f9d58106f10 2024-09-11T22:12:29.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d61de7740 1 Processor -- start 2024-09-11T22:12:29.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d61de7740 1 -- start start 2024-09-11T22:12:29.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 0x564e37281440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 0x564e3728bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e3728e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d61de7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564e371e6620 con 0x564e37281060 2024-09-11T22:12:29.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d61de7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e3718de50 con 0x564e3728c240 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d61de7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564e371e25e0 con 0x564e37281980 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d5cfa9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 0x564e37281440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d4a7fc640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9d440a2cf0 0x7f9d440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d5cfa9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 0x564e37281440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43084/0 (socket says 172.21.15.152:43084) 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d5cfa9640 1 -- 172.21.15.152:0/836674477 learned_addr learned my addr 172.21.15.152:0/836674477 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/836674477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 0x564e3728bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d5dfab640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9d440a2cf0 0x7f9d440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.671+0000 7f9d4a7fc640 1 -- 172.21.15.152:0/3114534625 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f9d500cea30 con 0x7f9d58106f10 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.672+0000 7f9d5d7aa640 1 -- 172.21.15.152:0/836674477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 msgr2=0x564e3728e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.672+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/836674477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e3728e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.672+0000 7f9d5d7aa640 1 -- 172.21.15.152:0/836674477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 msgr2=0x564e37281440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.672+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/836674477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 0x564e37281440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.672+0000 7f9d5d7aa640 1 -- 172.21.15.152:0/836674477 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e3717ed40 con 0x564e37281980 2024-09-11T22:12:29.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.672+0000 7f9d5dfab640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9d440a2cf0 0x7f9d440a51b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9d50016000 tx=0x7f9d50014d00 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:29.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.672+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/836674477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 0x564e3728bd00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00cbd0 tx=0x7f9d4c00e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6387745715b1d47c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:29.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.672+0000 7f9d437fe640 1 -- 172.21.15.152:0/836674477 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c005220 con 0x564e37281980 2024-09-11T22:12:29.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.672+0000 7f9d437fe640 1 -- 172.21.15.152:0/836674477 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d4c004c80 con 0x564e37281980 2024-09-11T22:12:29.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.672+0000 7f9d437fe640 1 -- 172.21.15.152:0/836674477 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c010810 con 0x564e37281980 2024-09-11T22:12:29.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.673+0000 7f9d61de7740 1 -- 172.21.15.152:0/836674477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 msgr2=0x564e3728bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.673+0000 7f9d61de7740 1 --2- 172.21.15.152:0/836674477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 0x564e3728bd00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00cbd0 tx=0x7f9d4c00e720 comp rx=0 tx=0).stop 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.673+0000 7f9d61de7740 1 -- 172.21.15.152:0/836674477 shutdown_connections 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.673+0000 7f9d61de7740 1 --2- 172.21.15.152:0/836674477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e3728e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.673+0000 7f9d61de7740 1 --2- 172.21.15.152:0/836674477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 0x564e3728bd00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.673+0000 7f9d61de7740 1 --2- 172.21.15.152:0/836674477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 0x564e37281440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.673+0000 7f9d61de7740 1 -- 172.21.15.152:0/836674477 >> 172.21.15.152:0/836674477 conn(0x564e3727d5f0 msgr2=0x564e3727d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.673+0000 7f9d61de7740 1 -- 172.21.15.152:0/836674477 shutdown_connections 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.673+0000 7f9d61de7740 1 -- 172.21.15.152:0/836674477 wait complete. 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.673+0000 7f9d61de7740 1 -- start start 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d61de7740 1 Processor -- start 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 0x564e37289040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 0x564e37289580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e37289ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d61de7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564e3728ee10 con 0x564e37281060 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d61de7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e3716ef10 con 0x564e3728c240 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d61de7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564e3728ef90 con 0x564e37281980 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d61de7740 10 client.0 _ll_register_callbacks cb 0x564e37192db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d5cfa9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 0x564e37289040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d5cfa9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 0x564e37289040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43098/0 (socket says 172.21.15.152:43098) 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d5cfa9640 1 -- 172.21.15.152:0/927425363 learned_addr learned my addr 172.21.15.152:0/927425363 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 0x564e37289580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.674+0000 7f9d5cfa9640 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e37289ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d5cfa9640 1 -- 172.21.15.152:0/927425363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 msgr2=0x564e37289580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d5cfa9640 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 0x564e37289580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d5cfa9640 1 -- 172.21.15.152:0/927425363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 msgr2=0x564e37289ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d5cfa9640 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e37289ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d5cfa9640 1 -- 172.21.15.152:0/927425363 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e36ef5580 con 0x564e37281060 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 0x564e37289580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d5cfa9640 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 0x564e37289040 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009230 tx=0x7f9d54005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3561fd6092fc5973 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d40ff9640 1 -- 172.21.15.152:0/927425363 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54035070 con 0x564e37281060 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d40ff9640 1 -- 172.21.15.152:0/927425363 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f9d54005220 con 0x564e37281060 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d61de7740 1 -- 172.21.15.152:0/927425363 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d4c004c80 con 0x564e37281060 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d40ff9640 1 -- 172.21.15.152:0/927425363 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9d54005420 con 0x564e37281060 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d61de7740 10 client.17394 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d61de7740 1 -- 172.21.15.152:0/927425363 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e36fbf960 con 0x564e37281060 2024-09-11T22:12:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.675+0000 7f9d40ff9640 1 -- 172.21.15.152:0/927425363 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d4c004c80 con 0x564e37281060 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.676+0000 7f9d40ff9640 1 -- 172.21.15.152:0/927425363 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9d54047020 con 0x564e37281060 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.676+0000 7f9d61de7740 10 client.17394 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.676+0000 7f9d61de7740 10 client.17394 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.676+0000 7f9d61de7740 20 client.17394 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.676+0000 7f9d61de7740 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e3729bee0 0x564e3729e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.676+0000 7f9d61de7740 4 client.17394 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.676+0000 7f9d61de7740 1 -- 172.21.15.152:0/927425363 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e371f3b90 con 0x564e3729bee0 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.676+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e3729bee0 0x564e3729e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.677+0000 7f9d40ff9640 10 client.17394 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.677+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e3729bee0 0x564e3729e2d0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4cb12d1ad57ad58 server_cookie=6cad785daebe5b3f in_seq=0 out_seq=0 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.677+0000 7f9d40ff9640 1 -- 172.21.15.152:0/927425363 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e371f3b90 con 0x564e3729bee0 2024-09-11T22:12:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.677+0000 7f9d40ff9640 10 client.17394 handle_command_reply: tid=0 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.677+0000 7f9d61de7740 1 client.17394 shutdown 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.677+0000 7f9d61de7740 1 -- 172.21.15.152:0/927425363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 msgr2=0x564e37289040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.677+0000 7f9d61de7740 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 0x564e37289040 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009230 tx=0x7f9d54005e00 comp rx=0 tx=0).stop 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.677+0000 7f9d61de7740 1 -- 172.21.15.152:0/927425363 shutdown_connections 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.677+0000 7f9d61de7740 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e3729bee0 0x564e3729e2d0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.678+0000 7f9d61de7740 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e37289ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.678+0000 7f9d61de7740 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281980 0x564e37289580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.678+0000 7f9d61de7740 1 --2- 172.21.15.152:0/927425363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281060 0x564e37289040 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.678+0000 7f9d40ff9640 0 client.17394 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.678+0000 7f9d61de7740 1 -- 172.21.15.152:0/927425363 >> 172.21.15.152:0/927425363 conn(0x564e3727d5f0 msgr2=0x564e3727c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.678+0000 7f9d61de7740 1 -- 172.21.15.152:0/927425363 shutdown_connections 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.678+0000 7f9d61de7740 1 -- 172.21.15.152:0/927425363 wait complete. 2024-09-11T22:12:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.678+0000 7f9d61de7740 20 client.17394 trim_cache size 0 max 16384 2024-09-11T22:12:29.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.695+0000 7f9d61de7740 1 Processor -- start 2024-09-11T22:12:29.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.696+0000 7f9d61de7740 1 -- start start 2024-09-11T22:12:29.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.696+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281060 0x564e37283ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.696+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e3728afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.696+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e372a3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.696+0000 7f9d61de7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581b2460 con 0x564e37281980 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.696+0000 7f9d61de7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581afd30 con 0x564e3728c240 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.696+0000 7f9d61de7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581adba0 con 0x564e37281060 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.696+0000 7f9d5d7aa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e3728afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.696+0000 7f9d5d7aa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e3728afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43104/0 (socket says 172.21.15.152:43104) 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.696+0000 7f9d5d7aa640 1 -- 172.21.15.152:0/1624749813 learned_addr learned my addr 172.21.15.152:0/1624749813 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.697+0000 7f9d5cfa9640 1 --2- 172.21.15.152:0/1624749813 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281060 0x564e37283ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.697+0000 7f9d5cfa9640 1 --2- 172.21.15.152:0/1624749813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e372a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.697+0000 7f9d5d7aa640 1 -- 172.21.15.152:0/1624749813 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281060 msgr2=0x564e37283ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.697+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/1624749813 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281060 0x564e37283ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.697+0000 7f9d5d7aa640 1 -- 172.21.15.152:0/1624749813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 msgr2=0x564e372a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.697+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/1624749813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e372a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.697+0000 7f9d5d7aa640 1 -- 172.21.15.152:0/1624749813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e3727d420 con 0x564e37281980 2024-09-11T22:12:29.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.697+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/1624749813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e3728afb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c005350 tx=0x7f9d4c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4b0dd4ffc7b6ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:29.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.697+0000 7f9d42ffd640 1 -- 172.21.15.152:0/1624749813 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c005600 con 0x564e37281980 2024-09-11T22:12:29.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.697+0000 7f9d42ffd640 1 -- 172.21.15.152:0/1624749813 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d4c004b40 con 0x564e37281980 2024-09-11T22:12:29.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.697+0000 7f9d42ffd640 1 -- 172.21.15.152:0/1624749813 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c010cd0 con 0x564e37281980 2024-09-11T22:12:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.698+0000 7f9d61de7740 1 -- 172.21.15.152:0/1624749813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 msgr2=0x564e3728afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:29.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.698+0000 7f9d61de7740 1 --2- 172.21.15.152:0/1624749813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e3728afb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c005350 tx=0x7f9d4c01e040 comp rx=0 tx=0).stop 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.698+0000 7f9d61de7740 1 -- 172.21.15.152:0/1624749813 shutdown_connections 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.698+0000 7f9d61de7740 1 --2- 172.21.15.152:0/1624749813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e372a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.698+0000 7f9d61de7740 1 --2- 172.21.15.152:0/1624749813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e3728afb0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.698+0000 7f9d61de7740 1 --2- 172.21.15.152:0/1624749813 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281060 0x564e37283ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.698+0000 7f9d61de7740 1 -- 172.21.15.152:0/1624749813 >> 172.21.15.152:0/1624749813 conn(0x564e3727d5f0 msgr2=0x564e3728a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.699+0000 7f9d61de7740 1 -- 172.21.15.152:0/1624749813 shutdown_connections 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.699+0000 7f9d61de7740 1 -- 172.21.15.152:0/1624749813 wait complete. 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.699+0000 7f9d61de7740 1 -- start start 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.699+0000 7f9d61de7740 1 Processor -- start 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281060 0x564e372901b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e372906f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d61de7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e37290c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d61de7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581ae1f0 con 0x564e37281980 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d61de7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581af660 con 0x564e3728c240 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d61de7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581ae8c0 con 0x564e37281060 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d5d7aa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e372906f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d5d7aa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e372906f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43108/0 (socket says 172.21.15.152:43108) 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d5d7aa640 1 -- 172.21.15.152:0/772472375 learned_addr learned my addr 172.21.15.152:0/772472375 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d5cfa9640 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281060 0x564e372901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d61de7740 10 client.0 _ll_register_callbacks cb 0x7f9d540041c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d5d7aa640 1 -- 172.21.15.152:0/772472375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281060 msgr2=0x564e372901b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281060 0x564e372901b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d5d7aa640 1 -- 172.21.15.152:0/772472375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 msgr2=0x564e37290c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:12:29.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e37290c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.700+0000 7f9d5d7aa640 1 -- 172.21.15.152:0/772472375 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e3727e280 con 0x564e37281980 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.701+0000 7f9d5d7aa640 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e372906f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00eda0 tx=0x7f9d4c00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ebcd6656484e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.701+0000 7f9d40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.701+0000 7f9d40ff9640 1 -- 172.21.15.152:0/772472375 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c039070 con 0x564e37281980 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.701+0000 7f9d40ff9640 1 -- 172.21.15.152:0/772472375 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f9d4c004860 con 0x564e37281980 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.701+0000 7f9d61de7740 1 -- 172.21.15.152:0/772472375 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d4c004b40 con 0x564e37281980 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.701+0000 7f9d40ff9640 1 -- 172.21.15.152:0/772472375 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9d4c045050 con 0x564e37281980 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.701+0000 7f9d61de7740 10 client.17400 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.701+0000 7f9d61de7740 1 -- 172.21.15.152:0/772472375 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e37306c50 con 0x564e37281980 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.701+0000 7f9d40ff9640 1 -- 172.21.15.152:0/772472375 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d4c004b40 con 0x564e37281980 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.702+0000 7f9d40ff9640 1 -- 172.21.15.152:0/772472375 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9d4c030070 con 0x564e37281980 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.702+0000 7f9d61de7740 10 client.17400 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:29.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.702+0000 7f9d61de7740 10 client.17400 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:12:29.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.702+0000 7f9d61de7740 20 client.17400 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:29.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.702+0000 7f9d61de7740 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e37307020 0x564e37309410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:29.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.702+0000 7f9d61de7740 4 client.17400 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e63398c8", "release": true, "await": true}] 2024-09-11T22:12:29.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.702+0000 7f9d61de7740 1 -- 172.21.15.152:0/772472375 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e63398c8", "release": true, "await": true}) -- 0x564e37278950 con 0x564e37307020 2024-09-11T22:12:29.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.702+0000 7f9d5cfa9640 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e37307020 0x564e37309410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:29.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.702+0000 7f9d40ff9640 10 client.17400 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:29.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.702+0000 7f9d5cfa9640 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e37307020 0x564e37309410 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e13e8ed89f31cd43 server_cookie=aa9966b5cfeca2a in_seq=0 out_seq=0 2024-09-11T22:12:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:29.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.780+0000 7f9d40ff9640 1 -- 172.21.15.152:0/772472375 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564e37278950 con 0x564e37307020 2024-09-11T22:12:29.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.780+0000 7f9d40ff9640 10 client.17400 handle_command_reply: tid=0 2024-09-11T22:12:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.780+0000 7f9d61de7740 1 client.17400 shutdown 2024-09-11T22:12:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.781+0000 7f9d61de7740 1 -- 172.21.15.152:0/772472375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 msgr2=0x564e372906f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.781+0000 7f9d61de7740 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e372906f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00eda0 tx=0x7f9d4c00cef0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.781+0000 7f9d61de7740 1 -- 172.21.15.152:0/772472375 shutdown_connections 2024-09-11T22:12:29.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.781+0000 7f9d61de7740 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e37307020 0x564e37309410 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.781+0000 7f9d40ff9640 0 client.17400 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:29.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.781+0000 7f9d61de7740 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e3728c240 0x564e37290c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.781+0000 7f9d61de7740 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e37281980 0x564e372906f0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.781+0000 7f9d61de7740 1 --2- 172.21.15.152:0/772472375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e37281060 0x564e372901b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.781+0000 7f9d61de7740 1 -- 172.21.15.152:0/772472375 >> 172.21.15.152:0/772472375 conn(0x564e3727d5f0 msgr2=0x564e3727c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:29.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.781+0000 7f9d61de7740 1 -- 172.21.15.152:0/772472375 shutdown_connections 2024-09-11T22:12:29.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.781+0000 7f9d61de7740 1 -- 172.21.15.152:0/772472375 wait complete. 2024-09-11T22:12:29.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.782+0000 7f9d61de7740 20 client.17400 trim_cache size 0 max 16384 2024-09-11T22:12:29.783 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:12:29.784 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:12:29.784 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:12:29.784 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 32, 2024-09-11T22:12:29.784 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:12:29.784 INFO:teuthology.orchestra.run.smithi152.stdout: "e63398c8": { 2024-09-11T22:12:29.784 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 32, 2024-09-11T22:12:29.784 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:12:29.784 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:12:29.784 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:12:29.784 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:12:29.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 139.4, 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:29.786 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:12:29.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/3114534625 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9d440a2cf0 msgr2=0x7f9d440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:29.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9d440a2cf0 0x7f9d440a51b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9d50016000 tx=0x7f9d50014d00 comp rx=0 tx=0).stop 2024-09-11T22:12:29.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/3114534625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d58106f10 msgr2=0x7f9d58074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:29.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d58106f10 0x7f9d58074f70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000b970 tx=0x7f9d5000be30 comp rx=0 tx=0).stop 2024-09-11T22:12:29.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/3114534625 shutdown_connections 2024-09-11T22:12:29.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9d440a2cf0 0x7f9d440a51b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d58106f10 0x7f9d58074f70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d58102790 0x7f9d58074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 --2- 172.21.15.152:0/3114534625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d58101de0 0x7f9d580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:29.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/3114534625 >> 172.21.15.152:0/3114534625 conn(0x7f9d580fd8c0 msgr2=0x7f9d580feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:29.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/3114534625 shutdown_connections 2024-09-11T22:12:29.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:29.783+0000 7f9d5fa0e640 1 -- 172.21.15.152:0/3114534625 wait complete. 2024-09-11T22:12:29.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 415.0 s, 12.0 tps, lat 14762.730 ms stddev 8515.900 2024-09-11T22:12:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.241+0000 7f28b35b0640 1 -- 172.21.15.152:0/719800085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28ac101350 msgr2=0x7f28ac10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.241+0000 7f28b35b0640 1 --2- 172.21.15.152:0/719800085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28ac101350 0x7f28ac10d880 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009cd0 tx=0x7f28a402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.242+0000 7f28b35b0640 1 -- 172.21.15.152:0/719800085 shutdown_connections 2024-09-11T22:12:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.242+0000 7f28b35b0640 1 --2- 172.21.15.152:0/719800085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28ac101350 0x7f28ac10d880 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.242+0000 7f28b35b0640 1 --2- 172.21.15.152:0/719800085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28ac1009b0 0x7f28ac100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.242+0000 7f28b35b0640 1 --2- 172.21.15.152:0/719800085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ac1069c0 0x7f28ac106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.242+0000 7f28b35b0640 1 -- 172.21.15.152:0/719800085 >> 172.21.15.152:0/719800085 conn(0x7f28ac077990 msgr2=0x7f28ac0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.242+0000 7f28b35b0640 1 -- 172.21.15.152:0/719800085 shutdown_connections 2024-09-11T22:12:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.242+0000 7f28b35b0640 1 -- 172.21.15.152:0/719800085 wait complete. 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b35b0640 1 Processor -- start 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b35b0640 1 -- start start 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b35b0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28ac1009b0 0x7f28ac1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b35b0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28ac101350 0x7f28ac198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b35b0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ac1069c0 0x7f28ac19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b35b0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac110e50 con 0x7f28ac1009b0 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b35b0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac110cd0 con 0x7f28ac1069c0 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b35b0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac110fd0 con 0x7f28ac101350 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b134c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28ac1009b0 0x7f28ac1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b134c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28ac1009b0 0x7f28ac1982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43126/0 (socket says 172.21.15.152:43126) 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b134c640 1 -- 172.21.15.152:0/3931567459 learned_addr learned my addr 172.21.15.152:0/3931567459 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28ac101350 0x7f28ac198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.243+0000 7f28b1b4d640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ac1069c0 0x7f28ac19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28b134c640 1 -- 172.21.15.152:0/3931567459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28ac101350 msgr2=0x7f28ac198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28b134c640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28ac101350 0x7f28ac198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28b134c640 1 -- 172.21.15.152:0/3931567459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ac1069c0 msgr2=0x7f28ac19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28b134c640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ac1069c0 0x7f28ac19cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28b134c640 1 -- 172.21.15.152:0/3931567459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ac19d2c0 con 0x7f28ac1009b0 2024-09-11T22:12:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28ac101350 0x7f28ac198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28b1b4d640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ac1069c0 0x7f28ac19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28b134c640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28ac1009b0 0x7f28ac1982d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f28a800d950 tx=0x7f28a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28a27fc640 1 -- 172.21.15.152:0/3931567459 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a8017030 con 0x7f28ac1009b0 2024-09-11T22:12:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28b35b0640 1 -- 172.21.15.152:0/3931567459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ac19d5b0 con 0x7f28ac1009b0 2024-09-11T22:12:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28a27fc640 1 -- 172.21.15.152:0/3931567459 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28a8004020 con 0x7f28ac1009b0 2024-09-11T22:12:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28a27fc640 1 -- 172.21.15.152:0/3931567459 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a80047a0 con 0x7f28ac1009b0 2024-09-11T22:12:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.244+0000 7f28b35b0640 1 -- 172.21.15.152:0/3931567459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ac0fcd10 con 0x7f28ac1009b0 2024-09-11T22:12:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.249+0000 7f28a27fc640 1 -- 172.21.15.152:0/3931567459 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f28a80041d0 con 0x7f28ac1009b0 2024-09-11T22:12:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.250+0000 7f28b6425740 1 Processor -- start 2024-09-11T22:12:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.250+0000 7f28b6425740 1 -- start start 2024-09-11T22:12:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.250+0000 7f28b6425740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.250+0000 7f28b6425740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 0x56108d154770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.250+0000 7f28b6425740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.250+0000 7f28b6425740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56108d0ae2f0 con 0x56108d14a410 2024-09-11T22:12:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.250+0000 7f28b6425740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56108d056270 con 0x56108d149af0 2024-09-11T22:12:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.250+0000 7f28b6425740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56108d0aa2b0 con 0x56108d154cb0 2024-09-11T22:12:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b0b4b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b134c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 0x56108d154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b0b4b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d1570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50938/0 (socket says 172.21.15.152:50938) 2024-09-11T22:12:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b0b4b640 1 -- 172.21.15.152:0/255896721 learned_addr learned my addr 172.21.15.152:0/255896721 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b1b4d640 1 --2- 172.21.15.152:0/255896721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b0b4b640 1 -- 172.21.15.152:0/255896721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 msgr2=0x56108d149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/255896721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b0b4b640 1 -- 172.21.15.152:0/255896721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 msgr2=0x56108d154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/255896721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 0x56108d154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b0b4b640 1 -- 172.21.15.152:0/255896721 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56108d055340 con 0x56108d154cb0 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28a27fc640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f28980a2e20 0x7f28980a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b1b4d640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f28980a2e20 0x7f28980a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/255896721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d1570a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f289c0114f0 tx=0x7f289c0119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b71dae8f1eea6b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28a27fc640 1 -- 172.21.15.152:0/3931567459 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f28a80ceea0 con 0x7f28ac1009b0 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28977fe640 1 -- 172.21.15.152:0/255896721 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c01e070 con 0x56108d154cb0 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28977fe640 1 -- 172.21.15.152:0/255896721 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f289c00faa0 con 0x56108d154cb0 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.251+0000 7f28977fe640 1 -- 172.21.15.152:0/255896721 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c019c80 con 0x56108d154cb0 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.252+0000 7f28b6425740 1 -- 172.21.15.152:0/255896721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 msgr2=0x56108d1570a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.252+0000 7f28b1b4d640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f28980a2e20 0x7f28980a52e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f28a4004af0 tx=0x7f28a4004a40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.252+0000 7f28b6425740 1 --2- 172.21.15.152:0/255896721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d1570a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f289c0114f0 tx=0x7f289c0119b0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.252+0000 7f28b6425740 1 -- 172.21.15.152:0/255896721 shutdown_connections 2024-09-11T22:12:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.252+0000 7f28b6425740 1 --2- 172.21.15.152:0/255896721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d1570a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.252+0000 7f28b6425740 1 --2- 172.21.15.152:0/255896721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 0x56108d154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.252+0000 7f28b6425740 1 --2- 172.21.15.152:0/255896721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.252+0000 7f28b6425740 1 -- 172.21.15.152:0/255896721 >> 172.21.15.152:0/255896721 conn(0x56108d146060 msgr2=0x56108d146440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.252+0000 7f28b6425740 1 -- 172.21.15.152:0/255896721 shutdown_connections 2024-09-11T22:12:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.252+0000 7f28b6425740 1 -- 172.21.15.152:0/255896721 wait complete. 2024-09-11T22:12:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b6425740 1 -- start start 2024-09-11T22:12:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b6425740 1 Processor -- start 2024-09-11T22:12:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b6425740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d149af0 0x56108d151b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b6425740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 0x56108d1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b6425740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d154cb0 0x56108d152610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b6425740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56108d157880 con 0x56108d14a410 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b6425740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56108d037290 con 0x56108d154cb0 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b6425740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56108d157a00 con 0x56108d149af0 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b6425740 10 client.0 _ll_register_callbacks cb 0x56108d068140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b0b4b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 0x56108d1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b0b4b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 0x56108d1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43148/0 (socket says 172.21.15.152:43148) 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.253+0000 7f28b0b4b640 1 -- 172.21.15.152:0/1688406603 learned_addr learned my addr 172.21.15.152:0/1688406603 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.254+0000 7f28b1b4d640 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d154cb0 0x56108d152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.254+0000 7f28b134c640 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d149af0 0x56108d151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.254+0000 7f28b0b4b640 1 -- 172.21.15.152:0/1688406603 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d149af0 msgr2=0x56108d151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.254+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d149af0 0x56108d151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.254+0000 7f28b0b4b640 1 -- 172.21.15.152:0/1688406603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d154cb0 msgr2=0x56108d152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.254+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d154cb0 0x56108d152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.254+0000 7f28b0b4b640 1 -- 172.21.15.152:0/1688406603 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56108cdc1210 con 0x56108d14a410 2024-09-11T22:12:30.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.256+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 0x56108d1520d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f289c01c040 tx=0x7f289c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2963dd68112ae5d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:30.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.256+0000 7f2894ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.256+0000 7f2894ff9640 1 -- 172.21.15.152:0/1688406603 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c027060 con 0x56108d14a410 2024-09-11T22:12:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.257+0000 7f2894ff9640 1 -- 172.21.15.152:0/1688406603 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f289c004030 con 0x56108d14a410 2024-09-11T22:12:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.257+0000 7f28b6425740 1 -- 172.21.15.152:0/1688406603 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f289c00faa0 con 0x56108d14a410 2024-09-11T22:12:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.257+0000 7f2894ff9640 1 -- 172.21.15.152:0/1688406603 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f289c01e040 con 0x56108d14a410 2024-09-11T22:12:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.257+0000 7f28b6425740 10 client.17412 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.257+0000 7f28b6425740 1 -- 172.21.15.152:0/1688406603 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56108ce8d620 con 0x56108d14a410 2024-09-11T22:12:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.257+0000 7f2894ff9640 1 -- 172.21.15.152:0/1688406603 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f289c00faa0 con 0x56108d14a410 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.258+0000 7f2894ff9640 1 -- 172.21.15.152:0/1688406603 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f289c005070 con 0x56108d14a410 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.258+0000 7f28b6425740 10 client.17412 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.258+0000 7f28b6425740 10 client.17412 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.258+0000 7f28b6425740 20 client.17412 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.258+0000 7f28b6425740 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56108d164ba0 0x56108d166f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.258+0000 7f28b6425740 4 client.17412 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.258+0000 7f28b6425740 1 -- 172.21.15.152:0/1688406603 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56108d0bba20 con 0x56108d164ba0 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.258+0000 7f28b134c640 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56108d164ba0 0x56108d166f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.259+0000 7f2894ff9640 10 client.17412 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.259+0000 7f28b134c640 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56108d164ba0 0x56108d166f90 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c21b503995f5f4b7 server_cookie=24ffd2f51ae70312 in_seq=0 out_seq=0 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.259+0000 7f2894ff9640 1 -- 172.21.15.152:0/1688406603 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56108d0bba20 con 0x56108d164ba0 2024-09-11T22:12:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.259+0000 7f2894ff9640 10 client.17412 handle_command_reply: tid=0 2024-09-11T22:12:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.259+0000 7f28b6425740 1 client.17412 shutdown 2024-09-11T22:12:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f28b6425740 1 -- 172.21.15.152:0/1688406603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 msgr2=0x56108d1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f28b6425740 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 0x56108d1520d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f289c01c040 tx=0x7f289c00f7f0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f28b6425740 1 -- 172.21.15.152:0/1688406603 shutdown_connections 2024-09-11T22:12:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f28b6425740 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56108d164ba0 0x56108d166f90 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f28b6425740 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d154cb0 0x56108d152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f28b6425740 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d14a410 0x56108d1520d0 secure :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f289c01c040 tx=0x7f289c00f7f0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f28b6425740 1 --2- 172.21.15.152:0/1688406603 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d149af0 0x56108d151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f28b6425740 1 -- 172.21.15.152:0/1688406603 >> 172.21.15.152:0/1688406603 conn(0x56108d146060 msgr2=0x56108d14bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f2894ff9640 0 client.17412 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f28b6425740 1 -- 172.21.15.152:0/1688406603 shutdown_connections 2024-09-11T22:12:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f28b6425740 1 -- 172.21.15.152:0/1688406603 wait complete. 2024-09-11T22:12:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.260+0000 7f28b6425740 20 client.17412 trim_cache size 0 max 16384 2024-09-11T22:12:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.284+0000 7f28b6425740 1 Processor -- start 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.284+0000 7f28b6425740 1 -- start start 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b6425740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d14c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b6425740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d152440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b6425740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d150c60 0x56108d153b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b6425740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac1ae120 con 0x56108d150c60 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b6425740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac1ab9f0 con 0x56108d149af0 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b6425740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac1a9860 con 0x56108d154cb0 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b134c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d14c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b0b4b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b1b4d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d150c60 0x56108d153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b0b4b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50964/0 (socket says 172.21.15.152:50964) 2024-09-11T22:12:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b134c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d14c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54660/0 (socket says 172.21.15.152:54660) 2024-09-11T22:12:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b0b4b640 1 -- 172.21.15.152:0/4243444670 learned_addr learned my addr 172.21.15.152:0/4243444670 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b0b4b640 1 -- 172.21.15.152:0/4243444670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 msgr2=0x56108d14c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/4243444670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d14c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b0b4b640 1 -- 172.21.15.152:0/4243444670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d150c60 msgr2=0x56108d153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/4243444670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d150c60 0x56108d153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.285+0000 7f28b0b4b640 1 -- 172.21.15.152:0/4243444670 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56108d145e90 con 0x56108d154cb0 2024-09-11T22:12:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.286+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/4243444670 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d152440 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f289c0054c0 tx=0x7f289c019410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=161673e35fcb4292 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.286+0000 7f2896ffd640 1 -- 172.21.15.152:0/4243444670 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c037070 con 0x56108d154cb0 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.286+0000 7f2896ffd640 1 -- 172.21.15.152:0/4243444670 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f289c0194f0 con 0x56108d154cb0 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.286+0000 7f2896ffd640 1 -- 172.21.15.152:0/4243444670 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c019b40 con 0x56108d154cb0 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.287+0000 7f28b6425740 1 -- 172.21.15.152:0/4243444670 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 msgr2=0x56108d152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.287+0000 7f28b6425740 1 --2- 172.21.15.152:0/4243444670 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d152440 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f289c0054c0 tx=0x7f289c019410 comp rx=0 tx=0).stop 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.287+0000 7f28b6425740 1 -- 172.21.15.152:0/4243444670 shutdown_connections 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.287+0000 7f28b6425740 1 --2- 172.21.15.152:0/4243444670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d150c60 0x56108d153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.287+0000 7f28b6425740 1 --2- 172.21.15.152:0/4243444670 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d152440 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.287+0000 7f28b6425740 1 --2- 172.21.15.152:0/4243444670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d14c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.287+0000 7f28b6425740 1 -- 172.21.15.152:0/4243444670 >> 172.21.15.152:0/4243444670 conn(0x56108d146060 msgr2=0x56108d1533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.287+0000 7f28b6425740 1 -- 172.21.15.152:0/4243444670 shutdown_connections 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.287+0000 7f28b6425740 1 -- 172.21.15.152:0/4243444670 wait complete. 2024-09-11T22:12:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.287+0000 7f28b6425740 1 -- start start 2024-09-11T22:12:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.287+0000 7f28b6425740 1 Processor -- start 2024-09-11T22:12:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.288+0000 7f28b6425740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d15d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.288+0000 7f28b6425740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d150c60 0x56108d1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.288+0000 7f28b6425740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d158c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.288+0000 7f28b0b4b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d150c60 0x56108d1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.289+0000 7f28b0b4b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d150c60 0x56108d1586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43154/0 (socket says 172.21.15.152:43154) 2024-09-11T22:12:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.289+0000 7f28b0b4b640 1 -- 172.21.15.152:0/1772383718 learned_addr learned my addr 172.21.15.152:0/1772383718 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.289+0000 7f28b1b4d640 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.289+0000 7f28b6425740 1 -- 172.21.15.152:0/1772383718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac1a9eb0 con 0x56108d150c60 2024-09-11T22:12:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.289+0000 7f28b6425740 1 -- 172.21.15.152:0/1772383718 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac1ab320 con 0x56108d149af0 2024-09-11T22:12:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.289+0000 7f28b6425740 1 -- 172.21.15.152:0/1772383718 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac1aa580 con 0x56108d154cb0 2024-09-11T22:12:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.289+0000 7f28b134c640 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f28b134c640 1 -- 172.21.15.152:0/1772383718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 msgr2=0x56108d158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f28b134c640 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f28b134c640 1 -- 172.21.15.152:0/1772383718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d150c60 msgr2=0x56108d1586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f28b134c640 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d150c60 0x56108d1586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f28b134c640 1 -- 172.21.15.152:0/1772383718 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56108d1412d0 con 0x56108d149af0 2024-09-11T22:12:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f28b6425740 10 client.0 _ll_register_callbacks cb 0x7f289c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f28b6425740 1 -- 172.21.15.152:0/1772383718 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f289c0194f0 con 0x56108d149af0 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f28b134c640 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d15d360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f28a80cc530 tx=0x7f28a80bb040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d6af1e07ab19549 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f2894ff9640 10 client.26807 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f2894ff9640 1 -- 172.21.15.152:0/1772383718 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a809ae40 con 0x56108d149af0 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f2894ff9640 1 -- 172.21.15.152:0/1772383718 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f28a80cc7b0 con 0x56108d149af0 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f2894ff9640 1 -- 172.21.15.152:0/1772383718 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f28a809ac60 con 0x56108d149af0 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.290+0000 7f28b6425740 10 client.26807 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.291+0000 7f28b6425740 1 -- 172.21.15.152:0/1772383718 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56108d1cf310 con 0x56108d149af0 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.291+0000 7f2894ff9640 1 -- 172.21.15.152:0/1772383718 <== mon.2 v2:172.21.15.179:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f28a8097970 con 0x56108d149af0 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.291+0000 7f28b6425740 10 client.26807 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.291+0000 7f28b6425740 10 client.26807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.291+0000 7f28b6425740 20 client.26807 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.291+0000 7f28b6425740 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56108d1cf960 0x56108d1d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.291+0000 7f28b6425740 4 client.26807 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:12:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.291+0000 7f28b6425740 1 -- 172.21.15.152:0/1772383718 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56108d0b5d70 con 0x56108d1cf960 2024-09-11T22:12:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.291+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56108d1cf960 0x56108d1d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.292+0000 7f28b0b4b640 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56108d1cf960 0x56108d1d1dc0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c68ca45b5cd5d90 server_cookie=2866107367ec88a0 in_seq=0 out_seq=0 2024-09-11T22:12:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.292+0000 7f2894ff9640 10 client.26807 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:30.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f2894ff9640 1 -- 172.21.15.152:0/1772383718 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56108d0b5d70 con 0x56108d1cf960 2024-09-11T22:12:30.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f2894ff9640 10 client.26807 handle_command_reply: tid=0 2024-09-11T22:12:30.302 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f28b6425740 1 client.26807 shutdown 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f28b6425740 1 -- 172.21.15.152:0/1772383718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 msgr2=0x56108d15d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f28b6425740 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d15d360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f28a80cc530 tx=0x7f28a80bb040 comp rx=0 tx=0).stop 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f28b6425740 1 -- 172.21.15.152:0/1772383718 shutdown_connections 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f28b6425740 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56108d1cf960 0x56108d1d1dc0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f28b6425740 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56108d154cb0 0x56108d158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f2894ff9640 0 client.26807 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f28b6425740 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56108d150c60 0x56108d1586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f28b6425740 1 --2- 172.21.15.152:0/1772383718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56108d149af0 0x56108d15d360 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.300+0000 7f28b6425740 1 -- 172.21.15.152:0/1772383718 >> 172.21.15.152:0/1772383718 conn(0x56108d146060 msgr2=0x56108d1451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.301+0000 7f28b6425740 1 -- 172.21.15.152:0/1772383718 shutdown_connections 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.301+0000 7f28b6425740 1 -- 172.21.15.152:0/1772383718 wait complete. 2024-09-11T22:12:30.303 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.301+0000 7f28b6425740 20 client.26807 trim_cache size 0 max 16384 2024-09-11T22:12:30.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:12:30.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:12:30.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:12:30.304 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:12:30.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 -- 172.21.15.152:0/3931567459 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f28980a2e20 msgr2=0x7f28980a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f28980a2e20 0x7f28980a52e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f28a4004af0 tx=0x7f28a4004a40 comp rx=0 tx=0).stop 2024-09-11T22:12:30.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 -- 172.21.15.152:0/3931567459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28ac1009b0 msgr2=0x7f28ac1982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28ac1009b0 0x7f28ac1982d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f28a800d950 tx=0x7f28a800de10 comp rx=0 tx=0).stop 2024-09-11T22:12:30.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 -- 172.21.15.152:0/3931567459 shutdown_connections 2024-09-11T22:12:30.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f28980a2e20 0x7f28980a52e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ac1069c0 0x7f28ac19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28ac101350 0x7f28ac198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 --2- 172.21.15.152:0/3931567459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28ac1009b0 0x7f28ac1982d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 -- 172.21.15.152:0/3931567459 >> 172.21.15.152:0/3931567459 conn(0x7f28ac077990 msgr2=0x7f28ac069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:30.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 -- 172.21.15.152:0/3931567459 shutdown_connections 2024-09-11T22:12:30.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:30.302+0000 7f28b35b0640 1 -- 172.21.15.152:0/3931567459 wait complete. 2024-09-11T22:12:30.658 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e63398c8', total seconds elapsed: 23.6 2024-09-11T22:12:30.658 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.4 2024-09-11T22:12:30.658 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:12:30.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.963+0000 7f6ccc219640 1 -- 172.21.15.152:0/946867530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cc4102dd0 msgr2=0x7f6cc41031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.963+0000 7f6ccc219640 1 --2- 172.21.15.152:0/946867530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cc4102dd0 0x7f6cc41031b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009930 tx=0x7f6cc002a420 comp rx=0 tx=0).stop 2024-09-11T22:12:30.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.963+0000 7f6ccc219640 1 -- 172.21.15.152:0/946867530 shutdown_connections 2024-09-11T22:12:30.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.963+0000 7f6ccc219640 1 --2- 172.21.15.152:0/946867530 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cc4108300 0x7f6cc410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.963+0000 7f6ccc219640 1 --2- 172.21.15.152:0/946867530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cc4103780 0x7f6cc4107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.963+0000 7f6ccc219640 1 --2- 172.21.15.152:0/946867530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cc4102dd0 0x7f6cc41031b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.963+0000 7f6ccc219640 1 -- 172.21.15.152:0/946867530 >> 172.21.15.152:0/946867530 conn(0x7f6cc40fc7d0 msgr2=0x7f6cc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:30.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.963+0000 7f6ccc219640 1 -- 172.21.15.152:0/946867530 shutdown_connections 2024-09-11T22:12:30.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.964+0000 7f6ccc219640 1 -- 172.21.15.152:0/946867530 wait complete. 2024-09-11T22:12:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.964+0000 7f6ccc219640 1 Processor -- start 2024-09-11T22:12:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6ccc219640 1 -- start start 2024-09-11T22:12:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6ccc219640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cc4102dd0 0x7f6cc4100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6ccc219640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cc4103780 0x7f6cc4100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6ccc219640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cc4108300 0x7f6cc41014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6ccc219640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4112070 con 0x7f6cc4108300 2024-09-11T22:12:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6ccc219640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4111ef0 con 0x7f6cc4102dd0 2024-09-11T22:12:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6ccc219640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc41121f0 con 0x7f6cc4103780 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6cc9fb5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cc4102dd0 0x7f6cc4100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6cc9fb5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cc4102dd0 0x7f6cc4100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54688/0 (socket says 172.21.15.152:54688) 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6cc9fb5640 1 -- 172.21.15.152:0/2054671213 learned_addr learned my addr 172.21.15.152:0/2054671213 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6cc97b4640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cc4103780 0x7f6cc4100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6cca7b6640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cc4108300 0x7f6cc41014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6cc9fb5640 1 -- 172.21.15.152:0/2054671213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cc4103780 msgr2=0x7f6cc4100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6cc9fb5640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cc4103780 0x7f6cc4100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6cc9fb5640 1 -- 172.21.15.152:0/2054671213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cc4108300 msgr2=0x7f6cc41014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6cc9fb5640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cc4108300 0x7f6cc41014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.965+0000 7f6cc9fb5640 1 -- 172.21.15.152:0/2054671213 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc41aadd0 con 0x7f6cc4102dd0 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.966+0000 7f6cc9fb5640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cc4102dd0 0x7f6cc4100a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009900 tx=0x7f6cc00309c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.966+0000 7f6cb6ffd640 1 -- 172.21.15.152:0/2054671213 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc003f070 con 0x7f6cc4102dd0 2024-09-11T22:12:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.966+0000 7f6cb6ffd640 1 -- 172.21.15.152:0/2054671213 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc00035f0 con 0x7f6cc4102dd0 2024-09-11T22:12:30.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.966+0000 7f6ccc219640 1 -- 172.21.15.152:0/2054671213 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc41aafa0 con 0x7f6cc4102dd0 2024-09-11T22:12:30.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.966+0000 7f6cb6ffd640 1 -- 172.21.15.152:0/2054671213 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0035030 con 0x7f6cc4102dd0 2024-09-11T22:12:30.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.966+0000 7f6ccc219640 1 -- 172.21.15.152:0/2054671213 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc41ab4a0 con 0x7f6cc4102dd0 2024-09-11T22:12:30.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.968+0000 7f6ccc219640 1 -- 172.21.15.152:0/2054671213 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc406a7b0 con 0x7f6cc4102dd0 2024-09-11T22:12:30.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.969+0000 7f6cb6ffd640 1 -- 172.21.15.152:0/2054671213 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f6cc0042070 con 0x7f6cc4102dd0 2024-09-11T22:12:30.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.969+0000 7f6cb6ffd640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6cb00a2d70 0x7f6cb00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:30.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.970+0000 7f6cb6ffd640 1 -- 172.21.15.152:0/2054671213 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f6cc00f01a0 con 0x7f6cc4102dd0 2024-09-11T22:12:30.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.970+0000 7f6cc97b4640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6cb00a2d70 0x7f6cb00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:30.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.972+0000 7f6cc97b4640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6cb00a2d70 0x7f6cb00a5230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6cc41021f0 tx=0x7f6cb8005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:30.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:30.975+0000 7f6cb6ffd640 1 -- 172.21.15.152:0/2054671213 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6cc0049020 con 0x7f6cc4102dd0 2024-09-11T22:12:31.060 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:31.201 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:31 smithi152 ceph-mon[31188]: pgmap v253: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 815 op/s 2024-09-11T22:12:31.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:31 smithi179 ceph-mon[35603]: pgmap v253: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 815 op/s 2024-09-11T22:12:31.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.312+0000 7f6ccc219640 1 -- 172.21.15.152:0/2054671213 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cc41ab670 con 0x7f6cc4102dd0 2024-09-11T22:12:31.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.312+0000 7f6cb6ffd640 1 -- 172.21.15.152:0/2054671213 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f6cc00bcd60 con 0x7f6cc4102dd0 2024-09-11T22:12:31.313 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:12:31.314 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:12:31.314 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:12:31.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.315+0000 7f6ccc219640 1 -- 172.21.15.152:0/2054671213 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6cb00a2d70 msgr2=0x7f6cb00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:31.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.315+0000 7f6ccc219640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6cb00a2d70 0x7f6cb00a5230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6cc41021f0 tx=0x7f6cb8005f90 comp rx=0 tx=0).stop 2024-09-11T22:12:31.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.315+0000 7f6ccc219640 1 -- 172.21.15.152:0/2054671213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cc4102dd0 msgr2=0x7f6cc4100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:31.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.315+0000 7f6ccc219640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cc4102dd0 0x7f6cc4100a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009900 tx=0x7f6cc00309c0 comp rx=0 tx=0).stop 2024-09-11T22:12:31.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.315+0000 7f6ccc219640 1 -- 172.21.15.152:0/2054671213 shutdown_connections 2024-09-11T22:12:31.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.315+0000 7f6ccc219640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6cb00a2d70 0x7f6cb00a5230 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:31.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.315+0000 7f6ccc219640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cc4108300 0x7f6cc41014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:31.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.315+0000 7f6ccc219640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cc4103780 0x7f6cc4100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:31.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.315+0000 7f6ccc219640 1 --2- 172.21.15.152:0/2054671213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cc4102dd0 0x7f6cc4100a30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:31.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.315+0000 7f6ccc219640 1 -- 172.21.15.152:0/2054671213 >> 172.21.15.152:0/2054671213 conn(0x7f6cc40fc7d0 msgr2=0x7f6cc40fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:31.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.316+0000 7f6ccc219640 1 -- 172.21.15.152:0/2054671213 shutdown_connections 2024-09-11T22:12:31.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.316+0000 7f6ccc219640 1 -- 172.21.15.152:0/2054671213 wait complete. 2024-09-11T22:12:31.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:31 smithi193 ceph-mon[35545]: pgmap v253: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 815 op/s 2024-09-11T22:12:32.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:32 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2054671213' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:32.284 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:12:32.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:32 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2054671213' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:32.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:32 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2054671213' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:12:32.365 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:12:32.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.951+0000 7f3eb28fd640 1 -- 172.21.15.152:0/1653135388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac103660 msgr2=0x7f3eac10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:32.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.951+0000 7f3eb28fd640 1 --2- 172.21.15.152:0/1653135388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac103660 0x7f3eac10bb50 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009900 tx=0x7f3e9402a480 comp rx=0 tx=0).stop 2024-09-11T22:12:32.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.951+0000 7f3eb28fd640 1 -- 172.21.15.152:0/1653135388 shutdown_connections 2024-09-11T22:12:32.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.951+0000 7f3eb28fd640 1 --2- 172.21.15.152:0/1653135388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eac10c170 0x7f3eac10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:32.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.951+0000 7f3eb28fd640 1 --2- 172.21.15.152:0/1653135388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac103660 0x7f3eac10bb50 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:32.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.951+0000 7f3eb28fd640 1 --2- 172.21.15.152:0/1653135388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3eac102d40 0x7f3eac103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:32.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.951+0000 7f3eb28fd640 1 -- 172.21.15.152:0/1653135388 >> 172.21.15.152:0/1653135388 conn(0x7f3eac0fc7a0 msgr2=0x7f3eac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:32.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.951+0000 7f3eb28fd640 1 -- 172.21.15.152:0/1653135388 shutdown_connections 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.951+0000 7f3eb28fd640 1 -- 172.21.15.152:0/1653135388 wait complete. 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eb28fd640 1 Processor -- start 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eb28fd640 1 -- start start 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eb28fd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eac102d40 0x7f3eac073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eb28fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3eac103660 0x7f3eac06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eb28fd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac10c170 0x7f3eac06c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eb28fd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3eac111f70 con 0x7f3eac10c170 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eb28fd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3eac111df0 con 0x7f3eac102d40 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eb28fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3eac1120f0 con 0x7f3eac103660 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eabfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eac102d40 0x7f3eac073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eabfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eac102d40 0x7f3eac073d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54708/0 (socket says 172.21.15.152:54708) 2024-09-11T22:12:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3ea3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3eac103660 0x7f3eac06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eabfff640 1 -- 172.21.15.152:0/365271344 learned_addr learned my addr 172.21.15.152:0/365271344 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eb0e9a640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac10c170 0x7f3eac06c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eabfff640 1 -- 172.21.15.152:0/365271344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3eac103660 msgr2=0x7f3eac06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eabfff640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3eac103660 0x7f3eac06bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eabfff640 1 -- 172.21.15.152:0/365271344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac10c170 msgr2=0x7f3eac06c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eabfff640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac10c170 0x7f3eac06c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.952+0000 7f3eabfff640 1 -- 172.21.15.152:0/365271344 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eac06ca40 con 0x7f3eac102d40 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.953+0000 7f3eabfff640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eac102d40 0x7f3eac073d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00e9f0 tx=0x7f3e9c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.953+0000 7f3ea9ffb640 1 -- 172.21.15.152:0/365271344 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00cd80 con 0x7f3eac102d40 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.953+0000 7f3ea9ffb640 1 -- 172.21.15.152:0/365271344 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e9c005500 con 0x7f3eac102d40 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.953+0000 7f3ea9ffb640 1 -- 172.21.15.152:0/365271344 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c010690 con 0x7f3eac102d40 2024-09-11T22:12:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.953+0000 7f3eb28fd640 1 -- 172.21.15.152:0/365271344 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eac1ad280 con 0x7f3eac102d40 2024-09-11T22:12:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.953+0000 7f3eb28fd640 1 -- 172.21.15.152:0/365271344 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eac1ad790 con 0x7f3eac102d40 2024-09-11T22:12:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.954+0000 7f3eb28fd640 1 -- 172.21.15.152:0/365271344 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eac06b070 con 0x7f3eac102d40 2024-09-11T22:12:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.955+0000 7f3ea9ffb640 1 -- 172.21.15.152:0/365271344 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3e9c0046c0 con 0x7f3eac102d40 2024-09-11T22:12:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.956+0000 7f3ea9ffb640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3e980a2d70 0x7f3e980a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.956+0000 7f3ea9ffb640 1 -- 172.21.15.152:0/365271344 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f3e9c0cf7f0 con 0x7f3eac102d40 2024-09-11T22:12:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.956+0000 7f3ea3fff640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3e980a2d70 0x7f3e980a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.957+0000 7f3ea3fff640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3e980a2d70 0x7f3e980a5230 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3e94006010 tx=0x7f3e94009560 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:31.959+0000 7f3ea9ffb640 1 -- 172.21.15.152:0/365271344 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e9c09c3b0 con 0x7f3eac102d40 2024-09-11T22:12:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.291+0000 7f3eb28fd640 1 -- 172.21.15.152:0/365271344 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3eac103120 con 0x7f3eac102d40 2024-09-11T22:12:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.292+0000 7f3ea9ffb640 1 -- 172.21.15.152:0/365271344 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f3eac103120 con 0x7f3eac102d40 2024-09-11T22:12:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:12:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 -- 172.21.15.152:0/365271344 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3e980a2d70 msgr2=0x7f3e980a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3e980a2d70 0x7f3e980a5230 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3e94006010 tx=0x7f3e94009560 comp rx=0 tx=0).stop 2024-09-11T22:12:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 -- 172.21.15.152:0/365271344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eac102d40 msgr2=0x7f3eac073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eac102d40 0x7f3eac073d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00e9f0 tx=0x7f3e9c00edf0 comp rx=0 tx=0).stop 2024-09-11T22:12:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 -- 172.21.15.152:0/365271344 shutdown_connections 2024-09-11T22:12:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3e980a2d70 0x7f3e980a5230 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac10c170 0x7f3eac06c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3eac103660 0x7f3eac06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 --2- 172.21.15.152:0/365271344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eac102d40 0x7f3eac073d10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 -- 172.21.15.152:0/365271344 >> 172.21.15.152:0/365271344 conn(0x7f3eac0fc7a0 msgr2=0x7f3eac0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 -- 172.21.15.152:0/365271344 shutdown_connections 2024-09-11T22:12:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:32.297+0000 7f3eb28fd640 1 -- 172.21.15.152:0/365271344 wait complete. 2024-09-11T22:12:33.036 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 139.4 --await-for 45.0' 2024-09-11T22:12:33.037 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 139.4 --await-for 45.0 2024-09-11T22:12:33.125 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:33.256 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:33 smithi152 ceph-mon[31188]: pgmap v254: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.7 MiB/s wr, 678 op/s 2024-09-11T22:12:33.256 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:33 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/365271344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:33.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:33 smithi179 ceph-mon[35603]: pgmap v254: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.7 MiB/s wr, 678 op/s 2024-09-11T22:12:33.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:33 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/365271344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:33.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:33 smithi193 ceph-mon[35545]: pgmap v254: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.7 MiB/s wr, 678 op/s 2024-09-11T22:12:33.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:33 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/365271344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:33.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.709+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/189014519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd01008c0 msgr2=0x7f3dd0100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:33.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.709+0000 7f3dd4aa1640 1 --2- 172.21.15.152:0/189014519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd01008c0 0x7f3dd0100ca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009930 tx=0x7f3dc002a420 comp rx=0 tx=0).stop 2024-09-11T22:12:33.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.709+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/189014519 shutdown_connections 2024-09-11T22:12:33.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.709+0000 7f3dd4aa1640 1 --2- 172.21.15.152:0/189014519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd0105ec0 0x7f3dd0106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.709+0000 7f3dd4aa1640 1 --2- 172.21.15.152:0/189014519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd01011e0 0x7f3dd0105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.709+0000 7f3dd4aa1640 1 --2- 172.21.15.152:0/189014519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd01008c0 0x7f3dd0100ca0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.709+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/189014519 >> 172.21.15.152:0/189014519 conn(0x7f3dd00fc7d0 msgr2=0x7f3dd00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.709+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/189014519 shutdown_connections 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.709+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/189014519 wait complete. 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.710+0000 7f3dd4aa1640 1 Processor -- start 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.710+0000 7f3dd4aa1640 1 -- start start 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.710+0000 7f3dd4aa1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd01008c0 0x7f3dd0114e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.710+0000 7f3dd4aa1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd01011e0 0x7f3dd010ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.710+0000 7f3dd4aa1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd0105ec0 0x7f3dd010f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.710+0000 7f3dd4aa1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0107930 con 0x7f3dd0105ec0 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.710+0000 7f3dd4aa1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01077b0 con 0x7f3dd01011e0 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.710+0000 7f3dd4aa1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0107ab0 con 0x7f3dd01008c0 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.710+0000 7f3dce59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd01008c0 0x7f3dd0114e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.711+0000 7f3dce59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd01008c0 0x7f3dd0114e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:57508/0 (socket says 172.21.15.152:57508) 2024-09-11T22:12:33.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.711+0000 7f3dce59c640 1 -- 172.21.15.152:0/4235870724 learned_addr learned my addr 172.21.15.152:0/4235870724 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:33.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.711+0000 7f3dced9d640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd0105ec0 0x7f3dd010f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.711+0000 7f3dce59c640 1 -- 172.21.15.152:0/4235870724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd01011e0 msgr2=0x7f3dd010ef00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:12:33.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.711+0000 7f3dce59c640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd01011e0 0x7f3dd010ef00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.711+0000 7f3dce59c640 1 -- 172.21.15.152:0/4235870724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd0105ec0 msgr2=0x7f3dd010f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:33.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.711+0000 7f3dce59c640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd0105ec0 0x7f3dd010f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.711+0000 7f3dce59c640 1 -- 172.21.15.152:0/4235870724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd010fbc0 con 0x7f3dd01008c0 2024-09-11T22:12:33.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.711+0000 7f3dce59c640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd01008c0 0x7f3dd0114e80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3dc002a940 tx=0x7f3dc0003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:33.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.712+0000 7f3dbf7fe640 1 -- 172.21.15.152:0/4235870724 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc003f070 con 0x7f3dd01008c0 2024-09-11T22:12:33.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.712+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/4235870724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd01b3960 con 0x7f3dd01008c0 2024-09-11T22:12:33.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.712+0000 7f3dbf7fe640 1 -- 172.21.15.152:0/4235870724 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc0031c90 con 0x7f3dd01008c0 2024-09-11T22:12:33.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.712+0000 7f3dbf7fe640 1 -- 172.21.15.152:0/4235870724 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0035030 con 0x7f3dd01008c0 2024-09-11T22:12:33.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.712+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/4235870724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd01b3e10 con 0x7f3dd01008c0 2024-09-11T22:12:33.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.716+0000 7f3dd6e7a740 1 Processor -- start 2024-09-11T22:12:33.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dd6e7a740 1 -- start start 2024-09-11T22:12:33.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dbf7fe640 1 -- 172.21.15.152:0/4235870724 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3dc0042070 con 0x7f3dd01008c0 2024-09-11T22:12:33.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d5e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d5e5d0 0x55e652d5ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d69370 0x55e652d6b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e652cc42f0 con 0x55e652d69370 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e652c6bcf0 con 0x55e652d5fb40 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e652cc02b0 con 0x55e652d5e5d0 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dced9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d5e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dce59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d5e5d0 0x55e652d5ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dced9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d5e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37188/0 (socket says 172.21.15.152:37188) 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dcdd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d69370 0x55e652d6b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.717+0000 7f3dced9d640 1 -- 172.21.15.152:0/3143978939 learned_addr learned my addr 172.21.15.152:0/3143978939 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dced9d640 1 -- 172.21.15.152:0/3143978939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d5e5d0 msgr2=0x55e652d5ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dced9d640 1 --2- 172.21.15.152:0/3143978939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d5e5d0 0x55e652d5ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dced9d640 1 -- 172.21.15.152:0/3143978939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d69370 msgr2=0x55e652d6b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:33.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dced9d640 1 --2- 172.21.15.152:0/3143978939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d69370 0x55e652d6b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dced9d640 1 -- 172.21.15.152:0/3143978939 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e652c503a0 con 0x55e652d5fb40 2024-09-11T22:12:33.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dce59c640 1 --2- 172.21.15.152:0/3143978939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d5e5d0 0x55e652d5ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:33.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dcdd9b640 1 --2- 172.21.15.152:0/3143978939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d69370 0x55e652d6b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:33.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dbf7fe640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db80a2cf0 0x7f3db80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dced9d640 1 --2- 172.21.15.152:0/3143978939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d5e090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009f40 tx=0x7f3dc8010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e2a1a1cc389ca92 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:33.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dbf7fe640 1 -- 172.21.15.152:0/4235870724 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f3dc00efc00 con 0x7f3dd01008c0 2024-09-11T22:12:33.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dce59c640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db80a2cf0 0x7f3db80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.718+0000 7f3dbcff9640 1 -- 172.21.15.152:0/3143978939 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8003b70 con 0x55e652d5fb40 2024-09-11T22:12:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.719+0000 7f3dbcff9640 1 -- 172.21.15.152:0/3143978939 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc8003d10 con 0x55e652d5fb40 2024-09-11T22:12:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.720+0000 7f3dce59c640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db80a2cf0 0x7f3db80a51b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00ed3a0 tx=0x7f3dc00f3750 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.720+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/3143978939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 msgr2=0x55e652d5e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.720+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/3143978939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d5e090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009f40 tx=0x7f3dc8010860 comp rx=0 tx=0).stop 2024-09-11T22:12:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.720+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/3143978939 shutdown_connections 2024-09-11T22:12:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.720+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/3143978939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d69370 0x55e652d6b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.721+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/3143978939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d5e5d0 0x55e652d5ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.721+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/3143978939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d5e090 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.721+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/3143978939 >> 172.21.15.152:0/3143978939 conn(0x55e652d27310 msgr2=0x55e652d5ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:33.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.721+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/3143978939 shutdown_connections 2024-09-11T22:12:33.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.721+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/3143978939 wait complete. 2024-09-11T22:12:33.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.722+0000 7f3dd6e7a740 1 -- start start 2024-09-11T22:12:33.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.722+0000 7f3dd6e7a740 1 Processor -- start 2024-09-11T22:12:33.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 0x55e652d68cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d65f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d69370 0x55e652d664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e652d6c0c0 con 0x55e652d5e5d0 2024-09-11T22:12:33.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e652c7f060 con 0x55e652d5fb40 2024-09-11T22:12:33.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e652d6c240 con 0x55e652d69370 2024-09-11T22:12:33.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dd6e7a740 10 client.0 _ll_register_callbacks cb 0x55e6529d28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:33.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dcdd9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d65f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dcdd9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d65f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37204/0 (socket says 172.21.15.152:37204) 2024-09-11T22:12:33.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dced9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d69370 0x55e652d664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dcdd9b640 1 -- 172.21.15.152:0/1334533314 learned_addr learned my addr 172.21.15.152:0/1334533314 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.723+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 0x55e652d68cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3dcdd9b640 1 -- 172.21.15.152:0/1334533314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d69370 msgr2=0x55e652d664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3dcdd9b640 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d69370 0x55e652d664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3dcdd9b640 1 -- 172.21.15.152:0/1334533314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 msgr2=0x55e652d68cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3dcdd9b640 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 0x55e652d68cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3dcdd9b640 1 -- 172.21.15.152:0/1334533314 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e652a353c0 con 0x55e652d5fb40 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 0x55e652d68cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3dcdd9b640 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d65f70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400e680 tx=0x7f3dc400eb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac91cba47d62af3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3db5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1334533314 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400aa90 con 0x55e652d5fb40 2024-09-11T22:12:33.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1334533314 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc8003d10 con 0x55e652d5fb40 2024-09-11T22:12:33.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1334533314 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f3dc400ac30 con 0x55e652d5fb40 2024-09-11T22:12:33.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1334533314 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3dc400ae30 con 0x55e652d5fb40 2024-09-11T22:12:33.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3dd6e7a740 10 client.26828 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:33.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1334533314 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e652d77bd0 con 0x55e652d5fb40 2024-09-11T22:12:33.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.724+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1334533314 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc8003d10 con 0x55e652d5fb40 2024-09-11T22:12:33.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.725+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1334533314 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3dc4003c80 con 0x55e652d5fb40 2024-09-11T22:12:33.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.725+0000 7f3dd6e7a740 10 client.26828 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:33.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.725+0000 7f3dd6e7a740 10 client.26828 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:12:33.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.725+0000 7f3dd6e7a740 20 client.26828 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:33.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.725+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55e652d79450 0x55e652d7b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.725+0000 7f3dd6e7a740 4 client.26828 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:33.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.725+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1334533314 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e652cd1860 con 0x55e652d79450 2024-09-11T22:12:33.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.725+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55e652d79450 0x55e652d7b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.725+0000 7f3db5ffb640 10 client.26828 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:12:33.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.725+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55e652d79450 0x55e652d7b890 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d534b7561b116c0b server_cookie=f1110ef3e998f7f1 in_seq=0 out_seq=0 2024-09-11T22:12:33.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1334533314 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e652cd1860 con 0x55e652d79450 2024-09-11T22:12:33.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3db5ffb640 10 client.26828 handle_command_reply: tid=0 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3dd6e7a740 1 client.26828 shutdown 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1334533314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 msgr2=0x55e652d65f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d65f70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400e680 tx=0x7f3dc400eb40 comp rx=0 tx=0).stop 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1334533314 shutdown_connections 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55e652d79450 0x55e652d7b890 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d69370 0x55e652d664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5fb40 0x55e652d65f70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3db5ffb640 0 client.26828 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1334533314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 0x55e652d68cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1334533314 >> 172.21.15.152:0/1334533314 conn(0x55e652d27310 msgr2=0x55e652d60960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1334533314 shutdown_connections 2024-09-11T22:12:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.726+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1334533314 wait complete. 2024-09-11T22:12:33.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.727+0000 7f3dd6e7a740 20 client.26828 trim_cache size 0 max 16384 2024-09-11T22:12:33.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.749+0000 7f3dd6e7a740 1 Processor -- start 2024-09-11T22:12:33.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.750+0000 7f3dd6e7a740 1 -- start start 2024-09-11T22:12:33.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.750+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5e5d0 0x55e652d67ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.750+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5fb40 0x55e652d61120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d69370 0x55e652d61660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01befe0 con 0x55e652d5fb40 2024-09-11T22:12:33.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01bc8b0 con 0x55e652d5e5d0 2024-09-11T22:12:33.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01ba720 con 0x55e652d69370 2024-09-11T22:12:33.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dced9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5e5d0 0x55e652d67ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dced9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5e5d0 0x55e652d67ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37214/0 (socket says 172.21.15.152:37214) 2024-09-11T22:12:33.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dced9d640 1 -- 172.21.15.152:0/1021226516 learned_addr learned my addr 172.21.15.152:0/1021226516 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1021226516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d69370 0x55e652d61660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dcdd9b640 1 --2- 172.21.15.152:0/1021226516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5fb40 0x55e652d61120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dced9d640 1 -- 172.21.15.152:0/1021226516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d69370 msgr2=0x55e652d61660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1021226516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d69370 0x55e652d61660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dced9d640 1 -- 172.21.15.152:0/1021226516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5fb40 msgr2=0x55e652d61120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1021226516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5fb40 0x55e652d61120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dced9d640 1 -- 172.21.15.152:0/1021226516 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e652d64f20 con 0x55e652d5e5d0 2024-09-11T22:12:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dcdd9b640 1 --2- 172.21.15.152:0/1021226516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5fb40 0x55e652d61120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1021226516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5e5d0 0x55e652d67ee0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8000f80 tx=0x7f3dc8009fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8be40b6ca1c62de6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.751+0000 7f3db7fff640 1 -- 172.21.15.152:0/1021226516 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8024040 con 0x55e652d5e5d0 2024-09-11T22:12:33.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.752+0000 7f3db7fff640 1 -- 172.21.15.152:0/1021226516 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc8011e50 con 0x55e652d5e5d0 2024-09-11T22:12:33.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.752+0000 7f3db7fff640 1 -- 172.21.15.152:0/1021226516 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc801bb00 con 0x55e652d5e5d0 2024-09-11T22:12:33.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.753+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1021226516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5e5d0 msgr2=0x55e652d67ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:33.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.753+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1021226516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5e5d0 0x55e652d67ee0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8000f80 tx=0x7f3dc8009fd0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.753+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1021226516 shutdown_connections 2024-09-11T22:12:33.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.753+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1021226516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d69370 0x55e652d61660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.753+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1021226516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5fb40 0x55e652d61120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.753+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1021226516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d5e5d0 0x55e652d67ee0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.753+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1021226516 >> 172.21.15.152:0/1021226516 conn(0x55e652d27310 msgr2=0x55e652d677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:33.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.753+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1021226516 shutdown_connections 2024-09-11T22:12:33.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.754+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1021226516 wait complete. 2024-09-11T22:12:33.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.754+0000 7f3dd6e7a740 1 -- start start 2024-09-11T22:12:33.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.754+0000 7f3dd6e7a740 1 Processor -- start 2024-09-11T22:12:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 0x55e652d71900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d5fb40 0x55e652d71e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dd6e7a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d69370 0x55e652d6cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01bad70 con 0x55e652d5e5d0 2024-09-11T22:12:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01bc1e0 con 0x55e652d69370 2024-09-11T22:12:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dd6e7a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01bb440 con 0x55e652d5fb40 2024-09-11T22:12:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dd6e7a740 10 client.0 _ll_register_callbacks cb 0x7f3dc400cdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dced9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 0x55e652d71900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dced9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 0x55e652d71900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56460/0 (socket says 172.21.15.152:56460) 2024-09-11T22:12:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dced9d640 1 -- 172.21.15.152:0/1837909624 learned_addr learned my addr 172.21.15.152:0/1837909624 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d69370 0x55e652d6cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dcdd9b640 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d5fb40 0x55e652d71e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dced9d640 1 -- 172.21.15.152:0/1837909624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d5fb40 msgr2=0x55e652d71e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d5fb40 0x55e652d71e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dced9d640 1 -- 172.21.15.152:0/1837909624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 msgr2=0x55e652d71900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 0x55e652d71900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.756+0000 7f3dced9d640 1 -- 172.21.15.152:0/1837909624 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e652d6d750 con 0x55e652d69370 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.757+0000 7f3dced9d640 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d69370 0x55e652d6cf20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8011830 tx=0x7f3dc8009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=177748d752c1ae84 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.757+0000 7f3db5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.757+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1837909624 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc803d070 con 0x55e652d69370 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.757+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1837909624 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f3dc801baf0 con 0x55e652d69370 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.757+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1837909624 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc8011e50 con 0x55e652d69370 2024-09-11T22:12:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.758+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1837909624 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3dc804a050 con 0x55e652d69370 2024-09-11T22:12:33.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.760+0000 7f3dd6e7a740 10 client.26834 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:33.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.760+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1837909624 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e652de3d50 con 0x55e652d69370 2024-09-11T22:12:33.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.761+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1837909624 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc803e040 con 0x55e652d69370 2024-09-11T22:12:33.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.761+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1837909624 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3dc802a040 con 0x55e652d69370 2024-09-11T22:12:33.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.761+0000 7f3dd6e7a740 10 client.26834 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:33.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.761+0000 7f3dd6e7a740 10 client.26834 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:12:33.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.761+0000 7f3dd6e7a740 20 client.26834 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:33.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.761+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55e652d79450 0x55e652de6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:33.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.761+0000 7f3dd6e7a740 4 client.26834 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:12:33.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.761+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1837909624 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3dc8011e50 con 0x55e652d79450 2024-09-11T22:12:33.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.761+0000 7f3dcdd9b640 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55e652d79450 0x55e652de6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:33.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.762+0000 7f3db5ffb640 10 client.26834 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:12:33.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.762+0000 7f3dcdd9b640 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55e652d79450 0x55e652de6190 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1955f8eed13c9dba server_cookie=8068aa4aad68aef in_seq=0 out_seq=0 2024-09-11T22:12:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.763+0000 7f3db5ffb640 1 -- 172.21.15.152:0/1837909624 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3dc8011e50 con 0x55e652d79450 2024-09-11T22:12:33.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.763+0000 7f3db5ffb640 10 client.26834 handle_command_reply: tid=0 2024-09-11T22:12:33.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.763+0000 7f3dd6e7a740 1 client.26834 shutdown 2024-09-11T22:12:33.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.765+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1837909624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d69370 msgr2=0x55e652d6cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:33.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.765+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d69370 0x55e652d6cf20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8011830 tx=0x7f3dc8009500 comp rx=0 tx=0).stop 2024-09-11T22:12:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.765+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1837909624 shutdown_connections 2024-09-11T22:12:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.765+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55e652d79450 0x55e652de6190 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.765+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e652d69370 0x55e652d6cf20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.765+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e652d5fb40 0x55e652d71e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.765+0000 7f3dd6e7a740 1 --2- 172.21.15.152:0/1837909624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e652d5e5d0 0x55e652d71900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.765+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1837909624 >> 172.21.15.152:0/1837909624 conn(0x55e652d27310 msgr2=0x55e652d67ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.766+0000 7f3db5ffb640 0 client.26834 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:12:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.766+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1837909624 shutdown_connections 2024-09-11T22:12:33.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.767+0000 7f3dd6e7a740 1 -- 172.21.15.152:0/1837909624 wait complete. 2024-09-11T22:12:33.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.767+0000 7f3dd6e7a740 20 client.26834 trim_cache size 0 max 16384 2024-09-11T22:12:33.768 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:12:33.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.768+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/4235870724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db80a2cf0 msgr2=0x7f3db80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:33.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.768+0000 7f3dd4aa1640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db80a2cf0 0x7f3db80a51b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00ed3a0 tx=0x7f3dc00f3750 comp rx=0 tx=0).stop 2024-09-11T22:12:33.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.768+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/4235870724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd01008c0 msgr2=0x7f3dd0114e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:33.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.768+0000 7f3dd4aa1640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd01008c0 0x7f3dd0114e80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3dc002a940 tx=0x7f3dc0003b90 comp rx=0 tx=0).stop 2024-09-11T22:12:33.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.768+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/4235870724 shutdown_connections 2024-09-11T22:12:33.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.768+0000 7f3dd4aa1640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3db80a2cf0 0x7f3db80a51b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.768+0000 7f3dd4aa1640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd0105ec0 0x7f3dd010f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.768+0000 7f3dd4aa1640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd01011e0 0x7f3dd010ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.768+0000 7f3dd4aa1640 1 --2- 172.21.15.152:0/4235870724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dd01008c0 0x7f3dd0114e80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:33.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.768+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/4235870724 >> 172.21.15.152:0/4235870724 conn(0x7f3dd00fc7d0 msgr2=0x7f3dd0103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:33.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.769+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/4235870724 shutdown_connections 2024-09-11T22:12:33.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:33.769+0000 7f3dd4aa1640 1 -- 172.21.15.152:0/4235870724 wait complete. 2024-09-11T22:12:33.779 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:34.294 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:34 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:12:34.294 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:34 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:12:34.295 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:34 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:12:34.295 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:34 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:12:34.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:34 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:12:34.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:34 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:12:34.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:34 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:12:34.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:34 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:12:34.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:34 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:12:34.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:34 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:12:34.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:34 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:12:34.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:34 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:12:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.519+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/902397471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a48102570 msgr2=0x7f3a481029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.519+0000 7f3a4d5ab640 1 --2- 172.21.15.152:0/902397471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a48102570 0x7f3a481029b0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009900 tx=0x7f3a3c02a480 comp rx=0 tx=0).stop 2024-09-11T22:12:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.519+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/902397471 shutdown_connections 2024-09-11T22:12:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.519+0000 7f3a4d5ab640 1 --2- 172.21.15.152:0/902397471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a48102ef0 0x7f3a4810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.519+0000 7f3a4d5ab640 1 --2- 172.21.15.152:0/902397471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a48102570 0x7f3a481029b0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.519+0000 7f3a4d5ab640 1 --2- 172.21.15.152:0/902397471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a48100e20 0x7f3a48101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.519+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/902397471 >> 172.21.15.152:0/902397471 conn(0x7f3a480fc7d0 msgr2=0x7f3a480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.519+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/902397471 shutdown_connections 2024-09-11T22:12:34.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.519+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/902397471 wait complete. 2024-09-11T22:12:34.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.520+0000 7f3a4d5ab640 1 Processor -- start 2024-09-11T22:12:34.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.520+0000 7f3a4d5ab640 1 -- start start 2024-09-11T22:12:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.520+0000 7f3a4d5ab640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a48100e20 0x7f3a481984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.520+0000 7f3a4d5ab640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a48102570 0x7f3a48198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.520+0000 7f3a4d5ab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a48102ef0 0x7f3a4819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.520+0000 7f3a46ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a48100e20 0x7f3a481984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.520+0000 7f3a46ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a48100e20 0x7f3a481984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37256/0 (socket says 172.21.15.152:37256) 2024-09-11T22:12:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.521+0000 7f3a46ffd640 1 -- 172.21.15.152:0/2768764029 learned_addr learned my addr 172.21.15.152:0/2768764029 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.521+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/2768764029 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481120d0 con 0x7f3a48102ef0 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.521+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/2768764029 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48111f50 con 0x7f3a48100e20 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.521+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/2768764029 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48112250 con 0x7f3a48102570 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.521+0000 7f3a467fc640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a48102570 0x7f3a48198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.522+0000 7f3a46ffd640 1 -- 172.21.15.152:0/2768764029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a48102570 msgr2=0x7f3a48198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.522+0000 7f3a46ffd640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a48102570 0x7f3a48198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.522+0000 7f3a46ffd640 1 -- 172.21.15.152:0/2768764029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a48102ef0 msgr2=0x7f3a4819cda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.522+0000 7f3a46ffd640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a48102ef0 0x7f3a4819cda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.522+0000 7f3a46ffd640 1 -- 172.21.15.152:0/2768764029 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4819d480 con 0x7f3a48100e20 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.522+0000 7f3a46ffd640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a48100e20 0x7f3a481984d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a3801fa00 tx=0x7f3a3801fec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.522+0000 7f3a2ffff640 1 -- 172.21.15.152:0/2768764029 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800cd80 con 0x7f3a48100e20 2024-09-11T22:12:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.522+0000 7f3a2ffff640 1 -- 172.21.15.152:0/2768764029 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a38021920 con 0x7f3a48100e20 2024-09-11T22:12:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.522+0000 7f3a2ffff640 1 -- 172.21.15.152:0/2768764029 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38029980 con 0x7f3a48100e20 2024-09-11T22:12:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.522+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/2768764029 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4819d770 con 0x7f3a48100e20 2024-09-11T22:12:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.522+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/2768764029 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a4806bc10 con 0x7f3a48100e20 2024-09-11T22:12:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.526+0000 7f3a4f984740 1 Processor -- start 2024-09-11T22:12:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.526+0000 7f3a4f984740 1 -- start start 2024-09-11T22:12:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.526+0000 7f3a2ffff640 1 -- 172.21.15.152:0/2768764029 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3a38021ad0 con 0x7f3a48100e20 2024-09-11T22:12:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.526+0000 7f3a4f984740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x563955663a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.526+0000 7f3a4f984740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 0x563955672810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.526+0000 7f3a4f984740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x563955675140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.526+0000 7f3a4f984740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5639555c92a0 con 0x563955672d50 2024-09-11T22:12:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.526+0000 7f3a4f984740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563955570b10 con 0x563955663620 2024-09-11T22:12:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.526+0000 7f3a4f984740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5639555c5260 con 0x563955663f40 2024-09-11T22:12:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a467fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x563955675140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a467fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x563955675140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56466/0 (socket says 172.21.15.152:56466) 2024-09-11T22:12:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a467fc640 1 -- 172.21.15.152:0/2408302588 learned_addr learned my addr 172.21.15.152:0/2408302588 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a2ffff640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3a300a2dc0 0x7f3a300a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a477fe640 1 --2- 172.21.15.152:0/2408302588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x563955663a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a2ffff640 1 -- 172.21.15.152:0/2768764029 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f3a380e08d0 con 0x7f3a48100e20 2024-09-11T22:12:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a467fc640 1 -- 172.21.15.152:0/2408302588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 msgr2=0x563955672810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:12:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a46ffd640 1 --2- 172.21.15.152:0/2408302588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 0x563955672810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a467fc640 1 --2- 172.21.15.152:0/2408302588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 0x563955672810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a467fc640 1 -- 172.21.15.152:0/2408302588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 msgr2=0x563955663a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:34.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a467fc640 1 --2- 172.21.15.152:0/2408302588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x563955663a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.527+0000 7f3a467fc640 1 -- 172.21.15.152:0/2408302588 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395533ab90 con 0x563955672d50 2024-09-11T22:12:34.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.528+0000 7f3a467fc640 1 --2- 172.21.15.152:0/2408302588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x563955675140 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c000c00 tx=0x7f3a3c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaeffdc3383cdfe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:34.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.528+0000 7f3a477fe640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3a300a2dc0 0x7f3a300a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.528+0000 7f3a2d7fa640 1 -- 172.21.15.152:0/2408302588 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c035040 con 0x563955672d50 2024-09-11T22:12:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.528+0000 7f3a2d7fa640 1 -- 172.21.15.152:0/2408302588 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a3c005520 con 0x563955672d50 2024-09-11T22:12:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.529+0000 7f3a4f984740 1 -- 172.21.15.152:0/2408302588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 msgr2=0x563955675140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.529+0000 7f3a2d7fa640 1 -- 172.21.15.152:0/2408302588 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c035040 con 0x563955672d50 2024-09-11T22:12:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.529+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2408302588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x563955675140 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c000c00 tx=0x7f3a3c004040 comp rx=0 tx=0).stop 2024-09-11T22:12:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.530+0000 7f3a477fe640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3a300a2dc0 0x7f3a300a5280 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3a40005fd0 tx=0x7f3a40004a40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.530+0000 7f3a4f984740 1 -- 172.21.15.152:0/2408302588 shutdown_connections 2024-09-11T22:12:34.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.530+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2408302588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x563955675140 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.530+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2408302588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 0x563955672810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.530+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2408302588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x563955663a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.530+0000 7f3a4f984740 1 -- 172.21.15.152:0/2408302588 >> 172.21.15.152:0/2408302588 conn(0x56395565fcf0 msgr2=0x5639556600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:34.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.530+0000 7f3a4f984740 1 -- 172.21.15.152:0/2408302588 shutdown_connections 2024-09-11T22:12:34.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.531+0000 7f3a4f984740 1 -- 172.21.15.152:0/2408302588 wait complete. 2024-09-11T22:12:34.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.531+0000 7f3a4f984740 1 -- start start 2024-09-11T22:12:34.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.531+0000 7f3a4f984740 1 Processor -- start 2024-09-11T22:12:34.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a4f984740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663620 0x56395566fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a4f984740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663f40 0x563955670130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a4f984740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x563955670670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a4f984740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563955675910 con 0x563955672d50 2024-09-11T22:12:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a4f984740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5639555516e0 con 0x563955663f40 2024-09-11T22:12:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a4f984740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563955675a90 con 0x563955663620 2024-09-11T22:12:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a477fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x563955670670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a4f984740 10 client.0 _ll_register_callbacks cb 0x563955575a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a46ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663620 0x56395566fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a46ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663620 0x56395566fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:57584/0 (socket says 172.21.15.152:57584) 2024-09-11T22:12:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a46ffd640 1 -- 172.21.15.152:0/3467740556 learned_addr learned my addr 172.21.15.152:0/3467740556 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a467fc640 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663f40 0x563955670130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a46ffd640 1 -- 172.21.15.152:0/3467740556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663f40 msgr2=0x563955670130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a46ffd640 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663f40 0x563955670130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a46ffd640 1 -- 172.21.15.152:0/3467740556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 msgr2=0x563955670670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a46ffd640 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x563955670670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a46ffd640 1 -- 172.21.15.152:0/3467740556 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56395567ee60 con 0x563955663620 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a467fc640 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663f40 0x563955670130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.532+0000 7f3a477fe640 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x563955670670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.533+0000 7f3a46ffd640 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663620 0x56395566fbf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3a380b54d0 tx=0x7f3a380ace50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d081419be9f33175 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.533+0000 7f3a2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.533+0000 7f3a2aff5640 1 -- 172.21.15.152:0/3467740556 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a380ac3e0 con 0x563955663620 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.533+0000 7f3a4f984740 1 -- 172.21.15.152:0/3467740556 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a3c005520 con 0x563955663620 2024-09-11T22:12:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.533+0000 7f3a2aff5640 1 -- 172.21.15.152:0/3467740556 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f3a38029b20 con 0x563955663620 2024-09-11T22:12:34.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.534+0000 7f3a2aff5640 1 -- 172.21.15.152:0/3467740556 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3a38029d20 con 0x563955663620 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.534+0000 7f3a4f984740 10 client.27004 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.534+0000 7f3a4f984740 1 -- 172.21.15.152:0/3467740556 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563955681880 con 0x563955663620 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.534+0000 7f3a2aff5640 1 -- 172.21.15.152:0/3467740556 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a3c005520 con 0x563955663620 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.534+0000 7f3a2aff5640 1 -- 172.21.15.152:0/3467740556 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3a380a8b70 con 0x563955663620 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.535+0000 7f3a4f984740 10 client.27004 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.535+0000 7f3a4f984740 10 client.27004 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.535+0000 7f3a4f984740 20 client.27004 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.535+0000 7f3a4f984740 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563955682c90 0x563955685080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.535+0000 7f3a4f984740 4 client.27004 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.535+0000 7f3a4f984740 1 -- 172.21.15.152:0/3467740556 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639555d69d0 con 0x563955682c90 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.535+0000 7f3a467fc640 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563955682c90 0x563955685080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.535+0000 7f3a2aff5640 10 client.27004 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.535+0000 7f3a467fc640 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563955682c90 0x563955685080 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b17e7a810744c01 server_cookie=276a0c6328fee958 in_seq=0 out_seq=0 2024-09-11T22:12:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a2aff5640 1 -- 172.21.15.152:0/3467740556 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5639555d69d0 con 0x563955682c90 2024-09-11T22:12:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a2aff5640 10 client.27004 handle_command_reply: tid=0 2024-09-11T22:12:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a4f984740 1 client.27004 shutdown 2024-09-11T22:12:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a4f984740 1 -- 172.21.15.152:0/3467740556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663620 msgr2=0x56395566fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a4f984740 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663620 0x56395566fbf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3a380b54d0 tx=0x7f3a380ace50 comp rx=0 tx=0).stop 2024-09-11T22:12:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a4f984740 1 -- 172.21.15.152:0/3467740556 shutdown_connections 2024-09-11T22:12:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a4f984740 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563955682c90 0x563955685080 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a4f984740 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x563955670670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a4f984740 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663f40 0x563955670130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a4f984740 1 --2- 172.21.15.152:0/3467740556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663620 0x56395566fbf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a4f984740 1 -- 172.21.15.152:0/3467740556 >> 172.21.15.152:0/3467740556 conn(0x56395565fcf0 msgr2=0x563955665a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a2aff5640 0 client.27004 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a4f984740 1 -- 172.21.15.152:0/3467740556 shutdown_connections 2024-09-11T22:12:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.537+0000 7f3a4f984740 1 -- 172.21.15.152:0/3467740556 wait complete. 2024-09-11T22:12:34.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.538+0000 7f3a4f984740 20 client.27004 trim_cache size 0 max 16384 2024-09-11T22:12:34.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.561+0000 7f3a4f984740 1 Processor -- start 2024-09-11T22:12:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.561+0000 7f3a4f984740 1 -- start start 2024-09-11T22:12:34.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a4f984740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x56395568a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a4f984740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 0x56395568ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a4f984740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x56395566ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a4f984740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481a59d0 con 0x563955672d50 2024-09-11T22:12:34.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a4f984740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48072660 con 0x563955663620 2024-09-11T22:12:34.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a4f984740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3a480704d0 con 0x563955663f40 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a46ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x56395568a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a467fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 0x56395568ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a467fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 0x56395568ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:57590/0 (socket says 172.21.15.152:57590) 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a46ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x56395568a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37294/0 (socket says 172.21.15.152:37294) 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a467fc640 1 -- 172.21.15.152:0/2905307084 learned_addr learned my addr 172.21.15.152:0/2905307084 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a477fe640 1 --2- 172.21.15.152:0/2905307084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x56395566ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a467fc640 1 -- 172.21.15.152:0/2905307084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 msgr2=0x56395568a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a467fc640 1 --2- 172.21.15.152:0/2905307084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x56395568a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a467fc640 1 -- 172.21.15.152:0/2905307084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 msgr2=0x56395566ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a467fc640 1 --2- 172.21.15.152:0/2905307084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x56395566ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a467fc640 1 -- 172.21.15.152:0/2905307084 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395566e140 con 0x563955663f40 2024-09-11T22:12:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.562+0000 7f3a46ffd640 1 --2- 172.21.15.152:0/2905307084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x56395568a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.563+0000 7f3a467fc640 1 --2- 172.21.15.152:0/2905307084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 0x56395568ae60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0314b0 tx=0x7f3a3c031440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27d426bd9326d76e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.563+0000 7f3a2cff9640 1 -- 172.21.15.152:0/2905307084 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c035050 con 0x563955663f40 2024-09-11T22:12:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.563+0000 7f3a2cff9640 1 -- 172.21.15.152:0/2905307084 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a3c0048c0 con 0x563955663f40 2024-09-11T22:12:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.563+0000 7f3a2cff9640 1 -- 172.21.15.152:0/2905307084 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c005090 con 0x563955663f40 2024-09-11T22:12:34.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.564+0000 7f3a4f984740 1 -- 172.21.15.152:0/2905307084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 msgr2=0x56395568ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:34.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.564+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2905307084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 0x56395568ae60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0314b0 tx=0x7f3a3c031440 comp rx=0 tx=0).stop 2024-09-11T22:12:34.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.564+0000 7f3a4f984740 1 -- 172.21.15.152:0/2905307084 shutdown_connections 2024-09-11T22:12:34.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.564+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2905307084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955672d50 0x56395566ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.564+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2905307084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955663f40 0x56395568ae60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.564+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2905307084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x56395568a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.565+0000 7f3a4f984740 1 -- 172.21.15.152:0/2905307084 >> 172.21.15.152:0/2905307084 conn(0x56395565fcf0 msgr2=0x56395565ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.565+0000 7f3a4f984740 1 -- 172.21.15.152:0/2905307084 shutdown_connections 2024-09-11T22:12:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.565+0000 7f3a4f984740 1 -- 172.21.15.152:0/2905307084 wait complete. 2024-09-11T22:12:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.565+0000 7f3a4f984740 1 -- start start 2024-09-11T22:12:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.565+0000 7f3a4f984740 1 Processor -- start 2024-09-11T22:12:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.566+0000 7f3a4f984740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x563955677280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.566+0000 7f3a4f984740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955663f40 0x5639556777c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.566+0000 7f3a46ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x563955677280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.566+0000 7f3a46ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x563955677280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37306/0 (socket says 172.21.15.152:37306) 2024-09-11T22:12:34.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.566+0000 7f3a46ffd640 1 -- 172.21.15.152:0/2082358897 learned_addr learned my addr 172.21.15.152:0/2082358897 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.566+0000 7f3a467fc640 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955663f40 0x5639556777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955672d50 0x5639556ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a4f984740 1 -- 172.21.15.152:0/2082358897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48070b20 con 0x563955663f40 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a4f984740 1 -- 172.21.15.152:0/2082358897 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48071f90 con 0x563955663620 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a477fe640 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955672d50 0x5639556ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a4f984740 1 -- 172.21.15.152:0/2082358897 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3a480711f0 con 0x563955672d50 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a4f984740 10 client.0 _ll_register_callbacks cb 0x7f3a380ad490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a467fc640 1 -- 172.21.15.152:0/2082358897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955672d50 msgr2=0x5639556ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a467fc640 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955672d50 0x5639556ec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a467fc640 1 -- 172.21.15.152:0/2082358897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 msgr2=0x563955677280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a467fc640 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x563955677280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a467fc640 1 -- 172.21.15.152:0/2082358897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639556ece60 con 0x563955663f40 2024-09-11T22:12:34.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.567+0000 7f3a477fe640 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955672d50 0x5639556ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:34.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.568+0000 7f3a467fc640 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955663f40 0x5639556777c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x56395566e3f0 tx=0x7f3a3c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4d72328fd3dce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:34.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.568+0000 7f3a2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.568+0000 7f3a2aff5640 1 -- 172.21.15.152:0/2082358897 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c0046c0 con 0x563955663f40 2024-09-11T22:12:34.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.568+0000 7f3a2aff5640 1 -- 172.21.15.152:0/2082358897 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f3a3c0035f0 con 0x563955663f40 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.568+0000 7f3a4f984740 1 -- 172.21.15.152:0/2082358897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a3c0048c0 con 0x563955663f40 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.568+0000 7f3a2aff5640 1 -- 172.21.15.152:0/2082358897 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3a3c068050 con 0x563955663f40 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.568+0000 7f3a4f984740 10 client.17457 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.568+0000 7f3a4f984740 1 -- 172.21.15.152:0/2082358897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5639556ee100 con 0x563955663f40 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.568+0000 7f3a2aff5640 1 -- 172.21.15.152:0/2082358897 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a3c0048c0 con 0x563955663f40 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.569+0000 7f3a2aff5640 1 -- 172.21.15.152:0/2082358897 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3a3c031540 con 0x563955663f40 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.569+0000 7f3a4f984740 10 client.17457 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.569+0000 7f3a4f984740 10 client.17457 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.569+0000 7f3a4f984740 20 client.17457 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.569+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639556ee380 0x5639556f0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.569+0000 7f3a4f984740 4 client.17457 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.4, "await_for": 45.0}] 2024-09-11T22:12:34.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.569+0000 7f3a4f984740 1 -- 172.21.15.152:0/2082358897 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.4, "await_for": 45.0}) -- 0x5639555d0d20 con 0x5639556ee380 2024-09-11T22:12:34.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.569+0000 7f3a46ffd640 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639556ee380 0x5639556f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:34.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.570+0000 7f3a46ffd640 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639556ee380 0x5639556f0770 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c56b699d08257b5 server_cookie=227bc8e54f95e7dd in_seq=0 out_seq=0 2024-09-11T22:12:34.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.570+0000 7f3a2aff5640 10 client.17457 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:34.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 420.0 s, 2772.4 tps, lat 112.577 ms stddev 1241.389 2024-09-11T22:12:34.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a2aff5640 1 -- 172.21.15.152:0/2082358897 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5639555d0d20 con 0x5639556ee380 2024-09-11T22:12:34.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a2aff5640 10 client.17457 handle_command_reply: tid=0 2024-09-11T22:12:34.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 1 client.17457 shutdown 2024-09-11T22:12:34.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 1 -- 172.21.15.152:0/2082358897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955663f40 msgr2=0x5639556777c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:34.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955663f40 0x5639556777c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x56395566e3f0 tx=0x7f3a3c004040 comp rx=0 tx=0).stop 2024-09-11T22:12:34.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 1 -- 172.21.15.152:0/2082358897 shutdown_connections 2024-09-11T22:12:34.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5639556ee380 0x5639556f0770 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563955672d50 0x5639556ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563955663f40 0x5639556777c0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a2aff5640 0 client.17457 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:34.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 1 --2- 172.21.15.152:0/2082358897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563955663620 0x563955677280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 1 -- 172.21.15.152:0/2082358897 >> 172.21.15.152:0/2082358897 conn(0x56395565fcf0 msgr2=0x5639556650c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:34.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 1 -- 172.21.15.152:0/2082358897 shutdown_connections 2024-09-11T22:12:34.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 1 -- 172.21.15.152:0/2082358897 wait complete. 2024-09-11T22:12:34.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.821+0000 7f3a4f984740 20 client.17457 trim_cache size 0 max 16384 2024-09-11T22:12:34.825 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:12:34.825 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:12:34.825 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:12:34.825 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 34, 2024-09-11T22:12:34.825 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:12:34.825 INFO:teuthology.orchestra.run.smithi152.stdout: "331a59b0": { 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 34, 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 139.4, 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:12:34.826 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:12:34.827 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:12:34.827 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:12:34.827 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:34.827 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:34.827 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:34.827 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:34.827 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:34.827 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/2768764029 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3a300a2dc0 msgr2=0x7f3a300a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3a300a2dc0 0x7f3a300a5280 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3a40005fd0 tx=0x7f3a40004a40 comp rx=0 tx=0).stop 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/2768764029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a48100e20 msgr2=0x7f3a481984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a48100e20 0x7f3a481984d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a3801fa00 tx=0x7f3a3801fec0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/2768764029 shutdown_connections 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3a300a2dc0 0x7f3a300a5280 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a48102ef0 0x7f3a4819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a48102570 0x7f3a48198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 --2- 172.21.15.152:0/2768764029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a48100e20 0x7f3a481984d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/2768764029 >> 172.21.15.152:0/2768764029 conn(0x7f3a480fc7d0 msgr2=0x7f3a48105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/2768764029 shutdown_connections 2024-09-11T22:12:34.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:34.822+0000 7f3a4d5ab640 1 -- 172.21.15.152:0/2768764029 wait complete. 2024-09-11T22:12:35.024 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:12:35.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:35 smithi152 ceph-mon[31188]: pgmap v255: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.0 MiB/s wr, 859 op/s 2024-09-11T22:12:35.293 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:35.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:35 smithi179 ceph-mon[35603]: pgmap v255: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.0 MiB/s wr, 859 op/s 2024-09-11T22:12:35.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:35 smithi193 ceph-mon[35545]: pgmap v255: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.0 MiB/s wr, 859 op/s 2024-09-11T22:12:35.728 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '331a59b0', quiesce took 5.1 seconds. Will release after: 14.299999999999999 2024-09-11T22:12:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.244+0000 7f5788b41640 1 -- 172.21.15.152:0/604352266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5784101420 msgr2=0x7f578410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.244+0000 7f5788b41640 1 --2- 172.21.15.152:0/604352266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5784101420 0x7f578410d950 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f577c009cd0 tx=0x7f577c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.244+0000 7f5788b41640 1 -- 172.21.15.152:0/604352266 shutdown_connections 2024-09-11T22:12:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.244+0000 7f5788b41640 1 --2- 172.21.15.152:0/604352266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5784101420 0x7f578410d950 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.244+0000 7f5788b41640 1 --2- 172.21.15.152:0/604352266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5784100a80 0x7f5784100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.244+0000 7f5788b41640 1 --2- 172.21.15.152:0/604352266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784106a80 0x7f5784106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.244+0000 7f5788b41640 1 -- 172.21.15.152:0/604352266 >> 172.21.15.152:0/604352266 conn(0x7f57840fc7a0 msgr2=0x7f57840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:36.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.244+0000 7f5788b41640 1 -- 172.21.15.152:0/604352266 shutdown_connections 2024-09-11T22:12:36.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.244+0000 7f5788b41640 1 -- 172.21.15.152:0/604352266 wait complete. 2024-09-11T22:12:36.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f5788b41640 1 Processor -- start 2024-09-11T22:12:36.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f5788b41640 1 -- start start 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f5788b41640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5784100a80 0x7f5784197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f5788b41640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784101420 0x7f5784197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f5788b41640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5784106a80 0x7f578419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f5788b41640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5784110e80 con 0x7f5784100a80 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f5788b41640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5784110d00 con 0x7f5784101420 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f5788b41640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5784111000 con 0x7f5784106a80 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f578259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5784100a80 0x7f5784197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f578259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5784100a80 0x7f5784197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56522/0 (socket says 172.21.15.152:56522) 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f578259c640 1 -- 172.21.15.152:0/818172308 learned_addr learned my addr 172.21.15.152:0/818172308 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.245+0000 7f5782d9d640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5784106a80 0x7f578419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f5781d9b640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784101420 0x7f5784197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f578259c640 1 -- 172.21.15.152:0/818172308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5784106a80 msgr2=0x7f578419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:36.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f578259c640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5784106a80 0x7f578419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f578259c640 1 -- 172.21.15.152:0/818172308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784101420 msgr2=0x7f5784197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:36.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f578259c640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784101420 0x7f5784197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f578259c640 1 -- 172.21.15.152:0/818172308 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578419c2b0 con 0x7f5784100a80 2024-09-11T22:12:36.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f5781d9b640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784101420 0x7f5784197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:36.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f578259c640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5784100a80 0x7f5784197300 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f577400e9f0 tx=0x7f577400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:36.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f57737fe640 1 -- 172.21.15.152:0/818172308 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577400cd80 con 0x7f5784100a80 2024-09-11T22:12:36.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f57737fe640 1 -- 172.21.15.152:0/818172308 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5774010910 con 0x7f5784100a80 2024-09-11T22:12:36.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f5788b41640 1 -- 172.21.15.152:0/818172308 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578419c5a0 con 0x7f5784100a80 2024-09-11T22:12:36.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f57737fe640 1 -- 172.21.15.152:0/818172308 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5774018990 con 0x7f5784100a80 2024-09-11T22:12:36.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.246+0000 7f5788b41640 1 -- 172.21.15.152:0/818172308 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57841a3e80 con 0x7f5784100a80 2024-09-11T22:12:36.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.249+0000 7f57737fe640 1 -- 172.21.15.152:0/818172308 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f5774010ac0 con 0x7f5784100a80 2024-09-11T22:12:36.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.249+0000 7f578af1a740 1 Processor -- start 2024-09-11T22:12:36.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f578af1a740 1 -- start start 2024-09-11T22:12:36.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f57737fe640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f576c0a2cf0 0x7f576c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f578af1a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a53b40 0x557d29a52090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f578af1a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a525d0 0x557d29a52a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f578af1a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f578af1a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557d299b82f0 con 0x557d29a5d370 2024-09-11T22:12:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f578af1a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557d2995fcf0 con 0x557d29a525d0 2024-09-11T22:12:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f578af1a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557d299b42b0 con 0x557d29a53b40 2024-09-11T22:12:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f57737fe640 1 -- 172.21.15.152:0/818172308 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f57740cf7f0 con 0x7f5784100a80 2024-09-11T22:12:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f5782d9d640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f576c0a2cf0 0x7f576c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f5782d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f578259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a53b40 0x557d29a52090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f5781d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a525d0 0x557d29a52a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f5782d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56530/0 (socket says 172.21.15.152:56530) 2024-09-11T22:12:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f578259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a53b40 0x557d29a52090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:57644/0 (socket says 172.21.15.152:57644) 2024-09-11T22:12:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.250+0000 7f5782d9d640 1 -- 172.21.15.152:0/2400488118 learned_addr learned my addr 172.21.15.152:0/2400488118 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.251+0000 7f5782d9d640 1 -- 172.21.15.152:0/2400488118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a53b40 msgr2=0x557d29a52090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.251+0000 7f5782d9d640 1 --2- 172.21.15.152:0/2400488118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a53b40 0x557d29a52090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.251+0000 7f5782d9d640 1 -- 172.21.15.152:0/2400488118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a525d0 msgr2=0x557d29a52a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.251+0000 7f5782d9d640 1 --2- 172.21.15.152:0/2400488118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a525d0 0x557d29a52a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.251+0000 7f5782d9d640 1 -- 172.21.15.152:0/2400488118 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d299443a0 con 0x557d29a5d370 2024-09-11T22:12:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.251+0000 7f5782d9d640 1 --2- 172.21.15.152:0/2400488118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5f760 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f577c02ae00 tx=0x7f577c031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9b41b66b831bf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.251+0000 7f5782d9d640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f576c0a2cf0 0x7f576c0a51b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f577c009a60 tx=0x7f577c03e000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.251+0000 7f5770ff9640 1 -- 172.21.15.152:0/2400488118 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c055070 con 0x557d29a5d370 2024-09-11T22:12:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.251+0000 7f5770ff9640 1 -- 172.21.15.152:0/2400488118 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f577c04c070 con 0x557d29a5d370 2024-09-11T22:12:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.251+0000 7f5770ff9640 1 -- 172.21.15.152:0/2400488118 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c030ca0 con 0x557d29a5d370 2024-09-11T22:12:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.252+0000 7f578af1a740 1 -- 172.21.15.152:0/2400488118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 msgr2=0x557d29a5f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.252+0000 7f578af1a740 1 --2- 172.21.15.152:0/2400488118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5f760 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f577c02ae00 tx=0x7f577c031ba0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.252+0000 7f578af1a740 1 -- 172.21.15.152:0/2400488118 shutdown_connections 2024-09-11T22:12:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.252+0000 7f578af1a740 1 --2- 172.21.15.152:0/2400488118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5f760 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.252+0000 7f578af1a740 1 --2- 172.21.15.152:0/2400488118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a525d0 0x557d29a52a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.252+0000 7f578af1a740 1 --2- 172.21.15.152:0/2400488118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a53b40 0x557d29a52090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.252+0000 7f578af1a740 1 -- 172.21.15.152:0/2400488118 >> 172.21.15.152:0/2400488118 conn(0x557d29a1b310 msgr2=0x557d29a4ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.252+0000 7f578af1a740 1 -- 172.21.15.152:0/2400488118 shutdown_connections 2024-09-11T22:12:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.252+0000 7f578af1a740 1 -- 172.21.15.152:0/2400488118 wait complete. 2024-09-11T22:12:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.252+0000 7f578af1a740 1 -- start start 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f578af1a740 1 Processor -- start 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f578af1a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a525d0 0x557d29a5ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f578af1a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a53b40 0x557d29a5a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f578af1a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a5d370 0x557d29a5a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f578af1a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557d29a60010 con 0x557d29a53b40 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f578af1a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557d29973060 con 0x557d29a5d370 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f578af1a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557d29a60190 con 0x557d29a525d0 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f578af1a740 10 client.0 _ll_register_callbacks cb 0x557d296c68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f5781d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a53b40 0x557d29a5a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f5782d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a5d370 0x557d29a5a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f5782d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a5d370 0x557d29a5a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37336/0 (socket says 172.21.15.152:37336) 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f5782d9d640 1 -- 172.21.15.152:0/1870445077 learned_addr learned my addr 172.21.15.152:0/1870445077 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f5781d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a53b40 0x557d29a5a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56542/0 (socket says 172.21.15.152:56542) 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f578259c640 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a525d0 0x557d29a5ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f5781d9b640 1 -- 172.21.15.152:0/1870445077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a525d0 msgr2=0x557d29a5ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f5781d9b640 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a525d0 0x557d29a5ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f5781d9b640 1 -- 172.21.15.152:0/1870445077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a5d370 msgr2=0x557d29a5a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f5781d9b640 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a5d370 0x557d29a5a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.253+0000 7f5781d9b640 1 -- 172.21.15.152:0/1870445077 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d297293c0 con 0x557d29a53b40 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f5781d9b640 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a53b40 0x557d29a5a0d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5778005fd0 tx=0x7f5778016c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9d4aba16b5ccf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f5769ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f5769ffb640 1 -- 172.21.15.152:0/1870445077 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778010e50 con 0x557d29a53b40 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f5769ffb640 1 -- 172.21.15.152:0/1870445077 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f577801e3e0 con 0x557d29a53b40 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f578af1a740 1 -- 172.21.15.152:0/1870445077 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f577c04c070 con 0x557d29a53b40 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f5769ffb640 1 -- 172.21.15.152:0/1870445077 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f577801e5e0 con 0x557d29a53b40 2024-09-11T22:12:36.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f578af1a740 10 client.17469 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f578af1a740 1 -- 172.21.15.152:0/1870445077 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557d29a6bbe0 con 0x557d29a53b40 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f5769ffb640 1 -- 172.21.15.152:0/1870445077 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f577c04c070 con 0x557d29a53b40 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f5769ffb640 1 -- 172.21.15.152:0/1870445077 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f577801d070 con 0x557d29a53b40 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f578af1a740 10 client.17469 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f578af1a740 10 client.17469 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f578af1a740 20 client.17469 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f578af1a740 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x557d29a6d0a0 0x557d29a6f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f578af1a740 4 client.17469 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.254+0000 7f578af1a740 1 -- 172.21.15.152:0/1870445077 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d299c5860 con 0x557d29a6d0a0 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.255+0000 7f578259c640 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x557d29a6d0a0 0x557d29a6f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.255+0000 7f5769ffb640 10 client.17469 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:12:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.255+0000 7f578259c640 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x557d29a6d0a0 0x557d29a6f4f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e148cf14e10712a5 server_cookie=9de7b2403532f5a9 in_seq=0 out_seq=0 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f5769ffb640 1 -- 172.21.15.152:0/1870445077 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d299c5860 con 0x557d29a6d0a0 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f5769ffb640 10 client.17469 handle_command_reply: tid=0 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 1 client.17469 shutdown 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 1 -- 172.21.15.152:0/1870445077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a53b40 msgr2=0x557d29a5a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a53b40 0x557d29a5a0d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5778005fd0 tx=0x7f5778016c30 comp rx=0 tx=0).stop 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 1 -- 172.21.15.152:0/1870445077 shutdown_connections 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x557d29a6d0a0 0x557d29a6f4f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f5769ffb640 0 client.17469 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a5d370 0x557d29a5a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a53b40 0x557d29a5a0d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 1 --2- 172.21.15.152:0/1870445077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a525d0 0x557d29a5ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 1 -- 172.21.15.152:0/1870445077 >> 172.21.15.152:0/1870445077 conn(0x557d29a1b310 msgr2=0x557d29a54990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 1 -- 172.21.15.152:0/1870445077 shutdown_connections 2024-09-11T22:12:36.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 1 -- 172.21.15.152:0/1870445077 wait complete. 2024-09-11T22:12:36.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.256+0000 7f578af1a740 20 client.17469 trim_cache size 0 max 16384 2024-09-11T22:12:36.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578af1a740 1 Processor -- start 2024-09-11T22:12:36.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578af1a740 1 -- start start 2024-09-11T22:12:36.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578af1a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a525d0 0x557d29a53300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578af1a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a5d370 0x557d29a5f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578af1a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a6d0a0 0x557d29a4e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578af1a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f57841ae090 con 0x557d29a525d0 2024-09-11T22:12:36.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578af1a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f57841ab960 con 0x557d29a6d0a0 2024-09-11T22:12:36.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578af1a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57841a97d0 con 0x557d29a5d370 2024-09-11T22:12:36.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a525d0 0x557d29a53300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a525d0 0x557d29a53300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56554/0 (socket says 172.21.15.152:56554) 2024-09-11T22:12:36.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578259c640 1 -- 172.21.15.152:0/702858068 learned_addr learned my addr 172.21.15.152:0/702858068 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:36.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578259c640 1 -- 172.21.15.152:0/702858068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a5d370 msgr2=0x557d29a5f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:36.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578259c640 1 --2- 172.21.15.152:0/702858068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a5d370 0x557d29a5f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578259c640 1 -- 172.21.15.152:0/702858068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a6d0a0 msgr2=0x557d29a4e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:36.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578259c640 1 --2- 172.21.15.152:0/702858068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a6d0a0 0x557d29a4e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578259c640 1 -- 172.21.15.152:0/702858068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d29a58620 con 0x557d29a525d0 2024-09-11T22:12:36.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.269+0000 7f578259c640 1 --2- 172.21.15.152:0/702858068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a525d0 0x557d29a53300 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5774098110 tx=0x7f5774000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb76ec44ab8159a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:36.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f576bfff640 1 -- 172.21.15.152:0/702858068 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57740a0060 con 0x557d29a525d0 2024-09-11T22:12:36.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f576bfff640 1 -- 172.21.15.152:0/702858068 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57740a4920 con 0x557d29a525d0 2024-09-11T22:12:36.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f576bfff640 1 -- 172.21.15.152:0/702858068 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57740cd2f0 con 0x557d29a525d0 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f578af1a740 1 -- 172.21.15.152:0/702858068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a525d0 msgr2=0x557d29a53300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f578af1a740 1 --2- 172.21.15.152:0/702858068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a525d0 0x557d29a53300 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5774098110 tx=0x7f5774000bc0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f578af1a740 1 -- 172.21.15.152:0/702858068 shutdown_connections 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f578af1a740 1 --2- 172.21.15.152:0/702858068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a6d0a0 0x557d29a4e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f578af1a740 1 --2- 172.21.15.152:0/702858068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a5d370 0x557d29a5f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f578af1a740 1 --2- 172.21.15.152:0/702858068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a525d0 0x557d29a53300 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f578af1a740 1 -- 172.21.15.152:0/702858068 >> 172.21.15.152:0/702858068 conn(0x557d29a1b310 msgr2=0x557d29a49a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f578af1a740 1 -- 172.21.15.152:0/702858068 shutdown_connections 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.270+0000 7f578af1a740 1 -- 172.21.15.152:0/702858068 wait complete. 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f578af1a740 1 -- start start 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f578af1a740 1 Processor -- start 2024-09-11T22:12:36.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f578af1a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a525d0 0x557d29a65bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f578af1a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f578af1a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a6d0a0 0x557d29a5ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f578af1a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f57841a9e20 con 0x557d29a5d370 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f578af1a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f57841ab290 con 0x557d29a525d0 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f578af1a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57841aa4f0 con 0x557d29a6d0a0 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f578af1a740 10 client.0 _ll_register_callbacks cb 0x7f577800bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f5781d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f5781d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56558/0 (socket says 172.21.15.152:56558) 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f5781d9b640 1 -- 172.21.15.152:0/2947346913 learned_addr learned my addr 172.21.15.152:0/2947346913 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f5781d9b640 1 -- 172.21.15.152:0/2947346913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a6d0a0 msgr2=0x557d29a5ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f5781d9b640 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a6d0a0 0x557d29a5ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f5781d9b640 1 -- 172.21.15.152:0/2947346913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a525d0 msgr2=0x557d29a65bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:36.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f578259c640 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a525d0 0x557d29a65bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f5781d9b640 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a525d0 0x557d29a65bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f5781d9b640 1 -- 172.21.15.152:0/2947346913 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d29a5f6c0 con 0x557d29a5d370 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.271+0000 7f578259c640 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a525d0 0x557d29a65bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f5781d9b640 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5e8d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f577801fc20 tx=0x7f57780107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ebf603131c66ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f5769ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f5769ffb640 1 -- 172.21.15.152:0/2947346913 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577801f640 con 0x557d29a5d370 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f5769ffb640 1 -- 172.21.15.152:0/2947346913 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f577801f7e0 con 0x557d29a5d370 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f578af1a740 1 -- 172.21.15.152:0/2947346913 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57740a4920 con 0x557d29a5d370 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f5769ffb640 1 -- 172.21.15.152:0/2947346913 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5778010e60 con 0x557d29a5d370 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f578af1a740 10 client.17475 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f578af1a740 1 -- 172.21.15.152:0/2947346913 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557d29ad7ec0 con 0x557d29a5d370 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f5769ffb640 1 -- 172.21.15.152:0/2947346913 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57740a4920 con 0x557d29a5d370 2024-09-11T22:12:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f5769ffb640 1 -- 172.21.15.152:0/2947346913 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f577801d040 con 0x557d29a5d370 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f578af1a740 10 client.17475 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f578af1a740 10 client.17475 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f578af1a740 20 client.17475 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f578af1a740 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x557d29ad85e0 0x557d29adaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f578af1a740 4 client.17475 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.272+0000 7f578af1a740 1 -- 172.21.15.152:0/2947346913 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d299bfd70 con 0x557d29ad85e0 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578259c640 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x557d29ad85e0 0x557d29adaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578259c640 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x557d29ad85e0 0x557d29adaa00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e073143bc4b1ea5 server_cookie=db21d8f8a9d3943e in_seq=0 out_seq=0 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f5769ffb640 10 client.17475 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f5769ffb640 1 -- 172.21.15.152:0/2947346913 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d299bfd70 con 0x557d29ad85e0 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f5769ffb640 10 client.17475 handle_command_reply: tid=0 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578af1a740 1 client.17475 shutdown 2024-09-11T22:12:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578af1a740 1 -- 172.21.15.152:0/2947346913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 msgr2=0x557d29a5e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578af1a740 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5e8d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f577801fc20 tx=0x7f57780107a0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578af1a740 1 -- 172.21.15.152:0/2947346913 shutdown_connections 2024-09-11T22:12:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578af1a740 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x557d29ad85e0 0x557d29adaa00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578af1a740 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d29a6d0a0 0x557d29a5ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578af1a740 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d29a5d370 0x557d29a5e8d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578af1a740 1 --2- 172.21.15.152:0/2947346913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d29a525d0 0x557d29a65bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f5769ffb640 0 client.17475 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:12:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578af1a740 1 -- 172.21.15.152:0/2947346913 >> 172.21.15.152:0/2947346913 conn(0x557d29a1b310 msgr2=0x557d29a4e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578af1a740 1 -- 172.21.15.152:0/2947346913 shutdown_connections 2024-09-11T22:12:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.273+0000 7f578af1a740 1 -- 172.21.15.152:0/2947346913 wait complete. 2024-09-11T22:12:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f578af1a740 20 client.17475 trim_cache size 0 max 16384 2024-09-11T22:12:36.281 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:12:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 -- 172.21.15.152:0/818172308 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f576c0a2cf0 msgr2=0x7f576c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f576c0a2cf0 0x7f576c0a51b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f577c009a60 tx=0x7f577c03e000 comp rx=0 tx=0).stop 2024-09-11T22:12:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 -- 172.21.15.152:0/818172308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5784100a80 msgr2=0x7f5784197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5784100a80 0x7f5784197300 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f577400e9f0 tx=0x7f577400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 -- 172.21.15.152:0/818172308 shutdown_connections 2024-09-11T22:12:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f576c0a2cf0 0x7f576c0a51b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5784106a80 0x7f578419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784101420 0x7f5784197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 --2- 172.21.15.152:0/818172308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5784100a80 0x7f5784197300 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:36.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 -- 172.21.15.152:0/818172308 >> 172.21.15.152:0/818172308 conn(0x7f57840fc7a0 msgr2=0x7f57840fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:36.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 -- 172.21.15.152:0/818172308 shutdown_connections 2024-09-11T22:12:36.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:36.274+0000 7f5788b41640 1 -- 172.21.15.152:0/818172308 wait complete. 2024-09-11T22:12:37.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:37 smithi152 ceph-mon[31188]: pgmap v256: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 893 op/s 2024-09-11T22:12:37.283 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:12:37.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:37 smithi179 ceph-mon[35603]: pgmap v256: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 893 op/s 2024-09-11T22:12:37.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:37 smithi193 ceph-mon[35545]: pgmap v256: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 893 op/s 2024-09-11T22:12:37.535 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:38.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.001+0000 7fb288a8b640 1 -- 172.21.15.152:0/1706188526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb284106f10 msgr2=0x7fb28410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:38.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.001+0000 7fb288a8b640 1 --2- 172.21.15.152:0/1706188526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb284106f10 0x7fb28410ea90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009ca0 tx=0x7fb27c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.001+0000 7fb288a8b640 1 -- 172.21.15.152:0/1706188526 shutdown_connections 2024-09-11T22:12:38.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.001+0000 7fb288a8b640 1 --2- 172.21.15.152:0/1706188526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb284106f10 0x7fb28410ea90 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.001+0000 7fb288a8b640 1 --2- 172.21.15.152:0/1706188526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb284102790 0x7fb2841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.001+0000 7fb288a8b640 1 --2- 172.21.15.152:0/1706188526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb284101de0 0x7fb2841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.001+0000 7fb288a8b640 1 -- 172.21.15.152:0/1706188526 >> 172.21.15.152:0/1706188526 conn(0x7fb2840fd8c0 msgr2=0x7fb2840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:38.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.001+0000 7fb288a8b640 1 -- 172.21.15.152:0/1706188526 shutdown_connections 2024-09-11T22:12:38.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.001+0000 7fb288a8b640 1 -- 172.21.15.152:0/1706188526 wait complete. 2024-09-11T22:12:38.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb288a8b640 1 Processor -- start 2024-09-11T22:12:38.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb288a8b640 1 -- start start 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb288a8b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb284101de0 0x7fb2840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb288a8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb284102790 0x7fb284074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb288a8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb284106f10 0x7fb284074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb288a8b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb284111f70 con 0x7fb284101de0 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb288a8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb284111df0 con 0x7fb284106f10 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb288a8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2841120f0 con 0x7fb284102790 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb28259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb284101de0 0x7fb2840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb28259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb284101de0 0x7fb2840744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56574/0 (socket says 172.21.15.152:56574) 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb28259c640 1 -- 172.21.15.152:0/1244722316 learned_addr learned my addr 172.21.15.152:0/1244722316 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb282d9d640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb284106f10 0x7fb284074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.002+0000 7fb281d9b640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb284102790 0x7fb284074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb28259c640 1 -- 172.21.15.152:0/1244722316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb284102790 msgr2=0x7fb284074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb28259c640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb284102790 0x7fb284074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb28259c640 1 -- 172.21.15.152:0/1244722316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb284106f10 msgr2=0x7fb284074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb28259c640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb284106f10 0x7fb284074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb28259c640 1 -- 172.21.15.152:0/1244722316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2841a68d0 con 0x7fb284101de0 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb282d9d640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb284106f10 0x7fb284074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb28259c640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb284101de0 0x7fb2840744f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb27400c890 tx=0x7fb27400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb2737fe640 1 -- 172.21.15.152:0/1244722316 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274004220 con 0x7fb284101de0 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb288a8b640 1 -- 172.21.15.152:0/1244722316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2841a6bc0 con 0x7fb284101de0 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb2737fe640 1 -- 172.21.15.152:0/1244722316 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2740043c0 con 0x7fb284101de0 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb2737fe640 1 -- 172.21.15.152:0/1244722316 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274004a00 con 0x7fb284101de0 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.003+0000 7fb288a8b640 1 -- 172.21.15.152:0/1244722316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2841a7100 con 0x7fb284101de0 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.005+0000 7fb2737fe640 1 -- 172.21.15.152:0/1244722316 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb2740079b0 con 0x7fb284101de0 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.005+0000 7fb28ae64740 1 Processor -- start 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28ae64740 1 -- start start 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a67fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67fca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a6809760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28ae64740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d9a67622f0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28ae64740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d9a6709cf0 con 0x55d9a67fdb40 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28ae64740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d9a675e2b0 con 0x55d9a6807370 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb2737fe640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb26c0a2cf0 0x7fb26c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67fca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56580/0 (socket says 172.21.15.152:56580) 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28259c640 1 -- 172.21.15.152:0/1734756928 learned_addr learned my addr 172.21.15.152:0/1734756928 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb282d9d640 1 --2- 172.21.15.152:0/1734756928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a67fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb281d9b640 1 --2- 172.21.15.152:0/1734756928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a6809760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb282d9d640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb26c0a2cf0 0x7fb26c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb2737fe640 1 -- 172.21.15.152:0/1244722316 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fb2740cf260 con 0x7fb284101de0 2024-09-11T22:12:38.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28259c640 1 -- 172.21.15.152:0/1734756928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 msgr2=0x55d9a6809760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28259c640 1 --2- 172.21.15.152:0/1734756928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a6809760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28259c640 1 -- 172.21.15.152:0/1734756928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 msgr2=0x55d9a67fc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.006+0000 7fb28259c640 1 --2- 172.21.15.152:0/1734756928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a67fc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.007+0000 7fb28259c640 1 -- 172.21.15.152:0/1734756928 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a66ee3a0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.007+0000 7fb28259c640 1 --2- 172.21.15.152:0/1734756928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67fca10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb2740058c0 tx=0x7fb2740054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d130e1d27e38db server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.007+0000 7fb282d9d640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb26c0a2cf0 0x7fb26c0a51b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009a60 tx=0x7fb27c0095c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.007+0000 7fb270ff9640 1 -- 172.21.15.152:0/1734756928 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27401d070 con 0x55d9a67fc5d0 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.007+0000 7fb270ff9640 1 -- 172.21.15.152:0/1734756928 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb27409b720 con 0x55d9a67fc5d0 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.007+0000 7fb270ff9640 1 -- 172.21.15.152:0/1734756928 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740ccd60 con 0x55d9a67fc5d0 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.008+0000 7fb28ae64740 1 -- 172.21.15.152:0/1734756928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 msgr2=0x55d9a67fca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.008+0000 7fb28ae64740 1 --2- 172.21.15.152:0/1734756928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67fca10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb2740058c0 tx=0x7fb2740054a0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.008+0000 7fb28ae64740 1 -- 172.21.15.152:0/1734756928 shutdown_connections 2024-09-11T22:12:38.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.008+0000 7fb28ae64740 1 --2- 172.21.15.152:0/1734756928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a6809760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.008+0000 7fb28ae64740 1 --2- 172.21.15.152:0/1734756928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67fca10 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.008+0000 7fb28ae64740 1 --2- 172.21.15.152:0/1734756928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a67fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.008+0000 7fb28ae64740 1 -- 172.21.15.152:0/1734756928 >> 172.21.15.152:0/1734756928 conn(0x55d9a67c5310 msgr2=0x55d9a67f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.008+0000 7fb28ae64740 1 -- 172.21.15.152:0/1734756928 shutdown_connections 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.008+0000 7fb28ae64740 1 -- 172.21.15.152:0/1734756928 wait complete. 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.008+0000 7fb28ae64740 1 -- start start 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.008+0000 7fb28ae64740 1 Processor -- start 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a6806d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a6804000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a68045d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28ae64740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d9a680a070 con 0x55d9a67fc5d0 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28ae64740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d9a671d060 con 0x55d9a67fdb40 2024-09-11T22:12:38.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28ae64740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d9a680a1f0 con 0x55d9a6807370 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28ae64740 10 client.0 _ll_register_callbacks cb 0x55d9a64708c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a6806d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a6806d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56588/0 (socket says 172.21.15.152:56588) 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28259c640 1 -- 172.21.15.152:0/634397 learned_addr learned my addr 172.21.15.152:0/634397 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb282d9d640 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a68045d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb281d9b640 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a6804000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28259c640 1 -- 172.21.15.152:0/634397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 msgr2=0x55d9a68045d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28259c640 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a68045d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28259c640 1 -- 172.21.15.152:0/634397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 msgr2=0x55d9a6804000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28259c640 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a6804000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28259c640 1 -- 172.21.15.152:0/634397 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9a64d33c0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb282d9d640 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a68045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:38.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28259c640 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a6806d50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb27409b6b0 tx=0x7fb274097a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e10f5c95ed89e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb269ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb269ffb640 1 -- 172.21.15.152:0/634397 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740b4060 con 0x55d9a67fc5d0 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb269ffb640 1 -- 172.21.15.152:0/634397 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fb27407a0d0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28ae64740 1 -- 172.21.15.152:0/634397 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb27409b720 con 0x55d9a67fc5d0 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb269ffb640 1 -- 172.21.15.152:0/634397 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb27401d070 con 0x55d9a67fc5d0 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28ae64740 10 client.17487 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.009+0000 7fb28ae64740 1 -- 172.21.15.152:0/634397 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d9a6815af0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.010+0000 7fb269ffb640 1 -- 172.21.15.152:0/634397 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb27409b720 con 0x55d9a67fc5d0 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.010+0000 7fb269ffb640 1 -- 172.21.15.152:0/634397 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb274097470 con 0x55d9a67fc5d0 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.010+0000 7fb28ae64740 10 client.17487 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.010+0000 7fb28ae64740 10 client.17487 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:38.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.010+0000 7fb28ae64740 20 client.17487 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.010+0000 7fb28ae64740 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d9a6816e40 0x55d9a6819230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.010+0000 7fb28ae64740 4 client.17487 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.010+0000 7fb28ae64740 1 -- 172.21.15.152:0/634397 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9a676f860 con 0x55d9a6816e40 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.010+0000 7fb281d9b640 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d9a6816e40 0x55d9a6819230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.011+0000 7fb269ffb640 10 client.17487 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.011+0000 7fb281d9b640 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d9a6816e40 0x55d9a6819230 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d47be61b529400e5 server_cookie=5c602529e6d0a17e in_seq=0 out_seq=0 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.011+0000 7fb269ffb640 1 -- 172.21.15.152:0/634397 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d9a676f860 con 0x55d9a6816e40 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.011+0000 7fb269ffb640 10 client.17487 handle_command_reply: tid=0 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.011+0000 7fb28ae64740 1 client.17487 shutdown 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb28ae64740 1 -- 172.21.15.152:0/634397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 msgr2=0x55d9a6806d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb28ae64740 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a6806d50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb27409b6b0 tx=0x7fb274097a90 comp rx=0 tx=0).stop 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb28ae64740 1 -- 172.21.15.152:0/634397 shutdown_connections 2024-09-11T22:12:38.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb28ae64740 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d9a6816e40 0x55d9a6819230 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb28ae64740 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a68045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb28ae64740 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a6804000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb269ffb640 0 client.17487 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb28ae64740 1 --2- 172.21.15.152:0/634397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a6806d50 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb28ae64740 1 -- 172.21.15.152:0/634397 >> 172.21.15.152:0/634397 conn(0x55d9a67c5310 msgr2=0x55d9a67fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb28ae64740 1 -- 172.21.15.152:0/634397 shutdown_connections 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb28ae64740 1 -- 172.21.15.152:0/634397 wait complete. 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.012+0000 7fb28ae64740 20 client.17487 trim_cache size 0 max 16384 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.024+0000 7fb28ae64740 1 Processor -- start 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.024+0000 7fb28ae64740 1 -- start start 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a68012c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a6801800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28ae64740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb2841b2550 con 0x55d9a67fc5d0 2024-09-11T22:12:38.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28ae64740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb2841afe20 con 0x55d9a67fdb40 2024-09-11T22:12:38.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28ae64740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2841adc90 con 0x55d9a6807370 2024-09-11T22:12:38.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.148 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:12:38.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67f7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56604/0 (socket says 172.21.15.152:56604) 2024-09-11T22:12:38.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28259c640 1 -- 172.21.15.152:0/2134554171 learned_addr learned my addr 172.21.15.152:0/2134554171 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb282d9d640 1 --2- 172.21.15.152:0/2134554171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a6801800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28259c640 1 -- 172.21.15.152:0/2134554171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 msgr2=0x55d9a6801800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb281d9b640 1 --2- 172.21.15.152:0/2134554171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a68012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28259c640 1 --2- 172.21.15.152:0/2134554171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a6801800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28259c640 1 -- 172.21.15.152:0/2134554171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 msgr2=0x55d9a68012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28259c640 1 --2- 172.21.15.152:0/2134554171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a68012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28259c640 1 -- 172.21.15.152:0/2134554171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a68070c0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb282d9d640 1 --2- 172.21.15.152:0/2134554171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a6801800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb28259c640 1 --2- 172.21.15.152:0/2134554171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67f7bf0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb274097b80 tx=0x7fb274099c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f021f24fc8d2c394 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb26bfff640 1 -- 172.21.15.152:0/2134554171 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740b4040 con 0x55d9a67fc5d0 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb26bfff640 1 -- 172.21.15.152:0/2134554171 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2740ccbd0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.025+0000 7fb26bfff640 1 -- 172.21.15.152:0/2134554171 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27407a0b0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 -- 172.21.15.152:0/2134554171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 msgr2=0x55d9a67f7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 --2- 172.21.15.152:0/2134554171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67f7bf0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb274097b80 tx=0x7fb274099c30 comp rx=0 tx=0).stop 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 -- 172.21.15.152:0/2134554171 shutdown_connections 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 --2- 172.21.15.152:0/2134554171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a6807370 0x55d9a6801800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 --2- 172.21.15.152:0/2134554171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a67fdb40 0x55d9a68012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 --2- 172.21.15.152:0/2134554171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a67f7bf0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 -- 172.21.15.152:0/2134554171 >> 172.21.15.152:0/2134554171 conn(0x55d9a67c5310 msgr2=0x55d9a67f74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 -- 172.21.15.152:0/2134554171 shutdown_connections 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 -- 172.21.15.152:0/2134554171 wait complete. 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 -- start start 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 Processor -- start 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.026+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a681a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a67fdb40 0x55d9a681a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28ae64740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a6807370 0x55d9a681ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28ae64740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb2841ae2e0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28ae64740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb2841af750 con 0x55d9a6807370 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28ae64740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2841ae9b0 con 0x55d9a67fdb40 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28ae64740 10 client.0 _ll_register_callbacks cb 0x7fb27c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a681a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a681a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56608/0 (socket says 172.21.15.152:56608) 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28259c640 1 -- 172.21.15.152:0/130829846 learned_addr learned my addr 172.21.15.152:0/130829846 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb282d9d640 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a6807370 0x55d9a681ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb281d9b640 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a67fdb40 0x55d9a681a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28259c640 1 -- 172.21.15.152:0/130829846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a67fdb40 msgr2=0x55d9a681a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28259c640 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a67fdb40 0x55d9a681a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28259c640 1 -- 172.21.15.152:0/130829846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a6807370 msgr2=0x55d9a681ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:38.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28259c640 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a6807370 0x55d9a681ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28259c640 1 -- 172.21.15.152:0/130829846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9a6880a70 con 0x55d9a67fc5d0 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb281d9b640 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a67fdb40 0x55d9a681a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28259c640 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a681a2e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb2740999d0 tx=0x7fb27409fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f776ad3f4312846 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb269ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb269ffb640 1 -- 172.21.15.152:0/130829846 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274097670 con 0x55d9a67fc5d0 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb269ffb640 1 -- 172.21.15.152:0/130829846 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fb27409a5e0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28ae64740 1 -- 172.21.15.152:0/130829846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2740ccbd0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb269ffb640 1 -- 172.21.15.152:0/130829846 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb27407a2c0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28ae64740 10 client.17493 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.027+0000 7fb28ae64740 1 -- 172.21.15.152:0/130829846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d9a6880a70 con 0x55d9a67fc5d0 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.028+0000 7fb269ffb640 1 -- 172.21.15.152:0/130829846 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2740ccbd0 con 0x55d9a67fc5d0 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.028+0000 7fb269ffb640 1 -- 172.21.15.152:0/130829846 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb27409ca50 con 0x55d9a67fc5d0 2024-09-11T22:12:38.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.028+0000 7fb28ae64740 10 client.17493 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.028+0000 7fb28ae64740 10 client.17493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.028+0000 7fb28ae64740 20 client.17493 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.028+0000 7fb28ae64740 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d9a6881f30 0x55d9a6884320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.028+0000 7fb28ae64740 4 client.17493 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.028+0000 7fb28ae64740 1 -- 172.21.15.152:0/130829846 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9a6769d70 con 0x55d9a6881f30 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.028+0000 7fb281d9b640 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d9a6881f30 0x55d9a6884320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.028+0000 7fb281d9b640 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d9a6881f30 0x55d9a6884320 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad6d3c328763fd2e server_cookie=beb9bc5aad15d422 in_seq=0 out_seq=0 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.028+0000 7fb269ffb640 10 client.17493 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb269ffb640 1 -- 172.21.15.152:0/130829846 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9a6769d70 con 0x55d9a6881f30 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb269ffb640 10 client.17493 handle_command_reply: tid=0 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 1 client.17493 shutdown 2024-09-11T22:12:38.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 1 -- 172.21.15.152:0/130829846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 msgr2=0x55d9a681a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a681a2e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb2740999d0 tx=0x7fb27409fb90 comp rx=0 tx=0).stop 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 1 -- 172.21.15.152:0/130829846 shutdown_connections 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d9a6881f30 0x55d9a6884320 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d9a6807370 0x55d9a681ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d9a67fdb40 0x55d9a681a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 1 --2- 172.21.15.152:0/130829846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9a67fc5d0 0x55d9a681a2e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb269ffb640 0 client.17493 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 1 -- 172.21.15.152:0/130829846 >> 172.21.15.152:0/130829846 conn(0x55d9a67c5310 msgr2=0x55d9a67fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 1 -- 172.21.15.152:0/130829846 shutdown_connections 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 1 -- 172.21.15.152:0/130829846 wait complete. 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb28ae64740 20 client.17493 trim_cache size 0 max 16384 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 -- 172.21.15.152:0/1244722316 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb26c0a2cf0 msgr2=0x7fb26c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb26c0a2cf0 0x7fb26c0a51b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009a60 tx=0x7fb27c0095c0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 -- 172.21.15.152:0/1244722316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb284101de0 msgr2=0x7fb2840744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:38.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb284101de0 0x7fb2840744f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb27400c890 tx=0x7fb27400cd50 comp rx=0 tx=0).stop 2024-09-11T22:12:38.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 -- 172.21.15.152:0/1244722316 shutdown_connections 2024-09-11T22:12:38.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb26c0a2cf0 0x7fb26c0a51b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb284106f10 0x7fb284074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb284102790 0x7fb284074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 --2- 172.21.15.152:0/1244722316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb284101de0 0x7fb2840744f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:38.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 -- 172.21.15.152:0/1244722316 >> 172.21.15.152:0/1244722316 conn(0x7fb2840fd8c0 msgr2=0x7fb2840feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:38.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 -- 172.21.15.152:0/1244722316 shutdown_connections 2024-09-11T22:12:38.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:38.029+0000 7fb288a8b640 1 -- 172.21.15.152:0/1244722316 wait complete. 2024-09-11T22:12:39.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:39 smithi152 ceph-mon[31188]: pgmap v257: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 893 op/s 2024-09-11T22:12:39.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:39 smithi179 ceph-mon[35603]: pgmap v257: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 893 op/s 2024-09-11T22:12:39.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:39 smithi193 ceph-mon[35545]: pgmap v257: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 893 op/s 2024-09-11T22:12:39.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:12:39.904 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:12:39.904 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:12:40.156 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:40.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.613+0000 7fc76f6fa640 1 -- 172.21.15.152:0/609174687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc768100a80 msgr2=0x7fc768100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:40.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.613+0000 7fc76f6fa640 1 --2- 172.21.15.152:0/609174687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc768100a80 0x7fc768100ee0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009930 tx=0x7fc75c02a420 comp rx=0 tx=0).stop 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.613+0000 7fc76f6fa640 1 -- 172.21.15.152:0/609174687 shutdown_connections 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.613+0000 7fc76f6fa640 1 --2- 172.21.15.152:0/609174687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc768101420 0x7fc76810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.613+0000 7fc76f6fa640 1 --2- 172.21.15.152:0/609174687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc768100a80 0x7fc768100ee0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.613+0000 7fc76f6fa640 1 --2- 172.21.15.152:0/609174687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc768106a80 0x7fc768106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.613+0000 7fc76f6fa640 1 -- 172.21.15.152:0/609174687 >> 172.21.15.152:0/609174687 conn(0x7fc7680fc7a0 msgr2=0x7fc7680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.613+0000 7fc76f6fa640 1 -- 172.21.15.152:0/609174687 shutdown_connections 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.613+0000 7fc76f6fa640 1 -- 172.21.15.152:0/609174687 wait complete. 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.613+0000 7fc76f6fa640 1 Processor -- start 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.613+0000 7fc76f6fa640 1 -- start start 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76f6fa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc768100a80 0x7fc7681984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76f6fa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc768101420 0x7fc768198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76f6fa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc768106a80 0x7fc76819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76f6fa640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc768110ea0 con 0x7fc768101420 2024-09-11T22:12:40.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76f6fa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc768110d20 con 0x7fc768100a80 2024-09-11T22:12:40.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76f6fa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc768111020 con 0x7fc768106a80 2024-09-11T22:12:40.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76cc95640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc768101420 0x7fc768198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76cc95640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc768101420 0x7fc768198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56622/0 (socket says 172.21.15.152:56622) 2024-09-11T22:12:40.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76cc95640 1 -- 172.21.15.152:0/3958339837 learned_addr learned my addr 172.21.15.152:0/3958339837 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:40.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76d496640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc768100a80 0x7fc7681984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76dc97640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc768106a80 0x7fc76819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76cc95640 1 -- 172.21.15.152:0/3958339837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc768106a80 msgr2=0x7fc76819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:40.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76cc95640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc768106a80 0x7fc76819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76cc95640 1 -- 172.21.15.152:0/3958339837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc768100a80 msgr2=0x7fc7681984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76cc95640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc768100a80 0x7fc7681984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76cc95640 1 -- 172.21.15.152:0/3958339837 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76819d480 con 0x7fc768101420 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76cc95640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc768101420 0x7fc768198a10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009230 tx=0x7fc75c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc7667fc640 1 -- 172.21.15.152:0/3958339837 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c03f030 con 0x7fc768101420 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc7667fc640 1 -- 172.21.15.152:0/3958339837 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc75c003ad0 con 0x7fc768101420 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76f6fa640 1 -- 172.21.15.152:0/3958339837 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76819d710 con 0x7fc768101420 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc7667fc640 1 -- 172.21.15.152:0/3958339837 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c035070 con 0x7fc768101420 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.614+0000 7fc76f6fa640 1 -- 172.21.15.152:0/3958339837 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7681a5050 con 0x7fc768101420 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.616+0000 7fc7667fc640 1 -- 172.21.15.152:0/3958339837 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fc75c042030 con 0x7fc768101420 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.617+0000 7fc771ad3740 1 Processor -- start 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.617+0000 7fc771ad3740 1 -- start start 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.617+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb3a40 0x55594eeb3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.617+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb4360 0x55594eec2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.617+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eec5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.617+0000 7fc771ad3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55594ee19280 con 0x55594eeb4360 2024-09-11T22:12:40.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.617+0000 7fc771ad3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55594edc0b10 con 0x55594eec3150 2024-09-11T22:12:40.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.617+0000 7fc771ad3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55594ee15240 con 0x55594eeb3a40 2024-09-11T22:12:40.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc7667fc640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7500a2cf0 0x7fc7500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76d496640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb4360 0x55594eec2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76d496640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb4360 0x55594eec2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56628/0 (socket says 172.21.15.152:56628) 2024-09-11T22:12:40.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76d496640 1 -- 172.21.15.152:0/1175833354 learned_addr learned my addr 172.21.15.152:0/1175833354 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:40.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76dc97640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7500a2cf0 0x7fc7500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76cc95640 1 --2- 172.21.15.152:0/1175833354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eec5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76dc97640 1 --2- 172.21.15.152:0/1175833354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb3a40 0x55594eeb3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76d496640 1 -- 172.21.15.152:0/1175833354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb3a40 msgr2=0x55594eeb3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76d496640 1 --2- 172.21.15.152:0/1175833354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb3a40 0x55594eeb3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc7667fc640 1 -- 172.21.15.152:0/3958339837 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fc75c0efa00 con 0x7fc768101420 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76d496640 1 -- 172.21.15.152:0/1175833354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 msgr2=0x55594eec5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76d496640 1 --2- 172.21.15.152:0/1175833354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eec5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76d496640 1 -- 172.21.15.152:0/1175833354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55594edcd1f0 con 0x55594eeb4360 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76d496640 1 --2- 172.21.15.152:0/1175833354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb4360 0x55594eec2c10 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc7580039f0 tx=0x7fc758003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a97075a386d35a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc76dc97640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7500a2cf0 0x7fc7500a51b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc76000af30 tx=0x7fc760006f10 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc74f7fe640 1 -- 172.21.15.152:0/1175833354 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758004b20 con 0x55594eeb4360 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc74f7fe640 1 -- 172.21.15.152:0/1175833354 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc758004cc0 con 0x55594eeb4360 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.618+0000 7fc74f7fe640 1 -- 172.21.15.152:0/1175833354 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758012740 con 0x55594eeb4360 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.619+0000 7fc771ad3740 1 -- 172.21.15.152:0/1175833354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb4360 msgr2=0x55594eec2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:40.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.619+0000 7fc771ad3740 1 --2- 172.21.15.152:0/1175833354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb4360 0x55594eec2c10 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc7580039f0 tx=0x7fc758003eb0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.619+0000 7fc771ad3740 1 -- 172.21.15.152:0/1175833354 shutdown_connections 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.619+0000 7fc771ad3740 1 --2- 172.21.15.152:0/1175833354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eec5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.619+0000 7fc771ad3740 1 --2- 172.21.15.152:0/1175833354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb4360 0x55594eec2c10 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.619+0000 7fc771ad3740 1 --2- 172.21.15.152:0/1175833354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb3a40 0x55594eeb3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.619+0000 7fc771ad3740 1 -- 172.21.15.152:0/1175833354 >> 172.21.15.152:0/1175833354 conn(0x55594eeb00f0 msgr2=0x55594eeb04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.619+0000 7fc771ad3740 1 -- 172.21.15.152:0/1175833354 shutdown_connections 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.619+0000 7fc771ad3740 1 -- 172.21.15.152:0/1175833354 wait complete. 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.619+0000 7fc771ad3740 1 -- start start 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.619+0000 7fc771ad3740 1 Processor -- start 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eeb3a40 0x55594eec0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eec0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eec3150 0x55594eec0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc771ad3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55594eec5d20 con 0x55594eec3150 2024-09-11T22:12:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc771ad3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55594edd3f10 con 0x55594eeb3a40 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc771ad3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55594eec5ea0 con 0x55594eeb4360 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc771ad3740 10 client.0 _ll_register_callbacks cb 0x55594ed9ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76dc97640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eec3150 0x55594eec0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76dc97640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eec3150 0x55594eec0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56640/0 (socket says 172.21.15.152:56640) 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76dc97640 1 -- 172.21.15.152:0/730129068 learned_addr learned my addr 172.21.15.152:0/730129068 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76cc95640 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eec0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76d496640 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eeb3a40 0x55594eec0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76dc97640 1 -- 172.21.15.152:0/730129068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 msgr2=0x55594eec0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76dc97640 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eec0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76dc97640 1 -- 172.21.15.152:0/730129068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eeb3a40 msgr2=0x55594eec0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76dc97640 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eeb3a40 0x55594eec0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76dc97640 1 -- 172.21.15.152:0/730129068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55594eb8a6a0 con 0x55594eec3150 2024-09-11T22:12:40.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76cc95640 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eec0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc76dc97640 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eec3150 0x55594eec0ab0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc760018b30 tx=0x7fc7600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ee03948ea5704d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.620+0000 7fc74cff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc74cff9640 1 -- 172.21.15.152:0/730129068 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760026060 con 0x55594eec3150 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc74cff9640 1 -- 172.21.15.152:0/730129068 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fc76000f040 con 0x55594eec3150 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc771ad3740 1 -- 172.21.15.152:0/730129068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc758004cc0 con 0x55594eec3150 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc74cff9640 1 -- 172.21.15.152:0/730129068 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc7600180d0 con 0x55594eec3150 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc771ad3740 10 client.17505 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc771ad3740 1 -- 172.21.15.152:0/730129068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55594eed1a10 con 0x55594eec3150 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc74cff9640 1 -- 172.21.15.152:0/730129068 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc758004cc0 con 0x55594eec3150 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc74cff9640 1 -- 172.21.15.152:0/730129068 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fc760012050 con 0x55594eec3150 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc771ad3740 10 client.17505 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc771ad3740 10 client.17505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc771ad3740 20 client.17505 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc771ad3740 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55594eed2ed0 0x55594eed5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc771ad3740 4 client.17505 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc771ad3740 1 -- 172.21.15.152:0/730129068 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55594ee267f0 con 0x55594eed2ed0 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.621+0000 7fc76d496640 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55594eed2ed0 0x55594eed5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.622+0000 7fc76d496640 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55594eed2ed0 0x55594eed5340 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e313e8cbd3e52862 server_cookie=8e067ce2dfca9fd8 in_seq=0 out_seq=0 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.622+0000 7fc74cff9640 10 client.17505 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.622+0000 7fc74cff9640 1 -- 172.21.15.152:0/730129068 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55594ee267f0 con 0x55594eed2ed0 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.622+0000 7fc74cff9640 10 client.17505 handle_command_reply: tid=0 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 1 client.17505 shutdown 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 1 -- 172.21.15.152:0/730129068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eec3150 msgr2=0x55594eec0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eec3150 0x55594eec0ab0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc760018b30 tx=0x7fc7600046c0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 1 -- 172.21.15.152:0/730129068 shutdown_connections 2024-09-11T22:12:40.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55594eed2ed0 0x55594eed5340 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eec3150 0x55594eec0ab0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eec0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc74cff9640 0 client.17505 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:40.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 1 --2- 172.21.15.152:0/730129068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eeb3a40 0x55594eec0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 1 -- 172.21.15.152:0/730129068 >> 172.21.15.152:0/730129068 conn(0x55594eeb00f0 msgr2=0x55594eeb5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:40.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 1 -- 172.21.15.152:0/730129068 shutdown_connections 2024-09-11T22:12:40.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 1 -- 172.21.15.152:0/730129068 wait complete. 2024-09-11T22:12:40.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.623+0000 7fc771ad3740 20 client.17505 trim_cache size 0 max 16384 2024-09-11T22:12:40.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc771ad3740 1 Processor -- start 2024-09-11T22:12:40.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc771ad3740 1 -- start start 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eedac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eedb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc771ad3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681ae0a0 con 0x55594eeb3a40 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc771ad3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681ab970 con 0x55594eec3150 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc771ad3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681a97e0 con 0x55594eeb4360 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc76d496640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc76d496640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56654/0 (socket says 172.21.15.152:56654) 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc76d496640 1 -- 172.21.15.152:0/710049581 learned_addr learned my addr 172.21.15.152:0/710049581 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc76cc95640 1 --2- 172.21.15.152:0/710049581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eedac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc76dc97640 1 --2- 172.21.15.152:0/710049581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eedb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc76d496640 1 -- 172.21.15.152:0/710049581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 msgr2=0x55594eedac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc76d496640 1 --2- 172.21.15.152:0/710049581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eedac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc76d496640 1 -- 172.21.15.152:0/710049581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 msgr2=0x55594eedb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc76d496640 1 --2- 172.21.15.152:0/710049581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eedb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.640+0000 7fc76d496640 1 -- 172.21.15.152:0/710049581 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55594eed56b0 con 0x55594eeb3a40 2024-09-11T22:12:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.641+0000 7fc76d496640 1 --2- 172.21.15.152:0/710049581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec1e90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x55594eeb6750 tx=0x7fc758009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6e6142c7aecdd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.641+0000 7fc74effd640 1 -- 172.21.15.152:0/710049581 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758028440 con 0x55594eeb3a40 2024-09-11T22:12:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.641+0000 7fc74effd640 1 -- 172.21.15.152:0/710049581 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc758028ac0 con 0x55594eeb3a40 2024-09-11T22:12:40.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.641+0000 7fc74effd640 1 -- 172.21.15.152:0/710049581 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758026db0 con 0x55594eeb3a40 2024-09-11T22:12:40.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.641+0000 7fc771ad3740 1 -- 172.21.15.152:0/710049581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 msgr2=0x55594eec1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:40.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.641+0000 7fc771ad3740 1 --2- 172.21.15.152:0/710049581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec1e90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x55594eeb6750 tx=0x7fc758009680 comp rx=0 tx=0).stop 2024-09-11T22:12:40.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.641+0000 7fc771ad3740 1 -- 172.21.15.152:0/710049581 shutdown_connections 2024-09-11T22:12:40.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.641+0000 7fc771ad3740 1 --2- 172.21.15.152:0/710049581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eedb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.641+0000 7fc771ad3740 1 --2- 172.21.15.152:0/710049581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eedac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.641+0000 7fc771ad3740 1 --2- 172.21.15.152:0/710049581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec1e90 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.641+0000 7fc771ad3740 1 -- 172.21.15.152:0/710049581 >> 172.21.15.152:0/710049581 conn(0x55594eeb00f0 msgr2=0x55594eec1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:40.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc771ad3740 1 -- 172.21.15.152:0/710049581 shutdown_connections 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc771ad3740 1 -- 172.21.15.152:0/710049581 wait complete. 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc771ad3740 1 -- start start 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc771ad3740 1 Processor -- start 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eec7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc771ad3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eec7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc771ad3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681a9e30 con 0x55594eeb3a40 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc771ad3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681ab2a0 con 0x55594eec3150 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc771ad3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681aa500 con 0x55594eeb4360 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc771ad3740 10 client.0 _ll_register_callbacks cb 0x7fc76000aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc76d496640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc76d496640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56670/0 (socket says 172.21.15.152:56670) 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.642+0000 7fc76d496640 1 -- 172.21.15.152:0/1651552784 learned_addr learned my addr 172.21.15.152:0/1651552784 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc76cc95640 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eec7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc76dc97640 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eec7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc76d496640 1 -- 172.21.15.152:0/1651552784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 msgr2=0x55594eec7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc76d496640 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eec7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc76d496640 1 -- 172.21.15.152:0/1651552784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 msgr2=0x55594eec7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc76d496640 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eec7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc76d496640 1 -- 172.21.15.152:0/1651552784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55594ef3cd80 con 0x55594eeb3a40 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc76dc97640 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eec7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc76d496640 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec7020 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc7580045f0 tx=0x7fc758009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5bf3c22a516de7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc74cff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc74cff9640 1 -- 172.21.15.152:0/1651552784 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758004900 con 0x55594eeb3a40 2024-09-11T22:12:40.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc74cff9640 1 -- 172.21.15.152:0/1651552784 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fc758026a30 con 0x55594eeb3a40 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc771ad3740 1 -- 172.21.15.152:0/1651552784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc758028ac0 con 0x55594eeb3a40 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc74cff9640 1 -- 172.21.15.152:0/1651552784 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc758042050 con 0x55594eeb3a40 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc771ad3740 10 client.17511 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.643+0000 7fc771ad3740 1 -- 172.21.15.152:0/1651552784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55594ef3e0a0 con 0x55594eeb3a40 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.644+0000 7fc74cff9640 1 -- 172.21.15.152:0/1651552784 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc758028ac0 con 0x55594eeb3a40 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.644+0000 7fc74cff9640 1 -- 172.21.15.152:0/1651552784 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fc75802e020 con 0x55594eeb3a40 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.644+0000 7fc771ad3740 10 client.17511 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.644+0000 7fc771ad3740 10 client.17511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.644+0000 7fc771ad3740 20 client.17511 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.644+0000 7fc771ad3740 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55594ef3e5b0 0x55594ef409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.644+0000 7fc771ad3740 4 client.17511 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.644+0000 7fc771ad3740 1 -- 172.21.15.152:0/1651552784 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55594ee20d00 con 0x55594ef3e5b0 2024-09-11T22:12:40.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.644+0000 7fc76cc95640 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55594ef3e5b0 0x55594ef409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.644+0000 7fc76cc95640 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55594ef3e5b0 0x55594ef409a0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cea1e4c692ea965 server_cookie=6380e81d3a0b9db1 in_seq=0 out_seq=0 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.644+0000 7fc74cff9640 10 client.17511 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc74cff9640 1 -- 172.21.15.152:0/1651552784 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55594ee20d00 con 0x55594ef3e5b0 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc74cff9640 10 client.17511 handle_command_reply: tid=0 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 1 client.17511 shutdown 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 1 -- 172.21.15.152:0/1651552784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 msgr2=0x55594eec7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec7020 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc7580045f0 tx=0x7fc758009400 comp rx=0 tx=0).stop 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 1 -- 172.21.15.152:0/1651552784 shutdown_connections 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55594ef3e5b0 0x55594ef409a0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55594eec3150 0x55594eec7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55594eeb4360 0x55594eec7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 1 --2- 172.21.15.152:0/1651552784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55594eeb3a40 0x55594eec7020 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc74cff9640 0 client.17511 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:40.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 1 -- 172.21.15.152:0/1651552784 >> 172.21.15.152:0/1651552784 conn(0x55594eeb00f0 msgr2=0x55594eeb5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:40.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 1 -- 172.21.15.152:0/1651552784 shutdown_connections 2024-09-11T22:12:40.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 1 -- 172.21.15.152:0/1651552784 wait complete. 2024-09-11T22:12:40.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.646+0000 7fc771ad3740 20 client.17511 trim_cache size 0 max 16384 2024-09-11T22:12:40.652 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:12:40.652 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:12:40.652 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "0f969d5a-4e44-4c66-846c-b5624af783e6", 2024-09-11T22:12:40.652 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:12:40.653 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:12:40.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 -- 172.21.15.152:0/3958339837 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7500a2cf0 msgr2=0x7fc7500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:40.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7500a2cf0 0x7fc7500a51b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc76000af30 tx=0x7fc760006f10 comp rx=0 tx=0).stop 2024-09-11T22:12:40.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 -- 172.21.15.152:0/3958339837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc768101420 msgr2=0x7fc768198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:40.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc768101420 0x7fc768198a10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009230 tx=0x7fc75c004270 comp rx=0 tx=0).stop 2024-09-11T22:12:40.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 -- 172.21.15.152:0/3958339837 shutdown_connections 2024-09-11T22:12:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc7500a2cf0 0x7fc7500a51b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc768106a80 0x7fc76819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc768101420 0x7fc768198a10 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 --2- 172.21.15.152:0/3958339837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc768100a80 0x7fc7681984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 -- 172.21.15.152:0/3958339837 >> 172.21.15.152:0/3958339837 conn(0x7fc7680fc7a0 msgr2=0x7fc76806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 -- 172.21.15.152:0/3958339837 shutdown_connections 2024-09-11T22:12:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:40.647+0000 7fc76f6fa640 1 -- 172.21.15.152:0/3958339837 wait complete. 2024-09-11T22:12:41.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:41 smithi179 ceph-mon[35603]: pgmap v258: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 10 MiB/s wr, 965 op/s 2024-09-11T22:12:41.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:41 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:12:41.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:41 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:12:41.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:41 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:12:41.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:41 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:12:41.311 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:41 smithi152 ceph-mon[31188]: pgmap v258: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 10 MiB/s wr, 965 op/s 2024-09-11T22:12:41.311 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:41 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:12:41.311 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:41 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:12:41.311 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:41 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:12:41.312 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:41 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:12:41.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:41 smithi193 ceph-mon[35545]: pgmap v258: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 10 MiB/s wr, 965 op/s 2024-09-11T22:12:41.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:41 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:12:41.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:41 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:12:41.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:41 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:12:41.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:41 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:12:41.367 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:12:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:42.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.070+0000 7f8bbb160640 1 -- 172.21.15.152:0/2069870854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb4101420 msgr2=0x7f8bb410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:42.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.070+0000 7f8bbb160640 1 --2- 172.21.15.152:0/2069870854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb4101420 0x7f8bb410d950 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009cd0 tx=0x7f8bac02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.070+0000 7f8bbb160640 1 -- 172.21.15.152:0/2069870854 shutdown_connections 2024-09-11T22:12:42.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.070+0000 7f8bbb160640 1 --2- 172.21.15.152:0/2069870854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb4101420 0x7f8bb410d950 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.070+0000 7f8bbb160640 1 --2- 172.21.15.152:0/2069870854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bb4100a80 0x7f8bb4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.070+0000 7f8bbb160640 1 --2- 172.21.15.152:0/2069870854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bb4106a80 0x7f8bb4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.070+0000 7f8bbb160640 1 -- 172.21.15.152:0/2069870854 >> 172.21.15.152:0/2069870854 conn(0x7f8bb40fc7a0 msgr2=0x7f8bb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:42.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.070+0000 7f8bbb160640 1 -- 172.21.15.152:0/2069870854 shutdown_connections 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.070+0000 7f8bbb160640 1 -- 172.21.15.152:0/2069870854 wait complete. 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bbb160640 1 Processor -- start 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bbb160640 1 -- start start 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bbb160640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bb4100a80 0x7f8bb4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bbb160640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bb4101420 0x7f8bb41997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bbb160640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb4106a80 0x7f8bb41a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bbb160640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb4110e80 con 0x7f8bb4106a80 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bbb160640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb4110d00 con 0x7f8bb4100a80 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bbb160640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb4111000 con 0x7f8bb4101420 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bb96fd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb4106a80 0x7f8bb41a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bb96fd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb4106a80 0x7f8bb41a4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56682/0 (socket says 172.21.15.152:56682) 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bb96fd640 1 -- 172.21.15.152:0/2206685342 learned_addr learned my addr 172.21.15.152:0/2206685342 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:42.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bb4101420 0x7f8bb41997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.071+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bb4100a80 0x7f8bb4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bb96fd640 1 -- 172.21.15.152:0/2206685342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bb4101420 msgr2=0x7f8bb41997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bb96fd640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bb4101420 0x7f8bb41997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bb96fd640 1 -- 172.21.15.152:0/2206685342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bb4100a80 msgr2=0x7f8bb4199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bb96fd640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bb4100a80 0x7f8bb4199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bb96fd640 1 -- 172.21.15.152:0/2206685342 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb41a4840 con 0x7f8bb4106a80 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bb4100a80 0x7f8bb4199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bb96fd640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb4106a80 0x7f8bb41a4300 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8bac005cc0 tx=0x7f8bac032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bb1ffb640 1 -- 172.21.15.152:0/2206685342 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac004040 con 0x7f8bb4106a80 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bbb160640 1 -- 172.21.15.152:0/2206685342 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb41a4a10 con 0x7f8bb4106a80 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bb1ffb640 1 -- 172.21.15.152:0/2206685342 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bac0046c0 con 0x7f8bb4106a80 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bb1ffb640 1 -- 172.21.15.152:0/2206685342 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac030e00 con 0x7f8bb4106a80 2024-09-11T22:12:42.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.072+0000 7f8bbb160640 1 -- 172.21.15.152:0/2206685342 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb41a4ec0 con 0x7f8bb4106a80 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.074+0000 7f8bb1ffb640 1 -- 172.21.15.152:0/2206685342 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8bac0305a0 con 0x7f8bb4106a80 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bbd539740 1 Processor -- start 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bbd539740 1 -- start start 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def218360 0x555def218740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218c80 0x555def227550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def227a90 0x555def229e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bbd539740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555def17e2e0 con 0x555def218c80 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bbd539740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555def125ce0 con 0x555def218360 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bbd539740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555def17a2a0 con 0x555def227a90 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb1ffb640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ba40a2cf0 0x7f8ba40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb8efc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218c80 0x555def227550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb8efc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218c80 0x555def227550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56698/0 (socket says 172.21.15.152:56698) 2024-09-11T22:12:42.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb8efc640 1 -- 172.21.15.152:0/496608717 learned_addr learned my addr 172.21.15.152:0/496608717 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb96fd640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ba40a2cf0 0x7f8ba40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/496608717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def218360 0x555def218740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb1ffb640 1 -- 172.21.15.152:0/2206685342 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f8bac02e030 con 0x7f8bb4106a80 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/496608717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def227a90 0x555def229e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb8efc640 1 -- 172.21.15.152:0/496608717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def227a90 msgr2=0x555def229e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/496608717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def227a90 0x555def229e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb8efc640 1 -- 172.21.15.152:0/496608717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def218360 msgr2=0x555def218740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/496608717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def218360 0x555def218740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb8efc640 1 -- 172.21.15.152:0/496608717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555def10a440 con 0x555def218c80 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.075+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/496608717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def218360 0x555def218740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/496608717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218c80 0x555def227550 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8010400 tx=0x7f8ba80108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b631328ad7188541 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8bb96fd640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ba40a2cf0 0x7f8ba40a51b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0ee3c0 tx=0x7f8bac0b2570 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:42.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8b9effd640 1 -- 172.21.15.152:0/496608717 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8011760 con 0x555def218c80 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8b9effd640 1 -- 172.21.15.152:0/496608717 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ba8011de0 con 0x555def218c80 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8b9effd640 1 -- 172.21.15.152:0/496608717 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba801a380 con 0x555def218c80 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8bbd539740 1 -- 172.21.15.152:0/496608717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218c80 msgr2=0x555def227550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8bbd539740 1 --2- 172.21.15.152:0/496608717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218c80 0x555def227550 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8010400 tx=0x7f8ba80108c0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8bbd539740 1 -- 172.21.15.152:0/496608717 shutdown_connections 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8bbd539740 1 --2- 172.21.15.152:0/496608717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def227a90 0x555def229e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8bbd539740 1 --2- 172.21.15.152:0/496608717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218c80 0x555def227550 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8bbd539740 1 --2- 172.21.15.152:0/496608717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def218360 0x555def218740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.076+0000 7f8bbd539740 1 -- 172.21.15.152:0/496608717 >> 172.21.15.152:0/496608717 conn(0x555def214a30 msgr2=0x555def214e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bbd539740 1 -- 172.21.15.152:0/496608717 shutdown_connections 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bbd539740 1 -- 172.21.15.152:0/496608717 wait complete. 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bbd539740 1 -- start start 2024-09-11T22:12:42.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bbd539740 1 Processor -- start 2024-09-11T22:12:42.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def227410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def218c80 0x555def2246c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def227a90 0x555def224c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bbd539740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555def22a660 con 0x555def218360 2024-09-11T22:12:42.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bbd539740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555def139050 con 0x555def218c80 2024-09-11T22:12:42.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bbd539740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555def22a7e0 con 0x555def227a90 2024-09-11T22:12:42.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bbd539740 10 client.0 _ll_register_callbacks cb 0x555def179160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:42.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bb3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def227410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bb3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def227410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56708/0 (socket says 172.21.15.152:56708) 2024-09-11T22:12:42.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.077+0000 7f8bb3fff640 1 -- 172.21.15.152:0/2367464216 learned_addr learned my addr 172.21.15.152:0/2367464216 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:42.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def218c80 0x555def2246c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8bb3fff640 1 -- 172.21.15.152:0/2367464216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def227a90 msgr2=0x555def224c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def227a90 0x555def224c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8bb3fff640 1 -- 172.21.15.152:0/2367464216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def218c80 msgr2=0x555def2246c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def218c80 0x555def2246c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8bb3fff640 1 -- 172.21.15.152:0/2367464216 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555deeeef3c0 con 0x555def218360 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def227410 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0012840 tx=0x7f8ba0012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569a1458e0f4cc28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8b93fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8b93fff640 1 -- 172.21.15.152:0/2367464216 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0021060 con 0x555def218360 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8b93fff640 1 -- 172.21.15.152:0/2367464216 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f8ba000fb50 con 0x555def218360 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8bbd539740 1 -- 172.21.15.152:0/2367464216 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ba8011de0 con 0x555def218360 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8b93fff640 1 -- 172.21.15.152:0/2367464216 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8ba000fd50 con 0x555def218360 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8bbd539740 10 client.17523 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:42.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8bbd539740 1 -- 172.21.15.152:0/2367464216 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555def236170 con 0x555def218360 2024-09-11T22:12:42.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.078+0000 7f8b93fff640 1 -- 172.21.15.152:0/2367464216 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ba8011de0 con 0x555def218360 2024-09-11T22:12:42.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.079+0000 7f8b93fff640 1 -- 172.21.15.152:0/2367464216 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8ba001b390 con 0x555def218360 2024-09-11T22:12:42.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.079+0000 7f8bbd539740 10 client.17523 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:42.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.079+0000 7f8bbd539740 10 client.17523 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:42.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.079+0000 7f8bbd539740 20 client.17523 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:42.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.079+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x555def237580 0x555def239970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.079+0000 7f8bbd539740 4 client.17523 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:42.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.079+0000 7f8bbd539740 1 -- 172.21.15.152:0/2367464216 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555def18b850 con 0x555def237580 2024-09-11T22:12:42.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.079+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x555def237580 0x555def239970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.079+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x555def237580 0x555def239970 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa8fcc7c033862fe server_cookie=fdede36da228de67 in_seq=0 out_seq=0 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.079+0000 7f8b93fff640 10 client.17523 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8b93fff640 1 -- 172.21.15.152:0/2367464216 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555def18b850 con 0x555def237580 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8b93fff640 10 client.17523 handle_command_reply: tid=0 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8bbd539740 1 client.17523 shutdown 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8bbd539740 1 -- 172.21.15.152:0/2367464216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 msgr2=0x555def227410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def227410 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0012840 tx=0x7f8ba0012d00 comp rx=0 tx=0).stop 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8bbd539740 1 -- 172.21.15.152:0/2367464216 shutdown_connections 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x555def237580 0x555def239970 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def227a90 0x555def224c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8b93fff640 0 client.17523 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def218c80 0x555def2246c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2367464216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def227410 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8bbd539740 1 -- 172.21.15.152:0/2367464216 >> 172.21.15.152:0/2367464216 conn(0x555def214a30 msgr2=0x555def21a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:42.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.080+0000 7f8bbd539740 1 -- 172.21.15.152:0/2367464216 shutdown_connections 2024-09-11T22:12:42.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.081+0000 7f8bbd539740 1 -- 172.21.15.152:0/2367464216 wait complete. 2024-09-11T22:12:42.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.081+0000 7f8bbd539740 20 client.17523 trim_cache size 0 max 16384 2024-09-11T22:12:42.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bbd539740 1 Processor -- start 2024-09-11T22:12:42.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bbd539740 1 -- start start 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def233930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def218c80 0x555def21a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def227a90 0x555def21aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bbd539740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb41adff0 con 0x555def218360 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bbd539740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb41ab8c0 con 0x555def227a90 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bbd539740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb41a9730 con 0x555def218c80 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bb3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def233930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bb3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def233930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56714/0 (socket says 172.21.15.152:56714) 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bb3fff640 1 -- 172.21.15.152:0/343250601 learned_addr learned my addr 172.21.15.152:0/343250601 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/343250601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def218c80 0x555def21a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bb3fff640 1 -- 172.21.15.152:0/343250601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def218c80 msgr2=0x555def21a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:42.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/343250601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def218c80 0x555def21a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bb3fff640 1 -- 172.21.15.152:0/343250601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def227a90 msgr2=0x555def21aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:42.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/343250601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def227a90 0x555def21aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bb3fff640 1 -- 172.21.15.152:0/343250601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555def239fa0 con 0x555def218360 2024-09-11T22:12:42.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/343250601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def218c80 0x555def21a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:42.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.098+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/343250601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def233930 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00058c0 tx=0x7f8ba0013fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecdbcc5af1451ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:42.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.099+0000 7f8b9e7fc640 1 -- 172.21.15.152:0/343250601 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba001be20 con 0x555def218360 2024-09-11T22:12:42.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.099+0000 7f8b9e7fc640 1 -- 172.21.15.152:0/343250601 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ba0004520 con 0x555def218360 2024-09-11T22:12:42.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.099+0000 7f8b9e7fc640 1 -- 172.21.15.152:0/343250601 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0003940 con 0x555def218360 2024-09-11T22:12:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.099+0000 7f8bbd539740 1 -- 172.21.15.152:0/343250601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 msgr2=0x555def233930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.099+0000 7f8bbd539740 1 --2- 172.21.15.152:0/343250601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def233930 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00058c0 tx=0x7f8ba0013fd0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.099+0000 7f8bbd539740 1 -- 172.21.15.152:0/343250601 shutdown_connections 2024-09-11T22:12:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.099+0000 7f8bbd539740 1 --2- 172.21.15.152:0/343250601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def227a90 0x555def21aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.099+0000 7f8bbd539740 1 --2- 172.21.15.152:0/343250601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def218c80 0x555def21a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.099+0000 7f8bbd539740 1 --2- 172.21.15.152:0/343250601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def233930 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.099+0000 7f8bbd539740 1 -- 172.21.15.152:0/343250601 >> 172.21.15.152:0/343250601 conn(0x555def214a30 msgr2=0x555def219e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.099+0000 7f8bbd539740 1 -- 172.21.15.152:0/343250601 shutdown_connections 2024-09-11T22:12:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bbd539740 1 -- 172.21.15.152:0/343250601 wait complete. 2024-09-11T22:12:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bbd539740 1 -- start start 2024-09-11T22:12:42.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bbd539740 1 Processor -- start 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def22bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def218c80 0x555def22c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bbd539740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def227a90 0x555def2a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bbd539740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb41a9d80 con 0x555def218360 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bbd539740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb41ab1f0 con 0x555def227a90 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bbd539740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb41aa450 con 0x555def218c80 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bbd539740 10 client.0 _ll_register_callbacks cb 0x7f8ba0009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bb3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def22bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bb3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def22bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56716/0 (socket says 172.21.15.152:56716) 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bb3fff640 1 -- 172.21.15.152:0/2591236398 learned_addr learned my addr 172.21.15.152:0/2591236398 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.100+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def218c80 0x555def22c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def227a90 0x555def2a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8bb3fff640 1 -- 172.21.15.152:0/2591236398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def218c80 msgr2=0x555def22c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def218c80 0x555def22c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8bb3fff640 1 -- 172.21.15.152:0/2591236398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def227a90 msgr2=0x555def2a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def227a90 0x555def2a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8bb3fff640 1 -- 172.21.15.152:0/2591236398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555def22c9d0 con 0x555def218360 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8bb3fff640 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def22bb90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8ba001bda0 tx=0x7f8ba001bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f7868f6b6c2685 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8b93fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8b93fff640 1 -- 172.21.15.152:0/2591236398 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0005040 con 0x555def218360 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8b93fff640 1 -- 172.21.15.152:0/2591236398 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f8ba00051e0 con 0x555def218360 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8bbd539740 1 -- 172.21.15.152:0/2591236398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ba0004520 con 0x555def218360 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8b93fff640 1 -- 172.21.15.152:0/2591236398 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8ba00053e0 con 0x555def218360 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8bbd539740 10 client.17529 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.101+0000 7f8bbd539740 1 -- 172.21.15.152:0/2591236398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555def2a2790 con 0x555def218360 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.102+0000 7f8b93fff640 1 -- 172.21.15.152:0/2591236398 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ba0004520 con 0x555def218360 2024-09-11T22:12:42.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.102+0000 7f8b93fff640 1 -- 172.21.15.152:0/2591236398 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8ba0039040 con 0x555def218360 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.102+0000 7f8bbd539740 10 client.17529 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.102+0000 7f8bbd539740 10 client.17529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.102+0000 7f8bbd539740 20 client.17529 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.102+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x555def2a2ea0 0x555def2a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.102+0000 7f8bbd539740 4 client.17529 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.102+0000 7f8bbd539740 1 -- 172.21.15.152:0/2591236398 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555def185d60 con 0x555def2a2ea0 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.102+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x555def2a2ea0 0x555def2a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.102+0000 7f8bb8efc640 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x555def2a2ea0 0x555def2a5290 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6063ebe77e9b5289 server_cookie=fae6b2799407971e in_seq=0 out_seq=0 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.102+0000 7f8b93fff640 10 client.17529 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8b93fff640 1 -- 172.21.15.152:0/2591236398 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555def185d60 con 0x555def2a2ea0 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8b93fff640 10 client.17529 handle_command_reply: tid=0 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 1 client.17529 shutdown 2024-09-11T22:12:42.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 1 -- 172.21.15.152:0/2591236398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 msgr2=0x555def22bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def22bb90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8ba001bda0 tx=0x7f8ba001bbc0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 1 -- 172.21.15.152:0/2591236398 shutdown_connections 2024-09-11T22:12:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x555def2a2ea0 0x555def2a5290 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555def227a90 0x555def2a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555def218c80 0x555def22c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 1 --2- 172.21.15.152:0/2591236398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555def218360 0x555def22bb90 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8b93fff640 0 client.17529 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 1 -- 172.21.15.152:0/2591236398 >> 172.21.15.152:0/2591236398 conn(0x555def214a30 msgr2=0x555def21a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:42.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 1 -- 172.21.15.152:0/2591236398 shutdown_connections 2024-09-11T22:12:42.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 1 -- 172.21.15.152:0/2591236398 wait complete. 2024-09-11T22:12:42.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.103+0000 7f8bbd539740 20 client.17529 trim_cache size 0 max 16384 2024-09-11T22:12:42.110 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:12:42.110 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:12:42.110 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:12:42.110 INFO:teuthology.orchestra.run.smithi152.stdout: "0f969d5a-4e44-4c66-846c-b5624af783e6": { 2024-09-11T22:12:42.110 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:12:42.110 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "0f969d5a-4e44-4c66-846c-b5624af783e6", 2024-09-11T22:12:42.110 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:12:42.110 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:42.111 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:42.111 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:12:42.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 -- 172.21.15.152:0/2206685342 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ba40a2cf0 msgr2=0x7f8ba40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:42.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ba40a2cf0 0x7f8ba40a51b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0ee3c0 tx=0x7f8bac0b2570 comp rx=0 tx=0).stop 2024-09-11T22:12:42.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 -- 172.21.15.152:0/2206685342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb4106a80 msgr2=0x7f8bb41a4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:42.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb4106a80 0x7f8bb41a4300 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8bac005cc0 tx=0x7f8bac032f40 comp rx=0 tx=0).stop 2024-09-11T22:12:42.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 -- 172.21.15.152:0/2206685342 shutdown_connections 2024-09-11T22:12:42.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ba40a2cf0 0x7f8ba40a51b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb4106a80 0x7f8bb41a4300 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bb4101420 0x7f8bb41997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 --2- 172.21.15.152:0/2206685342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bb4100a80 0x7f8bb4199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:42.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 -- 172.21.15.152:0/2206685342 >> 172.21.15.152:0/2206685342 conn(0x7f8bb40fc7a0 msgr2=0x7f8bb40fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:42.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 -- 172.21.15.152:0/2206685342 shutdown_connections 2024-09-11T22:12:42.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:42.104+0000 7f8bbb160640 1 -- 172.21.15.152:0/2206685342 wait complete. 2024-09-11T22:12:42.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:42 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:12:42.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:42 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:12:42.397 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:42 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:12:42.397 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:42 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:12:42.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:42 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:12:42.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:42 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:12:42.792 INFO:tasks.cephfs.filesystem:scrub status for tag:0f969d5a-4e44-4c66-846c-b5624af783e6 - {'path': '/', 'tag': '0f969d5a-4e44-4c66-846c-b5624af783e6', 'options': 'recursive,force'} 2024-09-11T22:12:43.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:43 smithi193 ceph-mon[35545]: pgmap v259: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.4 MiB/s wr, 292 op/s 2024-09-11T22:12:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.396+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/349778522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3b41069c0 msgr2=0x7fd3b4106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.396+0000 7fd3bb0a6640 1 --2- 172.21.15.152:0/349778522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3b41069c0 0x7fd3b4106da0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009930 tx=0x7fd3a402a420 comp rx=0 tx=0).stop 2024-09-11T22:12:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.396+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/349778522 shutdown_connections 2024-09-11T22:12:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.396+0000 7fd3bb0a6640 1 --2- 172.21.15.152:0/349778522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3b4101350 0x7fd3b410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.396+0000 7fd3bb0a6640 1 --2- 172.21.15.152:0/349778522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd3b41009b0 0x7fd3b4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.396+0000 7fd3bb0a6640 1 --2- 172.21.15.152:0/349778522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3b41069c0 0x7fd3b4106da0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.396+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/349778522 >> 172.21.15.152:0/349778522 conn(0x7fd3b4077990 msgr2=0x7fd3b40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.396+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/349778522 shutdown_connections 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.396+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/349778522 wait complete. 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.396+0000 7fd3bb0a6640 1 Processor -- start 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.396+0000 7fd3bb0a6640 1 -- start start 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3bb0a6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3b41009b0 0x7fd3b4199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3bb0a6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd3b4101350 0x7fd3b4199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3bb0a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3b41069c0 0x7fd3b41a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3bb0a6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4110e00 con 0x7fd3b41069c0 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3bb0a6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4110c80 con 0x7fd3b41009b0 2024-09-11T22:12:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3bb0a6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4110f80 con 0x7fd3b4101350 2024-09-11T22:12:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b9643640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3b41069c0 0x7fd3b41a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b9643640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3b41069c0 0x7fd3b41a41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36274/0 (socket says 172.21.15.152:36274) 2024-09-11T22:12:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b9643640 1 -- 172.21.15.152:0/503022291 learned_addr learned my addr 172.21.15.152:0/503022291 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b8e42640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3b41009b0 0x7fd3b4199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b9643640 1 -- 172.21.15.152:0/503022291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd3b4101350 msgr2=0x7fd3b4199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b9643640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd3b4101350 0x7fd3b4199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b9643640 1 -- 172.21.15.152:0/503022291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3b41009b0 msgr2=0x7fd3b4199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b9643640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3b41009b0 0x7fd3b4199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b9643640 1 -- 172.21.15.152:0/503022291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b41a46f0 con 0x7fd3b41069c0 2024-09-11T22:12:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b8e42640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3b41009b0 0x7fd3b4199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b9643640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3b41069c0 0x7fd3b41a41b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00cce0 tx=0x7fd3ac00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b1ffb640 1 -- 172.21.15.152:0/503022291 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00f450 con 0x7fd3b41069c0 2024-09-11T22:12:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/503022291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b41a48c0 con 0x7fd3b41069c0 2024-09-11T22:12:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b1ffb640 1 -- 172.21.15.152:0/503022291 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3ac00fad0 con 0x7fd3b41069c0 2024-09-11T22:12:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.397+0000 7fd3b1ffb640 1 -- 172.21.15.152:0/503022291 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac018c10 con 0x7fd3b41069c0 2024-09-11T22:12:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.398+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/503022291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b41a4d90 con 0x7fd3b41069c0 2024-09-11T22:12:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3b1ffb640 1 -- 172.21.15.152:0/503022291 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd3ac00f5f0 con 0x7fd3b41069c0 2024-09-11T22:12:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3bde38740 1 Processor -- start 2024-09-11T22:12:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3bde38740 1 -- start start 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9ef00 0x55d272f9f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9f820 0x55d272fa9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3bde38740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d272eff2f0 con 0x55d272faa0c0 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3bde38740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d272ea7270 con 0x55d272f9ef00 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3bde38740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d272efb2b0 con 0x55d272f9f820 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36284/0 (socket says 172.21.15.152:36284) 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.400+0000 7fd3b3fff640 1 -- 172.21.15.152:0/3179734499 learned_addr learned my addr 172.21.15.152:0/3179734499 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd3b1ffb640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd39c0a2da0 0x7fd39c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd3b8e42640 1 --2- 172.21.15.152:0/3179734499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9f820 0x55d272fa9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3179734499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9ef00 0x55d272f9f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd3b3fff640 1 -- 172.21.15.152:0/3179734499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9f820 msgr2=0x55d272fa9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3179734499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9f820 0x55d272fa9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd3b9643640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd39c0a2da0 0x7fd39c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd3b3fff640 1 -- 172.21.15.152:0/3179734499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9ef00 msgr2=0x55d272f9f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3179734499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9ef00 0x55d272f9f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd3b3fff640 1 -- 172.21.15.152:0/3179734499 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d272ea6340 con 0x55d272faa0c0 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd3b1ffb640 1 -- 172.21.15.152:0/503022291 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fd3ac0cfc00 con 0x7fd3b41069c0 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3179734499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fac4b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800de00 tx=0x7fd3a800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1caf13cbe1bd7c0b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd39affd640 1 -- 172.21.15.152:0/3179734499 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8016070 con 0x55d272faa0c0 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd39affd640 1 -- 172.21.15.152:0/3179734499 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a80035f0 con 0x55d272faa0c0 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.401+0000 7fd39affd640 1 -- 172.21.15.152:0/3179734499 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8012650 con 0x55d272faa0c0 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3bde38740 1 -- 172.21.15.152:0/3179734499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 msgr2=0x55d272fac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3b9643640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd39c0a2da0 0x7fd39c0a5260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0cd8f0 tx=0x7fd3ac06bf90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3179734499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fac4b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800de00 tx=0x7fd3a800d520 comp rx=0 tx=0).stop 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3bde38740 1 -- 172.21.15.152:0/3179734499 shutdown_connections 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3179734499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fac4b0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3179734499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9f820 0x55d272fa9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3179734499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9ef00 0x55d272f9f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3bde38740 1 -- 172.21.15.152:0/3179734499 >> 172.21.15.152:0/3179734499 conn(0x55d272f9b470 msgr2=0x55d272f9b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3bde38740 1 -- 172.21.15.152:0/3179734499 shutdown_connections 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3bde38740 1 -- 172.21.15.152:0/3179734499 wait complete. 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3bde38740 1 -- start start 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.402+0000 7fd3bde38740 1 Processor -- start 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9ef00 0x55d272fa6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9f820 0x55d272fa74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fa7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3bde38740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d272facc90 con 0x55d272faa0c0 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3bde38740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d272e88290 con 0x55d272f9f820 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3bde38740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d272face10 con 0x55d272f9ef00 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3bde38740 10 client.0 _ll_register_callbacks cb 0x55d272eb9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fa7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fa7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36296/0 (socket says 172.21.15.152:36296) 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3b3fff640 1 -- 172.21.15.152:0/3316345466 learned_addr learned my addr 172.21.15.152:0/3316345466 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3b8e42640 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9f820 0x55d272fa74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9ef00 0x55d272fa6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3b3fff640 1 -- 172.21.15.152:0/3316345466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9ef00 msgr2=0x55d272fa6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9ef00 0x55d272fa6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3b3fff640 1 -- 172.21.15.152:0/3316345466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9f820 msgr2=0x55d272fa74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9f820 0x55d272fa74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3b3fff640 1 -- 172.21.15.152:0/3316345466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d272c12210 con 0x55d272faa0c0 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fa7a20 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800ff80 tx=0x7fd3a800d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab6724f953e655e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd393fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd393fff640 1 -- 172.21.15.152:0/3316345466 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8016030 con 0x55d272faa0c0 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd393fff640 1 -- 172.21.15.152:0/3316345466 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fd3a80041f0 con 0x55d272faa0c0 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3bde38740 1 -- 172.21.15.152:0/3316345466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a80035f0 con 0x55d272faa0c0 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd393fff640 1 -- 172.21.15.152:0/3316345466 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd3a802f050 con 0x55d272faa0c0 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.403+0000 7fd3bde38740 10 client.17541 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.404+0000 7fd3bde38740 1 -- 172.21.15.152:0/3316345466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d272cde620 con 0x55d272faa0c0 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.404+0000 7fd393fff640 1 -- 172.21.15.152:0/3316345466 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a80035f0 con 0x55d272faa0c0 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.404+0000 7fd393fff640 1 -- 172.21.15.152:0/3316345466 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd3a8011440 con 0x55d272faa0c0 2024-09-11T22:12:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.404+0000 7fd3bde38740 10 client.17541 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.404+0000 7fd3bde38740 10 client.17541 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.404+0000 7fd3bde38740 20 client.17541 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.404+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d272fb9f40 0x55d272fbc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.404+0000 7fd3bde38740 4 client.17541 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.404+0000 7fd3bde38740 1 -- 172.21.15.152:0/3316345466 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d272f0ca20 con 0x55d272fb9f40 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.404+0000 7fd3b8e42640 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d272fb9f40 0x55d272fbc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.405+0000 7fd393fff640 10 client.17541 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.405+0000 7fd3b8e42640 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d272fb9f40 0x55d272fbc330 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79144a0ae1c2cc9f server_cookie=feba704f89613e8d in_seq=0 out_seq=0 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.405+0000 7fd393fff640 1 -- 172.21.15.152:0/3316345466 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d272f0ca20 con 0x55d272fb9f40 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.405+0000 7fd393fff640 10 client.17541 handle_command_reply: tid=0 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.405+0000 7fd3bde38740 1 client.17541 shutdown 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.405+0000 7fd3bde38740 1 -- 172.21.15.152:0/3316345466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 msgr2=0x55d272fa7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.405+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fa7a20 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800ff80 tx=0x7fd3a800d320 comp rx=0 tx=0).stop 2024-09-11T22:12:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.406+0000 7fd3bde38740 1 -- 172.21.15.152:0/3316345466 shutdown_connections 2024-09-11T22:12:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.406+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d272fb9f40 0x55d272fbc330 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.406+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272faa0c0 0x55d272fa7a20 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.406+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9f820 0x55d272fa74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.406+0000 7fd393fff640 0 client.17541 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.406+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3316345466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9ef00 0x55d272fa6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.406+0000 7fd3bde38740 1 -- 172.21.15.152:0/3316345466 >> 172.21.15.152:0/3316345466 conn(0x55d272f9b470 msgr2=0x55d272fa1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.406+0000 7fd3bde38740 1 -- 172.21.15.152:0/3316345466 shutdown_connections 2024-09-11T22:12:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.406+0000 7fd3bde38740 1 -- 172.21.15.152:0/3316345466 wait complete. 2024-09-11T22:12:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.406+0000 7fd3bde38740 20 client.17541 trim_cache size 0 max 16384 2024-09-11T22:12:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3bde38740 1 Processor -- start 2024-09-11T22:12:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3bde38740 1 -- start start 2024-09-11T22:12:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9ef00 0x55d272fa1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9f820 0x55d272fc1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272faa0c0 0x55d272fc1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3bde38740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b41adf60 con 0x55d272f9ef00 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3bde38740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b41ab830 con 0x55d272f9f820 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3bde38740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b41a96a0 con 0x55d272faa0c0 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9ef00 0x55d272fa1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3b3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9ef00 0x55d272fa1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36312/0 (socket says 172.21.15.152:36312) 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3b3fff640 1 -- 172.21.15.152:0/27676301 learned_addr learned my addr 172.21.15.152:0/27676301 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3b3fff640 1 -- 172.21.15.152:0/27676301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272faa0c0 msgr2=0x55d272fc1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/27676301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272faa0c0 0x55d272fc1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3b3fff640 1 -- 172.21.15.152:0/27676301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9f820 msgr2=0x55d272fc1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/27676301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9f820 0x55d272fc1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3b3fff640 1 -- 172.21.15.152:0/27676301 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d272f9f650 con 0x55d272f9ef00 2024-09-11T22:12:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/27676301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9ef00 0x55d272fa1070 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8000c00 tx=0x7fd3a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb99e3733a0a049 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.420+0000 7fd39a7fc640 1 -- 172.21.15.152:0/27676301 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8016040 con 0x55d272f9ef00 2024-09-11T22:12:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd39a7fc640 1 -- 172.21.15.152:0/27676301 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a80035f0 con 0x55d272f9ef00 2024-09-11T22:12:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd39a7fc640 1 -- 172.21.15.152:0/27676301 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8011a30 con 0x55d272f9ef00 2024-09-11T22:12:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd3bde38740 1 -- 172.21.15.152:0/27676301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9ef00 msgr2=0x55d272fa1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd3bde38740 1 --2- 172.21.15.152:0/27676301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9ef00 0x55d272fa1070 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8000c00 tx=0x7fd3a800d3b0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd3bde38740 1 -- 172.21.15.152:0/27676301 shutdown_connections 2024-09-11T22:12:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd3bde38740 1 --2- 172.21.15.152:0/27676301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272faa0c0 0x55d272fc1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd3bde38740 1 --2- 172.21.15.152:0/27676301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272f9f820 0x55d272fc1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd3bde38740 1 --2- 172.21.15.152:0/27676301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9ef00 0x55d272fa1070 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd3bde38740 1 -- 172.21.15.152:0/27676301 >> 172.21.15.152:0/27676301 conn(0x55d272f9b470 msgr2=0x55d272fa0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd3bde38740 1 -- 172.21.15.152:0/27676301 shutdown_connections 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd3bde38740 1 -- 172.21.15.152:0/27676301 wait complete. 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.421+0000 7fd3bde38740 1 -- start start 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3bde38740 1 Processor -- start 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9ef00 0x55d272fae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9f820 0x55d272fae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3bde38740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272faa0c0 0x55d272faeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3bde38740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b41a9cf0 con 0x55d272f9f820 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3bde38740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b41ab160 con 0x55d272faa0c0 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3bde38740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b41aa3c0 con 0x55d272f9ef00 2024-09-11T22:12:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3bde38740 10 client.0 _ll_register_callbacks cb 0x7fd3a800dc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b8e42640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9f820 0x55d272fae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b8e42640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9f820 0x55d272fae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36326/0 (socket says 172.21.15.152:36326) 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b8e42640 1 -- 172.21.15.152:0/3293861580 learned_addr learned my addr 172.21.15.152:0/3293861580 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9ef00 0x55d272fae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b8e42640 1 -- 172.21.15.152:0/3293861580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9ef00 msgr2=0x55d272fae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b8e42640 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9ef00 0x55d272fae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b8e42640 1 -- 172.21.15.152:0/3293861580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272faa0c0 msgr2=0x55d272faeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272faa0c0 0x55d272faeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b8e42640 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272faa0c0 0x55d272faeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b8e42640 1 -- 172.21.15.152:0/3293861580 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d273023b60 con 0x55d272f9f820 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272faa0c0 0x55d272faeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd3b8e42640 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9f820 0x55d272fae580 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009900 tx=0x7fd3a4032f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbd45a5275a44f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.422+0000 7fd393fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd393fff640 1 -- 172.21.15.152:0/3293861580 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4049060 con 0x55d272f9f820 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd393fff640 1 -- 172.21.15.152:0/3293861580 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fd3a4004390 con 0x55d272f9f820 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd3bde38740 1 -- 172.21.15.152:0/3293861580 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a80035f0 con 0x55d272f9f820 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd393fff640 1 -- 172.21.15.152:0/3293861580 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd3a4035040 con 0x55d272f9f820 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd3bde38740 10 client.17547 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd3bde38740 1 -- 172.21.15.152:0/3293861580 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d273024eb0 con 0x55d272f9f820 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd393fff640 1 -- 172.21.15.152:0/3293861580 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a80035f0 con 0x55d272f9f820 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd393fff640 1 -- 172.21.15.152:0/3293861580 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd3a4004c60 con 0x55d272f9f820 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd3bde38740 10 client.17547 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd3bde38740 10 client.17547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd3bde38740 20 client.17547 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d2730255c0 0x55d2730279e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd3bde38740 4 client.17547 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:12:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd3bde38740 1 -- 172.21.15.152:0/3293861580 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d272f06d70 con 0x55d2730255c0 2024-09-11T22:12:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.423+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d2730255c0 0x55d2730279e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.424+0000 7fd393fff640 10 client.17547 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.424+0000 7fd3b3fff640 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d2730255c0 0x55d2730279e0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b81844a2a2260a25 server_cookie=cd1a853b5bdb5893 in_seq=0 out_seq=0 2024-09-11T22:12:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.432+0000 7fd393fff640 1 -- 172.21.15.152:0/3293861580 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d272f06d70 con 0x55d2730255c0 2024-09-11T22:12:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.432+0000 7fd393fff640 10 client.17547 handle_command_reply: tid=0 2024-09-11T22:12:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.432+0000 7fd3bde38740 1 client.17547 shutdown 2024-09-11T22:12:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.432+0000 7fd3bde38740 1 -- 172.21.15.152:0/3293861580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9f820 msgr2=0x55d272fae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.432+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9f820 0x55d272fae580 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009900 tx=0x7fd3a4032f30 comp rx=0 tx=0).stop 2024-09-11T22:12:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd3bde38740 1 -- 172.21.15.152:0/3293861580 shutdown_connections 2024-09-11T22:12:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d2730255c0 0x55d2730279e0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d272faa0c0 0x55d272faeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d272f9f820 0x55d272fae580 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd393fff640 0 client.17547 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd3bde38740 1 --2- 172.21.15.152:0/3293861580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d272f9ef00 0x55d272fae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd3bde38740 1 -- 172.21.15.152:0/3293861580 >> 172.21.15.152:0/3293861580 conn(0x55d272f9b470 msgr2=0x55d272fa9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd3bde38740 1 -- 172.21.15.152:0/3293861580 shutdown_connections 2024-09-11T22:12:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd3bde38740 1 -- 172.21.15.152:0/3293861580 wait complete. 2024-09-11T22:12:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd3bde38740 20 client.17547 trim_cache size 0 max 16384 2024-09-11T22:12:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:12:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:12:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:12:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:12:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/503022291 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd39c0a2da0 msgr2=0x7fd39c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.433+0000 7fd3bb0a6640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd39c0a2da0 0x7fd39c0a5260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0cd8f0 tx=0x7fd3ac06bf90 comp rx=0 tx=0).stop 2024-09-11T22:12:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.434+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/503022291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3b41069c0 msgr2=0x7fd3b41a41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.434+0000 7fd3bb0a6640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3b41069c0 0x7fd3b41a41b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00cce0 tx=0x7fd3ac00a620 comp rx=0 tx=0).stop 2024-09-11T22:12:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.434+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/503022291 shutdown_connections 2024-09-11T22:12:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.434+0000 7fd3bb0a6640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd39c0a2da0 0x7fd39c0a5260 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.434+0000 7fd3bb0a6640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3b41069c0 0x7fd3b41a41b0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.434+0000 7fd3bb0a6640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd3b4101350 0x7fd3b4199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.434+0000 7fd3bb0a6640 1 --2- 172.21.15.152:0/503022291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3b41009b0 0x7fd3b4199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.434+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/503022291 >> 172.21.15.152:0/503022291 conn(0x7fd3b4077990 msgr2=0x7fd3b40fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.434+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/503022291 shutdown_connections 2024-09-11T22:12:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:43.434+0000 7fd3bb0a6640 1 -- 172.21.15.152:0/503022291 wait complete. 2024-09-11T22:12:43.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:43 smithi152 ceph-mon[31188]: pgmap v259: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.4 MiB/s wr, 292 op/s 2024-09-11T22:12:43.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:43 smithi179 ceph-mon[35603]: pgmap v259: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.4 MiB/s wr, 292 op/s 2024-09-11T22:12:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:12:45.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:45 smithi193 ceph-mon[35545]: pgmap v260: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.5 MiB/s wr, 299 op/s 2024-09-11T22:12:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:45 smithi152 ceph-mon[31188]: pgmap v260: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.5 MiB/s wr, 299 op/s 2024-09-11T22:12:45.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:45 smithi179 ceph-mon[35603]: pgmap v260: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.5 MiB/s wr, 299 op/s 2024-09-11T22:12:47.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:47 smithi193 ceph-mon[35545]: pgmap v261: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.2 MiB/s wr, 118 op/s 2024-09-11T22:12:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:47 smithi152 ceph-mon[31188]: pgmap v261: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.2 MiB/s wr, 118 op/s 2024-09-11T22:12:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:47 smithi179 ceph-mon[35603]: pgmap v261: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.2 MiB/s wr, 118 op/s 2024-09-11T22:12:49.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:49 smithi193 ceph-mon[35545]: pgmap v262: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 852 KiB/s wr, 79 op/s 2024-09-11T22:12:49.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:49 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:12:49.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:49 smithi152 ceph-mon[31188]: pgmap v262: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 852 KiB/s wr, 79 op/s 2024-09-11T22:12:49.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:49 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:12:49.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:49 smithi179 ceph-mon[35603]: pgmap v262: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 852 KiB/s wr, 79 op/s 2024-09-11T22:12:49.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:49 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:12:49.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:12:50.030 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:12:50.296 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:50.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:50 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:12:50.417 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:50 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:12:50.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:50 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:12:50.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.731+0000 7f3f0d11e640 1 -- 172.21.15.152:0/795107146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f08101450 msgr2=0x7f3f08105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:50.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.731+0000 7f3f0d11e640 1 --2- 172.21.15.152:0/795107146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f08101450 0x7f3f08105920 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009900 tx=0x7f3ef002a470 comp rx=0 tx=0).stop 2024-09-11T22:12:50.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.731+0000 7f3f0d11e640 1 -- 172.21.15.152:0/795107146 shutdown_connections 2024-09-11T22:12:50.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.731+0000 7f3f0d11e640 1 --2- 172.21.15.152:0/795107146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f08105f40 0x7f3f081063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:50.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.731+0000 7f3f0d11e640 1 --2- 172.21.15.152:0/795107146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f08101450 0x7f3f08105920 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:50.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.731+0000 7f3f0d11e640 1 --2- 172.21.15.152:0/795107146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f08100b30 0x7f3f08100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:50.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.731+0000 7f3f0d11e640 1 -- 172.21.15.152:0/795107146 >> 172.21.15.152:0/795107146 conn(0x7f3f080fc7a0 msgr2=0x7f3f080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:50.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.731+0000 7f3f0d11e640 1 -- 172.21.15.152:0/795107146 shutdown_connections 2024-09-11T22:12:50.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.732+0000 7f3f0d11e640 1 -- 172.21.15.152:0/795107146 wait complete. 2024-09-11T22:12:50.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.732+0000 7f3f0d11e640 1 Processor -- start 2024-09-11T22:12:50.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.732+0000 7f3f0d11e640 1 -- start start 2024-09-11T22:12:50.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.732+0000 7f3f0d11e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f08100b30 0x7f3f0819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.732+0000 7f3f0d11e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f08101450 0x7f3f0819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.732+0000 7f3f0d11e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f08105f40 0x7f3f081a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.732+0000 7f3f0d11e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f08118540 con 0x7f3f08100b30 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.732+0000 7f3f0d11e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f081183c0 con 0x7f3f08105f40 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.732+0000 7f3f0d11e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f081186c0 con 0x7f3f08101450 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f06d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f08100b30 0x7f3f0819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f06d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f08100b30 0x7f3f0819eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36344/0 (socket says 172.21.15.152:36344) 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f06d9d640 1 -- 172.21.15.152:0/1453524536 learned_addr learned my addr 172.21.15.152:0/1453524536 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f0759e640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f08105f40 0x7f3f081a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3efffff640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f08101450 0x7f3f0819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f06d9d640 1 -- 172.21.15.152:0/1453524536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f08101450 msgr2=0x7f3f0819efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:50.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f06d9d640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f08101450 0x7f3f0819efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f06d9d640 1 -- 172.21.15.152:0/1453524536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f08105f40 msgr2=0x7f3f081a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f06d9d640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f08105f40 0x7f3f081a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f06d9d640 1 -- 172.21.15.152:0/1453524536 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f081a3ad0 con 0x7f3f08100b30 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f06d9d640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f08100b30 0x7f3f0819eaa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800d950 tx=0x7f3ef800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f04d99640 1 -- 172.21.15.152:0/1453524536 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8017070 con 0x7f3f08100b30 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f04d99640 1 -- 172.21.15.152:0/1453524536 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ef8009c30 con 0x7f3f08100b30 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f0d11e640 1 -- 172.21.15.152:0/1453524536 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f081a3dc0 con 0x7f3f08100b30 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f04d99640 1 -- 172.21.15.152:0/1453524536 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef800f6b0 con 0x7f3f08100b30 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.733+0000 7f3f0d11e640 1 -- 172.21.15.152:0/1453524536 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f081ab650 con 0x7f3f08100b30 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.734+0000 7f3f0d11e640 1 -- 172.21.15.152:0/1453524536 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f08105920 con 0x7f3f08100b30 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.736+0000 7f3f04d99640 1 -- 172.21.15.152:0/1453524536 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3ef80109d0 con 0x7f3f08100b30 2024-09-11T22:12:50.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.736+0000 7f3f04d99640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef40a2cf0 0x7f3ef40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:50.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.736+0000 7f3efffff640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef40a2cf0 0x7f3ef40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:50.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.736+0000 7f3f04d99640 1 -- 172.21.15.152:0/1453524536 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f3ef80cf150 con 0x7f3f08100b30 2024-09-11T22:12:50.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.737+0000 7f3efffff640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef40a2cf0 0x7f3ef40a51b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3f081a0080 tx=0x7f3ef0005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:50.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.739+0000 7f3f04d99640 1 -- 172.21.15.152:0/1453524536 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ef8009de0 con 0x7f3f08100b30 2024-09-11T22:12:50.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.941+0000 7f3f0d11e640 1 -- 172.21.15.152:0/1453524536 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f081ab820 con 0x7f3f08100b30 2024-09-11T22:12:50.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.942+0000 7f3f04d99640 1 -- 172.21.15.152:0/1453524536 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f3ef809bcb0 con 0x7f3f08100b30 2024-09-11T22:12:50.943 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:12:50.943 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:12:50.943 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:12:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 -- 172.21.15.152:0/1453524536 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef40a2cf0 msgr2=0x7f3ef40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef40a2cf0 0x7f3ef40a51b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3f081a0080 tx=0x7f3ef0005a20 comp rx=0 tx=0).stop 2024-09-11T22:12:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 -- 172.21.15.152:0/1453524536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f08100b30 msgr2=0x7f3f0819eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f08100b30 0x7f3f0819eaa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800d950 tx=0x7f3ef800de10 comp rx=0 tx=0).stop 2024-09-11T22:12:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 -- 172.21.15.152:0/1453524536 shutdown_connections 2024-09-11T22:12:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef40a2cf0 0x7f3ef40a51b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:50.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f08105f40 0x7f3f081a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:50.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f08101450 0x7f3f0819efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:50.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 --2- 172.21.15.152:0/1453524536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f08100b30 0x7f3f0819eaa0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:50.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 -- 172.21.15.152:0/1453524536 >> 172.21.15.152:0/1453524536 conn(0x7f3f080fc7a0 msgr2=0x7f3f0810f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:50.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 -- 172.21.15.152:0/1453524536 shutdown_connections 2024-09-11T22:12:50.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:50.944+0000 7f3f0d11e640 1 -- 172.21.15.152:0/1453524536 wait complete. 2024-09-11T22:12:51.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:51 smithi193 ceph-mon[35545]: pgmap v263: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 187 op/s 2024-09-11T22:12:51.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:51 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1453524536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:51.436 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:51 smithi152 ceph-mon[31188]: pgmap v263: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 187 op/s 2024-09-11T22:12:51.436 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:51 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1453524536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:51.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:51 smithi179 ceph-mon[35603]: pgmap v263: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 187 op/s 2024-09-11T22:12:51.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:51 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1453524536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:12:51.634 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 331a59b0 --release --await' 2024-09-11T22:12:51.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 331a59b0 --release --await 2024-09-11T22:12:51.880 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:12:52.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.364+0000 7f2495505640 1 -- 172.21.15.152:0/238943770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2490100350 msgr2=0x7f2490100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:52.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.364+0000 7f2495505640 1 --2- 172.21.15.152:0/238943770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2490100350 0x7f2490100730 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2480009cd0 tx=0x7f248002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.364+0000 7f2495505640 1 -- 172.21.15.152:0/238943770 shutdown_connections 2024-09-11T22:12:52.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.364+0000 7f2495505640 1 --2- 172.21.15.152:0/238943770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2490106f50 0x7f249010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.364+0000 7f2495505640 1 --2- 172.21.15.152:0/238943770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2490100d00 0x7f2490106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.364+0000 7f2495505640 1 --2- 172.21.15.152:0/238943770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2490100350 0x7f2490100730 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.364+0000 7f2495505640 1 -- 172.21.15.152:0/238943770 >> 172.21.15.152:0/238943770 conn(0x7f2490077210 msgr2=0x7f24900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:52.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.364+0000 7f2495505640 1 -- 172.21.15.152:0/238943770 shutdown_connections 2024-09-11T22:12:52.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.364+0000 7f2495505640 1 -- 172.21.15.152:0/238943770 wait complete. 2024-09-11T22:12:52.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.365+0000 7f2495505640 1 Processor -- start 2024-09-11T22:12:52.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.365+0000 7f2495505640 1 -- start start 2024-09-11T22:12:52.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.365+0000 7f2495505640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2490100350 0x7f2490198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.365+0000 7f2495505640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2490100d00 0x7f2490198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.365+0000 7f2495505640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2490106f50 0x7f249019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.365+0000 7f2495505640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2490111fa0 con 0x7f2490100d00 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.365+0000 7f2495505640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2490111e20 con 0x7f2490106f50 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.365+0000 7f2495505640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2490112120 con 0x7f2490100350 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f248e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2490100d00 0x7f2490198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f248e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2490100d00 0x7f2490198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36362/0 (socket says 172.21.15.152:36362) 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f248e7fc640 1 -- 172.21.15.152:0/1586714271 learned_addr learned my addr 172.21.15.152:0/1586714271 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f248f7fe640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2490106f50 0x7f249019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f248effd640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2490100350 0x7f2490198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f248e7fc640 1 -- 172.21.15.152:0/1586714271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2490100350 msgr2=0x7f2490198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:52.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f248e7fc640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2490100350 0x7f2490198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f248e7fc640 1 -- 172.21.15.152:0/1586714271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2490106f50 msgr2=0x7f249019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:52.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f248e7fc640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2490106f50 0x7f249019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f248e7fc640 1 -- 172.21.15.152:0/1586714271 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249019d5b0 con 0x7f2490100d00 2024-09-11T22:12:52.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f248e7fc640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2490100d00 0x7f2490198b40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f248400c970 tx=0x7f248400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:52.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f2477fff640 1 -- 172.21.15.152:0/1586714271 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484007bb0 con 0x7f2490100d00 2024-09-11T22:12:52.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f2477fff640 1 -- 172.21.15.152:0/1586714271 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2484007d50 con 0x7f2490100d00 2024-09-11T22:12:52.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f2477fff640 1 -- 172.21.15.152:0/1586714271 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248400f450 con 0x7f2490100d00 2024-09-11T22:12:52.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f2495505640 1 -- 172.21.15.152:0/1586714271 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249019d8a0 con 0x7f2490100d00 2024-09-11T22:12:52.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.366+0000 7f2495505640 1 -- 172.21.15.152:0/1586714271 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249019dd00 con 0x7f2490100d00 2024-09-11T22:12:52.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.369+0000 7f2477fff640 1 -- 172.21.15.152:0/1586714271 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f24840046c0 con 0x7f2490100d00 2024-09-11T22:12:52.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.369+0000 7f24978de740 1 Processor -- start 2024-09-11T22:12:52.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.369+0000 7f24978de740 1 -- start start 2024-09-11T22:12:52.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.369+0000 7f24978de740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35060 0x55d7f3f35440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.369+0000 7f2477fff640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24780a2cf0 0x7f24780a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.369+0000 7f24978de740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35980 0x55d7f3f3fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.369+0000 7f24978de740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f40240 0x55d7f3f42630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.369+0000 7f24978de740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d7f3e9a620 con 0x55d7f3f35060 2024-09-11T22:12:52.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.369+0000 7f24978de740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d7f3e41e50 con 0x55d7f3f40240 2024-09-11T22:12:52.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.369+0000 7f24978de740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d7f3e965e0 con 0x55d7f3f35980 2024-09-11T22:12:52.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35060 0x55d7f3f35440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248effd640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24780a2cf0 0x7f24780a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35060 0x55d7f3f35440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36378/0 (socket says 172.21.15.152:36378) 2024-09-11T22:12:52.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248f7fe640 1 -- 172.21.15.152:0/3251674612 learned_addr learned my addr 172.21.15.152:0/3251674612 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:52.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248f7fe640 1 --2- 172.21.15.152:0/3251674612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f40240 0x55d7f3f42630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f2477fff640 1 -- 172.21.15.152:0/1586714271 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f24840cf520 con 0x7f2490100d00 2024-09-11T22:12:52.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248e7fc640 1 --2- 172.21.15.152:0/3251674612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35980 0x55d7f3f3fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248f7fe640 1 -- 172.21.15.152:0/3251674612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35980 msgr2=0x55d7f3f3fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:52.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248f7fe640 1 --2- 172.21.15.152:0/3251674612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35980 0x55d7f3f3fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248f7fe640 1 -- 172.21.15.152:0/3251674612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f40240 msgr2=0x55d7f3f42630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:52.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248f7fe640 1 --2- 172.21.15.152:0/3251674612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f40240 0x55d7f3f42630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248f7fe640 1 -- 172.21.15.152:0/3251674612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f3e32d40 con 0x55d7f3f35060 2024-09-11T22:12:52.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248effd640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24780a2cf0 0x7f24780a51b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2480006010 tx=0x7f2480009800 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:52.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f248f7fe640 1 --2- 172.21.15.152:0/3251674612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35060 0x55d7f3f35440 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2488005d50 tx=0x7f248800a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd0d5878fa5c762 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:52.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f24757fa640 1 -- 172.21.15.152:0/3251674612 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488005220 con 0x55d7f3f35060 2024-09-11T22:12:52.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f24757fa640 1 -- 172.21.15.152:0/3251674612 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2488014e40 con 0x55d7f3f35060 2024-09-11T22:12:52.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.370+0000 7f24757fa640 1 -- 172.21.15.152:0/3251674612 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248800d740 con 0x55d7f3f35060 2024-09-11T22:12:52.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.371+0000 7f24978de740 1 -- 172.21.15.152:0/3251674612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35060 msgr2=0x55d7f3f35440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:52.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.371+0000 7f24978de740 1 --2- 172.21.15.152:0/3251674612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35060 0x55d7f3f35440 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2488005d50 tx=0x7f248800a580 comp rx=0 tx=0).stop 2024-09-11T22:12:52.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.371+0000 7f24978de740 1 -- 172.21.15.152:0/3251674612 shutdown_connections 2024-09-11T22:12:52.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.371+0000 7f24978de740 1 --2- 172.21.15.152:0/3251674612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f40240 0x55d7f3f42630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.371+0000 7f24978de740 1 --2- 172.21.15.152:0/3251674612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35980 0x55d7f3f3fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.371+0000 7f24978de740 1 --2- 172.21.15.152:0/3251674612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35060 0x55d7f3f35440 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.371+0000 7f24978de740 1 -- 172.21.15.152:0/3251674612 >> 172.21.15.152:0/3251674612 conn(0x55d7f3f315f0 msgr2=0x55d7f3f319d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:52.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.371+0000 7f24978de740 1 -- 172.21.15.152:0/3251674612 shutdown_connections 2024-09-11T22:12:52.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.371+0000 7f24978de740 1 -- 172.21.15.152:0/3251674612 wait complete. 2024-09-11T22:12:52.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f24978de740 1 -- start start 2024-09-11T22:12:52.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f24978de740 1 Processor -- start 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f24978de740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 0x55d7f3f3d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f24978de740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35980 0x55d7f3f3d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f24978de740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f40240 0x55d7f3f3db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f24978de740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d7f3f42e10 con 0x55d7f3f40240 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f24978de740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d7f3e22f10 con 0x55d7f3f35060 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f24978de740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d7f3f42f90 con 0x55d7f3f35980 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f24978de740 10 client.0 _ll_register_callbacks cb 0x55d7f3e46db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f248f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f40240 0x55d7f3f3db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f248f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f40240 0x55d7f3f3db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36380/0 (socket says 172.21.15.152:36380) 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f248f7fe640 1 -- 172.21.15.152:0/2925858452 learned_addr learned my addr 172.21.15.152:0/2925858452 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f248effd640 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 0x55d7f3f3d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f248e7fc640 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35980 0x55d7f3f3d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f248f7fe640 1 -- 172.21.15.152:0/2925858452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35980 msgr2=0x55d7f3f3d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:52.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f248f7fe640 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35980 0x55d7f3f3d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f248f7fe640 1 -- 172.21.15.152:0/2925858452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 msgr2=0x55d7f3f3d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:52.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f248f7fe640 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 0x55d7f3f3d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f248f7fe640 1 -- 172.21.15.152:0/2925858452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f3ba9580 con 0x55d7f3f40240 2024-09-11T22:12:52.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.372+0000 7f248effd640 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 0x55d7f3f3d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:52.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f248f7fe640 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f40240 0x55d7f3f3db50 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2488005770 tx=0x7f248800ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c7a371945c1124 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:52.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f2472ff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:52.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f2472ff5640 1 -- 172.21.15.152:0/2925858452 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488023030 con 0x55d7f3f40240 2024-09-11T22:12:52.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f2472ff5640 1 -- 172.21.15.152:0/2925858452 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f24880048d0 con 0x55d7f3f40240 2024-09-11T22:12:52.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f24978de740 1 -- 172.21.15.152:0/2925858452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d7f3ea7b90 con 0x55d7f3f40240 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f2472ff5640 1 -- 172.21.15.152:0/2925858452 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f248800aaf0 con 0x55d7f3f40240 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f24978de740 10 client.17565 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f24978de740 1 -- 172.21.15.152:0/2925858452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d7f3c73960 con 0x55d7f3f40240 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f2472ff5640 1 -- 172.21.15.152:0/2925858452 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d7f3ea7b90 con 0x55d7f3f40240 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f2472ff5640 1 -- 172.21.15.152:0/2925858452 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f248802a4c0 con 0x55d7f3f40240 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f24978de740 10 client.17565 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f24978de740 10 client.17565 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f24978de740 20 client.17565 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f24978de740 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7f3f4fbd0 0x55d7f3f51fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f24978de740 4 client.17565 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.373+0000 7f24978de740 1 -- 172.21.15.152:0/2925858452 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7f3ea20a0 con 0x55d7f3f4fbd0 2024-09-11T22:12:52.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.374+0000 7f248effd640 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7f3f4fbd0 0x55d7f3f51fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.374+0000 7f2472ff5640 10 client.17565 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.374+0000 7f248effd640 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7f3f4fbd0 0x55d7f3f51fc0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=931b1da3e603dfd8 server_cookie=b917fe7a482b09f6 in_seq=0 out_seq=0 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f2472ff5640 1 -- 172.21.15.152:0/2925858452 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7f3ea20a0 con 0x55d7f3f4fbd0 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f2472ff5640 10 client.17565 handle_command_reply: tid=0 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 1 client.17565 shutdown 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 1 -- 172.21.15.152:0/2925858452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f40240 msgr2=0x55d7f3f3db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f40240 0x55d7f3f3db50 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2488005770 tx=0x7f248800ad10 comp rx=0 tx=0).stop 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 1 -- 172.21.15.152:0/2925858452 shutdown_connections 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7f3f4fbd0 0x55d7f3f51fc0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f40240 0x55d7f3f3db50 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35980 0x55d7f3f3d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f2472ff5640 0 client.17565 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:52.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 1 --2- 172.21.15.152:0/2925858452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 0x55d7f3f3d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 1 -- 172.21.15.152:0/2925858452 >> 172.21.15.152:0/2925858452 conn(0x55d7f3f315f0 msgr2=0x55d7f3f372d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:52.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 1 -- 172.21.15.152:0/2925858452 shutdown_connections 2024-09-11T22:12:52.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 1 -- 172.21.15.152:0/2925858452 wait complete. 2024-09-11T22:12:52.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.375+0000 7f24978de740 20 client.17565 trim_cache size 0 max 16384 2024-09-11T22:12:52.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f24978de740 1 Processor -- start 2024-09-11T22:12:52.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f24978de740 1 -- start start 2024-09-11T22:12:52.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f24978de740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35060 0x55d7f3f30640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f24978de740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f57560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f24978de740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f40240 0x55d7f3f57aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f24978de740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24901b26c0 con 0x55d7f3f35980 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f24978de740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24901aff90 con 0x55d7f3f40240 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f24978de740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f24901ade00 con 0x55d7f3f35060 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f248e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f57560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f248e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f57560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36382/0 (socket says 172.21.15.152:36382) 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f248e7fc640 1 -- 172.21.15.152:0/4033320570 learned_addr learned my addr 172.21.15.152:0/4033320570 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f248effd640 1 --2- 172.21.15.152:0/4033320570 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35060 0x55d7f3f30640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f248e7fc640 1 -- 172.21.15.152:0/4033320570 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35060 msgr2=0x55d7f3f30640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f248e7fc640 1 --2- 172.21.15.152:0/4033320570 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35060 0x55d7f3f30640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f248e7fc640 1 -- 172.21.15.152:0/4033320570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f40240 msgr2=0x55d7f3f57aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:52.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f248f7fe640 1 --2- 172.21.15.152:0/4033320570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f40240 0x55d7f3f57aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f248e7fc640 1 --2- 172.21.15.152:0/4033320570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f40240 0x55d7f3f57aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f248e7fc640 1 -- 172.21.15.152:0/4033320570 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f3f357b0 con 0x55d7f3f35980 2024-09-11T22:12:52.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.392+0000 7f248e7fc640 1 --2- 172.21.15.152:0/4033320570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f57560 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f24840cccc0 tx=0x7f248409b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696d8066825d4584 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:52.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f2474ff9640 1 -- 172.21.15.152:0/4033320570 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248401d040 con 0x55d7f3f35980 2024-09-11T22:12:52.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f2474ff9640 1 -- 172.21.15.152:0/4033320570 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f248409b9e0 con 0x55d7f3f35980 2024-09-11T22:12:52.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f2474ff9640 1 -- 172.21.15.152:0/4033320570 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24840a12a0 con 0x55d7f3f35980 2024-09-11T22:12:52.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f24978de740 1 -- 172.21.15.152:0/4033320570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 msgr2=0x55d7f3f57560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:52.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f24978de740 1 --2- 172.21.15.152:0/4033320570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f57560 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f24840cccc0 tx=0x7f248409b8b0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f24978de740 1 -- 172.21.15.152:0/4033320570 shutdown_connections 2024-09-11T22:12:52.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f24978de740 1 --2- 172.21.15.152:0/4033320570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f40240 0x55d7f3f57aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f24978de740 1 --2- 172.21.15.152:0/4033320570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f57560 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f24978de740 1 --2- 172.21.15.152:0/4033320570 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f35060 0x55d7f3f30640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f24978de740 1 -- 172.21.15.152:0/4033320570 >> 172.21.15.152:0/4033320570 conn(0x55d7f3f315f0 msgr2=0x55d7f3f2ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:52.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f24978de740 1 -- 172.21.15.152:0/4033320570 shutdown_connections 2024-09-11T22:12:52.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f24978de740 1 -- 172.21.15.152:0/4033320570 wait complete. 2024-09-11T22:12:52.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.393+0000 7f24978de740 1 -- start start 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f24978de740 1 Processor -- start 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f24978de740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 0x55d7f3f483c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f24978de740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f48900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f24978de740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f40240 0x55d7f3f451b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f24978de740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24901ae450 con 0x55d7f3f35980 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f24978de740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24901af8c0 con 0x55d7f3f35060 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f24978de740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f24901aeb20 con 0x55d7f3f40240 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f24978de740 10 client.0 _ll_register_callbacks cb 0x7f2488014730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f248e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f48900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f248e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f48900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36396/0 (socket says 172.21.15.152:36396) 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f248e7fc640 1 -- 172.21.15.152:0/2756013592 learned_addr learned my addr 172.21.15.152:0/2756013592 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f248effd640 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 0x55d7f3f483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f248e7fc640 1 -- 172.21.15.152:0/2756013592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f40240 msgr2=0x55d7f3f451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f248e7fc640 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f40240 0x55d7f3f451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f248e7fc640 1 -- 172.21.15.152:0/2756013592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 msgr2=0x55d7f3f483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f248e7fc640 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 0x55d7f3f483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f248e7fc640 1 -- 172.21.15.152:0/2756013592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f3f52330 con 0x55d7f3f35980 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f248effd640 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 0x55d7f3f483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f248e7fc640 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f48900 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f248409b6e0 tx=0x7f248409cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32715573137d4348 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.394+0000 7f2472ff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f2472ff5640 1 -- 172.21.15.152:0/2756013592 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24840b3070 con 0x55d7f3f35980 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f2472ff5640 1 -- 172.21.15.152:0/2756013592 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f24840b4de0 con 0x55d7f3f35980 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f24978de740 1 -- 172.21.15.152:0/2756013592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f248409b9e0 con 0x55d7f3f35980 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f2472ff5640 1 -- 172.21.15.152:0/2756013592 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f248401d070 con 0x55d7f3f35980 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f24978de740 10 client.17571 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f24978de740 1 -- 172.21.15.152:0/2756013592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d7f3fbae00 con 0x55d7f3f35980 2024-09-11T22:12:52.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f2472ff5640 1 -- 172.21.15.152:0/2756013592 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f248409b9e0 con 0x55d7f3f35980 2024-09-11T22:12:52.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f2472ff5640 1 -- 172.21.15.152:0/2756013592 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f248409bc40 con 0x55d7f3f35980 2024-09-11T22:12:52.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f24978de740 10 client.17571 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:52.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f24978de740 10 client.17571 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:12:52.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f24978de740 20 client.17571 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:52.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f24978de740 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7f3fbb490 0x55d7f3fbd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:52.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f24978de740 4 client.17571 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "331a59b0", "release": true, "await": true}] 2024-09-11T22:12:52.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f24978de740 1 -- 172.21.15.152:0/2756013592 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "331a59b0", "release": true, "await": true}) -- 0x55d7f3f2c950 con 0x55d7f3fbb490 2024-09-11T22:12:52.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.395+0000 7f248effd640 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7f3fbb490 0x55d7f3fbd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:52.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.396+0000 7f248effd640 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7f3fbb490 0x55d7f3fbd8b0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8a54196305867b8 server_cookie=ec9cd05323f275d5 in_seq=0 out_seq=0 2024-09-11T22:12:52.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.396+0000 7f2472ff5640 10 client.17571 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.449+0000 7f2472ff5640 1 -- 172.21.15.152:0/2756013592 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d7f3f2c950 con 0x55d7f3fbb490 2024-09-11T22:12:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.449+0000 7f2472ff5640 10 client.17571 handle_command_reply: tid=0 2024-09-11T22:12:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.449+0000 7f24978de740 1 client.17571 shutdown 2024-09-11T22:12:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.451+0000 7f24978de740 1 -- 172.21.15.152:0/2756013592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 msgr2=0x55d7f3f48900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.451+0000 7f24978de740 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f48900 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f248409b6e0 tx=0x7f248409cc40 comp rx=0 tx=0).stop 2024-09-11T22:12:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.451+0000 7f24978de740 1 -- 172.21.15.152:0/2756013592 shutdown_connections 2024-09-11T22:12:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.451+0000 7f24978de740 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d7f3fbb490 0x55d7f3fbd8b0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.451+0000 7f24978de740 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d7f3f40240 0x55d7f3f451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.451+0000 7f24978de740 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d7f3f35980 0x55d7f3f48900 secure :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f248409b6e0 tx=0x7f248409cc40 comp rx=0 tx=0).stop 2024-09-11T22:12:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.451+0000 7f24978de740 1 --2- 172.21.15.152:0/2756013592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f3f35060 0x55d7f3f483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.451+0000 7f24978de740 1 -- 172.21.15.152:0/2756013592 >> 172.21.15.152:0/2756013592 conn(0x55d7f3f315f0 msgr2=0x55d7f3f30750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.451+0000 7f2472ff5640 0 client.17571 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:52.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.452+0000 7f24978de740 1 -- 172.21.15.152:0/2756013592 shutdown_connections 2024-09-11T22:12:52.454 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:12:52.454 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 36, 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: "331a59b0": { 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 36, 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:12:52.455 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 139.4, 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:12:52.456 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:12:52.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.452+0000 7f24978de740 1 -- 172.21.15.152:0/2756013592 wait complete. 2024-09-11T22:12:52.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.452+0000 7f24978de740 20 client.17571 trim_cache size 0 max 16384 2024-09-11T22:12:52.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.453+0000 7f2495505640 1 -- 172.21.15.152:0/1586714271 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24780a2cf0 msgr2=0x7f24780a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.453+0000 7f2495505640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24780a2cf0 0x7f24780a51b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2480006010 tx=0x7f2480009800 comp rx=0 tx=0).stop 2024-09-11T22:12:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.453+0000 7f2495505640 1 -- 172.21.15.152:0/1586714271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2490100d00 msgr2=0x7f2490198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.453+0000 7f2495505640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2490100d00 0x7f2490198b40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f248400c970 tx=0x7f248400ce30 comp rx=0 tx=0).stop 2024-09-11T22:12:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.453+0000 7f2495505640 1 -- 172.21.15.152:0/1586714271 shutdown_connections 2024-09-11T22:12:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.453+0000 7f2495505640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24780a2cf0 0x7f24780a51b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.453+0000 7f2495505640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2490106f50 0x7f249019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.453+0000 7f2495505640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2490100d00 0x7f2490198b40 secure :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f248400c970 tx=0x7f248400ce30 comp rx=0 tx=0).stop 2024-09-11T22:12:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.453+0000 7f2495505640 1 --2- 172.21.15.152:0/1586714271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2490100350 0x7f2490198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.453+0000 7f2495505640 1 -- 172.21.15.152:0/1586714271 >> 172.21.15.152:0/1586714271 conn(0x7f2490077210 msgr2=0x7f24900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.453+0000 7f2495505640 1 -- 172.21.15.152:0/1586714271 shutdown_connections 2024-09-11T22:12:52.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:12:52.454+0000 7f2495505640 1 -- 172.21.15.152:0/1586714271 wait complete. 2024-09-11T22:12:53.248 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '331a59b0', total seconds elapsed: 22.6 2024-09-11T22:12:53.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:53 smithi193 ceph-mon[35545]: pgmap v264: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.0 MiB/s wr, 115 op/s 2024-09-11T22:12:53.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:53 smithi152 ceph-mon[31188]: pgmap v264: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.0 MiB/s wr, 115 op/s 2024-09-11T22:12:53.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:53 smithi179 ceph-mon[35603]: pgmap v264: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.0 MiB/s wr, 115 op/s 2024-09-11T22:12:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 440.0 s, 1850.3 tps, lat 218.709 ms stddev 1852.529 2024-09-11T22:12:55.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:55 smithi193 ceph-mon[35545]: pgmap v265: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.6 MiB/s wr, 162 op/s 2024-09-11T22:12:55.348 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:55 smithi152 ceph-mon[31188]: pgmap v265: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.6 MiB/s wr, 162 op/s 2024-09-11T22:12:55.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:55 smithi179 ceph-mon[35603]: pgmap v265: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.6 MiB/s wr, 162 op/s 2024-09-11T22:12:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.565+0000 7f4174af1640 1 -- 172.21.15.152:0/3321363580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4170101380 msgr2=0x7f417006a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.565+0000 7f4174af1640 1 --2- 172.21.15.152:0/3321363580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4170101380 0x7f417006a380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4168009be0 tx=0x7f416802a6c0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.565+0000 7f4174af1640 1 -- 172.21.15.152:0/3321363580 shutdown_connections 2024-09-11T22:12:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.565+0000 7f4174af1640 1 --2- 172.21.15.152:0/3321363580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4170101380 0x7f417006a380 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.565+0000 7f4174af1640 1 --2- 172.21.15.152:0/3321363580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41701009e0 0x7f4170100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.565+0000 7f4174af1640 1 --2- 172.21.15.152:0/3321363580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41701069f0 0x7f4170106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.565+0000 7f4174af1640 1 -- 172.21.15.152:0/3321363580 >> 172.21.15.152:0/3321363580 conn(0x7f41700fc6c0 msgr2=0x7f41700feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.565+0000 7f4174af1640 1 -- 172.21.15.152:0/3321363580 shutdown_connections 2024-09-11T22:12:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.565+0000 7f4174af1640 1 -- 172.21.15.152:0/3321363580 wait complete. 2024-09-11T22:12:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.566+0000 7f4174af1640 1 Processor -- start 2024-09-11T22:12:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.566+0000 7f4174af1640 1 -- start start 2024-09-11T22:12:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.566+0000 7f4174af1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41701009e0 0x7f41701a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.566+0000 7f4174af1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4170101380 0x7f41701a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f4174af1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41701069f0 0x7f417019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f4174af1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41701140f0 con 0x7f41701069f0 2024-09-11T22:12:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f4174af1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4170113f70 con 0x7f4170101380 2024-09-11T22:12:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f4174af1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4170114270 con 0x7f41701009e0 2024-09-11T22:12:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f416e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41701009e0 0x7f41701a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f416dd9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4170101380 0x7f41701a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f416dd9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4170101380 0x7f41701a0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:49432/0 (socket says 172.21.15.152:49432) 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f416dd9b640 1 -- 172.21.15.152:0/1034095783 learned_addr learned my addr 172.21.15.152:0/1034095783 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f416dd9b640 1 -- 172.21.15.152:0/1034095783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41701009e0 msgr2=0x7f41701a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f416dd9b640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41701009e0 0x7f41701a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f416dd9b640 1 -- 172.21.15.152:0/1034095783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41701069f0 msgr2=0x7f417019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f416dd9b640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41701069f0 0x7f417019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f416dd9b640 1 -- 172.21.15.152:0/1034095783 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417019ad80 con 0x7f4170101380 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.567+0000 7f416dd9b640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4170101380 0x7f41701a0990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f416400bf40 tx=0x7f416400dd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.568+0000 7f415f7fe640 1 -- 172.21.15.152:0/1034095783 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416401c070 con 0x7f4170101380 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.568+0000 7f415f7fe640 1 -- 172.21.15.152:0/1034095783 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f416401a070 con 0x7f4170101380 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.568+0000 7f415f7fe640 1 -- 172.21.15.152:0/1034095783 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4164009b10 con 0x7f4170101380 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.568+0000 7f4174af1640 1 -- 172.21.15.152:0/1034095783 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417019b070 con 0x7f4170101380 2024-09-11T22:12:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.568+0000 7f4174af1640 1 -- 172.21.15.152:0/1034095783 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417010fac0 con 0x7f4170101380 2024-09-11T22:12:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.572+0000 7f4177892740 1 Processor -- start 2024-09-11T22:12:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.572+0000 7f415f7fe640 1 -- 172.21.15.152:0/1034095783 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f4164009cb0 con 0x7f4170101380 2024-09-11T22:12:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.572+0000 7f4177892740 1 -- start start 2024-09-11T22:12:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.572+0000 7f4177892740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd7aaf0 0x56460fd7aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.572+0000 7f4177892740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd85770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.572+0000 7f4177892740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd85cb0 0x56460fd880a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.572+0000 7f4177892740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56460fcdf2f0 con 0x56460fd7aaf0 2024-09-11T22:12:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.572+0000 7f4177892740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56460fc87270 con 0x56460fd85cb0 2024-09-11T22:12:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.572+0000 7f4177892740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56460fcdb2b0 con 0x56460fd7b410 2024-09-11T22:12:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.573+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd7aaf0 0x56460fd7aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.573+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd7aaf0 0x56460fd7aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44716/0 (socket says 172.21.15.152:44716) 2024-09-11T22:12:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.573+0000 7f416ed9d640 1 -- 172.21.15.152:0/4090059645 learned_addr learned my addr 172.21.15.152:0/4090059645 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.573+0000 7f416ed9d640 1 -- 172.21.15.152:0/4090059645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 msgr2=0x56460fd85770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:12:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.573+0000 7f416ed9d640 1 --2- 172.21.15.152:0/4090059645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd85770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.573+0000 7f416ed9d640 1 -- 172.21.15.152:0/4090059645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd85cb0 msgr2=0x56460fd880a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.574+0000 7f416dd9b640 1 --2- 172.21.15.152:0/4090059645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd85cb0 0x56460fd880a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.574+0000 7f415f7fe640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41580a2f00 0x7f41580a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.574+0000 7f416ed9d640 1 --2- 172.21.15.152:0/4090059645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd85cb0 0x56460fd880a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.574+0000 7f416ed9d640 1 -- 172.21.15.152:0/4090059645 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460fc86340 con 0x56460fd7aaf0 2024-09-11T22:12:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.574+0000 7f416dd9b640 1 --2- 172.21.15.152:0/4090059645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd85cb0 0x56460fd880a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.574+0000 7f415f7fe640 1 -- 172.21.15.152:0/1034095783 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f41640d6ed0 con 0x7f4170101380 2024-09-11T22:12:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.574+0000 7f416e59c640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41580a2f00 0x7f41580a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.574+0000 7f416ed9d640 1 --2- 172.21.15.152:0/4090059645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd7aaf0 0x56460fd7aed0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f4168004af0 tx=0x7f41680314d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9435ca6fde2637f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.575+0000 7f415cff9640 1 -- 172.21.15.152:0/4090059645 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168040020 con 0x56460fd7aaf0 2024-09-11T22:12:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.575+0000 7f415cff9640 1 -- 172.21.15.152:0/4090059645 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4168030c30 con 0x56460fd7aaf0 2024-09-11T22:12:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.575+0000 7f416e59c640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41580a2f00 0x7f41580a53c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x56460fd77ec0 tx=0x7f4160009260 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.575+0000 7f415cff9640 1 -- 172.21.15.152:0/4090059645 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168036040 con 0x56460fd7aaf0 2024-09-11T22:12:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.576+0000 7f4177892740 1 -- 172.21.15.152:0/4090059645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd7aaf0 msgr2=0x56460fd7aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.576+0000 7f4177892740 1 --2- 172.21.15.152:0/4090059645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd7aaf0 0x56460fd7aed0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f4168004af0 tx=0x7f41680314d0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.576+0000 7f4177892740 1 -- 172.21.15.152:0/4090059645 shutdown_connections 2024-09-11T22:12:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.576+0000 7f4177892740 1 --2- 172.21.15.152:0/4090059645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd85cb0 0x56460fd880a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.576+0000 7f4177892740 1 --2- 172.21.15.152:0/4090059645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd85770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.576+0000 7f4177892740 1 --2- 172.21.15.152:0/4090059645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd7aaf0 0x56460fd7aed0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.576+0000 7f4177892740 1 -- 172.21.15.152:0/4090059645 >> 172.21.15.152:0/4090059645 conn(0x56460fd77060 msgr2=0x56460fd77440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.576+0000 7f4177892740 1 -- 172.21.15.152:0/4090059645 shutdown_connections 2024-09-11T22:12:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.576+0000 7f4177892740 1 -- 172.21.15.152:0/4090059645 wait complete. 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.577+0000 7f4177892740 1 -- start start 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.577+0000 7f4177892740 1 Processor -- start 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f4177892740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 0x56460fd82c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f4177892740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd83160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f4177892740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f4177892740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56460fd888d0 con 0x56460fd85cb0 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f4177892740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56460fc68290 con 0x56460fd7aaf0 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f4177892740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56460fd88a50 con 0x56460fd7b410 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd836a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44728/0 (socket says 172.21.15.152:44728) 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f416ed9d640 1 -- 172.21.15.152:0/1648071445 learned_addr learned my addr 172.21.15.152:0/1648071445 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f416dd9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd83160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f416e59c640 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 0x56460fd82c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.578+0000 7f4177892740 10 client.0 _ll_register_callbacks cb 0x56460fc99140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.579+0000 7f416e59c640 1 -- 172.21.15.152:0/1648071445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 msgr2=0x56460fd83160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.579+0000 7f416e59c640 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd83160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.579+0000 7f416e59c640 1 -- 172.21.15.152:0/1648071445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 msgr2=0x56460fd836a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.579+0000 7f416e59c640 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd836a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.579+0000 7f416e59c640 1 -- 172.21.15.152:0/1648071445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56460f9f2210 con 0x56460fd7aaf0 2024-09-11T22:12:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.579+0000 7f416e59c640 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 0x56460fd82c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4160005fd0 tx=0x7f4160004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e6ad7b0775795e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.579+0000 7f4155ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.579+0000 7f4155ffb640 1 -- 172.21.15.152:0/1648071445 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416000e990 con 0x56460fd7aaf0 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.579+0000 7f4155ffb640 1 -- 172.21.15.152:0/1648071445 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f416000eb30 con 0x56460fd7aaf0 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.579+0000 7f4177892740 1 -- 172.21.15.152:0/1648071445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4168030c30 con 0x56460fd7aaf0 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.580+0000 7f4155ffb640 1 -- 172.21.15.152:0/1648071445 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f416000ed30 con 0x56460fd7aaf0 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.580+0000 7f4177892740 10 client.26927 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.580+0000 7f4177892740 1 -- 172.21.15.152:0/1648071445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56460fabe620 con 0x56460fd7aaf0 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.580+0000 7f4155ffb640 1 -- 172.21.15.152:0/1648071445 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4168030c30 con 0x56460fd7aaf0 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.580+0000 7f4155ffb640 1 -- 172.21.15.152:0/1648071445 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f416001e6c0 con 0x56460fd7aaf0 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.580+0000 7f4177892740 10 client.26927 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.580+0000 7f4177892740 10 client.26927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.580+0000 7f4177892740 20 client.26927 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.580+0000 7f4177892740 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56460fd95c70 0x56460fd98060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.580+0000 7f4177892740 4 client.26927 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.580+0000 7f4177892740 1 -- 172.21.15.152:0/1648071445 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56460fceca20 con 0x56460fd95c70 2024-09-11T22:12:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.581+0000 7f416dd9b640 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56460fd95c70 0x56460fd98060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.581+0000 7f416dd9b640 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56460fd95c70 0x56460fd98060 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97fcb8e941af5771 server_cookie=7ef4b4fa6b5a4a61 in_seq=0 out_seq=0 2024-09-11T22:12:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.581+0000 7f4155ffb640 10 client.26927 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4155ffb640 1 -- 172.21.15.152:0/1648071445 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56460fceca20 con 0x56460fd95c70 2024-09-11T22:12:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4155ffb640 10 client.26927 handle_command_reply: tid=0 2024-09-11T22:12:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 1 client.26927 shutdown 2024-09-11T22:12:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 1 -- 172.21.15.152:0/1648071445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 msgr2=0x56460fd82c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 0x56460fd82c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4160005fd0 tx=0x7f4160004730 comp rx=0 tx=0).stop 2024-09-11T22:12:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 1 -- 172.21.15.152:0/1648071445 shutdown_connections 2024-09-11T22:12:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56460fd95c70 0x56460fd98060 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd836a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd83160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 1 --2- 172.21.15.152:0/1648071445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 0x56460fd82c20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 1 -- 172.21.15.152:0/1648071445 >> 172.21.15.152:0/1648071445 conn(0x56460fd77060 msgr2=0x56460fd7cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4155ffb640 0 client.26927 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 1 -- 172.21.15.152:0/1648071445 shutdown_connections 2024-09-11T22:12:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 1 -- 172.21.15.152:0/1648071445 wait complete. 2024-09-11T22:12:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.583+0000 7f4177892740 20 client.26927 trim_cache size 0 max 16384 2024-09-11T22:12:56.608 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.607+0000 7f4177892740 1 Processor -- start 2024-09-11T22:12:56.608 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.607+0000 7f4177892740 1 -- start start 2024-09-11T22:12:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.607+0000 7f4177892740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 0x56460fd834d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.607+0000 7f4177892740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd84b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f416e59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 0x56460fd834d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f416e59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 0x56460fd834d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:49466/0 (socket says 172.21.15.152:49466) 2024-09-11T22:12:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f416e59c640 1 -- 172.21.15.152:0/3004782926 learned_addr learned my addr 172.21.15.152:0/3004782926 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f416dd9b640 1 --2- 172.21.15.152:0/3004782926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd84b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f4177892740 1 --2- 172.21.15.152:0/3004782926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd9d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f4177892740 1 -- 172.21.15.152:0/3004782926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41701adfb0 con 0x56460fd85cb0 2024-09-11T22:12:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f4177892740 1 -- 172.21.15.152:0/3004782926 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f41701ab880 con 0x56460fd7aaf0 2024-09-11T22:12:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f4177892740 1 -- 172.21.15.152:0/3004782926 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f41701a96f0 con 0x56460fd7b410 2024-09-11T22:12:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f416e59c640 1 -- 172.21.15.152:0/3004782926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 msgr2=0x56460fd84b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f416e59c640 1 --2- 172.21.15.152:0/3004782926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd84b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f416e59c640 1 -- 172.21.15.152:0/3004782926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 msgr2=0x56460fd9d950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:12:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f416e59c640 1 --2- 172.21.15.152:0/3004782926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd9d950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f416e59c640 1 -- 172.21.15.152:0/3004782926 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460fd722d0 con 0x56460fd7aaf0 2024-09-11T22:12:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f416dd9b640 1 --2- 172.21.15.152:0/3004782926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd84b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.608+0000 7f416e59c640 1 --2- 172.21.15.152:0/3004782926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 0x56460fd834d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4160010810 tx=0x7f4160009970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc91420f56cdd598 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.609+0000 7f4157fff640 1 -- 172.21.15.152:0/3004782926 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160035070 con 0x56460fd7aaf0 2024-09-11T22:12:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.609+0000 7f4157fff640 1 -- 172.21.15.152:0/3004782926 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f416001e420 con 0x56460fd7aaf0 2024-09-11T22:12:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.609+0000 7f4157fff640 1 -- 172.21.15.152:0/3004782926 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600037f0 con 0x56460fd7aaf0 2024-09-11T22:12:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.610+0000 7f4177892740 1 -- 172.21.15.152:0/3004782926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 msgr2=0x56460fd834d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.610+0000 7f4177892740 1 --2- 172.21.15.152:0/3004782926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 0x56460fd834d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4160010810 tx=0x7f4160009970 comp rx=0 tx=0).stop 2024-09-11T22:12:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.610+0000 7f4177892740 1 -- 172.21.15.152:0/3004782926 shutdown_connections 2024-09-11T22:12:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.610+0000 7f4177892740 1 --2- 172.21.15.152:0/3004782926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd9d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.610+0000 7f4177892740 1 --2- 172.21.15.152:0/3004782926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7b410 0x56460fd84b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.610+0000 7f4177892740 1 --2- 172.21.15.152:0/3004782926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7aaf0 0x56460fd834d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.610+0000 7f4177892740 1 -- 172.21.15.152:0/3004782926 >> 172.21.15.152:0/3004782926 conn(0x56460fd77060 msgr2=0x56460fd84480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.611+0000 7f4177892740 1 -- 172.21.15.152:0/3004782926 shutdown_connections 2024-09-11T22:12:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.611+0000 7f4177892740 1 -- 172.21.15.152:0/3004782926 wait complete. 2024-09-11T22:12:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.611+0000 7f4177892740 1 -- start start 2024-09-11T22:12:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.611+0000 7f4177892740 1 Processor -- start 2024-09-11T22:12:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f4177892740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7aaf0 0x56460fd8ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f4177892740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7b410 0x56460fd8e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f4177892740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd7f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f4177892740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41701a9d40 con 0x56460fd85cb0 2024-09-11T22:12:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd7f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f416dd9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7b410 0x56460fd8e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd7f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44732/0 (socket says 172.21.15.152:44732) 2024-09-11T22:12:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f416ed9d640 1 -- 172.21.15.152:0/1368220741 learned_addr learned my addr 172.21.15.152:0/1368220741 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f416e59c640 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7aaf0 0x56460fd8ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f4177892740 1 -- 172.21.15.152:0/1368220741 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f41701ab1b0 con 0x56460fd7b410 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f4177892740 1 -- 172.21.15.152:0/1368220741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f41701aa410 con 0x56460fd7aaf0 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.612+0000 7f4177892740 10 client.0 _ll_register_callbacks cb 0x7f4160009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.613+0000 7f416e59c640 1 -- 172.21.15.152:0/1368220741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7b410 msgr2=0x56460fd8e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.613+0000 7f416e59c640 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7b410 0x56460fd8e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.613+0000 7f416e59c640 1 -- 172.21.15.152:0/1368220741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 msgr2=0x56460fd7f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.613+0000 7f416e59c640 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd7f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.613+0000 7f416e59c640 1 -- 172.21.15.152:0/1368220741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56460fd7fb70 con 0x56460fd7aaf0 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.613+0000 7f416ed9d640 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd7f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.613+0000 7f416e59c640 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7aaf0 0x56460fd8ded0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4160006010 tx=0x7f4160004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11f7d9bf0612024b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.613+0000 7f4155ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:12:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.613+0000 7f4155ffb640 1 -- 172.21.15.152:0/1368220741 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160035040 con 0x56460fd7aaf0 2024-09-11T22:12:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.613+0000 7f4155ffb640 1 -- 172.21.15.152:0/1368220741 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f4160005440 con 0x56460fd7aaf0 2024-09-11T22:12:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.613+0000 7f4177892740 1 -- 172.21.15.152:0/1368220741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f416001e420 con 0x56460fd7aaf0 2024-09-11T22:12:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.614+0000 7f4155ffb640 1 -- 172.21.15.152:0/1368220741 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f41600043c0 con 0x56460fd7aaf0 2024-09-11T22:12:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.614+0000 7f4177892740 10 client.27100 fetch_fsmap learned FSMap version 30 2024-09-11T22:12:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.614+0000 7f4177892740 1 -- 172.21.15.152:0/1368220741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56460fe00350 con 0x56460fd7aaf0 2024-09-11T22:12:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.614+0000 7f4155ffb640 1 -- 172.21.15.152:0/1368220741 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f416001e420 con 0x56460fd7aaf0 2024-09-11T22:12:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.614+0000 7f4155ffb640 1 -- 172.21.15.152:0/1368220741 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f4160003710 con 0x56460fd7aaf0 2024-09-11T22:12:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.615+0000 7f4177892740 10 client.27100 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:12:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.615+0000 7f4177892740 10 client.27100 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:12:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.615+0000 7f4177892740 20 client.27100 populate_metadata read hostname 'smithi152' 2024-09-11T22:12:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.615+0000 7f4177892740 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56460fe00a00 0x56460fe02e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.615+0000 7f4177892740 4 client.27100 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:12:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.615+0000 7f4177892740 1 -- 172.21.15.152:0/1368220741 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56460fce6d70 con 0x56460fe00a00 2024-09-11T22:12:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.615+0000 7f416dd9b640 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56460fe00a00 0x56460fe02e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.615+0000 7f4155ffb640 10 client.27100 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.615+0000 7f416dd9b640 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56460fe00a00 0x56460fe02e20 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb4d7726c8603397 server_cookie=a7d01b790039954d in_seq=0 out_seq=0 2024-09-11T22:12:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.625+0000 7f4155ffb640 1 -- 172.21.15.152:0/1368220741 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56460fce6d70 con 0x56460fe00a00 2024-09-11T22:12:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.625+0000 7f4155ffb640 10 client.27100 handle_command_reply: tid=0 2024-09-11T22:12:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.625+0000 7f4177892740 1 client.27100 shutdown 2024-09-11T22:12:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.626+0000 7f4177892740 1 -- 172.21.15.152:0/1368220741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7aaf0 msgr2=0x56460fd8ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.626+0000 7f4177892740 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7aaf0 0x56460fd8ded0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4160006010 tx=0x7f4160004250 comp rx=0 tx=0).stop 2024-09-11T22:12:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.626+0000 7f4177892740 1 -- 172.21.15.152:0/1368220741 shutdown_connections 2024-09-11T22:12:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.626+0000 7f4177892740 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56460fe00a00 0x56460fe02e20 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.626+0000 7f4177892740 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56460fd85cb0 0x56460fd7f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.626+0000 7f4177892740 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56460fd7b410 0x56460fd8e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.626+0000 7f4177892740 1 --2- 172.21.15.152:0/1368220741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56460fd7aaf0 0x56460fd8ded0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.626+0000 7f4177892740 1 -- 172.21.15.152:0/1368220741 >> 172.21.15.152:0/1368220741 conn(0x56460fd77060 msgr2=0x56460fd7cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.626+0000 7f4155ffb640 0 client.27100 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:12:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.626+0000 7f4177892740 1 -- 172.21.15.152:0/1368220741 shutdown_connections 2024-09-11T22:12:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.626+0000 7f4177892740 1 -- 172.21.15.152:0/1368220741 wait complete. 2024-09-11T22:12:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.627+0000 7f4177892740 20 client.27100 trim_cache size 0 max 16384 2024-09-11T22:12:56.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:12:56.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:12:56.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:12:56.629 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:12:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 -- 172.21.15.152:0/1034095783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41580a2f00 msgr2=0x7f41580a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41580a2f00 0x7f41580a53c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x56460fd77ec0 tx=0x7f4160009260 comp rx=0 tx=0).stop 2024-09-11T22:12:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 -- 172.21.15.152:0/1034095783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4170101380 msgr2=0x7f41701a0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4170101380 0x7f41701a0990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f416400bf40 tx=0x7f416400dd60 comp rx=0 tx=0).stop 2024-09-11T22:12:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 -- 172.21.15.152:0/1034095783 shutdown_connections 2024-09-11T22:12:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f41580a2f00 0x7f41580a53c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41701069f0 0x7f417019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4170101380 0x7f41701a0990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 --2- 172.21.15.152:0/1034095783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41701009e0 0x7f41701a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:56.630 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 -- 172.21.15.152:0/1034095783 >> 172.21.15.152:0/1034095783 conn(0x7f41700fc6c0 msgr2=0x7f4170107860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:56.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 -- 172.21.15.152:0/1034095783 shutdown_connections 2024-09-11T22:12:56.631 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:12:56.628+0000 7f4174af1640 1 -- 172.21.15.152:0/1034095783 wait complete. 2024-09-11T22:12:57.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:57 smithi193 ceph-mon[35545]: pgmap v266: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 177 op/s 2024-09-11T22:12:57.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:57 smithi152 ceph-mon[31188]: pgmap v266: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 177 op/s 2024-09-11T22:12:57.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:57 smithi179 ceph-mon[35603]: pgmap v266: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 177 op/s 2024-09-11T22:12:59.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:12:59 smithi152 ceph-mon[31188]: pgmap v267: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 176 op/s 2024-09-11T22:12:59.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:12:59 smithi179 ceph-mon[35603]: pgmap v267: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 176 op/s 2024-09-11T22:12:59.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:12:59 smithi193 ceph-mon[35545]: pgmap v267: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 176 op/s 2024-09-11T22:12:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 445.0 s, 3813.8 tps, lat 26.251 ms stddev 28.710 2024-09-11T22:13:01.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:01 smithi152 ceph-mon[31188]: pgmap v268: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 507 op/s 2024-09-11T22:13:01.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:01 smithi179 ceph-mon[35603]: pgmap v268: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 507 op/s 2024-09-11T22:13:01.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:01 smithi193 ceph-mon[35545]: pgmap v268: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 507 op/s 2024-09-11T22:13:03.347 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:03 smithi179 ceph-mon[35603]: pgmap v269: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.7 MiB/s wr, 399 op/s 2024-09-11T22:13:03.377 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:03 smithi193 ceph-mon[35545]: pgmap v269: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.7 MiB/s wr, 399 op/s 2024-09-11T22:13:03.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:03 smithi152 ceph-mon[31188]: pgmap v269: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.7 MiB/s wr, 399 op/s 2024-09-11T22:13:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 450.0 s, 903.8 tps, lat 108.377 ms stddev 130.055 2024-09-11T22:13:05.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:05 smithi152 ceph-mon[31188]: pgmap v270: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 7.7 MiB/s wr, 619 op/s 2024-09-11T22:13:05.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:05 smithi179 ceph-mon[35603]: pgmap v270: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 7.7 MiB/s wr, 619 op/s 2024-09-11T22:13:05.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:05 smithi193 ceph-mon[35545]: pgmap v270: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 7.7 MiB/s wr, 619 op/s 2024-09-11T22:13:07.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:07 smithi152 ceph-mon[31188]: pgmap v271: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.4 MiB/s wr, 696 op/s 2024-09-11T22:13:07.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:07 smithi179 ceph-mon[35603]: pgmap v271: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.4 MiB/s wr, 696 op/s 2024-09-11T22:13:07.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:07 smithi193 ceph-mon[35545]: pgmap v271: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.4 MiB/s wr, 696 op/s 2024-09-11T22:13:09.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:09 smithi152 ceph-mon[31188]: pgmap v272: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.2 MiB/s wr, 674 op/s 2024-09-11T22:13:09.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:09 smithi179 ceph-mon[35603]: pgmap v272: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.2 MiB/s wr, 674 op/s 2024-09-11T22:13:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:09 smithi193 ceph-mon[35545]: pgmap v272: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.2 MiB/s wr, 674 op/s 2024-09-11T22:13:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.739+0000 7f657c1fd640 1 -- 172.21.15.152:0/1904218866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574101ae0 msgr2=0x7f6574101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.739+0000 7f657c1fd640 1 --2- 172.21.15.152:0/1904218866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574101ae0 0x7f6574101f40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6564009900 tx=0x7f656402a410 comp rx=0 tx=0).stop 2024-09-11T22:13:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.739+0000 7f657c1fd640 1 -- 172.21.15.152:0/1904218866 shutdown_connections 2024-09-11T22:13:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.739+0000 7f657c1fd640 1 --2- 172.21.15.152:0/1904218866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6574102480 0x7f657410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.739+0000 7f657c1fd640 1 --2- 172.21.15.152:0/1904218866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574101ae0 0x7f6574101f40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.739+0000 7f657c1fd640 1 --2- 172.21.15.152:0/1904218866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6574107b80 0x7f6574107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.739+0000 7f657c1fd640 1 -- 172.21.15.152:0/1904218866 >> 172.21.15.152:0/1904218866 conn(0x7f65740fd7e0 msgr2=0x7f65740ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.739+0000 7f657c1fd640 1 -- 172.21.15.152:0/1904218866 shutdown_connections 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.739+0000 7f657c1fd640 1 -- 172.21.15.152:0/1904218866 wait complete. 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f657c1fd640 1 Processor -- start 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f657c1fd640 1 -- start start 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f657c1fd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6574101ae0 0x7f6574198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f657c1fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6574102480 0x7f6574198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f657c1fd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574107b80 0x7f657419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f657c1fd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6574111f80 con 0x7f6574101ae0 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f657c1fd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6574111e00 con 0x7f6574107b80 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f657c1fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6574112100 con 0x7f6574102480 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f6579f99640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6574101ae0 0x7f6574198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f6579f99640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6574101ae0 0x7f6574198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34768/0 (socket says 172.21.15.152:34768) 2024-09-11T22:13:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f6579f99640 1 -- 172.21.15.152:0/467587896 learned_addr learned my addr 172.21.15.152:0/467587896 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f6579798640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6574102480 0x7f6574198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f657a79a640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574107b80 0x7f657419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f6579f99640 1 -- 172.21.15.152:0/467587896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6574102480 msgr2=0x7f6574198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f6579f99640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6574102480 0x7f6574198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f6579f99640 1 -- 172.21.15.152:0/467587896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574107b80 msgr2=0x7f657419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f6579f99640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574107b80 0x7f657419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.740+0000 7f6579f99640 1 -- 172.21.15.152:0/467587896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657419d300 con 0x7f6574101ae0 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.741+0000 7f6579f99640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6574101ae0 0x7f6574198310 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f657000e9f0 tx=0x7f657000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.741+0000 7f656affd640 1 -- 172.21.15.152:0/467587896 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657000cd80 con 0x7f6574101ae0 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.741+0000 7f656affd640 1 -- 172.21.15.152:0/467587896 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6570010910 con 0x7f6574101ae0 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.741+0000 7f657c1fd640 1 -- 172.21.15.152:0/467587896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657419d5f0 con 0x7f6574101ae0 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.741+0000 7f656affd640 1 -- 172.21.15.152:0/467587896 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570018990 con 0x7f6574101ae0 2024-09-11T22:13:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.741+0000 7f657c1fd640 1 -- 172.21.15.152:0/467587896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65741a4e80 con 0x7f6574101ae0 2024-09-11T22:13:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.744+0000 7f656affd640 1 -- 172.21.15.152:0/467587896 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f6570010ac0 con 0x7f6574101ae0 2024-09-11T22:13:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.745+0000 7f656affd640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f65600a2df0 0x7f65600a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.745+0000 7f657f07e740 1 Processor -- start 2024-09-11T22:13:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f6579798640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f65600a2df0 0x7f65600a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f656affd640 1 -- 172.21.15.152:0/467587896 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8658+0+0 (secure 0 0 0) 0x7f65700cf7d0 con 0x7f6574101ae0 2024-09-11T22:13:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657f07e740 1 -- start start 2024-09-11T22:13:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657f07e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce670af0 0x55f6ce670ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657f07e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce67b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657f07e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce67bcb0 0x55f6ce67e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657f07e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce5d52f0 con 0x55f6ce67bcb0 2024-09-11T22:13:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657f07e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce57d270 con 0x55f6ce671410 2024-09-11T22:13:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657f07e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce5d12b0 con 0x55f6ce670af0 2024-09-11T22:13:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f6579798640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f65600a2df0 0x7f65600a52b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6564005ab0 tx=0x7f656402a910 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657a79a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce67bcb0 0x55f6ce67e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f6579798640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce67b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f6579f99640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce670af0 0x55f6ce670ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657a79a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce67bcb0 0x55f6ce67e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34778/0 (socket says 172.21.15.152:34778) 2024-09-11T22:13:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f6579798640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce67b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54334/0 (socket says 172.21.15.152:54334) 2024-09-11T22:13:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f6579f99640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce670af0 0x55f6ce670ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:60010/0 (socket says 172.21.15.152:60010) 2024-09-11T22:13:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657a79a640 1 -- 172.21.15.152:0/982633162 learned_addr learned my addr 172.21.15.152:0/982633162 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657a79a640 1 -- 172.21.15.152:0/982633162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce670af0 msgr2=0x55f6ce670ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657a79a640 1 --2- 172.21.15.152:0/982633162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce670af0 0x55f6ce670ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657a79a640 1 -- 172.21.15.152:0/982633162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 msgr2=0x55f6ce67b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657a79a640 1 --2- 172.21.15.152:0/982633162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce67b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f657a79a640 1 -- 172.21.15.152:0/982633162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ce57c340 con 0x55f6ce67bcb0 2024-09-11T22:13:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.746+0000 7f6579798640 1 --2- 172.21.15.152:0/982633162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce67b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.747+0000 7f657a79a640 1 --2- 172.21.15.152:0/982633162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce67bcb0 0x55f6ce67e0a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f656c009fd0 tx=0x7f656c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e4a653413524b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.747+0000 7f655ffff640 1 -- 172.21.15.152:0/982633162 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c004d20 con 0x55f6ce67bcb0 2024-09-11T22:13:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.747+0000 7f655ffff640 1 -- 172.21.15.152:0/982633162 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f656c004050 con 0x55f6ce67bcb0 2024-09-11T22:13:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.747+0000 7f655ffff640 1 -- 172.21.15.152:0/982633162 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c005220 con 0x55f6ce67bcb0 2024-09-11T22:13:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.748+0000 7f657f07e740 1 -- 172.21.15.152:0/982633162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce67bcb0 msgr2=0x55f6ce67e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.748+0000 7f657f07e740 1 --2- 172.21.15.152:0/982633162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce67bcb0 0x55f6ce67e0a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f656c009fd0 tx=0x7f656c0118d0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.748+0000 7f657f07e740 1 -- 172.21.15.152:0/982633162 shutdown_connections 2024-09-11T22:13:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.748+0000 7f657f07e740 1 --2- 172.21.15.152:0/982633162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce67bcb0 0x55f6ce67e0a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.748+0000 7f657f07e740 1 --2- 172.21.15.152:0/982633162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce67b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.748+0000 7f657f07e740 1 --2- 172.21.15.152:0/982633162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce670af0 0x55f6ce670ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.748+0000 7f657f07e740 1 -- 172.21.15.152:0/982633162 >> 172.21.15.152:0/982633162 conn(0x55f6ce66d060 msgr2=0x55f6ce66d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.748+0000 7f657f07e740 1 -- 172.21.15.152:0/982633162 shutdown_connections 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.748+0000 7f657f07e740 1 -- 172.21.15.152:0/982633162 wait complete. 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.748+0000 7f657f07e740 1 -- start start 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f657f07e740 1 Processor -- start 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f657f07e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 0x55f6ce678ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f657f07e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce679020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f657f07e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce679560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f657f07e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce67e880 con 0x55f6ce670af0 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f657f07e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce55e290 con 0x55f6ce671410 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f657f07e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce67ea00 con 0x55f6ce67bcb0 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f6579f99640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 0x55f6ce678ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f657f07e740 10 client.0 _ll_register_callbacks cb 0x55f6ce58f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f657a79a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce679560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f6579f99640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 0x55f6ce678ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34782/0 (socket says 172.21.15.152:34782) 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f6579f99640 1 -- 172.21.15.152:0/942535623 learned_addr learned my addr 172.21.15.152:0/942535623 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.749+0000 7f6579798640 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce679020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f6579798640 1 -- 172.21.15.152:0/942535623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 msgr2=0x55f6ce679560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f6579798640 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce679560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f6579798640 1 -- 172.21.15.152:0/942535623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 msgr2=0x55f6ce678ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f6579798640 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 0x55f6ce678ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f6579798640 1 -- 172.21.15.152:0/942535623 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ce2e8210 con 0x55f6ce671410 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f657a79a640 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce679560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f6579798640 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce679020 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f656402aa00 tx=0x7f6564009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fff7831825a54747 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f655d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:13:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f655d7fa640 1 -- 172.21.15.152:0/942535623 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564035040 con 0x55f6ce671410 2024-09-11T22:13:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f655d7fa640 1 -- 172.21.15.152:0/942535623 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8658+0+0 (secure 0 0 0) 0x7f65640048c0 con 0x55f6ce671410 2024-09-11T22:13:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f657f07e740 1 -- 172.21.15.152:0/942535623 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f656c004050 con 0x55f6ce671410 2024-09-11T22:13:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f655d7fa640 1 -- 172.21.15.152:0/942535623 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6564004ac0 con 0x55f6ce671410 2024-09-11T22:13:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f657f07e740 10 client.26945 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f657f07e740 1 -- 172.21.15.152:0/942535623 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f6ce3b4620 con 0x55f6ce671410 2024-09-11T22:13:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.750+0000 7f655d7fa640 1 -- 172.21.15.152:0/942535623 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f656c004050 con 0x55f6ce671410 2024-09-11T22:13:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.751+0000 7f655d7fa640 1 -- 172.21.15.152:0/942535623 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f6564032550 con 0x55f6ce671410 2024-09-11T22:13:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.751+0000 7f657f07e740 10 client.26945 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.751+0000 7f657f07e740 10 client.26945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.751+0000 7f657f07e740 20 client.26945 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.751+0000 7f657f07e740 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6ce68bb70 0x55f6ce68df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.751+0000 7f657f07e740 4 client.26945 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.751+0000 7f657f07e740 1 -- 172.21.15.152:0/942535623 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6ce5e2a20 con 0x55f6ce68bb70 2024-09-11T22:13:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.751+0000 7f6579f99640 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6ce68bb70 0x55f6ce68df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.751+0000 7f655d7fa640 10 client.26945 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.751+0000 7f6579f99640 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6ce68bb70 0x55f6ce68df60 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df1d6cec8d454cb server_cookie=17072bb653715f87 in_seq=0 out_seq=0 2024-09-11T22:13:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.752+0000 7f655d7fa640 1 -- 172.21.15.152:0/942535623 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6ce5e2a20 con 0x55f6ce68bb70 2024-09-11T22:13:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.752+0000 7f655d7fa640 10 client.26945 handle_command_reply: tid=0 2024-09-11T22:13:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 1 client.26945 shutdown 2024-09-11T22:13:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 1 -- 172.21.15.152:0/942535623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 msgr2=0x55f6ce679020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce679020 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f656402aa00 tx=0x7f6564009260 comp rx=0 tx=0).stop 2024-09-11T22:13:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 1 -- 172.21.15.152:0/942535623 shutdown_connections 2024-09-11T22:13:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6ce68bb70 0x55f6ce68df60 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce679560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce679020 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 1 --2- 172.21.15.152:0/942535623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 0x55f6ce678ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f655d7fa640 0 client.26945 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 1 -- 172.21.15.152:0/942535623 >> 172.21.15.152:0/942535623 conn(0x55f6ce66d060 msgr2=0x55f6ce672d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 1 -- 172.21.15.152:0/942535623 shutdown_connections 2024-09-11T22:13:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 1 -- 172.21.15.152:0/942535623 wait complete. 2024-09-11T22:13:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.753+0000 7f657f07e740 20 client.26945 trim_cache size 0 max 16384 2024-09-11T22:13:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.770+0000 7f657f07e740 1 Processor -- start 2024-09-11T22:13:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.770+0000 7f657f07e740 1 -- start start 2024-09-11T22:13:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f657f07e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce670af0 0x55f6ce679390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f657f07e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce671410 0x55f6ce693830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f657f07e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce693d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f657f07e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f65741b0280 con 0x55f6ce671410 2024-09-11T22:13:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f657f07e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f65741adb50 con 0x55f6ce670af0 2024-09-11T22:13:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f657f07e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f65741ab9c0 con 0x55f6ce67bcb0 2024-09-11T22:13:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f6579f99640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce670af0 0x55f6ce679390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f657a79a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce693d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f6579798640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce671410 0x55f6ce693830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f6579f99640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce670af0 0x55f6ce679390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54350/0 (socket says 172.21.15.152:54350) 2024-09-11T22:13:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f657a79a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce693d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:60018/0 (socket says 172.21.15.152:60018) 2024-09-11T22:13:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f6579798640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce671410 0x55f6ce693830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34790/0 (socket says 172.21.15.152:34790) 2024-09-11T22:13:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.771+0000 7f6579f99640 1 -- 172.21.15.152:0/637294713 learned_addr learned my addr 172.21.15.152:0/637294713 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.772+0000 7f6579f99640 1 -- 172.21.15.152:0/637294713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 msgr2=0x55f6ce693d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.772+0000 7f6579f99640 1 --2- 172.21.15.152:0/637294713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce693d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.772+0000 7f6579f99640 1 -- 172.21.15.152:0/637294713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce671410 msgr2=0x55f6ce693830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.772+0000 7f6579f99640 1 --2- 172.21.15.152:0/637294713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce671410 0x55f6ce693830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.772+0000 7f6579f99640 1 -- 172.21.15.152:0/637294713 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ce66ce90 con 0x55f6ce670af0 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.772+0000 7f6579798640 1 --2- 172.21.15.152:0/637294713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce671410 0x55f6ce693830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.772+0000 7f6579f99640 1 --2- 172.21.15.152:0/637294713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce670af0 0x55f6ce679390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f657009b9b0 tx=0x7f657001a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d78f8e6ac5635988 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.772+0000 7f655f7fe640 1 -- 172.21.15.152:0/637294713 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570099fb0 con 0x55f6ce670af0 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.772+0000 7f655f7fe640 1 -- 172.21.15.152:0/637294713 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6570098320 con 0x55f6ce670af0 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.772+0000 7f655f7fe640 1 -- 172.21.15.152:0/637294713 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570018c90 con 0x55f6ce670af0 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.773+0000 7f657f07e740 1 -- 172.21.15.152:0/637294713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce670af0 msgr2=0x55f6ce679390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.773+0000 7f657f07e740 1 --2- 172.21.15.152:0/637294713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce670af0 0x55f6ce679390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f657009b9b0 tx=0x7f657001a040 comp rx=0 tx=0).stop 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.773+0000 7f657f07e740 1 -- 172.21.15.152:0/637294713 shutdown_connections 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.773+0000 7f657f07e740 1 --2- 172.21.15.152:0/637294713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce693d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.773+0000 7f657f07e740 1 --2- 172.21.15.152:0/637294713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce671410 0x55f6ce693830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.773+0000 7f657f07e740 1 --2- 172.21.15.152:0/637294713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce670af0 0x55f6ce679390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.773+0000 7f657f07e740 1 -- 172.21.15.152:0/637294713 >> 172.21.15.152:0/637294713 conn(0x55f6ce66d060 msgr2=0x55f6ce67ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.773+0000 7f657f07e740 1 -- 172.21.15.152:0/637294713 shutdown_connections 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.773+0000 7f657f07e740 1 -- 172.21.15.152:0/637294713 wait complete. 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.773+0000 7f657f07e740 1 -- start start 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.773+0000 7f657f07e740 1 Processor -- start 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f657f07e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 0x55f6ce683cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f657f07e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce684200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f657f07e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce675310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f657f07e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f65741ac010 con 0x55f6ce670af0 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f657f07e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f65741ad480 con 0x55f6ce671410 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f657f07e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f65741ac6e0 con 0x55f6ce67bcb0 2024-09-11T22:13:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f657f07e740 10 client.0 _ll_register_callbacks cb 0x7f656c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f6579f99640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 0x55f6ce683cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f6579f99640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 0x55f6ce683cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34806/0 (socket says 172.21.15.152:34806) 2024-09-11T22:13:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f6579f99640 1 -- 172.21.15.152:0/272058365 learned_addr learned my addr 172.21.15.152:0/272058365 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f6579798640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce684200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f657a79a640 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce675310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f6579f99640 1 -- 172.21.15.152:0/272058365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 msgr2=0x55f6ce675310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f6579f99640 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce675310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f6579f99640 1 -- 172.21.15.152:0/272058365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 msgr2=0x55f6ce684200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f6579f99640 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce684200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f6579f99640 1 -- 172.21.15.152:0/272058365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ce6682d0 con 0x55f6ce670af0 2024-09-11T22:13:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f6579798640 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce684200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f6579f99640 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 0x55f6ce683cc0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f657000c6a0 tx=0x7f657000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4599d3b3d6635f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f655d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f655d7fa640 1 -- 172.21.15.152:0/272058365 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657009b100 con 0x55f6ce670af0 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f655d7fa640 1 -- 172.21.15.152:0/272058365 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8658+0+0 (secure 0 0 0) 0x7f65700b4e00 con 0x55f6ce670af0 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.774+0000 7f657f07e740 1 -- 172.21.15.152:0/272058365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6570098320 con 0x55f6ce670af0 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f655d7fa640 1 -- 172.21.15.152:0/272058365 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f657009b2a0 con 0x55f6ce670af0 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f657f07e740 10 client.17601 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f657f07e740 1 -- 172.21.15.152:0/272058365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f6ce6f5f30 con 0x55f6ce670af0 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f655d7fa640 1 -- 172.21.15.152:0/272058365 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6570098320 con 0x55f6ce670af0 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f655d7fa640 1 -- 172.21.15.152:0/272058365 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f65700ac030 con 0x55f6ce670af0 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f657f07e740 10 client.17601 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f657f07e740 10 client.17601 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f657f07e740 20 client.17601 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f657f07e740 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6ce6f6640 0x55f6ce6f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f657f07e740 4 client.17601 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:13:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f657f07e740 1 -- 172.21.15.152:0/272058365 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f6ce5dcd70 con 0x55f6ce6f6640 2024-09-11T22:13:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.775+0000 7f6579798640 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6ce6f6640 0x55f6ce6f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.776+0000 7f655d7fa640 10 client.17601 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.776+0000 7f6579798640 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6ce6f6640 0x55f6ce6f8a60 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52ce7e9f9a80e9a server_cookie=7aa6e40edaf6b4e in_seq=0 out_seq=0 2024-09-11T22:13:09.819 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 455.0 s, 2563.1 tps, lat 39.386 ms stddev 82.131 2024-09-11T22:13:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f655d7fa640 1 -- 172.21.15.152:0/272058365 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f6ce5dcd70 con 0x55f6ce6f6640 2024-09-11T22:13:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f655d7fa640 10 client.17601 handle_command_reply: tid=0 2024-09-11T22:13:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 1 client.17601 shutdown 2024-09-11T22:13:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 1 -- 172.21.15.152:0/272058365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 msgr2=0x55f6ce683cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 0x55f6ce683cc0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f657000c6a0 tx=0x7f657000cf40 comp rx=0 tx=0).stop 2024-09-11T22:13:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 1 -- 172.21.15.152:0/272058365 shutdown_connections 2024-09-11T22:13:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f6ce6f6640 0x55f6ce6f8a60 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f6ce67bcb0 0x55f6ce675310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6ce671410 0x55f6ce684200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f655d7fa640 0 client.17601 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 1 --2- 172.21.15.152:0/272058365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f6ce670af0 0x55f6ce683cc0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 1 -- 172.21.15.152:0/272058365 >> 172.21.15.152:0/272058365 conn(0x55f6ce66d060 msgr2=0x55f6ce672550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 1 -- 172.21.15.152:0/272058365 shutdown_connections 2024-09-11T22:13:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 1 -- 172.21.15.152:0/272058365 wait complete. 2024-09-11T22:13:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.844+0000 7f657f07e740 20 client.17601 trim_cache size 0 max 16384 2024-09-11T22:13:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:13:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:13:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:13:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:13:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 -- 172.21.15.152:0/467587896 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f65600a2df0 msgr2=0x7f65600a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f65600a2df0 0x7f65600a52b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6564005ab0 tx=0x7f656402a910 comp rx=0 tx=0).stop 2024-09-11T22:13:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 -- 172.21.15.152:0/467587896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6574101ae0 msgr2=0x7f6574198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6574101ae0 0x7f6574198310 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f657000e9f0 tx=0x7f657000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 -- 172.21.15.152:0/467587896 shutdown_connections 2024-09-11T22:13:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f65600a2df0 0x7f65600a52b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574107b80 0x7f657419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6574102480 0x7f6574198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 --2- 172.21.15.152:0/467587896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6574101ae0 0x7f6574198310 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 -- 172.21.15.152:0/467587896 >> 172.21.15.152:0/467587896 conn(0x7f65740fd7e0 msgr2=0x7f65740fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 -- 172.21.15.152:0/467587896 shutdown_connections 2024-09-11T22:13:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:09.845+0000 7f657c1fd640 1 -- 172.21.15.152:0/467587896 wait complete. 2024-09-11T22:13:10.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:10 smithi152 ceph-mon[31188]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T22:13:10.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:10 smithi179 ceph-mon[35603]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T22:13:10.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:10 smithi193 ceph-mon[35545]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T22:13:11.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:11 smithi152 ceph-mon[31188]: pgmap v274: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 27 MiB/s wr, 2.02k op/s 2024-09-11T22:13:11.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:11 smithi179 ceph-mon[35603]: pgmap v274: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 27 MiB/s wr, 2.02k op/s 2024-09-11T22:13:11.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:11 smithi193 ceph-mon[35545]: pgmap v274: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 27 MiB/s wr, 2.02k op/s 2024-09-11T22:13:12.794 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:13:13.127 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:13 smithi152 ceph-mon[31188]: pgmap v275: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 27 MiB/s wr, 2.02k op/s 2024-09-11T22:13:13.209 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:13:13.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:13 smithi179 ceph-mon[35603]: pgmap v275: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 27 MiB/s wr, 2.02k op/s 2024-09-11T22:13:13.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:13 smithi193 ceph-mon[35545]: pgmap v275: 97 pgs: 97 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 27 MiB/s wr, 2.02k op/s 2024-09-11T22:13:13.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.763+0000 7fb8edc40640 1 -- 172.21.15.152:0/730876585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8e8101420 msgr2=0x7fb8e810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:13.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.763+0000 7fb8edc40640 1 --2- 172.21.15.152:0/730876585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8e8101420 0x7fb8e810d950 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009900 tx=0x7fb8e002a420 comp rx=0 tx=0).stop 2024-09-11T22:13:13.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.763+0000 7fb8edc40640 1 -- 172.21.15.152:0/730876585 shutdown_connections 2024-09-11T22:13:13.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.763+0000 7fb8edc40640 1 --2- 172.21.15.152:0/730876585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8e8101420 0x7fb8e810d950 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.763+0000 7fb8edc40640 1 --2- 172.21.15.152:0/730876585 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8e8100a80 0x7fb8e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.763+0000 7fb8edc40640 1 --2- 172.21.15.152:0/730876585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e8106a80 0x7fb8e8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.763+0000 7fb8edc40640 1 -- 172.21.15.152:0/730876585 >> 172.21.15.152:0/730876585 conn(0x7fb8e80fc7a0 msgr2=0x7fb8e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:13.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.763+0000 7fb8edc40640 1 -- 172.21.15.152:0/730876585 shutdown_connections 2024-09-11T22:13:13.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.763+0000 7fb8edc40640 1 -- 172.21.15.152:0/730876585 wait complete. 2024-09-11T22:13:13.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.764+0000 7fb8edc40640 1 Processor -- start 2024-09-11T22:13:13.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.764+0000 7fb8edc40640 1 -- start start 2024-09-11T22:13:13.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8edc40640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e8100a80 0x7fb8e8198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8edc40640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8e8101420 0x7fb8e8198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8edc40640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8e8106a80 0x7fb8e819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8edc40640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e8112040 con 0x7fb8e8101420 2024-09-11T22:13:13.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8edc40640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e8111ec0 con 0x7fb8e8100a80 2024-09-11T22:13:13.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8edc40640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81121c0 con 0x7fb8e8106a80 2024-09-11T22:13:13.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8deffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8e8101420 0x7fb8e8198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8deffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8e8101420 0x7fb8e8198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35818/0 (socket says 172.21.15.152:35818) 2024-09-11T22:13:13.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8deffd640 1 -- 172.21.15.152:0/1585111950 learned_addr learned my addr 172.21.15.152:0/1585111950 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:13.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8e8106a80 0x7fb8e819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8e77fe640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e8100a80 0x7fb8e8198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8e7fff640 1 -- 172.21.15.152:0/1585111950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e8100a80 msgr2=0x7fb8e8198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:13.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e8100a80 0x7fb8e8198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8e7fff640 1 -- 172.21.15.152:0/1585111950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8e8101420 msgr2=0x7fb8e8198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:13.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8e8101420 0x7fb8e8198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.765+0000 7fb8e7fff640 1 -- 172.21.15.152:0/1585111950 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e819d530 con 0x7fb8e8106a80 2024-09-11T22:13:13.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.766+0000 7fb8e77fe640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e8100a80 0x7fb8e8198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:13.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.766+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8e8106a80 0x7fb8e819ce50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb8e002a940 tx=0x7fb8e0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:13.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.767+0000 7fb8e57fa640 1 -- 172.21.15.152:0/1585111950 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e003f030 con 0x7fb8e8106a80 2024-09-11T22:13:13.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.767+0000 7fb8e57fa640 1 -- 172.21.15.152:0/1585111950 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8e0003ad0 con 0x7fb8e8106a80 2024-09-11T22:13:13.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.768+0000 7fb8edc40640 1 -- 172.21.15.152:0/1585111950 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e819d7c0 con 0x7fb8e8106a80 2024-09-11T22:13:13.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.768+0000 7fb8edc40640 1 -- 172.21.15.152:0/1585111950 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e810e010 con 0x7fb8e8106a80 2024-09-11T22:13:13.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.768+0000 7fb8e57fa640 1 -- 172.21.15.152:0/1585111950 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0035070 con 0x7fb8e8106a80 2024-09-11T22:13:13.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.771+0000 7fb8e57fa640 1 -- 172.21.15.152:0/1585111950 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb8e0042030 con 0x7fb8e8106a80 2024-09-11T22:13:13.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.773+0000 7fb8f0019740 1 Processor -- start 2024-09-11T22:13:13.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8f0019740 1 -- start start 2024-09-11T22:13:13.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989beb70 0x5569989bef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989ba460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 0x5569989d4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8f0019740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55699891c2e0 con 0x5569989d2900 2024-09-11T22:13:13.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8f0019740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5569988c3ce0 con 0x5569989bf490 2024-09-11T22:13:13.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8f0019740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5569989182a0 con 0x5569989beb70 2024-09-11T22:13:13.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8deffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989beb70 0x5569989bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8deffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989beb70 0x5569989bef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59130/0 (socket says 172.21.15.152:59130) 2024-09-11T22:13:13.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8deffd640 1 -- 172.21.15.152:0/3619840389 learned_addr learned my addr 172.21.15.152:0/3619840389 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:13.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8e77fe640 1 --2- 172.21.15.152:0/3619840389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.774+0000 7fb8deffd640 1 --2- 172.21.15.152:0/3619840389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 0x5569989d4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.775+0000 7fb8e77fe640 1 -- 172.21.15.152:0/3619840389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989beb70 msgr2=0x5569989bef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:13.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.775+0000 7fb8e77fe640 1 --2- 172.21.15.152:0/3619840389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989beb70 0x5569989bef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.775+0000 7fb8e77fe640 1 -- 172.21.15.152:0/3619840389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 msgr2=0x5569989d4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:13.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.775+0000 7fb8e77fe640 1 --2- 172.21.15.152:0/3619840389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 0x5569989d4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.775+0000 7fb8e77fe640 1 -- 172.21.15.152:0/3619840389 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569988a8440 con 0x5569989bf490 2024-09-11T22:13:13.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.775+0000 7fb8deffd640 1 --2- 172.21.15.152:0/3619840389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 0x5569989d4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:13.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.775+0000 7fb8e77fe640 1 --2- 172.21.15.152:0/3619840389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989ba460 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800a7a0 tx=0x7fb8d80096d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24adb787ff224e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:13.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.776+0000 7fb8ddffb640 1 -- 172.21.15.152:0/3619840389 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8018020 con 0x5569989bf490 2024-09-11T22:13:13.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.776+0000 7fb8ddffb640 1 -- 172.21.15.152:0/3619840389 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8d800ae40 con 0x5569989bf490 2024-09-11T22:13:13.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.776+0000 7fb8e57fa640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb8d40a2e40 0x7fb8d40a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.777+0000 7fb8e57fa640 1 -- 172.21.15.152:0/1585111950 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8658+0+0 (secure 0 0 0) 0x7fb8e00ef840 con 0x7fb8e8106a80 2024-09-11T22:13:13.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.777+0000 7fb8f0019740 1 -- 172.21.15.152:0/3619840389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 msgr2=0x5569989ba460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:13.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.777+0000 7fb8f0019740 1 --2- 172.21.15.152:0/3619840389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989ba460 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800a7a0 tx=0x7fb8d80096d0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.779+0000 7fb8f0019740 1 -- 172.21.15.152:0/3619840389 shutdown_connections 2024-09-11T22:13:13.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.779+0000 7fb8f0019740 1 --2- 172.21.15.152:0/3619840389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 0x5569989d4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.779+0000 7fb8f0019740 1 --2- 172.21.15.152:0/3619840389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989ba460 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.779+0000 7fb8f0019740 1 --2- 172.21.15.152:0/3619840389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989beb70 0x5569989bef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.779+0000 7fb8f0019740 1 -- 172.21.15.152:0/3619840389 >> 172.21.15.152:0/3619840389 conn(0x5569989bb240 msgr2=0x5569989bb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:13.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.787+0000 7fb8f0019740 1 -- 172.21.15.152:0/3619840389 shutdown_connections 2024-09-11T22:13:13.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.787+0000 7fb8deffd640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb8d40a2e40 0x7fb8d40a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.790+0000 7fb8f0019740 1 -- 172.21.15.152:0/3619840389 wait complete. 2024-09-11T22:13:13.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.790+0000 7fb8f0019740 1 -- start start 2024-09-11T22:13:13.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.791+0000 7fb8f0019740 1 Processor -- start 2024-09-11T22:13:13.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.791+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989beb70 0x5569989ba1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.791+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.791+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 0x5569989b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.791+0000 7fb8f0019740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5569989d5350 con 0x5569989d2900 2024-09-11T22:13:13.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.791+0000 7fb8f0019740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5569988d7050 con 0x5569989bf490 2024-09-11T22:13:13.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.791+0000 7fb8f0019740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5569989d54d0 con 0x5569989beb70 2024-09-11T22:13:13.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.791+0000 7fb8f0019740 10 client.0 _ll_register_callbacks cb 0x556998917160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:13.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.794+0000 7fb8e77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989beb70 0x5569989ba1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.795+0000 7fb8e7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 0x5569989b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.795+0000 7fb8e7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 0x5569989b79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35828/0 (socket says 172.21.15.152:35828) 2024-09-11T22:13:13.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.795+0000 7fb8e7fff640 1 -- 172.21.15.152:0/2915586036 learned_addr learned my addr 172.21.15.152:0/2915586036 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:13.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.801+0000 7fb8deffd640 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.804+0000 7fb8e7fff640 1 -- 172.21.15.152:0/2915586036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989beb70 msgr2=0x5569989ba1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:13.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.804+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989beb70 0x5569989ba1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.804+0000 7fb8e7fff640 1 -- 172.21.15.152:0/2915586036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 msgr2=0x5569989b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:13.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.804+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.804+0000 7fb8e7fff640 1 -- 172.21.15.152:0/2915586036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55699868d3c0 con 0x5569989d2900 2024-09-11T22:13:13.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.804+0000 7fb8deffd640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb8d40a2e40 0x7fb8d40a5300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5569989bc330 tx=0x7fb8d0008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:13.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.805+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 0x5569989b79d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0003fd0 tx=0x7fb8e00bc430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74248aae45b4b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:13.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.805+0000 7fb8c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:13:13.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.805+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/2915586036 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00c48e0 con 0x5569989d2900 2024-09-11T22:13:13.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.806+0000 7fb8f0019740 1 -- 172.21.15.152:0/2915586036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556998929850 con 0x5569989d2900 2024-09-11T22:13:13.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.806+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/2915586036 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8658+0+0 (secure 0 0 0) 0x7fb8e00035f0 con 0x5569989d2900 2024-09-11T22:13:13.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.806+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/2915586036 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb8e00ed120 con 0x5569989d2900 2024-09-11T22:13:13.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.806+0000 7fb8f0019740 10 client.17610 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:13.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.806+0000 7fb8f0019740 1 -- 172.21.15.152:0/2915586036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5569989e0bc0 con 0x5569989d2900 2024-09-11T22:13:13.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.807+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/2915586036 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x556998929850 con 0x5569989d2900 2024-09-11T22:13:13.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.807+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/2915586036 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb8e00c4450 con 0x5569989d2900 2024-09-11T22:13:13.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.807+0000 7fb8f0019740 10 client.17610 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:13.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.807+0000 7fb8f0019740 10 client.17610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:13.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.807+0000 7fb8f0019740 20 client.17610 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:13.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.807+0000 7fb8f0019740 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5569989e22a0 0x5569989e46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.807+0000 7fb8f0019740 4 client.17610 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:13.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.807+0000 7fb8f0019740 1 -- 172.21.15.152:0/2915586036 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556998923d60 con 0x5569989e22a0 2024-09-11T22:13:13.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.810+0000 7fb8e77fe640 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5569989e22a0 0x5569989e46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.814+0000 7fb8e77fe640 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5569989e22a0 0x5569989e46e0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e74003fc9a8f1bd4 server_cookie=6828ca36fb464bfc in_seq=0 out_seq=0 2024-09-11T22:13:13.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.814+0000 7fb8c6ffd640 10 client.17610 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.817+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/2915586036 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556998923d60 con 0x5569989e22a0 2024-09-11T22:13:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.818+0000 7fb8c6ffd640 10 client.17610 handle_command_reply: tid=0 2024-09-11T22:13:13.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.818+0000 7fb8f0019740 1 client.17610 shutdown 2024-09-11T22:13:13.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.818+0000 7fb8f0019740 1 -- 172.21.15.152:0/2915586036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 msgr2=0x5569989b79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:13.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.818+0000 7fb8f0019740 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 0x5569989b79d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0003fd0 tx=0x7fb8e00bc430 comp rx=0 tx=0).stop 2024-09-11T22:13:13.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.818+0000 7fb8f0019740 1 -- 172.21.15.152:0/2915586036 shutdown_connections 2024-09-11T22:13:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.818+0000 7fb8f0019740 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5569989e22a0 0x5569989e46e0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.818+0000 7fb8f0019740 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989d2900 0x5569989b79d0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.818+0000 7fb8f0019740 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.818+0000 7fb8f0019740 1 --2- 172.21.15.152:0/2915586036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989beb70 0x5569989ba1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.818+0000 7fb8f0019740 1 -- 172.21.15.152:0/2915586036 >> 172.21.15.152:0/2915586036 conn(0x5569989bb240 msgr2=0x5569989c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.819+0000 7fb8c6ffd640 0 client.17610 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.819+0000 7fb8f0019740 1 -- 172.21.15.152:0/2915586036 shutdown_connections 2024-09-11T22:13:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.819+0000 7fb8f0019740 1 -- 172.21.15.152:0/2915586036 wait complete. 2024-09-11T22:13:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.819+0000 7fb8f0019740 20 client.17610 trim_cache size 0 max 16384 2024-09-11T22:13:13.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.844+0000 7fb8f0019740 1 Processor -- start 2024-09-11T22:13:13.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8f0019740 1 -- start start 2024-09-11T22:13:13.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989beb70 0x5569989e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989ea530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8f0019740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81ae220 con 0x5569989beb70 2024-09-11T22:13:13.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8f0019740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81abaf0 con 0x5569989bf490 2024-09-11T22:13:13.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8f0019740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81a9960 con 0x5569989d2900 2024-09-11T22:13:13.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8e7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8e7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59142/0 (socket says 172.21.15.152:59142) 2024-09-11T22:13:13.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8e7fff640 1 -- 172.21.15.152:0/1257325510 learned_addr learned my addr 172.21.15.152:0/1257325510 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:13.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8e7fff640 1 -- 172.21.15.152:0/1257325510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 msgr2=0x5569989ea530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:13.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/1257325510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989ea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8e7fff640 1 -- 172.21.15.152:0/1257325510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989beb70 msgr2=0x5569989e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:13.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/1257325510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989beb70 0x5569989e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.845+0000 7fb8e7fff640 1 -- 172.21.15.152:0/1257325510 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569989bf2c0 con 0x5569989d2900 2024-09-11T22:13:13.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.846+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/1257325510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989b2360 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00b80d0 tx=0x7fb8e00c01a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f345b8557f7ed4e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:13.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.846+0000 7fb8dd7fa640 1 -- 172.21.15.152:0/1257325510 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00c48e0 con 0x5569989d2900 2024-09-11T22:13:13.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.846+0000 7fb8dd7fa640 1 -- 172.21.15.152:0/1257325510 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8e0003c80 con 0x5569989d2900 2024-09-11T22:13:13.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.846+0000 7fb8dd7fa640 1 -- 172.21.15.152:0/1257325510 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00b82e0 con 0x5569989d2900 2024-09-11T22:13:13.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.847+0000 7fb8f0019740 1 -- 172.21.15.152:0/1257325510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 msgr2=0x5569989b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:13.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.847+0000 7fb8f0019740 1 --2- 172.21.15.152:0/1257325510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989b2360 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00b80d0 tx=0x7fb8e00c01a0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.847+0000 7fb8f0019740 1 -- 172.21.15.152:0/1257325510 shutdown_connections 2024-09-11T22:13:13.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.847+0000 7fb8f0019740 1 --2- 172.21.15.152:0/1257325510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989b2360 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.847+0000 7fb8f0019740 1 --2- 172.21.15.152:0/1257325510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989bf490 0x5569989ea530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.847+0000 7fb8f0019740 1 --2- 172.21.15.152:0/1257325510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989beb70 0x5569989e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.847+0000 7fb8f0019740 1 -- 172.21.15.152:0/1257325510 >> 172.21.15.152:0/1257325510 conn(0x5569989bb240 msgr2=0x5569989b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:13.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.847+0000 7fb8f0019740 1 -- 172.21.15.152:0/1257325510 shutdown_connections 2024-09-11T22:13:13.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.847+0000 7fb8f0019740 1 -- 172.21.15.152:0/1257325510 wait complete. 2024-09-11T22:13:13.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.847+0000 7fb8f0019740 1 -- start start 2024-09-11T22:13:13.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.848+0000 7fb8f0019740 1 Processor -- start 2024-09-11T22:13:13.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.848+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989beb70 0x5569989dad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.848+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989bf490 0x5569989d60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.848+0000 7fb8f0019740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989d6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.848+0000 7fb8e7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989d6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.848+0000 7fb8e7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989d6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59158/0 (socket says 172.21.15.152:59158) 2024-09-11T22:13:13.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.849+0000 7fb8e7fff640 1 -- 172.21.15.152:0/3861921246 learned_addr learned my addr 172.21.15.152:0/3861921246 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:13.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.848+0000 7fb8f0019740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81a9fb0 con 0x5569989bf490 2024-09-11T22:13:13.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.849+0000 7fb8f0019740 1 -- 172.21.15.152:0/3861921246 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81ab420 con 0x5569989beb70 2024-09-11T22:13:13.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.849+0000 7fb8f0019740 1 -- 172.21.15.152:0/3861921246 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81aa680 con 0x5569989d2900 2024-09-11T22:13:13.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.849+0000 7fb8f0019740 10 client.0 _ll_register_callbacks cb 0x7fb8e0005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.849+0000 7fb8e77fe640 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989beb70 0x5569989dad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.850+0000 7fb8e7fff640 1 -- 172.21.15.152:0/3861921246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989beb70 msgr2=0x5569989dad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.850+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989beb70 0x5569989dad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.850+0000 7fb8e7fff640 1 -- 172.21.15.152:0/3861921246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989bf490 msgr2=0x5569989d60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.850+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989bf490 0x5569989d60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.850+0000 7fb8e7fff640 1 -- 172.21.15.152:0/3861921246 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569989d6d30 con 0x5569989d2900 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.851+0000 7fb8e7fff640 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989d6600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00ef040 tx=0x7fb8e003b720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd886a3fb7d0982b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.851+0000 7fb8c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.851+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/3861921246 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00b7f10 con 0x5569989d2900 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.851+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/3861921246 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8658+0+0 (secure 0 0 0) 0x7fb8e00b79c0 con 0x5569989d2900 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.851+0000 7fb8f0019740 1 -- 172.21.15.152:0/3861921246 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8e0003c80 con 0x5569989d2900 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.851+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/3861921246 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb8e00c48e0 con 0x5569989d2900 2024-09-11T22:13:13.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.851+0000 7fb8f0019740 10 client.27133 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.851+0000 7fb8f0019740 1 -- 172.21.15.152:0/3861921246 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5569989d6d30 con 0x5569989d2900 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.851+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/3861921246 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8e00b7c00 con 0x5569989d2900 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.851+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/3861921246 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb8e00c11b0 con 0x5569989d2900 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.852+0000 7fb8f0019740 10 client.27133 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.852+0000 7fb8f0019740 10 client.27133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.852+0000 7fb8f0019740 20 client.27133 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.852+0000 7fb8f0019740 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556998a5e1f0 0x556998a605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.852+0000 7fb8f0019740 4 client.27133 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.852+0000 7fb8f0019740 1 -- 172.21.15.152:0/3861921246 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb8e0003c80 con 0x556998a5e1f0 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.852+0000 7fb8e77fe640 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556998a5e1f0 0x556998a605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.852+0000 7fb8c6ffd640 10 client.27133 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.852+0000 7fb8e77fe640 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556998a5e1f0 0x556998a605e0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=106ed9427938273b server_cookie=ffc56c0bf55f37f6 in_seq=0 out_seq=0 2024-09-11T22:13:13.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8c6ffd640 1 -- 172.21.15.152:0/3861921246 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fb8e0003c80 con 0x556998a5e1f0 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8c6ffd640 10 client.27133 handle_command_reply: tid=0 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 1 client.27133 shutdown 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 1 -- 172.21.15.152:0/3861921246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 msgr2=0x5569989d6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989d6600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00ef040 tx=0x7fb8e003b720 comp rx=0 tx=0).stop 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 1 -- 172.21.15.152:0/3861921246 shutdown_connections 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556998a5e1f0 0x556998a605e0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5569989d2900 0x5569989d6600 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5569989bf490 0x5569989d60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 1 --2- 172.21.15.152:0/3861921246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5569989beb70 0x5569989dad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 1 -- 172.21.15.152:0/3861921246 >> 172.21.15.152:0/3861921246 conn(0x5569989bb240 msgr2=0x5569989b6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8c6ffd640 0 client.27133 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 1 -- 172.21.15.152:0/3861921246 shutdown_connections 2024-09-11T22:13:13.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 1 -- 172.21.15.152:0/3861921246 wait complete. 2024-09-11T22:13:13.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.853+0000 7fb8f0019740 20 client.27133 trim_cache size 0 max 16384 2024-09-11T22:13:13.860 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:13:13.860 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:13:13.860 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:13:13.860 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:13:13.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.854+0000 7fb8edc40640 1 -- 172.21.15.152:0/1585111950 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb8d40a2e40 msgr2=0x7fb8d40a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:13.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.854+0000 7fb8edc40640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb8d40a2e40 0x7fb8d40a5300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5569989bc330 tx=0x7fb8d0008040 comp rx=0 tx=0).stop 2024-09-11T22:13:13.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.854+0000 7fb8edc40640 1 -- 172.21.15.152:0/1585111950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8e8106a80 msgr2=0x7fb8e819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:13.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.855+0000 7fb8edc40640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8e8106a80 0x7fb8e819ce50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb8e002a940 tx=0x7fb8e0004270 comp rx=0 tx=0).stop 2024-09-11T22:13:13.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.855+0000 7fb8edc40640 1 -- 172.21.15.152:0/1585111950 shutdown_connections 2024-09-11T22:13:13.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.855+0000 7fb8edc40640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb8d40a2e40 0x7fb8d40a5300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.855+0000 7fb8edc40640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8e8106a80 0x7fb8e819ce50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.855+0000 7fb8edc40640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8e8101420 0x7fb8e8198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.855+0000 7fb8edc40640 1 --2- 172.21.15.152:0/1585111950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e8100a80 0x7fb8e8198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:13.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.855+0000 7fb8edc40640 1 -- 172.21.15.152:0/1585111950 >> 172.21.15.152:0/1585111950 conn(0x7fb8e80fc7a0 msgr2=0x7fb8e80fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:13.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.855+0000 7fb8edc40640 1 -- 172.21.15.152:0/1585111950 shutdown_connections 2024-09-11T22:13:13.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:13.855+0000 7fb8edc40640 1 -- 172.21.15.152:0/1585111950 wait complete. 2024-09-11T22:13:14.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 460.0 s, 3078.6 tps, lat 32.856 ms stddev 39.959 2024-09-11T22:13:14.938 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:13:14.938 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:13:15.395 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:13:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:15 smithi152 ceph-mon[31188]: pgmap v276: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 26 MiB/s wr, 1.97k op/s 2024-09-11T22:13:15.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:15 smithi179 ceph-mon[35603]: pgmap v276: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 26 MiB/s wr, 1.97k op/s 2024-09-11T22:13:15.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:15 smithi193 ceph-mon[35545]: pgmap v276: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 26 MiB/s wr, 1.97k op/s 2024-09-11T22:13:15.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.964+0000 7f87029a5640 1 -- 172.21.15.152:0/3906127028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86fc101410 msgr2=0x7f86fc10d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:15.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.964+0000 7f87029a5640 1 --2- 172.21.15.152:0/3906127028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86fc101410 0x7f86fc10d940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009ca0 tx=0x7f86f402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:13:15.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.964+0000 7f87029a5640 1 -- 172.21.15.152:0/3906127028 shutdown_connections 2024-09-11T22:13:15.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.964+0000 7f87029a5640 1 --2- 172.21.15.152:0/3906127028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86fc101410 0x7f86fc10d940 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:15.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.964+0000 7f87029a5640 1 --2- 172.21.15.152:0/3906127028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc100a70 0x7f86fc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:15.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.964+0000 7f87029a5640 1 --2- 172.21.15.152:0/3906127028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86fc106a70 0x7f86fc106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:15.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.964+0000 7f87029a5640 1 -- 172.21.15.152:0/3906127028 >> 172.21.15.152:0/3906127028 conn(0x7f86fc0fc790 msgr2=0x7f86fc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:15.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.964+0000 7f87029a5640 1 -- 172.21.15.152:0/3906127028 shutdown_connections 2024-09-11T22:13:15.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.964+0000 7f87029a5640 1 -- 172.21.15.152:0/3906127028 wait complete. 2024-09-11T22:13:15.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.965+0000 7f87029a5640 1 Processor -- start 2024-09-11T22:13:15.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.965+0000 7f87029a5640 1 -- start start 2024-09-11T22:13:15.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.966+0000 7f87029a5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86fc100a70 0x7f86fc1a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:15.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.966+0000 7f87029a5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc101410 0x7f86fc1a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:15.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.966+0000 7f87029a5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86fc106a70 0x7f86fc10ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:15.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.966+0000 7f87029a5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc111fd0 con 0x7f86fc100a70 2024-09-11T22:13:15.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.966+0000 7f87029a5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc111e50 con 0x7f86fc101410 2024-09-11T22:13:15.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.966+0000 7f87029a5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc112150 con 0x7f86fc106a70 2024-09-11T22:13:15.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.966+0000 7f86fbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86fc100a70 0x7f86fc1a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:15.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.966+0000 7f86fbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86fc100a70 0x7f86fc1a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35858/0 (socket says 172.21.15.152:35858) 2024-09-11T22:13:15.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.966+0000 7f86fbfff640 1 -- 172.21.15.152:0/2657361394 learned_addr learned my addr 172.21.15.152:0/2657361394 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:15.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.967+0000 7f86fb7fe640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc101410 0x7f86fc1a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:15.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.967+0000 7f8700f42640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86fc106a70 0x7f86fc10ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:15.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.967+0000 7f86fbfff640 1 -- 172.21.15.152:0/2657361394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86fc106a70 msgr2=0x7f86fc10ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:15.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.967+0000 7f86fbfff640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86fc106a70 0x7f86fc10ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:15.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.967+0000 7f86fbfff640 1 -- 172.21.15.152:0/2657361394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc101410 msgr2=0x7f86fc1a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:15.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.967+0000 7f86fbfff640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc101410 0x7f86fc1a4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:15.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.967+0000 7f86fbfff640 1 -- 172.21.15.152:0/2657361394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc10d1e0 con 0x7f86fc100a70 2024-09-11T22:13:15.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.968+0000 7f86fbfff640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86fc100a70 0x7f86fc1a4640 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00e9f0 tx=0x7f86ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:15.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.968+0000 7f86f97fa640 1 -- 172.21.15.152:0/2657361394 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00cd80 con 0x7f86fc100a70 2024-09-11T22:13:15.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.968+0000 7f86f97fa640 1 -- 172.21.15.152:0/2657361394 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ec010910 con 0x7f86fc100a70 2024-09-11T22:13:15.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.968+0000 7f86f97fa640 1 -- 172.21.15.152:0/2657361394 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec018990 con 0x7f86fc100a70 2024-09-11T22:13:15.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.969+0000 7f87029a5640 1 -- 172.21.15.152:0/2657361394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86fc10d4d0 con 0x7f86fc100a70 2024-09-11T22:13:15.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.969+0000 7f87029a5640 1 -- 172.21.15.152:0/2657361394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86fc1ab4a0 con 0x7f86fc100a70 2024-09-11T22:13:15.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.970+0000 7f87029a5640 1 -- 172.21.15.152:0/2657361394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86fc1021b0 con 0x7f86fc100a70 2024-09-11T22:13:15.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.975+0000 7f86f97fa640 1 -- 172.21.15.152:0/2657361394 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f86ec010ac0 con 0x7f86fc100a70 2024-09-11T22:13:15.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.975+0000 7f86f97fa640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86e40a2d70 0x7f86e40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:15.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.976+0000 7f86f97fa640 1 -- 172.21.15.152:0/2657361394 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8658+0+0 (secure 0 0 0) 0x7f86ec0cfc60 con 0x7f86fc100a70 2024-09-11T22:13:15.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.976+0000 7f86fb7fe640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86e40a2d70 0x7f86e40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:15.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.977+0000 7f86fb7fe640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86e40a2d70 0x7f86e40a5230 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f86fc1100f0 tx=0x7f86f0005c60 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:15.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:15.981+0000 7f86f97fa640 1 -- 172.21.15.152:0/2657361394 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86ec09c7f0 con 0x7f86fc100a70 2024-09-11T22:13:16.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.347+0000 7f87029a5640 1 -- 172.21.15.152:0/2657361394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86fc100ed0 con 0x7f86fc100a70 2024-09-11T22:13:16.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.348+0000 7f86f97fa640 1 -- 172.21.15.152:0/2657361394 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f86ec09c0f0 con 0x7f86fc100a70 2024-09-11T22:13:16.350 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:13:16.350 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:13:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:13:16.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.351+0000 7f87029a5640 1 -- 172.21.15.152:0/2657361394 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86e40a2d70 msgr2=0x7f86e40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:16.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.351+0000 7f87029a5640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86e40a2d70 0x7f86e40a5230 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f86fc1100f0 tx=0x7f86f0005c60 comp rx=0 tx=0).stop 2024-09-11T22:13:16.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.351+0000 7f87029a5640 1 -- 172.21.15.152:0/2657361394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86fc100a70 msgr2=0x7f86fc1a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:16.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.351+0000 7f87029a5640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86fc100a70 0x7f86fc1a4640 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00e9f0 tx=0x7f86ec00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:13:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.352+0000 7f87029a5640 1 -- 172.21.15.152:0/2657361394 shutdown_connections 2024-09-11T22:13:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.352+0000 7f87029a5640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86e40a2d70 0x7f86e40a5230 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.352+0000 7f87029a5640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86fc106a70 0x7f86fc10ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.352+0000 7f87029a5640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc101410 0x7f86fc1a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.352+0000 7f87029a5640 1 --2- 172.21.15.152:0/2657361394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86fc100a70 0x7f86fc1a4640 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.352+0000 7f87029a5640 1 -- 172.21.15.152:0/2657361394 >> 172.21.15.152:0/2657361394 conn(0x7f86fc0fc790 msgr2=0x7f86fc0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.352+0000 7f87029a5640 1 -- 172.21.15.152:0/2657361394 shutdown_connections 2024-09-11T22:13:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:16.352+0000 7f87029a5640 1 -- 172.21.15.152:0/2657361394 wait complete. 2024-09-11T22:13:17.228 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:13:17.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:17 smithi152 ceph-mon[31188]: pgmap v277: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 27 MiB/s wr, 1.96k op/s 2024-09-11T22:13:17.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:17 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2657361394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:13:17.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:17 smithi179 ceph-mon[35603]: pgmap v277: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 27 MiB/s wr, 1.96k op/s 2024-09-11T22:13:17.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:17 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2657361394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:13:17.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:17 smithi193 ceph-mon[35545]: pgmap v277: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 27 MiB/s wr, 1.96k op/s 2024-09-11T22:13:17.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:17 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2657361394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:13:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:13:18.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.500+0000 7fe3aad45640 1 -- 172.21.15.152:0/2681341060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a4104000 msgr2=0x7fe3a41043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:18.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.500+0000 7fe3aad45640 1 --2- 172.21.15.152:0/2681341060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a4104000 0x7fe3a41043e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe398009900 tx=0x7fe39802a400 comp rx=0 tx=0).stop 2024-09-11T22:13:18.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.500+0000 7fe3aad45640 1 -- 172.21.15.152:0/2681341060 shutdown_connections 2024-09-11T22:13:18.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.500+0000 7fe3aad45640 1 --2- 172.21.15.152:0/2681341060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a4109130 0x7fe3a4110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.500+0000 7fe3aad45640 1 --2- 172.21.15.152:0/2681341060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3a41049b0 0x7fe3a4108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.500+0000 7fe3aad45640 1 --2- 172.21.15.152:0/2681341060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a4104000 0x7fe3a41043e0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.500+0000 7fe3aad45640 1 -- 172.21.15.152:0/2681341060 >> 172.21.15.152:0/2681341060 conn(0x7fe3a40ffa20 msgr2=0x7fe3a4101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.500+0000 7fe3aad45640 1 -- 172.21.15.152:0/2681341060 shutdown_connections 2024-09-11T22:13:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.500+0000 7fe3aad45640 1 -- 172.21.15.152:0/2681341060 wait complete. 2024-09-11T22:13:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.501+0000 7fe3aad45640 1 Processor -- start 2024-09-11T22:13:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.502+0000 7fe3aad45640 1 -- start start 2024-09-11T22:13:18.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3aad45640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a4104000 0x7fe3a419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3aad45640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a41049b0 0x7fe3a419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3aad45640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3a4109130 0x7fe3a419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3aad45640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4114180 con 0x7fe3a4104000 2024-09-11T22:13:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3aad45640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4114000 con 0x7fe3a41049b0 2024-09-11T22:13:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3aad45640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4114300 con 0x7fe3a4109130 2024-09-11T22:13:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3a8ae1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a4104000 0x7fe3a419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3a8ae1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a4104000 0x7fe3a419a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35880/0 (socket says 172.21.15.152:35880) 2024-09-11T22:13:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3a8ae1640 1 -- 172.21.15.152:0/1146006014 learned_addr learned my addr 172.21.15.152:0/1146006014 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3a3fff640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a41049b0 0x7fe3a419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3a92e2640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3a4109130 0x7fe3a419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3a3fff640 1 -- 172.21.15.152:0/1146006014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3a4109130 msgr2=0x7fe3a419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:18.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3a3fff640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3a4109130 0x7fe3a419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3a3fff640 1 -- 172.21.15.152:0/1146006014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a4104000 msgr2=0x7fe3a419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:18.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3a3fff640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a4104000 0x7fe3a419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.503+0000 7fe3a3fff640 1 -- 172.21.15.152:0/1146006014 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a419f650 con 0x7fe3a41049b0 2024-09-11T22:13:18.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.504+0000 7fe3a3fff640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a41049b0 0x7fe3a419abe0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe39000d6d0 tx=0x7fe39000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:18.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.504+0000 7fe3a1ffb640 1 -- 172.21.15.152:0/1146006014 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390017070 con 0x7fe3a41049b0 2024-09-11T22:13:18.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.504+0000 7fe3a1ffb640 1 -- 172.21.15.152:0/1146006014 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe390009820 con 0x7fe3a41049b0 2024-09-11T22:13:18.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.504+0000 7fe3a1ffb640 1 -- 172.21.15.152:0/1146006014 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390004d00 con 0x7fe3a41049b0 2024-09-11T22:13:18.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.504+0000 7fe3aad45640 1 -- 172.21.15.152:0/1146006014 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a419f940 con 0x7fe3a41049b0 2024-09-11T22:13:18.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.504+0000 7fe3aad45640 1 -- 172.21.15.152:0/1146006014 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a419fd70 con 0x7fe3a41049b0 2024-09-11T22:13:18.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.508+0000 7fe3ad11e740 1 Processor -- start 2024-09-11T22:13:18.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.508+0000 7fe3ad11e740 1 -- start start 2024-09-11T22:13:18.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.508+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.508+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.508+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 0x5646383d2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.508+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56463832b2f0 con 0x5646383c6b40 2024-09-11T22:13:18.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.508+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5646382d2cf0 con 0x5646383d0370 2024-09-11T22:13:18.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.508+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5646383272b0 con 0x5646383c55d0 2024-09-11T22:13:18.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.509+0000 7fe3a8ae1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.509+0000 7fe3a8ae1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59196/0 (socket says 172.21.15.152:59196) 2024-09-11T22:13:18.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.509+0000 7fe3a8ae1640 1 -- 172.21.15.152:0/1866487460 learned_addr learned my addr 172.21.15.152:0/1866487460 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:18.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.509+0000 7fe3a1ffb640 1 -- 172.21.15.152:0/1146006014 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe3900099d0 con 0x7fe3a41049b0 2024-09-11T22:13:18.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.509+0000 7fe3a8ae1640 1 -- 172.21.15.152:0/1866487460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 msgr2=0x5646383d2760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:13:18.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.509+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/1866487460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 0x5646383d2760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.509+0000 7fe3a8ae1640 1 -- 172.21.15.152:0/1866487460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 msgr2=0x5646383c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:18.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.509+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/1866487460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.509+0000 7fe3a8ae1640 1 -- 172.21.15.152:0/1866487460 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646382b73a0 con 0x5646383c55d0 2024-09-11T22:13:18.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.510+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/1866487460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383c5a10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe398005e80 tx=0x7fe398005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57194b8f9efba5eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:18.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.511+0000 7fe3a1ffb640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3940a2df0 0x7fe3940a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.511+0000 7fe3a1ffb640 1 -- 172.21.15.152:0/1146006014 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8658+0+0 (secure 0 0 0) 0x7fe3900cef90 con 0x7fe3a41049b0 2024-09-11T22:13:18.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.511+0000 7fe3a92e2640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3940a2df0 0x7fe3940a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.511+0000 7fe38effd640 1 -- 172.21.15.152:0/1866487460 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398035040 con 0x5646383c55d0 2024-09-11T22:13:18.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.511+0000 7fe38effd640 1 -- 172.21.15.152:0/1866487460 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3980044b0 con 0x5646383c55d0 2024-09-11T22:13:18.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.511+0000 7fe38effd640 1 -- 172.21.15.152:0/1866487460 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398003850 con 0x5646383c55d0 2024-09-11T22:13:18.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.512+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1866487460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 msgr2=0x5646383c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:18.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.512+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/1866487460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383c5a10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe398005e80 tx=0x7fe398005c00 comp rx=0 tx=0).stop 2024-09-11T22:13:18.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.513+0000 7fe3a92e2640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3940a2df0 0x7fe3940a52b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe39c005fd0 tx=0x7fe39c009a90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:18.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.513+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1866487460 shutdown_connections 2024-09-11T22:13:18.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.513+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/1866487460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 0x5646383d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.513+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/1866487460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383c5a10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.513+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/1866487460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.513+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1866487460 >> 172.21.15.152:0/1866487460 conn(0x56463838e310 msgr2=0x5646383c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:18.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.513+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1866487460 shutdown_connections 2024-09-11T22:13:18.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.513+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1866487460 wait complete. 2024-09-11T22:13:18.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.513+0000 7fe3ad11e740 1 -- start start 2024-09-11T22:13:18.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3ad11e740 1 Processor -- start 2024-09-11T22:13:18.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c55d0 0x5646383cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383c6b40 0x5646383cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383d0370 0x5646383cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5646383d3010 con 0x5646383c55d0 2024-09-11T22:13:18.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5646382e6060 con 0x5646383c6b40 2024-09-11T22:13:18.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5646383d3190 con 0x5646383d0370 2024-09-11T22:13:18.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3ad11e740 10 client.0 _ll_register_callbacks cb 0x5646380398c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:18.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3a8ae1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c55d0 0x5646383cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3a8ae1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c55d0 0x5646383cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35906/0 (socket says 172.21.15.152:35906) 2024-09-11T22:13:18.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3a8ae1640 1 -- 172.21.15.152:0/2308713608 learned_addr learned my addr 172.21.15.152:0/2308713608 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:18.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.514+0000 7fe3a92e2640 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383d0370 0x5646383cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.515+0000 7fe3a3fff640 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383c6b40 0x5646383cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.515+0000 7fe3a92e2640 1 -- 172.21.15.152:0/2308713608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383c6b40 msgr2=0x5646383cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:18.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.515+0000 7fe3a92e2640 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383c6b40 0x5646383cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.515+0000 7fe3a92e2640 1 -- 172.21.15.152:0/2308713608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c55d0 msgr2=0x5646383cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:18.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.515+0000 7fe3a92e2640 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c55d0 0x5646383cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.515+0000 7fe3a92e2640 1 -- 172.21.15.152:0/2308713608 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56463809c3c0 con 0x5646383d0370 2024-09-11T22:13:18.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.515+0000 7fe3a3fff640 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383c6b40 0x5646383cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:18.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.515+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c55d0 0x5646383cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:18.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.515+0000 7fe3a92e2640 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383d0370 0x5646383cd600 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009fd0 tx=0x7fe39c009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290ba4a952a0c140 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:18.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.516+0000 7fe383fff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:13:18.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.516+0000 7fe383fff640 1 -- 172.21.15.152:0/2308713608 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c004d20 con 0x5646383d0370 2024-09-11T22:13:18.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.516+0000 7fe383fff640 1 -- 172.21.15.152:0/2308713608 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8658+0+0 (secure 0 0 0) 0x7fe39c00fb50 con 0x5646383d0370 2024-09-11T22:13:18.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.516+0000 7fe3ad11e740 1 -- 172.21.15.152:0/2308713608 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3980044b0 con 0x5646383d0370 2024-09-11T22:13:18.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.518+0000 7fe383fff640 1 -- 172.21.15.152:0/2308713608 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe39c004810 con 0x5646383d0370 2024-09-11T22:13:18.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.518+0000 7fe3ad11e740 10 client.27148 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:18.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.518+0000 7fe3ad11e740 1 -- 172.21.15.152:0/2308713608 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5646383deb40 con 0x5646383d0370 2024-09-11T22:13:18.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.519+0000 7fe383fff640 1 -- 172.21.15.152:0/2308713608 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3980044b0 con 0x5646383d0370 2024-09-11T22:13:18.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.519+0000 7fe383fff640 1 -- 172.21.15.152:0/2308713608 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe39c01e420 con 0x5646383d0370 2024-09-11T22:13:18.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.519+0000 7fe3ad11e740 10 client.27148 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:18.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.519+0000 7fe3ad11e740 10 client.27148 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:13:18.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.519+0000 7fe3ad11e740 20 client.27148 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:18.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.519+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5646383e0000 0x5646383e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.519+0000 7fe3ad11e740 4 client.27148 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:18.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.519+0000 7fe3ad11e740 1 -- 172.21.15.152:0/2308713608 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564638338860 con 0x5646383e0000 2024-09-11T22:13:18.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.520+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5646383e0000 0x5646383e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.520+0000 7fe383fff640 10 client.27148 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:13:18.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.520+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5646383e0000 0x5646383e23f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9898233df60551fd server_cookie=34b5ce07c4fc5fae in_seq=0 out_seq=0 2024-09-11T22:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe383fff640 1 -- 172.21.15.152:0/2308713608 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564638338860 con 0x5646383e0000 2024-09-11T22:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe383fff640 10 client.27148 handle_command_reply: tid=0 2024-09-11T22:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe3ad11e740 1 client.27148 shutdown 2024-09-11T22:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe3ad11e740 1 -- 172.21.15.152:0/2308713608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383d0370 msgr2=0x5646383cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383d0370 0x5646383cd600 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009fd0 tx=0x7fe39c009500 comp rx=0 tx=0).stop 2024-09-11T22:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe3ad11e740 1 -- 172.21.15.152:0/2308713608 shutdown_connections 2024-09-11T22:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5646383e0000 0x5646383e23f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383d0370 0x5646383cd600 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383c6b40 0x5646383cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/2308713608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c55d0 0x5646383cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe383fff640 0 client.27148 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.522+0000 7fe3ad11e740 1 -- 172.21.15.152:0/2308713608 >> 172.21.15.152:0/2308713608 conn(0x56463838e310 msgr2=0x5646383c7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.523+0000 7fe3ad11e740 1 -- 172.21.15.152:0/2308713608 shutdown_connections 2024-09-11T22:13:18.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.523+0000 7fe3ad11e740 1 -- 172.21.15.152:0/2308713608 wait complete. 2024-09-11T22:13:18.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.523+0000 7fe3ad11e740 20 client.27148 trim_cache size 0 max 16384 2024-09-11T22:13:18.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.545+0000 7fe3ad11e740 1 Processor -- start 2024-09-11T22:13:18.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.545+0000 7fe3ad11e740 1 -- start start 2024-09-11T22:13:18.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.545+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.545+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383dc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.545+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 0x5646383e7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.545+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a41b2620 con 0x5646383c6b40 2024-09-11T22:13:18.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.545+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a41afef0 con 0x5646383d0370 2024-09-11T22:13:18.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.545+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a41add60 con 0x5646383c55d0 2024-09-11T22:13:18.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.545+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383dc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.546+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383dc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35914/0 (socket says 172.21.15.152:35914) 2024-09-11T22:13:18.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.546+0000 7fe3a3fff640 1 -- 172.21.15.152:0/204581553 learned_addr learned my addr 172.21.15.152:0/204581553 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:18.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.546+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/204581553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.546+0000 7fe3a8ae1640 1 -- 172.21.15.152:0/204581553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 msgr2=0x5646383e7c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:13:18.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.546+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/204581553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 0x5646383e7c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.546+0000 7fe3a8ae1640 1 -- 172.21.15.152:0/204581553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 msgr2=0x5646383dc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:18.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.546+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/204581553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383dc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.546+0000 7fe3a8ae1640 1 -- 172.21.15.152:0/204581553 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646383e2760 con 0x5646383c55d0 2024-09-11T22:13:18.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.546+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/204581553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383ccfe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe398004de0 tx=0x7fe3980046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b25f0c4132c191f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:18.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.546+0000 7fe38e7fc640 1 -- 172.21.15.152:0/204581553 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398035040 con 0x5646383c55d0 2024-09-11T22:13:18.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.547+0000 7fe38e7fc640 1 -- 172.21.15.152:0/204581553 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3980044b0 con 0x5646383c55d0 2024-09-11T22:13:18.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.547+0000 7fe38e7fc640 1 -- 172.21.15.152:0/204581553 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398031a80 con 0x5646383c55d0 2024-09-11T22:13:18.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.547+0000 7fe3ad11e740 1 -- 172.21.15.152:0/204581553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 msgr2=0x5646383ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:18.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.547+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/204581553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383ccfe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe398004de0 tx=0x7fe3980046c0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.548+0000 7fe3ad11e740 1 -- 172.21.15.152:0/204581553 shutdown_connections 2024-09-11T22:13:18.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.548+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/204581553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 0x5646383e7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.548+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/204581553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383dc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.548+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/204581553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383ccfe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.548+0000 7fe3ad11e740 1 -- 172.21.15.152:0/204581553 >> 172.21.15.152:0/204581553 conn(0x56463838e310 msgr2=0x5646383cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:18.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.549+0000 7fe3ad11e740 1 -- 172.21.15.152:0/204581553 shutdown_connections 2024-09-11T22:13:18.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.549+0000 7fe3ad11e740 1 -- 172.21.15.152:0/204581553 wait complete. 2024-09-11T22:13:18.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.550+0000 7fe3ad11e740 1 -- start start 2024-09-11T22:13:18.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.550+0000 7fe3ad11e740 1 Processor -- start 2024-09-11T22:13:18.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.551+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383d8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.551+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.551+0000 7fe3ad11e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 0x5646383ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.551+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a41ae3b0 con 0x5646383c6b40 2024-09-11T22:13:18.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.551+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a41af820 con 0x5646383d0370 2024-09-11T22:13:18.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.551+0000 7fe3ad11e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a41aea80 con 0x5646383c55d0 2024-09-11T22:13:18.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.551+0000 7fe3ad11e740 10 client.0 _ll_register_callbacks cb 0x7fe39c009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:18.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.552+0000 7fe3a8ae1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383d8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.552+0000 7fe3a8ae1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383d8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59218/0 (socket says 172.21.15.152:59218) 2024-09-11T22:13:18.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.552+0000 7fe3a8ae1640 1 -- 172.21.15.152:0/1628897750 learned_addr learned my addr 172.21.15.152:0/1628897750 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:18.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.552+0000 7fe3a3fff640 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.552+0000 7fe3a92e2640 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 0x5646383ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.552+0000 7fe3a92e2640 1 -- 172.21.15.152:0/1628897750 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 msgr2=0x5646383d8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:18.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.552+0000 7fe3a92e2640 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383d8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.552+0000 7fe3a92e2640 1 -- 172.21.15.152:0/1628897750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 msgr2=0x5646383c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:18.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.552+0000 7fe3a92e2640 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.552+0000 7fe3a92e2640 1 -- 172.21.15.152:0/1628897750 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646383d00d0 con 0x5646383d0370 2024-09-11T22:13:18.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.552+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383d8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:18.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.553+0000 7fe3a3fff640 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:18.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.553+0000 7fe3a92e2640 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 0x5646383ca210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe39c004010 tx=0x7fe39c01e630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f84a278137aa80c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:18.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.553+0000 7fe383fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:13:18.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.553+0000 7fe383fff640 1 -- 172.21.15.152:0/1628897750 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0049b0 con 0x5646383d0370 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.554+0000 7fe383fff640 1 -- 172.21.15.152:0/1628897750 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8658+0+0 (secure 0 0 0) 0x7fe39c004b50 con 0x5646383d0370 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.554+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1628897750 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3980044b0 con 0x5646383d0370 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.554+0000 7fe383fff640 1 -- 172.21.15.152:0/1628897750 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe39c004d70 con 0x5646383d0370 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.554+0000 7fe3ad11e740 10 client.26975 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.554+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1628897750 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56463844a9a0 con 0x5646383d0370 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.554+0000 7fe383fff640 1 -- 172.21.15.152:0/1628897750 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3980044b0 con 0x5646383d0370 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.554+0000 7fe383fff640 1 -- 172.21.15.152:0/1628897750 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe39c03c5d0 con 0x5646383d0370 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.555+0000 7fe3ad11e740 10 client.26975 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.555+0000 7fe3ad11e740 10 client.26975 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.555+0000 7fe3ad11e740 20 client.26975 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.555+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56463844b060 0x56463844d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.555+0000 7fe3ad11e740 4 client.26975 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:13:18.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.555+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1628897750 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564638332d70 con 0x56463844b060 2024-09-11T22:13:18.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.555+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56463844b060 0x56463844d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:18.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.555+0000 7fe3a8ae1640 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56463844b060 0x56463844d480 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4760afea1bf8e774 server_cookie=a4ccaf3d60d994dd in_seq=0 out_seq=0 2024-09-11T22:13:18.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.555+0000 7fe383fff640 10 client.26975 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:13:18.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.556+0000 7fe383fff640 1 -- 172.21.15.152:0/1628897750 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564638332d70 con 0x56463844b060 2024-09-11T22:13:18.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.556+0000 7fe383fff640 10 client.26975 handle_command_reply: tid=0 2024-09-11T22:13:18.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.556+0000 7fe3ad11e740 1 client.26975 shutdown 2024-09-11T22:13:18.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.556+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1628897750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 msgr2=0x5646383ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:18.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.556+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 0x5646383ca210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe39c004010 tx=0x7fe39c01e630 comp rx=0 tx=0).stop 2024-09-11T22:13:18.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.556+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1628897750 shutdown_connections 2024-09-11T22:13:18.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.556+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56463844b060 0x56463844d480 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.556+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646383d0370 0x5646383ca210 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.557+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5646383c6b40 0x5646383c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.556+0000 7fe383fff640 0 client.26975 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:13:18.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.557+0000 7fe3ad11e740 1 --2- 172.21.15.152:0/1628897750 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646383c55d0 0x5646383d8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.557+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1628897750 >> 172.21.15.152:0/1628897750 conn(0x56463838e310 msgr2=0x5646383c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:18.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.557+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1628897750 shutdown_connections 2024-09-11T22:13:18.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.557+0000 7fe3ad11e740 1 -- 172.21.15.152:0/1628897750 wait complete. 2024-09-11T22:13:18.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.558+0000 7fe3ad11e740 20 client.26975 trim_cache size 0 max 16384 2024-09-11T22:13:18.561 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:13:18.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.559+0000 7fe3aad45640 1 -- 172.21.15.152:0/1146006014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3940a2df0 msgr2=0x7fe3940a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:18.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.559+0000 7fe3aad45640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3940a2df0 0x7fe3940a52b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe39c005fd0 tx=0x7fe39c009a90 comp rx=0 tx=0).stop 2024-09-11T22:13:18.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.559+0000 7fe3aad45640 1 -- 172.21.15.152:0/1146006014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a41049b0 msgr2=0x7fe3a419abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:18.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.559+0000 7fe3aad45640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a41049b0 0x7fe3a419abe0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe39000d6d0 tx=0x7fe39000db90 comp rx=0 tx=0).stop 2024-09-11T22:13:18.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.559+0000 7fe3aad45640 1 -- 172.21.15.152:0/1146006014 shutdown_connections 2024-09-11T22:13:18.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.559+0000 7fe3aad45640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe3940a2df0 0x7fe3940a52b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.559+0000 7fe3aad45640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3a4109130 0x7fe3a419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.559+0000 7fe3aad45640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a41049b0 0x7fe3a419abe0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.559+0000 7fe3aad45640 1 --2- 172.21.15.152:0/1146006014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a4104000 0x7fe3a419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:18.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.559+0000 7fe3aad45640 1 -- 172.21.15.152:0/1146006014 >> 172.21.15.152:0/1146006014 conn(0x7fe3a40ffa20 msgr2=0x7fe3a4100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:18.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.560+0000 7fe3aad45640 1 -- 172.21.15.152:0/1146006014 shutdown_connections 2024-09-11T22:13:18.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:18.560+0000 7fe3aad45640 1 -- 172.21.15.152:0/1146006014 wait complete. 2024-09-11T22:13:19.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:19 smithi152 ceph-mon[31188]: pgmap v278: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 27 MiB/s wr, 1.96k op/s 2024-09-11T22:13:19.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:19 smithi152 ceph-mon[31188]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T22:13:19.414 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:13:19.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:19 smithi179 ceph-mon[35603]: pgmap v278: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 27 MiB/s wr, 1.96k op/s 2024-09-11T22:13:19.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:19 smithi179 ceph-mon[35603]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T22:13:19.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:19 smithi193 ceph-mon[35545]: pgmap v278: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 27 MiB/s wr, 1.96k op/s 2024-09-11T22:13:19.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:19 smithi193 ceph-mon[35545]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T22:13:19.795 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:13:19.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 465.0 s, 3831.6 tps, lat 26.078 ms stddev 29.881 2024-09-11T22:13:20.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.300+0000 7fa391653640 1 -- 172.21.15.152:0/2897795803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa38c112640 msgr2=0x7fa38c112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:20.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.300+0000 7fa391653640 1 --2- 172.21.15.152:0/2897795803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa38c112640 0x7fa38c112a20 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009900 tx=0x7fa37c02a410 comp rx=0 tx=0).stop 2024-09-11T22:13:20.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.301+0000 7fa391653640 1 -- 172.21.15.152:0/2897795803 shutdown_connections 2024-09-11T22:13:20.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.301+0000 7fa391653640 1 --2- 172.21.15.152:0/2897795803 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c10cf30 0x7fa38c119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.301+0000 7fa391653640 1 --2- 172.21.15.152:0/2897795803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa38c10c590 0x7fa38c10c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.301+0000 7fa391653640 1 --2- 172.21.15.152:0/2897795803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa38c112640 0x7fa38c112a20 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.301+0000 7fa391653640 1 -- 172.21.15.152:0/2897795803 >> 172.21.15.152:0/2897795803 conn(0x7fa38c06cdc0 msgr2=0x7fa38c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:20.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.301+0000 7fa391653640 1 -- 172.21.15.152:0/2897795803 shutdown_connections 2024-09-11T22:13:20.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.301+0000 7fa391653640 1 -- 172.21.15.152:0/2897795803 wait complete. 2024-09-11T22:13:20.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.301+0000 7fa391653640 1 Processor -- start 2024-09-11T22:13:20.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa391653640 1 -- start start 2024-09-11T22:13:20.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa391653640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c10c590 0x7fa38c1a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa391653640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa38c10cf30 0x7fa38c1a3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa391653640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa38c112640 0x7fa38c1a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa391653640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c11c9f0 con 0x7fa38c10cf30 2024-09-11T22:13:20.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa391653640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c11c870 con 0x7fa38c112640 2024-09-11T22:13:20.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa391653640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c11cb70 con 0x7fa38c10c590 2024-09-11T22:13:20.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa38affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c10c590 0x7fa38c1a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa38a7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa38c10cf30 0x7fa38c1a3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa38affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c10c590 0x7fa38c1a2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59226/0 (socket says 172.21.15.152:59226) 2024-09-11T22:13:20.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa38affd640 1 -- 172.21.15.152:0/2869870218 learned_addr learned my addr 172.21.15.152:0/2869870218 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:20.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.302+0000 7fa38b7fe640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa38c112640 0x7fa38c1a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.303+0000 7fa38a7fc640 1 -- 172.21.15.152:0/2869870218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c10c590 msgr2=0x7fa38c1a2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:20.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.303+0000 7fa38a7fc640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c10c590 0x7fa38c1a2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.303+0000 7fa38a7fc640 1 -- 172.21.15.152:0/2869870218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa38c112640 msgr2=0x7fa38c1a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:20.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.303+0000 7fa38a7fc640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa38c112640 0x7fa38c1a76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.303+0000 7fa38a7fc640 1 -- 172.21.15.152:0/2869870218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c1a7d80 con 0x7fa38c10cf30 2024-09-11T22:13:20.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.303+0000 7fa38b7fe640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa38c112640 0x7fa38c1a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:20.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.303+0000 7fa38a7fc640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa38c10cf30 0x7fa38c1a3310 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa38000e9f0 tx=0x7fa38000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:20.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.304+0000 7fa373fff640 1 -- 172.21.15.152:0/2869870218 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38000ccc0 con 0x7fa38c10cf30 2024-09-11T22:13:20.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.304+0000 7fa373fff640 1 -- 172.21.15.152:0/2869870218 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa380010910 con 0x7fa38c10cf30 2024-09-11T22:13:20.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.304+0000 7fa373fff640 1 -- 172.21.15.152:0/2869870218 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380018960 con 0x7fa38c10cf30 2024-09-11T22:13:20.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.304+0000 7fa391653640 1 -- 172.21.15.152:0/2869870218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38c1a8070 con 0x7fa38c10cf30 2024-09-11T22:13:20.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.304+0000 7fa391653640 1 -- 172.21.15.152:0/2869870218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38c1a84a0 con 0x7fa38c10cf30 2024-09-11T22:13:20.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.307+0000 7fa373fff640 1 -- 172.21.15.152:0/2869870218 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa380018b00 con 0x7fa38c10cf30 2024-09-11T22:13:20.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.308+0000 7fa373fff640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3740a2e40 0x7fa3740a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.308+0000 7fa38affd640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3740a2e40 0x7fa3740a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.308+0000 7fa373fff640 1 -- 172.21.15.152:0/2869870218 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fa3800d06f0 con 0x7fa38c10cf30 2024-09-11T22:13:20.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.309+0000 7fa38affd640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3740a2e40 0x7fa3740a5300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa37c000c00 tx=0x7fa37c0046c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:20.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.310+0000 7fa393a2c740 1 Processor -- start 2024-09-11T22:13:20.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.310+0000 7fa393a2c740 1 -- start start 2024-09-11T22:13:20.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b90612b40 0x559b90611090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b906115d0 0x559b90611a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b90626f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa393a2c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559b905772f0 con 0x559b90624b80 2024-09-11T22:13:20.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa393a2c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559b9051ecf0 con 0x559b90612b40 2024-09-11T22:13:20.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa393a2c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559b905732b0 con 0x559b906115d0 2024-09-11T22:13:20.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa38b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b90626f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa38a7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b906115d0 0x559b90611a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa38affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b90612b40 0x559b90611090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa38a7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b906115d0 0x559b90611a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59234/0 (socket says 172.21.15.152:59234) 2024-09-11T22:13:20.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa38a7fc640 1 -- 172.21.15.152:0/1782301136 learned_addr learned my addr 172.21.15.152:0/1782301136 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:20.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa38b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b90626f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35946/0 (socket says 172.21.15.152:35946) 2024-09-11T22:13:20.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa38a7fc640 1 -- 172.21.15.152:0/1782301136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b90612b40 msgr2=0x559b90611090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:20.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa38a7fc640 1 --2- 172.21.15.152:0/1782301136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b90612b40 0x559b90611090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa38a7fc640 1 -- 172.21.15.152:0/1782301136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 msgr2=0x559b90626f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:20.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa38a7fc640 1 --2- 172.21.15.152:0/1782301136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b90626f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.311+0000 7fa38a7fc640 1 -- 172.21.15.152:0/1782301136 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b905033a0 con 0x559b906115d0 2024-09-11T22:13:20.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.312+0000 7fa38a7fc640 1 --2- 172.21.15.152:0/1782301136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b906115d0 0x559b90611a10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa3800a5290 tx=0x7fa38009ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a59c5428de56fff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:20.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.312+0000 7fa3717fa640 1 -- 172.21.15.152:0/1782301136 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38009af00 con 0x559b906115d0 2024-09-11T22:13:20.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.312+0000 7fa3717fa640 1 -- 172.21.15.152:0/1782301136 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3800ce000 con 0x559b906115d0 2024-09-11T22:13:20.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.313+0000 7fa3717fa640 1 -- 172.21.15.152:0/1782301136 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38009c050 con 0x559b906115d0 2024-09-11T22:13:20.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.313+0000 7fa393a2c740 1 -- 172.21.15.152:0/1782301136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b906115d0 msgr2=0x559b90611a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:20.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.313+0000 7fa393a2c740 1 --2- 172.21.15.152:0/1782301136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b906115d0 0x559b90611a10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa3800a5290 tx=0x7fa38009ccc0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.313+0000 7fa393a2c740 1 -- 172.21.15.152:0/1782301136 shutdown_connections 2024-09-11T22:13:20.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.313+0000 7fa393a2c740 1 --2- 172.21.15.152:0/1782301136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b90626f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.313+0000 7fa393a2c740 1 --2- 172.21.15.152:0/1782301136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b906115d0 0x559b90611a10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.313+0000 7fa393a2c740 1 --2- 172.21.15.152:0/1782301136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b90612b40 0x559b90611090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.314+0000 7fa393a2c740 1 -- 172.21.15.152:0/1782301136 >> 172.21.15.152:0/1782301136 conn(0x559b905da310 msgr2=0x559b9060dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:20.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.314+0000 7fa393a2c740 1 -- 172.21.15.152:0/1782301136 shutdown_connections 2024-09-11T22:13:20.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.314+0000 7fa393a2c740 1 -- 172.21.15.152:0/1782301136 wait complete. 2024-09-11T22:13:20.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.314+0000 7fa393a2c740 1 -- start start 2024-09-11T22:13:20.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.317+0000 7fa393a2c740 1 Processor -- start 2024-09-11T22:13:20.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.317+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b906115d0 0x559b90624550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.317+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90612b40 0x559b90621850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.318+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b90624b80 0x559b90621eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.318+0000 7fa38a7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90612b40 0x559b90621850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.318+0000 7fa38a7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90612b40 0x559b90621850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35956/0 (socket says 172.21.15.152:35956) 2024-09-11T22:13:20.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.318+0000 7fa38a7fc640 1 -- 172.21.15.152:0/3826330324 learned_addr learned my addr 172.21.15.152:0/3826330324 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:20.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.318+0000 7fa393a2c740 1 -- 172.21.15.152:0/3826330324 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559b90627870 con 0x559b90612b40 2024-09-11T22:13:20.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.318+0000 7fa393a2c740 1 -- 172.21.15.152:0/3826330324 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559b90532060 con 0x559b90624b80 2024-09-11T22:13:20.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.318+0000 7fa393a2c740 1 -- 172.21.15.152:0/3826330324 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559b906279f0 con 0x559b906115d0 2024-09-11T22:13:20.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.318+0000 7fa393a2c740 10 client.0 _ll_register_callbacks cb 0x559b902858c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:20.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.318+0000 7fa38b7fe640 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b90624b80 0x559b90621eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.321+0000 7fa38b7fe640 1 -- 172.21.15.152:0/3826330324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b906115d0 msgr2=0x559b90624550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:20.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.321+0000 7fa38b7fe640 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b906115d0 0x559b90624550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.321+0000 7fa38b7fe640 1 -- 172.21.15.152:0/3826330324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90612b40 msgr2=0x559b90621850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:20.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.321+0000 7fa38b7fe640 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90612b40 0x559b90621850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.321+0000 7fa38b7fe640 1 -- 172.21.15.152:0/3826330324 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b902e83c0 con 0x559b90624b80 2024-09-11T22:13:20.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.321+0000 7fa38b7fe640 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b90624b80 0x559b90621eb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa384005fd0 tx=0x7fa3840107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6189ec9a45f2decf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:20.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.322+0000 7fa36eff5640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:13:20.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.322+0000 7fa36eff5640 1 -- 172.21.15.152:0/3826330324 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384004d20 con 0x559b90624b80 2024-09-11T22:13:20.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.324+0000 7fa393a2c740 1 -- 172.21.15.152:0/3826330324 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3800ce000 con 0x559b90624b80 2024-09-11T22:13:20.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.325+0000 7fa36eff5640 1 -- 172.21.15.152:0/3826330324 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fa384005020 con 0x559b90624b80 2024-09-11T22:13:20.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.326+0000 7fa36eff5640 1 -- 172.21.15.152:0/3826330324 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa384005220 con 0x559b90624b80 2024-09-11T22:13:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.326+0000 7fa393a2c740 10 client.26987 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.326+0000 7fa393a2c740 1 -- 172.21.15.152:0/3826330324 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559b90633430 con 0x559b90624b80 2024-09-11T22:13:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.326+0000 7fa36eff5640 1 -- 172.21.15.152:0/3826330324 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3840058a0 con 0x559b90624b80 2024-09-11T22:13:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.327+0000 7fa36eff5640 1 -- 172.21.15.152:0/3826330324 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa384019070 con 0x559b90624b80 2024-09-11T22:13:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.327+0000 7fa393a2c740 10 client.26987 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.327+0000 7fa393a2c740 10 client.26987 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:13:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.327+0000 7fa393a2c740 20 client.26987 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.327+0000 7fa393a2c740 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x559b90634900 0x559b90636d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.327+0000 7fa393a2c740 4 client.26987 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:20.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.327+0000 7fa393a2c740 1 -- 172.21.15.152:0/3826330324 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa3800ce000 con 0x559b90634900 2024-09-11T22:13:20.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.327+0000 7fa38affd640 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x559b90634900 0x559b90636d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.328+0000 7fa38affd640 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x559b90634900 0x559b90636d60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee487d53f91937f server_cookie=40a16c58c91be3f9 in_seq=0 out_seq=0 2024-09-11T22:13:20.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.328+0000 7fa36eff5640 10 client.26987 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:13:20.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.330+0000 7fa36eff5640 1 -- 172.21.15.152:0/3826330324 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa3800ce000 con 0x559b90634900 2024-09-11T22:13:20.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.330+0000 7fa36eff5640 10 client.26987 handle_command_reply: tid=0 2024-09-11T22:13:20.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.330+0000 7fa393a2c740 1 client.26987 shutdown 2024-09-11T22:13:20.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.333+0000 7fa393a2c740 1 -- 172.21.15.152:0/3826330324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b90624b80 msgr2=0x559b90621eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:20.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.333+0000 7fa393a2c740 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b90624b80 0x559b90621eb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa384005fd0 tx=0x7fa3840107a0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.334+0000 7fa393a2c740 1 -- 172.21.15.152:0/3826330324 shutdown_connections 2024-09-11T22:13:20.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.334+0000 7fa393a2c740 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x559b90634900 0x559b90636d60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.334+0000 7fa393a2c740 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b90624b80 0x559b90621eb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.334+0000 7fa393a2c740 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90612b40 0x559b90621850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.334+0000 7fa393a2c740 1 --2- 172.21.15.152:0/3826330324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b906115d0 0x559b90624550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.334+0000 7fa393a2c740 1 -- 172.21.15.152:0/3826330324 >> 172.21.15.152:0/3826330324 conn(0x559b905da310 msgr2=0x559b906139c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:20.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.335+0000 7fa36eff5640 0 client.26987 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:13:20.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.335+0000 7fa393a2c740 1 -- 172.21.15.152:0/3826330324 shutdown_connections 2024-09-11T22:13:20.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.335+0000 7fa393a2c740 1 -- 172.21.15.152:0/3826330324 wait complete. 2024-09-11T22:13:20.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.335+0000 7fa393a2c740 20 client.26987 trim_cache size 0 max 16384 2024-09-11T22:13:20.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.365+0000 7fa393a2c740 1 Processor -- start 2024-09-11T22:13:20.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.365+0000 7fa393a2c740 1 -- start start 2024-09-11T22:13:20.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 0x559b90630b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b90612b40 0x559b9063c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b9063cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa393a2c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa378011170 con 0x559b90624b80 2024-09-11T22:13:20.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa393a2c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa37800ea40 con 0x559b906115d0 2024-09-11T22:13:20.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa393a2c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa37800c8b0 con 0x559b90612b40 2024-09-11T22:13:20.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa38affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 0x559b90630b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa38affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 0x559b90630b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52830/0 (socket says 172.21.15.152:52830) 2024-09-11T22:13:20.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa38affd640 1 -- 172.21.15.152:0/527858573 learned_addr learned my addr 172.21.15.152:0/527858573 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:20.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa38affd640 1 -- 172.21.15.152:0/527858573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b90612b40 msgr2=0x559b9063c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:20.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa38affd640 1 --2- 172.21.15.152:0/527858573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b90612b40 0x559b9063c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa38affd640 1 -- 172.21.15.152:0/527858573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 msgr2=0x559b9063cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:20.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa38b7fe640 1 --2- 172.21.15.152:0/527858573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b9063cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa38affd640 1 --2- 172.21.15.152:0/527858573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b9063cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.366+0000 7fa38affd640 1 -- 172.21.15.152:0/527858573 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b90614120 con 0x559b906115d0 2024-09-11T22:13:20.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.367+0000 7fa38b7fe640 1 --2- 172.21.15.152:0/527858573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b9063cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:20.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.367+0000 7fa38affd640 1 --2- 172.21.15.152:0/527858573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 0x559b90630b70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x559b906375d0 tx=0x7fa37c041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca79b7a7502ceb73 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:20.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.367+0000 7fa370ff9640 1 -- 172.21.15.152:0/527858573 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c035040 con 0x559b906115d0 2024-09-11T22:13:20.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.367+0000 7fa370ff9640 1 -- 172.21.15.152:0/527858573 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa37c057070 con 0x559b906115d0 2024-09-11T22:13:20.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.367+0000 7fa370ff9640 1 -- 172.21.15.152:0/527858573 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c031e40 con 0x559b906115d0 2024-09-11T22:13:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.368+0000 7fa393a2c740 1 -- 172.21.15.152:0/527858573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 msgr2=0x559b90630b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.369+0000 7fa393a2c740 1 --2- 172.21.15.152:0/527858573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 0x559b90630b70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x559b906375d0 tx=0x7fa37c041000 comp rx=0 tx=0).stop 2024-09-11T22:13:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.369+0000 7fa393a2c740 1 -- 172.21.15.152:0/527858573 shutdown_connections 2024-09-11T22:13:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.369+0000 7fa393a2c740 1 --2- 172.21.15.152:0/527858573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b9063cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.369+0000 7fa393a2c740 1 --2- 172.21.15.152:0/527858573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b90612b40 0x559b9063c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.369+0000 7fa393a2c740 1 --2- 172.21.15.152:0/527858573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 0x559b90630b70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.369+0000 7fa393a2c740 1 -- 172.21.15.152:0/527858573 >> 172.21.15.152:0/527858573 conn(0x559b905da310 msgr2=0x559b906238d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.369+0000 7fa393a2c740 1 -- 172.21.15.152:0/527858573 shutdown_connections 2024-09-11T22:13:20.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.370+0000 7fa393a2c740 1 -- 172.21.15.152:0/527858573 wait complete. 2024-09-11T22:13:20.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.371+0000 7fa393a2c740 1 -- start start 2024-09-11T22:13:20.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.371+0000 7fa393a2c740 1 Processor -- start 2024-09-11T22:13:20.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.372+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 0x559b9062cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.372+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b90612b40 0x559b9062d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.372+0000 7fa38affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 0x559b9062cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.372+0000 7fa393a2c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b90629cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.372+0000 7fa393a2c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa37800cf00 con 0x559b90624b80 2024-09-11T22:13:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.372+0000 7fa38affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 0x559b9062cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52836/0 (socket says 172.21.15.152:52836) 2024-09-11T22:13:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.372+0000 7fa38affd640 1 -- 172.21.15.152:0/4054926046 learned_addr learned my addr 172.21.15.152:0/4054926046 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.372+0000 7fa38a7fc640 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b90612b40 0x559b9062d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.372+0000 7fa393a2c740 1 -- 172.21.15.152:0/4054926046 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa37800e370 con 0x559b906115d0 2024-09-11T22:13:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.372+0000 7fa393a2c740 1 -- 172.21.15.152:0/4054926046 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa37800d5d0 con 0x559b90612b40 2024-09-11T22:13:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.373+0000 7fa393a2c740 10 client.0 _ll_register_callbacks cb 0x7fa384009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.373+0000 7fa38b7fe640 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b90629cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.373+0000 7fa38a7fc640 1 -- 172.21.15.152:0/4054926046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 msgr2=0x559b9062cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:20.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.373+0000 7fa38a7fc640 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 0x559b9062cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.373+0000 7fa38a7fc640 1 -- 172.21.15.152:0/4054926046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 msgr2=0x559b90629cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:20.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.373+0000 7fa38a7fc640 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b90629cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.373+0000 7fa38a7fc640 1 -- 172.21.15.152:0/4054926046 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b9062a1f0 con 0x559b90612b40 2024-09-11T22:13:20.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.373+0000 7fa38a7fc640 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b90612b40 0x559b9062d220 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3800988e0 tx=0x7fa38000cf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f981ec469b7a7398 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:20.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.373+0000 7fa36eff5640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:13:20.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.373+0000 7fa36eff5640 1 -- 172.21.15.152:0/4054926046 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3800b9020 con 0x559b90612b40 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.374+0000 7fa36eff5640 1 -- 172.21.15.152:0/4054926046 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fa3800bb2c0 con 0x559b90612b40 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.374+0000 7fa393a2c740 1 -- 172.21.15.152:0/4054926046 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa37c057070 con 0x559b90612b40 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.374+0000 7fa36eff5640 1 -- 172.21.15.152:0/4054926046 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa3800bb4c0 con 0x559b90612b40 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.374+0000 7fa393a2c740 10 client.27166 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.374+0000 7fa393a2c740 1 -- 172.21.15.152:0/4054926046 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559b9069fce0 con 0x559b90612b40 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.374+0000 7fa36eff5640 1 -- 172.21.15.152:0/4054926046 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa380010ac0 con 0x559b90612b40 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.375+0000 7fa36eff5640 1 -- 172.21.15.152:0/4054926046 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa380098950 con 0x559b90612b40 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.375+0000 7fa393a2c740 10 client.27166 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.375+0000 7fa393a2c740 10 client.27166 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.375+0000 7fa393a2c740 20 client.27166 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.375+0000 7fa393a2c740 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x559b9069ff70 0x559b906a2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.375+0000 7fa393a2c740 4 client.27166 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:13:20.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.375+0000 7fa393a2c740 1 -- 172.21.15.152:0/4054926046 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa37c057070 con 0x559b9069ff70 2024-09-11T22:13:20.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.375+0000 7fa38affd640 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x559b9069ff70 0x559b906a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:20.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.376+0000 7fa38affd640 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x559b9069ff70 0x559b906a2360 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5fdd6e5305780792 server_cookie=d328f6037fbe5099 in_seq=0 out_seq=0 2024-09-11T22:13:20.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.376+0000 7fa36eff5640 10 client.27166 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:13:20.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.376+0000 7fa36eff5640 1 -- 172.21.15.152:0/4054926046 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa37c057070 con 0x559b9069ff70 2024-09-11T22:13:20.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.376+0000 7fa36eff5640 10 client.27166 handle_command_reply: tid=0 2024-09-11T22:13:20.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.376+0000 7fa393a2c740 1 client.27166 shutdown 2024-09-11T22:13:20.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa393a2c740 1 -- 172.21.15.152:0/4054926046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b90612b40 msgr2=0x559b9062d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:20.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa393a2c740 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b90612b40 0x559b9062d220 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3800988e0 tx=0x7fa38000cf10 comp rx=0 tx=0).stop 2024-09-11T22:13:20.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa393a2c740 1 -- 172.21.15.152:0/4054926046 shutdown_connections 2024-09-11T22:13:20.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa393a2c740 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x559b9069ff70 0x559b906a2360 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa36eff5640 0 client.27166 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:13:20.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa393a2c740 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b90624b80 0x559b90629cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa393a2c740 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559b90612b40 0x559b9062d220 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.381 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa393a2c740 1 --2- 172.21.15.152:0/4054926046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559b906115d0 0x559b9062cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa393a2c740 1 -- 172.21.15.152:0/4054926046 >> 172.21.15.152:0/4054926046 conn(0x559b905da310 msgr2=0x559b90613110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa393a2c740 1 -- 172.21.15.152:0/4054926046 shutdown_connections 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa393a2c740 1 -- 172.21.15.152:0/4054926046 wait complete. 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.377+0000 7fa393a2c740 20 client.27166 trim_cache size 0 max 16384 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.378+0000 7fa391653640 1 -- 172.21.15.152:0/2869870218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3740a2e40 msgr2=0x7fa3740a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.378+0000 7fa391653640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3740a2e40 0x7fa3740a5300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa37c000c00 tx=0x7fa37c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.378+0000 7fa391653640 1 -- 172.21.15.152:0/2869870218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa38c10cf30 msgr2=0x7fa38c1a3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.378+0000 7fa391653640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa38c10cf30 0x7fa38c1a3310 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa38000e9f0 tx=0x7fa38000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.380+0000 7fa391653640 1 -- 172.21.15.152:0/2869870218 shutdown_connections 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.380+0000 7fa391653640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3740a2e40 0x7fa3740a5300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.380+0000 7fa391653640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa38c112640 0x7fa38c1a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.380+0000 7fa391653640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa38c10cf30 0x7fa38c1a3310 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.380+0000 7fa391653640 1 --2- 172.21.15.152:0/2869870218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa38c10c590 0x7fa38c1a2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:20.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.380+0000 7fa391653640 1 -- 172.21.15.152:0/2869870218 >> 172.21.15.152:0/2869870218 conn(0x7fa38c06cdc0 msgr2=0x7fa38c10ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:20.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.380+0000 7fa391653640 1 -- 172.21.15.152:0/2869870218 shutdown_connections 2024-09-11T22:13:20.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:20.380+0000 7fa391653640 1 -- 172.21.15.152:0/2869870218 wait complete. 2024-09-11T22:13:21.122 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:13:21.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:21 smithi152 ceph-mon[31188]: pgmap v280: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 760 op/s 2024-09-11T22:13:21.535 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:13:21.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:21 smithi179 ceph-mon[35603]: pgmap v280: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 760 op/s 2024-09-11T22:13:21.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:21 smithi193 ceph-mon[35545]: pgmap v280: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 760 op/s 2024-09-11T22:13:22.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.122+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/2676279150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e4103ff0 msgr2=0x7ff3e41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.122+0000 7ff3ec0d7640 1 --2- 172.21.15.152:0/2676279150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e4103ff0 0x7ff3e41043d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009900 tx=0x7ff3e002a3f0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.123+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/2676279150 shutdown_connections 2024-09-11T22:13:22.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.123+0000 7ff3ec0d7640 1 --2- 172.21.15.152:0/2676279150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e4109120 0x7ff3e4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.123+0000 7ff3ec0d7640 1 --2- 172.21.15.152:0/2676279150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3e41049a0 0x7ff3e41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.123+0000 7ff3ec0d7640 1 --2- 172.21.15.152:0/2676279150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e4103ff0 0x7ff3e41043d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.123+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/2676279150 >> 172.21.15.152:0/2676279150 conn(0x7ff3e40ffab0 msgr2=0x7ff3e4101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:22.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.124+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/2676279150 shutdown_connections 2024-09-11T22:13:22.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.124+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/2676279150 wait complete. 2024-09-11T22:13:22.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.125+0000 7ff3ec0d7640 1 Processor -- start 2024-09-11T22:13:22.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.125+0000 7ff3ec0d7640 1 -- start start 2024-09-11T22:13:22.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.125+0000 7ff3ec0d7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e4103ff0 0x7ff3e4076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.125+0000 7ff3ec0d7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e41049a0 0x7ff3e4076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.125+0000 7ff3ec0d7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3e4109120 0x7ff3e4077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.125+0000 7ff3ec0d7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e4114170 con 0x7ff3e41049a0 2024-09-11T22:13:22.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.125+0000 7ff3ec0d7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e4113ff0 con 0x7ff3e4103ff0 2024-09-11T22:13:22.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.125+0000 7ff3ec0d7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e41142f0 con 0x7ff3e4109120 2024-09-11T22:13:22.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.125+0000 7ff3ea674640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3e4109120 0x7ff3e4077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.125+0000 7ff3ea674640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3e4109120 0x7ff3e4077180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59270/0 (socket says 172.21.15.152:59270) 2024-09-11T22:13:22.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.125+0000 7ff3ea674640 1 -- 172.21.15.152:0/1854451858 learned_addr learned my addr 172.21.15.152:0/1854451858 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:22.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.126+0000 7ff3ea674640 1 -- 172.21.15.152:0/1854451858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e4103ff0 msgr2=0x7ff3e4076700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:13:22.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.126+0000 7ff3ea674640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e4103ff0 0x7ff3e4076700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.126+0000 7ff3ea674640 1 -- 172.21.15.152:0/1854451858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e41049a0 msgr2=0x7ff3e4076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.126+0000 7ff3ea674640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e41049a0 0x7ff3e4076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.126+0000 7ff3ea674640 1 -- 172.21.15.152:0/1854451858 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e41aad30 con 0x7ff3e4109120 2024-09-11T22:13:22.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.126+0000 7ff3ea674640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3e4109120 0x7ff3e4077180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00eb40 tx=0x7ff3dc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:22.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.127+0000 7ff3daffd640 1 -- 172.21.15.152:0/1854451858 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc004b20 con 0x7ff3e4109120 2024-09-11T22:13:22.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.127+0000 7ff3daffd640 1 -- 172.21.15.152:0/1854451858 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3dc004cc0 con 0x7ff3e4109120 2024-09-11T22:13:22.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.127+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/1854451858 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e41ab020 con 0x7ff3e4109120 2024-09-11T22:13:22.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.127+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/1854451858 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e41ab560 con 0x7ff3e4109120 2024-09-11T22:13:22.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.127+0000 7ff3daffd640 1 -- 172.21.15.152:0/1854451858 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0107b0 con 0x7ff3e4109120 2024-09-11T22:13:22.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.130+0000 7ff3daffd640 1 -- 172.21.15.152:0/1854451858 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff3dc005020 con 0x7ff3e4109120 2024-09-11T22:13:22.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.131+0000 7ff3daffd640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3d00a2dc0 0x7ff3d00a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.131+0000 7ff3ee4b0740 1 Processor -- start 2024-09-11T22:13:22.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3d00a2dc0 0x7ff3d00a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3ee4b0740 1 -- start start 2024-09-11T22:13:22.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3daffd640 1 -- 172.21.15.152:0/1854451858 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7ff3dc0cf9f0 con 0x7ff3e4109120 2024-09-11T22:13:22.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca278b40 0x55d5ca277090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca2775d0 0x55d5ca277a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca282370 0x55d5ca284760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3ee4b0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d5ca1dd2f0 con 0x55d5ca278b40 2024-09-11T22:13:22.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3ee4b0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d5ca184cf0 con 0x55d5ca282370 2024-09-11T22:13:22.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3ee4b0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d5ca1d92b0 con 0x55d5ca2775d0 2024-09-11T22:13:22.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3e9e73640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca278b40 0x55d5ca277090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3e9e73640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca278b40 0x55d5ca277090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36004/0 (socket says 172.21.15.152:36004) 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.132+0000 7ff3e9e73640 1 -- 172.21.15.152:0/3033639512 learned_addr learned my addr 172.21.15.152:0/3033639512 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.133+0000 7ff3ea674640 1 --2- 172.21.15.152:0/3033639512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca282370 0x55d5ca284760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.134+0000 7ff3e9e73640 1 -- 172.21.15.152:0/3033639512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca2775d0 msgr2=0x55d5ca277a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.134+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/3033639512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca2775d0 0x55d5ca277a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.134+0000 7ff3e9e73640 1 -- 172.21.15.152:0/3033639512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca282370 msgr2=0x55d5ca284760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.134+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/3033639512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca282370 0x55d5ca284760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.134+0000 7ff3e9e73640 1 -- 172.21.15.152:0/3033639512 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5ca1693a0 con 0x55d5ca278b40 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.134+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3d00a2dc0 0x7ff3d00a5280 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0005c20 tx=0x7ff3e0000bc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.135+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/3033639512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca278b40 0x55d5ca277090 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0033000 tx=0x7ff3e0042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafd0f670c0af5c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.135+0000 7ff3cffff640 1 -- 172.21.15.152:0/3033639512 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e004c070 con 0x55d5ca278b40 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.135+0000 7ff3cffff640 1 -- 172.21.15.152:0/3033639512 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3e0043070 con 0x55d5ca278b40 2024-09-11T22:13:22.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.135+0000 7ff3cffff640 1 -- 172.21.15.152:0/3033639512 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0035040 con 0x55d5ca278b40 2024-09-11T22:13:22.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.136+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/3033639512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca278b40 msgr2=0x55d5ca277090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.136+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/3033639512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca278b40 0x55d5ca277090 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0033000 tx=0x7ff3e0042000 comp rx=0 tx=0).stop 2024-09-11T22:13:22.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.136+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/3033639512 shutdown_connections 2024-09-11T22:13:22.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.136+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/3033639512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca282370 0x55d5ca284760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.136+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/3033639512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca2775d0 0x55d5ca277a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.136+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/3033639512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca278b40 0x55d5ca277090 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.136+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/3033639512 >> 172.21.15.152:0/3033639512 conn(0x55d5ca240310 msgr2=0x55d5ca273c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:22.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.136+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/3033639512 shutdown_connections 2024-09-11T22:13:22.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.136+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/3033639512 wait complete. 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.136+0000 7ff3ee4b0740 1 -- start start 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.137+0000 7ff3ee4b0740 1 Processor -- start 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.137+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca2775d0 0x55d5ca281ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.137+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca278b40 0x55d5ca27ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.137+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca282370 0x55d5ca27f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.137+0000 7ff3ee4b0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d5ca2850b0 con 0x55d5ca282370 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.137+0000 7ff3ee4b0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d5ca198060 con 0x55d5ca2775d0 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.137+0000 7ff3ee4b0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d5ca285230 con 0x55d5ca278b40 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.137+0000 7ff3e9e73640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca2775d0 0x55d5ca281ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.137+0000 7ff3ee4b0740 10 client.0 _ll_register_callbacks cb 0x55d5c9eeb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3e9672640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca278b40 0x55d5ca27ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3e9672640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca278b40 0x55d5ca27ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59284/0 (socket says 172.21.15.152:59284) 2024-09-11T22:13:22.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3e9672640 1 -- 172.21.15.152:0/2970550818 learned_addr learned my addr 172.21.15.152:0/2970550818 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3ea674640 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca282370 0x55d5ca27f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3e9672640 1 -- 172.21.15.152:0/2970550818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca2775d0 msgr2=0x55d5ca281ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3e9672640 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca2775d0 0x55d5ca281ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3e9672640 1 -- 172.21.15.152:0/2970550818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca282370 msgr2=0x55d5ca27f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3e9672640 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca282370 0x55d5ca27f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3e9672640 1 -- 172.21.15.152:0/2970550818 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5c9f4e3c0 con 0x55d5ca278b40 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3ea674640 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca282370 0x55d5ca27f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3e9672640 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca278b40 0x55d5ca27ef90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400e600 tx=0x7ff3d400eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58141475bc47ad0e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2970550818 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4005220 con 0x55d5ca278b40 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.138+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2970550818 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7ff3d40053c0 con 0x55d5ca278b40 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.139+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2970550818 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e0043070 con 0x55d5ca278b40 2024-09-11T22:13:22.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.139+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2970550818 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff3d40055c0 con 0x55d5ca278b40 2024-09-11T22:13:22.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.139+0000 7ff3ee4b0740 10 client.27175 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:22.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.139+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2970550818 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d5ca290bb0 con 0x55d5ca278b40 2024-09-11T22:13:22.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.140+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2970550818 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3d4004c80 con 0x55d5ca278b40 2024-09-11T22:13:22.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.140+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2970550818 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff3d4022470 con 0x55d5ca278b40 2024-09-11T22:13:22.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.140+0000 7ff3ee4b0740 10 client.27175 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:22.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.140+0000 7ff3ee4b0740 10 client.27175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:22.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.140+0000 7ff3ee4b0740 20 client.27175 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.140+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d5ca292060 0x55d5ca294450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.140+0000 7ff3ee4b0740 4 client.27175 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.141+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2970550818 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff3e0043070 con 0x55d5ca292060 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.141+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d5ca292060 0x55d5ca294450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.142+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d5ca292060 0x55d5ca294450 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e48886b3ec88d6b server_cookie=44b9f385055ec08a in_seq=0 out_seq=0 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.142+0000 7ff3cd7fa640 10 client.27175 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.142+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2970550818 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff3e0043070 con 0x55d5ca292060 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.142+0000 7ff3cd7fa640 10 client.27175 handle_command_reply: tid=0 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.142+0000 7ff3ee4b0740 1 client.27175 shutdown 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2970550818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca278b40 msgr2=0x55d5ca27ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca278b40 0x55d5ca27ef90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400e600 tx=0x7ff3d400eac0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2970550818 shutdown_connections 2024-09-11T22:13:22.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d5ca292060 0x55d5ca294450 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca282370 0x55d5ca27f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca278b40 0x55d5ca27ef90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2970550818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca2775d0 0x55d5ca281ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2970550818 >> 172.21.15.152:0/2970550818 conn(0x55d5ca240310 msgr2=0x55d5ca279930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:22.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3cd7fa640 0 client.27175 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:22.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2970550818 shutdown_connections 2024-09-11T22:13:22.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2970550818 wait complete. 2024-09-11T22:13:22.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.143+0000 7ff3ee4b0740 20 client.27175 trim_cache size 0 max 16384 2024-09-11T22:13:22.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.165+0000 7ff3ee4b0740 1 Processor -- start 2024-09-11T22:13:22.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.165+0000 7ff3ee4b0740 1 -- start start 2024-09-11T22:13:22.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca2775d0 0x55d5ca28e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 0x55d5ca27e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca282370 0x55d5ca27a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3e9e73640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca2775d0 0x55d5ca28e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3e9e73640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca2775d0 0x55d5ca28e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59300/0 (socket says 172.21.15.152:59300) 2024-09-11T22:13:22.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3e9672640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 0x55d5ca27e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3e9672640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 0x55d5ca27e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52880/0 (socket says 172.21.15.152:52880) 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3e9e73640 1 -- 172.21.15.152:0/2510298484 learned_addr learned my addr 172.21.15.152:0/2510298484 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2510298484 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c8011230 con 0x55d5ca282370 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2510298484 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c800eb00 con 0x55d5ca278b40 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2510298484 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c800c970 con 0x55d5ca2775d0 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3ea674640 1 --2- 172.21.15.152:0/2510298484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca282370 0x55d5ca27a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3e9e73640 1 -- 172.21.15.152:0/2510298484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 msgr2=0x55d5ca27e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/2510298484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 0x55d5ca27e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3e9e73640 1 -- 172.21.15.152:0/2510298484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca282370 msgr2=0x55d5ca27a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/2510298484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca282370 0x55d5ca27a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.166+0000 7ff3e9e73640 1 -- 172.21.15.152:0/2510298484 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5ca278760 con 0x55d5ca2775d0 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.167+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/2510298484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca2775d0 0x55d5ca28e3b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff3e004a040 tx=0x7ff3e0005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94972bbfcf184976 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.167+0000 7ff3cf7fe640 1 -- 172.21.15.152:0/2510298484 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0056070 con 0x55d5ca2775d0 2024-09-11T22:13:22.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.167+0000 7ff3cf7fe640 1 -- 172.21.15.152:0/2510298484 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3e0003ed0 con 0x55d5ca2775d0 2024-09-11T22:13:22.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.167+0000 7ff3cf7fe640 1 -- 172.21.15.152:0/2510298484 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0035040 con 0x55d5ca2775d0 2024-09-11T22:13:22.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.168+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2510298484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca2775d0 msgr2=0x55d5ca28e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.168+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2510298484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca2775d0 0x55d5ca28e3b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff3e004a040 tx=0x7ff3e0005fd0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.168+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2510298484 shutdown_connections 2024-09-11T22:13:22.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.168+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2510298484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca282370 0x55d5ca27a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.168+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2510298484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 0x55d5ca27e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.168+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2510298484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca2775d0 0x55d5ca28e3b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.168+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2510298484 >> 172.21.15.152:0/2510298484 conn(0x55d5ca240310 msgr2=0x55d5ca27e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.169+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2510298484 shutdown_connections 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.169+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2510298484 wait complete. 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.169+0000 7ff3ee4b0740 1 -- start start 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.169+0000 7ff3ee4b0740 1 Processor -- start 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.170+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca2775d0 0x55d5ca28a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.170+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 0x55d5ca27ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.170+0000 7ff3ee4b0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca282370 0x55d5ca27bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.170+0000 7ff3ee4b0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c800cfc0 con 0x55d5ca2775d0 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.170+0000 7ff3ee4b0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c800e430 con 0x55d5ca278b40 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.170+0000 7ff3ee4b0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c800d690 con 0x55d5ca282370 2024-09-11T22:13:22.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.170+0000 7ff3ee4b0740 10 client.0 _ll_register_callbacks cb 0x7ff3d40095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.170+0000 7ff3e9672640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 0x55d5ca27ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3e9672640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 0x55d5ca27ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52896/0 (socket says 172.21.15.152:52896) 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3e9672640 1 -- 172.21.15.152:0/2689659370 learned_addr learned my addr 172.21.15.152:0/2689659370 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3ea674640 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca282370 0x55d5ca27bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca2775d0 0x55d5ca28a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3e9672640 1 -- 172.21.15.152:0/2689659370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca282370 msgr2=0x55d5ca27bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3e9672640 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca282370 0x55d5ca27bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3e9672640 1 -- 172.21.15.152:0/2689659370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca2775d0 msgr2=0x55d5ca28a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3e9672640 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca2775d0 0x55d5ca28a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3e9672640 1 -- 172.21.15.152:0/2689659370 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5ca27c540 con 0x55d5ca278b40 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca2775d0 0x55d5ca28a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3ea674640 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca282370 0x55d5ca27bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:22.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3e9672640 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 0x55d5ca27ba90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400a010 tx=0x7ff3d400e580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=142aa389a602f895 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:22.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:13:22.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.171+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2689659370 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4028040 con 0x55d5ca278b40 2024-09-11T22:13:22.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.172+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2689659370 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7ff3d4022ab0 con 0x55d5ca278b40 2024-09-11T22:13:22.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.172+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2689659370 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e0003ed0 con 0x55d5ca278b40 2024-09-11T22:13:22.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.172+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2689659370 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff3d4022d10 con 0x55d5ca278b40 2024-09-11T22:13:22.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.172+0000 7ff3ee4b0740 10 client.27008 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:22.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.172+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2689659370 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d5ca30da60 con 0x55d5ca278b40 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.172+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2689659370 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3d4004040 con 0x55d5ca278b40 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.173+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2689659370 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff3d4034030 con 0x55d5ca278b40 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.173+0000 7ff3ee4b0740 10 client.27008 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.173+0000 7ff3ee4b0740 10 client.27008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.173+0000 7ff3ee4b0740 20 client.27008 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.173+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d5ca30e200 0x55d5ca310620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.173+0000 7ff3ee4b0740 4 client.27008 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.173+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2689659370 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff3e0003ed0 con 0x55d5ca30e200 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.173+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d5ca30e200 0x55d5ca310620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.174+0000 7ff3cd7fa640 10 client.27008 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.174+0000 7ff3e9e73640 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d5ca30e200 0x55d5ca310620 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e928c52342ad64d server_cookie=9aad36b85914a509 in_seq=0 out_seq=0 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.174+0000 7ff3cd7fa640 1 -- 172.21.15.152:0/2689659370 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff3e0003ed0 con 0x55d5ca30e200 2024-09-11T22:13:22.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.174+0000 7ff3cd7fa640 10 client.27008 handle_command_reply: tid=0 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.174+0000 7ff3ee4b0740 1 client.27008 shutdown 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2689659370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 msgr2=0x55d5ca27ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 0x55d5ca27ba90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400a010 tx=0x7ff3d400e580 comp rx=0 tx=0).stop 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2689659370 shutdown_connections 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d5ca30e200 0x55d5ca310620 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d5ca282370 0x55d5ca27bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5ca278b40 0x55d5ca27ba90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3ee4b0740 1 --2- 172.21.15.152:0/2689659370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5ca2775d0 0x55d5ca28a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2689659370 >> 172.21.15.152:0/2689659370 conn(0x55d5ca240310 msgr2=0x55d5ca272310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3cd7fa640 0 client.27008 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2689659370 shutdown_connections 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3ee4b0740 1 -- 172.21.15.152:0/2689659370 wait complete. 2024-09-11T22:13:22.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.176+0000 7ff3ee4b0740 20 client.27008 trim_cache size 0 max 16384 2024-09-11T22:13:22.180 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:13:22.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.177+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/1854451858 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3d00a2dc0 msgr2=0x7ff3d00a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.177+0000 7ff3ec0d7640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3d00a2dc0 0x7ff3d00a5280 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0005c20 tx=0x7ff3e0000bc0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.177+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/1854451858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3e4109120 msgr2=0x7ff3e4077180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.177+0000 7ff3ec0d7640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3e4109120 0x7ff3e4077180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00eb40 tx=0x7ff3dc00c2d0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.178+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/1854451858 shutdown_connections 2024-09-11T22:13:22.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.178+0000 7ff3ec0d7640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3d00a2dc0 0x7ff3d00a5280 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.178+0000 7ff3ec0d7640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3e4109120 0x7ff3e4077180 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.178+0000 7ff3ec0d7640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e41049a0 0x7ff3e4076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.178+0000 7ff3ec0d7640 1 --2- 172.21.15.152:0/1854451858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e4103ff0 0x7ff3e4076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.178+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/1854451858 >> 172.21.15.152:0/1854451858 conn(0x7ff3e40ffab0 msgr2=0x7ff3e4100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:22.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.178+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/1854451858 shutdown_connections 2024-09-11T22:13:22.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:22.178+0000 7ff3ec0d7640 1 -- 172.21.15.152:0/1854451858 wait complete. 2024-09-11T22:13:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.980+0000 7fe7a0a11640 1 -- 172.21.15.152:0/3371636807 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7900319b0 con 0x7fe79c10acb0 2024-09-11T22:13:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.981+0000 7fe7a3c77640 1 -- 172.21.15.152:0/3371636807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c10acb0 msgr2=0x7fe79c113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.981+0000 7fe7a3c77640 1 --2- 172.21.15.152:0/3371636807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c10acb0 0x7fe79c113370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe790009900 tx=0x7fe79002a410 comp rx=0 tx=0).stop 2024-09-11T22:13:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.981+0000 7fe7a3c77640 1 -- 172.21.15.152:0/3371636807 shutdown_connections 2024-09-11T22:13:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.981+0000 7fe7a3c77640 1 --2- 172.21.15.152:0/3371636807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe79c1138b0 0x7fe79c115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.981+0000 7fe7a3c77640 1 --2- 172.21.15.152:0/3371636807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c10acb0 0x7fe79c113370 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.981+0000 7fe7a3c77640 1 --2- 172.21.15.152:0/3371636807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe79c10a300 0x7fe79c10a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.981+0000 7fe7a3c77640 1 -- 172.21.15.152:0/3371636807 >> 172.21.15.152:0/3371636807 conn(0x7fe79c06d210 msgr2=0x7fe79c06d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.981+0000 7fe7a3c77640 1 -- 172.21.15.152:0/3371636807 shutdown_connections 2024-09-11T22:13:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.981+0000 7fe7a3c77640 1 -- 172.21.15.152:0/3371636807 wait complete. 2024-09-11T22:13:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.982+0000 7fe7a3c77640 1 Processor -- start 2024-09-11T22:13:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.982+0000 7fe7a3c77640 1 -- start start 2024-09-11T22:13:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.982+0000 7fe7a3c77640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c10a300 0x7fe79c117840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a3c77640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe79c10acb0 0x7fe79c117d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a3c77640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe79c1138b0 0x7fe79c1182c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a3c77640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c11c940 con 0x7fe79c1138b0 2024-09-11T22:13:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a3c77640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c11c7c0 con 0x7fe79c10a300 2024-09-11T22:13:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a3c77640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c11cac0 con 0x7fe79c10acb0 2024-09-11T22:13:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a1a13640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c10a300 0x7fe79c117840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a1a13640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c10a300 0x7fe79c117840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52920/0 (socket says 172.21.15.152:52920) 2024-09-11T22:13:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a1a13640 1 -- 172.21.15.152:0/1167776334 learned_addr learned my addr 172.21.15.152:0/1167776334 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a1212640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe79c10acb0 0x7fe79c117d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a2214640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe79c1138b0 0x7fe79c1182c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a1a13640 1 -- 172.21.15.152:0/1167776334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe79c10acb0 msgr2=0x7fe79c117d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe79c10acb0 0x7fe79c117d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a1a13640 1 -- 172.21.15.152:0/1167776334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe79c1138b0 msgr2=0x7fe79c1182c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe79c1138b0 0x7fe79c1182c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.983+0000 7fe7a1a13640 1 -- 172.21.15.152:0/1167776334 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c1a2b60 con 0x7fe79c10a300 2024-09-11T22:13:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.984+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c10a300 0x7fe79c117840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe79400a8d0 tx=0x7fe79400ad90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.984+0000 7fe79affd640 1 -- 172.21.15.152:0/1167776334 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940079b0 con 0x7fe79c10a300 2024-09-11T22:13:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.984+0000 7fe79affd640 1 -- 172.21.15.152:0/1167776334 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe794005500 con 0x7fe79c10a300 2024-09-11T22:13:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.984+0000 7fe79affd640 1 -- 172.21.15.152:0/1167776334 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794014410 con 0x7fe79c10a300 2024-09-11T22:13:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.984+0000 7fe7a3c77640 1 -- 172.21.15.152:0/1167776334 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79c1a2e50 con 0x7fe79c10a300 2024-09-11T22:13:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.984+0000 7fe7a3c77640 1 -- 172.21.15.152:0/1167776334 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79c1a3320 con 0x7fe79c10a300 2024-09-11T22:13:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.987+0000 7fe79affd640 1 -- 172.21.15.152:0/1167776334 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe794004ea0 con 0x7fe79c10a300 2024-09-11T22:13:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.988+0000 7fe79affd640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe7840a2e20 0x7fe7840a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.988+0000 7fe79affd640 1 -- 172.21.15.152:0/1167776334 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fe7940cea00 con 0x7fe79c10a300 2024-09-11T22:13:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.989+0000 7fe7a6a0f740 1 Processor -- start 2024-09-11T22:13:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.989+0000 7fe7a6a0f740 1 -- start start 2024-09-11T22:13:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.989+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b6faf0 0x556ae3b6fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.989+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 0x556ae3b7a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.989+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 0x556ae3b7d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.989+0000 7fe7a6a0f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556ae3ad42f0 con 0x556ae3b6faf0 2024-09-11T22:13:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.989+0000 7fe7a6a0f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556ae3a7c270 con 0x556ae3b7acb0 2024-09-11T22:13:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.989+0000 7fe7a6a0f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556ae3ad02b0 con 0x556ae3b70410 2024-09-11T22:13:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.989+0000 7fe7a2214640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 0x556ae3b7d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.989+0000 7fe7a2214640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 0x556ae3b7d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52934/0 (socket says 172.21.15.152:52934) 2024-09-11T22:13:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.989+0000 7fe7a2214640 1 -- 172.21.15.152:0/4249598411 learned_addr learned my addr 172.21.15.152:0/4249598411 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.990+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/4249598411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b6faf0 0x556ae3b6fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.990+0000 7fe7a1212640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe7840a2e20 0x7fe7840a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.990+0000 7fe7a1212640 1 --2- 172.21.15.152:0/4249598411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 0x556ae3b7a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.990+0000 7fe7a2214640 1 -- 172.21.15.152:0/4249598411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 msgr2=0x556ae3b7a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.990+0000 7fe7a2214640 1 --2- 172.21.15.152:0/4249598411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 0x556ae3b7a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.990+0000 7fe7a2214640 1 -- 172.21.15.152:0/4249598411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b6faf0 msgr2=0x556ae3b6fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.990+0000 7fe7a2214640 1 --2- 172.21.15.152:0/4249598411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b6faf0 0x556ae3b6fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.990+0000 7fe7a2214640 1 -- 172.21.15.152:0/4249598411 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae3a7b340 con 0x556ae3b7acb0 2024-09-11T22:13:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.990+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/4249598411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b6faf0 0x556ae3b6fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.990+0000 7fe7a2214640 1 --2- 172.21.15.152:0/4249598411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 0x556ae3b7d0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009ec0 tx=0x7fe78c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=858629283fd9b211 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.990+0000 7fe783fff640 1 -- 172.21.15.152:0/4249598411 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c004d20 con 0x556ae3b7acb0 2024-09-11T22:13:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.991+0000 7fe783fff640 1 -- 172.21.15.152:0/4249598411 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe78c003e50 con 0x556ae3b7acb0 2024-09-11T22:13:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.991+0000 7fe7a1212640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe7840a2e20 0x7fe7840a52e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe790000c00 tx=0x7fe790005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.991+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/4249598411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 msgr2=0x556ae3b7d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.991+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/4249598411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 0x556ae3b7d0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009ec0 tx=0x7fe78c0107a0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.992+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/4249598411 shutdown_connections 2024-09-11T22:13:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.992+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/4249598411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 0x556ae3b7d0a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.992+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/4249598411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 0x556ae3b7a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.992+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/4249598411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b6faf0 0x556ae3b6fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.992+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/4249598411 >> 172.21.15.152:0/4249598411 conn(0x556ae3b6c060 msgr2=0x556ae3b6c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.992+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/4249598411 shutdown_connections 2024-09-11T22:13:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.992+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/4249598411 wait complete. 2024-09-11T22:13:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.993+0000 7fe7a6a0f740 1 -- start start 2024-09-11T22:13:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.993+0000 7fe7a6a0f740 1 Processor -- start 2024-09-11T22:13:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.993+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 0x556ae3b77b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.993+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 0x556ae3b78040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.993+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b7acb0 0x556ae3b78580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.993+0000 7fe7a6a0f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556ae3b7d920 con 0x556ae3b7acb0 2024-09-11T22:13:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.993+0000 7fe7a6a0f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556ae3a5d290 con 0x556ae3b6faf0 2024-09-11T22:13:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.993+0000 7fe7a6a0f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556ae3b7daa0 con 0x556ae3b70410 2024-09-11T22:13:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.994+0000 7fe7a6a0f740 10 client.0 _ll_register_callbacks cb 0x556ae3a8e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.994+0000 7fe7a2214640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b7acb0 0x556ae3b78580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.994+0000 7fe7a2214640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b7acb0 0x556ae3b78580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36060/0 (socket says 172.21.15.152:36060) 2024-09-11T22:13:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.994+0000 7fe7a2214640 1 -- 172.21.15.152:0/2180422353 learned_addr learned my addr 172.21.15.152:0/2180422353 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.994+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 0x556ae3b77b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.994+0000 7fe7a1212640 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 0x556ae3b78040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.995+0000 7fe7a2214640 1 -- 172.21.15.152:0/2180422353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 msgr2=0x556ae3b78040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.995+0000 7fe7a2214640 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 0x556ae3b78040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.995+0000 7fe7a2214640 1 -- 172.21.15.152:0/2180422353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 msgr2=0x556ae3b77b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.995+0000 7fe7a2214640 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 0x556ae3b77b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.995+0000 7fe7a2214640 1 -- 172.21.15.152:0/2180422353 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae37e7210 con 0x556ae3b7acb0 2024-09-11T22:13:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.995+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 0x556ae3b77b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.995+0000 7fe7a2214640 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b7acb0 0x556ae3b78580 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe78c010ca0 tx=0x7fe78c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e620b479c1d215cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.995+0000 7fe7817fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:13:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.996+0000 7fe7817fa640 1 -- 172.21.15.152:0/2180422353 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c009b30 con 0x556ae3b7acb0 2024-09-11T22:13:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.996+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2180422353 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe78c003e50 con 0x556ae3b7acb0 2024-09-11T22:13:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.996+0000 7fe7817fa640 1 -- 172.21.15.152:0/2180422353 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fe78c0056f0 con 0x556ae3b7acb0 2024-09-11T22:13:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.996+0000 7fe7817fa640 1 -- 172.21.15.152:0/2180422353 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe78c0058f0 con 0x556ae3b7acb0 2024-09-11T22:13:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.996+0000 7fe7a6a0f740 10 client.17667 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.996+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2180422353 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ae38b3620 con 0x556ae3b7acb0 2024-09-11T22:13:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.997+0000 7fe7817fa640 1 -- 172.21.15.152:0/2180422353 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe78c003e50 con 0x556ae3b7acb0 2024-09-11T22:13:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.997+0000 7fe7817fa640 1 -- 172.21.15.152:0/2180422353 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe78c011810 con 0x556ae3b7acb0 2024-09-11T22:13:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.997+0000 7fe7a6a0f740 10 client.17667 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.997+0000 7fe7a6a0f740 10 client.17667 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.997+0000 7fe7a6a0f740 20 client.17667 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.997+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556ae3b8afe0 0x556ae3b8d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.997+0000 7fe7a6a0f740 4 client.17667 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.997+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2180422353 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ae3ae1a20 con 0x556ae3b8afe0 2024-09-11T22:13:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.997+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556ae3b8afe0 0x556ae3b8d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.998+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556ae3b8afe0 0x556ae3b8d3f0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f305966b1b9a0758 server_cookie=d2dd92e6563bd2ea in_seq=0 out_seq=0 2024-09-11T22:13:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.998+0000 7fe7817fa640 10 client.17667 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7817fa640 1 -- 172.21.15.152:0/2180422353 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ae3ae1a20 con 0x556ae3b8afe0 2024-09-11T22:13:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7817fa640 10 client.17667 handle_command_reply: tid=0 2024-09-11T22:13:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7a6a0f740 1 client.17667 shutdown 2024-09-11T22:13:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2180422353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b7acb0 msgr2=0x556ae3b78580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b7acb0 0x556ae3b78580 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe78c010ca0 tx=0x7fe78c003ba0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2180422353 shutdown_connections 2024-09-11T22:13:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556ae3b8afe0 0x556ae3b8d3f0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b7acb0 0x556ae3b78580 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 0x556ae3b78040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2180422353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 0x556ae3b77b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2180422353 >> 172.21.15.152:0/2180422353 conn(0x556ae3b6c060 msgr2=0x556ae3b71dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7817fa640 0 client.17667 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2180422353 shutdown_connections 2024-09-11T22:13:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:22.999+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2180422353 wait complete. 2024-09-11T22:13:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.000+0000 7fe7a6a0f740 20 client.17667 trim_cache size 0 max 16384 2024-09-11T22:13:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.023+0000 7fe7a6a0f740 1 Processor -- start 2024-09-11T22:13:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.023+0000 7fe7a6a0f740 1 -- start start 2024-09-11T22:13:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.023+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b6faf0 0x556ae3b72560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.023+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b70410 0x556ae3b783b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.023+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 0x556ae3b92d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1212640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b70410 0x556ae3b783b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1a13640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b6faf0 0x556ae3b72560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1212640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b70410 0x556ae3b783b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36076/0 (socket says 172.21.15.152:36076) 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1a13640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b6faf0 0x556ae3b72560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59374/0 (socket says 172.21.15.152:59374) 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1212640 1 -- 172.21.15.152:0/2632251543 learned_addr learned my addr 172.21.15.152:0/2632251543 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2632251543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1c7790 con 0x556ae3b70410 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2632251543 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1c5060 con 0x556ae3b7acb0 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a2214640 1 --2- 172.21.15.152:0/2632251543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 0x556ae3b92d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2632251543 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c10a6e0 con 0x556ae3b6faf0 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1a13640 1 -- 172.21.15.152:0/2632251543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 msgr2=0x556ae3b92d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/2632251543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 0x556ae3b92d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1a13640 1 -- 172.21.15.152:0/2632251543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b70410 msgr2=0x556ae3b783b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/2632251543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b70410 0x556ae3b783b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1a13640 1 -- 172.21.15.152:0/2632251543 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae3b6f920 con 0x556ae3b6faf0 2024-09-11T22:13:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/2632251543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b6faf0 0x556ae3b72560 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe7940cc0f0 tx=0x7fe794004940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1472542aea1eac0e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.024+0000 7fe7a1212640 1 --2- 172.21.15.152:0/2632251543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b70410 0x556ae3b783b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.025+0000 7fe7837fe640 1 -- 172.21.15.152:0/2632251543 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940991c0 con 0x556ae3b6faf0 2024-09-11T22:13:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.025+0000 7fe7837fe640 1 -- 172.21.15.152:0/2632251543 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe794007d50 con 0x556ae3b6faf0 2024-09-11T22:13:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.025+0000 7fe7837fe640 1 -- 172.21.15.152:0/2632251543 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79409a570 con 0x556ae3b6faf0 2024-09-11T22:13:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.026+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2632251543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b6faf0 msgr2=0x556ae3b72560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.026+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2632251543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b6faf0 0x556ae3b72560 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe7940cc0f0 tx=0x7fe794004940 comp rx=0 tx=0).stop 2024-09-11T22:13:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.026+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2632251543 shutdown_connections 2024-09-11T22:13:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.026+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2632251543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b7acb0 0x556ae3b92d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.026+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2632251543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b70410 0x556ae3b783b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.026+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2632251543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b6faf0 0x556ae3b72560 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.026+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2632251543 >> 172.21.15.152:0/2632251543 conn(0x556ae3b6c060 msgr2=0x556ae3b6c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.026+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2632251543 shutdown_connections 2024-09-11T22:13:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.026+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2632251543 wait complete. 2024-09-11T22:13:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.027+0000 7fe7a6a0f740 1 -- start start 2024-09-11T22:13:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.027+0000 7fe7a6a0f740 1 Processor -- start 2024-09-11T22:13:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.028+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 0x556ae3b75480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.028+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 0x556ae3b82d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.028+0000 7fe7a6a0f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b7acb0 0x556ae3b832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.028+0000 7fe7a6a0f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1aa480 con 0x556ae3b7acb0 2024-09-11T22:13:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.028+0000 7fe7a6a0f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1c4990 con 0x556ae3b6faf0 2024-09-11T22:13:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.028+0000 7fe7a6a0f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1aab30 con 0x556ae3b70410 2024-09-11T22:13:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.028+0000 7fe7a1a13640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 0x556ae3b75480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.028+0000 7fe7a6a0f740 10 client.0 _ll_register_callbacks cb 0x7fe794097160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.028+0000 7fe7a1a13640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 0x556ae3b75480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:52962/0 (socket says 172.21.15.152:52962) 2024-09-11T22:13:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.028+0000 7fe7a1a13640 1 -- 172.21.15.152:0/2104689446 learned_addr learned my addr 172.21.15.152:0/2104689446 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.029+0000 7fe7a1a13640 1 -- 172.21.15.152:0/2104689446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 msgr2=0x556ae3b82d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:13:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.029+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/2104689446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 0x556ae3b82d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.029+0000 7fe7a1a13640 1 -- 172.21.15.152:0/2104689446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b7acb0 msgr2=0x556ae3b832c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.029+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/2104689446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b7acb0 0x556ae3b832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.029+0000 7fe7a1a13640 1 -- 172.21.15.152:0/2104689446 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae3b6be90 con 0x556ae3b6faf0 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.029+0000 7fe7a1a13640 1 --2- 172.21.15.152:0/2104689446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 0x556ae3b75480 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe7940a3600 tx=0x7fe794007bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=442ff1573e5c94b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.029+0000 7fe7817fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.029+0000 7fe7817fa640 1 -- 172.21.15.152:0/2104689446 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79407e060 con 0x556ae3b6faf0 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.029+0000 7fe7817fa640 1 -- 172.21.15.152:0/2104689446 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fe79409a310 con 0x556ae3b6faf0 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.029+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2104689446 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe794007d50 con 0x556ae3b6faf0 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.030+0000 7fe7817fa640 1 -- 172.21.15.152:0/2104689446 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe794099280 con 0x556ae3b6faf0 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.030+0000 7fe7a6a0f740 10 client.27026 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.030+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2104689446 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ae3bf4cd0 con 0x556ae3b6faf0 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.030+0000 7fe7817fa640 1 -- 172.21.15.152:0/2104689446 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe794084140 con 0x556ae3b6faf0 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.030+0000 7fe7817fa640 1 -- 172.21.15.152:0/2104689446 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe794079ce0 con 0x556ae3b6faf0 2024-09-11T22:13:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.030+0000 7fe7a6a0f740 10 client.27026 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.030+0000 7fe7a6a0f740 10 client.27026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.030+0000 7fe7a6a0f740 20 client.27026 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.030+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2104689446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556ae3bf50f0 0x556ae3bf74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.030+0000 7fe7a6a0f740 4 client.27026 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:13:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.030+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2104689446 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fe794007d50 con 0x556ae3bf50f0 2024-09-11T22:13:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.031+0000 7fe7a1212640 1 --2- 172.21.15.152:0/2104689446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556ae3bf50f0 0x556ae3bf74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.032+0000 7fe7a1212640 1 --2- 172.21.15.152:0/2104689446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556ae3bf50f0 0x556ae3bf74e0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=389ab6df884df877 server_cookie=92350753e6167bcc in_seq=0 out_seq=0 2024-09-11T22:13:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.032+0000 7fe7817fa640 10 client.27026 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.039+0000 7fe7817fa640 1 -- 172.21.15.152:0/2104689446 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fe794007d50 con 0x556ae3bf50f0 2024-09-11T22:13:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.039+0000 7fe7817fa640 10 client.27026 handle_command_reply: tid=0 2024-09-11T22:13:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.039+0000 7fe7a6a0f740 1 client.27026 shutdown 2024-09-11T22:13:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.039+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2104689446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 msgr2=0x556ae3b75480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.039+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2104689446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 0x556ae3b75480 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe7940a3600 tx=0x7fe794007bd0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.040+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2104689446 shutdown_connections 2024-09-11T22:13:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.040+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2104689446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556ae3bf50f0 0x556ae3bf74e0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.040+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2104689446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ae3b7acb0 0x556ae3b832c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.040+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2104689446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556ae3b70410 0x556ae3b82d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.040+0000 7fe7817fa640 0 client.27026 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.040+0000 7fe7a6a0f740 1 --2- 172.21.15.152:0/2104689446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556ae3b6faf0 0x556ae3b75480 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.040+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2104689446 >> 172.21.15.152:0/2104689446 conn(0x556ae3b6c060 msgr2=0x556ae3b79360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.040+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2104689446 shutdown_connections 2024-09-11T22:13:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.040+0000 7fe7a6a0f740 1 -- 172.21.15.152:0/2104689446 wait complete. 2024-09-11T22:13:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.040+0000 7fe7a6a0f740 20 client.27026 trim_cache size 0 max 16384 2024-09-11T22:13:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:13:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:13:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:13:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:13:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 -- 172.21.15.152:0/1167776334 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe7840a2e20 msgr2=0x7fe7840a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe7840a2e20 0x7fe7840a52e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe790000c00 tx=0x7fe790005a20 comp rx=0 tx=0).stop 2024-09-11T22:13:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 -- 172.21.15.152:0/1167776334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c10a300 msgr2=0x7fe79c117840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c10a300 0x7fe79c117840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe79400a8d0 tx=0x7fe79400ad90 comp rx=0 tx=0).stop 2024-09-11T22:13:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 -- 172.21.15.152:0/1167776334 shutdown_connections 2024-09-11T22:13:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe7840a2e20 0x7fe7840a52e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe79c1138b0 0x7fe79c1182c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe79c10acb0 0x7fe79c117d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 --2- 172.21.15.152:0/1167776334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c10a300 0x7fe79c117840 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 -- 172.21.15.152:0/1167776334 >> 172.21.15.152:0/1167776334 conn(0x7fe79c06d210 msgr2=0x7fe79c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 -- 172.21.15.152:0/1167776334 shutdown_connections 2024-09-11T22:13:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:23.042+0000 7fe7a3c77640 1 -- 172.21.15.152:0/1167776334 wait complete. 2024-09-11T22:13:23.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:23 smithi152 ceph-mon[31188]: pgmap v281: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 760 op/s 2024-09-11T22:13:23.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:23 smithi179 ceph-mon[35603]: pgmap v281: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 760 op/s 2024-09-11T22:13:23.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:23 smithi193 ceph-mon[35545]: pgmap v281: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 760 op/s 2024-09-11T22:13:23.949 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:13:23.950 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:13:24.343 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:13:24.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 470.0 s, 3999.8 tps, lat 24.803 ms stddev 28.993 2024-09-11T22:13:24.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.952+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2934546824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d4410e230 msgr2=0x7f7d4410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:24.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.952+0000 7f7d4b0d6640 1 --2- 172.21.15.152:0/2934546824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d4410e230 0x7f7d4410e610 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009cd0 tx=0x7f7d3402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.952+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2934546824 shutdown_connections 2024-09-11T22:13:24.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.952+0000 7f7d4b0d6640 1 --2- 172.21.15.152:0/2934546824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d44108b50 0x7f7d44115070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.952+0000 7f7d4b0d6640 1 --2- 172.21.15.152:0/2934546824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d441081f0 0x7f7d44108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.952+0000 7f7d4b0d6640 1 --2- 172.21.15.152:0/2934546824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d4410e230 0x7f7d4410e610 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.952+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2934546824 >> 172.21.15.152:0/2934546824 conn(0x7f7d44077bb0 msgr2=0x7f7d44079fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:24.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.952+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2934546824 shutdown_connections 2024-09-11T22:13:24.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.952+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2934546824 wait complete. 2024-09-11T22:13:24.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.952+0000 7f7d4b0d6640 1 Processor -- start 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.952+0000 7f7d4b0d6640 1 -- start start 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d4b0d6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d441081f0 0x7f7d441a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d4b0d6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d44108b50 0x7f7d441a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d4b0d6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4410e230 0x7f7d4419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d4b0d6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7d44118530 con 0x7f7d4410e230 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d4b0d6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d441183b0 con 0x7f7d44108b50 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d4b0d6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7d441186b0 con 0x7f7d441081f0 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d43fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d44108b50 0x7f7d441a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d48e72640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d441081f0 0x7f7d441a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d43fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d44108b50 0x7f7d441a4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37568/0 (socket says 172.21.15.152:37568) 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d43fff640 1 -- 172.21.15.152:0/2529983771 learned_addr learned my addr 172.21.15.152:0/2529983771 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:24.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d49673640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4410e230 0x7f7d4419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:24.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d49673640 1 -- 172.21.15.152:0/2529983771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d441081f0 msgr2=0x7f7d441a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:24.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d49673640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d441081f0 0x7f7d441a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d49673640 1 -- 172.21.15.152:0/2529983771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d44108b50 msgr2=0x7f7d441a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:24.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d49673640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d44108b50 0x7f7d441a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.953+0000 7f7d49673640 1 -- 172.21.15.152:0/2529983771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4419efb0 con 0x7f7d4410e230 2024-09-11T22:13:24.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.954+0000 7f7d49673640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4410e230 0x7f7d4419e880 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00d600 tx=0x7f7d3c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:24.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.955+0000 7f7d41ffb640 1 -- 172.21.15.152:0/2529983771 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c017070 con 0x7f7d4410e230 2024-09-11T22:13:24.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.955+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2529983771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4419f2a0 con 0x7f7d4410e230 2024-09-11T22:13:24.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.955+0000 7f7d41ffb640 1 -- 172.21.15.152:0/2529983771 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d3c009c60 con 0x7f7d4410e230 2024-09-11T22:13:24.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.955+0000 7f7d41ffb640 1 -- 172.21.15.152:0/2529983771 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c003cc0 con 0x7f7d4410e230 2024-09-11T22:13:24.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.955+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2529983771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d441ab590 con 0x7f7d4410e230 2024-09-11T22:13:24.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.958+0000 7f7d41ffb640 1 -- 172.21.15.152:0/2529983771 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f7d3c009780 con 0x7f7d4410e230 2024-09-11T22:13:24.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.959+0000 7f7d4d4af740 1 Processor -- start 2024-09-11T22:13:24.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.959+0000 7f7d4d4af740 1 -- start start 2024-09-11T22:13:24.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.959+0000 7f7d41ffb640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7d2c0a2cf0 0x7f7d2c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:24.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.959+0000 7f7d4d4af740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 0x563634ba8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:24.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d4d4af740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 0x563634bb3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:24.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d41ffb640 1 -- 172.21.15.152:0/2529983771 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7f7d3c0cec10 con 0x7f7d4410e230 2024-09-11T22:13:24.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d43fff640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7d2c0a2cf0 0x7f7d2c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:24.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d48e72640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 0x563634ba8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:24.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d43fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 0x563634bb3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:24.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d48e72640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 0x563634ba8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:40684/0 (socket says 172.21.15.152:40684) 2024-09-11T22:13:24.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d48e72640 1 -- 172.21.15.152:0/2355395061 learned_addr learned my addr 172.21.15.152:0/2355395061 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:24.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/2355395061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d4d4af740 1 -- 172.21.15.152:0/2355395061 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563634b0e280 con 0x563634ba9480 2024-09-11T22:13:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d4d4af740 1 -- 172.21.15.152:0/2355395061 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563634ab5b10 con 0x563634bb3d40 2024-09-11T22:13:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d4d4af740 1 -- 172.21.15.152:0/2355395061 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563634b0a240 con 0x563634ba8b60 2024-09-11T22:13:24.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d49673640 1 --2- 172.21.15.152:0/2355395061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d43fff640 1 -- 172.21.15.152:0/2355395061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 msgr2=0x563634ba8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d43fff640 1 --2- 172.21.15.152:0/2355395061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 0x563634ba8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d43fff640 1 -- 172.21.15.152:0/2355395061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 msgr2=0x563634bb6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d43fff640 1 --2- 172.21.15.152:0/2355395061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d43fff640 1 -- 172.21.15.152:0/2355395061 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563634ac21f0 con 0x563634ba9480 2024-09-11T22:13:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d43fff640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7d2c0a2cf0 0x7f7d2c0a51b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7d380097f0 tx=0x7f7d38009c40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.960+0000 7f7d43fff640 1 --2- 172.21.15.152:0/2355395061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 0x563634bb3800 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f7d4410d940 tx=0x7f7d3801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f96fa3363af1ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.961+0000 7f7d2affd640 1 -- 172.21.15.152:0/2355395061 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38024030 con 0x563634ba9480 2024-09-11T22:13:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.961+0000 7f7d2affd640 1 -- 172.21.15.152:0/2355395061 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d38005500 con 0x563634ba9480 2024-09-11T22:13:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.961+0000 7f7d2affd640 1 -- 172.21.15.152:0/2355395061 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380209c0 con 0x563634ba9480 2024-09-11T22:13:24.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.961+0000 7f7d4d4af740 1 -- 172.21.15.152:0/2355395061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 msgr2=0x563634bb3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.962+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/2355395061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 0x563634bb3800 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f7d4410d940 tx=0x7f7d3801d000 comp rx=0 tx=0).stop 2024-09-11T22:13:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.962+0000 7f7d4d4af740 1 -- 172.21.15.152:0/2355395061 shutdown_connections 2024-09-11T22:13:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.962+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/2355395061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.962+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/2355395061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 0x563634bb3800 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.962+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/2355395061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 0x563634ba8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.962+0000 7f7d4d4af740 1 -- 172.21.15.152:0/2355395061 >> 172.21.15.152:0/2355395061 conn(0x563634ba50f0 msgr2=0x563634ba54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.962+0000 7f7d4d4af740 1 -- 172.21.15.152:0/2355395061 shutdown_connections 2024-09-11T22:13:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.962+0000 7f7d4d4af740 1 -- 172.21.15.152:0/2355395061 wait complete. 2024-09-11T22:13:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.963+0000 7f7d4d4af740 1 -- start start 2024-09-11T22:13:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.963+0000 7f7d4d4af740 1 Processor -- start 2024-09-11T22:13:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.964+0000 7f7d4d4af740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba8b60 0x563634bb0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.964+0000 7f7d4d4af740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634ba9480 0x563634bb1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.964+0000 7f7d4d4af740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634bb3d40 0x563634bb16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.964+0000 7f7d4d4af740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563634bb6910 con 0x563634ba8b60 2024-09-11T22:13:24.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.964+0000 7f7d4d4af740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563634ac8f10 con 0x563634ba9480 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.964+0000 7f7d4d4af740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563634bb6a90 con 0x563634bb3d40 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.964+0000 7f7d49673640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634bb3d40 0x563634bb16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.964+0000 7f7d4d4af740 10 client.0 _ll_register_callbacks cb 0x563634a91a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.964+0000 7f7d49673640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634bb3d40 0x563634bb16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:40688/0 (socket says 172.21.15.152:40688) 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.964+0000 7f7d49673640 1 -- 172.21.15.152:0/826825093 learned_addr learned my addr 172.21.15.152:0/826825093 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.964+0000 7f7d48e72640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba8b60 0x563634bb0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.965+0000 7f7d43fff640 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634ba9480 0x563634bb1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.965+0000 7f7d49673640 1 -- 172.21.15.152:0/826825093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634ba9480 msgr2=0x563634bb1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.965+0000 7f7d49673640 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634ba9480 0x563634bb1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.965+0000 7f7d49673640 1 -- 172.21.15.152:0/826825093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba8b60 msgr2=0x563634bb0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.965+0000 7f7d49673640 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba8b60 0x563634bb0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.965+0000 7f7d49673640 1 -- 172.21.15.152:0/826825093 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363487f6a0 con 0x563634bb3d40 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.965+0000 7f7d49673640 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634bb3d40 0x563634bb16c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c097af0 tx=0x7f7d3c00d580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c243ab76c85a088 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.965+0000 7f7d23fff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.965+0000 7f7d23fff640 1 -- 172.21.15.152:0/826825093 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c020070 con 0x563634bb3d40 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.966+0000 7f7d23fff640 1 -- 172.21.15.152:0/826825093 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7f7d3c09f0c0 con 0x563634bb3d40 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.966+0000 7f7d4d4af740 1 -- 172.21.15.152:0/826825093 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d38005500 con 0x563634bb3d40 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.966+0000 7f7d23fff640 1 -- 172.21.15.152:0/826825093 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7d3c09f420 con 0x563634bb3d40 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.966+0000 7f7d4d4af740 10 client.27208 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.966+0000 7f7d4d4af740 1 -- 172.21.15.152:0/826825093 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563634bc25e0 con 0x563634bb3d40 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.966+0000 7f7d23fff640 1 -- 172.21.15.152:0/826825093 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d3c0a3ce0 con 0x563634bb3d40 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.967+0000 7f7d23fff640 1 -- 172.21.15.152:0/826825093 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7d3c097790 con 0x563634bb3d40 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.967+0000 7f7d4d4af740 10 client.27208 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.967+0000 7f7d4d4af740 10 client.27208 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:24.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.967+0000 7f7d4d4af740 20 client.27208 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.967+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563634bc3aa0 0x563634bc5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.967+0000 7f7d4d4af740 4 client.27208 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.967+0000 7f7d4d4af740 1 -- 172.21.15.152:0/826825093 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7d38005500 con 0x563634bc3aa0 2024-09-11T22:13:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.967+0000 7f7d48e72640 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563634bc3aa0 0x563634bc5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.967+0000 7f7d23fff640 10 client.27208 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:24.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.967+0000 7f7d48e72640 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563634bc3aa0 0x563634bc5e90 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a020f9a129483cfb server_cookie=4de815eb484eed70 in_seq=0 out_seq=0 2024-09-11T22:13:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.968+0000 7f7d23fff640 1 -- 172.21.15.152:0/826825093 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7d38005500 con 0x563634bc3aa0 2024-09-11T22:13:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.968+0000 7f7d23fff640 10 client.27208 handle_command_reply: tid=0 2024-09-11T22:13:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.968+0000 7f7d4d4af740 1 client.27208 shutdown 2024-09-11T22:13:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.968+0000 7f7d4d4af740 1 -- 172.21.15.152:0/826825093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634bb3d40 msgr2=0x563634bb16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.968+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634bb3d40 0x563634bb16c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c097af0 tx=0x7f7d3c00d580 comp rx=0 tx=0).stop 2024-09-11T22:13:24.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.968+0000 7f7d4d4af740 1 -- 172.21.15.152:0/826825093 shutdown_connections 2024-09-11T22:13:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.968+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563634bc3aa0 0x563634bc5e90 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.968+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634bb3d40 0x563634bb16c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.968+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634ba9480 0x563634bb1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.968+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/826825093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba8b60 0x563634bb0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.968+0000 7f7d4d4af740 1 -- 172.21.15.152:0/826825093 >> 172.21.15.152:0/826825093 conn(0x563634ba50f0 msgr2=0x563634baae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.970+0000 7f7d23fff640 0 client.27208 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.971+0000 7f7d4d4af740 1 -- 172.21.15.152:0/826825093 shutdown_connections 2024-09-11T22:13:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.971+0000 7f7d4d4af740 1 -- 172.21.15.152:0/826825093 wait complete. 2024-09-11T22:13:24.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.971+0000 7f7d4d4af740 20 client.27208 trim_cache size 0 max 16384 2024-09-11T22:13:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.998+0000 7f7d4d4af740 1 Processor -- start 2024-09-11T22:13:24.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.998+0000 7f7d4d4af740 1 -- start start 2024-09-11T22:13:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.998+0000 7f7d4d4af740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba8b60 0x563634ba40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:25.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.998+0000 7f7d4d4af740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba9480 0x563634bab610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.998+0000 7f7d4d4af740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.998+0000 7f7d4d4af740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7d441b68a0 con 0x563634ba8b60 2024-09-11T22:13:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.998+0000 7f7d4d4af740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d441b4170 con 0x563634bb3d40 2024-09-11T22:13:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.998+0000 7f7d4d4af740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7d441b1fe0 con 0x563634ba9480 2024-09-11T22:13:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d49673640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d43fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba9480 0x563634bab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d49673640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37612/0 (socket says 172.21.15.152:37612) 2024-09-11T22:13:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d49673640 1 -- 172.21.15.152:0/4235555288 learned_addr learned my addr 172.21.15.152:0/4235555288 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d48e72640 1 --2- 172.21.15.152:0/4235555288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba8b60 0x563634ba40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d43fff640 1 -- 172.21.15.152:0/4235555288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 msgr2=0x563634bb2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:25.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d43fff640 1 --2- 172.21.15.152:0/4235555288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d43fff640 1 -- 172.21.15.152:0/4235555288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba8b60 msgr2=0x563634ba40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d43fff640 1 --2- 172.21.15.152:0/4235555288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba8b60 0x563634ba40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d43fff640 1 -- 172.21.15.152:0/4235555288 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563634ba0830 con 0x563634ba9480 2024-09-11T22:13:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d43fff640 1 --2- 172.21.15.152:0/4235555288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba9480 0x563634bab610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d38006010 tx=0x7f7d38005d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5113909872d0fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d2a7fc640 1 -- 172.21.15.152:0/4235555288 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3802d020 con 0x563634ba9480 2024-09-11T22:13:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d2a7fc640 1 -- 172.21.15.152:0/4235555288 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d380055f0 con 0x563634ba9480 2024-09-11T22:13:25.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:24.999+0000 7f7d2a7fc640 1 -- 172.21.15.152:0/4235555288 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380035f0 con 0x563634ba9480 2024-09-11T22:13:25.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.000+0000 7f7d4d4af740 1 -- 172.21.15.152:0/4235555288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba9480 msgr2=0x563634bab610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:25.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.000+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/4235555288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba9480 0x563634bab610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d38006010 tx=0x7f7d38005d30 comp rx=0 tx=0).stop 2024-09-11T22:13:25.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.001+0000 7f7d4d4af740 1 -- 172.21.15.152:0/4235555288 shutdown_connections 2024-09-11T22:13:25.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.001+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/4235555288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.001+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/4235555288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba9480 0x563634bab610 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.001+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/4235555288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba8b60 0x563634ba40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.001+0000 7f7d4d4af740 1 -- 172.21.15.152:0/4235555288 >> 172.21.15.152:0/4235555288 conn(0x563634ba50f0 msgr2=0x563634bb2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:25.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.001+0000 7f7d4d4af740 1 -- 172.21.15.152:0/4235555288 shutdown_connections 2024-09-11T22:13:25.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.001+0000 7f7d4d4af740 1 -- 172.21.15.152:0/4235555288 wait complete. 2024-09-11T22:13:25.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.001+0000 7f7d4d4af740 1 -- start start 2024-09-11T22:13:25.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.001+0000 7f7d4d4af740 1 Processor -- start 2024-09-11T22:13:25.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d4d4af740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 0x563634bbc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:25.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d4d4af740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 0x563634bb8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d4d4af740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d4d4af740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7d441b2630 con 0x563634ba9480 2024-09-11T22:13:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d4d4af740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d441b3aa0 con 0x563634bb3d40 2024-09-11T22:13:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d4d4af740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7d441b2d00 con 0x563634ba8b60 2024-09-11T22:13:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d4d4af740 10 client.0 _ll_register_callbacks cb 0x7f7d3c09aef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d43fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 0x563634bb8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d49673640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d43fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 0x563634bb8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38954/0 (socket says 172.21.15.152:38954) 2024-09-11T22:13:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d43fff640 1 -- 172.21.15.152:0/1615891708 learned_addr learned my addr 172.21.15.152:0/1615891708 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d48e72640 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 0x563634bbc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d48e72640 1 -- 172.21.15.152:0/1615891708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 msgr2=0x563634bb8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d48e72640 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d48e72640 1 -- 172.21.15.152:0/1615891708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 msgr2=0x563634bb8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.002+0000 7f7d48e72640 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 0x563634bb8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.003+0000 7f7d48e72640 1 -- 172.21.15.152:0/1615891708 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563634bb91d0 con 0x563634ba8b60 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.003+0000 7f7d48e72640 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 0x563634bbc2e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7d34005e30 tx=0x7f7d34031a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae651614a3879f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.003+0000 7f7d23fff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.003+0000 7f7d23fff640 1 -- 172.21.15.152:0/1615891708 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d34003b70 con 0x563634ba8b60 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.003+0000 7f7d23fff640 1 -- 172.21.15.152:0/1615891708 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7f7d34003d10 con 0x563634ba8b60 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.003+0000 7f7d4d4af740 1 -- 172.21.15.152:0/1615891708 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d380055f0 con 0x563634ba8b60 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.003+0000 7f7d23fff640 1 -- 172.21.15.152:0/1615891708 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7d34004030 con 0x563634ba8b60 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.003+0000 7f7d4d4af740 10 client.27214 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:25.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.003+0000 7f7d4d4af740 1 -- 172.21.15.152:0/1615891708 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563634c40660 con 0x563634ba8b60 2024-09-11T22:13:25.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.005+0000 7f7d23fff640 1 -- 172.21.15.152:0/1615891708 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d380055f0 con 0x563634ba8b60 2024-09-11T22:13:25.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.005+0000 7f7d23fff640 1 -- 172.21.15.152:0/1615891708 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7d34050070 con 0x563634ba8b60 2024-09-11T22:13:25.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.005+0000 7f7d4d4af740 10 client.27214 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:25.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.005+0000 7f7d4d4af740 10 client.27214 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:25.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.005+0000 7f7d4d4af740 20 client.27214 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:25.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.005+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563634c40eb0 0x563634c432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:25.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.005+0000 7f7d4d4af740 4 client.27214 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:13:25.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.005+0000 7f7d4d4af740 1 -- 172.21.15.152:0/1615891708 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563634b1b7f0 con 0x563634c40eb0 2024-09-11T22:13:25.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.005+0000 7f7d43fff640 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563634c40eb0 0x563634c432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:25.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.007+0000 7f7d43fff640 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563634c40eb0 0x563634c432d0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=243a84eceaf01a52 server_cookie=bfbead54ffd36b71 in_seq=0 out_seq=0 2024-09-11T22:13:25.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.009+0000 7f7d23fff640 10 client.27214 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:25.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.010+0000 7f7d23fff640 1 -- 172.21.15.152:0/1615891708 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563634b1b7f0 con 0x563634c40eb0 2024-09-11T22:13:25.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.010+0000 7f7d23fff640 10 client.27214 handle_command_reply: tid=0 2024-09-11T22:13:25.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.012+0000 7f7d4d4af740 1 client.27214 shutdown 2024-09-11T22:13:25.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.016+0000 7f7d4d4af740 1 -- 172.21.15.152:0/1615891708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 msgr2=0x563634bbc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:25.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.016+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 0x563634bbc2e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7d34005e30 tx=0x7f7d34031a60 comp rx=0 tx=0).stop 2024-09-11T22:13:25.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.017+0000 7f7d4d4af740 1 -- 172.21.15.152:0/1615891708 shutdown_connections 2024-09-11T22:13:25.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.017+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563634c40eb0 0x563634c432d0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.017+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563634bb3d40 0x563634bb8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.017+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563634ba9480 0x563634bb8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.017+0000 7f7d23fff640 0 client.27214 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:25.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.017+0000 7f7d4d4af740 1 --2- 172.21.15.152:0/1615891708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563634ba8b60 0x563634bbc2e0 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7d34005e30 tx=0x7f7d34031a60 comp rx=0 tx=0).stop 2024-09-11T22:13:25.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.017+0000 7f7d4d4af740 1 -- 172.21.15.152:0/1615891708 >> 172.21.15.152:0/1615891708 conn(0x563634ba50f0 msgr2=0x563634bb1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:25.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.020+0000 7f7d4d4af740 1 -- 172.21.15.152:0/1615891708 shutdown_connections 2024-09-11T22:13:25.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.023+0000 7f7d4d4af740 1 -- 172.21.15.152:0/1615891708 wait complete. 2024-09-11T22:13:25.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.023+0000 7f7d4d4af740 20 client.27214 trim_cache size 0 max 16384 2024-09-11T22:13:25.025 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:13:25.025 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:13:25.025 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "cf6f8182-fefd-43c1-9430-db2c6a096abb", 2024-09-11T22:13:25.026 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:13:25.026 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:13:25.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.025+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2529983771 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7d2c0a2cf0 msgr2=0x7f7d2c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:25.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.025+0000 7f7d4b0d6640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7d2c0a2cf0 0x7f7d2c0a51b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7d380097f0 tx=0x7f7d38009c40 comp rx=0 tx=0).stop 2024-09-11T22:13:25.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.025+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2529983771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4410e230 msgr2=0x7f7d4419e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:25.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.025+0000 7f7d4b0d6640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4410e230 0x7f7d4419e880 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00d600 tx=0x7f7d3c00dac0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.025+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2529983771 shutdown_connections 2024-09-11T22:13:25.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.025+0000 7f7d4b0d6640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7d2c0a2cf0 0x7f7d2c0a51b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.025+0000 7f7d4b0d6640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4410e230 0x7f7d4419e880 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.025+0000 7f7d4b0d6640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d44108b50 0x7f7d441a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.025+0000 7f7d4b0d6640 1 --2- 172.21.15.152:0/2529983771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d441081f0 0x7f7d441a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.025+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2529983771 >> 172.21.15.152:0/2529983771 conn(0x7f7d44077bb0 msgr2=0x7f7d44079480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:25.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.026+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2529983771 shutdown_connections 2024-09-11T22:13:25.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:25.027+0000 7f7d4b0d6640 1 -- 172.21.15.152:0/2529983771 wait complete. 2024-09-11T22:13:25.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:25 smithi152 ceph-mon[31188]: pgmap v282: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 860 op/s 2024-09-11T22:13:25.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:25 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:13:25.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:25 smithi179 ceph-mon[35603]: pgmap v282: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 860 op/s 2024-09-11T22:13:25.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:25 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:13:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:25 smithi193 ceph-mon[35545]: pgmap v282: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 860 op/s 2024-09-11T22:13:25.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:25 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:13:25.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:13:26.264 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:13:26.421 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:26 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:13:26.421 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:26 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:13:26.421 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:26 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:13:26.421 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:26 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:13:26.421 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:26 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:13:26.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:26 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:13:26.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:26 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:13:26.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:26 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:13:26.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:26 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:13:26.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:26 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:13:26.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:26 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:13:26.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:26 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:13:26.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:26 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:13:26.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:26 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:13:26.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:26 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:13:26.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.870+0000 7fd154118640 1 -- 172.21.15.152:0/2782498928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14c100e20 msgr2=0x7fd14c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.870+0000 7fd154118640 1 --2- 172.21.15.152:0/2782498928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14c100e20 0x7fd14c101200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd148009cd0 tx=0x7fd14802a980 comp rx=0 tx=0).stop 2024-09-11T22:13:26.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.870+0000 7fd154118640 1 -- 172.21.15.152:0/2782498928 shutdown_connections 2024-09-11T22:13:26.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.870+0000 7fd154118640 1 --2- 172.21.15.152:0/2782498928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14c102ef0 0x7fd14c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.870+0000 7fd154118640 1 --2- 172.21.15.152:0/2782498928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd14c102570 0x7fd14c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.870+0000 7fd154118640 1 --2- 172.21.15.152:0/2782498928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14c100e20 0x7fd14c101200 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.870+0000 7fd154118640 1 -- 172.21.15.152:0/2782498928 >> 172.21.15.152:0/2782498928 conn(0x7fd14c0fc7d0 msgr2=0x7fd14c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.871+0000 7fd154118640 1 -- 172.21.15.152:0/2782498928 shutdown_connections 2024-09-11T22:13:26.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.871+0000 7fd154118640 1 -- 172.21.15.152:0/2782498928 wait complete. 2024-09-11T22:13:26.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.871+0000 7fd154118640 1 Processor -- start 2024-09-11T22:13:26.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.872+0000 7fd154118640 1 -- start start 2024-09-11T22:13:26.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.872+0000 7fd154118640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14c100e20 0x7fd14c1a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.872+0000 7fd154118640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd14c102570 0x7fd14c1a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.872+0000 7fd154118640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14c102ef0 0x7fd14c10cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.872+0000 7fd151eb4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14c100e20 0x7fd14c1a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.872+0000 7fd1516b3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd14c102570 0x7fd14c1a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.872+0000 7fd1516b3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd14c102570 0x7fd14c1a3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:40722/0 (socket says 172.21.15.152:40722) 2024-09-11T22:13:26.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.872+0000 7fd151eb4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14c100e20 0x7fd14c1a37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38970/0 (socket says 172.21.15.152:38970) 2024-09-11T22:13:26.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.872+0000 7fd1516b3640 1 -- 172.21.15.152:0/3671203413 learned_addr learned my addr 172.21.15.152:0/3671203413 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:26.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.872+0000 7fd154118640 1 -- 172.21.15.152:0/3671203413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1120a0 con 0x7fd14c100e20 2024-09-11T22:13:26.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.873+0000 7fd154118640 1 -- 172.21.15.152:0/3671203413 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c111f20 con 0x7fd14c102ef0 2024-09-11T22:13:26.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.873+0000 7fd154118640 1 -- 172.21.15.152:0/3671203413 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c112220 con 0x7fd14c102570 2024-09-11T22:13:26.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.873+0000 7fd1526b5640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14c102ef0 0x7fd14c10cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.873+0000 7fd1526b5640 1 -- 172.21.15.152:0/3671203413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd14c102570 msgr2=0x7fd14c1a3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.873+0000 7fd1526b5640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd14c102570 0x7fd14c1a3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.873+0000 7fd1526b5640 1 -- 172.21.15.152:0/3671203413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14c100e20 msgr2=0x7fd14c1a37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.873+0000 7fd1526b5640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14c100e20 0x7fd14c1a37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.873+0000 7fd1526b5640 1 -- 172.21.15.152:0/3671203413 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14c10d340 con 0x7fd14c102ef0 2024-09-11T22:13:26.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.873+0000 7fd1526b5640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14c102ef0 0x7fd14c10cbf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd14400b410 tx=0x7fd14400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.874+0000 7fd142ffd640 1 -- 172.21.15.152:0/3671203413 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144015020 con 0x7fd14c102ef0 2024-09-11T22:13:26.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.874+0000 7fd142ffd640 1 -- 172.21.15.152:0/3671203413 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd144011d10 con 0x7fd14c102ef0 2024-09-11T22:13:26.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.874+0000 7fd154118640 1 -- 172.21.15.152:0/3671203413 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd14c10d630 con 0x7fd14c102ef0 2024-09-11T22:13:26.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.874+0000 7fd142ffd640 1 -- 172.21.15.152:0/3671203413 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14400f2e0 con 0x7fd14c102ef0 2024-09-11T22:13:26.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.874+0000 7fd154118640 1 -- 172.21.15.152:0/3671203413 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd14c1ab710 con 0x7fd14c102ef0 2024-09-11T22:13:26.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.877+0000 7fd142ffd640 1 -- 172.21.15.152:0/3671203413 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd144018020 con 0x7fd14c102ef0 2024-09-11T22:13:26.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.880+0000 7fd142ffd640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1380a2d70 0x7fd1380a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.880+0000 7fd142ffd640 1 -- 172.21.15.152:0/3671203413 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fd1440cebd0 con 0x7fd14c102ef0 2024-09-11T22:13:26.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.880+0000 7fd1564f1740 1 Processor -- start 2024-09-11T22:13:26.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.880+0000 7fd151eb4640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1380a2d70 0x7fd1380a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd1564f1740 1 -- start start 2024-09-11T22:13:26.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433a4a0 0x5617b433a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 0x5617b4345140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b4345680 0x5617b4347a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd1564f1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5617b42a02e0 con 0x5617b433a4a0 2024-09-11T22:13:26.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd1564f1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5617b4247ce0 con 0x5617b4345680 2024-09-11T22:13:26.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd1564f1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5617b429c2a0 con 0x5617b433adc0 2024-09-11T22:13:26.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd151eb4640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1380a2d70 0x7fd1380a5230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd148030040 tx=0x7fd148009360 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd151eb4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433a4a0 0x5617b433a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd151eb4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433a4a0 0x5617b433a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38978/0 (socket says 172.21.15.152:38978) 2024-09-11T22:13:26.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd151eb4640 1 -- 172.21.15.152:0/2233348133 learned_addr learned my addr 172.21.15.152:0/2233348133 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:26.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd1516b3640 1 --2- 172.21.15.152:0/2233348133 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 0x5617b4345140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.881+0000 7fd1526b5640 1 --2- 172.21.15.152:0/2233348133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b4345680 0x5617b4347a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.882+0000 7fd1516b3640 1 -- 172.21.15.152:0/2233348133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b4345680 msgr2=0x5617b4347a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.882+0000 7fd1516b3640 1 --2- 172.21.15.152:0/2233348133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b4345680 0x5617b4347a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.882+0000 7fd1516b3640 1 -- 172.21.15.152:0/2233348133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433a4a0 msgr2=0x5617b433a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.882+0000 7fd1516b3640 1 --2- 172.21.15.152:0/2233348133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433a4a0 0x5617b433a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.882+0000 7fd1516b3640 1 -- 172.21.15.152:0/2233348133 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b422c440 con 0x5617b433adc0 2024-09-11T22:13:26.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.884+0000 7fd1516b3640 1 --2- 172.21.15.152:0/2233348133 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 0x5617b4345140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd14c10ddb0 tx=0x7fd13c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb153acad13c614e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.884+0000 7fd137fff640 1 -- 172.21.15.152:0/2233348133 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c004230 con 0x5617b433adc0 2024-09-11T22:13:26.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.884+0000 7fd137fff640 1 -- 172.21.15.152:0/2233348133 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd13c00be90 con 0x5617b433adc0 2024-09-11T22:13:26.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.884+0000 7fd137fff640 1 -- 172.21.15.152:0/2233348133 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c011790 con 0x5617b433adc0 2024-09-11T22:13:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.885+0000 7fd1564f1740 1 -- 172.21.15.152:0/2233348133 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 msgr2=0x5617b4345140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.885+0000 7fd1564f1740 1 --2- 172.21.15.152:0/2233348133 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 0x5617b4345140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd14c10ddb0 tx=0x7fd13c0107a0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.885+0000 7fd1564f1740 1 -- 172.21.15.152:0/2233348133 shutdown_connections 2024-09-11T22:13:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.885+0000 7fd1564f1740 1 --2- 172.21.15.152:0/2233348133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b4345680 0x5617b4347a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.885+0000 7fd1564f1740 1 --2- 172.21.15.152:0/2233348133 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 0x5617b4345140 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.885+0000 7fd1564f1740 1 --2- 172.21.15.152:0/2233348133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433a4a0 0x5617b433a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.885+0000 7fd1564f1740 1 -- 172.21.15.152:0/2233348133 >> 172.21.15.152:0/2233348133 conn(0x5617b4336a30 msgr2=0x5617b4336e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.885+0000 7fd1564f1740 1 -- 172.21.15.152:0/2233348133 shutdown_connections 2024-09-11T22:13:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.885+0000 7fd1564f1740 1 -- 172.21.15.152:0/2233348133 wait complete. 2024-09-11T22:13:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.885+0000 7fd1564f1740 1 -- start start 2024-09-11T22:13:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.886+0000 7fd1564f1740 1 Processor -- start 2024-09-11T22:13:26.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.886+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433a4a0 0x5617b4344fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.886+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433adc0 0x5617b4342280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.886+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b4345680 0x5617b43427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.886+0000 7fd1564f1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5617b4348250 con 0x5617b433adc0 2024-09-11T22:13:26.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.886+0000 7fd1564f1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5617b425b050 con 0x5617b4345680 2024-09-11T22:13:26.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.886+0000 7fd1564f1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5617b43483d0 con 0x5617b433a4a0 2024-09-11T22:13:26.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.886+0000 7fd1516b3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433adc0 0x5617b4342280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.887+0000 7fd1516b3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433adc0 0x5617b4342280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38984/0 (socket says 172.21.15.152:38984) 2024-09-11T22:13:26.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.887+0000 7fd1516b3640 1 -- 172.21.15.152:0/2309637967 learned_addr learned my addr 172.21.15.152:0/2309637967 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:26.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.887+0000 7fd151eb4640 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433a4a0 0x5617b4344fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.886+0000 7fd1564f1740 10 client.0 _ll_register_callbacks cb 0x5617b429b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.887+0000 7fd1526b5640 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b4345680 0x5617b43427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.887+0000 7fd1516b3640 1 -- 172.21.15.152:0/2309637967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433a4a0 msgr2=0x5617b4344fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.887+0000 7fd1516b3640 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433a4a0 0x5617b4344fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.887+0000 7fd1516b3640 1 -- 172.21.15.152:0/2309637967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b4345680 msgr2=0x5617b43427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.887+0000 7fd1516b3640 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b4345680 0x5617b43427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.887+0000 7fd1516b3640 1 -- 172.21.15.152:0/2309637967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617b40113c0 con 0x5617b433adc0 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.888+0000 7fd1526b5640 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b4345680 0x5617b43427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.888+0000 7fd1516b3640 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433adc0 0x5617b4342280 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd13c004180 tx=0x7fd13c0041b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51044e299f3f2e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.888+0000 7fd1357fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.888+0000 7fd1357fa640 1 -- 172.21.15.152:0/2309637967 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c02b060 con 0x5617b433adc0 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.888+0000 7fd1564f1740 1 -- 172.21.15.152:0/2309637967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd13c00be90 con 0x5617b433adc0 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.888+0000 7fd1357fa640 1 -- 172.21.15.152:0/2309637967 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fd13c0035f0 con 0x5617b433adc0 2024-09-11T22:13:26.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.888+0000 7fd1357fa640 1 -- 172.21.15.152:0/2309637967 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd13c0037f0 con 0x5617b433adc0 2024-09-11T22:13:26.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.888+0000 7fd1564f1740 10 client.17697 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:26.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.889+0000 7fd1564f1740 1 -- 172.21.15.152:0/2309637967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5617b4364bf0 con 0x5617b433adc0 2024-09-11T22:13:26.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.889+0000 7fd1357fa640 1 -- 172.21.15.152:0/2309637967 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd13c00be90 con 0x5617b433adc0 2024-09-11T22:13:26.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.890+0000 7fd1357fa640 1 -- 172.21.15.152:0/2309637967 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd13c011bc0 con 0x5617b433adc0 2024-09-11T22:13:26.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.890+0000 7fd1564f1740 10 client.17697 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:26.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.890+0000 7fd1564f1740 10 client.17697 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:26.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.890+0000 7fd1564f1740 20 client.17697 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:26.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.890+0000 7fd1564f1740 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5617b4366000 0x5617b43683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.890+0000 7fd1564f1740 4 client.17697 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:26.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.890+0000 7fd1564f1740 1 -- 172.21.15.152:0/2309637967 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617b42ad850 con 0x5617b4366000 2024-09-11T22:13:26.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.890+0000 7fd151eb4640 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5617b4366000 0x5617b43683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.890+0000 7fd1357fa640 10 client.17697 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:26.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.890+0000 7fd151eb4640 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5617b4366000 0x5617b43683f0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8c9815207702908 server_cookie=99e3fdec26e20b in_seq=0 out_seq=0 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1357fa640 1 -- 172.21.15.152:0/2309637967 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617b42ad850 con 0x5617b4366000 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1357fa640 10 client.17697 handle_command_reply: tid=0 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1564f1740 1 client.17697 shutdown 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1564f1740 1 -- 172.21.15.152:0/2309637967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433adc0 msgr2=0x5617b4342280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1564f1740 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433adc0 0x5617b4342280 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd13c004180 tx=0x7fd13c0041b0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1564f1740 1 -- 172.21.15.152:0/2309637967 shutdown_connections 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1564f1740 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5617b4366000 0x5617b43683f0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1564f1740 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b4345680 0x5617b43427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1564f1740 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b433adc0 0x5617b4342280 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1564f1740 1 --2- 172.21.15.152:0/2309637967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433a4a0 0x5617b4344fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1564f1740 1 -- 172.21.15.152:0/2309637967 >> 172.21.15.152:0/2309637967 conn(0x5617b4336a30 msgr2=0x5617b433c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1357fa640 0 client.17697 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:26.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.891+0000 7fd1564f1740 1 -- 172.21.15.152:0/2309637967 shutdown_connections 2024-09-11T22:13:26.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.893+0000 7fd1564f1740 1 -- 172.21.15.152:0/2309637967 wait complete. 2024-09-11T22:13:26.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.893+0000 7fd1564f1740 20 client.17697 trim_cache size 0 max 16384 2024-09-11T22:13:26.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.929+0000 7fd1564f1740 1 Processor -- start 2024-09-11T22:13:26.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd1564f1740 1 -- start start 2024-09-11T22:13:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433a4a0 0x5617b433f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b433adc0 0x5617b433fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b4345680 0x5617b433d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd1564f1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1ae250 con 0x5617b4345680 2024-09-11T22:13:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd1564f1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1abb20 con 0x5617b433adc0 2024-09-11T22:13:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd1564f1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c0724a0 con 0x5617b433a4a0 2024-09-11T22:13:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd1516b3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b433adc0 0x5617b433fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd1516b3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b433adc0 0x5617b433fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37670/0 (socket says 172.21.15.152:37670) 2024-09-11T22:13:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd1516b3640 1 -- 172.21.15.152:0/4089335948 learned_addr learned my addr 172.21.15.152:0/4089335948 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd151eb4640 1 --2- 172.21.15.152:0/4089335948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433a4a0 0x5617b433f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.930+0000 7fd1526b5640 1 --2- 172.21.15.152:0/4089335948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b4345680 0x5617b433d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.931+0000 7fd1526b5640 1 -- 172.21.15.152:0/4089335948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433a4a0 msgr2=0x5617b433f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.931+0000 7fd1526b5640 1 --2- 172.21.15.152:0/4089335948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433a4a0 0x5617b433f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.931+0000 7fd1526b5640 1 -- 172.21.15.152:0/4089335948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b433adc0 msgr2=0x5617b433fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.931+0000 7fd1526b5640 1 --2- 172.21.15.152:0/4089335948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b433adc0 0x5617b433fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.931+0000 7fd1526b5640 1 -- 172.21.15.152:0/4089335948 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b43364d0 con 0x5617b4345680 2024-09-11T22:13:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.931+0000 7fd1516b3640 1 --2- 172.21.15.152:0/4089335948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b433adc0 0x5617b433fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.931+0000 7fd1526b5640 1 --2- 172.21.15.152:0/4089335948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b4345680 0x5617b433d030 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd1440cc3d0 tx=0x7fd1440107b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbe3e7ae8f9cf59 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.931+0000 7fd1377fe640 1 -- 172.21.15.152:0/4089335948 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14409b1a0 con 0x5617b4345680 2024-09-11T22:13:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.931+0000 7fd1377fe640 1 -- 172.21.15.152:0/4089335948 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd14409f550 con 0x5617b4345680 2024-09-11T22:13:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.931+0000 7fd1377fe640 1 -- 172.21.15.152:0/4089335948 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144097810 con 0x5617b4345680 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.932+0000 7fd1564f1740 1 -- 172.21.15.152:0/4089335948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b4345680 msgr2=0x5617b433d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.932+0000 7fd1564f1740 1 --2- 172.21.15.152:0/4089335948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b4345680 0x5617b433d030 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd1440cc3d0 tx=0x7fd1440107b0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.933+0000 7fd1564f1740 1 -- 172.21.15.152:0/4089335948 shutdown_connections 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.933+0000 7fd1564f1740 1 --2- 172.21.15.152:0/4089335948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b4345680 0x5617b433d030 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.933+0000 7fd1564f1740 1 --2- 172.21.15.152:0/4089335948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b433adc0 0x5617b433fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.933+0000 7fd1564f1740 1 --2- 172.21.15.152:0/4089335948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433a4a0 0x5617b433f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.933+0000 7fd1564f1740 1 -- 172.21.15.152:0/4089335948 >> 172.21.15.152:0/4089335948 conn(0x5617b4336a30 msgr2=0x5617b4341370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.933+0000 7fd1564f1740 1 -- 172.21.15.152:0/4089335948 shutdown_connections 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.934+0000 7fd1564f1740 1 -- 172.21.15.152:0/4089335948 wait complete. 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.934+0000 7fd1564f1740 1 -- start start 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.934+0000 7fd1564f1740 1 Processor -- start 2024-09-11T22:13:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.935+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b433a4a0 0x5617b4368530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.935+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 0x5617b4368a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.935+0000 7fd1564f1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b4345680 0x5617b43ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.935+0000 7fd1564f1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c072af0 con 0x5617b4345680 2024-09-11T22:13:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.935+0000 7fd1564f1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c073f20 con 0x5617b433a4a0 2024-09-11T22:13:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.935+0000 7fd1564f1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c073180 con 0x5617b433adc0 2024-09-11T22:13:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.935+0000 7fd1564f1740 10 client.0 _ll_register_callbacks cb 0x7fd148009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.935+0000 7fd1516b3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 0x5617b4368a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.935+0000 7fd1516b3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 0x5617b4368a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:40768/0 (socket says 172.21.15.152:40768) 2024-09-11T22:13:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.935+0000 7fd1516b3640 1 -- 172.21.15.152:0/3140880568 learned_addr learned my addr 172.21.15.152:0/3140880568 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.935+0000 7fd1526b5640 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b4345680 0x5617b43ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.936+0000 7fd1516b3640 1 -- 172.21.15.152:0/3140880568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b433a4a0 msgr2=0x5617b4368530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:13:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.936+0000 7fd1516b3640 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b433a4a0 0x5617b4368530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.936+0000 7fd1516b3640 1 -- 172.21.15.152:0/3140880568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b4345680 msgr2=0x5617b43ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.936+0000 7fd1516b3640 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b4345680 0x5617b43ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.936+0000 7fd1516b3640 1 -- 172.21.15.152:0/3140880568 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617b43ceef0 con 0x5617b433adc0 2024-09-11T22:13:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.937+0000 7fd1516b3640 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 0x5617b4368a70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd13c013010 tx=0x7fd13c00bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deb064bc228d08e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.937+0000 7fd1357fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:13:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.939+0000 7fd1357fa640 1 -- 172.21.15.152:0/3140880568 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c01f070 con 0x5617b433adc0 2024-09-11T22:13:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.939+0000 7fd1564f1740 1 -- 172.21.15.152:0/3140880568 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd14409f550 con 0x5617b433adc0 2024-09-11T22:13:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.939+0000 7fd1357fa640 1 -- 172.21.15.152:0/3140880568 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fd13c0035f0 con 0x5617b433adc0 2024-09-11T22:13:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.939+0000 7fd1357fa640 1 -- 172.21.15.152:0/3140880568 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd13c02b040 con 0x5617b433adc0 2024-09-11T22:13:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.939+0000 7fd1564f1740 10 client.27232 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.939+0000 7fd1564f1740 1 -- 172.21.15.152:0/3140880568 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5617b43d01c0 con 0x5617b433adc0 2024-09-11T22:13:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.940+0000 7fd1357fa640 1 -- 172.21.15.152:0/3140880568 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd14409f550 con 0x5617b433adc0 2024-09-11T22:13:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.940+0000 7fd1357fa640 1 -- 172.21.15.152:0/3140880568 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd13c035020 con 0x5617b433adc0 2024-09-11T22:13:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.940+0000 7fd1564f1740 10 client.27232 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.940+0000 7fd1564f1740 10 client.27232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.940+0000 7fd1564f1740 20 client.27232 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.940+0000 7fd1564f1740 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5617b43d0880 0x5617b43d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.940+0000 7fd1564f1740 4 client.27232 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:13:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.940+0000 7fd1564f1740 1 -- 172.21.15.152:0/3140880568 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5617b42a7d60 con 0x5617b43d0880 2024-09-11T22:13:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.940+0000 7fd151eb4640 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5617b43d0880 0x5617b43d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.941+0000 7fd151eb4640 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5617b43d0880 0x5617b43d2ca0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8617f65105fafb81 server_cookie=a2a7321b12fb00d6 in_seq=0 out_seq=0 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.941+0000 7fd1357fa640 10 client.27232 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.941+0000 7fd1357fa640 1 -- 172.21.15.152:0/3140880568 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5617b42a7d60 con 0x5617b43d0880 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.941+0000 7fd1357fa640 10 client.27232 handle_command_reply: tid=0 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.941+0000 7fd1564f1740 1 client.27232 shutdown 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1564f1740 1 -- 172.21.15.152:0/3140880568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 msgr2=0x5617b4368a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1564f1740 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 0x5617b4368a70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd13c013010 tx=0x7fd13c00bc10 comp rx=0 tx=0).stop 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1564f1740 1 -- 172.21.15.152:0/3140880568 shutdown_connections 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1564f1740 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5617b43d0880 0x5617b43d2ca0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1564f1740 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5617b4345680 0x5617b43ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1564f1740 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5617b433adc0 0x5617b4368a70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1564f1740 1 --2- 172.21.15.152:0/3140880568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617b433a4a0 0x5617b4368530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1357fa640 0 client.27232 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1564f1740 1 -- 172.21.15.152:0/3140880568 >> 172.21.15.152:0/3140880568 conn(0x5617b4336a30 msgr2=0x5617b433cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1564f1740 1 -- 172.21.15.152:0/3140880568 shutdown_connections 2024-09-11T22:13:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1564f1740 1 -- 172.21.15.152:0/3140880568 wait complete. 2024-09-11T22:13:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.942+0000 7fd1564f1740 20 client.27232 trim_cache size 0 max 16384 2024-09-11T22:13:26.946 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:13:26.946 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:13:26.946 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:13:26.947 INFO:teuthology.orchestra.run.smithi152.stdout: "cf6f8182-fefd-43c1-9430-db2c6a096abb": { 2024-09-11T22:13:26.947 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:13:26.947 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "cf6f8182-fefd-43c1-9430-db2c6a096abb", 2024-09-11T22:13:26.947 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:13:26.947 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:13:26.947 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:13:26.947 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:13:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.943+0000 7fd154118640 1 -- 172.21.15.152:0/3671203413 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1380a2d70 msgr2=0x7fd1380a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.943+0000 7fd154118640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1380a2d70 0x7fd1380a5230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd148030040 tx=0x7fd148009360 comp rx=0 tx=0).stop 2024-09-11T22:13:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.943+0000 7fd154118640 1 -- 172.21.15.152:0/3671203413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14c102ef0 msgr2=0x7fd14c10cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.943+0000 7fd154118640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14c102ef0 0x7fd14c10cbf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd14400b410 tx=0x7fd14400b8d0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.943+0000 7fd154118640 1 -- 172.21.15.152:0/3671203413 shutdown_connections 2024-09-11T22:13:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.943+0000 7fd154118640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd1380a2d70 0x7fd1380a5230 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.943+0000 7fd154118640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14c102ef0 0x7fd14c10cbf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.943+0000 7fd154118640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd14c102570 0x7fd14c1a3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.944+0000 7fd154118640 1 --2- 172.21.15.152:0/3671203413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14c100e20 0x7fd14c1a37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.944+0000 7fd154118640 1 -- 172.21.15.152:0/3671203413 >> 172.21.15.152:0/3671203413 conn(0x7fd14c0fc7d0 msgr2=0x7fd14c0fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.944+0000 7fd154118640 1 -- 172.21.15.152:0/3671203413 shutdown_connections 2024-09-11T22:13:26.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:26.944+0000 7fd154118640 1 -- 172.21.15.152:0/3671203413 wait complete. 2024-09-11T22:13:27.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:27 smithi152 ceph-mon[31188]: pgmap v283: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.4 MiB/s wr, 812 op/s 2024-09-11T22:13:27.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:27 smithi179 ceph-mon[35603]: pgmap v283: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.4 MiB/s wr, 812 op/s 2024-09-11T22:13:27.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:27 smithi193 ceph-mon[35545]: pgmap v283: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.4 MiB/s wr, 812 op/s 2024-09-11T22:13:27.644 INFO:tasks.cephfs.filesystem:scrub status for tag:cf6f8182-fefd-43c1-9430-db2c6a096abb - {'path': '/', 'tag': 'cf6f8182-fefd-43c1-9430-db2c6a096abb', 'options': 'recursive,force'} 2024-09-11T22:13:29.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:29 smithi152 ceph-mon[31188]: pgmap v284: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.4 MiB/s wr, 812 op/s 2024-09-11T22:13:29.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:29 smithi179 ceph-mon[35603]: pgmap v284: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.4 MiB/s wr, 812 op/s 2024-09-11T22:13:29.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:29 smithi193 ceph-mon[35545]: pgmap v284: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.4 MiB/s wr, 812 op/s 2024-09-11T22:13:29.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 475.0 s, 3040.4 tps, lat 31.689 ms stddev 54.709 2024-09-11T22:13:31.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:31 smithi152 ceph-mon[31188]: pgmap v285: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 747 op/s 2024-09-11T22:13:31.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:31 smithi179 ceph-mon[35603]: pgmap v285: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 747 op/s 2024-09-11T22:13:31.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:31 smithi193 ceph-mon[35545]: pgmap v285: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 747 op/s 2024-09-11T22:13:33.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:33 smithi152 ceph-mon[31188]: pgmap v286: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 656 op/s 2024-09-11T22:13:33.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:33 smithi179 ceph-mon[35603]: pgmap v286: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 656 op/s 2024-09-11T22:13:33.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:33 smithi193 ceph-mon[35545]: pgmap v286: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 656 op/s 2024-09-11T22:13:34.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:34 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:13:34.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:34 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:13:34.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:34 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:13:34.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:34 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:13:34.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:34 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:13:34.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:34 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:13:34.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:34 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:13:34.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:34 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:13:34.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:34 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:13:34.820 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 480.0 s, 2734.4 tps, lat 37.930 ms stddev 50.983 2024-09-11T22:13:35.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:35 smithi152 ceph-mon[31188]: pgmap v287: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 1.35k op/s 2024-09-11T22:13:35.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:35 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:13:35.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:35 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:13:35.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:35 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:13:35.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:35 smithi179 ceph-mon[35603]: pgmap v287: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 1.35k op/s 2024-09-11T22:13:35.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:35 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:13:35.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:35 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:13:35.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:35 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:13:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:35 smithi193 ceph-mon[35545]: pgmap v287: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 1.35k op/s 2024-09-11T22:13:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:35 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:13:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:35 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:13:35.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:35 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:13:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.180+0000 7fbb8f54b640 1 -- 172.21.15.152:0/1947630312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb881009f0 msgr2=0x7fbb88100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.180+0000 7fbb8f54b640 1 --2- 172.21.15.152:0/1947630312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb881009f0 0x7fbb88100e50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800d940 tx=0x7fbb7802c3b0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.181+0000 7fbb8f54b640 1 -- 172.21.15.152:0/1947630312 shutdown_connections 2024-09-11T22:13:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.181+0000 7fbb8f54b640 1 --2- 172.21.15.152:0/1947630312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb88101390 0x7fbb8810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.181+0000 7fbb8f54b640 1 --2- 172.21.15.152:0/1947630312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb881009f0 0x7fbb88100e50 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.181+0000 7fbb8f54b640 1 --2- 172.21.15.152:0/1947630312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb88106a00 0x7fbb88106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.181+0000 7fbb8f54b640 1 -- 172.21.15.152:0/1947630312 >> 172.21.15.152:0/1947630312 conn(0x7fbb880fc6b0 msgr2=0x7fbb880fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.181+0000 7fbb8f54b640 1 -- 172.21.15.152:0/1947630312 shutdown_connections 2024-09-11T22:13:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.181+0000 7fbb8f54b640 1 -- 172.21.15.152:0/1947630312 wait complete. 2024-09-11T22:13:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.181+0000 7fbb8f54b640 1 Processor -- start 2024-09-11T22:13:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.181+0000 7fbb8f54b640 1 -- start start 2024-09-11T22:13:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.182+0000 7fbb8f54b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb881009f0 0x7fbb881163a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.182+0000 7fbb8f54b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb88101390 0x7fbb88110410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.182+0000 7fbb8f54b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb88106a00 0x7fbb88110950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.182+0000 7fbb8f54b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8810eec0 con 0x7fbb88101390 2024-09-11T22:13:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.182+0000 7fbb8f54b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8810ed40 con 0x7fbb881009f0 2024-09-11T22:13:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.182+0000 7fbb8f54b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8810f040 con 0x7fbb88106a00 2024-09-11T22:13:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.182+0000 7fbb8cae6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb88101390 0x7fbb88110410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.182+0000 7fbb8d2e7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb881009f0 0x7fbb881163a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.182+0000 7fbb8d2e7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb881009f0 0x7fbb881163a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:56174/0 (socket says 172.21.15.152:56174) 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.182+0000 7fbb8d2e7640 1 -- 172.21.15.152:0/3993288514 learned_addr learned my addr 172.21.15.152:0/3993288514 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.182+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb88106a00 0x7fbb88110950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.183+0000 7fbb8d2e7640 1 -- 172.21.15.152:0/3993288514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb88106a00 msgr2=0x7fbb88110950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.183+0000 7fbb8d2e7640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb88106a00 0x7fbb88110950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.183+0000 7fbb8d2e7640 1 -- 172.21.15.152:0/3993288514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb88101390 msgr2=0x7fbb88110410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.183+0000 7fbb8d2e7640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb88101390 0x7fbb88110410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.183+0000 7fbb8d2e7640 1 -- 172.21.15.152:0/3993288514 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb88111080 con 0x7fbb881009f0 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.183+0000 7fbb8d2e7640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb881009f0 0x7fbb881163a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400e9f0 tx=0x7fbb8400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.183+0000 7fbb7e7fc640 1 -- 172.21.15.152:0/3993288514 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400cd80 con 0x7fbb881009f0 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.183+0000 7fbb7e7fc640 1 -- 172.21.15.152:0/3993288514 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb84010910 con 0x7fbb881009f0 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.183+0000 7fbb8f54b640 1 -- 172.21.15.152:0/3993288514 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb881b38d0 con 0x7fbb881009f0 2024-09-11T22:13:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.183+0000 7fbb7e7fc640 1 -- 172.21.15.152:0/3993288514 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84018990 con 0x7fbb881009f0 2024-09-11T22:13:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.183+0000 7fbb8f54b640 1 -- 172.21.15.152:0/3993288514 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb881b3ce0 con 0x7fbb881009f0 2024-09-11T22:13:36.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.187+0000 7fbb7e7fc640 1 -- 172.21.15.152:0/3993288514 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fbb84010ac0 con 0x7fbb881009f0 2024-09-11T22:13:36.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.188+0000 7fbb91f22740 1 Processor -- start 2024-09-11T22:13:36.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.188+0000 7fbb91f22740 1 -- start start 2024-09-11T22:13:36.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89caabaf0 0x55c89caabed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caac410 0x55c89cab6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89cab6cb0 0x55c89cab90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb91f22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c89ca102f0 con 0x55c89caac410 2024-09-11T22:13:36.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb91f22740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c89c9b8270 con 0x55c89cab6cb0 2024-09-11T22:13:36.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb91f22740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c89ca0c2b0 con 0x55c89caabaf0 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb8dae8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89caabaf0 0x55c89caabed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb8dae8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89caabaf0 0x55c89caabed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:56378/0 (socket says 172.21.15.152:56378) 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb8dae8640 1 -- 172.21.15.152:0/4177590366 learned_addr learned my addr 172.21.15.152:0/4177590366 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb8d2e7640 1 --2- 172.21.15.152:0/4177590366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caac410 0x55c89cab6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb8cae6640 1 --2- 172.21.15.152:0/4177590366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89cab6cb0 0x55c89cab90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb8dae8640 1 -- 172.21.15.152:0/4177590366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89cab6cb0 msgr2=0x55c89cab90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/4177590366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89cab6cb0 0x55c89cab90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb8dae8640 1 -- 172.21.15.152:0/4177590366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caac410 msgr2=0x55c89cab6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/4177590366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caac410 0x55c89cab6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb8dae8640 1 -- 172.21.15.152:0/4177590366 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c89c9b7340 con 0x55c89caabaf0 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/4177590366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89caabaf0 0x55c89caabed0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009fd0 tx=0x7fbb800118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd07cc4321ca651a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.189+0000 7fbb7e7fc640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbb740a2e20 0x7fbb740a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.190+0000 7fbb8d2e7640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbb740a2e20 0x7fbb740a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.190+0000 7fbb7e7fc640 1 -- 172.21.15.152:0/3993288514 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fbb840cf730 con 0x7fbb881009f0 2024-09-11T22:13:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.190+0000 7fbb8d2e7640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbb740a2e20 0x7fbb740a52e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55c89caa8ec0 tx=0x7fbb840d5260 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.191+0000 7fbb737fe640 1 -- 172.21.15.152:0/4177590366 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80004d20 con 0x55c89caabaf0 2024-09-11T22:13:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.191+0000 7fbb737fe640 1 -- 172.21.15.152:0/4177590366 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb80004050 con 0x55c89caabaf0 2024-09-11T22:13:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.191+0000 7fbb737fe640 1 -- 172.21.15.152:0/4177590366 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80005280 con 0x55c89caabaf0 2024-09-11T22:13:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.192+0000 7fbb91f22740 1 -- 172.21.15.152:0/4177590366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89caabaf0 msgr2=0x55c89caabed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.192+0000 7fbb91f22740 1 --2- 172.21.15.152:0/4177590366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89caabaf0 0x55c89caabed0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009fd0 tx=0x7fbb800118d0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.192+0000 7fbb91f22740 1 -- 172.21.15.152:0/4177590366 shutdown_connections 2024-09-11T22:13:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.192+0000 7fbb91f22740 1 --2- 172.21.15.152:0/4177590366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89cab6cb0 0x55c89cab90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.192+0000 7fbb91f22740 1 --2- 172.21.15.152:0/4177590366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caac410 0x55c89cab6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.192+0000 7fbb91f22740 1 --2- 172.21.15.152:0/4177590366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89caabaf0 0x55c89caabed0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.192+0000 7fbb91f22740 1 -- 172.21.15.152:0/4177590366 >> 172.21.15.152:0/4177590366 conn(0x55c89caa8060 msgr2=0x55c89caa8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.192+0000 7fbb91f22740 1 -- 172.21.15.152:0/4177590366 shutdown_connections 2024-09-11T22:13:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.192+0000 7fbb91f22740 1 -- 172.21.15.152:0/4177590366 wait complete. 2024-09-11T22:13:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.192+0000 7fbb91f22740 1 -- start start 2024-09-11T22:13:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.192+0000 7fbb91f22740 1 Processor -- start 2024-09-11T22:13:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.193+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 0x55c89cab3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.193+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caac410 0x55c89cab40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.193+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cab4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.193+0000 7fbb91f22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c89cab9880 con 0x55c89caabaf0 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.193+0000 7fbb91f22740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c89c999290 con 0x55c89caac410 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.193+0000 7fbb91f22740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c89cab9a00 con 0x55c89cab6cb0 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.193+0000 7fbb8dae8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 0x55c89cab3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.193+0000 7fbb8dae8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 0x55c89cab3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58348/0 (socket says 172.21.15.152:58348) 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.193+0000 7fbb8dae8640 1 -- 172.21.15.152:0/3726337668 learned_addr learned my addr 172.21.15.152:0/3726337668 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.193+0000 7fbb91f22740 10 client.0 _ll_register_callbacks cb 0x55c89c9ca140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.194+0000 7fbb8cae6640 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caac410 0x55c89cab40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.194+0000 7fbb8cae6640 1 -- 172.21.15.152:0/3726337668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 msgr2=0x55c89cab4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.194+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cab4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.194+0000 7fbb8cae6640 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cab4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.194+0000 7fbb8cae6640 1 -- 172.21.15.152:0/3726337668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 msgr2=0x55c89cab3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:36.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.194+0000 7fbb8cae6640 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 0x55c89cab3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.194+0000 7fbb8cae6640 1 -- 172.21.15.152:0/3726337668 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c89c723210 con 0x55c89caac410 2024-09-11T22:13:36.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.194+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cab4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:36.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.195+0000 7fbb8cae6640 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caac410 0x55c89cab40f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800d860 tx=0x7fbb780045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e9a6a1c9cf046e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.195+0000 7fbb70ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:13:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.195+0000 7fbb70ff9640 1 -- 172.21.15.152:0/3726337668 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78042070 con 0x55c89caac410 2024-09-11T22:13:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.195+0000 7fbb91f22740 1 -- 172.21.15.152:0/3726337668 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb80004050 con 0x55c89caac410 2024-09-11T22:13:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.195+0000 7fbb70ff9640 1 -- 172.21.15.152:0/3726337668 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fbb7800d360 con 0x55c89caac410 2024-09-11T22:13:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.195+0000 7fbb70ff9640 1 -- 172.21.15.152:0/3726337668 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbb7804e050 con 0x55c89caac410 2024-09-11T22:13:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.195+0000 7fbb91f22740 10 client.27068 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.195+0000 7fbb91f22740 1 -- 172.21.15.152:0/3726337668 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c89c7ef620 con 0x55c89caac410 2024-09-11T22:13:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.195+0000 7fbb70ff9640 1 -- 172.21.15.152:0/3726337668 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb80004050 con 0x55c89caac410 2024-09-11T22:13:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.195+0000 7fbb70ff9640 1 -- 172.21.15.152:0/3726337668 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fbb780476b0 con 0x55c89caac410 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.195+0000 7fbb91f22740 10 client.27068 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.196+0000 7fbb91f22740 10 client.27068 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.196+0000 7fbb91f22740 20 client.27068 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.196+0000 7fbb91f22740 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c89cac6c00 0x55c89cac8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.196+0000 7fbb91f22740 4 client.27068 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.196+0000 7fbb91f22740 1 -- 172.21.15.152:0/3726337668 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c89ca1da20 con 0x55c89cac6c00 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.196+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c89cac6c00 0x55c89cac8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.197+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c89cac6c00 0x55c89cac8ff0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ecdcc3836ff59ad server_cookie=e4761c85fac08d37 in_seq=0 out_seq=0 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.197+0000 7fbb70ff9640 10 client.27068 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb70ff9640 1 -- 172.21.15.152:0/3726337668 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c89ca1da20 con 0x55c89cac6c00 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb70ff9640 10 client.27068 handle_command_reply: tid=0 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb91f22740 1 client.27068 shutdown 2024-09-11T22:13:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb91f22740 1 -- 172.21.15.152:0/3726337668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caac410 msgr2=0x55c89cab40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb91f22740 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caac410 0x55c89cab40f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800d860 tx=0x7fbb780045f0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb91f22740 1 -- 172.21.15.152:0/3726337668 shutdown_connections 2024-09-11T22:13:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb91f22740 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c89cac6c00 0x55c89cac8ff0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb91f22740 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cab4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb70ff9640 0 client.27068 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb91f22740 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caac410 0x55c89cab40f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb91f22740 1 --2- 172.21.15.152:0/3726337668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 0x55c89cab3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.198+0000 7fbb91f22740 1 -- 172.21.15.152:0/3726337668 >> 172.21.15.152:0/3726337668 conn(0x55c89caa8060 msgr2=0x55c89caaddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.199+0000 7fbb91f22740 1 -- 172.21.15.152:0/3726337668 shutdown_connections 2024-09-11T22:13:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.199+0000 7fbb91f22740 1 -- 172.21.15.152:0/3726337668 wait complete. 2024-09-11T22:13:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.199+0000 7fbb91f22740 20 client.27068 trim_cache size 0 max 16384 2024-09-11T22:13:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.220+0000 7fbb91f22740 1 Processor -- start 2024-09-11T22:13:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.220+0000 7fbb91f22740 1 -- start start 2024-09-11T22:13:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 0x55c89caae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caac410 0x55c89cab4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cace900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb91f22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb881bf0a0 con 0x55c89caabaf0 2024-09-11T22:13:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb8dae8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 0x55c89caae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb8dae8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 0x55c89caae5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58356/0 (socket says 172.21.15.152:58356) 2024-09-11T22:13:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb8dae8640 1 -- 172.21.15.152:0/4230140758 learned_addr learned my addr 172.21.15.152:0/4230140758 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb91f22740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbb881bc970 con 0x55c89caac410 2024-09-11T22:13:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb91f22740 1 -- 172.21.15.152:0/4230140758 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbb881ba7e0 con 0x55c89cab6cb0 2024-09-11T22:13:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb8cae6640 1 --2- 172.21.15.152:0/4230140758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caac410 0x55c89cab4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb8dae8640 1 -- 172.21.15.152:0/4230140758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 msgr2=0x55c89cace900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:13:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/4230140758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cace900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb8dae8640 1 -- 172.21.15.152:0/4230140758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caac410 msgr2=0x55c89cab4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/4230140758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caac410 0x55c89cab4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.221+0000 7fbb8dae8640 1 -- 172.21.15.152:0/4230140758 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c89caac240 con 0x55c89caabaf0 2024-09-11T22:13:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.222+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/4230140758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 0x55c89caae5b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009f70 tx=0x7fbb80009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d2770e37c4334c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.222+0000 7fbb72ffd640 1 -- 172.21.15.152:0/4230140758 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80004ac0 con 0x55c89caabaf0 2024-09-11T22:13:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.222+0000 7fbb72ffd640 1 -- 172.21.15.152:0/4230140758 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb80004c60 con 0x55c89caabaf0 2024-09-11T22:13:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.222+0000 7fbb72ffd640 1 -- 172.21.15.152:0/4230140758 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80005040 con 0x55c89caabaf0 2024-09-11T22:13:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.223+0000 7fbb91f22740 1 -- 172.21.15.152:0/4230140758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 msgr2=0x55c89caae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.223+0000 7fbb91f22740 1 --2- 172.21.15.152:0/4230140758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 0x55c89caae5b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009f70 tx=0x7fbb80009c80 comp rx=0 tx=0).stop 2024-09-11T22:13:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.223+0000 7fbb91f22740 1 -- 172.21.15.152:0/4230140758 shutdown_connections 2024-09-11T22:13:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.223+0000 7fbb91f22740 1 --2- 172.21.15.152:0/4230140758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cace900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.223+0000 7fbb91f22740 1 --2- 172.21.15.152:0/4230140758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caac410 0x55c89cab4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.223+0000 7fbb91f22740 1 --2- 172.21.15.152:0/4230140758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caabaf0 0x55c89caae5b0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.223+0000 7fbb91f22740 1 -- 172.21.15.152:0/4230140758 >> 172.21.15.152:0/4230140758 conn(0x55c89caa8060 msgr2=0x55c89cab5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.223+0000 7fbb91f22740 1 -- 172.21.15.152:0/4230140758 shutdown_connections 2024-09-11T22:13:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.223+0000 7fbb91f22740 1 -- 172.21.15.152:0/4230140758 wait complete. 2024-09-11T22:13:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.223+0000 7fbb91f22740 1 -- start start 2024-09-11T22:13:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.223+0000 7fbb91f22740 1 Processor -- start 2024-09-11T22:13:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.224+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caabaf0 0x55c89cabf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.224+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caac410 0x55c89caba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.224+0000 7fbb91f22740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cabafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.224+0000 7fbb91f22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb881bae30 con 0x55c89caac410 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.224+0000 7fbb91f22740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbb881bc2a0 con 0x55c89caabaf0 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.224+0000 7fbb91f22740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbb881bb500 con 0x55c89cab6cb0 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.224+0000 7fbb91f22740 10 client.0 _ll_register_callbacks cb 0x7fbb800093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8cae6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caac410 0x55c89caba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8dae8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caabaf0 0x55c89cabf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8cae6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caac410 0x55c89caba8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58360/0 (socket says 172.21.15.152:58360) 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8dae8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caabaf0 0x55c89cabf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:56214/0 (socket says 172.21.15.152:56214) 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8cae6640 1 -- 172.21.15.152:0/2388251172 learned_addr learned my addr 172.21.15.152:0/2388251172 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cabafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8dae8640 1 -- 172.21.15.152:0/2388251172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 msgr2=0x55c89cabafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cabafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8dae8640 1 -- 172.21.15.152:0/2388251172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caac410 msgr2=0x55c89caba8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caac410 0x55c89caba8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8dae8640 1 -- 172.21.15.152:0/2388251172 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c89cb308d0 con 0x55c89caabaf0 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb8dae8640 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caabaf0 0x55c89cabf580 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009d50 tx=0x7fbb8002d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60393fad9c23db99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.225+0000 7fbb70ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb70ff9640 1 -- 172.21.15.152:0/2388251172 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80005040 con 0x55c89caabaf0 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb70ff9640 1 -- 172.21.15.152:0/2388251172 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fbb80004440 con 0x55c89caabaf0 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb91f22740 1 -- 172.21.15.152:0/2388251172 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb80004c60 con 0x55c89caabaf0 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb70ff9640 1 -- 172.21.15.152:0/2388251172 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbb80004640 con 0x55c89caabaf0 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb91f22740 10 client.27074 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb91f22740 1 -- 172.21.15.152:0/2388251172 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c89cb31a80 con 0x55c89caabaf0 2024-09-11T22:13:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb70ff9640 1 -- 172.21.15.152:0/2388251172 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb80004c60 con 0x55c89caabaf0 2024-09-11T22:13:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb70ff9640 1 -- 172.21.15.152:0/2388251172 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fbb8000f660 con 0x55c89caabaf0 2024-09-11T22:13:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb91f22740 10 client.27074 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb91f22740 10 client.27074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb91f22740 20 client.27074 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb91f22740 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c89cb31eb0 0x55c89cb342a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb91f22740 4 client.27074 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:13:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.226+0000 7fbb91f22740 1 -- 172.21.15.152:0/2388251172 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c89ca17d70 con 0x55c89cb31eb0 2024-09-11T22:13:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.227+0000 7fbb8cae6640 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c89cb31eb0 0x55c89cb342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.227+0000 7fbb8cae6640 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c89cb31eb0 0x55c89cb342a0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f46fb973d455d28 server_cookie=27a4d7074faf68fc in_seq=0 out_seq=0 2024-09-11T22:13:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.227+0000 7fbb70ff9640 10 client.27074 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.235+0000 7fbb70ff9640 1 -- 172.21.15.152:0/2388251172 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c89ca17d70 con 0x55c89cb31eb0 2024-09-11T22:13:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.235+0000 7fbb70ff9640 10 client.27074 handle_command_reply: tid=0 2024-09-11T22:13:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.235+0000 7fbb91f22740 1 client.27074 shutdown 2024-09-11T22:13:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.235+0000 7fbb91f22740 1 -- 172.21.15.152:0/2388251172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caabaf0 msgr2=0x55c89cabf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.235+0000 7fbb91f22740 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caabaf0 0x55c89cabf580 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009d50 tx=0x7fbb8002d040 comp rx=0 tx=0).stop 2024-09-11T22:13:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.236+0000 7fbb91f22740 1 -- 172.21.15.152:0/2388251172 shutdown_connections 2024-09-11T22:13:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.236+0000 7fbb91f22740 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c89cb31eb0 0x55c89cb342a0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.236+0000 7fbb91f22740 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c89cab6cb0 0x55c89cabafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.236+0000 7fbb70ff9640 0 client.27074 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.236+0000 7fbb91f22740 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c89caac410 0x55c89caba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.236+0000 7fbb91f22740 1 --2- 172.21.15.152:0/2388251172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c89caabaf0 0x55c89cabf580 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.236+0000 7fbb91f22740 1 -- 172.21.15.152:0/2388251172 >> 172.21.15.152:0/2388251172 conn(0x55c89caa8060 msgr2=0x55c89caa69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.236+0000 7fbb91f22740 1 -- 172.21.15.152:0/2388251172 shutdown_connections 2024-09-11T22:13:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.236+0000 7fbb91f22740 1 -- 172.21.15.152:0/2388251172 wait complete. 2024-09-11T22:13:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.236+0000 7fbb91f22740 20 client.27074 trim_cache size 0 max 16384 2024-09-11T22:13:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:13:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:13:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:13:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:13:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 -- 172.21.15.152:0/3993288514 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbb740a2e20 msgr2=0x7fbb740a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbb740a2e20 0x7fbb740a52e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55c89caa8ec0 tx=0x7fbb840d5260 comp rx=0 tx=0).stop 2024-09-11T22:13:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 -- 172.21.15.152:0/3993288514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb881009f0 msgr2=0x7fbb881163a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb881009f0 0x7fbb881163a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400e9f0 tx=0x7fbb8400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 -- 172.21.15.152:0/3993288514 shutdown_connections 2024-09-11T22:13:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbb740a2e20 0x7fbb740a52e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb88106a00 0x7fbb88110950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb88101390 0x7fbb88110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 --2- 172.21.15.152:0/3993288514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb881009f0 0x7fbb881163a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 -- 172.21.15.152:0/3993288514 >> 172.21.15.152:0/3993288514 conn(0x7fbb880fc6b0 msgr2=0x7fbb880fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 -- 172.21.15.152:0/3993288514 shutdown_connections 2024-09-11T22:13:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:36.237+0000 7fbb8f54b640 1 -- 172.21.15.152:0/3993288514 wait complete. 2024-09-11T22:13:37.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:37 smithi152 ceph-mon[31188]: pgmap v288: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 36 MiB/s wr, 1.46k op/s 2024-09-11T22:13:37.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:37 smithi179 ceph-mon[35603]: pgmap v288: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 36 MiB/s wr, 1.46k op/s 2024-09-11T22:13:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:37 smithi193 ceph-mon[35545]: pgmap v288: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 36 MiB/s wr, 1.46k op/s 2024-09-11T22:13:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:39 smithi152 ceph-mon[31188]: pgmap v289: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 MiB/s wr, 1.39k op/s 2024-09-11T22:13:39.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:39 smithi179 ceph-mon[35603]: pgmap v289: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 MiB/s wr, 1.39k op/s 2024-09-11T22:13:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:39 smithi193 ceph-mon[35545]: pgmap v289: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 MiB/s wr, 1.39k op/s 2024-09-11T22:13:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 485.0 s, 3333.4 tps, lat 29.949 ms stddev 33.844 2024-09-11T22:13:41.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:41 smithi152 ceph-mon[31188]: pgmap v290: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 39 MiB/s wr, 1.70k op/s 2024-09-11T22:13:41.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:41 smithi179 ceph-mon[35603]: pgmap v290: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 39 MiB/s wr, 1.70k op/s 2024-09-11T22:13:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:41 smithi193 ceph-mon[35545]: pgmap v290: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 39 MiB/s wr, 1.70k op/s 2024-09-11T22:13:43.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:43 smithi152 ceph-mon[31188]: pgmap v291: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.38k op/s 2024-09-11T22:13:43.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:43 smithi179 ceph-mon[35603]: pgmap v291: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.38k op/s 2024-09-11T22:13:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:43 smithi193 ceph-mon[35545]: pgmap v291: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.38k op/s 2024-09-11T22:13:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 490.0 s, 3240.6 tps, lat 31.097 ms stddev 36.261 2024-09-11T22:13:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:45 smithi152 ceph-mon[31188]: pgmap v292: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 1.59k op/s 2024-09-11T22:13:45.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:45 smithi179 ceph-mon[35603]: pgmap v292: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 1.59k op/s 2024-09-11T22:13:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:45 smithi193 ceph-mon[35545]: pgmap v292: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 1.59k op/s 2024-09-11T22:13:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:47 smithi152 ceph-mon[31188]: pgmap v293: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 993 op/s 2024-09-11T22:13:47.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:47 smithi179 ceph-mon[35603]: pgmap v293: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 993 op/s 2024-09-11T22:13:47.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:47 smithi193 ceph-mon[35545]: pgmap v293: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 993 op/s 2024-09-11T22:13:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.370+0000 7fed407cf640 1 -- 172.21.15.152:0/3491848678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed381009e0 msgr2=0x7fed381046a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.370+0000 7fed407cf640 1 --2- 172.21.15.152:0/3491848678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed381009e0 0x7fed381046a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fed30009ca0 tx=0x7fed3002a8f0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.370+0000 7fed407cf640 1 -- 172.21.15.152:0/3491848678 shutdown_connections 2024-09-11T22:13:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.370+0000 7fed407cf640 1 --2- 172.21.15.152:0/3491848678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed381009e0 0x7fed381046a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.370+0000 7fed407cf640 1 --2- 172.21.15.152:0/3491848678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed380fff60 0x7fed381003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.370+0000 7fed407cf640 1 --2- 172.21.15.152:0/3491848678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed38106be0 0x7fed38106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.370+0000 7fed407cf640 1 -- 172.21.15.152:0/3491848678 >> 172.21.15.152:0/3491848678 conn(0x7fed380770f0 msgr2=0x7fed380fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.370+0000 7fed407cf640 1 -- 172.21.15.152:0/3491848678 shutdown_connections 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.370+0000 7fed407cf640 1 -- 172.21.15.152:0/3491848678 wait complete. 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.371+0000 7fed407cf640 1 Processor -- start 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.371+0000 7fed407cf640 1 -- start start 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.372+0000 7fed407cf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed380fff60 0x7fed381a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.372+0000 7fed407cf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed381009e0 0x7fed381a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.372+0000 7fed407cf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed38106be0 0x7fed3819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.372+0000 7fed407cf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fed381186a0 con 0x7fed380fff60 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.372+0000 7fed407cf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fed38118520 con 0x7fed381009e0 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.372+0000 7fed407cf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fed38118820 con 0x7fed38106be0 2024-09-11T22:13:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.372+0000 7fed3dd6a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed381009e0 0x7fed381a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.372+0000 7fed3dd6a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed381009e0 0x7fed381a4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:42550/0 (socket says 172.21.15.152:42550) 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.372+0000 7fed3dd6a640 1 -- 172.21.15.152:0/182175966 learned_addr learned my addr 172.21.15.152:0/182175966 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.372+0000 7fed3e56b640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed380fff60 0x7fed381a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.373+0000 7fed3dd6a640 1 -- 172.21.15.152:0/182175966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed38106be0 msgr2=0x7fed3819e970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.373+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed38106be0 0x7fed3819e970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.373+0000 7fed3dd6a640 1 -- 172.21.15.152:0/182175966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed380fff60 msgr2=0x7fed381a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.373+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed380fff60 0x7fed381a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.373+0000 7fed3dd6a640 1 -- 172.21.15.152:0/182175966 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3819f0f0 con 0x7fed381009e0 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.373+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed381009e0 0x7fed381a4d00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fed2800b4a0 tx=0x7fed2800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.373+0000 7fed2f7fe640 1 -- 172.21.15.152:0/182175966 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28014070 con 0x7fed381009e0 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.373+0000 7fed2f7fe640 1 -- 172.21.15.152:0/182175966 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed28010af0 con 0x7fed381009e0 2024-09-11T22:13:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.373+0000 7fed2f7fe640 1 -- 172.21.15.152:0/182175966 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28017d40 con 0x7fed381009e0 2024-09-11T22:13:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.373+0000 7fed407cf640 1 -- 172.21.15.152:0/182175966 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3819f3e0 con 0x7fed381009e0 2024-09-11T22:13:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.374+0000 7fed407cf640 1 -- 172.21.15.152:0/182175966 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed381ab680 con 0x7fed381009e0 2024-09-11T22:13:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.376+0000 7fed43645740 1 Processor -- start 2024-09-11T22:13:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.376+0000 7fed43645740 1 -- start start 2024-09-11T22:13:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed43645740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d63ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed43645740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d6e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed43645740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d6ecb0 0x560998d710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed43645740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560998cc82f0 con 0x560998d63af0 2024-09-11T22:13:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed43645740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560998c70270 con 0x560998d64410 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed43645740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560998cc42b0 con 0x560998d6ecb0 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed2f7fe640 1 -- 172.21.15.152:0/182175966 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fed28017070 con 0x7fed381009e0 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed3e56b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d6e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed3e56b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d6e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:42562/0 (socket says 172.21.15.152:42562) 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed3ed6c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d63ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed3ed6c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d63ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47130/0 (socket says 172.21.15.152:47130) 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed3ed6c640 1 -- 172.21.15.152:0/1073754888 learned_addr learned my addr 172.21.15.152:0/1073754888 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.377+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/1073754888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d6ecb0 0x560998d710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.378+0000 7fed3ed6c640 1 -- 172.21.15.152:0/1073754888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d6ecb0 msgr2=0x560998d710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.378+0000 7fed2f7fe640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fed240a2f50 0x7fed240a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.378+0000 7fed2f7fe640 1 -- 172.21.15.152:0/182175966 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fed280ce6d0 con 0x7fed381009e0 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.379+0000 7fed3ed6c640 1 --2- 172.21.15.152:0/1073754888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d6ecb0 0x560998d710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.379+0000 7fed3ed6c640 1 -- 172.21.15.152:0/1073754888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 msgr2=0x560998d6e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.379+0000 7fed3ed6c640 1 --2- 172.21.15.152:0/1073754888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d6e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.379+0000 7fed3ed6c640 1 -- 172.21.15.152:0/1073754888 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560998c6f340 con 0x560998d63af0 2024-09-11T22:13:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.379+0000 7fed3e56b640 1 --2- 172.21.15.152:0/1073754888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d6e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.379+0000 7fed3ed6c640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fed240a2f50 0x7fed240a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.379+0000 7fed3ed6c640 1 --2- 172.21.15.152:0/1073754888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d63ed0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fed300098c0 tx=0x7fed300098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbe058b49c76268 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.379+0000 7fed2cff9640 1 -- 172.21.15.152:0/1073754888 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3004b070 con 0x560998d63af0 2024-09-11T22:13:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.380+0000 7fed2cff9640 1 -- 172.21.15.152:0/1073754888 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed3003f070 con 0x560998d63af0 2024-09-11T22:13:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.380+0000 7fed2cff9640 1 -- 172.21.15.152:0/1073754888 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3002fb40 con 0x560998d63af0 2024-09-11T22:13:49.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.380+0000 7fed43645740 1 -- 172.21.15.152:0/1073754888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 msgr2=0x560998d63ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.380+0000 7fed43645740 1 --2- 172.21.15.152:0/1073754888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d63ed0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fed300098c0 tx=0x7fed300098f0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.380+0000 7fed3ed6c640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fed240a2f50 0x7fed240a5410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed30048000 tx=0x7fed30049000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.380+0000 7fed43645740 1 -- 172.21.15.152:0/1073754888 shutdown_connections 2024-09-11T22:13:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.380+0000 7fed43645740 1 --2- 172.21.15.152:0/1073754888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d6ecb0 0x560998d710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.380+0000 7fed43645740 1 --2- 172.21.15.152:0/1073754888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d6e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.380+0000 7fed43645740 1 --2- 172.21.15.152:0/1073754888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d63ed0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.380+0000 7fed43645740 1 -- 172.21.15.152:0/1073754888 >> 172.21.15.152:0/1073754888 conn(0x560998d60060 msgr2=0x560998d60440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed43645740 1 -- 172.21.15.152:0/1073754888 shutdown_connections 2024-09-11T22:13:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed43645740 1 -- 172.21.15.152:0/1073754888 wait complete. 2024-09-11T22:13:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed43645740 1 -- start start 2024-09-11T22:13:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed43645740 1 Processor -- start 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed43645740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d6bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed43645740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d6c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed43645740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d6ecb0 0x560998d6c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed43645740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560998d71880 con 0x560998d63af0 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed43645740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560998c51290 con 0x560998d64410 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed43645740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560998d71a00 con 0x560998d6ecb0 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed43645740 10 client.0 _ll_register_callbacks cb 0x560998c82140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed3e56b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d6bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed3e56b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d6bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47140/0 (socket says 172.21.15.152:47140) 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed3e56b640 1 -- 172.21.15.152:0/1117334244 learned_addr learned my addr 172.21.15.152:0/1117334244 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.381+0000 7fed3ed6c640 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d6ecb0 0x560998d6c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.382+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d6c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.382+0000 7fed3e56b640 1 -- 172.21.15.152:0/1117334244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d6ecb0 msgr2=0x560998d6c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.382+0000 7fed3e56b640 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d6ecb0 0x560998d6c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.382+0000 7fed3e56b640 1 -- 172.21.15.152:0/1117334244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 msgr2=0x560998d6c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.382+0000 7fed3e56b640 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d6c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.382+0000 7fed3e56b640 1 -- 172.21.15.152:0/1117334244 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609989db210 con 0x560998d63af0 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.382+0000 7fed3ed6c640 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d6ecb0 0x560998d6c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.382+0000 7fed21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.382+0000 7fed3e56b640 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d6bb50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fed3400bfc0 tx=0x7fed3400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5de42522e32dfa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.383+0000 7fed21ffb640 1 -- 172.21.15.152:0/1117334244 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34018020 con 0x560998d63af0 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.383+0000 7fed21ffb640 1 -- 172.21.15.152:0/1117334244 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fed34014670 con 0x560998d63af0 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.383+0000 7fed43645740 1 -- 172.21.15.152:0/1117334244 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed3003f070 con 0x560998d63af0 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.384+0000 7fed21ffb640 1 -- 172.21.15.152:0/1117334244 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fed34018020 con 0x560998d63af0 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.384+0000 7fed43645740 10 client.17733 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.384+0000 7fed43645740 1 -- 172.21.15.152:0/1117334244 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560998aa7620 con 0x560998d63af0 2024-09-11T22:13:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.384+0000 7fed21ffb640 1 -- 172.21.15.152:0/1117334244 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed3003f070 con 0x560998d63af0 2024-09-11T22:13:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.385+0000 7fed21ffb640 1 -- 172.21.15.152:0/1117334244 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fed34025020 con 0x560998d63af0 2024-09-11T22:13:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.385+0000 7fed43645740 10 client.17733 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.385+0000 7fed43645740 10 client.17733 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.385+0000 7fed43645740 20 client.17733 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.385+0000 7fed43645740 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560998d7ec20 0x560998d81010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.385+0000 7fed43645740 4 client.17733 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.385+0000 7fed43645740 1 -- 172.21.15.152:0/1117334244 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560998cd5a20 con 0x560998d7ec20 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.386+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560998d7ec20 0x560998d81010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.386+0000 7fed21ffb640 10 client.17733 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.386+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560998d7ec20 0x560998d81010 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=296798ecfb342947 server_cookie=efe02a3b0c6c2e3e in_seq=0 out_seq=0 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed21ffb640 1 -- 172.21.15.152:0/1117334244 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560998cd5a20 con 0x560998d7ec20 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed21ffb640 10 client.17733 handle_command_reply: tid=0 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 1 client.17733 shutdown 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 1 -- 172.21.15.152:0/1117334244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 msgr2=0x560998d6bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d6bb50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fed3400bfc0 tx=0x7fed3400f670 comp rx=0 tx=0).stop 2024-09-11T22:13:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 1 -- 172.21.15.152:0/1117334244 shutdown_connections 2024-09-11T22:13:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560998d7ec20 0x560998d81010 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d6ecb0 0x560998d6c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d6c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 1 --2- 172.21.15.152:0/1117334244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d6bb50 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 1 -- 172.21.15.152:0/1117334244 >> 172.21.15.152:0/1117334244 conn(0x560998d60060 msgr2=0x560998d65dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed21ffb640 0 client.17733 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 1 -- 172.21.15.152:0/1117334244 shutdown_connections 2024-09-11T22:13:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 1 -- 172.21.15.152:0/1117334244 wait complete. 2024-09-11T22:13:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.387+0000 7fed43645740 20 client.17733 trim_cache size 0 max 16384 2024-09-11T22:13:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed43645740 1 Processor -- start 2024-09-11T22:13:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed43645740 1 -- start start 2024-09-11T22:13:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed43645740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d66560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed43645740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d64410 0x560998d6c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed43645740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d6ecb0 0x560998d6dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed43645740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fed381b6980 con 0x560998d63af0 2024-09-11T22:13:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed43645740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fed381b4250 con 0x560998d6ecb0 2024-09-11T22:13:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed3e56b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d66560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed43645740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fed381b2060 con 0x560998d64410 2024-09-11T22:13:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed3e56b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d66560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47150/0 (socket says 172.21.15.152:47150) 2024-09-11T22:13:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed3e56b640 1 -- 172.21.15.152:0/4135953067 learned_addr learned my addr 172.21.15.152:0/4135953067 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed3ed6c640 1 --2- 172.21.15.152:0/4135953067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d6ecb0 0x560998d6dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/4135953067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d64410 0x560998d6c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed3dd6a640 1 -- 172.21.15.152:0/4135953067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d6ecb0 msgr2=0x560998d6dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/4135953067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d6ecb0 0x560998d6dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed3dd6a640 1 -- 172.21.15.152:0/4135953067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 msgr2=0x560998d66560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/4135953067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d66560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.408+0000 7fed3dd6a640 1 -- 172.21.15.152:0/4135953067 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560998d5fe90 con 0x560998d64410 2024-09-11T22:13:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.409+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/4135953067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d64410 0x560998d6c400 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fed280cbe40 tx=0x7fed28017760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7cf06fd126f4c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.410+0000 7fed23fff640 1 -- 172.21.15.152:0/4135953067 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2801e040 con 0x560998d64410 2024-09-11T22:13:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.410+0000 7fed23fff640 1 -- 172.21.15.152:0/4135953067 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed28098f40 con 0x560998d64410 2024-09-11T22:13:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.410+0000 7fed23fff640 1 -- 172.21.15.152:0/4135953067 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280cbfe0 con 0x560998d64410 2024-09-11T22:13:49.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.411+0000 7fed43645740 1 -- 172.21.15.152:0/4135953067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d64410 msgr2=0x560998d6c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.412 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.411+0000 7fed43645740 1 --2- 172.21.15.152:0/4135953067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d64410 0x560998d6c400 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fed280cbe40 tx=0x7fed28017760 comp rx=0 tx=0).stop 2024-09-11T22:13:49.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.412+0000 7fed43645740 1 -- 172.21.15.152:0/4135953067 shutdown_connections 2024-09-11T22:13:49.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.412+0000 7fed43645740 1 --2- 172.21.15.152:0/4135953067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d6ecb0 0x560998d6dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.412+0000 7fed43645740 1 --2- 172.21.15.152:0/4135953067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d64410 0x560998d6c400 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.412+0000 7fed43645740 1 --2- 172.21.15.152:0/4135953067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d63af0 0x560998d66560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.412+0000 7fed43645740 1 -- 172.21.15.152:0/4135953067 >> 172.21.15.152:0/4135953067 conn(0x560998d60060 msgr2=0x560998d6d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:49.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.412+0000 7fed43645740 1 -- 172.21.15.152:0/4135953067 shutdown_connections 2024-09-11T22:13:49.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.412+0000 7fed43645740 1 -- 172.21.15.152:0/4135953067 wait complete. 2024-09-11T22:13:49.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.412+0000 7fed43645740 1 -- start start 2024-09-11T22:13:49.413 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.412+0000 7fed43645740 1 Processor -- start 2024-09-11T22:13:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed43645740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d63af0 0x560998d76f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed43645740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d774a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed43645740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d6ecb0 0x560998d683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed43645740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fed381b2710 con 0x560998d6ecb0 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed43645740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fed381b3b80 con 0x560998d64410 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed43645740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fed381b2de0 con 0x560998d63af0 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed3ed6c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d6ecb0 0x560998d683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed3ed6c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d6ecb0 0x560998d683e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47164/0 (socket says 172.21.15.152:47164) 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed3ed6c640 1 -- 172.21.15.152:0/3188655862 learned_addr learned my addr 172.21.15.152:0/3188655862 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed3e56b640 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d63af0 0x560998d76f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed43645740 10 client.0 _ll_register_callbacks cb 0x7fed3400b2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed3e56b640 1 -- 172.21.15.152:0/3188655862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 msgr2=0x560998d774a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed3e56b640 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d774a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed3e56b640 1 -- 172.21.15.152:0/3188655862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d6ecb0 msgr2=0x560998d683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed3e56b640 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d6ecb0 0x560998d683e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.413+0000 7fed3e56b640 1 -- 172.21.15.152:0/3188655862 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560998d5b2d0 con 0x560998d63af0 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.414+0000 7fed3e56b640 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d63af0 0x560998d76f60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fed3400bf90 tx=0x7fed3401d600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be880190ac20778b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.414+0000 7fed21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.414+0000 7fed21ffb640 1 -- 172.21.15.152:0/3188655862 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3400fea0 con 0x560998d63af0 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.414+0000 7fed21ffb640 1 -- 172.21.15.152:0/3188655862 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fed34014a80 con 0x560998d63af0 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.414+0000 7fed43645740 1 -- 172.21.15.152:0/3188655862 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed28098f40 con 0x560998d63af0 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.414+0000 7fed21ffb640 1 -- 172.21.15.152:0/3188655862 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fed3400fb70 con 0x560998d63af0 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.414+0000 7fed43645740 10 client.27256 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.414+0000 7fed43645740 1 -- 172.21.15.152:0/3188655862 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560998de9210 con 0x560998d63af0 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.415+0000 7fed21ffb640 1 -- 172.21.15.152:0/3188655862 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed28098f40 con 0x560998d63af0 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.415+0000 7fed21ffb640 1 -- 172.21.15.152:0/3188655862 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fed3402e020 con 0x560998d63af0 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.415+0000 7fed43645740 10 client.27256 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.415+0000 7fed43645740 10 client.27256 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.415+0000 7fed43645740 20 client.27256 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.415+0000 7fed43645740 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560998de9960 0x560998debd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.415+0000 7fed43645740 4 client.27256 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:13:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.415+0000 7fed43645740 1 -- 172.21.15.152:0/3188655862 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560998ccfd70 con 0x560998de9960 2024-09-11T22:13:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.415+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560998de9960 0x560998debd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.415+0000 7fed21ffb640 10 client.27256 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.415+0000 7fed3dd6a640 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560998de9960 0x560998debd80 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c0729bca46fe12a server_cookie=4ac2fcc3e3b6aff1 in_seq=0 out_seq=0 2024-09-11T22:13:49.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed21ffb640 1 -- 172.21.15.152:0/3188655862 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560998ccfd70 con 0x560998de9960 2024-09-11T22:13:49.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed21ffb640 10 client.27256 handle_command_reply: tid=0 2024-09-11T22:13:49.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 1 client.27256 shutdown 2024-09-11T22:13:49.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 1 -- 172.21.15.152:0/3188655862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d63af0 msgr2=0x560998d76f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.424 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d63af0 0x560998d76f60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fed3400bf90 tx=0x7fed3401d600 comp rx=0 tx=0).stop 2024-09-11T22:13:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 1 -- 172.21.15.152:0/3188655862 shutdown_connections 2024-09-11T22:13:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560998de9960 0x560998debd80 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560998d6ecb0 0x560998d683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560998d64410 0x560998d774a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed21ffb640 0 client.27256 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 1 --2- 172.21.15.152:0/3188655862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560998d63af0 0x560998d76f60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 1 -- 172.21.15.152:0/3188655862 >> 172.21.15.152:0/3188655862 conn(0x560998d60060 msgr2=0x560998d5e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 1 -- 172.21.15.152:0/3188655862 shutdown_connections 2024-09-11T22:13:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 1 -- 172.21.15.152:0/3188655862 wait complete. 2024-09-11T22:13:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.423+0000 7fed43645740 20 client.27256 trim_cache size 0 max 16384 2024-09-11T22:13:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:13:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:13:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:13:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:13:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 -- 172.21.15.152:0/182175966 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fed240a2f50 msgr2=0x7fed240a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fed240a2f50 0x7fed240a5410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed30048000 tx=0x7fed30049000 comp rx=0 tx=0).stop 2024-09-11T22:13:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 -- 172.21.15.152:0/182175966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed381009e0 msgr2=0x7fed381a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed381009e0 0x7fed381a4d00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fed2800b4a0 tx=0x7fed2800b960 comp rx=0 tx=0).stop 2024-09-11T22:13:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 -- 172.21.15.152:0/182175966 shutdown_connections 2024-09-11T22:13:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fed240a2f50 0x7fed240a5410 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed38106be0 0x7fed3819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed381009e0 0x7fed381a4d00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 --2- 172.21.15.152:0/182175966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed380fff60 0x7fed381a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 -- 172.21.15.152:0/182175966 >> 172.21.15.152:0/182175966 conn(0x7fed380770f0 msgr2=0x7fed38102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 -- 172.21.15.152:0/182175966 shutdown_connections 2024-09-11T22:13:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:13:49.424+0000 7fed407cf640 1 -- 172.21.15.152:0/182175966 wait complete. 2024-09-11T22:13:49.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:49 smithi152 ceph-mon[31188]: pgmap v294: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.8 MiB/s wr, 616 op/s 2024-09-11T22:13:49.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:49 smithi179 ceph-mon[35603]: pgmap v294: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.8 MiB/s wr, 616 op/s 2024-09-11T22:13:49.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:49 smithi193 ceph-mon[35545]: pgmap v294: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.8 MiB/s wr, 616 op/s 2024-09-11T22:13:49.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 495.0 s, 2569.0 tps, lat 38.757 ms stddev 40.061 2024-09-11T22:13:51.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:51 smithi179 ceph-mon[35603]: pgmap v295: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 1.08k op/s 2024-09-11T22:13:51.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:51 smithi193 ceph-mon[35545]: pgmap v295: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 1.08k op/s 2024-09-11T22:13:51.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:51 smithi152 ceph-mon[31188]: pgmap v295: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 1.08k op/s 2024-09-11T22:13:53.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:53 smithi179 ceph-mon[35603]: pgmap v296: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 765 op/s 2024-09-11T22:13:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:53 smithi193 ceph-mon[35545]: pgmap v296: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 765 op/s 2024-09-11T22:13:53.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:53 smithi152 ceph-mon[31188]: pgmap v296: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 765 op/s 2024-09-11T22:13:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 500.0 s, 3562.2 tps, lat 28.128 ms stddev 31.693 2024-09-11T22:13:55.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:55 smithi179 ceph-mon[35603]: pgmap v297: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-09-11T22:13:55.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:55 smithi193 ceph-mon[35545]: pgmap v297: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-09-11T22:13:55.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:55 smithi152 ceph-mon[31188]: pgmap v297: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-09-11T22:13:57.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:57 smithi179 ceph-mon[35603]: pgmap v298: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.5 MiB/s wr, 875 op/s 2024-09-11T22:13:57.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:57 smithi193 ceph-mon[35545]: pgmap v298: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.5 MiB/s wr, 875 op/s 2024-09-11T22:13:57.645 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:13:57.683 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:57 smithi152 ceph-mon[31188]: pgmap v298: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.5 MiB/s wr, 875 op/s 2024-09-11T22:13:58.081 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:13:58.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.687+0000 7f9724034640 1 -- 172.21.15.152:0/3823459206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f971c105ec0 msgr2=0x7f971c106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:58.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.687+0000 7f9724034640 1 --2- 172.21.15.152:0/3823459206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f971c105ec0 0x7f971c106340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9714009c10 tx=0x7f971402a710 comp rx=0 tx=0).stop 2024-09-11T22:13:58.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.687+0000 7f9724034640 1 -- 172.21.15.152:0/3823459206 shutdown_connections 2024-09-11T22:13:58.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.687+0000 7f9724034640 1 --2- 172.21.15.152:0/3823459206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f971c105ec0 0x7f971c106340 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.687+0000 7f9724034640 1 --2- 172.21.15.152:0/3823459206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c1011e0 0x7f971c105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.687+0000 7f9724034640 1 --2- 172.21.15.152:0/3823459206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f971c1008c0 0x7f971c100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.687+0000 7f9724034640 1 -- 172.21.15.152:0/3823459206 >> 172.21.15.152:0/3823459206 conn(0x7f971c0fc7d0 msgr2=0x7f971c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:58.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.688+0000 7f9724034640 1 -- 172.21.15.152:0/3823459206 shutdown_connections 2024-09-11T22:13:58.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.688+0000 7f9724034640 1 -- 172.21.15.152:0/3823459206 wait complete. 2024-09-11T22:13:58.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.688+0000 7f9724034640 1 Processor -- start 2024-09-11T22:13:58.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f9724034640 1 -- start start 2024-09-11T22:13:58.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f9724034640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c1008c0 0x7f971c073970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f9724034640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f971c1011e0 0x7f971c073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f9724034640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f971c105ec0 0x7f971c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f9721dd0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c1008c0 0x7f971c073970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f9721dd0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c1008c0 0x7f971c073970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41030/0 (socket says 172.21.15.152:41030) 2024-09-11T22:13:58.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f9721dd0640 1 -- 172.21.15.152:0/2061495544 learned_addr learned my addr 172.21.15.152:0/2061495544 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:58.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f9724034640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f971c1186e0 con 0x7f971c1011e0 2024-09-11T22:13:58.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f9724034640 1 -- 172.21.15.152:0/2061495544 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f971c118560 con 0x7f971c1008c0 2024-09-11T22:13:58.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f9724034640 1 -- 172.21.15.152:0/2061495544 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f971c118860 con 0x7f971c105ec0 2024-09-11T22:13:58.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f97225d1640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f971c105ec0 0x7f971c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.689+0000 7f97215cf640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f971c1011e0 0x7f971c073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.690+0000 7f97215cf640 1 -- 172.21.15.152:0/2061495544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f971c105ec0 msgr2=0x7f971c06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:58.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.690+0000 7f97215cf640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f971c105ec0 0x7f971c06cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.690+0000 7f97215cf640 1 -- 172.21.15.152:0/2061495544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c1008c0 msgr2=0x7f971c073970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:58.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.690+0000 7f97215cf640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c1008c0 0x7f971c073970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.690+0000 7f97215cf640 1 -- 172.21.15.152:0/2061495544 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971c06d470 con 0x7f971c1011e0 2024-09-11T22:13:58.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.691+0000 7f97215cf640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f971c1011e0 0x7f971c073eb0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f970c00b3f0 tx=0x7f970c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:58.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.692+0000 7f9712ffd640 1 -- 172.21.15.152:0/2061495544 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c015020 con 0x7f971c1011e0 2024-09-11T22:13:58.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.692+0000 7f9712ffd640 1 -- 172.21.15.152:0/2061495544 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f970c011d10 con 0x7f971c1011e0 2024-09-11T22:13:58.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.692+0000 7f9712ffd640 1 -- 172.21.15.152:0/2061495544 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c00f2e0 con 0x7f971c1011e0 2024-09-11T22:13:58.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.692+0000 7f9724034640 1 -- 172.21.15.152:0/2061495544 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971c06d760 con 0x7f971c1011e0 2024-09-11T22:13:58.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.693+0000 7f9724034640 1 -- 172.21.15.152:0/2061495544 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f971c071730 con 0x7f971c1011e0 2024-09-11T22:13:58.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.698+0000 7f9712ffd640 1 -- 172.21.15.152:0/2061495544 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f970c018020 con 0x7f971c1011e0 2024-09-11T22:13:58.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.700+0000 7f972640d740 1 Processor -- start 2024-09-11T22:13:58.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.701+0000 7f972640d740 1 -- start start 2024-09-11T22:13:58.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.701+0000 7f972640d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602175f3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.701+0000 7f972640d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.701+0000 7f972640d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x560217600a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.701+0000 7f972640d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5602175592e0 con 0x5602175f34a0 2024-09-11T22:13:58.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.701+0000 7f972640d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560217500ce0 con 0x5602175fe680 2024-09-11T22:13:58.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.701+0000 7f972640d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5602175552a0 con 0x5602175f3dc0 2024-09-11T22:13:58.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.702+0000 7f9721dd0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.702+0000 7f9721dd0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:60008/0 (socket says 172.21.15.152:60008) 2024-09-11T22:13:58.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.702+0000 7f9721dd0640 1 -- 172.21.15.152:0/3702140416 learned_addr learned my addr 172.21.15.152:0/3702140416 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:58.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.702+0000 7f97225d1640 1 --2- 172.21.15.152:0/3702140416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602175f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.702+0000 7f97215cf640 1 --2- 172.21.15.152:0/3702140416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x560217600a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.702+0000 7f9721dd0640 1 -- 172.21.15.152:0/3702140416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 msgr2=0x560217600a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:58.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.703+0000 7f9721dd0640 1 --2- 172.21.15.152:0/3702140416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x560217600a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.703+0000 7f9721dd0640 1 -- 172.21.15.152:0/3702140416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 msgr2=0x5602175f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:58.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.703+0000 7f9721dd0640 1 --2- 172.21.15.152:0/3702140416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602175f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.703+0000 7f9721dd0640 1 -- 172.21.15.152:0/3702140416 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602174e5440 con 0x5602175f3dc0 2024-09-11T22:13:58.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.704+0000 7f9712ffd640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97080a2e80 0x7f97080a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.704+0000 7f97225d1640 1 --2- 172.21.15.152:0/3702140416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602175f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:58.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.704+0000 7f9712ffd640 1 -- 172.21.15.152:0/2061495544 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7f970c0cead0 con 0x7f971c1011e0 2024-09-11T22:13:58.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.705+0000 7f9721dd0640 1 --2- 172.21.15.152:0/3702140416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fe140 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9718009cf0 tx=0x7f97180117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cc0baf36f631138 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:58.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.705+0000 7f97225d1640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97080a2e80 0x7f97080a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.705+0000 7f9707fff640 1 -- 172.21.15.152:0/3702140416 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718012450 con 0x5602175f3dc0 2024-09-11T22:13:58.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.705+0000 7f9707fff640 1 -- 172.21.15.152:0/3702140416 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9718012ad0 con 0x5602175f3dc0 2024-09-11T22:13:58.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.705+0000 7f9707fff640 1 -- 172.21.15.152:0/3702140416 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971800fc60 con 0x5602175f3dc0 2024-09-11T22:13:58.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.706+0000 7f97225d1640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97080a2e80 0x7f97080a5340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f971402ac80 tx=0x7f971402ac10 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:58.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.706+0000 7f972640d740 1 -- 172.21.15.152:0/3702140416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 msgr2=0x5602175fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:58.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.706+0000 7f972640d740 1 --2- 172.21.15.152:0/3702140416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fe140 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9718009cf0 tx=0x7f97180117b0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.706+0000 7f972640d740 1 -- 172.21.15.152:0/3702140416 shutdown_connections 2024-09-11T22:13:58.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.706+0000 7f972640d740 1 --2- 172.21.15.152:0/3702140416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x560217600a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.706+0000 7f972640d740 1 --2- 172.21.15.152:0/3702140416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fe140 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.706+0000 7f972640d740 1 --2- 172.21.15.152:0/3702140416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602175f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.706+0000 7f972640d740 1 -- 172.21.15.152:0/3702140416 >> 172.21.15.152:0/3702140416 conn(0x5602175efa30 msgr2=0x5602175efe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:58.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.706+0000 7f972640d740 1 -- 172.21.15.152:0/3702140416 shutdown_connections 2024-09-11T22:13:58.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.706+0000 7f972640d740 1 -- 172.21.15.152:0/3702140416 wait complete. 2024-09-11T22:13:58.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.707+0000 7f972640d740 1 -- start start 2024-09-11T22:13:58.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.707+0000 7f972640d740 1 Processor -- start 2024-09-11T22:13:58.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.708+0000 7f972640d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602175fdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.708+0000 7f972640d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.708+0000 7f972640d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x5602175fb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.708+0000 7f972640d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560217612260 con 0x5602175f34a0 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.708+0000 7f972640d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560217514050 con 0x5602175fe680 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.708+0000 7f972640d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5602176123e0 con 0x5602175f3dc0 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.708+0000 7f972640d740 10 client.0 _ll_register_callbacks cb 0x560217554160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.708+0000 7f97215cf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.708+0000 7f97215cf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:60014/0 (socket says 172.21.15.152:60014) 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.708+0000 7f97215cf640 1 -- 172.21.15.152:0/567923172 learned_addr learned my addr 172.21.15.152:0/567923172 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.708+0000 7f97225d1640 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x5602175fb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.709+0000 7f97215cf640 1 -- 172.21.15.152:0/567923172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 msgr2=0x5602175fb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.709+0000 7f97215cf640 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x5602175fb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.709+0000 7f97215cf640 1 -- 172.21.15.152:0/567923172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 msgr2=0x5602175fdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:58.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.709+0000 7f97215cf640 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602175fdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.709+0000 7f97215cf640 1 -- 172.21.15.152:0/567923172 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602172ca3c0 con 0x5602175f3dc0 2024-09-11T22:13:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.709+0000 7f97215cf640 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fb210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f970c00b3c0 tx=0x7f970c09af70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7c7cf703eeaffaa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.709+0000 7f97057fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:13:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.709+0000 7f97057fa640 1 -- 172.21.15.152:0/567923172 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c010eb0 con 0x5602175f3dc0 2024-09-11T22:13:58.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.709+0000 7f97057fa640 1 -- 172.21.15.152:0/567923172 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7f970c0cc440 con 0x5602175f3dc0 2024-09-11T22:13:58.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.710+0000 7f972640d740 1 -- 172.21.15.152:0/567923172 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9718012ad0 con 0x5602175f3dc0 2024-09-11T22:13:58.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.710+0000 7f97057fa640 1 -- 172.21.15.152:0/567923172 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f970c09b7a0 con 0x5602175f3dc0 2024-09-11T22:13:58.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.710+0000 7f972640d740 10 client.27268 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:58.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.710+0000 7f972640d740 1 -- 172.21.15.152:0/567923172 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56021761dbd0 con 0x5602175f3dc0 2024-09-11T22:13:58.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.710+0000 7f97057fa640 1 -- 172.21.15.152:0/567923172 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9718012ad0 con 0x5602175f3dc0 2024-09-11T22:13:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.711+0000 7f97057fa640 1 -- 172.21.15.152:0/567923172 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f970c0b9ce0 con 0x5602175f3dc0 2024-09-11T22:13:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.711+0000 7f972640d740 10 client.27268 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.711+0000 7f972640d740 10 client.27268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.711+0000 7f972640d740 20 client.27268 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.711+0000 7f972640d740 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56021761f090 0x5602176214a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.711+0000 7f972640d740 4 client.27268 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.711+0000 7f972640d740 1 -- 172.21.15.152:0/567923172 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560217566850 con 0x56021761f090 2024-09-11T22:13:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.711+0000 7f9721dd0640 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56021761f090 0x5602176214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.712+0000 7f9721dd0640 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56021761f090 0x5602176214a0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19feead075d8ee16 server_cookie=b24d1248faa6f22 in_seq=0 out_seq=0 2024-09-11T22:13:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.712+0000 7f97057fa640 10 client.27268 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:58.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.713+0000 7f97057fa640 1 -- 172.21.15.152:0/567923172 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560217566850 con 0x56021761f090 2024-09-11T22:13:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.713+0000 7f97057fa640 10 client.27268 handle_command_reply: tid=0 2024-09-11T22:13:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.713+0000 7f972640d740 1 client.27268 shutdown 2024-09-11T22:13:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f972640d740 1 -- 172.21.15.152:0/567923172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 msgr2=0x5602175fb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:58.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f972640d740 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fb210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f970c00b3c0 tx=0x7f970c09af70 comp rx=0 tx=0).stop 2024-09-11T22:13:58.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f972640d740 1 -- 172.21.15.152:0/567923172 shutdown_connections 2024-09-11T22:13:58.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f972640d740 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56021761f090 0x5602176214a0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f972640d740 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x5602175fb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f972640d740 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x5602175fb210 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f972640d740 1 --2- 172.21.15.152:0/567923172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602175fdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f97057fa640 0 client.27268 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:58.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f972640d740 1 -- 172.21.15.152:0/567923172 >> 172.21.15.152:0/567923172 conn(0x5602175efa30 msgr2=0x5602175f5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:58.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f972640d740 1 -- 172.21.15.152:0/567923172 shutdown_connections 2024-09-11T22:13:58.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f972640d740 1 -- 172.21.15.152:0/567923172 wait complete. 2024-09-11T22:13:58.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.714+0000 7f972640d740 20 client.27268 trim_cache size 0 max 16384 2024-09-11T22:13:58.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.740+0000 7f972640d740 1 Processor -- start 2024-09-11T22:13:58.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f972640d740 1 -- start start 2024-09-11T22:13:58.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f972640d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f34a0 0x56021761b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f972640d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175f3dc0 0x560217626d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f972640d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175fe680 0x560217627280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f972640d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f971c1b68b0 con 0x5602175fe680 2024-09-11T22:13:58.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f972640d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f971c10fe00 con 0x5602175f3dc0 2024-09-11T22:13:58.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f972640d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f971c10dc70 con 0x5602175f34a0 2024-09-11T22:13:58.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f97225d1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175fe680 0x560217627280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f9721dd0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f34a0 0x56021761b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f97225d1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175fe680 0x560217627280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58368/0 (socket says 172.21.15.152:58368) 2024-09-11T22:13:58.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f9721dd0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f34a0 0x56021761b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:60018/0 (socket says 172.21.15.152:60018) 2024-09-11T22:13:58.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.741+0000 7f97225d1640 1 -- 172.21.15.152:0/1740523706 learned_addr learned my addr 172.21.15.152:0/1740523706 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:58.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.742+0000 7f9721dd0640 1 -- 172.21.15.152:0/1740523706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175f3dc0 msgr2=0x560217626d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:58.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.742+0000 7f9721dd0640 1 --2- 172.21.15.152:0/1740523706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175f3dc0 0x560217626d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.742+0000 7f9721dd0640 1 -- 172.21.15.152:0/1740523706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175fe680 msgr2=0x560217627280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:58.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.742+0000 7f9721dd0640 1 --2- 172.21.15.152:0/1740523706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175fe680 0x560217627280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.742+0000 7f9721dd0640 1 -- 172.21.15.152:0/1740523706 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602175ef4d0 con 0x5602175f34a0 2024-09-11T22:13:58.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.742+0000 7f9721dd0640 1 --2- 172.21.15.152:0/1740523706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f34a0 0x56021761b4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f971800f900 tx=0x7f971800f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5b495010e75f093 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:58.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.742+0000 7f97077fe640 1 -- 172.21.15.152:0/1740523706 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718009720 con 0x5602175f34a0 2024-09-11T22:13:58.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.742+0000 7f97077fe640 1 -- 172.21.15.152:0/1740523706 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9718029070 con 0x5602175f34a0 2024-09-11T22:13:58.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.742+0000 7f97077fe640 1 -- 172.21.15.152:0/1740523706 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718012450 con 0x5602175f34a0 2024-09-11T22:13:58.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.743+0000 7f972640d740 1 -- 172.21.15.152:0/1740523706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f34a0 msgr2=0x56021761b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:58.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.743+0000 7f972640d740 1 --2- 172.21.15.152:0/1740523706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f34a0 0x56021761b4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f971800f900 tx=0x7f971800f6c0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.743+0000 7f972640d740 1 -- 172.21.15.152:0/1740523706 shutdown_connections 2024-09-11T22:13:58.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.743+0000 7f972640d740 1 --2- 172.21.15.152:0/1740523706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175fe680 0x560217627280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.743+0000 7f972640d740 1 --2- 172.21.15.152:0/1740523706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175f3dc0 0x560217626d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.743+0000 7f972640d740 1 --2- 172.21.15.152:0/1740523706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f34a0 0x56021761b4c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.743+0000 7f972640d740 1 -- 172.21.15.152:0/1740523706 >> 172.21.15.152:0/1740523706 conn(0x5602175efa30 msgr2=0x5602175eeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.744+0000 7f972640d740 1 -- 172.21.15.152:0/1740523706 shutdown_connections 2024-09-11T22:13:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.744+0000 7f972640d740 1 -- 172.21.15.152:0/1740523706 wait complete. 2024-09-11T22:13:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.744+0000 7f972640d740 1 -- start start 2024-09-11T22:13:58.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.744+0000 7f972640d740 1 Processor -- start 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f972640d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602176153e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f972640d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x560217615920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f972640d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x560217615e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f972640d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f971c10e2c0 con 0x5602175f34a0 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f972640d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f971c10f730 con 0x5602175fe680 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f97215cf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x560217615920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f9721dd0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602176153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f9721dd0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602176153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58380/0 (socket says 172.21.15.152:58380) 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f9721dd0640 1 -- 172.21.15.152:0/700387745 learned_addr learned my addr 172.21.15.152:0/700387745 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f97215cf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x560217615920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:60030/0 (socket says 172.21.15.152:60030) 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f97225d1640 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x560217615e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f972640d740 1 -- 172.21.15.152:0/700387745 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f971c10e990 con 0x5602175f3dc0 2024-09-11T22:13:58.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.745+0000 7f972640d740 10 client.0 _ll_register_callbacks cb 0x7f970c010810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:58.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.746+0000 7f9721dd0640 1 -- 172.21.15.152:0/700387745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 msgr2=0x560217615920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:58.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.746+0000 7f9721dd0640 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x560217615920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.746+0000 7f9721dd0640 1 -- 172.21.15.152:0/700387745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 msgr2=0x560217615e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:58.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.746+0000 7f9721dd0640 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x560217615e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.746+0000 7f9721dd0640 1 -- 172.21.15.152:0/700387745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560217688d70 con 0x5602175f34a0 2024-09-11T22:13:58.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.746+0000 7f97215cf640 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x560217615920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:58.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.746+0000 7f97225d1640 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x560217615e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:58.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.746+0000 7f9721dd0640 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602176153e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9718009a80 tx=0x7f9718009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d699fac6d3dbcc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:58.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.746+0000 7f97057fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:13:58.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.747+0000 7f97057fa640 1 -- 172.21.15.152:0/700387745 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718036060 con 0x5602175f34a0 2024-09-11T22:13:58.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.747+0000 7f97057fa640 1 -- 172.21.15.152:0/700387745 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7f9718005290 con 0x5602175f34a0 2024-09-11T22:13:58.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.747+0000 7f972640d740 1 -- 172.21.15.152:0/700387745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9718029070 con 0x5602175f34a0 2024-09-11T22:13:58.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.747+0000 7f97057fa640 1 -- 172.21.15.152:0/700387745 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f97180054b0 con 0x5602175f34a0 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.747+0000 7f972640d740 10 client.17754 fetch_fsmap learned FSMap version 30 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.747+0000 7f972640d740 1 -- 172.21.15.152:0/700387745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56021768a020 con 0x5602175f34a0 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.747+0000 7f97057fa640 1 -- 172.21.15.152:0/700387745 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f971800fe10 con 0x5602175f34a0 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.747+0000 7f97057fa640 1 -- 172.21.15.152:0/700387745 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f97180035f0 con 0x5602175f34a0 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.748+0000 7f972640d740 10 client.17754 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.748+0000 7f972640d740 10 client.17754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.748+0000 7f972640d740 20 client.17754 populate_metadata read hostname 'smithi152' 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.748+0000 7f972640d740 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56021768a350 0x56021768c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.748+0000 7f972640d740 4 client.17754 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.748+0000 7f972640d740 1 -- 172.21.15.152:0/700387745 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f9718029070 con 0x56021768a350 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.748+0000 7f97215cf640 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56021768a350 0x56021768c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:58.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.748+0000 7f97057fa640 10 client.17754 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:58.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.748+0000 7f97215cf640 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56021768a350 0x56021768c740 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb3561056e17afe7 server_cookie=5c388af49774ef04 in_seq=0 out_seq=0 2024-09-11T22:13:58.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f97057fa640 1 -- 172.21.15.152:0/700387745 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f9718029070 con 0x56021768a350 2024-09-11T22:13:58.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f97057fa640 10 client.17754 handle_command_reply: tid=0 2024-09-11T22:13:58.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f972640d740 1 client.17754 shutdown 2024-09-11T22:13:58.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f972640d740 1 -- 172.21.15.152:0/700387745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 msgr2=0x5602176153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:58.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f972640d740 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602176153e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9718009a80 tx=0x7f9718009cb0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f972640d740 1 -- 172.21.15.152:0/700387745 shutdown_connections 2024-09-11T22:13:58.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f972640d740 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56021768a350 0x56021768c740 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f972640d740 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5602175fe680 0x560217615e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f972640d740 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5602175f3dc0 0x560217615920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f972640d740 1 --2- 172.21.15.152:0/700387745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602175f34a0 0x5602176153e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f972640d740 1 -- 172.21.15.152:0/700387745 >> 172.21.15.152:0/700387745 conn(0x5602175efa30 msgr2=0x5602175fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:58.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.749+0000 7f97057fa640 0 client.17754 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:13:58.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.750+0000 7f972640d740 1 -- 172.21.15.152:0/700387745 shutdown_connections 2024-09-11T22:13:58.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.750+0000 7f972640d740 1 -- 172.21.15.152:0/700387745 wait complete. 2024-09-11T22:13:58.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.750+0000 7f972640d740 20 client.17754 trim_cache size 0 max 16384 2024-09-11T22:13:58.758 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:13:58.758 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:13:58.758 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:13:58.758 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:13:58.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.751+0000 7f9724034640 1 -- 172.21.15.152:0/2061495544 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97080a2e80 msgr2=0x7f97080a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:58.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.751+0000 7f9724034640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97080a2e80 0x7f97080a5340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f971402ac80 tx=0x7f971402ac10 comp rx=0 tx=0).stop 2024-09-11T22:13:58.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.751+0000 7f9724034640 1 -- 172.21.15.152:0/2061495544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f971c1011e0 msgr2=0x7f971c073eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:58.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.751+0000 7f9724034640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f971c1011e0 0x7f971c073eb0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f970c00b3f0 tx=0x7f970c00b8b0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.751+0000 7f9724034640 1 -- 172.21.15.152:0/2061495544 shutdown_connections 2024-09-11T22:13:58.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.751+0000 7f9724034640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97080a2e80 0x7f97080a5340 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.751+0000 7f9724034640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f971c105ec0 0x7f971c06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.751+0000 7f9724034640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f971c1011e0 0x7f971c073eb0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.751+0000 7f9724034640 1 --2- 172.21.15.152:0/2061495544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c1008c0 0x7f971c073970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:58.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.751+0000 7f9724034640 1 -- 172.21.15.152:0/2061495544 >> 172.21.15.152:0/2061495544 conn(0x7f971c0fc7d0 msgr2=0x7f971c103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:58.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.752+0000 7f9724034640 1 -- 172.21.15.152:0/2061495544 shutdown_connections 2024-09-11T22:13:58.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:13:58.752+0000 7f9724034640 1 -- 172.21.15.152:0/2061495544 wait complete. 2024-09-11T22:13:59.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:13:59 smithi152 ceph-mon[31188]: pgmap v299: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.7 MiB/s wr, 781 op/s 2024-09-11T22:13:59.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:13:59 smithi179 ceph-mon[35603]: pgmap v299: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.7 MiB/s wr, 781 op/s 2024-09-11T22:13:59.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:13:59 smithi193 ceph-mon[35545]: pgmap v299: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.7 MiB/s wr, 781 op/s 2024-09-11T22:13:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 505.0 s, 3889.8 tps, lat 25.789 ms stddev 31.710 2024-09-11T22:13:59.879 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:13:59.880 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:14:00.334 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:01.295 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:01 smithi152 ceph-mon[31188]: pgmap v300: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 1.11k op/s 2024-09-11T22:14:01.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.385+0000 7f2857d81640 1 -- 172.21.15.152:0/1380603132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2850100e20 msgr2=0x7f2850101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:01.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.385+0000 7f2857d81640 1 --2- 172.21.15.152:0/1380603132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2850100e20 0x7f2850101200 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f284c009900 tx=0x7f284c02a480 comp rx=0 tx=0).stop 2024-09-11T22:14:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.385+0000 7f2857d81640 1 -- 172.21.15.152:0/1380603132 shutdown_connections 2024-09-11T22:14:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.385+0000 7f2857d81640 1 --2- 172.21.15.152:0/1380603132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2850102ef0 0x7f285010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.385+0000 7f2857d81640 1 --2- 172.21.15.152:0/1380603132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2850102570 0x7f28501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.385+0000 7f2857d81640 1 --2- 172.21.15.152:0/1380603132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2850100e20 0x7f2850101200 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.385+0000 7f2857d81640 1 -- 172.21.15.152:0/1380603132 >> 172.21.15.152:0/1380603132 conn(0x7f28500fc7d0 msgr2=0x7f28500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.385+0000 7f2857d81640 1 -- 172.21.15.152:0/1380603132 shutdown_connections 2024-09-11T22:14:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.385+0000 7f2857d81640 1 -- 172.21.15.152:0/1380603132 wait complete. 2024-09-11T22:14:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f2857d81640 1 Processor -- start 2024-09-11T22:14:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f2857d81640 1 -- start start 2024-09-11T22:14:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f2857d81640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2850100e20 0x7f2850199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f2857d81640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2850102570 0x7f2850199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f2857d81640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2850102ef0 0x7f28501a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f2857d81640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2850110f80 con 0x7f2850102570 2024-09-11T22:14:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f2857d81640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2850110e00 con 0x7f2850100e20 2024-09-11T22:14:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f2857d81640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2850111100 con 0x7f2850102ef0 2024-09-11T22:14:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f285531c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2850102570 0x7f2850199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f285531c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2850102570 0x7f2850199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58396/0 (socket says 172.21.15.152:58396) 2024-09-11T22:14:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f285531c640 1 -- 172.21.15.152:0/4009612568 learned_addr learned my addr 172.21.15.152:0/4009612568 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f2855b1d640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2850100e20 0x7f2850199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f285631e640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2850102ef0 0x7f28501a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f285531c640 1 -- 172.21.15.152:0/4009612568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2850102ef0 msgr2=0x7f28501a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f285531c640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2850102ef0 0x7f28501a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f285531c640 1 -- 172.21.15.152:0/4009612568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2850100e20 msgr2=0x7f2850199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.386+0000 7f285531c640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2850100e20 0x7f2850199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.387+0000 7f285531c640 1 -- 172.21.15.152:0/4009612568 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28501a4910 con 0x7f2850102570 2024-09-11T22:14:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.387+0000 7f2855b1d640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2850100e20 0x7f2850199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.387+0000 7f285531c640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2850102570 0x7f2850199890 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f284000d950 tx=0x7f284000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.387+0000 7f2846ffd640 1 -- 172.21.15.152:0/4009612568 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840017030 con 0x7f2850102570 2024-09-11T22:14:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.387+0000 7f2846ffd640 1 -- 172.21.15.152:0/4009612568 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2840004020 con 0x7f2850102570 2024-09-11T22:14:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.387+0000 7f2846ffd640 1 -- 172.21.15.152:0/4009612568 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28400047a0 con 0x7f2850102570 2024-09-11T22:14:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.387+0000 7f2857d81640 1 -- 172.21.15.152:0/4009612568 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28501a4ae0 con 0x7f2850102570 2024-09-11T22:14:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.387+0000 7f2857d81640 1 -- 172.21.15.152:0/4009612568 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28501a4fa0 con 0x7f2850102570 2024-09-11T22:14:01.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.388+0000 7f2857d81640 1 -- 172.21.15.152:0/4009612568 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28501021b0 con 0x7f2850102570 2024-09-11T22:14:01.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.389+0000 7f2846ffd640 1 -- 172.21.15.152:0/4009612568 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f28400041d0 con 0x7f2850102570 2024-09-11T22:14:01.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.390+0000 7f2846ffd640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f283c0a2cf0 0x7f283c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:01.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.391+0000 7f2855b1d640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f283c0a2cf0 0x7f283c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:01.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.391+0000 7f2846ffd640 1 -- 172.21.15.152:0/4009612568 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7f28400cedf0 con 0x7f2850102570 2024-09-11T22:14:01.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.391+0000 7f2855b1d640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f283c0a2cf0 0x7f283c0a51b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f284c009230 tx=0x7f284c0058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:01.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.397+0000 7f2846ffd640 1 -- 172.21.15.152:0/4009612568 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f284009b9b0 con 0x7f2850102570 2024-09-11T22:14:01.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:01 smithi179 ceph-mon[35603]: pgmap v300: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 1.11k op/s 2024-09-11T22:14:01.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:01 smithi193 ceph-mon[35545]: pgmap v300: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 1.11k op/s 2024-09-11T22:14:01.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.647+0000 7f2857d81640 1 -- 172.21.15.152:0/4009612568 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f285002d7c0 con 0x7f2850102570 2024-09-11T22:14:01.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.648+0000 7f2846ffd640 1 -- 172.21.15.152:0/4009612568 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f2840095e20 con 0x7f2850102570 2024-09-11T22:14:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:14:01.649 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:14:01.649 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:14:01.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.650+0000 7f2857d81640 1 -- 172.21.15.152:0/4009612568 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f283c0a2cf0 msgr2=0x7f283c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:01.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.650+0000 7f2857d81640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f283c0a2cf0 0x7f283c0a51b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f284c009230 tx=0x7f284c0058d0 comp rx=0 tx=0).stop 2024-09-11T22:14:01.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.650+0000 7f2857d81640 1 -- 172.21.15.152:0/4009612568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2850102570 msgr2=0x7f2850199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:01.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.650+0000 7f2857d81640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2850102570 0x7f2850199890 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f284000d950 tx=0x7f284000de10 comp rx=0 tx=0).stop 2024-09-11T22:14:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.650+0000 7f2857d81640 1 -- 172.21.15.152:0/4009612568 shutdown_connections 2024-09-11T22:14:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.650+0000 7f2857d81640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f283c0a2cf0 0x7f283c0a51b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.650+0000 7f2857d81640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2850102ef0 0x7f28501a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.650+0000 7f2857d81640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2850102570 0x7f2850199890 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.650+0000 7f2857d81640 1 --2- 172.21.15.152:0/4009612568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2850100e20 0x7f2850199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.650+0000 7f2857d81640 1 -- 172.21.15.152:0/4009612568 >> 172.21.15.152:0/4009612568 conn(0x7f28500fc7d0 msgr2=0x7f28500fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.650+0000 7f2857d81640 1 -- 172.21.15.152:0/4009612568 shutdown_connections 2024-09-11T22:14:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:01.651+0000 7f2857d81640 1 -- 172.21.15.152:0/4009612568 wait complete. 2024-09-11T22:14:02.300 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:02 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/4009612568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:02.331 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:14:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.540+0000 7f4027952640 1 -- 172.21.15.152:0/2137952785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40201009a0 msgr2=0x7f402010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.540+0000 7f4027952640 1 --2- 172.21.15.152:0/2137952785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40201009a0 0x7f402010ea90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4018009ca0 tx=0x7f401802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.540+0000 7f4027952640 1 -- 172.21.15.152:0/2137952785 shutdown_connections 2024-09-11T22:14:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.540+0000 7f4027952640 1 --2- 172.21.15.152:0/2137952785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40201009a0 0x7f402010ea90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.540+0000 7f4027952640 1 --2- 172.21.15.152:0/2137952785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4020100000 0x7f4020100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.540+0000 7f4027952640 1 --2- 172.21.15.152:0/2137952785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4020103ab0 0x7f4020103e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.540+0000 7f4027952640 1 -- 172.21.15.152:0/2137952785 >> 172.21.15.152:0/2137952785 conn(0x7f40200770f0 msgr2=0x7f40200fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.540+0000 7f4027952640 1 -- 172.21.15.152:0/2137952785 shutdown_connections 2024-09-11T22:14:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.540+0000 7f4027952640 1 -- 172.21.15.152:0/2137952785 wait complete. 2024-09-11T22:14:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f4027952640 1 Processor -- start 2024-09-11T22:14:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f4027952640 1 -- start start 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f4027952640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4020100000 0x7f4020198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f4027952640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40201009a0 0x7f4020198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f4027952640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4020103ab0 0x7f402019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f4027952640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f40201120a0 con 0x7f4020100000 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f4027952640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4020111f20 con 0x7f40201009a0 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f4027952640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4020112220 con 0x7f4020103ab0 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f40256ee640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4020100000 0x7f4020198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f4024eed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40201009a0 0x7f4020198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f40256ee640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4020100000 0x7f4020198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58414/0 (socket says 172.21.15.152:58414) 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f40256ee640 1 -- 172.21.15.152:0/2690223028 learned_addr learned my addr 172.21.15.152:0/2690223028 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.541+0000 7f4025eef640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4020103ab0 0x7f402019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.542+0000 7f4024eed640 1 -- 172.21.15.152:0/2690223028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4020103ab0 msgr2=0x7f402019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.542+0000 7f4024eed640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4020103ab0 0x7f402019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.542+0000 7f4024eed640 1 -- 172.21.15.152:0/2690223028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4020100000 msgr2=0x7f4020198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.542+0000 7f4024eed640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4020100000 0x7f4020198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.542+0000 7f4024eed640 1 -- 172.21.15.152:0/2690223028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402019d420 con 0x7f40201009a0 2024-09-11T22:14:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.542+0000 7f4024eed640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40201009a0 0x7f4020198970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f401000e9f0 tx=0x7f401000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.542+0000 7f40167fc640 1 -- 172.21.15.152:0/2690223028 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401000ccc0 con 0x7f40201009a0 2024-09-11T22:14:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.542+0000 7f4027952640 1 -- 172.21.15.152:0/2690223028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402019d710 con 0x7f40201009a0 2024-09-11T22:14:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.542+0000 7f40167fc640 1 -- 172.21.15.152:0/2690223028 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4010010910 con 0x7f40201009a0 2024-09-11T22:14:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.542+0000 7f4027952640 1 -- 172.21.15.152:0/2690223028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40201a4fa0 con 0x7f40201009a0 2024-09-11T22:14:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.543+0000 7f40167fc640 1 -- 172.21.15.152:0/2690223028 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010018900 con 0x7f40201009a0 2024-09-11T22:14:02.551 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:02 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/4009612568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f40167fc640 1 -- 172.21.15.152:0/2690223028 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f4010010ac0 con 0x7f40201009a0 2024-09-11T22:14:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f402a7c9740 1 Processor -- start 2024-09-11T22:14:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f402a7c9740 1 -- start start 2024-09-11T22:14:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 0x55ab63f21990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 0x55ab63f22310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f35350 0x55ab63f37740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f402a7c9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ab63e862f0 con 0x55ab63f21ed0 2024-09-11T22:14:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f402a7c9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ab63e2e270 con 0x55ab63f23080 2024-09-11T22:14:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f402a7c9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ab63e822b0 con 0x55ab63f35350 2024-09-11T22:14:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f4025eef640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 0x55ab63f21990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f4024eed640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f35350 0x55ab63f37740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f4025eef640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 0x55ab63f21990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41114/0 (socket says 172.21.15.152:41114) 2024-09-11T22:14:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f4025eef640 1 -- 172.21.15.152:0/2764879017 learned_addr learned my addr 172.21.15.152:0/2764879017 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.545+0000 7f40256ee640 1 --2- 172.21.15.152:0/2764879017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 0x55ab63f22310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f40167fc640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f400c0a2da0 0x7f400c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f4025eef640 1 -- 172.21.15.152:0/2764879017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f35350 msgr2=0x55ab63f37740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f4025eef640 1 --2- 172.21.15.152:0/2764879017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f35350 0x55ab63f37740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f4025eef640 1 -- 172.21.15.152:0/2764879017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 msgr2=0x55ab63f22310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f4025eef640 1 --2- 172.21.15.152:0/2764879017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 0x55ab63f22310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f4025eef640 1 -- 172.21.15.152:0/2764879017 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab63e2d340 con 0x55ab63f23080 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f40167fc640 1 -- 172.21.15.152:0/2690223028 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7f40100cf7a0 con 0x7f40201009a0 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f4025eef640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f400c0a2da0 0x7f400c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f4025eef640 1 --2- 172.21.15.152:0/2764879017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 0x55ab63f21990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4018009ca0 tx=0x7f4018009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=569f83b1aa8186e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f400b7fe640 1 -- 172.21.15.152:0/2764879017 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018042040 con 0x55ab63f23080 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f4025eef640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f400c0a2da0 0x7f400c0a5260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f401804d000 tx=0x7f401804e000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f400b7fe640 1 -- 172.21.15.152:0/2764879017 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4018036040 con 0x55ab63f23080 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.546+0000 7f400b7fe640 1 -- 172.21.15.152:0/2764879017 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401802f950 con 0x55ab63f23080 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.547+0000 7f402a7c9740 1 -- 172.21.15.152:0/2764879017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 msgr2=0x55ab63f21990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.547+0000 7f402a7c9740 1 --2- 172.21.15.152:0/2764879017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 0x55ab63f21990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4018009ca0 tx=0x7f4018009800 comp rx=0 tx=0).stop 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.547+0000 7f402a7c9740 1 -- 172.21.15.152:0/2764879017 shutdown_connections 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.547+0000 7f402a7c9740 1 --2- 172.21.15.152:0/2764879017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f35350 0x55ab63f37740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.547+0000 7f402a7c9740 1 --2- 172.21.15.152:0/2764879017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 0x55ab63f22310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.547+0000 7f402a7c9740 1 --2- 172.21.15.152:0/2764879017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 0x55ab63f21990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.547+0000 7f402a7c9740 1 -- 172.21.15.152:0/2764879017 >> 172.21.15.152:0/2764879017 conn(0x55ab63f1e060 msgr2=0x55ab63f1e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.547+0000 7f402a7c9740 1 -- 172.21.15.152:0/2764879017 shutdown_connections 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.547+0000 7f402a7c9740 1 -- 172.21.15.152:0/2764879017 wait complete. 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.547+0000 7f402a7c9740 1 -- start start 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f402a7c9740 1 Processor -- start 2024-09-11T22:14:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 0x55ab63f25760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f23080 0x55ab63f25ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f35350 0x55ab63f261e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f402a7c9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ab63f380b0 con 0x55ab63f35350 2024-09-11T22:14:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f402a7c9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ab63e0f290 con 0x55ab63f21ed0 2024-09-11T22:14:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f402a7c9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ab63f38230 con 0x55ab63f23080 2024-09-11T22:14:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f40256ee640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 0x55ab63f25760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f4025eef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f35350 0x55ab63f261e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f4024eed640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f23080 0x55ab63f25ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f40256ee640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 0x55ab63f25760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41128/0 (socket says 172.21.15.152:41128) 2024-09-11T22:14:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f40256ee640 1 -- 172.21.15.152:0/389412872 learned_addr learned my addr 172.21.15.152:0/389412872 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.548+0000 7f402a7c9740 10 client.0 _ll_register_callbacks cb 0x55ab63e40140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f40256ee640 1 -- 172.21.15.152:0/389412872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f23080 msgr2=0x55ab63f25ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f40256ee640 1 --2- 172.21.15.152:0/389412872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f23080 0x55ab63f25ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f40256ee640 1 -- 172.21.15.152:0/389412872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f35350 msgr2=0x55ab63f261e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f40256ee640 1 --2- 172.21.15.152:0/389412872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f35350 0x55ab63f261e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f40256ee640 1 -- 172.21.15.152:0/389412872 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab63b99210 con 0x55ab63f21ed0 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f40256ee640 1 --2- 172.21.15.152:0/389412872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 0x55ab63f25760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f401c0127d0 tx=0x7f401c012c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4be16e0d4a7bcb30 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f4008ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f4008ff9640 1 -- 172.21.15.152:0/389412872 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c00f920 con 0x55ab63f21ed0 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f4008ff9640 1 -- 172.21.15.152:0/389412872 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7f401c00fac0 con 0x55ab63f21ed0 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f402a7c9740 1 -- 172.21.15.152:0/389412872 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4018036040 con 0x55ab63f21ed0 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f4008ff9640 1 -- 172.21.15.152:0/389412872 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f401c00fcc0 con 0x55ab63f21ed0 2024-09-11T22:14:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f402a7c9740 10 client.27119 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f402a7c9740 1 -- 172.21.15.152:0/389412872 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ab63c65620 con 0x55ab63f21ed0 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.549+0000 7f4008ff9640 1 -- 172.21.15.152:0/389412872 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4018036040 con 0x55ab63f21ed0 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.550+0000 7f4008ff9640 1 -- 172.21.15.152:0/389412872 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f401c01c420 con 0x55ab63f21ed0 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.550+0000 7f402a7c9740 10 client.27119 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.550+0000 7f402a7c9740 10 client.27119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.550+0000 7f402a7c9740 20 client.27119 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.550+0000 7f402a7c9740 1 --2- 172.21.15.152:0/389412872 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ab63f455b0 0x55ab63f47a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.550+0000 7f402a7c9740 4 client.27119 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.550+0000 7f402a7c9740 1 -- 172.21.15.152:0/389412872 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab63e93a20 con 0x55ab63f455b0 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.550+0000 7f4024eed640 1 --2- 172.21.15.152:0/389412872 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ab63f455b0 0x55ab63f47a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.550+0000 7f4008ff9640 10 client.27119 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.550+0000 7f4024eed640 1 --2- 172.21.15.152:0/389412872 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ab63f455b0 0x55ab63f47a00 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1a197660931b8e1 server_cookie=258b7cf6bb44ec90 in_seq=0 out_seq=0 2024-09-11T22:14:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f4008ff9640 1 -- 172.21.15.152:0/389412872 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab63e93a20 con 0x55ab63f455b0 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f4008ff9640 10 client.27119 handle_command_reply: tid=0 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 1 client.27119 shutdown 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 1 -- 172.21.15.152:0/389412872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 msgr2=0x55ab63f25760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 1 --2- 172.21.15.152:0/389412872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 0x55ab63f25760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f401c0127d0 tx=0x7f401c012c90 comp rx=0 tx=0).stop 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 1 -- 172.21.15.152:0/389412872 shutdown_connections 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 1 --2- 172.21.15.152:0/389412872 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ab63f455b0 0x55ab63f47a00 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 1 --2- 172.21.15.152:0/389412872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f35350 0x55ab63f261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f4008ff9640 0 client.27119 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 1 --2- 172.21.15.152:0/389412872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f23080 0x55ab63f25ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 1 --2- 172.21.15.152:0/389412872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 0x55ab63f25760 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 1 -- 172.21.15.152:0/389412872 >> 172.21.15.152:0/389412872 conn(0x55ab63f1e060 msgr2=0x55ab63f23dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 1 -- 172.21.15.152:0/389412872 shutdown_connections 2024-09-11T22:14:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 1 -- 172.21.15.152:0/389412872 wait complete. 2024-09-11T22:14:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.551+0000 7f402a7c9740 20 client.27119 trim_cache size 0 max 16384 2024-09-11T22:14:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f402a7c9740 1 Processor -- start 2024-09-11T22:14:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f402a7c9740 1 -- start start 2024-09-11T22:14:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 0x55ab63f26fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 0x55ab63f27500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 0x55ab63f27a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f402a7c9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f40201adf00 con 0x55ab63f21ed0 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f402a7c9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f40201ab7d0 con 0x55ab63f23080 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f402a7c9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f40201a9660 con 0x55ab63f1e060 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f4024eed640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 0x55ab63f27500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f4024eed640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 0x55ab63f27500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58450/0 (socket says 172.21.15.152:58450) 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f40256ee640 1 --2- 172.21.15.152:0/641685308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 0x55ab63f26fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f4024eed640 1 -- 172.21.15.152:0/641685308 learned_addr learned my addr 172.21.15.152:0/641685308 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.570+0000 7f4025eef640 1 --2- 172.21.15.152:0/641685308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 0x55ab63f27a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.571+0000 7f4024eed640 1 -- 172.21.15.152:0/641685308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 msgr2=0x55ab63f26fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.571+0000 7f4024eed640 1 --2- 172.21.15.152:0/641685308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 0x55ab63f26fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.571+0000 7f4024eed640 1 -- 172.21.15.152:0/641685308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 msgr2=0x55ab63f27a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.571+0000 7f4024eed640 1 --2- 172.21.15.152:0/641685308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 0x55ab63f27a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.571+0000 7f4024eed640 1 -- 172.21.15.152:0/641685308 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab63f44150 con 0x55ab63f21ed0 2024-09-11T22:14:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.571+0000 7f40256ee640 1 --2- 172.21.15.152:0/641685308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 0x55ab63f26fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.571+0000 7f4024eed640 1 --2- 172.21.15.152:0/641685308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 0x55ab63f27500 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f401009ba10 tx=0x7f40100d1cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e30874aef5bacd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.571+0000 7f400affd640 1 -- 172.21.15.152:0/641685308 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40100a0010 con 0x55ab63f21ed0 2024-09-11T22:14:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.571+0000 7f400affd640 1 -- 172.21.15.152:0/641685308 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40100b1070 con 0x55ab63f21ed0 2024-09-11T22:14:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.571+0000 7f400affd640 1 -- 172.21.15.152:0/641685308 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40100cd270 con 0x55ab63f21ed0 2024-09-11T22:14:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.572+0000 7f402a7c9740 1 -- 172.21.15.152:0/641685308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 msgr2=0x55ab63f27500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.572+0000 7f402a7c9740 1 --2- 172.21.15.152:0/641685308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 0x55ab63f27500 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f401009ba10 tx=0x7f40100d1cb0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.572+0000 7f402a7c9740 1 -- 172.21.15.152:0/641685308 shutdown_connections 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.572+0000 7f402a7c9740 1 --2- 172.21.15.152:0/641685308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f23080 0x55ab63f27a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.572+0000 7f402a7c9740 1 --2- 172.21.15.152:0/641685308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f21ed0 0x55ab63f27500 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.572+0000 7f402a7c9740 1 --2- 172.21.15.152:0/641685308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 0x55ab63f26fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.572+0000 7f402a7c9740 1 -- 172.21.15.152:0/641685308 >> 172.21.15.152:0/641685308 conn(0x55ab63f36fd0 msgr2=0x55ab63f1e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.572+0000 7f402a7c9740 1 -- 172.21.15.152:0/641685308 shutdown_connections 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.572+0000 7f402a7c9740 1 -- 172.21.15.152:0/641685308 wait complete. 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f402a7c9740 1 -- start start 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f402a7c9740 1 Processor -- start 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 0x55ab63f3d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 0x55ab63f3da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f402a7c9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f23080 0x55ab63f384e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f402a7c9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f40201a9cb0 con 0x55ab63f23080 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f402a7c9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f40201ab100 con 0x55ab63f21ed0 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f402a7c9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f40201aa360 con 0x55ab63f1e060 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f402a7c9740 10 client.0 _ll_register_callbacks cb 0x7f401c0098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f4025eef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f23080 0x55ab63f384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f4025eef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f23080 0x55ab63f384e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58458/0 (socket says 172.21.15.152:58458) 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f40256ee640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 0x55ab63f3d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f4025eef640 1 -- 172.21.15.152:0/2884297993 learned_addr learned my addr 172.21.15.152:0/2884297993 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f4024eed640 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 0x55ab63f3da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f4025eef640 1 -- 172.21.15.152:0/2884297993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 msgr2=0x55ab63f3d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f4025eef640 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 0x55ab63f3d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f4025eef640 1 -- 172.21.15.152:0/2884297993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 msgr2=0x55ab63f3da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f4025eef640 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 0x55ab63f3da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f4025eef640 1 -- 172.21.15.152:0/2884297993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab63f38a20 con 0x55ab63f23080 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.573+0000 7f40256ee640 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 0x55ab63f3d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f4024eed640 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 0x55ab63f3da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f4025eef640 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f23080 0x55ab63f384e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f40180049d0 tx=0x7f4018004960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f92bd9997b1d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f4008ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f4008ff9640 1 -- 172.21.15.152:0/2884297993 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018042040 con 0x55ab63f23080 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f4008ff9640 1 -- 172.21.15.152:0/2884297993 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7f401802f680 con 0x55ab63f23080 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f402a7c9740 1 -- 172.21.15.152:0/2884297993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40100b1070 con 0x55ab63f23080 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f4008ff9640 1 -- 172.21.15.152:0/2884297993 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4018009540 con 0x55ab63f23080 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f402a7c9740 10 client.17778 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f402a7c9740 1 -- 172.21.15.152:0/2884297993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ab63fb0b00 con 0x55ab63f23080 2024-09-11T22:14:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f4008ff9640 1 -- 172.21.15.152:0/2884297993 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40100b1070 con 0x55ab63f23080 2024-09-11T22:14:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f4008ff9640 1 -- 172.21.15.152:0/2884297993 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f4018030630 con 0x55ab63f23080 2024-09-11T22:14:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f402a7c9740 10 client.17778 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f402a7c9740 10 client.17778 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.574+0000 7f402a7c9740 20 client.17778 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.575+0000 7f402a7c9740 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ab63f35350 0x55ab63fb2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.575+0000 7f402a7c9740 4 client.17778 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:14:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.575+0000 7f402a7c9740 1 -- 172.21.15.152:0/2884297993 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ab63e8dd70 con 0x55ab63f35350 2024-09-11T22:14:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.575+0000 7f40256ee640 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ab63f35350 0x55ab63fb2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.575+0000 7f4008ff9640 10 client.17778 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:02.575+0000 7f40256ee640 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ab63f35350 0x55ab63fb2e00 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9895f239d64e1ad3 server_cookie=cc7e359eb1eefd90 in_seq=0 out_seq=0 2024-09-11T22:14:02.582 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:02 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/4009612568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:02.629 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.125+0000 7fb36ba98640 1 -- 172.21.15.152:0/4281127799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb364101de0 msgr2=0x7fb3641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.125+0000 7fb36ba98640 1 --2- 172.21.15.152:0/4281127799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb364101de0 0x7fb3641021c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb360009900 tx=0x7fb36002a410 comp rx=0 tx=0).stop 2024-09-11T22:14:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.125+0000 7fb36ba98640 1 -- 172.21.15.152:0/4281127799 shutdown_connections 2024-09-11T22:14:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.125+0000 7fb36ba98640 1 --2- 172.21.15.152:0/4281127799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb364106f10 0x7fb36410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.125+0000 7fb36ba98640 1 --2- 172.21.15.152:0/4281127799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb364102790 0x7fb3641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.125+0000 7fb36ba98640 1 --2- 172.21.15.152:0/4281127799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb364101de0 0x7fb3641021c0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.125+0000 7fb36ba98640 1 -- 172.21.15.152:0/4281127799 >> 172.21.15.152:0/4281127799 conn(0x7fb3640fd8c0 msgr2=0x7fb3640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.125+0000 7fb36ba98640 1 -- 172.21.15.152:0/4281127799 shutdown_connections 2024-09-11T22:14:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.125+0000 7fb36ba98640 1 -- 172.21.15.152:0/4281127799 wait complete. 2024-09-11T22:14:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb36ba98640 1 Processor -- start 2024-09-11T22:14:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb36ba98640 1 -- start start 2024-09-11T22:14:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb36ba98640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb364101de0 0x7fb364198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb36ba98640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb364102790 0x7fb364198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb36ba98640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb364106f10 0x7fb36419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb36ba98640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb364111f70 con 0x7fb364102790 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb36ba98640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb364111df0 con 0x7fb364106f10 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb36ba98640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641120f0 con 0x7fb364101de0 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb369033640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb364102790 0x7fb364198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb369033640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb364102790 0x7fb364198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58482/0 (socket says 172.21.15.152:58482) 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb369834640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb364101de0 0x7fb364198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb369033640 1 -- 172.21.15.152:0/189974188 learned_addr learned my addr 172.21.15.152:0/189974188 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.126+0000 7fb36a035640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb364106f10 0x7fb36419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.127+0000 7fb369033640 1 -- 172.21.15.152:0/189974188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb364101de0 msgr2=0x7fb364198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.127+0000 7fb369033640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb364101de0 0x7fb364198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.127+0000 7fb369033640 1 -- 172.21.15.152:0/189974188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb364106f10 msgr2=0x7fb36419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.127+0000 7fb369033640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb364106f10 0x7fb36419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.127+0000 7fb369033640 1 -- 172.21.15.152:0/189974188 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36419d400 con 0x7fb364102790 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.127+0000 7fb369033640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb364102790 0x7fb364198990 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb35400e9f0 tx=0x7fb35400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.127+0000 7fb35affd640 1 -- 172.21.15.152:0/189974188 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35400cd80 con 0x7fb364102790 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.127+0000 7fb36ba98640 1 -- 172.21.15.152:0/189974188 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb36419d6f0 con 0x7fb364102790 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.127+0000 7fb35affd640 1 -- 172.21.15.152:0/189974188 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb354005500 con 0x7fb364102790 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.127+0000 7fb35affd640 1 -- 172.21.15.152:0/189974188 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354010690 con 0x7fb364102790 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.127+0000 7fb36ba98640 1 -- 172.21.15.152:0/189974188 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3641a4fd0 con 0x7fb364102790 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.130+0000 7fb35affd640 1 -- 172.21.15.152:0/189974188 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb3540046c0 con 0x7fb364102790 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.130+0000 7fb36de71740 1 Processor -- start 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.130+0000 7fb36de71740 1 -- start start 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.130+0000 7fb36de71740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 0x558522186090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.130+0000 7fb36de71740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x558522186a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.130+0000 7fb36de71740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522191370 0x558522193760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.130+0000 7fb36de71740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5585220ec2f0 con 0x558522191370 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.130+0000 7fb36de71740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558522093cf0 con 0x5585221865d0 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.130+0000 7fb36de71740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5585220e82b0 con 0x558522187b40 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb36a035640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 0x558522186090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb369834640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x558522186a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb36a035640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 0x558522186090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:60150/0 (socket says 172.21.15.152:60150) 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb36a035640 1 -- 172.21.15.152:0/2887746243 learned_addr learned my addr 172.21.15.152:0/2887746243 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb369033640 1 --2- 172.21.15.152:0/2887746243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522191370 0x558522193760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb369834640 1 -- 172.21.15.152:0/2887746243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 msgr2=0x558522186090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb369834640 1 --2- 172.21.15.152:0/2887746243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 0x558522186090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb369834640 1 -- 172.21.15.152:0/2887746243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522191370 msgr2=0x558522193760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb369834640 1 --2- 172.21.15.152:0/2887746243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522191370 0x558522193760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb369834640 1 -- 172.21.15.152:0/2887746243 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585220783a0 con 0x5585221865d0 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb36a035640 1 --2- 172.21.15.152:0/2887746243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 0x558522186090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb35affd640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb3500a2cf0 0x7fb3500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb36a035640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb3500a2cf0 0x7fb3500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb369834640 1 --2- 172.21.15.152:0/2887746243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x558522186a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb360005940 tx=0x7fb360005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab048ba6c2c94e3d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb35affd640 1 -- 172.21.15.152:0/189974188 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fb3540cf8f0 con 0x7fb364102790 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb34ffff640 1 -- 172.21.15.152:0/2887746243 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360040070 con 0x5585221865d0 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb34ffff640 1 -- 172.21.15.152:0/2887746243 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb360031870 con 0x5585221865d0 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.131+0000 7fb34ffff640 1 -- 172.21.15.152:0/2887746243 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360035040 con 0x5585221865d0 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.132+0000 7fb36de71740 1 -- 172.21.15.152:0/2887746243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 msgr2=0x558522186a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.132+0000 7fb36a035640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb3500a2cf0 0x7fb3500a51b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009fd0 tx=0x7fb35c015040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.132+0000 7fb36de71740 1 --2- 172.21.15.152:0/2887746243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x558522186a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb360005940 tx=0x7fb360005be0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.132+0000 7fb36de71740 1 -- 172.21.15.152:0/2887746243 shutdown_connections 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.132+0000 7fb36de71740 1 --2- 172.21.15.152:0/2887746243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522191370 0x558522193760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.132+0000 7fb36de71740 1 --2- 172.21.15.152:0/2887746243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x558522186a10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.132+0000 7fb36de71740 1 --2- 172.21.15.152:0/2887746243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 0x558522186090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.132+0000 7fb36de71740 1 -- 172.21.15.152:0/2887746243 >> 172.21.15.152:0/2887746243 conn(0x55852214f310 msgr2=0x558522182c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.132+0000 7fb36de71740 1 -- 172.21.15.152:0/2887746243 shutdown_connections 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.132+0000 7fb36de71740 1 -- 172.21.15.152:0/2887746243 wait complete. 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb36de71740 1 -- start start 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb36de71740 1 Processor -- start 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb36de71740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5585221865d0 0x558522190d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb36de71740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x55852218e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb36de71740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558522191370 0x55852218e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb36de71740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558522194010 con 0x558522187b40 2024-09-11T22:14:03.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb36de71740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5585220a7060 con 0x558522191370 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb36de71740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558522194190 con 0x5585221865d0 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb36de71740 10 client.0 _ll_register_callbacks cb 0x558521dfa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb369033640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x55852218e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb369834640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5585221865d0 0x558522190d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb369834640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5585221865d0 0x558522190d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:60154/0 (socket says 172.21.15.152:60154) 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb36a035640 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558522191370 0x55852218e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb369834640 1 -- 172.21.15.152:0/54614565 learned_addr learned my addr 172.21.15.152:0/54614565 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.133+0000 7fb369033640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x55852218e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58506/0 (socket says 172.21.15.152:58506) 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb369033640 1 -- 172.21.15.152:0/54614565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5585221865d0 msgr2=0x558522190d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb369033640 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5585221865d0 0x558522190d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb369033640 1 -- 172.21.15.152:0/54614565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558522191370 msgr2=0x55852218e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb369033640 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558522191370 0x55852218e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb369033640 1 -- 172.21.15.152:0/54614565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558521e5d3c0 con 0x558522187b40 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb369834640 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5585221865d0 0x558522190d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb36a035640 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558522191370 0x55852218e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb369033640 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x55852218e040 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb3540ccf80 tx=0x7fb3540980b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f329980492e787b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb34d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb34d7fa640 1 -- 172.21.15.152:0/54614565 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3540d1e60 con 0x558522187b40 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb34d7fa640 1 -- 172.21.15.152:0/54614565 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fb3540a4730 con 0x558522187b40 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb36de71740 1 -- 172.21.15.152:0/54614565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb360031870 con 0x558522187b40 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb34d7fa640 1 -- 172.21.15.152:0/54614565 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb3540cd410 con 0x558522187b40 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb36de71740 10 client.17790 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb36de71740 1 -- 172.21.15.152:0/54614565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55852219fae0 con 0x558522187b40 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.134+0000 7fb34d7fa640 1 -- 172.21.15.152:0/54614565 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb360031870 con 0x558522187b40 2024-09-11T22:14:03.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.135+0000 7fb34d7fa640 1 -- 172.21.15.152:0/54614565 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb3540cfce0 con 0x558522187b40 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.135+0000 7fb36de71740 10 client.17790 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.135+0000 7fb36de71740 10 client.17790 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.135+0000 7fb36de71740 20 client.17790 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.135+0000 7fb36de71740 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5585221a0ff0 0x5585221a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.135+0000 7fb36de71740 4 client.17790 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.135+0000 7fb36de71740 1 -- 172.21.15.152:0/54614565 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585220f9860 con 0x5585221a0ff0 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.135+0000 7fb369834640 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5585221a0ff0 0x5585221a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.135+0000 7fb369834640 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5585221a0ff0 0x5585221a33e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=420922fbc38c1988 server_cookie=db3d38b0b3b8678a in_seq=0 out_seq=0 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.135+0000 7fb34d7fa640 10 client.17790 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb34d7fa640 1 -- 172.21.15.152:0/54614565 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585220f9860 con 0x5585221a0ff0 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb34d7fa640 10 client.17790 handle_command_reply: tid=0 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 1 client.17790 shutdown 2024-09-11T22:14:03.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 1 -- 172.21.15.152:0/54614565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 msgr2=0x55852218e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x55852218e040 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb3540ccf80 tx=0x7fb3540980b0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 1 -- 172.21.15.152:0/54614565 shutdown_connections 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5585221a0ff0 0x5585221a33e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558522191370 0x55852218e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x55852218e040 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 1 --2- 172.21.15.152:0/54614565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5585221865d0 0x558522190d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb34d7fa640 0 client.17790 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 1 -- 172.21.15.152:0/54614565 >> 172.21.15.152:0/54614565 conn(0x55852214f310 msgr2=0x558522188960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 1 -- 172.21.15.152:0/54614565 shutdown_connections 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 1 -- 172.21.15.152:0/54614565 wait complete. 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.136+0000 7fb36de71740 20 client.17790 trim_cache size 0 max 16384 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.150+0000 7fb36de71740 1 Processor -- start 2024-09-11T22:14:03.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.150+0000 7fb36de71740 1 -- start start 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.150+0000 7fb36de71740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x558522182e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.150+0000 7fb36de71740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x558522187300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.150+0000 7fb36de71740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522191370 0x55852219d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.150+0000 7fb36de71740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641ae120 con 0x558522187b40 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.150+0000 7fb36de71740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641ab9f0 con 0x5585221865d0 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.150+0000 7fb36de71740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641a9860 con 0x558522191370 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb369033640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x558522187300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb369033640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x558522187300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58510/0 (socket says 172.21.15.152:58510) 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb369033640 1 -- 172.21.15.152:0/869499110 learned_addr learned my addr 172.21.15.152:0/869499110 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb369834640 1 --2- 172.21.15.152:0/869499110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x558522182e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb36a035640 1 --2- 172.21.15.152:0/869499110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522191370 0x55852219d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb369033640 1 -- 172.21.15.152:0/869499110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522191370 msgr2=0x55852219d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb369033640 1 --2- 172.21.15.152:0/869499110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522191370 0x55852219d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb369033640 1 -- 172.21.15.152:0/869499110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 msgr2=0x558522182e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb369033640 1 --2- 172.21.15.152:0/869499110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x558522182e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb369033640 1 -- 172.21.15.152:0/869499110 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558522191100 con 0x558522187b40 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb369033640 1 --2- 172.21.15.152:0/869499110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x558522187300 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb354005820 tx=0x7fb354098120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a75e40d19ef847 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.151+0000 7fb34f7fe640 1 -- 172.21.15.152:0/869499110 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35409bd50 con 0x558522187b40 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.152+0000 7fb34f7fe640 1 -- 172.21.15.152:0/869499110 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3540a9070 con 0x558522187b40 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.152+0000 7fb34f7fe640 1 -- 172.21.15.152:0/869499110 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35409ac90 con 0x558522187b40 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.152+0000 7fb36de71740 1 -- 172.21.15.152:0/869499110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 msgr2=0x558522187300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.152+0000 7fb36de71740 1 --2- 172.21.15.152:0/869499110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x558522187300 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb354005820 tx=0x7fb354098120 comp rx=0 tx=0).stop 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.153+0000 7fb36de71740 1 -- 172.21.15.152:0/869499110 shutdown_connections 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.153+0000 7fb36de71740 1 --2- 172.21.15.152:0/869499110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522191370 0x55852219d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.153+0000 7fb36de71740 1 --2- 172.21.15.152:0/869499110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522187b40 0x558522187300 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.153+0000 7fb36de71740 1 --2- 172.21.15.152:0/869499110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x558522182e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.153+0000 7fb36de71740 1 -- 172.21.15.152:0/869499110 >> 172.21.15.152:0/869499110 conn(0x55852214f310 msgr2=0x558522182700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.153+0000 7fb36de71740 1 -- 172.21.15.152:0/869499110 shutdown_connections 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.153+0000 7fb36de71740 1 -- 172.21.15.152:0/869499110 wait complete. 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.153+0000 7fb36de71740 1 -- start start 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.153+0000 7fb36de71740 1 Processor -- start 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb36de71740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x5585221947c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb36de71740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 0x558522194d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb36de71740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522191370 0x558522209c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb36de71740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641a9eb0 con 0x558522191370 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb36de71740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641ab320 con 0x5585221865d0 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb36de71740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641aa580 con 0x558522187b40 2024-09-11T22:14:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb36de71740 10 client.0 _ll_register_callbacks cb 0x7fb3540d5220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:03.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb369834640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x5585221947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb36a035640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522191370 0x558522209c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb369834640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x5585221947c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41216/0 (socket says 172.21.15.152:41216) 2024-09-11T22:14:03.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb369834640 1 -- 172.21.15.152:0/1392930896 learned_addr learned my addr 172.21.15.152:0/1392930896 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:03.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.154+0000 7fb369033640 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 0x558522194d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.155+0000 7fb369834640 1 -- 172.21.15.152:0/1392930896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 msgr2=0x558522194d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.155+0000 7fb369834640 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 0x558522194d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.155+0000 7fb369834640 1 -- 172.21.15.152:0/1392930896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522191370 msgr2=0x558522209c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.155+0000 7fb369834640 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522191370 0x558522209c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.155+0000 7fb369834640 1 -- 172.21.15.152:0/1392930896 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55852220a1b0 con 0x5585221865d0 2024-09-11T22:14:03.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.155+0000 7fb369033640 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 0x558522194d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:03.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.155+0000 7fb369834640 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x5585221947c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb360005460 tx=0x7fb360005500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=256c0ad01ac439cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.155+0000 7fb34d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:14:03.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.155+0000 7fb34d7fa640 1 -- 172.21.15.152:0/1392930896 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360040040 con 0x5585221865d0 2024-09-11T22:14:03.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.155+0000 7fb34d7fa640 1 -- 172.21.15.152:0/1392930896 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8614+0+0 (secure 0 0 0) 0x7fb360004240 con 0x5585221865d0 2024-09-11T22:14:03.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.155+0000 7fb36de71740 1 -- 172.21.15.152:0/1392930896 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3540a9070 con 0x5585221865d0 2024-09-11T22:14:03.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb34d7fa640 1 -- 172.21.15.152:0/1392930896 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb36005f050 con 0x5585221865d0 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb36de71740 10 client.27143 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb36de71740 1 -- 172.21.15.152:0/1392930896 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55852220b3b0 con 0x5585221865d0 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb34d7fa640 1 -- 172.21.15.152:0/1392930896 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3540a9070 con 0x5585221865d0 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb34d7fa640 1 -- 172.21.15.152:0/1392930896 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb36004f440 con 0x5585221865d0 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb36de71740 10 client.27143 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb36de71740 10 client.27143 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb36de71740 20 client.27143 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb36de71740 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55852220b750 0x55852220db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb36de71740 4 client.27143 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb36de71740 1 -- 172.21.15.152:0/1392930896 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585220f3d70 con 0x55852220b750 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.156+0000 7fb369033640 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55852220b750 0x55852220db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.157+0000 7fb34d7fa640 10 client.27143 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.157+0000 7fb369033640 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55852220b750 0x55852220db40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c3c918387f894326 server_cookie=e8c1de5d7cd7e06a in_seq=0 out_seq=0 2024-09-11T22:14:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.157+0000 7fb34d7fa640 1 -- 172.21.15.152:0/1392930896 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585220f3d70 con 0x55852220b750 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.157+0000 7fb34d7fa640 10 client.27143 handle_command_reply: tid=0 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.157+0000 7fb36de71740 1 client.27143 shutdown 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.157+0000 7fb36de71740 1 -- 172.21.15.152:0/1392930896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 msgr2=0x5585221947c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.157+0000 7fb36de71740 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x5585221947c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb360005460 tx=0x7fb360005500 comp rx=0 tx=0).stop 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.158+0000 7fb36de71740 1 -- 172.21.15.152:0/1392930896 shutdown_connections 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.158+0000 7fb36de71740 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55852220b750 0x55852220db40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.158+0000 7fb36de71740 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558522191370 0x558522209c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.158+0000 7fb36de71740 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558522187b40 0x558522194d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.158+0000 7fb34d7fa640 0 client.27143 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.158+0000 7fb36de71740 1 --2- 172.21.15.152:0/1392930896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585221865d0 0x5585221947c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.158+0000 7fb36de71740 1 -- 172.21.15.152:0/1392930896 >> 172.21.15.152:0/1392930896 conn(0x55852214f310 msgr2=0x558522182700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.158+0000 7fb36de71740 1 -- 172.21.15.152:0/1392930896 shutdown_connections 2024-09-11T22:14:03.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.158+0000 7fb36de71740 1 -- 172.21.15.152:0/1392930896 wait complete. 2024-09-11T22:14:03.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.158+0000 7fb36de71740 20 client.27143 trim_cache size 0 max 16384 2024-09-11T22:14:03.175 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:14:03.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 -- 172.21.15.152:0/189974188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb3500a2cf0 msgr2=0x7fb3500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb3500a2cf0 0x7fb3500a51b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009fd0 tx=0x7fb35c015040 comp rx=0 tx=0).stop 2024-09-11T22:14:03.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 -- 172.21.15.152:0/189974188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb364102790 msgr2=0x7fb364198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb364102790 0x7fb364198990 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb35400e9f0 tx=0x7fb35400edf0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 -- 172.21.15.152:0/189974188 shutdown_connections 2024-09-11T22:14:03.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb3500a2cf0 0x7fb3500a51b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb364106f10 0x7fb36419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb364102790 0x7fb364198990 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 --2- 172.21.15.152:0/189974188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb364101de0 0x7fb364198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 -- 172.21.15.152:0/189974188 >> 172.21.15.152:0/189974188 conn(0x7fb3640fd8c0 msgr2=0x7fb3640fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 -- 172.21.15.152:0/189974188 shutdown_connections 2024-09-11T22:14:03.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:03.159+0000 7fb36ba98640 1 -- 172.21.15.152:0/189974188 wait complete. 2024-09-11T22:14:03.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:03 smithi152 ceph-mon[31188]: pgmap v301: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 649 op/s 2024-09-11T22:14:03.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:03 smithi179 ceph-mon[35603]: pgmap v301: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 649 op/s 2024-09-11T22:14:03.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:03 smithi193 ceph-mon[35545]: pgmap v301: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 649 op/s 2024-09-11T22:14:03.818 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f4008ff9640 1 -- 172.21.15.152:0/2884297993 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ab63e8dd70 con 0x55ab63f35350 2024-09-11T22:14:03.818 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f4008ff9640 10 client.17778 handle_command_reply: tid=0 2024-09-11T22:14:03.818 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 1 client.17778 shutdown 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 1 -- 172.21.15.152:0/2884297993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f23080 msgr2=0x55ab63f384e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f23080 0x55ab63f384e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f40180049d0 tx=0x7f4018004960 comp rx=0 tx=0).stop 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 1 -- 172.21.15.152:0/2884297993 shutdown_connections 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ab63f35350 0x55ab63fb2e00 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab63f23080 0x55ab63f384e0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f4008ff9640 0 client.17778 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ab63f21ed0 0x55ab63f3da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 1 --2- 172.21.15.152:0/2884297993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab63f1e060 0x55ab63f3d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 1 -- 172.21.15.152:0/2884297993 >> 172.21.15.152:0/2884297993 conn(0x55ab63f36fd0 msgr2=0x55ab63f23540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 1 -- 172.21.15.152:0/2884297993 shutdown_connections 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 1 -- 172.21.15.152:0/2884297993 wait complete. 2024-09-11T22:14:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.817+0000 7f402a7c9740 20 client.17778 trim_cache size 0 max 16384 2024-09-11T22:14:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:14:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:14:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:14:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:14:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 -- 172.21.15.152:0/2690223028 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f400c0a2da0 msgr2=0x7f400c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f400c0a2da0 0x7f400c0a5260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f401804d000 tx=0x7f401804e000 comp rx=0 tx=0).stop 2024-09-11T22:14:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 -- 172.21.15.152:0/2690223028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40201009a0 msgr2=0x7f4020198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40201009a0 0x7f4020198970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f401000e9f0 tx=0x7f401000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 -- 172.21.15.152:0/2690223028 shutdown_connections 2024-09-11T22:14:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f400c0a2da0 0x7f400c0a5260 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4020103ab0 0x7f402019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40201009a0 0x7f4020198970 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 --2- 172.21.15.152:0/2690223028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4020100000 0x7f4020198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 -- 172.21.15.152:0/2690223028 >> 172.21.15.152:0/2690223028 conn(0x7f40200770f0 msgr2=0x7f4020105950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.822 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 -- 172.21.15.152:0/2690223028 shutdown_connections 2024-09-11T22:14:03.822 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:03.818+0000 7f4027952640 1 -- 172.21.15.152:0/2690223028 wait complete. 2024-09-11T22:14:03.855 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:14:04.184 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:04.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.700+0000 7f5970dd5640 1 -- 172.21.15.152:0/1778181045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f596c108290 msgr2=0x7f596c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.700+0000 7f5970dd5640 1 --2- 172.21.15.152:0/1778181045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f596c108290 0x7f596c10ec30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f5964009cd0 tx=0x7f596402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.700+0000 7f5970dd5640 1 -- 172.21.15.152:0/1778181045 shutdown_connections 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.700+0000 7f5970dd5640 1 --2- 172.21.15.152:0/1778181045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f596c108290 0x7f596c10ec30 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.700+0000 7f5970dd5640 1 --2- 172.21.15.152:0/1778181045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f596c103740 0x7f596c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.700+0000 7f5970dd5640 1 --2- 172.21.15.152:0/1778181045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f596c102d90 0x7f596c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.700+0000 7f5970dd5640 1 -- 172.21.15.152:0/1778181045 >> 172.21.15.152:0/1778181045 conn(0x7f596c0fc7d0 msgr2=0x7f596c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.700+0000 7f5970dd5640 1 -- 172.21.15.152:0/1778181045 shutdown_connections 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.700+0000 7f5970dd5640 1 -- 172.21.15.152:0/1778181045 wait complete. 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.700+0000 7f5970dd5640 1 Processor -- start 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f5970dd5640 1 -- start start 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f5970dd5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f596c102d90 0x7f596c1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f5970dd5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f596c103740 0x7f596c100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f5970dd5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f596c108290 0x7f596c101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f5970dd5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f596c112090 con 0x7f596c103740 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f5970dd5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f596c111f10 con 0x7f596c102d90 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f5970dd5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f596c112210 con 0x7f596c108290 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f5963fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f596c103740 0x7f596c100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f596a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f596c102d90 0x7f596c1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f5963fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f596c103740 0x7f596c100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58420/0 (socket says 172.21.15.152:58420) 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f5963fff640 1 -- 172.21.15.152:0/1921340621 learned_addr learned my addr 172.21.15.152:0/1921340621 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f596ad9d640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f596c108290 0x7f596c101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f596a59c640 1 -- 172.21.15.152:0/1921340621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f596c108290 msgr2=0x7f596c101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f596a59c640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f596c108290 0x7f596c101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f596a59c640 1 -- 172.21.15.152:0/1921340621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f596c103740 msgr2=0x7f596c100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f596a59c640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f596c103740 0x7f596c100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f596a59c640 1 -- 172.21.15.152:0/1921340621 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c1a6a00 con 0x7f596c102d90 2024-09-11T22:14:04.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.701+0000 7f5963fff640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f596c103740 0x7f596c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:04.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.702+0000 7f596a59c640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f596c102d90 0x7f596c1009f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f595c00e9f0 tx=0x7f595c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.702+0000 7f59637fe640 1 -- 172.21.15.152:0/1921340621 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c00ccc0 con 0x7f596c102d90 2024-09-11T22:14:04.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.702+0000 7f5970dd5640 1 -- 172.21.15.152:0/1921340621 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c1a6cf0 con 0x7f596c102d90 2024-09-11T22:14:04.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.702+0000 7f59637fe640 1 -- 172.21.15.152:0/1921340621 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c005020 con 0x7f596c102d90 2024-09-11T22:14:04.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.702+0000 7f5970dd5640 1 -- 172.21.15.152:0/1921340621 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c1a71d0 con 0x7f596c102d90 2024-09-11T22:14:04.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.702+0000 7f59637fe640 1 -- 172.21.15.152:0/1921340621 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c0049e0 con 0x7f596c102d90 2024-09-11T22:14:04.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.704+0000 7f59637fe640 1 -- 172.21.15.152:0/1921340621 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f595c005560 con 0x7f596c102d90 2024-09-11T22:14:04.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f59731ae740 1 Processor -- start 2024-09-11T22:14:04.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f59731ae740 1 -- start start 2024-09-11T22:14:04.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f59637fe640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59580a2cf0 0x7f59580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f59731ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b6b40 0x564b967b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f59731ae740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b55d0 0x564b967b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f59731ae740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f596ad9d640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59580a2cf0 0x7f59580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f59731ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564b9671b2f0 con 0x564b967b6b40 2024-09-11T22:14:04.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f59731ae740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564b966c2cf0 con 0x564b967c0370 2024-09-11T22:14:04.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f59731ae740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564b967172b0 con 0x564b967b55d0 2024-09-11T22:14:04.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f59637fe640 1 -- 172.21.15.152:0/1921340621 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f595c0cf410 con 0x7f596c102d90 2024-09-11T22:14:04.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f596a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b6b40 0x564b967b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f596a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b6b40 0x564b967b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58424/0 (socket says 172.21.15.152:58424) 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f596a59c640 1 -- 172.21.15.152:0/335786236 learned_addr learned my addr 172.21.15.152:0/335786236 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f5963fff640 1 --2- 172.21.15.152:0/335786236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b55d0 0x564b967b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.705+0000 7f596ad9d640 1 --2- 172.21.15.152:0/335786236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.706+0000 7f596a59c640 1 -- 172.21.15.152:0/335786236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b55d0 msgr2=0x564b967b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.706+0000 7f596a59c640 1 --2- 172.21.15.152:0/335786236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b55d0 0x564b967b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.706+0000 7f596a59c640 1 -- 172.21.15.152:0/335786236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 msgr2=0x564b967c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.706+0000 7f596a59c640 1 --2- 172.21.15.152:0/335786236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.706+0000 7f596a59c640 1 -- 172.21.15.152:0/335786236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b966a73a0 con 0x564b967b6b40 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.706+0000 7f596ad9d640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59580a2cf0 0x7f59580a51b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5964004ab0 tx=0x7f59640316c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.706+0000 7f596a59c640 1 --2- 172.21.15.152:0/335786236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b6b40 0x564b967b5090 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f595c098270 tx=0x7f595c005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64887ee2e8644456 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.706+0000 7f5960ff9640 1 -- 172.21.15.152:0/335786236 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c0b4070 con 0x564b967b6b40 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.706+0000 7f5960ff9640 1 -- 172.21.15.152:0/335786236 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c09fc50 con 0x564b967b6b40 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.706+0000 7f5960ff9640 1 -- 172.21.15.152:0/335786236 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c01c040 con 0x564b967b6b40 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.707+0000 7f59731ae740 1 -- 172.21.15.152:0/335786236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b6b40 msgr2=0x564b967b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.707+0000 7f59731ae740 1 --2- 172.21.15.152:0/335786236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b6b40 0x564b967b5090 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f595c098270 tx=0x7f595c005310 comp rx=0 tx=0).stop 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.707+0000 7f59731ae740 1 -- 172.21.15.152:0/335786236 shutdown_connections 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.707+0000 7f59731ae740 1 --2- 172.21.15.152:0/335786236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.707+0000 7f59731ae740 1 --2- 172.21.15.152:0/335786236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b55d0 0x564b967b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.707+0000 7f59731ae740 1 --2- 172.21.15.152:0/335786236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b6b40 0x564b967b5090 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.707+0000 7f59731ae740 1 -- 172.21.15.152:0/335786236 >> 172.21.15.152:0/335786236 conn(0x564b9677e310 msgr2=0x564b967b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.707+0000 7f59731ae740 1 -- 172.21.15.152:0/335786236 shutdown_connections 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.707+0000 7f59731ae740 1 -- 172.21.15.152:0/335786236 wait complete. 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.707+0000 7f59731ae740 1 -- start start 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f59731ae740 1 Processor -- start 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f59731ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 0x564b967bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f59731ae740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b6b40 0x564b967bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f59731ae740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f59731ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564b967c3070 con 0x564b967b55d0 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f59731ae740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564b966d6060 con 0x564b967c0370 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f59731ae740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564b967c31f0 con 0x564b967b6b40 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f59731ae740 10 client.0 _ll_register_callbacks cb 0x564b964298c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f596a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 0x564b967bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f5963fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b6b40 0x564b967bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f596ad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f596ad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967bd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55092/0 (socket says 172.21.15.152:55092) 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f596ad9d640 1 -- 172.21.15.152:0/1193318543 learned_addr learned my addr 172.21.15.152:0/1193318543 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f596a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 0x564b967bfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58426/0 (socket says 172.21.15.152:58426) 2024-09-11T22:14:04.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f596ad9d640 1 -- 172.21.15.152:0/1193318543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b6b40 msgr2=0x564b967bd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f596ad9d640 1 --2- 172.21.15.152:0/1193318543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b6b40 0x564b967bd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f596ad9d640 1 -- 172.21.15.152:0/1193318543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 msgr2=0x564b967bfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f596ad9d640 1 --2- 172.21.15.152:0/1193318543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 0x564b967bfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f596ad9d640 1 -- 172.21.15.152:0/1193318543 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9648c3c0 con 0x564b967c0370 2024-09-11T22:14:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f596ad9d640 1 --2- 172.21.15.152:0/1193318543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967bd6f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5964035000 tx=0x7f596402a8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55adf776c9eccbe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.708+0000 7f5951ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:14:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f5951ffb640 1 -- 172.21.15.152:0/1193318543 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596404e070 con 0x564b967c0370 2024-09-11T22:14:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f59731ae740 1 -- 172.21.15.152:0/1193318543 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f595c09fc50 con 0x564b967c0370 2024-09-11T22:14:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f5951ffb640 1 -- 172.21.15.152:0/1193318543 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f59640305a0 con 0x564b967c0370 2024-09-11T22:14:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f5951ffb640 1 -- 172.21.15.152:0/1193318543 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f59640307a0 con 0x564b967c0370 2024-09-11T22:14:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f59731ae740 10 client.27155 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f59731ae740 1 -- 172.21.15.152:0/1193318543 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564b967ceb80 con 0x564b967c0370 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f5951ffb640 1 -- 172.21.15.152:0/1193318543 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c09fc50 con 0x564b967c0370 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f5951ffb640 1 -- 172.21.15.152:0/1193318543 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5964049070 con 0x564b967c0370 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f59731ae740 10 client.27155 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f59731ae740 10 client.27155 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f59731ae740 20 client.27155 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f59731ae740 1 --2- 172.21.15.152:0/1193318543 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564b967cffe0 0x564b967d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f59731ae740 4 client.27155 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f59731ae740 1 -- 172.21.15.152:0/1193318543 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b96728860 con 0x564b967cffe0 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.709+0000 7f596a59c640 1 --2- 172.21.15.152:0/1193318543 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564b967cffe0 0x564b967d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.710+0000 7f596a59c640 1 --2- 172.21.15.152:0/1193318543 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564b967cffe0 0x564b967d2420 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0fc8d7e056bb6de server_cookie=b2a77d6b599b0805 in_seq=0 out_seq=0 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.710+0000 7f5951ffb640 10 client.27155 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:14:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.710+0000 7f5951ffb640 1 -- 172.21.15.152:0/1193318543 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b96728860 con 0x564b967cffe0 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.710+0000 7f5951ffb640 10 client.27155 handle_command_reply: tid=0 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.710+0000 7f59731ae740 1 client.27155 shutdown 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f59731ae740 1 -- 172.21.15.152:0/1193318543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 msgr2=0x564b967bd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f59731ae740 1 --2- 172.21.15.152:0/1193318543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967bd6f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5964035000 tx=0x7f596402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f59731ae740 1 -- 172.21.15.152:0/1193318543 shutdown_connections 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f59731ae740 1 --2- 172.21.15.152:0/1193318543 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564b967cffe0 0x564b967d2420 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f59731ae740 1 --2- 172.21.15.152:0/1193318543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967bd6f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f59731ae740 1 --2- 172.21.15.152:0/1193318543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b6b40 0x564b967bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f59731ae740 1 --2- 172.21.15.152:0/1193318543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 0x564b967bfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f59731ae740 1 -- 172.21.15.152:0/1193318543 >> 172.21.15.152:0/1193318543 conn(0x564b9677e310 msgr2=0x564b967b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f5951ffb640 0 client.27155 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f59731ae740 1 -- 172.21.15.152:0/1193318543 shutdown_connections 2024-09-11T22:14:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f59731ae740 1 -- 172.21.15.152:0/1193318543 wait complete. 2024-09-11T22:14:04.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.711+0000 7f59731ae740 20 client.27155 trim_cache size 0 max 16384 2024-09-11T22:14:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.725+0000 7f59731ae740 1 Processor -- start 2024-09-11T22:14:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.725+0000 7f59731ae740 1 -- start start 2024-09-11T22:14:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f59731ae740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b55d0 0x564b967bd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f59731ae740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967b6b40 0x564b967bf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f59731ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967c0370 0x564b967b8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f59731ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1b2650 con 0x564b967c0370 2024-09-11T22:14:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f59731ae740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1aff20 con 0x564b967b6b40 2024-09-11T22:14:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f59731ae740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1add90 con 0x564b967b55d0 2024-09-11T22:14:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f596ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967c0370 0x564b967b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f596a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b55d0 0x564b967bd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f596ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967c0370 0x564b967b8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58438/0 (socket says 172.21.15.152:58438) 2024-09-11T22:14:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f596ad9d640 1 -- 172.21.15.152:0/878787442 learned_addr learned my addr 172.21.15.152:0/878787442 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f5963fff640 1 --2- 172.21.15.152:0/878787442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967b6b40 0x564b967bf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f596a59c640 1 -- 172.21.15.152:0/878787442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967b6b40 msgr2=0x564b967bf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f596a59c640 1 --2- 172.21.15.152:0/878787442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967b6b40 0x564b967bf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f596a59c640 1 -- 172.21.15.152:0/878787442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967c0370 msgr2=0x564b967b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f596a59c640 1 --2- 172.21.15.152:0/878787442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967c0370 0x564b967b8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f596a59c640 1 -- 172.21.15.152:0/878787442 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b967bdfc0 con 0x564b967b55d0 2024-09-11T22:14:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.726+0000 7f596ad9d640 1 --2- 172.21.15.152:0/878787442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967c0370 0x564b967b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:04.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.727+0000 7f596a59c640 1 --2- 172.21.15.152:0/878787442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b55d0 0x564b967bd6c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f595c098270 tx=0x7f595c097c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36c004f3960ac458 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.727+0000 7f5953fff640 1 -- 172.21.15.152:0/878787442 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c01c040 con 0x564b967b55d0 2024-09-11T22:14:04.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.727+0000 7f5953fff640 1 -- 172.21.15.152:0/878787442 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c0ccd50 con 0x564b967b55d0 2024-09-11T22:14:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.727+0000 7f5953fff640 1 -- 172.21.15.152:0/878787442 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c0b4040 con 0x564b967b55d0 2024-09-11T22:14:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.728+0000 7f59731ae740 1 -- 172.21.15.152:0/878787442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b55d0 msgr2=0x564b967bd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.728+0000 7f59731ae740 1 --2- 172.21.15.152:0/878787442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b55d0 0x564b967bd6c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f595c098270 tx=0x7f595c097c30 comp rx=0 tx=0).stop 2024-09-11T22:14:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.728+0000 7f59731ae740 1 -- 172.21.15.152:0/878787442 shutdown_connections 2024-09-11T22:14:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.728+0000 7f59731ae740 1 --2- 172.21.15.152:0/878787442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967c0370 0x564b967b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.728+0000 7f59731ae740 1 --2- 172.21.15.152:0/878787442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967b6b40 0x564b967bf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.728+0000 7f59731ae740 1 --2- 172.21.15.152:0/878787442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b55d0 0x564b967bd6c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.728+0000 7f59731ae740 1 -- 172.21.15.152:0/878787442 >> 172.21.15.152:0/878787442 conn(0x564b9677e310 msgr2=0x564b967be8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.728+0000 7f59731ae740 1 -- 172.21.15.152:0/878787442 shutdown_connections 2024-09-11T22:14:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.728+0000 7f59731ae740 1 -- 172.21.15.152:0/878787442 wait complete. 2024-09-11T22:14:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.728+0000 7f59731ae740 1 -- start start 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.728+0000 7f59731ae740 1 Processor -- start 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f59731ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 0x564b967c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f59731ae740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b6b40 0x564b967b9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f59731ae740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967b9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f59731ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1ae3e0 con 0x564b967b55d0 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f59731ae740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1af850 con 0x564b967c0370 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f59731ae740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1aeab0 con 0x564b967b6b40 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f59731ae740 10 client.0 _ll_register_callbacks cb 0x7f595c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f596a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 0x564b967c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f596a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 0x564b967c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58454/0 (socket says 172.21.15.152:58454) 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f596a59c640 1 -- 172.21.15.152:0/4266068842 learned_addr learned my addr 172.21.15.152:0/4266068842 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f5963fff640 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b6b40 0x564b967b9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f596ad9d640 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967b9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f5963fff640 1 -- 172.21.15.152:0/4266068842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 msgr2=0x564b967b9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f5963fff640 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967b9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f5963fff640 1 -- 172.21.15.152:0/4266068842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 msgr2=0x564b967c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f5963fff640 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 0x564b967c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f5963fff640 1 -- 172.21.15.152:0/4266068842 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b967ba500 con 0x564b967b6b40 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f596a59c640 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 0x564b967c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f5963fff640 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b6b40 0x564b967b9a80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x564b967b2ce0 tx=0x7f595400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=602d063a573525a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.729+0000 7f5951ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f5951ffb640 1 -- 172.21.15.152:0/4266068842 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954023060 con 0x564b967b6b40 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f5951ffb640 1 -- 172.21.15.152:0/4266068842 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f5954004030 con 0x564b967b6b40 2024-09-11T22:14:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f59731ae740 1 -- 172.21.15.152:0/4266068842 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f595c0ccd50 con 0x564b967b6b40 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f5951ffb640 1 -- 172.21.15.152:0/4266068842 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5954004230 con 0x564b967b6b40 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f59731ae740 10 client.27334 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f59731ae740 1 -- 172.21.15.152:0/4266068842 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564b9683a9d0 con 0x564b967b6b40 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f5951ffb640 1 -- 172.21.15.152:0/4266068842 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c0ccd50 con 0x564b967b6b40 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f5951ffb640 1 -- 172.21.15.152:0/4266068842 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5954004b30 con 0x564b967b6b40 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f59731ae740 10 client.27334 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f59731ae740 10 client.27334 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f59731ae740 20 client.27334 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f59731ae740 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564b9683b170 0x564b9683d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f59731ae740 4 client.27334 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.730+0000 7f59731ae740 1 -- 172.21.15.152:0/4266068842 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b96722d70 con 0x564b9683b170 2024-09-11T22:14:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f596a59c640 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564b9683b170 0x564b9683d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f596a59c640 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564b9683b170 0x564b9683d590 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f23fbffaa5ca2a9 server_cookie=79f2b849f478e8b9 in_seq=0 out_seq=0 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f5951ffb640 10 client.27334 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f5951ffb640 1 -- 172.21.15.152:0/4266068842 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b96722d70 con 0x564b9683b170 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f5951ffb640 10 client.27334 handle_command_reply: tid=0 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 1 client.27334 shutdown 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 1 -- 172.21.15.152:0/4266068842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b6b40 msgr2=0x564b967b9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b6b40 0x564b967b9a80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x564b967b2ce0 tx=0x7f595400f790 comp rx=0 tx=0).stop 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 1 -- 172.21.15.152:0/4266068842 shutdown_connections 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x564b9683b170 0x564b9683d590 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b967c0370 0x564b967b9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b967b6b40 0x564b967b9a80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f5951ffb640 0 client.27334 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:14:04.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 1 --2- 172.21.15.152:0/4266068842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b967b55d0 0x564b967c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 1 -- 172.21.15.152:0/4266068842 >> 172.21.15.152:0/4266068842 conn(0x564b9677e310 msgr2=0x564b967bf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 1 -- 172.21.15.152:0/4266068842 shutdown_connections 2024-09-11T22:14:04.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 1 -- 172.21.15.152:0/4266068842 wait complete. 2024-09-11T22:14:04.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.731+0000 7f59731ae740 20 client.27334 trim_cache size 0 max 16384 2024-09-11T22:14:04.740 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:14:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 -- 172.21.15.152:0/1921340621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59580a2cf0 msgr2=0x7f59580a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59580a2cf0 0x7f59580a51b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5964004ab0 tx=0x7f59640316c0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 -- 172.21.15.152:0/1921340621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f596c102d90 msgr2=0x7f596c1009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f596c102d90 0x7f596c1009f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f595c00e9f0 tx=0x7f595c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 -- 172.21.15.152:0/1921340621 shutdown_connections 2024-09-11T22:14:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59580a2cf0 0x7f59580a51b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f596c108290 0x7f596c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f596c103740 0x7f596c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 --2- 172.21.15.152:0/1921340621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f596c102d90 0x7f596c1009f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 -- 172.21.15.152:0/1921340621 >> 172.21.15.152:0/1921340621 conn(0x7f596c0fc7d0 msgr2=0x7f596c106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 -- 172.21.15.152:0/1921340621 shutdown_connections 2024-09-11T22:14:04.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:04.732+0000 7f5970dd5640 1 -- 172.21.15.152:0/1921340621 wait complete. 2024-09-11T22:14:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 510.0 s, 689.6 tps, lat 131.761 ms stddev 207.745 2024-09-11T22:14:05.306 INFO:tasks.quiescer.fs.[cephfs]:Total duration (45.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T22:14:05.306 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.55 2024-09-11T22:14:05.306 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:14:05.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:05 smithi179 ceph-mon[35603]: pgmap v302: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.1 MiB/s wr, 821 op/s 2024-09-11T22:14:05.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:05 smithi179 ceph-mon[35603]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T22:14:05.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:05 smithi193 ceph-mon[35545]: pgmap v302: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.1 MiB/s wr, 821 op/s 2024-09-11T22:14:05.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:05 smithi193 ceph-mon[35545]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T22:14:05.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:05 smithi152 ceph-mon[31188]: pgmap v302: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.1 MiB/s wr, 821 op/s 2024-09-11T22:14:05.620 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:05 smithi152 ceph-mon[31188]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T22:14:05.648 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:14:05.722 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:06.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.741+0000 7f8852506640 1 -- 172.21.15.152:0/578118662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f884c101dd0 msgr2=0x7f884c1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:06.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.741+0000 7f8852506640 1 --2- 172.21.15.152:0/578118662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f884c101dd0 0x7f884c1021b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f883c009900 tx=0x7f883c02a410 comp rx=0 tx=0).stop 2024-09-11T22:14:06.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.741+0000 7f8852506640 1 -- 172.21.15.152:0/578118662 shutdown_connections 2024-09-11T22:14:06.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.741+0000 7f8852506640 1 --2- 172.21.15.152:0/578118662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f884c106f00 0x7f884c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.741+0000 7f8852506640 1 --2- 172.21.15.152:0/578118662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f884c102780 0x7f884c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.741+0000 7f8852506640 1 --2- 172.21.15.152:0/578118662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f884c101dd0 0x7f884c1021b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.742+0000 7f8852506640 1 -- 172.21.15.152:0/578118662 >> 172.21.15.152:0/578118662 conn(0x7f884c0fd8b0 msgr2=0x7f884c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.742+0000 7f8852506640 1 -- 172.21.15.152:0/578118662 shutdown_connections 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.742+0000 7f8852506640 1 -- 172.21.15.152:0/578118662 wait complete. 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.742+0000 7f8852506640 1 Processor -- start 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.742+0000 7f8852506640 1 -- start start 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.742+0000 7f8852506640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f884c101dd0 0x7f884c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f8852506640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f884c102780 0x7f884c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f8852506640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f884c106f00 0x7f884c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f8852506640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f884c111f60 con 0x7f884c102780 2024-09-11T22:14:06.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f8852506640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f884c111de0 con 0x7f884c106f00 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f8852506640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f884c1120e0 con 0x7f884c101dd0 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f884b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f884c102780 0x7f884c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f884b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f884c102780 0x7f884c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58472/0 (socket says 172.21.15.152:58472) 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f884b7fe640 1 -- 172.21.15.152:0/2816249340 learned_addr learned my addr 172.21.15.152:0/2816249340 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f884bfff640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f884c101dd0 0x7f884c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f8850aa3640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f884c106f00 0x7f884c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f884b7fe640 1 -- 172.21.15.152:0/2816249340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f884c101dd0 msgr2=0x7f884c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f884b7fe640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f884c101dd0 0x7f884c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f884b7fe640 1 -- 172.21.15.152:0/2816249340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f884c106f00 msgr2=0x7f884c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f884b7fe640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f884c106f00 0x7f884c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f884b7fe640 1 -- 172.21.15.152:0/2816249340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c1a6900 con 0x7f884c102780 2024-09-11T22:14:06.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f884b7fe640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f884c102780 0x7f884c074a30 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f884000e9f0 tx=0x7f884000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:06.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f88497fa640 1 -- 172.21.15.152:0/2816249340 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884000cd80 con 0x7f884c102780 2024-09-11T22:14:06.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f8852506640 1 -- 172.21.15.152:0/2816249340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884c1a6bf0 con 0x7f884c102780 2024-09-11T22:14:06.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f88497fa640 1 -- 172.21.15.152:0/2816249340 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8840005500 con 0x7f884c102780 2024-09-11T22:14:06.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f88497fa640 1 -- 172.21.15.152:0/2816249340 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840010690 con 0x7f884c102780 2024-09-11T22:14:06.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.743+0000 7f8852506640 1 -- 172.21.15.152:0/2816249340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884c1a7130 con 0x7f884c102780 2024-09-11T22:14:06.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.744+0000 7f8852506640 1 -- 172.21.15.152:0/2816249340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f884c1021b0 con 0x7f884c102780 2024-09-11T22:14:06.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.746+0000 7f88497fa640 1 -- 172.21.15.152:0/2816249340 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f88400046c0 con 0x7f884c102780 2024-09-11T22:14:06.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.747+0000 7f88497fa640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88340a2cf0 0x7f88340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:06.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.747+0000 7f884bfff640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88340a2cf0 0x7f88340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:06.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.747+0000 7f88497fa640 1 -- 172.21.15.152:0/2816249340 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f88400cfaf0 con 0x7f884c102780 2024-09-11T22:14:06.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.747+0000 7f884bfff640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88340a2cf0 0x7f88340a51b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f883c009230 tx=0x7f883c0058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:06.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.751+0000 7f88497fa640 1 -- 172.21.15.152:0/2816249340 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88400541b0 con 0x7f884c102780 2024-09-11T22:14:06.787 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:06.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.995+0000 7f8852506640 1 -- 172.21.15.152:0/2816249340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f884c02d7c0 con 0x7f884c102780 2024-09-11T22:14:06.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.995+0000 7f88497fa640 1 -- 172.21.15.152:0/2816249340 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f884009c680 con 0x7f884c102780 2024-09-11T22:14:06.996 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:14:06.997 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:14:06.997 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:14:06.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 -- 172.21.15.152:0/2816249340 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88340a2cf0 msgr2=0x7f88340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:06.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88340a2cf0 0x7f88340a51b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f883c009230 tx=0x7f883c0058d0 comp rx=0 tx=0).stop 2024-09-11T22:14:06.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 -- 172.21.15.152:0/2816249340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f884c102780 msgr2=0x7f884c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:06.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f884c102780 0x7f884c074a30 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f884000e9f0 tx=0x7f884000edf0 comp rx=0 tx=0).stop 2024-09-11T22:14:06.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 -- 172.21.15.152:0/2816249340 shutdown_connections 2024-09-11T22:14:06.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f88340a2cf0 0x7f88340a51b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:06.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f884c106f00 0x7f884c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:06.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f884c102780 0x7f884c074a30 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:06.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 --2- 172.21.15.152:0/2816249340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f884c101dd0 0x7f884c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:06.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 -- 172.21.15.152:0/2816249340 >> 172.21.15.152:0/2816249340 conn(0x7f884c0fd8b0 msgr2=0x7f884c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:06.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 -- 172.21.15.152:0/2816249340 shutdown_connections 2024-09-11T22:14:06.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:06.998+0000 7f8852506640 1 -- 172.21.15.152:0/2816249340 wait complete. 2024-09-11T22:14:07.505 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:07 smithi152 ceph-mon[31188]: pgmap v304: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.6 MiB/s wr, 738 op/s 2024-09-11T22:14:07.505 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:07 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2816249340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:07.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.517+0000 7f9e90025640 1 -- 172.21.15.152:0/51212521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e88106f50 msgr2=0x7f9e8810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:07.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.517+0000 7f9e90025640 1 --2- 172.21.15.152:0/51212521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e88106f50 0x7f9e8810eaf0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009cd0 tx=0x7f9e8002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.517+0000 7f9e90025640 1 -- 172.21.15.152:0/51212521 shutdown_connections 2024-09-11T22:14:07.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.517+0000 7f9e90025640 1 --2- 172.21.15.152:0/51212521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e88106f50 0x7f9e8810eaf0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.517+0000 7f9e90025640 1 --2- 172.21.15.152:0/51212521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e88100ca0 0x7f9e88106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.517+0000 7f9e90025640 1 --2- 172.21.15.152:0/51212521 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e881002f0 0x7f9e881006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.517+0000 7f9e90025640 1 -- 172.21.15.152:0/51212521 >> 172.21.15.152:0/51212521 conn(0x7f9e88077220 msgr2=0x7f9e880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:07.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.517+0000 7f9e90025640 1 -- 172.21.15.152:0/51212521 shutdown_connections 2024-09-11T22:14:07.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.517+0000 7f9e90025640 1 -- 172.21.15.152:0/51212521 wait complete. 2024-09-11T22:14:07.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e90025640 1 Processor -- start 2024-09-11T22:14:07.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e90025640 1 -- start start 2024-09-11T22:14:07.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e90025640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e881002f0 0x7f9e88198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e90025640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e88100ca0 0x7f9e88198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e90025640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e88106f50 0x7f9e8819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e90025640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88111fa0 con 0x7f9e881002f0 2024-09-11T22:14:07.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e90025640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88111e20 con 0x7f9e88106f50 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e90025640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88112120 con 0x7f9e88100ca0 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8ddc1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e881002f0 0x7f9e88198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8ddc1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e881002f0 0x7f9e88198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58502/0 (socket says 172.21.15.152:58502) 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/4025612051 learned_addr learned my addr 172.21.15.152:0/4025612051 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e88100ca0 0x7f9e88198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8e5c2640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e88106f50 0x7f9e8819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8d5c0640 1 -- 172.21.15.152:0/4025612051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e88106f50 msgr2=0x7f9e8819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e88106f50 0x7f9e8819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8d5c0640 1 -- 172.21.15.152:0/4025612051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e881002f0 msgr2=0x7f9e88198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e881002f0 0x7f9e88198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8d5c0640 1 -- 172.21.15.152:0/4025612051 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8819d3b0 con 0x7f9e88100ca0 2024-09-11T22:14:07.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8e5c2640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e88106f50 0x7f9e8819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:07.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.518+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e881002f0 0x7f9e88198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:07.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.519+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e88100ca0 0x7f9e88198940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800e9c0 tx=0x7f9e7800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:07.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.519+0000 7f9e7effd640 1 -- 172.21.15.152:0/4025612051 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800ccc0 con 0x7f9e88100ca0 2024-09-11T22:14:07.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.519+0000 7f9e90025640 1 -- 172.21.15.152:0/4025612051 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8819d6a0 con 0x7f9e88100ca0 2024-09-11T22:14:07.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.519+0000 7f9e7effd640 1 -- 172.21.15.152:0/4025612051 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e78010910 con 0x7f9e88100ca0 2024-09-11T22:14:07.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.519+0000 7f9e7effd640 1 -- 172.21.15.152:0/4025612051 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78018880 con 0x7f9e88100ca0 2024-09-11T22:14:07.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.519+0000 7f9e90025640 1 -- 172.21.15.152:0/4025612051 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e881a4f80 con 0x7f9e88100ca0 2024-09-11T22:14:07.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.521+0000 7f9e923fe740 1 Processor -- start 2024-09-11T22:14:07.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.521+0000 7f9e923fe740 1 -- start start 2024-09-11T22:14:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e7effd640 1 -- 172.21.15.152:0/4025612051 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9e78010ac0 con 0x7f9e88100ca0 2024-09-11T22:14:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a172b40 0x56201a171090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 0x56201a171a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a17c370 0x56201a17e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e923fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56201a0d72f0 con 0x56201a17c370 2024-09-11T22:14:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e923fe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56201a07ecf0 con 0x56201a1715d0 2024-09-11T22:14:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e923fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56201a0d32b0 con 0x56201a172b40 2024-09-11T22:14:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8d5c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a17c370 0x56201a17e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8ddc1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 0x56201a171a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8d5c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a17c370 0x56201a17e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58512/0 (socket says 172.21.15.152:58512) 2024-09-11T22:14:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8d5c0640 1 -- 172.21.15.152:0/759094458 learned_addr learned my addr 172.21.15.152:0/759094458 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8e5c2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a172b40 0x56201a171090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/759094458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a172b40 msgr2=0x56201a171090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/759094458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a172b40 0x56201a171090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/759094458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a17c370 msgr2=0x56201a17e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/759094458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a17c370 0x56201a17e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/759094458 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201a0633a0 con 0x56201a1715d0 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/759094458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a17c370 0x56201a17e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e7effd640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9e740a2cf0 0x7f9e740a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.522+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/759094458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 0x56201a171a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9e840114f0 tx=0x7f9e840119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=271eab708098cb72 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.523+0000 7f9e8e5c2640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9e740a2cf0 0x7f9e740a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.523+0000 7f9e73fff640 1 -- 172.21.15.152:0/759094458 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8401e070 con 0x56201a1715d0 2024-09-11T22:14:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.523+0000 7f9e7effd640 1 -- 172.21.15.152:0/4025612051 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f9e780cf830 con 0x7f9e88100ca0 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.523+0000 7f9e73fff640 1 -- 172.21.15.152:0/759094458 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e840035f0 con 0x56201a1715d0 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.523+0000 7f9e73fff640 1 -- 172.21.15.152:0/759094458 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400f820 con 0x56201a1715d0 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.523+0000 7f9e923fe740 1 -- 172.21.15.152:0/759094458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 msgr2=0x56201a171a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.523+0000 7f9e8e5c2640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9e740a2cf0 0x7f9e740a51b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9e80006010 tx=0x7f9e80031820 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.523+0000 7f9e923fe740 1 --2- 172.21.15.152:0/759094458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 0x56201a171a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9e840114f0 tx=0x7f9e840119b0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.524+0000 7f9e923fe740 1 -- 172.21.15.152:0/759094458 shutdown_connections 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.524+0000 7f9e923fe740 1 --2- 172.21.15.152:0/759094458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a17c370 0x56201a17e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.524+0000 7f9e923fe740 1 --2- 172.21.15.152:0/759094458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 0x56201a171a10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.524+0000 7f9e923fe740 1 --2- 172.21.15.152:0/759094458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a172b40 0x56201a171090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.524+0000 7f9e923fe740 1 -- 172.21.15.152:0/759094458 >> 172.21.15.152:0/759094458 conn(0x56201a13a310 msgr2=0x56201a16dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.524+0000 7f9e923fe740 1 -- 172.21.15.152:0/759094458 shutdown_connections 2024-09-11T22:14:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.524+0000 7f9e923fe740 1 -- 172.21.15.152:0/759094458 wait complete. 2024-09-11T22:14:07.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.524+0000 7f9e923fe740 1 -- start start 2024-09-11T22:14:07.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.524+0000 7f9e923fe740 1 Processor -- start 2024-09-11T22:14:07.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 0x56201a17bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 0x56201a178fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a17c370 0x56201a179520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e923fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56201a17f070 con 0x56201a172b40 2024-09-11T22:14:07.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e923fe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56201a092060 con 0x56201a1715d0 2024-09-11T22:14:07.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e923fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56201a17f1f0 con 0x56201a17c370 2024-09-11T22:14:07.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e923fe740 10 client.0 _ll_register_callbacks cb 0x562019de58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8ddc1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 0x56201a17bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8ddc1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 0x56201a17bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55168/0 (socket says 172.21.15.152:55168) 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8d5c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 0x56201a178fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/2008068180 learned_addr learned my addr 172.21.15.152:0/2008068180 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8e5c2640 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a17c370 0x56201a179520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/2008068180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a17c370 msgr2=0x56201a179520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a17c370 0x56201a179520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/2008068180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 msgr2=0x56201a178fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 0x56201a178fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/2008068180 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562019e483c0 con 0x56201a1715d0 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 0x56201a178fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:07.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 0x56201a17bcf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9e840114c0 tx=0x7f9e840041f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c8b33383b73793c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.525+0000 7f9e717fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.526+0000 7f9e717fa640 1 -- 172.21.15.152:0/2008068180 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8401e070 con 0x56201a1715d0 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.526+0000 7f9e923fe740 1 -- 172.21.15.152:0/2008068180 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e840035f0 con 0x56201a1715d0 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.526+0000 7f9e717fa640 1 -- 172.21.15.152:0/2008068180 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f9e84005240 con 0x56201a1715d0 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.526+0000 7f9e717fa640 1 -- 172.21.15.152:0/2008068180 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9e84030050 con 0x56201a1715d0 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.526+0000 7f9e923fe740 10 client.27179 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.526+0000 7f9e923fe740 1 -- 172.21.15.152:0/2008068180 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56201a18aaa0 con 0x56201a1715d0 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.526+0000 7f9e717fa640 1 -- 172.21.15.152:0/2008068180 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e840035f0 con 0x56201a1715d0 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.527+0000 7f9e717fa640 1 -- 172.21.15.152:0/2008068180 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9e8402b030 con 0x56201a1715d0 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.527+0000 7f9e923fe740 10 client.27179 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.527+0000 7f9e923fe740 10 client.27179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.527+0000 7f9e923fe740 20 client.27179 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.527+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56201a18be50 0x56201a18e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.527+0000 7f9e923fe740 4 client.27179 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.527+0000 7f9e923fe740 1 -- 172.21.15.152:0/2008068180 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56201a0e4860 con 0x56201a18be50 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.527+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56201a18be50 0x56201a18e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.527+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56201a18be50 0x56201a18e240 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d388472ce1d4037a server_cookie=2569ea6703912073 in_seq=0 out_seq=0 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.527+0000 7f9e717fa640 10 client.27179 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e717fa640 1 -- 172.21.15.152:0/2008068180 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56201a0e4860 con 0x56201a18be50 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e717fa640 10 client.27179 handle_command_reply: tid=0 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e923fe740 1 client.27179 shutdown 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e923fe740 1 -- 172.21.15.152:0/2008068180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 msgr2=0x56201a17bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 0x56201a17bcf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9e840114c0 tx=0x7f9e840041f0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e923fe740 1 -- 172.21.15.152:0/2008068180 shutdown_connections 2024-09-11T22:14:07.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56201a18be50 0x56201a18e240 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a17c370 0x56201a179520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 0x56201a178fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e717fa640 0 client.27179 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:07.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2008068180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a1715d0 0x56201a17bcf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e923fe740 1 -- 172.21.15.152:0/2008068180 >> 172.21.15.152:0/2008068180 conn(0x56201a13a310 msgr2=0x56201a173960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:07.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.528+0000 7f9e923fe740 1 -- 172.21.15.152:0/2008068180 shutdown_connections 2024-09-11T22:14:07.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.529+0000 7f9e923fe740 1 -- 172.21.15.152:0/2008068180 wait complete. 2024-09-11T22:14:07.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.529+0000 7f9e923fe740 20 client.27179 trim_cache size 0 max 16384 2024-09-11T22:14:07.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e923fe740 1 Processor -- start 2024-09-11T22:14:07.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e923fe740 1 -- start start 2024-09-11T22:14:07.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a1715d0 0x56201a188310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a172b40 0x56201a174120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a17c370 0x56201a174660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e923fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9e881ae150 con 0x56201a1715d0 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e923fe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9e881aba20 con 0x56201a172b40 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e923fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9e881a9890 con 0x56201a17c370 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e8ddc1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a1715d0 0x56201a188310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e8ddc1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a1715d0 0x56201a188310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58528/0 (socket says 172.21.15.152:58528) 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/3874949883 learned_addr learned my addr 172.21.15.152:0/3874949883 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e8e5c2640 1 --2- 172.21.15.152:0/3874949883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a17c370 0x56201a174660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/3874949883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a172b40 0x56201a174120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.542+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/3874949883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a17c370 msgr2=0x56201a174660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.543+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/3874949883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a17c370 0x56201a174660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.543+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/3874949883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a172b40 msgr2=0x56201a174120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:07.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.543+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/3874949883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a172b40 0x56201a174120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.543+0000 7f9e8ddc1640 1 -- 172.21.15.152:0/3874949883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201a18e7d0 con 0x56201a1715d0 2024-09-11T22:14:07.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.543+0000 7f9e8e5c2640 1 --2- 172.21.15.152:0/3874949883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a17c370 0x56201a174660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:07.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.543+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/3874949883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a172b40 0x56201a174120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:07.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.543+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/3874949883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a1715d0 0x56201a188310 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400a010 tx=0x7f9e84003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37334b4f349344b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:07.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.543+0000 7f9e737fe640 1 -- 172.21.15.152:0/3874949883 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8401e070 con 0x56201a1715d0 2024-09-11T22:14:07.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.543+0000 7f9e737fe640 1 -- 172.21.15.152:0/3874949883 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8401f040 con 0x56201a1715d0 2024-09-11T22:14:07.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.543+0000 7f9e737fe640 1 -- 172.21.15.152:0/3874949883 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84005240 con 0x56201a1715d0 2024-09-11T22:14:07.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.544+0000 7f9e923fe740 1 -- 172.21.15.152:0/3874949883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a1715d0 msgr2=0x56201a188310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:07.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.544+0000 7f9e923fe740 1 --2- 172.21.15.152:0/3874949883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a1715d0 0x56201a188310 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400a010 tx=0x7f9e84003f40 comp rx=0 tx=0).stop 2024-09-11T22:14:07.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.544+0000 7f9e923fe740 1 -- 172.21.15.152:0/3874949883 shutdown_connections 2024-09-11T22:14:07.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.544+0000 7f9e923fe740 1 --2- 172.21.15.152:0/3874949883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a17c370 0x56201a174660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.544+0000 7f9e923fe740 1 --2- 172.21.15.152:0/3874949883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a172b40 0x56201a174120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.544+0000 7f9e923fe740 1 --2- 172.21.15.152:0/3874949883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a1715d0 0x56201a188310 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.544+0000 7f9e923fe740 1 -- 172.21.15.152:0/3874949883 >> 172.21.15.152:0/3874949883 conn(0x56201a13a310 msgr2=0x56201a17b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.544+0000 7f9e923fe740 1 -- 172.21.15.152:0/3874949883 shutdown_connections 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.544+0000 7f9e923fe740 1 -- 172.21.15.152:0/3874949883 wait complete. 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.544+0000 7f9e923fe740 1 -- start start 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e923fe740 1 Processor -- start 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a1715d0 0x56201a1848e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 0x56201a175af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e923fe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a17c370 0x56201a176030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e923fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9e881a9ee0 con 0x56201a172b40 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e923fe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9e881ab350 con 0x56201a17c370 2024-09-11T22:14:07.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e923fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9e881aa5b0 con 0x56201a1715d0 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e923fe740 10 client.0 _ll_register_callbacks cb 0x7f9e8401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e8d5c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 0x56201a175af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e8d5c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 0x56201a175af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58532/0 (socket says 172.21.15.152:58532) 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e8d5c0640 1 -- 172.21.15.152:0/2985933588 learned_addr learned my addr 172.21.15.152:0/2985933588 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a1715d0 0x56201a1848e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.545+0000 7f9e8e5c2640 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a17c370 0x56201a176030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e8d5c0640 1 -- 172.21.15.152:0/2985933588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a1715d0 msgr2=0x56201a1848e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a1715d0 0x56201a1848e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e8d5c0640 1 -- 172.21.15.152:0/2985933588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a17c370 msgr2=0x56201a176030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a17c370 0x56201a176030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e8d5c0640 1 -- 172.21.15.152:0/2985933588 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56201a176570 con 0x56201a172b40 2024-09-11T22:14:07.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a1715d0 0x56201a1848e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:07.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e8d5c0640 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 0x56201a175af0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9e780986e0 tx=0x7f9e78005b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849b7886e39ffdf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:07.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e717fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:07.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e717fa640 1 -- 172.21.15.152:0/2985933588 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7809bd10 con 0x56201a172b40 2024-09-11T22:14:07.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e717fa640 1 -- 172.21.15.152:0/2985933588 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f9e78098380 con 0x56201a172b40 2024-09-11T22:14:07.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e923fe740 1 -- 172.21.15.152:0/2985933588 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e8401f040 con 0x56201a172b40 2024-09-11T22:14:07.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e717fa640 1 -- 172.21.15.152:0/2985933588 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9e780b4e60 con 0x56201a172b40 2024-09-11T22:14:07.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e923fe740 10 client.17838 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:07.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e923fe740 1 -- 172.21.15.152:0/2985933588 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56201a1f6740 con 0x56201a172b40 2024-09-11T22:14:07.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.546+0000 7f9e717fa640 1 -- 172.21.15.152:0/2985933588 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e780b1020 con 0x56201a172b40 2024-09-11T22:14:07.551 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:07 smithi179 ceph-mon[35603]: pgmap v304: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.6 MiB/s wr, 738 op/s 2024-09-11T22:14:07.551 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:07 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2816249340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:07.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.547+0000 7f9e717fa640 1 -- 172.21.15.152:0/2985933588 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9e7809b160 con 0x56201a172b40 2024-09-11T22:14:07.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.547+0000 7f9e923fe740 10 client.17838 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:07.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.547+0000 7f9e923fe740 10 client.17838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:07.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.547+0000 7f9e923fe740 20 client.17838 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:07.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.547+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56201a1f6ef0 0x56201a1f9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:07.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.547+0000 7f9e923fe740 4 client.17838 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:14:07.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.547+0000 7f9e923fe740 1 -- 172.21.15.152:0/2985933588 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9e8401f040 con 0x56201a1f6ef0 2024-09-11T22:14:07.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.547+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56201a1f6ef0 0x56201a1f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.547+0000 7f9e8ddc1640 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56201a1f6ef0 0x56201a1f9310 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0f4050ca5216ca server_cookie=cce2b1e2ba91b59f in_seq=0 out_seq=0 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.547+0000 7f9e717fa640 10 client.17838 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e717fa640 1 -- 172.21.15.152:0/2985933588 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9e8401f040 con 0x56201a1f6ef0 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e717fa640 10 client.17838 handle_command_reply: tid=0 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 1 client.17838 shutdown 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 1 -- 172.21.15.152:0/2985933588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 msgr2=0x56201a175af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 0x56201a175af0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9e780986e0 tx=0x7f9e78005b60 comp rx=0 tx=0).stop 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 1 -- 172.21.15.152:0/2985933588 shutdown_connections 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56201a1f6ef0 0x56201a1f9310 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56201a17c370 0x56201a176030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56201a172b40 0x56201a175af0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e717fa640 0 client.17838 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:07.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 1 --2- 172.21.15.152:0/2985933588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56201a1715d0 0x56201a1848e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 1 -- 172.21.15.152:0/2985933588 >> 172.21.15.152:0/2985933588 conn(0x56201a13a310 msgr2=0x56201a16c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:07.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 1 -- 172.21.15.152:0/2985933588 shutdown_connections 2024-09-11T22:14:07.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 1 -- 172.21.15.152:0/2985933588 wait complete. 2024-09-11T22:14:07.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.548+0000 7f9e923fe740 20 client.17838 trim_cache size 0 max 16384 2024-09-11T22:14:07.554 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:14:07.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 -- 172.21.15.152:0/4025612051 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9e740a2cf0 msgr2=0x7f9e740a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:07.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9e740a2cf0 0x7f9e740a51b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9e80006010 tx=0x7f9e80031820 comp rx=0 tx=0).stop 2024-09-11T22:14:07.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 -- 172.21.15.152:0/4025612051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e88100ca0 msgr2=0x7f9e88198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:07.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e88100ca0 0x7f9e88198940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800e9c0 tx=0x7f9e7800ee80 comp rx=0 tx=0).stop 2024-09-11T22:14:07.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 -- 172.21.15.152:0/4025612051 shutdown_connections 2024-09-11T22:14:07.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9e740a2cf0 0x7f9e740a51b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e88106f50 0x7f9e8819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e88100ca0 0x7f9e88198940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 --2- 172.21.15.152:0/4025612051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e881002f0 0x7f9e88198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:07.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 -- 172.21.15.152:0/4025612051 >> 172.21.15.152:0/4025612051 conn(0x7f9e88077220 msgr2=0x7f9e88105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:07.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 -- 172.21.15.152:0/4025612051 shutdown_connections 2024-09-11T22:14:07.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:07.549+0000 7f9e90025640 1 -- 172.21.15.152:0/4025612051 wait complete. 2024-09-11T22:14:07.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:07 smithi193 ceph-mon[35545]: pgmap v304: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.6 MiB/s wr, 738 op/s 2024-09-11T22:14:07.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:07 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2816249340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:09.029 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0' 2024-09-11T22:14:09.030 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0 2024-09-11T22:14:09.311 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:09.540 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:14:09.541 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:14:09.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:09 smithi179 ceph-mon[35603]: pgmap v305: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.6 MiB/s wr, 738 op/s 2024-09-11T22:14:09.568 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:09 smithi152 ceph-mon[31188]: pgmap v305: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.6 MiB/s wr, 738 op/s 2024-09-11T22:14:09.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:09 smithi193 ceph-mon[35545]: pgmap v305: 97 pgs: 97 active+clean; 4.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.6 MiB/s wr, 738 op/s 2024-09-11T22:14:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 515.0 s, 215.6 tps, lat 465.355 ms stddev 281.051 2024-09-11T22:14:09.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.858+0000 7f7d1666e640 1 -- 172.21.15.152:0/26891360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d10101430 msgr2=0x7f7d1010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:09.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.858+0000 7f7d1666e640 1 --2- 172.21.15.152:0/26891360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d10101430 0x7f7d1010d960 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009cd0 tx=0x7f7d0802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.859+0000 7f7d1666e640 1 -- 172.21.15.152:0/26891360 shutdown_connections 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.859+0000 7f7d1666e640 1 --2- 172.21.15.152:0/26891360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d10101430 0x7f7d1010d960 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.859+0000 7f7d1666e640 1 --2- 172.21.15.152:0/26891360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d10100a90 0x7f7d10100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.859+0000 7f7d1666e640 1 --2- 172.21.15.152:0/26891360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d10106a90 0x7f7d10106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.859+0000 7f7d1666e640 1 -- 172.21.15.152:0/26891360 >> 172.21.15.152:0/26891360 conn(0x7f7d100fc7d0 msgr2=0x7f7d100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.859+0000 7f7d1666e640 1 -- 172.21.15.152:0/26891360 shutdown_connections 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.859+0000 7f7d1666e640 1 -- 172.21.15.152:0/26891360 wait complete. 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.860+0000 7f7d1666e640 1 Processor -- start 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.860+0000 7f7d1666e640 1 -- start start 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.860+0000 7f7d1666e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d10100a90 0x7f7d10198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.860+0000 7f7d1666e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d10101430 0x7f7d10198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.860+0000 7f7d1666e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d10106a90 0x7f7d1019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.860+0000 7f7d1666e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7d10110e90 con 0x7f7d10101430 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.860+0000 7f7d1666e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d10110d10 con 0x7f7d10106a90 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.860+0000 7f7d1666e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7d10111010 con 0x7f7d10100a90 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.860+0000 7f7d0f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d10101430 0x7f7d10198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.860+0000 7f7d0f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d10101430 0x7f7d10198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58550/0 (socket says 172.21.15.152:58550) 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.860+0000 7f7d0f7fe640 1 -- 172.21.15.152:0/340565399 learned_addr learned my addr 172.21.15.152:0/340565399 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.861+0000 7f7d14c0b640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d10106a90 0x7f7d1019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.861+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d10100a90 0x7f7d10198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.861+0000 7f7d0f7fe640 1 -- 172.21.15.152:0/340565399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d10100a90 msgr2=0x7f7d10198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.861+0000 7f7d0f7fe640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d10100a90 0x7f7d10198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.861+0000 7f7d0f7fe640 1 -- 172.21.15.152:0/340565399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d10106a90 msgr2=0x7f7d1019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.861+0000 7f7d0f7fe640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d10106a90 0x7f7d1019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.861+0000 7f7d0f7fe640 1 -- 172.21.15.152:0/340565399 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1019d1c0 con 0x7f7d10101430 2024-09-11T22:14:09.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.861+0000 7f7d0f7fe640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d10101430 0x7f7d10198750 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400e9f0 tx=0x7f7d0400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:09.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.861+0000 7f7d0d7fa640 1 -- 172.21.15.152:0/340565399 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400cd80 con 0x7f7d10101430 2024-09-11T22:14:09.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.861+0000 7f7d1666e640 1 -- 172.21.15.152:0/340565399 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1019d4b0 con 0x7f7d10101430 2024-09-11T22:14:09.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.861+0000 7f7d0d7fa640 1 -- 172.21.15.152:0/340565399 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d04010910 con 0x7f7d10101430 2024-09-11T22:14:09.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.862+0000 7f7d0d7fa640 1 -- 172.21.15.152:0/340565399 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04018990 con 0x7f7d10101430 2024-09-11T22:14:09.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.862+0000 7f7d1666e640 1 -- 172.21.15.152:0/340565399 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d100fcbb0 con 0x7f7d10101430 2024-09-11T22:14:09.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.864+0000 7f7d0d7fa640 1 -- 172.21.15.152:0/340565399 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f7d04018b30 con 0x7f7d10101430 2024-09-11T22:14:09.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.865+0000 7f7d0d7fa640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7cf80a2df0 0x7f7cf80a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.865+0000 7f7d0d7fa640 1 -- 172.21.15.152:0/340565399 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f7d040cf800 con 0x7f7d10101430 2024-09-11T22:14:09.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.865+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7cf80a2df0 0x7f7cf80a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.865+0000 7f7d18a47740 1 Processor -- start 2024-09-11T22:14:09.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.865+0000 7f7d18a47740 1 -- start start 2024-09-11T22:14:09.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.865+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7cf80a2df0 0x7f7cf80a52b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009b50 tx=0x7f7d00005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.865+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f2850 0x55a9198f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.865+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f3170 0x55a9198fd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.865+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198fda30 0x55a9198ffe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d18a47740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a919857160 con 0x55a9198fda30 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d18a47740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a9197fe720 con 0x55a9198f3170 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d18a47740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a919853120 con 0x55a9198f2850 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d0ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f2850 0x55a9198f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d0ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f2850 0x55a9198f2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:58502/0 (socket says 172.21.15.152:58502) 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d0ffff640 1 -- 172.21.15.152:0/2450731937 learned_addr learned my addr 172.21.15.152:0/2450731937 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d0f7fe640 1 --2- 172.21.15.152:0/2450731937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f3170 0x55a9198fd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d14c0b640 1 --2- 172.21.15.152:0/2450731937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198fda30 0x55a9198ffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d0ffff640 1 -- 172.21.15.152:0/2450731937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f3170 msgr2=0x55a9198fd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:09.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/2450731937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f3170 0x55a9198fd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d0ffff640 1 -- 172.21.15.152:0/2450731937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198fda30 msgr2=0x55a9198ffe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:09.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/2450731937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198fda30 0x55a9198ffe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d0ffff640 1 -- 172.21.15.152:0/2450731937 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9195c8ba0 con 0x55a9198f2850 2024-09-11T22:14:09.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/2450731937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f2850 0x55a9198f2c30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009670 tx=0x7f7d00014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b3affbe0fec8481 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:09.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7cf67fc640 1 -- 172.21.15.152:0/2450731937 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0001e420 con 0x55a9198f2850 2024-09-11T22:14:09.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7cf67fc640 1 -- 172.21.15.152:0/2450731937 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d0001eaa0 con 0x55a9198f2850 2024-09-11T22:14:09.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.866+0000 7f7cf67fc640 1 -- 172.21.15.152:0/2450731937 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0001dc30 con 0x55a9198f2850 2024-09-11T22:14:09.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.867+0000 7f7d18a47740 1 -- 172.21.15.152:0/2450731937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f2850 msgr2=0x55a9198f2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:09.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.867+0000 7f7d18a47740 1 --2- 172.21.15.152:0/2450731937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f2850 0x55a9198f2c30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009670 tx=0x7f7d00014000 comp rx=0 tx=0).stop 2024-09-11T22:14:09.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.868+0000 7f7d18a47740 1 -- 172.21.15.152:0/2450731937 shutdown_connections 2024-09-11T22:14:09.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.868+0000 7f7d18a47740 1 --2- 172.21.15.152:0/2450731937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198fda30 0x55a9198ffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.868+0000 7f7d18a47740 1 --2- 172.21.15.152:0/2450731937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f3170 0x55a9198fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.868+0000 7f7d18a47740 1 --2- 172.21.15.152:0/2450731937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f2850 0x55a9198f2c30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.868+0000 7f7d18a47740 1 -- 172.21.15.152:0/2450731937 >> 172.21.15.152:0/2450731937 conn(0x55a9198eede0 msgr2=0x55a9198ef1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:09.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.868+0000 7f7d18a47740 1 -- 172.21.15.152:0/2450731937 shutdown_connections 2024-09-11T22:14:09.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.868+0000 7f7d18a47740 1 -- 172.21.15.152:0/2450731937 wait complete. 2024-09-11T22:14:09.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.868+0000 7f7d18a47740 1 -- start start 2024-09-11T22:14:09.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.868+0000 7f7d18a47740 1 Processor -- start 2024-09-11T22:14:09.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f2850 0x55a9198fa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a9198fae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198fda30 0x55a9198fb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d0f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a9198fae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d0f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a9198fae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:58508/0 (socket says 172.21.15.152:58508) 2024-09-11T22:14:09.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d0f7fe640 1 -- 172.21.15.152:0/1248344317 learned_addr learned my addr 172.21.15.152:0/1248344317 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:09.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d18a47740 1 -- 172.21.15.152:0/1248344317 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a919900600 con 0x55a9198fda30 2024-09-11T22:14:09.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d18a47740 1 -- 172.21.15.152:0/1248344317 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a9197df900 con 0x55a9198f2850 2024-09-11T22:14:09.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d18a47740 1 -- 172.21.15.152:0/1248344317 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a919900780 con 0x55a9198f3170 2024-09-11T22:14:09.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f2850 0x55a9198fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d14c0b640 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198fda30 0x55a9198fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.869+0000 7f7d18a47740 10 client.0 _ll_register_callbacks cb 0x55a9197dd780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:09.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.870+0000 7f7d0f7fe640 1 -- 172.21.15.152:0/1248344317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f2850 msgr2=0x55a9198fa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:09.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.870+0000 7f7d0f7fe640 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f2850 0x55a9198fa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.870+0000 7f7d0f7fe640 1 -- 172.21.15.152:0/1248344317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198fda30 msgr2=0x55a9198fb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:09.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.870+0000 7f7d0f7fe640 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198fda30 0x55a9198fb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.870+0000 7f7d0f7fe640 1 -- 172.21.15.152:0/1248344317 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a91981fc50 con 0x55a9198f3170 2024-09-11T22:14:09.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.870+0000 7f7d0f7fe640 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a9198fae50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400c6a0 tx=0x7f7d040a0120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b5f86cfcb9bd30b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.870+0000 7f7cef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.870+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1248344317 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040cd2f0 con 0x55a9198f3170 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.870+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1248344317 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f7d0409b330 con 0x55a9198f3170 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.870+0000 7f7d18a47740 1 -- 172.21.15.152:0/1248344317 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d0001eaa0 con 0x55a9198f3170 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.870+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1248344317 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7d040ba390 con 0x55a9198f3170 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.871+0000 7f7d18a47740 10 client.27370 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.871+0000 7f7d18a47740 1 -- 172.21.15.152:0/1248344317 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a919914aa0 con 0x55a9198f3170 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.871+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1248344317 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d0001eaa0 con 0x55a9198f3170 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.871+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1248344317 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7d040a1170 con 0x55a9198f3170 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.871+0000 7f7d18a47740 10 client.27370 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.871+0000 7f7d18a47740 10 client.27370 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.871+0000 7f7d18a47740 20 client.27370 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:09.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.871+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a919915c70 0x55a9199180d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.871+0000 7f7d18a47740 4 client.27370 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:09.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.871+0000 7f7d18a47740 1 -- 172.21.15.152:0/1248344317 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a919864890 con 0x55a919915c70 2024-09-11T22:14:09.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.871+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a919915c70 0x55a9199180d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.872+0000 7f7cef7fe640 10 client.27370 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:09.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.872+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a919915c70 0x55a9199180d0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee6c4efd57be547a server_cookie=12fcdd6fe268a781 in_seq=0 out_seq=0 2024-09-11T22:14:09.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.872+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1248344317 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a919864890 con 0x55a919915c70 2024-09-11T22:14:09.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.872+0000 7f7cef7fe640 10 client.27370 handle_command_reply: tid=0 2024-09-11T22:14:09.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.872+0000 7f7d18a47740 1 client.27370 shutdown 2024-09-11T22:14:09.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.873+0000 7f7d18a47740 1 -- 172.21.15.152:0/1248344317 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 msgr2=0x55a9198fae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:09.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.873+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a9198fae50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400c6a0 tx=0x7f7d040a0120 comp rx=0 tx=0).stop 2024-09-11T22:14:09.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.875+0000 7f7d18a47740 1 -- 172.21.15.152:0/1248344317 shutdown_connections 2024-09-11T22:14:09.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.875+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a919915c70 0x55a9199180d0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.875+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198fda30 0x55a9198fb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.875+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a9198fae50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.875+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1248344317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f2850 0x55a9198fa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.875+0000 7f7cef7fe640 0 client.27370 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:09.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.875+0000 7f7d18a47740 1 -- 172.21.15.152:0/1248344317 >> 172.21.15.152:0/1248344317 conn(0x55a9198eede0 msgr2=0x55a9198f4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:09.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.875+0000 7f7d18a47740 1 -- 172.21.15.152:0/1248344317 shutdown_connections 2024-09-11T22:14:09.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.875+0000 7f7d18a47740 1 -- 172.21.15.152:0/1248344317 wait complete. 2024-09-11T22:14:09.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.875+0000 7f7d18a47740 20 client.27370 trim_cache size 0 max 16384 2024-09-11T22:14:09.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.904+0000 7f7d18a47740 1 Processor -- start 2024-09-11T22:14:09.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.904+0000 7f7d18a47740 1 -- start start 2024-09-11T22:14:09.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198f2850 0x55a9198fc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a91991d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198fda30 0x55a91991dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d18a47740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7d101ae1d0 con 0x55a9198f2850 2024-09-11T22:14:09.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d18a47740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d101abaa0 con 0x55a9198fda30 2024-09-11T22:14:09.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d18a47740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7d101a9910 con 0x55a9198f3170 2024-09-11T22:14:09.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d14c0b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198fda30 0x55a91991dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d0f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a91991d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d0f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a91991d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:58524/0 (socket says 172.21.15.152:58524) 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d0f7fe640 1 -- 172.21.15.152:0/646543926 learned_addr learned my addr 172.21.15.152:0/646543926 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/646543926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198f2850 0x55a9198fc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d14c0b640 1 -- 172.21.15.152:0/646543926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 msgr2=0x55a91991d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d14c0b640 1 --2- 172.21.15.152:0/646543926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a91991d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d14c0b640 1 -- 172.21.15.152:0/646543926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198f2850 msgr2=0x55a9198fc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d14c0b640 1 --2- 172.21.15.152:0/646543926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198f2850 0x55a9198fc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.905+0000 7f7d14c0b640 1 -- 172.21.15.152:0/646543926 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9198ee880 con 0x55a9198fda30 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.906+0000 7f7d0f7fe640 1 --2- 172.21.15.152:0/646543926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a91991d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.906+0000 7f7d14c0b640 1 --2- 172.21.15.152:0/646543926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198fda30 0x55a91991dee0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7d08005cc0 tx=0x7f7d08005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68066403d7086675 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.906+0000 7f7cf5ffb640 1 -- 172.21.15.152:0/646543926 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d080318c0 con 0x55a9198fda30 2024-09-11T22:14:09.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.906+0000 7f7cf5ffb640 1 -- 172.21.15.152:0/646543926 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d08036040 con 0x55a9198fda30 2024-09-11T22:14:09.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.906+0000 7f7cf5ffb640 1 -- 172.21.15.152:0/646543926 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08004680 con 0x55a9198fda30 2024-09-11T22:14:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.907+0000 7f7d18a47740 1 -- 172.21.15.152:0/646543926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198fda30 msgr2=0x55a91991dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.907+0000 7f7d18a47740 1 --2- 172.21.15.152:0/646543926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198fda30 0x55a91991dee0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7d08005cc0 tx=0x7f7d08005c50 comp rx=0 tx=0).stop 2024-09-11T22:14:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.907+0000 7f7d18a47740 1 -- 172.21.15.152:0/646543926 shutdown_connections 2024-09-11T22:14:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.907+0000 7f7d18a47740 1 --2- 172.21.15.152:0/646543926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198fda30 0x55a91991dee0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.907+0000 7f7d18a47740 1 --2- 172.21.15.152:0/646543926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198f3170 0x55a91991d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.907+0000 7f7d18a47740 1 --2- 172.21.15.152:0/646543926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198f2850 0x55a9198fc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.907+0000 7f7d18a47740 1 -- 172.21.15.152:0/646543926 >> 172.21.15.152:0/646543926 conn(0x55a9198eede0 msgr2=0x55a9198fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.907+0000 7f7d18a47740 1 -- 172.21.15.152:0/646543926 shutdown_connections 2024-09-11T22:14:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.907+0000 7f7d18a47740 1 -- 172.21.15.152:0/646543926 wait complete. 2024-09-11T22:14:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.908+0000 7f7d18a47740 1 -- start start 2024-09-11T22:14:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.908+0000 7f7d18a47740 1 Processor -- start 2024-09-11T22:14:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.908+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f2850 0x55a919905bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.908+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198f3170 0x55a9199060f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d18a47740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198fda30 0x55a9199029a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d0f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198f3170 0x55a9199060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d0f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198f3170 0x55a9199060f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58584/0 (socket says 172.21.15.152:58584) 2024-09-11T22:14:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d0ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f2850 0x55a919905bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d0f7fe640 1 -- 172.21.15.152:0/1541944416 learned_addr learned my addr 172.21.15.152:0/1541944416 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d18a47740 1 -- 172.21.15.152:0/1541944416 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7d101a9f60 con 0x55a9198f3170 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d18a47740 1 -- 172.21.15.152:0/1541944416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d101ab3d0 con 0x55a9198f2850 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d18a47740 1 -- 172.21.15.152:0/1541944416 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7d101aa630 con 0x55a9198fda30 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d18a47740 10 client.0 _ll_register_callbacks cb 0x7f7d04098000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d14c0b640 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198fda30 0x55a9199029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d0ffff640 1 -- 172.21.15.152:0/1541944416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198fda30 msgr2=0x55a9199029a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198fda30 0x55a9199029a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d0ffff640 1 -- 172.21.15.152:0/1541944416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198f3170 msgr2=0x55a9199060f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198f3170 0x55a9199060f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d0ffff640 1 -- 172.21.15.152:0/1541944416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a919903010 con 0x55a9198f2850 2024-09-11T22:14:09.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7d0ffff640 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f2850 0x55a919905bb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009640 tx=0x7f7d0001d810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e22cbe32c6468c3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:09.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.909+0000 7f7cef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:14:09.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.910+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1541944416 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00005450 con 0x55a9198f2850 2024-09-11T22:14:09.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.910+0000 7f7d18a47740 1 -- 172.21.15.152:0/1541944416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d08036040 con 0x55a9198f2850 2024-09-11T22:14:09.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.910+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1541944416 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f7d00009040 con 0x55a9198f2850 2024-09-11T22:14:09.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.910+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1541944416 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7d00043050 con 0x55a9198f2850 2024-09-11T22:14:09.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.910+0000 7f7d18a47740 10 client.27203 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:09.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.910+0000 7f7d18a47740 1 -- 172.21.15.152:0/1541944416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a9199812a0 con 0x55a9198f2850 2024-09-11T22:14:09.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.910+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1541944416 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d08036040 con 0x55a9198f2850 2024-09-11T22:14:09.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.911+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1541944416 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7d0003f4c0 con 0x55a9198f2850 2024-09-11T22:14:09.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.911+0000 7f7d18a47740 10 client.27203 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:09.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.911+0000 7f7d18a47740 10 client.27203 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:14:09.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.911+0000 7f7d18a47740 20 client.27203 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:09.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.911+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9199817b0 0x55a919983c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:09.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.911+0000 7f7d18a47740 4 client.27203 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}] 2024-09-11T22:14:09.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.911+0000 7f7d18a47740 1 -- 172.21.15.152:0/1541944416 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}) -- 0x55a9198ea410 con 0x55a9199817b0 2024-09-11T22:14:09.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.912+0000 7f7d0f7fe640 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9199817b0 0x55a919983c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:09.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.912+0000 7f7cef7fe640 10 client.27203 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:09.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:09.912+0000 7f7d0f7fe640 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9199817b0 0x55a919983c10 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beaa3037b3e168f4 server_cookie=46e3af9700ac55f6 in_seq=0 out_seq=0 2024-09-11T22:14:09.916 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:10.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.196+0000 7f7cef7fe640 1 -- 172.21.15.152:0/1541944416 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a9198ea410 con 0x55a9199817b0 2024-09-11T22:14:10.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.196+0000 7f7cef7fe640 10 client.27203 handle_command_reply: tid=0 2024-09-11T22:14:10.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.196+0000 7f7d18a47740 1 client.27203 shutdown 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7d18a47740 1 -- 172.21.15.152:0/1541944416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f2850 msgr2=0x55a919905bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f2850 0x55a919905bb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009640 tx=0x7f7d0001d810 comp rx=0 tx=0).stop 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7d18a47740 1 -- 172.21.15.152:0/1541944416 shutdown_connections 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a9199817b0 0x55a919983c10 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9198fda30 0x55a9199029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7cef7fe640 0 client.27203 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9198f3170 0x55a9199060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7d18a47740 1 --2- 172.21.15.152:0/1541944416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9198f2850 0x55a919905bb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7d18a47740 1 -- 172.21.15.152:0/1541944416 >> 172.21.15.152:0/1541944416 conn(0x55a9198eede0 msgr2=0x55a9198fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7d18a47740 1 -- 172.21.15.152:0/1541944416 shutdown_connections 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7d18a47740 1 -- 172.21.15.152:0/1541944416 wait complete. 2024-09-11T22:14:10.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.197+0000 7f7d18a47740 20 client.27203 trim_cache size 0 max 16384 2024-09-11T22:14:10.200 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:14:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:14:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:14:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 38, 2024-09-11T22:14:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:14:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "200f4ef3": { 2024-09-11T22:14:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 38, 2024-09-11T22:14:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:14:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:14:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 142.6, 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:10.202 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:14:10.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 -- 172.21.15.152:0/340565399 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7cf80a2df0 msgr2=0x7f7cf80a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7cf80a2df0 0x7f7cf80a52b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009b50 tx=0x7f7d00005f90 comp rx=0 tx=0).stop 2024-09-11T22:14:10.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 -- 172.21.15.152:0/340565399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d10101430 msgr2=0x7f7d10198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d10101430 0x7f7d10198750 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400e9f0 tx=0x7f7d0400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 -- 172.21.15.152:0/340565399 shutdown_connections 2024-09-11T22:14:10.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7cf80a2df0 0x7f7cf80a52b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d10106a90 0x7f7d1019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d10101430 0x7f7d10198750 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 --2- 172.21.15.152:0/340565399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d10100a90 0x7f7d10198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 -- 172.21.15.152:0/340565399 >> 172.21.15.152:0/340565399 conn(0x7f7d100fc7d0 msgr2=0x7f7d1006a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 -- 172.21.15.152:0/340565399 shutdown_connections 2024-09-11T22:14:10.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.198+0000 7f7d1666e640 1 -- 172.21.15.152:0/340565399 wait complete. 2024-09-11T22:14:10.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.396+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/2782831691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f18102d40 msgr2=0x7f3f18103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.396+0000 7f3f1dc6f640 1 --2- 172.21.15.152:0/2782831691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f18102d40 0x7f3f18103120 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009ca0 tx=0x7f3f0802a950 comp rx=0 tx=0).stop 2024-09-11T22:14:10.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.396+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/2782831691 shutdown_connections 2024-09-11T22:14:10.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.396+0000 7f3f1dc6f640 1 --2- 172.21.15.152:0/2782831691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f1810c170 0x7f3f1810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.396+0000 7f3f1dc6f640 1 --2- 172.21.15.152:0/2782831691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f18103660 0x7f3f1810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.396+0000 7f3f1dc6f640 1 --2- 172.21.15.152:0/2782831691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f18102d40 0x7f3f18103120 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.396+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/2782831691 >> 172.21.15.152:0/2782831691 conn(0x7f3f180fc7a0 msgr2=0x7f3f180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.396+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/2782831691 shutdown_connections 2024-09-11T22:14:10.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.396+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/2782831691 wait complete. 2024-09-11T22:14:10.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.397+0000 7f3f1dc6f640 1 Processor -- start 2024-09-11T22:14:10.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.397+0000 7f3f1dc6f640 1 -- start start 2024-09-11T22:14:10.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.397+0000 7f3f1dc6f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f18102d40 0x7f3f18198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.397+0000 7f3f1dc6f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f18103660 0x7f3f18198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.397+0000 7f3f1dc6f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f1810c170 0x7f3f1819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.397+0000 7f3f1dc6f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f18111f70 con 0x7f3f1810c170 2024-09-11T22:14:10.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.397+0000 7f3f1dc6f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f18111df0 con 0x7f3f18102d40 2024-09-11T22:14:10.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.397+0000 7f3f1dc6f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181120f0 con 0x7f3f18103660 2024-09-11T22:14:10.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f17fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f1810c170 0x7f3f1819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f17fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f1810c170 0x7f3f1819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58596/0 (socket says 172.21.15.152:58596) 2024-09-11T22:14:10.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f17fff640 1 -- 172.21.15.152:0/961560663 learned_addr learned my addr 172.21.15.152:0/961560663 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:10.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f177fe640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f18102d40 0x7f3f18198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f18103660 0x7f3f18198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f17fff640 1 -- 172.21.15.152:0/961560663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f18103660 msgr2=0x7f3f18198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f17fff640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f18103660 0x7f3f18198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f17fff640 1 -- 172.21.15.152:0/961560663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f18102d40 msgr2=0x7f3f18198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f17fff640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f18102d40 0x7f3f18198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f17fff640 1 -- 172.21.15.152:0/961560663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1819d400 con 0x7f3f1810c170 2024-09-11T22:14:10.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f177fe640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f18102d40 0x7f3f18198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:10.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f17fff640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f1810c170 0x7f3f1819cd20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000e970 tx=0x7f3f1000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f14ff9640 1 -- 172.21.15.152:0/961560663 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000ccc0 con 0x7f3f1810c170 2024-09-11T22:14:10.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/961560663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1819d6f0 con 0x7f3f1810c170 2024-09-11T22:14:10.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f14ff9640 1 -- 172.21.15.152:0/961560663 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f1000ce60 con 0x7f3f1810c170 2024-09-11T22:14:10.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f14ff9640 1 -- 172.21.15.152:0/961560663 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10010450 con 0x7f3f1810c170 2024-09-11T22:14:10.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.398+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/961560663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f181008d0 con 0x7f3f1810c170 2024-09-11T22:14:10.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f14ff9640 1 -- 172.21.15.152:0/961560663 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3f10005020 con 0x7f3f1810c170 2024-09-11T22:14:10.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f20048740 1 Processor -- start 2024-09-11T22:14:10.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f20048740 1 -- start start 2024-09-11T22:14:10.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f20048740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24845b80 0x55ba24845f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f20048740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba248464a0 0x55ba24850820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f20048740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba24853150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f20048740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ba247ab280 con 0x55ba24850d60 2024-09-11T22:14:10.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f20048740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ba24752b10 con 0x55ba24845b80 2024-09-11T22:14:10.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f20048740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ba247a7240 con 0x55ba248464a0 2024-09-11T22:14:10.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f16ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba24853150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f16ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba24853150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58606/0 (socket says 172.21.15.152:58606) 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f16ffd640 1 -- 172.21.15.152:0/339838739 learned_addr learned my addr 172.21.15.152:0/339838739 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f177fe640 1 --2- 172.21.15.152:0/339838739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba248464a0 0x55ba24850820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f14ff9640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f000a2cf0 0x7f3f000a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.401+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/339838739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24845b80 0x55ba24845f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3f16ffd640 1 -- 172.21.15.152:0/339838739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba248464a0 msgr2=0x55ba24850820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/339838739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba248464a0 0x55ba24850820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3f17fff640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f000a2cf0 0x7f3f000a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3f16ffd640 1 -- 172.21.15.152:0/339838739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24845b80 msgr2=0x55ba24845f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/339838739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24845b80 0x55ba24845f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3f16ffd640 1 -- 172.21.15.152:0/339838739 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2475f1f0 con 0x55ba24850d60 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3f14ff9640 1 -- 172.21.15.152:0/961560663 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f3f100cf8c0 con 0x7f3f1810c170 2024-09-11T22:14:10.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/339838739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba24853150 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c011540 tx=0x7f3f0c00a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97ad9ad9aea13cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3efdffb640 1 -- 172.21.15.152:0/339838739 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c005220 con 0x55ba24850d60 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3f17fff640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f000a2cf0 0x7f3f000a51b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3f100cd030 tx=0x7f3f1001bb30 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3efdffb640 1 -- 172.21.15.152:0/339838739 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f0c004c80 con 0x55ba24850d60 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.402+0000 7f3efdffb640 1 -- 172.21.15.152:0/339838739 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c00fb90 con 0x55ba24850d60 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.403+0000 7f3f20048740 1 -- 172.21.15.152:0/339838739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 msgr2=0x55ba24853150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.403+0000 7f3f20048740 1 --2- 172.21.15.152:0/339838739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba24853150 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c011540 tx=0x7f3f0c00a740 comp rx=0 tx=0).stop 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.403+0000 7f3f20048740 1 -- 172.21.15.152:0/339838739 shutdown_connections 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.403+0000 7f3f20048740 1 --2- 172.21.15.152:0/339838739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba24853150 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.403+0000 7f3f20048740 1 --2- 172.21.15.152:0/339838739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba248464a0 0x55ba24850820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.403+0000 7f3f20048740 1 --2- 172.21.15.152:0/339838739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24845b80 0x55ba24845f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.403+0000 7f3f20048740 1 -- 172.21.15.152:0/339838739 >> 172.21.15.152:0/339838739 conn(0x55ba24842110 msgr2=0x55ba248424f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.403+0000 7f3f20048740 1 -- 172.21.15.152:0/339838739 shutdown_connections 2024-09-11T22:14:10.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.403+0000 7f3f20048740 1 -- 172.21.15.152:0/339838739 wait complete. 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.403+0000 7f3f20048740 1 -- start start 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.403+0000 7f3f20048740 1 Processor -- start 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f20048740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba2484dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f20048740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba2484e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f20048740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 0x55ba2484e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f20048740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ba24853930 con 0x55ba248464a0 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f20048740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ba24765f10 con 0x55ba24850d60 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f20048740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ba24853ab0 con 0x55ba24845b80 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f20048740 10 client.0 _ll_register_callbacks cb 0x55ba2472ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba2484e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba2484e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58614/0 (socket says 172.21.15.152:58614) 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f177fe640 1 -- 172.21.15.152:0/2931826633 learned_addr learned my addr 172.21.15.152:0/2931826633 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 0x55ba2484e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba2484dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f177fe640 1 -- 172.21.15.152:0/2931826633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 msgr2=0x55ba2484dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f177fe640 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba2484dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f177fe640 1 -- 172.21.15.152:0/2931826633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 msgr2=0x55ba2484e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f177fe640 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 0x55ba2484e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f177fe640 1 -- 172.21.15.152:0/2931826633 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba2451c6a0 con 0x55ba248464a0 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 0x55ba2484e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3f177fe640 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba2484e1a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3f08035000 tx=0x7f3f0802fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390aba04fa4b1241 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.404+0000 7f3ef6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/2931826633 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08034040 con 0x55ba248464a0 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/2931826633 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f3f0803c7c0 con 0x55ba248464a0 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3f20048740 1 -- 172.21.15.152:0/2931826633 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f0c004c80 con 0x55ba248464a0 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/2931826633 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3f08054050 con 0x55ba248464a0 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3f20048740 10 client.17868 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:10.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3f20048740 1 -- 172.21.15.152:0/2931826633 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ba2485f560 con 0x55ba248464a0 2024-09-11T22:14:10.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/2931826633 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f0c004c80 con 0x55ba248464a0 2024-09-11T22:14:10.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/2931826633 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3f0804f030 con 0x55ba248464a0 2024-09-11T22:14:10.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3f20048740 10 client.17868 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:10.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3f20048740 10 client.17868 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:10.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3f20048740 20 client.17868 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:10.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3f20048740 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ba24860b30 0x55ba24862f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3f20048740 4 client.17868 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:10.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.405+0000 7f3f20048740 1 -- 172.21.15.152:0/2931826633 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba247b87f0 con 0x55ba24860b30 2024-09-11T22:14:10.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.406+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ba24860b30 0x55ba24862f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.406+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ba24860b30 0x55ba24862f90 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff4ed699a49eae89 server_cookie=e2d5c74cf6cbbe12 in_seq=0 out_seq=0 2024-09-11T22:14:10.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.406+0000 7f3ef6ffd640 10 client.17868 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:10.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/2931826633 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba247b87f0 con 0x55ba24860b30 2024-09-11T22:14:10.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3ef6ffd640 10 client.17868 handle_command_reply: tid=0 2024-09-11T22:14:10.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 1 client.17868 shutdown 2024-09-11T22:14:10.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 1 -- 172.21.15.152:0/2931826633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 msgr2=0x55ba2484e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba2484e1a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3f08035000 tx=0x7f3f0802fec0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 1 -- 172.21.15.152:0/2931826633 shutdown_connections 2024-09-11T22:14:10.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ba24860b30 0x55ba24862f90 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 0x55ba2484e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba2484e1a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 1 --2- 172.21.15.152:0/2931826633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba2484dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 1 -- 172.21.15.152:0/2931826633 >> 172.21.15.152:0/2931826633 conn(0x55ba24842110 msgr2=0x55ba24847df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3ef6ffd640 0 client.17868 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:10.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 1 -- 172.21.15.152:0/2931826633 shutdown_connections 2024-09-11T22:14:10.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 1 -- 172.21.15.152:0/2931826633 wait complete. 2024-09-11T22:14:10.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.407+0000 7f3f20048740 20 client.17868 trim_cache size 0 max 16384 2024-09-11T22:14:10.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.424+0000 7f3f20048740 1 Processor -- start 2024-09-11T22:14:10.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.424+0000 7f3f20048740 1 -- start start 2024-09-11T22:14:10.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.424+0000 7f3f20048740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba24868860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.424+0000 7f3f20048740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba248464a0 0x55ba24868da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.424+0000 7f3f20048740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba248475d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.424+0000 7f3f20048740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181ae090 con 0x55ba24850d60 2024-09-11T22:14:10.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.424+0000 7f3f20048740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181ab960 con 0x55ba248464a0 2024-09-11T22:14:10.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.424+0000 7f3f20048740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181a97d0 con 0x55ba24845b80 2024-09-11T22:14:10.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.424+0000 7f3f16ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba248475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.424+0000 7f3f16ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba248475d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58628/0 (socket says 172.21.15.152:58628) 2024-09-11T22:14:10.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.424+0000 7f3f16ffd640 1 -- 172.21.15.152:0/722168454 learned_addr learned my addr 172.21.15.152:0/722168454 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:10.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/722168454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba24868860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3f177fe640 1 --2- 172.21.15.152:0/722168454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba248464a0 0x55ba24868da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3f16ffd640 1 -- 172.21.15.152:0/722168454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 msgr2=0x55ba24868860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/722168454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba24868860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3f16ffd640 1 -- 172.21.15.152:0/722168454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba248464a0 msgr2=0x55ba24868da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/722168454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba248464a0 0x55ba24868da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3f16ffd640 1 -- 172.21.15.152:0/722168454 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba248462d0 con 0x55ba24850d60 2024-09-11T22:14:10.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3f177fe640 1 --2- 172.21.15.152:0/722168454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba248464a0 0x55ba24868da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:10.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/722168454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba248475d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c011540 tx=0x7f3f0c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415c62c52b40a596 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3efd7fa640 1 -- 172.21.15.152:0/722168454 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c00fce0 con 0x55ba24850d60 2024-09-11T22:14:10.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3efd7fa640 1 -- 172.21.15.152:0/722168454 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f0c00fe80 con 0x55ba24850d60 2024-09-11T22:14:10.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.425+0000 7f3efd7fa640 1 -- 172.21.15.152:0/722168454 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0048c0 con 0x55ba24850d60 2024-09-11T22:14:10.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.426+0000 7f3f20048740 1 -- 172.21.15.152:0/722168454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 msgr2=0x55ba248475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.426+0000 7f3f20048740 1 --2- 172.21.15.152:0/722168454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba248475d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c011540 tx=0x7f3f0c013040 comp rx=0 tx=0).stop 2024-09-11T22:14:10.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.426+0000 7f3f20048740 1 -- 172.21.15.152:0/722168454 shutdown_connections 2024-09-11T22:14:10.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.426+0000 7f3f20048740 1 --2- 172.21.15.152:0/722168454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba24850d60 0x55ba248475d0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.426+0000 7f3f20048740 1 --2- 172.21.15.152:0/722168454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba248464a0 0x55ba24868da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.426+0000 7f3f20048740 1 --2- 172.21.15.152:0/722168454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba24868860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.426+0000 7f3f20048740 1 -- 172.21.15.152:0/722168454 >> 172.21.15.152:0/722168454 conn(0x55ba24842110 msgr2=0x55ba2484fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.426+0000 7f3f20048740 1 -- 172.21.15.152:0/722168454 shutdown_connections 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.426+0000 7f3f20048740 1 -- 172.21.15.152:0/722168454 wait complete. 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.426+0000 7f3f20048740 1 -- start start 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f20048740 1 Processor -- start 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f20048740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba248591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f20048740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba24854500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f20048740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 0x55ba24854a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f20048740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181a9e20 con 0x55ba248464a0 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f20048740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181ab290 con 0x55ba24850d60 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f20048740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181aa4f0 con 0x55ba24845b80 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f20048740 10 client.0 _ll_register_callbacks cb 0x7f3f0802fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:10.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba24854500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba24854500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58630/0 (socket says 172.21.15.152:58630) 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f177fe640 1 -- 172.21.15.152:0/3453483806 learned_addr learned my addr 172.21.15.152:0/3453483806 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba248591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 0x55ba24854a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f177fe640 1 -- 172.21.15.152:0/3453483806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 msgr2=0x55ba248591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f177fe640 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba248591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f177fe640 1 -- 172.21.15.152:0/3453483806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 msgr2=0x55ba24854a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f177fe640 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 0x55ba24854a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f177fe640 1 -- 172.21.15.152:0/3453483806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba24855000 con 0x55ba248464a0 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.427+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 0x55ba24854a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3f177fe640 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba24854500 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3f0802ae70 tx=0x7f3f0802fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b460e909bb681ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3ef6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/3453483806 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0805c030 con 0x55ba248464a0 2024-09-11T22:14:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/3453483806 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f3f08030760 con 0x55ba248464a0 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3f20048740 1 -- 172.21.15.152:0/3453483806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ba247b2d00 con 0x55ba248464a0 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/3453483806 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3f08034070 con 0x55ba248464a0 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3f20048740 10 client.17874 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3f20048740 1 -- 172.21.15.152:0/3453483806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ba248cb5e0 con 0x55ba248464a0 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/3453483806 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ba247b2d00 con 0x55ba248464a0 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/3453483806 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3f0804f050 con 0x55ba248464a0 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3f20048740 10 client.17874 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3f20048740 10 client.17874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3f20048740 20 client.17874 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3f20048740 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ba248cbd00 0x55ba248ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3f20048740 4 client.17874 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.428+0000 7f3f20048740 1 -- 172.21.15.152:0/3453483806 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ba2472f110 con 0x55ba248cbd00 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.429+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ba248cbd00 0x55ba248ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.429+0000 7f3f16ffd640 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ba248cbd00 0x55ba248ce120 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2751831b93a7a414 server_cookie=8080b85c038eadf3 in_seq=0 out_seq=0 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.429+0000 7f3ef6ffd640 10 client.17874 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/3453483806 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ba2472f110 con 0x55ba248cbd00 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3ef6ffd640 10 client.17874 handle_command_reply: tid=0 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 1 client.17874 shutdown 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 1 -- 172.21.15.152:0/3453483806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 msgr2=0x55ba24854500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba24854500 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3f0802ae70 tx=0x7f3f0802fcf0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 1 -- 172.21.15.152:0/3453483806 shutdown_connections 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ba248cbd00 0x55ba248ce120 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3ef6ffd640 0 client.17874 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba24850d60 0x55ba24854a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba248464a0 0x55ba24854500 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 1 --2- 172.21.15.152:0/3453483806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba24845b80 0x55ba248591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 1 -- 172.21.15.152:0/3453483806 >> 172.21.15.152:0/3453483806 conn(0x55ba24842110 msgr2=0x55ba24840a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 1 -- 172.21.15.152:0/3453483806 shutdown_connections 2024-09-11T22:14:10.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 1 -- 172.21.15.152:0/3453483806 wait complete. 2024-09-11T22:14:10.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.430+0000 7f3f20048740 20 client.17874 trim_cache size 0 max 16384 2024-09-11T22:14:10.437 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:14:10.437 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:14:10.437 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "16aab9e7-904a-4612-a151-a1fb7fc884fc", 2024-09-11T22:14:10.437 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:14:10.437 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:14:10.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/961560663 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f000a2cf0 msgr2=0x7f3f000a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f000a2cf0 0x7f3f000a51b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3f100cd030 tx=0x7f3f1001bb30 comp rx=0 tx=0).stop 2024-09-11T22:14:10.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/961560663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f1810c170 msgr2=0x7f3f1819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f1810c170 0x7f3f1819cd20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000e970 tx=0x7f3f1000ed70 comp rx=0 tx=0).stop 2024-09-11T22:14:10.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/961560663 shutdown_connections 2024-09-11T22:14:10.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f000a2cf0 0x7f3f000a51b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f1810c170 0x7f3f1819cd20 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f18103660 0x7f3f18198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 --2- 172.21.15.152:0/961560663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f18102d40 0x7f3f18198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/961560663 >> 172.21.15.152:0/961560663 conn(0x7f3f180fc7a0 msgr2=0x7f3f180fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/961560663 shutdown_connections 2024-09-11T22:14:10.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:10.431+0000 7f3f1dc6f640 1 -- 172.21.15.152:0/961560663 wait complete. 2024-09-11T22:14:11.463 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:11 smithi152 ceph-mon[31188]: pgmap v306: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.8 MiB/s wr, 502 op/s 2024-09-11T22:14:11.463 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:11 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:14:11.463 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:11 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:11.463 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:11 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:14:11.463 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:11 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:14:11.463 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:11 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:11.463 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:11 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:11.490 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:14:11.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:11 smithi179 ceph-mon[35603]: pgmap v306: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.8 MiB/s wr, 502 op/s 2024-09-11T22:14:11.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:11 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:14:11.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:11 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:11.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:11 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:14:11.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:11 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:14:11.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:11 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:11.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:11 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:11.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:11 smithi193 ceph-mon[35545]: pgmap v306: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.8 MiB/s wr, 502 op/s 2024-09-11T22:14:11.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:11 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:14:11.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:11 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:11.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:11 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:14:11.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:11 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:14:11.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:11 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:11.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:11 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:12.044 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '200f4ef3', quiesce took 6.7 seconds. Will release after: 15.850000000000001 2024-09-11T22:14:12.112 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:12.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.591+0000 7f697f188640 1 -- 172.21.15.152:0/2565971578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6978103700 msgr2=0x7f697810bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:12.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.591+0000 7f697f188640 1 --2- 172.21.15.152:0/2565971578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6978103700 0x7f697810bbf0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f6964009900 tx=0x7f696402a480 comp rx=0 tx=0).stop 2024-09-11T22:14:12.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.591+0000 7f697f188640 1 -- 172.21.15.152:0/2565971578 shutdown_connections 2024-09-11T22:14:12.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.591+0000 7f697f188640 1 --2- 172.21.15.152:0/2565971578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f697810c180 0x7f697810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.591+0000 7f697f188640 1 --2- 172.21.15.152:0/2565971578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6978103700 0x7f697810bbf0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.591+0000 7f697f188640 1 --2- 172.21.15.152:0/2565971578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978102de0 0x7f69781031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.591+0000 7f697f188640 1 -- 172.21.15.152:0/2565971578 >> 172.21.15.152:0/2565971578 conn(0x7f69780fc7a0 msgr2=0x7f69780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.591+0000 7f697f188640 1 -- 172.21.15.152:0/2565971578 shutdown_connections 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.591+0000 7f697f188640 1 -- 172.21.15.152:0/2565971578 wait complete. 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.591+0000 7f697f188640 1 Processor -- start 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.591+0000 7f697f188640 1 -- start start 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697f188640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6978102de0 0x7f69781984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697f188640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978103700 0x7f69781989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697f188640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f697810c180 0x7f697819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697f188640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6978111fd0 con 0x7f6978102de0 2024-09-11T22:14:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697f188640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6978111e50 con 0x7f6978103700 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697f188640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6978112150 con 0x7f697810c180 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697cf24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6978102de0 0x7f69781984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697cf24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6978102de0 0x7f69781984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58654/0 (socket says 172.21.15.152:58654) 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697cf24640 1 -- 172.21.15.152:0/2772192624 learned_addr learned my addr 172.21.15.152:0/2772192624 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f6977fff640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978103700 0x7f69781989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697d725640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f697810c180 0x7f697819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697cf24640 1 -- 172.21.15.152:0/2772192624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f697810c180 msgr2=0x7f697819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697cf24640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f697810c180 0x7f697819cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697cf24640 1 -- 172.21.15.152:0/2772192624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978103700 msgr2=0x7f69781989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697cf24640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978103700 0x7f69781989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697cf24640 1 -- 172.21.15.152:0/2772192624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697819d460 con 0x7f6978102de0 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f6977fff640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978103700 0x7f69781989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697cf24640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6978102de0 0x7f69781984b0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f696c00b4a0 tx=0x7f696c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f6975ffb640 1 -- 172.21.15.152:0/2772192624 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c014070 con 0x7f6978102de0 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f6975ffb640 1 -- 172.21.15.152:0/2772192624 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f696c010af0 con 0x7f6978102de0 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f697f188640 1 -- 172.21.15.152:0/2772192624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697819d750 con 0x7f6978102de0 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.592+0000 7f6975ffb640 1 -- 172.21.15.152:0/2772192624 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c017d10 con 0x7f6978102de0 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.593+0000 7f697f188640 1 -- 172.21.15.152:0/2772192624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69781a5030 con 0x7f6978102de0 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.595+0000 7f6975ffb640 1 -- 172.21.15.152:0/2772192624 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f696c017070 con 0x7f6978102de0 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.595+0000 7f6981561740 1 Processor -- start 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.595+0000 7f6981561740 1 -- start start 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6975ffb640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69680a2d70 0x7f69680a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6981561740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3ae4a0 0x55c46f3ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6981561740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f3b9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6981561740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3b9680 0x55c46f3bba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6981561740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c46f3142e0 con 0x55c46f3ae4a0 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6981561740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c46f2bbce0 con 0x55c46f3b9680 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6981561740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c46f3102a0 con 0x55c46f3aedc0 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f697d725640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69680a2d70 0x7f69680a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f697cf24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3ae4a0 0x55c46f3ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6977fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f3b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6975ffb640 1 -- 172.21.15.152:0/2772192624 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f696c0ce7d0 con 0x7f6978102de0 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6977fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f3b9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:58610/0 (socket says 172.21.15.152:58610) 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6977fff640 1 -- 172.21.15.152:0/2182183763 learned_addr learned my addr 172.21.15.152:0/2182183763 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f697d725640 1 --2- 172.21.15.152:0/2182183763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3b9680 0x55c46f3bba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f697cf24640 1 -- 172.21.15.152:0/2182183763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 msgr2=0x55c46f3b9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f697cf24640 1 --2- 172.21.15.152:0/2182183763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f3b9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f697cf24640 1 -- 172.21.15.152:0/2182183763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3b9680 msgr2=0x55c46f3bba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f697cf24640 1 --2- 172.21.15.152:0/2182183763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3b9680 0x55c46f3bba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f697cf24640 1 -- 172.21.15.152:0/2182183763 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c46f2a0440 con 0x55c46f3ae4a0 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f6977fff640 1 --2- 172.21.15.152:0/2182183763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f3b9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f697d725640 1 --2- 172.21.15.152:0/2182183763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3b9680 0x55c46f3bba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f697d725640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69680a2d70 0x7f69680a5230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6970009270 tx=0x7f6970009c90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.596+0000 7f697cf24640 1 --2- 172.21.15.152:0/2182183763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3ae4a0 0x55c46f3ae880 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f696c0cbf40 tx=0x7f696c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e0f4eaba5b660d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6962ffd640 1 -- 172.21.15.152:0/2182183763 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c01e070 con 0x55c46f3ae4a0 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6962ffd640 1 -- 172.21.15.152:0/2182183763 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f696c09ad10 con 0x55c46f3ae4a0 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6962ffd640 1 -- 172.21.15.152:0/2182183763 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c06af60 con 0x55c46f3ae4a0 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6981561740 1 -- 172.21.15.152:0/2182183763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3ae4a0 msgr2=0x55c46f3ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6981561740 1 --2- 172.21.15.152:0/2182183763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3ae4a0 0x55c46f3ae880 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f696c0cbf40 tx=0x7f696c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6981561740 1 -- 172.21.15.152:0/2182183763 shutdown_connections 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6981561740 1 --2- 172.21.15.152:0/2182183763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3b9680 0x55c46f3bba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6981561740 1 --2- 172.21.15.152:0/2182183763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f3b9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6981561740 1 --2- 172.21.15.152:0/2182183763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3ae4a0 0x55c46f3ae880 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6981561740 1 -- 172.21.15.152:0/2182183763 >> 172.21.15.152:0/2182183763 conn(0x55c46f3aaa30 msgr2=0x55c46f3aae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6981561740 1 -- 172.21.15.152:0/2182183763 shutdown_connections 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.597+0000 7f6981561740 1 -- 172.21.15.152:0/2182183763 wait complete. 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6981561740 1 -- start start 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6981561740 1 Processor -- start 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6981561740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f3b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6981561740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3aedc0 0x55c46f3b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6981561740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3b9680 0x55c46f3b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6981561740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c46f3bc250 con 0x55c46f3aedc0 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6981561740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c46f2cf050 con 0x55c46f3ae4a0 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6981561740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c46f3bc3d0 con 0x55c46f3b9680 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6981561740 10 client.0 _ll_register_callbacks cb 0x55c46f30f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6977fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3aedc0 0x55c46f3b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6977fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3aedc0 0x55c46f3b6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58684/0 (socket says 172.21.15.152:58684) 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.598+0000 7f6977fff640 1 -- 172.21.15.152:0/1662864900 learned_addr learned my addr 172.21.15.152:0/1662864900 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f697cf24640 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f3b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f697d725640 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3b9680 0x55c46f3b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6977fff640 1 -- 172.21.15.152:0/1662864900 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3b9680 msgr2=0x55c46f3b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6977fff640 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3b9680 0x55c46f3b67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6977fff640 1 -- 172.21.15.152:0/1662864900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 msgr2=0x55c46f3b8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6977fff640 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f3b8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6977fff640 1 -- 172.21.15.152:0/1662864900 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c46f0853c0 con 0x55c46f3aedc0 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6977fff640 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3aedc0 0x55c46f3b6270 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f6964009900 tx=0x7f6964032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1a4c0492840e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6957fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6957fff640 1 -- 172.21.15.152:0/1662864900 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6964035040 con 0x55c46f3aedc0 2024-09-11T22:14:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6957fff640 1 -- 172.21.15.152:0/1662864900 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f6964004450 con 0x55c46f3aedc0 2024-09-11T22:14:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6981561740 1 -- 172.21.15.152:0/1662864900 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f696c09ad10 con 0x55c46f3aedc0 2024-09-11T22:14:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6957fff640 1 -- 172.21.15.152:0/1662864900 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6964031a20 con 0x55c46f3aedc0 2024-09-11T22:14:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6981561740 10 client.17886 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6981561740 1 -- 172.21.15.152:0/1662864900 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c46f3c7c00 con 0x55c46f3aedc0 2024-09-11T22:14:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6957fff640 1 -- 172.21.15.152:0/1662864900 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f696c09ad10 con 0x55c46f3aedc0 2024-09-11T22:14:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6957fff640 1 -- 172.21.15.152:0/1662864900 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f69640035f0 con 0x55c46f3aedc0 2024-09-11T22:14:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6981561740 10 client.17886 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.599+0000 7f6981561740 10 client.17886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.600+0000 7f6981561740 20 client.17886 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.600+0000 7f6981561740 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c46f3c9060 0x55c46f3cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.600+0000 7f6981561740 4 client.17886 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.600+0000 7f6981561740 1 -- 172.21.15.152:0/1662864900 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c46f321850 con 0x55c46f3c9060 2024-09-11T22:14:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.600+0000 7f697cf24640 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c46f3c9060 0x55c46f3cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.600+0000 7f697cf24640 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c46f3c9060 0x55c46f3cb4e0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8949d19c75c2ffb server_cookie=2659e2c9150913bd in_seq=0 out_seq=0 2024-09-11T22:14:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.600+0000 7f6957fff640 10 client.17886 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6957fff640 1 -- 172.21.15.152:0/1662864900 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c46f321850 con 0x55c46f3c9060 2024-09-11T22:14:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6957fff640 10 client.17886 handle_command_reply: tid=0 2024-09-11T22:14:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 1 client.17886 shutdown 2024-09-11T22:14:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 1 -- 172.21.15.152:0/1662864900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3aedc0 msgr2=0x55c46f3b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3aedc0 0x55c46f3b6270 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f6964009900 tx=0x7f6964032fc0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 1 -- 172.21.15.152:0/1662864900 shutdown_connections 2024-09-11T22:14:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c46f3c9060 0x55c46f3cb4e0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3b9680 0x55c46f3b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3aedc0 0x55c46f3b6270 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 1 --2- 172.21.15.152:0/1662864900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f3b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 1 -- 172.21.15.152:0/1662864900 >> 172.21.15.152:0/1662864900 conn(0x55c46f3aaa30 msgr2=0x55c46f3a9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6957fff640 0 client.17886 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 1 -- 172.21.15.152:0/1662864900 shutdown_connections 2024-09-11T22:14:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 1 -- 172.21.15.152:0/1662864900 wait complete. 2024-09-11T22:14:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.601+0000 7f6981561740 20 client.17886 trim_cache size 0 max 16384 2024-09-11T22:14:12.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.618+0000 7f6981561740 1 Processor -- start 2024-09-11T22:14:12.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.618+0000 7f6981561740 1 -- start start 2024-09-11T22:14:12.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.618+0000 7f6981561740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f3b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.618+0000 7f6981561740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f3b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.618+0000 7f6981561740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f3c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.618+0000 7f6981561740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f69781b0470 con 0x55c46f3b9680 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.618+0000 7f6981561740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f69781add40 con 0x55c46f3ae4a0 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.618+0000 7f6981561740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69781abbb0 con 0x55c46f3aedc0 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f697d725640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f3c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f697d725640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f3c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58692/0 (socket says 172.21.15.152:58692) 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f697d725640 1 -- 172.21.15.152:0/2094351660 learned_addr learned my addr 172.21.15.152:0/2094351660 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f697cf24640 1 --2- 172.21.15.152:0/2094351660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f3b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f6977fff640 1 --2- 172.21.15.152:0/2094351660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f3b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f697d725640 1 -- 172.21.15.152:0/2094351660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 msgr2=0x55c46f3b81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f697d725640 1 --2- 172.21.15.152:0/2094351660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f3b81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f697d725640 1 -- 172.21.15.152:0/2094351660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 msgr2=0x55c46f3b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f697d725640 1 --2- 172.21.15.152:0/2094351660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f3b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f697d725640 1 -- 172.21.15.152:0/2094351660 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c46f3b9330 con 0x55c46f3b9680 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f6977fff640 1 --2- 172.21.15.152:0/2094351660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f3b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f697d725640 1 --2- 172.21.15.152:0/2094351660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f3c1a00 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f69700142b0 tx=0x7f697001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580ebe0bff847464 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f69627fc640 1 -- 172.21.15.152:0/2094351660 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69700142e0 con 0x55c46f3b9680 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f69627fc640 1 -- 172.21.15.152:0/2094351660 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69700123f0 con 0x55c46f3b9680 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.619+0000 7f69627fc640 1 -- 172.21.15.152:0/2094351660 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697001fe60 con 0x55c46f3b9680 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.620+0000 7f6981561740 1 -- 172.21.15.152:0/2094351660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 msgr2=0x55c46f3c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.620+0000 7f6981561740 1 --2- 172.21.15.152:0/2094351660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f3c1a00 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f69700142b0 tx=0x7f697001d000 comp rx=0 tx=0).stop 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.620+0000 7f6981561740 1 -- 172.21.15.152:0/2094351660 shutdown_connections 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.620+0000 7f6981561740 1 --2- 172.21.15.152:0/2094351660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f3c1a00 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.620+0000 7f6981561740 1 --2- 172.21.15.152:0/2094351660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f3b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.620+0000 7f6981561740 1 --2- 172.21.15.152:0/2094351660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f3b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.620+0000 7f6981561740 1 -- 172.21.15.152:0/2094351660 >> 172.21.15.152:0/2094351660 conn(0x55c46f3aaa30 msgr2=0x55c46f3b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.620+0000 7f6981561740 1 -- 172.21.15.152:0/2094351660 shutdown_connections 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.620+0000 7f6981561740 1 -- 172.21.15.152:0/2094351660 wait complete. 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.620+0000 7f6981561740 1 -- start start 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.620+0000 7f6981561740 1 Processor -- start 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6981561740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f42b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6981561740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f42b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6981561740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f42f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6981561740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f69781ac200 con 0x55c46f3b9680 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6981561740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f69781ad670 con 0x55c46f3ae4a0 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6981561740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69781ac8d0 con 0x55c46f3aedc0 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6981561740 10 client.0 _ll_register_callbacks cb 0x7f6964009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f697cf24640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f42b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f697d725640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f42f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f697d725640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f42f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58694/0 (socket says 172.21.15.152:58694) 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f697d725640 1 -- 172.21.15.152:0/618366762 learned_addr learned my addr 172.21.15.152:0/618366762 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f697cf24640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f42b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55348/0 (socket says 172.21.15.152:55348) 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6977fff640 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f42b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f697d725640 1 -- 172.21.15.152:0/618366762 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 msgr2=0x55c46f42b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f697d725640 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f42b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f697d725640 1 -- 172.21.15.152:0/618366762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 msgr2=0x55c46f42b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f697d725640 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f42b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f697d725640 1 -- 172.21.15.152:0/618366762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c46f42fd90 con 0x55c46f3b9680 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f697d725640 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f42f6f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f6970012010 tx=0x7f6970009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f857b56cabe84a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6957fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6957fff640 1 -- 172.21.15.152:0/618366762 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697001f980 con 0x55c46f3b9680 2024-09-11T22:14:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6957fff640 1 -- 172.21.15.152:0/618366762 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8658+0+0 (secure 0 0 0) 0x7f697001fb20 con 0x55c46f3b9680 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.621+0000 7f6981561740 1 -- 172.21.15.152:0/618366762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69700123f0 con 0x55c46f3b9680 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f6957fff640 1 -- 172.21.15.152:0/618366762 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6970003970 con 0x55c46f3b9680 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f6981561740 10 client.17892 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f6981561740 1 -- 172.21.15.152:0/618366762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c46f4382a0 con 0x55c46f3b9680 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f6957fff640 1 -- 172.21.15.152:0/618366762 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69700123f0 con 0x55c46f3b9680 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f6957fff640 1 -- 172.21.15.152:0/618366762 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f6970026070 con 0x55c46f3b9680 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f6981561740 10 client.17892 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f6981561740 10 client.17892 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f6981561740 20 client.17892 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f6981561740 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c46f438980 0x55c46f43ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f6981561740 4 client.17892 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f6981561740 1 -- 172.21.15.152:0/618366762 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c46f3b6b40 con 0x55c46f438980 2024-09-11T22:14:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.622+0000 7f697cf24640 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c46f438980 0x55c46f43ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f697cf24640 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c46f438980 0x55c46f43ada0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f8067823017d051 server_cookie=e1f16796d7cdaee6 in_seq=0 out_seq=0 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6957fff640 10 client.17892 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6957fff640 1 -- 172.21.15.152:0/618366762 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c46f3b6b40 con 0x55c46f438980 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6957fff640 10 client.17892 handle_command_reply: tid=0 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 1 client.17892 shutdown 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 1 -- 172.21.15.152:0/618366762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 msgr2=0x55c46f42f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f42f6f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f6970012010 tx=0x7f6970009ea0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 1 -- 172.21.15.152:0/618366762 shutdown_connections 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c46f438980 0x55c46f43ada0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c46f3b9680 0x55c46f42f6f0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c46f3aedc0 0x55c46f42b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 1 --2- 172.21.15.152:0/618366762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c46f3ae4a0 0x55c46f42b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 1 -- 172.21.15.152:0/618366762 >> 172.21.15.152:0/618366762 conn(0x55c46f3aaa30 msgr2=0x55c46f3b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:12.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6957fff640 0 client.17892 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:12.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 1 -- 172.21.15.152:0/618366762 shutdown_connections 2024-09-11T22:14:12.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 1 -- 172.21.15.152:0/618366762 wait complete. 2024-09-11T22:14:12.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.623+0000 7f6981561740 20 client.17892 trim_cache size 0 max 16384 2024-09-11T22:14:12.633 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:14:12.633 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:14:12.633 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:14:12.633 INFO:teuthology.orchestra.run.smithi152.stdout: "16aab9e7-904a-4612-a151-a1fb7fc884fc": { 2024-09-11T22:14:12.633 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:14:12.634 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "16aab9e7-904a-4612-a151-a1fb7fc884fc", 2024-09-11T22:14:12.634 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:14:12.634 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:12.634 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:12.634 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 -- 172.21.15.152:0/2772192624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69680a2d70 msgr2=0x7f69680a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69680a2d70 0x7f69680a5230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6970009270 tx=0x7f6970009c90 comp rx=0 tx=0).stop 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 -- 172.21.15.152:0/2772192624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6978102de0 msgr2=0x7f69781984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6978102de0 0x7f69781984b0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f696c00b4a0 tx=0x7f696c00b960 comp rx=0 tx=0).stop 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 -- 172.21.15.152:0/2772192624 shutdown_connections 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69680a2d70 0x7f69680a5230 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f697810c180 0x7f697819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978103700 0x7f69781989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 --2- 172.21.15.152:0/2772192624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6978102de0 0x7f69781984b0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 -- 172.21.15.152:0/2772192624 >> 172.21.15.152:0/2772192624 conn(0x7f69780fc7a0 msgr2=0x7f69780fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 -- 172.21.15.152:0/2772192624 shutdown_connections 2024-09-11T22:14:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:12.624+0000 7f697f188640 1 -- 172.21.15.152:0/2772192624 wait complete. 2024-09-11T22:14:13.441 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:13 smithi152 ceph-mon[31188]: pgmap v307: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.8 MiB/s wr, 502 op/s 2024-09-11T22:14:13.469 INFO:tasks.cephfs.filesystem:scrub status for tag:16aab9e7-904a-4612-a151-a1fb7fc884fc - {'path': '/', 'tag': '16aab9e7-904a-4612-a151-a1fb7fc884fc', 'options': 'recursive,force'} 2024-09-11T22:14:13.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:13 smithi179 ceph-mon[35603]: pgmap v307: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.8 MiB/s wr, 502 op/s 2024-09-11T22:14:13.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:13 smithi193 ceph-mon[35545]: pgmap v307: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.8 MiB/s wr, 502 op/s 2024-09-11T22:14:14.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 520.0 s, 10.8 tps, lat 521.994 ms stddev 282.273 2024-09-11T22:14:15.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:15 smithi179 ceph-mon[35603]: pgmap v308: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.6 MiB/s wr, 336 op/s 2024-09-11T22:14:15.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:15 smithi179 ceph-mon[35603]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T22:14:15.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:15 smithi193 ceph-mon[35545]: pgmap v308: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.6 MiB/s wr, 336 op/s 2024-09-11T22:14:15.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:15 smithi193 ceph-mon[35545]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T22:14:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:15 smithi152 ceph-mon[31188]: pgmap v308: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.6 MiB/s wr, 336 op/s 2024-09-11T22:14:15.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:15 smithi152 ceph-mon[31188]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T22:14:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.906+0000 7f3f1391f640 1 -- 172.21.15.152:0/1738233059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f0c10c0d0 msgr2=0x7f3f0c10e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.906+0000 7f3f1391f640 1 --2- 172.21.15.152:0/1738233059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f0c10c0d0 0x7f3f0c10e590 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009ca0 tx=0x7f3f0402a950 comp rx=0 tx=0).stop 2024-09-11T22:14:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 -- 172.21.15.152:0/1738233059 shutdown_connections 2024-09-11T22:14:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 --2- 172.21.15.152:0/1738233059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f0c10c0d0 0x7f3f0c10e590 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 --2- 172.21.15.152:0/1738233059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c1035d0 0x7f3f0c10bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 --2- 172.21.15.152:0/1738233059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f0c102cb0 0x7f3f0c103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 -- 172.21.15.152:0/1738233059 >> 172.21.15.152:0/1738233059 conn(0x7f3f0c0fc6c0 msgr2=0x7f3f0c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 -- 172.21.15.152:0/1738233059 shutdown_connections 2024-09-11T22:14:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 -- 172.21.15.152:0/1738233059 wait complete. 2024-09-11T22:14:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 Processor -- start 2024-09-11T22:14:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 -- start start 2024-09-11T22:14:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f0c102cb0 0x7f3f0c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f0c1035d0 0x7f3f0c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c10c0d0 0x7f3f0c19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c111ef0 con 0x7f3f0c1035d0 2024-09-11T22:14:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c111d70 con 0x7f3f0c10c0d0 2024-09-11T22:14:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.907+0000 7f3f1391f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c112070 con 0x7f3f0c102cb0 2024-09-11T22:14:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f10eba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f0c1035d0 0x7f3f0c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f10eba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f0c1035d0 0x7f3f0c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33538/0 (socket says 172.21.15.152:33538) 2024-09-11T22:14:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f10eba640 1 -- 172.21.15.152:0/620981219 learned_addr learned my addr 172.21.15.152:0/620981219 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f116bb640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f0c102cb0 0x7f3f0c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f11ebc640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c10c0d0 0x7f3f0c19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f10eba640 1 -- 172.21.15.152:0/620981219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f0c102cb0 msgr2=0x7f3f0c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f10eba640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f0c102cb0 0x7f3f0c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f10eba640 1 -- 172.21.15.152:0/620981219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c10c0d0 msgr2=0x7f3f0c19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f10eba640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c10c0d0 0x7f3f0c19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f10eba640 1 -- 172.21.15.152:0/620981219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c19d2f0 con 0x7f3f0c1035d0 2024-09-11T22:14:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f11ebc640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c10c0d0 0x7f3f0c19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f10eba640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f0c1035d0 0x7f3f0c198840 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800d950 tx=0x7f3f0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f027fc640 1 -- 172.21.15.152:0/620981219 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08017070 con 0x7f3f0c1035d0 2024-09-11T22:14:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f027fc640 1 -- 172.21.15.152:0/620981219 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f08009c30 con 0x7f3f0c1035d0 2024-09-11T22:14:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f1391f640 1 -- 172.21.15.152:0/620981219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0c19d5e0 con 0x7f3f0c1035d0 2024-09-11T22:14:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f027fc640 1 -- 172.21.15.152:0/620981219 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0800f6b0 con 0x7f3f0c1035d0 2024-09-11T22:14:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.908+0000 7f3f1391f640 1 -- 172.21.15.152:0/620981219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f0c1a4e70 con 0x7f3f0c1035d0 2024-09-11T22:14:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.910+0000 7f3f027fc640 1 -- 172.21.15.152:0/620981219 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3f080109d0 con 0x7f3f0c1035d0 2024-09-11T22:14:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f166b4740 1 Processor -- start 2024-09-11T22:14:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f166b4740 1 -- start start 2024-09-11T22:14:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6dced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6dd410 0x56314a6e7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6e7cb0 0x56314a6ea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f166b4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56314a6412f0 con 0x56314a6dcaf0 2024-09-11T22:14:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f166b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56314a5e9270 con 0x56314a6e7cb0 2024-09-11T22:14:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f166b4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56314a63d2b0 con 0x56314a6dd410 2024-09-11T22:14:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f027fc640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef80a2da0 0x7f3ef80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f11ebc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6dced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f11ebc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6dced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33544/0 (socket says 172.21.15.152:33544) 2024-09-11T22:14:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f116bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6dd410 0x56314a6e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f11ebc640 1 -- 172.21.15.152:0/1880387737 learned_addr learned my addr 172.21.15.152:0/1880387737 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f11ebc640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef80a2da0 0x7f3ef80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f027fc640 1 -- 172.21.15.152:0/620981219 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f3f080cf100 con 0x7f3f0c1035d0 2024-09-11T22:14:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.911+0000 7f3f10eba640 1 --2- 172.21.15.152:0/1880387737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6e7cb0 0x56314a6ea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.912+0000 7f3f116bb640 1 -- 172.21.15.152:0/1880387737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6e7cb0 msgr2=0x56314a6ea0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.912+0000 7f3f116bb640 1 --2- 172.21.15.152:0/1880387737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6e7cb0 0x56314a6ea0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.912+0000 7f3f116bb640 1 -- 172.21.15.152:0/1880387737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 msgr2=0x56314a6dced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.912+0000 7f3f116bb640 1 --2- 172.21.15.152:0/1880387737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6dced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.912+0000 7f3f116bb640 1 -- 172.21.15.152:0/1880387737 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56314a5e8340 con 0x56314a6dd410 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.912+0000 7f3f11ebc640 1 --2- 172.21.15.152:0/1880387737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6dced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.912+0000 7f3f11ebc640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef80a2da0 0x7f3ef80a5260 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009a60 tx=0x7f3f040095c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.912+0000 7f3f116bb640 1 --2- 172.21.15.152:0/1880387737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6dd410 0x56314a6e7770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00bbe0 tx=0x7f3efc00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7379f82ecb438948 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.912+0000 7f3ef77fe640 1 -- 172.21.15.152:0/1880387737 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc015070 con 0x56314a6dd410 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.912+0000 7f3ef77fe640 1 -- 172.21.15.152:0/1880387737 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3efc005500 con 0x56314a6dd410 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.912+0000 7f3ef77fe640 1 -- 172.21.15.152:0/1880387737 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc011440 con 0x56314a6dd410 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.913+0000 7f3f166b4740 1 -- 172.21.15.152:0/1880387737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6dd410 msgr2=0x56314a6e7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.913+0000 7f3f166b4740 1 --2- 172.21.15.152:0/1880387737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6dd410 0x56314a6e7770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00bbe0 tx=0x7f3efc00f730 comp rx=0 tx=0).stop 2024-09-11T22:14:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.913+0000 7f3f166b4740 1 -- 172.21.15.152:0/1880387737 shutdown_connections 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.913+0000 7f3f166b4740 1 --2- 172.21.15.152:0/1880387737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6e7cb0 0x56314a6ea0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.913+0000 7f3f166b4740 1 --2- 172.21.15.152:0/1880387737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6dd410 0x56314a6e7770 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.913+0000 7f3f166b4740 1 --2- 172.21.15.152:0/1880387737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6dced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.913+0000 7f3f166b4740 1 -- 172.21.15.152:0/1880387737 >> 172.21.15.152:0/1880387737 conn(0x56314a6d9060 msgr2=0x56314a6d9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.913+0000 7f3f166b4740 1 -- 172.21.15.152:0/1880387737 shutdown_connections 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.913+0000 7f3f166b4740 1 -- 172.21.15.152:0/1880387737 wait complete. 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.913+0000 7f3f166b4740 1 -- start start 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.913+0000 7f3f166b4740 1 Processor -- start 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6dcaf0 0x56314a6e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6e7cb0 0x56314a6e5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f166b4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56314a6ea880 con 0x56314a6dd410 2024-09-11T22:14:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f166b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56314a5ca290 con 0x56314a6dcaf0 2024-09-11T22:14:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f166b4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56314a6eaa00 con 0x56314a6e7cb0 2024-09-11T22:14:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f166b4740 10 client.0 _ll_register_callbacks cb 0x56314a5fb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f10eba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f10eba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33554/0 (socket says 172.21.15.152:33554) 2024-09-11T22:14:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f10eba640 1 -- 172.21.15.152:0/3292939778 learned_addr learned my addr 172.21.15.152:0/3292939778 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f11ebc640 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6e7cb0 0x56314a6e5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f116bb640 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6dcaf0 0x56314a6e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f10eba640 1 -- 172.21.15.152:0/3292939778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6e7cb0 msgr2=0x56314a6e5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f10eba640 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6e7cb0 0x56314a6e5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f10eba640 1 -- 172.21.15.152:0/3292939778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6dcaf0 msgr2=0x56314a6e4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f10eba640 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6dcaf0 0x56314a6e4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f10eba640 1 -- 172.21.15.152:0/3292939778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56314a354210 con 0x56314a6dd410 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f10eba640 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e5140 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3f080ccdf0 tx=0x7f3f0809b100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfcc4ad83b916d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3ef4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/3292939778 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08020040 con 0x56314a6dd410 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/3292939778 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f3f0806a1b0 con 0x56314a6dd410 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.914+0000 7f3f166b4740 1 -- 172.21.15.152:0/3292939778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3efc005500 con 0x56314a6dd410 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/3292939778 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3f08009de0 con 0x56314a6dd410 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3f166b4740 10 client.17904 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3f166b4740 1 -- 172.21.15.152:0/3292939778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56314a420620 con 0x56314a6dd410 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/3292939778 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3efc005500 con 0x56314a6dd410 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/3292939778 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3f0806d0f0 con 0x56314a6dd410 2024-09-11T22:14:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3f166b4740 10 client.17904 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3f166b4740 10 client.17904 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3f166b4740 20 client.17904 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3f166b4740 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56314a6f7c70 0x56314a6fa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3f166b4740 4 client.17904 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3f166b4740 1 -- 172.21.15.152:0/3292939778 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56314a64ea20 con 0x56314a6f7c70 2024-09-11T22:14:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.915+0000 7f3f116bb640 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56314a6f7c70 0x56314a6fa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3ef4ff9640 10 client.17904 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3f116bb640 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56314a6f7c70 0x56314a6fa060 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=906a1294062d7a75 server_cookie=b27ae92a7cdaea0d in_seq=0 out_seq=0 2024-09-11T22:14:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/3292939778 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56314a64ea20 con 0x56314a6f7c70 2024-09-11T22:14:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3ef4ff9640 10 client.17904 handle_command_reply: tid=0 2024-09-11T22:14:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3f166b4740 1 client.17904 shutdown 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3f166b4740 1 -- 172.21.15.152:0/3292939778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 msgr2=0x56314a6e5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3f166b4740 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e5140 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3f080ccdf0 tx=0x7f3f0809b100 comp rx=0 tx=0).stop 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3f166b4740 1 -- 172.21.15.152:0/3292939778 shutdown_connections 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3f166b4740 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56314a6f7c70 0x56314a6fa060 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3f166b4740 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6e7cb0 0x56314a6e5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3f166b4740 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e5140 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3ef4ff9640 0 client.17904 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3f166b4740 1 --2- 172.21.15.152:0/3292939778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6dcaf0 0x56314a6e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.916+0000 7f3f166b4740 1 -- 172.21.15.152:0/3292939778 >> 172.21.15.152:0/3292939778 conn(0x56314a6d9060 msgr2=0x56314a6dedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.917+0000 7f3f166b4740 1 -- 172.21.15.152:0/3292939778 shutdown_connections 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.917+0000 7f3f166b4740 1 -- 172.21.15.152:0/3292939778 wait complete. 2024-09-11T22:14:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.917+0000 7f3f166b4740 20 client.17904 trim_cache size 0 max 16384 2024-09-11T22:14:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f166b4740 1 Processor -- start 2024-09-11T22:14:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f166b4740 1 -- start start 2024-09-11T22:14:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6dcaf0 0x56314a6df560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6e7cb0 0x56314a6f0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f166b4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1b01c0 con 0x56314a6dd410 2024-09-11T22:14:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f166b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1ada90 con 0x56314a6dcaf0 2024-09-11T22:14:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f166b4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1ab900 con 0x56314a6e7cb0 2024-09-11T22:14:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f10eba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f10eba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33562/0 (socket says 172.21.15.152:33562) 2024-09-11T22:14:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f10eba640 1 -- 172.21.15.152:0/3217345508 learned_addr learned my addr 172.21.15.152:0/3217345508 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f116bb640 1 --2- 172.21.15.152:0/3217345508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6dcaf0 0x56314a6df560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f11ebc640 1 --2- 172.21.15.152:0/3217345508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6e7cb0 0x56314a6f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f10eba640 1 -- 172.21.15.152:0/3217345508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6e7cb0 msgr2=0x56314a6f0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f10eba640 1 --2- 172.21.15.152:0/3217345508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6e7cb0 0x56314a6f0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f10eba640 1 -- 172.21.15.152:0/3217345508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6dcaf0 msgr2=0x56314a6df560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f10eba640 1 --2- 172.21.15.152:0/3217345508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6dcaf0 0x56314a6df560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f10eba640 1 -- 172.21.15.152:0/3217345508 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56314a6e7750 con 0x56314a6dd410 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3f10eba640 1 --2- 172.21.15.152:0/3217345508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e54b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3f0809b2c0 tx=0x7f3f08000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc3daba278e81e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/3217345508 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08020070 con 0x56314a6dd410 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/3217345508 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f0809b5c0 con 0x56314a6dd410 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.931+0000 7f3ef6ffd640 1 -- 172.21.15.152:0/3217345508 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0809ad10 con 0x56314a6dd410 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.932+0000 7f3f166b4740 1 -- 172.21.15.152:0/3217345508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 msgr2=0x56314a6e54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.932+0000 7f3f166b4740 1 --2- 172.21.15.152:0/3217345508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e54b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3f0809b2c0 tx=0x7f3f08000bc0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.932+0000 7f3f166b4740 1 -- 172.21.15.152:0/3217345508 shutdown_connections 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.932+0000 7f3f166b4740 1 --2- 172.21.15.152:0/3217345508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6e7cb0 0x56314a6f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.932+0000 7f3f166b4740 1 --2- 172.21.15.152:0/3217345508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dd410 0x56314a6e54b0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.932+0000 7f3f166b4740 1 --2- 172.21.15.152:0/3217345508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6dcaf0 0x56314a6df560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.932+0000 7f3f166b4740 1 -- 172.21.15.152:0/3217345508 >> 172.21.15.152:0/3217345508 conn(0x56314a6d9060 msgr2=0x56314a6e6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.932+0000 7f3f166b4740 1 -- 172.21.15.152:0/3217345508 shutdown_connections 2024-09-11T22:14:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.932+0000 7f3f166b4740 1 -- 172.21.15.152:0/3217345508 wait complete. 2024-09-11T22:14:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.932+0000 7f3f166b4740 1 -- start start 2024-09-11T22:14:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.932+0000 7f3f166b4740 1 Processor -- start 2024-09-11T22:14:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6ff650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6dd410 0x56314a6ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f166b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6e7cb0 0x56314a75ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f166b4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1abf50 con 0x56314a6dcaf0 2024-09-11T22:14:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f166b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1ad3c0 con 0x56314a6e7cb0 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f166b4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1ac620 con 0x56314a6dd410 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f166b4740 10 client.0 _ll_register_callbacks cb 0x7f3f080860b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f116bb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f116bb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6ff650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33578/0 (socket says 172.21.15.152:33578) 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f116bb640 1 -- 172.21.15.152:0/4023148074 learned_addr learned my addr 172.21.15.152:0/4023148074 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f10eba640 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6dd410 0x56314a6ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f11ebc640 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6e7cb0 0x56314a75ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f116bb640 1 -- 172.21.15.152:0/4023148074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6dd410 msgr2=0x56314a6ffb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f116bb640 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6dd410 0x56314a6ffb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f116bb640 1 -- 172.21.15.152:0/4023148074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6e7cb0 msgr2=0x56314a75ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f116bb640 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6e7cb0 0x56314a75ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f116bb640 1 -- 172.21.15.152:0/4023148074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56314a75e450 con 0x56314a6dcaf0 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f116bb640 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6ff650 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00b4a0 tx=0x7f3efc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f214d14fa123f9ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3ef4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/4023148074 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc02a020 con 0x56314a6dcaf0 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/4023148074 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f3efc027430 con 0x56314a6dcaf0 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.933+0000 7f3f166b4740 1 -- 172.21.15.152:0/4023148074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f0809b5c0 con 0x56314a6dcaf0 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/4023148074 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3efc015040 con 0x56314a6dcaf0 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3f166b4740 10 client.17910 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3f166b4740 1 -- 172.21.15.152:0/4023148074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56314a7669b0 con 0x56314a6dcaf0 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/4023148074 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f0809b5c0 con 0x56314a6dcaf0 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/4023148074 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3efc004e70 con 0x56314a6dcaf0 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3f166b4740 10 client.17910 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3f166b4740 10 client.17910 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3f166b4740 20 client.17910 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3f166b4740 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56314a766e50 0x56314a769240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3f166b4740 4 client.17910 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:14:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3f166b4740 1 -- 172.21.15.152:0/4023148074 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56314a648d70 con 0x56314a766e50 2024-09-11T22:14:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.934+0000 7f3f10eba640 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56314a766e50 0x56314a769240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.935+0000 7f3ef4ff9640 10 client.17910 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.935+0000 7f3f10eba640 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56314a766e50 0x56314a769240 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31caf0303d92f5e5 server_cookie=5f4b20aefd75ff1 in_seq=0 out_seq=0 2024-09-11T22:14:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.943+0000 7f3ef4ff9640 1 -- 172.21.15.152:0/4023148074 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56314a648d70 con 0x56314a766e50 2024-09-11T22:14:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.943+0000 7f3ef4ff9640 10 client.17910 handle_command_reply: tid=0 2024-09-11T22:14:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.943+0000 7f3f166b4740 1 client.17910 shutdown 2024-09-11T22:14:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f166b4740 1 -- 172.21.15.152:0/4023148074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 msgr2=0x56314a6ff650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f166b4740 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6ff650 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00b4a0 tx=0x7f3efc00b780 comp rx=0 tx=0).stop 2024-09-11T22:14:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f166b4740 1 -- 172.21.15.152:0/4023148074 shutdown_connections 2024-09-11T22:14:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f166b4740 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56314a766e50 0x56314a769240 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f166b4740 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56314a6e7cb0 0x56314a75ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3ef4ff9640 0 client.17910 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f166b4740 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56314a6dd410 0x56314a6ffb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f166b4740 1 --2- 172.21.15.152:0/4023148074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56314a6dcaf0 0x56314a6ff650 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f166b4740 1 -- 172.21.15.152:0/4023148074 >> 172.21.15.152:0/4023148074 conn(0x56314a6d9060 msgr2=0x56314a6d79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f166b4740 1 -- 172.21.15.152:0/4023148074 shutdown_connections 2024-09-11T22:14:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f166b4740 1 -- 172.21.15.152:0/4023148074 wait complete. 2024-09-11T22:14:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f166b4740 20 client.17910 trim_cache size 0 max 16384 2024-09-11T22:14:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:14:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:14:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:14:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:14:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f1391f640 1 -- 172.21.15.152:0/620981219 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef80a2da0 msgr2=0x7f3ef80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f1391f640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef80a2da0 0x7f3ef80a5260 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009a60 tx=0x7f3f040095c0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f1391f640 1 -- 172.21.15.152:0/620981219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f0c1035d0 msgr2=0x7f3f0c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f1391f640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f0c1035d0 0x7f3f0c198840 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800d950 tx=0x7f3f0800de10 comp rx=0 tx=0).stop 2024-09-11T22:14:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f1391f640 1 -- 172.21.15.152:0/620981219 shutdown_connections 2024-09-11T22:14:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f1391f640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ef80a2da0 0x7f3ef80a5260 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f1391f640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c10c0d0 0x7f3f0c19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f1391f640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f0c1035d0 0x7f3f0c198840 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f1391f640 1 --2- 172.21.15.152:0/620981219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f0c102cb0 0x7f3f0c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.944+0000 7f3f1391f640 1 -- 172.21.15.152:0/620981219 >> 172.21.15.152:0/620981219 conn(0x7f3f0c0fc6c0 msgr2=0x7f3f0c0fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.945+0000 7f3f1391f640 1 -- 172.21.15.152:0/620981219 shutdown_connections 2024-09-11T22:14:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:16.945+0000 7f3f1391f640 1 -- 172.21.15.152:0/620981219 wait complete. 2024-09-11T22:14:17.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:17 smithi179 ceph-mon[35603]: pgmap v310: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-11T22:14:17.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:17 smithi193 ceph-mon[35545]: pgmap v310: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-11T22:14:17.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:17 smithi152 ceph-mon[31188]: pgmap v310: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-11T22:14:19.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:19 smithi179 ceph-mon[35603]: pgmap v311: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-11T22:14:19.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:19 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:14:19.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:19 smithi193 ceph-mon[35545]: pgmap v311: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-11T22:14:19.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:19 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:14:19.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:19 smithi152 ceph-mon[31188]: pgmap v311: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-11T22:14:19.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:19 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:14:19.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:14:20.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:20 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:14:20.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:20 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:14:20.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:20 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:14:21.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:21 smithi179 ceph-mon[35603]: pgmap v312: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 1.3 MiB/s wr, 146 op/s 2024-09-11T22:14:21.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:21 smithi193 ceph-mon[35545]: pgmap v312: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 1.3 MiB/s wr, 146 op/s 2024-09-11T22:14:21.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:21 smithi152 ceph-mon[31188]: pgmap v312: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 1.3 MiB/s wr, 146 op/s 2024-09-11T22:14:23.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:23 smithi179 ceph-mon[35603]: pgmap v313: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 1.3 MiB/s wr, 146 op/s 2024-09-11T22:14:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:23 smithi193 ceph-mon[35545]: pgmap v313: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 1.3 MiB/s wr, 146 op/s 2024-09-11T22:14:23.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:23 smithi152 ceph-mon[31188]: pgmap v313: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 1.3 MiB/s wr, 146 op/s 2024-09-11T22:14:24.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:14:25.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:25 smithi179 ceph-mon[35603]: pgmap v314: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-09-11T22:14:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:25 smithi193 ceph-mon[35545]: pgmap v314: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-09-11T22:14:25.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:25 smithi152 ceph-mon[31188]: pgmap v314: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-09-11T22:14:27.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:27 smithi179 ceph-mon[35603]: pgmap v315: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 917 KiB/s wr, 78 op/s 2024-09-11T22:14:27.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:27 smithi193 ceph-mon[35545]: pgmap v315: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 917 KiB/s wr, 78 op/s 2024-09-11T22:14:27.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:27 smithi152 ceph-mon[31188]: pgmap v315: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 917 KiB/s wr, 78 op/s 2024-09-11T22:14:27.895 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:14:28.162 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:28.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.651+0000 7efdcb98b640 1 -- 172.21.15.152:0/3261077905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdc4102d30 msgr2=0x7efdc4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.651+0000 7efdcb98b640 1 --2- 172.21.15.152:0/3261077905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdc4102d30 0x7efdc4103110 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009930 tx=0x7efdc002a420 comp rx=0 tx=0).stop 2024-09-11T22:14:28.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.651+0000 7efdcb98b640 1 -- 172.21.15.152:0/3261077905 shutdown_connections 2024-09-11T22:14:28.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.651+0000 7efdcb98b640 1 --2- 172.21.15.152:0/3261077905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdc41082a0 0x7efdc410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.651+0000 7efdcb98b640 1 --2- 172.21.15.152:0/3261077905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc41036e0 0x7efdc4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.651+0000 7efdcb98b640 1 --2- 172.21.15.152:0/3261077905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdc4102d30 0x7efdc4103110 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.651+0000 7efdcb98b640 1 -- 172.21.15.152:0/3261077905 >> 172.21.15.152:0/3261077905 conn(0x7efdc40fc7d0 msgr2=0x7efdc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:28.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.651+0000 7efdcb98b640 1 -- 172.21.15.152:0/3261077905 shutdown_connections 2024-09-11T22:14:28.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.651+0000 7efdcb98b640 1 -- 172.21.15.152:0/3261077905 wait complete. 2024-09-11T22:14:28.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.651+0000 7efdcb98b640 1 Processor -- start 2024-09-11T22:14:28.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.651+0000 7efdcb98b640 1 -- start start 2024-09-11T22:14:28.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdcb98b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdc4102d30 0x7efdc4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdcb98b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdc41036e0 0x7efdc4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdcb98b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc41082a0 0x7efdc4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdcb98b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efdc41120a0 con 0x7efdc4102d30 2024-09-11T22:14:28.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdcb98b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efdc4111f20 con 0x7efdc41082a0 2024-09-11T22:14:28.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdcb98b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efdc4112220 con 0x7efdc41036e0 2024-09-11T22:14:28.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdc9727640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdc4102d30 0x7efdc4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdc9727640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdc4102d30 0x7efdc4100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49794/0 (socket says 172.21.15.152:49794) 2024-09-11T22:14:28.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdc9727640 1 -- 172.21.15.152:0/1142792976 learned_addr learned my addr 172.21.15.152:0/1142792976 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:28.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdc8f26640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdc41036e0 0x7efdc4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdc9f28640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc41082a0 0x7efdc4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdc9727640 1 -- 172.21.15.152:0/1142792976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdc41036e0 msgr2=0x7efdc4100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdc9727640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdc41036e0 0x7efdc4100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdc9727640 1 -- 172.21.15.152:0/1142792976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc41082a0 msgr2=0x7efdc4101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdc9727640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc41082a0 0x7efdc4101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdc9727640 1 -- 172.21.15.152:0/1142792976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc41a6a80 con 0x7efdc4102d30 2024-09-11T22:14:28.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdc9727640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdc4102d30 0x7efdc4100990 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009230 tx=0x7efdc0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:28.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdba7fc640 1 -- 172.21.15.152:0/1142792976 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc003f030 con 0x7efdc4102d30 2024-09-11T22:14:28.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdba7fc640 1 -- 172.21.15.152:0/1142792976 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdc0003ad0 con 0x7efdc4102d30 2024-09-11T22:14:28.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdcb98b640 1 -- 172.21.15.152:0/1142792976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc41a6d10 con 0x7efdc4102d30 2024-09-11T22:14:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdba7fc640 1 -- 172.21.15.152:0/1142792976 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0035070 con 0x7efdc4102d30 2024-09-11T22:14:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.652+0000 7efdcb98b640 1 -- 172.21.15.152:0/1142792976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc41a71a0 con 0x7efdc4102d30 2024-09-11T22:14:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.653+0000 7efdcb98b640 1 -- 172.21.15.152:0/1142792976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc4103110 con 0x7efdc4102d30 2024-09-11T22:14:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.655+0000 7efdba7fc640 1 -- 172.21.15.152:0/1142792976 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7efdc0042030 con 0x7efdc4102d30 2024-09-11T22:14:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.655+0000 7efdba7fc640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efdb00a2cf0 0x7efdb00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.655+0000 7efdc8f26640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efdb00a2cf0 0x7efdb00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.655+0000 7efdba7fc640 1 -- 172.21.15.152:0/1142792976 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7efdc00efd60 con 0x7efdc4102d30 2024-09-11T22:14:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.656+0000 7efdc8f26640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efdb00a2cf0 0x7efdb00a51b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efdc4102420 tx=0x7efdb400b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.659+0000 7efdba7fc640 1 -- 172.21.15.152:0/1142792976 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efdc00bc920 con 0x7efdc4102d30 2024-09-11T22:14:28.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.859+0000 7efdcb98b640 1 -- 172.21.15.152:0/1142792976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdc410a2b0 con 0x7efdc4102d30 2024-09-11T22:14:28.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.860+0000 7efdba7fc640 1 -- 172.21.15.152:0/1142792976 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7efdc00bc220 con 0x7efdc4102d30 2024-09-11T22:14:28.862 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:14:28.862 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:14:28.862 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:14:28.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.862+0000 7efdcb98b640 1 -- 172.21.15.152:0/1142792976 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efdb00a2cf0 msgr2=0x7efdb00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.862+0000 7efdcb98b640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efdb00a2cf0 0x7efdb00a51b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efdc4102420 tx=0x7efdb400b390 comp rx=0 tx=0).stop 2024-09-11T22:14:28.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.862+0000 7efdcb98b640 1 -- 172.21.15.152:0/1142792976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdc4102d30 msgr2=0x7efdc4100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.862+0000 7efdcb98b640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdc4102d30 0x7efdc4100990 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009230 tx=0x7efdc0004270 comp rx=0 tx=0).stop 2024-09-11T22:14:28.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.862+0000 7efdcb98b640 1 -- 172.21.15.152:0/1142792976 shutdown_connections 2024-09-11T22:14:28.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.862+0000 7efdcb98b640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efdb00a2cf0 0x7efdb00a51b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.862+0000 7efdcb98b640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc41082a0 0x7efdc4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.862+0000 7efdcb98b640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdc41036e0 0x7efdc4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.862+0000 7efdcb98b640 1 --2- 172.21.15.152:0/1142792976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdc4102d30 0x7efdc4100990 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.862+0000 7efdcb98b640 1 -- 172.21.15.152:0/1142792976 >> 172.21.15.152:0/1142792976 conn(0x7efdc40fc7d0 msgr2=0x7efdc4105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:28.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.862+0000 7efdcb98b640 1 -- 172.21.15.152:0/1142792976 shutdown_connections 2024-09-11T22:14:28.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:28.863+0000 7efdcb98b640 1 -- 172.21.15.152:0/1142792976 wait complete. 2024-09-11T22:14:29.146 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:29 smithi152 ceph-mon[31188]: pgmap v316: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 881 KiB/s wr, 75 op/s 2024-09-11T22:14:29.146 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:29 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1142792976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:29.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:29 smithi193 ceph-mon[35545]: pgmap v316: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 881 KiB/s wr, 75 op/s 2024-09-11T22:14:29.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:29 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1142792976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:29.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:29 smithi179 ceph-mon[35603]: pgmap v316: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 881 KiB/s wr, 75 op/s 2024-09-11T22:14:29.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:29 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1142792976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:29.753 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 200f4ef3 --release --await' 2024-09-11T22:14:29.754 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 200f4ef3 --release --await 2024-09-11T22:14:29.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:14:30.012 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.041+0000 7f3d4112c640 1 -- 172.21.15.152:0/410133800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d3c10c0d0 msgr2=0x7f3d3c10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.041+0000 7f3d4112c640 1 --2- 172.21.15.152:0/410133800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d3c10c0d0 0x7f3d3c10e570 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009ca0 tx=0x7f3d3402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.041+0000 7f3d4112c640 1 -- 172.21.15.152:0/410133800 shutdown_connections 2024-09-11T22:14:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.041+0000 7f3d4112c640 1 --2- 172.21.15.152:0/410133800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d3c10c0d0 0x7f3d3c10e570 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.041+0000 7f3d4112c640 1 --2- 172.21.15.152:0/410133800 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d3c1035c0 0x7f3d3c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.041+0000 7f3d4112c640 1 --2- 172.21.15.152:0/410133800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d3c102ca0 0x7f3d3c103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.041+0000 7f3d4112c640 1 -- 172.21.15.152:0/410133800 >> 172.21.15.152:0/410133800 conn(0x7f3d3c0fc6b0 msgr2=0x7f3d3c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.042+0000 7f3d4112c640 1 -- 172.21.15.152:0/410133800 shutdown_connections 2024-09-11T22:14:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.042+0000 7f3d4112c640 1 -- 172.21.15.152:0/410133800 wait complete. 2024-09-11T22:14:30.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.042+0000 7f3d4112c640 1 Processor -- start 2024-09-11T22:14:30.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d4112c640 1 -- start start 2024-09-11T22:14:30.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d4112c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d3c102ca0 0x7f3d3c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d4112c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d3c1035c0 0x7f3d3c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d4112c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d3c10c0d0 0x7f3d3c19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d4112c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c111ed0 con 0x7f3d3c1035c0 2024-09-11T22:14:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d4112c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c111d50 con 0x7f3d3c10c0d0 2024-09-11T22:14:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d4112c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c112050 con 0x7f3d3c102ca0 2024-09-11T22:14:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d3a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d3c1035c0 0x7f3d3c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d3a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d3c1035c0 0x7f3d3c198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49814/0 (socket says 172.21.15.152:49814) 2024-09-11T22:14:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d3a59c640 1 -- 172.21.15.152:0/3347850104 learned_addr learned my addr 172.21.15.152:0/3347850104 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d3b59e640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d3c10c0d0 0x7f3d3c19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.043+0000 7f3d3ad9d640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d3c102ca0 0x7f3d3c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.044+0000 7f3d3a59c640 1 -- 172.21.15.152:0/3347850104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d3c102ca0 msgr2=0x7f3d3c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.044+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d3c102ca0 0x7f3d3c1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.044+0000 7f3d3a59c640 1 -- 172.21.15.152:0/3347850104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d3c10c0d0 msgr2=0x7f3d3c19cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.044+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d3c10c0d0 0x7f3d3c19cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.044+0000 7f3d3a59c640 1 -- 172.21.15.152:0/3347850104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3c19d2d0 con 0x7f3d3c1035c0 2024-09-11T22:14:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.044+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d3c1035c0 0x7f3d3c198820 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000e9c0 tx=0x7f3d3000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.044+0000 7f3d23fff640 1 -- 172.21.15.152:0/3347850104 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000cd80 con 0x7f3d3c1035c0 2024-09-11T22:14:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.044+0000 7f3d23fff640 1 -- 172.21.15.152:0/3347850104 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d300035f0 con 0x7f3d3c1035c0 2024-09-11T22:14:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.044+0000 7f3d23fff640 1 -- 172.21.15.152:0/3347850104 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30010690 con 0x7f3d3c1035c0 2024-09-11T22:14:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.044+0000 7f3d4112c640 1 -- 172.21.15.152:0/3347850104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3c19d5c0 con 0x7f3d3c1035c0 2024-09-11T22:14:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.044+0000 7f3d4112c640 1 -- 172.21.15.152:0/3347850104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d3c1a4e50 con 0x7f3d3c1035c0 2024-09-11T22:14:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.047+0000 7f3d23fff640 1 -- 172.21.15.152:0/3347850104 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3d300037a0 con 0x7f3d3c1035c0 2024-09-11T22:14:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.047+0000 7f3d43ebd740 1 Processor -- start 2024-09-11T22:14:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.047+0000 7f3d43ebd740 1 -- start start 2024-09-11T22:14:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa63442ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d23fff640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3d240a2da0 0x7f3d240a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa6344dcb0 0x55aa634500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aa633a72f0 con 0x55aa63443410 2024-09-11T22:14:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55aa6334f270 con 0x55aa63442af0 2024-09-11T22:14:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55aa633a32b0 con 0x55aa6344dcb0 2024-09-11T22:14:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3b59e640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3d240a2da0 0x7f3d240a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d23fff640 1 -- 172.21.15.152:0/3347850104 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f3d300cf770 con 0x7f3d3c1035c0 2024-09-11T22:14:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3b59e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa6344dcb0 0x55aa634500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3ad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa63442ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49822/0 (socket says 172.21.15.152:49822) 2024-09-11T22:14:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3a59c640 1 -- 172.21.15.152:0/3926205921 learned_addr learned my addr 172.21.15.152:0/3926205921 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3a59c640 1 -- 172.21.15.152:0/3926205921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa6344dcb0 msgr2=0x55aa634500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/3926205921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa6344dcb0 0x55aa634500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3a59c640 1 -- 172.21.15.152:0/3926205921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 msgr2=0x55aa63442ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/3926205921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa63442ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3a59c640 1 -- 172.21.15.152:0/3926205921 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa6334e340 con 0x55aa63443410 2024-09-11T22:14:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.048+0000 7f3d3ad9d640 1 --2- 172.21.15.152:0/3926205921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa63442ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.049+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/3926205921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344d770 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3d300a4370 tx=0x7f3d3009b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68eaa6dce73906bf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.049+0000 7f3d3b59e640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3d240a2da0 0x7f3d240a5260 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d34004af0 tx=0x7f3d3402f450 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.050+0000 7f3d217fa640 1 -- 172.21.15.152:0/3926205921 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30086040 con 0x55aa63443410 2024-09-11T22:14:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.050+0000 7f3d217fa640 1 -- 172.21.15.152:0/3926205921 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d3009c330 con 0x55aa63443410 2024-09-11T22:14:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.050+0000 7f3d217fa640 1 -- 172.21.15.152:0/3926205921 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d300cd0e0 con 0x55aa63443410 2024-09-11T22:14:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.050+0000 7f3d43ebd740 1 -- 172.21.15.152:0/3926205921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 msgr2=0x55aa6344d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.050+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/3926205921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344d770 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3d300a4370 tx=0x7f3d3009b770 comp rx=0 tx=0).stop 2024-09-11T22:14:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.050+0000 7f3d43ebd740 1 -- 172.21.15.152:0/3926205921 shutdown_connections 2024-09-11T22:14:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.050+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/3926205921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa6344dcb0 0x55aa634500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.050+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/3926205921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344d770 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.050+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/3926205921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa63442ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.050+0000 7f3d43ebd740 1 -- 172.21.15.152:0/3926205921 >> 172.21.15.152:0/3926205921 conn(0x55aa6343f060 msgr2=0x55aa6343f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d43ebd740 1 -- 172.21.15.152:0/3926205921 shutdown_connections 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d43ebd740 1 -- 172.21.15.152:0/3926205921 wait complete. 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d43ebd740 1 -- start start 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d43ebd740 1 Processor -- start 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa6344ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa6344dcb0 0x55aa6344b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aa63454c90 con 0x55aa63443410 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55aa63330290 con 0x55aa63442af0 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55aa63454e10 con 0x55aa6344dcb0 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d43ebd740 10 client.0 _ll_register_callbacks cb 0x55aa63361140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d3a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d3a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49824/0 (socket says 172.21.15.152:49824) 2024-09-11T22:14:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d3a59c640 1 -- 172.21.15.152:0/1352042030 learned_addr learned my addr 172.21.15.152:0/1352042030 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d3b59e640 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa6344dcb0 0x55aa6344b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.051+0000 7f3d3ad9d640 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa6344ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d3a59c640 1 -- 172.21.15.152:0/1352042030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa6344dcb0 msgr2=0x55aa6344b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa6344dcb0 0x55aa6344b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d3a59c640 1 -- 172.21.15.152:0/1352042030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 msgr2=0x55aa6344ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa6344ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d3a59c640 1 -- 172.21.15.152:0/1352042030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa630ba210 con 0x55aa63443410 2024-09-11T22:14:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344b170 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3d30098090 tx=0x7f3d30003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad651572d971d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d1eff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d1eff5640 1 -- 172.21.15.152:0/1352042030 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30086040 con 0x55aa63443410 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d1eff5640 1 -- 172.21.15.152:0/1352042030 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f3d300a4410 con 0x55aa63443410 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d43ebd740 1 -- 172.21.15.152:0/1352042030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d3009c330 con 0x55aa63443410 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d1eff5640 1 -- 172.21.15.152:0/1352042030 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3d3009bc30 con 0x55aa63443410 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d43ebd740 10 client.17928 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d43ebd740 1 -- 172.21.15.152:0/1352042030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55aa63186620 con 0x55aa63443410 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.052+0000 7f3d1eff5640 1 -- 172.21.15.152:0/1352042030 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d3009c330 con 0x55aa63443410 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.053+0000 7f3d1eff5640 1 -- 172.21.15.152:0/1352042030 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3d3009b110 con 0x55aa63443410 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.053+0000 7f3d43ebd740 10 client.17928 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.053+0000 7f3d43ebd740 10 client.17928 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.053+0000 7f3d43ebd740 20 client.17928 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.053+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55aa63461f30 0x55aa63464320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.053+0000 7f3d43ebd740 4 client.17928 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.053+0000 7f3d43ebd740 1 -- 172.21.15.152:0/1352042030 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa633b4a20 con 0x55aa63461f30 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.053+0000 7f3d3ad9d640 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55aa63461f30 0x55aa63464320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.053+0000 7f3d3ad9d640 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55aa63461f30 0x55aa63464320 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a07bdfc9c75cee6 server_cookie=8ec3372529a83dad in_seq=0 out_seq=0 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.053+0000 7f3d1eff5640 10 client.17928 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d1eff5640 1 -- 172.21.15.152:0/1352042030 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa633b4a20 con 0x55aa63461f30 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d1eff5640 10 client.17928 handle_command_reply: tid=0 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 1 client.17928 shutdown 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 1 -- 172.21.15.152:0/1352042030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 msgr2=0x55aa6344b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344b170 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3d30098090 tx=0x7f3d30003d40 comp rx=0 tx=0).stop 2024-09-11T22:14:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 1 -- 172.21.15.152:0/1352042030 shutdown_connections 2024-09-11T22:14:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55aa63461f30 0x55aa63464320 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa6344dcb0 0x55aa6344b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63443410 0x55aa6344b170 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d1eff5640 0 client.17928 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/1352042030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa6344ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 1 -- 172.21.15.152:0/1352042030 >> 172.21.15.152:0/1352042030 conn(0x55aa6343f060 msgr2=0x55aa63444dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 1 -- 172.21.15.152:0/1352042030 shutdown_connections 2024-09-11T22:14:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 1 -- 172.21.15.152:0/1352042030 wait complete. 2024-09-11T22:14:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.054+0000 7f3d43ebd740 20 client.17928 trim_cache size 0 max 16384 2024-09-11T22:14:30.074 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.068+0000 7f3d43ebd740 1 Processor -- start 2024-09-11T22:14:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.068+0000 7f3d43ebd740 1 -- start start 2024-09-11T22:14:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa6344c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa63443410 0x55aa6344b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa6344dcb0 0x55aa634698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c1ae010 con 0x55aa6344dcb0 2024-09-11T22:14:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c1ab8e0 con 0x55aa63442af0 2024-09-11T22:14:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c1a9750 con 0x55aa63443410 2024-09-11T22:14:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3b59e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa6344dcb0 0x55aa634698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3b59e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa6344dcb0 0x55aa634698f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49828/0 (socket says 172.21.15.152:49828) 2024-09-11T22:14:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3b59e640 1 -- 172.21.15.152:0/3132900681 learned_addr learned my addr 172.21.15.152:0/3132900681 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3ad9d640 1 --2- 172.21.15.152:0/3132900681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa6344c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/3132900681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa63443410 0x55aa6344b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3b59e640 1 -- 172.21.15.152:0/3132900681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa63443410 msgr2=0x55aa6344b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3b59e640 1 --2- 172.21.15.152:0/3132900681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa63443410 0x55aa6344b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3b59e640 1 -- 172.21.15.152:0/3132900681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 msgr2=0x55aa6344c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3b59e640 1 --2- 172.21.15.152:0/3132900681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa6344c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3b59e640 1 -- 172.21.15.152:0/3132900681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa63443240 con 0x55aa6344dcb0 2024-09-11T22:14:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3ad9d640 1 --2- 172.21.15.152:0/3132900681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa6344c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/3132900681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa63443410 0x55aa6344b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d3b59e640 1 --2- 172.21.15.152:0/3132900681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa6344dcb0 0x55aa634698f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009ca0 tx=0x7f3d34049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d545fcda76a7b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d20ff9640 1 -- 172.21.15.152:0/3132900681 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34041040 con 0x55aa6344dcb0 2024-09-11T22:14:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d20ff9640 1 -- 172.21.15.152:0/3132900681 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d34036040 con 0x55aa6344dcb0 2024-09-11T22:14:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.069+0000 7f3d20ff9640 1 -- 172.21.15.152:0/3132900681 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3402fd20 con 0x55aa6344dcb0 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.070+0000 7f3d43ebd740 1 -- 172.21.15.152:0/3132900681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa6344dcb0 msgr2=0x55aa634698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.070+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/3132900681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa6344dcb0 0x55aa634698f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009ca0 tx=0x7f3d34049000 comp rx=0 tx=0).stop 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.070+0000 7f3d43ebd740 1 -- 172.21.15.152:0/3132900681 shutdown_connections 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.070+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/3132900681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa6344dcb0 0x55aa634698f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.070+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/3132900681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa63443410 0x55aa6344b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.070+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/3132900681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa63442af0 0x55aa6344c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.070+0000 7f3d43ebd740 1 -- 172.21.15.152:0/3132900681 >> 172.21.15.152:0/3132900681 conn(0x55aa6343f060 msgr2=0x55aa63444d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.070+0000 7f3d43ebd740 1 -- 172.21.15.152:0/3132900681 shutdown_connections 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.070+0000 7f3d43ebd740 1 -- 172.21.15.152:0/3132900681 wait complete. 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.070+0000 7f3d43ebd740 1 -- start start 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.070+0000 7f3d43ebd740 1 Processor -- start 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63442af0 0x55aa6345a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa63443410 0x55aa63455be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d43ebd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa6344dcb0 0x55aa63456180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c1a9da0 con 0x55aa63442af0 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c1ab210 con 0x55aa6344dcb0 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d43ebd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c1aa470 con 0x55aa63443410 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d43ebd740 10 client.0 _ll_register_callbacks cb 0x7f3d2c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63442af0 0x55aa6345a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63442af0 0x55aa6345a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49834/0 (socket says 172.21.15.152:49834) 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3ad9d640 1 -- 172.21.15.152:0/2443759468 learned_addr learned my addr 172.21.15.152:0/2443759468 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3b59e640 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa6344dcb0 0x55aa63456180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa63443410 0x55aa63455be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3ad9d640 1 -- 172.21.15.152:0/2443759468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa63443410 msgr2=0x55aa63455be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3ad9d640 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa63443410 0x55aa63455be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3ad9d640 1 -- 172.21.15.152:0/2443759468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa6344dcb0 msgr2=0x55aa63456180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3ad9d640 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa6344dcb0 0x55aa63456180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3ad9d640 1 -- 172.21.15.152:0/2443759468 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa634569b0 con 0x55aa63442af0 2024-09-11T22:14:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3b59e640 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa6344dcb0 0x55aa63456180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d3ad9d640 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63442af0 0x55aa6345a8c0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c000c00 tx=0x7f3d2c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fb3ec841c43ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d1eff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d1eff5640 1 -- 172.21.15.152:0/2443759468 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c027630 con 0x55aa63442af0 2024-09-11T22:14:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d1eff5640 1 -- 172.21.15.152:0/2443759468 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f3d2c0277d0 con 0x55aa63442af0 2024-09-11T22:14:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.071+0000 7f3d43ebd740 1 -- 172.21.15.152:0/2443759468 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d34036040 con 0x55aa63442af0 2024-09-11T22:14:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d1eff5640 1 -- 172.21.15.152:0/2443759468 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3d2c0279d0 con 0x55aa63442af0 2024-09-11T22:14:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d43ebd740 10 client.17934 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d43ebd740 1 -- 172.21.15.152:0/2443759468 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55aa634cc970 con 0x55aa63442af0 2024-09-11T22:14:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d1eff5640 1 -- 172.21.15.152:0/2443759468 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d34036040 con 0x55aa63442af0 2024-09-11T22:14:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d1eff5640 1 -- 172.21.15.152:0/2443759468 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3d2c02f410 con 0x55aa63442af0 2024-09-11T22:14:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d43ebd740 10 client.17934 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d43ebd740 10 client.17934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d43ebd740 20 client.17934 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55aa634cd0c0 0x55aa634cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d43ebd740 4 client.17934 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:14:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d43ebd740 1 -- 172.21.15.152:0/2443759468 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aa633aed70 con 0x55aa634cd0c0 2024-09-11T22:14:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.072+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55aa634cd0c0 0x55aa634cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.073+0000 7f3d1eff5640 10 client.17934 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.073+0000 7f3d3a59c640 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55aa634cd0c0 0x55aa634cf4e0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e55921f6e828b224 server_cookie=765bbc912804b836 in_seq=0 out_seq=0 2024-09-11T22:14:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d1eff5640 1 -- 172.21.15.152:0/2443759468 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aa633aed70 con 0x55aa634cd0c0 2024-09-11T22:14:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d1eff5640 10 client.17934 handle_command_reply: tid=0 2024-09-11T22:14:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 1 client.17934 shutdown 2024-09-11T22:14:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 1 -- 172.21.15.152:0/2443759468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63442af0 msgr2=0x55aa6345a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63442af0 0x55aa6345a8c0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c000c00 tx=0x7f3d2c005870 comp rx=0 tx=0).stop 2024-09-11T22:14:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 1 -- 172.21.15.152:0/2443759468 shutdown_connections 2024-09-11T22:14:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55aa634cd0c0 0x55aa634cf4e0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aa6344dcb0 0x55aa63456180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d1eff5640 0 client.17934 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aa63443410 0x55aa63455be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 1 --2- 172.21.15.152:0/2443759468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa63442af0 0x55aa6345a8c0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 1 -- 172.21.15.152:0/2443759468 >> 172.21.15.152:0/2443759468 conn(0x55aa6343f060 msgr2=0x55aa634444c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 1 -- 172.21.15.152:0/2443759468 shutdown_connections 2024-09-11T22:14:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 1 -- 172.21.15.152:0/2443759468 wait complete. 2024-09-11T22:14:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.081+0000 7f3d43ebd740 20 client.17934 trim_cache size 0 max 16384 2024-09-11T22:14:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:14:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:14:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:14:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:14:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 -- 172.21.15.152:0/3347850104 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3d240a2da0 msgr2=0x7f3d240a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3d240a2da0 0x7f3d240a5260 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d34004af0 tx=0x7f3d3402f450 comp rx=0 tx=0).stop 2024-09-11T22:14:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 -- 172.21.15.152:0/3347850104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d3c1035c0 msgr2=0x7f3d3c198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d3c1035c0 0x7f3d3c198820 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000e9c0 tx=0x7f3d3000ee80 comp rx=0 tx=0).stop 2024-09-11T22:14:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 -- 172.21.15.152:0/3347850104 shutdown_connections 2024-09-11T22:14:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3d240a2da0 0x7f3d240a5260 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d3c10c0d0 0x7f3d3c19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d3c1035c0 0x7f3d3c198820 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 --2- 172.21.15.152:0/3347850104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d3c102ca0 0x7f3d3c1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 -- 172.21.15.152:0/3347850104 >> 172.21.15.152:0/3347850104 conn(0x7f3d3c0fc6b0 msgr2=0x7f3d3c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 -- 172.21.15.152:0/3347850104 shutdown_connections 2024-09-11T22:14:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:30.082+0000 7f3d4112c640 1 -- 172.21.15.152:0/3347850104 wait complete. 2024-09-11T22:14:30.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.474+0000 7f3f87e8e640 1 -- 172.21.15.152:0/521099292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f80102570 msgr2=0x7f3f801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.474+0000 7f3f87e8e640 1 --2- 172.21.15.152:0/521099292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f80102570 0x7f3f801029b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009900 tx=0x7f3f7402a480 comp rx=0 tx=0).stop 2024-09-11T22:14:30.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.474+0000 7f3f87e8e640 1 -- 172.21.15.152:0/521099292 shutdown_connections 2024-09-11T22:14:30.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.474+0000 7f3f87e8e640 1 --2- 172.21.15.152:0/521099292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f80102ef0 0x7f3f8010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.474+0000 7f3f87e8e640 1 --2- 172.21.15.152:0/521099292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f80102570 0x7f3f801029b0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.474+0000 7f3f87e8e640 1 --2- 172.21.15.152:0/521099292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f80100e20 0x7f3f80101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.474+0000 7f3f87e8e640 1 -- 172.21.15.152:0/521099292 >> 172.21.15.152:0/521099292 conn(0x7f3f800fc7d0 msgr2=0x7f3f800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.474+0000 7f3f87e8e640 1 -- 172.21.15.152:0/521099292 shutdown_connections 2024-09-11T22:14:30.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.474+0000 7f3f87e8e640 1 -- 172.21.15.152:0/521099292 wait complete. 2024-09-11T22:14:30.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f87e8e640 1 Processor -- start 2024-09-11T22:14:30.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f87e8e640 1 -- start start 2024-09-11T22:14:30.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f87e8e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f80100e20 0x7f3f80198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f87e8e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f80102570 0x7f3f80198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f87e8e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f80102ef0 0x7f3f8019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f87e8e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f80110f80 con 0x7f3f80102ef0 2024-09-11T22:14:30.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f87e8e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f80110e00 con 0x7f3f80100e20 2024-09-11T22:14:30.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f87e8e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f80111100 con 0x7f3f80102570 2024-09-11T22:14:30.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f8642b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f80102ef0 0x7f3f8019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f8642b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f80102ef0 0x7f3f8019ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49862/0 (socket says 172.21.15.152:49862) 2024-09-11T22:14:30.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f8642b640 1 -- 172.21.15.152:0/3774279757 learned_addr learned my addr 172.21.15.152:0/3774279757 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f85c2a640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f80100e20 0x7f3f80198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f85429640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f80102570 0x7f3f80198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f8642b640 1 -- 172.21.15.152:0/3774279757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f80102570 msgr2=0x7f3f80198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f8642b640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f80102570 0x7f3f80198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f8642b640 1 -- 172.21.15.152:0/3774279757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f80100e20 msgr2=0x7f3f80198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f8642b640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f80100e20 0x7f3f80198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.475+0000 7f3f8642b640 1 -- 172.21.15.152:0/3774279757 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8019d4e0 con 0x7f3f80102ef0 2024-09-11T22:14:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.476+0000 7f3f8642b640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f80102ef0 0x7f3f8019ce00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800e970 tx=0x7f3f7800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.476+0000 7f3f7effd640 1 -- 172.21.15.152:0/3774279757 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800ccc0 con 0x7f3f80102ef0 2024-09-11T22:14:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.476+0000 7f3f7effd640 1 -- 172.21.15.152:0/3774279757 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f7800ce60 con 0x7f3f80102ef0 2024-09-11T22:14:30.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.476+0000 7f3f87e8e640 1 -- 172.21.15.152:0/3774279757 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8019d7d0 con 0x7f3f80102ef0 2024-09-11T22:14:30.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.476+0000 7f3f87e8e640 1 -- 172.21.15.152:0/3774279757 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f801a50b0 con 0x7f3f80102ef0 2024-09-11T22:14:30.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.476+0000 7f3f7effd640 1 -- 172.21.15.152:0/3774279757 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78010490 con 0x7f3f80102ef0 2024-09-11T22:14:30.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.478+0000 7f3f7effd640 1 -- 172.21.15.152:0/3774279757 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3f780046c0 con 0x7f3f80102ef0 2024-09-11T22:14:30.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.478+0000 7f3f8a267740 1 Processor -- start 2024-09-11T22:14:30.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f8a267740 1 -- start start 2024-09-11T22:14:30.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6ee3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 0x557ab6ef2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ef2650 0x557ab6ef4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f8a267740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557ab6e48620 con 0x557ab6ee2f40 2024-09-11T22:14:30.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f8a267740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557ab6defe50 con 0x557ab6ee3860 2024-09-11T22:14:30.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f8a267740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557ab6e445e0 con 0x557ab6ef2650 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f85429640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6ee3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f7effd640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f680a2d70 0x7f3f680a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f85429640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6ee3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49866/0 (socket says 172.21.15.152:49866) 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f85429640 1 -- 172.21.15.152:0/3581529081 learned_addr learned my addr 172.21.15.152:0/3581529081 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f85c2a640 1 --2- 172.21.15.152:0/3581529081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 0x557ab6ef2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f8642b640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f680a2d70 0x7f3f680a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f85429640 1 --2- 172.21.15.152:0/3581529081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ef2650 0x557ab6ef4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f85429640 1 -- 172.21.15.152:0/3581529081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ef2650 msgr2=0x557ab6ef4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f85429640 1 --2- 172.21.15.152:0/3581529081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ef2650 0x557ab6ef4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f85429640 1 -- 172.21.15.152:0/3581529081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 msgr2=0x557ab6ef2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f85429640 1 --2- 172.21.15.152:0/3581529081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 0x557ab6ef2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f7effd640 1 -- 172.21.15.152:0/3774279757 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f3f780cf790 con 0x7f3f80102ef0 2024-09-11T22:14:30.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f85429640 1 -- 172.21.15.152:0/3581529081 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab6de0d40 con 0x557ab6ee2f40 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.479+0000 7f3f85c2a640 1 --2- 172.21.15.152:0/3581529081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 0x557ab6ef2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.480+0000 7f3f85429640 1 --2- 172.21.15.152:0/3581529081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6ee3320 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f3f740096c0 tx=0x7f3f74031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4e31bba81061aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.480+0000 7f3f8642b640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f680a2d70 0x7f3f680a5230 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3f7809bbe0 tx=0x7f3f780c67e0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.480+0000 7f3f67fff640 1 -- 172.21.15.152:0/3581529081 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74043020 con 0x557ab6ee2f40 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.480+0000 7f3f67fff640 1 -- 172.21.15.152:0/3581529081 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f740044c0 con 0x557ab6ee2f40 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.480+0000 7f3f67fff640 1 -- 172.21.15.152:0/3581529081 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74035070 con 0x557ab6ee2f40 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.481+0000 7f3f8a267740 1 -- 172.21.15.152:0/3581529081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 msgr2=0x557ab6ee3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.481+0000 7f3f8a267740 1 --2- 172.21.15.152:0/3581529081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6ee3320 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f3f740096c0 tx=0x7f3f74031400 comp rx=0 tx=0).stop 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.481+0000 7f3f8a267740 1 -- 172.21.15.152:0/3581529081 shutdown_connections 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.481+0000 7f3f8a267740 1 --2- 172.21.15.152:0/3581529081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ef2650 0x557ab6ef4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.481+0000 7f3f8a267740 1 --2- 172.21.15.152:0/3581529081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 0x557ab6ef2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.481+0000 7f3f8a267740 1 --2- 172.21.15.152:0/3581529081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6ee3320 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.481+0000 7f3f8a267740 1 -- 172.21.15.152:0/3581529081 >> 172.21.15.152:0/3581529081 conn(0x557ab6edf5f0 msgr2=0x557ab6edf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.481+0000 7f3f8a267740 1 -- 172.21.15.152:0/3581529081 shutdown_connections 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.481+0000 7f3f8a267740 1 -- 172.21.15.152:0/3581529081 wait complete. 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.481+0000 7f3f8a267740 1 -- start start 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.481+0000 7f3f8a267740 1 Processor -- start 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6eef550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee3860 0x557ab6eefa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ef2650 0x557ab6eeffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f8a267740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557ab6ef5220 con 0x557ab6ee2f40 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f8a267740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557ab6dd0f10 con 0x557ab6ef2650 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f8a267740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557ab6ef53a0 con 0x557ab6ee3860 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f8a267740 10 client.0 _ll_register_callbacks cb 0x557ab6df4db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f85429640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6eef550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f85c2a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee3860 0x557ab6eefa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f85429640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6eef550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49878/0 (socket says 172.21.15.152:49878) 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f85429640 1 -- 172.21.15.152:0/1478919631 learned_addr learned my addr 172.21.15.152:0/1478919631 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f85429640 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ef2650 0x557ab6eeffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f85429640 1 -- 172.21.15.152:0/1478919631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee3860 msgr2=0x557ab6eefa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f85429640 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee3860 0x557ab6eefa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f85429640 1 -- 172.21.15.152:0/1478919631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ef2650 msgr2=0x557ab6eeffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f85429640 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ef2650 0x557ab6eeffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f85429640 1 -- 172.21.15.152:0/1478919631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ab6b57580 con 0x557ab6ee2f40 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f85429640 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6eef550 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f3f7402a4c0 tx=0x7f3f74004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73cce6b55381ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f657fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f657fa640 1 -- 172.21.15.152:0/1478919631 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74043070 con 0x557ab6ee2f40 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f657fa640 1 -- 172.21.15.152:0/1478919631 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f3f74031540 con 0x557ab6ee2f40 2024-09-11T22:14:30.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.482+0000 7f3f8a267740 1 -- 172.21.15.152:0/1478919631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ab6e55b90 con 0x557ab6ee2f40 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f657fa640 1 -- 172.21.15.152:0/1478919631 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3f74035040 con 0x557ab6ee2f40 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f8a267740 10 client.17946 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f8a267740 1 -- 172.21.15.152:0/1478919631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557ab6c21960 con 0x557ab6ee2f40 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f657fa640 1 -- 172.21.15.152:0/1478919631 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557ab6e55b90 con 0x557ab6ee2f40 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f657fa640 1 -- 172.21.15.152:0/1478919631 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3f7403d680 con 0x557ab6ee2f40 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f8a267740 10 client.17946 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f8a267740 10 client.17946 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f8a267740 20 client.17946 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f8a267740 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557ab6f020e0 0x557ab6f044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f8a267740 4 client.17946 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f8a267740 1 -- 172.21.15.152:0/1478919631 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ab6e500a0 con 0x557ab6f020e0 2024-09-11T22:14:30.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.483+0000 7f3f85c2a640 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557ab6f020e0 0x557ab6f044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.484+0000 7f3f85c2a640 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557ab6f020e0 0x557ab6f044d0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78dad769eb7f46da server_cookie=ddb0edd81eddfdf9 in_seq=0 out_seq=0 2024-09-11T22:14:30.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.484+0000 7f3f657fa640 10 client.17946 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:30.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.484+0000 7f3f657fa640 1 -- 172.21.15.152:0/1478919631 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ab6e500a0 con 0x557ab6f020e0 2024-09-11T22:14:30.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.484+0000 7f3f657fa640 10 client.17946 handle_command_reply: tid=0 2024-09-11T22:14:30.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.484+0000 7f3f8a267740 1 client.17946 shutdown 2024-09-11T22:14:30.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.484+0000 7f3f8a267740 1 -- 172.21.15.152:0/1478919631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 msgr2=0x557ab6eef550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.484+0000 7f3f8a267740 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6eef550 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f3f7402a4c0 tx=0x7f3f74004d20 comp rx=0 tx=0).stop 2024-09-11T22:14:30.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.485+0000 7f3f8a267740 1 -- 172.21.15.152:0/1478919631 shutdown_connections 2024-09-11T22:14:30.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.485+0000 7f3f8a267740 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557ab6f020e0 0x557ab6f044d0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.485+0000 7f3f8a267740 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ef2650 0x557ab6eeffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.485+0000 7f3f8a267740 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee3860 0x557ab6eefa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.485+0000 7f3f657fa640 0 client.17946 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:30.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.485+0000 7f3f8a267740 1 --2- 172.21.15.152:0/1478919631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6eef550 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.485+0000 7f3f8a267740 1 -- 172.21.15.152:0/1478919631 >> 172.21.15.152:0/1478919631 conn(0x557ab6edf5f0 msgr2=0x557ab6ee5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.485+0000 7f3f8a267740 1 -- 172.21.15.152:0/1478919631 shutdown_connections 2024-09-11T22:14:30.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.485+0000 7f3f8a267740 1 -- 172.21.15.152:0/1478919631 wait complete. 2024-09-11T22:14:30.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.485+0000 7f3f8a267740 20 client.17946 trim_cache size 0 max 16384 2024-09-11T22:14:30.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.501+0000 7f3f8a267740 1 Processor -- start 2024-09-11T22:14:30.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.501+0000 7f3f8a267740 1 -- start start 2024-09-11T22:14:30.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.501+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee2f40 0x557ab6eec7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.501+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 0x557ab6eecd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.501+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ef2650 0x557ab6eef510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.501+0000 7f3f8a267740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c011170 con 0x557ab6ef2650 2024-09-11T22:14:30.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.501+0000 7f3f8a267740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c00ea40 con 0x557ab6ee3860 2024-09-11T22:14:30.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.501+0000 7f3f8a267740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c00c8b0 con 0x557ab6ee2f40 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.501+0000 7f3f85429640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ef2650 0x557ab6eef510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.501+0000 7f3f85429640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ef2650 0x557ab6eef510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49882/0 (socket says 172.21.15.152:49882) 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f85429640 1 -- 172.21.15.152:0/4183802427 learned_addr learned my addr 172.21.15.152:0/4183802427 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f85c2a640 1 --2- 172.21.15.152:0/4183802427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 0x557ab6eecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f85429640 1 --2- 172.21.15.152:0/4183802427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee2f40 0x557ab6eec7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f85429640 1 -- 172.21.15.152:0/4183802427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee2f40 msgr2=0x557ab6eec7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f85429640 1 --2- 172.21.15.152:0/4183802427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee2f40 0x557ab6eec7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f85429640 1 -- 172.21.15.152:0/4183802427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 msgr2=0x557ab6eecd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f85429640 1 --2- 172.21.15.152:0/4183802427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 0x557ab6eecd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f85429640 1 -- 172.21.15.152:0/4183802427 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab6eee500 con 0x557ab6ef2650 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f85c2a640 1 --2- 172.21.15.152:0/4183802427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 0x557ab6eecd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f85429640 1 --2- 172.21.15.152:0/4183802427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ef2650 0x557ab6eef510 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f3f7403dc90 tx=0x7f3f7404c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8310e8c60a02ed38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f677fe640 1 -- 172.21.15.152:0/4183802427 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74043070 con 0x557ab6ef2650 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f677fe640 1 -- 172.21.15.152:0/4183802427 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f74050070 con 0x557ab6ef2650 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.502+0000 7f3f677fe640 1 -- 172.21.15.152:0/4183802427 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74031c60 con 0x557ab6ef2650 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.503+0000 7f3f8a267740 1 -- 172.21.15.152:0/4183802427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ef2650 msgr2=0x557ab6eef510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.503+0000 7f3f8a267740 1 --2- 172.21.15.152:0/4183802427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ef2650 0x557ab6eef510 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f3f7403dc90 tx=0x7f3f7404c040 comp rx=0 tx=0).stop 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.503+0000 7f3f8a267740 1 -- 172.21.15.152:0/4183802427 shutdown_connections 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.503+0000 7f3f8a267740 1 --2- 172.21.15.152:0/4183802427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ef2650 0x557ab6eef510 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.503+0000 7f3f8a267740 1 --2- 172.21.15.152:0/4183802427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ee3860 0x557ab6eecd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.503+0000 7f3f8a267740 1 --2- 172.21.15.152:0/4183802427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee2f40 0x557ab6eec7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.503+0000 7f3f8a267740 1 -- 172.21.15.152:0/4183802427 >> 172.21.15.152:0/4183802427 conn(0x557ab6edf5f0 msgr2=0x557ab6efd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.503+0000 7f3f8a267740 1 -- 172.21.15.152:0/4183802427 shutdown_connections 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.503+0000 7f3f8a267740 1 -- 172.21.15.152:0/4183802427 wait complete. 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.503+0000 7f3f8a267740 1 -- start start 2024-09-11T22:14:30.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.503+0000 7f3f8a267740 1 Processor -- start 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6f079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee3860 0x557ab6f05d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f8a267740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ef2650 0x557ab6f062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f8a267740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c00cf00 con 0x557ab6ee2f40 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f8a267740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c00e370 con 0x557ab6ef2650 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f8a267740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c00d5d0 con 0x557ab6ee3860 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f8a267740 10 client.0 _ll_register_callbacks cb 0x7f3f74009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f85429640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6f079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f85429640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6f079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49896/0 (socket says 172.21.15.152:49896) 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f85429640 1 -- 172.21.15.152:0/3788186569 learned_addr learned my addr 172.21.15.152:0/3788186569 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f85c2a640 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee3860 0x557ab6f05d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f85429640 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ef2650 0x557ab6f062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f85429640 1 -- 172.21.15.152:0/3788186569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee3860 msgr2=0x557ab6f05d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f85429640 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee3860 0x557ab6f05d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f85429640 1 -- 172.21.15.152:0/3788186569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ef2650 msgr2=0x557ab6f062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f85429640 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ef2650 0x557ab6f062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f85429640 1 -- 172.21.15.152:0/3788186569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ab6eda930 con 0x557ab6ee2f40 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f85429640 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6f079c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3f7402a4c0 tx=0x7f3f7403d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292f704fae2fd306 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f657fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f657fa640 1 -- 172.21.15.152:0/3788186569 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74043040 con 0x557ab6ee2f40 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f657fa640 1 -- 172.21.15.152:0/3788186569 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f3f7403a9e0 con 0x557ab6ee2f40 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f8a267740 1 -- 172.21.15.152:0/3788186569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f74050070 con 0x557ab6ee2f40 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f657fa640 1 -- 172.21.15.152:0/3788186569 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3f74005400 con 0x557ab6ee2f40 2024-09-11T22:14:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.504+0000 7f3f8a267740 10 client.17952 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.505+0000 7f3f8a267740 1 -- 172.21.15.152:0/3788186569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557ab6ee3690 con 0x557ab6ee2f40 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.505+0000 7f3f657fa640 1 -- 172.21.15.152:0/3788186569 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f74050070 con 0x557ab6ee2f40 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.505+0000 7f3f657fa640 1 -- 172.21.15.152:0/3788186569 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f3f74031b40 con 0x557ab6ee2f40 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.505+0000 7f3f8a267740 10 client.17952 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.505+0000 7f3f8a267740 10 client.17952 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.505+0000 7f3f8a267740 20 client.17952 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.505+0000 7f3f8a267740 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557ab6f6d8f0 0x557ab6f6fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.505+0000 7f3f8a267740 4 client.17952 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "200f4ef3", "release": true, "await": true}] 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.505+0000 7f3f8a267740 1 -- 172.21.15.152:0/3788186569 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "200f4ef3", "release": true, "await": true}) -- 0x557ab6dcc5a0 con 0x557ab6f6d8f0 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.505+0000 7f3f85c2a640 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557ab6f6d8f0 0x557ab6f6fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.506+0000 7f3f85c2a640 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557ab6f6d8f0 0x557ab6f6fce0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fe971b50eabd5e3 server_cookie=4ba3c3782a5e3cdf in_seq=0 out_seq=0 2024-09-11T22:14:30.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.506+0000 7f3f657fa640 10 client.17952 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:30.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.554+0000 7f3f657fa640 1 -- 172.21.15.152:0/3788186569 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557ab6dcc5a0 con 0x557ab6f6d8f0 2024-09-11T22:14:30.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.554+0000 7f3f657fa640 10 client.17952 handle_command_reply: tid=0 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.554+0000 7f3f8a267740 1 client.17952 shutdown 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f8a267740 1 -- 172.21.15.152:0/3788186569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 msgr2=0x557ab6f079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f8a267740 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6f079c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3f7402a4c0 tx=0x7f3f7403d8e0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f8a267740 1 -- 172.21.15.152:0/3788186569 shutdown_connections 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f8a267740 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557ab6f6d8f0 0x557ab6f6fce0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f8a267740 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ab6ef2650 0x557ab6f062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f8a267740 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557ab6ee3860 0x557ab6f05d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f8a267740 1 --2- 172.21.15.152:0/3788186569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ab6ee2f40 0x557ab6f079c0 secure :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3f7402a4c0 tx=0x7f3f7403d8e0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f8a267740 1 -- 172.21.15.152:0/3788186569 >> 172.21.15.152:0/3788186569 conn(0x557ab6edf5f0 msgr2=0x557ab6ee4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f657fa640 0 client.17952 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f8a267740 1 -- 172.21.15.152:0/3788186569 shutdown_connections 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f8a267740 1 -- 172.21.15.152:0/3788186569 wait complete. 2024-09-11T22:14:30.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.555+0000 7f3f8a267740 20 client.17952 trim_cache size 0 max 16384 2024-09-11T22:14:30.559 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:14:30.559 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:14:30.559 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:14:30.560 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 40, 2024-09-11T22:14:30.560 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:14:30.560 INFO:teuthology.orchestra.run.smithi152.stdout: "200f4ef3": { 2024-09-11T22:14:30.560 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 40, 2024-09-11T22:14:30.560 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:14:30.560 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:14:30.560 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 142.6, 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:30.561 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:30.562 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:30.562 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:30.562 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:30.562 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:14:30.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.556+0000 7f3f87e8e640 1 -- 172.21.15.152:0/3774279757 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f680a2d70 msgr2=0x7f3f680a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.556+0000 7f3f87e8e640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f680a2d70 0x7f3f680a5230 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3f7809bbe0 tx=0x7f3f780c67e0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.556+0000 7f3f87e8e640 1 -- 172.21.15.152:0/3774279757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f80102ef0 msgr2=0x7f3f8019ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.556+0000 7f3f87e8e640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f80102ef0 0x7f3f8019ce00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800e970 tx=0x7f3f7800ed70 comp rx=0 tx=0).stop 2024-09-11T22:14:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.556+0000 7f3f87e8e640 1 -- 172.21.15.152:0/3774279757 shutdown_connections 2024-09-11T22:14:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.556+0000 7f3f87e8e640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3f680a2d70 0x7f3f680a5230 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.556+0000 7f3f87e8e640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f80102ef0 0x7f3f8019ce00 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.556+0000 7f3f87e8e640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f80102570 0x7f3f80198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.556+0000 7f3f87e8e640 1 --2- 172.21.15.152:0/3774279757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f80100e20 0x7f3f80198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.556+0000 7f3f87e8e640 1 -- 172.21.15.152:0/3774279757 >> 172.21.15.152:0/3774279757 conn(0x7f3f800fc7d0 msgr2=0x7f3f8006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.557+0000 7f3f87e8e640 1 -- 172.21.15.152:0/3774279757 shutdown_connections 2024-09-11T22:14:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:30.557+0000 7f3f87e8e640 1 -- 172.21.15.152:0/3774279757 wait complete. 2024-09-11T22:14:31.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:31 smithi152 ceph-mon[31188]: pgmap v317: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 MiB/s wr, 1.19k op/s 2024-09-11T22:14:31.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:31 smithi193 ceph-mon[35545]: pgmap v317: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 MiB/s wr, 1.19k op/s 2024-09-11T22:14:31.477 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '200f4ef3', total seconds elapsed: 26.2 2024-09-11T22:14:31.477 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.55 2024-09-11T22:14:31.478 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:14:31.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:31 smithi179 ceph-mon[35603]: pgmap v317: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 MiB/s wr, 1.19k op/s 2024-09-11T22:14:31.876 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:32.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.443+0000 7f6964eb5640 1 -- 172.21.15.152:0/995322796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6960101430 msgr2=0x7f696010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:32.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.443+0000 7f6964eb5640 1 --2- 172.21.15.152:0/995322796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6960101430 0x7f696010d960 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f6958009cd0 tx=0x7f695802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.443+0000 7f6964eb5640 1 -- 172.21.15.152:0/995322796 shutdown_connections 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.443+0000 7f6964eb5640 1 --2- 172.21.15.152:0/995322796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6960101430 0x7f696010d960 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.443+0000 7f6964eb5640 1 --2- 172.21.15.152:0/995322796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6960100a90 0x7f6960100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.443+0000 7f6964eb5640 1 --2- 172.21.15.152:0/995322796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960106a90 0x7f6960106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.443+0000 7f6964eb5640 1 -- 172.21.15.152:0/995322796 >> 172.21.15.152:0/995322796 conn(0x7f69600fc7d0 msgr2=0x7f69600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.443+0000 7f6964eb5640 1 -- 172.21.15.152:0/995322796 shutdown_connections 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.443+0000 7f6964eb5640 1 -- 172.21.15.152:0/995322796 wait complete. 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.444+0000 7f6964eb5640 1 Processor -- start 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.444+0000 7f6964eb5640 1 -- start start 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f6964eb5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6960100a90 0x7f69601079e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f6964eb5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960101430 0x7f6960107f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:32.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f6964eb5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6960106a90 0x7f6960108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f6964eb5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6960111fe0 con 0x7f6960100a90 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f6964eb5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6960111e60 con 0x7f6960106a90 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f6964eb5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6960112160 con 0x7f6960101430 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f6957fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960101430 0x7f6960107f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f6957fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960101430 0x7f6960107f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:36776/0 (socket says 172.21.15.152:36776) 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f6957fff640 1 -- 172.21.15.152:0/914848217 learned_addr learned my addr 172.21.15.152:0/914848217 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f695e59c640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6960100a90 0x7f69601079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f695ed9d640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6960106a90 0x7f6960108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f695ed9d640 1 -- 172.21.15.152:0/914848217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960101430 msgr2=0x7f6960107f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f695ed9d640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960101430 0x7f6960107f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f695ed9d640 1 -- 172.21.15.152:0/914848217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6960100a90 msgr2=0x7f69601079e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:32.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f695ed9d640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6960100a90 0x7f69601079e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:32.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.445+0000 7f695ed9d640 1 -- 172.21.15.152:0/914848217 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69601aad00 con 0x7f6960106a90 2024-09-11T22:14:32.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.446+0000 7f695ed9d640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6960106a90 0x7f6960108460 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f695802ae00 tx=0x7f6958031e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:32.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.446+0000 7f69577fe640 1 -- 172.21.15.152:0/914848217 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958004040 con 0x7f6960106a90 2024-09-11T22:14:32.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.446+0000 7f69577fe640 1 -- 172.21.15.152:0/914848217 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69580046c0 con 0x7f6960106a90 2024-09-11T22:14:32.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.446+0000 7f69577fe640 1 -- 172.21.15.152:0/914848217 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958030ec0 con 0x7f6960106a90 2024-09-11T22:14:32.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.446+0000 7f6964eb5640 1 -- 172.21.15.152:0/914848217 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69601aaf90 con 0x7f6960106a90 2024-09-11T22:14:32.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.446+0000 7f6964eb5640 1 -- 172.21.15.152:0/914848217 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69601ab3f0 con 0x7f6960106a90 2024-09-11T22:14:32.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.448+0000 7f6964eb5640 1 -- 172.21.15.152:0/914848217 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69601021d0 con 0x7f6960106a90 2024-09-11T22:14:32.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.452+0000 7f69577fe640 1 -- 172.21.15.152:0/914848217 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f69580305a0 con 0x7f6960106a90 2024-09-11T22:14:32.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.453+0000 7f69577fe640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f694c0a2f90 0x7f694c0a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:32.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.453+0000 7f69577fe640 1 -- 172.21.15.152:0/914848217 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f695802e030 con 0x7f6960106a90 2024-09-11T22:14:32.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.458+0000 7f695e59c640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f694c0a2f90 0x7f694c0a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:32.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.462+0000 7f69577fe640 1 -- 172.21.15.152:0/914848217 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f695804b060 con 0x7f6960106a90 2024-09-11T22:14:32.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.472+0000 7f695e59c640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f694c0a2f90 0x7f694c0a5450 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6950005d00 tx=0x7f695000b410 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:32.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.797+0000 7f6964eb5640 1 -- 172.21.15.152:0/914848217 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6960108f10 con 0x7f6960106a90 2024-09-11T22:14:32.799 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:14:32.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.798+0000 7f69577fe640 1 -- 172.21.15.152:0/914848217 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f6960108f10 con 0x7f6960106a90 2024-09-11T22:14:32.799 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:14:32.800 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:14:32.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 -- 172.21.15.152:0/914848217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f694c0a2f90 msgr2=0x7f694c0a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:32.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f694c0a2f90 0x7f694c0a5450 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6950005d00 tx=0x7f695000b410 comp rx=0 tx=0).stop 2024-09-11T22:14:32.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 -- 172.21.15.152:0/914848217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6960106a90 msgr2=0x7f6960108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:32.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6960106a90 0x7f6960108460 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f695802ae00 tx=0x7f6958031e60 comp rx=0 tx=0).stop 2024-09-11T22:14:32.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 -- 172.21.15.152:0/914848217 shutdown_connections 2024-09-11T22:14:32.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f694c0a2f90 0x7f694c0a5450 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:32.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6960106a90 0x7f6960108460 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:32.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960101430 0x7f6960107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:32.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 --2- 172.21.15.152:0/914848217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6960100a90 0x7f69601079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:32.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 -- 172.21.15.152:0/914848217 >> 172.21.15.152:0/914848217 conn(0x7f69600fc7d0 msgr2=0x7f69600fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:32.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 -- 172.21.15.152:0/914848217 shutdown_connections 2024-09-11T22:14:32.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:32.801+0000 7f6964eb5640 1 -- 172.21.15.152:0/914848217 wait complete. 2024-09-11T22:14:33.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:33 smithi193 ceph-mon[35545]: pgmap v318: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 1.12k op/s 2024-09-11T22:14:33.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:33 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/914848217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:33.347 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:33 smithi179 ceph-mon[35603]: pgmap v318: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 1.12k op/s 2024-09-11T22:14:33.347 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:33 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/914848217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:33.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:33 smithi152 ceph-mon[31188]: pgmap v318: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 1.12k op/s 2024-09-11T22:14:33.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:33 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/914848217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:33.564 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0' 2024-09-11T22:14:33.565 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0 2024-09-11T22:14:33.915 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:34.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.463+0000 7fa884689640 1 -- 172.21.15.152:0/2923079422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa87c108290 msgr2=0x7fa87c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.463+0000 7fa884689640 1 --2- 172.21.15.152:0/2923079422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa87c108290 0x7fa87c10ec30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa874009ca0 tx=0x7fa87402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.463+0000 7fa884689640 1 -- 172.21.15.152:0/2923079422 shutdown_connections 2024-09-11T22:14:34.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.463+0000 7fa884689640 1 --2- 172.21.15.152:0/2923079422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa87c108290 0x7fa87c10ec30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.463+0000 7fa884689640 1 --2- 172.21.15.152:0/2923079422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87c103740 0x7fa87c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.463+0000 7fa884689640 1 --2- 172.21.15.152:0/2923079422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa87c102d90 0x7fa87c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.463+0000 7fa884689640 1 -- 172.21.15.152:0/2923079422 >> 172.21.15.152:0/2923079422 conn(0x7fa87c0fc7d0 msgr2=0x7fa87c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:34.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.464+0000 7fa884689640 1 -- 172.21.15.152:0/2923079422 shutdown_connections 2024-09-11T22:14:34.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.464+0000 7fa884689640 1 -- 172.21.15.152:0/2923079422 wait complete. 2024-09-11T22:14:34.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.464+0000 7fa884689640 1 Processor -- start 2024-09-11T22:14:34.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.464+0000 7fa884689640 1 -- start start 2024-09-11T22:14:34.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa884689640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa87c102d90 0x7fa87c1a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa884689640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa87c103740 0x7fa87c1a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa884689640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87c108290 0x7fa87c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa884689640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c1120d0 con 0x7fa87c103740 2024-09-11T22:14:34.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa884689640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c111f50 con 0x7fa87c108290 2024-09-11T22:14:34.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa884689640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c112250 con 0x7fa87c102d90 2024-09-11T22:14:34.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa882425640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa87c102d90 0x7fa87c1a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa882425640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa87c102d90 0x7fa87c1a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:56064/0 (socket says 172.21.15.152:56064) 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa882425640 1 -- 172.21.15.152:0/426698478 learned_addr learned my addr 172.21.15.152:0/426698478 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa881c24640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa87c103740 0x7fa87c1a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa882c26640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87c108290 0x7fa87c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa882425640 1 -- 172.21.15.152:0/426698478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87c108290 msgr2=0x7fa87c19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa882425640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87c108290 0x7fa87c19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa882425640 1 -- 172.21.15.152:0/426698478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa87c103740 msgr2=0x7fa87c1a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa882425640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa87c103740 0x7fa87c1a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa882425640 1 -- 172.21.15.152:0/426698478 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c19aef0 con 0x7fa87c102d90 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.465+0000 7fa881c24640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa87c103740 0x7fa87c1a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.466+0000 7fa882425640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa87c102d90 0x7fa87c1a0560 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa87800e9f0 tx=0x7fa87800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.466+0000 7fa8737fe640 1 -- 172.21.15.152:0/426698478 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87800cd80 con 0x7fa87c102d90 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.466+0000 7fa884689640 1 -- 172.21.15.152:0/426698478 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87c19b1e0 con 0x7fa87c102d90 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.466+0000 7fa8737fe640 1 -- 172.21.15.152:0/426698478 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa878010910 con 0x7fa87c102d90 2024-09-11T22:14:34.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.466+0000 7fa8737fe640 1 -- 172.21.15.152:0/426698478 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa878018990 con 0x7fa87c102d90 2024-09-11T22:14:34.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.466+0000 7fa884689640 1 -- 172.21.15.152:0/426698478 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87c1a7550 con 0x7fa87c102d90 2024-09-11T22:14:34.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.469+0000 7fa886a62740 1 Processor -- start 2024-09-11T22:14:34.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa886a62740 1 -- start start 2024-09-11T22:14:34.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa886a62740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc686c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa886a62740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc687170 0x562adc6914f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa886a62740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc693e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa886a62740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562adc5eb160 con 0x562adc686850 2024-09-11T22:14:34.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa886a62740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562adc592720 con 0x562adc691a30 2024-09-11T22:14:34.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa886a62740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562adc5e7120 con 0x562adc687170 2024-09-11T22:14:34.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa8737fe640 1 -- 172.21.15.152:0/426698478 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa878010ac0 con 0x7fa87c102d90 2024-09-11T22:14:34.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa882c26640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc686c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa882c26640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc686c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38132/0 (socket says 172.21.15.152:38132) 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa882c26640 1 -- 172.21.15.152:0/418138288 learned_addr learned my addr 172.21.15.152:0/418138288 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.470+0000 7fa881c24640 1 --2- 172.21.15.152:0/418138288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc693e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.471+0000 7fa882c26640 1 -- 172.21.15.152:0/418138288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc687170 msgr2=0x562adc6914f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.471+0000 7fa882425640 1 --2- 172.21.15.152:0/418138288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc687170 0x562adc6914f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.472+0000 7fa882c26640 1 --2- 172.21.15.152:0/418138288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc687170 0x562adc6914f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.472+0000 7fa882c26640 1 -- 172.21.15.152:0/418138288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 msgr2=0x562adc693e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.472+0000 7fa882c26640 1 --2- 172.21.15.152:0/418138288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc693e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.472+0000 7fa882c26640 1 -- 172.21.15.152:0/418138288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562adc35cba0 con 0x562adc686850 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.472+0000 7fa881c24640 1 --2- 172.21.15.152:0/418138288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc693e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.472+0000 7fa882425640 1 --2- 172.21.15.152:0/418138288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc687170 0x562adc6914f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.472+0000 7fa8737fe640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8680a2d70 0x7fa8680a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.472+0000 7fa882425640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8680a2d70 0x7fa8680a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.472+0000 7fa882c26640 1 --2- 172.21.15.152:0/418138288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc686c30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa874005fe0 tx=0x7fa8740098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c8222e435b1397 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.472+0000 7fa8737fe640 1 -- 172.21.15.152:0/426698478 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7fa8780cf8e0 con 0x7fa87c102d90 2024-09-11T22:14:34.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.473+0000 7fa870ff9640 1 -- 172.21.15.152:0/418138288 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874031730 con 0x562adc686850 2024-09-11T22:14:34.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.473+0000 7fa882425640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8680a2d70 0x7fa8680a5230 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8780cd080 tx=0x7fa878018420 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.473+0000 7fa870ff9640 1 -- 172.21.15.152:0/418138288 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa874036030 con 0x562adc686850 2024-09-11T22:14:34.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.473+0000 7fa870ff9640 1 -- 172.21.15.152:0/418138288 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874030c20 con 0x562adc686850 2024-09-11T22:14:34.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.473+0000 7fa886a62740 1 -- 172.21.15.152:0/418138288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 msgr2=0x562adc686c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.473+0000 7fa886a62740 1 --2- 172.21.15.152:0/418138288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc686c30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa874005fe0 tx=0x7fa8740098b0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.473+0000 7fa886a62740 1 -- 172.21.15.152:0/418138288 shutdown_connections 2024-09-11T22:14:34.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 --2- 172.21.15.152:0/418138288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc693e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 --2- 172.21.15.152:0/418138288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc687170 0x562adc6914f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 --2- 172.21.15.152:0/418138288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc686c30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 -- 172.21.15.152:0/418138288 >> 172.21.15.152:0/418138288 conn(0x562adc682de0 msgr2=0x562adc6831c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 -- 172.21.15.152:0/418138288 shutdown_connections 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 -- 172.21.15.152:0/418138288 wait complete. 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 -- start start 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 Processor -- start 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc686850 0x562adc68e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 0x562adc68ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc68f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562adc694600 con 0x562adc687170 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562adc573900 con 0x562adc691a30 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562adc694780 con 0x562adc686850 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.474+0000 7fa886a62740 10 client.0 _ll_register_callbacks cb 0x562adc571780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:34.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa881c24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 0x562adc68ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa882c26640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc686850 0x562adc68e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa881c24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 0x562adc68ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38138/0 (socket says 172.21.15.152:38138) 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa881c24640 1 -- 172.21.15.152:0/2776025630 learned_addr learned my addr 172.21.15.152:0/2776025630 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa882c26640 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc68f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa882c26640 1 -- 172.21.15.152:0/2776025630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 msgr2=0x562adc68f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa882c26640 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc68f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa882c26640 1 -- 172.21.15.152:0/2776025630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 msgr2=0x562adc68ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa882c26640 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 0x562adc68ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa882c26640 1 -- 172.21.15.152:0/2776025630 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562adc5b3c50 con 0x562adc686850 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa882c26640 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc686850 0x562adc68e940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa874009920 tx=0x7fa874003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27215af6e1311a30 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.475+0000 7fa865ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:14:34.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.476+0000 7fa865ffb640 1 -- 172.21.15.152:0/2776025630 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874058060 con 0x562adc686850 2024-09-11T22:14:34.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.476+0000 7fa865ffb640 1 -- 172.21.15.152:0/2776025630 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7fa8740319f0 con 0x562adc686850 2024-09-11T22:14:34.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.476+0000 7fa886a62740 1 -- 172.21.15.152:0/2776025630 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa874036030 con 0x562adc686850 2024-09-11T22:14:34.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.476+0000 7fa865ffb640 1 -- 172.21.15.152:0/2776025630 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa874031bf0 con 0x562adc686850 2024-09-11T22:14:34.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.476+0000 7fa886a62740 10 client.27469 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:34.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.476+0000 7fa886a62740 1 -- 172.21.15.152:0/2776025630 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562adc694600 con 0x562adc686850 2024-09-11T22:14:34.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.477+0000 7fa865ffb640 1 -- 172.21.15.152:0/2776025630 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa874036030 con 0x562adc686850 2024-09-11T22:14:34.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.477+0000 7fa865ffb640 1 -- 172.21.15.152:0/2776025630 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa874042070 con 0x562adc686850 2024-09-11T22:14:34.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.477+0000 7fa886a62740 10 client.27469 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:34.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.477+0000 7fa886a62740 10 client.27469 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:14:34.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.477+0000 7fa886a62740 20 client.27469 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:34.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.477+0000 7fa886a62740 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562adc6a13b0 0x562adc6a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.477+0000 7fa886a62740 4 client.27469 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:34.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.477+0000 7fa886a62740 1 -- 172.21.15.152:0/2776025630 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562adc5f8890 con 0x562adc6a13b0 2024-09-11T22:14:34.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.477+0000 7fa881c24640 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562adc6a13b0 0x562adc6a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.477+0000 7fa865ffb640 10 client.27469 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.478+0000 7fa881c24640 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562adc6a13b0 0x562adc6a37a0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba15113591e82607 server_cookie=9a840746b9e5d990 in_seq=0 out_seq=0 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.479+0000 7fa865ffb640 1 -- 172.21.15.152:0/2776025630 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562adc5f8890 con 0x562adc6a13b0 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.479+0000 7fa865ffb640 10 client.27469 handle_command_reply: tid=0 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.479+0000 7fa886a62740 1 client.27469 shutdown 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.479+0000 7fa886a62740 1 -- 172.21.15.152:0/2776025630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc686850 msgr2=0x562adc68e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.479+0000 7fa886a62740 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc686850 0x562adc68e940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa874009920 tx=0x7fa874003f10 comp rx=0 tx=0).stop 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.479+0000 7fa886a62740 1 -- 172.21.15.152:0/2776025630 shutdown_connections 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.479+0000 7fa886a62740 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562adc6a13b0 0x562adc6a37a0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.479+0000 7fa886a62740 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc68f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.479+0000 7fa886a62740 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 0x562adc68ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.479+0000 7fa886a62740 1 --2- 172.21.15.152:0/2776025630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc686850 0x562adc68e940 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.479+0000 7fa886a62740 1 -- 172.21.15.152:0/2776025630 >> 172.21.15.152:0/2776025630 conn(0x562adc682de0 msgr2=0x562adc681ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:34.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.480+0000 7fa865ffb640 0 client.27469 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:34.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.480+0000 7fa886a62740 1 -- 172.21.15.152:0/2776025630 shutdown_connections 2024-09-11T22:14:34.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.480+0000 7fa886a62740 1 -- 172.21.15.152:0/2776025630 wait complete. 2024-09-11T22:14:34.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.480+0000 7fa886a62740 20 client.27469 trim_cache size 0 max 16384 2024-09-11T22:14:34.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.502+0000 7fa886a62740 1 Processor -- start 2024-09-11T22:14:34.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.502+0000 7fa886a62740 1 -- start start 2024-09-11T22:14:34.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa886a62740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc6a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa886a62740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc687170 0x562adc6a9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa886a62740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc6882a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa886a62740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c1ae120 con 0x562adc686850 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa886a62740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c1ab9f0 con 0x562adc691a30 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa886a62740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c1a98e0 con 0x562adc687170 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa882c26640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc6a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa882c26640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc6a8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38144/0 (socket says 172.21.15.152:38144) 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa882c26640 1 -- 172.21.15.152:0/2146078308 learned_addr learned my addr 172.21.15.152:0/2146078308 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa881c24640 1 --2- 172.21.15.152:0/2146078308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc687170 0x562adc6a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa882c26640 1 --2- 172.21.15.152:0/2146078308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc6882a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa882c26640 1 -- 172.21.15.152:0/2146078308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc687170 msgr2=0x562adc6a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa882c26640 1 --2- 172.21.15.152:0/2146078308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc687170 0x562adc6a9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa882c26640 1 -- 172.21.15.152:0/2146078308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 msgr2=0x562adc6882a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa882c26640 1 --2- 172.21.15.152:0/2146078308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc6882a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa882c26640 1 -- 172.21.15.152:0/2146078308 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562adc69d860 con 0x562adc686850 2024-09-11T22:14:34.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa882c26640 1 --2- 172.21.15.152:0/2146078308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc6a8ec0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa874003d00 tx=0x7fa8740098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f18024ac64c184 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa867fff640 1 -- 172.21.15.152:0/2146078308 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874058070 con 0x562adc686850 2024-09-11T22:14:34.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa867fff640 1 -- 172.21.15.152:0/2146078308 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa874036070 con 0x562adc686850 2024-09-11T22:14:34.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.503+0000 7fa867fff640 1 -- 172.21.15.152:0/2146078308 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874030c30 con 0x562adc686850 2024-09-11T22:14:34.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.504+0000 7fa886a62740 1 -- 172.21.15.152:0/2146078308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 msgr2=0x562adc6a8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.504+0000 7fa886a62740 1 --2- 172.21.15.152:0/2146078308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc6a8ec0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa874003d00 tx=0x7fa8740098b0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.505+0000 7fa886a62740 1 -- 172.21.15.152:0/2146078308 shutdown_connections 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.505+0000 7fa886a62740 1 --2- 172.21.15.152:0/2146078308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc6882a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.505+0000 7fa886a62740 1 --2- 172.21.15.152:0/2146078308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc687170 0x562adc6a9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.505+0000 7fa886a62740 1 --2- 172.21.15.152:0/2146078308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc686850 0x562adc6a8ec0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.505+0000 7fa886a62740 1 -- 172.21.15.152:0/2146078308 >> 172.21.15.152:0/2146078308 conn(0x562adc682de0 msgr2=0x562adc681ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.505+0000 7fa886a62740 1 -- 172.21.15.152:0/2146078308 shutdown_connections 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.505+0000 7fa886a62740 1 -- 172.21.15.152:0/2146078308 wait complete. 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.505+0000 7fa886a62740 1 -- start start 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa886a62740 1 Processor -- start 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa886a62740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc686850 0x562adc699f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa886a62740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 0x562adc6952e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa886a62740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc695820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa886a62740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c1a9f30 con 0x562adc687170 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa886a62740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c1ab320 con 0x562adc691a30 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa886a62740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c1aa580 con 0x562adc686850 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa886a62740 10 client.0 _ll_register_callbacks cb 0x7fa86c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa881c24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 0x562adc6952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa881c24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 0x562adc6952e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38150/0 (socket says 172.21.15.152:38150) 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa881c24640 1 -- 172.21.15.152:0/1771761440 learned_addr learned my addr 172.21.15.152:0/1771761440 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa882c26640 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc686850 0x562adc699f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa882c26640 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc695820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa881c24640 1 -- 172.21.15.152:0/1771761440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc686850 msgr2=0x562adc699f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa881c24640 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc686850 0x562adc699f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa881c24640 1 -- 172.21.15.152:0/1771761440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 msgr2=0x562adc695820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa881c24640 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc695820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa881c24640 1 -- 172.21.15.152:0/1771761440 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562adc695e60 con 0x562adc687170 2024-09-11T22:14:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa881c24640 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 0x562adc6952e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x562adc68ff80 tx=0x7fa86c016eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa940d0911933d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.506+0000 7fa865ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.507+0000 7fa865ffb640 1 -- 172.21.15.152:0/1771761440 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c016310 con 0x562adc687170 2024-09-11T22:14:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.507+0000 7fa865ffb640 1 -- 172.21.15.152:0/1771761440 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7fa86c0164b0 con 0x562adc687170 2024-09-11T22:14:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.507+0000 7fa886a62740 1 -- 172.21.15.152:0/1771761440 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa874036070 con 0x562adc687170 2024-09-11T22:14:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.507+0000 7fa865ffb640 1 -- 172.21.15.152:0/1771761440 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa86c0166b0 con 0x562adc687170 2024-09-11T22:14:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.507+0000 7fa886a62740 10 client.17976 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.507+0000 7fa886a62740 1 -- 172.21.15.152:0/1771761440 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562adc70bd50 con 0x562adc687170 2024-09-11T22:14:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.508+0000 7fa865ffb640 1 -- 172.21.15.152:0/1771761440 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa874036070 con 0x562adc687170 2024-09-11T22:14:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.508+0000 7fa865ffb640 1 -- 172.21.15.152:0/1771761440 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa86c025410 con 0x562adc687170 2024-09-11T22:14:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.509+0000 7fa886a62740 10 client.17976 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.509+0000 7fa886a62740 10 client.17976 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:14:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.509+0000 7fa886a62740 20 client.17976 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.509+0000 7fa886a62740 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562adc70c5a0 0x562adc70e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.509+0000 7fa886a62740 4 client.17976 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}] 2024-09-11T22:14:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.509+0000 7fa886a62740 1 -- 172.21.15.152:0/1771761440 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}) -- 0x562adc5f2be0 con 0x562adc70c5a0 2024-09-11T22:14:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.509+0000 7fa882c26640 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562adc70c5a0 0x562adc70e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.509+0000 7fa882c26640 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562adc70c5a0 0x562adc70e9c0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd3eff77b0f3b41f server_cookie=59d69d42ca84211e in_seq=0 out_seq=0 2024-09-11T22:14:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.509+0000 7fa865ffb640 10 client.17976 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:34.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa865ffb640 1 -- 172.21.15.152:0/1771761440 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562adc5f2be0 con 0x562adc70c5a0 2024-09-11T22:14:34.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa865ffb640 10 client.17976 handle_command_reply: tid=0 2024-09-11T22:14:34.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa886a62740 1 client.17976 shutdown 2024-09-11T22:14:34.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa886a62740 1 -- 172.21.15.152:0/1771761440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 msgr2=0x562adc6952e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa886a62740 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 0x562adc6952e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x562adc68ff80 tx=0x7fa86c016eb0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa886a62740 1 -- 172.21.15.152:0/1771761440 shutdown_connections 2024-09-11T22:14:34.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa886a62740 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562adc70c5a0 0x562adc70e9c0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa886a62740 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562adc691a30 0x562adc695820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa865ffb640 0 client.17976 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:34.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa886a62740 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562adc687170 0x562adc6952e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa886a62740 1 --2- 172.21.15.152:0/1771761440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562adc686850 0x562adc699f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa886a62740 1 -- 172.21.15.152:0/1771761440 >> 172.21.15.152:0/1771761440 conn(0x562adc682de0 msgr2=0x562adc69c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:34.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa886a62740 1 -- 172.21.15.152:0/1771761440 shutdown_connections 2024-09-11T22:14:34.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.789+0000 7fa886a62740 1 -- 172.21.15.152:0/1771761440 wait complete. 2024-09-11T22:14:34.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa886a62740 20 client.17976 trim_cache size 0 max 16384 2024-09-11T22:14:34.793 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:14:34.793 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 42, 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "873073c2": { 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 42, 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 142.6, 2024-09-11T22:14:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:14:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:14:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:14:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:14:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:14:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:14:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:34.795 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:14:34.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 -- 172.21.15.152:0/426698478 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8680a2d70 msgr2=0x7fa8680a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8680a2d70 0x7fa8680a5230 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8780cd080 tx=0x7fa878018420 comp rx=0 tx=0).stop 2024-09-11T22:14:34.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 -- 172.21.15.152:0/426698478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa87c102d90 msgr2=0x7fa87c1a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa87c102d90 0x7fa87c1a0560 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa87800e9f0 tx=0x7fa87800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 -- 172.21.15.152:0/426698478 shutdown_connections 2024-09-11T22:14:34.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa8680a2d70 0x7fa8680a5230 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87c108290 0x7fa87c19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa87c103740 0x7fa87c1a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 --2- 172.21.15.152:0/426698478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa87c102d90 0x7fa87c1a0560 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 -- 172.21.15.152:0/426698478 >> 172.21.15.152:0/426698478 conn(0x7fa87c0fc7d0 msgr2=0x7fa87c0fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:34.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 -- 172.21.15.152:0/426698478 shutdown_connections 2024-09-11T22:14:34.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:34.790+0000 7fa884689640 1 -- 172.21.15.152:0/426698478 wait complete. 2024-09-11T22:14:34.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 540.0 s, 2162.0 tps, lat 230.284 ms stddev 2003.164 2024-09-11T22:14:35.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:35 smithi193 ceph-mon[35545]: pgmap v319: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:14:35.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:35 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:14:35.425 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:35 smithi179 ceph-mon[35603]: pgmap v319: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:14:35.425 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:35 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:14:35.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:35 smithi152 ceph-mon[31188]: pgmap v319: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 1.24k op/s 2024-09-11T22:14:35.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:35 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:14:35.563 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '873073c2', quiesce took 4.1 seconds. Will release after: 18.450000000000003 2024-09-11T22:14:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: pgmap v320: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 1.29k op/s 2024-09-11T22:14:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:14:37.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: pgmap v320: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 1.29k op/s 2024-09-11T22:14:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:14:37.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:14:37.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: pgmap v320: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 1.29k op/s 2024-09-11T22:14:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.731 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:14:37.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:14:37.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:14:37.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:14:38.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:38 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-11T22:14:38.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:38 smithi179 ceph-mon[35603]: Unable to set osd_memory_target on smithi179 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-11T22:14:38.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:38 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-11T22:14:38.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:38 smithi179 ceph-mon[35603]: Unable to set osd_memory_target on smithi193 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-11T22:14:38.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:38 smithi179 ceph-mon[35603]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-11T22:14:38.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:38 smithi179 ceph-mon[35603]: Unable to set osd_memory_target on smithi152 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-11T22:14:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:38 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-11T22:14:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:38 smithi193 ceph-mon[35545]: Unable to set osd_memory_target on smithi179 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-11T22:14:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:38 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-11T22:14:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:38 smithi193 ceph-mon[35545]: Unable to set osd_memory_target on smithi193 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-11T22:14:38.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:38 smithi193 ceph-mon[35545]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-11T22:14:38.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:38 smithi193 ceph-mon[35545]: Unable to set osd_memory_target on smithi152 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-11T22:14:38.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:38 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-11T22:14:38.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:38 smithi152 ceph-mon[31188]: Unable to set osd_memory_target on smithi179 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-11T22:14:38.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:38 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-11T22:14:38.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:38 smithi152 ceph-mon[31188]: Unable to set osd_memory_target on smithi193 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-11T22:14:38.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:38 smithi152 ceph-mon[31188]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-11T22:14:38.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:38 smithi152 ceph-mon[31188]: Unable to set osd_memory_target on smithi152 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-11T22:14:39.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:39 smithi179 ceph-mon[35603]: pgmap v321: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 1.29k op/s 2024-09-11T22:14:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:39 smithi193 ceph-mon[35545]: pgmap v321: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 1.29k op/s 2024-09-11T22:14:39.622 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:39 smithi152 ceph-mon[31188]: pgmap v321: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 1.29k op/s 2024-09-11T22:14:39.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:14:41.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:41 smithi179 ceph-mon[35603]: pgmap v322: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 1.36k op/s 2024-09-11T22:14:41.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:41 smithi193 ceph-mon[35545]: pgmap v322: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 1.36k op/s 2024-09-11T22:14:41.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:41 smithi152 ceph-mon[31188]: pgmap v322: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 1.36k op/s 2024-09-11T22:14:43.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.178+0000 7f787d976640 1 -- 172.21.15.152:0/616203137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7878101390 msgr2=0x7f787810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.178+0000 7f787d976640 1 --2- 172.21.15.152:0/616203137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7878101390 0x7f787810d8c0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7868009930 tx=0x7f786802a420 comp rx=0 tx=0).stop 2024-09-11T22:14:43.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.178+0000 7f787d976640 1 -- 172.21.15.152:0/616203137 shutdown_connections 2024-09-11T22:14:43.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.178+0000 7f787d976640 1 --2- 172.21.15.152:0/616203137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7878101390 0x7f787810d8c0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.178+0000 7f787d976640 1 --2- 172.21.15.152:0/616203137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78781009f0 0x7f7878100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.178+0000 7f787d976640 1 --2- 172.21.15.152:0/616203137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7878106a00 0x7f7878106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.182 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.178+0000 7f787d976640 1 -- 172.21.15.152:0/616203137 >> 172.21.15.152:0/616203137 conn(0x7f78780fc6b0 msgr2=0x7f78780fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.178+0000 7f787d976640 1 -- 172.21.15.152:0/616203137 shutdown_connections 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.178+0000 7f787d976640 1 -- 172.21.15.152:0/616203137 wait complete. 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.178+0000 7f787d976640 1 Processor -- start 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f787d976640 1 -- start start 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f787d976640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78781009f0 0x7f7878198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f787d976640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7878101390 0x7f78781988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f787d976640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7878106a00 0x7f787819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f787d976640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7878110e40 con 0x7f7878101390 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f787d976640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7878110cc0 con 0x7f78781009f0 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f787d976640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7878110fc0 con 0x7f7878106a00 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f78767fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7878101390 0x7f78781988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f78767fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7878101390 0x7f78781988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38178/0 (socket says 172.21.15.152:38178) 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f78767fc640 1 -- 172.21.15.152:0/1248198996 learned_addr learned my addr 172.21.15.152:0/1248198996 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f78777fe640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7878106a00 0x7f787819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f7876ffd640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78781009f0 0x7f7878198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f78767fc640 1 -- 172.21.15.152:0/1248198996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7878106a00 msgr2=0x7f787819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f78767fc640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7878106a00 0x7f787819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f78767fc640 1 -- 172.21.15.152:0/1248198996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78781009f0 msgr2=0x7f7878198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f78767fc640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78781009f0 0x7f7878198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.179+0000 7f78767fc640 1 -- 172.21.15.152:0/1248198996 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787819d350 con 0x7f7878101390 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.180+0000 7f78767fc640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7878101390 0x7f78781988a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f786000d950 tx=0x7f786000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.180+0000 7f787c974640 1 -- 172.21.15.152:0/1248198996 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860017030 con 0x7f7878101390 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.180+0000 7f787c974640 1 -- 172.21.15.152:0/1248198996 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7860004020 con 0x7f7878101390 2024-09-11T22:14:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.180+0000 7f787d976640 1 -- 172.21.15.152:0/1248198996 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787819d640 con 0x7f7878101390 2024-09-11T22:14:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.180+0000 7f787c974640 1 -- 172.21.15.152:0/1248198996 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600047a0 con 0x7f7878101390 2024-09-11T22:14:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.180+0000 7f787d976640 1 -- 172.21.15.152:0/1248198996 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78781a4ed0 con 0x7f7878101390 2024-09-11T22:14:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.182+0000 7f787c974640 1 -- 172.21.15.152:0/1248198996 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f78600041d0 con 0x7f7878101390 2024-09-11T22:14:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.182+0000 7f78807ed740 1 Processor -- start 2024-09-11T22:14:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.182+0000 7f78807ed740 1 -- start start 2024-09-11T22:14:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78807ed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 0x55d6605dced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78807ed740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d6605e7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78807ed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d6605ea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78807ed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d6605412f0 con 0x55d6605e7cb0 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78807ed740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d6604e9270 con 0x55d6605dcaf0 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78807ed740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d66053d2b0 con 0x55d6605dd410 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78767fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d6605ea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78767fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d6605ea0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38186/0 (socket says 172.21.15.152:38186) 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78767fc640 1 -- 172.21.15.152:0/2241201001 learned_addr learned my addr 172.21.15.152:0/2241201001 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78777fe640 1 --2- 172.21.15.152:0/2241201001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 0x55d6605dced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f7876ffd640 1 --2- 172.21.15.152:0/2241201001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d6605e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f787c974640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78640a2da0 0x7f78640a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78767fc640 1 -- 172.21.15.152:0/2241201001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 msgr2=0x55d6605e7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78767fc640 1 --2- 172.21.15.152:0/2241201001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d6605e7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78767fc640 1 -- 172.21.15.152:0/2241201001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 msgr2=0x55d6605dced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78767fc640 1 --2- 172.21.15.152:0/2241201001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 0x55d6605dced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f787c974640 1 -- 172.21.15.152:0/1248198996 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f78600cedc0 con 0x7f7878101390 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78767fc640 1 -- 172.21.15.152:0/2241201001 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6604e8340 con 0x55d6605e7cb0 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78777fe640 1 --2- 172.21.15.152:0/2241201001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 0x55d6605dced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f7876ffd640 1 --2- 172.21.15.152:0/2241201001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d6605e7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.183+0000 7f78777fe640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78640a2da0 0x7f78640a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.184+0000 7f78767fc640 1 --2- 172.21.15.152:0/2241201001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d6605ea0a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f78600cc420 tx=0x7f78600509f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7730e63379f0a7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.184+0000 7f786dffb640 1 -- 172.21.15.152:0/2241201001 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786009b050 con 0x55d6605e7cb0 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.184+0000 7f786dffb640 1 -- 172.21.15.152:0/2241201001 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f786009b980 con 0x55d6605e7cb0 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.184+0000 7f786dffb640 1 -- 172.21.15.152:0/2241201001 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786009abe0 con 0x55d6605e7cb0 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.184+0000 7f78807ed740 1 -- 172.21.15.152:0/2241201001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 msgr2=0x55d6605ea0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.184+0000 7f78777fe640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78640a2da0 0x7f78640a5260 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7868006010 tx=0x7f7868009260 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.185+0000 7f78807ed740 1 --2- 172.21.15.152:0/2241201001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d6605ea0a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f78600cc420 tx=0x7f78600509f0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.185+0000 7f78807ed740 1 -- 172.21.15.152:0/2241201001 shutdown_connections 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.185+0000 7f78807ed740 1 --2- 172.21.15.152:0/2241201001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d6605ea0a0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.185+0000 7f78807ed740 1 --2- 172.21.15.152:0/2241201001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d6605e7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.185+0000 7f78807ed740 1 --2- 172.21.15.152:0/2241201001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 0x55d6605dced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.185+0000 7f78807ed740 1 -- 172.21.15.152:0/2241201001 >> 172.21.15.152:0/2241201001 conn(0x55d6605d9060 msgr2=0x55d6605d9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.185+0000 7f78807ed740 1 -- 172.21.15.152:0/2241201001 shutdown_connections 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.185+0000 7f78807ed740 1 -- 172.21.15.152:0/2241201001 wait complete. 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.185+0000 7f78807ed740 1 -- start start 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.185+0000 7f78807ed740 1 Processor -- start 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f78807ed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f78807ed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dd410 0x55d6605e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f78807ed740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605e7cb0 0x55d6605e55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f78807ed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d6605ea820 con 0x55d6605dcaf0 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f78807ed740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d6604ca290 con 0x55d6605dd410 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f78807ed740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d6605ea9a0 con 0x55d6605e7cb0 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7876ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f78807ed740 10 client.0 _ll_register_callbacks cb 0x55d6604fb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7876ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38192/0 (socket says 172.21.15.152:38192) 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7876ffd640 1 -- 172.21.15.152:0/2475570715 learned_addr learned my addr 172.21.15.152:0/2475570715 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f78767fc640 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dd410 0x55d6605e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f78777fe640 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605e7cb0 0x55d6605e55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7876ffd640 1 -- 172.21.15.152:0/2475570715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605e7cb0 msgr2=0x55d6605e55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7876ffd640 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605e7cb0 0x55d6605e55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7876ffd640 1 -- 172.21.15.152:0/2475570715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dd410 msgr2=0x55d6605e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7876ffd640 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dd410 0x55d6605e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7876ffd640 1 -- 172.21.15.152:0/2475570715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d660254210 con 0x55d6605dcaf0 2024-09-11T22:14:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7876ffd640 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e4b60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7870011d40 tx=0x7f787000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9160a8497c10a269 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7856ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7856ffd640 1 -- 172.21.15.152:0/2475570715 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870003970 con 0x55d6605dcaf0 2024-09-11T22:14:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7856ffd640 1 -- 172.21.15.152:0/2475570715 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f7870003b10 con 0x55d6605dcaf0 2024-09-11T22:14:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f78807ed740 1 -- 172.21.15.152:0/2475570715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f786009b980 con 0x55d6605dcaf0 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.186+0000 7f7856ffd640 1 -- 172.21.15.152:0/2475570715 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7870003d50 con 0x55d6605dcaf0 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.187+0000 7f78807ed740 10 client.17988 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.187+0000 7f78807ed740 1 -- 172.21.15.152:0/2475570715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d660320620 con 0x55d6605dcaf0 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.187+0000 7f7856ffd640 1 -- 172.21.15.152:0/2475570715 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f786009b980 con 0x55d6605dcaf0 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.187+0000 7f7856ffd640 1 -- 172.21.15.152:0/2475570715 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f787001a640 con 0x55d6605dcaf0 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.187+0000 7f78807ed740 10 client.17988 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.187+0000 7f78807ed740 10 client.17988 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.187+0000 7f78807ed740 20 client.17988 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.187+0000 7f78807ed740 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d6605f7b90 0x55d6605f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.187+0000 7f78807ed740 4 client.17988 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.187+0000 7f78807ed740 1 -- 172.21.15.152:0/2475570715 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d66054ea20 con 0x55d6605f7b90 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.187+0000 7f78767fc640 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d6605f7b90 0x55d6605f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.188+0000 7f78767fc640 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d6605f7b90 0x55d6605f9fc0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a99aea8b4ccfa857 server_cookie=28ca8b956ffa86db in_seq=0 out_seq=0 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.188+0000 7f7856ffd640 10 client.17988 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.188+0000 7f7856ffd640 1 -- 172.21.15.152:0/2475570715 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d66054ea20 con 0x55d6605f7b90 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.188+0000 7f7856ffd640 10 client.17988 handle_command_reply: tid=0 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.188+0000 7f78807ed740 1 client.17988 shutdown 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.188+0000 7f78807ed740 1 -- 172.21.15.152:0/2475570715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 msgr2=0x55d6605e4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.188+0000 7f78807ed740 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e4b60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7870011d40 tx=0x7f787000f790 comp rx=0 tx=0).stop 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.189+0000 7f78807ed740 1 -- 172.21.15.152:0/2475570715 shutdown_connections 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.189+0000 7f78807ed740 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d6605f7b90 0x55d6605f9fc0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.189+0000 7f78807ed740 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605e7cb0 0x55d6605e55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.189+0000 7f78807ed740 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dd410 0x55d6605e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.189+0000 7f7856ffd640 0 client.17988 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.189+0000 7f78807ed740 1 --2- 172.21.15.152:0/2475570715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e4b60 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.189+0000 7f78807ed740 1 -- 172.21.15.152:0/2475570715 >> 172.21.15.152:0/2475570715 conn(0x55d6605d9060 msgr2=0x55d6605dedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.189+0000 7f78807ed740 1 -- 172.21.15.152:0/2475570715 shutdown_connections 2024-09-11T22:14:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.189+0000 7f78807ed740 1 -- 172.21.15.152:0/2475570715 wait complete. 2024-09-11T22:14:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.189+0000 7f78807ed740 20 client.17988 trim_cache size 0 max 16384 2024-09-11T22:14:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f78807ed740 1 Processor -- start 2024-09-11T22:14:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f78807ed740 1 -- start start 2024-09-11T22:14:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f78807ed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f78807ed740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d6605f0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f78807ed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605e7cb0 0x55d6605f0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f78807ed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f78781b0310 con 0x55d6605dcaf0 2024-09-11T22:14:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f78807ed740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78781adbe0 con 0x55d6605e7cb0 2024-09-11T22:14:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f78807ed740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78781aba50 con 0x55d6605dd410 2024-09-11T22:14:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f7876ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f7876ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38204/0 (socket says 172.21.15.152:38204) 2024-09-11T22:14:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f7876ffd640 1 -- 172.21.15.152:0/2508498314 learned_addr learned my addr 172.21.15.152:0/2508498314 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f78777fe640 1 --2- 172.21.15.152:0/2508498314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605e7cb0 0x55d6605f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f7876ffd640 1 -- 172.21.15.152:0/2508498314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 msgr2=0x55d6605f0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f7876ffd640 1 --2- 172.21.15.152:0/2508498314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d6605f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f7876ffd640 1 -- 172.21.15.152:0/2508498314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605e7cb0 msgr2=0x55d6605f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f7876ffd640 1 --2- 172.21.15.152:0/2508498314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605e7cb0 0x55d6605f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f7876ffd640 1 -- 172.21.15.152:0/2508498314 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6605de000 con 0x55d6605dcaf0 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f7876ffd640 1 --2- 172.21.15.152:0/2508498314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e5410 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7870005d50 tx=0x7f787001bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a077fbf7c8a12dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f786d7fa640 1 -- 172.21.15.152:0/2508498314 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870009570 con 0x55d6605dcaf0 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f786d7fa640 1 -- 172.21.15.152:0/2508498314 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7870003970 con 0x55d6605dcaf0 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f786d7fa640 1 -- 172.21.15.152:0/2508498314 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870005690 con 0x55d6605dcaf0 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f78807ed740 1 -- 172.21.15.152:0/2508498314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 msgr2=0x55d6605e5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.204+0000 7f78807ed740 1 --2- 172.21.15.152:0/2508498314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e5410 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7870005d50 tx=0x7f787001bf40 comp rx=0 tx=0).stop 2024-09-11T22:14:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 -- 172.21.15.152:0/2508498314 shutdown_connections 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 --2- 172.21.15.152:0/2508498314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605e7cb0 0x55d6605f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 --2- 172.21.15.152:0/2508498314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d6605f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 --2- 172.21.15.152:0/2508498314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605dcaf0 0x55d6605e5410 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 -- 172.21.15.152:0/2508498314 >> 172.21.15.152:0/2508498314 conn(0x55d6605d9060 msgr2=0x55d6605e6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 -- 172.21.15.152:0/2508498314 shutdown_connections 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 -- 172.21.15.152:0/2508498314 wait complete. 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 -- start start 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 Processor -- start 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 0x55d66065a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d66065adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d66065b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f78781ac0a0 con 0x55d6605e7cb0 2024-09-11T22:14:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78781ad510 con 0x55d6605dcaf0 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78781ac770 con 0x55d6605dd410 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78807ed740 10 client.0 _ll_register_callbacks cb 0x7f7870009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.205+0000 7f78777fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d66065b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78777fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d66065b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38206/0 (socket says 172.21.15.152:38206) 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78777fe640 1 -- 172.21.15.152:0/567917054 learned_addr learned my addr 172.21.15.152:0/567917054 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78767fc640 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d66065adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f7876ffd640 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 0x55d66065a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78777fe640 1 -- 172.21.15.152:0/567917054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 msgr2=0x55d66065adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78777fe640 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d66065adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78777fe640 1 -- 172.21.15.152:0/567917054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 msgr2=0x55d66065a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78777fe640 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 0x55d66065a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78777fe640 1 -- 172.21.15.152:0/567917054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d660665b00 con 0x55d6605e7cb0 2024-09-11T22:14:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78767fc640 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d66065adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f7876ffd640 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 0x55d66065a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78777fe640 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d66065b330 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7868033000 tx=0x7f786802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319466eac590b716 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f7856ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f7856ffd640 1 -- 172.21.15.152:0/567917054 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786804f070 con 0x55d6605e7cb0 2024-09-11T22:14:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f7856ffd640 1 -- 172.21.15.152:0/567917054 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f7868003c70 con 0x55d6605e7cb0 2024-09-11T22:14:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78807ed740 1 -- 172.21.15.152:0/567917054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7870003970 con 0x55d6605e7cb0 2024-09-11T22:14:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f7856ffd640 1 -- 172.21.15.152:0/567917054 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f786805b050 con 0x55d6605e7cb0 2024-09-11T22:14:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78807ed740 10 client.17994 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.206+0000 7f78807ed740 1 -- 172.21.15.152:0/567917054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d660666e10 con 0x55d6605e7cb0 2024-09-11T22:14:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.207+0000 7f7856ffd640 1 -- 172.21.15.152:0/567917054 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7870003970 con 0x55d6605e7cb0 2024-09-11T22:14:43.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.207+0000 7f7856ffd640 1 -- 172.21.15.152:0/567917054 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7868047070 con 0x55d6605e7cb0 2024-09-11T22:14:43.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.207+0000 7f78807ed740 10 client.17994 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:43.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.207+0000 7f78807ed740 10 client.17994 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:43.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.207+0000 7f78807ed740 20 client.17994 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:43.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.207+0000 7f78807ed740 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d6606675c0 0x55d6606699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.207+0000 7f78807ed740 4 client.17994 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:14:43.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.207+0000 7f78807ed740 1 -- 172.21.15.152:0/567917054 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d660548d70 con 0x55d6606675c0 2024-09-11T22:14:43.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.207+0000 7f7876ffd640 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d6606675c0 0x55d6606699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.207+0000 7f7856ffd640 10 client.17994 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:43.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.207+0000 7f7876ffd640 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d6606675c0 0x55d6606699e0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd0a53620daaa323 server_cookie=c0e161e6164254d2 in_seq=0 out_seq=0 2024-09-11T22:14:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f7856ffd640 1 -- 172.21.15.152:0/567917054 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d660548d70 con 0x55d6606675c0 2024-09-11T22:14:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f7856ffd640 10 client.17994 handle_command_reply: tid=0 2024-09-11T22:14:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 1 client.17994 shutdown 2024-09-11T22:14:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 1 -- 172.21.15.152:0/567917054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 msgr2=0x55d66065b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d66065b330 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7868033000 tx=0x7f786802a420 comp rx=0 tx=0).stop 2024-09-11T22:14:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 1 -- 172.21.15.152:0/567917054 shutdown_connections 2024-09-11T22:14:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d6606675c0 0x55d6606699e0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6605e7cb0 0x55d66065b330 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d6605dd410 0x55d66065adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 1 --2- 172.21.15.152:0/567917054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6605dcaf0 0x55d66065a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f7856ffd640 0 client.17994 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 1 -- 172.21.15.152:0/567917054 >> 172.21.15.152:0/567917054 conn(0x55d6605d9060 msgr2=0x55d6605de550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 1 -- 172.21.15.152:0/567917054 shutdown_connections 2024-09-11T22:14:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 1 -- 172.21.15.152:0/567917054 wait complete. 2024-09-11T22:14:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.216+0000 7f78807ed740 20 client.17994 trim_cache size 0 max 16384 2024-09-11T22:14:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:14:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:14:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:14:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:14:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 -- 172.21.15.152:0/1248198996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78640a2da0 msgr2=0x7f78640a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78640a2da0 0x7f78640a5260 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7868006010 tx=0x7f7868009260 comp rx=0 tx=0).stop 2024-09-11T22:14:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 -- 172.21.15.152:0/1248198996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7878101390 msgr2=0x7f78781988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7878101390 0x7f78781988a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f786000d950 tx=0x7f786000de10 comp rx=0 tx=0).stop 2024-09-11T22:14:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 -- 172.21.15.152:0/1248198996 shutdown_connections 2024-09-11T22:14:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78640a2da0 0x7f78640a5260 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7878106a00 0x7f787819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7878101390 0x7f78781988a0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 --2- 172.21.15.152:0/1248198996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78781009f0 0x7f7878198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 -- 172.21.15.152:0/1248198996 >> 172.21.15.152:0/1248198996 conn(0x7f78780fc6b0 msgr2=0x7f787806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 -- 172.21.15.152:0/1248198996 shutdown_connections 2024-09-11T22:14:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:43.217+0000 7f787d976640 1 -- 172.21.15.152:0/1248198996 wait complete. 2024-09-11T22:14:43.470 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:14:43.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:43 smithi179 ceph-mon[35603]: pgmap v323: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.4 MiB/s wr, 251 op/s 2024-09-11T22:14:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:43 smithi193 ceph-mon[35545]: pgmap v323: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.4 MiB/s wr, 251 op/s 2024-09-11T22:14:43.720 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:43 smithi152 ceph-mon[31188]: pgmap v323: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.4 MiB/s wr, 251 op/s 2024-09-11T22:14:44.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.212+0000 7f1b1b220640 1 -- 172.21.15.152:0/412380842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b1410c180 msgr2=0x7f1b1410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:44.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.212+0000 7f1b1b220640 1 --2- 172.21.15.152:0/412380842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b1410c180 0x7f1b1410e600 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009ca0 tx=0x7f1b0c02a950 comp rx=0 tx=0).stop 2024-09-11T22:14:44.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.212+0000 7f1b1b220640 1 -- 172.21.15.152:0/412380842 shutdown_connections 2024-09-11T22:14:44.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.212+0000 7f1b1b220640 1 --2- 172.21.15.152:0/412380842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b1410c180 0x7f1b1410e600 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.212+0000 7f1b1b220640 1 --2- 172.21.15.152:0/412380842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b141036c0 0x7f1b1410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.212+0000 7f1b1b220640 1 --2- 172.21.15.152:0/412380842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b14102da0 0x7f1b14103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.212+0000 7f1b1b220640 1 -- 172.21.15.152:0/412380842 >> 172.21.15.152:0/412380842 conn(0x7f1b140fc7a0 msgr2=0x7f1b140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:44.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.212+0000 7f1b1b220640 1 -- 172.21.15.152:0/412380842 shutdown_connections 2024-09-11T22:14:44.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.212+0000 7f1b1b220640 1 -- 172.21.15.152:0/412380842 wait complete. 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.212+0000 7f1b1b220640 1 Processor -- start 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.212+0000 7f1b1b220640 1 -- start start 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b1b220640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b14102da0 0x7f1b141983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b1b220640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b141036c0 0x7f1b14198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b1b220640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b1410c180 0x7f1b1419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b1b220640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14111f60 con 0x7f1b141036c0 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b1b220640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14111de0 con 0x7f1b14102da0 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b1b220640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141120e0 con 0x7f1b1410c180 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b141036c0 0x7f1b14198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b141036c0 0x7f1b14198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53018/0 (socket says 172.21.15.152:53018) 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b13fff640 1 -- 172.21.15.152:0/972460391 learned_addr learned my addr 172.21.15.152:0/972460391 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:44.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b14102da0 0x7f1b141983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b197bd640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b1410c180 0x7f1b1419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b13fff640 1 -- 172.21.15.152:0/972460391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b1410c180 msgr2=0x7f1b1419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b13fff640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b1410c180 0x7f1b1419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b13fff640 1 -- 172.21.15.152:0/972460391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b14102da0 msgr2=0x7f1b141983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b13fff640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b14102da0 0x7f1b141983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b13fff640 1 -- 172.21.15.152:0/972460391 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1419d370 con 0x7f1b141036c0 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b14102da0 0x7f1b141983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.213+0000 7f1b13fff640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b141036c0 0x7f1b14198900 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800d950 tx=0x7f1b0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.214+0000 7f1b11ffb640 1 -- 172.21.15.152:0/972460391 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08017030 con 0x7f1b141036c0 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.214+0000 7f1b11ffb640 1 -- 172.21.15.152:0/972460391 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b08004020 con 0x7f1b141036c0 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.214+0000 7f1b11ffb640 1 -- 172.21.15.152:0/972460391 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080047a0 con 0x7f1b141036c0 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.214+0000 7f1b1b220640 1 -- 172.21.15.152:0/972460391 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1419d660 con 0x7f1b141036c0 2024-09-11T22:14:44.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.214+0000 7f1b1b220640 1 -- 172.21.15.152:0/972460391 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b141a4f40 con 0x7f1b141036c0 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.216+0000 7f1b11ffb640 1 -- 172.21.15.152:0/972460391 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f1b080041d0 con 0x7f1b141036c0 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b11ffb640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1afc0a2d70 0x7f1afc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b1d5f9740 1 Processor -- start 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b1d5f9740 1 -- start start 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1afc0a2d70 0x7f1afc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b11ffb640 1 -- 172.21.15.152:0/972460391 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f1b080cedc0 con 0x7f1b141036c0 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8287880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8287dc0 0x55bab8292140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8292680 0x55bab8294a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bab81ed2e0 con 0x55bab82874a0 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55bab8194ce0 con 0x55bab8287dc0 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bab81e92a0 con 0x55bab8292680 2024-09-11T22:14:44.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b18fbc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8287880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b18fbc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8287880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53024/0 (socket says 172.21.15.152:53024) 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b18fbc640 1 -- 172.21.15.152:0/281361251 learned_addr learned my addr 172.21.15.152:0/281361251 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b197bd640 1 --2- 172.21.15.152:0/281361251 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8292680 0x55bab8294a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b13fff640 1 --2- 172.21.15.152:0/281361251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8287dc0 0x55bab8292140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1afc0a2d70 0x7f1afc0a5230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009c70 tx=0x7f1b040117b0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b18fbc640 1 -- 172.21.15.152:0/281361251 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8292680 msgr2=0x55bab8294a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/281361251 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8292680 0x55bab8294a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b18fbc640 1 -- 172.21.15.152:0/281361251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8287dc0 msgr2=0x55bab8292140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/281361251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8287dc0 0x55bab8292140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.217+0000 7f1b18fbc640 1 -- 172.21.15.152:0/281361251 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab8179440 con 0x55bab82874a0 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.218+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/281361251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8287880 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1b040145b0 tx=0x7f1b0401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca7f1479904aa65 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.218+0000 7f1afaffd640 1 -- 172.21.15.152:0/281361251 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b040142d0 con 0x55bab82874a0 2024-09-11T22:14:44.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.218+0000 7f1afaffd640 1 -- 172.21.15.152:0/281361251 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b0400f9f0 con 0x55bab82874a0 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.218+0000 7f1afaffd640 1 -- 172.21.15.152:0/281361251 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04012c30 con 0x55bab82874a0 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.218+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/281361251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 msgr2=0x55bab8287880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.218+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/281361251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8287880 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1b040145b0 tx=0x7f1b0401c000 comp rx=0 tx=0).stop 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/281361251 shutdown_connections 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/281361251 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8292680 0x55bab8294a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/281361251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8287dc0 0x55bab8292140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/281361251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8287880 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/281361251 >> 172.21.15.152:0/281361251 conn(0x55bab8283a30 msgr2=0x55bab8283e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/281361251 shutdown_connections 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/281361251 wait complete. 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 -- start start 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 Processor -- start 2024-09-11T22:14:44.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab82874a0 0x55bab8291fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8287dc0 0x55bab828f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8292680 0x55bab828f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bab8295250 con 0x55bab8292680 2024-09-11T22:14:44.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55bab81a8050 con 0x55bab82874a0 2024-09-11T22:14:44.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.219+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bab82953d0 con 0x55bab8287dc0 2024-09-11T22:14:44.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b1d5f9740 10 client.0 _ll_register_callbacks cb 0x55bab81e8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:44.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b197bd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8292680 0x55bab828f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8287dc0 0x55bab828f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b197bd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8292680 0x55bab828f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53032/0 (socket says 172.21.15.152:53032) 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b197bd640 1 -- 172.21.15.152:0/2488932258 learned_addr learned my addr 172.21.15.152:0/2488932258 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab82874a0 0x55bab8291fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b197bd640 1 -- 172.21.15.152:0/2488932258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8287dc0 msgr2=0x55bab828f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b197bd640 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8287dc0 0x55bab828f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b197bd640 1 -- 172.21.15.152:0/2488932258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab82874a0 msgr2=0x55bab8291fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b197bd640 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab82874a0 0x55bab8291fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b197bd640 1 -- 172.21.15.152:0/2488932258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bab7f5e3c0 con 0x55bab8292680 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b197bd640 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8292680 0x55bab828f790 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009ca0 tx=0x7f1b0c02ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd8af96c27dc963 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1af3fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1af3fff640 1 -- 172.21.15.152:0/2488932258 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c04a060 con 0x55bab8292680 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1af3fff640 1 -- 172.21.15.152:0/2488932258 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f1b0c003970 con 0x55bab8292680 2024-09-11T22:14:44.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2488932258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b0400f9f0 con 0x55bab8292680 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1af3fff640 1 -- 172.21.15.152:0/2488932258 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1b0c034040 con 0x55bab8292680 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b1d5f9740 10 client.18006 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.220+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2488932258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bab82a0bd0 con 0x55bab8292680 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.221+0000 7f1af3fff640 1 -- 172.21.15.152:0/2488932258 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b0400f9f0 con 0x55bab8292680 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.221+0000 7f1af3fff640 1 -- 172.21.15.152:0/2488932258 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f1b0c0304d0 con 0x55bab8292680 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.221+0000 7f1b1d5f9740 10 client.18006 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.221+0000 7f1b1d5f9740 10 client.18006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.221+0000 7f1b1d5f9740 20 client.18006 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.221+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bab82a1f20 0x55bab82a4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.221+0000 7f1b1d5f9740 4 client.18006 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.221+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2488932258 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bab81fa850 con 0x55bab82a1f20 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.221+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bab82a1f20 0x55bab82a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.221+0000 7f1af3fff640 10 client.18006 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.221+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bab82a1f20 0x55bab82a4310 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=692ef015ec6e5c7f server_cookie=1d90b453181b3a9e in_seq=0 out_seq=0 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1af3fff640 1 -- 172.21.15.152:0/2488932258 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bab81fa850 con 0x55bab82a1f20 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1af3fff640 10 client.18006 handle_command_reply: tid=0 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1b1d5f9740 1 client.18006 shutdown 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2488932258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8292680 msgr2=0x55bab828f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8292680 0x55bab828f790 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009ca0 tx=0x7f1b0c02ff50 comp rx=0 tx=0).stop 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2488932258 shutdown_connections 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bab82a1f20 0x55bab82a4310 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8292680 0x55bab828f790 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8287dc0 0x55bab828f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1af3fff640 0 client.18006 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:44.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2488932258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab82874a0 0x55bab8291fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.222+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2488932258 >> 172.21.15.152:0/2488932258 conn(0x55bab8283a30 msgr2=0x55bab8282b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:44.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.223+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2488932258 shutdown_connections 2024-09-11T22:14:44.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.223+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2488932258 wait complete. 2024-09-11T22:14:44.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.223+0000 7f1b1d5f9740 20 client.18006 trim_cache size 0 max 16384 2024-09-11T22:14:44.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b1d5f9740 1 Processor -- start 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b1d5f9740 1 -- start start 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8283a30 0x55bab829e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab82874a0 0x55bab828f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8287dc0 0x55bab828a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141b0280 con 0x55bab8287dc0 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141adb50 con 0x55bab8283a30 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141ab9c0 con 0x55bab82874a0 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b197bd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8287dc0 0x55bab828a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b197bd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8287dc0 0x55bab828a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53036/0 (socket says 172.21.15.152:53036) 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b197bd640 1 -- 172.21.15.152:0/2482051139 learned_addr learned my addr 172.21.15.152:0/2482051139 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/2482051139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8283a30 0x55bab829e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b13fff640 1 --2- 172.21.15.152:0/2482051139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab82874a0 0x55bab828f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b197bd640 1 -- 172.21.15.152:0/2482051139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab82874a0 msgr2=0x55bab828f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b197bd640 1 --2- 172.21.15.152:0/2482051139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab82874a0 0x55bab828f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b197bd640 1 -- 172.21.15.152:0/2482051139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8283a30 msgr2=0x55bab829e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.240+0000 7f1b197bd640 1 --2- 172.21.15.152:0/2482051139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8283a30 0x55bab829e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.241+0000 7f1b197bd640 1 -- 172.21.15.152:0/2482051139 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab8287bf0 con 0x55bab8287dc0 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.241+0000 7f1b13fff640 1 --2- 172.21.15.152:0/2482051139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab82874a0 0x55bab828f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.241+0000 7f1b197bd640 1 --2- 172.21.15.152:0/2482051139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8287dc0 0x55bab828a7f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c02a990 tx=0x7f1b0c005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1eb55003a894bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.241+0000 7f1afa7fc640 1 -- 172.21.15.152:0/2482051139 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c04a050 con 0x55bab8287dc0 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.241+0000 7f1afa7fc640 1 -- 172.21.15.152:0/2482051139 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b0c02f6f0 con 0x55bab8287dc0 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.241+0000 7f1afa7fc640 1 -- 172.21.15.152:0/2482051139 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c003d30 con 0x55bab8287dc0 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2482051139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8287dc0 msgr2=0x55bab828a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2482051139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8287dc0 0x55bab828a7f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c02a990 tx=0x7f1b0c005d80 comp rx=0 tx=0).stop 2024-09-11T22:14:44.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2482051139 shutdown_connections 2024-09-11T22:14:44.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2482051139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab8287dc0 0x55bab828a7f0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2482051139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab82874a0 0x55bab828f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2482051139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8283a30 0x55bab829e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2482051139 >> 172.21.15.152:0/2482051139 conn(0x55bab828f8f0 msgr2=0x55bab828a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:44.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2482051139 shutdown_connections 2024-09-11T22:14:44.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2482051139 wait complete. 2024-09-11T22:14:44.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 -- start start 2024-09-11T22:14:44.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 Processor -- start 2024-09-11T22:14:44.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8283a30 0x55bab82964d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.242+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8296a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b1d5f9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8287dc0 0x55bab8296f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141ac010 con 0x55bab82874a0 2024-09-11T22:14:44.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141ad480 con 0x55bab8283a30 2024-09-11T22:14:44.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b1d5f9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141ac6e0 con 0x55bab8287dc0 2024-09-11T22:14:44.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b1d5f9740 10 client.0 _ll_register_callbacks cb 0x7f1b0c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:44.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8296a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8296a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53052/0 (socket says 172.21.15.152:53052) 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b13fff640 1 -- 172.21.15.152:0/2169322894 learned_addr learned my addr 172.21.15.152:0/2169322894 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8283a30 0x55bab82964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b197bd640 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8287dc0 0x55bab8296f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b13fff640 1 -- 172.21.15.152:0/2169322894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8287dc0 msgr2=0x55bab8296f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b13fff640 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8287dc0 0x55bab8296f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b13fff640 1 -- 172.21.15.152:0/2169322894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8283a30 msgr2=0x55bab82964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b13fff640 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8283a30 0x55bab82964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b13fff640 1 -- 172.21.15.152:0/2169322894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bab8310100 con 0x55bab82874a0 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b13fff640 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8296a10 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f1b0809af80 tx=0x7f1b0809acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7998c26bd1a73c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1af3fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1af3fff640 1 -- 172.21.15.152:0/2169322894 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080b3020 con 0x55bab82874a0 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1af3fff640 1 -- 172.21.15.152:0/2169322894 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f1b080cc730 con 0x55bab82874a0 2024-09-11T22:14:44.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2169322894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b0c02f6f0 con 0x55bab82874a0 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1af3fff640 1 -- 172.21.15.152:0/2169322894 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1b0809f630 con 0x55bab82874a0 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b1d5f9740 10 client.18012 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.243+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2169322894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bab8311430 con 0x55bab82874a0 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.244+0000 7f1af3fff640 1 -- 172.21.15.152:0/2169322894 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b0c02f6f0 con 0x55bab82874a0 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.244+0000 7f1af3fff640 1 -- 172.21.15.152:0/2169322894 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f1b0809a6d0 con 0x55bab82874a0 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.244+0000 7f1b1d5f9740 10 client.18012 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.244+0000 7f1b1d5f9740 10 client.18012 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.244+0000 7f1b1d5f9740 20 client.18012 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.244+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bab8292680 0x55bab8313c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.244+0000 7f1b1d5f9740 4 client.18012 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.244+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2169322894 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bab81f4d60 con 0x55bab8292680 2024-09-11T22:14:44.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.244+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bab8292680 0x55bab8313c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.244+0000 7f1b18fbc640 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bab8292680 0x55bab8313c70 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f12352c2c7933d4 server_cookie=87343f3d5178d4dc in_seq=0 out_seq=0 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.244+0000 7f1af3fff640 10 client.18012 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1af3fff640 1 -- 172.21.15.152:0/2169322894 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55bab81f4d60 con 0x55bab8292680 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1af3fff640 10 client.18012 handle_command_reply: tid=0 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 1 client.18012 shutdown 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2169322894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 msgr2=0x55bab8296a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8296a10 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f1b0809af80 tx=0x7f1b0809acf0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2169322894 shutdown_connections 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55bab8292680 0x55bab8313c70 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bab8287dc0 0x55bab8296f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1af3fff640 0 client.18012 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bab82874a0 0x55bab8296a10 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 1 --2- 172.21.15.152:0/2169322894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bab8283a30 0x55bab82964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2169322894 >> 172.21.15.152:0/2169322894 conn(0x55bab828f8f0 msgr2=0x55bab828a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:44.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2169322894 shutdown_connections 2024-09-11T22:14:44.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 1 -- 172.21.15.152:0/2169322894 wait complete. 2024-09-11T22:14:44.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.245+0000 7f1b1d5f9740 20 client.18012 trim_cache size 0 max 16384 2024-09-11T22:14:44.252 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:14:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:14:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:14:44.252 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:14:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 -- 172.21.15.152:0/972460391 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1afc0a2d70 msgr2=0x7f1afc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1afc0a2d70 0x7f1afc0a5230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009c70 tx=0x7f1b040117b0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 -- 172.21.15.152:0/972460391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b141036c0 msgr2=0x7f1b14198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b141036c0 0x7f1b14198900 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800d950 tx=0x7f1b0800de10 comp rx=0 tx=0).stop 2024-09-11T22:14:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 -- 172.21.15.152:0/972460391 shutdown_connections 2024-09-11T22:14:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1afc0a2d70 0x7f1afc0a5230 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b1410c180 0x7f1b1419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b141036c0 0x7f1b14198900 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 --2- 172.21.15.152:0/972460391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b14102da0 0x7f1b141983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:44.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 -- 172.21.15.152:0/972460391 >> 172.21.15.152:0/972460391 conn(0x7f1b140fc7a0 msgr2=0x7f1b140fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:44.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 -- 172.21.15.152:0/972460391 shutdown_connections 2024-09-11T22:14:44.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:44.246+0000 7f1b1b220640 1 -- 172.21.15.152:0/972460391 wait complete. 2024-09-11T22:14:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:14:45.027 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:14:45.027 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:14:45.276 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:45.519 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:45 smithi152 ceph-mon[31188]: pgmap v324: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.4 MiB/s wr, 253 op/s 2024-09-11T22:14:45.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:45 smithi179 ceph-mon[35603]: pgmap v324: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.4 MiB/s wr, 253 op/s 2024-09-11T22:14:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:45 smithi193 ceph-mon[35545]: pgmap v324: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.4 MiB/s wr, 253 op/s 2024-09-11T22:14:45.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.783+0000 7fd784a9f640 1 -- 172.21.15.152:0/3713927228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd780102570 msgr2=0x7fd7801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.783+0000 7fd784a9f640 1 --2- 172.21.15.152:0/3713927228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd780102570 0x7fd7801029b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fd768009900 tx=0x7fd76802a480 comp rx=0 tx=0).stop 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.783+0000 7fd784a9f640 1 -- 172.21.15.152:0/3713927228 shutdown_connections 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.783+0000 7fd784a9f640 1 --2- 172.21.15.152:0/3713927228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd780102ef0 0x7fd78010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.783+0000 7fd784a9f640 1 --2- 172.21.15.152:0/3713927228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd780102570 0x7fd7801029b0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.783+0000 7fd784a9f640 1 --2- 172.21.15.152:0/3713927228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd780100e20 0x7fd780101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.783+0000 7fd784a9f640 1 -- 172.21.15.152:0/3713927228 >> 172.21.15.152:0/3713927228 conn(0x7fd7800fc7d0 msgr2=0x7fd7800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.783+0000 7fd784a9f640 1 -- 172.21.15.152:0/3713927228 shutdown_connections 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.783+0000 7fd784a9f640 1 -- 172.21.15.152:0/3713927228 wait complete. 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd784a9f640 1 Processor -- start 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd784a9f640 1 -- start start 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd784a9f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd780100e20 0x7fd7800fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd784a9f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd780102570 0x7fd7800fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd784a9f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd780102ef0 0x7fd7800fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd784a9f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd780110f80 con 0x7fd780102570 2024-09-11T22:14:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd784a9f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd780110e00 con 0x7fd780100e20 2024-09-11T22:14:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd784a9f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd780111100 con 0x7fd780102ef0 2024-09-11T22:14:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd777fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd780102570 0x7fd7800fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd777fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd780102570 0x7fd7800fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53064/0 (socket says 172.21.15.152:53064) 2024-09-11T22:14:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd777fff640 1 -- 172.21.15.152:0/929021569 learned_addr learned my addr 172.21.15.152:0/929021569 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd77e59c640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd780100e20 0x7fd7800fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd77ed9d640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd780102ef0 0x7fd7800fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd777fff640 1 -- 172.21.15.152:0/929021569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd780102ef0 msgr2=0x7fd7800fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd777fff640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd780102ef0 0x7fd7800fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd777fff640 1 -- 172.21.15.152:0/929021569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd780100e20 msgr2=0x7fd7800fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd777fff640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd780100e20 0x7fd7800fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd777fff640 1 -- 172.21.15.152:0/929021569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7801a6990 con 0x7fd780102570 2024-09-11T22:14:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.784+0000 7fd77ed9d640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd780102ef0 0x7fd7800fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.785+0000 7fd777fff640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd780102570 0x7fd7800fd1c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd768006010 tx=0x7fd768003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.785+0000 7fd7777fe640 1 -- 172.21.15.152:0/929021569 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76803f070 con 0x7fd780102570 2024-09-11T22:14:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.785+0000 7fd7777fe640 1 -- 172.21.15.152:0/929021569 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd768031c30 con 0x7fd780102570 2024-09-11T22:14:45.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.785+0000 7fd784a9f640 1 -- 172.21.15.152:0/929021569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7801a6c20 con 0x7fd780102570 2024-09-11T22:14:45.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.785+0000 7fd7777fe640 1 -- 172.21.15.152:0/929021569 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768035030 con 0x7fd780102570 2024-09-11T22:14:45.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.785+0000 7fd784a9f640 1 -- 172.21.15.152:0/929021569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7801a7100 con 0x7fd780102570 2024-09-11T22:14:45.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.786+0000 7fd784a9f640 1 -- 172.21.15.152:0/929021569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd780101200 con 0x7fd780102570 2024-09-11T22:14:45.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.788+0000 7fd7777fe640 1 -- 172.21.15.152:0/929021569 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd768042070 con 0x7fd780102570 2024-09-11T22:14:45.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.788+0000 7fd7777fe640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd76c0a2cf0 0x7fd76c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.789+0000 7fd77e59c640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd76c0a2cf0 0x7fd76c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.789+0000 7fd7777fe640 1 -- 172.21.15.152:0/929021569 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7fd7680f0100 con 0x7fd780102570 2024-09-11T22:14:45.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.789+0000 7fd77e59c640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd76c0a2cf0 0x7fd76c0a51b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd770005fd0 tx=0x7fd77000b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.792+0000 7fd7777fe640 1 -- 172.21.15.152:0/929021569 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd768031de0 con 0x7fd780102570 2024-09-11T22:14:45.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.991+0000 7fd784a9f640 1 -- 172.21.15.152:0/929021569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd78010a0a0 con 0x7fd780102570 2024-09-11T22:14:45.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.992+0000 7fd7777fe640 1 -- 172.21.15.152:0/929021569 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7fd7680bcd80 con 0x7fd780102570 2024-09-11T22:14:45.993 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:14:45.993 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:14:45.993 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:14:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 -- 172.21.15.152:0/929021569 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd76c0a2cf0 msgr2=0x7fd76c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd76c0a2cf0 0x7fd76c0a51b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd770005fd0 tx=0x7fd77000b390 comp rx=0 tx=0).stop 2024-09-11T22:14:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 -- 172.21.15.152:0/929021569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd780102570 msgr2=0x7fd7800fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd780102570 0x7fd7800fd1c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd768006010 tx=0x7fd768003c10 comp rx=0 tx=0).stop 2024-09-11T22:14:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 -- 172.21.15.152:0/929021569 shutdown_connections 2024-09-11T22:14:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd76c0a2cf0 0x7fd76c0a51b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd780102ef0 0x7fd7800fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd780102570 0x7fd7800fd1c0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 --2- 172.21.15.152:0/929021569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd780100e20 0x7fd7800fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 -- 172.21.15.152:0/929021569 >> 172.21.15.152:0/929021569 conn(0x7fd7800fc7d0 msgr2=0x7fd78006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 -- 172.21.15.152:0/929021569 shutdown_connections 2024-09-11T22:14:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:45.994+0000 7fd784a9f640 1 -- 172.21.15.152:0/929021569 wait complete. 2024-09-11T22:14:46.495 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:46 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/929021569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:46.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:46 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/929021569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:46.786 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:14:46.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:46 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/929021569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:47.042 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:47.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:47 smithi152 ceph-mon[31188]: pgmap v325: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2024-09-11T22:14:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.485+0000 7f63fb48c640 1 -- 172.21.15.152:0/3277739986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63f4101df0 msgr2=0x7f63f41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.485+0000 7f63fb48c640 1 --2- 172.21.15.152:0/3277739986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63f4101df0 0x7f63f41021d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009900 tx=0x7f63f002a410 comp rx=0 tx=0).stop 2024-09-11T22:14:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.485+0000 7f63fb48c640 1 -- 172.21.15.152:0/3277739986 shutdown_connections 2024-09-11T22:14:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.485+0000 7f63fb48c640 1 --2- 172.21.15.152:0/3277739986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63f4106f20 0x7f63f410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.485+0000 7f63fb48c640 1 --2- 172.21.15.152:0/3277739986 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f41027a0 0x7f63f41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.485+0000 7f63fb48c640 1 --2- 172.21.15.152:0/3277739986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63f4101df0 0x7f63f41021d0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.485+0000 7f63fb48c640 1 -- 172.21.15.152:0/3277739986 >> 172.21.15.152:0/3277739986 conn(0x7f63f40fd8f0 msgr2=0x7f63f40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.485+0000 7f63fb48c640 1 -- 172.21.15.152:0/3277739986 shutdown_connections 2024-09-11T22:14:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.485+0000 7f63fb48c640 1 -- 172.21.15.152:0/3277739986 wait complete. 2024-09-11T22:14:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.485+0000 7f63fb48c640 1 Processor -- start 2024-09-11T22:14:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63fb48c640 1 -- start start 2024-09-11T22:14:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63fb48c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63f4101df0 0x7f63f4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63fb48c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63f41027a0 0x7f63f41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63fb48c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f4106f20 0x7f63f419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63fb48c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4111f40 con 0x7f63f4101df0 2024-09-11T22:14:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63fb48c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4111dc0 con 0x7f63f41027a0 2024-09-11T22:14:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63fb48c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41120c0 con 0x7f63f4106f20 2024-09-11T22:14:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f9228640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63f4101df0 0x7f63f4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f9228640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63f4101df0 0x7f63f4198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53088/0 (socket says 172.21.15.152:53088) 2024-09-11T22:14:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f9228640 1 -- 172.21.15.152:0/4088457641 learned_addr learned my addr 172.21.15.152:0/4088457641 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f8a27640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63f41027a0 0x7f63f41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f9a29640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f4106f20 0x7f63f419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f9228640 1 -- 172.21.15.152:0/4088457641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f4106f20 msgr2=0x7f63f419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f9228640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f4106f20 0x7f63f419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f9228640 1 -- 172.21.15.152:0/4088457641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63f41027a0 msgr2=0x7f63f41988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f9228640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63f41027a0 0x7f63f41988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f9228640 1 -- 172.21.15.152:0/4088457641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f419d330 con 0x7f63f4101df0 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f9a29640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f4106f20 0x7f63f419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.486+0000 7f63f9228640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63f4101df0 0x7f63f4198380 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f63f0006010 tx=0x7f63f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.487+0000 7f63ea7fc640 1 -- 172.21.15.152:0/4088457641 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f003f030 con 0x7f63f4101df0 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.487+0000 7f63ea7fc640 1 -- 172.21.15.152:0/4088457641 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63f0003ce0 con 0x7f63f4101df0 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.487+0000 7f63fb48c640 1 -- 172.21.15.152:0/4088457641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f419d5c0 con 0x7f63f4101df0 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.487+0000 7f63ea7fc640 1 -- 172.21.15.152:0/4088457641 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0035070 con 0x7f63f4101df0 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.487+0000 7f63fb48c640 1 -- 172.21.15.152:0/4088457641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f41a4f00 con 0x7f63f4101df0 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.489+0000 7f63ea7fc640 1 -- 172.21.15.152:0/4088457641 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f63f0042030 con 0x7f63f4101df0 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63fd865740 1 Processor -- start 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63ea7fc640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63e00a2d70 0x7f63e00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63fd865740 1 -- start start 2024-09-11T22:14:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f9a29640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63e00a2d70 0x7f63e00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63ea7fc640 1 -- 172.21.15.152:0/4088457641 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f63f00efaa0 con 0x7f63f4101df0 2024-09-11T22:14:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63fd865740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba08b40 0x557fcba07090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63fd865740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba07a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63fd865740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba16780 0x557fcba18b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63fd865740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557fcb96d2f0 con 0x557fcba075d0 2024-09-11T22:14:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63fd865740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557fcb914cf0 con 0x557fcba08b40 2024-09-11T22:14:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63fd865740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557fcb9692b0 con 0x557fcba16780 2024-09-11T22:14:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f8a27640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba07a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f8a27640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba07a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53098/0 (socket says 172.21.15.152:53098) 2024-09-11T22:14:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f8a27640 1 -- 172.21.15.152:0/1332830755 learned_addr learned my addr 172.21.15.152:0/1332830755 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f9a29640 1 --2- 172.21.15.152:0/1332830755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba16780 0x557fcba18b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f9228640 1 --2- 172.21.15.152:0/1332830755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba08b40 0x557fcba07090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f8a27640 1 -- 172.21.15.152:0/1332830755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba16780 msgr2=0x557fcba18b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f8a27640 1 --2- 172.21.15.152:0/1332830755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba16780 0x557fcba18b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f9a29640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63e00a2d70 0x7f63e00a5230 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f63ec005fd0 tx=0x7f63ec00f730 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f8a27640 1 -- 172.21.15.152:0/1332830755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba08b40 msgr2=0x557fcba07090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f8a27640 1 --2- 172.21.15.152:0/1332830755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba08b40 0x557fcba07090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.490+0000 7f63f8a27640 1 -- 172.21.15.152:0/1332830755 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcb8f93a0 con 0x557fcba075d0 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.491+0000 7f63f8a27640 1 --2- 172.21.15.152:0/1332830755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba07a10 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f63e400cc40 tx=0x7f63e400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da14a7d79be1069 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.491+0000 7f63df7fe640 1 -- 172.21.15.152:0/1332830755 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4014070 con 0x557fcba075d0 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.491+0000 7f63df7fe640 1 -- 172.21.15.152:0/1332830755 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63e40047a0 con 0x557fcba075d0 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.491+0000 7f63df7fe640 1 -- 172.21.15.152:0/1332830755 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4010720 con 0x557fcba075d0 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 -- 172.21.15.152:0/1332830755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 msgr2=0x557fcba07a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 --2- 172.21.15.152:0/1332830755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba07a10 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f63e400cc40 tx=0x7f63e400e720 comp rx=0 tx=0).stop 2024-09-11T22:14:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 -- 172.21.15.152:0/1332830755 shutdown_connections 2024-09-11T22:14:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 --2- 172.21.15.152:0/1332830755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba16780 0x557fcba18b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 --2- 172.21.15.152:0/1332830755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba07a10 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 --2- 172.21.15.152:0/1332830755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba08b40 0x557fcba07090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 -- 172.21.15.152:0/1332830755 >> 172.21.15.152:0/1332830755 conn(0x557fcb9d0310 msgr2=0x557fcba03c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 -- 172.21.15.152:0/1332830755 shutdown_connections 2024-09-11T22:14:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 -- 172.21.15.152:0/1332830755 wait complete. 2024-09-11T22:14:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 -- start start 2024-09-11T22:14:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 Processor -- start 2024-09-11T22:14:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba075d0 0x557fcba16150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba08b40 0x557fcba13400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba16780 0x557fcba139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557fcba19480 con 0x557fcba16780 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557fcb928060 con 0x557fcba08b40 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.492+0000 7f63fd865740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557fcba19600 con 0x557fcba075d0 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63fd865740 10 client.0 _ll_register_callbacks cb 0x557fcb67b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63f9a29640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba16780 0x557fcba139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63f9a29640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba16780 0x557fcba139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53106/0 (socket says 172.21.15.152:53106) 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63f9a29640 1 -- 172.21.15.152:0/564308232 learned_addr learned my addr 172.21.15.152:0/564308232 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63f8a27640 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba08b40 0x557fcba13400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63f9228640 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba075d0 0x557fcba16150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63f9a29640 1 -- 172.21.15.152:0/564308232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba075d0 msgr2=0x557fcba16150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63f9a29640 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba075d0 0x557fcba16150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63f9a29640 1 -- 172.21.15.152:0/564308232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba08b40 msgr2=0x557fcba13400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63f9a29640 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba08b40 0x557fcba13400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63f9a29640 1 -- 172.21.15.152:0/564308232 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fcb6de3c0 con 0x557fcba16780 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63f9a29640 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba16780 0x557fcba139f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0128e0 tx=0x7f63ec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b7af170db31655 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63dcff9640 1 -- 172.21.15.152:0/564308232 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec01dd60 con 0x557fcba16780 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63fd865740 1 -- 172.21.15.152:0/564308232 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63e40047a0 con 0x557fcba16780 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63dcff9640 1 -- 172.21.15.152:0/564308232 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f63ec01e440 con 0x557fcba16780 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63dcff9640 1 -- 172.21.15.152:0/564308232 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f63ec01e640 con 0x557fcba16780 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.493+0000 7f63fd865740 10 client.18030 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.494+0000 7f63fd865740 1 -- 172.21.15.152:0/564308232 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557fcba24f50 con 0x557fcba16780 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.494+0000 7f63dcff9640 1 -- 172.21.15.152:0/564308232 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63e40047a0 con 0x557fcba16780 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.494+0000 7f63dcff9640 1 -- 172.21.15.152:0/564308232 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f63ec029860 con 0x557fcba16780 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.494+0000 7f63fd865740 10 client.18030 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.494+0000 7f63fd865740 10 client.18030 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.494+0000 7f63fd865740 20 client.18030 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.494+0000 7f63fd865740 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x557fcba26410 0x557fcba28840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.494+0000 7f63fd865740 4 client.18030 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.494+0000 7f63fd865740 1 -- 172.21.15.152:0/564308232 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fcb97a860 con 0x557fcba26410 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.494+0000 7f63f9228640 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x557fcba26410 0x557fcba28840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.495+0000 7f63dcff9640 10 client.18030 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.495+0000 7f63f9228640 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x557fcba26410 0x557fcba28840 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3c5c0dd20daf35ea server_cookie=16646c30dc64b1c9 in_seq=0 out_seq=0 2024-09-11T22:14:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.495+0000 7f63dcff9640 1 -- 172.21.15.152:0/564308232 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557fcb97a860 con 0x557fcba26410 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.495+0000 7f63dcff9640 10 client.18030 handle_command_reply: tid=0 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.495+0000 7f63fd865740 1 client.18030 shutdown 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.495+0000 7f63fd865740 1 -- 172.21.15.152:0/564308232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba16780 msgr2=0x557fcba139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.495+0000 7f63fd865740 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba16780 0x557fcba139f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0128e0 tx=0x7f63ec004ab0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.496+0000 7f63fd865740 1 -- 172.21.15.152:0/564308232 shutdown_connections 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.496+0000 7f63fd865740 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x557fcba26410 0x557fcba28840 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.496+0000 7f63fd865740 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba16780 0x557fcba139f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.496+0000 7f63fd865740 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba08b40 0x557fcba13400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.496+0000 7f63fd865740 1 --2- 172.21.15.152:0/564308232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba075d0 0x557fcba16150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.496+0000 7f63fd865740 1 -- 172.21.15.152:0/564308232 >> 172.21.15.152:0/564308232 conn(0x557fcb9d0310 msgr2=0x557fcba09930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.496+0000 7f63dcff9640 0 client.18030 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.496+0000 7f63fd865740 1 -- 172.21.15.152:0/564308232 shutdown_connections 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.496+0000 7f63fd865740 1 -- 172.21.15.152:0/564308232 wait complete. 2024-09-11T22:14:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.496+0000 7f63fd865740 20 client.18030 trim_cache size 0 max 16384 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63fd865740 1 Processor -- start 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63fd865740 1 -- start start 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63fd865740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba22720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63fd865740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba08b40 0x557fcba03700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63fd865740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba16780 0x557fcba03c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63fd865740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41ae010 con 0x557fcba075d0 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63fd865740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41ab8e0 con 0x557fcba16780 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63fd865740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41a9750 con 0x557fcba08b40 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f9228640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba22720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f9228640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba22720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53118/0 (socket says 172.21.15.152:53118) 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f9228640 1 -- 172.21.15.152:0/3558856421 learned_addr learned my addr 172.21.15.152:0/3558856421 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f8a27640 1 --2- 172.21.15.152:0/3558856421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba08b40 0x557fcba03700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f9a29640 1 --2- 172.21.15.152:0/3558856421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba16780 0x557fcba03c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f9228640 1 -- 172.21.15.152:0/3558856421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba08b40 msgr2=0x557fcba03700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f9228640 1 --2- 172.21.15.152:0/3558856421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba08b40 0x557fcba03700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f9228640 1 -- 172.21.15.152:0/3558856421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba16780 msgr2=0x557fcba03c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f9228640 1 --2- 172.21.15.152:0/3558856421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba16780 0x557fcba03c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f9228640 1 -- 172.21.15.152:0/3558856421 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcba04180 con 0x557fcba075d0 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f8a27640 1 --2- 172.21.15.152:0/3558856421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba08b40 0x557fcba03700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.509+0000 7f63f9228640 1 --2- 172.21.15.152:0/3558856421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba22720 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f63f00b8480 tx=0x7f63f00bba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807e614650513f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63deffd640 1 -- 172.21.15.152:0/3558856421 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0049040 con 0x557fcba075d0 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63deffd640 1 -- 172.21.15.152:0/3558856421 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63f00bc720 con 0x557fcba075d0 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63deffd640 1 -- 172.21.15.152:0/3558856421 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f00ba3b0 con 0x557fcba075d0 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63fd865740 1 -- 172.21.15.152:0/3558856421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 msgr2=0x557fcba22720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63fd865740 1 --2- 172.21.15.152:0/3558856421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba22720 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f63f00b8480 tx=0x7f63f00bba80 comp rx=0 tx=0).stop 2024-09-11T22:14:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63fd865740 1 -- 172.21.15.152:0/3558856421 shutdown_connections 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63fd865740 1 --2- 172.21.15.152:0/3558856421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba16780 0x557fcba03c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63fd865740 1 --2- 172.21.15.152:0/3558856421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba08b40 0x557fcba03700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63fd865740 1 --2- 172.21.15.152:0/3558856421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba22720 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63fd865740 1 -- 172.21.15.152:0/3558856421 >> 172.21.15.152:0/3558856421 conn(0x557fcb9d0310 msgr2=0x557fcba133c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63fd865740 1 -- 172.21.15.152:0/3558856421 shutdown_connections 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.510+0000 7f63fd865740 1 -- 172.21.15.152:0/3558856421 wait complete. 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63fd865740 1 -- start start 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63fd865740 1 Processor -- start 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63fd865740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba1f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63fd865740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba08b40 0x557fcba10260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63fd865740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba16780 0x557fcba107e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63fd865740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41a9da0 con 0x557fcba075d0 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63fd865740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41ab210 con 0x557fcba16780 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63fd865740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41aa470 con 0x557fcba08b40 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63fd865740 10 client.0 _ll_register_callbacks cb 0x7f63ec00fee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63f9228640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba1f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63f9228640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba1f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53130/0 (socket says 172.21.15.152:53130) 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63f9228640 1 -- 172.21.15.152:0/2219121973 learned_addr learned my addr 172.21.15.152:0/2219121973 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63f9228640 1 -- 172.21.15.152:0/2219121973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba08b40 msgr2=0x557fcba10260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63f8a27640 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba08b40 0x557fcba10260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63f9a29640 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba16780 0x557fcba107e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63f9228640 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba08b40 0x557fcba10260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63f9228640 1 -- 172.21.15.152:0/2219121973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba16780 msgr2=0x557fcba107e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63f9228640 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba16780 0x557fcba107e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63f9228640 1 -- 172.21.15.152:0/2219121973 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fcba11010 con 0x557fcba075d0 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.511+0000 7f63f9a29640 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba16780 0x557fcba107e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63f9228640 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba1f090 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f63f00bbe10 tx=0x7f63f002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f701f3f96673ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63dcff9640 1 -- 172.21.15.152:0/2219121973 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0049040 con 0x557fcba075d0 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63dcff9640 1 -- 172.21.15.152:0/2219121973 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f63f00ed410 con 0x557fcba075d0 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63fd865740 1 -- 172.21.15.152:0/2219121973 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63f00bc720 con 0x557fcba075d0 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63dcff9640 1 -- 172.21.15.152:0/2219121973 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f63f00c4c90 con 0x557fcba075d0 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63fd865740 10 client.18036 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63fd865740 1 -- 172.21.15.152:0/2219121973 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557fcba91180 con 0x557fcba075d0 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63dcff9640 1 -- 172.21.15.152:0/2219121973 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63f00bc720 con 0x557fcba075d0 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63dcff9640 1 -- 172.21.15.152:0/2219121973 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f63f00a6ce0 con 0x557fcba075d0 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63fd865740 10 client.18036 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:47.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63fd865740 10 client.18036 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63fd865740 20 client.18036 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63fd865740 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x557fcba91830 0x557fcba93c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63fd865740 4 client.18036 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.512+0000 7f63fd865740 1 -- 172.21.15.152:0/2219121973 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557fcb974d70 con 0x557fcba91830 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63f8a27640 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x557fcba91830 0x557fcba93c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63dcff9640 10 client.18036 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63f8a27640 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x557fcba91830 0x557fcba93c20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b19d18aabb0b65cf server_cookie=ac1eeae51325d2f0 in_seq=0 out_seq=0 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63dcff9640 1 -- 172.21.15.152:0/2219121973 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557fcb974d70 con 0x557fcba91830 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63dcff9640 10 client.18036 handle_command_reply: tid=0 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63fd865740 1 client.18036 shutdown 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63fd865740 1 -- 172.21.15.152:0/2219121973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 msgr2=0x557fcba1f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63fd865740 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba1f090 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f63f00bbe10 tx=0x7f63f002a410 comp rx=0 tx=0).stop 2024-09-11T22:14:47.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63fd865740 1 -- 172.21.15.152:0/2219121973 shutdown_connections 2024-09-11T22:14:47.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63fd865740 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x557fcba91830 0x557fcba93c20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63fd865740 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fcba16780 0x557fcba107e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63fd865740 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fcba08b40 0x557fcba10260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63dcff9640 0 client.18036 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:14:47.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63fd865740 1 --2- 172.21.15.152:0/2219121973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fcba075d0 0x557fcba1f090 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63fd865740 1 -- 172.21.15.152:0/2219121973 >> 172.21.15.152:0/2219121973 conn(0x557fcb9d0310 msgr2=0x557fcba118e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63fd865740 1 -- 172.21.15.152:0/2219121973 shutdown_connections 2024-09-11T22:14:47.537 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:14:47.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.513+0000 7f63fd865740 1 -- 172.21.15.152:0/2219121973 wait complete. 2024-09-11T22:14:47.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fd865740 20 client.18036 trim_cache size 0 max 16384 2024-09-11T22:14:47.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 -- 172.21.15.152:0/4088457641 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63e00a2d70 msgr2=0x7f63e00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63e00a2d70 0x7f63e00a5230 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f63ec005fd0 tx=0x7f63ec00f730 comp rx=0 tx=0).stop 2024-09-11T22:14:47.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 -- 172.21.15.152:0/4088457641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63f4101df0 msgr2=0x7f63f4198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63f4101df0 0x7f63f4198380 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f63f0006010 tx=0x7f63f00042f0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 -- 172.21.15.152:0/4088457641 shutdown_connections 2024-09-11T22:14:47.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63e00a2d70 0x7f63e00a5230 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63f4106f20 0x7f63f419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63f41027a0 0x7f63f41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 --2- 172.21.15.152:0/4088457641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63f4101df0 0x7f63f4198380 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 -- 172.21.15.152:0/4088457641 >> 172.21.15.152:0/4088457641 conn(0x7f63f40fd8f0 msgr2=0x7f63f40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 -- 172.21.15.152:0/4088457641 shutdown_connections 2024-09-11T22:14:47.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:47.514+0000 7f63fb48c640 1 -- 172.21.15.152:0/4088457641 wait complete. 2024-09-11T22:14:47.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:47 smithi193 ceph-mon[35545]: pgmap v325: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2024-09-11T22:14:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:47 smithi179 ceph-mon[35603]: pgmap v325: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2024-09-11T22:14:48.235 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:14:48.485 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.943+0000 7f12896b9640 1 -- 172.21.15.152:0/1794777056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1284105590 msgr2=0x7f128410d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.943+0000 7f12896b9640 1 --2- 172.21.15.152:0/1794777056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1284105590 0x7f128410d110 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1274009900 tx=0x7f127402a410 comp rx=0 tx=0).stop 2024-09-11T22:14:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.943+0000 7f12896b9640 1 -- 172.21.15.152:0/1794777056 shutdown_connections 2024-09-11T22:14:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.943+0000 7f12896b9640 1 --2- 172.21.15.152:0/1794777056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1284105590 0x7f128410d110 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.943+0000 7f12896b9640 1 --2- 172.21.15.152:0/1794777056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1284100e10 0x7f1284104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.943+0000 7f12896b9640 1 --2- 172.21.15.152:0/1794777056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1284100460 0x7f1284100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.943+0000 7f12896b9640 1 -- 172.21.15.152:0/1794777056 >> 172.21.15.152:0/1794777056 conn(0x7f12840fbee0 msgr2=0x7f12840fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.943+0000 7f12896b9640 1 -- 172.21.15.152:0/1794777056 shutdown_connections 2024-09-11T22:14:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.943+0000 7f12896b9640 1 -- 172.21.15.152:0/1794777056 wait complete. 2024-09-11T22:14:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f12896b9640 1 Processor -- start 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f12896b9640 1 -- start start 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f12896b9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1284100460 0x7f128419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f12896b9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1284100e10 0x7f128419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f12896b9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1284105590 0x7f128419ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f12896b9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1284110610 con 0x7f1284100460 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f12896b9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1284110490 con 0x7f1284105590 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f12896b9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1284110790 con 0x7f1284100e10 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f1282ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1284100460 0x7f128419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f1282ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1284100460 0x7f128419a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53146/0 (socket says 172.21.15.152:53146) 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f1282ffd640 1 -- 172.21.15.152:0/3960526797 learned_addr learned my addr 172.21.15.152:0/3960526797 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.944+0000 7f12827fc640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1284100e10 0x7f128419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f1282ffd640 1 -- 172.21.15.152:0/3960526797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1284100e10 msgr2=0x7f128419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f1282ffd640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1284100e10 0x7f128419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f1282ffd640 1 -- 172.21.15.152:0/3960526797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1284105590 msgr2=0x7f128419ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f12837fe640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1284105590 0x7f128419ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f1282ffd640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1284105590 0x7f128419ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f1282ffd640 1 -- 172.21.15.152:0/3960526797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128419f530 con 0x7f1284100460 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f1282ffd640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1284100460 0x7f128419a580 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f126c00c920 tx=0x7f126c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f127bfff640 1 -- 172.21.15.152:0/3960526797 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c007c70 con 0x7f1284100460 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f12896b9640 1 -- 172.21.15.152:0/3960526797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128419f820 con 0x7f1284100460 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f127bfff640 1 -- 172.21.15.152:0/3960526797 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f126c007e10 con 0x7f1284100460 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f127bfff640 1 -- 172.21.15.152:0/3960526797 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c018890 con 0x7f1284100460 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.945+0000 7f12896b9640 1 -- 172.21.15.152:0/3960526797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12841a7100 con 0x7f1284100460 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.947+0000 7f127bfff640 1 -- 172.21.15.152:0/3960526797 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f126c018a70 con 0x7f1284100460 2024-09-11T22:14:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f128ba92740 1 Processor -- start 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f128ba92740 1 -- start start 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f128ba92740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed4b40 0x5573e6ed3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f128ba92740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f128ba92740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6ee0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f128ba92740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5573e6e392f0 con 0x5573e6ed35d0 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f128ba92740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5573e6de0cf0 con 0x5573e6ede370 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f128ba92740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5573e6e352b0 con 0x5573e6ed4b40 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f127bfff640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12700a2cf0 0x7f12700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f1282ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f1282ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53154/0 (socket says 172.21.15.152:53154) 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.948+0000 7f1282ffd640 1 -- 172.21.15.152:0/4104169134 learned_addr learned my addr 172.21.15.152:0/4104169134 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f12837fe640 1 --2- 172.21.15.152:0/4104169134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed4b40 0x5573e6ed3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f12827fc640 1 --2- 172.21.15.152:0/4104169134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6ee0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f12837fe640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12700a2cf0 0x7f12700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f127bfff640 1 -- 172.21.15.152:0/3960526797 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f126c0cf6b0 con 0x7f1284100460 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f1282ffd640 1 -- 172.21.15.152:0/4104169134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed4b40 msgr2=0x5573e6ed3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f1282ffd640 1 --2- 172.21.15.152:0/4104169134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed4b40 0x5573e6ed3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f1282ffd640 1 -- 172.21.15.152:0/4104169134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 msgr2=0x5573e6ee0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f1282ffd640 1 --2- 172.21.15.152:0/4104169134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6ee0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f1282ffd640 1 -- 172.21.15.152:0/4104169134 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573e6dc53a0 con 0x5573e6ed35d0 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f1282ffd640 1 --2- 172.21.15.152:0/4104169134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed3a10 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f126c0cce50 tx=0x7f126c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e82777b94dc6563 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f12837fe640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12700a2cf0 0x7f12700a51b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f127402a930 tx=0x7f1274005fd0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f12797fa640 1 -- 172.21.15.152:0/4104169134 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c00de20 con 0x5573e6ed35d0 2024-09-11T22:14:48.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f12797fa640 1 -- 172.21.15.152:0/4104169134 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f126c09ff20 con 0x5573e6ed35d0 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.949+0000 7f12797fa640 1 -- 172.21.15.152:0/4104169134 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c0cd020 con 0x5573e6ed35d0 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.950+0000 7f128ba92740 1 -- 172.21.15.152:0/4104169134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 msgr2=0x5573e6ed3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.950+0000 7f128ba92740 1 --2- 172.21.15.152:0/4104169134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed3a10 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f126c0cce50 tx=0x7f126c020000 comp rx=0 tx=0).stop 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.950+0000 7f128ba92740 1 -- 172.21.15.152:0/4104169134 shutdown_connections 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.950+0000 7f128ba92740 1 --2- 172.21.15.152:0/4104169134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6ee0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.950+0000 7f128ba92740 1 --2- 172.21.15.152:0/4104169134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed3a10 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.950+0000 7f128ba92740 1 --2- 172.21.15.152:0/4104169134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed4b40 0x5573e6ed3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.950+0000 7f128ba92740 1 -- 172.21.15.152:0/4104169134 >> 172.21.15.152:0/4104169134 conn(0x5573e6e9c310 msgr2=0x5573e6ecfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.950+0000 7f128ba92740 1 -- 172.21.15.152:0/4104169134 shutdown_connections 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.950+0000 7f128ba92740 1 -- 172.21.15.152:0/4104169134 wait complete. 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.950+0000 7f128ba92740 1 -- start start 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.950+0000 7f128ba92740 1 Processor -- start 2024-09-11T22:14:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f128ba92740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed35d0 0x5573e6edde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f128ba92740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6edb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f128ba92740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6edb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f128ba92740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5573e6ee1010 con 0x5573e6ed4b40 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f128ba92740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5573e6df4060 con 0x5573e6ede370 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f128ba92740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5573e6ee1190 con 0x5573e6ed35d0 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f128ba92740 10 client.0 _ll_register_callbacks cb 0x5573e6b478c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f12827fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6edb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f12827fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6edb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53160/0 (socket says 172.21.15.152:53160) 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f12827fc640 1 -- 172.21.15.152:0/1753547557 learned_addr learned my addr 172.21.15.152:0/1753547557 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f1282ffd640 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed35d0 0x5573e6edde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f12837fe640 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6edb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f12827fc640 1 -- 172.21.15.152:0/1753547557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed35d0 msgr2=0x5573e6edde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:48.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f12827fc640 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed35d0 0x5573e6edde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f12827fc640 1 -- 172.21.15.152:0/1753547557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 msgr2=0x5573e6edb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f12827fc640 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6edb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f12827fc640 1 -- 172.21.15.152:0/1753547557 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573e6baa3c0 con 0x5573e6ed4b40 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f12827fc640 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6edb0e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f127c00be80 tx=0x7f127c007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75731db85b7dc18d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f126a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f126a7fc640 1 -- 172.21.15.152:0/1753547557 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c009e20 con 0x5573e6ed4b40 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f126a7fc640 1 -- 172.21.15.152:0/1753547557 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f127c007c90 con 0x5573e6ed4b40 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.951+0000 7f128ba92740 1 -- 172.21.15.152:0/1753547557 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f126c09ff20 con 0x5573e6ed4b40 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f126a7fc640 1 -- 172.21.15.152:0/1753547557 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f127c021470 con 0x5573e6ed4b40 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f128ba92740 10 client.18048 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f128ba92740 1 -- 172.21.15.152:0/1753547557 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5573e6eecc30 con 0x5573e6ed4b40 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f126a7fc640 1 -- 172.21.15.152:0/1753547557 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f126c09ff20 con 0x5573e6ed4b40 2024-09-11T22:14:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f126a7fc640 1 -- 172.21.15.152:0/1753547557 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f127c0184c0 con 0x5573e6ed4b40 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f128ba92740 10 client.18048 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f128ba92740 10 client.18048 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f128ba92740 20 client.18048 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f128ba92740 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5573e6eee190 0x5573e6ef05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f128ba92740 4 client.18048 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f128ba92740 1 -- 172.21.15.152:0/1753547557 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573e6e46860 con 0x5573e6eee190 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.952+0000 7f1282ffd640 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5573e6eee190 0x5573e6ef05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.953+0000 7f1282ffd640 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5573e6eee190 0x5573e6ef05d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1954403a6f38dc0b server_cookie=31411bc08e063cf7 in_seq=0 out_seq=0 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.953+0000 7f126a7fc640 10 client.18048 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.953+0000 7f126a7fc640 1 -- 172.21.15.152:0/1753547557 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573e6e46860 con 0x5573e6eee190 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.953+0000 7f126a7fc640 10 client.18048 handle_command_reply: tid=0 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.953+0000 7f128ba92740 1 client.18048 shutdown 2024-09-11T22:14:48.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.953+0000 7f128ba92740 1 -- 172.21.15.152:0/1753547557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 msgr2=0x5573e6edb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.953+0000 7f128ba92740 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6edb0e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f127c00be80 tx=0x7f127c007680 comp rx=0 tx=0).stop 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.953+0000 7f128ba92740 1 -- 172.21.15.152:0/1753547557 shutdown_connections 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.954+0000 7f128ba92740 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5573e6eee190 0x5573e6ef05d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.954+0000 7f128ba92740 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6edb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.954+0000 7f128ba92740 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6edb0e0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.954+0000 7f126a7fc640 0 client.18048 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.954+0000 7f128ba92740 1 --2- 172.21.15.152:0/1753547557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed35d0 0x5573e6edde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.954+0000 7f128ba92740 1 -- 172.21.15.152:0/1753547557 >> 172.21.15.152:0/1753547557 conn(0x5573e6e9c310 msgr2=0x5573e6ed5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.954+0000 7f128ba92740 1 -- 172.21.15.152:0/1753547557 shutdown_connections 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.954+0000 7f128ba92740 1 -- 172.21.15.152:0/1753547557 wait complete. 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.954+0000 7f128ba92740 20 client.18048 trim_cache size 0 max 16384 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.966+0000 7f128ba92740 1 Processor -- start 2024-09-11T22:14:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.966+0000 7f128ba92740 1 -- start start 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f128ba92740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f128ba92740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ed4b40 0x5573e6ed66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f128ba92740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ede370 0x5573e6ef5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f128ba92740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12841b24a0 con 0x5573e6ed35d0 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f128ba92740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12841afd70 con 0x5573e6ed4b40 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f128ba92740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12841adbe0 con 0x5573e6ede370 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1282ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1282ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53164/0 (socket says 172.21.15.152:53164) 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1282ffd640 1 -- 172.21.15.152:0/553334523 learned_addr learned my addr 172.21.15.152:0/553334523 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f12827fc640 1 --2- 172.21.15.152:0/553334523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ed4b40 0x5573e6ed66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f12837fe640 1 --2- 172.21.15.152:0/553334523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ede370 0x5573e6ef5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1282ffd640 1 -- 172.21.15.152:0/553334523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ede370 msgr2=0x5573e6ef5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:48.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1282ffd640 1 --2- 172.21.15.152:0/553334523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ede370 0x5573e6ef5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1282ffd640 1 -- 172.21.15.152:0/553334523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ed4b40 msgr2=0x5573e6ed66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1282ffd640 1 --2- 172.21.15.152:0/553334523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ed4b40 0x5573e6ed66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1282ffd640 1 -- 172.21.15.152:0/553334523 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573e6ef0c50 con 0x5573e6ed35d0 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1282ffd640 1 --2- 172.21.15.152:0/553334523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed6180 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f126c09bb00 tx=0x7f126c097ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8372355ef0551b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1278ff9640 1 -- 172.21.15.152:0/553334523 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c09ff20 con 0x5573e6ed35d0 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1278ff9640 1 -- 172.21.15.152:0/553334523 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f126c0a8100 con 0x5573e6ed35d0 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.967+0000 7f1278ff9640 1 -- 172.21.15.152:0/553334523 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c0981e0 con 0x5573e6ed35d0 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.968+0000 7f128ba92740 1 -- 172.21.15.152:0/553334523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 msgr2=0x5573e6ed6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.968+0000 7f128ba92740 1 --2- 172.21.15.152:0/553334523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed6180 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f126c09bb00 tx=0x7f126c097ed0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.968+0000 7f128ba92740 1 -- 172.21.15.152:0/553334523 shutdown_connections 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.968+0000 7f128ba92740 1 --2- 172.21.15.152:0/553334523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ede370 0x5573e6ef5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.968+0000 7f128ba92740 1 --2- 172.21.15.152:0/553334523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ed4b40 0x5573e6ed66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.968+0000 7f128ba92740 1 --2- 172.21.15.152:0/553334523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed35d0 0x5573e6ed6180 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.968+0000 7f128ba92740 1 -- 172.21.15.152:0/553334523 >> 172.21.15.152:0/553334523 conn(0x5573e6e9c310 msgr2=0x5573e6eda1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.968+0000 7f128ba92740 1 -- 172.21.15.152:0/553334523 shutdown_connections 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.968+0000 7f128ba92740 1 -- 172.21.15.152:0/553334523 wait complete. 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.968+0000 7f128ba92740 1 -- start start 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f128ba92740 1 Processor -- start 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f128ba92740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed35d0 0x5573e6ee6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f128ba92740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6ed7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f128ba92740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6ed8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f128ba92740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12841ae230 con 0x5573e6ed4b40 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f128ba92740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12841af6a0 con 0x5573e6ede370 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f128ba92740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12841ae900 con 0x5573e6ed35d0 2024-09-11T22:14:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f128ba92740 10 client.0 _ll_register_callbacks cb 0x7f127c009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f12827fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6ed7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f12827fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6ed7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53180/0 (socket says 172.21.15.152:53180) 2024-09-11T22:14:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f12827fc640 1 -- 172.21.15.152:0/4197418962 learned_addr learned my addr 172.21.15.152:0/4197418962 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f1282ffd640 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed35d0 0x5573e6ee6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f12837fe640 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6ed8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f12827fc640 1 -- 172.21.15.152:0/4197418962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed35d0 msgr2=0x5573e6ee6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f12827fc640 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed35d0 0x5573e6ee6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f12827fc640 1 -- 172.21.15.152:0/4197418962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 msgr2=0x5573e6ed8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f12827fc640 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6ed8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f12827fc640 1 -- 172.21.15.152:0/4197418962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573e6ed8b20 con 0x5573e6ed4b40 2024-09-11T22:14:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f12837fe640 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6ed8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f12827fc640 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6ed7dd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f127c007c00 tx=0x7f127c00bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce45939c3aa8e32a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.969+0000 7f126a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f126a7fc640 1 -- 172.21.15.152:0/4197418962 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c018b50 con 0x5573e6ed4b40 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f126a7fc640 1 -- 172.21.15.152:0/4197418962 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f127c018cf0 con 0x5573e6ed4b40 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f128ba92740 1 -- 172.21.15.152:0/4197418962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f126c0a8100 con 0x5573e6ed4b40 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f126a7fc640 1 -- 172.21.15.152:0/4197418962 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f127c0183c0 con 0x5573e6ed4b40 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f128ba92740 10 client.18054 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f128ba92740 1 -- 172.21.15.152:0/4197418962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5573e6f58eb0 con 0x5573e6ed4b40 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f126a7fc640 1 -- 172.21.15.152:0/4197418962 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f126c0a8100 con 0x5573e6ed4b40 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f126a7fc640 1 -- 172.21.15.152:0/4197418962 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f127c02a430 con 0x5573e6ed4b40 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f128ba92740 10 client.18054 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f128ba92740 10 client.18054 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:14:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f128ba92740 20 client.18054 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f128ba92740 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5573e6f59630 0x5573e6f5ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f128ba92740 4 client.18054 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.970+0000 7f128ba92740 1 -- 172.21.15.152:0/4197418962 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5573e6e40d70 con 0x5573e6f59630 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f1282ffd640 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5573e6f59630 0x5573e6f5ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f126a7fc640 10 client.18054 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f1282ffd640 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5573e6f59630 0x5573e6f5ba50 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7c32e3d9f1833ac server_cookie=cb608b6931426874 in_seq=0 out_seq=0 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f126a7fc640 1 -- 172.21.15.152:0/4197418962 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5573e6e40d70 con 0x5573e6f59630 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f126a7fc640 10 client.18054 handle_command_reply: tid=0 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f128ba92740 1 client.18054 shutdown 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f128ba92740 1 -- 172.21.15.152:0/4197418962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 msgr2=0x5573e6ed7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f128ba92740 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6ed7dd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f127c007c00 tx=0x7f127c00bb60 comp rx=0 tx=0).stop 2024-09-11T22:14:48.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f128ba92740 1 -- 172.21.15.152:0/4197418962 shutdown_connections 2024-09-11T22:14:48.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f128ba92740 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5573e6f59630 0x5573e6f5ba50 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f128ba92740 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5573e6ede370 0x5573e6ed8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f128ba92740 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573e6ed4b40 0x5573e6ed7dd0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f128ba92740 1 --2- 172.21.15.152:0/4197418962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573e6ed35d0 0x5573e6ee6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f128ba92740 1 -- 172.21.15.152:0/4197418962 >> 172.21.15.152:0/4197418962 conn(0x5573e6e9c310 msgr2=0x5573e6edc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:48.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f126a7fc640 0 client.18054 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:14:48.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f128ba92740 1 -- 172.21.15.152:0/4197418962 shutdown_connections 2024-09-11T22:14:48.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.971+0000 7f128ba92740 1 -- 172.21.15.152:0/4197418962 wait complete. 2024-09-11T22:14:48.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f128ba92740 20 client.18054 trim_cache size 0 max 16384 2024-09-11T22:14:48.989 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:14:48.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 -- 172.21.15.152:0/3960526797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12700a2cf0 msgr2=0x7f12700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:48.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12700a2cf0 0x7f12700a51b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f127402a930 tx=0x7f1274005fd0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 -- 172.21.15.152:0/3960526797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1284100460 msgr2=0x7f128419a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:48.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1284100460 0x7f128419a580 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f126c00c920 tx=0x7f126c00cde0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 -- 172.21.15.152:0/3960526797 shutdown_connections 2024-09-11T22:14:48.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12700a2cf0 0x7f12700a51b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1284105590 0x7f128419ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1284100e10 0x7f128419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 --2- 172.21.15.152:0/3960526797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1284100460 0x7f128419a580 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:48.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 -- 172.21.15.152:0/3960526797 >> 172.21.15.152:0/3960526797 conn(0x7f12840fbee0 msgr2=0x7f128410c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:48.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 -- 172.21.15.152:0/3960526797 shutdown_connections 2024-09-11T22:14:48.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:48.972+0000 7f12896b9640 1 -- 172.21.15.152:0/3960526797 wait complete. 2024-09-11T22:14:49.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:49 smithi193 ceph-mon[35545]: pgmap v326: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 779 KiB/s wr, 79 op/s 2024-09-11T22:14:49.633 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:49 smithi152 ceph-mon[31188]: pgmap v326: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 779 KiB/s wr, 79 op/s 2024-09-11T22:14:49.660 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:14:49.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:49 smithi179 ceph-mon[35603]: pgmap v326: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 779 KiB/s wr, 79 op/s 2024-09-11T22:14:49.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:14:49.907 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:50.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.409+0000 7fc8cc054640 1 -- 172.21.15.152:0/1611244136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c4101de0 msgr2=0x7fc8c41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:50.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.409+0000 7fc8cc054640 1 --2- 172.21.15.152:0/1611244136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c4101de0 0x7fc8c41021c0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009900 tx=0x7fc8c002a410 comp rx=0 tx=0).stop 2024-09-11T22:14:50.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.409+0000 7fc8cc054640 1 -- 172.21.15.152:0/1611244136 shutdown_connections 2024-09-11T22:14:50.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.409+0000 7fc8cc054640 1 --2- 172.21.15.152:0/1611244136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c4106f10 0x7fc8c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.409+0000 7fc8cc054640 1 --2- 172.21.15.152:0/1611244136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c4102790 0x7fc8c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.409+0000 7fc8cc054640 1 --2- 172.21.15.152:0/1611244136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c4101de0 0x7fc8c41021c0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.409+0000 7fc8cc054640 1 -- 172.21.15.152:0/1611244136 >> 172.21.15.152:0/1611244136 conn(0x7fc8c40fd8c0 msgr2=0x7fc8c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:50.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.409+0000 7fc8cc054640 1 -- 172.21.15.152:0/1611244136 shutdown_connections 2024-09-11T22:14:50.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.409+0000 7fc8cc054640 1 -- 172.21.15.152:0/1611244136 wait complete. 2024-09-11T22:14:50.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.409+0000 7fc8cc054640 1 Processor -- start 2024-09-11T22:14:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8cc054640 1 -- start start 2024-09-11T22:14:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8cc054640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c4101de0 0x7fc8c40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8cc054640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c4102790 0x7fc8c4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8cc054640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c4106f10 0x7fc8c4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8cc054640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c4111f30 con 0x7fc8c4102790 2024-09-11T22:14:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8cc054640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c4111db0 con 0x7fc8c4101de0 2024-09-11T22:14:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8cc054640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41120b0 con 0x7fc8c4106f10 2024-09-11T22:14:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8c95ef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c4102790 0x7fc8c4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8c95ef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c4102790 0x7fc8c4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53206/0 (socket says 172.21.15.152:53206) 2024-09-11T22:14:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8c95ef640 1 -- 172.21.15.152:0/2112063067 learned_addr learned my addr 172.21.15.152:0/2112063067 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8ca5f1640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c4106f10 0x7fc8c4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c4101de0 0x7fc8c40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8c95ef640 1 -- 172.21.15.152:0/2112063067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c4106f10 msgr2=0x7fc8c4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:50.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c4106f10 0x7fc8c4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8c95ef640 1 -- 172.21.15.152:0/2112063067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c4101de0 msgr2=0x7fc8c40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:50.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c4101de0 0x7fc8c40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8c95ef640 1 -- 172.21.15.152:0/2112063067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c41a68c0 con 0x7fc8c4102790 2024-09-11T22:14:50.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8ca5f1640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c4106f10 0x7fc8c4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:50.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c4102790 0x7fc8c4074a30 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400d950 tx=0x7fc8b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:50.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.410+0000 7fc8baffd640 1 -- 172.21.15.152:0/2112063067 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4017070 con 0x7fc8c4102790 2024-09-11T22:14:50.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.411+0000 7fc8cc054640 1 -- 172.21.15.152:0/2112063067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c41a6bb0 con 0x7fc8c4102790 2024-09-11T22:14:50.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.411+0000 7fc8baffd640 1 -- 172.21.15.152:0/2112063067 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8b4009c30 con 0x7fc8c4102790 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.411+0000 7fc8baffd640 1 -- 172.21.15.152:0/2112063067 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400f6b0 con 0x7fc8c4102790 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.411+0000 7fc8cc054640 1 -- 172.21.15.152:0/2112063067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c41a70f0 con 0x7fc8c4102790 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.413+0000 7fc8baffd640 1 -- 172.21.15.152:0/2112063067 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fc8b40109d0 con 0x7fc8c4102790 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.413+0000 7fc8ce42d740 1 Processor -- start 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.413+0000 7fc8ce42d740 1 -- start start 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491bb40 0x560bc491a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491a5d0 0x560bc491aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4927760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560bc48802f0 con 0x560bc4925370 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560bc4827cf0 con 0x560bc491a5d0 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560bc487c2b0 con 0x560bc491bb40 2024-09-11T22:14:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8c95ef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4927760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8c95ef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4927760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53222/0 (socket says 172.21.15.152:53222) 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8c95ef640 1 -- 172.21.15.152:0/396488767 learned_addr learned my addr 172.21.15.152:0/396488767 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/396488767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491a5d0 0x560bc491aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8baffd640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc8b00a2cf0 0x7fc8b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8ca5f1640 1 --2- 172.21.15.152:0/396488767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491bb40 0x560bc491a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8ca5f1640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc8b00a2cf0 0x7fc8b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8baffd640 1 -- 172.21.15.152:0/2112063067 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7fc8b40cf170 con 0x7fc8c4102790 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8c9df0640 1 -- 172.21.15.152:0/396488767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491bb40 msgr2=0x560bc491a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/396488767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491bb40 0x560bc491a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8c9df0640 1 -- 172.21.15.152:0/396488767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 msgr2=0x560bc4927760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/396488767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4927760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8c9df0640 1 -- 172.21.15.152:0/396488767 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bc480c3a0 con 0x560bc491a5d0 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8ca5f1640 1 --2- 172.21.15.152:0/396488767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491bb40 0x560bc491a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.414+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/396488767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4927760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.415+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/396488767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491a5d0 0x560bc491aa10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009230 tx=0x7fc8c0032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9525e0f17f10fed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.415+0000 7fc8ca5f1640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc8b00a2cf0 0x7fc8b00a51b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc013600 tx=0x7fc8bc005c60 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.415+0000 7fc8affff640 1 -- 172.21.15.152:0/396488767 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c003f070 con 0x560bc491a5d0 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.415+0000 7fc8affff640 1 -- 172.21.15.152:0/396488767 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8c00317b0 con 0x560bc491a5d0 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.415+0000 7fc8affff640 1 -- 172.21.15.152:0/396488767 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0035070 con 0x560bc491a5d0 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.415+0000 7fc8ce42d740 1 -- 172.21.15.152:0/396488767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491a5d0 msgr2=0x560bc491aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.415+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/396488767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491a5d0 0x560bc491aa10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009230 tx=0x7fc8c0032ce0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.415+0000 7fc8ce42d740 1 -- 172.21.15.152:0/396488767 shutdown_connections 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.415+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/396488767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4927760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/396488767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491a5d0 0x560bc491aa10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/396488767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491bb40 0x560bc491a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 -- 172.21.15.152:0/396488767 >> 172.21.15.152:0/396488767 conn(0x560bc48e3310 msgr2=0x560bc4916c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 -- 172.21.15.152:0/396488767 shutdown_connections 2024-09-11T22:14:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 -- 172.21.15.152:0/396488767 wait complete. 2024-09-11T22:14:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 -- start start 2024-09-11T22:14:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 Processor -- start 2024-09-11T22:14:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc4924cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc4921fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc4925370 0x560bc4922520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560bc4928010 con 0x560bc491a5d0 2024-09-11T22:14:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560bc483b060 con 0x560bc491bb40 2024-09-11T22:14:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560bc4928190 con 0x560bc4925370 2024-09-11T22:14:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.416+0000 7fc8ce42d740 10 client.0 _ll_register_callbacks cb 0x560bc458e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c9df0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc4924cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c95ef640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc4921fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c9df0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc4924cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53226/0 (socket says 172.21.15.152:53226) 2024-09-11T22:14:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c9df0640 1 -- 172.21.15.152:0/1579041631 learned_addr learned my addr 172.21.15.152:0/1579041631 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c95ef640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc4921fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:56504/0 (socket says 172.21.15.152:56504) 2024-09-11T22:14:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8ca5f1640 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc4925370 0x560bc4922520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c9df0640 1 -- 172.21.15.152:0/1579041631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc4925370 msgr2=0x560bc4922520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc4925370 0x560bc4922520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c9df0640 1 -- 172.21.15.152:0/1579041631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 msgr2=0x560bc4921fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc4921fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c9df0640 1 -- 172.21.15.152:0/1579041631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bc45f13c0 con 0x560bc491a5d0 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc4921fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc4924cf0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0031550 tx=0x7fc8c0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398ea75022db4d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/1579041631 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0035070 con 0x560bc491a5d0 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/1579041631 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7fc8c0004440 con 0x560bc491a5d0 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8ce42d740 1 -- 172.21.15.152:0/1579041631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8c00317b0 con 0x560bc491a5d0 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/1579041631 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc8c0055050 con 0x560bc491a5d0 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8ce42d740 10 client.18066 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.417+0000 7fc8ce42d740 1 -- 172.21.15.152:0/1579041631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560bc4933a40 con 0x560bc491a5d0 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.418+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/1579041631 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8c00317b0 con 0x560bc491a5d0 2024-09-11T22:14:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.418+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/1579041631 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fc8c0004ac0 con 0x560bc491a5d0 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.418+0000 7fc8ce42d740 10 client.18066 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.418+0000 7fc8ce42d740 10 client.18066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.418+0000 7fc8ce42d740 20 client.18066 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.418+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560bc4934d90 0x560bc4937180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.418+0000 7fc8ce42d740 4 client.18066 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.418+0000 7fc8ce42d740 1 -- 172.21.15.152:0/1579041631 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bc488d860 con 0x560bc4934d90 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.418+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560bc4934d90 0x560bc4937180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.418+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560bc4934d90 0x560bc4937180 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8cae8349f7cb701 server_cookie=430da6615e17066a in_seq=0 out_seq=0 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.418+0000 7fc8ad7fa640 10 client.18066 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/1579041631 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560bc488d860 con 0x560bc4934d90 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ad7fa640 10 client.18066 handle_command_reply: tid=0 2024-09-11T22:14:50.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ce42d740 1 client.18066 shutdown 2024-09-11T22:14:50.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ce42d740 1 -- 172.21.15.152:0/1579041631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 msgr2=0x560bc4924cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:50.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc4924cf0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0031550 tx=0x7fc8c0005780 comp rx=0 tx=0).stop 2024-09-11T22:14:50.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ce42d740 1 -- 172.21.15.152:0/1579041631 shutdown_connections 2024-09-11T22:14:50.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560bc4934d90 0x560bc4937180 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc4925370 0x560bc4922520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc4921fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ad7fa640 0 client.18066 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:50.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/1579041631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc4924cf0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ce42d740 1 -- 172.21.15.152:0/1579041631 >> 172.21.15.152:0/1579041631 conn(0x560bc48e3310 msgr2=0x560bc491c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:50.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ce42d740 1 -- 172.21.15.152:0/1579041631 shutdown_connections 2024-09-11T22:14:50.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.419+0000 7fc8ce42d740 1 -- 172.21.15.152:0/1579041631 wait complete. 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.420+0000 7fc8ce42d740 20 client.18066 trim_cache size 0 max 16384 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.432+0000 7fc8ce42d740 1 Processor -- start 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.432+0000 7fc8ce42d740 1 -- start start 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.432+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491a5d0 0x560bc49312b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.432+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc4926760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.432+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4926ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.432+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41b2440 con 0x560bc4925370 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.432+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41afd10 con 0x560bc491bb40 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.432+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41adb80 con 0x560bc491a5d0 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8ca5f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4926ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8ca5f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4926ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53228/0 (socket says 172.21.15.152:53228) 2024-09-11T22:14:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8ca5f1640 1 -- 172.21.15.152:0/3951187649 learned_addr learned my addr 172.21.15.152:0/3951187649 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/3951187649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491a5d0 0x560bc49312b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/3951187649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc4926760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8ca5f1640 1 -- 172.21.15.152:0/3951187649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491a5d0 msgr2=0x560bc49312b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8ca5f1640 1 --2- 172.21.15.152:0/3951187649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491a5d0 0x560bc49312b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8ca5f1640 1 -- 172.21.15.152:0/3951187649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 msgr2=0x560bc4926760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8ca5f1640 1 --2- 172.21.15.152:0/3951187649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc4926760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8ca5f1640 1 -- 172.21.15.152:0/3951187649 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bc4917960 con 0x560bc4925370 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/3951187649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491a5d0 0x560bc49312b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/3951187649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc4926760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8ca5f1640 1 --2- 172.21.15.152:0/3951187649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4926ca0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0108f0 tx=0x7fc8bc00a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71269f1578bfd49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8af7fe640 1 -- 172.21.15.152:0/3951187649 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc025030 con 0x560bc4925370 2024-09-11T22:14:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8af7fe640 1 -- 172.21.15.152:0/3951187649 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8bc01b040 con 0x560bc4925370 2024-09-11T22:14:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.433+0000 7fc8af7fe640 1 -- 172.21.15.152:0/3951187649 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc005280 con 0x560bc4925370 2024-09-11T22:14:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.434+0000 7fc8ce42d740 1 -- 172.21.15.152:0/3951187649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 msgr2=0x560bc4926ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.434+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/3951187649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4926ca0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0108f0 tx=0x7fc8bc00a590 comp rx=0 tx=0).stop 2024-09-11T22:14:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.434+0000 7fc8ce42d740 1 -- 172.21.15.152:0/3951187649 shutdown_connections 2024-09-11T22:14:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.434+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/3951187649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc4925370 0x560bc4926ca0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.434+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/3951187649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc4926760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.434+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/3951187649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc491a5d0 0x560bc49312b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.434+0000 7fc8ce42d740 1 -- 172.21.15.152:0/3951187649 >> 172.21.15.152:0/3951187649 conn(0x560bc48e3310 msgr2=0x560bc4911a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.434+0000 7fc8ce42d740 1 -- 172.21.15.152:0/3951187649 shutdown_connections 2024-09-11T22:14:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.434+0000 7fc8ce42d740 1 -- 172.21.15.152:0/3951187649 wait complete. 2024-09-11T22:14:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.434+0000 7fc8ce42d740 1 -- start start 2024-09-11T22:14:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.434+0000 7fc8ce42d740 1 Processor -- start 2024-09-11T22:14:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc492d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc492d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ce42d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc4925370 0x560bc491f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41ae1d0 con 0x560bc491a5d0 2024-09-11T22:14:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41af640 con 0x560bc491bb40 2024-09-11T22:14:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ce42d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41ae8a0 con 0x560bc4925370 2024-09-11T22:14:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ce42d740 10 client.0 _ll_register_callbacks cb 0x7fc8b4097950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8c9df0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc492d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8c9df0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc492d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53238/0 (socket says 172.21.15.152:53238) 2024-09-11T22:14:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8c9df0640 1 -- 172.21.15.152:0/2994395656 learned_addr learned my addr 172.21.15.152:0/2994395656 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc492d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ca5f1640 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc4925370 0x560bc491f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8c9df0640 1 -- 172.21.15.152:0/2994395656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc4925370 msgr2=0x560bc491f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc4925370 0x560bc491f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8c9df0640 1 -- 172.21.15.152:0/2994395656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 msgr2=0x560bc492d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc492d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8c9df0640 1 -- 172.21.15.152:0/2994395656 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bc492e050 con 0x560bc491a5d0 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc492d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8c9df0640 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc492d420 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0000c00 tx=0x7fc8c0031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9307f9c2951f1c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/2994395656 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0035030 con 0x560bc491a5d0 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/2994395656 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7fc8c0031b70 con 0x560bc491a5d0 2024-09-11T22:14:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.435+0000 7fc8ce42d740 1 -- 172.21.15.152:0/2994395656 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8bc01b040 con 0x560bc491a5d0 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/2994395656 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc8c003f040 con 0x560bc491a5d0 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8ce42d740 10 client.18072 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8ce42d740 1 -- 172.21.15.152:0/2994395656 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560bc493bc20 con 0x560bc491a5d0 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/2994395656 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8bc01b040 con 0x560bc491a5d0 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/2994395656 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fc8c0003960 con 0x560bc491a5d0 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8ce42d740 10 client.18072 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8ce42d740 10 client.18072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8ce42d740 20 client.18072 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560bc499f6f0 0x560bc49a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8ce42d740 4 client.18072 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8ce42d740 1 -- 172.21.15.152:0/2994395656 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560bc4887d70 con 0x560bc499f6f0 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.436+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560bc499f6f0 0x560bc49a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ad7fa640 10 client.18072 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8c95ef640 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560bc499f6f0 0x560bc49a1ae0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c8df5f185e563e7 server_cookie=5cc02c51263e38b in_seq=0 out_seq=0 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ad7fa640 1 -- 172.21.15.152:0/2994395656 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560bc4887d70 con 0x560bc499f6f0 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ad7fa640 10 client.18072 handle_command_reply: tid=0 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 1 client.18072 shutdown 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 1 -- 172.21.15.152:0/2994395656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 msgr2=0x560bc492d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc492d420 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0000c00 tx=0x7fc8c0031840 comp rx=0 tx=0).stop 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 1 -- 172.21.15.152:0/2994395656 shutdown_connections 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560bc499f6f0 0x560bc49a1ae0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560bc4925370 0x560bc491f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560bc491bb40 0x560bc492d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 1 --2- 172.21.15.152:0/2994395656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560bc491a5d0 0x560bc492d420 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 1 -- 172.21.15.152:0/2994395656 >> 172.21.15.152:0/2994395656 conn(0x560bc48e3310 msgr2=0x560bc4920890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ad7fa640 0 client.18072 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 1 -- 172.21.15.152:0/2994395656 shutdown_connections 2024-09-11T22:14:50.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 1 -- 172.21.15.152:0/2994395656 wait complete. 2024-09-11T22:14:50.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.437+0000 7fc8ce42d740 20 client.18072 trim_cache size 0 max 16384 2024-09-11T22:14:50.457 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 -- 172.21.15.152:0/2112063067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc8b00a2cf0 msgr2=0x7fc8b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc8b00a2cf0 0x7fc8b00a51b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc013600 tx=0x7fc8bc005c60 comp rx=0 tx=0).stop 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 -- 172.21.15.152:0/2112063067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c4102790 msgr2=0x7fc8c4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c4102790 0x7fc8c4074a30 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400d950 tx=0x7fc8b400de10 comp rx=0 tx=0).stop 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 -- 172.21.15.152:0/2112063067 shutdown_connections 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc8b00a2cf0 0x7fc8b00a51b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c4106f10 0x7fc8c4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c4102790 0x7fc8c4074a30 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 --2- 172.21.15.152:0/2112063067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c4101de0 0x7fc8c40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 -- 172.21.15.152:0/2112063067 >> 172.21.15.152:0/2112063067 conn(0x7fc8c40fd8c0 msgr2=0x7fc8c40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 -- 172.21.15.152:0/2112063067 shutdown_connections 2024-09-11T22:14:50.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:50.438+0000 7fc8cc054640 1 -- 172.21.15.152:0/2112063067 wait complete. 2024-09-11T22:14:51.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:51 smithi152 ceph-mon[31188]: pgmap v327: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2024-09-11T22:14:51.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:51 smithi193 ceph-mon[35545]: pgmap v327: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2024-09-11T22:14:51.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:51 smithi179 ceph-mon[35603]: pgmap v327: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2024-09-11T22:14:52.203 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:14:52.204 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:14:52.465 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:52.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.936+0000 7f9b5b339640 1 -- 172.21.15.152:0/3590396450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b54101430 msgr2=0x7f9b5410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.936+0000 7f9b5b339640 1 --2- 172.21.15.152:0/3590396450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b54101430 0x7f9b5410d960 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009cd0 tx=0x7f9b4c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.936+0000 7f9b5b339640 1 -- 172.21.15.152:0/3590396450 shutdown_connections 2024-09-11T22:14:52.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.936+0000 7f9b5b339640 1 --2- 172.21.15.152:0/3590396450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b54101430 0x7f9b5410d960 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.936+0000 7f9b5b339640 1 --2- 172.21.15.152:0/3590396450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54100a90 0x7f9b54100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.936+0000 7f9b5b339640 1 --2- 172.21.15.152:0/3590396450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b54106a90 0x7f9b54106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.936+0000 7f9b5b339640 1 -- 172.21.15.152:0/3590396450 >> 172.21.15.152:0/3590396450 conn(0x7f9b540fc7d0 msgr2=0x7f9b540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.936+0000 7f9b5b339640 1 -- 172.21.15.152:0/3590396450 shutdown_connections 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.936+0000 7f9b5b339640 1 -- 172.21.15.152:0/3590396450 wait complete. 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b5b339640 1 Processor -- start 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b5b339640 1 -- start start 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b5b339640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b54100a90 0x7f9b54198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b5b339640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54101430 0x7f9b541989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b5b339640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b54106a90 0x7f9b5419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b5b339640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9b54110eb0 con 0x7f9b54106a90 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b5b339640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9b54110d30 con 0x7f9b54100a90 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b5b339640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b54111030 con 0x7f9b54101430 2024-09-11T22:14:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b598d6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b54106a90 0x7f9b5419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b598d6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b54106a90 0x7f9b5419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53258/0 (socket says 172.21.15.152:53258) 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b598d6640 1 -- 172.21.15.152:0/1786017049 learned_addr learned my addr 172.21.15.152:0/1786017049 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b590d5640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b54100a90 0x7f9b54198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b588d4640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54101430 0x7f9b541989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b598d6640 1 -- 172.21.15.152:0/1786017049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54101430 msgr2=0x7f9b541989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b598d6640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54101430 0x7f9b541989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b598d6640 1 -- 172.21.15.152:0/1786017049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b54100a90 msgr2=0x7f9b54198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b598d6640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b54100a90 0x7f9b54198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b598d6640 1 -- 172.21.15.152:0/1786017049 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5419d430 con 0x7f9b54106a90 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.937+0000 7f9b588d4640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54101430 0x7f9b541989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.938+0000 7f9b598d6640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b54106a90 0x7f9b5419cd50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c005cc0 tx=0x7f9b4c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:52.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.938+0000 7f9b467fc640 1 -- 172.21.15.152:0/1786017049 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c004040 con 0x7f9b54106a90 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.938+0000 7f9b467fc640 1 -- 172.21.15.152:0/1786017049 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b4c0046c0 con 0x7f9b54106a90 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.938+0000 7f9b5b339640 1 -- 172.21.15.152:0/1786017049 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b5419d6c0 con 0x7f9b54106a90 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.938+0000 7f9b467fc640 1 -- 172.21.15.152:0/1786017049 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c046480 con 0x7f9b54106a90 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.938+0000 7f9b5b339640 1 -- 172.21.15.152:0/1786017049 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b541a5000 con 0x7f9b54106a90 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.940+0000 7f9b467fc640 1 -- 172.21.15.152:0/1786017049 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9b4c0305a0 con 0x7f9b54106a90 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.940+0000 7f9b5d712740 1 Processor -- start 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.940+0000 7f9b5d712740 1 -- start start 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687da1a40 0x55b687da1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da2360 0x55b687db0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687db3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b5d712740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b687d07280 con 0x55b687db1150 2024-09-11T22:14:52.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b5d712740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b687caeb10 con 0x55b687da2360 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b5d712740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b687d03240 con 0x55b687da1a40 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b467fc640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9b400a2cf0 0x7f9b400a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b598d6640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9b400a2cf0 0x7f9b400a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b588d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687db3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b588d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687db3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53268/0 (socket says 172.21.15.152:53268) 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b588d4640 1 -- 172.21.15.152:0/3710655482 learned_addr learned my addr 172.21.15.152:0/3710655482 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b467fc640 1 -- 172.21.15.152:0/1786017049 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f9b4c02e030 con 0x7f9b54106a90 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b588d4640 1 --2- 172.21.15.152:0/3710655482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687da1a40 0x55b687da1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b590d5640 1 --2- 172.21.15.152:0/3710655482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da2360 0x55b687db0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b588d4640 1 -- 172.21.15.152:0/3710655482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687da1a40 msgr2=0x55b687da1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b588d4640 1 --2- 172.21.15.152:0/3710655482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687da1a40 0x55b687da1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b588d4640 1 -- 172.21.15.152:0/3710655482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da2360 msgr2=0x55b687db0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:52.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b588d4640 1 --2- 172.21.15.152:0/3710655482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da2360 0x55b687db0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b588d4640 1 -- 172.21.15.152:0/3710655482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b687cbb1f0 con 0x55b687db1150 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b590d5640 1 --2- 172.21.15.152:0/3710655482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da2360 0x55b687db0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b598d6640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9b400a2cf0 0x7f9b400a51b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0ee880 tx=0x7f9b4c0b25f0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.941+0000 7f9b588d4640 1 --2- 172.21.15.152:0/3710655482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687db3540 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000cf10 tx=0x7f9b5000c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f18556f90c17456 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b3f7fe640 1 -- 172.21.15.152:0/3710655482 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5001b070 con 0x55b687db1150 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b3f7fe640 1 -- 172.21.15.152:0/3710655482 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b5000ee40 con 0x55b687db1150 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b3f7fe640 1 -- 172.21.15.152:0/3710655482 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000f040 con 0x55b687db1150 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b5d712740 1 -- 172.21.15.152:0/3710655482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 msgr2=0x55b687db3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3710655482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687db3540 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000cf10 tx=0x7f9b5000c410 comp rx=0 tx=0).stop 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b5d712740 1 -- 172.21.15.152:0/3710655482 shutdown_connections 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3710655482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687db3540 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3710655482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da2360 0x55b687db0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3710655482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687da1a40 0x55b687da1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b5d712740 1 -- 172.21.15.152:0/3710655482 >> 172.21.15.152:0/3710655482 conn(0x55b687d9e0f0 msgr2=0x55b687d9e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b5d712740 1 -- 172.21.15.152:0/3710655482 shutdown_connections 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.942+0000 7f9b5d712740 1 -- 172.21.15.152:0/3710655482 wait complete. 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b5d712740 1 -- start start 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b5d712740 1 Processor -- start 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 0x55b687dae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687da2360 0x55b687dae620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687daeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b5d712740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b687db3d20 con 0x55b687db1150 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b5d712740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b687cc1f10 con 0x55b687da1a40 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b5d712740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b687db3ea0 con 0x55b687da2360 2024-09-11T22:14:52.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b5d712740 10 client.0 _ll_register_callbacks cb 0x55b687c8aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:52.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b588d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687daeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b588d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687daeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53284/0 (socket says 172.21.15.152:53284) 2024-09-11T22:14:52.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b588d4640 1 -- 172.21.15.152:0/3741215154 learned_addr learned my addr 172.21.15.152:0/3741215154 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:52.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.943+0000 7f9b590d5640 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687da2360 0x55b687dae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b588d4640 1 -- 172.21.15.152:0/3741215154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687da2360 msgr2=0x55b687dae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:52.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b588d4640 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687da2360 0x55b687dae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b588d4640 1 -- 172.21.15.152:0/3741215154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 msgr2=0x55b687dae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:52.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b588d4640 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 0x55b687dae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b588d4640 1 -- 172.21.15.152:0/3741215154 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b687a786a0 con 0x55b687db1150 2024-09-11T22:14:52.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b590d5640 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687da2360 0x55b687dae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:52.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b588d4640 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687daeb60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9b50019040 tx=0x7f9b50015390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb76532a5cec60a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3741215154 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50027060 con 0x55b687db1150 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3741215154 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f9b50016a40 con 0x55b687db1150 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b5d712740 1 -- 172.21.15.152:0/3741215154 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b687d147f0 con 0x55b687db1150 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3741215154 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9b5001b040 con 0x55b687db1150 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b5d712740 10 client.18084 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b5d712740 1 -- 172.21.15.152:0/3741215154 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b687dbfa00 con 0x55b687db1150 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3741215154 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b687d147f0 con 0x55b687db1150 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3741215154 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9b50015070 con 0x55b687db1150 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b5d712740 10 client.18084 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.944+0000 7f9b5d712740 10 client.18084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.945+0000 7f9b5d712740 20 client.18084 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:52.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.945+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b687dc0ec0 0x55b687dc32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.945+0000 7f9b5d712740 4 client.18084 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.945+0000 7f9b5d712740 1 -- 172.21.15.152:0/3741215154 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b687d0ed00 con 0x55b687dc0ec0 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.945+0000 7f9b590d5640 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b687dc0ec0 0x55b687dc32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.945+0000 7f9b3cff9640 10 client.18084 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.945+0000 7f9b590d5640 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b687dc0ec0 0x55b687dc32b0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26aeb5a69575a25 server_cookie=4b5adefb48603972 in_seq=0 out_seq=0 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3741215154 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b687d0ed00 con 0x55b687dc0ec0 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b3cff9640 10 client.18084 handle_command_reply: tid=0 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 1 client.18084 shutdown 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 1 -- 172.21.15.152:0/3741215154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 msgr2=0x55b687daeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687daeb60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9b50019040 tx=0x7f9b50015390 comp rx=0 tx=0).stop 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 1 -- 172.21.15.152:0/3741215154 shutdown_connections 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b687dc0ec0 0x55b687dc32b0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687db1150 0x55b687daeb60 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687da2360 0x55b687dae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3741215154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 0x55b687dae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 1 -- 172.21.15.152:0/3741215154 >> 172.21.15.152:0/3741215154 conn(0x55b687d9e0f0 msgr2=0x55b687da3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:52.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b3cff9640 0 client.18084 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:52.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 1 -- 172.21.15.152:0/3741215154 shutdown_connections 2024-09-11T22:14:52.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 1 -- 172.21.15.152:0/3741215154 wait complete. 2024-09-11T22:14:52.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.946+0000 7f9b5d712740 20 client.18084 trim_cache size 0 max 16384 2024-09-11T22:14:52.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.963+0000 7f9b5d712740 1 Processor -- start 2024-09-11T22:14:52.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b5d712740 1 -- start start 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 0x55b687dc88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687dc8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687db1150 0x55b687d9ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b5d712740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541adfd0 con 0x55b687da2360 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b5d712740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541ab8a0 con 0x55b687da1a40 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b5d712740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541a9710 con 0x55b687db1150 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b590d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687dc8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b590d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687dc8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53300/0 (socket says 172.21.15.152:53300) 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b590d5640 1 -- 172.21.15.152:0/1180844574 learned_addr learned my addr 172.21.15.152:0/1180844574 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b588d4640 1 --2- 172.21.15.152:0/1180844574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 0x55b687dc88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b588d4640 1 --2- 172.21.15.152:0/1180844574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687db1150 0x55b687d9ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b590d5640 1 -- 172.21.15.152:0/1180844574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687db1150 msgr2=0x55b687d9ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b590d5640 1 --2- 172.21.15.152:0/1180844574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687db1150 0x55b687d9ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b590d5640 1 -- 172.21.15.152:0/1180844574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 msgr2=0x55b687dc88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b590d5640 1 --2- 172.21.15.152:0/1180844574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 0x55b687dc88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b590d5640 1 -- 172.21.15.152:0/1180844574 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b687d99830 con 0x55b687da2360 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b588d4640 1 --2- 172.21.15.152:0/1180844574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687db1150 0x55b687d9ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b590d5640 1 --2- 172.21.15.152:0/1180844574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687dc8df0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9b48000c00 tx=0x7f9b4800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a997453b6e2f938 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b3effd640 1 -- 172.21.15.152:0/1180844574 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b48003e20 con 0x55b687da2360 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b3effd640 1 -- 172.21.15.152:0/1180844574 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b48011920 con 0x55b687da2360 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.964+0000 7f9b3effd640 1 -- 172.21.15.152:0/1180844574 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4801ca80 con 0x55b687da2360 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.965+0000 7f9b5d712740 1 -- 172.21.15.152:0/1180844574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 msgr2=0x55b687dc8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.965+0000 7f9b5d712740 1 --2- 172.21.15.152:0/1180844574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687dc8df0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9b48000c00 tx=0x7f9b4800be00 comp rx=0 tx=0).stop 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.965+0000 7f9b5d712740 1 -- 172.21.15.152:0/1180844574 shutdown_connections 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.965+0000 7f9b5d712740 1 --2- 172.21.15.152:0/1180844574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687db1150 0x55b687d9ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.965+0000 7f9b5d712740 1 --2- 172.21.15.152:0/1180844574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687dc8df0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.965+0000 7f9b5d712740 1 --2- 172.21.15.152:0/1180844574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 0x55b687dc88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.965+0000 7f9b5d712740 1 -- 172.21.15.152:0/1180844574 >> 172.21.15.152:0/1180844574 conn(0x55b687d9e0f0 msgr2=0x55b687db0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.965+0000 7f9b5d712740 1 -- 172.21.15.152:0/1180844574 shutdown_connections 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.965+0000 7f9b5d712740 1 -- 172.21.15.152:0/1180844574 wait complete. 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.965+0000 7f9b5d712740 1 -- start start 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b5d712740 1 Processor -- start 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 0x55b687db9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687db4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b5d712740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687db1150 0x55b687db5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b5d712740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541a9d60 con 0x55b687da2360 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b5d712740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541ab1d0 con 0x55b687da1a40 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b5d712740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541aa430 con 0x55b687db1150 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b5d712740 10 client.0 _ll_register_callbacks cb 0x7f9b50019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:52.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b590d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687db4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b590d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687db4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53312/0 (socket says 172.21.15.152:53312) 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b590d5640 1 -- 172.21.15.152:0/3246181953 learned_addr learned my addr 172.21.15.152:0/3246181953 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b588d4640 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 0x55b687db9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b588d4640 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687db1150 0x55b687db5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b590d5640 1 -- 172.21.15.152:0/3246181953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687db1150 msgr2=0x55b687db5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b590d5640 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687db1150 0x55b687db5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b590d5640 1 -- 172.21.15.152:0/3246181953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 msgr2=0x55b687db9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b590d5640 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 0x55b687db9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.966+0000 7f9b590d5640 1 -- 172.21.15.152:0/3246181953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b687db5a60 con 0x55b687da2360 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b590d5640 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687db4cb0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9b48005c20 tx=0x7f9b48004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfd971acfa1d567 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3246181953 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b48011640 con 0x55b687da2360 2024-09-11T22:14:52.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b5d712740 1 -- 172.21.15.152:0/3246181953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b48011920 con 0x55b687da2360 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3246181953 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f9b48011ad0 con 0x55b687da2360 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3246181953 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9b48003eb0 con 0x55b687da2360 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b5d712740 10 client.18090 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b5d712740 1 -- 172.21.15.152:0/3246181953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b687e2b8d0 con 0x55b687da2360 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3246181953 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b48011920 con 0x55b687da2360 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3246181953 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9b48027540 con 0x55b687da2360 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b5d712740 10 client.18090 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b5d712740 10 client.18090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.967+0000 7f9b5d712740 20 client.18090 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.968+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b687e2bfc0 0x55b687e2e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.968+0000 7f9b5d712740 4 client.18090 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.968+0000 7f9b5d712740 1 -- 172.21.15.152:0/3246181953 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b687c8b110 con 0x55b687e2bfc0 2024-09-11T22:14:52.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.968+0000 7f9b588d4640 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b687e2bfc0 0x55b687e2e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.968+0000 7f9b588d4640 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b687e2bfc0 0x55b687e2e3e0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f16f828d5a0def31 server_cookie=2da4495ec30942ee in_seq=0 out_seq=0 2024-09-11T22:14:52.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.968+0000 7f9b3cff9640 10 client.18090 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:52.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b3cff9640 1 -- 172.21.15.152:0/3246181953 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b687c8b110 con 0x55b687e2bfc0 2024-09-11T22:14:52.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b3cff9640 10 client.18090 handle_command_reply: tid=0 2024-09-11T22:14:52.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b5d712740 1 client.18090 shutdown 2024-09-11T22:14:52.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b5d712740 1 -- 172.21.15.152:0/3246181953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 msgr2=0x55b687db4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687db4cb0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9b48005c20 tx=0x7f9b48004490 comp rx=0 tx=0).stop 2024-09-11T22:14:52.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b5d712740 1 -- 172.21.15.152:0/3246181953 shutdown_connections 2024-09-11T22:14:52.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b687e2bfc0 0x55b687e2e3e0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b687db1150 0x55b687db5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b687da2360 0x55b687db4cb0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b5d712740 1 --2- 172.21.15.152:0/3246181953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b687da1a40 0x55b687db9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b5d712740 1 -- 172.21.15.152:0/3246181953 >> 172.21.15.152:0/3246181953 conn(0x55b687d9e0f0 msgr2=0x55b687d9ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:52.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.969+0000 7f9b3cff9640 0 client.18090 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:52.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5d712740 1 -- 172.21.15.152:0/3246181953 shutdown_connections 2024-09-11T22:14:52.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5d712740 1 -- 172.21.15.152:0/3246181953 wait complete. 2024-09-11T22:14:52.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5d712740 20 client.18090 trim_cache size 0 max 16384 2024-09-11T22:14:52.976 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:14:52.976 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:14:52.976 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "5cda79f5-de21-4f13-a629-094a268c7380", 2024-09-11T22:14:52.976 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:14:52.976 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:14:52.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 -- 172.21.15.152:0/1786017049 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9b400a2cf0 msgr2=0x7f9b400a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9b400a2cf0 0x7f9b400a51b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0ee880 tx=0x7f9b4c0b25f0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 -- 172.21.15.152:0/1786017049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b54106a90 msgr2=0x7f9b5419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b54106a90 0x7f9b5419cd50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c005cc0 tx=0x7f9b4c003970 comp rx=0 tx=0).stop 2024-09-11T22:14:52.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 -- 172.21.15.152:0/1786017049 shutdown_connections 2024-09-11T22:14:52.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9b400a2cf0 0x7f9b400a51b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b54106a90 0x7f9b5419cd50 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54101430 0x7f9b541989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 --2- 172.21.15.152:0/1786017049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b54100a90 0x7f9b54198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 -- 172.21.15.152:0/1786017049 >> 172.21.15.152:0/1786017049 conn(0x7f9b540fc7d0 msgr2=0x7f9b5406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:52.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 -- 172.21.15.152:0/1786017049 shutdown_connections 2024-09-11T22:14:52.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:52.970+0000 7f9b5b339640 1 -- 172.21.15.152:0/1786017049 wait complete. 2024-09-11T22:14:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:53 smithi193 ceph-mon[35545]: pgmap v328: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 363 KiB/s wr, 45 op/s 2024-09-11T22:14:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:53 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:14:53.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:53 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:53.621 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:53 smithi152 ceph-mon[31188]: pgmap v328: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 363 KiB/s wr, 45 op/s 2024-09-11T22:14:53.621 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:53 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:14:53.621 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:53 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:53 smithi179 ceph-mon[35603]: pgmap v328: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 363 KiB/s wr, 45 op/s 2024-09-11T22:14:53.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:53 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:14:53.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:53 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:53.803 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:14:54.014 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:14:54.054 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:54.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.501+0000 7f948c31a640 1 -- 172.21.15.152:0/2399785937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484100480 msgr2=0x7f9484100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.501+0000 7f948c31a640 1 --2- 172.21.15.152:0/2399785937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484100480 0x7f9484100860 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f9474009ca0 tx=0x7f947402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.501+0000 7f948c31a640 1 -- 172.21.15.152:0/2399785937 shutdown_connections 2024-09-11T22:14:54.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.501+0000 7f948c31a640 1 --2- 172.21.15.152:0/2399785937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94841055b0 0x7f948410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.501+0000 7f948c31a640 1 --2- 172.21.15.152:0/2399785937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9484100e30 0x7f9484104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.501+0000 7f948c31a640 1 --2- 172.21.15.152:0/2399785937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484100480 0x7f9484100860 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.501+0000 7f948c31a640 1 -- 172.21.15.152:0/2399785937 >> 172.21.15.152:0/2399785937 conn(0x7f9484077210 msgr2=0x7f94840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.501+0000 7f948c31a640 1 -- 172.21.15.152:0/2399785937 shutdown_connections 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.501+0000 7f948c31a640 1 -- 172.21.15.152:0/2399785937 wait complete. 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.502+0000 7f948c31a640 1 Processor -- start 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.502+0000 7f948c31a640 1 -- start start 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.502+0000 7f948c31a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484100480 0x7f9484197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.502+0000 7f948c31a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9484100e30 0x7f9484197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.502+0000 7f948c31a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94841055b0 0x7f948419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.502+0000 7f948c31a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9484110630 con 0x7f9484100480 2024-09-11T22:14:54.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.502+0000 7f948c31a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f94841104b0 con 0x7f94841055b0 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.502+0000 7f948c31a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94841107b0 con 0x7f9484100e30 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.502+0000 7f948a0b6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484100480 0x7f9484197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948a0b6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484100480 0x7f9484197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41894/0 (socket says 172.21.15.152:41894) 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948a0b6640 1 -- 172.21.15.152:0/1796922953 learned_addr learned my addr 172.21.15.152:0/1796922953 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f94898b5640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9484100e30 0x7f9484197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948a8b7640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94841055b0 0x7f948419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948a0b6640 1 -- 172.21.15.152:0/1796922953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9484100e30 msgr2=0x7f9484197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948a0b6640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9484100e30 0x7f9484197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948a0b6640 1 -- 172.21.15.152:0/1796922953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94841055b0 msgr2=0x7f948419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948a0b6640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94841055b0 0x7f948419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948a0b6640 1 -- 172.21.15.152:0/1796922953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948419c400 con 0x7f9484100480 2024-09-11T22:14:54.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948a8b7640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94841055b0 0x7f948419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f94898b5640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9484100e30 0x7f9484197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948a0b6640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484100480 0x7f9484197450 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f947402ade0 tx=0x7f94740319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f94837fe640 1 -- 172.21.15.152:0/1796922953 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947402fa20 con 0x7f9484100480 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f94837fe640 1 -- 172.21.15.152:0/1796922953 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947402fbc0 con 0x7f9484100480 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f94837fe640 1 -- 172.21.15.152:0/1796922953 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94740467b0 con 0x7f9484100480 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948c31a640 1 -- 172.21.15.152:0/1796922953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948419c690 con 0x7f9484100480 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.503+0000 7f948c31a640 1 -- 172.21.15.152:0/1796922953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94841a3fd0 con 0x7f9484100480 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f94837fe640 1 -- 172.21.15.152:0/1796922953 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9474046950 con 0x7f9484100480 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f948e6f3740 1 Processor -- start 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f948e6f3740 1 -- start start 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a5394a0 0x55cd0a539880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a539dc0 0x55cd0a544140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a546a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f948e6f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cd0a49f2e0 con 0x55cd0a544680 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f948e6f3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cd0a446ce0 con 0x55cd0a5394a0 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f948e6f3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cd0a49b2a0 con 0x55cd0a539dc0 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f94898b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a546a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f94898b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a546a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41900/0 (socket says 172.21.15.152:41900) 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f94898b5640 1 -- 172.21.15.152:0/207029640 learned_addr learned my addr 172.21.15.152:0/207029640 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.506+0000 7f94837fe640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f946c0a2cf0 0x7f946c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f948a0b6640 1 --2- 172.21.15.152:0/207029640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a539dc0 0x55cd0a544140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f948a8b7640 1 --2- 172.21.15.152:0/207029640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a5394a0 0x55cd0a539880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f948a8b7640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f946c0a2cf0 0x7f946c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f94898b5640 1 -- 172.21.15.152:0/207029640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a539dc0 msgr2=0x55cd0a544140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f94898b5640 1 --2- 172.21.15.152:0/207029640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a539dc0 0x55cd0a544140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f94898b5640 1 -- 172.21.15.152:0/207029640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a5394a0 msgr2=0x55cd0a539880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f94898b5640 1 --2- 172.21.15.152:0/207029640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a5394a0 0x55cd0a539880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f94898b5640 1 -- 172.21.15.152:0/207029640 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0a42b440 con 0x55cd0a544680 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f948a0b6640 1 --2- 172.21.15.152:0/207029640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a539dc0 0x55cd0a544140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f948a8b7640 1 --2- 172.21.15.152:0/207029640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a5394a0 0x55cd0a539880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f94837fe640 1 -- 172.21.15.152:0/1796922953 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f94740f0950 con 0x7f9484100480 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f94898b5640 1 --2- 172.21.15.152:0/207029640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a546a70 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9478007800 tx=0x7f9478007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41eed4c845f037e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f948a8b7640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f946c0a2cf0 0x7f946c0a51b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f947c005fd0 tx=0x7f947c0046c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f9480dea640 1 -- 172.21.15.152:0/207029640 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947800d940 con 0x55cd0a544680 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f9480dea640 1 -- 172.21.15.152:0/207029640 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94780125e0 con 0x55cd0a544680 2024-09-11T22:14:54.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.507+0000 7f9480dea640 1 -- 172.21.15.152:0/207029640 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947801a610 con 0x55cd0a544680 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.508+0000 7f948e6f3740 1 -- 172.21.15.152:0/207029640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 msgr2=0x55cd0a546a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.508+0000 7f948e6f3740 1 --2- 172.21.15.152:0/207029640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a546a70 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9478007800 tx=0x7f9478007cc0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.508+0000 7f948e6f3740 1 -- 172.21.15.152:0/207029640 shutdown_connections 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.508+0000 7f948e6f3740 1 --2- 172.21.15.152:0/207029640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a546a70 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.508+0000 7f948e6f3740 1 --2- 172.21.15.152:0/207029640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a539dc0 0x55cd0a544140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.508+0000 7f948e6f3740 1 --2- 172.21.15.152:0/207029640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a5394a0 0x55cd0a539880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.508+0000 7f948e6f3740 1 -- 172.21.15.152:0/207029640 >> 172.21.15.152:0/207029640 conn(0x55cd0a535a30 msgr2=0x55cd0a535e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.508+0000 7f948e6f3740 1 -- 172.21.15.152:0/207029640 shutdown_connections 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.508+0000 7f948e6f3740 1 -- 172.21.15.152:0/207029640 wait complete. 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.508+0000 7f948e6f3740 1 -- start start 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f948e6f3740 1 Processor -- start 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a5394a0 0x55cd0a543f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a539dc0 0x55cd0a5411d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a544680 0x55cd0a541710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f948e6f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cd0a547250 con 0x55cd0a539dc0 2024-09-11T22:14:54.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f948e6f3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cd0a45a050 con 0x55cd0a5394a0 2024-09-11T22:14:54.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f948e6f3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cd0a5473d0 con 0x55cd0a544680 2024-09-11T22:14:54.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f948e6f3740 10 client.0 _ll_register_callbacks cb 0x55cd0a49a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:54.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f94898b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a539dc0 0x55cd0a5411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f94898b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a539dc0 0x55cd0a5411d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41906/0 (socket says 172.21.15.152:41906) 2024-09-11T22:14:54.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f94898b5640 1 -- 172.21.15.152:0/1946682340 learned_addr learned my addr 172.21.15.152:0/1946682340 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:54.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f948a0b6640 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a5394a0 0x55cd0a543f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f948a8b7640 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a544680 0x55cd0a541710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f94898b5640 1 -- 172.21.15.152:0/1946682340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a544680 msgr2=0x55cd0a541710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f94898b5640 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a544680 0x55cd0a541710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f94898b5640 1 -- 172.21.15.152:0/1946682340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a5394a0 msgr2=0x55cd0a543f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f94898b5640 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a5394a0 0x55cd0a543f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f94898b5640 1 -- 172.21.15.152:0/1946682340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0a2103c0 con 0x55cd0a539dc0 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f94898b5640 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a539dc0 0x55cd0a5411d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f9478012f90 tx=0x7f9478012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af1f28c790f5596 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f9469ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.509+0000 7f9469ffb640 1 -- 172.21.15.152:0/1946682340 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478028020 con 0x55cd0a539dc0 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f948e6f3740 1 -- 172.21.15.152:0/1946682340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94780125e0 con 0x55cd0a539dc0 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f9469ffb640 1 -- 172.21.15.152:0/1946682340 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f947800da10 con 0x55cd0a539dc0 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f9469ffb640 1 -- 172.21.15.152:0/1946682340 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9478033050 con 0x55cd0a539dc0 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f948e6f3740 10 client.18102 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f948e6f3740 1 -- 172.21.15.152:0/1946682340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cd0a552b70 con 0x55cd0a539dc0 2024-09-11T22:14:54.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f9469ffb640 1 -- 172.21.15.152:0/1946682340 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94780125e0 con 0x55cd0a539dc0 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f9469ffb640 1 -- 172.21.15.152:0/1946682340 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9478024b50 con 0x55cd0a539dc0 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f948e6f3740 10 client.18102 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f948e6f3740 10 client.18102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f948e6f3740 20 client.18102 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cd0a553f20 0x55cd0a556310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f948e6f3740 4 client.18102 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f948e6f3740 1 -- 172.21.15.152:0/1946682340 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd0a4ac850 con 0x55cd0a553f20 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.510+0000 7f948a0b6640 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cd0a553f20 0x55cd0a556310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.511+0000 7f948a0b6640 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cd0a553f20 0x55cd0a556310 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c5af9940004a895 server_cookie=374f917cb473c12b in_seq=0 out_seq=0 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.511+0000 7f9469ffb640 10 client.18102 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.511+0000 7f9469ffb640 1 -- 172.21.15.152:0/1946682340 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd0a4ac850 con 0x55cd0a553f20 2024-09-11T22:14:54.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.511+0000 7f9469ffb640 10 client.18102 handle_command_reply: tid=0 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 1 client.18102 shutdown 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 1 -- 172.21.15.152:0/1946682340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a539dc0 msgr2=0x55cd0a5411d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a539dc0 0x55cd0a5411d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f9478012f90 tx=0x7f9478012b00 comp rx=0 tx=0).stop 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 1 -- 172.21.15.152:0/1946682340 shutdown_connections 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cd0a553f20 0x55cd0a556310 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a544680 0x55cd0a541710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a539dc0 0x55cd0a5411d0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1946682340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a5394a0 0x55cd0a543f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 1 -- 172.21.15.152:0/1946682340 >> 172.21.15.152:0/1946682340 conn(0x55cd0a535a30 msgr2=0x55cd0a53b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f9469ffb640 0 client.18102 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 1 -- 172.21.15.152:0/1946682340 shutdown_connections 2024-09-11T22:14:54.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 1 -- 172.21.15.152:0/1946682340 wait complete. 2024-09-11T22:14:54.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.512+0000 7f948e6f3740 20 client.18102 trim_cache size 0 max 16384 2024-09-11T22:14:54.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948e6f3740 1 Processor -- start 2024-09-11T22:14:54.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948e6f3740 1 -- start start 2024-09-11T22:14:54.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a5394a0 0x55cd0a5504b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a539dc0 0x55cd0a53c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a543140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948e6f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f94841ae0d0 con 0x55cd0a544680 2024-09-11T22:14:54.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948e6f3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f94841ab9a0 con 0x55cd0a539dc0 2024-09-11T22:14:54.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948e6f3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94841a9810 con 0x55cd0a5394a0 2024-09-11T22:14:54.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948a8b7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a543140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948a8b7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a543140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41910/0 (socket says 172.21.15.152:41910) 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948a8b7640 1 -- 172.21.15.152:0/3589489845 learned_addr learned my addr 172.21.15.152:0/3589489845 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f94898b5640 1 --2- 172.21.15.152:0/3589489845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a539dc0 0x55cd0a53c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948a0b6640 1 --2- 172.21.15.152:0/3589489845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a5394a0 0x55cd0a5504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948a8b7640 1 -- 172.21.15.152:0/3589489845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a5394a0 msgr2=0x55cd0a5504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948a8b7640 1 --2- 172.21.15.152:0/3589489845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a5394a0 0x55cd0a5504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948a8b7640 1 -- 172.21.15.152:0/3589489845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a539dc0 msgr2=0x55cd0a53c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948a8b7640 1 --2- 172.21.15.152:0/3589489845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a539dc0 0x55cd0a53c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948a8b7640 1 -- 172.21.15.152:0/3589489845 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0a535860 con 0x55cd0a544680 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948a0b6640 1 --2- 172.21.15.152:0/3589489845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a5394a0 0x55cd0a5504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.529+0000 7f948a8b7640 1 --2- 172.21.15.152:0/3589489845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a543140 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f947c00f7a0 tx=0x7f947c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53574305be86cdd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f946bfff640 1 -- 172.21.15.152:0/3589489845 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c01d8c0 con 0x55cd0a544680 2024-09-11T22:14:54.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f946bfff640 1 -- 172.21.15.152:0/3589489845 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947c029480 con 0x55cd0a544680 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f946bfff640 1 -- 172.21.15.152:0/3589489845 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c01e630 con 0x55cd0a544680 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f948e6f3740 1 -- 172.21.15.152:0/3589489845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 msgr2=0x55cd0a543140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f948e6f3740 1 --2- 172.21.15.152:0/3589489845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a543140 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f947c00f7a0 tx=0x7f947c00c490 comp rx=0 tx=0).stop 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f948e6f3740 1 -- 172.21.15.152:0/3589489845 shutdown_connections 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f948e6f3740 1 --2- 172.21.15.152:0/3589489845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a544680 0x55cd0a543140 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f948e6f3740 1 --2- 172.21.15.152:0/3589489845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a539dc0 0x55cd0a53c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f948e6f3740 1 --2- 172.21.15.152:0/3589489845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a5394a0 0x55cd0a5504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f948e6f3740 1 -- 172.21.15.152:0/3589489845 >> 172.21.15.152:0/3589489845 conn(0x55cd0a535a30 msgr2=0x55cd0a542a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f948e6f3740 1 -- 172.21.15.152:0/3589489845 shutdown_connections 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.530+0000 7f948e6f3740 1 -- 172.21.15.152:0/3589489845 wait complete. 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948e6f3740 1 -- start start 2024-09-11T22:14:54.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948e6f3740 1 Processor -- start 2024-09-11T22:14:54.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a5394a0 0x55cd0a54cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a539dc0 0x55cd0a547e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948e6f3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a544680 0x55cd0a5483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948e6f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f94841a9e60 con 0x55cd0a5394a0 2024-09-11T22:14:54.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948e6f3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f94841ab2d0 con 0x55cd0a544680 2024-09-11T22:14:54.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948e6f3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94841aa530 con 0x55cd0a539dc0 2024-09-11T22:14:54.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948e6f3740 10 client.0 _ll_register_callbacks cb 0x7f9478007650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:54.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948a0b6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a5394a0 0x55cd0a54cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948a0b6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a5394a0 0x55cd0a54cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41914/0 (socket says 172.21.15.152:41914) 2024-09-11T22:14:54.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948a0b6640 1 -- 172.21.15.152:0/1770822734 learned_addr learned my addr 172.21.15.152:0/1770822734 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:54.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f94898b5640 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a539dc0 0x55cd0a547e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948a8b7640 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a544680 0x55cd0a5483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948a0b6640 1 -- 172.21.15.152:0/1770822734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a539dc0 msgr2=0x55cd0a547e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948a0b6640 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a539dc0 0x55cd0a547e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948a0b6640 1 -- 172.21.15.152:0/1770822734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a544680 msgr2=0x55cd0a5483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948a0b6640 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a544680 0x55cd0a5483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.531+0000 7f948a0b6640 1 -- 172.21.15.152:0/1770822734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0a548960 con 0x55cd0a5394a0 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f948a0b6640 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a5394a0 0x55cd0a54cb30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f94740bcf40 tx=0x7f947402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5eb5f77681a01d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f9469ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f9469ffb640 1 -- 172.21.15.152:0/1770822734 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94740c1360 con 0x55cd0a5394a0 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f9469ffb640 1 -- 172.21.15.152:0/1770822734 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f947402fd70 con 0x55cd0a5394a0 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f948e6f3740 1 -- 172.21.15.152:0/1770822734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f947c029480 con 0x55cd0a5394a0 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f9469ffb640 1 -- 172.21.15.152:0/1770822734 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f94740c5b90 con 0x55cd0a5394a0 2024-09-11T22:14:54.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f948e6f3740 10 client.18108 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:54.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f948e6f3740 1 -- 172.21.15.152:0/1770822734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cd0a5be7b0 con 0x55cd0a5394a0 2024-09-11T22:14:54.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f9469ffb640 1 -- 172.21.15.152:0/1770822734 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947c029480 con 0x55cd0a5394a0 2024-09-11T22:14:54.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f9469ffb640 1 -- 172.21.15.152:0/1770822734 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f947404e030 con 0x55cd0a5394a0 2024-09-11T22:14:54.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f948e6f3740 10 client.18108 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:54.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f948e6f3740 10 client.18108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:54.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f948e6f3740 20 client.18108 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:54.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cd0a5bee80 0x55cd0a5c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f948e6f3740 4 client.18108 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:14:54.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.532+0000 7f948e6f3740 1 -- 172.21.15.152:0/1770822734 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cd0a4a6d60 con 0x55cd0a5bee80 2024-09-11T22:14:54.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.533+0000 7f94898b5640 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cd0a5bee80 0x55cd0a5c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.533+0000 7f9469ffb640 10 client.18108 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:54.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.533+0000 7f94898b5640 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cd0a5bee80 0x55cd0a5c1270 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb52c8cc62b27422 server_cookie=8310075b16680349 in_seq=0 out_seq=0 2024-09-11T22:14:54.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.533+0000 7f9469ffb640 1 -- 172.21.15.152:0/1770822734 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55cd0a4a6d60 con 0x55cd0a5bee80 2024-09-11T22:14:54.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.533+0000 7f9469ffb640 10 client.18108 handle_command_reply: tid=0 2024-09-11T22:14:54.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.533+0000 7f948e6f3740 1 client.18108 shutdown 2024-09-11T22:14:54.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948e6f3740 1 -- 172.21.15.152:0/1770822734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a5394a0 msgr2=0x55cd0a54cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a5394a0 0x55cd0a54cb30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f94740bcf40 tx=0x7f947402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948e6f3740 1 -- 172.21.15.152:0/1770822734 shutdown_connections 2024-09-11T22:14:54.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cd0a5bee80 0x55cd0a5c1270 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f9469ffb640 0 client.18108 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:54.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd0a544680 0x55cd0a5483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cd0a539dc0 0x55cd0a547e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948e6f3740 1 --2- 172.21.15.152:0/1770822734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd0a5394a0 0x55cd0a54cb30 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948e6f3740 1 -- 172.21.15.152:0/1770822734 >> 172.21.15.152:0/1770822734 conn(0x55cd0a535a30 msgr2=0x55cd0a534350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948e6f3740 1 -- 172.21.15.152:0/1770822734 shutdown_connections 2024-09-11T22:14:54.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948e6f3740 1 -- 172.21.15.152:0/1770822734 wait complete. 2024-09-11T22:14:54.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948e6f3740 20 client.18108 trim_cache size 0 max 16384 2024-09-11T22:14:54.554 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:14:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:14:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:14:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "5cda79f5-de21-4f13-a629-094a268c7380": { 2024-09-11T22:14:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:14:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "5cda79f5-de21-4f13-a629-094a268c7380", 2024-09-11T22:14:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:14:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:54.556 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:14:54.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948c31a640 1 -- 172.21.15.152:0/1796922953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f946c0a2cf0 msgr2=0x7f946c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948c31a640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f946c0a2cf0 0x7f946c0a51b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f947c005fd0 tx=0x7f947c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948c31a640 1 -- 172.21.15.152:0/1796922953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484100480 msgr2=0x7f9484197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.534+0000 7f948c31a640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484100480 0x7f9484197450 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f947402ade0 tx=0x7f94740319f0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.535+0000 7f948c31a640 1 -- 172.21.15.152:0/1796922953 shutdown_connections 2024-09-11T22:14:54.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.535+0000 7f948c31a640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f946c0a2cf0 0x7f946c0a51b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.535+0000 7f948c31a640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94841055b0 0x7f948419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.535+0000 7f948c31a640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9484100e30 0x7f9484197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.535+0000 7f948c31a640 1 --2- 172.21.15.152:0/1796922953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484100480 0x7f9484197450 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.535+0000 7f948c31a640 1 -- 172.21.15.152:0/1796922953 >> 172.21.15.152:0/1796922953 conn(0x7f9484077210 msgr2=0x7f94840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.535+0000 7f948c31a640 1 -- 172.21.15.152:0/1796922953 shutdown_connections 2024-09-11T22:14:54.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:54.535+0000 7f948c31a640 1 -- 172.21.15.152:0/1796922953 wait complete. 2024-09-11T22:14:54.558 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:54 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:14:54.558 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:54 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:54.558 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:54 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:14:54.558 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:54 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:54.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:54 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:14:54.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:54 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:54 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:14:54.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:54 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:54.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:14:54.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:54 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:14:54.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:54 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:54.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:54 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:14:54.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:54 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:14:54.900 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:55.320 INFO:tasks.cephfs.filesystem:scrub status for tag:5cda79f5-de21-4f13-a629-094a268c7380 - {'path': '/', 'tag': '5cda79f5-de21-4f13-a629-094a268c7380', 'options': 'recursive,force'} 2024-09-11T22:14:55.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:55 smithi193 ceph-mon[35545]: pgmap v329: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 364 KiB/s wr, 46 op/s 2024-09-11T22:14:55.613 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:55 smithi152 ceph-mon[31188]: pgmap v329: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 364 KiB/s wr, 46 op/s 2024-09-11T22:14:55.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:55 smithi179 ceph-mon[35603]: pgmap v329: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 364 KiB/s wr, 46 op/s 2024-09-11T22:14:55.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.833+0000 7f3d06881640 1 -- 172.21.15.152:0/2627818596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d00106a80 msgr2=0x7f3d00106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.833+0000 7f3d06881640 1 --2- 172.21.15.152:0/2627818596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d00106a80 0x7f3d00106e60 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009930 tx=0x7f3cf002a420 comp rx=0 tx=0).stop 2024-09-11T22:14:55.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.833+0000 7f3d06881640 1 -- 172.21.15.152:0/2627818596 shutdown_connections 2024-09-11T22:14:55.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.833+0000 7f3d06881640 1 --2- 172.21.15.152:0/2627818596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d00101420 0x7f3d0010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.833+0000 7f3d06881640 1 --2- 172.21.15.152:0/2627818596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d00100a80 0x7f3d00100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.833+0000 7f3d06881640 1 --2- 172.21.15.152:0/2627818596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d00106a80 0x7f3d00106e60 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.833+0000 7f3d06881640 1 -- 172.21.15.152:0/2627818596 >> 172.21.15.152:0/2627818596 conn(0x7f3d000fc7a0 msgr2=0x7f3d000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:55.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.834+0000 7f3d06881640 1 -- 172.21.15.152:0/2627818596 shutdown_connections 2024-09-11T22:14:55.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.834+0000 7f3d06881640 1 -- 172.21.15.152:0/2627818596 wait complete. 2024-09-11T22:14:55.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.834+0000 7f3d06881640 1 Processor -- start 2024-09-11T22:14:55.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.834+0000 7f3d06881640 1 -- start start 2024-09-11T22:14:55.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.834+0000 7f3d06881640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d00100a80 0x7f3d001992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.834+0000 7f3d06881640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d00101420 0x7f3d00199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3d06881640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d00106a80 0x7f3d001a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3d06881640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00110e80 con 0x7f3d00100a80 2024-09-11T22:14:55.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3d06881640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00110d00 con 0x7f3d00106a80 2024-09-11T22:14:55.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3d06881640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00111000 con 0x7f3d00101420 2024-09-11T22:14:55.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d00100a80 0x7f3d001992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d00100a80 0x7f3d001992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41944/0 (socket says 172.21.15.152:41944) 2024-09-11T22:14:55.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfffff640 1 -- 172.21.15.152:0/740080060 learned_addr learned my addr 172.21.15.152:0/740080060 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:55.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cff7fe640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d00101420 0x7f3d00199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3d04e1e640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d00106a80 0x7f3d001a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfffff640 1 -- 172.21.15.152:0/740080060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d00101420 msgr2=0x7f3d00199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfffff640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d00101420 0x7f3d00199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfffff640 1 -- 172.21.15.152:0/740080060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d00106a80 msgr2=0x7f3d001a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfffff640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d00106a80 0x7f3d001a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfffff640 1 -- 172.21.15.152:0/740080060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d001a4890 con 0x7f3d00100a80 2024-09-11T22:14:55.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfffff640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d00100a80 0x7f3d001992d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009230 tx=0x7f3cf0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfd7fa640 1 -- 172.21.15.152:0/740080060 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf003f030 con 0x7f3d00100a80 2024-09-11T22:14:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfd7fa640 1 -- 172.21.15.152:0/740080060 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cf0003ad0 con 0x7f3d00100a80 2024-09-11T22:14:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3d06881640 1 -- 172.21.15.152:0/740080060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d001a4a60 con 0x7f3d00100a80 2024-09-11T22:14:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3cfd7fa640 1 -- 172.21.15.152:0/740080060 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0035070 con 0x7f3d00100a80 2024-09-11T22:14:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.835+0000 7f3d06881640 1 -- 172.21.15.152:0/740080060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d001a4eb0 con 0x7f3d00100a80 2024-09-11T22:14:55.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.836+0000 7f3d06881640 1 -- 172.21.15.152:0/740080060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d00100ee0 con 0x7f3d00100a80 2024-09-11T22:14:55.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.838+0000 7f3cfd7fa640 1 -- 172.21.15.152:0/740080060 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3cf0042030 con 0x7f3d00100a80 2024-09-11T22:14:55.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.838+0000 7f3cfd7fa640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2cf0 0x7f3ce80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.838+0000 7f3cfd7fa640 1 -- 172.21.15.152:0/740080060 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f3cf00ef650 con 0x7f3d00100a80 2024-09-11T22:14:55.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.838+0000 7f3cff7fe640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2cf0 0x7f3ce80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.839+0000 7f3cff7fe640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2cf0 0x7f3ce80a51b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3d0006b2e0 tx=0x7f3cf400a2d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:55.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:55.842+0000 7f3cfd7fa640 1 -- 172.21.15.152:0/740080060 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3cf00bc210 con 0x7f3d00100a80 2024-09-11T22:14:56.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.044+0000 7f3d06881640 1 -- 172.21.15.152:0/740080060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d00108ff0 con 0x7f3d00100a80 2024-09-11T22:14:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.045+0000 7f3cfd7fa640 1 -- 172.21.15.152:0/740080060 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f3cf00bbb10 con 0x7f3d00100a80 2024-09-11T22:14:56.046 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:14:56.046 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:14:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:14:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 -- 172.21.15.152:0/740080060 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2cf0 msgr2=0x7f3ce80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2cf0 0x7f3ce80a51b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3d0006b2e0 tx=0x7f3cf400a2d0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 -- 172.21.15.152:0/740080060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d00100a80 msgr2=0x7f3d001992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d00100a80 0x7f3d001992d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009230 tx=0x7f3cf0004270 comp rx=0 tx=0).stop 2024-09-11T22:14:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 -- 172.21.15.152:0/740080060 shutdown_connections 2024-09-11T22:14:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ce80a2cf0 0x7f3ce80a51b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d00106a80 0x7f3d001a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d00101420 0x7f3d00199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 --2- 172.21.15.152:0/740080060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d00100a80 0x7f3d001992d0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 -- 172.21.15.152:0/740080060 >> 172.21.15.152:0/740080060 conn(0x7f3d000fc7a0 msgr2=0x7f3d000fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 -- 172.21.15.152:0/740080060 shutdown_connections 2024-09-11T22:14:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:56.047+0000 7f3d06881640 1 -- 172.21.15.152:0/740080060 wait complete. 2024-09-11T22:14:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.307+0000 7f410b48d640 1 -- 172.21.15.152:0/4146464372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104101390 msgr2=0x7f410410d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.307+0000 7f410b48d640 1 --2- 172.21.15.152:0/4146464372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104101390 0x7f410410d8c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009cd0 tx=0x7f40fc02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.307+0000 7f410b48d640 1 -- 172.21.15.152:0/4146464372 shutdown_connections 2024-09-11T22:14:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.307+0000 7f410b48d640 1 --2- 172.21.15.152:0/4146464372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104101390 0x7f410410d8c0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.307+0000 7f410b48d640 1 --2- 172.21.15.152:0/4146464372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41041009f0 0x7f4104100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.307+0000 7f410b48d640 1 --2- 172.21.15.152:0/4146464372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4104106a00 0x7f4104106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.307+0000 7f410b48d640 1 -- 172.21.15.152:0/4146464372 >> 172.21.15.152:0/4146464372 conn(0x7f41040fc6b0 msgr2=0x7f41040fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.307+0000 7f410b48d640 1 -- 172.21.15.152:0/4146464372 shutdown_connections 2024-09-11T22:14:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.307+0000 7f410b48d640 1 -- 172.21.15.152:0/4146464372 wait complete. 2024-09-11T22:14:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.307+0000 7f410b48d640 1 Processor -- start 2024-09-11T22:14:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.307+0000 7f410b48d640 1 -- start start 2024-09-11T22:14:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f410b48d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41041009f0 0x7f41041991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f410b48d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4104101390 0x7f41041996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f410b48d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104106a00 0x7f41041a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f410b48d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4104110e40 con 0x7f4104106a00 2024-09-11T22:14:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f410b48d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4104110cc0 con 0x7f4104101390 2024-09-11T22:14:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f410b48d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4104110fc0 con 0x7f41041009f0 2024-09-11T22:14:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4109a2a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104106a00 0x7f41041a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4109a2a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104106a00 0x7f41041a4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41962/0 (socket says 172.21.15.152:41962) 2024-09-11T22:14:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4109a2a640 1 -- 172.21.15.152:0/1043781973 learned_addr learned my addr 172.21.15.152:0/1043781973 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4109229640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41041009f0 0x7f41041991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4108a28640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4104101390 0x7f41041996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4109a2a640 1 -- 172.21.15.152:0/1043781973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41041009f0 msgr2=0x7f41041991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4109a2a640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41041009f0 0x7f41041991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4109a2a640 1 -- 172.21.15.152:0/1043781973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4104101390 msgr2=0x7f41041996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4109a2a640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4104101390 0x7f41041996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4109a2a640 1 -- 172.21.15.152:0/1043781973 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41041a4770 con 0x7f4104106a00 2024-09-11T22:14:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4108a28640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4104101390 0x7f41041996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.308+0000 7f4109a2a640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104106a00 0x7f41041a4230 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f40fc005cc0 tx=0x7f40fc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.309+0000 7f40fa7fc640 1 -- 172.21.15.152:0/1043781973 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc004040 con 0x7f4104106a00 2024-09-11T22:14:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.309+0000 7f40fa7fc640 1 -- 172.21.15.152:0/1043781973 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40fc0046c0 con 0x7f4104106a00 2024-09-11T22:14:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.309+0000 7f410b48d640 1 -- 172.21.15.152:0/1043781973 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41041a4940 con 0x7f4104106a00 2024-09-11T22:14:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.309+0000 7f40fa7fc640 1 -- 172.21.15.152:0/1043781973 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc046480 con 0x7f4104106a00 2024-09-11T22:14:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.309+0000 7f410b48d640 1 -- 172.21.15.152:0/1043781973 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41041a4e50 con 0x7f4104106a00 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.312+0000 7f410e22c740 1 Processor -- start 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.312+0000 7f40fa7fc640 1 -- 172.21.15.152:0/1043781973 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f40fc0305a0 con 0x7f4104106a00 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.312+0000 7f410e22c740 1 -- start start 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.312+0000 7f410e22c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 0x55a68e1c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.312+0000 7f410e22c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 0x55a68e1cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.312+0000 7f410e22c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1d20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.312+0000 7f410e22c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a68e1292f0 con 0x55a68e1c5410 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.312+0000 7f410e22c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a68e0d1270 con 0x55a68e1c4af0 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.312+0000 7f410e22c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a68e1252b0 con 0x55a68e1cfcb0 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4108a28640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 0x55a68e1c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4108a28640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 0x55a68e1c4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37810/0 (socket says 172.21.15.152:37810) 2024-09-11T22:14:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4109229640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 0x55a68e1cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4108a28640 1 -- 172.21.15.152:0/2932004595 learned_addr learned my addr 172.21.15.152:0/2932004595 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4108a28640 1 --2- 172.21.15.152:0/2932004595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1d20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4109229640 1 -- 172.21.15.152:0/2932004595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 msgr2=0x55a68e1d20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4109229640 1 --2- 172.21.15.152:0/2932004595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1d20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4109229640 1 -- 172.21.15.152:0/2932004595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 msgr2=0x55a68e1c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4109229640 1 --2- 172.21.15.152:0/2932004595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 0x55a68e1c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4109229640 1 -- 172.21.15.152:0/2932004595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68e0d0340 con 0x55a68e1c5410 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f40fa7fc640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40f00a2e20 0x7f40f00a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4109229640 1 --2- 172.21.15.152:0/2932004595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 0x55a68e1cf770 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f4100005fd0 tx=0x7f41000107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c73867fd738bfd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f4108a28640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40f00a2e20 0x7f40f00a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.313+0000 7f40fa7fc640 1 -- 172.21.15.152:0/1043781973 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f40fc02e030 con 0x7f4104106a00 2024-09-11T22:14:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.314+0000 7f40ef7fe640 1 -- 172.21.15.152:0/2932004595 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410000be60 con 0x55a68e1c5410 2024-09-11T22:14:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.314+0000 7f40ef7fe640 1 -- 172.21.15.152:0/2932004595 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f410001c960 con 0x55a68e1c5410 2024-09-11T22:14:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.314+0000 7f40ef7fe640 1 -- 172.21.15.152:0/2932004595 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100011b20 con 0x55a68e1c5410 2024-09-11T22:14:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 -- 172.21.15.152:0/2932004595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 msgr2=0x55a68e1cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f4108a28640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40f00a2e20 0x7f40f00a52e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55a68e1c23e0 tx=0x7f40f400c570 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 --2- 172.21.15.152:0/2932004595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 0x55a68e1cf770 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f4100005fd0 tx=0x7f41000107a0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 -- 172.21.15.152:0/2932004595 shutdown_connections 2024-09-11T22:14:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 --2- 172.21.15.152:0/2932004595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1d20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 --2- 172.21.15.152:0/2932004595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 0x55a68e1cf770 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 --2- 172.21.15.152:0/2932004595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 0x55a68e1c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 -- 172.21.15.152:0/2932004595 >> 172.21.15.152:0/2932004595 conn(0x55a68e1c1060 msgr2=0x55a68e1c1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 -- 172.21.15.152:0/2932004595 shutdown_connections 2024-09-11T22:14:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 -- 172.21.15.152:0/2932004595 wait complete. 2024-09-11T22:14:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 -- start start 2024-09-11T22:14:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 Processor -- start 2024-09-11T22:14:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 0x55a68e1ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.315+0000 7f410e22c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 0x55a68e1cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f410e22c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f410e22c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a68e1d2880 con 0x55a68e1c5410 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f410e22c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a68e0b2290 con 0x55a68e1c4af0 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f410e22c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a68e1d2a00 con 0x55a68e1cfcb0 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f410e22c740 10 client.0 _ll_register_callbacks cb 0x55a68e0e3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4108a28640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 0x55a68e1cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4108a28640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 0x55a68e1cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41976/0 (socket says 172.21.15.152:41976) 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4108a28640 1 -- 172.21.15.152:0/1501509276 learned_addr learned my addr 172.21.15.152:0/1501509276 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4109a2a640 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4109229640 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 0x55a68e1ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4108a28640 1 -- 172.21.15.152:0/1501509276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 msgr2=0x55a68e1cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4108a28640 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4108a28640 1 -- 172.21.15.152:0/1501509276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 msgr2=0x55a68e1ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4108a28640 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 0x55a68e1ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4108a28640 1 -- 172.21.15.152:0/1501509276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a68de3c210 con 0x55a68e1c5410 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4109229640 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 0x55a68e1ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f4108a28640 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 0x55a68e1cd090 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f40f4014f70 tx=0x7f40f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db44e3bda297d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f40ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f40ecff9640 1 -- 172.21.15.152:0/1501509276 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f400fd90 con 0x55a68e1c5410 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f410e22c740 1 -- 172.21.15.152:0/1501509276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f410001c960 con 0x55a68e1c5410 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.316+0000 7f40ecff9640 1 -- 172.21.15.152:0/1501509276 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f40f4005020 con 0x55a68e1c5410 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.317+0000 7f40ecff9640 1 -- 172.21.15.152:0/1501509276 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f40f4005220 con 0x55a68e1c5410 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.317+0000 7f410e22c740 10 client.18126 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.317+0000 7f410e22c740 1 -- 172.21.15.152:0/1501509276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a68df08620 con 0x55a68e1c5410 2024-09-11T22:14:56.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.319+0000 7f40ecff9640 1 -- 172.21.15.152:0/1501509276 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f410001c960 con 0x55a68e1c5410 2024-09-11T22:14:56.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.320+0000 7f40ecff9640 1 -- 172.21.15.152:0/1501509276 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f40f4011440 con 0x55a68e1c5410 2024-09-11T22:14:56.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.320+0000 7f410e22c740 10 client.18126 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:56.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.320+0000 7f410e22c740 10 client.18126 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:56.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.320+0000 7f410e22c740 20 client.18126 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.320+0000 7f410e22c740 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a68e1e4100 0x55a68e1e64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.320+0000 7f410e22c740 4 client.18126 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.320+0000 7f410e22c740 1 -- 172.21.15.152:0/1501509276 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a68e136a20 con 0x55a68e1e4100 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.320+0000 7f4109229640 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a68e1e4100 0x55a68e1e64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.320+0000 7f40ecff9640 10 client.18126 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.320+0000 7f4109229640 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a68e1e4100 0x55a68e1e64f0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7a6515b91b916b3 server_cookie=b51f5482e3503dd8 in_seq=0 out_seq=0 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f40ecff9640 1 -- 172.21.15.152:0/1501509276 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a68e136a20 con 0x55a68e1e4100 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f40ecff9640 10 client.18126 handle_command_reply: tid=0 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f410e22c740 1 client.18126 shutdown 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f410e22c740 1 -- 172.21.15.152:0/1501509276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 msgr2=0x55a68e1cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f410e22c740 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 0x55a68e1cd090 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f40f4014f70 tx=0x7f40f4004730 comp rx=0 tx=0).stop 2024-09-11T22:14:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f410e22c740 1 -- 172.21.15.152:0/1501509276 shutdown_connections 2024-09-11T22:14:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f410e22c740 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a68e1e4100 0x55a68e1e64f0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f410e22c740 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f410e22c740 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c5410 0x55a68e1cd090 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f410e22c740 1 --2- 172.21.15.152:0/1501509276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c4af0 0x55a68e1ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f40ecff9640 0 client.18126 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.321+0000 7f410e22c740 1 -- 172.21.15.152:0/1501509276 >> 172.21.15.152:0/1501509276 conn(0x55a68e1c1060 msgr2=0x55a68e1c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.322+0000 7f410e22c740 1 -- 172.21.15.152:0/1501509276 shutdown_connections 2024-09-11T22:14:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.322+0000 7f410e22c740 1 -- 172.21.15.152:0/1501509276 wait complete. 2024-09-11T22:14:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.322+0000 7f410e22c740 20 client.18126 trim_cache size 0 max 16384 2024-09-11T22:14:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.336+0000 7f410e22c740 1 Processor -- start 2024-09-11T22:14:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f410e22c740 1 -- start start 2024-09-11T22:14:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f410e22c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1c7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f410e22c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c5410 0x55a68e1ebe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f410e22c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1ec340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f410e22c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41041adf70 con 0x55a68e1c4af0 2024-09-11T22:14:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f410e22c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f41041ab840 con 0x55a68e1c5410 2024-09-11T22:14:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f410e22c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f41041a96b0 con 0x55a68e1cfcb0 2024-09-11T22:14:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4109229640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4109229640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41990/0 (socket says 172.21.15.152:41990) 2024-09-11T22:14:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4109229640 1 -- 172.21.15.152:0/1583080147 learned_addr learned my addr 172.21.15.152:0/1583080147 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4109a2a640 1 --2- 172.21.15.152:0/1583080147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1ec340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4108a28640 1 --2- 172.21.15.152:0/1583080147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c5410 0x55a68e1ebe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4109229640 1 -- 172.21.15.152:0/1583080147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 msgr2=0x55a68e1ec340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4109229640 1 --2- 172.21.15.152:0/1583080147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1ec340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4109229640 1 -- 172.21.15.152:0/1583080147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c5410 msgr2=0x55a68e1ebe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4109229640 1 --2- 172.21.15.152:0/1583080147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c5410 0x55a68e1ebe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4109229640 1 -- 172.21.15.152:0/1583080147 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68e1c0e90 con 0x55a68e1c4af0 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4108a28640 1 --2- 172.21.15.152:0/1583080147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c5410 0x55a68e1ebe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f4109229640 1 --2- 172.21.15.152:0/1583080147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1c7560 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4100005fd0 tx=0x7f4100011680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f572b306a72828 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.337+0000 7f40eeffd640 1 -- 172.21.15.152:0/1583080147 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100005030 con 0x55a68e1c4af0 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.338+0000 7f40eeffd640 1 -- 172.21.15.152:0/1583080147 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41000116f0 con 0x55a68e1c4af0 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.338+0000 7f40eeffd640 1 -- 172.21.15.152:0/1583080147 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41000056b0 con 0x55a68e1c4af0 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.338+0000 7f410e22c740 1 -- 172.21.15.152:0/1583080147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 msgr2=0x55a68e1c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.338+0000 7f410e22c740 1 --2- 172.21.15.152:0/1583080147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1c7560 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4100005fd0 tx=0x7f4100011680 comp rx=0 tx=0).stop 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.338+0000 7f410e22c740 1 -- 172.21.15.152:0/1583080147 shutdown_connections 2024-09-11T22:14:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.338+0000 7f410e22c740 1 --2- 172.21.15.152:0/1583080147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1cfcb0 0x55a68e1ec340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.338+0000 7f410e22c740 1 --2- 172.21.15.152:0/1583080147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1c5410 0x55a68e1ebe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.338+0000 7f410e22c740 1 --2- 172.21.15.152:0/1583080147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1c7560 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.338+0000 7f410e22c740 1 -- 172.21.15.152:0/1583080147 >> 172.21.15.152:0/1583080147 conn(0x55a68e1c1060 msgr2=0x55a68e1cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.338+0000 7f410e22c740 1 -- 172.21.15.152:0/1583080147 shutdown_connections 2024-09-11T22:14:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.338+0000 7f410e22c740 1 -- 172.21.15.152:0/1583080147 wait complete. 2024-09-11T22:14:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f410e22c740 1 -- start start 2024-09-11T22:14:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f410e22c740 1 Processor -- start 2024-09-11T22:14:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f410e22c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1dc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f410e22c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1c5410 0x55a68e1c9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f410e22c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1cfcb0 0x55a68e1c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f410e22c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41041a9d00 con 0x55a68e1c4af0 2024-09-11T22:14:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f410e22c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f41041ab170 con 0x55a68e1cfcb0 2024-09-11T22:14:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f410e22c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f41041aa3d0 con 0x55a68e1c5410 2024-09-11T22:14:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f410e22c740 10 client.0 _ll_register_callbacks cb 0x7f40f400c930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f4109229640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1dc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f4109229640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1dc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42004/0 (socket says 172.21.15.152:42004) 2024-09-11T22:14:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f4109229640 1 -- 172.21.15.152:0/50003994 learned_addr learned my addr 172.21.15.152:0/50003994 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f4108a28640 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1c5410 0x55a68e1c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f4109a2a640 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1cfcb0 0x55a68e1c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f4109229640 1 -- 172.21.15.152:0/50003994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1c5410 msgr2=0x55a68e1c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f4109229640 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1c5410 0x55a68e1c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f4109229640 1 -- 172.21.15.152:0/50003994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1cfcb0 msgr2=0x55a68e1c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f4109229640 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1cfcb0 0x55a68e1c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f4109229640 1 -- 172.21.15.152:0/50003994 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a68e1c1cf0 con 0x55a68e1c4af0 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.339+0000 7f4109a2a640 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1cfcb0 0x55a68e1c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f4109229640 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1dc990 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f4100005d00 tx=0x7f410000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fddbe4c4e9cf75 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f40ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f40ecff9640 1 -- 172.21.15.152:0/50003994 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100011aa0 con 0x55a68e1c4af0 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f410e22c740 1 -- 172.21.15.152:0/50003994 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41000116f0 con 0x55a68e1c4af0 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f40ecff9640 1 -- 172.21.15.152:0/50003994 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f4100011c40 con 0x55a68e1c4af0 2024-09-11T22:14:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f40ecff9640 1 -- 172.21.15.152:0/50003994 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f410003f050 con 0x55a68e1c4af0 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f410e22c740 10 client.18132 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f410e22c740 1 -- 172.21.15.152:0/50003994 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a68e24ecd0 con 0x55a68e1c4af0 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f40ecff9640 1 -- 172.21.15.152:0/50003994 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41000116f0 con 0x55a68e1c4af0 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f40ecff9640 1 -- 172.21.15.152:0/50003994 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f4100004960 con 0x55a68e1c4af0 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f410e22c740 10 client.18132 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f410e22c740 10 client.18132 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f410e22c740 20 client.18132 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f410e22c740 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a68e24f1f0 0x55a68e2515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f410e22c740 4 client.18132 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.340+0000 7f410e22c740 1 -- 172.21.15.152:0/50003994 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a68e130d70 con 0x55a68e24f1f0 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.341+0000 7f4108a28640 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a68e24f1f0 0x55a68e2515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.341+0000 7f40ecff9640 10 client.18132 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.341+0000 7f4108a28640 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a68e24f1f0 0x55a68e2515e0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2589b2ec505d2605 server_cookie=29b5c1341068231d in_seq=0 out_seq=0 2024-09-11T22:14:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f40ecff9640 1 -- 172.21.15.152:0/50003994 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a68e130d70 con 0x55a68e24f1f0 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f40ecff9640 10 client.18132 handle_command_reply: tid=0 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 1 client.18132 shutdown 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 1 -- 172.21.15.152:0/50003994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 msgr2=0x55a68e1dc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1dc990 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f4100005d00 tx=0x7f410000be90 comp rx=0 tx=0).stop 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 1 -- 172.21.15.152:0/50003994 shutdown_connections 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a68e24f1f0 0x55a68e2515e0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a68e1cfcb0 0x55a68e1c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f40ecff9640 0 client.18132 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a68e1c5410 0x55a68e1c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 1 --2- 172.21.15.152:0/50003994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a68e1c4af0 0x55a68e1dc990 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 1 -- 172.21.15.152:0/50003994 >> 172.21.15.152:0/50003994 conn(0x55a68e1c1060 msgr2=0x55a68e1bf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 1 -- 172.21.15.152:0/50003994 shutdown_connections 2024-09-11T22:14:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 1 -- 172.21.15.152:0/50003994 wait complete. 2024-09-11T22:14:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.349+0000 7f410e22c740 20 client.18132 trim_cache size 0 max 16384 2024-09-11T22:14:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:14:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:14:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:14:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:14:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 -- 172.21.15.152:0/1043781973 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40f00a2e20 msgr2=0x7f40f00a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40f00a2e20 0x7f40f00a52e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55a68e1c23e0 tx=0x7f40f400c570 comp rx=0 tx=0).stop 2024-09-11T22:14:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 -- 172.21.15.152:0/1043781973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104106a00 msgr2=0x7f41041a4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104106a00 0x7f41041a4230 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f40fc005cc0 tx=0x7f40fc003970 comp rx=0 tx=0).stop 2024-09-11T22:14:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 -- 172.21.15.152:0/1043781973 shutdown_connections 2024-09-11T22:14:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f40f00a2e20 0x7f40f00a52e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104106a00 0x7f41041a4230 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4104101390 0x7f41041996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 --2- 172.21.15.152:0/1043781973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41041009f0 0x7f41041991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 -- 172.21.15.152:0/1043781973 >> 172.21.15.152:0/1043781973 conn(0x7f41040fc6b0 msgr2=0x7f41040fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 -- 172.21.15.152:0/1043781973 shutdown_connections 2024-09-11T22:14:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:14:56.350+0000 7f410b48d640 1 -- 172.21.15.152:0/1043781973 wait complete. 2024-09-11T22:14:56.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:56 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/740080060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:56.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:56 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/740080060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:56.794 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 873073c2 --release --await' 2024-09-11T22:14:56.794 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 873073c2 --release --await 2024-09-11T22:14:56.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:56 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/740080060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:14:57.040 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:14:57.438 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:57 smithi152 ceph-mon[31188]: pgmap v330: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 367 KiB/s wr, 47 op/s 2024-09-11T22:14:57.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.524+0000 7f8d55525640 1 -- 172.21.15.152:0/2739258849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d50106f10 msgr2=0x7f8d5010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.524+0000 7f8d55525640 1 --2- 172.21.15.152:0/2739258849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d50106f10 0x7f8d5010ea90 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009ca0 tx=0x7f8d4802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.524+0000 7f8d55525640 1 -- 172.21.15.152:0/2739258849 shutdown_connections 2024-09-11T22:14:57.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.524+0000 7f8d55525640 1 --2- 172.21.15.152:0/2739258849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d50106f10 0x7f8d5010ea90 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.524+0000 7f8d55525640 1 --2- 172.21.15.152:0/2739258849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d50102790 0x7f8d501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.524+0000 7f8d55525640 1 --2- 172.21.15.152:0/2739258849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d50101de0 0x7f8d501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.524+0000 7f8d55525640 1 -- 172.21.15.152:0/2739258849 >> 172.21.15.152:0/2739258849 conn(0x7f8d500fd8c0 msgr2=0x7f8d500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:57.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.524+0000 7f8d55525640 1 -- 172.21.15.152:0/2739258849 shutdown_connections 2024-09-11T22:14:57.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.524+0000 7f8d55525640 1 -- 172.21.15.152:0/2739258849 wait complete. 2024-09-11T22:14:57.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.524+0000 7f8d55525640 1 Processor -- start 2024-09-11T22:14:57.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d55525640 1 -- start start 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d55525640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d50101de0 0x7f8d501983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d55525640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d50102790 0x7f8d50198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d55525640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d50106f10 0x7f8d5019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d55525640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8d50111f70 con 0x7f8d50106f10 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d55525640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d50111df0 con 0x7f8d50102790 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d55525640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501120f0 con 0x7f8d50101de0 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d4f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d50106f10 0x7f8d5019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d4f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d50106f10 0x7f8d5019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42018/0 (socket says 172.21.15.152:42018) 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/1327547878 learned_addr learned my addr 172.21.15.152:0/1327547878 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d4e7fc640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d50102790 0x7f8d50198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d4effd640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d50101de0 0x7f8d501983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/1327547878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d50101de0 msgr2=0x7f8d501983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d50101de0 0x7f8d501983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/1327547878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d50102790 msgr2=0x7f8d50198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d50102790 0x7f8d50198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/1327547878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5019d3a0 con 0x7f8d50106f10 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.525+0000 7f8d4effd640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d50101de0 0x7f8d501983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.526+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d50106f10 0x7f8d5019ccc0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8d48031a60 tx=0x7f8d48031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.526+0000 7f8d47fff640 1 -- 172.21.15.152:0/1327547878 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48003c30 con 0x7f8d50106f10 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.526+0000 7f8d55525640 1 -- 172.21.15.152:0/1327547878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5019d630 con 0x7f8d50106f10 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.526+0000 7f8d47fff640 1 -- 172.21.15.152:0/1327547878 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d48003dd0 con 0x7f8d50106f10 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.526+0000 7f8d47fff640 1 -- 172.21.15.152:0/1327547878 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d480047e0 con 0x7f8d50106f10 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.526+0000 7f8d55525640 1 -- 172.21.15.152:0/1327547878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d501a4f70 con 0x7f8d50106f10 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.528+0000 7f8d47fff640 1 -- 172.21.15.152:0/1327547878 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8d4802f790 con 0x7f8d50106f10 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.528+0000 7f8d578fe740 1 Processor -- start 2024-09-11T22:14:57.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.528+0000 7f8d578fe740 1 -- start start 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d47fff640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d3c0a2cf0 0x7f8d3c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4e7fc640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d3c0a2cf0 0x7f8d3c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d47fff640 1 -- 172.21.15.152:0/1327547878 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f8d480f0830 con 0x7f8d50106f10 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d788440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d792d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d795630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d578fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ae6d6ed620 con 0x55ae6d793240 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d578fe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ae6d694e50 con 0x55ae6d788980 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d578fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ae6d6e95e0 con 0x55ae6d788060 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d795630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d795630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42030/0 (socket says 172.21.15.152:42030) 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/2994545416 learned_addr learned my addr 172.21.15.152:0/2994545416 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:57.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4effd640 1 --2- 172.21.15.152:0/2994545416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d788440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4e7fc640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d3c0a2cf0 0x7f8d3c0a51b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8d40005d90 tx=0x7f8d40005d20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:57.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4e7fc640 1 --2- 172.21.15.152:0/2994545416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d792d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/2994545416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 msgr2=0x55ae6d788440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:57.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/2994545416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d788440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/2994545416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 msgr2=0x55ae6d792d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:57.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/2994545416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d792d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.529+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/2994545416 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae6d685d40 con 0x55ae6d793240 2024-09-11T22:14:57.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.530+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/2994545416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d795630 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8d480b97d0 tx=0x7f8d480b8980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715580b403950c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:57.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.530+0000 7f8d457fa640 1 -- 172.21.15.152:0/2994545416 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d480bd500 con 0x55ae6d793240 2024-09-11T22:14:57.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.530+0000 7f8d457fa640 1 -- 172.21.15.152:0/2994545416 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d48036030 con 0x55ae6d793240 2024-09-11T22:14:57.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.530+0000 7f8d457fa640 1 -- 172.21.15.152:0/2994545416 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d480b9470 con 0x55ae6d793240 2024-09-11T22:14:57.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.530+0000 7f8d578fe740 1 -- 172.21.15.152:0/2994545416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 msgr2=0x55ae6d795630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.530+0000 7f8d578fe740 1 --2- 172.21.15.152:0/2994545416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d795630 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8d480b97d0 tx=0x7f8d480b8980 comp rx=0 tx=0).stop 2024-09-11T22:14:57.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 -- 172.21.15.152:0/2994545416 shutdown_connections 2024-09-11T22:14:57.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 --2- 172.21.15.152:0/2994545416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d795630 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 --2- 172.21.15.152:0/2994545416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d792d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 --2- 172.21.15.152:0/2994545416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d788440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 -- 172.21.15.152:0/2994545416 >> 172.21.15.152:0/2994545416 conn(0x55ae6d7845f0 msgr2=0x55ae6d7849d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:57.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 -- 172.21.15.152:0/2994545416 shutdown_connections 2024-09-11T22:14:57.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 -- 172.21.15.152:0/2994545416 wait complete. 2024-09-11T22:14:57.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 -- start start 2024-09-11T22:14:57.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 Processor -- start 2024-09-11T22:14:57.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d7901b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d788980 0x55ae6d7906f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d793240 0x55ae6d790c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ae6d6ed620 con 0x55ae6d788980 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ae6d675f10 con 0x55ae6d793240 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.531+0000 7f8d578fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ae6d795bd0 con 0x55ae6d788060 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d578fe740 10 client.0 _ll_register_callbacks cb 0x55ae6d699db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d4e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d788980 0x55ae6d7906f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d4e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d788980 0x55ae6d7906f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42034/0 (socket says 172.21.15.152:42034) 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d4e7fc640 1 -- 172.21.15.152:0/3127865980 learned_addr learned my addr 172.21.15.152:0/3127865980 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d4effd640 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d7901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d793240 0x55ae6d790c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d4e7fc640 1 -- 172.21.15.152:0/3127865980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 msgr2=0x55ae6d7901b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d4e7fc640 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d7901b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d4e7fc640 1 -- 172.21.15.152:0/3127865980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d793240 msgr2=0x55ae6d790c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:57.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d4e7fc640 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d793240 0x55ae6d790c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d4e7fc640 1 -- 172.21.15.152:0/3127865980 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae6d3fc580 con 0x55ae6d788980 2024-09-11T22:14:57.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d4e7fc640 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d788980 0x55ae6d7906f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8d40010960 tx=0x7f8d40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bb6e97e5c77296 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:57.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d367fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:57.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d367fc640 1 -- 172.21.15.152:0/3127865980 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4000fd50 con 0x55ae6d788980 2024-09-11T22:14:57.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d367fc640 1 -- 172.21.15.152:0/3127865980 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f8d4001e430 con 0x55ae6d788980 2024-09-11T22:14:57.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d578fe740 1 -- 172.21.15.152:0/3127865980 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d48036030 con 0x55ae6d788980 2024-09-11T22:14:57.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d367fc640 1 -- 172.21.15.152:0/3127865980 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8d4001e630 con 0x55ae6d788980 2024-09-11T22:14:57.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d578fe740 10 client.18144 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:57.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.532+0000 7f8d578fe740 1 -- 172.21.15.152:0/3127865980 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ae6d4c6960 con 0x55ae6d788980 2024-09-11T22:14:57.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.533+0000 7f8d367fc640 1 -- 172.21.15.152:0/3127865980 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d48036030 con 0x55ae6d788980 2024-09-11T22:14:57.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.533+0000 7f8d367fc640 1 -- 172.21.15.152:0/3127865980 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8d4002e940 con 0x55ae6d788980 2024-09-11T22:14:57.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.533+0000 7f8d578fe740 10 client.18144 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:57.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.533+0000 7f8d578fe740 10 client.18144 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:14:57.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.533+0000 7f8d578fe740 20 client.18144 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:57.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.533+0000 7f8d578fe740 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae6d7a2a90 0x55ae6d7a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.533+0000 7f8d578fe740 4 client.18144 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:57.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.533+0000 7f8d578fe740 1 -- 172.21.15.152:0/3127865980 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae6d6fab90 con 0x55ae6d7a2a90 2024-09-11T22:14:57.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.533+0000 7f8d4effd640 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae6d7a2a90 0x55ae6d7a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.533+0000 7f8d367fc640 10 client.18144 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:57.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.533+0000 7f8d4effd640 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae6d7a2a90 0x55ae6d7a4ed0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f999d7cf5feb62a5 server_cookie=15478d0143d6de6a in_seq=0 out_seq=0 2024-09-11T22:14:57.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d367fc640 1 -- 172.21.15.152:0/3127865980 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae6d6fab90 con 0x55ae6d7a2a90 2024-09-11T22:14:57.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d367fc640 10 client.18144 handle_command_reply: tid=0 2024-09-11T22:14:57.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d578fe740 1 client.18144 shutdown 2024-09-11T22:14:57.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d578fe740 1 -- 172.21.15.152:0/3127865980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d788980 msgr2=0x55ae6d7906f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d578fe740 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d788980 0x55ae6d7906f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8d40010960 tx=0x7f8d40004730 comp rx=0 tx=0).stop 2024-09-11T22:14:57.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d578fe740 1 -- 172.21.15.152:0/3127865980 shutdown_connections 2024-09-11T22:14:57.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d578fe740 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae6d7a2a90 0x55ae6d7a4ed0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d578fe740 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d793240 0x55ae6d790c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d578fe740 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d788980 0x55ae6d7906f0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d367fc640 0 client.18144 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:57.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d578fe740 1 --2- 172.21.15.152:0/3127865980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d7901b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d578fe740 1 -- 172.21.15.152:0/3127865980 >> 172.21.15.152:0/3127865980 conn(0x55ae6d7845f0 msgr2=0x55ae6d78a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:57.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d578fe740 1 -- 172.21.15.152:0/3127865980 shutdown_connections 2024-09-11T22:14:57.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.534+0000 7f8d578fe740 1 -- 172.21.15.152:0/3127865980 wait complete. 2024-09-11T22:14:57.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.535+0000 7f8d578fe740 20 client.18144 trim_cache size 0 max 16384 2024-09-11T22:14:57.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.551+0000 7f8d578fe740 1 Processor -- start 2024-09-11T22:14:57.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.551+0000 7f8d578fe740 1 -- start start 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.551+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d783640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.551+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d7aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.551+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d7aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d578fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501b0260 con 0x55ae6d793240 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d578fe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501adb30 con 0x55ae6d788980 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d578fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501ab9a0 con 0x55ae6d788060 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d7aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d7aace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42048/0 (socket says 172.21.15.152:42048) 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/2720225118 learned_addr learned my addr 172.21.15.152:0/2720225118 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4effd640 1 --2- 172.21.15.152:0/2720225118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d783640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4e7fc640 1 --2- 172.21.15.152:0/2720225118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d7aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/2720225118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 msgr2=0x55ae6d783640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/2720225118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d783640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/2720225118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 msgr2=0x55ae6d7aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/2720225118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d7aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/2720225118 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae6d787e90 con 0x55ae6d793240 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4e7fc640 1 --2- 172.21.15.152:0/2720225118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d7aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/2720225118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d7aace0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8d480ee520 tx=0x7f8d4802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d6856ab44b1cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d44ff9640 1 -- 172.21.15.152:0/2720225118 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d480bd500 con 0x55ae6d793240 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d44ff9640 1 -- 172.21.15.152:0/2720225118 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d48036070 con 0x55ae6d793240 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.552+0000 7f8d44ff9640 1 -- 172.21.15.152:0/2720225118 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d480b9560 con 0x55ae6d793240 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.553+0000 7f8d578fe740 1 -- 172.21.15.152:0/2720225118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 msgr2=0x55ae6d7aace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.553+0000 7f8d578fe740 1 --2- 172.21.15.152:0/2720225118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d7aace0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8d480ee520 tx=0x7f8d4802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.553+0000 7f8d578fe740 1 -- 172.21.15.152:0/2720225118 shutdown_connections 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.553+0000 7f8d578fe740 1 --2- 172.21.15.152:0/2720225118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d7aace0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.553+0000 7f8d578fe740 1 --2- 172.21.15.152:0/2720225118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d7aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.553+0000 7f8d578fe740 1 --2- 172.21.15.152:0/2720225118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d783640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.553+0000 7f8d578fe740 1 -- 172.21.15.152:0/2720225118 >> 172.21.15.152:0/2720225118 conn(0x55ae6d7845f0 msgr2=0x55ae6d782f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.553+0000 7f8d578fe740 1 -- 172.21.15.152:0/2720225118 shutdown_connections 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.553+0000 7f8d578fe740 1 -- 172.21.15.152:0/2720225118 wait complete. 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.553+0000 7f8d578fe740 1 -- start start 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d578fe740 1 Processor -- start 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d79ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d79b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d578fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d797c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d578fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501abff0 con 0x55ae6d793240 2024-09-11T22:14:57.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d578fe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501ad460 con 0x55ae6d788980 2024-09-11T22:14:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d578fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501ac6c0 con 0x55ae6d788060 2024-09-11T22:14:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d578fe740 10 client.0 _ll_register_callbacks cb 0x7f8d40010660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d797c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d797c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42064/0 (socket says 172.21.15.152:42064) 2024-09-11T22:14:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/1373803548 learned_addr learned my addr 172.21.15.152:0/1373803548 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:14:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4e7fc640 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d79b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4effd640 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d79ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/1373803548 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 msgr2=0x55ae6d79ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d79ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/1373803548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 msgr2=0x55ae6d79b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d79b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4f7fe640 1 -- 172.21.15.152:0/1373803548 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae6d7983c0 con 0x55ae6d793240 2024-09-11T22:14:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4e7fc640 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d79b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d4f7fe640 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d797c30 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f8d480b9210 tx=0x7f8d480c12f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824b97e0d8941996 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.554+0000 7f8d367fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:14:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d367fc640 1 -- 172.21.15.152:0/1373803548 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d480b94e0 con 0x55ae6d793240 2024-09-11T22:14:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d578fe740 1 -- 172.21.15.152:0/1373803548 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d48036070 con 0x55ae6d793240 2024-09-11T22:14:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d367fc640 1 -- 172.21.15.152:0/1373803548 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8614+0+0 (secure 0 0 0) 0x7f8d480c0070 con 0x55ae6d793240 2024-09-11T22:14:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d367fc640 1 -- 172.21.15.152:0/1373803548 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8d480ee0e0 con 0x55ae6d793240 2024-09-11T22:14:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d578fe740 10 client.18150 fetch_fsmap learned FSMap version 30 2024-09-11T22:14:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d578fe740 1 -- 172.21.15.152:0/1373803548 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ae6d80e1b0 con 0x55ae6d793240 2024-09-11T22:14:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d367fc640 1 -- 172.21.15.152:0/1373803548 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d48036070 con 0x55ae6d793240 2024-09-11T22:14:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d367fc640 1 -- 172.21.15.152:0/1373803548 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8d48004b40 con 0x55ae6d793240 2024-09-11T22:14:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d578fe740 10 client.18150 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:14:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d578fe740 10 client.18150 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:14:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d578fe740 20 client.18150 populate_metadata read hostname 'smithi152' 2024-09-11T22:14:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d578fe740 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae6d80e630 0x55ae6d810a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d578fe740 4 client.18150 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "873073c2", "release": true, "await": true}] 2024-09-11T22:14:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.555+0000 7f8d578fe740 1 -- 172.21.15.152:0/1373803548 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "873073c2", "release": true, "await": true}) -- 0x55ae6d6f50a0 con 0x55ae6d80e630 2024-09-11T22:14:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.556+0000 7f8d4effd640 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae6d80e630 0x55ae6d810a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.556+0000 7f8d367fc640 10 client.18150 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.556+0000 7f8d4effd640 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae6d80e630 0x55ae6d810a20 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93a10570925686fe server_cookie=38e61179ad7338ee in_seq=0 out_seq=0 2024-09-11T22:14:57.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:57 smithi193 ceph-mon[35545]: pgmap v330: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 367 KiB/s wr, 47 op/s 2024-09-11T22:14:57.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.618+0000 7f8d367fc640 1 -- 172.21.15.152:0/1373803548 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ae6d6f50a0 con 0x55ae6d80e630 2024-09-11T22:14:57.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.618+0000 7f8d367fc640 10 client.18150 handle_command_reply: tid=0 2024-09-11T22:14:57.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.618+0000 7f8d578fe740 1 client.18150 shutdown 2024-09-11T22:14:57.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d578fe740 1 -- 172.21.15.152:0/1373803548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 msgr2=0x55ae6d797c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d578fe740 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d797c30 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f8d480b9210 tx=0x7f8d480c12f0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d578fe740 1 -- 172.21.15.152:0/1373803548 shutdown_connections 2024-09-11T22:14:57.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d578fe740 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ae6d80e630 0x55ae6d810a20 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d367fc640 0 client.18150 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:14:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d578fe740 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae6d793240 0x55ae6d797c30 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d578fe740 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae6d788980 0x55ae6d79b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d578fe740 1 --2- 172.21.15.152:0/1373803548 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae6d788060 0x55ae6d79ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d578fe740 1 -- 172.21.15.152:0/1373803548 >> 172.21.15.152:0/1373803548 conn(0x55ae6d7845f0 msgr2=0x55ae6d78a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d578fe740 1 -- 172.21.15.152:0/1373803548 shutdown_connections 2024-09-11T22:14:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d578fe740 1 -- 172.21.15.152:0/1373803548 wait complete. 2024-09-11T22:14:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.619+0000 7f8d578fe740 20 client.18150 trim_cache size 0 max 16384 2024-09-11T22:14:57.621 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 44, 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: "873073c2": { 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 44, 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:14:57.622 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 142.6, 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:14:57.623 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:14:57.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.621+0000 7f8d55525640 1 -- 172.21.15.152:0/1327547878 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d3c0a2cf0 msgr2=0x7f8d3c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.621+0000 7f8d55525640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d3c0a2cf0 0x7f8d3c0a51b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8d40005d90 tx=0x7f8d40005d20 comp rx=0 tx=0).stop 2024-09-11T22:14:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.621+0000 7f8d55525640 1 -- 172.21.15.152:0/1327547878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d50106f10 msgr2=0x7f8d5019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.621+0000 7f8d55525640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d50106f10 0x7f8d5019ccc0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8d48031a60 tx=0x7f8d48031a90 comp rx=0 tx=0).stop 2024-09-11T22:14:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.621+0000 7f8d55525640 1 -- 172.21.15.152:0/1327547878 shutdown_connections 2024-09-11T22:14:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.621+0000 7f8d55525640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d3c0a2cf0 0x7f8d3c0a51b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.621+0000 7f8d55525640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d50106f10 0x7f8d5019ccc0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.621+0000 7f8d55525640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d50102790 0x7f8d50198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.621+0000 7f8d55525640 1 --2- 172.21.15.152:0/1327547878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d50101de0 0x7f8d501983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.621+0000 7f8d55525640 1 -- 172.21.15.152:0/1327547878 >> 172.21.15.152:0/1327547878 conn(0x7f8d500fd8c0 msgr2=0x7f8d500feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.622+0000 7f8d55525640 1 -- 172.21.15.152:0/1327547878 shutdown_connections 2024-09-11T22:14:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:14:57.622+0000 7f8d55525640 1 -- 172.21.15.152:0/1327547878 wait complete. 2024-09-11T22:14:57.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:57 smithi179 ceph-mon[35603]: pgmap v330: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 367 KiB/s wr, 47 op/s 2024-09-11T22:14:58.554 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '873073c2', total seconds elapsed: 27.1 2024-09-11T22:14:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:59 smithi152 ceph-mon[31188]: pgmap v331: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 361 KiB/s wr, 44 op/s 2024-09-11T22:14:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:59 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:14:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:14:59 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:14:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:59 smithi179 ceph-mon[35603]: pgmap v331: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 361 KiB/s wr, 44 op/s 2024-09-11T22:14:59.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:59 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:14:59.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:14:59 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:14:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 565.0 s, 1062.3 tps, lat 475.933 ms stddev 3145.413 2024-09-11T22:14:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:59 smithi193 ceph-mon[35545]: pgmap v331: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 361 KiB/s wr, 44 op/s 2024-09-11T22:14:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:59 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:14:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:14:59 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:15:01.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:01 smithi152 ceph-mon[31188]: pgmap v332: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 960 KiB/s wr, 108 op/s 2024-09-11T22:15:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:01 smithi179 ceph-mon[35603]: pgmap v332: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 960 KiB/s wr, 108 op/s 2024-09-11T22:15:01.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:01 smithi193 ceph-mon[35545]: pgmap v332: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 960 KiB/s wr, 108 op/s 2024-09-11T22:15:03.598 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:03 smithi179 ceph-mon[35603]: pgmap v333: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 604 KiB/s wr, 67 op/s 2024-09-11T22:15:03.628 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:03 smithi193 ceph-mon[35545]: pgmap v333: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 604 KiB/s wr, 67 op/s 2024-09-11T22:15:03.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:03 smithi152 ceph-mon[31188]: pgmap v333: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 604 KiB/s wr, 67 op/s 2024-09-11T22:15:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 570.0 s, 2270.6 tps, lat 44.400 ms stddev 68.327 2024-09-11T22:15:05.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:05 smithi152 ceph-mon[31188]: pgmap v334: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.7 MiB/s wr, 633 op/s 2024-09-11T22:15:05.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:05 smithi179 ceph-mon[35603]: pgmap v334: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.7 MiB/s wr, 633 op/s 2024-09-11T22:15:05.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:05 smithi193 ceph-mon[35545]: pgmap v334: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.7 MiB/s wr, 633 op/s 2024-09-11T22:15:07.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:07 smithi152 ceph-mon[31188]: pgmap v335: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 9.9 MiB/s wr, 1.05k op/s 2024-09-11T22:15:07.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:07 smithi179 ceph-mon[35603]: pgmap v335: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 9.9 MiB/s wr, 1.05k op/s 2024-09-11T22:15:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:07 smithi193 ceph-mon[35545]: pgmap v335: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 9.9 MiB/s wr, 1.05k op/s 2024-09-11T22:15:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.490+0000 7fadf907b640 1 -- 172.21.15.152:0/3757843491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec094b70 msgr2=0x7fadec094f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.490+0000 7fadf907b640 1 --2- 172.21.15.152:0/3757843491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec094b70 0x7fadec094f50 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fade8009930 tx=0x7fade802a440 comp rx=0 tx=0).stop 2024-09-11T22:15:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.490+0000 7fadf907b640 1 -- 172.21.15.152:0/3757843491 shutdown_connections 2024-09-11T22:15:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.490+0000 7fadf907b640 1 --2- 172.21.15.152:0/3757843491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadec099880 0x7fadec0a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.490+0000 7fadf907b640 1 --2- 172.21.15.152:0/3757843491 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadec095520 0x7fadec099170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.490+0000 7fadf907b640 1 --2- 172.21.15.152:0/3757843491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec094b70 0x7fadec094f50 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.490+0000 7fadf907b640 1 -- 172.21.15.152:0/3757843491 >> 172.21.15.152:0/3757843491 conn(0x7fadec00a1e0 msgr2=0x7fadec00a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.490+0000 7fadf907b640 1 -- 172.21.15.152:0/3757843491 shutdown_connections 2024-09-11T22:15:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.491+0000 7fadf907b640 1 -- 172.21.15.152:0/3757843491 wait complete. 2024-09-11T22:15:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.491+0000 7fadf907b640 1 Processor -- start 2024-09-11T22:15:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.491+0000 7fadf907b640 1 -- start start 2024-09-11T22:15:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.492+0000 7fadf907b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadec094b70 0x7fadec12c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.492+0000 7fadf907b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadec099880 0x7fadec12c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.492+0000 7fadf907b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec130980 0x7fadec130e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.492+0000 7fadf907b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fadec0a49e0 con 0x7fadec130980 2024-09-11T22:15:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.492+0000 7fadf887a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec130980 0x7fadec130e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.493+0000 7fadf887a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec130980 0x7fadec130e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52818/0 (socket says 172.21.15.152:52818) 2024-09-11T22:15:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.493+0000 7fadf887a640 1 -- 172.21.15.152:0/3095562495 learned_addr learned my addr 172.21.15.152:0/3095562495 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.493+0000 7fadf907b640 1 -- 172.21.15.152:0/3095562495 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fadec0a4860 con 0x7fadec099880 2024-09-11T22:15:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.493+0000 7fadf907b640 1 -- 172.21.15.152:0/3095562495 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fadec0a4b60 con 0x7fadec094b70 2024-09-11T22:15:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.494+0000 7fadf887a640 1 -- 172.21.15.152:0/3095562495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadec094b70 msgr2=0x7fadec12c0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:15:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.494+0000 7fadf887a640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadec094b70 0x7fadec12c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.494+0000 7fadf887a640 1 -- 172.21.15.152:0/3095562495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadec099880 msgr2=0x7fadec12c600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:15:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.494+0000 7fadf887a640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadec099880 0x7fadec12c600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.494+0000 7fadf887a640 1 -- 172.21.15.152:0/3095562495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadec131470 con 0x7fadec130980 2024-09-11T22:15:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.494+0000 7fadf887a640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec130980 0x7fadec130e30 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fadf4065a40 tx=0x7fadf407b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.494+0000 7fadf17fa640 1 -- 172.21.15.152:0/3095562495 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40508c0 con 0x7fadec130980 2024-09-11T22:15:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.495+0000 7fadf17fa640 1 -- 172.21.15.152:0/3095562495 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadf407be20 con 0x7fadec130980 2024-09-11T22:15:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.495+0000 7fadf17fa640 1 -- 172.21.15.152:0/3095562495 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf407f690 con 0x7fadec130980 2024-09-11T22:15:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.495+0000 7fadf907b640 1 -- 172.21.15.152:0/3095562495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadec131760 con 0x7fadec130980 2024-09-11T22:15:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.496+0000 7fadf907b640 1 -- 172.21.15.152:0/3095562495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadec138f50 con 0x7fadec130980 2024-09-11T22:15:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.499+0000 7fadfd07a740 1 Processor -- start 2024-09-11T22:15:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.499+0000 7fadf17fa640 1 -- 172.21.15.152:0/3095562495 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fadf4080b90 con 0x7fadec130980 2024-09-11T22:15:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.500+0000 7fadfd07a740 1 -- start start 2024-09-11T22:15:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.500+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 0x564fc0dda3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.500+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda9c0 0x564fc0dde1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.500+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dde710 0x564fc0ddeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.500+0000 7fadfd07a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564fc0d3e2f0 con 0x564fc0dde710 2024-09-11T22:15:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.500+0000 7fadfd07a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564fc0ce6270 con 0x564fc0dda010 2024-09-11T22:15:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.500+0000 7fadfd07a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564fc0d3a2b0 con 0x564fc0dda9c0 2024-09-11T22:15:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.500+0000 7fadf17fa640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fade40a2e80 0x7fade40a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.501+0000 7fadf17fa640 1 -- 172.21.15.152:0/3095562495 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8658+0+0 (secure 0 0 0) 0x7fadf413aa40 con 0x7fadec130980 2024-09-11T22:15:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.501+0000 7fadf887a640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fade40a2e80 0x7fade40a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.501+0000 7fadf3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda9c0 0x564fc0dde1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.501+0000 7fadf3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda9c0 0x564fc0dde1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:57598/0 (socket says 172.21.15.152:57598) 2024-09-11T22:15:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.501+0000 7fadf3fff640 1 -- 172.21.15.152:0/2447139785 learned_addr learned my addr 172.21.15.152:0/2447139785 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.501+0000 7fadf37fe640 1 --2- 172.21.15.152:0/2447139785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 0x564fc0dda3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.502+0000 7fadf37fe640 1 --2- 172.21.15.152:0/2447139785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dde710 0x564fc0ddeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.502+0000 7fadf3fff640 1 -- 172.21.15.152:0/2447139785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 msgr2=0x564fc0dda3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.502+0000 7fadf3fff640 1 --2- 172.21.15.152:0/2447139785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 0x564fc0dda3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.502+0000 7fadf3fff640 1 -- 172.21.15.152:0/2447139785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dde710 msgr2=0x564fc0ddeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.502+0000 7fadf3fff640 1 --2- 172.21.15.152:0/2447139785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dde710 0x564fc0ddeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.502+0000 7fadf3fff640 1 -- 172.21.15.152:0/2447139785 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fc0ce5340 con 0x564fc0dda9c0 2024-09-11T22:15:09.506 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.505+0000 7fadf887a640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fade40a2e80 0x7fade40a5340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf41382c0 tx=0x7fadf4076040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:09.506 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.505+0000 7fadf3fff640 1 --2- 172.21.15.152:0/2447139785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda9c0 0x564fc0dde1d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fade802aa30 tx=0x7fade80314b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59b66252430a05f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.507+0000 7fadde7fc640 1 -- 172.21.15.152:0/2447139785 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade803e070 con 0x564fc0dda9c0 2024-09-11T22:15:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.508+0000 7fadde7fc640 1 -- 172.21.15.152:0/2447139785 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fade8005510 con 0x564fc0dda9c0 2024-09-11T22:15:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.509+0000 7fadfd07a740 1 -- 172.21.15.152:0/2447139785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda9c0 msgr2=0x564fc0dde1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.509+0000 7fadfd07a740 1 --2- 172.21.15.152:0/2447139785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda9c0 0x564fc0dde1d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fade802aa30 tx=0x7fade80314b0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.511+0000 7fadfd07a740 1 -- 172.21.15.152:0/2447139785 shutdown_connections 2024-09-11T22:15:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.511+0000 7fadfd07a740 1 --2- 172.21.15.152:0/2447139785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dde710 0x564fc0ddeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.511+0000 7fadfd07a740 1 --2- 172.21.15.152:0/2447139785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda9c0 0x564fc0dde1d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.511+0000 7fadfd07a740 1 --2- 172.21.15.152:0/2447139785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 0x564fc0dda3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.511+0000 7fadfd07a740 1 -- 172.21.15.152:0/2447139785 >> 172.21.15.152:0/2447139785 conn(0x564fc0dd5ce0 msgr2=0x564fc0dd60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.511+0000 7fadfd07a740 1 -- 172.21.15.152:0/2447139785 shutdown_connections 2024-09-11T22:15:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.512+0000 7fadfd07a740 1 -- 172.21.15.152:0/2447139785 wait complete. 2024-09-11T22:15:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.512+0000 7fadfd07a740 1 -- start start 2024-09-11T22:15:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.513+0000 7fadfd07a740 1 Processor -- start 2024-09-11T22:15:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.513+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda010 0x564fc0df8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.513+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda9c0 0x564fc0df5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.513+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dde710 0x564fc0df5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.513+0000 7fadfd07a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564fc0df8af0 con 0x564fc0dda9c0 2024-09-11T22:15:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.513+0000 7fadfd07a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564fc0cc7290 con 0x564fc0dde710 2024-09-11T22:15:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.514+0000 7fadfd07a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564fc0df8c70 con 0x564fc0dda010 2024-09-11T22:15:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.514+0000 7fadfd07a740 10 client.0 _ll_register_callbacks cb 0x564fc0cf8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.514+0000 7fadf37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda010 0x564fc0df8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.514+0000 7fadf37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda010 0x564fc0df8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:57600/0 (socket says 172.21.15.152:57600) 2024-09-11T22:15:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.514+0000 7fadf37fe640 1 -- 172.21.15.152:0/932852674 learned_addr learned my addr 172.21.15.152:0/932852674 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.514+0000 7fadf37fe640 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dde710 0x564fc0df5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.514+0000 7fadf3fff640 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda9c0 0x564fc0df5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.515+0000 7fadf37fe640 1 -- 172.21.15.152:0/932852674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dde710 msgr2=0x564fc0df5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.515+0000 7fadf37fe640 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dde710 0x564fc0df5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.515+0000 7fadf37fe640 1 -- 172.21.15.152:0/932852674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda9c0 msgr2=0x564fc0df5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.515+0000 7fadf37fe640 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda9c0 0x564fc0df5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.515+0000 7fadf37fe640 1 -- 172.21.15.152:0/932852674 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fc0a51210 con 0x564fc0dda010 2024-09-11T22:15:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.517+0000 7fadf37fe640 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda010 0x564fc0df8270 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fade000df00 tx=0x7fade000a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c320aced1ff29c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.517+0000 7fadd37fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:15:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.517+0000 7fadd37fe640 1 -- 172.21.15.152:0/932852674 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0011040 con 0x564fc0dda010 2024-09-11T22:15:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.517+0000 7fadfd07a740 1 -- 172.21.15.152:0/932852674 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fade8005510 con 0x564fc0dda010 2024-09-11T22:15:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.518+0000 7fadd37fe640 1 -- 172.21.15.152:0/932852674 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8658+0+0 (secure 0 0 0) 0x7fade0006110 con 0x564fc0dda010 2024-09-11T22:15:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.518+0000 7fadd37fe640 1 -- 172.21.15.152:0/932852674 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fade0006310 con 0x564fc0dda010 2024-09-11T22:15:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.518+0000 7fadfd07a740 10 client.27604 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.518+0000 7fadfd07a740 1 -- 172.21.15.152:0/932852674 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564fc0b1d620 con 0x564fc0dda010 2024-09-11T22:15:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.518+0000 7fadd37fe640 1 -- 172.21.15.152:0/932852674 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fade8005510 con 0x564fc0dda010 2024-09-11T22:15:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.519+0000 7fadd37fe640 1 -- 172.21.15.152:0/932852674 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fade0017040 con 0x564fc0dda010 2024-09-11T22:15:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.519+0000 7fadfd07a740 10 client.27604 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.519+0000 7fadfd07a740 10 client.27604 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.519+0000 7fadfd07a740 20 client.27604 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.519+0000 7fadfd07a740 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564fc0e06230 0x564fc0e086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.519+0000 7fadfd07a740 4 client.27604 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.519+0000 7fadfd07a740 1 -- 172.21.15.152:0/932852674 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fc0d4ba20 con 0x564fc0e06230 2024-09-11T22:15:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.519+0000 7fadf3fff640 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564fc0e06230 0x564fc0e086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.521+0000 7fadd37fe640 10 client.27604 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.521+0000 7fadf3fff640 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564fc0e06230 0x564fc0e086b0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53db2543616baca0 server_cookie=18aea82182861927 in_seq=0 out_seq=0 2024-09-11T22:15:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.525+0000 7fadd37fe640 1 -- 172.21.15.152:0/932852674 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fc0d4ba20 con 0x564fc0e06230 2024-09-11T22:15:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.526+0000 7fadd37fe640 10 client.27604 handle_command_reply: tid=0 2024-09-11T22:15:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.526+0000 7fadfd07a740 1 client.27604 shutdown 2024-09-11T22:15:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.526+0000 7fadfd07a740 1 -- 172.21.15.152:0/932852674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda010 msgr2=0x564fc0df8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.526+0000 7fadfd07a740 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda010 0x564fc0df8270 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fade000df00 tx=0x7fade000a040 comp rx=0 tx=0).stop 2024-09-11T22:15:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.526+0000 7fadfd07a740 1 -- 172.21.15.152:0/932852674 shutdown_connections 2024-09-11T22:15:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.526+0000 7fadfd07a740 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564fc0e06230 0x564fc0e086b0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.526+0000 7fadfd07a740 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dde710 0x564fc0df5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.526+0000 7fadfd07a740 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda9c0 0x564fc0df5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.526+0000 7fadfd07a740 1 --2- 172.21.15.152:0/932852674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dda010 0x564fc0df8270 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.526+0000 7fadfd07a740 1 -- 172.21.15.152:0/932852674 >> 172.21.15.152:0/932852674 conn(0x564fc0dd5ce0 msgr2=0x564fc0de2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.526+0000 7fadd37fe640 0 client.27604 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.527+0000 7fadfd07a740 1 -- 172.21.15.152:0/932852674 shutdown_connections 2024-09-11T22:15:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.527+0000 7fadfd07a740 1 -- 172.21.15.152:0/932852674 wait complete. 2024-09-11T22:15:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.527+0000 7fadfd07a740 20 client.27604 trim_cache size 0 max 16384 2024-09-11T22:15:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.553+0000 7fadfd07a740 1 Processor -- start 2024-09-11T22:15:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.553+0000 7fadfd07a740 1 -- start start 2024-09-11T22:15:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.554+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda010 0x564fc0e08620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.554+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda9c0 0x564fc0df54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.554+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dde710 0x564fc0df7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.554+0000 7fadfd07a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fadec1420f0 con 0x564fc0dda010 2024-09-11T22:15:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.555+0000 7fadfd07a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fadec13f9c0 con 0x564fc0dda9c0 2024-09-11T22:15:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.555+0000 7fadf3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda9c0 0x564fc0df54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.555+0000 7fadf3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda9c0 0x564fc0df54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58220/0 (socket says 172.21.15.152:58220) 2024-09-11T22:15:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.555+0000 7fadf3fff640 1 -- 172.21.15.152:0/1069061173 learned_addr learned my addr 172.21.15.152:0/1069061173 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.555+0000 7fadf37fe640 1 --2- 172.21.15.152:0/1069061173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dde710 0x564fc0df7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.555+0000 7fadfd07a740 1 -- 172.21.15.152:0/1069061173 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fadec13d830 con 0x564fc0dde710 2024-09-11T22:15:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.555+0000 7fadf3fff640 1 -- 172.21.15.152:0/1069061173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dde710 msgr2=0x564fc0df7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.555+0000 7fadf3fff640 1 --2- 172.21.15.152:0/1069061173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dde710 0x564fc0df7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.555+0000 7fadf3fff640 1 -- 172.21.15.152:0/1069061173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda010 msgr2=0x564fc0e08620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.555+0000 7fadf3fff640 1 --2- 172.21.15.152:0/1069061173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda010 0x564fc0e08620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.555+0000 7fadf3fff640 1 -- 172.21.15.152:0/1069061173 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fc0dd9b50 con 0x564fc0dda9c0 2024-09-11T22:15:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.556+0000 7fadf37fe640 1 --2- 172.21.15.152:0/1069061173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dde710 0x564fc0df7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.556+0000 7fadf3fff640 1 --2- 172.21.15.152:0/1069061173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda9c0 0x564fc0df54c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fade8005dc0 tx=0x7fade80056c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cefbb0c2a03e6dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.559+0000 7fadddffb640 1 -- 172.21.15.152:0/1069061173 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade803e040 con 0x564fc0dda9c0 2024-09-11T22:15:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.560+0000 7fadddffb640 1 -- 172.21.15.152:0/1069061173 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564fc0d4ba20 con 0x564fc0dda9c0 2024-09-11T22:15:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.560+0000 7fadddffb640 1 -- 172.21.15.152:0/1069061173 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8031810 con 0x564fc0dda9c0 2024-09-11T22:15:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.561+0000 7fadfd07a740 1 -- 172.21.15.152:0/1069061173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda9c0 msgr2=0x564fc0df54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.561+0000 7fadfd07a740 1 --2- 172.21.15.152:0/1069061173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda9c0 0x564fc0df54c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fade8005dc0 tx=0x7fade80056c0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.561+0000 7fadfd07a740 1 -- 172.21.15.152:0/1069061173 shutdown_connections 2024-09-11T22:15:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.561+0000 7fadfd07a740 1 --2- 172.21.15.152:0/1069061173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dde710 0x564fc0df7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.561+0000 7fadfd07a740 1 --2- 172.21.15.152:0/1069061173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda9c0 0x564fc0df54c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.561+0000 7fadfd07a740 1 --2- 172.21.15.152:0/1069061173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda010 0x564fc0e08620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.561+0000 7fadfd07a740 1 -- 172.21.15.152:0/1069061173 >> 172.21.15.152:0/1069061173 conn(0x564fc0dd5ce0 msgr2=0x564fc0df4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.562+0000 7fadfd07a740 1 -- 172.21.15.152:0/1069061173 shutdown_connections 2024-09-11T22:15:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.562+0000 7fadfd07a740 1 -- 172.21.15.152:0/1069061173 wait complete. 2024-09-11T22:15:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.562+0000 7fadfd07a740 1 -- start start 2024-09-11T22:15:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.562+0000 7fadfd07a740 1 Processor -- start 2024-09-11T22:15:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.563+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 0x564fc0dfe1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.563+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda9c0 0x564fc0dfe710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.563+0000 7fadfd07a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dde710 0x564fc0ddbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.563+0000 7fadfd07a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fadec13de80 con 0x564fc0dda9c0 2024-09-11T22:15:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.563+0000 7fadfd07a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fadec13f2f0 con 0x564fc0dda010 2024-09-11T22:15:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.563+0000 7fadfd07a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fadec13e550 con 0x564fc0dde710 2024-09-11T22:15:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.563+0000 7fadfd07a740 10 client.0 _ll_register_callbacks cb 0x7fade000d960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.563+0000 7fadf37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 0x564fc0dfe1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.563+0000 7fadf37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dde710 0x564fc0ddbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.563+0000 7fadf37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 0x564fc0dfe1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:58228/0 (socket says 172.21.15.152:58228) 2024-09-11T22:15:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.563+0000 7fadf37fe640 1 -- 172.21.15.152:0/3204884523 learned_addr learned my addr 172.21.15.152:0/3204884523 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.565+0000 7fadf3fff640 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda9c0 0x564fc0dfe710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.565+0000 7fadf37fe640 1 -- 172.21.15.152:0/3204884523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dde710 msgr2=0x564fc0ddbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.565+0000 7fadf37fe640 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dde710 0x564fc0ddbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.565+0000 7fadf37fe640 1 -- 172.21.15.152:0/3204884523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda9c0 msgr2=0x564fc0dfe710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.566+0000 7fadf37fe640 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda9c0 0x564fc0dfe710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.566+0000 7fadf37fe640 1 -- 172.21.15.152:0/3204884523 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fc0df64b0 con 0x564fc0dda010 2024-09-11T22:15:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.566+0000 7fadf37fe640 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 0x564fc0dfe1d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fade000d780 tx=0x7fade000d6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbb75419930b71da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.566+0000 7fadd37fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:15:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.566+0000 7fadd37fe640 1 -- 172.21.15.152:0/3204884523 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0007ef0 con 0x564fc0dda010 2024-09-11T22:15:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.566+0000 7fadd37fe640 1 -- 172.21.15.152:0/3204884523 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8658+0+0 (secure 0 0 0) 0x7fade0003730 con 0x564fc0dda010 2024-09-11T22:15:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.567+0000 7fadfd07a740 1 -- 172.21.15.152:0/3204884523 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564fc0d4ba20 con 0x564fc0dda010 2024-09-11T22:15:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.568+0000 7fadd37fe640 1 -- 172.21.15.152:0/3204884523 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fade0008090 con 0x564fc0dda010 2024-09-11T22:15:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.568+0000 7fadfd07a740 10 client.27452 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.568+0000 7fadfd07a740 1 -- 172.21.15.152:0/3204884523 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564fc0e70870 con 0x564fc0dda010 2024-09-11T22:15:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.569+0000 7fadd37fe640 1 -- 172.21.15.152:0/3204884523 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564fc0d4ba20 con 0x564fc0dda010 2024-09-11T22:15:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.569+0000 7fadd37fe640 1 -- 172.21.15.152:0/3204884523 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fade002f9f0 con 0x564fc0dda010 2024-09-11T22:15:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.569+0000 7fadfd07a740 10 client.27452 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.569+0000 7fadfd07a740 10 client.27452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.569+0000 7fadfd07a740 20 client.27452 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.570+0000 7fadfd07a740 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564fc0e70f40 0x564fc0e73360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.570+0000 7fadfd07a740 4 client.27452 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:15:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.570+0000 7fadfd07a740 1 -- 172.21.15.152:0/3204884523 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564fc0d45d70 con 0x564fc0e70f40 2024-09-11T22:15:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.570+0000 7fadf3fff640 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564fc0e70f40 0x564fc0e73360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.570+0000 7fadd37fe640 10 client.27452 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:09.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.570+0000 7fadf3fff640 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564fc0e70f40 0x564fc0e73360 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=612191b7c146b16b server_cookie=a68a0ed0497f7024 in_seq=0 out_seq=0 2024-09-11T22:15:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.712+0000 7fadd37fe640 1 -- 172.21.15.152:0/3204884523 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564fc0d45d70 con 0x564fc0e70f40 2024-09-11T22:15:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.712+0000 7fadd37fe640 10 client.27452 handle_command_reply: tid=0 2024-09-11T22:15:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 1 client.27452 shutdown 2024-09-11T22:15:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 1 -- 172.21.15.152:0/3204884523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 msgr2=0x564fc0dfe1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 0x564fc0dfe1d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fade000d780 tx=0x7fade000d6f0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 1 -- 172.21.15.152:0/3204884523 shutdown_connections 2024-09-11T22:15:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564fc0e70f40 0x564fc0e73360 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564fc0dde710 0x564fc0ddbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564fc0dda9c0 0x564fc0dfe710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 1 --2- 172.21.15.152:0/3204884523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564fc0dda010 0x564fc0dfe1d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 1 -- 172.21.15.152:0/3204884523 >> 172.21.15.152:0/3204884523 conn(0x564fc0dd5ce0 msgr2=0x564fc0de27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadd37fe640 0 client.27452 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 1 -- 172.21.15.152:0/3204884523 shutdown_connections 2024-09-11T22:15:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 1 -- 172.21.15.152:0/3204884523 wait complete. 2024-09-11T22:15:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.713+0000 7fadfd07a740 20 client.27452 trim_cache size 0 max 16384 2024-09-11T22:15:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:15:09.716 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:15:09.716 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:15:09.716 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:15:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.714+0000 7fadf907b640 1 -- 172.21.15.152:0/3095562495 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fade40a2e80 msgr2=0x7fade40a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.714+0000 7fadf907b640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fade40a2e80 0x7fade40a5340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf41382c0 tx=0x7fadf4076040 comp rx=0 tx=0).stop 2024-09-11T22:15:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.714+0000 7fadf907b640 1 -- 172.21.15.152:0/3095562495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec130980 msgr2=0x7fadec130e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.714+0000 7fadf907b640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec130980 0x7fadec130e30 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fadf4065a40 tx=0x7fadf407b530 comp rx=0 tx=0).stop 2024-09-11T22:15:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.715+0000 7fadf907b640 1 -- 172.21.15.152:0/3095562495 shutdown_connections 2024-09-11T22:15:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.715+0000 7fadf907b640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fade40a2e80 0x7fade40a5340 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.715+0000 7fadf907b640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec130980 0x7fadec130e30 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.715+0000 7fadf907b640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadec099880 0x7fadec12c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.715+0000 7fadf907b640 1 --2- 172.21.15.152:0/3095562495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadec094b70 0x7fadec12c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.715+0000 7fadf907b640 1 -- 172.21.15.152:0/3095562495 >> 172.21.15.152:0/3095562495 conn(0x7fadec00a1e0 msgr2=0x7fadec004a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.715+0000 7fadf907b640 1 -- 172.21.15.152:0/3095562495 shutdown_connections 2024-09-11T22:15:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:09.715+0000 7fadf907b640 1 -- 172.21.15.152:0/3095562495 wait complete. 2024-09-11T22:15:09.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:09 smithi152 ceph-mon[31188]: pgmap v336: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 9.9 MiB/s wr, 1.05k op/s 2024-09-11T22:15:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:09 smithi179 ceph-mon[35603]: pgmap v336: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 9.9 MiB/s wr, 1.05k op/s 2024-09-11T22:15:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 575.0 s, 2903.2 tps, lat 32.975 ms stddev 43.262 2024-09-11T22:15:09.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:09 smithi193 ceph-mon[35545]: pgmap v336: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 9.9 MiB/s wr, 1.05k op/s 2024-09-11T22:15:10.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:10 smithi152 ceph-mon[31188]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T22:15:10.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:10 smithi179 ceph-mon[35603]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T22:15:10.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:10 smithi193 ceph-mon[35545]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T22:15:11.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:11 smithi152 ceph-mon[31188]: pgmap v338: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 15 MiB/s wr, 1.56k op/s 2024-09-11T22:15:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:11 smithi179 ceph-mon[35603]: pgmap v338: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 15 MiB/s wr, 1.56k op/s 2024-09-11T22:15:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:11 smithi193 ceph-mon[35545]: pgmap v338: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 15 MiB/s wr, 1.56k op/s 2024-09-11T22:15:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:13 smithi152 ceph-mon[31188]: pgmap v339: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 15 MiB/s wr, 1.56k op/s 2024-09-11T22:15:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:13 smithi179 ceph-mon[35603]: pgmap v339: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 15 MiB/s wr, 1.56k op/s 2024-09-11T22:15:13.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:13 smithi193 ceph-mon[35545]: pgmap v339: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 15 MiB/s wr, 1.56k op/s 2024-09-11T22:15:14.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 580.0 s, 2570.8 tps, lat 40.478 ms stddev 49.471 2024-09-11T22:15:15.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:15 smithi152 ceph-mon[31188]: pgmap v340: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2024-09-11T22:15:15.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:15 smithi179 ceph-mon[35603]: pgmap v340: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2024-09-11T22:15:15.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:15 smithi193 ceph-mon[35545]: pgmap v340: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2024-09-11T22:15:17.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:17 smithi152 ceph-mon[31188]: pgmap v341: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-09-11T22:15:17.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:17 smithi179 ceph-mon[35603]: pgmap v341: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-09-11T22:15:17.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:17 smithi193 ceph-mon[35545]: pgmap v341: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-09-11T22:15:19.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:19 smithi152 ceph-mon[31188]: pgmap v342: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-09-11T22:15:19.732 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:19 smithi152 ceph-mon[31188]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T22:15:19.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:19 smithi179 ceph-mon[35603]: pgmap v342: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-09-11T22:15:19.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:19 smithi179 ceph-mon[35603]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T22:15:19.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 585.0 s, 2159.6 tps, lat 45.934 ms stddev 50.976 2024-09-11T22:15:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:19 smithi193 ceph-mon[35545]: pgmap v342: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-09-11T22:15:19.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:19 smithi193 ceph-mon[35545]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T22:15:21.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:21 smithi152 ceph-mon[31188]: pgmap v344: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.7 MiB/s wr, 719 op/s 2024-09-11T22:15:21.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:21 smithi179 ceph-mon[35603]: pgmap v344: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.7 MiB/s wr, 719 op/s 2024-09-11T22:15:21.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:21 smithi193 ceph-mon[35545]: pgmap v344: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.7 MiB/s wr, 719 op/s 2024-09-11T22:15:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.826+0000 7f22298ba640 1 -- 172.21.15.152:0/1019771967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224101370 msgr2=0x7f222410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.826+0000 7f22298ba640 1 --2- 172.21.15.152:0/1019771967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224101370 0x7f222410d8a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f221c009cd0 tx=0x7f221c02a910 comp rx=0 tx=0).stop 2024-09-11T22:15:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.826+0000 7f22298ba640 1 -- 172.21.15.152:0/1019771967 shutdown_connections 2024-09-11T22:15:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.826+0000 7f22298ba640 1 --2- 172.21.15.152:0/1019771967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224101370 0x7f222410d8a0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.826+0000 7f22298ba640 1 --2- 172.21.15.152:0/1019771967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22241009d0 0x7f2224100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.826+0000 7f22298ba640 1 --2- 172.21.15.152:0/1019771967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22241069e0 0x7f2224106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.826+0000 7f22298ba640 1 -- 172.21.15.152:0/1019771967 >> 172.21.15.152:0/1019771967 conn(0x7f22240fc6b0 msgr2=0x7f22240fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.826+0000 7f22298ba640 1 -- 172.21.15.152:0/1019771967 shutdown_connections 2024-09-11T22:15:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.826+0000 7f22298ba640 1 -- 172.21.15.152:0/1019771967 wait complete. 2024-09-11T22:15:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.826+0000 7f22298ba640 1 Processor -- start 2024-09-11T22:15:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f22298ba640 1 -- start start 2024-09-11T22:15:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f22298ba640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22241009d0 0x7f2224196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f22298ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2224101370 0x7f22241974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f22298ba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22241069e0 0x7f22241979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f22298ba640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2224110e20 con 0x7f22241069e0 2024-09-11T22:15:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f22298ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2224110ca0 con 0x7f2224101370 2024-09-11T22:15:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f22298ba640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2224110fa0 con 0x7f22241009d0 2024-09-11T22:15:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f2222ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22241009d0 0x7f2224196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f221bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2224101370 0x7f22241974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f2222ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22241009d0 0x7f2224196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:51170/0 (socket says 172.21.15.152:51170) 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f2222ffd640 1 -- 172.21.15.152:0/1552608592 learned_addr learned my addr 172.21.15.152:0/1552608592 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f22237fe640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22241069e0 0x7f22241979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f221bfff640 1 -- 172.21.15.152:0/1552608592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22241009d0 msgr2=0x7f2224196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f221bfff640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22241009d0 0x7f2224196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f221bfff640 1 -- 172.21.15.152:0/1552608592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22241069e0 msgr2=0x7f22241979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f221bfff640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22241069e0 0x7f22241979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.827+0000 7f221bfff640 1 -- 172.21.15.152:0/1552608592 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22241a67d0 con 0x7f2224101370 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.828+0000 7f2222ffd640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22241009d0 0x7f2224196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.828+0000 7f221bfff640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2224101370 0x7f22241974a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f220c00e9f0 tx=0x7f220c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.828+0000 7f22288b8640 1 -- 172.21.15.152:0/1552608592 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c00ccc0 con 0x7f2224101370 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.828+0000 7f22298ba640 1 -- 172.21.15.152:0/1552608592 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22241a6ac0 con 0x7f2224101370 2024-09-11T22:15:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.828+0000 7f22288b8640 1 -- 172.21.15.152:0/1552608592 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f220c010910 con 0x7f2224101370 2024-09-11T22:15:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.828+0000 7f22288b8640 1 -- 172.21.15.152:0/1552608592 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c018960 con 0x7f2224101370 2024-09-11T22:15:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.828+0000 7f22298ba640 1 -- 172.21.15.152:0/1552608592 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22241a7060 con 0x7f2224101370 2024-09-11T22:15:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.831+0000 7f222c65c740 1 Processor -- start 2024-09-11T22:15:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f222c65c740 1 -- start start 2024-09-11T22:15:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f222c65c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcc9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f222c65c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 0x56550fcd4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f222c65c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 0x56550fcd70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f222c65c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56550fc2e2f0 con 0x56550fcc9af0 2024-09-11T22:15:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f222c65c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56550fbd6270 con 0x56550fcd4cb0 2024-09-11T22:15:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f222c65c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56550fc2a2b0 con 0x56550fcca410 2024-09-11T22:15:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f22288b8640 1 -- 172.21.15.152:0/1552608592 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f220c010ac0 con 0x7f2224101370 2024-09-11T22:15:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f221bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 0x56550fcd70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f2222ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 0x56550fcd4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f22237fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcc9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f2222ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 0x56550fcd4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:51182/0 (socket says 172.21.15.152:51182) 2024-09-11T22:15:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f2222ffd640 1 -- 172.21.15.152:0/3148850150 learned_addr learned my addr 172.21.15.152:0/3148850150 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.832+0000 7f221bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 0x56550fcd70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:35440/0 (socket says 172.21.15.152:35440) 2024-09-11T22:15:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.833+0000 7f22237fe640 1 -- 172.21.15.152:0/3148850150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 msgr2=0x56550fcd4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.833+0000 7f22237fe640 1 --2- 172.21.15.152:0/3148850150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 0x56550fcd4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.833+0000 7f22237fe640 1 -- 172.21.15.152:0/3148850150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 msgr2=0x56550fcd70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.833+0000 7f22237fe640 1 --2- 172.21.15.152:0/3148850150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 0x56550fcd70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.833+0000 7f22237fe640 1 -- 172.21.15.152:0/3148850150 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56550fbd5340 con 0x56550fcc9af0 2024-09-11T22:15:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.833+0000 7f22237fe640 1 --2- 172.21.15.152:0/3148850150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcc9ed0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f221c02ae80 tx=0x7f221c02f320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1d75ada9bedb6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.833+0000 7f2219ffb640 1 -- 172.21.15.152:0/3148850150 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c031b80 con 0x56550fcc9af0 2024-09-11T22:15:22.836 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.833+0000 7f2219ffb640 1 -- 172.21.15.152:0/3148850150 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f221c036030 con 0x56550fcc9af0 2024-09-11T22:15:22.836 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.833+0000 7f2219ffb640 1 -- 172.21.15.152:0/3148850150 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c004040 con 0x56550fcc9af0 2024-09-11T22:15:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.834+0000 7f22288b8640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22100a2e70 0x7f22100a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.834+0000 7f22288b8640 1 -- 172.21.15.152:0/1552608592 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f220c0cf880 con 0x7f2224101370 2024-09-11T22:15:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.834+0000 7f2222ffd640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22100a2e70 0x7f22100a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.834+0000 7f222c65c740 1 -- 172.21.15.152:0/3148850150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 msgr2=0x56550fcc9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.834+0000 7f222c65c740 1 --2- 172.21.15.152:0/3148850150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcc9ed0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f221c02ae80 tx=0x7f221c02f320 comp rx=0 tx=0).stop 2024-09-11T22:15:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.835+0000 7f222c65c740 1 -- 172.21.15.152:0/3148850150 shutdown_connections 2024-09-11T22:15:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.835+0000 7f222c65c740 1 --2- 172.21.15.152:0/3148850150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 0x56550fcd70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.835+0000 7f222c65c740 1 --2- 172.21.15.152:0/3148850150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 0x56550fcd4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.835+0000 7f222c65c740 1 --2- 172.21.15.152:0/3148850150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcc9ed0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.835+0000 7f222c65c740 1 -- 172.21.15.152:0/3148850150 >> 172.21.15.152:0/3148850150 conn(0x56550fcc6060 msgr2=0x56550fcc6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.835+0000 7f222c65c740 1 -- 172.21.15.152:0/3148850150 shutdown_connections 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.835+0000 7f222c65c740 1 -- 172.21.15.152:0/3148850150 wait complete. 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.835+0000 7f2222ffd640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22100a2e70 0x7f22100a5330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x56550fcc6ec0 tx=0x7f2214005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.835+0000 7f222c65c740 1 -- start start 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f222c65c740 1 Processor -- start 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f222c65c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcd1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f222c65c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 0x56550fcd20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f222c65c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 0x56550fcd25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f222c65c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56550fcd7880 con 0x56550fcc9af0 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f222c65c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56550fbb7290 con 0x56550fcd4cb0 2024-09-11T22:15:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f222c65c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56550fcd7a00 con 0x56550fcca410 2024-09-11T22:15:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f222c65c740 10 client.0 _ll_register_callbacks cb 0x56550fbe8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f221bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 0x56550fcd20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f2222ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcd1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f221bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 0x56550fcd20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:51186/0 (socket says 172.21.15.152:51186) 2024-09-11T22:15:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f221bfff640 1 -- 172.21.15.152:0/3866649272 learned_addr learned my addr 172.21.15.152:0/3866649272 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f2222ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcd1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59468/0 (socket says 172.21.15.152:59468) 2024-09-11T22:15:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.836+0000 7f22237fe640 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 0x56550fcd25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.837+0000 7f221bfff640 1 -- 172.21.15.152:0/3866649272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 msgr2=0x56550fcd25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.837+0000 7f221bfff640 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 0x56550fcd25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.837+0000 7f221bfff640 1 -- 172.21.15.152:0/3866649272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 msgr2=0x56550fcd1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.837+0000 7f221bfff640 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcd1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.837+0000 7f221bfff640 1 -- 172.21.15.152:0/3866649272 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56550f941210 con 0x56550fcca410 2024-09-11T22:15:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.837+0000 7f22237fe640 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 0x56550fcd25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.837+0000 7f2222ffd640 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcd1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.837+0000 7f221bfff640 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 0x56550fcd20b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f220c09ba90 tx=0x7f220c010ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e31e18a20d51bfee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.837+0000 7f2202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:15:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.838+0000 7f2202ffd640 1 -- 172.21.15.152:0/3866649272 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c09b8d0 con 0x56550fcca410 2024-09-11T22:15:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.838+0000 7f2202ffd640 1 -- 172.21.15.152:0/3866649272 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f220c09b3e0 con 0x56550fcca410 2024-09-11T22:15:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f222c65c740 1 -- 172.21.15.152:0/3866649272 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f221c036030 con 0x56550fcca410 2024-09-11T22:15:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f2202ffd640 1 -- 172.21.15.152:0/3866649272 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f220c09b6f0 con 0x56550fcca410 2024-09-11T22:15:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f222c65c740 10 client.27619 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f222c65c740 1 -- 172.21.15.152:0/3866649272 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56550fa0d620 con 0x56550fcca410 2024-09-11T22:15:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f2202ffd640 1 -- 172.21.15.152:0/3866649272 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f221c036030 con 0x56550fcca410 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f2202ffd640 1 -- 172.21.15.152:0/3866649272 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f220c018c20 con 0x56550fcca410 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f222c65c740 10 client.27619 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f222c65c740 10 client.27619 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f222c65c740 20 client.27619 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f222c65c740 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56550fce4c20 0x56550fce7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f222c65c740 4 client.27619 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.839+0000 7f222c65c740 1 -- 172.21.15.152:0/3866649272 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56550fc3ba20 con 0x56550fce4c20 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.840+0000 7f2222ffd640 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56550fce4c20 0x56550fce7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.840+0000 7f2222ffd640 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56550fce4c20 0x56550fce7010 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6ad7134af13f2f5 server_cookie=45f8718a5bedcb8 in_seq=0 out_seq=0 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.840+0000 7f2202ffd640 10 client.27619 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f2202ffd640 1 -- 172.21.15.152:0/3866649272 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56550fc3ba20 con 0x56550fce4c20 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f2202ffd640 10 client.27619 handle_command_reply: tid=0 2024-09-11T22:15:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f222c65c740 1 client.27619 shutdown 2024-09-11T22:15:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f222c65c740 1 -- 172.21.15.152:0/3866649272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 msgr2=0x56550fcd20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f222c65c740 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 0x56550fcd20b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f220c09ba90 tx=0x7f220c010ef0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f222c65c740 1 -- 172.21.15.152:0/3866649272 shutdown_connections 2024-09-11T22:15:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f222c65c740 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56550fce4c20 0x56550fce7010 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f222c65c740 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcd4cb0 0x56550fcd25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f222c65c740 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcca410 0x56550fcd20b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f2202ffd640 0 client.27619 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f222c65c740 1 --2- 172.21.15.152:0/3866649272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcd1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.841+0000 7f222c65c740 1 -- 172.21.15.152:0/3866649272 >> 172.21.15.152:0/3866649272 conn(0x56550fcc6060 msgr2=0x56550fccbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.842+0000 7f222c65c740 1 -- 172.21.15.152:0/3866649272 shutdown_connections 2024-09-11T22:15:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.842+0000 7f222c65c740 1 -- 172.21.15.152:0/3866649272 wait complete. 2024-09-11T22:15:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.842+0000 7f222c65c740 20 client.27619 trim_cache size 0 max 16384 2024-09-11T22:15:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f222c65c740 1 Processor -- start 2024-09-11T22:15:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f222c65c740 1 -- start start 2024-09-11T22:15:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f222c65c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcc9af0 0x56550fccc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f222c65c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcca410 0x56550fcd2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f222c65c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcd4cb0 0x56550fcd3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f222c65c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f22241b2470 con 0x56550fcca410 2024-09-11T22:15:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f222c65c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f22241afd40 con 0x56550fcc9af0 2024-09-11T22:15:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f222c65c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f22241adbb0 con 0x56550fcd4cb0 2024-09-11T22:15:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f221bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcca410 0x56550fcd2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f22237fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcd4cb0 0x56550fcd3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f221bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcca410 0x56550fcd2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59482/0 (socket says 172.21.15.152:59482) 2024-09-11T22:15:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f2222ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcc9af0 0x56550fccc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f221bfff640 1 -- 172.21.15.152:0/920620769 learned_addr learned my addr 172.21.15.152:0/920620769 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f22237fe640 1 -- 172.21.15.152:0/920620769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcc9af0 msgr2=0x56550fccc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f22237fe640 1 --2- 172.21.15.152:0/920620769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcc9af0 0x56550fccc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f22237fe640 1 -- 172.21.15.152:0/920620769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcca410 msgr2=0x56550fcd2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f22237fe640 1 --2- 172.21.15.152:0/920620769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcca410 0x56550fcd2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f22237fe640 1 -- 172.21.15.152:0/920620769 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56550fcc5e90 con 0x56550fcd4cb0 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f221bfff640 1 --2- 172.21.15.152:0/920620769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcca410 0x56550fcd2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.861+0000 7f2222ffd640 1 --2- 172.21.15.152:0/920620769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcc9af0 0x56550fccc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.862+0000 7f22237fe640 1 --2- 172.21.15.152:0/920620769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcd4cb0 0x56550fcd3ae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f221c009cd0 tx=0x7f221c02a910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2462c5ad8fb59546 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.862+0000 7f22197fa640 1 -- 172.21.15.152:0/920620769 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c009780 con 0x56550fcd4cb0 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.862+0000 7f22197fa640 1 -- 172.21.15.152:0/920620769 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f221c054070 con 0x56550fcd4cb0 2024-09-11T22:15:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.862+0000 7f22197fa640 1 -- 172.21.15.152:0/920620769 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c031e60 con 0x56550fcd4cb0 2024-09-11T22:15:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.863+0000 7f222c65c740 1 -- 172.21.15.152:0/920620769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcd4cb0 msgr2=0x56550fcd3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.863+0000 7f222c65c740 1 --2- 172.21.15.152:0/920620769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcd4cb0 0x56550fcd3ae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f221c009cd0 tx=0x7f221c02a910 comp rx=0 tx=0).stop 2024-09-11T22:15:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.863+0000 7f222c65c740 1 -- 172.21.15.152:0/920620769 shutdown_connections 2024-09-11T22:15:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.863+0000 7f222c65c740 1 --2- 172.21.15.152:0/920620769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcd4cb0 0x56550fcd3ae0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.863+0000 7f222c65c740 1 --2- 172.21.15.152:0/920620769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcca410 0x56550fcd2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.863+0000 7f222c65c740 1 --2- 172.21.15.152:0/920620769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcc9af0 0x56550fccc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.863+0000 7f222c65c740 1 -- 172.21.15.152:0/920620769 >> 172.21.15.152:0/920620769 conn(0x56550fcc6060 msgr2=0x56550fcd33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.863+0000 7f222c65c740 1 -- 172.21.15.152:0/920620769 shutdown_connections 2024-09-11T22:15:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.863+0000 7f222c65c740 1 -- 172.21.15.152:0/920620769 wait complete. 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f222c65c740 1 -- start start 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f222c65c740 1 Processor -- start 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f222c65c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcdce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f222c65c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcca410 0x56550fcdd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f222c65c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcd4cb0 0x56550fcce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f222c65c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f22241ae200 con 0x56550fcc9af0 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f222c65c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f22241af670 con 0x56550fcca410 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f222c65c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f22241ae8d0 con 0x56550fcd4cb0 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f222c65c740 10 client.0 _ll_register_callbacks cb 0x7f220c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f2222ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcdce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f221bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcca410 0x56550fcdd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f2222ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcdce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59494/0 (socket says 172.21.15.152:59494) 2024-09-11T22:15:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f2222ffd640 1 -- 172.21.15.152:0/2627727645 learned_addr learned my addr 172.21.15.152:0/2627727645 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.864+0000 7f22237fe640 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcd4cb0 0x56550fcce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f221bfff640 1 -- 172.21.15.152:0/2627727645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcd4cb0 msgr2=0x56550fcce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f221bfff640 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcd4cb0 0x56550fcce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f221bfff640 1 -- 172.21.15.152:0/2627727645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 msgr2=0x56550fcdce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f221bfff640 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcdce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f221bfff640 1 -- 172.21.15.152:0/2627727645 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56550fcc9920 con 0x56550fcca410 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f2222ffd640 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcdce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f221bfff640 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcca410 0x56550fcdd3c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f220c0cfc80 tx=0x7f220c0cd4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dad6be31258636c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f2202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f2202ffd640 1 -- 172.21.15.152:0/2627727645 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c0b8060 con 0x56550fcca410 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f2202ffd640 1 -- 172.21.15.152:0/2627727645 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f220c09b3e0 con 0x56550fcca410 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f222c65c740 1 -- 172.21.15.152:0/2627727645 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f221c054070 con 0x56550fcca410 2024-09-11T22:15:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f2202ffd640 1 -- 172.21.15.152:0/2627727645 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f220c07f050 con 0x56550fcca410 2024-09-11T22:15:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f222c65c740 10 client.27470 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f222c65c740 1 -- 172.21.15.152:0/2627727645 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56550fcc7110 con 0x56550fcca410 2024-09-11T22:15:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f2202ffd640 1 -- 172.21.15.152:0/2627727645 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f221c054070 con 0x56550fcca410 2024-09-11T22:15:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.865+0000 7f2202ffd640 1 -- 172.21.15.152:0/2627727645 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f220c09ac50 con 0x56550fcca410 2024-09-11T22:15:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.866+0000 7f222c65c740 10 client.27470 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.866+0000 7f222c65c740 10 client.27470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.866+0000 7f222c65c740 20 client.27470 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.866+0000 7f222c65c740 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56550fd4f630 0x56550fd51a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.866+0000 7f222c65c740 4 client.27470 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:15:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.866+0000 7f222c65c740 1 -- 172.21.15.152:0/2627727645 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56550fc35d70 con 0x56550fd4f630 2024-09-11T22:15:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.866+0000 7f2222ffd640 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56550fd4f630 0x56550fd51a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.866+0000 7f2202ffd640 10 client.27470 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.866+0000 7f2222ffd640 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56550fd4f630 0x56550fd51a50 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eecb8efdb106d4db server_cookie=19eb3bfdddb2ada9 in_seq=0 out_seq=0 2024-09-11T22:15:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.914+0000 7f2202ffd640 1 -- 172.21.15.152:0/2627727645 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56550fc35d70 con 0x56550fd4f630 2024-09-11T22:15:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.914+0000 7f2202ffd640 10 client.27470 handle_command_reply: tid=0 2024-09-11T22:15:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.917+0000 7f222c65c740 1 client.27470 shutdown 2024-09-11T22:15:22.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.921+0000 7f222c65c740 1 -- 172.21.15.152:0/2627727645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcca410 msgr2=0x56550fcdd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:22.923 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.921+0000 7f222c65c740 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcca410 0x56550fcdd3c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f220c0cfc80 tx=0x7f220c0cd4a0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.923+0000 7f222c65c740 1 -- 172.21.15.152:0/2627727645 shutdown_connections 2024-09-11T22:15:22.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.923+0000 7f222c65c740 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56550fd4f630 0x56550fd51a50 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.923+0000 7f2202ffd640 0 client.27470 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:22.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.923+0000 7f222c65c740 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56550fcd4cb0 0x56550fcce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.923+0000 7f222c65c740 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56550fcca410 0x56550fcdd3c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.924 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.923+0000 7f222c65c740 1 --2- 172.21.15.152:0/2627727645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56550fcc9af0 0x56550fcdce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.923+0000 7f222c65c740 1 -- 172.21.15.152:0/2627727645 >> 172.21.15.152:0/2627727645 conn(0x56550fcc6060 msgr2=0x56550fcc51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.923+0000 7f222c65c740 1 -- 172.21.15.152:0/2627727645 shutdown_connections 2024-09-11T22:15:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.923+0000 7f222c65c740 1 -- 172.21.15.152:0/2627727645 wait complete. 2024-09-11T22:15:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:15:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:15:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:15:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:15:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.924+0000 7f222c65c740 20 client.27470 trim_cache size 0 max 16384 2024-09-11T22:15:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.927+0000 7f22298ba640 1 -- 172.21.15.152:0/1552608592 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22100a2e70 msgr2=0x7f22100a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.927+0000 7f22298ba640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22100a2e70 0x7f22100a5330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x56550fcc6ec0 tx=0x7f2214005f90 comp rx=0 tx=0).stop 2024-09-11T22:15:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.927+0000 7f22298ba640 1 -- 172.21.15.152:0/1552608592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2224101370 msgr2=0x7f22241974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.927+0000 7f22298ba640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2224101370 0x7f22241974a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f220c00e9f0 tx=0x7f220c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.927+0000 7f22298ba640 1 -- 172.21.15.152:0/1552608592 shutdown_connections 2024-09-11T22:15:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.927+0000 7f22298ba640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f22100a2e70 0x7f22100a5330 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.927+0000 7f22298ba640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22241069e0 0x7f22241979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.927+0000 7f22298ba640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2224101370 0x7f22241974a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.927+0000 7f22298ba640 1 --2- 172.21.15.152:0/1552608592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22241009d0 0x7f2224196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.927+0000 7f22298ba640 1 -- 172.21.15.152:0/1552608592 >> 172.21.15.152:0/1552608592 conn(0x7f22240fc6b0 msgr2=0x7f22240fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.928+0000 7f22298ba640 1 -- 172.21.15.152:0/1552608592 shutdown_connections 2024-09-11T22:15:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:22.928+0000 7f22298ba640 1 -- 172.21.15.152:0/1552608592 wait complete. 2024-09-11T22:15:23.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:23 smithi152 ceph-mon[31188]: pgmap v345: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.7 MiB/s wr, 719 op/s 2024-09-11T22:15:23.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:23 smithi179 ceph-mon[35603]: pgmap v345: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.7 MiB/s wr, 719 op/s 2024-09-11T22:15:23.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:23 smithi193 ceph-mon[35545]: pgmap v345: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.7 MiB/s wr, 719 op/s 2024-09-11T22:15:24.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 590.0 s, 2627.6 tps, lat 38.238 ms stddev 42.044 2024-09-11T22:15:25.322 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:15:25.667 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:15:25.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:25 smithi152 ceph-mon[31188]: pgmap v346: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.2 MiB/s wr, 681 op/s 2024-09-11T22:15:25.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:25 smithi179 ceph-mon[35603]: pgmap v346: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.2 MiB/s wr, 681 op/s 2024-09-11T22:15:25.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:25 smithi193 ceph-mon[35545]: pgmap v346: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.2 MiB/s wr, 681 op/s 2024-09-11T22:15:26.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.220+0000 7f7fa7800640 1 -- 172.21.15.152:0/1432993884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa0101410 msgr2=0x7f7fa010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:26.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.220+0000 7f7fa7800640 1 --2- 172.21.15.152:0/1432993884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa0101410 0x7f7fa010d940 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009cd0 tx=0x7f7f9802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.223+0000 7f7fa7800640 1 -- 172.21.15.152:0/1432993884 shutdown_connections 2024-09-11T22:15:26.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.223+0000 7f7fa7800640 1 --2- 172.21.15.152:0/1432993884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa0101410 0x7f7fa010d940 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.223+0000 7f7fa7800640 1 --2- 172.21.15.152:0/1432993884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa0100a70 0x7f7fa0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.223+0000 7f7fa7800640 1 --2- 172.21.15.152:0/1432993884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fa0106a70 0x7f7fa0106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.223+0000 7f7fa7800640 1 -- 172.21.15.152:0/1432993884 >> 172.21.15.152:0/1432993884 conn(0x7f7fa00fc790 msgr2=0x7f7fa00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:26.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.224+0000 7f7fa7800640 1 -- 172.21.15.152:0/1432993884 shutdown_connections 2024-09-11T22:15:26.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.224+0000 7f7fa7800640 1 -- 172.21.15.152:0/1432993884 wait complete. 2024-09-11T22:15:26.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa7800640 1 Processor -- start 2024-09-11T22:15:26.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa7800640 1 -- start start 2024-09-11T22:15:26.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa7800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa0100a70 0x7f7fa019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa7800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa0101410 0x7f7fa019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa7800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fa0106a70 0x7f7fa019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa7800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa0110e70 con 0x7f7fa0101410 2024-09-11T22:15:26.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa7800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa0110cf0 con 0x7f7fa0100a70 2024-09-11T22:15:26.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa7800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa0110ff0 con 0x7f7fa0106a70 2024-09-11T22:15:26.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa4d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa0101410 0x7f7fa019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa4d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa0101410 0x7f7fa019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40274/0 (socket says 172.21.15.152:40274) 2024-09-11T22:15:26.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa4d9b640 1 -- 172.21.15.152:0/2483599430 learned_addr learned my addr 172.21.15.152:0/2483599430 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:26.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa559c640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa0100a70 0x7f7fa019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.225+0000 7f7fa5d9d640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fa0106a70 0x7f7fa019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7fa559c640 1 -- 172.21.15.152:0/2483599430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fa0106a70 msgr2=0x7f7fa019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:26.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7fa559c640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fa0106a70 0x7f7fa019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7fa559c640 1 -- 172.21.15.152:0/2483599430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa0101410 msgr2=0x7f7fa019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:26.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7fa559c640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa0101410 0x7f7fa019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7fa559c640 1 -- 172.21.15.152:0/2483599430 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa019f560 con 0x7f7fa0100a70 2024-09-11T22:15:26.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7fa4d9b640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa0101410 0x7f7fa019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:26.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7fa559c640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa0100a70 0x7f7fa019a5b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00d6d0 tx=0x7f7f9c00db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:26.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7f967fc640 1 -- 172.21.15.152:0/2483599430 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c017070 con 0x7f7fa0100a70 2024-09-11T22:15:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7f967fc640 1 -- 172.21.15.152:0/2483599430 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f9c009820 con 0x7f7fa0100a70 2024-09-11T22:15:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7f967fc640 1 -- 172.21.15.152:0/2483599430 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c004d00 con 0x7f7fa0100a70 2024-09-11T22:15:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7fa7800640 1 -- 172.21.15.152:0/2483599430 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa019f850 con 0x7f7fa0100a70 2024-09-11T22:15:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.226+0000 7f7fa7800640 1 -- 172.21.15.152:0/2483599430 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa01a7130 con 0x7f7fa0100a70 2024-09-11T22:15:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.229+0000 7f7f967fc640 1 -- 172.21.15.152:0/2483599430 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f7f9c0099d0 con 0x7f7fa0100a70 2024-09-11T22:15:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.229+0000 7f7fa9bd9740 1 Processor -- start 2024-09-11T22:15:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.229+0000 7f7fa9bd9740 1 -- start start 2024-09-11T22:15:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cd1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cdc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cdea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557e15c372e0 con 0x557e15cd14a0 2024-09-11T22:15:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557e15bdece0 con 0x557e15cdc680 2024-09-11T22:15:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557e15c332a0 con 0x557e15cd1dc0 2024-09-11T22:15:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa4d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cdea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa4d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cdea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:36808/0 (socket says 172.21.15.152:36808) 2024-09-11T22:15:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa4d9b640 1 -- 172.21.15.152:0/1558801385 learned_addr learned my addr 172.21.15.152:0/1558801385 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa5d9d640 1 --2- 172.21.15.152:0/1558801385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cd1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7f967fc640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7f8c0a2cf0 0x7f7f8c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa4d9b640 1 -- 172.21.15.152:0/1558801385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 msgr2=0x557e15cdc140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:15:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7f967fc640 1 -- 172.21.15.152:0/2483599430 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f7f9c0ced90 con 0x7f7fa0100a70 2024-09-11T22:15:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa4d9b640 1 --2- 172.21.15.152:0/1558801385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cdc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa4d9b640 1 -- 172.21.15.152:0/1558801385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 msgr2=0x557e15cd1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa4d9b640 1 --2- 172.21.15.152:0/1558801385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cd1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa4d9b640 1 -- 172.21.15.152:0/1558801385 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e15bc3440 con 0x557e15cdc680 2024-09-11T22:15:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.230+0000 7f7fa5d9d640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7f8c0a2cf0 0x7f7f8c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.231+0000 7f7fa4d9b640 1 --2- 172.21.15.152:0/1558801385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cdea70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f900115f0 tx=0x7f7f90011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1004741ce8e21d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.231+0000 7f7f8b7fe640 1 -- 172.21.15.152:0/1558801385 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9001e070 con 0x557e15cdc680 2024-09-11T22:15:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.231+0000 7f7f8b7fe640 1 -- 172.21.15.152:0/1558801385 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f9000f660 con 0x557e15cdc680 2024-09-11T22:15:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.231+0000 7f7f8b7fe640 1 -- 172.21.15.152:0/1558801385 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90003850 con 0x557e15cdc680 2024-09-11T22:15:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.232+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1558801385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 msgr2=0x557e15cdea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.232+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/1558801385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cdea70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f900115f0 tx=0x7f7f90011ab0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.232+0000 7f7fa5d9d640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7f8c0a2cf0 0x7f7f8c0a51b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7f98005e30 tx=0x7f7f98041040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.232+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1558801385 shutdown_connections 2024-09-11T22:15:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.232+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/1558801385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cdea70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.232+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/1558801385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cdc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.232+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/1558801385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cd1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.232+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1558801385 >> 172.21.15.152:0/1558801385 conn(0x557e15ccda30 msgr2=0x557e15ccde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.233+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1558801385 shutdown_connections 2024-09-11T22:15:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.233+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1558801385 wait complete. 2024-09-11T22:15:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.233+0000 7f7fa9bd9740 1 -- start start 2024-09-11T22:15:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.233+0000 7f7fa9bd9740 1 Processor -- start 2024-09-11T22:15:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.234+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cdc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.234+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.234+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.234+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557e15cdf250 con 0x557e15cd14a0 2024-09-11T22:15:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.234+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557e15bf2050 con 0x557e15cdc680 2024-09-11T22:15:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.234+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557e15cdf3d0 con 0x557e15cd1dc0 2024-09-11T22:15:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.234+0000 7f7fa9bd9740 10 client.0 _ll_register_callbacks cb 0x557e15c32160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.235+0000 7f7fa5d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.235+0000 7f7fa4d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.235+0000 7f7fa5d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:36818/0 (socket says 172.21.15.152:36818) 2024-09-11T22:15:26.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.235+0000 7f7fa5d9d640 1 -- 172.21.15.152:0/3042789355 learned_addr learned my addr 172.21.15.152:0/3042789355 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:26.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.235+0000 7f7fa559c640 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cdc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.235+0000 7f7fa5d9d640 1 -- 172.21.15.152:0/3042789355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 msgr2=0x557e15cd92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:26.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.235+0000 7f7fa5d9d640 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.235+0000 7f7fa5d9d640 1 -- 172.21.15.152:0/3042789355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 msgr2=0x557e15cdc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.235+0000 7f7fa5d9d640 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cdc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.235+0000 7f7fa5d9d640 1 -- 172.21.15.152:0/3042789355 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e159a83c0 con 0x557e15cdc680 2024-09-11T22:15:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.236+0000 7f7fa5d9d640 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd9880 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f98035000 tx=0x7f7f980095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=972e82a88052721 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.236+0000 7f7f88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:15:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.236+0000 7f7f88ff9640 1 -- 172.21.15.152:0/3042789355 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f980305a0 con 0x557e15cdc680 2024-09-11T22:15:26.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.236+0000 7f7f88ff9640 1 -- 172.21.15.152:0/3042789355 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f7f98030740 con 0x557e15cdc680 2024-09-11T22:15:26.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.236+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3042789355 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f9000f660 con 0x557e15cdc680 2024-09-11T22:15:26.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.237+0000 7f7f88ff9640 1 -- 172.21.15.152:0/3042789355 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7f98030940 con 0x557e15cdc680 2024-09-11T22:15:26.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.237+0000 7f7fa9bd9740 10 client.27482 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:26.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.237+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3042789355 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557e15ceacb0 con 0x557e15cdc680 2024-09-11T22:15:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.237+0000 7f7f88ff9640 1 -- 172.21.15.152:0/3042789355 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f9000f660 con 0x557e15cdc680 2024-09-11T22:15:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.237+0000 7f7f88ff9640 1 -- 172.21.15.152:0/3042789355 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7f98030070 con 0x557e15cdc680 2024-09-11T22:15:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.237+0000 7f7fa9bd9740 10 client.27482 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.237+0000 7f7fa9bd9740 10 client.27482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.238+0000 7f7fa9bd9740 20 client.27482 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.238+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557e15cec170 0x557e15cee560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.238+0000 7f7fa9bd9740 4 client.27482 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.238+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3042789355 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e15c44850 con 0x557e15cec170 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.238+0000 7f7fa559c640 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557e15cec170 0x557e15cee560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.238+0000 7f7f88ff9640 10 client.27482 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.238+0000 7f7fa559c640 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557e15cec170 0x557e15cee560 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e30c6a02fbd9e8e6 server_cookie=2b37f70821972ff1 in_seq=0 out_seq=0 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7f88ff9640 1 -- 172.21.15.152:0/3042789355 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e15c44850 con 0x557e15cec170 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7f88ff9640 10 client.27482 handle_command_reply: tid=0 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7fa9bd9740 1 client.27482 shutdown 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3042789355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 msgr2=0x557e15cd9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd9880 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f98035000 tx=0x7f7f980095c0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3042789355 shutdown_connections 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557e15cec170 0x557e15cee560 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd9880 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7f88ff9640 0 client.27482 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/3042789355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cdc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.239+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3042789355 >> 172.21.15.152:0/3042789355 conn(0x557e15ccda30 msgr2=0x557e15cd3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.240+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3042789355 shutdown_connections 2024-09-11T22:15:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.240+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3042789355 wait complete. 2024-09-11T22:15:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.240+0000 7f7fa9bd9740 20 client.27482 trim_cache size 0 max 16384 2024-09-11T22:15:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa9bd9740 1 Processor -- start 2024-09-11T22:15:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa9bd9740 1 -- start start 2024-09-11T22:15:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15ce84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cf3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01ae1e0 con 0x557e15cd14a0 2024-09-11T22:15:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01abab0 con 0x557e15cdc680 2024-09-11T22:15:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01a9960 con 0x557e15cd1dc0 2024-09-11T22:15:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa559c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15ce84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa5d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cf3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa559c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15ce84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40308/0 (socket says 172.21.15.152:40308) 2024-09-11T22:15:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa559c640 1 -- 172.21.15.152:0/3483889590 learned_addr learned my addr 172.21.15.152:0/3483889590 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.264+0000 7f7fa4d9b640 1 --2- 172.21.15.152:0/3483889590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.265+0000 7f7fa4d9b640 1 -- 172.21.15.152:0/3483889590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 msgr2=0x557e15cf3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.265+0000 7f7fa4d9b640 1 --2- 172.21.15.152:0/3483889590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cf3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.265+0000 7f7fa4d9b640 1 -- 172.21.15.152:0/3483889590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 msgr2=0x557e15ce84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.265+0000 7f7fa4d9b640 1 --2- 172.21.15.152:0/3483889590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15ce84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.265+0000 7f7fa4d9b640 1 -- 172.21.15.152:0/3483889590 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e15cd82b0 con 0x557e15cd1dc0 2024-09-11T22:15:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.265+0000 7f7fa4d9b640 1 --2- 172.21.15.152:0/3483889590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd40e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f900115c0 tx=0x7f7f90009530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c613be555c315c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.265+0000 7f7f8affd640 1 -- 172.21.15.152:0/3483889590 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90025b90 con 0x557e15cd1dc0 2024-09-11T22:15:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.265+0000 7f7f8affd640 1 -- 172.21.15.152:0/3483889590 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f90029030 con 0x557e15cd1dc0 2024-09-11T22:15:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.265+0000 7f7f8affd640 1 -- 172.21.15.152:0/3483889590 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000fc30 con 0x557e15cd1dc0 2024-09-11T22:15:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.266+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3483889590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 msgr2=0x557e15cd40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.266+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/3483889590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd40e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f900115c0 tx=0x7f7f90009530 comp rx=0 tx=0).stop 2024-09-11T22:15:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.266+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3483889590 shutdown_connections 2024-09-11T22:15:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.266+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/3483889590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cf3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.266+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/3483889590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd40e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.266+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/3483889590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15ce84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.266+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3483889590 >> 172.21.15.152:0/3483889590 conn(0x557e15ccda30 msgr2=0x557e15cdb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.267+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3483889590 shutdown_connections 2024-09-11T22:15:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.267+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/3483889590 wait complete. 2024-09-11T22:15:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.267+0000 7f7fa9bd9740 1 -- start start 2024-09-11T22:15:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.267+0000 7f7fa9bd9740 1 Processor -- start 2024-09-11T22:15:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cd6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa9bd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01a9fb0 con 0x557e15cd14a0 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01ab3e0 con 0x557e15cdc680 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa9bd9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01aa640 con 0x557e15cd1dc0 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa9bd9740 10 client.0 _ll_register_callbacks cb 0x7f7f90005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa5d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa5d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:36844/0 (socket says 172.21.15.152:36844) 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa5d9d640 1 -- 172.21.15.152:0/1694448553 learned_addr learned my addr 172.21.15.152:0/1694448553 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa559c640 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cd6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa4d9b640 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa5d9d640 1 -- 172.21.15.152:0/1694448553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 msgr2=0x557e15cd6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa5d9d640 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa5d9d640 1 -- 172.21.15.152:0/1694448553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 msgr2=0x557e15cd6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa5d9d640 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cd6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.268+0000 7f7fa5d9d640 1 -- 172.21.15.152:0/1694448553 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e15d55d60 con 0x557e15cdc680 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.269+0000 7f7fa5d9d640 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd6dd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7f9803ee70 tx=0x7f7f98031800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aeecfdc9d67a12b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.269+0000 7f7f88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.269+0000 7f7f88ff9640 1 -- 172.21.15.152:0/1694448553 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98030760 con 0x557e15cdc680 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.269+0000 7f7f88ff9640 1 -- 172.21.15.152:0/1694448553 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f7f98030ae0 con 0x557e15cdc680 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.269+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1694448553 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f90029030 con 0x557e15cdc680 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.269+0000 7f7f88ff9640 1 -- 172.21.15.152:0/1694448553 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7f9806a050 con 0x557e15cdc680 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.269+0000 7f7fa9bd9740 10 client.27488 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.269+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1694448553 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557e15d57050 con 0x557e15cdc680 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.269+0000 7f7f88ff9640 1 -- 172.21.15.152:0/1694448553 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f90029030 con 0x557e15cdc680 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.270+0000 7f7f88ff9640 1 -- 172.21.15.152:0/1694448553 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7f9805c570 con 0x557e15cdc680 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.270+0000 7f7fa9bd9740 10 client.27488 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.270+0000 7f7fa9bd9740 10 client.27488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:26.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.270+0000 7f7fa9bd9740 20 client.27488 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:26.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.270+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557e15d577f0 0x557e15d59c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:26.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.270+0000 7f7fa9bd9740 4 client.27488 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:15:26.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.270+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1694448553 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557e15c3ed60 con 0x557e15d577f0 2024-09-11T22:15:26.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.270+0000 7f7fa559c640 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557e15d577f0 0x557e15d59c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.271+0000 7f7fa559c640 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557e15d577f0 0x557e15d59c10 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f04845ea70aefdf server_cookie=2e28806b116c9293 in_seq=0 out_seq=0 2024-09-11T22:15:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.271+0000 7f7f88ff9640 10 client.27488 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.271+0000 7f7f88ff9640 1 -- 172.21.15.152:0/1694448553 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557e15c3ed60 con 0x557e15d577f0 2024-09-11T22:15:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.271+0000 7f7f88ff9640 10 client.27488 handle_command_reply: tid=0 2024-09-11T22:15:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.271+0000 7f7fa9bd9740 1 client.27488 shutdown 2024-09-11T22:15:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.271+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1694448553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 msgr2=0x557e15cd6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.271+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd6dd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7f9803ee70 tx=0x7f7f98031800 comp rx=0 tx=0).stop 2024-09-11T22:15:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.272+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1694448553 shutdown_connections 2024-09-11T22:15:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.272+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557e15d577f0 0x557e15d59c10 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.272+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557e15cdc680 0x557e15cd6dd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.272+0000 7f7f88ff9640 0 client.27488 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.272+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e15cd1dc0 0x557e15cd6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.272+0000 7f7fa9bd9740 1 --2- 172.21.15.152:0/1694448553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e15cd14a0 0x557e15cd6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.272+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1694448553 >> 172.21.15.152:0/1694448553 conn(0x557e15ccda30 msgr2=0x557e15ccc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.272+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1694448553 shutdown_connections 2024-09-11T22:15:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.272+0000 7f7fa9bd9740 1 -- 172.21.15.152:0/1694448553 wait complete. 2024-09-11T22:15:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.273+0000 7f7fa9bd9740 20 client.27488 trim_cache size 0 max 16384 2024-09-11T22:15:26.276 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:15:26.276 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:15:26.277 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:15:26.277 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:15:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 -- 172.21.15.152:0/2483599430 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7f8c0a2cf0 msgr2=0x7f7f8c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7f8c0a2cf0 0x7f7f8c0a51b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7f98005e30 tx=0x7f7f98041040 comp rx=0 tx=0).stop 2024-09-11T22:15:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 -- 172.21.15.152:0/2483599430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa0100a70 msgr2=0x7f7fa019a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa0100a70 0x7f7fa019a5b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00d6d0 tx=0x7f7f9c00db90 comp rx=0 tx=0).stop 2024-09-11T22:15:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 -- 172.21.15.152:0/2483599430 shutdown_connections 2024-09-11T22:15:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7f8c0a2cf0 0x7f7f8c0a51b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7fa0106a70 0x7f7fa019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa0101410 0x7f7fa019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 --2- 172.21.15.152:0/2483599430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa0100a70 0x7f7fa019a5b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 -- 172.21.15.152:0/2483599430 >> 172.21.15.152:0/2483599430 conn(0x7f7fa00fc790 msgr2=0x7f7fa010c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 -- 172.21.15.152:0/2483599430 shutdown_connections 2024-09-11T22:15:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:26.274+0000 7f7fa7800640 1 -- 172.21.15.152:0/2483599430 wait complete. 2024-09-11T22:15:27.435 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:15:27.436 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:15:27.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:27 smithi152 ceph-mon[31188]: pgmap v347: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 755 op/s 2024-09-11T22:15:27.792 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:15:27.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:27 smithi179 ceph-mon[35603]: pgmap v347: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 755 op/s 2024-09-11T22:15:27.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:27 smithi193 ceph-mon[35545]: pgmap v347: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 755 op/s 2024-09-11T22:15:28.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.529+0000 7fae3ad4e640 1 -- 172.21.15.152:0/784041469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae34108450 msgr2=0x7fae34108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:28.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.529+0000 7fae3ad4e640 1 --2- 172.21.15.152:0/784041469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae34108450 0x7fae34108830 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fae24009900 tx=0x7fae2402a410 comp rx=0 tx=0).stop 2024-09-11T22:15:28.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.529+0000 7fae3ad4e640 1 -- 172.21.15.152:0/784041469 shutdown_connections 2024-09-11T22:15:28.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.529+0000 7fae3ad4e640 1 --2- 172.21.15.152:0/784041469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae3410d530 0x7fae341150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:28.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.529+0000 7fae3ad4e640 1 --2- 172.21.15.152:0/784041469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae34108e00 0x7fae3410ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:28.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.529+0000 7fae3ad4e640 1 --2- 172.21.15.152:0/784041469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae34108450 0x7fae34108830 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:28.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.529+0000 7fae3ad4e640 1 -- 172.21.15.152:0/784041469 >> 172.21.15.152:0/784041469 conn(0x7fae34077ba0 msgr2=0x7fae34079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:28.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.529+0000 7fae3ad4e640 1 -- 172.21.15.152:0/784041469 shutdown_connections 2024-09-11T22:15:28.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.529+0000 7fae3ad4e640 1 -- 172.21.15.152:0/784041469 wait complete. 2024-09-11T22:15:28.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae3ad4e640 1 Processor -- start 2024-09-11T22:15:28.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae3ad4e640 1 -- start start 2024-09-11T22:15:28.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae3ad4e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae34108450 0x7fae341a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:28.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae3ad4e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae34108e00 0x7fae341a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:28.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae3ad4e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae3410d530 0x7fae3419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:28.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae38aea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae34108450 0x7fae341a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:28.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae3ad4e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fae341185b0 con 0x7fae34108450 2024-09-11T22:15:28.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae3ad4e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fae34118430 con 0x7fae34108e00 2024-09-11T22:15:28.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae3ad4e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fae34118730 con 0x7fae3410d530 2024-09-11T22:15:28.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae38aea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae34108450 0x7fae341a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40326/0 (socket says 172.21.15.152:40326) 2024-09-11T22:15:28.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae38aea640 1 -- 172.21.15.152:0/91067991 learned_addr learned my addr 172.21.15.152:0/91067991 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:28.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.530+0000 7fae33fff640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae34108e00 0x7fae341a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:28.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.531+0000 7fae392eb640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae3410d530 0x7fae3419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:28.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.531+0000 7fae33fff640 1 -- 172.21.15.152:0/91067991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae3410d530 msgr2=0x7fae3419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:28.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.531+0000 7fae33fff640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae3410d530 0x7fae3419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:28.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.531+0000 7fae33fff640 1 -- 172.21.15.152:0/91067991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae34108450 msgr2=0x7fae341a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:28.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.531+0000 7fae33fff640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae34108450 0x7fae341a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:28.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.531+0000 7fae33fff640 1 -- 172.21.15.152:0/91067991 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3419ef90 con 0x7fae34108e00 2024-09-11T22:15:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.531+0000 7fae392eb640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae3410d530 0x7fae3419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.531+0000 7fae33fff640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae34108e00 0x7fae341a4be0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fae2800e9f0 tx=0x7fae2800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.531+0000 7fae31ffb640 1 -- 172.21.15.152:0/91067991 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2800cd80 con 0x7fae34108e00 2024-09-11T22:15:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.531+0000 7fae31ffb640 1 -- 172.21.15.152:0/91067991 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae280035f0 con 0x7fae34108e00 2024-09-11T22:15:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.531+0000 7fae3ad4e640 1 -- 172.21.15.152:0/91067991 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3419f280 con 0x7fae34108e00 2024-09-11T22:15:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.532+0000 7fae3ad4e640 1 -- 172.21.15.152:0/91067991 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae341ab570 con 0x7fae34108e00 2024-09-11T22:15:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.532+0000 7fae31ffb640 1 -- 172.21.15.152:0/91067991 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28010690 con 0x7fae34108e00 2024-09-11T22:15:28.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.535+0000 7fae3ad4e640 1 -- 172.21.15.152:0/91067991 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae34108830 con 0x7fae34108e00 2024-09-11T22:15:28.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.536+0000 7fae31ffb640 1 -- 172.21.15.152:0/91067991 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fae28003b30 con 0x7fae34108e00 2024-09-11T22:15:28.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.537+0000 7fae31ffb640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fae1c0a2df0 0x7fae1c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:28.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.537+0000 7fae31ffb640 1 -- 172.21.15.152:0/91067991 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7fae280cf820 con 0x7fae34108e00 2024-09-11T22:15:28.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.537+0000 7fae38aea640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fae1c0a2df0 0x7fae1c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:28.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.537+0000 7fae38aea640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fae1c0a2df0 0x7fae1c0a52b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae240096c0 tx=0x7fae240046c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:28.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.541+0000 7fae31ffb640 1 -- 172.21.15.152:0/91067991 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae2809c380 con 0x7fae34108e00 2024-09-11T22:15:28.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.863+0000 7fae3ad4e640 1 -- 172.21.15.152:0/91067991 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae3419fd90 con 0x7fae34108e00 2024-09-11T22:15:28.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.866+0000 7fae31ffb640 1 -- 172.21.15.152:0/91067991 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7fae2809bc80 con 0x7fae34108e00 2024-09-11T22:15:28.867 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:15:28.867 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:15:28.867 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:15:28.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.869+0000 7fae3ad4e640 1 -- 172.21.15.152:0/91067991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fae1c0a2df0 msgr2=0x7fae1c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:28.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.870+0000 7fae3ad4e640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fae1c0a2df0 0x7fae1c0a52b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae240096c0 tx=0x7fae240046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:28.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.870+0000 7fae3ad4e640 1 -- 172.21.15.152:0/91067991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae34108e00 msgr2=0x7fae341a4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:28.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.870+0000 7fae3ad4e640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae34108e00 0x7fae341a4be0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fae2800e9f0 tx=0x7fae2800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:15:28.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.872+0000 7fae3ad4e640 1 -- 172.21.15.152:0/91067991 shutdown_connections 2024-09-11T22:15:28.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.872+0000 7fae3ad4e640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fae1c0a2df0 0x7fae1c0a52b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:28.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.872+0000 7fae3ad4e640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae3410d530 0x7fae3419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:28.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.872+0000 7fae3ad4e640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae34108e00 0x7fae341a4be0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:28.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.872+0000 7fae3ad4e640 1 --2- 172.21.15.152:0/91067991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae34108450 0x7fae341a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:28.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.872+0000 7fae3ad4e640 1 -- 172.21.15.152:0/91067991 >> 172.21.15.152:0/91067991 conn(0x7fae34077ba0 msgr2=0x7fae34078e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:28.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.874+0000 7fae3ad4e640 1 -- 172.21.15.152:0/91067991 shutdown_connections 2024-09-11T22:15:28.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:28.874+0000 7fae3ad4e640 1 -- 172.21.15.152:0/91067991 wait complete. 2024-09-11T22:15:29.688 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:29 smithi152 ceph-mon[31188]: pgmap v348: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 755 op/s 2024-09-11T22:15:29.688 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:29 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/91067991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:15:29.740 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:15:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:29 smithi179 ceph-mon[35603]: pgmap v348: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 755 op/s 2024-09-11T22:15:29.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:29 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/91067991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:15:29.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 595.0 s, 1848.8 tps, lat 48.657 ms stddev 67.198 2024-09-11T22:15:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:29 smithi193 ceph-mon[35545]: pgmap v348: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 755 op/s 2024-09-11T22:15:29.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:29 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/91067991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:15:30.061 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:15:30.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.625+0000 7f96230fa640 1 -- 172.21.15.152:0/3414006620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c102ef0 msgr2=0x7f961c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:30.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.625+0000 7f96230fa640 1 --2- 172.21.15.152:0/3414006620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c102ef0 0x7f961c10da40 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f9614009ca0 tx=0x7f961402a950 comp rx=0 tx=0).stop 2024-09-11T22:15:30.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.625+0000 7f96230fa640 1 -- 172.21.15.152:0/3414006620 shutdown_connections 2024-09-11T22:15:30.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.625+0000 7f96230fa640 1 --2- 172.21.15.152:0/3414006620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c102ef0 0x7f961c10da40 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.625+0000 7f96230fa640 1 --2- 172.21.15.152:0/3414006620 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f961c102570 0x7f961c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.625+0000 7f96230fa640 1 --2- 172.21.15.152:0/3414006620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f961c100e20 0x7f961c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.625+0000 7f96230fa640 1 -- 172.21.15.152:0/3414006620 >> 172.21.15.152:0/3414006620 conn(0x7f961c0fc7d0 msgr2=0x7f961c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:30.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.625+0000 7f96230fa640 1 -- 172.21.15.152:0/3414006620 shutdown_connections 2024-09-11T22:15:30.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.625+0000 7f96230fa640 1 -- 172.21.15.152:0/3414006620 wait complete. 2024-09-11T22:15:30.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.626+0000 7f96230fa640 1 Processor -- start 2024-09-11T22:15:30.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.626+0000 7f96230fa640 1 -- start start 2024-09-11T22:15:30.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.626+0000 7f96230fa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f961c100e20 0x7f961c19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.626+0000 7f96230fa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c102570 0x7f961c19d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.626+0000 7f96230fa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f961c102ef0 0x7f961c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.626+0000 7f96230fa640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f961c110f80 con 0x7f961c102570 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.626+0000 7f96230fa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f961c110e00 con 0x7f961c102ef0 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.626+0000 7f96230fa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f961c111100 con 0x7f961c100e20 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f961bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c102570 0x7f961c19d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f961bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c102570 0x7f961c19d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40346/0 (socket says 172.21.15.152:40346) 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f961bfff640 1 -- 172.21.15.152:0/1535207560 learned_addr learned my addr 172.21.15.152:0/1535207560 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f9621697640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f961c102ef0 0x7f961c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f9620e96640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f961c100e20 0x7f961c19d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f961bfff640 1 -- 172.21.15.152:0/1535207560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f961c100e20 msgr2=0x7f961c19d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f961bfff640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f961c100e20 0x7f961c19d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f961bfff640 1 -- 172.21.15.152:0/1535207560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f961c102ef0 msgr2=0x7f961c198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f961bfff640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f961c102ef0 0x7f961c198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f961bfff640 1 -- 172.21.15.152:0/1535207560 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c198e90 con 0x7f961c102570 2024-09-11T22:15:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f9621697640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f961c102ef0 0x7f961c198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f961bfff640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c102570 0x7f961c19d5f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f960800d770 tx=0x7f960800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f9619ffb640 1 -- 172.21.15.152:0/1535207560 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608017070 con 0x7f961c102570 2024-09-11T22:15:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f9619ffb640 1 -- 172.21.15.152:0/1535207560 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9608005500 con 0x7f961c102570 2024-09-11T22:15:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f96230fa640 1 -- 172.21.15.152:0/1535207560 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961c199120 con 0x7f961c102570 2024-09-11T22:15:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.627+0000 7f9619ffb640 1 -- 172.21.15.152:0/1535207560 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608004e00 con 0x7f961c102570 2024-09-11T22:15:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.628+0000 7f96230fa640 1 -- 172.21.15.152:0/1535207560 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f961c111700 con 0x7f961c102570 2024-09-11T22:15:30.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.631+0000 7f96254d3740 1 Processor -- start 2024-09-11T22:15:30.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.631+0000 7f96254d3740 1 -- start start 2024-09-11T22:15:30.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.631+0000 7f96254d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 0x5574daa24090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.631+0000 7f96254d3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa245d0 0x5574daa24a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.631+0000 7f96254d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa37b80 0x5574daa39f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.631+0000 7f96254d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5574da98a2f0 con 0x5574daa37b80 2024-09-11T22:15:30.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.631+0000 7f96254d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5574da931cf0 con 0x5574daa25b40 2024-09-11T22:15:30.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.631+0000 7f96254d3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5574da9862b0 con 0x5574daa245d0 2024-09-11T22:15:30.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.631+0000 7f9621697640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 0x5574daa24090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.632+0000 7f9621697640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 0x5574daa24090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:36896/0 (socket says 172.21.15.152:36896) 2024-09-11T22:15:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.632+0000 7f9621697640 1 -- 172.21.15.152:0/3628355666 learned_addr learned my addr 172.21.15.152:0/3628355666 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.632+0000 7f9620e96640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa245d0 0x5574daa24a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.632+0000 7f9621697640 1 -- 172.21.15.152:0/3628355666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa245d0 msgr2=0x5574daa24a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.632+0000 7f9621697640 1 --2- 172.21.15.152:0/3628355666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa245d0 0x5574daa24a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.632+0000 7f9621697640 1 -- 172.21.15.152:0/3628355666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa37b80 msgr2=0x5574daa39f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:15:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.632+0000 7f9621697640 1 --2- 172.21.15.152:0/3628355666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa37b80 0x5574daa39f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.632+0000 7f9621697640 1 -- 172.21.15.152:0/3628355666 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574da9163a0 con 0x5574daa25b40 2024-09-11T22:15:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.632+0000 7f9621697640 1 --2- 172.21.15.152:0/3628355666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 0x5574daa24090 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9614009ca0 tx=0x7f9614005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f9db715584ebea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.633+0000 7f9606ffd640 1 -- 172.21.15.152:0/3628355666 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614048070 con 0x5574daa25b40 2024-09-11T22:15:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.633+0000 7f9606ffd640 1 -- 172.21.15.152:0/3628355666 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9614003970 con 0x5574daa25b40 2024-09-11T22:15:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.633+0000 7f9606ffd640 1 -- 172.21.15.152:0/3628355666 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614034040 con 0x5574daa25b40 2024-09-11T22:15:30.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.634+0000 7f96254d3740 1 -- 172.21.15.152:0/3628355666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 msgr2=0x5574daa24090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.634+0000 7f96254d3740 1 --2- 172.21.15.152:0/3628355666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 0x5574daa24090 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9614009ca0 tx=0x7f9614005ef0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.634+0000 7f96254d3740 1 -- 172.21.15.152:0/3628355666 shutdown_connections 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.634+0000 7f96254d3740 1 --2- 172.21.15.152:0/3628355666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa37b80 0x5574daa39f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.634+0000 7f96254d3740 1 --2- 172.21.15.152:0/3628355666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa245d0 0x5574daa24a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.634+0000 7f96254d3740 1 --2- 172.21.15.152:0/3628355666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 0x5574daa24090 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.634+0000 7f96254d3740 1 -- 172.21.15.152:0/3628355666 >> 172.21.15.152:0/3628355666 conn(0x5574da9ed310 msgr2=0x5574daa20c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.634+0000 7f9619ffb640 1 -- 172.21.15.152:0/1535207560 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9608004fa0 con 0x7f961c102570 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.634+0000 7f96254d3740 1 -- 172.21.15.152:0/3628355666 shutdown_connections 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.634+0000 7f96254d3740 1 -- 172.21.15.152:0/3628355666 wait complete. 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.634+0000 7f96254d3740 1 -- start start 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f96254d3740 1 Processor -- start 2024-09-11T22:15:30.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f9619ffb640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f960c0a2c00 0x7f960c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f96254d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa34980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f96254d3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa25b40 0x5574daa34ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f96254d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa35400 0x5574daa43d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f96254d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5574daa3a820 con 0x5574daa245d0 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f96254d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5574da945060 con 0x5574daa35400 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f96254d3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5574daa3a9a0 con 0x5574daa25b40 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f96254d3740 10 client.0 _ll_register_callbacks cb 0x5574da6988c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f9619ffb640 1 -- 172.21.15.152:0/1535207560 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f96080cee80 con 0x7f961c102570 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f9621697640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f960c0a2c00 0x7f960c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f9620e96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa34980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f9620e96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa34980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40362/0 (socket says 172.21.15.152:40362) 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f9620e96640 1 -- 172.21.15.152:0/2102043975 learned_addr learned my addr 172.21.15.152:0/2102043975 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:30.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f961bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa25b40 0x5574daa34ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.635+0000 7f9621697640 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa35400 0x5574daa43d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.636+0000 7f9620e96640 1 -- 172.21.15.152:0/2102043975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa25b40 msgr2=0x5574daa34ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.636+0000 7f9620e96640 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa25b40 0x5574daa34ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.636+0000 7f9620e96640 1 -- 172.21.15.152:0/2102043975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa35400 msgr2=0x5574daa43d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.636+0000 7f9620e96640 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa35400 0x5574daa43d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.636+0000 7f9620e96640 1 -- 172.21.15.152:0/2102043975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574da6fb3c0 con 0x5574daa245d0 2024-09-11T22:15:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.636+0000 7f9620e96640 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa34980 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9610012700 tx=0x7f9610012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16daa8ecffa6749a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.636+0000 7f9621697640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f960c0a2c00 0x7f960c0a50c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f961402ff60 tx=0x7f96140040e0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.636+0000 7f95fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:15:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f95fbfff640 1 -- 172.21.15.152:0/2102043975 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610004050 con 0x5574daa245d0 2024-09-11T22:15:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f96254d3740 1 -- 172.21.15.152:0/2102043975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9614003970 con 0x5574daa245d0 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f95fbfff640 1 -- 172.21.15.152:0/2102043975 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f96100041f0 con 0x5574daa245d0 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f95fbfff640 1 -- 172.21.15.152:0/2102043975 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f96100043f0 con 0x5574daa245d0 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f96254d3740 10 client.18216 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f96254d3740 1 -- 172.21.15.152:0/2102043975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5574daa46900 con 0x5574daa245d0 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f95fbfff640 1 -- 172.21.15.152:0/2102043975 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9614003970 con 0x5574daa245d0 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f95fbfff640 1 -- 172.21.15.152:0/2102043975 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9610003b10 con 0x5574daa245d0 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f96254d3740 10 client.18216 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f96254d3740 10 client.18216 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f96254d3740 20 client.18216 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f96254d3740 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5574daa47dc0 0x5574daa4a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f96254d3740 4 client.18216 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:30.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.637+0000 7f96254d3740 1 -- 172.21.15.152:0/2102043975 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574da997860 con 0x5574daa47dc0 2024-09-11T22:15:30.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.638+0000 7f961bfff640 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5574daa47dc0 0x5574daa4a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.639+0000 7f961bfff640 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5574daa47dc0 0x5574daa4a1e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=84f90e79e26a398 server_cookie=7aa6d84e54ec783f in_seq=0 out_seq=0 2024-09-11T22:15:30.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.639+0000 7f95fbfff640 10 client.18216 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:15:30.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.639+0000 7f95fbfff640 1 -- 172.21.15.152:0/2102043975 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5574da997860 con 0x5574daa47dc0 2024-09-11T22:15:30.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.639+0000 7f95fbfff640 10 client.18216 handle_command_reply: tid=0 2024-09-11T22:15:30.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.640+0000 7f96254d3740 1 client.18216 shutdown 2024-09-11T22:15:30.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.640+0000 7f96254d3740 1 -- 172.21.15.152:0/2102043975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 msgr2=0x5574daa34980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:30.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.640+0000 7f96254d3740 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa34980 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9610012700 tx=0x7f9610012bc0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.640+0000 7f96254d3740 1 -- 172.21.15.152:0/2102043975 shutdown_connections 2024-09-11T22:15:30.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.640+0000 7f96254d3740 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5574daa47dc0 0x5574daa4a1e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.640+0000 7f96254d3740 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa35400 0x5574daa43d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.640+0000 7f96254d3740 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa25b40 0x5574daa34ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.640+0000 7f95fbfff640 0 client.18216 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:15:30.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.640+0000 7f96254d3740 1 --2- 172.21.15.152:0/2102043975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa34980 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.640+0000 7f96254d3740 1 -- 172.21.15.152:0/2102043975 >> 172.21.15.152:0/2102043975 conn(0x5574da9ed310 msgr2=0x5574daa26960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:30.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.640+0000 7f96254d3740 1 -- 172.21.15.152:0/2102043975 shutdown_connections 2024-09-11T22:15:30.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.641+0000 7f96254d3740 1 -- 172.21.15.152:0/2102043975 wait complete. 2024-09-11T22:15:30.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.641+0000 7f96254d3740 20 client.18216 trim_cache size 0 max 16384 2024-09-11T22:15:30.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.661+0000 7f96254d3740 1 Processor -- start 2024-09-11T22:15:30.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.662+0000 7f96254d3740 1 -- start start 2024-09-11T22:15:30.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f96254d3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa245d0 0x5574daa33250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f96254d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa25b40 0x5574daa43b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f96254d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa35400 0x5574daa44060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f96254d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f961c1ae000 con 0x5574daa25b40 2024-09-11T22:15:30.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f96254d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f961c1ab8d0 con 0x5574daa35400 2024-09-11T22:15:30.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f96254d3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f961c1a9740 con 0x5574daa245d0 2024-09-11T22:15:30.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f9621697640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa35400 0x5574daa44060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f961bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa25b40 0x5574daa43b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f9621697640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa35400 0x5574daa44060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:36918/0 (socket says 172.21.15.152:36918) 2024-09-11T22:15:30.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f961bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa25b40 0x5574daa43b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40372/0 (socket says 172.21.15.152:40372) 2024-09-11T22:15:30.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f9621697640 1 -- 172.21.15.152:0/1522063643 learned_addr learned my addr 172.21.15.152:0/1522063643 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:30.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.663+0000 7f9620e96640 1 --2- 172.21.15.152:0/1522063643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa245d0 0x5574daa33250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.665+0000 7f961bfff640 1 -- 172.21.15.152:0/1522063643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa245d0 msgr2=0x5574daa33250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:30.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.665+0000 7f961bfff640 1 --2- 172.21.15.152:0/1522063643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa245d0 0x5574daa33250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.665+0000 7f961bfff640 1 -- 172.21.15.152:0/1522063643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa35400 msgr2=0x5574daa44060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.665+0000 7f961bfff640 1 --2- 172.21.15.152:0/1522063643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa35400 0x5574daa44060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.665+0000 7f961bfff640 1 -- 172.21.15.152:0/1522063643 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574daa4a840 con 0x5574daa25b40 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.665+0000 7f961bfff640 1 --2- 172.21.15.152:0/1522063643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa25b40 0x5574daa43b20 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f96080cc570 tx=0x7f96080bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e036428413bc7e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.665+0000 7f96067fc640 1 -- 172.21.15.152:0/1522063643 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96080b4070 con 0x5574daa25b40 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.665+0000 7f96067fc640 1 -- 172.21.15.152:0/1522063643 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96080a3fb0 con 0x5574daa25b40 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.665+0000 7f96067fc640 1 -- 172.21.15.152:0/1522063643 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608020040 con 0x5574daa25b40 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.666+0000 7f96254d3740 1 -- 172.21.15.152:0/1522063643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa25b40 msgr2=0x5574daa43b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.666+0000 7f96254d3740 1 --2- 172.21.15.152:0/1522063643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa25b40 0x5574daa43b20 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f96080cc570 tx=0x7f96080bb040 comp rx=0 tx=0).stop 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.666+0000 7f96254d3740 1 -- 172.21.15.152:0/1522063643 shutdown_connections 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.666+0000 7f96254d3740 1 --2- 172.21.15.152:0/1522063643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa35400 0x5574daa44060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.666+0000 7f96254d3740 1 --2- 172.21.15.152:0/1522063643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa25b40 0x5574daa43b20 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.666+0000 7f96254d3740 1 --2- 172.21.15.152:0/1522063643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa245d0 0x5574daa33250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.666+0000 7f96254d3740 1 -- 172.21.15.152:0/1522063643 >> 172.21.15.152:0/1522063643 conn(0x5574da9ed310 msgr2=0x5574daa1fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:30.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.667+0000 7f96254d3740 1 -- 172.21.15.152:0/1522063643 shutdown_connections 2024-09-11T22:15:30.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.667+0000 7f96254d3740 1 -- 172.21.15.152:0/1522063643 wait complete. 2024-09-11T22:15:30.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.667+0000 7f96254d3740 1 -- start start 2024-09-11T22:15:30.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.667+0000 7f96254d3740 1 Processor -- start 2024-09-11T22:15:30.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f96254d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa3fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f96254d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 0x5574daa401d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f96254d3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa35400 0x5574daa3cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f96254d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f961c1a9d90 con 0x5574daa245d0 2024-09-11T22:15:30.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f96254d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f961c1ab200 con 0x5574daa25b40 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f96254d3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f961c1aa460 con 0x5574daa35400 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f9620e96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa3fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f96254d3740 10 client.0 _ll_register_callbacks cb 0x7f96100097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f9620e96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa3fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40388/0 (socket says 172.21.15.152:40388) 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f9620e96640 1 -- 172.21.15.152:0/1845011417 learned_addr learned my addr 172.21.15.152:0/1845011417 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f9621697640 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa35400 0x5574daa3cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f961bfff640 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 0x5574daa401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f9620e96640 1 -- 172.21.15.152:0/1845011417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa35400 msgr2=0x5574daa3cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f9620e96640 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa35400 0x5574daa3cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f9620e96640 1 -- 172.21.15.152:0/1845011417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 msgr2=0x5574daa401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f9620e96640 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 0x5574daa401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.668+0000 7f9620e96640 1 -- 172.21.15.152:0/1845011417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574daa21960 con 0x5574daa245d0 2024-09-11T22:15:30.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.669+0000 7f9620e96640 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa3fc90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f9610010570 tx=0x7f9610009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5234a5b2b4039804 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:30.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.669+0000 7f95fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:15:30.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.669+0000 7f95fbfff640 1 -- 172.21.15.152:0/1845011417 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961000f920 con 0x5574daa245d0 2024-09-11T22:15:30.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.669+0000 7f95fbfff640 1 -- 172.21.15.152:0/1845011417 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f9610018040 con 0x5574daa245d0 2024-09-11T22:15:30.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.669+0000 7f96254d3740 1 -- 172.21.15.152:0/1845011417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96080a3fb0 con 0x5574daa245d0 2024-09-11T22:15:30.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.670+0000 7f95fbfff640 1 -- 172.21.15.152:0/1845011417 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f961000fac0 con 0x5574daa245d0 2024-09-11T22:15:30.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.670+0000 7f96254d3740 10 client.18222 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:30.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.670+0000 7f96254d3740 1 -- 172.21.15.152:0/1845011417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5574daa3a760 con 0x5574daa245d0 2024-09-11T22:15:30.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.670+0000 7f95fbfff640 1 -- 172.21.15.152:0/1845011417 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9610005520 con 0x5574daa245d0 2024-09-11T22:15:30.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.670+0000 7f95fbfff640 1 -- 172.21.15.152:0/1845011417 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f96100036d0 con 0x5574daa245d0 2024-09-11T22:15:30.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.670+0000 7f96254d3740 10 client.18222 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:30.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.671+0000 7f96254d3740 10 client.18222 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:15:30.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.671+0000 7f96254d3740 20 client.18222 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:30.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.671+0000 7f96254d3740 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5574daab3510 0x5574daab5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:30.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.671+0000 7f96254d3740 4 client.18222 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:15:30.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.671+0000 7f96254d3740 1 -- 172.21.15.152:0/1845011417 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f96080a3fb0 con 0x5574daab3510 2024-09-11T22:15:30.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.671+0000 7f961bfff640 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5574daab3510 0x5574daab5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:30.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.671+0000 7f95fbfff640 10 client.18222 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:15:30.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f961bfff640 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5574daab3510 0x5574daab5930 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a95df2bb086095f9 server_cookie=ee1d97d8f945b61c in_seq=0 out_seq=0 2024-09-11T22:15:30.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f95fbfff640 1 -- 172.21.15.152:0/1845011417 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f96080a3fb0 con 0x5574daab3510 2024-09-11T22:15:30.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f95fbfff640 10 client.18222 handle_command_reply: tid=0 2024-09-11T22:15:30.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f96254d3740 1 client.18222 shutdown 2024-09-11T22:15:30.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f96254d3740 1 -- 172.21.15.152:0/1845011417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 msgr2=0x5574daa3fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:30.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f96254d3740 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa3fc90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f9610010570 tx=0x7f9610009d90 comp rx=0 tx=0).stop 2024-09-11T22:15:30.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f96254d3740 1 -- 172.21.15.152:0/1845011417 shutdown_connections 2024-09-11T22:15:30.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f96254d3740 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5574daab3510 0x5574daab5930 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f95fbfff640 0 client.18222 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:15:30.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f96254d3740 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5574daa35400 0x5574daa3cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f96254d3740 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574daa25b40 0x5574daa401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f96254d3740 1 --2- 172.21.15.152:0/1845011417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574daa245d0 0x5574daa3fc90 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.672+0000 7f96254d3740 1 -- 172.21.15.152:0/1845011417 >> 172.21.15.152:0/1845011417 conn(0x5574da9ed310 msgr2=0x5574daa26110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:30.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.673+0000 7f96254d3740 1 -- 172.21.15.152:0/1845011417 shutdown_connections 2024-09-11T22:15:30.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.673+0000 7f96254d3740 1 -- 172.21.15.152:0/1845011417 wait complete. 2024-09-11T22:15:30.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.673+0000 7f96254d3740 20 client.18222 trim_cache size 0 max 16384 2024-09-11T22:15:30.678 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:15:30.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.674+0000 7f96230fa640 1 -- 172.21.15.152:0/1535207560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f960c0a2c00 msgr2=0x7f960c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:30.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.674+0000 7f96230fa640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f960c0a2c00 0x7f960c0a50c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f961402ff60 tx=0x7f96140040e0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.674+0000 7f96230fa640 1 -- 172.21.15.152:0/1535207560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c102570 msgr2=0x7f961c19d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:30.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.674+0000 7f96230fa640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c102570 0x7f961c19d5f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f960800d770 tx=0x7f960800dc30 comp rx=0 tx=0).stop 2024-09-11T22:15:30.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.674+0000 7f96230fa640 1 -- 172.21.15.152:0/1535207560 shutdown_connections 2024-09-11T22:15:30.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.674+0000 7f96230fa640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f960c0a2c00 0x7f960c0a50c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.674+0000 7f96230fa640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f961c102ef0 0x7f961c198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.674+0000 7f96230fa640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c102570 0x7f961c19d5f0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.674+0000 7f96230fa640 1 --2- 172.21.15.152:0/1535207560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f961c100e20 0x7f961c19d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:30.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.674+0000 7f96230fa640 1 -- 172.21.15.152:0/1535207560 >> 172.21.15.152:0/1535207560 conn(0x7f961c0fc7d0 msgr2=0x7f961c103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:30.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.675+0000 7f96230fa640 1 -- 172.21.15.152:0/1535207560 shutdown_connections 2024-09-11T22:15:30.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:30.675+0000 7f96230fa640 1 -- 172.21.15.152:0/1535207560 wait complete. 2024-09-11T22:15:31.406 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:15:31.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:31 smithi152 ceph-mon[31188]: pgmap v349: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.4 MiB/s wr, 663 op/s 2024-09-11T22:15:31.770 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:15:31.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:31 smithi179 ceph-mon[35603]: pgmap v349: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.4 MiB/s wr, 663 op/s 2024-09-11T22:15:31.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:31 smithi193 ceph-mon[35545]: pgmap v349: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.4 MiB/s wr, 663 op/s 2024-09-11T22:15:32.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.351+0000 7f73beffd640 1 -- 172.21.15.152:0/2874017836 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8031cc0 con 0x7f73c010e230 2024-09-11T22:15:32.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.352+0000 7f73c64f0640 1 -- 172.21.15.152:0/2874017836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c010e230 msgr2=0x7f73c010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:32.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.352+0000 7f73c64f0640 1 --2- 172.21.15.152:0/2874017836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c010e230 0x7f73c010e610 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009cd0 tx=0x7f73b802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.352+0000 7f73c64f0640 1 -- 172.21.15.152:0/2874017836 shutdown_connections 2024-09-11T22:15:32.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.352+0000 7f73c64f0640 1 --2- 172.21.15.152:0/2874017836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c0108b50 0x7f73c0115070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.352+0000 7f73c64f0640 1 --2- 172.21.15.152:0/2874017836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73c01081f0 0x7f73c0108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.352+0000 7f73c64f0640 1 --2- 172.21.15.152:0/2874017836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c010e230 0x7f73c010e610 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.352+0000 7f73c64f0640 1 -- 172.21.15.152:0/2874017836 >> 172.21.15.152:0/2874017836 conn(0x7f73c0077bb0 msgr2=0x7f73c0079fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:32.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.352+0000 7f73c64f0640 1 -- 172.21.15.152:0/2874017836 shutdown_connections 2024-09-11T22:15:32.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.352+0000 7f73c64f0640 1 -- 172.21.15.152:0/2874017836 wait complete. 2024-09-11T22:15:32.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.353+0000 7f73c64f0640 1 Processor -- start 2024-09-11T22:15:32.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.353+0000 7f73c64f0640 1 -- start start 2024-09-11T22:15:32.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73c64f0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c01081f0 0x7f73c00827d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73c64f0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c0108b50 0x7f73c0082d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73c64f0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73c010e230 0x7f73c007ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73c64f0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0118580 con 0x7f73c010e230 2024-09-11T22:15:32.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73c64f0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0118400 con 0x7f73c01081f0 2024-09-11T22:15:32.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73c64f0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0118700 con 0x7f73c0108b50 2024-09-11T22:15:32.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73bffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c01081f0 0x7f73c00827d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73bffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c01081f0 0x7f73c00827d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:36960/0 (socket says 172.21.15.152:36960) 2024-09-11T22:15:32.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73bffff640 1 -- 172.21.15.152:0/3795703693 learned_addr learned my addr 172.21.15.152:0/3795703693 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:32.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73c4a8d640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73c010e230 0x7f73c007ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73bf7fe640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c0108b50 0x7f73c0082d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73bffff640 1 -- 172.21.15.152:0/3795703693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c0108b50 msgr2=0x7f73c0082d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:32.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73bffff640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c0108b50 0x7f73c0082d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73bffff640 1 -- 172.21.15.152:0/3795703693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73c010e230 msgr2=0x7f73c007ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:32.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73bffff640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73c010e230 0x7f73c007ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.354+0000 7f73bffff640 1 -- 172.21.15.152:0/3795703693 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c007c300 con 0x7f73c01081f0 2024-09-11T22:15:32.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.355+0000 7f73bffff640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c01081f0 0x7f73c00827d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f73b8033040 tx=0x7f73b80093d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:32.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.355+0000 7f73bd7fa640 1 -- 172.21.15.152:0/3795703693 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8004040 con 0x7f73c01081f0 2024-09-11T22:15:32.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.355+0000 7f73c64f0640 1 -- 172.21.15.152:0/3795703693 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c007c590 con 0x7f73c01081f0 2024-09-11T22:15:32.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.355+0000 7f73c64f0640 1 -- 172.21.15.152:0/3795703693 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c00805e0 con 0x7f73c01081f0 2024-09-11T22:15:32.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.355+0000 7f73bd7fa640 1 -- 172.21.15.152:0/3795703693 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b80098b0 con 0x7f73c01081f0 2024-09-11T22:15:32.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.355+0000 7f73bd7fa640 1 -- 172.21.15.152:0/3795703693 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8030bc0 con 0x7f73c01081f0 2024-09-11T22:15:32.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.358+0000 7f73c88c9740 1 Processor -- start 2024-09-11T22:15:32.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.358+0000 7f73c88c9740 1 -- start start 2024-09-11T22:15:32.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c80902b40 0x555c80901090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c80901a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c8090c370 0x555c8090e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73c88c9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555c808672f0 con 0x555c809015d0 2024-09-11T22:15:32.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73c88c9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555c8080ecf0 con 0x555c80902b40 2024-09-11T22:15:32.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73c88c9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555c808632b0 con 0x555c8090c370 2024-09-11T22:15:32.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73bd7fa640 1 -- 172.21.15.152:0/3795703693 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f73b80041e0 con 0x7f73c01081f0 2024-09-11T22:15:32.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73bffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c80901a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73bffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c80901a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40414/0 (socket says 172.21.15.152:40414) 2024-09-11T22:15:32.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73bffff640 1 -- 172.21.15.152:0/1257637916 learned_addr learned my addr 172.21.15.152:0/1257637916 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:32.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73c4a8d640 1 --2- 172.21.15.152:0/1257637916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c80902b40 0x555c80901090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73bf7fe640 1 --2- 172.21.15.152:0/1257637916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c8090c370 0x555c8090e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73bffff640 1 -- 172.21.15.152:0/1257637916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c8090c370 msgr2=0x555c8090e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:32.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73bffff640 1 --2- 172.21.15.152:0/1257637916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c8090c370 0x555c8090e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73bffff640 1 -- 172.21.15.152:0/1257637916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c80902b40 msgr2=0x555c80901090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:32.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73bffff640 1 --2- 172.21.15.152:0/1257637916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c80902b40 0x555c80901090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.359+0000 7f73bffff640 1 -- 172.21.15.152:0/1257637916 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c807f33a0 con 0x555c809015d0 2024-09-11T22:15:32.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.360+0000 7f73bffff640 1 --2- 172.21.15.152:0/1257637916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c80901a10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f73b80edcc0 tx=0x7f73b80f89d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9fe100ec5b3d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:32.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.360+0000 7f73bd7fa640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73a80a2d70 0x7f73a80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.360+0000 7f73a67fc640 1 -- 172.21.15.152:0/1257637916 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80f24e0 con 0x555c809015d0 2024-09-11T22:15:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.360+0000 7f73bd7fa640 1 -- 172.21.15.152:0/3795703693 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f73b802e070 con 0x7f73c01081f0 2024-09-11T22:15:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.360+0000 7f73a67fc640 1 -- 172.21.15.152:0/1257637916 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b80fd030 con 0x555c809015d0 2024-09-11T22:15:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.361+0000 7f73c4a8d640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73a80a2d70 0x7f73a80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.361+0000 7f73a67fc640 1 -- 172.21.15.152:0/1257637916 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80bc690 con 0x555c809015d0 2024-09-11T22:15:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.361+0000 7f73c88c9740 1 -- 172.21.15.152:0/1257637916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 msgr2=0x555c80901a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.361+0000 7f73c4a8d640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73a80a2d70 0x7f73a80a5230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009d10 tx=0x7f73b0005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.361+0000 7f73c88c9740 1 --2- 172.21.15.152:0/1257637916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c80901a10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f73b80edcc0 tx=0x7f73b80f89d0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.361+0000 7f73c88c9740 1 -- 172.21.15.152:0/1257637916 shutdown_connections 2024-09-11T22:15:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.361+0000 7f73c88c9740 1 --2- 172.21.15.152:0/1257637916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c8090c370 0x555c8090e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.361+0000 7f73c88c9740 1 --2- 172.21.15.152:0/1257637916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c80901a10 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.361+0000 7f73c88c9740 1 --2- 172.21.15.152:0/1257637916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c80902b40 0x555c80901090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.361+0000 7f73c88c9740 1 -- 172.21.15.152:0/1257637916 >> 172.21.15.152:0/1257637916 conn(0x555c808ca310 msgr2=0x555c808fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.362+0000 7f73c88c9740 1 -- 172.21.15.152:0/1257637916 shutdown_connections 2024-09-11T22:15:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.362+0000 7f73c88c9740 1 -- 172.21.15.152:0/1257637916 wait complete. 2024-09-11T22:15:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.362+0000 7f73c88c9740 1 -- start start 2024-09-11T22:15:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.362+0000 7f73c88c9740 1 Processor -- start 2024-09-11T22:15:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.362+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 0x555c8090bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.362+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c80902b40 0x555c80908e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.362+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c8090c370 0x555c80909390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.362+0000 7f73c88c9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555c8090ee30 con 0x555c80902b40 2024-09-11T22:15:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.362+0000 7f73c88c9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555c80822060 con 0x555c809015d0 2024-09-11T22:15:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.362+0000 7f73c88c9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555c8090efb0 con 0x555c8090c370 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73bf7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c80902b40 0x555c80908e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73c88c9740 10 client.0 _ll_register_callbacks cb 0x555c805758c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73bffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 0x555c8090bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73bffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 0x555c8090bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:36976/0 (socket says 172.21.15.152:36976) 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73bf7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c80902b40 0x555c80908e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40420/0 (socket says 172.21.15.152:40420) 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73bffff640 1 -- 172.21.15.152:0/2535338897 learned_addr learned my addr 172.21.15.152:0/2535338897 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73c4a8d640 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c8090c370 0x555c80909390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73bf7fe640 1 -- 172.21.15.152:0/2535338897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c8090c370 msgr2=0x555c80909390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73bf7fe640 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c8090c370 0x555c80909390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73bf7fe640 1 -- 172.21.15.152:0/2535338897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 msgr2=0x555c8090bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73bf7fe640 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 0x555c8090bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73bf7fe640 1 -- 172.21.15.152:0/2535338897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c805d83c0 con 0x555c80902b40 2024-09-11T22:15:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73bf7fe640 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c80902b40 0x555c80908e50 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f73c007d020 tx=0x7f73b4012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f824815568bff3e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f739f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:15:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f739f7fe640 1 -- 172.21.15.152:0/2535338897 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4004320 con 0x555c80902b40 2024-09-11T22:15:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.363+0000 7f73c88c9740 1 -- 172.21.15.152:0/2535338897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b80fd030 con 0x555c80902b40 2024-09-11T22:15:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.364+0000 7f739f7fe640 1 -- 172.21.15.152:0/2535338897 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f73b40118f0 con 0x555c80902b40 2024-09-11T22:15:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.364+0000 7f739f7fe640 1 -- 172.21.15.152:0/2535338897 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f73b4011b30 con 0x555c80902b40 2024-09-11T22:15:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.364+0000 7f73c88c9740 10 client.18234 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.364+0000 7f73c88c9740 1 -- 172.21.15.152:0/2535338897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555c8091a8c0 con 0x555c80902b40 2024-09-11T22:15:32.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.364+0000 7f739f7fe640 1 -- 172.21.15.152:0/2535338897 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b40044c0 con 0x555c80902b40 2024-09-11T22:15:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.365+0000 7f739f7fe640 1 -- 172.21.15.152:0/2535338897 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f73b40035f0 con 0x555c80902b40 2024-09-11T22:15:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.366+0000 7f73c88c9740 10 client.18234 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.366+0000 7f73c88c9740 10 client.18234 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:15:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.366+0000 7f73c88c9740 20 client.18234 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.366+0000 7f73c88c9740 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555c8091bcd0 0x555c8091e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.366+0000 7f73c88c9740 4 client.18234 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.366+0000 7f73c88c9740 1 -- 172.21.15.152:0/2535338897 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f73b80fd030 con 0x555c8091bcd0 2024-09-11T22:15:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.366+0000 7f73bffff640 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555c8091bcd0 0x555c8091e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.366+0000 7f73bffff640 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555c8091bcd0 0x555c8091e0c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=821cccd359257eff server_cookie=87d25776e5918443 in_seq=0 out_seq=0 2024-09-11T22:15:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.366+0000 7f739f7fe640 10 client.18234 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:15:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.367+0000 7f739f7fe640 1 -- 172.21.15.152:0/2535338897 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f73b80fd030 con 0x555c8091bcd0 2024-09-11T22:15:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.367+0000 7f739f7fe640 10 client.18234 handle_command_reply: tid=0 2024-09-11T22:15:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.367+0000 7f73c88c9740 1 client.18234 shutdown 2024-09-11T22:15:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.367+0000 7f73c88c9740 1 -- 172.21.15.152:0/2535338897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c80902b40 msgr2=0x555c80908e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.367+0000 7f73c88c9740 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c80902b40 0x555c80908e50 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f73c007d020 tx=0x7f73b4012b60 comp rx=0 tx=0).stop 2024-09-11T22:15:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.367+0000 7f73c88c9740 1 -- 172.21.15.152:0/2535338897 shutdown_connections 2024-09-11T22:15:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.367+0000 7f73c88c9740 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555c8091bcd0 0x555c8091e0c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.367+0000 7f739f7fe640 0 client.18234 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:15:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.368+0000 7f73c88c9740 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c8090c370 0x555c80909390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.368+0000 7f73c88c9740 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c80902b40 0x555c80908e50 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.368+0000 7f73c88c9740 1 --2- 172.21.15.152:0/2535338897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 0x555c8090bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.368+0000 7f73c88c9740 1 -- 172.21.15.152:0/2535338897 >> 172.21.15.152:0/2535338897 conn(0x555c808ca310 msgr2=0x555c80903930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:32.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.368+0000 7f73c88c9740 1 -- 172.21.15.152:0/2535338897 shutdown_connections 2024-09-11T22:15:32.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.368+0000 7f73c88c9740 1 -- 172.21.15.152:0/2535338897 wait complete. 2024-09-11T22:15:32.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.368+0000 7f73c88c9740 20 client.18234 trim_cache size 0 max 16384 2024-09-11T22:15:32.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.385+0000 7f73c88c9740 1 Processor -- start 2024-09-11T22:15:32.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73c88c9740 1 -- start start 2024-09-11T22:15:32.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 0x555c80908e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 0x555c80909350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c8090c370 0x555c8090d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73c88c9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac011170 con 0x555c8090c370 2024-09-11T22:15:32.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73c88c9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac00ea40 con 0x555c809015d0 2024-09-11T22:15:32.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73c88c9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac00c8b0 con 0x555c80902b40 2024-09-11T22:15:32.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73bf7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 0x555c80909350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73bf7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 0x555c80909350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:59196/0 (socket says 172.21.15.152:59196) 2024-09-11T22:15:32.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73c4a8d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c8090c370 0x555c8090d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73bf7fe640 1 -- 172.21.15.152:0/3404259677 learned_addr learned my addr 172.21.15.152:0/3404259677 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:32.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73bffff640 1 --2- 172.21.15.152:0/3404259677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 0x555c80908e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73bffff640 1 -- 172.21.15.152:0/3404259677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 msgr2=0x555c80909350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:32.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73bffff640 1 --2- 172.21.15.152:0/3404259677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 0x555c80909350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73bffff640 1 -- 172.21.15.152:0/3404259677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c8090c370 msgr2=0x555c8090d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:32.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73bffff640 1 --2- 172.21.15.152:0/3404259677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c8090c370 0x555c8090d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73bffff640 1 -- 172.21.15.152:0/3404259677 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c80909990 con 0x555c809015d0 2024-09-11T22:15:32.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.386+0000 7f73c4a8d640 1 --2- 172.21.15.152:0/3404259677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c8090c370 0x555c8090d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:32.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.387+0000 7f73bffff640 1 --2- 172.21.15.152:0/3404259677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 0x555c80908e10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f73b80b9520 tx=0x7f73b80f3e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7efb729ee0584975 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:32.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.387+0000 7f73a5ffb640 1 -- 172.21.15.152:0/3404259677 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80d4070 con 0x555c809015d0 2024-09-11T22:15:32.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.387+0000 7f73a5ffb640 1 -- 172.21.15.152:0/3404259677 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b80fd040 con 0x555c809015d0 2024-09-11T22:15:32.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.387+0000 7f73a5ffb640 1 -- 172.21.15.152:0/3404259677 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80bc4b0 con 0x555c809015d0 2024-09-11T22:15:32.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.388+0000 7f73c88c9740 1 -- 172.21.15.152:0/3404259677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 msgr2=0x555c80908e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:32.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.388+0000 7f73c88c9740 1 --2- 172.21.15.152:0/3404259677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 0x555c80908e10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f73b80b9520 tx=0x7f73b80f3e20 comp rx=0 tx=0).stop 2024-09-11T22:15:32.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.388+0000 7f73c88c9740 1 -- 172.21.15.152:0/3404259677 shutdown_connections 2024-09-11T22:15:32.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.388+0000 7f73c88c9740 1 --2- 172.21.15.152:0/3404259677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c8090c370 0x555c8090d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.388+0000 7f73c88c9740 1 --2- 172.21.15.152:0/3404259677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 0x555c80909350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.388+0000 7f73c88c9740 1 --2- 172.21.15.152:0/3404259677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c809015d0 0x555c80908e10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.388+0000 7f73c88c9740 1 -- 172.21.15.152:0/3404259677 >> 172.21.15.152:0/3404259677 conn(0x555c808ca310 msgr2=0x555c8090e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.388+0000 7f73c88c9740 1 -- 172.21.15.152:0/3404259677 shutdown_connections 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.388+0000 7f73c88c9740 1 -- 172.21.15.152:0/3404259677 wait complete. 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.389+0000 7f73c88c9740 1 -- start start 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.389+0000 7f73c88c9740 1 Processor -- start 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.389+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c8090d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.389+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 0x555c8090d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.389+0000 7f73bffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c8090d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.389+0000 7f73bffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c8090d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40444/0 (socket says 172.21.15.152:40444) 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73c88c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c8090c370 0x555c80913300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73bffff640 1 -- 172.21.15.152:0/3787057782 learned_addr learned my addr 172.21.15.152:0/3787057782 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73bf7fe640 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 0x555c8090d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73c88c9740 1 -- 172.21.15.152:0/3787057782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac00cf00 con 0x555c809015d0 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73c88c9740 1 -- 172.21.15.152:0/3787057782 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac00e370 con 0x555c8090c370 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73c88c9740 1 -- 172.21.15.152:0/3787057782 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac00d5d0 con 0x555c80902b40 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73c4a8d640 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c8090c370 0x555c80913300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73c88c9740 10 client.0 _ll_register_callbacks cb 0x7f73b40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73bf7fe640 1 -- 172.21.15.152:0/3787057782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c8090c370 msgr2=0x555c80913300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73bf7fe640 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c8090c370 0x555c80913300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73bf7fe640 1 -- 172.21.15.152:0/3787057782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 msgr2=0x555c8090d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73bf7fe640 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c8090d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73bf7fe640 1 -- 172.21.15.152:0/3787057782 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c80913910 con 0x555c80902b40 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73bffff640 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c8090d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:32.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73c88c9740 1 -- 172.21.15.152:0/3787057782 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b80fd040 con 0x555c80902b40 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f73bf7fe640 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 0x555c8090d980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x555c808221b0 tx=0x7f73b4005c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e93e87a0eb7e58ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f739f7fe640 10 client.27679 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f739f7fe640 1 -- 172.21.15.152:0/3787057782 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4009ca0 con 0x555c80902b40 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.390+0000 7f739f7fe640 1 -- 172.21.15.152:0/3787057782 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f73b402c050 con 0x555c80902b40 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.391+0000 7f739f7fe640 1 -- 172.21.15.152:0/3787057782 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f73b4003cf0 con 0x555c80902b40 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.391+0000 7f73c88c9740 10 client.27679 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.391+0000 7f73c88c9740 1 -- 172.21.15.152:0/3787057782 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) -- 0x555c80914af0 con 0x555c80902b40 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.391+0000 7f739f7fe640 1 -- 172.21.15.152:0/3787057782 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f73b40035f0 con 0x555c80902b40 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.391+0000 7f73c88c9740 10 client.27679 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.391+0000 7f73c88c9740 10 client.27679 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.391+0000 7f73c88c9740 20 client.27679 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.391+0000 7f73c88c9740 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555c8091bcd0 0x555c80988970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:32.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.391+0000 7f73c88c9740 4 client.27679 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.391+0000 7f73c88c9740 1 -- 172.21.15.152:0/3787057782 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555c80874860 con 0x555c8091bcd0 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.391+0000 7f73bffff640 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555c8091bcd0 0x555c80988970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.392+0000 7f73bffff640 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555c8091bcd0 0x555c80988970 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18127b94ea95526a server_cookie=93449c90adf595df in_seq=0 out_seq=0 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.392+0000 7f739f7fe640 10 client.27679 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.392+0000 7f739f7fe640 1 -- 172.21.15.152:0/3787057782 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555c80874860 con 0x555c8091bcd0 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.392+0000 7f739f7fe640 10 client.27679 handle_command_reply: tid=0 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.392+0000 7f73c88c9740 1 client.27679 shutdown 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.392+0000 7f73c88c9740 1 -- 172.21.15.152:0/3787057782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 msgr2=0x555c8090d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.392+0000 7f73c88c9740 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 0x555c8090d980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x555c808221b0 tx=0x7f73b4005c40 comp rx=0 tx=0).stop 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c88c9740 1 -- 172.21.15.152:0/3787057782 shutdown_connections 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c88c9740 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x555c8091bcd0 0x555c80988970 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c88c9740 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555c8090c370 0x555c80913300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c88c9740 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c80902b40 0x555c8090d980 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f739f7fe640 0 client.27679 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:15:32.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c88c9740 1 --2- 172.21.15.152:0/3787057782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c809015d0 0x555c8090d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.400 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:15:32.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c88c9740 1 -- 172.21.15.152:0/3787057782 >> 172.21.15.152:0/3787057782 conn(0x555c808ca310 msgr2=0x555c8090a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:32.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c88c9740 1 -- 172.21.15.152:0/3787057782 shutdown_connections 2024-09-11T22:15:32.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c88c9740 1 -- 172.21.15.152:0/3787057782 wait complete. 2024-09-11T22:15:32.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c88c9740 20 client.27679 trim_cache size 0 max 16384 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c64f0640 1 -- 172.21.15.152:0/3795703693 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73a80a2d70 msgr2=0x7f73a80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c64f0640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73a80a2d70 0x7f73a80a5230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009d10 tx=0x7f73b0005f90 comp rx=0 tx=0).stop 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c64f0640 1 -- 172.21.15.152:0/3795703693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c01081f0 msgr2=0x7f73c00827d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c64f0640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c01081f0 0x7f73c00827d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f73b8033040 tx=0x7f73b80093d0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c64f0640 1 -- 172.21.15.152:0/3795703693 shutdown_connections 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c64f0640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73a80a2d70 0x7f73a80a5230 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c64f0640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73c010e230 0x7f73c007ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c64f0640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c0108b50 0x7f73c0082d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c64f0640 1 --2- 172.21.15.152:0/3795703693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c01081f0 0x7f73c00827d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.393+0000 7f73c64f0640 1 -- 172.21.15.152:0/3795703693 >> 172.21.15.152:0/3795703693 conn(0x7f73c0077bb0 msgr2=0x7f73c0079360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.394+0000 7f73c64f0640 1 -- 172.21.15.152:0/3795703693 shutdown_connections 2024-09-11T22:15:32.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:32.394+0000 7f73c64f0640 1 -- 172.21.15.152:0/3795703693 wait complete. 2024-09-11T22:15:33.181 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:15:33.521 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:15:33.667 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:33 smithi152 ceph-mon[31188]: pgmap v350: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.6 MiB/s wr, 581 op/s 2024-09-11T22:15:33.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:33 smithi179 ceph-mon[35603]: pgmap v350: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.6 MiB/s wr, 581 op/s 2024-09-11T22:15:33.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:33 smithi193 ceph-mon[35545]: pgmap v350: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.6 MiB/s wr, 581 op/s 2024-09-11T22:15:34.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.324+0000 7f7c730bf640 1 -- 172.21.15.152:0/1590475331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c6c106a80 msgr2=0x7f7c6c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:34.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.324+0000 7f7c730bf640 1 --2- 172.21.15.152:0/1590475331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c6c106a80 0x7f7c6c106e60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009cd0 tx=0x7f7c5c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.324+0000 7f7c730bf640 1 -- 172.21.15.152:0/1590475331 shutdown_connections 2024-09-11T22:15:34.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.324+0000 7f7c730bf640 1 --2- 172.21.15.152:0/1590475331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c6c101420 0x7f7c6c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.324+0000 7f7c730bf640 1 --2- 172.21.15.152:0/1590475331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c6c100a80 0x7f7c6c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.324+0000 7f7c730bf640 1 --2- 172.21.15.152:0/1590475331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c6c106a80 0x7f7c6c106e60 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.324+0000 7f7c730bf640 1 -- 172.21.15.152:0/1590475331 >> 172.21.15.152:0/1590475331 conn(0x7f7c6c0fc7a0 msgr2=0x7f7c6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:34.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.324+0000 7f7c730bf640 1 -- 172.21.15.152:0/1590475331 shutdown_connections 2024-09-11T22:15:34.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.324+0000 7f7c730bf640 1 -- 172.21.15.152:0/1590475331 wait complete. 2024-09-11T22:15:34.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.325+0000 7f7c730bf640 1 Processor -- start 2024-09-11T22:15:34.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.325+0000 7f7c730bf640 1 -- start start 2024-09-11T22:15:34.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.325+0000 7f7c730bf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c6c100a80 0x7f7c6c111410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.325+0000 7f7c730bf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c6c101420 0x7f7c6c111950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.325+0000 7f7c730bf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c6c106a80 0x7f7c6c111e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.325+0000 7f7c730bf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c10fd70 con 0x7f7c6c106a80 2024-09-11T22:15:34.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.325+0000 7f7c730bf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c10fbf0 con 0x7f7c6c100a80 2024-09-11T22:15:34.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.325+0000 7f7c730bf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c10fef0 con 0x7f7c6c101420 2024-09-11T22:15:34.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.325+0000 7f7c70e5b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c6c100a80 0x7f7c6c111410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.325+0000 7f7c70e5b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c6c100a80 0x7f7c6c111410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55020/0 (socket says 172.21.15.152:55020) 2024-09-11T22:15:34.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.325+0000 7f7c70e5b640 1 -- 172.21.15.152:0/885399942 learned_addr learned my addr 172.21.15.152:0/885399942 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:34.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.326+0000 7f7c70e5b640 1 -- 172.21.15.152:0/885399942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c6c101420 msgr2=0x7f7c6c111950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:15:34.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.326+0000 7f7c70e5b640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c6c101420 0x7f7c6c111950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.326+0000 7f7c70e5b640 1 -- 172.21.15.152:0/885399942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c6c106a80 msgr2=0x7f7c6c111e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:34.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.326+0000 7f7c7165c640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c6c106a80 0x7f7c6c111e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.326+0000 7f7c70e5b640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c6c106a80 0x7f7c6c111e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.326+0000 7f7c70e5b640 1 -- 172.21.15.152:0/885399942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6c19a4f0 con 0x7f7c6c100a80 2024-09-11T22:15:34.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.326+0000 7f7c70e5b640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c6c100a80 0x7f7c6c111410 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c02ae00 tx=0x7f7c5c031e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:34.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.327+0000 7f7c69ffb640 1 -- 172.21.15.152:0/885399942 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c003e00 con 0x7f7c6c100a80 2024-09-11T22:15:34.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.327+0000 7f7c69ffb640 1 -- 172.21.15.152:0/885399942 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c5c004520 con 0x7f7c6c100a80 2024-09-11T22:15:34.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.327+0000 7f7c730bf640 1 -- 172.21.15.152:0/885399942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6c19a780 con 0x7f7c6c100a80 2024-09-11T22:15:34.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.327+0000 7f7c69ffb640 1 -- 172.21.15.152:0/885399942 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c030e10 con 0x7f7c6c100a80 2024-09-11T22:15:34.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.327+0000 7f7c730bf640 1 -- 172.21.15.152:0/885399942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6c19acc0 con 0x7f7c6c100a80 2024-09-11T22:15:34.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.330+0000 7f7c69ffb640 1 -- 172.21.15.152:0/885399942 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f7c5c0046d0 con 0x7f7c6c100a80 2024-09-11T22:15:34.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c75498740 1 Processor -- start 2024-09-11T22:15:34.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c75498740 1 -- start start 2024-09-11T22:15:34.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c75498740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x5640696e1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c75498740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696e1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c75498740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696ec370 0x5640696ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c75498740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5640696472f0 con 0x5640696e2b40 2024-09-11T22:15:34.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c75498740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5640695eecf0 con 0x5640696ec370 2024-09-11T22:15:34.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c75498740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5640696432b0 con 0x5640696e15d0 2024-09-11T22:15:34.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c7165c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x5640696e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c7165c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x5640696e1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44078/0 (socket says 172.21.15.152:44078) 2024-09-11T22:15:34.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c70e5b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696e1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c7165c640 1 -- 172.21.15.152:0/2847296017 learned_addr learned my addr 172.21.15.152:0/2847296017 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:34.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c6bfff640 1 --2- 172.21.15.152:0/2847296017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696ec370 0x5640696ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c7165c640 1 -- 172.21.15.152:0/2847296017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 msgr2=0x5640696e1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:34.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c7165c640 1 --2- 172.21.15.152:0/2847296017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696e1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c7165c640 1 -- 172.21.15.152:0/2847296017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696ec370 msgr2=0x5640696ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:34.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c7165c640 1 --2- 172.21.15.152:0/2847296017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696ec370 0x5640696ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c7165c640 1 -- 172.21.15.152:0/2847296017 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640695d33a0 con 0x5640696e2b40 2024-09-11T22:15:34.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.331+0000 7f7c70e5b640 1 --2- 172.21.15.152:0/2847296017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:34.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.332+0000 7f7c7165c640 1 --2- 172.21.15.152:0/2847296017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x5640696e1090 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009b50 tx=0x7f7c54010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcb36820da5ad36 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:34.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.332+0000 7f7c69ffb640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c580a2e40 0x7f7c580a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.332+0000 7f7c62ffd640 1 -- 172.21.15.152:0/2847296017 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54009e40 con 0x5640696e2b40 2024-09-11T22:15:34.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.332+0000 7f7c70e5b640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c580a2e40 0x7f7c580a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.332+0000 7f7c62ffd640 1 -- 172.21.15.152:0/2847296017 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c54012930 con 0x5640696e2b40 2024-09-11T22:15:34.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.332+0000 7f7c62ffd640 1 -- 172.21.15.152:0/2847296017 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54011a10 con 0x5640696e2b40 2024-09-11T22:15:34.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.332+0000 7f7c69ffb640 1 -- 172.21.15.152:0/885399942 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f7c5c02e020 con 0x7f7c6c100a80 2024-09-11T22:15:34.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c75498740 1 -- 172.21.15.152:0/2847296017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 msgr2=0x5640696e1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:34.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c75498740 1 --2- 172.21.15.152:0/2847296017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x5640696e1090 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009b50 tx=0x7f7c54010740 comp rx=0 tx=0).stop 2024-09-11T22:15:34.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c70e5b640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c580a2e40 0x7f7c580a5300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0ede80 tx=0x7f7c5c0f2040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:34.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c75498740 1 -- 172.21.15.152:0/2847296017 shutdown_connections 2024-09-11T22:15:34.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c75498740 1 --2- 172.21.15.152:0/2847296017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696ec370 0x5640696ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c75498740 1 --2- 172.21.15.152:0/2847296017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c75498740 1 --2- 172.21.15.152:0/2847296017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x5640696e1090 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c75498740 1 -- 172.21.15.152:0/2847296017 >> 172.21.15.152:0/2847296017 conn(0x5640696aa310 msgr2=0x5640696ddc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:34.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c75498740 1 -- 172.21.15.152:0/2847296017 shutdown_connections 2024-09-11T22:15:34.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c75498740 1 -- 172.21.15.152:0/2847296017 wait complete. 2024-09-11T22:15:34.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c75498740 1 -- start start 2024-09-11T22:15:34.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.333+0000 7f7c75498740 1 Processor -- start 2024-09-11T22:15:34.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c75498740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e15d0 0x5640696ebd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c75498740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696e2b40 0x5640696e8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c75498740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696ec370 0x5640696e95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c75498740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5640696ef070 con 0x5640696e15d0 2024-09-11T22:15:34.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c75498740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564069602060 con 0x5640696e2b40 2024-09-11T22:15:34.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c75498740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5640696ef1f0 con 0x5640696ec370 2024-09-11T22:15:34.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c7165c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e15d0 0x5640696ebd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c75498740 10 client.0 _ll_register_callbacks cb 0x5640693558c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:34.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c7165c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e15d0 0x5640696ebd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44092/0 (socket says 172.21.15.152:44092) 2024-09-11T22:15:34.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c7165c640 1 -- 172.21.15.152:0/3814549161 learned_addr learned my addr 172.21.15.152:0/3814549161 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:34.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c6bfff640 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696e2b40 0x5640696e8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c7165c640 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696ec370 0x5640696e95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c7165c640 1 -- 172.21.15.152:0/3814549161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696e2b40 msgr2=0x5640696e8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:34.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c7165c640 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696e2b40 0x5640696e8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c7165c640 1 -- 172.21.15.152:0/3814549161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e15d0 msgr2=0x5640696ebd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:34.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.334+0000 7f7c7165c640 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e15d0 0x5640696ebd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.335+0000 7f7c7165c640 1 -- 172.21.15.152:0/3814549161 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640693b83c0 con 0x5640696ec370 2024-09-11T22:15:34.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.335+0000 7f7c7165c640 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696ec370 0x5640696e95d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009b20 tx=0x7f7c54005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f5301a887da64d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:34.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.336+0000 7f7c4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:15:34.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.336+0000 7f7c4bfff640 1 -- 172.21.15.152:0/3814549161 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54026040 con 0x5640696ec370 2024-09-11T22:15:34.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.336+0000 7f7c4bfff640 1 -- 172.21.15.152:0/3814549161 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f7c54005040 con 0x5640696ec370 2024-09-11T22:15:34.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.336+0000 7f7c75498740 1 -- 172.21.15.152:0/3814549161 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c54012930 con 0x5640696ec370 2024-09-11T22:15:34.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.336+0000 7f7c4bfff640 1 -- 172.21.15.152:0/3814549161 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7c54033050 con 0x5640696ec370 2024-09-11T22:15:34.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.336+0000 7f7c75498740 10 client.27688 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:34.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.336+0000 7f7c75498740 1 -- 172.21.15.152:0/3814549161 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5640696faad0 con 0x5640696ec370 2024-09-11T22:15:34.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.337+0000 7f7c4bfff640 1 -- 172.21.15.152:0/3814549161 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c54012930 con 0x5640696ec370 2024-09-11T22:15:34.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.337+0000 7f7c4bfff640 1 -- 172.21.15.152:0/3814549161 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7c5400f040 con 0x5640696ec370 2024-09-11T22:15:34.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.337+0000 7f7c75498740 10 client.27688 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:34.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.337+0000 7f7c75498740 10 client.27688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:34.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.337+0000 7f7c75498740 20 client.27688 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:34.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.337+0000 7f7c75498740 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5640696fbf90 0x5640696fe380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.337+0000 7f7c75498740 4 client.27688 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:34.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.337+0000 7f7c75498740 1 -- 172.21.15.152:0/3814549161 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564069654860 con 0x5640696fbf90 2024-09-11T22:15:34.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.337+0000 7f7c6bfff640 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5640696fbf90 0x5640696fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.337+0000 7f7c6bfff640 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5640696fbf90 0x5640696fe380 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d501553141054c5 server_cookie=6b20819099b6abf in_seq=0 out_seq=0 2024-09-11T22:15:34.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.337+0000 7f7c4bfff640 10 client.27688 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:34.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c4bfff640 1 -- 172.21.15.152:0/3814549161 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564069654860 con 0x5640696fbf90 2024-09-11T22:15:34.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c4bfff640 10 client.27688 handle_command_reply: tid=0 2024-09-11T22:15:34.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c75498740 1 client.27688 shutdown 2024-09-11T22:15:34.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c75498740 1 -- 172.21.15.152:0/3814549161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696ec370 msgr2=0x5640696e95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:34.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c75498740 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696ec370 0x5640696e95d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009b20 tx=0x7f7c54005f90 comp rx=0 tx=0).stop 2024-09-11T22:15:34.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c75498740 1 -- 172.21.15.152:0/3814549161 shutdown_connections 2024-09-11T22:15:34.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c75498740 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5640696fbf90 0x5640696fe380 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c75498740 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696ec370 0x5640696e95d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c75498740 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696e2b40 0x5640696e8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c75498740 1 --2- 172.21.15.152:0/3814549161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e15d0 0x5640696ebd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c4bfff640 0 client.27688 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:34.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.338+0000 7f7c75498740 1 -- 172.21.15.152:0/3814549161 >> 172.21.15.152:0/3814549161 conn(0x5640696aa310 msgr2=0x5640696e3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:34.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.339+0000 7f7c75498740 1 -- 172.21.15.152:0/3814549161 shutdown_connections 2024-09-11T22:15:34.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.339+0000 7f7c75498740 1 -- 172.21.15.152:0/3814549161 wait complete. 2024-09-11T22:15:34.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.339+0000 7f7c75498740 20 client.27688 trim_cache size 0 max 16384 2024-09-11T22:15:34.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c75498740 1 Processor -- start 2024-09-11T22:15:34.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c75498740 1 -- start start 2024-09-11T22:15:34.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c75498740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696f8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c75498740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x564069703920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c75498740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696ec370 0x564069703e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c75498740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c1beae0 con 0x5640696e2b40 2024-09-11T22:15:34.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c75498740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c1bf1b0 con 0x5640696ec370 2024-09-11T22:15:34.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c75498740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c1bca80 con 0x5640696e15d0 2024-09-11T22:15:34.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c6bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x564069703920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c6bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x564069703920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44108/0 (socket says 172.21.15.152:44108) 2024-09-11T22:15:34.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c6bfff640 1 -- 172.21.15.152:0/3873582455 learned_addr learned my addr 172.21.15.152:0/3873582455 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:34.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c7165c640 1 --2- 172.21.15.152:0/3873582455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.356+0000 7f7c7165c640 1 --2- 172.21.15.152:0/3873582455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696ec370 0x564069703e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.357+0000 7f7c6bfff640 1 -- 172.21.15.152:0/3873582455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 msgr2=0x5640696f8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:34.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.357+0000 7f7c6bfff640 1 --2- 172.21.15.152:0/3873582455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696f8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.357+0000 7f7c6bfff640 1 -- 172.21.15.152:0/3873582455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696ec370 msgr2=0x564069703e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:34.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.357+0000 7f7c6bfff640 1 --2- 172.21.15.152:0/3873582455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696ec370 0x564069703e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.357+0000 7f7c6bfff640 1 -- 172.21.15.152:0/3873582455 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640696e1df0 con 0x5640696e2b40 2024-09-11T22:15:34.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.357+0000 7f7c6bfff640 1 --2- 172.21.15.152:0/3873582455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x564069703920 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009bd0 tx=0x7f7c64005b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311c007b0657ca3a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:34.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.357+0000 7f7c627fc640 1 -- 172.21.15.152:0/3873582455 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64003aa0 con 0x5640696e2b40 2024-09-11T22:15:34.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.357+0000 7f7c627fc640 1 -- 172.21.15.152:0/3873582455 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c64005500 con 0x5640696e2b40 2024-09-11T22:15:34.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.357+0000 7f7c627fc640 1 -- 172.21.15.152:0/3873582455 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64004d60 con 0x5640696e2b40 2024-09-11T22:15:34.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.358+0000 7f7c75498740 1 -- 172.21.15.152:0/3873582455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 msgr2=0x564069703920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:34.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.358+0000 7f7c75498740 1 --2- 172.21.15.152:0/3873582455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x564069703920 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009bd0 tx=0x7f7c64005b80 comp rx=0 tx=0).stop 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.358+0000 7f7c75498740 1 -- 172.21.15.152:0/3873582455 shutdown_connections 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.358+0000 7f7c75498740 1 --2- 172.21.15.152:0/3873582455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696ec370 0x564069703e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.358+0000 7f7c75498740 1 --2- 172.21.15.152:0/3873582455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696e2b40 0x564069703920 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.358+0000 7f7c75498740 1 --2- 172.21.15.152:0/3873582455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.358+0000 7f7c75498740 1 -- 172.21.15.152:0/3873582455 >> 172.21.15.152:0/3873582455 conn(0x5640696aa310 msgr2=0x5640696e80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.358+0000 7f7c75498740 1 -- 172.21.15.152:0/3873582455 shutdown_connections 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.358+0000 7f7c75498740 1 -- 172.21.15.152:0/3873582455 wait complete. 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.358+0000 7f7c75498740 1 -- start start 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.358+0000 7f7c75498740 1 Processor -- start 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.359+0000 7f7c75498740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.359+0000 7f7c75498740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696e2b40 0x5640696f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.359+0000 7f7c75498740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696ec370 0x5640696efb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.359+0000 7f7c75498740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c1a1ee0 con 0x5640696ec370 2024-09-11T22:15:34.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.359+0000 7f7c7165c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.359+0000 7f7c7165c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696f47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:48132/0 (socket says 172.21.15.152:48132) 2024-09-11T22:15:34.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.359+0000 7f7c7165c640 1 -- 172.21.15.152:0/1342656106 learned_addr learned my addr 172.21.15.152:0/1342656106 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:34.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c75498740 1 -- 172.21.15.152:0/1342656106 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c1bc3b0 con 0x5640696e2b40 2024-09-11T22:15:34.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c75498740 1 -- 172.21.15.152:0/1342656106 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c1a25b0 con 0x5640696e15d0 2024-09-11T22:15:34.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c75498740 10 client.0 _ll_register_callbacks cb 0x7f7c5c0f3df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:34.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c6bfff640 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696e2b40 0x5640696f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c7165c640 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696ec370 0x5640696efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c6bfff640 1 -- 172.21.15.152:0/1342656106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 msgr2=0x5640696f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:34.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c6bfff640 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c6bfff640 1 -- 172.21.15.152:0/1342656106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696ec370 msgr2=0x5640696efb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:34.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c6bfff640 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696ec370 0x5640696efb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c6bfff640 1 -- 172.21.15.152:0/1342656106 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640696f03c0 con 0x5640696e2b40 2024-09-11T22:15:34.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c6bfff640 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696e2b40 0x5640696f4cf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5640696e7710 tx=0x7f7c64005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53f2ba38f9765c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:34.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.360+0000 7f7c4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:15:34.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c4bfff640 1 -- 172.21.15.152:0/1342656106 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64003aa0 con 0x5640696e2b40 2024-09-11T22:15:34.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c4bfff640 1 -- 172.21.15.152:0/1342656106 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f7c64021030 con 0x5640696e2b40 2024-09-11T22:15:34.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c75498740 1 -- 172.21.15.152:0/1342656106 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c64005500 con 0x5640696e2b40 2024-09-11T22:15:34.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c4bfff640 1 -- 172.21.15.152:0/1342656106 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7c64032050 con 0x5640696e2b40 2024-09-11T22:15:34.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c75498740 10 client.27548 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:34.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c75498740 1 -- 172.21.15.152:0/1342656106 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5640697664d0 con 0x5640696e2b40 2024-09-11T22:15:34.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c4bfff640 1 -- 172.21.15.152:0/1342656106 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c64005500 con 0x5640696e2b40 2024-09-11T22:15:34.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c4bfff640 1 -- 172.21.15.152:0/1342656106 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7c640049e0 con 0x5640696e2b40 2024-09-11T22:15:34.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c75498740 10 client.27548 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:34.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c75498740 10 client.27548 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:34.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c75498740 20 client.27548 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:34.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c75498740 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564069766b60 0x564069768f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:34.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c75498740 4 client.27548 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:15:34.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c75498740 1 -- 172.21.15.152:0/1342656106 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56406964ed70 con 0x564069766b60 2024-09-11T22:15:34.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.361+0000 7f7c7165c640 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564069766b60 0x564069768f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:34.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c4bfff640 10 client.27548 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:34.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c7165c640 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564069766b60 0x564069768f80 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15fe239067a9917b server_cookie=29a3a141c4d1cf71 in_seq=0 out_seq=0 2024-09-11T22:15:34.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c4bfff640 1 -- 172.21.15.152:0/1342656106 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56406964ed70 con 0x564069766b60 2024-09-11T22:15:34.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c4bfff640 10 client.27548 handle_command_reply: tid=0 2024-09-11T22:15:34.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c75498740 1 client.27548 shutdown 2024-09-11T22:15:34.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c75498740 1 -- 172.21.15.152:0/1342656106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696e2b40 msgr2=0x5640696f4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:34.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c75498740 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696e2b40 0x5640696f4cf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5640696e7710 tx=0x7f7c64005dc0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c75498740 1 -- 172.21.15.152:0/1342656106 shutdown_connections 2024-09-11T22:15:34.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c75498740 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564069766b60 0x564069768f80 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c75498740 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5640696ec370 0x5640696efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c4bfff640 0 client.27548 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:34.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c75498740 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640696e2b40 0x5640696f4cf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c75498740 1 --2- 172.21.15.152:0/1342656106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5640696e15d0 0x5640696f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c75498740 1 -- 172.21.15.152:0/1342656106 >> 172.21.15.152:0/1342656106 conn(0x5640696aa310 msgr2=0x5640696ea840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:34.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c75498740 1 -- 172.21.15.152:0/1342656106 shutdown_connections 2024-09-11T22:15:34.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.362+0000 7f7c75498740 1 -- 172.21.15.152:0/1342656106 wait complete. 2024-09-11T22:15:34.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.363+0000 7f7c75498740 20 client.27548 trim_cache size 0 max 16384 2024-09-11T22:15:34.374 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:15:34.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 -- 172.21.15.152:0/885399942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c580a2e40 msgr2=0x7f7c580a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:34.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c580a2e40 0x7f7c580a5300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0ede80 tx=0x7f7c5c0f2040 comp rx=0 tx=0).stop 2024-09-11T22:15:34.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 -- 172.21.15.152:0/885399942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c6c100a80 msgr2=0x7f7c6c111410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:34.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c6c100a80 0x7f7c6c111410 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c02ae00 tx=0x7f7c5c031e60 comp rx=0 tx=0).stop 2024-09-11T22:15:34.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 -- 172.21.15.152:0/885399942 shutdown_connections 2024-09-11T22:15:34.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7c580a2e40 0x7f7c580a5300 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c6c106a80 0x7f7c6c111e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c6c101420 0x7f7c6c111950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 --2- 172.21.15.152:0/885399942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c6c100a80 0x7f7c6c111410 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:34.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 -- 172.21.15.152:0/885399942 >> 172.21.15.152:0/885399942 conn(0x7f7c6c0fc7a0 msgr2=0x7f7c6c104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:34.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 -- 172.21.15.152:0/885399942 shutdown_connections 2024-09-11T22:15:34.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:34.364+0000 7f7c730bf640 1 -- 172.21.15.152:0/885399942 wait complete. 2024-09-11T22:15:34.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 600.0 s, 2242.0 tps, lat 48.778 ms stddev 84.367 2024-09-11T22:15:35.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:35 smithi152 ceph-mon[31188]: pgmap v351: 97 pgs: 97 active+clean; 4.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-09-11T22:15:35.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:35 smithi179 ceph-mon[35603]: pgmap v351: 97 pgs: 97 active+clean; 4.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-09-11T22:15:35.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:35 smithi193 ceph-mon[35545]: pgmap v351: 97 pgs: 97 active+clean; 4.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-09-11T22:15:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.035+0000 7f7762d6d640 1 -- 172.21.15.152:0/1573884246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f775c102ca0 msgr2=0x7f775c103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.035+0000 7f7762d6d640 1 --2- 172.21.15.152:0/1573884246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f775c102ca0 0x7f775c103080 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f7758009900 tx=0x7f775802a410 comp rx=0 tx=0).stop 2024-09-11T22:15:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.035+0000 7f7762d6d640 1 -- 172.21.15.152:0/1573884246 shutdown_connections 2024-09-11T22:15:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.035+0000 7f7762d6d640 1 --2- 172.21.15.152:0/1573884246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f775c10c0d0 0x7f775c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.035+0000 7f7762d6d640 1 --2- 172.21.15.152:0/1573884246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f775c1035c0 0x7f775c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.035+0000 7f7762d6d640 1 --2- 172.21.15.152:0/1573884246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f775c102ca0 0x7f775c103080 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.035+0000 7f7762d6d640 1 -- 172.21.15.152:0/1573884246 >> 172.21.15.152:0/1573884246 conn(0x7f775c0fc6b0 msgr2=0x7f775c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.035+0000 7f7762d6d640 1 -- 172.21.15.152:0/1573884246 shutdown_connections 2024-09-11T22:15:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.035+0000 7f7762d6d640 1 -- 172.21.15.152:0/1573884246 wait complete. 2024-09-11T22:15:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7762d6d640 1 Processor -- start 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7762d6d640 1 -- start start 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7762d6d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f775c102ca0 0x7f775c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7762d6d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f775c1035c0 0x7f775c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7762d6d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f775c10c0d0 0x7f775c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7762d6d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f775c111ed0 con 0x7f775c10c0d0 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7762d6d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f775c111d50 con 0x7f775c102ca0 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7762d6d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f775c112050 con 0x7f775c1035c0 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f776130a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f775c10c0d0 0x7f775c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7760b09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f775c102ca0 0x7f775c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f776130a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f775c10c0d0 0x7f775c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44130/0 (socket says 172.21.15.152:44130) 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7753fff640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f775c1035c0 0x7f775c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f776130a640 1 -- 172.21.15.152:0/1624456254 learned_addr learned my addr 172.21.15.152:0/1624456254 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7760b09640 1 -- 172.21.15.152:0/1624456254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f775c1035c0 msgr2=0x7f775c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7760b09640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f775c1035c0 0x7f775c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7760b09640 1 -- 172.21.15.152:0/1624456254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f775c10c0d0 msgr2=0x7f775c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7760b09640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f775c10c0d0 0x7f775c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f7760b09640 1 -- 172.21.15.152:0/1624456254 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c19d3d0 con 0x7f775c102ca0 2024-09-11T22:15:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.036+0000 7f776130a640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f775c10c0d0 0x7f775c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.037+0000 7f7760b09640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f775c102ca0 0x7f775c1983e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7758005940 tx=0x7f77580042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.037+0000 7f7751ffb640 1 -- 172.21.15.152:0/1624456254 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775803f030 con 0x7f775c102ca0 2024-09-11T22:15:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.037+0000 7f7751ffb640 1 -- 172.21.15.152:0/1624456254 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7758031990 con 0x7f775c102ca0 2024-09-11T22:15:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.037+0000 7f7751ffb640 1 -- 172.21.15.152:0/1624456254 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758035070 con 0x7f775c102ca0 2024-09-11T22:15:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.038+0000 7f7762d6d640 1 -- 172.21.15.152:0/1624456254 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c19d660 con 0x7f775c102ca0 2024-09-11T22:15:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.039+0000 7f7762d6d640 1 -- 172.21.15.152:0/1624456254 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c1a4f50 con 0x7f775c102ca0 2024-09-11T22:15:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.041+0000 7f7751ffb640 1 -- 172.21.15.152:0/1624456254 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f7758042030 con 0x7f775c102ca0 2024-09-11T22:15:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7765beb740 1 Processor -- start 2024-09-11T22:15:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7765beb740 1 -- start start 2024-09-11T22:15:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7765beb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272344a10 0x55a272344df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7765beb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272345330 0x55a272353b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7765beb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 0x55a2723564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7765beb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a2722a92f0 con 0x55a272345330 2024-09-11T22:15:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7765beb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a272251270 con 0x55a2723540c0 2024-09-11T22:15:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7765beb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a2722a52b0 con 0x55a272344a10 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7751ffb640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77440a2f00 0x7f77440a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7760b09640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272345330 0x55a272353b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7753fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 0x55a2723564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7753fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 0x55a2723564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55098/0 (socket says 172.21.15.152:55098) 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7753fff640 1 -- 172.21.15.152:0/3950631213 learned_addr learned my addr 172.21.15.152:0/3950631213 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f7751ffb640 1 -- 172.21.15.152:0/1624456254 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f77580ef670 con 0x7f775c102ca0 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.042+0000 7f776130a640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77440a2f00 0x7f77440a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f7753fff640 1 -- 172.21.15.152:0/3950631213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272344a10 msgr2=0x55a272344df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f776130a640 1 --2- 172.21.15.152:0/3950631213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272344a10 0x55a272344df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f7753fff640 1 --2- 172.21.15.152:0/3950631213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272344a10 0x55a272344df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f7753fff640 1 -- 172.21.15.152:0/3950631213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272345330 msgr2=0x55a272353b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f7753fff640 1 --2- 172.21.15.152:0/3950631213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272345330 0x55a272353b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f7753fff640 1 -- 172.21.15.152:0/3950631213 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a272250340 con 0x55a2723540c0 2024-09-11T22:15:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f776130a640 1 --2- 172.21.15.152:0/3950631213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272344a10 0x55a272344df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f7753fff640 1 --2- 172.21.15.152:0/3950631213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 0x55a2723564b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f774c009c60 tx=0x7f774c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c1ad5e4fb36b3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f776130a640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77440a2f00 0x7f77440a53c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f77540049d0 tx=0x7f7754011460 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f7742ffd640 1 -- 172.21.15.152:0/3950631213 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c004220 con 0x55a2723540c0 2024-09-11T22:15:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f7742ffd640 1 -- 172.21.15.152:0/3950631213 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f774c009e10 con 0x55a2723540c0 2024-09-11T22:15:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.043+0000 7f7742ffd640 1 -- 172.21.15.152:0/3950631213 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c019790 con 0x55a2723540c0 2024-09-11T22:15:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.044+0000 7f7765beb740 1 -- 172.21.15.152:0/3950631213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 msgr2=0x55a2723564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.044+0000 7f7765beb740 1 --2- 172.21.15.152:0/3950631213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 0x55a2723564b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f774c009c60 tx=0x7f774c011810 comp rx=0 tx=0).stop 2024-09-11T22:15:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.044+0000 7f7765beb740 1 -- 172.21.15.152:0/3950631213 shutdown_connections 2024-09-11T22:15:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.044+0000 7f7765beb740 1 --2- 172.21.15.152:0/3950631213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 0x55a2723564b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.044+0000 7f7765beb740 1 --2- 172.21.15.152:0/3950631213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272345330 0x55a272353b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.044+0000 7f7765beb740 1 --2- 172.21.15.152:0/3950631213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272344a10 0x55a272344df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.044+0000 7f7765beb740 1 -- 172.21.15.152:0/3950631213 >> 172.21.15.152:0/3950631213 conn(0x55a272341060 msgr2=0x55a272341440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.044+0000 7f7765beb740 1 -- 172.21.15.152:0/3950631213 shutdown_connections 2024-09-11T22:15:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.044+0000 7f7765beb740 1 -- 172.21.15.152:0/3950631213 wait complete. 2024-09-11T22:15:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.044+0000 7f7765beb740 1 -- start start 2024-09-11T22:15:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.044+0000 7f7765beb740 1 Processor -- start 2024-09-11T22:15:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f7765beb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a272344a10 0x55a272350ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f7765beb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272345330 0x55a272351410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f7765beb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2723540c0 0x55a272351950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f7765beb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a272356c90 con 0x55a2723540c0 2024-09-11T22:15:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f7765beb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a272232290 con 0x55a272344a10 2024-09-11T22:15:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f7765beb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a272356e10 con 0x55a272345330 2024-09-11T22:15:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f7765beb740 10 client.0 _ll_register_callbacks cb 0x55a272263140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f776130a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2723540c0 0x55a272351950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f776130a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2723540c0 0x55a272351950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44140/0 (socket says 172.21.15.152:44140) 2024-09-11T22:15:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f7753fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272345330 0x55a272351410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f7760b09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a272344a10 0x55a272350ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f776130a640 1 -- 172.21.15.152:0/3329026257 learned_addr learned my addr 172.21.15.152:0/3329026257 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f776130a640 1 -- 172.21.15.152:0/3329026257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272345330 msgr2=0x55a272351410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f776130a640 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272345330 0x55a272351410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f776130a640 1 -- 172.21.15.152:0/3329026257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a272344a10 msgr2=0x55a272350ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f776130a640 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a272344a10 0x55a272350ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f776130a640 1 -- 172.21.15.152:0/3329026257 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a271fbc210 con 0x55a2723540c0 2024-09-11T22:15:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f7760b09640 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a272344a10 0x55a272350ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f776130a640 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2723540c0 0x55a272351950 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f7754010650 tx=0x7f7754004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19214d5bce36cc06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f773bfff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f773bfff640 1 -- 172.21.15.152:0/3329026257 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775401f6c0 con 0x55a2723540c0 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f773bfff640 1 -- 172.21.15.152:0/3329026257 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f775401f860 con 0x55a2723540c0 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.045+0000 7f7765beb740 1 -- 172.21.15.152:0/3329026257 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f774c009e10 con 0x55a2723540c0 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f773bfff640 1 -- 172.21.15.152:0/3329026257 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f775402e050 con 0x55a2723540c0 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f7765beb740 10 client.18267 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f7765beb740 1 -- 172.21.15.152:0/3329026257 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a272088620 con 0x55a2723540c0 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f773bfff640 1 -- 172.21.15.152:0/3329026257 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f774c009e10 con 0x55a2723540c0 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f773bfff640 1 -- 172.21.15.152:0/3329026257 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7754027c40 con 0x55a2723540c0 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f7765beb740 10 client.18267 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f7765beb740 10 client.18267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f7765beb740 20 client.18267 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f7765beb740 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a272363f60 0x55a2723663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f7765beb740 4 client.18267 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f7765beb740 1 -- 172.21.15.152:0/3329026257 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2722b6a20 con 0x55a272363f60 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.046+0000 7f7760b09640 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a272363f60 0x55a2723663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.047+0000 7f7760b09640 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a272363f60 0x55a2723663b0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83fd9ae66d94cb6a server_cookie=120c587b08d8d8b8 in_seq=0 out_seq=0 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.048+0000 7f773bfff640 10 client.18267 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.048+0000 7f773bfff640 1 -- 172.21.15.152:0/3329026257 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2722b6a20 con 0x55a272363f60 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.048+0000 7f773bfff640 10 client.18267 handle_command_reply: tid=0 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.048+0000 7f7765beb740 1 client.18267 shutdown 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f7765beb740 1 -- 172.21.15.152:0/3329026257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2723540c0 msgr2=0x55a272351950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f7765beb740 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2723540c0 0x55a272351950 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f7754010650 tx=0x7f7754004ab0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f7765beb740 1 -- 172.21.15.152:0/3329026257 shutdown_connections 2024-09-11T22:15:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f7765beb740 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a272363f60 0x55a2723663b0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f7765beb740 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2723540c0 0x55a272351950 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f7765beb740 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272345330 0x55a272351410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f7765beb740 1 --2- 172.21.15.152:0/3329026257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a272344a10 0x55a272350ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f773bfff640 0 client.18267 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f7765beb740 1 -- 172.21.15.152:0/3329026257 >> 172.21.15.152:0/3329026257 conn(0x55a272341060 msgr2=0x55a272346d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f7765beb740 1 -- 172.21.15.152:0/3329026257 shutdown_connections 2024-09-11T22:15:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f7765beb740 1 -- 172.21.15.152:0/3329026257 wait complete. 2024-09-11T22:15:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.049+0000 7f7765beb740 20 client.18267 trim_cache size 0 max 16384 2024-09-11T22:15:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7765beb740 1 Processor -- start 2024-09-11T22:15:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7765beb740 1 -- start start 2024-09-11T22:15:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7765beb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27236bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7765beb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272345330 0x55a27236c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7765beb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 0x55a27234e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7765beb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1adfa0 con 0x55a272344a10 2024-09-11T22:15:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7765beb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1ab870 con 0x55a2723540c0 2024-09-11T22:15:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7765beb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1a96e0 con 0x55a272345330 2024-09-11T22:15:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7760b09640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27236bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7760b09640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27236bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44150/0 (socket says 172.21.15.152:44150) 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7760b09640 1 -- 172.21.15.152:0/319823864 learned_addr learned my addr 172.21.15.152:0/319823864 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f776130a640 1 --2- 172.21.15.152:0/319823864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 0x55a27234e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.067+0000 7f7753fff640 1 --2- 172.21.15.152:0/319823864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272345330 0x55a27236c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.068+0000 7f7760b09640 1 -- 172.21.15.152:0/319823864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272345330 msgr2=0x55a27236c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.068+0000 7f7760b09640 1 --2- 172.21.15.152:0/319823864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272345330 0x55a27236c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.068+0000 7f7760b09640 1 -- 172.21.15.152:0/319823864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 msgr2=0x55a27234e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.068+0000 7f7760b09640 1 --2- 172.21.15.152:0/319823864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 0x55a27234e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.068+0000 7f7760b09640 1 -- 172.21.15.152:0/319823864 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a272340e90 con 0x55a272344a10 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.068+0000 7f776130a640 1 --2- 172.21.15.152:0/319823864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 0x55a27234e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.068+0000 7f7760b09640 1 --2- 172.21.15.152:0/319823864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27236bd10 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f77580bbb70 tx=0x7f775808ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6b68cbadad0dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.068+0000 7f77427fc640 1 -- 172.21.15.152:0/319823864 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580bce60 con 0x55a272344a10 2024-09-11T22:15:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.068+0000 7f77427fc640 1 -- 172.21.15.152:0/319823864 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77580bbbe0 con 0x55a272344a10 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.068+0000 7f77427fc640 1 -- 172.21.15.152:0/319823864 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758049040 con 0x55a272344a10 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.069+0000 7f7765beb740 1 -- 172.21.15.152:0/319823864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 msgr2=0x55a27236bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.069+0000 7f7765beb740 1 --2- 172.21.15.152:0/319823864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27236bd10 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f77580bbb70 tx=0x7f775808ecd0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.069+0000 7f7765beb740 1 -- 172.21.15.152:0/319823864 shutdown_connections 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.069+0000 7f7765beb740 1 --2- 172.21.15.152:0/319823864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2723540c0 0x55a27234e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.069+0000 7f7765beb740 1 --2- 172.21.15.152:0/319823864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a272345330 0x55a27236c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.069+0000 7f7765beb740 1 --2- 172.21.15.152:0/319823864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27236bd10 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.069+0000 7f7765beb740 1 -- 172.21.15.152:0/319823864 >> 172.21.15.152:0/319823864 conn(0x55a272341060 msgr2=0x55a272352f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.069+0000 7f7765beb740 1 -- 172.21.15.152:0/319823864 shutdown_connections 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.069+0000 7f7765beb740 1 -- 172.21.15.152:0/319823864 wait complete. 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.069+0000 7f7765beb740 1 -- start start 2024-09-11T22:15:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.069+0000 7f7765beb740 1 Processor -- start 2024-09-11T22:15:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7765beb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27235c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7765beb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a272345330 0x55a27234dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7765beb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2723540c0 0x55a27234e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7765beb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1a9d30 con 0x55a272344a10 2024-09-11T22:15:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7765beb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1ab1a0 con 0x55a272345330 2024-09-11T22:15:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7765beb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1aa400 con 0x55a2723540c0 2024-09-11T22:15:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7765beb740 10 client.0 _ll_register_callbacks cb 0x7f7754011f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7760b09640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27235c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7760b09640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27235c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44166/0 (socket says 172.21.15.152:44166) 2024-09-11T22:15:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7760b09640 1 -- 172.21.15.152:0/2250080049 learned_addr learned my addr 172.21.15.152:0/2250080049 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7753fff640 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a272345330 0x55a27234dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f776130a640 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2723540c0 0x55a27234e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7760b09640 1 -- 172.21.15.152:0/2250080049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2723540c0 msgr2=0x55a27234e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7760b09640 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2723540c0 0x55a27234e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7760b09640 1 -- 172.21.15.152:0/2250080049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a272345330 msgr2=0x55a27234dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7760b09640 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a272345330 0x55a27234dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7760b09640 1 -- 172.21.15.152:0/2250080049 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a27234e8e0 con 0x55a272344a10 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7760b09640 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27235c820 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7758004290 tx=0x7f77580bffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7ab02a57a082f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f773bfff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f773bfff640 1 -- 172.21.15.152:0/2250080049 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580d4070 con 0x55a272344a10 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f773bfff640 1 -- 172.21.15.152:0/2250080049 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f77580b8250 con 0x55a272344a10 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7765beb740 1 -- 172.21.15.152:0/2250080049 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77580bbbe0 con 0x55a272344a10 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f773bfff640 1 -- 172.21.15.152:0/2250080049 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77580bce60 con 0x55a272344a10 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.070+0000 7f7765beb740 10 client.18273 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.071+0000 7f7765beb740 1 -- 172.21.15.152:0/2250080049 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a2723ceca0 con 0x55a272344a10 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.071+0000 7f773bfff640 1 -- 172.21.15.152:0/2250080049 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77580bbbe0 con 0x55a272344a10 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.071+0000 7f773bfff640 1 -- 172.21.15.152:0/2250080049 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f775803bc70 con 0x55a272344a10 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.071+0000 7f7765beb740 10 client.18273 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.071+0000 7f7765beb740 10 client.18273 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.071+0000 7f7765beb740 20 client.18273 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.071+0000 7f7765beb740 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a272363f60 0x55a2723d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.071+0000 7f7765beb740 4 client.18273 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:15:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.071+0000 7f7765beb740 1 -- 172.21.15.152:0/2250080049 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a2722b0d70 con 0x55a272363f60 2024-09-11T22:15:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.071+0000 7f7753fff640 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a272363f60 0x55a2723d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.073+0000 7f7753fff640 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a272363f60 0x55a2723d1310 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b3af01fc7eb8fe6 server_cookie=84c648ce5894c948 in_seq=0 out_seq=0 2024-09-11T22:15:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.073+0000 7f773bfff640 10 client.18273 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f773bfff640 1 -- 172.21.15.152:0/2250080049 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a2722b0d70 con 0x55a272363f60 2024-09-11T22:15:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f773bfff640 10 client.18273 handle_command_reply: tid=0 2024-09-11T22:15:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 1 client.18273 shutdown 2024-09-11T22:15:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 1 -- 172.21.15.152:0/2250080049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 msgr2=0x55a27235c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27235c820 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7758004290 tx=0x7f77580bffd0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 1 -- 172.21.15.152:0/2250080049 shutdown_connections 2024-09-11T22:15:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a272363f60 0x55a2723d1310 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2723540c0 0x55a27234e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a272345330 0x55a27234dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 1 --2- 172.21.15.152:0/2250080049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a272344a10 0x55a27235c820 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 1 -- 172.21.15.152:0/2250080049 >> 172.21.15.152:0/2250080049 conn(0x55a272341060 msgr2=0x55a27233f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f773bfff640 0 client.18273 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 1 -- 172.21.15.152:0/2250080049 shutdown_connections 2024-09-11T22:15:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 1 -- 172.21.15.152:0/2250080049 wait complete. 2024-09-11T22:15:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.132+0000 7f7765beb740 20 client.18273 trim_cache size 0 max 16384 2024-09-11T22:15:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:15:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:15:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:15:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:15:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 -- 172.21.15.152:0/1624456254 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77440a2f00 msgr2=0x7f77440a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77440a2f00 0x7f77440a53c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f77540049d0 tx=0x7f7754011460 comp rx=0 tx=0).stop 2024-09-11T22:15:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 -- 172.21.15.152:0/1624456254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f775c102ca0 msgr2=0x7f775c1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f775c102ca0 0x7f775c1983e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7758005940 tx=0x7f77580042f0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 -- 172.21.15.152:0/1624456254 shutdown_connections 2024-09-11T22:15:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77440a2f00 0x7f77440a53c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f775c10c0d0 0x7f775c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f775c1035c0 0x7f775c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 --2- 172.21.15.152:0/1624456254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f775c102ca0 0x7f775c1983e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 -- 172.21.15.152:0/1624456254 >> 172.21.15.152:0/1624456254 conn(0x7f775c0fc6b0 msgr2=0x7f775c0fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 -- 172.21.15.152:0/1624456254 shutdown_connections 2024-09-11T22:15:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:36.133+0000 7f7762d6d640 1 -- 172.21.15.152:0/1624456254 wait complete. 2024-09-11T22:15:36.147 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:15:36.147 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:15:36.475 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:15:37.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.009+0000 7f0b31a95640 1 -- 172.21.15.152:0/1199603345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b2c102ef0 msgr2=0x7f0b2c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.009+0000 7f0b31a95640 1 --2- 172.21.15.152:0/1199603345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b2c102ef0 0x7f0b2c10da40 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009ca0 tx=0x7f0b2402a950 comp rx=0 tx=0).stop 2024-09-11T22:15:37.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.009+0000 7f0b31a95640 1 -- 172.21.15.152:0/1199603345 shutdown_connections 2024-09-11T22:15:37.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.009+0000 7f0b31a95640 1 --2- 172.21.15.152:0/1199603345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b2c102ef0 0x7f0b2c10da40 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.009+0000 7f0b31a95640 1 --2- 172.21.15.152:0/1199603345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b2c102570 0x7f0b2c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.009+0000 7f0b31a95640 1 --2- 172.21.15.152:0/1199603345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b2c100e20 0x7f0b2c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.009+0000 7f0b31a95640 1 -- 172.21.15.152:0/1199603345 >> 172.21.15.152:0/1199603345 conn(0x7f0b2c0fc7d0 msgr2=0x7f0b2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:37.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.009+0000 7f0b31a95640 1 -- 172.21.15.152:0/1199603345 shutdown_connections 2024-09-11T22:15:37.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.009+0000 7f0b31a95640 1 -- 172.21.15.152:0/1199603345 wait complete. 2024-09-11T22:15:37.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.011+0000 7f0b31a95640 1 Processor -- start 2024-09-11T22:15:37.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b31a95640 1 -- start start 2024-09-11T22:15:37.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b31a95640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b2c100e20 0x7f0b2c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b31a95640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b2c102570 0x7f0b2c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b31a95640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b2c102ef0 0x7f0b2c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b31a95640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c110f80 con 0x7f0b2c100e20 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b31a95640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c110e00 con 0x7f0b2c102ef0 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b31a95640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c111100 con 0x7f0b2c102570 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b2c100e20 0x7f0b2c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b2c100e20 0x7f0b2c1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44176/0 (socket says 172.21.15.152:44176) 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b2b7fe640 1 -- 172.21.15.152:0/3207812212 learned_addr learned my addr 172.21.15.152:0/3207812212 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b2bfff640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b2c102ef0 0x7f0b2c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b2affd640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b2c102570 0x7f0b2c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b2b7fe640 1 -- 172.21.15.152:0/3207812212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b2c102570 msgr2=0x7f0b2c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b2b7fe640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b2c102570 0x7f0b2c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b2b7fe640 1 -- 172.21.15.152:0/3207812212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b2c102ef0 msgr2=0x7f0b2c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b2b7fe640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b2c102ef0 0x7f0b2c19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b2b7fe640 1 -- 172.21.15.152:0/3207812212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c19d460 con 0x7f0b2c100e20 2024-09-11T22:15:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.012+0000 7f0b2bfff640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b2c102ef0 0x7f0b2c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.013+0000 7f0b2b7fe640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b2c100e20 0x7f0b2c1984b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00e9f0 tx=0x7f0b1c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.013+0000 7f0b28ff9640 1 -- 172.21.15.152:0/3207812212 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00cd80 con 0x7f0b2c100e20 2024-09-11T22:15:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.013+0000 7f0b31a95640 1 -- 172.21.15.152:0/3207812212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2c19d750 con 0x7f0b2c100e20 2024-09-11T22:15:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.013+0000 7f0b31a95640 1 -- 172.21.15.152:0/3207812212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2c1a5030 con 0x7f0b2c100e20 2024-09-11T22:15:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.013+0000 7f0b28ff9640 1 -- 172.21.15.152:0/3207812212 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b1c010910 con 0x7f0b2c100e20 2024-09-11T22:15:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.013+0000 7f0b28ff9640 1 -- 172.21.15.152:0/3207812212 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c0188f0 con 0x7f0b2c100e20 2024-09-11T22:15:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.016+0000 7f0b28ff9640 1 -- 172.21.15.152:0/3207812212 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0b1c018bb0 con 0x7f0b2c100e20 2024-09-11T22:15:37.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.016+0000 7f0b33e6e740 1 Processor -- start 2024-09-11T22:15:37.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.016+0000 7f0b33e6e740 1 -- start start 2024-09-11T22:15:37.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.016+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b32b60 0x5654b2b32f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.016+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b33480 0x5654b2b3d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b40130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b33e6e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5654b2a98280 con 0x5654b2b33480 2024-09-11T22:15:37.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b33e6e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5654b2a3fb10 con 0x5654b2b3dd40 2024-09-11T22:15:37.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b33e6e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5654b2a94240 con 0x5654b2b32b60 2024-09-11T22:15:37.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b33480 0x5654b2b3d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b28ff9640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0b140a2d70 0x7f0b140a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b32b60 0x5654b2b32f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b40130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b40130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55168/0 (socket says 172.21.15.152:55168) 2024-09-11T22:15:37.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b32b60 0x5654b2b32f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:48204/0 (socket says 172.21.15.152:48204) 2024-09-11T22:15:37.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2affd640 1 -- 172.21.15.152:0/917166658 learned_addr learned my addr 172.21.15.152:0/917166658 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b28ff9640 1 -- 172.21.15.152:0/3207812212 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f0b1c0cf6e0 con 0x7f0b2c100e20 2024-09-11T22:15:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2bfff640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0b140a2d70 0x7f0b140a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2affd640 1 -- 172.21.15.152:0/917166658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b32b60 msgr2=0x5654b2b32f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2affd640 1 --2- 172.21.15.152:0/917166658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b32b60 0x5654b2b32f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2affd640 1 -- 172.21.15.152:0/917166658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b33480 msgr2=0x5654b2b3d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2affd640 1 --2- 172.21.15.152:0/917166658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b33480 0x5654b2b3d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2affd640 1 -- 172.21.15.152:0/917166658 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654b2a4c1f0 con 0x5654b2b3dd40 2024-09-11T22:15:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b2affd640 1 --2- 172.21.15.152:0/917166658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b40130 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009ca0 tx=0x7f0b20011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58333e7bb7cae4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.017+0000 7f0b11ffb640 1 -- 172.21.15.152:0/917166658 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2001e070 con 0x5654b2b3dd40 2024-09-11T22:15:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.018+0000 7f0b11ffb640 1 -- 172.21.15.152:0/917166658 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b20019b10 con 0x5654b2b3dd40 2024-09-11T22:15:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.018+0000 7f0b11ffb640 1 -- 172.21.15.152:0/917166658 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2000eae0 con 0x5654b2b3dd40 2024-09-11T22:15:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.018+0000 7f0b33e6e740 1 -- 172.21.15.152:0/917166658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 msgr2=0x5654b2b40130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.018+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/917166658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b40130 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009ca0 tx=0x7f0b20011810 comp rx=0 tx=0).stop 2024-09-11T22:15:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.018+0000 7f0b2bfff640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0b140a2d70 0x7f0b140a5230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0b24004af0 tx=0x7f0b2402a950 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.019+0000 7f0b33e6e740 1 -- 172.21.15.152:0/917166658 shutdown_connections 2024-09-11T22:15:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.019+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/917166658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b40130 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.019+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/917166658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b33480 0x5654b2b3d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.019+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/917166658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b32b60 0x5654b2b32f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.019+0000 7f0b33e6e740 1 -- 172.21.15.152:0/917166658 >> 172.21.15.152:0/917166658 conn(0x5654b2b2f0f0 msgr2=0x5654b2b2f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.020+0000 7f0b33e6e740 1 -- 172.21.15.152:0/917166658 shutdown_connections 2024-09-11T22:15:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.020+0000 7f0b33e6e740 1 -- 172.21.15.152:0/917166658 wait complete. 2024-09-11T22:15:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.020+0000 7f0b33e6e740 1 -- start start 2024-09-11T22:15:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b33e6e740 1 Processor -- start 2024-09-11T22:15:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b32b60 0x5654b2b3ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b33480 0x5654b2b3b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b3dd40 0x5654b2b3b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b33e6e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5654b2b40960 con 0x5654b2b3dd40 2024-09-11T22:15:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b2affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b33480 0x5654b2b3b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b2bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b3dd40 0x5654b2b3b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b2affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b33480 0x5654b2b3b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55178/0 (socket says 172.21.15.152:55178) 2024-09-11T22:15:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b2affd640 1 -- 172.21.15.152:0/3416646316 learned_addr learned my addr 172.21.15.152:0/3416646316 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b33e6e740 1 -- 172.21.15.152:0/3416646316 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5654b2a52f10 con 0x5654b2b33480 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b33e6e740 1 -- 172.21.15.152:0/3416646316 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5654b2b40ae0 con 0x5654b2b32b60 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b2b7fe640 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b32b60 0x5654b2b3ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.021+0000 7f0b33e6e740 10 client.0 _ll_register_callbacks cb 0x5654b2a1ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.022+0000 7f0b2affd640 1 -- 172.21.15.152:0/3416646316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b32b60 msgr2=0x5654b2b3ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.022+0000 7f0b2affd640 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b32b60 0x5654b2b3ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.022+0000 7f0b2affd640 1 -- 172.21.15.152:0/3416646316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b3dd40 msgr2=0x5654b2b3b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.022+0000 7f0b2affd640 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b3dd40 0x5654b2b3b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.022+0000 7f0b2affd640 1 -- 172.21.15.152:0/3416646316 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654b28096a0 con 0x5654b2b33480 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.022+0000 7f0b2affd640 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b33480 0x5654b2b3b140 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009c70 tx=0x7f0b2000e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d840d429af57e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.022+0000 7f0b0affd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.022+0000 7f0b0affd640 1 -- 172.21.15.152:0/3416646316 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20027030 con 0x5654b2b33480 2024-09-11T22:15:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.022+0000 7f0b0affd640 1 -- 172.21.15.152:0/3416646316 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f0b20005260 con 0x5654b2b33480 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.022+0000 7f0b33e6e740 1 -- 172.21.15.152:0/3416646316 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b20019b10 con 0x5654b2b33480 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b0affd640 1 -- 172.21.15.152:0/3416646316 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0b2001e070 con 0x5654b2b33480 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b33e6e740 10 client.27578 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b33e6e740 1 -- 172.21.15.152:0/3416646316 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5654b2b54d90 con 0x5654b2b33480 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b0affd640 1 -- 172.21.15.152:0/3416646316 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b20019b10 con 0x5654b2b33480 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b0affd640 1 -- 172.21.15.152:0/3416646316 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f0b20004750 con 0x5654b2b33480 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b33e6e740 10 client.27578 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b33e6e740 10 client.27578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b33e6e740 20 client.27578 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654b2b56250 0x5654b2b58640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b33e6e740 4 client.27578 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b33e6e740 1 -- 172.21.15.152:0/3416646316 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654b2aa57f0 con 0x5654b2b56250 2024-09-11T22:15:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.023+0000 7f0b2b7fe640 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654b2b56250 0x5654b2b58640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.024+0000 7f0b2b7fe640 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654b2b56250 0x5654b2b58640 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6b1007f626f3289 server_cookie=79525d48378f65b in_seq=0 out_seq=0 2024-09-11T22:15:37.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.024+0000 7f0b0affd640 10 client.27578 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:37.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.024+0000 7f0b0affd640 1 -- 172.21.15.152:0/3416646316 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654b2aa57f0 con 0x5654b2b56250 2024-09-11T22:15:37.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.024+0000 7f0b0affd640 10 client.27578 handle_command_reply: tid=0 2024-09-11T22:15:37.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 1 client.27578 shutdown 2024-09-11T22:15:37.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 1 -- 172.21.15.152:0/3416646316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b33480 msgr2=0x5654b2b3b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b33480 0x5654b2b3b140 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009c70 tx=0x7f0b2000e640 comp rx=0 tx=0).stop 2024-09-11T22:15:37.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 1 -- 172.21.15.152:0/3416646316 shutdown_connections 2024-09-11T22:15:37.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654b2b56250 0x5654b2b58640 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b0affd640 0 client.27578 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:37.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b3dd40 0x5654b2b3b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b33480 0x5654b2b3b140 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/3416646316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b32b60 0x5654b2b3ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 1 -- 172.21.15.152:0/3416646316 >> 172.21.15.152:0/3416646316 conn(0x5654b2b2f0f0 msgr2=0x5654b2b34e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:37.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 1 -- 172.21.15.152:0/3416646316 shutdown_connections 2024-09-11T22:15:37.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 1 -- 172.21.15.152:0/3416646316 wait complete. 2024-09-11T22:15:37.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.025+0000 7f0b33e6e740 20 client.27578 trim_cache size 0 max 16384 2024-09-11T22:15:37.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.047+0000 7f0b33e6e740 1 Processor -- start 2024-09-11T22:15:37.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.047+0000 7f0b33e6e740 1 -- start start 2024-09-11T22:15:37.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.047+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b32b60 0x5654b2b3ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.047+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b33480 0x5654b2b5deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.047+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b5e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.047+0000 7f0b33e6e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b18011170 con 0x5654b2b32b60 2024-09-11T22:15:37.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.047+0000 7f0b33e6e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1800ea40 con 0x5654b2b3dd40 2024-09-11T22:15:37.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.047+0000 7f0b33e6e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1800c8b0 con 0x5654b2b33480 2024-09-11T22:15:37.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b32b60 0x5654b2b3ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b5e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b5e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55192/0 (socket says 172.21.15.152:55192) 2024-09-11T22:15:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b32b60 0x5654b2b3ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44204/0 (socket says 172.21.15.152:44204) 2024-09-11T22:15:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2bfff640 1 -- 172.21.15.152:0/1823597593 learned_addr learned my addr 172.21.15.152:0/1823597593 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2affd640 1 --2- 172.21.15.152:0/1823597593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b33480 0x5654b2b5deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2bfff640 1 -- 172.21.15.152:0/1823597593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b33480 msgr2=0x5654b2b5deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2bfff640 1 --2- 172.21.15.152:0/1823597593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b33480 0x5654b2b5deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2bfff640 1 -- 172.21.15.152:0/1823597593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b32b60 msgr2=0x5654b2b3ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2bfff640 1 --2- 172.21.15.152:0/1823597593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b32b60 0x5654b2b3ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2bfff640 1 -- 172.21.15.152:0/1823597593 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654b2b2ef20 con 0x5654b2b3dd40 2024-09-11T22:15:37.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b2bfff640 1 --2- 172.21.15.152:0/1823597593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b5e3f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0b24006010 tx=0x7f0b24004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b979fd4289df082a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b117fa640 1 -- 172.21.15.152:0/1823597593 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24054070 con 0x5654b2b3dd40 2024-09-11T22:15:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b117fa640 1 -- 172.21.15.152:0/1823597593 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b24003b70 con 0x5654b2b3dd40 2024-09-11T22:15:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.048+0000 7f0b117fa640 1 -- 172.21.15.152:0/1823597593 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24034040 con 0x5654b2b3dd40 2024-09-11T22:15:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.050+0000 7f0b33e6e740 1 -- 172.21.15.152:0/1823597593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 msgr2=0x5654b2b5e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.050+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/1823597593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b5e3f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0b24006010 tx=0x7f0b24004a40 comp rx=0 tx=0).stop 2024-09-11T22:15:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.050+0000 7f0b33e6e740 1 -- 172.21.15.152:0/1823597593 shutdown_connections 2024-09-11T22:15:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.050+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/1823597593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b3dd40 0x5654b2b5e3f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.050+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/1823597593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b33480 0x5654b2b5deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.050+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/1823597593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b32b60 0x5654b2b3ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.050+0000 7f0b33e6e740 1 -- 172.21.15.152:0/1823597593 >> 172.21.15.152:0/1823597593 conn(0x5654b2b2f0f0 msgr2=0x5654b2b3c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.050+0000 7f0b33e6e740 1 -- 172.21.15.152:0/1823597593 shutdown_connections 2024-09-11T22:15:37.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.050+0000 7f0b33e6e740 1 -- 172.21.15.152:0/1823597593 wait complete. 2024-09-11T22:15:37.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.051+0000 7f0b33e6e740 1 -- start start 2024-09-11T22:15:37.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.051+0000 7f0b33e6e740 1 Processor -- start 2024-09-11T22:15:37.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.051+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b32b60 0x5654b2b4a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.051+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b33480 0x5654b2b4ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.051+0000 7f0b33e6e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b3dd40 0x5654b2bbfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.051+0000 7f0b33e6e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1800cf00 con 0x5654b2b33480 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.051+0000 7f0b33e6e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1800e370 con 0x5654b2b32b60 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.051+0000 7f0b33e6e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1800d5d0 con 0x5654b2b3dd40 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.051+0000 7f0b33e6e740 10 client.0 _ll_register_callbacks cb 0x7f0b2001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.051+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b32b60 0x5654b2b4a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b2affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b33480 0x5654b2b4ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b32b60 0x5654b2b4a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55204/0 (socket says 172.21.15.152:55204) 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b2b7fe640 1 -- 172.21.15.152:0/2698954979 learned_addr learned my addr 172.21.15.152:0/2698954979 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b2bfff640 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b3dd40 0x5654b2bbfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b2b7fe640 1 -- 172.21.15.152:0/2698954979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b3dd40 msgr2=0x5654b2bbfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b2b7fe640 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b3dd40 0x5654b2bbfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b2b7fe640 1 -- 172.21.15.152:0/2698954979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b33480 msgr2=0x5654b2b4ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b2b7fe640 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b33480 0x5654b2b4ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b2b7fe640 1 -- 172.21.15.152:0/2698954979 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654b2bc03c0 con 0x5654b2b32b60 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b2affd640 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b33480 0x5654b2b4ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b2b7fe640 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b32b60 0x5654b2b4a750 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0cce80 tx=0x7f0b1c09b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d14c441286eaf54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b0affd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b0affd640 1 -- 172.21.15.152:0/2698954979 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c026040 con 0x5654b2b32b60 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b33e6e740 1 -- 172.21.15.152:0/2698954979 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b24003b70 con 0x5654b2b32b60 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b0affd640 1 -- 172.21.15.152:0/2698954979 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f0b1c0982c0 con 0x5654b2b32b60 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b0affd640 1 -- 172.21.15.152:0/2698954979 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0b1c0cfb90 con 0x5654b2b32b60 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b33e6e740 10 client.27584 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b33e6e740 1 -- 172.21.15.152:0/2698954979 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5654b2bc15e0 con 0x5654b2b32b60 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.052+0000 7f0b0affd640 1 -- 172.21.15.152:0/2698954979 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b24003b70 con 0x5654b2b32b60 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.053+0000 7f0b0affd640 1 -- 172.21.15.152:0/2698954979 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f0b1c0d2ce0 con 0x5654b2b32b60 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.053+0000 7f0b33e6e740 10 client.27584 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.053+0000 7f0b33e6e740 10 client.27584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:37.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.053+0000 7f0b33e6e740 20 client.27584 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:37.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.053+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654b2b56250 0x5654b2bc3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.053+0000 7f0b33e6e740 4 client.27584 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:15:37.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.053+0000 7f0b33e6e740 1 -- 172.21.15.152:0/2698954979 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5654b2a9fd00 con 0x5654b2b56250 2024-09-11T22:15:37.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.053+0000 7f0b2affd640 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654b2b56250 0x5654b2bc3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.053+0000 7f0b0affd640 10 client.27584 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:37.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.053+0000 7f0b2affd640 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654b2b56250 0x5654b2bc3cc0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=101e29aa980a9cf8 server_cookie=93d5eb61334b51df in_seq=0 out_seq=0 2024-09-11T22:15:37.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.055+0000 7f0b0affd640 1 -- 172.21.15.152:0/2698954979 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5654b2a9fd00 con 0x5654b2b56250 2024-09-11T22:15:37.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.055+0000 7f0b0affd640 10 client.27584 handle_command_reply: tid=0 2024-09-11T22:15:37.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.055+0000 7f0b33e6e740 1 client.27584 shutdown 2024-09-11T22:15:37.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b33e6e740 1 -- 172.21.15.152:0/2698954979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b32b60 msgr2=0x5654b2b4a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b32b60 0x5654b2b4a750 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0cce80 tx=0x7f0b1c09b8b0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b33e6e740 1 -- 172.21.15.152:0/2698954979 shutdown_connections 2024-09-11T22:15:37.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5654b2b56250 0x5654b2bc3cc0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654b2b3dd40 0x5654b2bbfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654b2b33480 0x5654b2b4ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b33e6e740 1 --2- 172.21.15.152:0/2698954979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654b2b32b60 0x5654b2b4a750 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b0affd640 0 client.27584 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:37.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b33e6e740 1 -- 172.21.15.152:0/2698954979 >> 172.21.15.152:0/2698954979 conn(0x5654b2b2f0f0 msgr2=0x5654b2b51cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:37.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b33e6e740 1 -- 172.21.15.152:0/2698954979 shutdown_connections 2024-09-11T22:15:37.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b33e6e740 1 -- 172.21.15.152:0/2698954979 wait complete. 2024-09-11T22:15:37.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.056+0000 7f0b33e6e740 20 client.27584 trim_cache size 0 max 16384 2024-09-11T22:15:37.061 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:15:37.061 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:15:37.061 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "5c02a832-40bf-467b-b0d7-008e646242d0", 2024-09-11T22:15:37.061 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:15:37.061 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:15:37.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 -- 172.21.15.152:0/3207812212 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0b140a2d70 msgr2=0x7f0b140a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0b140a2d70 0x7f0b140a5230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0b24004af0 tx=0x7f0b2402a950 comp rx=0 tx=0).stop 2024-09-11T22:15:37.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 -- 172.21.15.152:0/3207812212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b2c100e20 msgr2=0x7f0b2c1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b2c100e20 0x7f0b2c1984b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00e9f0 tx=0x7f0b1c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 -- 172.21.15.152:0/3207812212 shutdown_connections 2024-09-11T22:15:37.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0b140a2d70 0x7f0b140a5230 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b2c102ef0 0x7f0b2c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b2c102570 0x7f0b2c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 --2- 172.21.15.152:0/3207812212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b2c100e20 0x7f0b2c1984b0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 -- 172.21.15.152:0/3207812212 >> 172.21.15.152:0/3207812212 conn(0x7f0b2c0fc7d0 msgr2=0x7f0b2c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:37.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 -- 172.21.15.152:0/3207812212 shutdown_connections 2024-09-11T22:15:37.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:37.057+0000 7f0b31a95640 1 -- 172.21.15.152:0/3207812212 wait complete. 2024-09-11T22:15:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:37 smithi152 ceph-mon[31188]: pgmap v352: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 27 MiB/s wr, 1.78k op/s 2024-09-11T22:15:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:37 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:15:37.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:37 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:15:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:37 smithi179 ceph-mon[35603]: pgmap v352: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 27 MiB/s wr, 1.78k op/s 2024-09-11T22:15:37.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:37 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:15:37.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:37 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:15:37.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:37 smithi193 ceph-mon[35545]: pgmap v352: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 27 MiB/s wr, 1.78k op/s 2024-09-11T22:15:37.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:37 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:15:37.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:37 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:15:37.866 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:15:38.220 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:15:38.701 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:38 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:15:38.702 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:38 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:15:38.702 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:38 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:15:38.702 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:38 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:15:38.702 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:38 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:15:38.702 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:38 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:15:38.702 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:38 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:15:38.702 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:38 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:15:38.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:38 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:15:38.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:38 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:15:38.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:38 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:15:38.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:38 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:15:38.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:38 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:15:38.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:38 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:15:38.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:38 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:15:38.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:38 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:15:38.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.813+0000 7f92efbb1640 1 -- 172.21.15.152:0/2010007701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92e810ae80 msgr2=0x7f92e8113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.813+0000 7f92efbb1640 1 --2- 172.21.15.152:0/2010007701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92e810ae80 0x7f92e8113370 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009900 tx=0x7f92d802a410 comp rx=0 tx=0).stop 2024-09-11T22:15:38.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.814+0000 7f92efbb1640 1 -- 172.21.15.152:0/2010007701 shutdown_connections 2024-09-11T22:15:38.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.814+0000 7f92efbb1640 1 --2- 172.21.15.152:0/2010007701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e8113940 0x7f92e8115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.814+0000 7f92efbb1640 1 --2- 172.21.15.152:0/2010007701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92e810ae80 0x7f92e8113370 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.814+0000 7f92efbb1640 1 --2- 172.21.15.152:0/2010007701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92e810a560 0x7f92e810a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.814+0000 7f92efbb1640 1 -- 172.21.15.152:0/2010007701 >> 172.21.15.152:0/2010007701 conn(0x7f92e806e140 msgr2=0x7f92e806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.814+0000 7f92efbb1640 1 -- 172.21.15.152:0/2010007701 shutdown_connections 2024-09-11T22:15:38.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.814+0000 7f92efbb1640 1 -- 172.21.15.152:0/2010007701 wait complete. 2024-09-11T22:15:38.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.815+0000 7f92efbb1640 1 Processor -- start 2024-09-11T22:15:38.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.815+0000 7f92efbb1640 1 -- start start 2024-09-11T22:15:38.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.815+0000 7f92efbb1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92e810a560 0x7f92e8113df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.815+0000 7f92efbb1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92e810ae80 0x7f92e8114330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.815+0000 7f92efbb1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e8113940 0x7f92e8114870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.815+0000 7f92efbb1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f92e8119660 con 0x7f92e810a560 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92efbb1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81194e0 con 0x7f92e8113940 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92efbb1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81197e0 con 0x7f92e810ae80 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ee14e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e8113940 0x7f92e8114870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ed14c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92e810ae80 0x7f92e8114330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ee14e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e8113940 0x7f92e8114870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55218/0 (socket says 172.21.15.152:55218) 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ee14e640 1 -- 172.21.15.152:0/3807483545 learned_addr learned my addr 172.21.15.152:0/3807483545 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ed14c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92e810ae80 0x7f92e8114330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:48240/0 (socket says 172.21.15.152:48240) 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ed94d640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92e810a560 0x7f92e8113df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ee14e640 1 -- 172.21.15.152:0/3807483545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92e810ae80 msgr2=0x7f92e8114330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ee14e640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92e810ae80 0x7f92e8114330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ee14e640 1 -- 172.21.15.152:0/3807483545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92e810a560 msgr2=0x7f92e8113df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ee14e640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92e810a560 0x7f92e8113df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ee14e640 1 -- 172.21.15.152:0/3807483545 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e81b3620 con 0x7f92e8113940 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92ee14e640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e8113940 0x7f92e8114870 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f92e000eb10 tx=0x7f92e000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92deffd640 1 -- 172.21.15.152:0/3807483545 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0004b20 con 0x7f92e8113940 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.817+0000 7f92efbb1640 1 -- 172.21.15.152:0/3807483545 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e81b3850 con 0x7f92e8113940 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.816+0000 7f92deffd640 1 -- 172.21.15.152:0/3807483545 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e0004cc0 con 0x7f92e8113940 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.817+0000 7f92efbb1640 1 -- 172.21.15.152:0/3807483545 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e81b3db0 con 0x7f92e8113940 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.817+0000 7f92deffd640 1 -- 172.21.15.152:0/3807483545 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0010760 con 0x7f92e8113940 2024-09-11T22:15:38.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.819+0000 7f92deffd640 1 -- 172.21.15.152:0/3807483545 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f92e0005020 con 0x7f92e8113940 2024-09-11T22:15:38.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.820+0000 7f92f1f8a740 1 Processor -- start 2024-09-11T22:15:38.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.820+0000 7f92deffd640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92d40a2d70 0x7f92d40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.820+0000 7f92f1f8a740 1 -- start start 2024-09-11T22:15:38.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.820+0000 7f92deffd640 1 -- 172.21.15.152:0/3807483545 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f92e00cfbf0 con 0x7f92e8113940 2024-09-11T22:15:38.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.820+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147f4a0 0x55ac7147f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.820+0000 7f92ed14c640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92d40a2d70 0x7f92d40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.820+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 0x55ac7148a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.820+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 0x55ac7148ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.820+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ac713e52e0 con 0x55ac7148a680 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.820+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ac7138cce0 con 0x55ac7147f4a0 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.820+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ac713e12a0 con 0x55ac7147fdc0 2024-09-11T22:15:38.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ed94d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147f4a0 0x55ac7147f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ed94d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147f4a0 0x55ac7147f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55232/0 (socket says 172.21.15.152:55232) 2024-09-11T22:15:38.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ed94d640 1 -- 172.21.15.152:0/1627687722 learned_addr learned my addr 172.21.15.152:0/1627687722 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:38.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ee14e640 1 --2- 172.21.15.152:0/1627687722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 0x55ac7148ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ed14c640 1 --2- 172.21.15.152:0/1627687722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 0x55ac7148a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ee14e640 1 -- 172.21.15.152:0/1627687722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 msgr2=0x55ac7148a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:38.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ee14e640 1 --2- 172.21.15.152:0/1627687722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 0x55ac7148a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ee14e640 1 -- 172.21.15.152:0/1627687722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147f4a0 msgr2=0x55ac7147f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:38.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ee14e640 1 --2- 172.21.15.152:0/1627687722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147f4a0 0x55ac7147f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ee14e640 1 -- 172.21.15.152:0/1627687722 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac71371440 con 0x55ac7148a680 2024-09-11T22:15:38.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ed14c640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92d40a2d70 0x7f92d40a5230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f92e81a4db0 tx=0x7f92d8005d50 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.821+0000 7f92ee14e640 1 --2- 172.21.15.152:0/1627687722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 0x55ac7148ca70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f92e00cd2e0 tx=0x7f92e009bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71d89c0ec0b53fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.822+0000 7f92d3fff640 1 -- 172.21.15.152:0/1627687722 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e009c0b0 con 0x55ac7148a680 2024-09-11T22:15:38.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.822+0000 7f92d3fff640 1 -- 172.21.15.152:0/1627687722 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e00a0460 con 0x55ac7148a680 2024-09-11T22:15:38.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.822+0000 7f92d3fff640 1 -- 172.21.15.152:0/1627687722 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0098720 con 0x55ac7148a680 2024-09-11T22:15:38.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:38 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:15:38.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:38 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:15:38.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:38 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:15:38.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:38 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:15:38.830 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:38 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:15:38.831 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:38 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:15:38.831 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:38 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:15:38.831 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:38 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:15:38.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.823+0000 7f92f1f8a740 1 -- 172.21.15.152:0/1627687722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 msgr2=0x55ac7148ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.823+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/1627687722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 0x55ac7148ca70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f92e00cd2e0 tx=0x7f92e009bf40 comp rx=0 tx=0).stop 2024-09-11T22:15:38.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.823+0000 7f92f1f8a740 1 -- 172.21.15.152:0/1627687722 shutdown_connections 2024-09-11T22:15:38.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.823+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/1627687722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 0x55ac7148ca70 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.823+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/1627687722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 0x55ac7148a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.823+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/1627687722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147f4a0 0x55ac7147f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.823+0000 7f92f1f8a740 1 -- 172.21.15.152:0/1627687722 >> 172.21.15.152:0/1627687722 conn(0x55ac7147ba30 msgr2=0x55ac7147be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.823+0000 7f92f1f8a740 1 -- 172.21.15.152:0/1627687722 shutdown_connections 2024-09-11T22:15:38.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.823+0000 7f92f1f8a740 1 -- 172.21.15.152:0/1627687722 wait complete. 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.824+0000 7f92f1f8a740 1 -- start start 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.824+0000 7f92f1f8a740 1 Processor -- start 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.824+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 0x55ac7148a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.824+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147fdc0 0x55ac714872c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.824+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7148a680 0x55ac71487840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.824+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ac7148d1f0 con 0x55ac7147f4a0 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.824+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ac713a0050 con 0x55ac7147fdc0 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.824+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ac7148d370 con 0x55ac7148a680 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.824+0000 7f92f1f8a740 10 client.0 _ll_register_callbacks cb 0x55ac713e0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ed14c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147fdc0 0x55ac714872c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ee14e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7148a680 0x55ac71487840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ed14c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147fdc0 0x55ac714872c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:55236/0 (socket says 172.21.15.152:55236) 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ed14c640 1 -- 172.21.15.152:0/2894579696 learned_addr learned my addr 172.21.15.152:0/2894579696 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ed94d640 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 0x55ac7148a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ee14e640 1 -- 172.21.15.152:0/2894579696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147fdc0 msgr2=0x55ac714872c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ee14e640 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147fdc0 0x55ac714872c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ee14e640 1 -- 172.21.15.152:0/2894579696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 msgr2=0x55ac7148a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ee14e640 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 0x55ac7148a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ee14e640 1 -- 172.21.15.152:0/2894579696 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac711563c0 con 0x55ac7148a680 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ed14c640 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147fdc0 0x55ac714872c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ed94d640 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 0x55ac7148a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2894579696 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92e00a0460 con 0x55ac7148a680 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92ee14e640 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7148a680 0x55ac71487840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55ac7147cdb0 tx=0x7f92e009bfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=239c92e7ea6f953e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92d17fa640 10 client.27739 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:15:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.825+0000 7f92d17fa640 1 -- 172.21.15.152:0/2894579696 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e00b4070 con 0x55ac7148a680 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92d17fa640 1 -- 172.21.15.152:0/2894579696 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f92e00a00d0 con 0x55ac7148a680 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92d17fa640 1 -- 172.21.15.152:0/2894579696 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f92e009c0b0 con 0x55ac7148a680 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92f1f8a740 10 client.27739 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2894579696 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55ac7148d220 con 0x55ac7148a680 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92d17fa640 1 -- 172.21.15.152:0/2894579696 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f92e0098720 con 0x55ac7148a680 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92f1f8a740 10 client.27739 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92f1f8a740 10 client.27739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92f1f8a740 20 client.27739 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac71499c20 0x55ac7149c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92f1f8a740 4 client.27739 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2894579696 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac713f2850 con 0x55ac71499c20 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.826+0000 7f92ed94d640 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac71499c20 0x55ac7149c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.827+0000 7f92ed94d640 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac71499c20 0x55ac7149c010 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=904fdf7a167466d6 server_cookie=5f63f89f3b20e50d in_seq=0 out_seq=0 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.827+0000 7f92d17fa640 10 client.27739 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92d17fa640 1 -- 172.21.15.152:0/2894579696 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac713f2850 con 0x55ac71499c20 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92d17fa640 10 client.27739 handle_command_reply: tid=0 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 1 client.27739 shutdown 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2894579696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7148a680 msgr2=0x55ac71487840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7148a680 0x55ac71487840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55ac7147cdb0 tx=0x7f92e009bfb0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2894579696 shutdown_connections 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac71499c20 0x55ac7149c010 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92d17fa640 0 client.27739 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7148a680 0x55ac71487840 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147fdc0 0x55ac714872c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2894579696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 0x55ac7148a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2894579696 >> 172.21.15.152:0/2894579696 conn(0x55ac7147ba30 msgr2=0x55ac71481710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2894579696 shutdown_connections 2024-09-11T22:15:38.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2894579696 wait complete. 2024-09-11T22:15:38.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.828+0000 7f92f1f8a740 20 client.27739 trim_cache size 0 max 16384 2024-09-11T22:15:38.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.855+0000 7f92f1f8a740 1 Processor -- start 2024-09-11T22:15:38.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.855+0000 7f92f1f8a740 1 -- start start 2024-09-11T22:15:38.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.855+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147f4a0 0x55ac71496450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.855+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 0x55ac714827f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.855+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 0x55ac714a1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.855+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81bf0a0 con 0x55ac7148a680 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.855+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81bc970 con 0x55ac7147f4a0 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.855+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81ba7e0 con 0x55ac7147fdc0 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.856+0000 7f92ee14e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 0x55ac714a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.856+0000 7f92ee14e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 0x55ac714a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44256/0 (socket says 172.21.15.152:44256) 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.856+0000 7f92ee14e640 1 -- 172.21.15.152:0/1177820412 learned_addr learned my addr 172.21.15.152:0/1177820412 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.857+0000 7f92ed94d640 1 --2- 172.21.15.152:0/1177820412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147f4a0 0x55ac71496450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.857+0000 7f92ee14e640 1 -- 172.21.15.152:0/1177820412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 msgr2=0x55ac714827f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.857+0000 7f92ee14e640 1 --2- 172.21.15.152:0/1177820412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 0x55ac714827f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.857+0000 7f92ee14e640 1 -- 172.21.15.152:0/1177820412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147f4a0 msgr2=0x55ac71496450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.857+0000 7f92ee14e640 1 --2- 172.21.15.152:0/1177820412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147f4a0 0x55ac71496450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.857+0000 7f92ee14e640 1 -- 172.21.15.152:0/1177820412 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac7147cbc0 con 0x55ac7148a680 2024-09-11T22:15:38.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.858+0000 7f92ee14e640 1 --2- 172.21.15.152:0/1177820412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 0x55ac714a1640 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f92e009c040 tx=0x7f92e00057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31889168b3e337d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.858+0000 7f92d37fe640 1 -- 172.21.15.152:0/1177820412 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e00b4070 con 0x55ac7148a680 2024-09-11T22:15:38.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.858+0000 7f92d37fe640 1 -- 172.21.15.152:0/1177820412 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e00a0460 con 0x55ac7148a680 2024-09-11T22:15:38.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.858+0000 7f92d37fe640 1 -- 172.21.15.152:0/1177820412 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0005570 con 0x55ac7148a680 2024-09-11T22:15:38.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.860+0000 7f92f1f8a740 1 -- 172.21.15.152:0/1177820412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 msgr2=0x55ac714a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.860+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/1177820412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 0x55ac714a1640 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f92e009c040 tx=0x7f92e00057d0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.864+0000 7f92f1f8a740 1 -- 172.21.15.152:0/1177820412 shutdown_connections 2024-09-11T22:15:38.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.865+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/1177820412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7148a680 0x55ac714a1640 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.865+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/1177820412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 0x55ac714827f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.865+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/1177820412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7147f4a0 0x55ac71496450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.865+0000 7f92f1f8a740 1 -- 172.21.15.152:0/1177820412 >> 172.21.15.152:0/1177820412 conn(0x55ac7147ba30 msgr2=0x55ac714820e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.874+0000 7f92f1f8a740 1 -- 172.21.15.152:0/1177820412 shutdown_connections 2024-09-11T22:15:38.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.876+0000 7f92f1f8a740 1 -- 172.21.15.152:0/1177820412 wait complete. 2024-09-11T22:15:38.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.876+0000 7f92f1f8a740 1 -- start start 2024-09-11T22:15:38.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.876+0000 7f92f1f8a740 1 Processor -- start 2024-09-11T22:15:38.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.878+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 0x55ac71484230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.878+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 0x55ac71484770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.878+0000 7f92f1f8a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7148a680 0x55ac71484cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.878+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81bae30 con 0x55ac7147f4a0 2024-09-11T22:15:38.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.878+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81bc2a0 con 0x55ac7148a680 2024-09-11T22:15:38.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.878+0000 7f92f1f8a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81bb500 con 0x55ac7147fdc0 2024-09-11T22:15:38.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.878+0000 7f92f1f8a740 10 client.0 _ll_register_callbacks cb 0x7f92e0098350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:38.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92ee14e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7148a680 0x55ac71484cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92ed94d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 0x55ac71484230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92ed94d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 0x55ac71484230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44260/0 (socket says 172.21.15.152:44260) 2024-09-11T22:15:38.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92ed94d640 1 -- 172.21.15.152:0/2879976496 learned_addr learned my addr 172.21.15.152:0/2879976496 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:38.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92ed14c640 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 0x55ac71484770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92ed94d640 1 -- 172.21.15.152:0/2879976496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 msgr2=0x55ac71484770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:38.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92ed94d640 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 0x55ac71484770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92ed94d640 1 -- 172.21.15.152:0/2879976496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7148a680 msgr2=0x55ac71484cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:38.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92ed94d640 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7148a680 0x55ac71484cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92ed94d640 1 -- 172.21.15.152:0/2879976496 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac71503610 con 0x55ac7147f4a0 2024-09-11T22:15:38.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92ed94d640 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 0x55ac71484230 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f92e4005d70 tx=0x7f92e4012a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1941ac56e82cb1b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.879+0000 7f92d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:15:38.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.880+0000 7f92d17fa640 1 -- 172.21.15.152:0/2879976496 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e402c060 con 0x55ac7147f4a0 2024-09-11T22:15:38.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.880+0000 7f92d17fa640 1 -- 172.21.15.152:0/2879976496 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f92e401f990 con 0x55ac7147f4a0 2024-09-11T22:15:38.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.880+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2879976496 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92e00a0460 con 0x55ac7147f4a0 2024-09-11T22:15:38.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.880+0000 7f92d17fa640 1 -- 172.21.15.152:0/2879976496 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f92e401fb90 con 0x55ac7147f4a0 2024-09-11T22:15:38.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.880+0000 7f92f1f8a740 10 client.18309 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:38.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.880+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2879976496 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ac71504880 con 0x55ac7147f4a0 2024-09-11T22:15:38.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.881+0000 7f92d17fa640 1 -- 172.21.15.152:0/2879976496 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e00a0460 con 0x55ac7147f4a0 2024-09-11T22:15:38.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.881+0000 7f92d17fa640 1 -- 172.21.15.152:0/2879976496 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f92e401e400 con 0x55ac7147f4a0 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.881+0000 7f92f1f8a740 10 client.18309 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.881+0000 7f92f1f8a740 10 client.18309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.881+0000 7f92f1f8a740 20 client.18309 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.881+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac71499c20 0x55ac71506f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.881+0000 7f92f1f8a740 4 client.18309 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.881+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2879976496 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ac713ecd60 con 0x55ac71499c20 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.881+0000 7f92ed14c640 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac71499c20 0x55ac71506f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.882+0000 7f92d17fa640 10 client.18309 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.882+0000 7f92ed14c640 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac71499c20 0x55ac71506f60 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f384f9e7705d30d server_cookie=da509f15dcb9aec9 in_seq=0 out_seq=0 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.882+0000 7f92d17fa640 1 -- 172.21.15.152:0/2879976496 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ac713ecd60 con 0x55ac71499c20 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.882+0000 7f92d17fa640 10 client.18309 handle_command_reply: tid=0 2024-09-11T22:15:38.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.882+0000 7f92f1f8a740 1 client.18309 shutdown 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.882+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2879976496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 msgr2=0x55ac71484230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.882+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 0x55ac71484230 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f92e4005d70 tx=0x7f92e4012a40 comp rx=0 tx=0).stop 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2879976496 shutdown_connections 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55ac71499c20 0x55ac71506f60 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac7148a680 0x55ac71484cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ac7147fdc0 0x55ac71484770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92f1f8a740 1 --2- 172.21.15.152:0/2879976496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac7147f4a0 0x55ac71484230 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2879976496 >> 172.21.15.152:0/2879976496 conn(0x55ac7147ba30 msgr2=0x55ac71482870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92d17fa640 0 client.18309 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2879976496 shutdown_connections 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92f1f8a740 1 -- 172.21.15.152:0/2879976496 wait complete. 2024-09-11T22:15:38.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92f1f8a740 20 client.18309 trim_cache size 0 max 16384 2024-09-11T22:15:38.887 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:15:38.887 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:15:38.887 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:15:38.887 INFO:teuthology.orchestra.run.smithi152.stdout: "5c02a832-40bf-467b-b0d7-008e646242d0": { 2024-09-11T22:15:38.887 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:15:38.887 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "5c02a832-40bf-467b-b0d7-008e646242d0", 2024-09-11T22:15:38.887 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:15:38.887 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:15:38.887 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:15:38.887 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:15:38.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92efbb1640 1 -- 172.21.15.152:0/3807483545 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92d40a2d70 msgr2=0x7f92d40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.883+0000 7f92efbb1640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92d40a2d70 0x7f92d40a5230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f92e81a4db0 tx=0x7f92d8005d50 comp rx=0 tx=0).stop 2024-09-11T22:15:38.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.884+0000 7f92efbb1640 1 -- 172.21.15.152:0/3807483545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e8113940 msgr2=0x7f92e8114870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.884+0000 7f92efbb1640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e8113940 0x7f92e8114870 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f92e000eb10 tx=0x7f92e000c2d0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.884+0000 7f92efbb1640 1 -- 172.21.15.152:0/3807483545 shutdown_connections 2024-09-11T22:15:38.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.884+0000 7f92efbb1640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f92d40a2d70 0x7f92d40a5230 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.884+0000 7f92efbb1640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e8113940 0x7f92e8114870 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.884+0000 7f92efbb1640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92e810ae80 0x7f92e8114330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.884+0000 7f92efbb1640 1 --2- 172.21.15.152:0/3807483545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92e810a560 0x7f92e8113df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.884+0000 7f92efbb1640 1 -- 172.21.15.152:0/3807483545 >> 172.21.15.152:0/3807483545 conn(0x7f92e806e140 msgr2=0x7f92e80718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.884+0000 7f92efbb1640 1 -- 172.21.15.152:0/3807483545 shutdown_connections 2024-09-11T22:15:38.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:15:38.884+0000 7f92efbb1640 1 -- 172.21.15.152:0/3807483545 wait complete. 2024-09-11T22:15:39.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:39 smithi152 ceph-mon[31188]: pgmap v353: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 1.59k op/s 2024-09-11T22:15:39.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:39 smithi179 ceph-mon[35603]: pgmap v353: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 1.59k op/s 2024-09-11T22:15:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 605.0 s, 2229.2 tps, lat 45.126 ms stddev 50.981 2024-09-11T22:15:39.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:39 smithi193 ceph-mon[35545]: pgmap v353: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 1.59k op/s 2024-09-11T22:15:40.009 INFO:tasks.cephfs.filesystem:scrub status for tag:5c02a832-40bf-467b-b0d7-008e646242d0 - {'path': '/', 'tag': '5c02a832-40bf-467b-b0d7-008e646242d0', 'options': 'recursive,force'} 2024-09-11T22:15:41.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:41 smithi152 ceph-mon[31188]: pgmap v354: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 28 MiB/s wr, 1.94k op/s 2024-09-11T22:15:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:41 smithi179 ceph-mon[35603]: pgmap v354: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 28 MiB/s wr, 1.94k op/s 2024-09-11T22:15:41.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:41 smithi193 ceph-mon[35545]: pgmap v354: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 28 MiB/s wr, 1.94k op/s 2024-09-11T22:15:43.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:43 smithi152 ceph-mon[31188]: pgmap v355: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 1.66k op/s 2024-09-11T22:15:43.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:43 smithi179 ceph-mon[35603]: pgmap v355: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 1.66k op/s 2024-09-11T22:15:43.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:43 smithi193 ceph-mon[35545]: pgmap v355: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 1.66k op/s 2024-09-11T22:15:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:44 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:15:44.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:44 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:15:44.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:44 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:15:44.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:44 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:15:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 610.0 s, 2998.2 tps, lat 33.443 ms stddev 37.142 2024-09-11T22:15:44.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:44 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:15:44.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:44 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:15:45.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:45 smithi152 ceph-mon[31188]: pgmap v356: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 MiB/s wr, 1.86k op/s 2024-09-11T22:15:45.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:45 smithi179 ceph-mon[35603]: pgmap v356: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 MiB/s wr, 1.86k op/s 2024-09-11T22:15:45.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:45 smithi193 ceph-mon[35545]: pgmap v356: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 MiB/s wr, 1.86k op/s 2024-09-11T22:15:47.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:47 smithi152 ceph-mon[31188]: pgmap v357: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 1.32k op/s 2024-09-11T22:15:47.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:47 smithi179 ceph-mon[35603]: pgmap v357: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 1.32k op/s 2024-09-11T22:15:47.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:47 smithi193 ceph-mon[35545]: pgmap v357: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 1.32k op/s 2024-09-11T22:15:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.244+0000 7f2ced50c640 1 -- 172.21.15.152:0/3521422319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ce81069e0 msgr2=0x7f2ce8106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.244+0000 7f2ced50c640 1 --2- 172.21.15.152:0/3521422319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ce81069e0 0x7f2ce8106dc0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009930 tx=0x7f2cd802a420 comp rx=0 tx=0).stop 2024-09-11T22:15:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.244+0000 7f2ced50c640 1 -- 172.21.15.152:0/3521422319 shutdown_connections 2024-09-11T22:15:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.244+0000 7f2ced50c640 1 --2- 172.21.15.152:0/3521422319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce8101370 0x7f2ce810d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.244+0000 7f2ced50c640 1 --2- 172.21.15.152:0/3521422319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce81009d0 0x7f2ce8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.244+0000 7f2ced50c640 1 --2- 172.21.15.152:0/3521422319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ce81069e0 0x7f2ce8106dc0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.244+0000 7f2ced50c640 1 -- 172.21.15.152:0/3521422319 >> 172.21.15.152:0/3521422319 conn(0x7f2ce80fc6b0 msgr2=0x7f2ce80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.244+0000 7f2ced50c640 1 -- 172.21.15.152:0/3521422319 shutdown_connections 2024-09-11T22:15:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.244+0000 7f2ced50c640 1 -- 172.21.15.152:0/3521422319 wait complete. 2024-09-11T22:15:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.245+0000 7f2ced50c640 1 Processor -- start 2024-09-11T22:15:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.245+0000 7f2ced50c640 1 -- start start 2024-09-11T22:15:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ced50c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce81009d0 0x7f2ce8197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ced50c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ce8101370 0x7f2ce81977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ced50c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce81069e0 0x7f2ce819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ced50c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8110e70 con 0x7f2ce8101370 2024-09-11T22:15:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ced50c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8110cf0 con 0x7f2ce81009d0 2024-09-11T22:15:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ced50c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8110ff0 con 0x7f2ce81069e0 2024-09-11T22:15:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce67fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ce8101370 0x7f2ce81977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce67fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ce8101370 0x7f2ce81977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44048/0 (socket says 172.21.15.152:44048) 2024-09-11T22:15:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce67fc640 1 -- 172.21.15.152:0/2166789442 learned_addr learned my addr 172.21.15.152:0/2166789442 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce6ffd640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce81009d0 0x7f2ce8197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce77fe640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce81069e0 0x7f2ce819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce67fc640 1 -- 172.21.15.152:0/2166789442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce81069e0 msgr2=0x7f2ce819bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce67fc640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce81069e0 0x7f2ce819bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce67fc640 1 -- 172.21.15.152:0/2166789442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce81009d0 msgr2=0x7f2ce8197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce67fc640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce81009d0 0x7f2ce8197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce67fc640 1 -- 172.21.15.152:0/2166789442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce819c280 con 0x7f2ce8101370 2024-09-11T22:15:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce77fe640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce81069e0 0x7f2ce819bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ce67fc640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ce8101370 0x7f2ce81977d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00e9f0 tx=0x7f2cdc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ccffff640 1 -- 172.21.15.152:0/2166789442 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc00cd80 con 0x7f2ce8101370 2024-09-11T22:15:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ccffff640 1 -- 172.21.15.152:0/2166789442 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cdc005500 con 0x7f2ce8101370 2024-09-11T22:15:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ced50c640 1 -- 172.21.15.152:0/2166789442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce819c570 con 0x7f2ce8101370 2024-09-11T22:15:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.246+0000 7f2ccffff640 1 -- 172.21.15.152:0/2166789442 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc010690 con 0x7f2ce8101370 2024-09-11T22:15:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.247+0000 7f2ced50c640 1 -- 172.21.15.152:0/2166789442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce81a3e00 con 0x7f2ce8101370 2024-09-11T22:15:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2cf029d740 1 Processor -- start 2024-09-11T22:15:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2cf029d740 1 -- start start 2024-09-11T22:15:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2ccffff640 1 -- 172.21.15.152:0/2166789442 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f2cdc0046c0 con 0x7f2ce8101370 2024-09-11T22:15:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2cf029d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7de9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2cf029d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 0x556c4d7df400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2cf029d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7edd70 0x556c4d7f0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2cf029d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556c4d7432f0 con 0x556c4d7defa0 2024-09-11T22:15:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2cf029d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556c4d6eb270 con 0x556c4d7e0150 2024-09-11T22:15:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2cf029d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556c4d73f2b0 con 0x556c4d7edd70 2024-09-11T22:15:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7de9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2ce6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 0x556c4d7df400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2ce67fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7edd70 0x556c4d7f0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7de9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:36652/0 (socket says 172.21.15.152:36652) 2024-09-11T22:15:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2ce77fe640 1 -- 172.21.15.152:0/4190859689 learned_addr learned my addr 172.21.15.152:0/4190859689 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.250+0000 7f2ce6ffd640 1 --2- 172.21.15.152:0/4190859689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 0x556c4d7df400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44062/0 (socket says 172.21.15.152:44062) 2024-09-11T22:15:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ce77fe640 1 -- 172.21.15.152:0/4190859689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7edd70 msgr2=0x556c4d7f0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ce77fe640 1 --2- 172.21.15.152:0/4190859689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7edd70 0x556c4d7f0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ce77fe640 1 -- 172.21.15.152:0/4190859689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 msgr2=0x556c4d7df400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ce77fe640 1 --2- 172.21.15.152:0/4190859689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 0x556c4d7df400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ce77fe640 1 -- 172.21.15.152:0/4190859689 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c4d6ea340 con 0x556c4d7e0150 2024-09-11T22:15:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ce77fe640 1 --2- 172.21.15.152:0/4190859689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7de9d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009fd0 tx=0x7f2ce0010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61a6cb729481b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ccffff640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2cd00a2df0 0x7f2cd00a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ccd7fa640 1 -- 172.21.15.152:0/4190859689 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0011700 con 0x556c4d7e0150 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ce6ffd640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2cd00a2df0 0x7f2cd00a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ccd7fa640 1 -- 172.21.15.152:0/4190859689 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ce0011d80 con 0x556c4d7e0150 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ccd7fa640 1 -- 172.21.15.152:0/4190859689 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000e3c0 con 0x556c4d7e0150 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.251+0000 7f2ccffff640 1 -- 172.21.15.152:0/2166789442 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f2cdc0cf980 con 0x7f2ce8101370 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.252+0000 7f2ce6ffd640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2cd00a2df0 0x7f2cd00a52b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2cd802a990 tx=0x7f2cd802a920 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.252+0000 7f2cf029d740 1 -- 172.21.15.152:0/4190859689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 msgr2=0x556c4d7de9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.252+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4190859689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7de9d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009fd0 tx=0x7f2ce0010860 comp rx=0 tx=0).stop 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.252+0000 7f2cf029d740 1 -- 172.21.15.152:0/4190859689 shutdown_connections 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.252+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4190859689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7edd70 0x556c4d7f0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.252+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4190859689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 0x556c4d7df400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.252+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4190859689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7de9d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.252+0000 7f2cf029d740 1 -- 172.21.15.152:0/4190859689 >> 172.21.15.152:0/4190859689 conn(0x556c4d7db060 msgr2=0x556c4d7db440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.252+0000 7f2cf029d740 1 -- 172.21.15.152:0/4190859689 shutdown_connections 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.252+0000 7f2cf029d740 1 -- 172.21.15.152:0/4190859689 wait complete. 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.253+0000 7f2cf029d740 1 -- start start 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.253+0000 7f2cf029d740 1 Processor -- start 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.253+0000 7f2cf029d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 0x556c4d7eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.254+0000 7f2ce6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 0x556c4d7eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.254+0000 7f2ce6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 0x556c4d7eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44080/0 (socket says 172.21.15.152:44080) 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.254+0000 7f2ce6ffd640 1 -- 172.21.15.152:0/4078166168 learned_addr learned my addr 172.21.15.152:0/4078166168 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.254+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7eb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.254+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7edd70 0x556c4d7eb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.254+0000 7f2cf029d740 1 -- 172.21.15.152:0/4078166168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556c4d7f0ca0 con 0x556c4d7defa0 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.254+0000 7f2cf029d740 1 -- 172.21.15.152:0/4078166168 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556c4d6cc290 con 0x556c4d7e0150 2024-09-11T22:15:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.254+0000 7f2cf029d740 1 -- 172.21.15.152:0/4078166168 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556c4d7f0e20 con 0x556c4d7edd70 2024-09-11T22:15:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.254+0000 7f2ce67fc640 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7eb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.254+0000 7f2ce77fe640 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7edd70 0x556c4d7eb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2ce67fc640 1 -- 172.21.15.152:0/4078166168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7edd70 msgr2=0x556c4d7eb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:49.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2ce67fc640 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7edd70 0x556c4d7eb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2ce67fc640 1 -- 172.21.15.152:0/4078166168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 msgr2=0x556c4d7eacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2ce67fc640 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 0x556c4d7eacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2ce67fc640 1 -- 172.21.15.152:0/4078166168 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c4d456210 con 0x556c4d7e0150 2024-09-11T22:15:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2cf029d740 10 client.0 _ll_register_callbacks cb 0x556c4d6fd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2cf029d740 1 -- 172.21.15.152:0/4078166168 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce0011d80 con 0x556c4d7e0150 2024-09-11T22:15:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2ce67fc640 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7eb200 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0cd040 tx=0x7f2cdc0d3040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1d34a1385ff2e53 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2ccaff5640 10 client.27608 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:15:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2ccaff5640 1 -- 172.21.15.152:0/4078166168 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc09e030 con 0x556c4d7e0150 2024-09-11T22:15:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2ccaff5640 1 -- 172.21.15.152:0/4078166168 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f2cdc0a4620 con 0x556c4d7e0150 2024-09-11T22:15:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2ccaff5640 1 -- 172.21.15.152:0/4078166168 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2cdc09b980 con 0x556c4d7e0150 2024-09-11T22:15:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2cf029d740 10 client.27608 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.255+0000 7f2cf029d740 1 -- 172.21.15.152:0/4078166168 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=30}) -- 0x556c4d522620 con 0x556c4d7e0150 2024-09-11T22:15:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.256+0000 7f2ccaff5640 1 -- 172.21.15.152:0/4078166168 <== mon.2 v2:172.21.15.179:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f2cdc09b290 con 0x556c4d7e0150 2024-09-11T22:15:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.256+0000 7f2cf029d740 10 client.27608 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.256+0000 7f2cf029d740 10 client.27608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.256+0000 7f2cf029d740 20 client.27608 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.256+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556c4d80eea0 0x556c4d811330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.256+0000 7f2cf029d740 4 client.27608 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.256+0000 7f2cf029d740 1 -- 172.21.15.152:0/4078166168 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c4d750a20 con 0x556c4d80eea0 2024-09-11T22:15:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.256+0000 7f2ce6ffd640 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556c4d80eea0 0x556c4d811330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.256+0000 7f2ccaff5640 10 client.27608 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.256+0000 7f2ce6ffd640 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556c4d80eea0 0x556c4d811330 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba4f26e45bcaf7d9 server_cookie=7a7fbf46c7d0656c in_seq=0 out_seq=0 2024-09-11T22:15:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2ccaff5640 1 -- 172.21.15.152:0/4078166168 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c4d750a20 con 0x556c4d80eea0 2024-09-11T22:15:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2ccaff5640 10 client.27608 handle_command_reply: tid=0 2024-09-11T22:15:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 1 client.27608 shutdown 2024-09-11T22:15:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 1 -- 172.21.15.152:0/4078166168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 msgr2=0x556c4d7eb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7eb200 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0cd040 tx=0x7f2cdc0d3040 comp rx=0 tx=0).stop 2024-09-11T22:15:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 1 -- 172.21.15.152:0/4078166168 shutdown_connections 2024-09-11T22:15:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556c4d80eea0 0x556c4d811330 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2ccaff5640 0 client.27608 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7edd70 0x556c4d7eb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7eb200 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 1 --2- 172.21.15.152:0/4078166168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7defa0 0x556c4d7eacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 1 -- 172.21.15.152:0/4078166168 >> 172.21.15.152:0/4078166168 conn(0x556c4d7db060 msgr2=0x556c4d7e0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 1 -- 172.21.15.152:0/4078166168 shutdown_connections 2024-09-11T22:15:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 1 -- 172.21.15.152:0/4078166168 wait complete. 2024-09-11T22:15:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.257+0000 7f2cf029d740 20 client.27608 trim_cache size 0 max 16384 2024-09-11T22:15:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.282+0000 7f2cf029d740 1 Processor -- start 2024-09-11T22:15:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.286+0000 7f2cf029d740 1 -- start start 2024-09-11T22:15:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.286+0000 7f2cf029d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 0x556c4d7da9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.286+0000 7f2cf029d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.286+0000 7f2cf029d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7edd70 0x556c4d816c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.286+0000 7f2cf029d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81a57f0 con 0x556c4d7edd70 2024-09-11T22:15:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.286+0000 7f2cf029d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8073500 con 0x556c4d7e0150 2024-09-11T22:15:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.286+0000 7f2cf029d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8071370 con 0x556c4d7defa0 2024-09-11T22:15:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.289+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7edd70 0x556c4d816c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.289+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7edd70 0x556c4d816c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44092/0 (socket says 172.21.15.152:44092) 2024-09-11T22:15:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.289+0000 7f2ce77fe640 1 -- 172.21.15.152:0/53398172 learned_addr learned my addr 172.21.15.152:0/53398172 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.293+0000 7f2ce6ffd640 1 --2- 172.21.15.152:0/53398172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 0x556c4d7da9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.293+0000 7f2ce67fc640 1 --2- 172.21.15.152:0/53398172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.294+0000 7f2ce77fe640 1 -- 172.21.15.152:0/53398172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 msgr2=0x556c4d7da9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.294+0000 7f2ce77fe640 1 --2- 172.21.15.152:0/53398172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 0x556c4d7da9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.294+0000 7f2ce77fe640 1 -- 172.21.15.152:0/53398172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 msgr2=0x556c4d7ecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.294+0000 7f2ce77fe640 1 --2- 172.21.15.152:0/53398172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7ecc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.294+0000 7f2ce77fe640 1 -- 172.21.15.152:0/53398172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c4d7df640 con 0x556c4d7edd70 2024-09-11T22:15:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.299+0000 7f2ce77fe640 1 --2- 172.21.15.152:0/53398172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7edd70 0x556c4d816c40 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2ce001bb60 tx=0x7f2ce001bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718f1c058eb6a6d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.302+0000 7f2cccff9640 1 -- 172.21.15.152:0/53398172 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce001be30 con 0x556c4d7edd70 2024-09-11T22:15:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.302+0000 7f2cccff9640 1 -- 172.21.15.152:0/53398172 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ce0023040 con 0x556c4d7edd70 2024-09-11T22:15:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.302+0000 7f2cccff9640 1 -- 172.21.15.152:0/53398172 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0011760 con 0x556c4d7edd70 2024-09-11T22:15:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.303+0000 7f2cf029d740 1 -- 172.21.15.152:0/53398172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7edd70 msgr2=0x556c4d816c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.303+0000 7f2cf029d740 1 --2- 172.21.15.152:0/53398172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7edd70 0x556c4d816c40 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2ce001bb60 tx=0x7f2ce001bb90 comp rx=0 tx=0).stop 2024-09-11T22:15:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.304+0000 7f2cf029d740 1 -- 172.21.15.152:0/53398172 shutdown_connections 2024-09-11T22:15:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.304+0000 7f2cf029d740 1 --2- 172.21.15.152:0/53398172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7edd70 0x556c4d816c40 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.304+0000 7f2cf029d740 1 --2- 172.21.15.152:0/53398172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7e0150 0x556c4d7ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.304+0000 7f2cf029d740 1 --2- 172.21.15.152:0/53398172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 0x556c4d7da9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.304+0000 7f2cf029d740 1 -- 172.21.15.152:0/53398172 >> 172.21.15.152:0/53398172 conn(0x556c4d7db060 msgr2=0x556c4d7ec520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.305+0000 7f2cf029d740 1 -- 172.21.15.152:0/53398172 shutdown_connections 2024-09-11T22:15:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.305+0000 7f2cf029d740 1 -- 172.21.15.152:0/53398172 wait complete. 2024-09-11T22:15:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.305+0000 7f2cf029d740 1 -- start start 2024-09-11T22:15:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.306+0000 7f2cf029d740 1 Processor -- start 2024-09-11T22:15:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.306+0000 7f2cf029d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 0x556c4d7f6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.306+0000 7f2cf029d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7e0150 0x556c4d7f6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.306+0000 7f2ce6ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 0x556c4d7f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.306+0000 7f2ce6ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 0x556c4d7f6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:45318/0 (socket says 172.21.15.152:45318) 2024-09-11T22:15:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.306+0000 7f2ce6ffd640 1 -- 172.21.15.152:0/3250786388 learned_addr learned my addr 172.21.15.152:0/3250786388 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:15:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.306+0000 7f2cf029d740 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7edd70 0x556c4d7e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.306+0000 7f2cf029d740 1 -- 172.21.15.152:0/3250786388 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce80719c0 con 0x556c4d7e0150 2024-09-11T22:15:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.306+0000 7f2ce67fc640 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7e0150 0x556c4d7f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.306+0000 7f2cf029d740 1 -- 172.21.15.152:0/3250786388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8072e30 con 0x556c4d7edd70 2024-09-11T22:15:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.306+0000 7f2cf029d740 1 -- 172.21.15.152:0/3250786388 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8072090 con 0x556c4d7defa0 2024-09-11T22:15:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.307+0000 7f2ce77fe640 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7edd70 0x556c4d7e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.307+0000 7f2ce6ffd640 1 -- 172.21.15.152:0/3250786388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7edd70 msgr2=0x556c4d7e5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.307+0000 7f2ce6ffd640 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7edd70 0x556c4d7e5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.307+0000 7f2ce6ffd640 1 -- 172.21.15.152:0/3250786388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7e0150 msgr2=0x556c4d7f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.307+0000 7f2ce6ffd640 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7e0150 0x556c4d7f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.307+0000 7f2ce6ffd640 1 -- 172.21.15.152:0/3250786388 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c4d7f6cc0 con 0x556c4d7defa0 2024-09-11T22:15:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.307+0000 7f2cf029d740 10 client.0 _ll_register_callbacks cb 0x7f2cdc0d5220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.307+0000 7f2cf029d740 1 -- 172.21.15.152:0/3250786388 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce0023040 con 0x556c4d7defa0 2024-09-11T22:15:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.308+0000 7f2ce6ffd640 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 0x556c4d7f6110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009900 tx=0x7f2cd8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a5bd5787cc9b134 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.308+0000 7f2ccaff5640 10 client.27760 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:15:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.311+0000 7f2ccaff5640 1 -- 172.21.15.152:0/3250786388 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8035040 con 0x556c4d7defa0 2024-09-11T22:15:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.311+0000 7f2ccaff5640 1 -- 172.21.15.152:0/3250786388 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f2cd8004cd0 con 0x556c4d7defa0 2024-09-11T22:15:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.311+0000 7f2ccaff5640 1 -- 172.21.15.152:0/3250786388 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2cd80325c0 con 0x556c4d7defa0 2024-09-11T22:15:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.311+0000 7f2cf029d740 10 client.27760 fetch_fsmap learned FSMap version 30 2024-09-11T22:15:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.311+0000 7f2cf029d740 1 -- 172.21.15.152:0/3250786388 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) -- 0x556c4d871ff0 con 0x556c4d7defa0 2024-09-11T22:15:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.312+0000 7f2ccaff5640 1 -- 172.21.15.152:0/3250786388 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f2cd8032760 con 0x556c4d7defa0 2024-09-11T22:15:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.312+0000 7f2cf029d740 10 client.27760 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:15:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.312+0000 7f2cf029d740 10 client.27760 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:15:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.312+0000 7f2cf029d740 20 client.27760 populate_metadata read hostname 'smithi152' 2024-09-11T22:15:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.312+0000 7f2cf029d740 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556c4d80eea0 0x556c4d874690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.312+0000 7f2cf029d740 4 client.27760 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:15:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.312+0000 7f2cf029d740 1 -- 172.21.15.152:0/3250786388 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556c4d74ad70 con 0x556c4d80eea0 2024-09-11T22:15:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.312+0000 7f2ce67fc640 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556c4d80eea0 0x556c4d874690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.313+0000 7f2ce67fc640 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556c4d80eea0 0x556c4d874690 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7b458f483aa3183 server_cookie=54e89ed194847ac0 in_seq=0 out_seq=0 2024-09-11T22:15:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.313+0000 7f2ccaff5640 10 client.27760 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.342+0000 7f2ccaff5640 1 -- 172.21.15.152:0/3250786388 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556c4d74ad70 con 0x556c4d80eea0 2024-09-11T22:15:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.342+0000 7f2ccaff5640 10 client.27760 handle_command_reply: tid=0 2024-09-11T22:15:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 1 client.27760 shutdown 2024-09-11T22:15:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 1 -- 172.21.15.152:0/3250786388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 msgr2=0x556c4d7f6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 0x556c4d7f6110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009900 tx=0x7f2cd8009260 comp rx=0 tx=0).stop 2024-09-11T22:15:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 1 -- 172.21.15.152:0/3250786388 shutdown_connections 2024-09-11T22:15:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x556c4d80eea0 0x556c4d874690 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c4d7edd70 0x556c4d7e5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c4d7e0150 0x556c4d7f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 1 --2- 172.21.15.152:0/3250786388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c4d7defa0 0x556c4d7f6110 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2ccaff5640 0 client.27760 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:15:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 1 -- 172.21.15.152:0/3250786388 >> 172.21.15.152:0/3250786388 conn(0x556c4d7db060 msgr2=0x556c4d7eac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 1 -- 172.21.15.152:0/3250786388 shutdown_connections 2024-09-11T22:15:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 1 -- 172.21.15.152:0/3250786388 wait complete. 2024-09-11T22:15:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.343+0000 7f2cf029d740 20 client.27760 trim_cache size 0 max 16384 2024-09-11T22:15:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:15:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:15:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:15:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:15:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 -- 172.21.15.152:0/2166789442 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2cd00a2df0 msgr2=0x7f2cd00a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2cd00a2df0 0x7f2cd00a52b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2cd802a990 tx=0x7f2cd802a920 comp rx=0 tx=0).stop 2024-09-11T22:15:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 -- 172.21.15.152:0/2166789442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ce8101370 msgr2=0x7f2ce81977d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ce8101370 0x7f2ce81977d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00e9f0 tx=0x7f2cdc00edf0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 -- 172.21.15.152:0/2166789442 shutdown_connections 2024-09-11T22:15:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2cd00a2df0 0x7f2cd00a52b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce81069e0 0x7f2ce819bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ce8101370 0x7f2ce81977d0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 --2- 172.21.15.152:0/2166789442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce81009d0 0x7f2ce8197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 -- 172.21.15.152:0/2166789442 >> 172.21.15.152:0/2166789442 conn(0x7f2ce80fc6b0 msgr2=0x7f2ce80fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 -- 172.21.15.152:0/2166789442 shutdown_connections 2024-09-11T22:15:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:15:49.344+0000 7f2ced50c640 1 -- 172.21.15.152:0/2166789442 wait complete. 2024-09-11T22:15:49.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:49 smithi152 ceph-mon[31188]: pgmap v358: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 635 op/s 2024-09-11T22:15:49.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:49 smithi179 ceph-mon[35603]: pgmap v358: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 635 op/s 2024-09-11T22:15:49.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 615.0 s, 2337.0 tps, lat 42.629 ms stddev 46.125 2024-09-11T22:15:49.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:49 smithi193 ceph-mon[35545]: pgmap v358: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 635 op/s 2024-09-11T22:15:51.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:51 smithi152 ceph-mon[31188]: pgmap v359: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.9 MiB/s wr, 916 op/s 2024-09-11T22:15:51.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:51 smithi179 ceph-mon[35603]: pgmap v359: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.9 MiB/s wr, 916 op/s 2024-09-11T22:15:51.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:51 smithi193 ceph-mon[35545]: pgmap v359: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.9 MiB/s wr, 916 op/s 2024-09-11T22:15:53.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:53 smithi152 ceph-mon[31188]: pgmap v360: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 574 op/s 2024-09-11T22:15:53.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:53 smithi179 ceph-mon[35603]: pgmap v360: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 574 op/s 2024-09-11T22:15:53.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:53 smithi193 ceph-mon[35545]: pgmap v360: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 574 op/s 2024-09-11T22:15:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 620.0 s, 2066.4 tps, lat 48.373 ms stddev 50.632 2024-09-11T22:15:55.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:55 smithi152 ceph-mon[31188]: pgmap v361: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 787 op/s 2024-09-11T22:15:55.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:55 smithi179 ceph-mon[35603]: pgmap v361: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 787 op/s 2024-09-11T22:15:55.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:55 smithi193 ceph-mon[35545]: pgmap v361: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 787 op/s 2024-09-11T22:15:57.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:57 smithi152 ceph-mon[31188]: pgmap v362: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 744 op/s 2024-09-11T22:15:57.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:57 smithi179 ceph-mon[35603]: pgmap v362: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 744 op/s 2024-09-11T22:15:57.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:57 smithi193 ceph-mon[35545]: pgmap v362: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 744 op/s 2024-09-11T22:15:59.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:15:59 smithi152 ceph-mon[31188]: pgmap v363: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 646 op/s 2024-09-11T22:15:59.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:15:59 smithi179 ceph-mon[35603]: pgmap v363: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 646 op/s 2024-09-11T22:15:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 625.0 s, 2387.4 tps, lat 41.843 ms stddev 49.321 2024-09-11T22:15:59.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:15:59 smithi193 ceph-mon[35545]: pgmap v363: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 646 op/s 2024-09-11T22:16:01.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:01 smithi179 ceph-mon[35603]: pgmap v364: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 19 MiB/s wr, 957 op/s 2024-09-11T22:16:01.827 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:01 smithi193 ceph-mon[35545]: pgmap v364: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 19 MiB/s wr, 957 op/s 2024-09-11T22:16:01.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:01 smithi152 ceph-mon[31188]: pgmap v364: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 19 MiB/s wr, 957 op/s 2024-09-11T22:16:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.440+0000 7f0812123640 1 -- 172.21.15.152:0/70833095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f080c102470 msgr2=0x7f080c10e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.440+0000 7f0812123640 1 --2- 172.21.15.152:0/70833095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f080c102470 0x7f080c10e9a0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f0804009cd0 tx=0x7f080402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.440+0000 7f0812123640 1 -- 172.21.15.152:0/70833095 shutdown_connections 2024-09-11T22:16:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.440+0000 7f0812123640 1 --2- 172.21.15.152:0/70833095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f080c102470 0x7f080c10e9a0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.440+0000 7f0812123640 1 --2- 172.21.15.152:0/70833095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f080c101ad0 0x7f080c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.440+0000 7f0812123640 1 --2- 172.21.15.152:0/70833095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c107b70 0x7f080c107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.440+0000 7f0812123640 1 -- 172.21.15.152:0/70833095 >> 172.21.15.152:0/70833095 conn(0x7f080c0fd7b0 msgr2=0x7f080c0ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.440+0000 7f0812123640 1 -- 172.21.15.152:0/70833095 shutdown_connections 2024-09-11T22:16:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.440+0000 7f0812123640 1 -- 172.21.15.152:0/70833095 wait complete. 2024-09-11T22:16:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f0812123640 1 Processor -- start 2024-09-11T22:16:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f0812123640 1 -- start start 2024-09-11T22:16:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f0812123640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f080c101ad0 0x7f080c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f0812123640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f080c102470 0x7f080c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f0812123640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c107b70 0x7f080c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f0812123640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f080c111ee0 con 0x7f080c102470 2024-09-11T22:16:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f0812123640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f080c111d60 con 0x7f080c107b70 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f0812123640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f080c112060 con 0x7f080c101ad0 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f0803fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f080c102470 0x7f080c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f0803fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f080c102470 0x7f080c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59600/0 (socket says 172.21.15.152:59600) 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f0803fff640 1 -- 172.21.15.152:0/2456507217 learned_addr learned my addr 172.21.15.152:0/2456507217 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f080b7fe640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f080c101ad0 0x7f080c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.441+0000 7f080bfff640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c107b70 0x7f080c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.442+0000 7f0803fff640 1 -- 172.21.15.152:0/2456507217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f080c101ad0 msgr2=0x7f080c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.442+0000 7f0803fff640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f080c101ad0 0x7f080c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.442+0000 7f0803fff640 1 -- 172.21.15.152:0/2456507217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c107b70 msgr2=0x7f080c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.442+0000 7f0803fff640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c107b70 0x7f080c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.442+0000 7f0803fff640 1 -- 172.21.15.152:0/2456507217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c1a67f0 con 0x7f080c102470 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.442+0000 7f0803fff640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f080c102470 0x7f080c074a30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f07f400d950 tx=0x7f07f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.442+0000 7f08097fa640 1 -- 172.21.15.152:0/2456507217 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4017030 con 0x7f080c102470 2024-09-11T22:16:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.442+0000 7f08097fa640 1 -- 172.21.15.152:0/2456507217 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07f4004020 con 0x7f080c102470 2024-09-11T22:16:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.442+0000 7f0812123640 1 -- 172.21.15.152:0/2456507217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080c1a6ae0 con 0x7f080c102470 2024-09-11T22:16:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.442+0000 7f08097fa640 1 -- 172.21.15.152:0/2456507217 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f40047a0 con 0x7f080c102470 2024-09-11T22:16:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.442+0000 7f0812123640 1 -- 172.21.15.152:0/2456507217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080c1a7030 con 0x7f080c102470 2024-09-11T22:16:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f0814ebc740 1 Processor -- start 2024-09-11T22:16:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f0814ebc740 1 -- start start 2024-09-11T22:16:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a5aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5b410 0x558b94a65770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f08097fa640 1 -- 172.21.15.152:0/2456507217 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f07f40041d0 con 0x7f080c102470 2024-09-11T22:16:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a65cb0 0x558b94a680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f0814ebc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558b949bf2f0 con 0x558b94a5aaf0 2024-09-11T22:16:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f0814ebc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558b94967270 con 0x558b94a65cb0 2024-09-11T22:16:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f0814ebc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558b949bb2b0 con 0x558b94a5b410 2024-09-11T22:16:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f080bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a5aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f080bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a5aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59616/0 (socket says 172.21.15.152:59616) 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f080bfff640 1 -- 172.21.15.152:0/2093066340 learned_addr learned my addr 172.21.15.152:0/2093066340 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f080b7fe640 1 --2- 172.21.15.152:0/2093066340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5b410 0x558b94a65770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.445+0000 7f0803fff640 1 --2- 172.21.15.152:0/2093066340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a65cb0 0x558b94a680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f080bfff640 1 -- 172.21.15.152:0/2093066340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5b410 msgr2=0x558b94a65770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f080bfff640 1 --2- 172.21.15.152:0/2093066340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5b410 0x558b94a65770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f080bfff640 1 -- 172.21.15.152:0/2093066340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a65cb0 msgr2=0x558b94a680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f080bfff640 1 --2- 172.21.15.152:0/2093066340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a65cb0 0x558b94a680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f080bfff640 1 -- 172.21.15.152:0/2093066340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b94966340 con 0x558b94a5aaf0 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f080bfff640 1 --2- 172.21.15.152:0/2093066340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a5aed0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0804009cd0 tx=0x7f0804009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92856acf203b2eac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f08097fa640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07f80a2da0 0x7f07f80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f080b7fe640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07f80a2da0 0x7f07f80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f08097fa640 1 -- 172.21.15.152:0/2456507217 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f07f40cede0 con 0x7f080c102470 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f0801ffb640 1 -- 172.21.15.152:0/2093066340 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804048070 con 0x558b94a5aaf0 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f0801ffb640 1 -- 172.21.15.152:0/2093066340 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0804036070 con 0x558b94a5aaf0 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.446+0000 7f0801ffb640 1 -- 172.21.15.152:0/2093066340 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804004470 con 0x558b94a5aaf0 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.447+0000 7f0814ebc740 1 -- 172.21.15.152:0/2093066340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 msgr2=0x558b94a5aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.447+0000 7f080b7fe640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07f80a2da0 0x7f07f80a5260 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x558b94a57ec0 tx=0x7f07fc005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.447+0000 7f0814ebc740 1 --2- 172.21.15.152:0/2093066340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a5aed0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0804009cd0 tx=0x7f0804009a20 comp rx=0 tx=0).stop 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.447+0000 7f0814ebc740 1 -- 172.21.15.152:0/2093066340 shutdown_connections 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.447+0000 7f0814ebc740 1 --2- 172.21.15.152:0/2093066340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a65cb0 0x558b94a680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.447+0000 7f0814ebc740 1 --2- 172.21.15.152:0/2093066340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5b410 0x558b94a65770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.447+0000 7f0814ebc740 1 --2- 172.21.15.152:0/2093066340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a5aed0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.447+0000 7f0814ebc740 1 -- 172.21.15.152:0/2093066340 >> 172.21.15.152:0/2093066340 conn(0x558b94a57060 msgr2=0x558b94a57440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.447+0000 7f0814ebc740 1 -- 172.21.15.152:0/2093066340 shutdown_connections 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.447+0000 7f0814ebc740 1 -- 172.21.15.152:0/2093066340 wait complete. 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.447+0000 7f0814ebc740 1 -- start start 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0814ebc740 1 Processor -- start 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5aaf0 0x558b94a62be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a63120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a63660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0814ebc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558b94a68880 con 0x558b94a65cb0 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0814ebc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558b94948290 con 0x558b94a5b410 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0814ebc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558b94a68a00 con 0x558b94a5aaf0 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0814ebc740 10 client.0 _ll_register_callbacks cb 0x558b94979140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f080bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a63660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f080bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a63660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59624/0 (socket says 172.21.15.152:59624) 2024-09-11T22:16:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f080bfff640 1 -- 172.21.15.152:0/342026188 learned_addr learned my addr 172.21.15.152:0/342026188 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f080b7fe640 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5aaf0 0x558b94a62be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0803fff640 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a63120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0803fff640 1 -- 172.21.15.152:0/342026188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5aaf0 msgr2=0x558b94a62be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0803fff640 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5aaf0 0x558b94a62be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0803fff640 1 -- 172.21.15.152:0/342026188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 msgr2=0x558b94a63660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0803fff640 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a63660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f0803fff640 1 -- 172.21.15.152:0/342026188 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b946d2210 con 0x558b94a5b410 2024-09-11T22:16:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f080b7fe640 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5aaf0 0x558b94a62be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.448+0000 7f080bfff640 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a63660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.449+0000 7f0803fff640 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a63120 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f07f40cc4d0 tx=0x7f07f40d2520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13b44e71f64358d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.449+0000 7f07eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.449+0000 7f07eaffd640 1 -- 172.21.15.152:0/342026188 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f409b070 con 0x558b94a5b410 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.449+0000 7f07eaffd640 1 -- 172.21.15.152:0/342026188 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f07f409f220 con 0x558b94a5b410 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.449+0000 7f0814ebc740 1 -- 172.21.15.152:0/342026188 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0804036070 con 0x558b94a5b410 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.449+0000 7f07eaffd640 1 -- 172.21.15.152:0/342026188 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f07f409ac00 con 0x558b94a5b410 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.449+0000 7f0814ebc740 10 client.27626 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.449+0000 7f0814ebc740 1 -- 172.21.15.152:0/342026188 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558b9479e620 con 0x558b94a5b410 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.449+0000 7f07eaffd640 1 -- 172.21.15.152:0/342026188 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0804036070 con 0x558b94a5b410 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.449+0000 7f07eaffd640 1 -- 172.21.15.152:0/342026188 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f07f40bb0c0 con 0x558b94a5b410 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.450+0000 7f0814ebc740 10 client.27626 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.450+0000 7f0814ebc740 10 client.27626 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.450+0000 7f0814ebc740 20 client.27626 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.450+0000 7f0814ebc740 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558b94a75ca0 0x558b94a78090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.450+0000 7f0814ebc740 4 client.27626 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.450+0000 7f0814ebc740 1 -- 172.21.15.152:0/342026188 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b949cca20 con 0x558b94a75ca0 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.450+0000 7f080b7fe640 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558b94a75ca0 0x558b94a78090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.450+0000 7f07eaffd640 10 client.27626 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.450+0000 7f080b7fe640 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558b94a75ca0 0x558b94a78090 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e162fe18ceceb08 server_cookie=dd3d899b7137cce0 in_seq=0 out_seq=0 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.451+0000 7f07eaffd640 1 -- 172.21.15.152:0/342026188 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b949cca20 con 0x558b94a75ca0 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.451+0000 7f07eaffd640 10 client.27626 handle_command_reply: tid=0 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.451+0000 7f0814ebc740 1 client.27626 shutdown 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.451+0000 7f0814ebc740 1 -- 172.21.15.152:0/342026188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 msgr2=0x558b94a63120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.451+0000 7f0814ebc740 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a63120 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f07f40cc4d0 tx=0x7f07f40d2520 comp rx=0 tx=0).stop 2024-09-11T22:16:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.452+0000 7f0814ebc740 1 -- 172.21.15.152:0/342026188 shutdown_connections 2024-09-11T22:16:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.452+0000 7f0814ebc740 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558b94a75ca0 0x558b94a78090 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.452+0000 7f0814ebc740 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a63660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.452+0000 7f0814ebc740 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a63120 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.452+0000 7f07eaffd640 0 client.27626 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.452+0000 7f0814ebc740 1 --2- 172.21.15.152:0/342026188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5aaf0 0x558b94a62be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.452+0000 7f0814ebc740 1 -- 172.21.15.152:0/342026188 >> 172.21.15.152:0/342026188 conn(0x558b94a57060 msgr2=0x558b94a561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.452+0000 7f0814ebc740 1 -- 172.21.15.152:0/342026188 shutdown_connections 2024-09-11T22:16:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.452+0000 7f0814ebc740 1 -- 172.21.15.152:0/342026188 wait complete. 2024-09-11T22:16:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.452+0000 7f0814ebc740 20 client.27626 trim_cache size 0 max 16384 2024-09-11T22:16:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.468+0000 7f0814ebc740 1 Processor -- start 2024-09-11T22:16:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.468+0000 7f0814ebc740 1 -- start start 2024-09-11T22:16:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.468+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a63490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.468+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a7d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.468+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a65cb0 0x558b94a7de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.468+0000 7f0814ebc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1b2360 con 0x558b94a5aaf0 2024-09-11T22:16:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.468+0000 7f0814ebc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1afc30 con 0x558b94a5b410 2024-09-11T22:16:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.468+0000 7f0814ebc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1adaa0 con 0x558b94a65cb0 2024-09-11T22:16:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a63490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f080bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a65cb0 0x558b94a7de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f0803fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a7d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a63490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59638/0 (socket says 172.21.15.152:59638) 2024-09-11T22:16:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f080b7fe640 1 -- 172.21.15.152:0/3112234395 learned_addr learned my addr 172.21.15.152:0/3112234395 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f080bfff640 1 -- 172.21.15.152:0/3112234395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 msgr2=0x558b94a7d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f080bfff640 1 --2- 172.21.15.152:0/3112234395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a7d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f080bfff640 1 -- 172.21.15.152:0/3112234395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 msgr2=0x558b94a63490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f080bfff640 1 --2- 172.21.15.152:0/3112234395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a63490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f080bfff640 1 -- 172.21.15.152:0/3112234395 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b94a57cf0 con 0x558b94a65cb0 2024-09-11T22:16:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f080b7fe640 1 --2- 172.21.15.152:0/3112234395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a63490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f080bfff640 1 --2- 172.21.15.152:0/3112234395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a65cb0 0x558b94a7de70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0804046040 tx=0x7f0804003f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d5ed3c003c6e277 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.469+0000 7f08017fa640 1 -- 172.21.15.152:0/3112234395 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804048040 con 0x558b94a65cb0 2024-09-11T22:16:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.470+0000 7f08017fa640 1 -- 172.21.15.152:0/3112234395 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0804036040 con 0x558b94a65cb0 2024-09-11T22:16:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.470+0000 7f08017fa640 1 -- 172.21.15.152:0/3112234395 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804004650 con 0x558b94a65cb0 2024-09-11T22:16:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.470+0000 7f0814ebc740 1 -- 172.21.15.152:0/3112234395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a65cb0 msgr2=0x558b94a7de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.470+0000 7f0814ebc740 1 --2- 172.21.15.152:0/3112234395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a65cb0 0x558b94a7de70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0804046040 tx=0x7f0804003f30 comp rx=0 tx=0).stop 2024-09-11T22:16:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.470+0000 7f0814ebc740 1 -- 172.21.15.152:0/3112234395 shutdown_connections 2024-09-11T22:16:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.470+0000 7f0814ebc740 1 --2- 172.21.15.152:0/3112234395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a65cb0 0x558b94a7de70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.470+0000 7f0814ebc740 1 --2- 172.21.15.152:0/3112234395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a7d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 --2- 172.21.15.152:0/3112234395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a5aaf0 0x558b94a63490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 -- 172.21.15.152:0/3112234395 >> 172.21.15.152:0/3112234395 conn(0x558b94a57060 msgr2=0x558b94a64c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 -- 172.21.15.152:0/3112234395 shutdown_connections 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 -- 172.21.15.152:0/3112234395 wait complete. 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 -- start start 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 Processor -- start 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5aaf0 0x558b94a6de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a6e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a5f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1ae0f0 con 0x558b94a65cb0 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1af560 con 0x558b94a5b410 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.471+0000 7f0814ebc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1ae7c0 con 0x558b94a5aaf0 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f0814ebc740 10 client.0 _ll_register_callbacks cb 0x7f07f40046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f080bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a5f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f0803fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a6e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f080bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a5f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59646/0 (socket says 172.21.15.152:59646) 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f080bfff640 1 -- 172.21.15.152:0/1102997735 learned_addr learned my addr 172.21.15.152:0/1102997735 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f080b7fe640 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5aaf0 0x558b94a6de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f0803fff640 1 -- 172.21.15.152:0/1102997735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5aaf0 msgr2=0x558b94a6de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f0803fff640 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5aaf0 0x558b94a6de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f0803fff640 1 -- 172.21.15.152:0/1102997735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 msgr2=0x558b94a5f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f0803fff640 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a5f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f0803fff640 1 -- 172.21.15.152:0/1102997735 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b94a5fc40 con 0x558b94a5b410 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f080bfff640 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a5f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f0803fff640 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a6e3c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f07f40ccad0 tx=0x7f07f4097b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da9a1bc20cdff22 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f07eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f07eaffd640 1 -- 172.21.15.152:0/1102997735 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f409ade0 con 0x558b94a5b410 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f07eaffd640 1 -- 172.21.15.152:0/1102997735 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8614+0+0 (secure 0 0 0) 0x7f07f40d2ae0 con 0x558b94a5b410 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.472+0000 7f0814ebc740 1 -- 172.21.15.152:0/1102997735 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0804036040 con 0x558b94a5b410 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f07eaffd640 1 -- 172.21.15.152:0/1102997735 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f07f409b070 con 0x558b94a5b410 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f0814ebc740 10 client.27632 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f0814ebc740 1 -- 172.21.15.152:0/1102997735 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558b94ae03d0 con 0x558b94a5b410 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f07eaffd640 1 -- 172.21.15.152:0/1102997735 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0804036040 con 0x558b94a5b410 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f07eaffd640 1 -- 172.21.15.152:0/1102997735 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f07f40d2ce0 con 0x558b94a5b410 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f0814ebc740 10 client.27632 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f0814ebc740 10 client.27632 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f0814ebc740 20 client.27632 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f0814ebc740 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558b94ae0ac0 0x558b94ae2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f0814ebc740 4 client.27632 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:16:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f0814ebc740 1 -- 172.21.15.152:0/1102997735 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558b949c6d70 con 0x558b94ae0ac0 2024-09-11T22:16:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.473+0000 7f080b7fe640 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558b94ae0ac0 0x558b94ae2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.474+0000 7f080b7fe640 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558b94ae0ac0 0x558b94ae2ee0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51761addfbe4b854 server_cookie=da889efc14dc597e in_seq=0 out_seq=0 2024-09-11T22:16:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:02.474+0000 7f07eaffd640 10 client.27632 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:03.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:03 smithi179 ceph-mon[35603]: pgmap v365: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 16 MiB/s wr, 676 op/s 2024-09-11T22:16:03.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f07eaffd640 1 -- 172.21.15.152:0/1102997735 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558b949c6d70 con 0x558b94ae0ac0 2024-09-11T22:16:03.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f07eaffd640 10 client.27632 handle_command_reply: tid=0 2024-09-11T22:16:03.824 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 1 client.27632 shutdown 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 1 -- 172.21.15.152:0/1102997735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 msgr2=0x558b94a6e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a6e3c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f07f40ccad0 tx=0x7f07f4097b40 comp rx=0 tx=0).stop 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 1 -- 172.21.15.152:0/1102997735 shutdown_connections 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558b94ae0ac0 0x558b94ae2ee0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b94a65cb0 0x558b94a5f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b94a5b410 0x558b94a6e3c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 1 --2- 172.21.15.152:0/1102997735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558b94a5aaf0 0x558b94a6de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f07eaffd640 0 client.27632 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 1 -- 172.21.15.152:0/1102997735 >> 172.21.15.152:0/1102997735 conn(0x558b94a57060 msgr2=0x558b94a561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 1 -- 172.21.15.152:0/1102997735 shutdown_connections 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 1 -- 172.21.15.152:0/1102997735 wait complete. 2024-09-11T22:16:03.825 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.822+0000 7f0814ebc740 20 client.27632 trim_cache size 0 max 16384 2024-09-11T22:16:03.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:16:03.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:16:03.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:16:03.826 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:16:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 -- 172.21.15.152:0/2456507217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07f80a2da0 msgr2=0x7f07f80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07f80a2da0 0x7f07f80a5260 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x558b94a57ec0 tx=0x7f07fc005f90 comp rx=0 tx=0).stop 2024-09-11T22:16:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 -- 172.21.15.152:0/2456507217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f080c102470 msgr2=0x7f080c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f080c102470 0x7f080c074a30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f07f400d950 tx=0x7f07f400de10 comp rx=0 tx=0).stop 2024-09-11T22:16:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 -- 172.21.15.152:0/2456507217 shutdown_connections 2024-09-11T22:16:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f07f80a2da0 0x7f07f80a5260 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c107b70 0x7f080c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f080c102470 0x7f080c074a30 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 --2- 172.21.15.152:0/2456507217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f080c101ad0 0x7f080c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 -- 172.21.15.152:0/2456507217 >> 172.21.15.152:0/2456507217 conn(0x7f080c0fd7b0 msgr2=0x7f080c0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 -- 172.21.15.152:0/2456507217 shutdown_connections 2024-09-11T22:16:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:03.823+0000 7f0812123640 1 -- 172.21.15.152:0/2456507217 wait complete. 2024-09-11T22:16:03.828 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:03 smithi193 ceph-mon[35545]: pgmap v365: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 16 MiB/s wr, 676 op/s 2024-09-11T22:16:03.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:03 smithi152 ceph-mon[31188]: pgmap v365: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 16 MiB/s wr, 676 op/s 2024-09-11T22:16:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 630.0 s, 1517.4 tps, lat 63.878 ms stddev 136.031 2024-09-11T22:16:05.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:05 smithi179 ceph-mon[35603]: pgmap v366: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 30 MiB/s wr, 1.45k op/s 2024-09-11T22:16:05.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:05 smithi179 ceph-mon[35603]: osdmap e96: 12 total, 12 up, 12 in 2024-09-11T22:16:05.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:05 smithi193 ceph-mon[35545]: pgmap v366: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 30 MiB/s wr, 1.45k op/s 2024-09-11T22:16:05.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:05 smithi193 ceph-mon[35545]: osdmap e96: 12 total, 12 up, 12 in 2024-09-11T22:16:05.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:05 smithi152 ceph-mon[31188]: pgmap v366: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 30 MiB/s wr, 1.45k op/s 2024-09-11T22:16:05.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:05 smithi152 ceph-mon[31188]: osdmap e96: 12 total, 12 up, 12 in 2024-09-11T22:16:07.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:07 smithi179 ceph-mon[35603]: pgmap v368: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 42 MiB/s wr, 2.07k op/s 2024-09-11T22:16:07.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:07 smithi193 ceph-mon[35545]: pgmap v368: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 42 MiB/s wr, 2.07k op/s 2024-09-11T22:16:07.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:07 smithi152 ceph-mon[31188]: pgmap v368: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 42 MiB/s wr, 2.07k op/s 2024-09-11T22:16:09.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:09 smithi179 ceph-mon[35603]: pgmap v369: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 42 MiB/s wr, 2.07k op/s 2024-09-11T22:16:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 635.0 s, 2241.4 tps, lat 45.969 ms stddev 57.396 2024-09-11T22:16:09.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:09 smithi193 ceph-mon[35545]: pgmap v369: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 42 MiB/s wr, 2.07k op/s 2024-09-11T22:16:09.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:09 smithi152 ceph-mon[31188]: pgmap v369: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 42 MiB/s wr, 2.07k op/s 2024-09-11T22:16:10.010 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:16:10.405 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:10.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.916+0000 7f34f0410640 1 -- 172.21.15.152:0/3577905684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e8105ec0 msgr2=0x7f34e8106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.916+0000 7f34f0410640 1 --2- 172.21.15.152:0/3577905684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e8105ec0 0x7f34e8106340 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009890 tx=0x7f34e402a380 comp rx=0 tx=0).stop 2024-09-11T22:16:10.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.916+0000 7f34f0410640 1 -- 172.21.15.152:0/3577905684 shutdown_connections 2024-09-11T22:16:10.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.916+0000 7f34f0410640 1 --2- 172.21.15.152:0/3577905684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e8105ec0 0x7f34e8106340 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.916+0000 7f34f0410640 1 --2- 172.21.15.152:0/3577905684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e81011e0 0x7f34e8105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.916+0000 7f34f0410640 1 --2- 172.21.15.152:0/3577905684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e81008c0 0x7f34e8100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.916+0000 7f34f0410640 1 -- 172.21.15.152:0/3577905684 >> 172.21.15.152:0/3577905684 conn(0x7f34e80fc7d0 msgr2=0x7f34e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.917+0000 7f34f0410640 1 -- 172.21.15.152:0/3577905684 shutdown_connections 2024-09-11T22:16:10.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.917+0000 7f34f0410640 1 -- 172.21.15.152:0/3577905684 wait complete. 2024-09-11T22:16:10.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.918+0000 7f34f0410640 1 Processor -- start 2024-09-11T22:16:10.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.918+0000 7f34f0410640 1 -- start start 2024-09-11T22:16:10.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.919+0000 7f34f0410640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e81008c0 0x7f34e8115050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.919+0000 7f34f0410640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e8105ec0 0x7f34e810f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.919+0000 7f34f0410640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e810f610 0x7f34e810fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.919+0000 7f34ee1ac640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e81008c0 0x7f34e8115050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.919+0000 7f34ee1ac640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e81008c0 0x7f34e8115050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:55612/0 (socket says 172.21.15.152:55612) 2024-09-11T22:16:10.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.919+0000 7f34ee1ac640 1 -- 172.21.15.152:0/3138980945 learned_addr learned my addr 172.21.15.152:0/3138980945 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:10.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.919+0000 7f34f0410640 1 -- 172.21.15.152:0/3138980945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f34e8107930 con 0x7f34e8105ec0 2024-09-11T22:16:10.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.919+0000 7f34f0410640 1 -- 172.21.15.152:0/3138980945 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34e81077b0 con 0x7f34e810f610 2024-09-11T22:16:10.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.919+0000 7f34f0410640 1 -- 172.21.15.152:0/3138980945 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34e8107ab0 con 0x7f34e81008c0 2024-09-11T22:16:10.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.920+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e8105ec0 0x7f34e810f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.920+0000 7f34ee9ad640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e810f610 0x7f34e810fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.920+0000 7f34ee1ac640 1 -- 172.21.15.152:0/3138980945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e810f610 msgr2=0x7f34e810fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.920+0000 7f34ee1ac640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e810f610 0x7f34e810fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.920+0000 7f34ee1ac640 1 -- 172.21.15.152:0/3138980945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e8105ec0 msgr2=0x7f34e810f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.920+0000 7f34ee1ac640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e8105ec0 0x7f34e810f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.920+0000 7f34ee1ac640 1 -- 172.21.15.152:0/3138980945 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e81b3c10 con 0x7f34e81008c0 2024-09-11T22:16:10.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.921+0000 7f34ee1ac640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e81008c0 0x7f34e8115050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f34e000c420 tx=0x7f34e000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.921+0000 7f34df7fe640 1 -- 172.21.15.152:0/3138980945 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0004b20 con 0x7f34e81008c0 2024-09-11T22:16:10.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.921+0000 7f34f0410640 1 -- 172.21.15.152:0/3138980945 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e81b3f00 con 0x7f34e81008c0 2024-09-11T22:16:10.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.922+0000 7f34f0410640 1 -- 172.21.15.152:0/3138980945 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e81b43b0 con 0x7f34e81008c0 2024-09-11T22:16:10.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.922+0000 7f34df7fe640 1 -- 172.21.15.152:0/3138980945 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34e0003e50 con 0x7f34e81008c0 2024-09-11T22:16:10.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.922+0000 7f34df7fe640 1 -- 172.21.15.152:0/3138980945 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e000b590 con 0x7f34e81008c0 2024-09-11T22:16:10.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.926+0000 7f34f27e9740 1 Processor -- start 2024-09-11T22:16:10.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.926+0000 7f34f27e9740 1 -- start start 2024-09-11T22:16:10.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 0x55d1a931b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931bdc0 0x55d1a9326140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 0x55d1a9328a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34f27e9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d1a92812e0 con 0x55d1a9326680 2024-09-11T22:16:10.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34f27e9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d1a9228ce0 con 0x55d1a931bdc0 2024-09-11T22:16:10.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34f27e9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d1a927d2a0 con 0x55d1a931b4a0 2024-09-11T22:16:10.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34ed9ab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 0x55d1a9328a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34ed9ab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 0x55d1a9328a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46604/0 (socket says 172.21.15.152:46604) 2024-09-11T22:16:10.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34ed9ab640 1 -- 172.21.15.152:0/2962889047 learned_addr learned my addr 172.21.15.152:0/2962889047 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:10.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34ee9ad640 1 --2- 172.21.15.152:0/2962889047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 0x55d1a931b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34ed9ab640 1 -- 172.21.15.152:0/2962889047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 msgr2=0x55d1a931b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/2962889047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 0x55d1a931b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34ed9ab640 1 -- 172.21.15.152:0/2962889047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931bdc0 msgr2=0x55d1a9326140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:16:10.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/2962889047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931bdc0 0x55d1a9326140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.927+0000 7f34ed9ab640 1 -- 172.21.15.152:0/2962889047 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a920d440 con 0x55d1a9326680 2024-09-11T22:16:10.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.928+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/2962889047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 0x55d1a9328a70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009950 tx=0x7f34d8009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d02e731df25c9dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.928+0000 7f34dcdea640 1 -- 172.21.15.152:0/2962889047 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8017070 con 0x55d1a9326680 2024-09-11T22:16:10.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.928+0000 7f34dcdea640 1 -- 172.21.15.152:0/2962889047 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d8013470 con 0x55d1a9326680 2024-09-11T22:16:10.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.928+0000 7f34dcdea640 1 -- 172.21.15.152:0/2962889047 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8012630 con 0x55d1a9326680 2024-09-11T22:16:10.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.928+0000 7f34df7fe640 1 -- 172.21.15.152:0/3138980945 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f34e001d020 con 0x7f34e81008c0 2024-09-11T22:16:10.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34f27e9740 1 -- 172.21.15.152:0/2962889047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 msgr2=0x55d1a9328a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34f27e9740 1 --2- 172.21.15.152:0/2962889047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 0x55d1a9328a70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009950 tx=0x7f34d8009e10 comp rx=0 tx=0).stop 2024-09-11T22:16:10.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34f27e9740 1 -- 172.21.15.152:0/2962889047 shutdown_connections 2024-09-11T22:16:10.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34f27e9740 1 --2- 172.21.15.152:0/2962889047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 0x55d1a9328a70 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34f27e9740 1 --2- 172.21.15.152:0/2962889047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931bdc0 0x55d1a9326140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34f27e9740 1 --2- 172.21.15.152:0/2962889047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 0x55d1a931b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34f27e9740 1 -- 172.21.15.152:0/2962889047 >> 172.21.15.152:0/2962889047 conn(0x55d1a9317a30 msgr2=0x55d1a9317e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34f27e9740 1 -- 172.21.15.152:0/2962889047 shutdown_connections 2024-09-11T22:16:10.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34f27e9740 1 -- 172.21.15.152:0/2962889047 wait complete. 2024-09-11T22:16:10.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34df7fe640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f34d40a2cd0 0x7f34d40a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f34d40a2cd0 0x7f34d40a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34f27e9740 1 -- start start 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.929+0000 7f34df7fe640 1 -- 172.21.15.152:0/3138980945 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8658+0+0 (secure 0 0 0) 0x7f34e00cf490 con 0x7f34e81008c0 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34f27e9740 1 Processor -- start 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931b4a0 0x55d1a9326010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931bdc0 0x55d1a93232c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a9326680 0x55d1a9323840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34f27e9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d1a9329250 con 0x55d1a931bdc0 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34f27e9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d1a923c050 con 0x55d1a931b4a0 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34f27e9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d1a93293d0 con 0x55d1a9326680 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34f27e9740 10 client.0 _ll_register_callbacks cb 0x55d1a927c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34ed9ab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931bdc0 0x55d1a93232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34ee9ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a9326680 0x55d1a9323840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34ee9ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a9326680 0x55d1a9323840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:55632/0 (socket says 172.21.15.152:55632) 2024-09-11T22:16:10.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34ee9ad640 1 -- 172.21.15.152:0/3072011279 learned_addr learned my addr 172.21.15.152:0/3072011279 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:10.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.930+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f34d40a2cd0 0x7f34d40a5190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f34d8013dd0 tx=0x7f34d80046c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.931+0000 7f34ee9ad640 1 -- 172.21.15.152:0/3072011279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931b4a0 msgr2=0x55d1a9326010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.931+0000 7f34ee9ad640 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931b4a0 0x55d1a9326010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.931+0000 7f34ee9ad640 1 -- 172.21.15.152:0/3072011279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931bdc0 msgr2=0x55d1a93232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.931+0000 7f34ee9ad640 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931bdc0 0x55d1a93232c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.931+0000 7f34ee9ad640 1 -- 172.21.15.152:0/3072011279 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1a8ff23c0 con 0x55d1a9326680 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.931+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931bdc0 0x55d1a93232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.931+0000 7f34ee9ad640 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a9326680 0x55d1a9323840 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009890 tx=0x7f34e40041a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0061d3602b9d55b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.931+0000 7f34d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.931+0000 7f34d1ffb640 1 -- 172.21.15.152:0/3072011279 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e4037040 con 0x55d1a9326680 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.931+0000 7f34f27e9740 1 -- 172.21.15.152:0/3072011279 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d8013470 con 0x55d1a9326680 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.932+0000 7f34d1ffb640 1 -- 172.21.15.152:0/3072011279 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8658+0+0 (secure 0 0 0) 0x7f34e4030750 con 0x55d1a9326680 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.932+0000 7f34d1ffb640 1 -- 172.21.15.152:0/3072011279 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f34e4030970 con 0x55d1a9326680 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.932+0000 7f34f27e9740 10 client.27790 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.932+0000 7f34f27e9740 1 -- 172.21.15.152:0/3072011279 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d1a93327a0 con 0x55d1a9326680 2024-09-11T22:16:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.933+0000 7f34d1ffb640 1 -- 172.21.15.152:0/3072011279 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d8013470 con 0x55d1a9326680 2024-09-11T22:16:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.933+0000 7f34d1ffb640 1 -- 172.21.15.152:0/3072011279 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f34e406f020 con 0x55d1a9326680 2024-09-11T22:16:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.933+0000 7f34f27e9740 10 client.27790 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.933+0000 7f34f27e9740 10 client.27790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.933+0000 7f34f27e9740 20 client.27790 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.933+0000 7f34f27e9740 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d1a9333da0 0x55d1a9336240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.933+0000 7f34f27e9740 4 client.27790 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.933+0000 7f34f27e9740 1 -- 172.21.15.152:0/3072011279 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1a928e850 con 0x55d1a9333da0 2024-09-11T22:16:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.934+0000 7f34ee1ac640 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d1a9333da0 0x55d1a9336240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.934+0000 7f34d1ffb640 10 client.27790 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.934+0000 7f34ee1ac640 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d1a9333da0 0x55d1a9336240 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19cf53058d6a2c37 server_cookie=377a8186b9b2423b in_seq=0 out_seq=0 2024-09-11T22:16:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34d1ffb640 1 -- 172.21.15.152:0/3072011279 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1a928e850 con 0x55d1a9333da0 2024-09-11T22:16:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34d1ffb640 10 client.27790 handle_command_reply: tid=0 2024-09-11T22:16:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 1 client.27790 shutdown 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 1 -- 172.21.15.152:0/3072011279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a9326680 msgr2=0x55d1a9323840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a9326680 0x55d1a9323840 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009890 tx=0x7f34e40041a0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 1 -- 172.21.15.152:0/3072011279 shutdown_connections 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d1a9333da0 0x55d1a9336240 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a9326680 0x55d1a9323840 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931bdc0 0x55d1a93232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34d1ffb640 0 client.27790 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 1 --2- 172.21.15.152:0/3072011279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931b4a0 0x55d1a9326010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 1 -- 172.21.15.152:0/3072011279 >> 172.21.15.152:0/3072011279 conn(0x55d1a9317a30 msgr2=0x55d1a931d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 1 -- 172.21.15.152:0/3072011279 shutdown_connections 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 1 -- 172.21.15.152:0/3072011279 wait complete. 2024-09-11T22:16:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.935+0000 7f34f27e9740 20 client.27790 trim_cache size 0 max 16384 2024-09-11T22:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.959+0000 7f34f27e9740 1 Processor -- start 2024-09-11T22:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.959+0000 7f34f27e9740 1 -- start start 2024-09-11T22:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 0x55d1a9325230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931bdc0 0x55d1a933bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 0x55d1a933c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34f27e9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc011200 con 0x55d1a9326680 2024-09-11T22:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34f27e9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc00ead0 con 0x55d1a931bdc0 2024-09-11T22:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34f27e9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc00c940 con 0x55d1a931b4a0 2024-09-11T22:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ee9ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 0x55d1a933c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ee1ac640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 0x55d1a9325230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ee1ac640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 0x55d1a9325230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:55636/0 (socket says 172.21.15.152:55636) 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ee1ac640 1 -- 172.21.15.152:0/462248427 learned_addr learned my addr 172.21.15.152:0/462248427 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ee9ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 0x55d1a933c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46614/0 (socket says 172.21.15.152:46614) 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/462248427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931bdc0 0x55d1a933bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ed9ab640 1 -- 172.21.15.152:0/462248427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 msgr2=0x55d1a9325230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/462248427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 0x55d1a9325230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ed9ab640 1 -- 172.21.15.152:0/462248427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 msgr2=0x55d1a933c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/462248427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 0x55d1a933c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ed9ab640 1 -- 172.21.15.152:0/462248427 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a931b2d0 con 0x55d1a931bdc0 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ee1ac640 1 --2- 172.21.15.152:0/462248427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 0x55d1a9325230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.960+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/462248427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931bdc0 0x55d1a933bb10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f34d800e5a0 tx=0x7f34d8009110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=904bfc5f981e31a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.961+0000 7f34d3fff640 1 -- 172.21.15.152:0/462248427 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d801c9a0 con 0x55d1a931bdc0 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.961+0000 7f34d3fff640 1 -- 172.21.15.152:0/462248427 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d801cb40 con 0x55d1a931bdc0 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.961+0000 7f34d3fff640 1 -- 172.21.15.152:0/462248427 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8028690 con 0x55d1a931bdc0 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.961+0000 7f34f27e9740 1 -- 172.21.15.152:0/462248427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931bdc0 msgr2=0x55d1a933bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.961+0000 7f34f27e9740 1 --2- 172.21.15.152:0/462248427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931bdc0 0x55d1a933bb10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f34d800e5a0 tx=0x7f34d8009110 comp rx=0 tx=0).stop 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 -- 172.21.15.152:0/462248427 shutdown_connections 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 --2- 172.21.15.152:0/462248427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a9326680 0x55d1a933c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 --2- 172.21.15.152:0/462248427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a931bdc0 0x55d1a933bb10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 --2- 172.21.15.152:0/462248427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931b4a0 0x55d1a9325230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 -- 172.21.15.152:0/462248427 >> 172.21.15.152:0/462248427 conn(0x55d1a9317a30 msgr2=0x55d1a9324b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 -- 172.21.15.152:0/462248427 shutdown_connections 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 -- 172.21.15.152:0/462248427 wait complete. 2024-09-11T22:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 -- start start 2024-09-11T22:16:10.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 Processor -- start 2024-09-11T22:16:10.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931b4a0 0x55d1a932b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931bdc0 0x55d1a932bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a9326680 0x55d1a932c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc00cf90 con 0x55d1a931b4a0 2024-09-11T22:16:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc00e400 con 0x55d1a9326680 2024-09-11T22:16:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.962+0000 7f34f27e9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc00d660 con 0x55d1a931bdc0 2024-09-11T22:16:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34f27e9740 10 client.0 _ll_register_callbacks cb 0x7f34e0009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34ee1ac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931b4a0 0x55d1a932b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34ee1ac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931b4a0 0x55d1a932b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46618/0 (socket says 172.21.15.152:46618) 2024-09-11T22:16:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34ee1ac640 1 -- 172.21.15.152:0/2412136103 learned_addr learned my addr 172.21.15.152:0/2412136103 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34ee9ad640 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a9326680 0x55d1a932c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931bdc0 0x55d1a932bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34ee1ac640 1 -- 172.21.15.152:0/2412136103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931bdc0 msgr2=0x55d1a932bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34ee1ac640 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931bdc0 0x55d1a932bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34ee1ac640 1 -- 172.21.15.152:0/2412136103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a9326680 msgr2=0x55d1a932c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34ee1ac640 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a9326680 0x55d1a932c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34ee1ac640 1 -- 172.21.15.152:0/2412136103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1a939ff50 con 0x55d1a931b4a0 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34ee1ac640 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931b4a0 0x55d1a932b680 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f34e00ccc00 tx=0x7f34e000b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecec7bbf7fcbaa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34d1ffb640 1 -- 172.21.15.152:0/2412136103 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0084e60 con 0x55d1a931b4a0 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34d1ffb640 1 -- 172.21.15.152:0/2412136103 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8658+0+0 (secure 0 0 0) 0x7f34e00ccdd0 con 0x55d1a931b4a0 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.963+0000 7f34f27e9740 1 -- 172.21.15.152:0/2412136103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d801cb40 con 0x55d1a931b4a0 2024-09-11T22:16:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.964+0000 7f34d1ffb640 1 -- 172.21.15.152:0/2412136103 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f34e001a040 con 0x55d1a931b4a0 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.964+0000 7f34f27e9740 10 client.18363 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.964+0000 7f34f27e9740 1 -- 172.21.15.152:0/2412136103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d1a93a12c0 con 0x55d1a931b4a0 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.964+0000 7f34d1ffb640 1 -- 172.21.15.152:0/2412136103 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d801cb40 con 0x55d1a931b4a0 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.964+0000 7f34d1ffb640 1 -- 172.21.15.152:0/2412136103 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f34e000b040 con 0x55d1a931b4a0 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.964+0000 7f34f27e9740 10 client.18363 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.964+0000 7f34f27e9740 10 client.18363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.964+0000 7f34f27e9740 20 client.18363 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.964+0000 7f34f27e9740 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d1a93a1a90 0x55d1a93a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.964+0000 7f34f27e9740 4 client.18363 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.964+0000 7f34f27e9740 1 -- 172.21.15.152:0/2412136103 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d1a9288d60 con 0x55d1a93a1a90 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.965+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d1a93a1a90 0x55d1a93a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.966+0000 7f34ed9ab640 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d1a93a1a90 0x55d1a93a3eb0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffc825fadb4e440f server_cookie=1802a97d4d80910f in_seq=0 out_seq=0 2024-09-11T22:16:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.966+0000 7f34d1ffb640 10 client.18363 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.966+0000 7f34d1ffb640 1 -- 172.21.15.152:0/2412136103 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d1a9288d60 con 0x55d1a93a1a90 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.966+0000 7f34d1ffb640 10 client.18363 handle_command_reply: tid=0 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.966+0000 7f34f27e9740 1 client.18363 shutdown 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.966+0000 7f34f27e9740 1 -- 172.21.15.152:0/2412136103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931b4a0 msgr2=0x55d1a932b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.966+0000 7f34f27e9740 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931b4a0 0x55d1a932b680 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f34e00ccc00 tx=0x7f34e000b7a0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.966+0000 7f34f27e9740 1 -- 172.21.15.152:0/2412136103 shutdown_connections 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f27e9740 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d1a93a1a90 0x55d1a93a3eb0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f27e9740 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1a9326680 0x55d1a932c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f27e9740 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d1a931bdc0 0x55d1a932bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f27e9740 1 --2- 172.21.15.152:0/2412136103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d1a931b4a0 0x55d1a932b680 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f27e9740 1 -- 172.21.15.152:0/2412136103 >> 172.21.15.152:0/2412136103 conn(0x55d1a9317a30 msgr2=0x55d1a9325340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34d1ffb640 0 client.18363 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f27e9740 1 -- 172.21.15.152:0/2412136103 shutdown_connections 2024-09-11T22:16:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f27e9740 1 -- 172.21.15.152:0/2412136103 wait complete. 2024-09-11T22:16:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f27e9740 20 client.18363 trim_cache size 0 max 16384 2024-09-11T22:16:10.973 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:16:10.973 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:16:10.973 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:16:10.973 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:16:10.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f0410640 1 -- 172.21.15.152:0/3138980945 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f34d40a2cd0 msgr2=0x7f34d40a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f0410640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f34d40a2cd0 0x7f34d40a5190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f34d8013dd0 tx=0x7f34d80046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f0410640 1 -- 172.21.15.152:0/3138980945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e81008c0 msgr2=0x7f34e8115050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.967+0000 7f34f0410640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e81008c0 0x7f34e8115050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f34e000c420 tx=0x7f34e000c820 comp rx=0 tx=0).stop 2024-09-11T22:16:10.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.968+0000 7f34f0410640 1 -- 172.21.15.152:0/3138980945 shutdown_connections 2024-09-11T22:16:10.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.968+0000 7f34f0410640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f34d40a2cd0 0x7f34d40a5190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.968+0000 7f34f0410640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e810f610 0x7f34e810fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.968+0000 7f34f0410640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e8105ec0 0x7f34e810f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.968+0000 7f34f0410640 1 --2- 172.21.15.152:0/3138980945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e81008c0 0x7f34e8115050 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.968+0000 7f34f0410640 1 -- 172.21.15.152:0/3138980945 >> 172.21.15.152:0/3138980945 conn(0x7f34e80fc7d0 msgr2=0x7f34e81080f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.968+0000 7f34f0410640 1 -- 172.21.15.152:0/3138980945 shutdown_connections 2024-09-11T22:16:10.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:10.968+0000 7f34f0410640 1 -- 172.21.15.152:0/3138980945 wait complete. 2024-09-11T22:16:11.790 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:11 smithi152 ceph-mon[31188]: pgmap v370: 97 pgs: 97 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 39 MiB/s wr, 2.04k op/s 2024-09-11T22:16:11.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:11 smithi179 ceph-mon[35603]: pgmap v370: 97 pgs: 97 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 39 MiB/s wr, 2.04k op/s 2024-09-11T22:16:11.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:11 smithi193 ceph-mon[35545]: pgmap v370: 97 pgs: 97 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 39 MiB/s wr, 2.04k op/s 2024-09-11T22:16:11.832 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:16:11.832 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:16:12.192 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:12.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.713+0000 7fb801526640 1 -- 172.21.15.152:0/1759752686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7fc102ef0 msgr2=0x7fb7fc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:12.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.713+0000 7fb801526640 1 --2- 172.21.15.152:0/1759752686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7fc102ef0 0x7fb7fc10da40 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009ca0 tx=0x7fb7f402a950 comp rx=0 tx=0).stop 2024-09-11T22:16:12.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.714+0000 7fb801526640 1 -- 172.21.15.152:0/1759752686 shutdown_connections 2024-09-11T22:16:12.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.714+0000 7fb801526640 1 --2- 172.21.15.152:0/1759752686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7fc102ef0 0x7fb7fc10da40 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:12.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.714+0000 7fb801526640 1 --2- 172.21.15.152:0/1759752686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7fc102570 0x7fb7fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:12.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.714+0000 7fb801526640 1 --2- 172.21.15.152:0/1759752686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc100e20 0x7fb7fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:12.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.714+0000 7fb801526640 1 -- 172.21.15.152:0/1759752686 >> 172.21.15.152:0/1759752686 conn(0x7fb7fc0fc7d0 msgr2=0x7fb7fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.714+0000 7fb801526640 1 -- 172.21.15.152:0/1759752686 shutdown_connections 2024-09-11T22:16:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.714+0000 7fb801526640 1 -- 172.21.15.152:0/1759752686 wait complete. 2024-09-11T22:16:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.715+0000 7fb801526640 1 Processor -- start 2024-09-11T22:16:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.715+0000 7fb801526640 1 -- start start 2024-09-11T22:16:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.715+0000 7fb801526640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7fc100e20 0x7fb7fc1a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.715+0000 7fb801526640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7fc102570 0x7fb7fc1a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.715+0000 7fb801526640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc102ef0 0x7fb7fc19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.715+0000 7fb801526640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc110f80 con 0x7fb7fc100e20 2024-09-11T22:16:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.715+0000 7fb801526640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc110e00 con 0x7fb7fc102ef0 2024-09-11T22:16:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.715+0000 7fb801526640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc111100 con 0x7fb7fc102570 2024-09-11T22:16:12.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7faffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7fc100e20 0x7fb7fc1a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7f27fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7fc102570 0x7fb7fc1a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7faffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7fc100e20 0x7fb7fc1a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46644/0 (socket says 172.21.15.152:46644) 2024-09-11T22:16:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7faffd640 1 -- 172.21.15.152:0/1669441967 learned_addr learned my addr 172.21.15.152:0/1669441967 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7fb7fe640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc102ef0 0x7fb7fc19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7faffd640 1 -- 172.21.15.152:0/1669441967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7fc102570 msgr2=0x7fb7fc1a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7faffd640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7fc102570 0x7fb7fc1a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7faffd640 1 -- 172.21.15.152:0/1669441967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc102ef0 msgr2=0x7fb7fc19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7faffd640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc102ef0 0x7fb7fc19ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7faffd640 1 -- 172.21.15.152:0/1669441967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc19f330 con 0x7fb7fc100e20 2024-09-11T22:16:12.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7f27fc640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7fc102570 0x7fb7fc1a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7faffd640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7fc100e20 0x7fb7fc1a4770 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00e9f0 tx=0x7fb7ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7f8ff9640 1 -- 172.21.15.152:0/1669441967 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00cd80 con 0x7fb7fc100e20 2024-09-11T22:16:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7f8ff9640 1 -- 172.21.15.152:0/1669441967 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7ec010910 con 0x7fb7fc100e20 2024-09-11T22:16:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb7f8ff9640 1 -- 172.21.15.152:0/1669441967 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec018990 con 0x7fb7fc100e20 2024-09-11T22:16:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb801526640 1 -- 172.21.15.152:0/1669441967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7fc19f620 con 0x7fb7fc100e20 2024-09-11T22:16:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.716+0000 7fb801526640 1 -- 172.21.15.152:0/1669441967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7fc1ab640 con 0x7fb7fc100e20 2024-09-11T22:16:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.718+0000 7fb801526640 1 -- 172.21.15.152:0/1669441967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7fc101200 con 0x7fb7fc100e20 2024-09-11T22:16:12.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.719+0000 7fb7f8ff9640 1 -- 172.21.15.152:0/1669441967 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb7ec010ac0 con 0x7fb7fc100e20 2024-09-11T22:16:12.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.720+0000 7fb7f8ff9640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2cf0 0x7fb7e80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:12.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.720+0000 7fb7f27fc640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2cf0 0x7fb7e80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:12.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.720+0000 7fb7f8ff9640 1 -- 172.21.15.152:0/1669441967 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8658+0+0 (secure 0 0 0) 0x7fb7ec0cf8b0 con 0x7fb7fc100e20 2024-09-11T22:16:12.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.722+0000 7fb7f27fc640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2cf0 0x7fb7e80a51b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0fed30 tx=0x7fb7e4005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:12.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:12.726+0000 7fb7f8ff9640 1 -- 172.21.15.152:0/1669441967 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7ec09bdf0 con 0x7fb7fc100e20 2024-09-11T22:16:13.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.047+0000 7fb801526640 1 -- 172.21.15.152:0/1669441967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7fc1ab810 con 0x7fb7fc100e20 2024-09-11T22:16:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.048+0000 7fb7f8ff9640 1 -- 172.21.15.152:0/1669441967 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7fb7ec0a00f0 con 0x7fb7fc100e20 2024-09-11T22:16:13.049 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:16:13.050 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:16:13.050 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:16:13.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.051+0000 7fb801526640 1 -- 172.21.15.152:0/1669441967 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2cf0 msgr2=0x7fb7e80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:13.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.051+0000 7fb801526640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2cf0 0x7fb7e80a51b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0fed30 tx=0x7fb7e4005f90 comp rx=0 tx=0).stop 2024-09-11T22:16:13.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.051+0000 7fb801526640 1 -- 172.21.15.152:0/1669441967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7fc100e20 msgr2=0x7fb7fc1a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:13.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.051+0000 7fb801526640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7fc100e20 0x7fb7fc1a4770 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00e9f0 tx=0x7fb7ec00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:16:13.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.051+0000 7fb801526640 1 -- 172.21.15.152:0/1669441967 shutdown_connections 2024-09-11T22:16:13.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.051+0000 7fb801526640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7e80a2cf0 0x7fb7e80a51b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:13.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.051+0000 7fb801526640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc102ef0 0x7fb7fc19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:13.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.051+0000 7fb801526640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb7fc102570 0x7fb7fc1a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:13.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.051+0000 7fb801526640 1 --2- 172.21.15.152:0/1669441967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7fc100e20 0x7fb7fc1a4770 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:13.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.051+0000 7fb801526640 1 -- 172.21.15.152:0/1669441967 >> 172.21.15.152:0/1669441967 conn(0x7fb7fc0fc7d0 msgr2=0x7fb7fc06a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:13.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.052+0000 7fb801526640 1 -- 172.21.15.152:0/1669441967 shutdown_connections 2024-09-11T22:16:13.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:13.052+0000 7fb801526640 1 -- 172.21.15.152:0/1669441967 wait complete. 2024-09-11T22:16:13.718 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:13 smithi152 ceph-mon[31188]: pgmap v371: 97 pgs: 97 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 39 MiB/s wr, 2.04k op/s 2024-09-11T22:16:13.718 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:13 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1669441967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:13.757 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:16:13.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:13 smithi179 ceph-mon[35603]: pgmap v371: 97 pgs: 97 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 39 MiB/s wr, 2.04k op/s 2024-09-11T22:16:13.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:13 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1669441967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:13.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:13 smithi193 ceph-mon[35545]: pgmap v371: 97 pgs: 97 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 39 MiB/s wr, 2.04k op/s 2024-09-11T22:16:13.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:13 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1669441967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:14.115 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:14.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.683+0000 7f109a6f3640 1 -- 172.21.15.152:0/1153653649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1094102790 msgr2=0x7f10941067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:14.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.683+0000 7f109a6f3640 1 --2- 172.21.15.152:0/1153653649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1094102790 0x7f10941067e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f107c009900 tx=0x7f107c02a410 comp rx=0 tx=0).stop 2024-09-11T22:16:14.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.683+0000 7f109a6f3640 1 -- 172.21.15.152:0/1153653649 shutdown_connections 2024-09-11T22:16:14.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.683+0000 7f109a6f3640 1 --2- 172.21.15.152:0/1153653649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1094106f10 0x7f109410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.683+0000 7f109a6f3640 1 --2- 172.21.15.152:0/1153653649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1094102790 0x7f10941067e0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.683+0000 7f109a6f3640 1 --2- 172.21.15.152:0/1153653649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1094101de0 0x7f10941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.683+0000 7f109a6f3640 1 -- 172.21.15.152:0/1153653649 >> 172.21.15.152:0/1153653649 conn(0x7f10940fd8c0 msgr2=0x7f10940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:14.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.683+0000 7f109a6f3640 1 -- 172.21.15.152:0/1153653649 shutdown_connections 2024-09-11T22:16:14.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.683+0000 7f109a6f3640 1 -- 172.21.15.152:0/1153653649 wait complete. 2024-09-11T22:16:14.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.684+0000 7f109a6f3640 1 Processor -- start 2024-09-11T22:16:14.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.684+0000 7f109a6f3640 1 -- start start 2024-09-11T22:16:14.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.684+0000 7f109a6f3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1094101de0 0x7f10941984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.684+0000 7f109a6f3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1094102790 0x7f10941989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.684+0000 7f109a6f3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1094106f10 0x7f109419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.684+0000 7f109a6f3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1094111f70 con 0x7f1094106f10 2024-09-11T22:16:14.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.684+0000 7f109a6f3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1094111df0 con 0x7f1094101de0 2024-09-11T22:16:14.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.684+0000 7f109a6f3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10941120f0 con 0x7f1094102790 2024-09-11T22:16:14.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.685+0000 7f1093fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1094101de0 0x7f10941984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.685+0000 7f1093fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1094101de0 0x7f10941984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:57528/0 (socket says 172.21.15.152:57528) 2024-09-11T22:16:14.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.685+0000 7f1093fff640 1 -- 172.21.15.152:0/3431823938 learned_addr learned my addr 172.21.15.152:0/3431823938 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:14.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.685+0000 7f1098c90640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1094106f10 0x7f109419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.685+0000 7f108bfff640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1094102790 0x7f10941989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.685+0000 7f1093fff640 1 -- 172.21.15.152:0/3431823938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1094102790 msgr2=0x7f10941989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:14.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.685+0000 7f1093fff640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1094102790 0x7f10941989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.685+0000 7f1093fff640 1 -- 172.21.15.152:0/3431823938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1094106f10 msgr2=0x7f109419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:14.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.685+0000 7f1093fff640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1094106f10 0x7f109419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.685+0000 7f1093fff640 1 -- 172.21.15.152:0/3431823938 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109419d2c0 con 0x7f1094101de0 2024-09-11T22:16:14.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.685+0000 7f1093fff640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1094101de0 0x7f10941984b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f108400e9f0 tx=0x7f108400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:14.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.686+0000 7f1091ffb640 1 -- 172.21.15.152:0/3431823938 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108400cd80 con 0x7f1094101de0 2024-09-11T22:16:14.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.686+0000 7f1091ffb640 1 -- 172.21.15.152:0/3431823938 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1084005500 con 0x7f1094101de0 2024-09-11T22:16:14.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.686+0000 7f1091ffb640 1 -- 172.21.15.152:0/3431823938 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1084010690 con 0x7f1094101de0 2024-09-11T22:16:14.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.686+0000 7f109a6f3640 1 -- 172.21.15.152:0/3431823938 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109419d550 con 0x7f1094101de0 2024-09-11T22:16:14.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.686+0000 7f109a6f3640 1 -- 172.21.15.152:0/3431823938 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109419da40 con 0x7f1094101de0 2024-09-11T22:16:14.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.689+0000 7f109cacc740 1 Processor -- start 2024-09-11T22:16:14.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.689+0000 7f1091ffb640 1 -- 172.21.15.152:0/3431823938 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f10840046c0 con 0x7f1094101de0 2024-09-11T22:16:14.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.690+0000 7f109cacc740 1 -- start start 2024-09-11T22:16:14.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f109cacc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef20f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f109cacc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef20f5d0 0x5582ef20fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f109cacc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 0x5582ef21c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f109cacc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5582ef1752f0 con 0x5582ef21a370 2024-09-11T22:16:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f109cacc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5582ef11ccf0 con 0x5582ef210b40 2024-09-11T22:16:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f109cacc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5582ef1712b0 con 0x5582ef20f5d0 2024-09-11T22:16:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f1098c90640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef20f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f1098c90640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef20f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:57538/0 (socket says 172.21.15.152:57538) 2024-09-11T22:16:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f1098c90640 1 -- 172.21.15.152:0/112137333 learned_addr learned my addr 172.21.15.152:0/112137333 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f1093fff640 1 --2- 172.21.15.152:0/112137333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef20f5d0 0x5582ef20fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f108bfff640 1 --2- 172.21.15.152:0/112137333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 0x5582ef21c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f1098c90640 1 -- 172.21.15.152:0/112137333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef20f5d0 msgr2=0x5582ef20fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f1098c90640 1 --2- 172.21.15.152:0/112137333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef20f5d0 0x5582ef20fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f1098c90640 1 -- 172.21.15.152:0/112137333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 msgr2=0x5582ef21c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f1098c90640 1 --2- 172.21.15.152:0/112137333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 0x5582ef21c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.691+0000 7f1098c90640 1 -- 172.21.15.152:0/112137333 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582ef1013a0 con 0x5582ef210b40 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.692+0000 7f1098c90640 1 --2- 172.21.15.152:0/112137333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef20f090 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f108c009f90 tx=0x7f108c010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f12718bcb6fc795 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.692+0000 7f108a7fc640 1 -- 172.21.15.152:0/112137333 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c011700 con 0x5582ef210b40 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.692+0000 7f108a7fc640 1 -- 172.21.15.152:0/112137333 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f108c011d80 con 0x5582ef210b40 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.692+0000 7f108a7fc640 1 -- 172.21.15.152:0/112137333 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c018380 con 0x5582ef210b40 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f1091ffb640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10800a2e40 0x7f10800a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f109cacc740 1 -- 172.21.15.152:0/112137333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 msgr2=0x5582ef20f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f109cacc740 1 --2- 172.21.15.152:0/112137333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef20f090 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f108c009f90 tx=0x7f108c010860 comp rx=0 tx=0).stop 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f109cacc740 1 -- 172.21.15.152:0/112137333 shutdown_connections 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f109cacc740 1 --2- 172.21.15.152:0/112137333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 0x5582ef21c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f109cacc740 1 --2- 172.21.15.152:0/112137333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef20f5d0 0x5582ef20fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f109cacc740 1 --2- 172.21.15.152:0/112137333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef20f090 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f109cacc740 1 -- 172.21.15.152:0/112137333 >> 172.21.15.152:0/112137333 conn(0x5582ef1d8310 msgr2=0x5582ef20bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f1091ffb640 1 -- 172.21.15.152:0/3431823938 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f10840cf860 con 0x7f1094101de0 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f109cacc740 1 -- 172.21.15.152:0/112137333 shutdown_connections 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f1093fff640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10800a2e40 0x7f10800a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f109cacc740 1 -- 172.21.15.152:0/112137333 wait complete. 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.693+0000 7f109cacc740 1 -- start start 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f1093fff640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10800a2e40 0x7f10800a5300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f10840cd000 tx=0x7f10840d5550 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f109cacc740 1 Processor -- start 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f109cacc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef20f5d0 0x5582ef219ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f109cacc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef210b40 0x5582ef216f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f109cacc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef21a370 0x5582ef2174f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f109cacc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5582ef21d070 con 0x5582ef20f5d0 2024-09-11T22:16:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f109cacc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5582ef130060 con 0x5582ef21a370 2024-09-11T22:16:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f109cacc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5582ef21d1f0 con 0x5582ef210b40 2024-09-11T22:16:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f109cacc740 10 client.0 _ll_register_callbacks cb 0x5582eee838c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f108bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef210b40 0x5582ef216f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f1098c90640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef20f5d0 0x5582ef219ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f108bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef210b40 0x5582ef216f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:49990/0 (socket says 172.21.15.152:49990) 2024-09-11T22:16:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f108bfff640 1 -- 172.21.15.152:0/2261476855 learned_addr learned my addr 172.21.15.152:0/2261476855 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f1098c90640 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef21a370 0x5582ef2174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f108bfff640 1 -- 172.21.15.152:0/2261476855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef21a370 msgr2=0x5582ef2174f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.694+0000 7f108bfff640 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef21a370 0x5582ef2174f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.695+0000 7f108bfff640 1 -- 172.21.15.152:0/2261476855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef20f5d0 msgr2=0x5582ef219ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.695+0000 7f108bfff640 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef20f5d0 0x5582ef219ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.695+0000 7f108bfff640 1 -- 172.21.15.152:0/2261476855 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582eeee63c0 con 0x5582ef210b40 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.695+0000 7f1098c90640 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef21a370 0x5582ef2174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.695+0000 7f108bfff640 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef210b40 0x5582ef216f90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f107c005ab0 tx=0x7f107c031860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43575c152b60a8be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.695+0000 7f10737fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.695+0000 7f10737fe640 1 -- 172.21.15.152:0/2261476855 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c035070 con 0x5582ef210b40 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.695+0000 7f10737fe640 1 -- 172.21.15.152:0/2261476855 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f107c004240 con 0x5582ef210b40 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.695+0000 7f109cacc740 1 -- 172.21.15.152:0/2261476855 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f108c011d80 con 0x5582ef210b40 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.696+0000 7f10737fe640 1 -- 172.21.15.152:0/2261476855 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f107c005d50 con 0x5582ef210b40 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.696+0000 7f109cacc740 10 client.27814 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.696+0000 7f109cacc740 1 -- 172.21.15.152:0/2261476855 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5582ef228a80 con 0x5582ef210b40 2024-09-11T22:16:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.696+0000 7f10737fe640 1 -- 172.21.15.152:0/2261476855 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f107c004440 con 0x5582ef210b40 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.696+0000 7f10737fe640 1 -- 172.21.15.152:0/2261476855 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f107c004be0 con 0x5582ef210b40 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.696+0000 7f109cacc740 10 client.27814 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.696+0000 7f109cacc740 10 client.27814 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.696+0000 7f109cacc740 20 client.27814 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.696+0000 7f109cacc740 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5582ef229f40 0x5582ef22c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.696+0000 7f109cacc740 4 client.27814 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.696+0000 7f109cacc740 1 -- 172.21.15.152:0/2261476855 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f108c011d80 con 0x5582ef229f40 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.697+0000 7f1098c90640 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5582ef229f40 0x5582ef22c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.697+0000 7f10737fe640 10 client.27814 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.697+0000 7f1098c90640 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5582ef229f40 0x5582ef22c330 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5b23234d536bbf3 server_cookie=6d189b5a209dae2a in_seq=0 out_seq=0 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f10737fe640 1 -- 172.21.15.152:0/2261476855 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f108c011d80 con 0x5582ef229f40 2024-09-11T22:16:14.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f10737fe640 10 client.27814 handle_command_reply: tid=0 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 1 client.27814 shutdown 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 1 -- 172.21.15.152:0/2261476855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef210b40 msgr2=0x5582ef216f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef210b40 0x5582ef216f90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f107c005ab0 tx=0x7f107c031860 comp rx=0 tx=0).stop 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 1 -- 172.21.15.152:0/2261476855 shutdown_connections 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5582ef229f40 0x5582ef22c330 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f10737fe640 0 client.27814 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef21a370 0x5582ef2174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef210b40 0x5582ef216f90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 1 --2- 172.21.15.152:0/2261476855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef20f5d0 0x5582ef219ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 1 -- 172.21.15.152:0/2261476855 >> 172.21.15.152:0/2261476855 conn(0x5582ef1d8310 msgr2=0x5582ef211960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 1 -- 172.21.15.152:0/2261476855 shutdown_connections 2024-09-11T22:16:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 1 -- 172.21.15.152:0/2261476855 wait complete. 2024-09-11T22:16:14.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.698+0000 7f109cacc740 20 client.27814 trim_cache size 0 max 16384 2024-09-11T22:16:14.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.720+0000 7f109cacc740 1 Processor -- start 2024-09-11T22:16:14.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.720+0000 7f109cacc740 1 -- start start 2024-09-11T22:16:14.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.721+0000 7f109cacc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef20f5d0 0x5582ef226310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.721+0000 7f109cacc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef216ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.721+0000 7f109cacc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef21a370 0x5582ef212120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.721+0000 7f109cacc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f10941b6960 con 0x5582ef20f5d0 2024-09-11T22:16:14.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.721+0000 7f109cacc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10941b4230 con 0x5582ef210b40 2024-09-11T22:16:14.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.721+0000 7f109cacc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10941b20a0 con 0x5582ef21a370 2024-09-11T22:16:14.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.724+0000 7f108bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef216ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.727+0000 7f108bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef216ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:57550/0 (socket says 172.21.15.152:57550) 2024-09-11T22:16:14.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.727+0000 7f108bfff640 1 -- 172.21.15.152:0/672822446 learned_addr learned my addr 172.21.15.152:0/672822446 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:14.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.728+0000 7f1098c90640 1 --2- 172.21.15.152:0/672822446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef20f5d0 0x5582ef226310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.728+0000 7f1098c90640 1 --2- 172.21.15.152:0/672822446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef21a370 0x5582ef212120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.731+0000 7f108bfff640 1 -- 172.21.15.152:0/672822446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef21a370 msgr2=0x5582ef212120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:14.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.731+0000 7f108bfff640 1 --2- 172.21.15.152:0/672822446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef21a370 0x5582ef212120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.731+0000 7f108bfff640 1 -- 172.21.15.152:0/672822446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef20f5d0 msgr2=0x5582ef226310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:14.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.731+0000 7f108bfff640 1 --2- 172.21.15.152:0/672822446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef20f5d0 0x5582ef226310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.731+0000 7f108bfff640 1 -- 172.21.15.152:0/672822446 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582ef21a050 con 0x5582ef210b40 2024-09-11T22:16:14.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.736+0000 7f108bfff640 1 --2- 172.21.15.152:0/672822446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef216ec0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f107c02a930 tx=0x7f107c02a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bf43f4dd0fff758 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:14.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.740+0000 7f1089ffb640 1 -- 172.21.15.152:0/672822446 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c035070 con 0x5582ef210b40 2024-09-11T22:16:14.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.740+0000 7f1089ffb640 1 -- 172.21.15.152:0/672822446 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f107c031d60 con 0x5582ef210b40 2024-09-11T22:16:14.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.741+0000 7f1089ffb640 1 -- 172.21.15.152:0/672822446 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c004ae0 con 0x5582ef210b40 2024-09-11T22:16:14.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.742+0000 7f109cacc740 1 -- 172.21.15.152:0/672822446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 msgr2=0x5582ef216ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:14.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.742+0000 7f109cacc740 1 --2- 172.21.15.152:0/672822446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef216ec0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f107c02a930 tx=0x7f107c02a410 comp rx=0 tx=0).stop 2024-09-11T22:16:14.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.746+0000 7f109cacc740 1 -- 172.21.15.152:0/672822446 shutdown_connections 2024-09-11T22:16:14.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.746+0000 7f109cacc740 1 --2- 172.21.15.152:0/672822446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef21a370 0x5582ef212120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.746+0000 7f109cacc740 1 --2- 172.21.15.152:0/672822446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef216ec0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.746+0000 7f109cacc740 1 --2- 172.21.15.152:0/672822446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef20f5d0 0x5582ef226310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.746+0000 7f109cacc740 1 -- 172.21.15.152:0/672822446 >> 172.21.15.152:0/672822446 conn(0x5582ef1d8310 msgr2=0x5582ef216080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:14.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.751+0000 7f109cacc740 1 -- 172.21.15.152:0/672822446 shutdown_connections 2024-09-11T22:16:14.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.753+0000 7f109cacc740 1 -- 172.21.15.152:0/672822446 wait complete. 2024-09-11T22:16:14.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.754+0000 7f109cacc740 1 -- start start 2024-09-11T22:16:14.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.754+0000 7f109cacc740 1 Processor -- start 2024-09-11T22:16:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.757+0000 7f109cacc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef20f5d0 0x5582ef222d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.757+0000 7f109cacc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef213e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.757+0000 7f109cacc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 0x5582ef214560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.757+0000 7f109cacc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f10941b26f0 con 0x5582ef21a370 2024-09-11T22:16:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.757+0000 7f109cacc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10941b3b60 con 0x5582ef210b40 2024-09-11T22:16:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.757+0000 7f109cacc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10941b2dc0 con 0x5582ef20f5d0 2024-09-11T22:16:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.757+0000 7f109cacc740 10 client.0 _ll_register_callbacks cb 0x7f1084005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:14.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.759+0000 7f1098c90640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 0x5582ef214560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.759+0000 7f1098c90640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 0x5582ef214560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50260/0 (socket says 172.21.15.152:50260) 2024-09-11T22:16:14.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.759+0000 7f1098c90640 1 -- 172.21.15.152:0/203898728 learned_addr learned my addr 172.21.15.152:0/203898728 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:14.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.760+0000 7f1098c90640 1 -- 172.21.15.152:0/203898728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef20f5d0 msgr2=0x5582ef222d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:14.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.760+0000 7f1098c90640 1 --2- 172.21.15.152:0/203898728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef20f5d0 0x5582ef222d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.760+0000 7f1098c90640 1 -- 172.21.15.152:0/203898728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 msgr2=0x5582ef213e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:14.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.760+0000 7f1098c90640 1 --2- 172.21.15.152:0/203898728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef213e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.760+0000 7f1098c90640 1 -- 172.21.15.152:0/203898728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582ef2a4ba0 con 0x5582ef21a370 2024-09-11T22:16:14.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.760+0000 7f1098c90640 1 --2- 172.21.15.152:0/203898728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 0x5582ef214560 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f108c013010 tx=0x7f108c005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549ec528b4ca5640 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:14.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.760+0000 7f10737fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:14.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.761+0000 7f10737fe640 1 -- 172.21.15.152:0/203898728 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c019b60 con 0x5582ef21a370 2024-09-11T22:16:14.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.761+0000 7f10737fe640 1 -- 172.21.15.152:0/203898728 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f108c019d00 con 0x5582ef21a370 2024-09-11T22:16:14.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.761+0000 7f109cacc740 1 -- 172.21.15.152:0/203898728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f107c031d60 con 0x5582ef21a370 2024-09-11T22:16:14.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.761+0000 7f10737fe640 1 -- 172.21.15.152:0/203898728 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f108c003970 con 0x5582ef21a370 2024-09-11T22:16:14.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.761+0000 7f109cacc740 10 client.18387 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:14.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.761+0000 7f109cacc740 1 -- 172.21.15.152:0/203898728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5582ef2a5cf0 con 0x5582ef21a370 2024-09-11T22:16:14.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.762+0000 7f10737fe640 1 -- 172.21.15.152:0/203898728 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f107c031d60 con 0x5582ef21a370 2024-09-11T22:16:14.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.762+0000 7f10737fe640 1 -- 172.21.15.152:0/203898728 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f108c005760 con 0x5582ef21a370 2024-09-11T22:16:14.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.762+0000 7f109cacc740 10 client.18387 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:14.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.762+0000 7f109cacc740 10 client.18387 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:16:14.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.762+0000 7f109cacc740 20 client.18387 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:14.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.762+0000 7f109cacc740 1 --2- 172.21.15.152:0/203898728 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5582ef229f40 0x5582ef2a8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:14.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.762+0000 7f109cacc740 4 client.18387 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:16:14.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.762+0000 7f109cacc740 1 -- 172.21.15.152:0/203898728 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5582ef182860 con 0x5582ef229f40 2024-09-11T22:16:14.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.762+0000 7f108bfff640 1 --2- 172.21.15.152:0/203898728 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5582ef229f40 0x5582ef2a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:14.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.763+0000 7f108bfff640 1 --2- 172.21.15.152:0/203898728 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5582ef229f40 0x5582ef2a8150 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb58f5932d654b18 server_cookie=661f6d579a0e26a in_seq=0 out_seq=0 2024-09-11T22:16:14.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.763+0000 7f10737fe640 10 client.18387 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:16:14.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.763+0000 7f10737fe640 1 -- 172.21.15.152:0/203898728 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5582ef182860 con 0x5582ef229f40 2024-09-11T22:16:14.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.763+0000 7f10737fe640 10 client.18387 handle_command_reply: tid=0 2024-09-11T22:16:14.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.763+0000 7f109cacc740 1 client.18387 shutdown 2024-09-11T22:16:14.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f109cacc740 1 -- 172.21.15.152:0/203898728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 msgr2=0x5582ef214560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:14.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f109cacc740 1 --2- 172.21.15.152:0/203898728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 0x5582ef214560 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f108c013010 tx=0x7f108c005d10 comp rx=0 tx=0).stop 2024-09-11T22:16:14.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f109cacc740 1 -- 172.21.15.152:0/203898728 shutdown_connections 2024-09-11T22:16:14.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f109cacc740 1 --2- 172.21.15.152:0/203898728 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5582ef229f40 0x5582ef2a8150 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f109cacc740 1 --2- 172.21.15.152:0/203898728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582ef21a370 0x5582ef214560 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f109cacc740 1 --2- 172.21.15.152:0/203898728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5582ef210b40 0x5582ef213e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f109cacc740 1 --2- 172.21.15.152:0/203898728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582ef20f5d0 0x5582ef222d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f109cacc740 1 -- 172.21.15.152:0/203898728 >> 172.21.15.152:0/203898728 conn(0x5582ef1d8310 msgr2=0x5582ef2187f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:14.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f10737fe640 0 client.18387 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:16:14.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f109cacc740 1 -- 172.21.15.152:0/203898728 shutdown_connections 2024-09-11T22:16:14.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f109cacc740 1 -- 172.21.15.152:0/203898728 wait complete. 2024-09-11T22:16:14.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.764+0000 7f109cacc740 20 client.18387 trim_cache size 0 max 16384 2024-09-11T22:16:14.766 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:16:14.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.765+0000 7f109a6f3640 1 -- 172.21.15.152:0/3431823938 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10800a2e40 msgr2=0x7f10800a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:14.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.765+0000 7f109a6f3640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10800a2e40 0x7f10800a5300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f10840cd000 tx=0x7f10840d5550 comp rx=0 tx=0).stop 2024-09-11T22:16:14.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.765+0000 7f109a6f3640 1 -- 172.21.15.152:0/3431823938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1094101de0 msgr2=0x7f10941984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:14.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.765+0000 7f109a6f3640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1094101de0 0x7f10941984b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f108400e9f0 tx=0x7f108400edf0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.765+0000 7f109a6f3640 1 -- 172.21.15.152:0/3431823938 shutdown_connections 2024-09-11T22:16:14.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.765+0000 7f109a6f3640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10800a2e40 0x7f10800a5300 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.765+0000 7f109a6f3640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1094106f10 0x7f109419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.765+0000 7f109a6f3640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1094102790 0x7f10941989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.765+0000 7f109a6f3640 1 --2- 172.21.15.152:0/3431823938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1094101de0 0x7f10941984b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:14.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.766+0000 7f109a6f3640 1 -- 172.21.15.152:0/3431823938 >> 172.21.15.152:0/3431823938 conn(0x7f10940fd8c0 msgr2=0x7f10940fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:14.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.766+0000 7f109a6f3640 1 -- 172.21.15.152:0/3431823938 shutdown_connections 2024-09-11T22:16:14.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:14.766+0000 7f109a6f3640 1 -- 172.21.15.152:0/3431823938 wait complete. 2024-09-11T22:16:14.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 640.0 s, 2065.2 tps, lat 48.177 ms stddev 55.917 2024-09-11T22:16:15.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:15 smithi179 ceph-mon[35603]: pgmap v372: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 26 MiB/s wr, 1.28k op/s 2024-09-11T22:16:15.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:15 smithi179 ceph-mon[35603]: osdmap e97: 12 total, 12 up, 12 in 2024-09-11T22:16:15.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:15 smithi193 ceph-mon[35545]: pgmap v372: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 26 MiB/s wr, 1.28k op/s 2024-09-11T22:16:15.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:15 smithi193 ceph-mon[35545]: osdmap e97: 12 total, 12 up, 12 in 2024-09-11T22:16:15.402 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:15 smithi152 ceph-mon[31188]: pgmap v372: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 26 MiB/s wr, 1.28k op/s 2024-09-11T22:16:15.402 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:15 smithi152 ceph-mon[31188]: osdmap e97: 12 total, 12 up, 12 in 2024-09-11T22:16:15.441 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:16:15.799 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.311+0000 7f870ef35640 1 -- 172.21.15.152:0/2914105744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8708101df0 msgr2=0x7f87081021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.311+0000 7f870ef35640 1 --2- 172.21.15.152:0/2914105744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8708101df0 0x7f87081021d0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009900 tx=0x7f86fc02a410 comp rx=0 tx=0).stop 2024-09-11T22:16:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.312+0000 7f870ef35640 1 -- 172.21.15.152:0/2914105744 shutdown_connections 2024-09-11T22:16:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.312+0000 7f870ef35640 1 --2- 172.21.15.152:0/2914105744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8708106f20 0x7f870810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.312+0000 7f870ef35640 1 --2- 172.21.15.152:0/2914105744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87081027a0 0x7f87081067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.312+0000 7f870ef35640 1 --2- 172.21.15.152:0/2914105744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8708101df0 0x7f87081021d0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.312+0000 7f870ef35640 1 -- 172.21.15.152:0/2914105744 >> 172.21.15.152:0/2914105744 conn(0x7f87080fd8b0 msgr2=0x7f87080ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.312+0000 7f870ef35640 1 -- 172.21.15.152:0/2914105744 shutdown_connections 2024-09-11T22:16:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.312+0000 7f870ef35640 1 -- 172.21.15.152:0/2914105744 wait complete. 2024-09-11T22:16:16.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.313+0000 7f870ef35640 1 Processor -- start 2024-09-11T22:16:16.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.314+0000 7f870ef35640 1 -- start start 2024-09-11T22:16:16.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.314+0000 7f870ef35640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8708101df0 0x7f870810b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.314+0000 7f870ef35640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87081027a0 0x7f870810ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.314+0000 7f870ccd1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8708101df0 0x7f870810b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.315+0000 7f870ef35640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8708106f20 0x7f87081a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.315+0000 7f870ef35640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8708075870 con 0x7f87081027a0 2024-09-11T22:16:16.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.315+0000 7f870ef35640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f87080756f0 con 0x7f8708106f20 2024-09-11T22:16:16.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.315+0000 7f870ef35640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f87080759f0 con 0x7f8708101df0 2024-09-11T22:16:16.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.315+0000 7f870ccd1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8708101df0 0x7f870810b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50024/0 (socket says 172.21.15.152:50024) 2024-09-11T22:16:16.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.315+0000 7f870ccd1640 1 -- 172.21.15.152:0/3399672188 learned_addr learned my addr 172.21.15.152:0/3399672188 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f870d4d2640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8708106f20 0x7f87081a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f8707fff640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87081027a0 0x7f870810ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f870ccd1640 1 -- 172.21.15.152:0/3399672188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8708106f20 msgr2=0x7f87081a44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f870ccd1640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8708106f20 0x7f87081a44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f870ccd1640 1 -- 172.21.15.152:0/3399672188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87081027a0 msgr2=0x7f870810ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f870ccd1640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87081027a0 0x7f870810ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f870ccd1640 1 -- 172.21.15.152:0/3399672188 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87081a4c20 con 0x7f8708101df0 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f8707fff640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87081027a0 0x7f870810ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f870ccd1640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8708101df0 0x7f870810b550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f86fc006010 tx=0x7f86fc004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f8705ffb640 1 -- 172.21.15.152:0/3399672188 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc03f030 con 0x7f8708101df0 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f870ef35640 1 -- 172.21.15.152:0/3399672188 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87081a4eb0 con 0x7f8708101df0 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f8705ffb640 1 -- 172.21.15.152:0/3399672188 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86fc004440 con 0x7f8708101df0 2024-09-11T22:16:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.316+0000 7f8705ffb640 1 -- 172.21.15.152:0/3399672188 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc035070 con 0x7f8708101df0 2024-09-11T22:16:16.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.317+0000 7f870ef35640 1 -- 172.21.15.152:0/3399672188 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87081ab5a0 con 0x7f8708101df0 2024-09-11T22:16:16.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.320+0000 7f871130e740 1 Processor -- start 2024-09-11T22:16:16.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.320+0000 7f871130e740 1 -- start start 2024-09-11T22:16:16.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f871130e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc88090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f871130e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc885d0 0x5621ddc88a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f871130e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc93370 0x5621ddc95760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f871130e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5621ddbee2f0 con 0x5621ddc885d0 2024-09-11T22:16:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f871130e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5621ddb95cf0 con 0x5621ddc93370 2024-09-11T22:16:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f871130e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5621ddbea2b0 con 0x5621ddc89b40 2024-09-11T22:16:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f870d4d2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc88090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f870d4d2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc88090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50030/0 (socket says 172.21.15.152:50030) 2024-09-11T22:16:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f870d4d2640 1 -- 172.21.15.152:0/4204907549 learned_addr learned my addr 172.21.15.152:0/4204907549 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f8707fff640 1 --2- 172.21.15.152:0/4204907549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc93370 0x5621ddc95760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f870d4d2640 1 -- 172.21.15.152:0/4204907549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc93370 msgr2=0x5621ddc95760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f870d4d2640 1 --2- 172.21.15.152:0/4204907549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc93370 0x5621ddc95760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f870d4d2640 1 -- 172.21.15.152:0/4204907549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc885d0 msgr2=0x5621ddc88a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:16:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f870d4d2640 1 --2- 172.21.15.152:0/4204907549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc885d0 0x5621ddc88a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f870d4d2640 1 -- 172.21.15.152:0/4204907549 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ddb7a3a0 con 0x5621ddc89b40 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f8705ffb640 1 -- 172.21.15.152:0/3399672188 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f86fc042030 con 0x7f8708101df0 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.321+0000 7f870d4d2640 1 --2- 172.21.15.152:0/4204907549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc88090 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8700009f40 tx=0x7f8700010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef92059079125525 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.322+0000 7f86f2ffd640 1 -- 172.21.15.152:0/4204907549 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700003b70 con 0x5621ddc89b40 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.322+0000 7f86f2ffd640 1 -- 172.21.15.152:0/4204907549 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8700003d10 con 0x5621ddc89b40 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.322+0000 7f86f2ffd640 1 -- 172.21.15.152:0/4204907549 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87000119d0 con 0x5621ddc89b40 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.322+0000 7f8705ffb640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86f80a2d70 0x7f86f80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.322+0000 7f870ccd1640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86f80a2d70 0x7f86f80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f871130e740 1 -- 172.21.15.152:0/4204907549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 msgr2=0x5621ddc88090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f871130e740 1 --2- 172.21.15.152:0/4204907549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc88090 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8700009f40 tx=0x7f8700010860 comp rx=0 tx=0).stop 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f8705ffb640 1 -- 172.21.15.152:0/3399672188 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f86fc0ef490 con 0x7f8708101df0 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f870ccd1640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86f80a2d70 0x7f86f80a5230 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5621ddc85ac0 tx=0x7f86fc0b7b90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f871130e740 1 -- 172.21.15.152:0/4204907549 shutdown_connections 2024-09-11T22:16:16.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f871130e740 1 --2- 172.21.15.152:0/4204907549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc93370 0x5621ddc95760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f871130e740 1 --2- 172.21.15.152:0/4204907549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc885d0 0x5621ddc88a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f871130e740 1 --2- 172.21.15.152:0/4204907549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc88090 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f871130e740 1 -- 172.21.15.152:0/4204907549 >> 172.21.15.152:0/4204907549 conn(0x5621ddc51310 msgr2=0x5621ddc84c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f871130e740 1 -- 172.21.15.152:0/4204907549 shutdown_connections 2024-09-11T22:16:16.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f871130e740 1 -- 172.21.15.152:0/4204907549 wait complete. 2024-09-11T22:16:16.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.323+0000 7f871130e740 1 -- start start 2024-09-11T22:16:16.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.324+0000 7f871130e740 1 Processor -- start 2024-09-11T22:16:16.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.325+0000 7f871130e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc92dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.326+0000 7f871130e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc90080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.326+0000 7f870d4d2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc92dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.326+0000 7f870d4d2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc92dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:57604/0 (socket says 172.21.15.152:57604) 2024-09-11T22:16:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.326+0000 7f870d4d2640 1 -- 172.21.15.152:0/682104999 learned_addr learned my addr 172.21.15.152:0/682104999 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.326+0000 7f871130e740 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc93370 0x5621ddc90810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.326+0000 7f871130e740 1 -- 172.21.15.152:0/682104999 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5621ddc96070 con 0x5621ddc93370 2024-09-11T22:16:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.326+0000 7f871130e740 1 -- 172.21.15.152:0/682104999 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5621ddba9060 con 0x5621ddc885d0 2024-09-11T22:16:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.326+0000 7f871130e740 1 -- 172.21.15.152:0/682104999 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5621ddc961f0 con 0x5621ddc89b40 2024-09-11T22:16:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.326+0000 7f871130e740 10 client.0 _ll_register_callbacks cb 0x5621dd8fc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.326+0000 7f870d4d2640 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc93370 0x5621ddc90810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f870d4d2640 1 -- 172.21.15.152:0/682104999 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 msgr2=0x5621ddc90080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f870d4d2640 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc90080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f870d4d2640 1 -- 172.21.15.152:0/682104999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc93370 msgr2=0x5621ddc90810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f870d4d2640 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc93370 0x5621ddc90810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f870d4d2640 1 -- 172.21.15.152:0/682104999 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621dd95f3c0 con 0x5621ddc885d0 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f870d4d2640 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc92dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f87000115b0 tx=0x7f8700011500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ae49a84c1281d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f86e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f86e7fff640 1 -- 172.21.15.152:0/682104999 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700004490 con 0x5621ddc885d0 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f86e7fff640 1 -- 172.21.15.152:0/682104999 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f8700004630 con 0x5621ddc885d0 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f871130e740 1 -- 172.21.15.152:0/682104999 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8700003d10 con 0x5621ddc885d0 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f86e7fff640 1 -- 172.21.15.152:0/682104999 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8700011710 con 0x5621ddc885d0 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f871130e740 10 client.27674 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.327+0000 7f871130e740 1 -- 172.21.15.152:0/682104999 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5621ddca1b90 con 0x5621ddc885d0 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.328+0000 7f86e7fff640 1 -- 172.21.15.152:0/682104999 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8700003d10 con 0x5621ddc885d0 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.328+0000 7f86e7fff640 1 -- 172.21.15.152:0/682104999 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f87000056e0 con 0x5621ddc885d0 2024-09-11T22:16:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.328+0000 7f871130e740 10 client.27674 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.328+0000 7f871130e740 10 client.27674 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:16:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.328+0000 7f871130e740 20 client.27674 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.328+0000 7f871130e740 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5621ddca2ee0 0x5621ddca52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.328+0000 7f871130e740 4 client.27674 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.328+0000 7f871130e740 1 -- 172.21.15.152:0/682104999 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621ddbfb860 con 0x5621ddca2ee0 2024-09-11T22:16:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.328+0000 7f8707fff640 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5621ddca2ee0 0x5621ddca52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.329+0000 7f86e7fff640 10 client.27674 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:16:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.329+0000 7f8707fff640 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5621ddca2ee0 0x5621ddca52d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2297ecb13e09a4f2 server_cookie=8b6ef1d513d44123 in_seq=0 out_seq=0 2024-09-11T22:16:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.329+0000 7f86e7fff640 1 -- 172.21.15.152:0/682104999 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621ddbfb860 con 0x5621ddca2ee0 2024-09-11T22:16:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.329+0000 7f86e7fff640 10 client.27674 handle_command_reply: tid=0 2024-09-11T22:16:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.330+0000 7f871130e740 1 client.27674 shutdown 2024-09-11T22:16:16.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.330+0000 7f871130e740 1 -- 172.21.15.152:0/682104999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 msgr2=0x5621ddc92dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.330+0000 7f871130e740 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc92dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f87000115b0 tx=0x7f8700011500 comp rx=0 tx=0).stop 2024-09-11T22:16:16.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.331+0000 7f871130e740 1 -- 172.21.15.152:0/682104999 shutdown_connections 2024-09-11T22:16:16.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.331+0000 7f871130e740 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5621ddca2ee0 0x5621ddca52d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.331+0000 7f871130e740 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc93370 0x5621ddc90810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.331+0000 7f871130e740 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc90080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.331+0000 7f871130e740 1 --2- 172.21.15.152:0/682104999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc92dd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.331+0000 7f871130e740 1 -- 172.21.15.152:0/682104999 >> 172.21.15.152:0/682104999 conn(0x5621ddc51310 msgr2=0x5621ddc8a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.331+0000 7f86e7fff640 0 client.27674 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:16:16.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.331+0000 7f871130e740 1 -- 172.21.15.152:0/682104999 shutdown_connections 2024-09-11T22:16:16.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.331+0000 7f871130e740 1 -- 172.21.15.152:0/682104999 wait complete. 2024-09-11T22:16:16.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.331+0000 7f871130e740 20 client.27674 trim_cache size 0 max 16384 2024-09-11T22:16:16.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f871130e740 1 Processor -- start 2024-09-11T22:16:16.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f871130e740 1 -- start start 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f871130e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc885d0 0x5621ddc84e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f871130e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc89b40 0x5621ddc8f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f871130e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc93370 0x5621ddcaa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f871130e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f87081ae090 con 0x5621ddc885d0 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f871130e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f87081ab960 con 0x5621ddc89b40 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f871130e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f87081021d0 con 0x5621ddc93370 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f870d4d2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc885d0 0x5621ddc84e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f8707fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc89b40 0x5621ddc8f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f870d4d2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc885d0 0x5621ddc84e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50298/0 (socket says 172.21.15.152:50298) 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.348+0000 7f870d4d2640 1 -- 172.21.15.152:0/1636836107 learned_addr learned my addr 172.21.15.152:0/1636836107 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.349+0000 7f870d4d2640 1 --2- 172.21.15.152:0/1636836107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc93370 0x5621ddcaa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.349+0000 7f8707fff640 1 -- 172.21.15.152:0/1636836107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc93370 msgr2=0x5621ddcaa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.349+0000 7f8707fff640 1 --2- 172.21.15.152:0/1636836107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc93370 0x5621ddcaa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.349+0000 7f8707fff640 1 -- 172.21.15.152:0/1636836107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc885d0 msgr2=0x5621ddc84e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.349+0000 7f8707fff640 1 --2- 172.21.15.152:0/1636836107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc885d0 0x5621ddc84e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.349+0000 7f8707fff640 1 -- 172.21.15.152:0/1636836107 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ddc8e5d0 con 0x5621ddc89b40 2024-09-11T22:16:16.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.349+0000 7f870d4d2640 1 --2- 172.21.15.152:0/1636836107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc93370 0x5621ddcaa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:16.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.349+0000 7f8707fff640 1 --2- 172.21.15.152:0/1636836107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc89b40 0x5621ddc8f060 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x5621ddc916c0 tx=0x7f86f40041a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c51423e246890e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.349+0000 7f86f27fc640 1 -- 172.21.15.152:0/1636836107 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4003cc0 con 0x5621ddc89b40 2024-09-11T22:16:16.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.349+0000 7f86f27fc640 1 -- 172.21.15.152:0/1636836107 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86f4003e60 con 0x5621ddc89b40 2024-09-11T22:16:16.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.349+0000 7f86f27fc640 1 -- 172.21.15.152:0/1636836107 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f40129e0 con 0x5621ddc89b40 2024-09-11T22:16:16.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.350+0000 7f871130e740 1 -- 172.21.15.152:0/1636836107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc89b40 msgr2=0x5621ddc8f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.350+0000 7f871130e740 1 --2- 172.21.15.152:0/1636836107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc89b40 0x5621ddc8f060 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x5621ddc916c0 tx=0x7f86f40041a0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.350+0000 7f871130e740 1 -- 172.21.15.152:0/1636836107 shutdown_connections 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.350+0000 7f871130e740 1 --2- 172.21.15.152:0/1636836107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc93370 0x5621ddcaa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.350+0000 7f871130e740 1 --2- 172.21.15.152:0/1636836107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc89b40 0x5621ddc8f060 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.350+0000 7f871130e740 1 --2- 172.21.15.152:0/1636836107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc885d0 0x5621ddc84e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.350+0000 7f871130e740 1 -- 172.21.15.152:0/1636836107 >> 172.21.15.152:0/1636836107 conn(0x5621ddc51310 msgr2=0x5621ddc8e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.350+0000 7f871130e740 1 -- 172.21.15.152:0/1636836107 shutdown_connections 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.350+0000 7f871130e740 1 -- 172.21.15.152:0/1636836107 wait complete. 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.351+0000 7f871130e740 1 -- start start 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.351+0000 7f871130e740 1 Processor -- start 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.351+0000 7f871130e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc9bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.351+0000 7f871130e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc96f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.351+0000 7f871130e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc93370 0x5621ddc97440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.351+0000 7f871130e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8708072ae0 con 0x5621ddc93370 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.351+0000 7f871130e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8708073f10 con 0x5621ddc885d0 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.351+0000 7f871130e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8708073170 con 0x5621ddc89b40 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.351+0000 7f871130e740 10 client.0 _ll_register_callbacks cb 0x7f86f40095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f870d4d2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc93370 0x5621ddc97440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f870d4d2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc9bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f870d4d2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc9bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:57610/0 (socket says 172.21.15.152:57610) 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f870d4d2640 1 -- 172.21.15.152:0/3170903387 learned_addr learned my addr 172.21.15.152:0/3170903387 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f8707fff640 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc96f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f870d4d2640 1 -- 172.21.15.152:0/3170903387 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 msgr2=0x5621ddc96f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f870d4d2640 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc96f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f870d4d2640 1 -- 172.21.15.152:0/3170903387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc93370 msgr2=0x5621ddc97440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f870d4d2640 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc93370 0x5621ddc97440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f870d4d2640 1 -- 172.21.15.152:0/3170903387 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621ddc97c20 con 0x5621ddc885d0 2024-09-11T22:16:16.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f870d4d2640 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc9bbd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f870000a010 tx=0x7f8700004b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1a5a032fb03d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f86e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:16.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f86e7fff640 1 -- 172.21.15.152:0/3170903387 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700047040 con 0x5621ddc885d0 2024-09-11T22:16:16.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f871130e740 1 -- 172.21.15.152:0/3170903387 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86f4003e60 con 0x5621ddc885d0 2024-09-11T22:16:16.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.352+0000 7f86e7fff640 1 -- 172.21.15.152:0/3170903387 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f870003da40 con 0x5621ddc885d0 2024-09-11T22:16:16.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f86e7fff640 1 -- 172.21.15.152:0/3170903387 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f870003d2c0 con 0x5621ddc885d0 2024-09-11T22:16:16.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f871130e740 10 client.27680 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:16.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f871130e740 1 -- 172.21.15.152:0/3170903387 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5621ddd0d820 con 0x5621ddc885d0 2024-09-11T22:16:16.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f86e7fff640 1 -- 172.21.15.152:0/3170903387 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86f4003e60 con 0x5621ddc885d0 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f86e7fff640 1 -- 172.21.15.152:0/3170903387 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f87000435e0 con 0x5621ddc885d0 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f871130e740 10 client.27680 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f871130e740 10 client.27680 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f871130e740 20 client.27680 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f871130e740 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5621ddd0de80 0x5621ddd10270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f871130e740 4 client.27680 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f871130e740 1 -- 172.21.15.152:0/3170903387 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5621ddbf5d70 con 0x5621ddd0de80 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.353+0000 7f8707fff640 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5621ddd0de80 0x5621ddd10270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.354+0000 7f8707fff640 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5621ddd0de80 0x5621ddd10270 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e5e5661f57951fe9 server_cookie=f6a740c762829f4f in_seq=0 out_seq=0 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.354+0000 7f86e7fff640 10 client.27680 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.354+0000 7f86e7fff640 1 -- 172.21.15.152:0/3170903387 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5621ddbf5d70 con 0x5621ddd0de80 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.354+0000 7f86e7fff640 10 client.27680 handle_command_reply: tid=0 2024-09-11T22:16:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.354+0000 7f871130e740 1 client.27680 shutdown 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.355+0000 7f871130e740 1 -- 172.21.15.152:0/3170903387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 msgr2=0x5621ddc9bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.355+0000 7f871130e740 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc9bbd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f870000a010 tx=0x7f8700004b90 comp rx=0 tx=0).stop 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.355+0000 7f871130e740 1 -- 172.21.15.152:0/3170903387 shutdown_connections 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.355+0000 7f871130e740 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5621ddd0de80 0x5621ddd10270 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.355+0000 7f871130e740 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621ddc93370 0x5621ddc97440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.355+0000 7f86e7fff640 0 client.27680 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.355+0000 7f871130e740 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621ddc89b40 0x5621ddc96f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.355+0000 7f871130e740 1 --2- 172.21.15.152:0/3170903387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621ddc885d0 0x5621ddc9bbd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.355+0000 7f871130e740 1 -- 172.21.15.152:0/3170903387 >> 172.21.15.152:0/3170903387 conn(0x5621ddc51310 msgr2=0x5621ddc8f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.356+0000 7f871130e740 1 -- 172.21.15.152:0/3170903387 shutdown_connections 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.356+0000 7f871130e740 1 -- 172.21.15.152:0/3170903387 wait complete. 2024-09-11T22:16:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.356+0000 7f871130e740 20 client.27680 trim_cache size 0 max 16384 2024-09-11T22:16:16.361 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:16:16.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 -- 172.21.15.152:0/3399672188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86f80a2d70 msgr2=0x7f86f80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86f80a2d70 0x7f86f80a5230 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5621ddc85ac0 tx=0x7f86fc0b7b90 comp rx=0 tx=0).stop 2024-09-11T22:16:16.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 -- 172.21.15.152:0/3399672188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8708101df0 msgr2=0x7f870810b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8708101df0 0x7f870810b550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f86fc006010 tx=0x7f86fc004040 comp rx=0 tx=0).stop 2024-09-11T22:16:16.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 -- 172.21.15.152:0/3399672188 shutdown_connections 2024-09-11T22:16:16.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f86f80a2d70 0x7f86f80a5230 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8708106f20 0x7f87081a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87081027a0 0x7f870810ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 --2- 172.21.15.152:0/3399672188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8708101df0 0x7f870810b550 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 -- 172.21.15.152:0/3399672188 >> 172.21.15.152:0/3399672188 conn(0x7f87080fd8b0 msgr2=0x7f87080fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 -- 172.21.15.152:0/3399672188 shutdown_connections 2024-09-11T22:16:16.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:16.357+0000 7f870ef35640 1 -- 172.21.15.152:0/3399672188 wait complete. 2024-09-11T22:16:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.956+0000 7f042fe5c640 1 -- 172.21.15.152:0/1015729368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0428101ad0 msgr2=0x7f0428101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.956+0000 7f042fe5c640 1 --2- 172.21.15.152:0/1015729368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0428101ad0 0x7f0428101f30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0418009900 tx=0x7f041802a3f0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.956+0000 7f042fe5c640 1 -- 172.21.15.152:0/1015729368 shutdown_connections 2024-09-11T22:16:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.956+0000 7f042fe5c640 1 --2- 172.21.15.152:0/1015729368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0428102470 0x7f042810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.956+0000 7f042fe5c640 1 --2- 172.21.15.152:0/1015729368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0428101ad0 0x7f0428101f30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.956+0000 7f042fe5c640 1 --2- 172.21.15.152:0/1015729368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0428107b70 0x7f0428107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.956+0000 7f042fe5c640 1 -- 172.21.15.152:0/1015729368 >> 172.21.15.152:0/1015729368 conn(0x7f04280fd7d0 msgr2=0x7f04280ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.956+0000 7f042fe5c640 1 -- 172.21.15.152:0/1015729368 shutdown_connections 2024-09-11T22:16:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.956+0000 7f042fe5c640 1 -- 172.21.15.152:0/1015729368 wait complete. 2024-09-11T22:16:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042fe5c640 1 Processor -- start 2024-09-11T22:16:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042fe5c640 1 -- start start 2024-09-11T22:16:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042fe5c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0428101ad0 0x7f0428117200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042fe5c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0428102470 0x7f0428117740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042fe5c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0428107b70 0x7f04281113b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042fe5c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f042810fd40 con 0x7f0428107b70 2024-09-11T22:16:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042fe5c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f042810fbc0 con 0x7f0428101ad0 2024-09-11T22:16:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042fe5c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f042810fec0 con 0x7f0428102470 2024-09-11T22:16:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042d3f7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0428102470 0x7f0428117740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042e3f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0428107b70 0x7f04281113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042d3f7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0428102470 0x7f0428117740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50064/0 (socket says 172.21.15.152:50064) 2024-09-11T22:16:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042d3f7640 1 -- 172.21.15.152:0/1272536236 learned_addr learned my addr 172.21.15.152:0/1272536236 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.958+0000 7f042dbf8640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0428101ad0 0x7f0428117200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.959+0000 7f042d3f7640 1 -- 172.21.15.152:0/1272536236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0428101ad0 msgr2=0x7f0428117200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.959+0000 7f042d3f7640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0428101ad0 0x7f0428117200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.959+0000 7f042d3f7640 1 -- 172.21.15.152:0/1272536236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0428107b70 msgr2=0x7f04281113b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.959+0000 7f042d3f7640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0428107b70 0x7f04281113b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.959+0000 7f042d3f7640 1 -- 172.21.15.152:0/1272536236 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0428111c70 con 0x7f0428102470 2024-09-11T22:16:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.959+0000 7f042e3f9640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0428107b70 0x7f04281113b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.959+0000 7f042dbf8640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0428101ad0 0x7f0428117200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.959+0000 7f042d3f7640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0428102470 0x7f0428117740 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f041802a9e0 tx=0x7f0418003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.959+0000 7f041effd640 1 -- 172.21.15.152:0/1272536236 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041803f070 con 0x7f0428102470 2024-09-11T22:16:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.959+0000 7f041effd640 1 -- 172.21.15.152:0/1272536236 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0418031c30 con 0x7f0428102470 2024-09-11T22:16:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.960+0000 7f041effd640 1 -- 172.21.15.152:0/1272536236 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418035030 con 0x7f0428102470 2024-09-11T22:16:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.960+0000 7f042fe5c640 1 -- 172.21.15.152:0/1272536236 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0428111f00 con 0x7f0428102470 2024-09-11T22:16:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.960+0000 7f042fe5c640 1 -- 172.21.15.152:0/1272536236 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04281b3cd0 con 0x7f0428102470 2024-09-11T22:16:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.962+0000 7f041effd640 1 -- 172.21.15.152:0/1272536236 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0418042070 con 0x7f0428102470 2024-09-11T22:16:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.963+0000 7f0432bed740 1 Processor -- start 2024-09-11T22:16:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.964+0000 7f041effd640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04140a2e20 0x7f04140a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.964+0000 7f041effd640 1 -- 172.21.15.152:0/1272536236 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f04180ef790 con 0x7f0428102470 2024-09-11T22:16:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.965+0000 7f0432bed740 1 -- start start 2024-09-11T22:16:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.965+0000 7f042e3f9640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04140a2e20 0x7f04140a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.965+0000 7f0432bed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abdcded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.965+0000 7f0432bed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abdd8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.965+0000 7f0432bed740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abddb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.965+0000 7f0432bed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5651abd322f0 con 0x5651abdce410 2024-09-11T22:16:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.965+0000 7f0432bed740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5651abcda270 con 0x5651abdcdaf0 2024-09-11T22:16:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.965+0000 7f0432bed740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5651abd2e2b0 con 0x5651abdd8cb0 2024-09-11T22:16:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042d3f7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abdd8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042d3f7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abdd8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50328/0 (socket says 172.21.15.152:50328) 2024-09-11T22:16:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042d3f7640 1 -- 172.21.15.152:0/3347241384 learned_addr learned my addr 172.21.15.152:0/3347241384 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042dbf8640 1 --2- 172.21.15.152:0/3347241384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abdcded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042d3f7640 1 -- 172.21.15.152:0/3347241384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 msgr2=0x5651abddb0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:16:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042d3f7640 1 --2- 172.21.15.152:0/3347241384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abddb0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042d3f7640 1 -- 172.21.15.152:0/3347241384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 msgr2=0x5651abdcded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042d3f7640 1 --2- 172.21.15.152:0/3347241384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abdcded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042d3f7640 1 -- 172.21.15.152:0/3347241384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651abcd9340 con 0x5651abdce410 2024-09-11T22:16:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042dbf8640 1 --2- 172.21.15.152:0/3347241384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abdcded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042d3f7640 1 --2- 172.21.15.152:0/3347241384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abdd8770 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f04180b85c0 tx=0x7f04180bba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bb7c0e46ad9a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f0413fff640 1 -- 172.21.15.152:0/3347241384 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418049040 con 0x5651abdce410 2024-09-11T22:16:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f042e3f9640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04140a2e20 0x7f04140a52e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5651abdcb3e0 tx=0x7f0420009500 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f0413fff640 1 -- 172.21.15.152:0/3347241384 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04180bc2f0 con 0x5651abdce410 2024-09-11T22:16:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.966+0000 7f0413fff640 1 -- 172.21.15.152:0/3347241384 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04180b8260 con 0x5651abdce410 2024-09-11T22:16:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.967+0000 7f0432bed740 1 -- 172.21.15.152:0/3347241384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 msgr2=0x5651abdd8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.967+0000 7f0432bed740 1 --2- 172.21.15.152:0/3347241384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abdd8770 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f04180b85c0 tx=0x7f04180bba80 comp rx=0 tx=0).stop 2024-09-11T22:16:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.967+0000 7f0432bed740 1 -- 172.21.15.152:0/3347241384 shutdown_connections 2024-09-11T22:16:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.967+0000 7f0432bed740 1 --2- 172.21.15.152:0/3347241384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abddb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.967+0000 7f0432bed740 1 --2- 172.21.15.152:0/3347241384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abdd8770 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.967+0000 7f0432bed740 1 --2- 172.21.15.152:0/3347241384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abdcded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.967+0000 7f0432bed740 1 -- 172.21.15.152:0/3347241384 >> 172.21.15.152:0/3347241384 conn(0x5651abdca060 msgr2=0x5651abdca440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.967+0000 7f0432bed740 1 -- 172.21.15.152:0/3347241384 shutdown_connections 2024-09-11T22:16:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.967+0000 7f0432bed740 1 -- 172.21.15.152:0/3347241384 wait complete. 2024-09-11T22:16:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f0432bed740 1 -- start start 2024-09-11T22:16:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f0432bed740 1 Processor -- start 2024-09-11T22:16:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f0432bed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abdd5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f0432bed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abdd6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f0432bed740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abdd6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f042d3f7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abdd6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f0432bed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5651abddb640 con 0x5651abdce410 2024-09-11T22:16:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f042d3f7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abdd6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50336/0 (socket says 172.21.15.152:50336) 2024-09-11T22:16:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f0432bed740 1 -- 172.21.15.152:0/1859325101 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5651abcbb290 con 0x5651abdcdaf0 2024-09-11T22:16:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f042d3f7640 1 -- 172.21.15.152:0/1859325101 learned_addr learned my addr 172.21.15.152:0/1859325101 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f0432bed740 1 -- 172.21.15.152:0/1859325101 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5651abddb7c0 con 0x5651abdd8cb0 2024-09-11T22:16:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f042dbf8640 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abdd5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.969+0000 7f042e3f9640 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abdd6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.968+0000 7f0432bed740 10 client.0 _ll_register_callbacks cb 0x5651abcec140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.969+0000 7f042dbf8640 1 -- 172.21.15.152:0/1859325101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 msgr2=0x5651abdd6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.969+0000 7f042dbf8640 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abdd6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.969+0000 7f042dbf8640 1 -- 172.21.15.152:0/1859325101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 msgr2=0x5651abdd6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.969+0000 7f042dbf8640 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abdd6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.969+0000 7f042dbf8640 1 -- 172.21.15.152:0/1859325101 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651aba45210 con 0x5651abdcdaf0 2024-09-11T22:16:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.969+0000 7f0432bed740 1 -- 172.21.15.152:0/1859325101 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04180bc2f0 con 0x5651abdcdaf0 2024-09-11T22:16:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.969+0000 7f042dbf8640 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abdd5c00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0424012580 tx=0x7f0424012980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=981106deab7280fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.969+0000 7f04117fa640 10 client.27689 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.969+0000 7f04117fa640 1 -- 172.21.15.152:0/1859325101 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424004020 con 0x5651abdcdaf0 2024-09-11T22:16:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f04117fa640 1 -- 172.21.15.152:0/1859325101 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f04240041c0 con 0x5651abdcdaf0 2024-09-11T22:16:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f04117fa640 1 -- 172.21.15.152:0/1859325101 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f04240043c0 con 0x5651abdcdaf0 2024-09-11T22:16:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f0432bed740 10 client.27689 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f0432bed740 1 -- 172.21.15.152:0/1859325101 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5651abb11620 con 0x5651abdcdaf0 2024-09-11T22:16:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f04117fa640 1 -- 172.21.15.152:0/1859325101 <== mon.2 v2:172.21.15.179:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f04240107e0 con 0x5651abdcdaf0 2024-09-11T22:16:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f0432bed740 10 client.27689 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f0432bed740 10 client.27689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f0432bed740 20 client.27689 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f0432bed740 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5651abde87c0 0x5651abdeabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f0432bed740 4 client.27689 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f0432bed740 1 -- 172.21.15.152:0/1859325101 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651abd3fa20 con 0x5651abde87c0 2024-09-11T22:16:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.970+0000 7f042d3f7640 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5651abde87c0 0x5651abdeabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.971+0000 7f04117fa640 10 client.27689 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.971+0000 7f042d3f7640 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5651abde87c0 0x5651abdeabb0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a219a3e1fa49bf7 server_cookie=1f58c7267d92a66f in_seq=0 out_seq=0 2024-09-11T22:16:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f04117fa640 1 -- 172.21.15.152:0/1859325101 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651abd3fa20 con 0x5651abde87c0 2024-09-11T22:16:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f04117fa640 10 client.27689 handle_command_reply: tid=0 2024-09-11T22:16:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 1 client.27689 shutdown 2024-09-11T22:16:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 1 -- 172.21.15.152:0/1859325101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 msgr2=0x5651abdd5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abdd5c00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0424012580 tx=0x7f0424012980 comp rx=0 tx=0).stop 2024-09-11T22:16:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 1 -- 172.21.15.152:0/1859325101 shutdown_connections 2024-09-11T22:16:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5651abde87c0 0x5651abdeabb0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abdd6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abdd6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 1 --2- 172.21.15.152:0/1859325101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abdd5c00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 1 -- 172.21.15.152:0/1859325101 >> 172.21.15.152:0/1859325101 conn(0x5651abdca060 msgr2=0x5651abdcfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f04117fa640 0 client.27689 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 1 -- 172.21.15.152:0/1859325101 shutdown_connections 2024-09-11T22:16:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 1 -- 172.21.15.152:0/1859325101 wait complete. 2024-09-11T22:16:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.972+0000 7f0432bed740 20 client.27689 trim_cache size 0 max 16384 2024-09-11T22:16:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.994+0000 7f0432bed740 1 Processor -- start 2024-09-11T22:16:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.994+0000 7f0432bed740 1 -- start start 2024-09-11T22:16:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.994+0000 7f0432bed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdcdaf0 0x5651abdd64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.994+0000 7f0432bed740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdce410 0x5651abdf0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.994+0000 7f0432bed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdd8cb0 0x5651abdf0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.994+0000 7f0432bed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04281bef90 con 0x5651abdcdaf0 2024-09-11T22:16:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.994+0000 7f0432bed740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f04281bc860 con 0x5651abdd8cb0 2024-09-11T22:16:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.994+0000 7f0432bed740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04281ba6d0 con 0x5651abdce410 2024-09-11T22:16:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042dbf8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdcdaf0 0x5651abdd64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042e3f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdd8cb0 0x5651abdf0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042e3f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdd8cb0 0x5651abdf0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:57654/0 (socket says 172.21.15.152:57654) 2024-09-11T22:16:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042dbf8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdcdaf0 0x5651abdd64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50340/0 (socket says 172.21.15.152:50340) 2024-09-11T22:16:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042e3f9640 1 -- 172.21.15.152:0/3639467581 learned_addr learned my addr 172.21.15.152:0/3639467581 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042d3f7640 1 --2- 172.21.15.152:0/3639467581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdce410 0x5651abdf0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042e3f9640 1 -- 172.21.15.152:0/3639467581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdce410 msgr2=0x5651abdf0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042e3f9640 1 --2- 172.21.15.152:0/3639467581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdce410 0x5651abdf0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042e3f9640 1 -- 172.21.15.152:0/3639467581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdcdaf0 msgr2=0x5651abdd64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042e3f9640 1 --2- 172.21.15.152:0/3639467581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdcdaf0 0x5651abdd64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042e3f9640 1 -- 172.21.15.152:0/3639467581 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651abdc9e90 con 0x5651abdd8cb0 2024-09-11T22:16:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042d3f7640 1 --2- 172.21.15.152:0/3639467581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdce410 0x5651abdf0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042dbf8640 1 --2- 172.21.15.152:0/3639467581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdcdaf0 0x5651abdd64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f042e3f9640 1 --2- 172.21.15.152:0/3639467581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdd8cb0 0x5651abdf0940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f04200119c0 tx=0x7f0420014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=558729646341c2e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f04137fe640 1 -- 172.21.15.152:0/3639467581 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420004240 con 0x5651abdd8cb0 2024-09-11T22:16:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f04137fe640 1 -- 172.21.15.152:0/3639467581 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0420028440 con 0x5651abdd8cb0 2024-09-11T22:16:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.995+0000 7f04137fe640 1 -- 172.21.15.152:0/3639467581 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042001e660 con 0x5651abdd8cb0 2024-09-11T22:16:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.996+0000 7f0432bed740 1 -- 172.21.15.152:0/3639467581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdd8cb0 msgr2=0x5651abdf0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.996+0000 7f0432bed740 1 --2- 172.21.15.152:0/3639467581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdd8cb0 0x5651abdf0940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f04200119c0 tx=0x7f0420014000 comp rx=0 tx=0).stop 2024-09-11T22:16:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.997+0000 7f0432bed740 1 -- 172.21.15.152:0/3639467581 shutdown_connections 2024-09-11T22:16:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.997+0000 7f0432bed740 1 --2- 172.21.15.152:0/3639467581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdd8cb0 0x5651abdf0940 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.997+0000 7f0432bed740 1 --2- 172.21.15.152:0/3639467581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdce410 0x5651abdf0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.997+0000 7f0432bed740 1 --2- 172.21.15.152:0/3639467581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdcdaf0 0x5651abdd64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.997+0000 7f0432bed740 1 -- 172.21.15.152:0/3639467581 >> 172.21.15.152:0/3639467581 conn(0x5651abdca060 msgr2=0x5651abdd7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.998+0000 7f0432bed740 1 -- 172.21.15.152:0/3639467581 shutdown_connections 2024-09-11T22:16:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.998+0000 7f0432bed740 1 -- 172.21.15.152:0/3639467581 wait complete. 2024-09-11T22:16:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.998+0000 7f0432bed740 1 -- start start 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.998+0000 7f0432bed740 1 Processor -- start 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f0432bed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abddc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f0432bed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abddcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f0432bed740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abddd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f0432bed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04281bad20 con 0x5651abdce410 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f0432bed740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f04281bc190 con 0x5651abdcdaf0 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f0432bed740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04281bb3f0 con 0x5651abdd8cb0 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f0432bed740 10 client.0 _ll_register_callbacks cb 0x7f0424009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f042d3f7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abddcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f042d3f7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abddcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50356/0 (socket says 172.21.15.152:50356) 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f042d3f7640 1 -- 172.21.15.152:0/3920882867 learned_addr learned my addr 172.21.15.152:0/3920882867 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f042e3f9640 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abddd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:16.999+0000 7f042dbf8640 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abddc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.000+0000 7f042d3f7640 1 -- 172.21.15.152:0/3920882867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 msgr2=0x5651abddd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.000+0000 7f042d3f7640 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abddd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.000+0000 7f042d3f7640 1 -- 172.21.15.152:0/3920882867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 msgr2=0x5651abddc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.000+0000 7f042d3f7640 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abddc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.000+0000 7f042d3f7640 1 -- 172.21.15.152:0/3920882867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651abdc52d0 con 0x5651abdce410 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.000+0000 7f042e3f9640 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abddd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.000+0000 7f042d3f7640 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abddcd00 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0418000c00 tx=0x7f04180bb650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595870c91548d758 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.000+0000 7f04117fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.000+0000 7f04117fa640 1 -- 172.21.15.152:0/3920882867 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418049040 con 0x5651abdce410 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.000+0000 7f04117fa640 1 -- 172.21.15.152:0/3920882867 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f04180b8260 con 0x5651abdce410 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.000+0000 7f0432bed740 1 -- 172.21.15.152:0/3920882867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0420028440 con 0x5651abdce410 2024-09-11T22:16:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f04117fa640 1 -- 172.21.15.152:0/3920882867 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f04180bbbf0 con 0x5651abdce410 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f0432bed740 10 client.18420 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f0432bed740 1 -- 172.21.15.152:0/3920882867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5651abe53550 con 0x5651abdce410 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f04117fa640 1 -- 172.21.15.152:0/3920882867 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0420028440 con 0x5651abdce410 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f04117fa640 1 -- 172.21.15.152:0/3920882867 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f041804c060 con 0x5651abdce410 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f0432bed740 10 client.18420 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f0432bed740 10 client.18420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f0432bed740 20 client.18420 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f0432bed740 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5651abe53a80 0x5651abe55e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f0432bed740 4 client.18420 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f0432bed740 1 -- 172.21.15.152:0/3920882867 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5651abd39d70 con 0x5651abe53a80 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.001+0000 7f042dbf8640 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5651abe53a80 0x5651abe55e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.002+0000 7f04117fa640 10 client.18420 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.002+0000 7f042dbf8640 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5651abe53a80 0x5651abe55e70 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4043bdbb3dda770 server_cookie=4c9f94aacf35cfa0 in_seq=0 out_seq=0 2024-09-11T22:16:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f04117fa640 1 -- 172.21.15.152:0/3920882867 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5651abd39d70 con 0x5651abe53a80 2024-09-11T22:16:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f04117fa640 10 client.18420 handle_command_reply: tid=0 2024-09-11T22:16:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f0432bed740 1 client.18420 shutdown 2024-09-11T22:16:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f0432bed740 1 -- 172.21.15.152:0/3920882867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 msgr2=0x5651abddcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f0432bed740 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abddcd00 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0418000c00 tx=0x7f04180bb650 comp rx=0 tx=0).stop 2024-09-11T22:16:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f0432bed740 1 -- 172.21.15.152:0/3920882867 shutdown_connections 2024-09-11T22:16:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f0432bed740 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5651abe53a80 0x5651abe55e70 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f0432bed740 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5651abdd8cb0 0x5651abddd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f0432bed740 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651abdce410 0x5651abddcd00 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f04117fa640 0 client.18420 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f0432bed740 1 --2- 172.21.15.152:0/3920882867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651abdcdaf0 0x5651abddc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f0432bed740 1 -- 172.21.15.152:0/3920882867 >> 172.21.15.152:0/3920882867 conn(0x5651abdca060 msgr2=0x5651abdcf550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.010+0000 7f0432bed740 1 -- 172.21.15.152:0/3920882867 shutdown_connections 2024-09-11T22:16:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f0432bed740 1 -- 172.21.15.152:0/3920882867 wait complete. 2024-09-11T22:16:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f0432bed740 20 client.18420 trim_cache size 0 max 16384 2024-09-11T22:16:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:16:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:16:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:16:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:16:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 -- 172.21.15.152:0/1272536236 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04140a2e20 msgr2=0x7f04140a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04140a2e20 0x7f04140a52e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5651abdcb3e0 tx=0x7f0420009500 comp rx=0 tx=0).stop 2024-09-11T22:16:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 -- 172.21.15.152:0/1272536236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0428102470 msgr2=0x7f0428117740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0428102470 0x7f0428117740 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f041802a9e0 tx=0x7f0418003c10 comp rx=0 tx=0).stop 2024-09-11T22:16:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 -- 172.21.15.152:0/1272536236 shutdown_connections 2024-09-11T22:16:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f04140a2e20 0x7f04140a52e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0428107b70 0x7f04281113b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0428102470 0x7f0428117740 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 --2- 172.21.15.152:0/1272536236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0428101ad0 0x7f0428117200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 -- 172.21.15.152:0/1272536236 >> 172.21.15.152:0/1272536236 conn(0x7f04280fd7d0 msgr2=0x7f04280fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 -- 172.21.15.152:0/1272536236 shutdown_connections 2024-09-11T22:16:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:17.011+0000 7f042fe5c640 1 -- 172.21.15.152:0/1272536236 wait complete. 2024-09-11T22:16:17.118 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:16:17.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:17 smithi152 ceph-mon[31188]: pgmap v374: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 665 op/s 2024-09-11T22:16:17.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:17 smithi179 ceph-mon[35603]: pgmap v374: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 665 op/s 2024-09-11T22:16:17.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:17 smithi193 ceph-mon[35545]: pgmap v374: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 665 op/s 2024-09-11T22:16:17.498 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:18.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.301+0000 7fd58dcc9640 1 -- 172.21.15.152:0/3176255933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588102ef0 msgr2=0x7fd588069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.301+0000 7fd58dcc9640 1 --2- 172.21.15.152:0/3176255933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588102ef0 0x7fd588069f70 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fd580009be0 tx=0x7fd58002a750 comp rx=0 tx=0).stop 2024-09-11T22:16:18.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.301+0000 7fd58dcc9640 1 -- 172.21.15.152:0/3176255933 shutdown_connections 2024-09-11T22:16:18.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.301+0000 7fd58dcc9640 1 --2- 172.21.15.152:0/3176255933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588102ef0 0x7fd588069f70 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.301+0000 7fd58dcc9640 1 --2- 172.21.15.152:0/3176255933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588102570 0x7fd5881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.301+0000 7fd58dcc9640 1 --2- 172.21.15.152:0/3176255933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588100e20 0x7fd588101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.301+0000 7fd58dcc9640 1 -- 172.21.15.152:0/3176255933 >> 172.21.15.152:0/3176255933 conn(0x7fd5880fc7d0 msgr2=0x7fd5880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.301+0000 7fd58dcc9640 1 -- 172.21.15.152:0/3176255933 shutdown_connections 2024-09-11T22:16:18.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.301+0000 7fd58dcc9640 1 -- 172.21.15.152:0/3176255933 wait complete. 2024-09-11T22:16:18.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd58dcc9640 1 Processor -- start 2024-09-11T22:16:18.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd58dcc9640 1 -- start start 2024-09-11T22:16:18.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd58dcc9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588100e20 0x7fd58819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd58dcc9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588102570 0x7fd58819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd58dcc9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588102ef0 0x7fd58819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd58dcc9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd588114280 con 0x7fd588100e20 2024-09-11T22:16:18.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd58dcc9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd588114100 con 0x7fd588102570 2024-09-11T22:16:18.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd58dcc9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd588114400 con 0x7fd588102ef0 2024-09-11T22:16:18.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd5877fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588100e20 0x7fd58819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd5877fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588100e20 0x7fd58819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50368/0 (socket says 172.21.15.152:50368) 2024-09-11T22:16:18.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd586ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588102570 0x7fd58819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.302+0000 7fd5877fe640 1 -- 172.21.15.152:0/1253074524 learned_addr learned my addr 172.21.15.152:0/1253074524 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:18.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.303+0000 7fd587fff640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588102ef0 0x7fd58819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.303+0000 7fd587fff640 1 -- 172.21.15.152:0/1253074524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588102570 msgr2=0x7fd58819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.303+0000 7fd587fff640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588102570 0x7fd58819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.303+0000 7fd587fff640 1 -- 172.21.15.152:0/1253074524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588100e20 msgr2=0x7fd58819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.303+0000 7fd587fff640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588100e20 0x7fd58819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.303+0000 7fd587fff640 1 -- 172.21.15.152:0/1253074524 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58819f5a0 con 0x7fd588102ef0 2024-09-11T22:16:18.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.303+0000 7fd587fff640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588102ef0 0x7fd58819eec0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd580034040 tx=0x7fd5800305d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.304+0000 7fd584ff9640 1 -- 172.21.15.152:0/1253074524 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580041020 con 0x7fd588102ef0 2024-09-11T22:16:18.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.304+0000 7fd584ff9640 1 -- 172.21.15.152:0/1253074524 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd580037040 con 0x7fd588102ef0 2024-09-11T22:16:18.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.304+0000 7fd584ff9640 1 -- 172.21.15.152:0/1253074524 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580036070 con 0x7fd588102ef0 2024-09-11T22:16:18.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.304+0000 7fd58dcc9640 1 -- 172.21.15.152:0/1253074524 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58819f830 con 0x7fd588102ef0 2024-09-11T22:16:18.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.304+0000 7fd58dcc9640 1 -- 172.21.15.152:0/1253074524 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd58819fcc0 con 0x7fd588102ef0 2024-09-11T22:16:18.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.308+0000 7fd584ff9640 1 -- 172.21.15.152:0/1253074524 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd580044020 con 0x7fd588102ef0 2024-09-11T22:16:18.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.308+0000 7fd5900a2740 1 Processor -- start 2024-09-11T22:16:18.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.308+0000 7fd5900a2740 1 -- start start 2024-09-11T22:16:18.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.308+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded23090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.308+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded235d0 0x5568ded23a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.308+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded2e370 0x5568ded30760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.308+0000 7fd5900a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5568dec892f0 con 0x5568ded24b40 2024-09-11T22:16:18.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.308+0000 7fd5900a2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5568dec30cf0 con 0x5568ded2e370 2024-09-11T22:16:18.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.308+0000 7fd5900a2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5568dec852b0 con 0x5568ded235d0 2024-09-11T22:16:18.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd586ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded23090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd586ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded23090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50380/0 (socket says 172.21.15.152:50380) 2024-09-11T22:16:18.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd586ffd640 1 -- 172.21.15.152:0/4224472187 learned_addr learned my addr 172.21.15.152:0/4224472187 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:18.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd5877fe640 1 --2- 172.21.15.152:0/4224472187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded235d0 0x5568ded23a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd586ffd640 1 --2- 172.21.15.152:0/4224472187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded2e370 0x5568ded30760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd584ff9640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5700a2ec0 0x7fd5700a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd586ffd640 1 -- 172.21.15.152:0/4224472187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded235d0 msgr2=0x5568ded23a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd586ffd640 1 --2- 172.21.15.152:0/4224472187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded235d0 0x5568ded23a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd586ffd640 1 -- 172.21.15.152:0/4224472187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded2e370 msgr2=0x5568ded30760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd586ffd640 1 --2- 172.21.15.152:0/4224472187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded2e370 0x5568ded30760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd586ffd640 1 -- 172.21.15.152:0/4224472187 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568dec153a0 con 0x5568ded24b40 2024-09-11T22:16:18.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.309+0000 7fd584ff9640 1 -- 172.21.15.152:0/1253074524 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7fd5800eff00 con 0x7fd588102ef0 2024-09-11T22:16:18.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.310+0000 7fd586ffd640 1 --2- 172.21.15.152:0/4224472187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded23090 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009510 tx=0x7fd57c0096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae568687abdcf9af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.310+0000 7fd587fff640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5700a2ec0 0x7fd5700a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.310+0000 7fd56dffb640 1 -- 172.21.15.152:0/4224472187 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c012cc0 con 0x5568ded24b40 2024-09-11T22:16:18.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.310+0000 7fd56dffb640 1 -- 172.21.15.152:0/4224472187 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c010cb0 con 0x5568ded24b40 2024-09-11T22:16:18.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.310+0000 7fd56dffb640 1 -- 172.21.15.152:0/4224472187 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c01eba0 con 0x5568ded24b40 2024-09-11T22:16:18.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.311+0000 7fd5900a2740 1 -- 172.21.15.152:0/4224472187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 msgr2=0x5568ded23090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.311+0000 7fd587fff640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5700a2ec0 0x7fd5700a5380 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd5800ed5f0 tx=0x7fd58002a750 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.311+0000 7fd5900a2740 1 --2- 172.21.15.152:0/4224472187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded23090 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009510 tx=0x7fd57c0096e0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.311+0000 7fd5900a2740 1 -- 172.21.15.152:0/4224472187 shutdown_connections 2024-09-11T22:16:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.311+0000 7fd5900a2740 1 --2- 172.21.15.152:0/4224472187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded2e370 0x5568ded30760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.311+0000 7fd5900a2740 1 --2- 172.21.15.152:0/4224472187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded235d0 0x5568ded23a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.311+0000 7fd5900a2740 1 --2- 172.21.15.152:0/4224472187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded23090 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.311+0000 7fd5900a2740 1 -- 172.21.15.152:0/4224472187 >> 172.21.15.152:0/4224472187 conn(0x5568decec310 msgr2=0x5568ded1fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.312+0000 7fd5900a2740 1 -- 172.21.15.152:0/4224472187 shutdown_connections 2024-09-11T22:16:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.312+0000 7fd5900a2740 1 -- 172.21.15.152:0/4224472187 wait complete. 2024-09-11T22:16:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.313+0000 7fd5900a2740 1 -- start start 2024-09-11T22:16:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.313+0000 7fd5900a2740 1 Processor -- start 2024-09-11T22:16:18.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.314+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded235d0 0x5568ded2dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.314+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded24b40 0x5568ded2b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.314+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded2e370 0x5568ded2b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.314+0000 7fd5900a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5568ded31070 con 0x5568ded2e370 2024-09-11T22:16:18.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.314+0000 7fd5900a2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5568dec44060 con 0x5568ded235d0 2024-09-11T22:16:18.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.314+0000 7fd5900a2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5568ded311f0 con 0x5568ded24b40 2024-09-11T22:16:18.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.314+0000 7fd5900a2740 10 client.0 _ll_register_callbacks cb 0x5568de9978c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:18.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.316+0000 7fd586ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded235d0 0x5568ded2dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.316+0000 7fd5877fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded24b40 0x5568ded2b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.316+0000 7fd5877fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded24b40 0x5568ded2b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:50136/0 (socket says 172.21.15.152:50136) 2024-09-11T22:16:18.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.316+0000 7fd5877fe640 1 -- 172.21.15.152:0/3640576827 learned_addr learned my addr 172.21.15.152:0/3640576827 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:18.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.322+0000 7fd586ffd640 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded2e370 0x5568ded2b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.322+0000 7fd5877fe640 1 -- 172.21.15.152:0/3640576827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded235d0 msgr2=0x5568ded2dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.322+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded235d0 0x5568ded2dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.322+0000 7fd5877fe640 1 -- 172.21.15.152:0/3640576827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded2e370 msgr2=0x5568ded2b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.322+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded2e370 0x5568ded2b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.322+0000 7fd5877fe640 1 -- 172.21.15.152:0/3640576827 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568de9fa3c0 con 0x5568ded24b40 2024-09-11T22:16:18.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.330+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded24b40 0x5568ded2b040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd57800bfc0 tx=0x7fd578011870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70123c77ba385c3e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.330+0000 7fd566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:16:18.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.331+0000 7fd566ffd640 1 -- 172.21.15.152:0/3640576827 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578004220 con 0x5568ded24b40 2024-09-11T22:16:18.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.331+0000 7fd5900a2740 1 -- 172.21.15.152:0/3640576827 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd57c010cb0 con 0x5568ded24b40 2024-09-11T22:16:18.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.332+0000 7fd566ffd640 1 -- 172.21.15.152:0/3640576827 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7fd5780043c0 con 0x5568ded24b40 2024-09-11T22:16:18.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.332+0000 7fd566ffd640 1 -- 172.21.15.152:0/3640576827 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd5780035f0 con 0x5568ded24b40 2024-09-11T22:16:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.333+0000 7fd5900a2740 10 client.27853 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.333+0000 7fd5900a2740 1 -- 172.21.15.152:0/3640576827 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5568ded3cbf0 con 0x5568ded24b40 2024-09-11T22:16:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.333+0000 7fd566ffd640 1 -- 172.21.15.152:0/3640576827 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c010cb0 con 0x5568ded24b40 2024-09-11T22:16:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.333+0000 7fd566ffd640 1 -- 172.21.15.152:0/3640576827 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd578012ab0 con 0x5568ded24b40 2024-09-11T22:16:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.333+0000 7fd5900a2740 10 client.27853 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.333+0000 7fd5900a2740 10 client.27853 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.333+0000 7fd5900a2740 20 client.27853 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.333+0000 7fd5900a2740 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ded3e100 0x5568ded40520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.334+0000 7fd5900a2740 4 client.27853 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.334+0000 7fd5900a2740 1 -- 172.21.15.152:0/3640576827 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568dec96860 con 0x5568ded3e100 2024-09-11T22:16:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.334+0000 7fd586ffd640 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ded3e100 0x5568ded40520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.335+0000 7fd586ffd640 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ded3e100 0x5568ded40520 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b3156483b6a786a server_cookie=ccb9e5bf4e50ca58 in_seq=0 out_seq=0 2024-09-11T22:16:18.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.335+0000 7fd566ffd640 10 client.27853 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:18.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.336+0000 7fd566ffd640 1 -- 172.21.15.152:0/3640576827 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568dec96860 con 0x5568ded3e100 2024-09-11T22:16:18.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.336+0000 7fd566ffd640 10 client.27853 handle_command_reply: tid=0 2024-09-11T22:16:18.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.336+0000 7fd5900a2740 1 client.27853 shutdown 2024-09-11T22:16:18.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.336+0000 7fd5900a2740 1 -- 172.21.15.152:0/3640576827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded24b40 msgr2=0x5568ded2b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.336+0000 7fd5900a2740 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded24b40 0x5568ded2b040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd57800bfc0 tx=0x7fd578011870 comp rx=0 tx=0).stop 2024-09-11T22:16:18.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.337+0000 7fd5900a2740 1 -- 172.21.15.152:0/3640576827 shutdown_connections 2024-09-11T22:16:18.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.337+0000 7fd5900a2740 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568ded3e100 0x5568ded40520 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.337+0000 7fd5900a2740 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded2e370 0x5568ded2b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.337+0000 7fd5900a2740 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded24b40 0x5568ded2b040 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.337+0000 7fd5900a2740 1 --2- 172.21.15.152:0/3640576827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded235d0 0x5568ded2dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.337+0000 7fd5900a2740 1 -- 172.21.15.152:0/3640576827 >> 172.21.15.152:0/3640576827 conn(0x5568decec310 msgr2=0x5568ded25960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.337+0000 7fd566ffd640 0 client.27853 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:18.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.338+0000 7fd5900a2740 1 -- 172.21.15.152:0/3640576827 shutdown_connections 2024-09-11T22:16:18.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.338+0000 7fd5900a2740 1 -- 172.21.15.152:0/3640576827 wait complete. 2024-09-11T22:16:18.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.338+0000 7fd5900a2740 20 client.27853 trim_cache size 0 max 16384 2024-09-11T22:16:18.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.358+0000 7fd5900a2740 1 Processor -- start 2024-09-11T22:16:18.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.358+0000 7fd5900a2740 1 -- start start 2024-09-11T22:16:18.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.358+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded235d0 0x5568ded2b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.358+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded3a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.358+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded2e370 0x5568ded45df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.358+0000 7fd5900a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd5881bad30 con 0x5568ded24b40 2024-09-11T22:16:18.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.358+0000 7fd5900a2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd5881b8600 con 0x5568ded2e370 2024-09-11T22:16:18.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.358+0000 7fd5900a2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd58819b990 con 0x5568ded235d0 2024-09-11T22:16:18.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd5877fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded3a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd5877fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded3a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50396/0 (socket says 172.21.15.152:50396) 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd5877fe640 1 -- 172.21.15.152:0/2307021881 learned_addr learned my addr 172.21.15.152:0/2307021881 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd586ffd640 1 --2- 172.21.15.152:0/2307021881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded235d0 0x5568ded2b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd586ffd640 1 --2- 172.21.15.152:0/2307021881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded2e370 0x5568ded45df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd586ffd640 1 -- 172.21.15.152:0/2307021881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded2e370 msgr2=0x5568ded45df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd586ffd640 1 --2- 172.21.15.152:0/2307021881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded2e370 0x5568ded45df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd586ffd640 1 -- 172.21.15.152:0/2307021881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 msgr2=0x5568ded3a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd586ffd640 1 --2- 172.21.15.152:0/2307021881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded3a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd586ffd640 1 -- 172.21.15.152:0/2307021881 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ded20960 con 0x5568ded235d0 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd5877fe640 1 --2- 172.21.15.152:0/2307021881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded3a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd586ffd640 1 --2- 172.21.15.152:0/2307021881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded235d0 0x5568ded2b010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5568ded40d90 tx=0x7fd57c0096e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e76331a9a519d6fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.359+0000 7fd56d7fa640 1 -- 172.21.15.152:0/2307021881 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c017040 con 0x5568ded235d0 2024-09-11T22:16:18.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.360+0000 7fd56d7fa640 1 -- 172.21.15.152:0/2307021881 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c025040 con 0x5568ded235d0 2024-09-11T22:16:18.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.360+0000 7fd56d7fa640 1 -- 172.21.15.152:0/2307021881 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c01eb10 con 0x5568ded235d0 2024-09-11T22:16:18.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.360+0000 7fd5900a2740 1 -- 172.21.15.152:0/2307021881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded235d0 msgr2=0x5568ded2b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.360+0000 7fd5900a2740 1 --2- 172.21.15.152:0/2307021881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded235d0 0x5568ded2b010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5568ded40d90 tx=0x7fd57c0096e0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.361+0000 7fd5900a2740 1 -- 172.21.15.152:0/2307021881 shutdown_connections 2024-09-11T22:16:18.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.361+0000 7fd5900a2740 1 --2- 172.21.15.152:0/2307021881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded2e370 0x5568ded45df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.361+0000 7fd5900a2740 1 --2- 172.21.15.152:0/2307021881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded3a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.361+0000 7fd5900a2740 1 --2- 172.21.15.152:0/2307021881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded235d0 0x5568ded2b010 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.361+0000 7fd5900a2740 1 -- 172.21.15.152:0/2307021881 >> 172.21.15.152:0/2307021881 conn(0x5568decec310 msgr2=0x5568ded2a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.361+0000 7fd5900a2740 1 -- 172.21.15.152:0/2307021881 shutdown_connections 2024-09-11T22:16:18.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.362+0000 7fd5900a2740 1 -- 172.21.15.152:0/2307021881 wait complete. 2024-09-11T22:16:18.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.362+0000 7fd5900a2740 1 -- start start 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.362+0000 7fd5900a2740 1 Processor -- start 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded235d0 0x5568ded31440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded31980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd5900a2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded2e370 0x5568ded31ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd5900a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd588072da0 con 0x5568ded24b40 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd5900a2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd5880741d0 con 0x5568ded235d0 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd5900a2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd588073430 con 0x5568ded2e370 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd5877fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded31980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd5900a2740 10 client.0 _ll_register_callbacks cb 0x7fd57800b4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd586ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded235d0 0x5568ded31440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd5877fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded31980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50400/0 (socket says 172.21.15.152:50400) 2024-09-11T22:16:18.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd5877fe640 1 -- 172.21.15.152:0/317705996 learned_addr learned my addr 172.21.15.152:0/317705996 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.363+0000 7fd586ffd640 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded2e370 0x5568ded31ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd586ffd640 1 -- 172.21.15.152:0/317705996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded2e370 msgr2=0x5568ded31ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd586ffd640 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded2e370 0x5568ded31ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd586ffd640 1 -- 172.21.15.152:0/317705996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 msgr2=0x5568ded31980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd586ffd640 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded31980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd586ffd640 1 -- 172.21.15.152:0/317705996 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568deda6e00 con 0x5568ded235d0 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd5877fe640 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded31980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd586ffd640 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded235d0 0x5568ded31440 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5568ded40d90 tx=0x7fd57c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d56062e9007d3db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd566ffd640 1 -- 172.21.15.152:0/317705996 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c010cb0 con 0x5568ded235d0 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd566ffd640 1 -- 172.21.15.152:0/317705996 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7fd57c0050b0 con 0x5568ded235d0 2024-09-11T22:16:18.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd5900a2740 1 -- 172.21.15.152:0/317705996 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd57c025040 con 0x5568ded235d0 2024-09-11T22:16:18.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.364+0000 7fd566ffd640 1 -- 172.21.15.152:0/317705996 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd57c0052b0 con 0x5568ded235d0 2024-09-11T22:16:18.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.365+0000 7fd5900a2740 10 client.27713 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:18.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.365+0000 7fd5900a2740 1 -- 172.21.15.152:0/317705996 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5568deda8100 con 0x5568ded235d0 2024-09-11T22:16:18.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.365+0000 7fd566ffd640 1 -- 172.21.15.152:0/317705996 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c005450 con 0x5568ded235d0 2024-09-11T22:16:18.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.366+0000 7fd566ffd640 1 -- 172.21.15.152:0/317705996 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd57c003860 con 0x5568ded235d0 2024-09-11T22:16:18.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.366+0000 7fd5900a2740 10 client.27713 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:18.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.366+0000 7fd5900a2740 10 client.27713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:18.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.366+0000 7fd5900a2740 20 client.27713 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:18.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.366+0000 7fd5900a2740 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568deda85c0 0x5568dedaa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.366+0000 7fd5900a2740 4 client.27713 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:16:18.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.366+0000 7fd5900a2740 1 -- 172.21.15.152:0/317705996 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd57c025040 con 0x5568deda85c0 2024-09-11T22:16:18.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.366+0000 7fd5877fe640 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568deda85c0 0x5568dedaa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.367+0000 7fd566ffd640 10 client.27713 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:18.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.367+0000 7fd5877fe640 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568deda85c0 0x5568dedaa9b0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f12520ecb498535a server_cookie=7a1c7c1cdfc07ce2 in_seq=0 out_seq=0 2024-09-11T22:16:18.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.367+0000 7fd566ffd640 1 -- 172.21.15.152:0/317705996 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd57c025040 con 0x5568deda85c0 2024-09-11T22:16:18.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.367+0000 7fd566ffd640 10 client.27713 handle_command_reply: tid=0 2024-09-11T22:16:18.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.367+0000 7fd5900a2740 1 client.27713 shutdown 2024-09-11T22:16:18.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd5900a2740 1 -- 172.21.15.152:0/317705996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded235d0 msgr2=0x5568ded31440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd5900a2740 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded235d0 0x5568ded31440 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5568ded40d90 tx=0x7fd57c005fd0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd5900a2740 1 -- 172.21.15.152:0/317705996 shutdown_connections 2024-09-11T22:16:18.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd5900a2740 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568deda85c0 0x5568dedaa9b0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd566ffd640 0 client.27713 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:18.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd5900a2740 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568ded2e370 0x5568ded31ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd5900a2740 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568ded24b40 0x5568ded31980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd5900a2740 1 --2- 172.21.15.152:0/317705996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568ded235d0 0x5568ded31440 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd5900a2740 1 -- 172.21.15.152:0/317705996 >> 172.21.15.152:0/317705996 conn(0x5568decec310 msgr2=0x5568ded1ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd5900a2740 1 -- 172.21.15.152:0/317705996 shutdown_connections 2024-09-11T22:16:18.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd5900a2740 1 -- 172.21.15.152:0/317705996 wait complete. 2024-09-11T22:16:18.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.368+0000 7fd5900a2740 20 client.27713 trim_cache size 0 max 16384 2024-09-11T22:16:18.373 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:16:18.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 -- 172.21.15.152:0/1253074524 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5700a2ec0 msgr2=0x7fd5700a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5700a2ec0 0x7fd5700a5380 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd5800ed5f0 tx=0x7fd58002a750 comp rx=0 tx=0).stop 2024-09-11T22:16:18.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 -- 172.21.15.152:0/1253074524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588102ef0 msgr2=0x7fd58819eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588102ef0 0x7fd58819eec0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd580034040 tx=0x7fd5800305d0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 -- 172.21.15.152:0/1253074524 shutdown_connections 2024-09-11T22:16:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5700a2ec0 0x7fd5700a5380 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588102ef0 0x7fd58819eec0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588102570 0x7fd58819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 --2- 172.21.15.152:0/1253074524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588100e20 0x7fd58819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 -- 172.21.15.152:0/1253074524 >> 172.21.15.152:0/1253074524 conn(0x7fd5880fc7d0 msgr2=0x7fd58810f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 -- 172.21.15.152:0/1253074524 shutdown_connections 2024-09-11T22:16:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:18.369+0000 7fd58dcc9640 1 -- 172.21.15.152:0/1253074524 wait complete. 2024-09-11T22:16:19.295 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:19 smithi152 ceph-mon[31188]: pgmap v375: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 665 op/s 2024-09-11T22:16:19.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:19 smithi193 ceph-mon[35545]: pgmap v375: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 665 op/s 2024-09-11T22:16:19.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:19 smithi179 ceph-mon[35603]: pgmap v375: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 665 op/s 2024-09-11T22:16:19.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 645.0 s, 2489.4 tps, lat 40.468 ms stddev 46.324 2024-09-11T22:16:20.297 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:16:20.298 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:16:20.675 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:21.102 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:21 smithi152 ceph-mon[31188]: pgmap v376: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 663 op/s 2024-09-11T22:16:21.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:21 smithi193 ceph-mon[35545]: pgmap v376: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 663 op/s 2024-09-11T22:16:21.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.268+0000 7f79a8958640 1 -- 172.21.15.152:0/1541264594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102ef0 msgr2=0x7f79a410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.268+0000 7f79a8958640 1 --2- 172.21.15.152:0/1541264594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102ef0 0x7f79a410da40 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f799c009ca0 tx=0x7f799c02a950 comp rx=0 tx=0).stop 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.268+0000 7f79a8958640 1 -- 172.21.15.152:0/1541264594 shutdown_connections 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.268+0000 7f79a8958640 1 --2- 172.21.15.152:0/1541264594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102ef0 0x7f79a410da40 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.268+0000 7f79a8958640 1 --2- 172.21.15.152:0/1541264594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4102570 0x7f79a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.268+0000 7f79a8958640 1 --2- 172.21.15.152:0/1541264594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4100e20 0x7f79a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.268+0000 7f79a8958640 1 -- 172.21.15.152:0/1541264594 >> 172.21.15.152:0/1541264594 conn(0x7f79a40fc7d0 msgr2=0x7f79a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.268+0000 7f79a8958640 1 -- 172.21.15.152:0/1541264594 shutdown_connections 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.268+0000 7f79a8958640 1 -- 172.21.15.152:0/1541264594 wait complete. 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.269+0000 7f79a8958640 1 Processor -- start 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.269+0000 7f79a8958640 1 -- start start 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.269+0000 7f79a8958640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4100e20 0x7f79a41962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.269+0000 7f79a8958640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4102570 0x7f79a4196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.269+0000 7f79a8958640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102ef0 0x7f79a419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.269+0000 7f79a8958640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79a410fe80 con 0x7f79a4102ef0 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.269+0000 7f79a8958640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79a410fd00 con 0x7f79a4100e20 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.269+0000 7f79a8958640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79a4110000 con 0x7f79a4102570 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.269+0000 7f79a2d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102ef0 0x7f79a419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79a2d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102ef0 0x7f79a419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50410/0 (socket says 172.21.15.152:50410) 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79a2d9d640 1 -- 172.21.15.152:0/3920249735 learned_addr learned my addr 172.21.15.152:0/3920249735 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79a259c640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4100e20 0x7f79a41962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79a1d9b640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4102570 0x7f79a4196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79a2d9d640 1 -- 172.21.15.152:0/3920249735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4102570 msgr2=0x7f79a4196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79a2d9d640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4102570 0x7f79a4196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79a2d9d640 1 -- 172.21.15.152:0/3920249735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4100e20 msgr2=0x7f79a41962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79a2d9d640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4100e20 0x7f79a41962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79a2d9d640 1 -- 172.21.15.152:0/3920249735 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a419b290 con 0x7f79a4102ef0 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79a2d9d640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102ef0 0x7f79a419abb0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f799c005e30 tx=0x7f799c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79937fe640 1 -- 172.21.15.152:0/3920249735 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c034040 con 0x7f79a4102ef0 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79a8958640 1 -- 172.21.15.152:0/3920249735 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a419b520 con 0x7f79a4102ef0 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79937fe640 1 -- 172.21.15.152:0/3920249735 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f799c02f930 con 0x7f79a4102ef0 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.270+0000 7f79937fe640 1 -- 172.21.15.152:0/3920249735 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c0045e0 con 0x7f79a4102ef0 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.271+0000 7f79a8958640 1 -- 172.21.15.152:0/3920249735 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a41a2e60 con 0x7f79a4102ef0 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.274+0000 7f79aad31740 1 Processor -- start 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.274+0000 7f79937fe640 1 -- 172.21.15.152:0/3920249735 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f799c037020 con 0x7f79a4102ef0 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79aad31740 1 -- start start 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79aad31740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79aad31740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b8480 0x5593d85c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79aad31740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85c2d40 0x5593d85c5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79aad31740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5593d851d280 con 0x5593d85b8480 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79aad31740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5593d84c4b10 con 0x5593d85b7b60 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79aad31740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5593d8519240 con 0x5593d85c2d40 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79a1d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79a1d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:57718/0 (socket says 172.21.15.152:57718) 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79a1d9b640 1 -- 172.21.15.152:0/4124462479 learned_addr learned my addr 172.21.15.152:0/4124462479 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79a1d9b640 1 --2- 172.21.15.152:0/4124462479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85c2d40 0x5593d85c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79a259c640 1 --2- 172.21.15.152:0/4124462479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b8480 0x5593d85c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79a1d9b640 1 -- 172.21.15.152:0/4124462479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85c2d40 msgr2=0x5593d85c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79a1d9b640 1 --2- 172.21.15.152:0/4124462479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85c2d40 0x5593d85c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79a1d9b640 1 -- 172.21.15.152:0/4124462479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b8480 msgr2=0x5593d85c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79a1d9b640 1 --2- 172.21.15.152:0/4124462479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b8480 0x5593d85c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79a1d9b640 1 -- 172.21.15.152:0/4124462479 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593d84d11f0 con 0x5593d85b7b60 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.275+0000 7f79937fe640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f798c0a71c0 0x7f798c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.276+0000 7f79a1d9b640 1 --2- 172.21.15.152:0/4124462479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85b7f40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7998009fd0 tx=0x7f7998004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2ca9d999d3a8394 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.276+0000 7f79937fe640 1 -- 172.21.15.152:0/3920249735 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f799c0f0100 con 0x7f79a4102ef0 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.276+0000 7f79a259c640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f798c0a71c0 0x7f798c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.276+0000 7f7990ff9640 1 -- 172.21.15.152:0/4124462479 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7998004050 con 0x5593d85b7b60 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.276+0000 7f7990ff9640 1 -- 172.21.15.152:0/4124462479 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7998005500 con 0x5593d85b7b60 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.276+0000 7f7990ff9640 1 -- 172.21.15.152:0/4124462479 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7998004d90 con 0x5593d85b7b60 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.276+0000 7f79aad31740 1 -- 172.21.15.152:0/4124462479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 msgr2=0x5593d85b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.277+0000 7f79aad31740 1 --2- 172.21.15.152:0/4124462479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85b7f40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7998009fd0 tx=0x7f7998004730 comp rx=0 tx=0).stop 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.277+0000 7f79aad31740 1 -- 172.21.15.152:0/4124462479 shutdown_connections 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.277+0000 7f79aad31740 1 --2- 172.21.15.152:0/4124462479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85c2d40 0x5593d85c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.277+0000 7f79aad31740 1 --2- 172.21.15.152:0/4124462479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b8480 0x5593d85c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.277+0000 7f79aad31740 1 --2- 172.21.15.152:0/4124462479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85b7f40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.277+0000 7f79aad31740 1 -- 172.21.15.152:0/4124462479 >> 172.21.15.152:0/4124462479 conn(0x5593d85b40f0 msgr2=0x5593d85b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.277+0000 7f79a259c640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f798c0a71c0 0x7f798c0a9680 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5593d85b4f50 tx=0x7f799400b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.277+0000 7f79aad31740 1 -- 172.21.15.152:0/4124462479 shutdown_connections 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.277+0000 7f79aad31740 1 -- 172.21.15.152:0/4124462479 wait complete. 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.277+0000 7f79aad31740 1 -- start start 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.277+0000 7f79aad31740 1 Processor -- start 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79aad31740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79aad31740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b8480 0x5593d85c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79aad31740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85c2d40 0x5593d85c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79aad31740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5593d85c5910 con 0x5593d85b8480 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79aad31740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5593d84d7f10 con 0x5593d85b7b60 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79aad31740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5593d85c5a90 con 0x5593d85c2d40 2024-09-11T22:16:21.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79aad31740 10 client.0 _ll_register_callbacks cb 0x5593d84a0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79a259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79a1d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b8480 0x5593d85c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79a259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85bfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:57734/0 (socket says 172.21.15.152:57734) 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79a259c640 1 -- 172.21.15.152:0/2274839095 learned_addr learned my addr 172.21.15.152:0/2274839095 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79a259c640 1 -- 172.21.15.152:0/2274839095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85c2d40 msgr2=0x5593d85c06e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79a259c640 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85c2d40 0x5593d85c06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79a259c640 1 -- 172.21.15.152:0/2274839095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b8480 msgr2=0x5593d85c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79a259c640 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b8480 0x5593d85c01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79a259c640 1 -- 172.21.15.152:0/2274839095 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593d828e6a0 con 0x5593d85b7b60 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.278+0000 7f79a1d9b640 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b8480 0x5593d85c01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.279+0000 7f79a259c640 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85bfc60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f799400b5e0 tx=0x7f79940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7962fc0dbd99cace server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.279+0000 7f7989ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.279+0000 7f7989ffb640 1 -- 172.21.15.152:0/2274839095 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799402c060 con 0x5593d85b7b60 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.280+0000 7f79aad31740 1 -- 172.21.15.152:0/2274839095 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7998005500 con 0x5593d85b7b60 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.280+0000 7f7989ffb640 1 -- 172.21.15.152:0/2274839095 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f7994017030 con 0x5593d85b7b60 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.281+0000 7f7989ffb640 1 -- 172.21.15.152:0/2274839095 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7994027410 con 0x5593d85b7b60 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.281+0000 7f79aad31740 10 client.27725 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.281+0000 7f79aad31740 1 -- 172.21.15.152:0/2274839095 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5593d85d9e10 con 0x5593d85b7b60 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.281+0000 7f7989ffb640 1 -- 172.21.15.152:0/2274839095 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7998005500 con 0x5593d85b7b60 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.282+0000 7f7989ffb640 1 -- 172.21.15.152:0/2274839095 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f799401c4f0 con 0x5593d85b7b60 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.282+0000 7f79aad31740 10 client.27725 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.282+0000 7f79aad31740 10 client.27725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.282+0000 7f79aad31740 20 client.27725 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.282+0000 7f79aad31740 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593d85db640 0x5593d85ddb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.282+0000 7f79aad31740 4 client.27725 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.282+0000 7f79aad31740 1 -- 172.21.15.152:0/2274839095 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593d852a7f0 con 0x5593d85db640 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.282+0000 7f79a1d9b640 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593d85db640 0x5593d85ddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.283+0000 7f7989ffb640 10 client.27725 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.283+0000 7f79a1d9b640 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593d85db640 0x5593d85ddb00 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e62b9156d413a30 server_cookie=843e56c3a06d7234 in_seq=0 out_seq=0 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.283+0000 7f7989ffb640 1 -- 172.21.15.152:0/2274839095 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593d852a7f0 con 0x5593d85db640 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.283+0000 7f7989ffb640 10 client.27725 handle_command_reply: tid=0 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.283+0000 7f79aad31740 1 client.27725 shutdown 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.285+0000 7f79aad31740 1 -- 172.21.15.152:0/2274839095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 msgr2=0x5593d85bfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.285+0000 7f79aad31740 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85bfc60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f799400b5e0 tx=0x7f79940046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.285+0000 7f79aad31740 1 -- 172.21.15.152:0/2274839095 shutdown_connections 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.285+0000 7f79aad31740 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593d85db640 0x5593d85ddb00 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.285+0000 7f79aad31740 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85c2d40 0x5593d85c06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.285+0000 7f79aad31740 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b8480 0x5593d85c01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.285+0000 7f7989ffb640 0 client.27725 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.285+0000 7f79aad31740 1 --2- 172.21.15.152:0/2274839095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85bfc60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.285+0000 7f79aad31740 1 -- 172.21.15.152:0/2274839095 >> 172.21.15.152:0/2274839095 conn(0x5593d85b40f0 msgr2=0x5593d85b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.286+0000 7f79aad31740 1 -- 172.21.15.152:0/2274839095 shutdown_connections 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.286+0000 7f79aad31740 1 -- 172.21.15.152:0/2274839095 wait complete. 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.286+0000 7f79aad31740 20 client.27725 trim_cache size 0 max 16384 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79aad31740 1 Processor -- start 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79aad31740 1 -- start start 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79aad31740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85e3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79aad31740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85b8480 0x5593d85e3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79aad31740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85c2d40 0x5593d85bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79aad31740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41adfd0 con 0x5593d85c2d40 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79aad31740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41ab8a0 con 0x5593d85b7b60 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79aad31740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41a9710 con 0x5593d85b8480 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79a259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85e3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79a259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85e3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:57738/0 (socket says 172.21.15.152:57738) 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79a259c640 1 -- 172.21.15.152:0/2155527593 learned_addr learned my addr 172.21.15.152:0/2155527593 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79a2d9d640 1 --2- 172.21.15.152:0/2155527593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85c2d40 0x5593d85bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79a259c640 1 -- 172.21.15.152:0/2155527593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85b8480 msgr2=0x5593d85e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.320+0000 7f79a259c640 1 --2- 172.21.15.152:0/2155527593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85b8480 0x5593d85e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.321+0000 7f79a259c640 1 -- 172.21.15.152:0/2155527593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85c2d40 msgr2=0x5593d85bcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.321+0000 7f79a259c640 1 --2- 172.21.15.152:0/2155527593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85c2d40 0x5593d85bcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.321+0000 7f79a259c640 1 -- 172.21.15.152:0/2155527593 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593d85b51a0 con 0x5593d85b7b60 2024-09-11T22:16:21.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.321+0000 7f79a259c640 1 --2- 172.21.15.152:0/2155527593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85e3410 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7994018040 tx=0x7f7994004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30f221248cf3f78e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:21.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.321+0000 7f798bfff640 1 -- 172.21.15.152:0/2155527593 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994036080 con 0x5593d85b7b60 2024-09-11T22:16:21.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.321+0000 7f798bfff640 1 -- 172.21.15.152:0/2155527593 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7994003bf0 con 0x5593d85b7b60 2024-09-11T22:16:21.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.321+0000 7f798bfff640 1 -- 172.21.15.152:0/2155527593 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994004990 con 0x5593d85b7b60 2024-09-11T22:16:21.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.322+0000 7f79aad31740 1 -- 172.21.15.152:0/2155527593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 msgr2=0x5593d85e3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.322+0000 7f79aad31740 1 --2- 172.21.15.152:0/2155527593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85e3410 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7994018040 tx=0x7f7994004430 comp rx=0 tx=0).stop 2024-09-11T22:16:21.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.322+0000 7f79aad31740 1 -- 172.21.15.152:0/2155527593 shutdown_connections 2024-09-11T22:16:21.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.322+0000 7f79aad31740 1 --2- 172.21.15.152:0/2155527593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85c2d40 0x5593d85bcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.322+0000 7f79aad31740 1 --2- 172.21.15.152:0/2155527593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85b8480 0x5593d85e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.322+0000 7f79aad31740 1 --2- 172.21.15.152:0/2155527593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85b7b60 0x5593d85e3410 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.322+0000 7f79aad31740 1 -- 172.21.15.152:0/2155527593 >> 172.21.15.152:0/2155527593 conn(0x5593d85b40f0 msgr2=0x5593d85c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:21.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.322+0000 7f79aad31740 1 -- 172.21.15.152:0/2155527593 shutdown_connections 2024-09-11T22:16:21.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.322+0000 7f79aad31740 1 -- 172.21.15.152:0/2155527593 wait complete. 2024-09-11T22:16:21.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79aad31740 1 -- start start 2024-09-11T22:16:21.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79aad31740 1 Processor -- start 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79aad31740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b7b60 0x5593d85cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79aad31740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85b8480 0x5593d85cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79aad31740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85c2d40 0x5593d85d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79a259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b7b60 0x5593d85cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79aad31740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41a9d60 con 0x5593d85b7b60 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79aad31740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41ab1d0 con 0x5593d85c2d40 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79a259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b7b60 0x5593d85cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50440/0 (socket says 172.21.15.152:50440) 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79aad31740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41aa430 con 0x5593d85b8480 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79a259c640 1 -- 172.21.15.152:0/160996037 learned_addr learned my addr 172.21.15.152:0/160996037 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79a2d9d640 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85c2d40 0x5593d85d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79a1d9b640 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85b8480 0x5593d85cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79aad31740 10 client.0 _ll_register_callbacks cb 0x7f7994004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79a259c640 1 -- 172.21.15.152:0/160996037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85b8480 msgr2=0x5593d85cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79a259c640 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85b8480 0x5593d85cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.323+0000 7f79a259c640 1 -- 172.21.15.152:0/160996037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85c2d40 msgr2=0x5593d85d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.324+0000 7f79a259c640 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85c2d40 0x5593d85d0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.324+0000 7f79a259c640 1 -- 172.21.15.152:0/160996037 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593d85ba9d0 con 0x5593d85b7b60 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.324+0000 7f79a259c640 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b7b60 0x5593d85cf580 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f799401c4d0 tx=0x7f7994005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fc6a8be37dd258 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.324+0000 7f7989ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.324+0000 7f7989ffb640 1 -- 172.21.15.152:0/160996037 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994036040 con 0x5593d85b7b60 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.324+0000 7f7989ffb640 1 -- 172.21.15.152:0/160996037 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f79940054f0 con 0x5593d85b7b60 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.324+0000 7f79aad31740 1 -- 172.21.15.152:0/160996037 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5593d8524d00 con 0x5593d85b7b60 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.324+0000 7f7989ffb640 1 -- 172.21.15.152:0/160996037 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f799402c040 con 0x5593d85b7b60 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.324+0000 7f79aad31740 10 client.18456 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.324+0000 7f79aad31740 1 -- 172.21.15.152:0/160996037 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5593d86467b0 con 0x5593d85b7b60 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.325+0000 7f7989ffb640 1 -- 172.21.15.152:0/160996037 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5593d8524d00 con 0x5593d85b7b60 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.325+0000 7f7989ffb640 1 -- 172.21.15.152:0/160996037 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f79940277e0 con 0x5593d85b7b60 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.325+0000 7f79aad31740 10 client.18456 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.325+0000 7f79aad31740 10 client.18456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.325+0000 7f79aad31740 20 client.18456 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.325+0000 7f79aad31740 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593d85db640 0x5593d8648e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.325+0000 7f79aad31740 4 client.18456 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.325+0000 7f79aad31740 1 -- 172.21.15.152:0/160996037 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5593d84a1110 con 0x5593d85db640 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.325+0000 7f79a1d9b640 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593d85db640 0x5593d8648e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.326+0000 7f7989ffb640 10 client.18456 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.326+0000 7f79a1d9b640 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593d85db640 0x5593d8648e70 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=499b765cd482de56 server_cookie=c752c7727a009b8b in_seq=0 out_seq=0 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f7989ffb640 1 -- 172.21.15.152:0/160996037 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5593d84a1110 con 0x5593d85db640 2024-09-11T22:16:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f7989ffb640 10 client.18456 handle_command_reply: tid=0 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f79aad31740 1 client.18456 shutdown 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f79aad31740 1 -- 172.21.15.152:0/160996037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b7b60 msgr2=0x5593d85cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f79aad31740 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b7b60 0x5593d85cf580 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f799401c4d0 tx=0x7f7994005270 comp rx=0 tx=0).stop 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f79aad31740 1 -- 172.21.15.152:0/160996037 shutdown_connections 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f79aad31740 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5593d85db640 0x5593d8648e70 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f79aad31740 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5593d85c2d40 0x5593d85d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f79aad31740 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5593d85b8480 0x5593d85cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f79aad31740 1 --2- 172.21.15.152:0/160996037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5593d85b7b60 0x5593d85cf580 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f79aad31740 1 -- 172.21.15.152:0/160996037 >> 172.21.15.152:0/160996037 conn(0x5593d85b40f0 msgr2=0x5593d85b95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f7989ffb640 0 client.18456 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.327+0000 7f79aad31740 1 -- 172.21.15.152:0/160996037 shutdown_connections 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.328+0000 7f79aad31740 1 -- 172.21.15.152:0/160996037 wait complete. 2024-09-11T22:16:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.328+0000 7f79aad31740 20 client.18456 trim_cache size 0 max 16384 2024-09-11T22:16:21.349 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:16:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:16:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "ea16ab9d-a39f-4e85-b8ce-a1b7cf860c25", 2024-09-11T22:16:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:16:21.349 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:16:21.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.328+0000 7f79a8958640 1 -- 172.21.15.152:0/3920249735 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f798c0a71c0 msgr2=0x7f798c0a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.328+0000 7f79a8958640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f798c0a71c0 0x7f798c0a9680 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5593d85b4f50 tx=0x7f799400b390 comp rx=0 tx=0).stop 2024-09-11T22:16:21.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.328+0000 7f79a8958640 1 -- 172.21.15.152:0/3920249735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102ef0 msgr2=0x7f79a419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.328+0000 7f79a8958640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102ef0 0x7f79a419abb0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f799c005e30 tx=0x7f799c003c10 comp rx=0 tx=0).stop 2024-09-11T22:16:21.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.329+0000 7f79a8958640 1 -- 172.21.15.152:0/3920249735 shutdown_connections 2024-09-11T22:16:21.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.329+0000 7f79a8958640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f798c0a71c0 0x7f798c0a9680 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.329+0000 7f79a8958640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a4102ef0 0x7f79a419abb0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.329+0000 7f79a8958640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79a4102570 0x7f79a4196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.329+0000 7f79a8958640 1 --2- 172.21.15.152:0/3920249735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a4100e20 0x7f79a41962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.329+0000 7f79a8958640 1 -- 172.21.15.152:0/3920249735 >> 172.21.15.152:0/3920249735 conn(0x7f79a40fc7d0 msgr2=0x7f79a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.329+0000 7f79a8958640 1 -- 172.21.15.152:0/3920249735 shutdown_connections 2024-09-11T22:16:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:21.329+0000 7f79a8958640 1 -- 172.21.15.152:0/3920249735 wait complete. 2024-09-11T22:16:21.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:21 smithi179 ceph-mon[35603]: pgmap v376: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 663 op/s 2024-09-11T22:16:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:22 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:16:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:22 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:16:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:22 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:16:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:22 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:16:22.312 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.2 2024-09-11T22:16:22.313 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:16:22.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:22 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:16:22.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:22 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:16:22.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:22 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:16:22.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:22 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:16:22.403 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:16:22.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:22 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:16:22.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:22 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:16:22.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:22 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:16:22.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:22 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:16:22.690 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:23.096 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:23 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:16:23.097 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:23 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:16:23.097 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:23 smithi152 ceph-mon[31188]: pgmap v377: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 663 op/s 2024-09-11T22:16:23.199 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:23.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.207+0000 7f58d696a640 1 -- 172.21.15.152:0/2530840433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58d0101e20 msgr2=0x7f58d01056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.207+0000 7f58d696a640 1 --2- 172.21.15.152:0/2530840433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58d0101e20 0x7f58d01056b0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009900 tx=0x7f58b802a3f0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.207+0000 7f58d696a640 1 -- 172.21.15.152:0/2530840433 shutdown_connections 2024-09-11T22:16:23.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.207+0000 7f58d696a640 1 --2- 172.21.15.152:0/2530840433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58d0105de0 0x7f58d010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.207+0000 7f58d696a640 1 --2- 172.21.15.152:0/2530840433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58d0101e20 0x7f58d01056b0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.207+0000 7f58d696a640 1 --2- 172.21.15.152:0/2530840433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d0101470 0x7f58d0101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.207+0000 7f58d696a640 1 -- 172.21.15.152:0/2530840433 >> 172.21.15.152:0/2530840433 conn(0x7f58d0077230 msgr2=0x7f58d00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.207+0000 7f58d696a640 1 -- 172.21.15.152:0/2530840433 shutdown_connections 2024-09-11T22:16:23.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.207+0000 7f58d696a640 1 -- 172.21.15.152:0/2530840433 wait complete. 2024-09-11T22:16:23.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.208+0000 7f58d696a640 1 Processor -- start 2024-09-11T22:16:23.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.208+0000 7f58d696a640 1 -- start start 2024-09-11T22:16:23.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.208+0000 7f58d696a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58d0101470 0x7f58d0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.208+0000 7f58d696a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58d0101e20 0x7f58d0198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.208+0000 7f58d696a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d0105de0 0x7f58d019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58d696a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f58d0111fb0 con 0x7f58d0101470 2024-09-11T22:16:23.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58cffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58d0101470 0x7f58d0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58d696a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f58d0111e30 con 0x7f58d0105de0 2024-09-11T22:16:23.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58cffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58d0101470 0x7f58d0198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50458/0 (socket says 172.21.15.152:50458) 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58d696a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f58d0112130 con 0x7f58d0101e20 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58cffff640 1 -- 172.21.15.152:0/526410923 learned_addr learned my addr 172.21.15.152:0/526410923 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58c7fff640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58d0101e20 0x7f58d0198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58d4f07640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d0105de0 0x7f58d019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58c7fff640 1 -- 172.21.15.152:0/526410923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d0105de0 msgr2=0x7f58d019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58c7fff640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d0105de0 0x7f58d019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58c7fff640 1 -- 172.21.15.152:0/526410923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58d0101470 msgr2=0x7f58d0198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58c7fff640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58d0101470 0x7f58d0198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58c7fff640 1 -- 172.21.15.152:0/526410923 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d019d400 con 0x7f58d0101e20 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.209+0000 7f58cffff640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58d0101470 0x7f58d0198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.210+0000 7f58c7fff640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58d0101e20 0x7f58d0198990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f58b802a910 tx=0x7f58b8003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.210+0000 7f58cdffb640 1 -- 172.21.15.152:0/526410923 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b803f070 con 0x7f58d0101e20 2024-09-11T22:16:23.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.210+0000 7f58d696a640 1 -- 172.21.15.152:0/526410923 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d019d690 con 0x7f58d0101e20 2024-09-11T22:16:23.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.210+0000 7f58cdffb640 1 -- 172.21.15.152:0/526410923 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58b8031c90 con 0x7f58d0101e20 2024-09-11T22:16:23.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.210+0000 7f58cdffb640 1 -- 172.21.15.152:0/526410923 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8035030 con 0x7f58d0101e20 2024-09-11T22:16:23.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.211+0000 7f58d696a640 1 -- 172.21.15.152:0/526410923 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d01a4fd0 con 0x7f58d0101e20 2024-09-11T22:16:23.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.212+0000 7f58d696a640 1 -- 172.21.15.152:0/526410923 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d0102220 con 0x7f58d0101e20 2024-09-11T22:16:23.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.221+0000 7f58cdffb640 1 -- 172.21.15.152:0/526410923 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f58b8042070 con 0x7f58d0101e20 2024-09-11T22:16:23.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.222+0000 7f58cdffb640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f58bc0a2df0 0x7f58bc0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.222+0000 7f58cdffb640 1 -- 172.21.15.152:0/526410923 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f58b80effb0 con 0x7f58d0101e20 2024-09-11T22:16:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.224+0000 7f58cffff640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f58bc0a2df0 0x7f58bc0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.226+0000 7f58cdffb640 1 -- 172.21.15.152:0/526410923 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f58b80bcb10 con 0x7f58d0101e20 2024-09-11T22:16:23.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.233+0000 7f58cffff640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f58bc0a2df0 0x7f58bc0a52b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f58c0011550 tx=0x7f58c0005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:23 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:16:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:23 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:16:23.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:23 smithi193 ceph-mon[35545]: pgmap v377: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 663 op/s 2024-09-11T22:16:23.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:23 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:16:23.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:23 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:16:23.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:23 smithi179 ceph-mon[35603]: pgmap v377: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 663 op/s 2024-09-11T22:16:23.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.666+0000 7f58d696a640 1 -- 172.21.15.152:0/526410923 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58d0101850 con 0x7f58d0101e20 2024-09-11T22:16:23.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.671+0000 7f58cdffb640 1 -- 172.21.15.152:0/526410923 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f58d0101850 con 0x7f58d0101e20 2024-09-11T22:16:23.675 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:16:23.676 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:16:23.678 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:16:23.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.674+0000 7f58d696a640 1 -- 172.21.15.152:0/526410923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f58bc0a2df0 msgr2=0x7f58bc0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.674+0000 7f58d696a640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f58bc0a2df0 0x7f58bc0a52b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f58c0011550 tx=0x7f58c0005f90 comp rx=0 tx=0).stop 2024-09-11T22:16:23.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.674+0000 7f58d696a640 1 -- 172.21.15.152:0/526410923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58d0101e20 msgr2=0x7f58d0198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.674+0000 7f58d696a640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58d0101e20 0x7f58d0198990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f58b802a910 tx=0x7f58b8003b20 comp rx=0 tx=0).stop 2024-09-11T22:16:23.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.676+0000 7f58d696a640 1 -- 172.21.15.152:0/526410923 shutdown_connections 2024-09-11T22:16:23.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.676+0000 7f58d696a640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f58bc0a2df0 0x7f58bc0a52b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.676+0000 7f58d696a640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d0105de0 0x7f58d019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.676+0000 7f58d696a640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58d0101e20 0x7f58d0198990 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.676+0000 7f58d696a640 1 --2- 172.21.15.152:0/526410923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58d0101470 0x7f58d0198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.676+0000 7f58d696a640 1 -- 172.21.15.152:0/526410923 >> 172.21.15.152:0/526410923 conn(0x7f58d0077230 msgr2=0x7f58d0104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:23.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.676+0000 7f58d696a640 1 -- 172.21.15.152:0/526410923 shutdown_connections 2024-09-11T22:16:23.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.676+0000 7f58d696a640 1 -- 172.21.15.152:0/526410923 wait complete. 2024-09-11T22:16:24.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.857+0000 7f8e5effd640 1 -- 172.21.15.152:0/3253763792 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50004230 con 0x7f8e601002b0 2024-09-11T22:16:24.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.858+0000 7f8e6526f640 1 -- 172.21.15.152:0/3253763792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e601002b0 msgr2=0x7f8e60100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.858+0000 7f8e6526f640 1 --2- 172.21.15.152:0/3253763792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e601002b0 0x7f8e60100690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009900 tx=0x7f8e5002a410 comp rx=0 tx=0).stop 2024-09-11T22:16:24.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.860+0000 7f8e6526f640 1 -- 172.21.15.152:0/3253763792 shutdown_connections 2024-09-11T22:16:24.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.860+0000 7f8e6526f640 1 --2- 172.21.15.152:0/3253763792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e601053e0 0x7f8e6010cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.860+0000 7f8e6526f640 1 --2- 172.21.15.152:0/3253763792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e60100c60 0x7f8e60104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.860+0000 7f8e6526f640 1 --2- 172.21.15.152:0/3253763792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e601002b0 0x7f8e60100690 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.860+0000 7f8e6526f640 1 -- 172.21.15.152:0/3253763792 >> 172.21.15.152:0/3253763792 conn(0x7f8e60077070 msgr2=0x7f8e600fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.860+0000 7f8e6526f640 1 -- 172.21.15.152:0/3253763792 shutdown_connections 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.860+0000 7f8e6526f640 1 -- 172.21.15.152:0/3253763792 wait complete. 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.861+0000 7f8e6526f640 1 Processor -- start 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.861+0000 7f8e6526f640 1 -- start start 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.862+0000 7f8e6526f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e601002b0 0x7f8e6019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.862+0000 7f8e6526f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e60100c60 0x7f8e6019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.863+0000 7f8e5ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e601002b0 0x7f8e6019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.863+0000 7f8e5ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e601002b0 0x7f8e6019c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:39254/0 (socket says 172.21.15.152:39254) 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.863+0000 7f8e5ffff640 1 -- 172.21.15.152:0/1765700936 learned_addr learned my addr 172.21.15.152:0/1765700936 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.863+0000 7f8e6526f640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e601053e0 0x7f8e60196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.863+0000 7f8e6526f640 1 -- 172.21.15.152:0/1765700936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8e601104b0 con 0x7f8e60100c60 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.863+0000 7f8e6526f640 1 -- 172.21.15.152:0/1765700936 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8e60110330 con 0x7f8e601053e0 2024-09-11T22:16:24.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.865+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e601053e0 0x7f8e60196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.865+0000 7f8e5f7fe640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e60100c60 0x7f8e6019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.866+0000 7f8e6526f640 1 -- 172.21.15.152:0/1765700936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8e60110630 con 0x7f8e601002b0 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.870+0000 7f8e64a6e640 1 -- 172.21.15.152:0/1765700936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e601002b0 msgr2=0x7f8e6019c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.870+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e601002b0 0x7f8e6019c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.870+0000 7f8e64a6e640 1 -- 172.21.15.152:0/1765700936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e60100c60 msgr2=0x7f8e6019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.870+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e60100c60 0x7f8e6019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.870+0000 7f8e64a6e640 1 -- 172.21.15.152:0/1765700936 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e60196fd0 con 0x7f8e601053e0 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.871+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e601053e0 0x7f8e60196760 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009f80 tx=0x7f8e5800b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.872+0000 7f8e5d7fa640 1 -- 172.21.15.152:0/1765700936 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800c2a0 con 0x7f8e601053e0 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.872+0000 7f8e5d7fa640 1 -- 172.21.15.152:0/1765700936 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e58013b40 con 0x7f8e601053e0 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.872+0000 7f8e6526f640 1 -- 172.21.15.152:0/1765700936 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e60197260 con 0x7f8e601053e0 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.872+0000 7f8e6526f640 1 -- 172.21.15.152:0/1765700936 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e600696e0 con 0x7f8e601053e0 2024-09-11T22:16:24.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.872+0000 7f8e5d7fa640 1 -- 172.21.15.152:0/1765700936 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5801cca0 con 0x7f8e601053e0 2024-09-11T22:16:24.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.876+0000 7f8e5d7fa640 1 -- 172.21.15.152:0/1765700936 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8e58013cf0 con 0x7f8e601053e0 2024-09-11T22:16:24.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.877+0000 7f8e5d7fa640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8e480a2ec0 0x7f8e480a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.877+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8e480a2ec0 0x7f8e480a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.877+0000 7f8e5d7fa640 1 -- 172.21.15.152:0/1765700936 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f8e580d31f0 con 0x7f8e601053e0 2024-09-11T22:16:24.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.878+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8e480a2ec0 0x7f8e480a5380 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8e500096c0 tx=0x7f8e50005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.882+0000 7f8e688aa740 1 Processor -- start 2024-09-11T22:16:24.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.882+0000 7f8e688aa740 1 -- start start 2024-09-11T22:16:24.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.886+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc8e80 0x5567e5cc9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.886+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cc97a0 0x5567e5cd3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.886+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 0x5567e5cd6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.886+0000 7f8e688aa740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5567e5c262e0 con 0x5567e5cd4060 2024-09-11T22:16:24.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.886+0000 7f8e688aa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5567e5bcdce0 con 0x5567e5cc8e80 2024-09-11T22:16:24.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.886+0000 7f8e688aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5567e5c222a0 con 0x5567e5cc97a0 2024-09-11T22:16:24.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.887+0000 7f8e5ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc8e80 0x5567e5cc9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.887+0000 7f8e5ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc8e80 0x5567e5cc9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:59530/0 (socket says 172.21.15.152:59530) 2024-09-11T22:16:24.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.887+0000 7f8e5ffff640 1 -- 172.21.15.152:0/823264913 learned_addr learned my addr 172.21.15.152:0/823264913 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:24.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.887+0000 7f8e5f7fe640 1 --2- 172.21.15.152:0/823264913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cc97a0 0x5567e5cd3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.887+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/823264913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 0x5567e5cd6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.887+0000 7f8e5ffff640 1 -- 172.21.15.152:0/823264913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cc97a0 msgr2=0x5567e5cd3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:24.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.887+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/823264913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cc97a0 0x5567e5cd3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.887+0000 7f8e5ffff640 1 -- 172.21.15.152:0/823264913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 msgr2=0x5567e5cd6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:24.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.887+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/823264913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 0x5567e5cd6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.887+0000 7f8e5ffff640 1 -- 172.21.15.152:0/823264913 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567e5bb2440 con 0x5567e5cc8e80 2024-09-11T22:16:24.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.888+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/823264913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc8e80 0x5567e5cc9260 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8e50033040 tx=0x7f8e5003f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bc760b54e209c2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.888+0000 7f8e467fc640 1 -- 172.21.15.152:0/823264913 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50005400 con 0x5567e5cc8e80 2024-09-11T22:16:24.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.888+0000 7f8e467fc640 1 -- 172.21.15.152:0/823264913 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e500055a0 con 0x5567e5cc8e80 2024-09-11T22:16:24.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.889+0000 7f8e688aa740 1 -- 172.21.15.152:0/823264913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc8e80 msgr2=0x5567e5cc9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.889+0000 7f8e688aa740 1 --2- 172.21.15.152:0/823264913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc8e80 0x5567e5cc9260 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8e50033040 tx=0x7f8e5003f000 comp rx=0 tx=0).stop 2024-09-11T22:16:24.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.890+0000 7f8e688aa740 1 -- 172.21.15.152:0/823264913 shutdown_connections 2024-09-11T22:16:24.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.890+0000 7f8e688aa740 1 --2- 172.21.15.152:0/823264913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 0x5567e5cd6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.890+0000 7f8e688aa740 1 --2- 172.21.15.152:0/823264913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cc97a0 0x5567e5cd3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.890+0000 7f8e688aa740 1 --2- 172.21.15.152:0/823264913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc8e80 0x5567e5cc9260 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.890+0000 7f8e688aa740 1 -- 172.21.15.152:0/823264913 >> 172.21.15.152:0/823264913 conn(0x5567e5cc5410 msgr2=0x5567e5cc57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.890+0000 7f8e688aa740 1 -- 172.21.15.152:0/823264913 shutdown_connections 2024-09-11T22:16:24.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.890+0000 7f8e688aa740 1 -- 172.21.15.152:0/823264913 wait complete. 2024-09-11T22:16:24.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.890+0000 7f8e688aa740 1 -- start start 2024-09-11T22:16:24.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.891+0000 7f8e688aa740 1 Processor -- start 2024-09-11T22:16:24.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.891+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cc97a0 0x5567e5cd37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.891+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd4060 0x5567e5cd0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.891+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd0fa0 0x5567e5cd1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.891+0000 7f8e688aa740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5567e5cd6cd0 con 0x5567e5cc97a0 2024-09-11T22:16:24.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.891+0000 7f8e688aa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5567e5be1050 con 0x5567e5cd0fa0 2024-09-11T22:16:24.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.891+0000 7f8e688aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5567e5cd6e50 con 0x5567e5cd4060 2024-09-11T22:16:24.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.891+0000 7f8e688aa740 10 client.0 _ll_register_callbacks cb 0x5567e5c21160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:24.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.892+0000 7f8e64a6e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd0fa0 0x5567e5cd1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.892+0000 7f8e64a6e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd0fa0 0x5567e5cd1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:59536/0 (socket says 172.21.15.152:59536) 2024-09-11T22:16:24.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.892+0000 7f8e64a6e640 1 -- 172.21.15.152:0/2803752645 learned_addr learned my addr 172.21.15.152:0/2803752645 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:24.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.892+0000 7f8e64a6e640 1 -- 172.21.15.152:0/2803752645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd4060 msgr2=0x5567e5cd0a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:16:24.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.892+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/2803752645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd4060 0x5567e5cd0a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.892+0000 7f8e64a6e640 1 -- 172.21.15.152:0/2803752645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cc97a0 msgr2=0x5567e5cd37b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:16:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.892+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/2803752645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cc97a0 0x5567e5cd37b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.892+0000 7f8e64a6e640 1 -- 172.21.15.152:0/2803752645 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567e59973c0 con 0x5567e5cd0fa0 2024-09-11T22:16:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.893+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/2803752645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd0fa0 0x5567e5cd1420 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800bc20 tx=0x7f8e5809fe90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e768012e9caee271 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.895+0000 7f8e3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.898+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/2803752645 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e580d0d00 con 0x5567e5cd0fa0 2024-09-11T22:16:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.898+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/2803752645 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f8e5809eaa0 con 0x5567e5cd0fa0 2024-09-11T22:16:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.898+0000 7f8e688aa740 1 -- 172.21.15.152:0/2803752645 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5567e5c33850 con 0x5567e5cd0fa0 2024-09-11T22:16:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.898+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/2803752645 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8e5809eca0 con 0x5567e5cd0fa0 2024-09-11T22:16:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.899+0000 7f8e688aa740 10 client.27749 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.899+0000 7f8e688aa740 1 -- 172.21.15.152:0/2803752645 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5567e5cf39e0 con 0x5567e5cd0fa0 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.900+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/2803752645 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5567e5c33850 con 0x5567e5cd0fa0 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.901+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/2803752645 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8e58024030 con 0x5567e5cd0fa0 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.901+0000 7f8e688aa740 10 client.27749 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.901+0000 7f8e688aa740 10 client.27749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.901+0000 7f8e688aa740 20 client.27749 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.901+0000 7f8e688aa740 1 --2- 172.21.15.152:0/2803752645 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567e5cf4e40 0x5567e5cf7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.901+0000 7f8e688aa740 4 client.27749 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.901+0000 7f8e688aa740 1 -- 172.21.15.152:0/2803752645 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567e5c2dd60 con 0x5567e5cf4e40 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.902+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/2803752645 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567e5cf4e40 0x5567e5cf7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.903+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/2803752645 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567e5cf4e40 0x5567e5cf7300 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a20bc2afdc08c8a3 server_cookie=3ab09c98d7304eba in_seq=0 out_seq=0 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.903+0000 7f8e3f7fe640 10 client.27749 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.904+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/2803752645 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5567e5c2dd60 con 0x5567e5cf4e40 2024-09-11T22:16:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.904+0000 7f8e3f7fe640 10 client.27749 handle_command_reply: tid=0 2024-09-11T22:16:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.904+0000 7f8e688aa740 1 client.27749 shutdown 2024-09-11T22:16:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.906+0000 7f8e688aa740 1 -- 172.21.15.152:0/2803752645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd0fa0 msgr2=0x5567e5cd1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.906+0000 7f8e688aa740 1 --2- 172.21.15.152:0/2803752645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd0fa0 0x5567e5cd1420 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800bc20 tx=0x7f8e5809fe90 comp rx=0 tx=0).stop 2024-09-11T22:16:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.906+0000 7f8e688aa740 1 -- 172.21.15.152:0/2803752645 shutdown_connections 2024-09-11T22:16:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.906+0000 7f8e688aa740 1 --2- 172.21.15.152:0/2803752645 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567e5cf4e40 0x5567e5cf7300 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.906+0000 7f8e688aa740 1 --2- 172.21.15.152:0/2803752645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd0fa0 0x5567e5cd1420 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.906+0000 7f8e688aa740 1 --2- 172.21.15.152:0/2803752645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd4060 0x5567e5cd0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.906+0000 7f8e688aa740 1 --2- 172.21.15.152:0/2803752645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cc97a0 0x5567e5cd37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.906+0000 7f8e688aa740 1 -- 172.21.15.152:0/2803752645 >> 172.21.15.152:0/2803752645 conn(0x5567e5cc5410 msgr2=0x5567e5cbb520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.908+0000 7f8e3f7fe640 0 client.27749 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.908+0000 7f8e688aa740 1 -- 172.21.15.152:0/2803752645 shutdown_connections 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.908+0000 7f8e688aa740 1 -- 172.21.15.152:0/2803752645 wait complete. 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.909+0000 7f8e688aa740 20 client.27749 trim_cache size 0 max 16384 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.951+0000 7f8e688aa740 1 Processor -- start 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.951+0000 7f8e688aa740 1 -- start start 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.952+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cc97a0 0x5567e5cbbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.952+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd0fa0 0x5567e5cc5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.952+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd4060 0x5567e5ccba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.952+0000 7f8e688aa740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c011170 con 0x5567e5cc97a0 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.952+0000 7f8e688aa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c00ea40 con 0x5567e5cd4060 2024-09-11T22:16:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.952+0000 7f8e688aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c00c940 con 0x5567e5cd0fa0 2024-09-11T22:16:24.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.953+0000 7f8e5f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd0fa0 0x5567e5cc5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.953+0000 7f8e5f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd0fa0 0x5567e5cc5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:39270/0 (socket says 172.21.15.152:39270) 2024-09-11T22:16:24.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.953+0000 7f8e5f7fe640 1 -- 172.21.15.152:0/2143570797 learned_addr learned my addr 172.21.15.152:0/2143570797 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:24.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.953+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/2143570797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cc97a0 0x5567e5cbbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.953+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/2143570797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd4060 0x5567e5ccba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.953+0000 7f8e5ffff640 1 -- 172.21.15.152:0/2143570797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd0fa0 msgr2=0x5567e5cc5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:24.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.953+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/2143570797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd0fa0 0x5567e5cc5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.953+0000 7f8e5ffff640 1 -- 172.21.15.152:0/2143570797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd4060 msgr2=0x5567e5ccba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:24.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.953+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/2143570797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd4060 0x5567e5ccba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.953+0000 7f8e5ffff640 1 -- 172.21.15.152:0/2143570797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567e5ccefb0 con 0x5567e5cc97a0 2024-09-11T22:16:24.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.954+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/2143570797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cc97a0 0x5567e5cbbc10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f8e50005940 tx=0x7f8e50005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1716da1a5e36f47f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.954+0000 7f8e45ffb640 1 -- 172.21.15.152:0/2143570797 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50061070 con 0x5567e5cc97a0 2024-09-11T22:16:24.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.954+0000 7f8e45ffb640 1 -- 172.21.15.152:0/2143570797 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e50004240 con 0x5567e5cc97a0 2024-09-11T22:16:24.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.954+0000 7f8e45ffb640 1 -- 172.21.15.152:0/2143570797 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5005c480 con 0x5567e5cc97a0 2024-09-11T22:16:24.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.956+0000 7f8e688aa740 1 -- 172.21.15.152:0/2143570797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cc97a0 msgr2=0x5567e5cbbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.956+0000 7f8e688aa740 1 --2- 172.21.15.152:0/2143570797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cc97a0 0x5567e5cbbc10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f8e50005940 tx=0x7f8e50005850 comp rx=0 tx=0).stop 2024-09-11T22:16:24.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.956+0000 7f8e688aa740 1 -- 172.21.15.152:0/2143570797 shutdown_connections 2024-09-11T22:16:24.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.956+0000 7f8e688aa740 1 --2- 172.21.15.152:0/2143570797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cd4060 0x5567e5ccba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.956+0000 7f8e688aa740 1 --2- 172.21.15.152:0/2143570797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd0fa0 0x5567e5cc5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.956+0000 7f8e688aa740 1 --2- 172.21.15.152:0/2143570797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cc97a0 0x5567e5cbbc10 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.956+0000 7f8e688aa740 1 -- 172.21.15.152:0/2143570797 >> 172.21.15.152:0/2143570797 conn(0x5567e5cc5410 msgr2=0x5567e5cbb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.957+0000 7f8e688aa740 1 -- 172.21.15.152:0/2143570797 shutdown_connections 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.957+0000 7f8e688aa740 1 -- 172.21.15.152:0/2143570797 wait complete. 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.957+0000 7f8e688aa740 1 -- start start 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.957+0000 7f8e688aa740 1 Processor -- start 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.958+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc97a0 0x5567e5cdc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.958+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd0fa0 0x5567e5cd4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.958+0000 7f8e688aa740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 0x5567e5cd5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.958+0000 7f8e688aa740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c00cf00 con 0x5567e5cd4060 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.958+0000 7f8e688aa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c00e370 con 0x5567e5cc97a0 2024-09-11T22:16:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.958+0000 7f8e688aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c00d5d0 con 0x5567e5cd0fa0 2024-09-11T22:16:24.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.958+0000 7f8e688aa740 10 client.0 _ll_register_callbacks cb 0x7f8e5800c440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:24.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.960+0000 7f8e5f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd0fa0 0x5567e5cd4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.960+0000 7f8e64a6e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 0x5567e5cd5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.960+0000 7f8e64a6e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 0x5567e5cd5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34486/0 (socket says 172.21.15.152:34486) 2024-09-11T22:16:24.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.960+0000 7f8e64a6e640 1 -- 172.21.15.152:0/341441187 learned_addr learned my addr 172.21.15.152:0/341441187 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:24.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.960+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc97a0 0x5567e5cdc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.960+0000 7f8e64a6e640 1 -- 172.21.15.152:0/341441187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd0fa0 msgr2=0x5567e5cd4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:24.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.960+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd0fa0 0x5567e5cd4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.960+0000 7f8e64a6e640 1 -- 172.21.15.152:0/341441187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc97a0 msgr2=0x5567e5cdc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:24.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.960+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc97a0 0x5567e5cdc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.960+0000 7f8e64a6e640 1 -- 172.21.15.152:0/341441187 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567e5cd56d0 con 0x5567e5cd4060 2024-09-11T22:16:24.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.961+0000 7f8e64a6e640 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 0x5567e5cd5110 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f8e580d0fd0 tx=0x7f8e58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fe62487fd73c68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.961+0000 7f8e3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:24.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.961+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/341441187 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e580ad060 con 0x5567e5cd4060 2024-09-11T22:16:24.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.961+0000 7f8e688aa740 1 -- 172.21.15.152:0/341441187 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e50004240 con 0x5567e5cd4060 2024-09-11T22:16:24.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.961+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/341441187 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f8e580b3b70 con 0x5567e5cd4060 2024-09-11T22:16:24.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.962+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/341441187 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8e5809e890 con 0x5567e5cd4060 2024-09-11T22:16:24.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.963+0000 7f8e688aa740 10 client.18471 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:24.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.963+0000 7f8e688aa740 1 -- 172.21.15.152:0/341441187 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5567e5cdafb0 con 0x5567e5cd4060 2024-09-11T22:16:24.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.964+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/341441187 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e50004240 con 0x5567e5cd4060 2024-09-11T22:16:24.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.965+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/341441187 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8e58024040 con 0x5567e5cd4060 2024-09-11T22:16:24.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.965+0000 7f8e688aa740 10 client.18471 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:24.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.965+0000 7f8e688aa740 10 client.18471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:24.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.965+0000 7f8e688aa740 20 client.18471 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:24.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.965+0000 7f8e688aa740 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567e5cbc900 0x5567e5cbed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.965+0000 7f8e688aa740 4 client.18471 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:16:24.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.965+0000 7f8e688aa740 1 -- 172.21.15.152:0/341441187 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5567e5baa210 con 0x5567e5cbc900 2024-09-11T22:16:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.967+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567e5cbc900 0x5567e5cbed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.977+0000 7f8e5ffff640 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567e5cbc900 0x5567e5cbed20 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7a84a4ad4acf652 server_cookie=475ae3bc22d05822 in_seq=0 out_seq=0 2024-09-11T22:16:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.977+0000 7f8e3f7fe640 10 client.18471 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.978+0000 7f8e3f7fe640 1 -- 172.21.15.152:0/341441187 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5567e5baa210 con 0x5567e5cbc900 2024-09-11T22:16:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.978+0000 7f8e3f7fe640 10 client.18471 handle_command_reply: tid=0 2024-09-11T22:16:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.978+0000 7f8e688aa740 1 client.18471 shutdown 2024-09-11T22:16:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.978+0000 7f8e688aa740 1 -- 172.21.15.152:0/341441187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 msgr2=0x5567e5cd5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.979+0000 7f8e688aa740 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 0x5567e5cd5110 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f8e580d0fd0 tx=0x7f8e58004a40 comp rx=0 tx=0).stop 2024-09-11T22:16:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.979+0000 7f8e688aa740 1 -- 172.21.15.152:0/341441187 shutdown_connections 2024-09-11T22:16:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.979+0000 7f8e688aa740 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5567e5cbc900 0x5567e5cbed20 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.979+0000 7f8e688aa740 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5567e5cd4060 0x5567e5cd5110 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.979+0000 7f8e688aa740 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5567e5cd0fa0 0x5567e5cd4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.979+0000 7f8e688aa740 1 --2- 172.21.15.152:0/341441187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e5cc97a0 0x5567e5cdc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.346 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:16:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:16:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:16:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "ea16ab9d-a39f-4e85-b8ce-a1b7cf860c25": { 2024-09-11T22:16:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:16:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "ea16ab9d-a39f-4e85-b8ce-a1b7cf860c25", 2024-09-11T22:16:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:16:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:24.347 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:16:24.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.979+0000 7f8e688aa740 1 -- 172.21.15.152:0/341441187 >> 172.21.15.152:0/341441187 conn(0x5567e5cc5410 msgr2=0x5567e5ccb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.979+0000 7f8e3f7fe640 0 client.18471 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:24.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.984+0000 7f8e688aa740 1 -- 172.21.15.152:0/341441187 shutdown_connections 2024-09-11T22:16:24.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.985+0000 7f8e688aa740 1 -- 172.21.15.152:0/341441187 wait complete. 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.986+0000 7f8e688aa740 20 client.18471 trim_cache size 0 max 16384 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.990+0000 7f8e6526f640 1 -- 172.21.15.152:0/1765700936 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8e480a2ec0 msgr2=0x7f8e480a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.990+0000 7f8e6526f640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8e480a2ec0 0x7f8e480a5380 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8e500096c0 tx=0x7f8e50005a20 comp rx=0 tx=0).stop 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.990+0000 7f8e6526f640 1 -- 172.21.15.152:0/1765700936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e601053e0 msgr2=0x7f8e60196760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.990+0000 7f8e6526f640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e601053e0 0x7f8e60196760 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009f80 tx=0x7f8e5800b7e0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.991+0000 7f8e6526f640 1 -- 172.21.15.152:0/1765700936 shutdown_connections 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.991+0000 7f8e6526f640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8e480a2ec0 0x7f8e480a5380 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.991+0000 7f8e6526f640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e601053e0 0x7f8e60196760 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.991+0000 7f8e6526f640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e60100c60 0x7f8e6019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.991+0000 7f8e6526f640 1 --2- 172.21.15.152:0/1765700936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e601002b0 0x7f8e6019c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.991+0000 7f8e6526f640 1 -- 172.21.15.152:0/1765700936 >> 172.21.15.152:0/1765700936 conn(0x7f8e60077070 msgr2=0x7f8e60103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.992+0000 7f8e6526f640 1 -- 172.21.15.152:0/1765700936 shutdown_connections 2024-09-11T22:16:24.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:23.992+0000 7f8e6526f640 1 -- 172.21.15.152:0/1765700936 wait complete. 2024-09-11T22:16:24.349 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:24 smithi152 ceph-mon[31188]: pgmap v378: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.9 MiB/s wr, 548 op/s 2024-09-11T22:16:24.349 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:24 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/526410923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:24.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:24 smithi179 ceph-mon[35603]: pgmap v378: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.9 MiB/s wr, 548 op/s 2024-09-11T22:16:24.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:24 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/526410923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:24 smithi193 ceph-mon[35545]: pgmap v378: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.9 MiB/s wr, 548 op/s 2024-09-11T22:16:24.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:24 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/526410923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:24.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 650.0 s, 1690.0 tps, lat 59.155 ms stddev 96.783 2024-09-11T22:16:24.931 INFO:tasks.cephfs.filesystem:scrub status for tag:ea16ab9d-a39f-4e85-b8ce-a1b7cf860c25 - {'path': '/', 'tag': 'ea16ab9d-a39f-4e85-b8ce-a1b7cf860c25', 'options': 'recursive,force'} 2024-09-11T22:16:25.639 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 147.2 --await-for 45.0' 2024-09-11T22:16:25.639 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 147.2 --await-for 45.0 2024-09-11T22:16:25.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:25 smithi152 ceph-mon[31188]: pgmap v379: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 22 MiB/s wr, 1.33k op/s 2024-09-11T22:16:26.002 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:26.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:25 smithi179 ceph-mon[35603]: pgmap v379: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 22 MiB/s wr, 1.33k op/s 2024-09-11T22:16:26.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:25 smithi193 ceph-mon[35545]: pgmap v379: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 22 MiB/s wr, 1.33k op/s 2024-09-11T22:16:26.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.545+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1045370856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4b01011e0 msgr2=0x7fe4b0105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.545+0000 7fe4b5cf9640 1 --2- 172.21.15.152:0/1045370856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4b01011e0 0x7fe4b0105980 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009900 tx=0x7fe4a402a410 comp rx=0 tx=0).stop 2024-09-11T22:16:26.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.558+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1045370856 shutdown_connections 2024-09-11T22:16:26.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.558+0000 7fe4b5cf9640 1 --2- 172.21.15.152:0/1045370856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4b0105ec0 0x7fe4b0106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.558+0000 7fe4b5cf9640 1 --2- 172.21.15.152:0/1045370856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4b01011e0 0x7fe4b0105980 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.558+0000 7fe4b5cf9640 1 --2- 172.21.15.152:0/1045370856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b01008c0 0x7fe4b0100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.558+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1045370856 >> 172.21.15.152:0/1045370856 conn(0x7fe4b00fc7d0 msgr2=0x7fe4b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:26.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.563+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1045370856 shutdown_connections 2024-09-11T22:16:26.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.564+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1045370856 wait complete. 2024-09-11T22:16:26.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.565+0000 7fe4b5cf9640 1 Processor -- start 2024-09-11T22:16:26.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.565+0000 7fe4b5cf9640 1 -- start start 2024-09-11T22:16:26.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.565+0000 7fe4b5cf9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4b01008c0 0x7fe4b0073900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.565+0000 7fe4b5cf9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4b01011e0 0x7fe4b0073e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.565+0000 7fe4b5cf9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b0105ec0 0x7fe4b006cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.565+0000 7fe4b5cf9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b0118700 con 0x7fe4b01011e0 2024-09-11T22:16:26.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.565+0000 7fe4b5cf9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b0118580 con 0x7fe4b0105ec0 2024-09-11T22:16:26.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.565+0000 7fe4b5cf9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b0118880 con 0x7fe4b01008c0 2024-09-11T22:16:26.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.567+0000 7fe4affff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b0105ec0 0x7fe4b006cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.567+0000 7fe4affff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b0105ec0 0x7fe4b006cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:59580/0 (socket says 172.21.15.152:59580) 2024-09-11T22:16:26.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.567+0000 7fe4affff640 1 -- 172.21.15.152:0/1515205122 learned_addr learned my addr 172.21.15.152:0/1515205122 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:26.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.567+0000 7fe4af7fe640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4b01008c0 0x7fe4b0073900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.567+0000 7fe4affff640 1 -- 172.21.15.152:0/1515205122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4b01008c0 msgr2=0x7fe4b0073900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.567+0000 7fe4affff640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4b01008c0 0x7fe4b0073900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.567+0000 7fe4affff640 1 -- 172.21.15.152:0/1515205122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4b01011e0 msgr2=0x7fe4b0073e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.568+0000 7fe4affff640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4b01011e0 0x7fe4b0073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.568+0000 7fe4affff640 1 -- 172.21.15.152:0/1515205122 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b006d3e0 con 0x7fe4b0105ec0 2024-09-11T22:16:26.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.573+0000 7fe4affff640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b0105ec0 0x7fe4b006cb20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800c970 tx=0x7fe4a800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:26.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.585+0000 7fe4acff9640 1 -- 172.21.15.152:0/1515205122 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8007bb0 con 0x7fe4b0105ec0 2024-09-11T22:16:26.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.585+0000 7fe4acff9640 1 -- 172.21.15.152:0/1515205122 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4a8007d50 con 0x7fe4b0105ec0 2024-09-11T22:16:26.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.585+0000 7fe4acff9640 1 -- 172.21.15.152:0/1515205122 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800f450 con 0x7fe4b0105ec0 2024-09-11T22:16:26.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.586+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1515205122 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b006d6d0 con 0x7fe4b0105ec0 2024-09-11T22:16:26.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.586+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1515205122 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b0071600 con 0x7fe4b0105ec0 2024-09-11T22:16:26.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.589+0000 7fe4b80d2740 1 Processor -- start 2024-09-11T22:16:26.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.589+0000 7fe4b80d2740 1 -- start start 2024-09-11T22:16:26.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.590+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a3760 0x55a3777a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.590+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 0x55a3777ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.590+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.590+0000 7fe4b80d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a3777092a0 con 0x55a3777a3760 2024-09-11T22:16:26.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.590+0000 7fe4b80d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a3776b0b10 con 0x55a3777a4080 2024-09-11T22:16:26.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.590+0000 7fe4b80d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a377705260 con 0x55a3777ae940 2024-09-11T22:16:26.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.590+0000 7fe4aeffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a3760 0x55a3777a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.590+0000 7fe4aeffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a3760 0x55a3777a3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34514/0 (socket says 172.21.15.152:34514) 2024-09-11T22:16:26.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.590+0000 7fe4aeffd640 1 -- 172.21.15.152:0/1785039146 learned_addr learned my addr 172.21.15.152:0/1785039146 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:26.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.590+0000 7fe4af7fe640 1 --2- 172.21.15.152:0/1785039146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 0x55a3777ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.590+0000 7fe4aeffd640 1 --2- 172.21.15.152:0/1785039146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.591+0000 7fe4aeffd640 1 -- 172.21.15.152:0/1785039146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 msgr2=0x55a3777b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:26.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.591+0000 7fe4aeffd640 1 --2- 172.21.15.152:0/1785039146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.591+0000 7fe4aeffd640 1 -- 172.21.15.152:0/1785039146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 msgr2=0x55a3777ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:26.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.591+0000 7fe4aeffd640 1 --2- 172.21.15.152:0/1785039146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 0x55a3777ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.591+0000 7fe4aeffd640 1 -- 172.21.15.152:0/1785039146 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a37747ab90 con 0x55a3777a3760 2024-09-11T22:16:26.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.591+0000 7fe4aeffd640 1 --2- 172.21.15.152:0/1785039146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a3760 0x55a3777a3b40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40057c0 tx=0x7fe4a4005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7298bdb2c93b2c89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:26.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.592+0000 7fe495ffb640 1 -- 172.21.15.152:0/1785039146 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4035040 con 0x55a3777a3760 2024-09-11T22:16:26.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.592+0000 7fe495ffb640 1 -- 172.21.15.152:0/1785039146 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4a4031ba0 con 0x55a3777a3760 2024-09-11T22:16:26.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.593+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1785039146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a3760 msgr2=0x55a3777a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.593+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/1785039146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a3760 0x55a3777a3b40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40057c0 tx=0x7fe4a4005a20 comp rx=0 tx=0).stop 2024-09-11T22:16:26.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.595+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1785039146 shutdown_connections 2024-09-11T22:16:26.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.595+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/1785039146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.595+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/1785039146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 0x55a3777ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.595+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/1785039146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a3760 0x55a3777a3b40 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.595+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1785039146 >> 172.21.15.152:0/1785039146 conn(0x55a37779fcf0 msgr2=0x55a3777a00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:26.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.595+0000 7fe4acff9640 1 -- 172.21.15.152:0/1515205122 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe4a8004ee0 con 0x7fe4b0105ec0 2024-09-11T22:16:26.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.596+0000 7fe4acff9640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4980a2f00 0x7fe4980a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.596+0000 7fe4acff9640 1 -- 172.21.15.152:0/1515205122 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7fe4a80cf4a0 con 0x7fe4b0105ec0 2024-09-11T22:16:26.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.598+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1785039146 shutdown_connections 2024-09-11T22:16:26.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.598+0000 7fe4af7fe640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4980a2f00 0x7fe4980a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.598+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1785039146 wait complete. 2024-09-11T22:16:26.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.599+0000 7fe4b80d2740 1 -- start start 2024-09-11T22:16:26.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.599+0000 7fe4b80d2740 1 Processor -- start 2024-09-11T22:16:26.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.599+0000 7fe4af7fe640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4980a2f00 0x7fe4980a53c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55a3777a0b50 tx=0x7fe4a000e040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:26.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.601+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a3760 0x55a3777ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.601+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a4080 0x55a3777abd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.601+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777ac250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.601+0000 7fe4b80d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a3777b1550 con 0x55a3777a4080 2024-09-11T22:16:26.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.601+0000 7fe4b80d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a3776916e0 con 0x55a3777a3760 2024-09-11T22:16:26.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.601+0000 7fe4b80d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a3777b16d0 con 0x55a3777ae940 2024-09-11T22:16:26.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.601+0000 7fe4b80d2740 10 client.0 _ll_register_callbacks cb 0x55a3776b5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:26.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.601+0000 7fe4affff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.601+0000 7fe4affff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:39298/0 (socket says 172.21.15.152:39298) 2024-09-11T22:16:26.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.601+0000 7fe4affff640 1 -- 172.21.15.152:0/3816638929 learned_addr learned my addr 172.21.15.152:0/3816638929 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:26.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.602+0000 7fe4aeffd640 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a4080 0x55a3777abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.602+0000 7fe4affff640 1 -- 172.21.15.152:0/3816638929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a3760 msgr2=0x55a3777ab7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:16:26.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.602+0000 7fe4affff640 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a3760 0x55a3777ab7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.602+0000 7fe4affff640 1 -- 172.21.15.152:0/3816638929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a4080 msgr2=0x55a3777abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:26.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.602+0000 7fe4affff640 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a4080 0x55a3777abd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.602+0000 7fe4affff640 1 -- 172.21.15.152:0/3816638929 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3777baa40 con 0x55a3777ae940 2024-09-11T22:16:26.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.603+0000 7fe4affff640 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777ac250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8098350 tx=0x7fe4a809b3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd3cba1b06cd103a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:26.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.603+0000 7fe48effd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:16:26.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.603+0000 7fe48effd640 1 -- 172.21.15.152:0/3816638929 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80b3070 con 0x55a3777ae940 2024-09-11T22:16:26.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.603+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3816638929 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4a4031ba0 con 0x55a3777ae940 2024-09-11T22:16:26.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.603+0000 7fe48effd640 1 -- 172.21.15.152:0/3816638929 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7fe4a80051d0 con 0x55a3777ae940 2024-09-11T22:16:26.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.604+0000 7fe48effd640 1 -- 172.21.15.152:0/3816638929 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe4a80a45f0 con 0x55a3777ae940 2024-09-11T22:16:26.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.605+0000 7fe4b80d2740 10 client.27901 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:26.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.605+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3816638929 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a3777bd400 con 0x55a3777ae940 2024-09-11T22:16:26.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.609+0000 7fe48effd640 1 -- 172.21.15.152:0/3816638929 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4a4031ba0 con 0x55a3777ae940 2024-09-11T22:16:26.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.609+0000 7fe48effd640 1 -- 172.21.15.152:0/3816638929 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe4a809aea0 con 0x55a3777ae940 2024-09-11T22:16:26.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.609+0000 7fe4b80d2740 10 client.27901 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:26.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.609+0000 7fe4b80d2740 10 client.27901 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:16:26.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.609+0000 7fe4b80d2740 20 client.27901 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:26.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.609+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a3777bed30 0x55a3777c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.609+0000 7fe4b80d2740 4 client.27901 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:26.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.609+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3816638929 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3777169d0 con 0x55a3777bed30 2024-09-11T22:16:26.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.610+0000 7fe4af7fe640 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a3777bed30 0x55a3777c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.612+0000 7fe4af7fe640 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a3777bed30 0x55a3777c11d0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca0d9a005dc02564 server_cookie=4fcb4327141fb6b8 in_seq=0 out_seq=0 2024-09-11T22:16:26.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.612+0000 7fe48effd640 10 client.27901 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:26.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.614+0000 7fe48effd640 1 -- 172.21.15.152:0/3816638929 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3777169d0 con 0x55a3777bed30 2024-09-11T22:16:26.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.614+0000 7fe48effd640 10 client.27901 handle_command_reply: tid=0 2024-09-11T22:16:26.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.614+0000 7fe4b80d2740 1 client.27901 shutdown 2024-09-11T22:16:26.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.614+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3816638929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 msgr2=0x55a3777ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.614+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777ac250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8098350 tx=0x7fe4a809b3a0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.614+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3816638929 shutdown_connections 2024-09-11T22:16:26.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.614+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a3777bed30 0x55a3777c11d0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.615+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777ac250 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.615+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a4080 0x55a3777abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.615+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/3816638929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a3760 0x55a3777ab7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.615+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3816638929 >> 172.21.15.152:0/3816638929 conn(0x55a37779fcf0 msgr2=0x55a3777a5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:26.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.615+0000 7fe48effd640 0 client.27901 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:26.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.615+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3816638929 shutdown_connections 2024-09-11T22:16:26.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.615+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3816638929 wait complete. 2024-09-11T22:16:26.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.615+0000 7fe4b80d2740 20 client.27901 trim_cache size 0 max 16384 2024-09-11T22:16:26.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.642+0000 7fe4b80d2740 1 Processor -- start 2024-09-11T22:16:26.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.642+0000 7fe4b80d2740 1 -- start start 2024-09-11T22:16:26.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.642+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a3760 0x55a3777aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.642+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a4080 0x55a3777c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.642+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.642+0000 7fe4b80d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b01adf90 con 0x55a3777a4080 2024-09-11T22:16:26.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.642+0000 7fe4af7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a3760 0x55a3777aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.642+0000 7fe4af7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a3760 0x55a3777aa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:59618/0 (socket says 172.21.15.152:59618) 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.642+0000 7fe4af7fe640 1 -- 172.21.15.152:0/3031305683 learned_addr learned my addr 172.21.15.152:0/3031305683 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3031305683 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b01ab860 con 0x55a3777a3760 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3031305683 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b01a96d0 con 0x55a3777ae940 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4affff640 1 --2- 172.21.15.152:0/3031305683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4aeffd640 1 --2- 172.21.15.152:0/3031305683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a4080 0x55a3777c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4affff640 1 -- 172.21.15.152:0/3031305683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a3760 msgr2=0x55a3777aa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4affff640 1 --2- 172.21.15.152:0/3031305683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a3760 0x55a3777aa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4affff640 1 -- 172.21.15.152:0/3031305683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a4080 msgr2=0x55a3777c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4affff640 1 --2- 172.21.15.152:0/3031305683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a4080 0x55a3777c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4affff640 1 -- 172.21.15.152:0/3031305683 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3777a71a0 con 0x55a3777ae940 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4aeffd640 1 --2- 172.21.15.152:0/3031305683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a4080 0x55a3777c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4af7fe640 1 --2- 172.21.15.152:0/3031305683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a3760 0x55a3777aa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:26.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4affff640 1 --2- 172.21.15.152:0/3031305683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777c7020 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8007590 tx=0x7fe4a8099e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=399c78b7390189f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:26.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.643+0000 7fe4957fa640 1 -- 172.21.15.152:0/3031305683 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80b3040 con 0x55a3777ae940 2024-09-11T22:16:26.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.644+0000 7fe4957fa640 1 -- 172.21.15.152:0/3031305683 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4a8005590 con 0x55a3777ae940 2024-09-11T22:16:26.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.644+0000 7fe4957fa640 1 -- 172.21.15.152:0/3031305683 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80a1080 con 0x55a3777ae940 2024-09-11T22:16:26.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.645+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3031305683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 msgr2=0x55a3777c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.645+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/3031305683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777c7020 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8007590 tx=0x7fe4a8099e90 comp rx=0 tx=0).stop 2024-09-11T22:16:26.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.645+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3031305683 shutdown_connections 2024-09-11T22:16:26.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.645+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/3031305683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777ae940 0x55a3777c7020 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.645+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/3031305683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777a4080 0x55a3777c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.645+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/3031305683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a3760 0x55a3777aa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.645+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3031305683 >> 172.21.15.152:0/3031305683 conn(0x55a37779fcf0 msgr2=0x55a3777ad850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:26.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.645+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3031305683 shutdown_connections 2024-09-11T22:16:26.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.645+0000 7fe4b80d2740 1 -- 172.21.15.152:0/3031305683 wait complete. 2024-09-11T22:16:26.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.646+0000 7fe4b80d2740 1 -- start start 2024-09-11T22:16:26.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.646+0000 7fe4b80d2740 1 Processor -- start 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.646+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777a3760 0x55a3777a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.646+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 0x55a3777a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.646+0000 7fe4b80d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777ae940 0x55a3777a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4b80d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b01a9d20 con 0x55a3777ae940 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4b80d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b01ab190 con 0x55a3777a4080 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4b80d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b01aa3f0 con 0x55a3777a3760 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4b80d2740 10 client.0 _ll_register_callbacks cb 0x7fe4a809b4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4aeffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 0x55a3777a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4affff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777ae940 0x55a3777a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4aeffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 0x55a3777a8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:59634/0 (socket says 172.21.15.152:59634) 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4aeffd640 1 -- 172.21.15.152:0/1591754241 learned_addr learned my addr 172.21.15.152:0/1591754241 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:26.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4af7fe640 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777a3760 0x55a3777a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4aeffd640 1 -- 172.21.15.152:0/1591754241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777a3760 msgr2=0x55a3777a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4aeffd640 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777a3760 0x55a3777a86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4aeffd640 1 -- 172.21.15.152:0/1591754241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777ae940 msgr2=0x55a3777a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4aeffd640 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777ae940 0x55a3777a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4aeffd640 1 -- 172.21.15.152:0/1591754241 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3777aa780 con 0x55a3777a4080 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe4aeffd640 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 0x55a3777a8bf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4006010 tx=0x7fe4a402ab90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c5ec93c94627c84 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.647+0000 7fe48effd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.648+0000 7fe48effd640 1 -- 172.21.15.152:0/1591754241 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4050070 con 0x55a3777a4080 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.648+0000 7fe48effd640 1 -- 172.21.15.152:0/1591754241 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7fe4a4031ba0 con 0x55a3777a4080 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.648+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1591754241 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4a8005590 con 0x55a3777a4080 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.648+0000 7fe48effd640 1 -- 172.21.15.152:0/1591754241 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe4a4035040 con 0x55a3777a4080 2024-09-11T22:16:26.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.648+0000 7fe4b80d2740 10 client.27764 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:26.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.648+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1591754241 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a3777a3eb0 con 0x55a3777a4080 2024-09-11T22:16:26.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.648+0000 7fe48effd640 1 -- 172.21.15.152:0/1591754241 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4a8005590 con 0x55a3777a4080 2024-09-11T22:16:26.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.649+0000 7fe48effd640 1 -- 172.21.15.152:0/1591754241 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe4a403e6e0 con 0x55a3777a4080 2024-09-11T22:16:26.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.649+0000 7fe4b80d2740 10 client.27764 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:26.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.649+0000 7fe4b80d2740 10 client.27764 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:16:26.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.649+0000 7fe4b80d2740 20 client.27764 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:26.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.649+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a377829c10 0x55a37782c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.649+0000 7fe4b80d2740 4 client.27764 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.2, "await_for": 45.0}] 2024-09-11T22:16:26.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.649+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1591754241 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.2, "await_for": 45.0}) -- 0x55a377710d20 con 0x55a377829c10 2024-09-11T22:16:26.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.649+0000 7fe4af7fe640 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a377829c10 0x55a37782c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.650+0000 7fe4af7fe640 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a377829c10 0x55a37782c000 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=917b15a609aa94c1 server_cookie=d3056c73c6141e7a in_seq=0 out_seq=0 2024-09-11T22:16:26.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.650+0000 7fe48effd640 10 client.27764 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:26.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe48effd640 1 -- 172.21.15.152:0/1591754241 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55a377710d20 con 0x55a377829c10 2024-09-11T22:16:26.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe48effd640 10 client.27764 handle_command_reply: tid=0 2024-09-11T22:16:26.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe4b80d2740 1 client.27764 shutdown 2024-09-11T22:16:26.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1591754241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 msgr2=0x55a3777a8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 0x55a3777a8bf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4006010 tx=0x7fe4a402ab90 comp rx=0 tx=0).stop 2024-09-11T22:16:26.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1591754241 shutdown_connections 2024-09-11T22:16:26.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a377829c10 0x55a37782c000 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3777ae940 0x55a3777a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3777a4080 0x55a3777a8bf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe4b80d2740 1 --2- 172.21.15.152:0/1591754241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3777a3760 0x55a3777a86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe48effd640 0 client.27764 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:26.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.991+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1591754241 >> 172.21.15.152:0/1591754241 conn(0x55a37779fcf0 msgr2=0x55a37779ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:26.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1591754241 shutdown_connections 2024-09-11T22:16:26.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b80d2740 1 -- 172.21.15.152:0/1591754241 wait complete. 2024-09-11T22:16:26.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b80d2740 20 client.27764 trim_cache size 0 max 16384 2024-09-11T22:16:26.995 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:16:26.995 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:16:26.995 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:16:26.995 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 46, 2024-09-11T22:16:26.995 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:16:26.995 INFO:teuthology.orchestra.run.smithi152.stdout: "255c99d": { 2024-09-11T22:16:26.995 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 46, 2024-09-11T22:16:26.996 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:16:26.996 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:16:26.996 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:16:26.996 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:16:26.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:16:26.996 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:16:26.996 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 147.2, 2024-09-11T22:16:26.997 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:16:26.997 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:16:26.997 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:16:26.997 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:16:26.997 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:16:26.997 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:16:26.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:26.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:26.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:26.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:26.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:26.998 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:16:26.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1515205122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4980a2f00 msgr2=0x7fe4980a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4980a2f00 0x7fe4980a53c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55a3777a0b50 tx=0x7fe4a000e040 comp rx=0 tx=0).stop 2024-09-11T22:16:26.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1515205122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b0105ec0 msgr2=0x7fe4b006cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b0105ec0 0x7fe4b006cb20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800c970 tx=0x7fe4a800ce30 comp rx=0 tx=0).stop 2024-09-11T22:16:26.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1515205122 shutdown_connections 2024-09-11T22:16:27.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4980a2f00 0x7fe4980a53c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b0105ec0 0x7fe4b006cb20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4b01011e0 0x7fe4b0073e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 --2- 172.21.15.152:0/1515205122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4b01008c0 0x7fe4b0073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1515205122 >> 172.21.15.152:0/1515205122 conn(0x7fe4b00fc7d0 msgr2=0x7fe4b0103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:27.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1515205122 shutdown_connections 2024-09-11T22:16:27.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:26.992+0000 7fe4b5cf9640 1 -- 172.21.15.152:0/1515205122 wait complete. 2024-09-11T22:16:27.642 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '255c99d', quiesce took 5.3 seconds. Will release after: 21.9 2024-09-11T22:16:27.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:27 smithi152 ceph-mon[31188]: pgmap v380: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 1.28k op/s 2024-09-11T22:16:28.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:27 smithi179 ceph-mon[35603]: pgmap v380: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 1.28k op/s 2024-09-11T22:16:28.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:27 smithi193 ceph-mon[35545]: pgmap v380: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 1.28k op/s 2024-09-11T22:16:29.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:28 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:16:29.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:28 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:16:29.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:28 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:16:29.821 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 655.0 s, 870.4 tps, lat 42.743 ms stddev 54.370 2024-09-11T22:16:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.111+0000 7f4681aba640 1 -- 172.21.15.152:0/3520032722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f467c106a00 msgr2=0x7f467c106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.111+0000 7f4681aba640 1 --2- 172.21.15.152:0/3520032722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f467c106a00 0x7f467c106de0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f466c009930 tx=0x7f466c02a420 comp rx=0 tx=0).stop 2024-09-11T22:16:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.111+0000 7f4681aba640 1 -- 172.21.15.152:0/3520032722 shutdown_connections 2024-09-11T22:16:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.111+0000 7f4681aba640 1 --2- 172.21.15.152:0/3520032722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c101390 0x7f467c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.111+0000 7f4681aba640 1 --2- 172.21.15.152:0/3520032722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f467c1009f0 0x7f467c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.111+0000 7f4681aba640 1 --2- 172.21.15.152:0/3520032722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f467c106a00 0x7f467c106de0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.111+0000 7f4681aba640 1 -- 172.21.15.152:0/3520032722 >> 172.21.15.152:0/3520032722 conn(0x7f467c0fc6b0 msgr2=0x7f467c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.111+0000 7f4681aba640 1 -- 172.21.15.152:0/3520032722 shutdown_connections 2024-09-11T22:16:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.111+0000 7f4681aba640 1 -- 172.21.15.152:0/3520032722 wait complete. 2024-09-11T22:16:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f4681aba640 1 Processor -- start 2024-09-11T22:16:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f4681aba640 1 -- start start 2024-09-11T22:16:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f4681aba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c1009f0 0x7f467c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f4681aba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f467c101390 0x7f467c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f4681aba640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f467c106a00 0x7f467c1a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f4681aba640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f467c110e40 con 0x7f467c101390 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f4681aba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f467c110cc0 con 0x7f467c1009f0 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f4681aba640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f467c110fc0 con 0x7f467c106a00 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f467affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f467c101390 0x7f467c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f467affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f467c101390 0x7f467c199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34550/0 (socket says 172.21.15.152:34550) 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f467affd640 1 -- 172.21.15.152:0/3719895408 learned_addr learned my addr 172.21.15.152:0/3719895408 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f467bfff640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f467c106a00 0x7f467c1a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f467b7fe640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c1009f0 0x7f467c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f467affd640 1 -- 172.21.15.152:0/3719895408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f467c106a00 msgr2=0x7f467c1a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f467affd640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f467c106a00 0x7f467c1a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f467affd640 1 -- 172.21.15.152:0/3719895408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c1009f0 msgr2=0x7f467c1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.112+0000 7f467affd640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c1009f0 0x7f467c1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.113+0000 7f467affd640 1 -- 172.21.15.152:0/3719895408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c1a47b0 con 0x7f467c101390 2024-09-11T22:16:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.113+0000 7f467b7fe640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c1009f0 0x7f467c1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.113+0000 7f467bfff640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f467c106a00 0x7f467c1a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.113+0000 7f467affd640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f467c101390 0x7f467c199730 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f467000d770 tx=0x7f467000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.113+0000 7f4678ff9640 1 -- 172.21.15.152:0/3719895408 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670017070 con 0x7f467c101390 2024-09-11T22:16:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.113+0000 7f4678ff9640 1 -- 172.21.15.152:0/3719895408 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4670005500 con 0x7f467c101390 2024-09-11T22:16:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.113+0000 7f4681aba640 1 -- 172.21.15.152:0/3719895408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467c1a4980 con 0x7f467c101390 2024-09-11T22:16:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.113+0000 7f4678ff9640 1 -- 172.21.15.152:0/3719895408 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670004e00 con 0x7f467c101390 2024-09-11T22:16:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.113+0000 7f4681aba640 1 -- 172.21.15.152:0/3719895408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467c1a4e50 con 0x7f467c101390 2024-09-11T22:16:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.115+0000 7f4678ff9640 1 -- 172.21.15.152:0/3719895408 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f4670004fa0 con 0x7f467c101390 2024-09-11T22:16:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f468485b740 1 Processor -- start 2024-09-11T22:16:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f468485b740 1 -- start start 2024-09-11T22:16:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f468485b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647068af0 0x55c647068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f468485b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c647073770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f468485b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c6470760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f468485b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c646fcd2f0 con 0x55c647073cb0 2024-09-11T22:16:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f468485b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c646f75270 con 0x55c647068af0 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f468485b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c646fc92b0 con 0x55c647069410 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f4678ff9640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f46640a2da0 0x7f46640a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f467affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c6470760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f467affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c6470760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34558/0 (socket says 172.21.15.152:34558) 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f467affd640 1 -- 172.21.15.152:0/1099202194 learned_addr learned my addr 172.21.15.152:0/1099202194 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f467bfff640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f46640a2da0 0x7f46640a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f467b7fe640 1 --2- 172.21.15.152:0/1099202194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c647073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f467bfff640 1 --2- 172.21.15.152:0/1099202194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647068af0 0x55c647068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.116+0000 7f4678ff9640 1 -- 172.21.15.152:0/3719895408 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f46700cefe0 con 0x7f467c101390 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.117+0000 7f467b7fe640 1 -- 172.21.15.152:0/1099202194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647068af0 msgr2=0x55c647068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.117+0000 7f467b7fe640 1 --2- 172.21.15.152:0/1099202194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647068af0 0x55c647068ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.117+0000 7f467b7fe640 1 -- 172.21.15.152:0/1099202194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 msgr2=0x55c6470760a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.117+0000 7f467b7fe640 1 --2- 172.21.15.152:0/1099202194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c6470760a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.117+0000 7f467b7fe640 1 -- 172.21.15.152:0/1099202194 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c646f74340 con 0x55c647069410 2024-09-11T22:16:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.117+0000 7f467affd640 1 --2- 172.21.15.152:0/1099202194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c6470760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.117+0000 7f467bfff640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f46640a2da0 0x7f46640a5260 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4674009fd0 tx=0x7f4674009dc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.117+0000 7f467b7fe640 1 --2- 172.21.15.152:0/1099202194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c647073770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f466c000c00 tx=0x7f466c009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=566104c09d7b4058 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.117+0000 7f4661ffb640 1 -- 172.21.15.152:0/1099202194 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c03f070 con 0x55c647069410 2024-09-11T22:16:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.117+0000 7f4661ffb640 1 -- 172.21.15.152:0/1099202194 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f466c004030 con 0x55c647069410 2024-09-11T22:16:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.117+0000 7f4661ffb640 1 -- 172.21.15.152:0/1099202194 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c035070 con 0x55c647069410 2024-09-11T22:16:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.118+0000 7f468485b740 1 -- 172.21.15.152:0/1099202194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 msgr2=0x55c647073770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.118+0000 7f468485b740 1 --2- 172.21.15.152:0/1099202194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c647073770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f466c000c00 tx=0x7f466c009680 comp rx=0 tx=0).stop 2024-09-11T22:16:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.118+0000 7f468485b740 1 -- 172.21.15.152:0/1099202194 shutdown_connections 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.118+0000 7f468485b740 1 --2- 172.21.15.152:0/1099202194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c6470760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.118+0000 7f468485b740 1 --2- 172.21.15.152:0/1099202194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c647073770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.118+0000 7f468485b740 1 --2- 172.21.15.152:0/1099202194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647068af0 0x55c647068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.118+0000 7f468485b740 1 -- 172.21.15.152:0/1099202194 >> 172.21.15.152:0/1099202194 conn(0x55c647065060 msgr2=0x55c647065440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.118+0000 7f468485b740 1 -- 172.21.15.152:0/1099202194 shutdown_connections 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.118+0000 7f468485b740 1 -- 172.21.15.152:0/1099202194 wait complete. 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.118+0000 7f468485b740 1 -- start start 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f468485b740 1 Processor -- start 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f468485b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647068af0 0x55c647070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f468485b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647069410 0x55c647071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f468485b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647073cb0 0x55c647071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f468485b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c647076880 con 0x55c647069410 2024-09-11T22:16:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f468485b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c646f56290 con 0x55c647073cb0 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f468485b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c647076a00 con 0x55c647068af0 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f468485b740 10 client.0 _ll_register_callbacks cb 0x55c646f87140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647069410 0x55c647071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647069410 0x55c647071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34566/0 (socket says 172.21.15.152:34566) 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467affd640 1 -- 172.21.15.152:0/2479075575 learned_addr learned my addr 172.21.15.152:0/2479075575 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467b7fe640 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647068af0 0x55c647070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467bfff640 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647073cb0 0x55c647071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467affd640 1 -- 172.21.15.152:0/2479075575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647068af0 msgr2=0x55c647070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467affd640 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647068af0 0x55c647070bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467affd640 1 -- 172.21.15.152:0/2479075575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647073cb0 msgr2=0x55c647071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467affd640 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647073cb0 0x55c647071650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467affd640 1 -- 172.21.15.152:0/2479075575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c646ce0210 con 0x55c647069410 2024-09-11T22:16:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467b7fe640 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647068af0 0x55c647070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f467affd640 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647069410 0x55c647071110 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f46700ccb30 tx=0x7f46700057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae203ea6d567e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f465affd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f465affd640 1 -- 172.21.15.152:0/2479075575 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670020040 con 0x55c647069410 2024-09-11T22:16:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f465affd640 1 -- 172.21.15.152:0/2479075575 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f4670097b10 con 0x55c647069410 2024-09-11T22:16:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.119+0000 7f468485b740 1 -- 172.21.15.152:0/2479075575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f466c004030 con 0x55c647069410 2024-09-11T22:16:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f465affd640 1 -- 172.21.15.152:0/2479075575 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f467009b4a0 con 0x55c647069410 2024-09-11T22:16:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f468485b740 10 client.18498 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f468485b740 1 -- 172.21.15.152:0/2479075575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c646dac620 con 0x55c647069410 2024-09-11T22:16:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f465affd640 1 -- 172.21.15.152:0/2479075575 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f466c004030 con 0x55c647069410 2024-09-11T22:16:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f465affd640 1 -- 172.21.15.152:0/2479075575 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f467009a360 con 0x55c647069410 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f468485b740 10 client.18498 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f468485b740 10 client.18498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f468485b740 20 client.18498 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f468485b740 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c647083c40 0x55c647086050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f468485b740 4 client.18498 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f468485b740 1 -- 172.21.15.152:0/2479075575 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c646fdaa20 con 0x55c647083c40 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.120+0000 7f467b7fe640 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c647083c40 0x55c647086050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.121+0000 7f467b7fe640 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c647083c40 0x55c647086050 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78eb0bc33af8354a server_cookie=a0e16ca9dbc6d7b5 in_seq=0 out_seq=0 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.121+0000 7f465affd640 10 client.18498 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.121+0000 7f465affd640 1 -- 172.21.15.152:0/2479075575 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c646fdaa20 con 0x55c647083c40 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.121+0000 7f465affd640 10 client.18498 handle_command_reply: tid=0 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 1 client.18498 shutdown 2024-09-11T22:16:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 1 -- 172.21.15.152:0/2479075575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647069410 msgr2=0x55c647071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647069410 0x55c647071110 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f46700ccb30 tx=0x7f46700057b0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 1 -- 172.21.15.152:0/2479075575 shutdown_connections 2024-09-11T22:16:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c647083c40 0x55c647086050 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647073cb0 0x55c647071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647069410 0x55c647071110 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 1 --2- 172.21.15.152:0/2479075575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647068af0 0x55c647070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f465affd640 0 client.18498 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 1 -- 172.21.15.152:0/2479075575 >> 172.21.15.152:0/2479075575 conn(0x55c647065060 msgr2=0x55c64706ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 1 -- 172.21.15.152:0/2479075575 shutdown_connections 2024-09-11T22:16:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 1 -- 172.21.15.152:0/2479075575 wait complete. 2024-09-11T22:16:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.122+0000 7f468485b740 20 client.18498 trim_cache size 0 max 16384 2024-09-11T22:16:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.136+0000 7f468485b740 1 Processor -- start 2024-09-11T22:16:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.136+0000 7f468485b740 1 -- start start 2024-09-11T22:16:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.136+0000 7f468485b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647068af0 0x55c6470714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.136+0000 7f468485b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c64708b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.136+0000 7f468485b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647073cb0 0x55c64708be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.136+0000 7f468485b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f467c1b0280 con 0x55c647068af0 2024-09-11T22:16:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.136+0000 7f468485b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f467c1adb50 con 0x55c647073cb0 2024-09-11T22:16:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.136+0000 7f468485b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f467c1ab9c0 con 0x55c647069410 2024-09-11T22:16:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.136+0000 7f467b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647068af0 0x55c6470714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.136+0000 7f467b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647068af0 0x55c6470714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34582/0 (socket says 172.21.15.152:34582) 2024-09-11T22:16:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.136+0000 7f467b7fe640 1 -- 172.21.15.152:0/80872182 learned_addr learned my addr 172.21.15.152:0/80872182 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.137+0000 7f467b7fe640 1 -- 172.21.15.152:0/80872182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 msgr2=0x55c64708b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.137+0000 7f467b7fe640 1 --2- 172.21.15.152:0/80872182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c64708b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.137+0000 7f467b7fe640 1 -- 172.21.15.152:0/80872182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647073cb0 msgr2=0x55c64708be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.137+0000 7f467b7fe640 1 --2- 172.21.15.152:0/80872182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647073cb0 0x55c64708be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.137+0000 7f467b7fe640 1 -- 172.21.15.152:0/80872182 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c647065cf0 con 0x55c647068af0 2024-09-11T22:16:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.137+0000 7f467b7fe640 1 --2- 172.21.15.152:0/80872182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647068af0 0x55c6470714c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f466c006010 tx=0x7f466c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c5b2f3f3b943a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.137+0000 7f46617fa640 1 -- 172.21.15.152:0/80872182 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c035040 con 0x55c647068af0 2024-09-11T22:16:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.137+0000 7f46617fa640 1 -- 172.21.15.152:0/80872182 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f466c004250 con 0x55c647068af0 2024-09-11T22:16:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.137+0000 7f46617fa640 1 -- 172.21.15.152:0/80872182 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c03f040 con 0x55c647068af0 2024-09-11T22:16:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 -- 172.21.15.152:0/80872182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647068af0 msgr2=0x55c6470714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 --2- 172.21.15.152:0/80872182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647068af0 0x55c6470714c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f466c006010 tx=0x7f466c02a420 comp rx=0 tx=0).stop 2024-09-11T22:16:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 -- 172.21.15.152:0/80872182 shutdown_connections 2024-09-11T22:16:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 --2- 172.21.15.152:0/80872182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647073cb0 0x55c64708be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 --2- 172.21.15.152:0/80872182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c64708b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 --2- 172.21.15.152:0/80872182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647068af0 0x55c6470714c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 -- 172.21.15.152:0/80872182 >> 172.21.15.152:0/80872182 conn(0x55c647065060 msgr2=0x55c647072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 -- 172.21.15.152:0/80872182 shutdown_connections 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 -- 172.21.15.152:0/80872182 wait complete. 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 -- start start 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 Processor -- start 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647068af0 0x55c64707bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c64707c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c647078c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f467c1ac010 con 0x55c647073cb0 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f467c1ad480 con 0x55c647068af0 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f467c1ac6e0 con 0x55c647069410 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.138+0000 7f468485b740 10 client.0 _ll_register_callbacks cb 0x7f467000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c647078c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c647078c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34590/0 (socket says 172.21.15.152:34590) 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467bfff640 1 -- 172.21.15.152:0/3346318233 learned_addr learned my addr 172.21.15.152:0/3346318233 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467affd640 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c64707c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467b7fe640 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647068af0 0x55c64707bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467bfff640 1 -- 172.21.15.152:0/3346318233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 msgr2=0x55c64707c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467bfff640 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c64707c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467bfff640 1 -- 172.21.15.152:0/3346318233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647068af0 msgr2=0x55c64707bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467bfff640 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647068af0 0x55c64707bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467bfff640 1 -- 172.21.15.152:0/3346318233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6470602d0 con 0x55c647073cb0 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467affd640 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c64707c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f467bfff640 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c647078c60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f4674011da0 tx=0x7f4674004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f6ed82aaee3ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f465affd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f465affd640 1 -- 172.21.15.152:0/3346318233 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674027070 con 0x55c647073cb0 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f465affd640 1 -- 172.21.15.152:0/3346318233 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f4674004530 con 0x55c647073cb0 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f468485b740 1 -- 172.21.15.152:0/3346318233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f466c004250 con 0x55c647073cb0 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f465affd640 1 -- 172.21.15.152:0/3346318233 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4674033050 con 0x55c647073cb0 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f468485b740 10 client.18504 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.139+0000 7f468485b740 1 -- 172.21.15.152:0/3346318233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c6470eec70 con 0x55c647073cb0 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.140+0000 7f465affd640 1 -- 172.21.15.152:0/3346318233 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f466c004250 con 0x55c647073cb0 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.140+0000 7f465affd640 1 -- 172.21.15.152:0/3346318233 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f4674012450 con 0x55c647073cb0 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.140+0000 7f468485b740 10 client.18504 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.140+0000 7f468485b740 10 client.18504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.140+0000 7f468485b740 20 client.18504 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.140+0000 7f468485b740 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c6470ef420 0x55c6470f1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.140+0000 7f468485b740 4 client.18504 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:16:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.140+0000 7f468485b740 1 -- 172.21.15.152:0/3346318233 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c646fd4d70 con 0x55c6470ef420 2024-09-11T22:16:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.140+0000 7f467b7fe640 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c6470ef420 0x55c6470f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.140+0000 7f467b7fe640 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c6470ef420 0x55c6470f1840 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fc31594e271db14 server_cookie=4db01e1b1451db17 in_seq=0 out_seq=0 2024-09-11T22:16:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.140+0000 7f465affd640 10 client.18504 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f465affd640 1 -- 172.21.15.152:0/3346318233 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c646fd4d70 con 0x55c6470ef420 2024-09-11T22:16:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f465affd640 10 client.18504 handle_command_reply: tid=0 2024-09-11T22:16:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 1 client.18504 shutdown 2024-09-11T22:16:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 1 -- 172.21.15.152:0/3346318233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 msgr2=0x55c647078c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c647078c60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f4674011da0 tx=0x7f4674004a40 comp rx=0 tx=0).stop 2024-09-11T22:16:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 1 -- 172.21.15.152:0/3346318233 shutdown_connections 2024-09-11T22:16:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c6470ef420 0x55c6470f1840 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c647073cb0 0x55c647078c60 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c647069410 0x55c64707c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f465affd640 0 client.18504 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 1 --2- 172.21.15.152:0/3346318233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c647068af0 0x55c64707bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 1 -- 172.21.15.152:0/3346318233 >> 172.21.15.152:0/3346318233 conn(0x55c647065060 msgr2=0x55c6470639a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 1 -- 172.21.15.152:0/3346318233 shutdown_connections 2024-09-11T22:16:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 1 -- 172.21.15.152:0/3346318233 wait complete. 2024-09-11T22:16:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.149+0000 7f468485b740 20 client.18504 trim_cache size 0 max 16384 2024-09-11T22:16:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:16:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:16:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:16:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:16:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 -- 172.21.15.152:0/3719895408 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f46640a2da0 msgr2=0x7f46640a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.152 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f46640a2da0 0x7f46640a5260 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4674009fd0 tx=0x7f4674009dc0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 -- 172.21.15.152:0/3719895408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f467c101390 msgr2=0x7f467c199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f467c101390 0x7f467c199730 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f467000d770 tx=0x7f467000dc30 comp rx=0 tx=0).stop 2024-09-11T22:16:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 -- 172.21.15.152:0/3719895408 shutdown_connections 2024-09-11T22:16:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f46640a2da0 0x7f46640a5260 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f467c106a00 0x7f467c1a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f467c101390 0x7f467c199730 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.153 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 --2- 172.21.15.152:0/3719895408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c1009f0 0x7f467c1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 -- 172.21.15.152:0/3719895408 >> 172.21.15.152:0/3719895408 conn(0x7f467c0fc6b0 msgr2=0x7f467c0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 -- 172.21.15.152:0/3719895408 shutdown_connections 2024-09-11T22:16:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:30.150+0000 7f4681aba640 1 -- 172.21.15.152:0/3719895408 wait complete. 2024-09-11T22:16:30.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:29 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:16:30.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:29 smithi152 ceph-mon[31188]: pgmap v381: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 30 MiB/s wr, 1.88k op/s 2024-09-11T22:16:30.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:29 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:16:30.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:29 smithi179 ceph-mon[35603]: pgmap v381: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 30 MiB/s wr, 1.88k op/s 2024-09-11T22:16:30.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:29 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:16:30.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:29 smithi193 ceph-mon[35545]: pgmap v381: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 30 MiB/s wr, 1.88k op/s 2024-09-11T22:16:31.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:31 smithi152 ceph-mon[31188]: pgmap v382: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 25 MiB/s wr, 1.60k op/s 2024-09-11T22:16:32.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:31 smithi179 ceph-mon[35603]: pgmap v382: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 25 MiB/s wr, 1.60k op/s 2024-09-11T22:16:32.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:31 smithi193 ceph-mon[35545]: pgmap v382: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 25 MiB/s wr, 1.60k op/s 2024-09-11T22:16:33.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:33 smithi152 ceph-mon[31188]: pgmap v383: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 25 MiB/s wr, 1.60k op/s 2024-09-11T22:16:34.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:33 smithi179 ceph-mon[35603]: pgmap v383: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 25 MiB/s wr, 1.60k op/s 2024-09-11T22:16:34.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:33 smithi193 ceph-mon[35545]: pgmap v383: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 25 MiB/s wr, 1.60k op/s 2024-09-11T22:16:34.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:16:35.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:35 smithi152 ceph-mon[31188]: pgmap v384: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 25 MiB/s wr, 1.57k op/s 2024-09-11T22:16:36.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:35 smithi179 ceph-mon[35603]: pgmap v384: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 25 MiB/s wr, 1.57k op/s 2024-09-11T22:16:36.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:35 smithi193 ceph-mon[35545]: pgmap v384: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 25 MiB/s wr, 1.57k op/s 2024-09-11T22:16:37.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:37 smithi152 ceph-mon[31188]: pgmap v385: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 8.9 MiB/s wr, 611 op/s 2024-09-11T22:16:38.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:37 smithi179 ceph-mon[35603]: pgmap v385: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 8.9 MiB/s wr, 611 op/s 2024-09-11T22:16:38.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:37 smithi193 ceph-mon[35545]: pgmap v385: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 8.9 MiB/s wr, 611 op/s 2024-09-11T22:16:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:38 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:16:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:38 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:38 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:38 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:38 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:38 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:38 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:38 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:16:39.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:38 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:38 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:38 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:38 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:38 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:38 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:38 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:16:39.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:38 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:38 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:38 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:38 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:38 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:38 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:16:39.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:39 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:16:39.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:39 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:16:39.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:39 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:39.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:39 smithi152 ceph-mon[31188]: pgmap v386: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 12 MiB/s wr, 921 op/s 2024-09-11T22:16:40.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:39 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:16:40.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:39 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:16:40.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:39 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:40.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:39 smithi179 ceph-mon[35603]: pgmap v386: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 12 MiB/s wr, 921 op/s 2024-09-11T22:16:40.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:39 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:16:40.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:39 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:16:40.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:39 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:16:40.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:39 smithi193 ceph-mon[35545]: pgmap v386: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 12 MiB/s wr, 921 op/s 2024-09-11T22:16:41.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:41 smithi152 ceph-mon[31188]: pgmap v387: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.7 MiB/s wr, 316 op/s 2024-09-11T22:16:42.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:41 smithi179 ceph-mon[35603]: pgmap v387: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.7 MiB/s wr, 316 op/s 2024-09-11T22:16:42.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:41 smithi193 ceph-mon[35545]: pgmap v387: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.7 MiB/s wr, 316 op/s 2024-09-11T22:16:43.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.246+0000 7f90aef28640 1 -- 172.21.15.152:0/2793950929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90a810c130 msgr2=0x7f90a810e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:43.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.246+0000 7f90aef28640 1 --2- 172.21.15.152:0/2793950929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90a810c130 0x7f90a810e5a0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009ca0 tx=0x7f90a002a950 comp rx=0 tx=0).stop 2024-09-11T22:16:43.260 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.246+0000 7f90aef28640 1 -- 172.21.15.152:0/2793950929 shutdown_connections 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.246+0000 7f90aef28640 1 --2- 172.21.15.152:0/2793950929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90a810c130 0x7f90a810e5a0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.246+0000 7f90aef28640 1 --2- 172.21.15.152:0/2793950929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90a8103680 0x7f90a810bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.246+0000 7f90aef28640 1 --2- 172.21.15.152:0/2793950929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90a8102d60 0x7f90a8103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.246+0000 7f90aef28640 1 -- 172.21.15.152:0/2793950929 >> 172.21.15.152:0/2793950929 conn(0x7f90a80fc6b0 msgr2=0x7f90a80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.246+0000 7f90aef28640 1 -- 172.21.15.152:0/2793950929 shutdown_connections 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.247+0000 7f90aef28640 1 -- 172.21.15.152:0/2793950929 wait complete. 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.247+0000 7f90aef28640 1 Processor -- start 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.247+0000 7f90aef28640 1 -- start start 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.247+0000 7f90aef28640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90a8102d60 0x7f90a81982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.247+0000 7f90aef28640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90a8103680 0x7f90a8198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.247+0000 7f90aef28640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90a810c130 0x7f90a819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.247+0000 7f90aef28640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8111f00 con 0x7f90a8103680 2024-09-11T22:16:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.247+0000 7f90aef28640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8111d80 con 0x7f90a810c130 2024-09-11T22:16:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.247+0000 7f90aef28640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8112080 con 0x7f90a8102d60 2024-09-11T22:16:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.247+0000 7f90a7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90a8103680 0x7f90a8198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90a7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90a8103680 0x7f90a8198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41130/0 (socket says 172.21.15.152:41130) 2024-09-11T22:16:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90a7fff640 1 -- 172.21.15.152:0/3944698848 learned_addr learned my addr 172.21.15.152:0/3944698848 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90accc4640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90a8102d60 0x7f90a81982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90a810c130 0x7f90a819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90a7fff640 1 -- 172.21.15.152:0/3944698848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90a8102d60 msgr2=0x7f90a81982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90a7fff640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90a8102d60 0x7f90a81982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90a7fff640 1 -- 172.21.15.152:0/3944698848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90a810c130 msgr2=0x7f90a819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90a7fff640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90a810c130 0x7f90a819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90a7fff640 1 -- 172.21.15.152:0/3944698848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a819d2e0 con 0x7f90a8103680 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90a810c130 0x7f90a819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90a7fff640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90a8103680 0x7f90a8198830 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f909400d950 tx=0x7f909400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90a5ffb640 1 -- 172.21.15.152:0/3944698848 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094017030 con 0x7f90a8103680 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90aef28640 1 -- 172.21.15.152:0/3944698848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a819d5d0 con 0x7f90a8103680 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90a5ffb640 1 -- 172.21.15.152:0/3944698848 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9094004020 con 0x7f90a8103680 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.248+0000 7f90a5ffb640 1 -- 172.21.15.152:0/3944698848 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90940047a0 con 0x7f90a8103680 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.249+0000 7f90aef28640 1 -- 172.21.15.152:0/3944698848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a81a4e60 con 0x7f90a8103680 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.251+0000 7f90a5ffb640 1 -- 172.21.15.152:0/3944698848 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f90940041d0 con 0x7f90a8103680 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90b1cb6740 1 Processor -- start 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90b1cb6740 1 -- start start 2024-09-11T22:16:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f25caf0 0x55d42f25ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25d410 0x55d42f267770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f26a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d42f1c12f0 con 0x55d42f267cb0 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d42f169270 con 0x55d42f25d410 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d42f1bd2b0 con 0x55d42f25caf0 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90a7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f26a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90a7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f26a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41142/0 (socket says 172.21.15.152:41142) 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90a7fff640 1 -- 172.21.15.152:0/3126854691 learned_addr learned my addr 172.21.15.152:0/3126854691 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90accc4640 1 --2- 172.21.15.152:0/3126854691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25d410 0x55d42f267770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/3126854691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f25caf0 0x55d42f25ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90a5ffb640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90980a2da0 0x7f90980a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90a7fff640 1 -- 172.21.15.152:0/3126854691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f25caf0 msgr2=0x55d42f25ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90a7fff640 1 --2- 172.21.15.152:0/3126854691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f25caf0 0x55d42f25ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90a7fff640 1 -- 172.21.15.152:0/3126854691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25d410 msgr2=0x55d42f267770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90a7fff640 1 --2- 172.21.15.152:0/3126854691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25d410 0x55d42f267770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90a7fff640 1 -- 172.21.15.152:0/3126854691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42f168340 con 0x55d42f267cb0 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90accc4640 1 --2- 172.21.15.152:0/3126854691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25d410 0x55d42f267770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.252+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90980a2da0 0x7f90980a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.253+0000 7f90a5ffb640 1 -- 172.21.15.152:0/3944698848 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f90940cee40 con 0x7f90a8103680 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.253+0000 7f90a7fff640 1 --2- 172.21.15.152:0/3126854691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f26a0a0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f90940cc4a0 tx=0x7f9094090790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5237f91fe8aabe2f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.253+0000 7f9092ffd640 1 -- 172.21.15.152:0/3126854691 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909409ae40 con 0x55d42f267cb0 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.253+0000 7f9092ffd640 1 -- 172.21.15.152:0/3126854691 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9094066390 con 0x55d42f267cb0 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.253+0000 7f9092ffd640 1 -- 172.21.15.152:0/3126854691 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909409ac60 con 0x55d42f267cb0 2024-09-11T22:16:43.265 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.253+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90980a2da0 0x7f90980a5260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f90a0005e30 tx=0x7f90a003e040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.254+0000 7f90b1cb6740 1 -- 172.21.15.152:0/3126854691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 msgr2=0x55d42f26a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.254+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/3126854691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f26a0a0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f90940cc4a0 tx=0x7f9094090790 comp rx=0 tx=0).stop 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.254+0000 7f90b1cb6740 1 -- 172.21.15.152:0/3126854691 shutdown_connections 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.254+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/3126854691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f26a0a0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.254+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/3126854691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25d410 0x55d42f267770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.254+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/3126854691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f25caf0 0x55d42f25ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.254+0000 7f90b1cb6740 1 -- 172.21.15.152:0/3126854691 >> 172.21.15.152:0/3126854691 conn(0x55d42f259060 msgr2=0x55d42f259440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.254+0000 7f90b1cb6740 1 -- 172.21.15.152:0/3126854691 shutdown_connections 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.254+0000 7f90b1cb6740 1 -- 172.21.15.152:0/3126854691 wait complete. 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.254+0000 7f90b1cb6740 1 -- start start 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.254+0000 7f90b1cb6740 1 Processor -- start 2024-09-11T22:16:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25caf0 0x55d42f264b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25d410 0x55d42f265080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 0x55d42f2655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d42f26a880 con 0x55d42f25d410 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d42f14a290 con 0x55d42f25caf0 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d42f26aa00 con 0x55d42f267cb0 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90b1cb6740 10 client.0 _ll_register_callbacks cb 0x55d42f17b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90a7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25d410 0x55d42f265080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90a7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25d410 0x55d42f265080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41152/0 (socket says 172.21.15.152:41152) 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90a7fff640 1 -- 172.21.15.152:0/488949339 learned_addr learned my addr 172.21.15.152:0/488949339 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90accc4640 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25caf0 0x55d42f264b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 0x55d42f2655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90a7fff640 1 -- 172.21.15.152:0/488949339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 msgr2=0x55d42f2655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90a7fff640 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 0x55d42f2655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90a7fff640 1 -- 172.21.15.152:0/488949339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25caf0 msgr2=0x55d42f264b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90a7fff640 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25caf0 0x55d42f264b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90a7fff640 1 -- 172.21.15.152:0/488949339 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d42eed4210 con 0x55d42f25d410 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 0x55d42f2655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90a7fff640 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25d410 0x55d42f265080 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f909409b000 tx=0x7f90940cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ae3c30972d93ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f9087fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f9087fff640 1 -- 172.21.15.152:0/488949339 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909409ac60 con 0x55d42f25d410 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f9087fff640 1 -- 172.21.15.152:0/488949339 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f90940cc7b0 con 0x55d42f25d410 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f90b1cb6740 1 -- 172.21.15.152:0/488949339 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9094066390 con 0x55d42f25d410 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.255+0000 7f9087fff640 1 -- 172.21.15.152:0/488949339 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f909409b0d0 con 0x55d42f25d410 2024-09-11T22:16:43.268 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.256+0000 7f90b1cb6740 10 client.18516 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.256+0000 7f90b1cb6740 1 -- 172.21.15.152:0/488949339 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d42efa0620 con 0x55d42f25d410 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.256+0000 7f9087fff640 1 -- 172.21.15.152:0/488949339 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9094066390 con 0x55d42f25d410 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.256+0000 7f9087fff640 1 -- 172.21.15.152:0/488949339 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f90940d0020 con 0x55d42f25d410 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.256+0000 7f90b1cb6740 10 client.18516 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.256+0000 7f90b1cb6740 10 client.18516 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.256+0000 7f90b1cb6740 20 client.18516 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.256+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d42f277a60 0x55d42f279e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.256+0000 7f90b1cb6740 4 client.18516 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.256+0000 7f90b1cb6740 1 -- 172.21.15.152:0/488949339 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d42f1cea20 con 0x55d42f277a60 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.256+0000 7f90accc4640 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d42f277a60 0x55d42f279e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.257+0000 7f90accc4640 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d42f277a60 0x55d42f279e50 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a327e4c2939a5c45 server_cookie=4ff393dbc113aa34 in_seq=0 out_seq=0 2024-09-11T22:16:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.257+0000 7f9087fff640 10 client.18516 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.257+0000 7f9087fff640 1 -- 172.21.15.152:0/488949339 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d42f1cea20 con 0x55d42f277a60 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.257+0000 7f9087fff640 10 client.18516 handle_command_reply: tid=0 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 1 client.18516 shutdown 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 1 -- 172.21.15.152:0/488949339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25d410 msgr2=0x55d42f265080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25d410 0x55d42f265080 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f909409b000 tx=0x7f90940cf040 comp rx=0 tx=0).stop 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 1 -- 172.21.15.152:0/488949339 shutdown_connections 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d42f277a60 0x55d42f279e50 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 0x55d42f2655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25d410 0x55d42f265080 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/488949339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25caf0 0x55d42f264b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f9087fff640 0 client.18516 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 1 -- 172.21.15.152:0/488949339 >> 172.21.15.152:0/488949339 conn(0x55d42f259060 msgr2=0x55d42f25edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:43.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 1 -- 172.21.15.152:0/488949339 shutdown_connections 2024-09-11T22:16:43.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 1 -- 172.21.15.152:0/488949339 wait complete. 2024-09-11T22:16:43.271 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.258+0000 7f90b1cb6740 20 client.18516 trim_cache size 0 max 16384 2024-09-11T22:16:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.272+0000 7f90b1cb6740 1 Processor -- start 2024-09-11T22:16:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.272+0000 7f90b1cb6740 1 -- start start 2024-09-11T22:16:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.272+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25caf0 0x55d42f2653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.272+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25d410 0x55d42f27f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.272+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 0x55d42f27f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.272+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81b0210 con 0x55d42f25caf0 2024-09-11T22:16:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.272+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81adae0 con 0x55d42f25d410 2024-09-11T22:16:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.272+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81ab950 con 0x55d42f267cb0 2024-09-11T22:16:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90accc4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25caf0 0x55d42f2653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90accc4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25caf0 0x55d42f2653f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41156/0 (socket says 172.21.15.152:41156) 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90accc4640 1 -- 172.21.15.152:0/68065852 learned_addr learned my addr 172.21.15.152:0/68065852 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/68065852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 0x55d42f27f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90accc4640 1 -- 172.21.15.152:0/68065852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 msgr2=0x55d42f27f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90a7fff640 1 --2- 172.21.15.152:0/68065852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25d410 0x55d42f27f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90accc4640 1 --2- 172.21.15.152:0/68065852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 0x55d42f27f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90accc4640 1 -- 172.21.15.152:0/68065852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25d410 msgr2=0x55d42f27f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90accc4640 1 --2- 172.21.15.152:0/68065852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25d410 0x55d42f27f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90accc4640 1 -- 172.21.15.152:0/68065852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42f27a1c0 con 0x55d42f25caf0 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/68065852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 0x55d42f27f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90accc4640 1 --2- 172.21.15.152:0/68065852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25caf0 0x55d42f2653f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f909c00bc20 tx=0x7f909c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf3373e69965542 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90927fc640 1 -- 172.21.15.152:0/68065852 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c011440 con 0x55d42f25caf0 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90927fc640 1 -- 172.21.15.152:0/68065852 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f909c011ac0 con 0x55d42f25caf0 2024-09-11T22:16:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.273+0000 7f90927fc640 1 -- 172.21.15.152:0/68065852 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c026a70 con 0x55d42f25caf0 2024-09-11T22:16:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.274+0000 7f90b1cb6740 1 -- 172.21.15.152:0/68065852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25caf0 msgr2=0x55d42f2653f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.274+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/68065852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25caf0 0x55d42f2653f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f909c00bc20 tx=0x7f909c00b390 comp rx=0 tx=0).stop 2024-09-11T22:16:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.274+0000 7f90b1cb6740 1 -- 172.21.15.152:0/68065852 shutdown_connections 2024-09-11T22:16:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.274+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/68065852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f267cb0 0x55d42f27f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.274+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/68065852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25d410 0x55d42f27f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.274+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/68065852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f25caf0 0x55d42f2653f0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.274+0000 7f90b1cb6740 1 -- 172.21.15.152:0/68065852 >> 172.21.15.152:0/68065852 conn(0x55d42f259060 msgr2=0x55d42f266bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.274+0000 7f90b1cb6740 1 -- 172.21.15.152:0/68065852 shutdown_connections 2024-09-11T22:16:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.274+0000 7f90b1cb6740 1 -- 172.21.15.152:0/68065852 wait complete. 2024-09-11T22:16:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.274+0000 7f90b1cb6740 1 -- start start 2024-09-11T22:16:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.274+0000 7f90b1cb6740 1 Processor -- start 2024-09-11T22:16:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25caf0 0x55d42f2700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f25d410 0x55d42f2614f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90b1cb6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f261a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81abfa0 con 0x55d42f267cb0 2024-09-11T22:16:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81ad410 con 0x55d42f25caf0 2024-09-11T22:16:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90b1cb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81ac670 con 0x55d42f25d410 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90b1cb6740 10 client.0 _ll_register_callbacks cb 0x7f909c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90ad4c5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f261a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90ad4c5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f261a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41164/0 (socket says 172.21.15.152:41164) 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90ad4c5640 1 -- 172.21.15.152:0/971661061 learned_addr learned my addr 172.21.15.152:0/971661061 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90a7fff640 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f25d410 0x55d42f2614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90accc4640 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25caf0 0x55d42f2700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90ad4c5640 1 -- 172.21.15.152:0/971661061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f25d410 msgr2=0x55d42f2614f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f25d410 0x55d42f2614f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90ad4c5640 1 -- 172.21.15.152:0/971661061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25caf0 msgr2=0x55d42f2700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25caf0 0x55d42f2700d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90ad4c5640 1 -- 172.21.15.152:0/971661061 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d42f261f70 con 0x55d42f267cb0 2024-09-11T22:16:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90ad4c5640 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f261a30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009ca0 tx=0x7f90a0005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bfd7e60af16e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f9087fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f9087fff640 1 -- 172.21.15.152:0/971661061 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0034040 con 0x55d42f267cb0 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f9087fff640 1 -- 172.21.15.152:0/971661061 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f90a0045bb0 con 0x55d42f267cb0 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.275+0000 7f90b1cb6740 1 -- 172.21.15.152:0/971661061 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f909c011ac0 con 0x55d42f267cb0 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f9087fff640 1 -- 172.21.15.152:0/971661061 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f90a0045db0 con 0x55d42f267cb0 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f90b1cb6740 10 client.18522 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f90b1cb6740 1 -- 172.21.15.152:0/971661061 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d42f2e2040 con 0x55d42f267cb0 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f9087fff640 1 -- 172.21.15.152:0/971661061 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f909c011ac0 con 0x55d42f267cb0 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f9087fff640 1 -- 172.21.15.152:0/971661061 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f90a0004660 con 0x55d42f267cb0 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f90b1cb6740 10 client.18522 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f90b1cb6740 10 client.18522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f90b1cb6740 20 client.18522 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d42f2e2810 0x55d42f2e4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f90b1cb6740 4 client.18522 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:16:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f90b1cb6740 1 -- 172.21.15.152:0/971661061 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d42f1c8d70 con 0x55d42f2e2810 2024-09-11T22:16:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.276+0000 7f90accc4640 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d42f2e2810 0x55d42f2e4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.277+0000 7f9087fff640 10 client.18522 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.277+0000 7f90accc4640 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d42f2e2810 0x55d42f2e4c30 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5a6c4c758e9bfb0 server_cookie=287b3d2743eb4f18 in_seq=0 out_seq=0 2024-09-11T22:16:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f9087fff640 1 -- 172.21.15.152:0/971661061 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d42f1c8d70 con 0x55d42f2e2810 2024-09-11T22:16:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f9087fff640 10 client.18522 handle_command_reply: tid=0 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f90b1cb6740 1 client.18522 shutdown 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f90b1cb6740 1 -- 172.21.15.152:0/971661061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 msgr2=0x55d42f261a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f261a30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009ca0 tx=0x7f90a0005d80 comp rx=0 tx=0).stop 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f90b1cb6740 1 -- 172.21.15.152:0/971661061 shutdown_connections 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55d42f2e2810 0x55d42f2e4c30 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d42f267cb0 0x55d42f261a30 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d42f25d410 0x55d42f2614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f9087fff640 0 client.18522 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f90b1cb6740 1 --2- 172.21.15.152:0/971661061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d42f25caf0 0x55d42f2700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f90b1cb6740 1 -- 172.21.15.152:0/971661061 >> 172.21.15.152:0/971661061 conn(0x55d42f259060 msgr2=0x55d42f2579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f90b1cb6740 1 -- 172.21.15.152:0/971661061 shutdown_connections 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.285+0000 7f90b1cb6740 1 -- 172.21.15.152:0/971661061 wait complete. 2024-09-11T22:16:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90b1cb6740 20 client.18522 trim_cache size 0 max 16384 2024-09-11T22:16:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:16:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:16:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:16:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:16:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 -- 172.21.15.152:0/3944698848 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90980a2da0 msgr2=0x7f90980a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90980a2da0 0x7f90980a5260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f90a0005e30 tx=0x7f90a003e040 comp rx=0 tx=0).stop 2024-09-11T22:16:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 -- 172.21.15.152:0/3944698848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90a8103680 msgr2=0x7f90a8198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90a8103680 0x7f90a8198830 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f909400d950 tx=0x7f909400de10 comp rx=0 tx=0).stop 2024-09-11T22:16:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 -- 172.21.15.152:0/3944698848 shutdown_connections 2024-09-11T22:16:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90980a2da0 0x7f90980a5260 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90a810c130 0x7f90a819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90a8103680 0x7f90a8198830 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 --2- 172.21.15.152:0/3944698848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90a8102d60 0x7f90a81982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 -- 172.21.15.152:0/3944698848 >> 172.21.15.152:0/3944698848 conn(0x7f90a80fc6b0 msgr2=0x7f90a80fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 -- 172.21.15.152:0/3944698848 shutdown_connections 2024-09-11T22:16:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:43.286+0000 7f90aef28640 1 -- 172.21.15.152:0/3944698848 wait complete. 2024-09-11T22:16:43.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:43 smithi152 ceph-mon[31188]: pgmap v388: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.7 MiB/s wr, 317 op/s 2024-09-11T22:16:44.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:43 smithi179 ceph-mon[35603]: pgmap v388: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.7 MiB/s wr, 317 op/s 2024-09-11T22:16:44.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:43 smithi193 ceph-mon[35545]: pgmap v388: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.7 MiB/s wr, 317 op/s 2024-09-11T22:16:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:16:45.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:45 smithi152 ceph-mon[31188]: pgmap v389: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.7 MiB/s wr, 321 op/s 2024-09-11T22:16:46.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:45 smithi179 ceph-mon[35603]: pgmap v389: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.7 MiB/s wr, 321 op/s 2024-09-11T22:16:46.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:45 smithi193 ceph-mon[35545]: pgmap v389: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.7 MiB/s wr, 321 op/s 2024-09-11T22:16:47.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:47 smithi152 ceph-mon[31188]: pgmap v390: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.7 MiB/s wr, 316 op/s 2024-09-11T22:16:48.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:47 smithi179 ceph-mon[35603]: pgmap v390: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.7 MiB/s wr, 316 op/s 2024-09-11T22:16:48.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:47 smithi193 ceph-mon[35545]: pgmap v390: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.7 MiB/s wr, 316 op/s 2024-09-11T22:16:49.544 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:16:49.811 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:49.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:16:49.931 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:49 smithi152 ceph-mon[31188]: pgmap v391: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.7 MiB/s wr, 319 op/s 2024-09-11T22:16:50.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:49 smithi179 ceph-mon[35603]: pgmap v391: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.7 MiB/s wr, 319 op/s 2024-09-11T22:16:50.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:49 smithi193 ceph-mon[35545]: pgmap v391: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.7 MiB/s wr, 319 op/s 2024-09-11T22:16:50.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.296+0000 7fb77228e640 1 -- 172.21.15.152:0/4156853482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb76c102790 msgr2=0x7fb76c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:50.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.296+0000 7fb77228e640 1 --2- 172.21.15.152:0/4156853482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb76c102790 0x7fb76c1067e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fb760009900 tx=0x7fb76002a410 comp rx=0 tx=0).stop 2024-09-11T22:16:50.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.296+0000 7fb77228e640 1 -- 172.21.15.152:0/4156853482 shutdown_connections 2024-09-11T22:16:50.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.296+0000 7fb77228e640 1 --2- 172.21.15.152:0/4156853482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c106f10 0x7fb76c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:50.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.296+0000 7fb77228e640 1 --2- 172.21.15.152:0/4156853482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb76c102790 0x7fb76c1067e0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:50.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.296+0000 7fb77228e640 1 --2- 172.21.15.152:0/4156853482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c101de0 0x7fb76c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:50.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.296+0000 7fb77228e640 1 -- 172.21.15.152:0/4156853482 >> 172.21.15.152:0/4156853482 conn(0x7fb76c0fd8c0 msgr2=0x7fb76c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.296+0000 7fb77228e640 1 -- 172.21.15.152:0/4156853482 shutdown_connections 2024-09-11T22:16:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.296+0000 7fb77228e640 1 -- 172.21.15.152:0/4156853482 wait complete. 2024-09-11T22:16:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb77228e640 1 Processor -- start 2024-09-11T22:16:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb77228e640 1 -- start start 2024-09-11T22:16:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb77228e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb76c101de0 0x7fb76c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb77228e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c102790 0x7fb76c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb77228e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c106f10 0x7fb76c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb77228e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c111f70 con 0x7fb76c101de0 2024-09-11T22:16:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb77228e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c111df0 con 0x7fb76c106f10 2024-09-11T22:16:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb77228e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c1120f0 con 0x7fb76c102790 2024-09-11T22:16:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb76bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb76c101de0 0x7fb76c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb76bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb76c101de0 0x7fb76c1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51736/0 (socket says 172.21.15.152:51736) 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb76bfff640 1 -- 172.21.15.152:0/1157685776 learned_addr learned my addr 172.21.15.152:0/1157685776 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb76b7fe640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c102790 0x7fb76c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb77082b640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c106f10 0x7fb76c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb76bfff640 1 -- 172.21.15.152:0/1157685776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c102790 msgr2=0x7fb76c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.297+0000 7fb76bfff640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c102790 0x7fb76c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.298+0000 7fb76bfff640 1 -- 172.21.15.152:0/1157685776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c106f10 msgr2=0x7fb76c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.298+0000 7fb76bfff640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c106f10 0x7fb76c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.298+0000 7fb76bfff640 1 -- 172.21.15.152:0/1157685776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c19d380 con 0x7fb76c101de0 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.298+0000 7fb76b7fe640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c102790 0x7fb76c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.298+0000 7fb77082b640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c106f10 0x7fb76c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.298+0000 7fb76bfff640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb76c101de0 0x7fb76c1983d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00c970 tx=0x7fb75c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.298+0000 7fb7697fa640 1 -- 172.21.15.152:0/1157685776 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c007bb0 con 0x7fb76c101de0 2024-09-11T22:16:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.298+0000 7fb7697fa640 1 -- 172.21.15.152:0/1157685776 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb75c007d50 con 0x7fb76c101de0 2024-09-11T22:16:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.298+0000 7fb77228e640 1 -- 172.21.15.152:0/1157685776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76c19d670 con 0x7fb76c101de0 2024-09-11T22:16:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.298+0000 7fb7697fa640 1 -- 172.21.15.152:0/1157685776 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00f450 con 0x7fb76c101de0 2024-09-11T22:16:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.298+0000 7fb77228e640 1 -- 172.21.15.152:0/1157685776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb76c1a4f50 con 0x7fb76c101de0 2024-09-11T22:16:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.299+0000 7fb77228e640 1 -- 172.21.15.152:0/1157685776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb76c1021c0 con 0x7fb76c101de0 2024-09-11T22:16:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.300+0000 7fb7697fa640 1 -- 172.21.15.152:0/1157685776 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb75c004fe0 con 0x7fb76c101de0 2024-09-11T22:16:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.301+0000 7fb7697fa640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7540a2d70 0x7fb7540a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.301+0000 7fb76b7fe640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7540a2d70 0x7fb7540a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.301+0000 7fb7697fa640 1 -- 172.21.15.152:0/1157685776 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7fb75c0cf6b0 con 0x7fb76c101de0 2024-09-11T22:16:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.301+0000 7fb76b7fe640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7540a2d70 0x7fb7540a5230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb760000c00 tx=0x7fb760032d50 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.304+0000 7fb7697fa640 1 -- 172.21.15.152:0/1157685776 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb75c014030 con 0x7fb76c101de0 2024-09-11T22:16:50.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.503+0000 7fb77228e640 1 -- 172.21.15.152:0/1157685776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb76c199730 con 0x7fb76c101de0 2024-09-11T22:16:50.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.504+0000 7fb7697fa640 1 -- 172.21.15.152:0/1157685776 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7fb75c09c2f0 con 0x7fb76c101de0 2024-09-11T22:16:50.505 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:16:50.505 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:16:50.506 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:16:50.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 -- 172.21.15.152:0/1157685776 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7540a2d70 msgr2=0x7fb7540a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:50.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7540a2d70 0x7fb7540a5230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb760000c00 tx=0x7fb760032d50 comp rx=0 tx=0).stop 2024-09-11T22:16:50.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 -- 172.21.15.152:0/1157685776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb76c101de0 msgr2=0x7fb76c1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:50.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb76c101de0 0x7fb76c1983d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00c970 tx=0x7fb75c00ce30 comp rx=0 tx=0).stop 2024-09-11T22:16:50.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 -- 172.21.15.152:0/1157685776 shutdown_connections 2024-09-11T22:16:50.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb7540a2d70 0x7fb7540a5230 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:50.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c106f10 0x7fb76c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:50.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb76c102790 0x7fb76c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:50.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 --2- 172.21.15.152:0/1157685776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb76c101de0 0x7fb76c1983d0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:50.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 -- 172.21.15.152:0/1157685776 >> 172.21.15.152:0/1157685776 conn(0x7fb76c0fd8c0 msgr2=0x7fb76c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:50.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 -- 172.21.15.152:0/1157685776 shutdown_connections 2024-09-11T22:16:50.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:50.506+0000 7fb77228e640 1 -- 172.21.15.152:0/1157685776 wait complete. 2024-09-11T22:16:50.957 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:50 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1157685776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:51.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:50 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1157685776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:51.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:50 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1157685776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:51.183 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 255c99d --release --await' 2024-09-11T22:16:51.183 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 255c99d --release --await 2024-09-11T22:16:51.432 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:51.807 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:51 smithi152 ceph-mon[31188]: pgmap v392: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-09-11T22:16:51.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.893+0000 7f141c0f5640 1 -- 172.21.15.152:0/979226376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1414100e20 msgr2=0x7f1414101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:51.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.893+0000 7f141c0f5640 1 --2- 172.21.15.152:0/979226376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1414100e20 0x7f1414101200 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f1410009900 tx=0x7f141002a480 comp rx=0 tx=0).stop 2024-09-11T22:16:51.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.893+0000 7f141c0f5640 1 -- 172.21.15.152:0/979226376 shutdown_connections 2024-09-11T22:16:51.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.893+0000 7f141c0f5640 1 --2- 172.21.15.152:0/979226376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1414102ef0 0x7f141410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.893+0000 7f141c0f5640 1 --2- 172.21.15.152:0/979226376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1414102570 0x7f14141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.893+0000 7f141c0f5640 1 --2- 172.21.15.152:0/979226376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1414100e20 0x7f1414101200 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.893+0000 7f141c0f5640 1 -- 172.21.15.152:0/979226376 >> 172.21.15.152:0/979226376 conn(0x7f14140fc7d0 msgr2=0x7f14140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:51.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.894+0000 7f141c0f5640 1 -- 172.21.15.152:0/979226376 shutdown_connections 2024-09-11T22:16:51.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.894+0000 7f141c0f5640 1 -- 172.21.15.152:0/979226376 wait complete. 2024-09-11T22:16:51.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.894+0000 7f141c0f5640 1 Processor -- start 2024-09-11T22:16:51.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.894+0000 7f141c0f5640 1 -- start start 2024-09-11T22:16:51.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.894+0000 7f141c0f5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1414100e20 0x7f141419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.894+0000 7f141c0f5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1414102570 0x7f141419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.894+0000 7f141c0f5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1414102ef0 0x7f141419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.894+0000 7f141c0f5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1414110f50 con 0x7f1414100e20 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.894+0000 7f141c0f5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1414110dd0 con 0x7f1414102ef0 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.894+0000 7f141c0f5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14141110d0 con 0x7f1414102570 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.894+0000 7f1419e91640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1414100e20 0x7f141419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f1419e91640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1414100e20 0x7f141419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51756/0 (socket says 172.21.15.152:51756) 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f1419e91640 1 -- 172.21.15.152:0/1309713446 learned_addr learned my addr 172.21.15.152:0/1309713446 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f141a692640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1414102ef0 0x7f141419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f1419690640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1414102570 0x7f141419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f1419e91640 1 -- 172.21.15.152:0/1309713446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1414102570 msgr2=0x7f141419ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:51.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f1419e91640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1414102570 0x7f141419ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f1419e91640 1 -- 172.21.15.152:0/1309713446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1414102ef0 msgr2=0x7f141419efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f1419e91640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1414102ef0 0x7f141419efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f1419e91640 1 -- 172.21.15.152:0/1309713446 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141419f6b0 con 0x7f1414100e20 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f1419e91640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1414100e20 0x7f141419a700 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f1410006010 tx=0x7f1410003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f140affd640 1 -- 172.21.15.152:0/1309713446 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141003f070 con 0x7f1414100e20 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f140affd640 1 -- 172.21.15.152:0/1309713446 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1410031e30 con 0x7f1414100e20 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f141c0f5640 1 -- 172.21.15.152:0/1309713446 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141419f940 con 0x7f1414100e20 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f140affd640 1 -- 172.21.15.152:0/1309713446 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410035030 con 0x7f1414100e20 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.895+0000 7f141c0f5640 1 -- 172.21.15.152:0/1309713446 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14141a7280 con 0x7f1414100e20 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.897+0000 7f140affd640 1 -- 172.21.15.152:0/1309713446 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f1410042070 con 0x7f1414100e20 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f141e4ce740 1 Processor -- start 2024-09-11T22:16:51.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f141e4ce740 1 -- start start 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f140affd640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14000a2d70 0x7f14000a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 0x5568b9c05440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05980 0x5568b9c0fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c10240 0x5568b9c12630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f141e4ce740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5568b9b6a620 con 0x5568b9c05980 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f141e4ce740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5568b9b11e50 con 0x5568b9c05060 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f141e4ce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5568b9b665e0 con 0x5568b9c10240 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f141a692640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14000a2d70 0x7f14000a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f1419690640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05980 0x5568b9c0fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f1419690640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05980 0x5568b9c0fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51770/0 (socket says 172.21.15.152:51770) 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f140affd640 1 -- 172.21.15.152:0/1309713446 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f14100efe60 con 0x7f1414100e20 2024-09-11T22:16:51.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.898+0000 7f1419690640 1 -- 172.21.15.152:0/3510204915 learned_addr learned my addr 172.21.15.152:0/3510204915 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f141a692640 1 --2- 172.21.15.152:0/3510204915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c10240 0x5568b9c12630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f1419e91640 1 --2- 172.21.15.152:0/3510204915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 0x5568b9c05440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f1419690640 1 -- 172.21.15.152:0/3510204915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c10240 msgr2=0x5568b9c12630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f1419690640 1 --2- 172.21.15.152:0/3510204915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c10240 0x5568b9c12630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f1419690640 1 -- 172.21.15.152:0/3510204915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 msgr2=0x5568b9c05440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f1419690640 1 --2- 172.21.15.152:0/3510204915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 0x5568b9c05440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f1419690640 1 -- 172.21.15.152:0/3510204915 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b9b02d40 con 0x5568b9c05980 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f1419e91640 1 --2- 172.21.15.152:0/3510204915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 0x5568b9c05440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f141a692640 1 --2- 172.21.15.152:0/3510204915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c10240 0x5568b9c12630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f141a692640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14000a2d70 0x7f14000a5230 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f140c00a780 tx=0x7f140c013ae0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f1419690640 1 --2- 172.21.15.152:0/3510204915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05980 0x5568b9c0fd00 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f140400cbc0 tx=0x7f140400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8301f7dde3daee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:51.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f13fffff640 1 -- 172.21.15.152:0/3510204915 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404017dd0 con 0x5568b9c05980 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f13fffff640 1 -- 172.21.15.152:0/3510204915 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1404022960 con 0x5568b9c05980 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.899+0000 7f13fffff640 1 -- 172.21.15.152:0/3510204915 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14040207a0 con 0x5568b9c05980 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.900+0000 7f141e4ce740 1 -- 172.21.15.152:0/3510204915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05980 msgr2=0x5568b9c0fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.900+0000 7f141e4ce740 1 --2- 172.21.15.152:0/3510204915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05980 0x5568b9c0fd00 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f140400cbc0 tx=0x7f140400e720 comp rx=0 tx=0).stop 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.900+0000 7f141e4ce740 1 -- 172.21.15.152:0/3510204915 shutdown_connections 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.900+0000 7f141e4ce740 1 --2- 172.21.15.152:0/3510204915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c10240 0x5568b9c12630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.900+0000 7f141e4ce740 1 --2- 172.21.15.152:0/3510204915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05980 0x5568b9c0fd00 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.900+0000 7f141e4ce740 1 --2- 172.21.15.152:0/3510204915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 0x5568b9c05440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.900+0000 7f141e4ce740 1 -- 172.21.15.152:0/3510204915 >> 172.21.15.152:0/3510204915 conn(0x5568b9c015f0 msgr2=0x5568b9c019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.900+0000 7f141e4ce740 1 -- 172.21.15.152:0/3510204915 shutdown_connections 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.900+0000 7f141e4ce740 1 -- 172.21.15.152:0/3510204915 wait complete. 2024-09-11T22:16:51.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.900+0000 7f141e4ce740 1 -- start start 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.900+0000 7f141e4ce740 1 Processor -- start 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 0x5568b9c0d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c05980 0x5568b9c0d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c0db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141e4ce740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5568b9c12e10 con 0x5568b9c10240 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141e4ce740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5568b9af2f10 con 0x5568b9c05060 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141e4ce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5568b9c12f90 con 0x5568b9c05980 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141e4ce740 10 client.0 _ll_register_callbacks cb 0x5568b9b16db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141a692640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c0db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141a692640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c0db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51786/0 (socket says 172.21.15.152:51786) 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141a692640 1 -- 172.21.15.152:0/2605136038 learned_addr learned my addr 172.21.15.152:0/2605136038 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:51.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f1419690640 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c05980 0x5568b9c0d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f1419e91640 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 0x5568b9c0d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141a692640 1 -- 172.21.15.152:0/2605136038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c05980 msgr2=0x5568b9c0d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141a692640 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c05980 0x5568b9c0d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141a692640 1 -- 172.21.15.152:0/2605136038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 msgr2=0x5568b9c0d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141a692640 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 0x5568b9c0d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f141a692640 1 -- 172.21.15.152:0/2605136038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568b9879580 con 0x5568b9c10240 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f1419690640 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c05980 0x5568b9c0d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.901+0000 7f1419e91640 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 0x5568b9c0d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f141a692640 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c0db60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f140c011ab0 tx=0x7f140c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db5e6faabc89c47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f13fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f13fd7fa640 1 -- 172.21.15.152:0/2605136038 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c003970 con 0x5568b9c10240 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f141e4ce740 1 -- 172.21.15.152:0/2605136038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1404022960 con 0x5568b9c10240 2024-09-11T22:16:51.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f13fd7fa640 1 -- 172.21.15.152:0/2605136038 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f140c003b10 con 0x5568b9c10240 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f13fd7fa640 1 -- 172.21.15.152:0/2605136038 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f140c003d10 con 0x5568b9c10240 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f141e4ce740 10 client.18540 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f141e4ce740 1 -- 172.21.15.152:0/2605136038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5568b9943960 con 0x5568b9c10240 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f13fd7fa640 1 -- 172.21.15.152:0/2605136038 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1404022960 con 0x5568b9c10240 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f13fd7fa640 1 -- 172.21.15.152:0/2605136038 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f140c01f6f0 con 0x5568b9c10240 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f141e4ce740 10 client.18540 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f141e4ce740 10 client.18540 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f141e4ce740 20 client.18540 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f141e4ce740 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568b9c1fcb0 0x5568b9c22170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f141e4ce740 4 client.18540 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.902+0000 7f141e4ce740 1 -- 172.21.15.152:0/2605136038 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568b9b77b90 con 0x5568b9c1fcb0 2024-09-11T22:16:51.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.903+0000 7f1419e91640 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568b9c1fcb0 0x5568b9c22170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.903+0000 7f1419e91640 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568b9c1fcb0 0x5568b9c22170 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93a4916e63fff86e server_cookie=f3bc3b9a46ed164f in_seq=0 out_seq=0 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.903+0000 7f13fd7fa640 10 client.18540 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f13fd7fa640 1 -- 172.21.15.152:0/2605136038 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f14100cbe80 con 0x5568b9c1fcb0 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f13fd7fa640 10 client.18540 handle_command_reply: tid=0 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 1 client.18540 shutdown 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 1 -- 172.21.15.152:0/2605136038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 msgr2=0x5568b9c0db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c0db60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f140c011ab0 tx=0x7f140c004ab0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 1 -- 172.21.15.152:0/2605136038 shutdown_connections 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568b9c1fcb0 0x5568b9c22170 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c0db60 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c05980 0x5568b9c0d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 1 --2- 172.21.15.152:0/2605136038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05060 0x5568b9c0d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f13fd7fa640 0 client.18540 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:51.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 1 -- 172.21.15.152:0/2605136038 >> 172.21.15.152:0/2605136038 conn(0x5568b9c015f0 msgr2=0x5568b9c07320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:51.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 1 -- 172.21.15.152:0/2605136038 shutdown_connections 2024-09-11T22:16:51.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 1 -- 172.21.15.152:0/2605136038 wait complete. 2024-09-11T22:16:51.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.904+0000 7f141e4ce740 20 client.18540 trim_cache size 0 max 16384 2024-09-11T22:16:51.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.921+0000 7f141e4ce740 1 Processor -- start 2024-09-11T22:16:51.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.921+0000 7f141e4ce740 1 -- start start 2024-09-11T22:16:51.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.921+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c05060 0x5568b9c07b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.921+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05980 0x5568b9c00640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.921+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c27a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.921+0000 7f141e4ce740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f14141ae0a0 con 0x5568b9c10240 2024-09-11T22:16:51.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.921+0000 7f141e4ce740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14141ab970 con 0x5568b9c05980 2024-09-11T22:16:51.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.921+0000 7f141e4ce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14141a9800 con 0x5568b9c05060 2024-09-11T22:16:51.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.921+0000 7f141a692640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c27a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.921+0000 7f141a692640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c27a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51794/0 (socket says 172.21.15.152:51794) 2024-09-11T22:16:51.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.921+0000 7f141a692640 1 -- 172.21.15.152:0/2110137678 learned_addr learned my addr 172.21.15.152:0/2110137678 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f1419690640 1 --2- 172.21.15.152:0/2110137678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05980 0x5568b9c00640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f1419e91640 1 --2- 172.21.15.152:0/2110137678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c05060 0x5568b9c07b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f141a692640 1 -- 172.21.15.152:0/2110137678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c05060 msgr2=0x5568b9c07b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f141a692640 1 --2- 172.21.15.152:0/2110137678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c05060 0x5568b9c07b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f141a692640 1 -- 172.21.15.152:0/2110137678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05980 msgr2=0x5568b9c00640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f141a692640 1 --2- 172.21.15.152:0/2110137678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05980 0x5568b9c00640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f141a692640 1 -- 172.21.15.152:0/2110137678 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b9c227f0 con 0x5568b9c10240 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f1419690640 1 --2- 172.21.15.152:0/2110137678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05980 0x5568b9c00640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f141a692640 1 --2- 172.21.15.152:0/2110137678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c27a90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f140c01fb10 tx=0x7f140c00abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd88f9f0e18268dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f13ff7fe640 1 -- 172.21.15.152:0/2110137678 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c032070 con 0x5568b9c10240 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f13ff7fe640 1 -- 172.21.15.152:0/2110137678 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140c012e20 con 0x5568b9c10240 2024-09-11T22:16:51.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.922+0000 7f13ff7fe640 1 -- 172.21.15.152:0/2110137678 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c0041c0 con 0x5568b9c10240 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.923+0000 7f141e4ce740 1 -- 172.21.15.152:0/2110137678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 msgr2=0x5568b9c27a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.923+0000 7f141e4ce740 1 --2- 172.21.15.152:0/2110137678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c27a90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f140c01fb10 tx=0x7f140c00abe0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.923+0000 7f141e4ce740 1 -- 172.21.15.152:0/2110137678 shutdown_connections 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.923+0000 7f141e4ce740 1 --2- 172.21.15.152:0/2110137678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c10240 0x5568b9c27a90 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.923+0000 7f141e4ce740 1 --2- 172.21.15.152:0/2110137678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05980 0x5568b9c00640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.923+0000 7f141e4ce740 1 --2- 172.21.15.152:0/2110137678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c05060 0x5568b9c07b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.923+0000 7f141e4ce740 1 -- 172.21.15.152:0/2110137678 >> 172.21.15.152:0/2110137678 conn(0x5568b9c015f0 msgr2=0x5568b9bfff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.923+0000 7f141e4ce740 1 -- 172.21.15.152:0/2110137678 shutdown_connections 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.923+0000 7f141e4ce740 1 -- 172.21.15.152:0/2110137678 wait complete. 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.923+0000 7f141e4ce740 1 -- start start 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.923+0000 7f141e4ce740 1 Processor -- start 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05060 0x5568b9c143b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05980 0x5568b9c148f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f141e4ce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c10240 0x5568b9c89a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f141e4ce740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f14141a9e50 con 0x5568b9c05060 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f141e4ce740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14141ab2a0 con 0x5568b9c05980 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f141e4ce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14141aa500 con 0x5568b9c10240 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f141e4ce740 10 client.0 _ll_register_callbacks cb 0x7f140c0117b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f1419e91640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05060 0x5568b9c143b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f1419e91640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05060 0x5568b9c143b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51798/0 (socket says 172.21.15.152:51798) 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f1419e91640 1 -- 172.21.15.152:0/3884042371 learned_addr learned my addr 172.21.15.152:0/3884042371 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f1419690640 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05980 0x5568b9c148f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f141a692640 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c10240 0x5568b9c89a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f1419e91640 1 -- 172.21.15.152:0/3884042371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c10240 msgr2=0x5568b9c89a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:51.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f1419e91640 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c10240 0x5568b9c89a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f1419e91640 1 -- 172.21.15.152:0/3884042371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05980 msgr2=0x5568b9c148f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f1419e91640 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05980 0x5568b9c148f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f1419e91640 1 -- 172.21.15.152:0/3884042371 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568b9c89fa0 con 0x5568b9c05060 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f1419e91640 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05060 0x5568b9c143b0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f14100bc250 tx=0x7f14100bc150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6c9cf155b5b49d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f13fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f13fd7fa640 1 -- 172.21.15.152:0/3884042371 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410049040 con 0x5568b9c05060 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f13fd7fa640 1 -- 172.21.15.152:0/3884042371 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f141003b5f0 con 0x5568b9c05060 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.924+0000 7f141e4ce740 1 -- 172.21.15.152:0/3884042371 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f140c012e20 con 0x5568b9c05060 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f13fd7fa640 1 -- 172.21.15.152:0/3884042371 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f14100bc9c0 con 0x5568b9c05060 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f141e4ce740 10 client.18546 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f141e4ce740 1 -- 172.21.15.152:0/3884042371 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5568b9c8b170 con 0x5568b9c05060 2024-09-11T22:16:51.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f13fd7fa640 1 -- 172.21.15.152:0/3884042371 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f141009d020 con 0x5568b9c05060 2024-09-11T22:16:51.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f13fd7fa640 1 -- 172.21.15.152:0/3884042371 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f14100a4d30 con 0x5568b9c05060 2024-09-11T22:16:51.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f141e4ce740 10 client.18546 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:51.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f141e4ce740 10 client.18546 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:16:51.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f141e4ce740 20 client.18546 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:51.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f141e4ce740 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568b9c8b840 0x5568b9c8dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:51.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f141e4ce740 4 client.18546 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "255c99d", "release": true, "await": true}] 2024-09-11T22:16:51.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f141e4ce740 1 -- 172.21.15.152:0/3884042371 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "255c99d", "release": true, "await": true}) -- 0x5568b9bfc950 con 0x5568b9c8b840 2024-09-11T22:16:51.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.925+0000 7f1419690640 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568b9c8b840 0x5568b9c8dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:51.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.926+0000 7f13fd7fa640 10 client.18546 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:51.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.926+0000 7f1419690640 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568b9c8b840 0x5568b9c8dc60 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32888e137c2dc345 server_cookie=6a28f795a68ac6da in_seq=0 out_seq=0 2024-09-11T22:16:51.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.986+0000 7f13fd7fa640 1 -- 172.21.15.152:0/3884042371 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5568b9bfc950 con 0x5568b9c8b840 2024-09-11T22:16:51.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.986+0000 7f13fd7fa640 10 client.18546 handle_command_reply: tid=0 2024-09-11T22:16:51.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.986+0000 7f141e4ce740 1 client.18546 shutdown 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.986+0000 7f141e4ce740 1 -- 172.21.15.152:0/3884042371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05060 msgr2=0x5568b9c143b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.987+0000 7f141e4ce740 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05060 0x5568b9c143b0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f14100bc250 tx=0x7f14100bc150 comp rx=0 tx=0).stop 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.987+0000 7f141e4ce740 1 -- 172.21.15.152:0/3884042371 shutdown_connections 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.987+0000 7f141e4ce740 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5568b9c8b840 0x5568b9c8dc60 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.987+0000 7f13fd7fa640 0 client.18546 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.987+0000 7f141e4ce740 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5568b9c10240 0x5568b9c89a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.987+0000 7f141e4ce740 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568b9c05980 0x5568b9c148f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.987+0000 7f141e4ce740 1 --2- 172.21.15.152:0/3884042371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5568b9c05060 0x5568b9c143b0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.987+0000 7f141e4ce740 1 -- 172.21.15.152:0/3884042371 >> 172.21.15.152:0/3884042371 conn(0x5568b9c015f0 msgr2=0x5568b9c0d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.987+0000 7f141e4ce740 1 -- 172.21.15.152:0/3884042371 shutdown_connections 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.987+0000 7f141e4ce740 1 -- 172.21.15.152:0/3884042371 wait complete. 2024-09-11T22:16:51.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.987+0000 7f141e4ce740 20 client.18546 trim_cache size 0 max 16384 2024-09-11T22:16:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:16:51.990 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:16:51.990 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:16:51.990 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 48, 2024-09-11T22:16:51.990 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:16:51.990 INFO:teuthology.orchestra.run.smithi152.stdout: "255c99d": { 2024-09-11T22:16:51.990 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 48, 2024-09-11T22:16:51.990 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:16:51.990 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 147.2, 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:51.991 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:51.992 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:51.992 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:16:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:16:51.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.988+0000 7f141c0f5640 1 -- 172.21.15.152:0/1309713446 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14000a2d70 msgr2=0x7f14000a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:51.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.988+0000 7f141c0f5640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14000a2d70 0x7f14000a5230 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f140c00a780 tx=0x7f140c013ae0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.988+0000 7f141c0f5640 1 -- 172.21.15.152:0/1309713446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1414100e20 msgr2=0x7f141419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:51.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.988+0000 7f141c0f5640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1414100e20 0x7f141419a700 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f1410006010 tx=0x7f1410003c80 comp rx=0 tx=0).stop 2024-09-11T22:16:51.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.989+0000 7f141c0f5640 1 -- 172.21.15.152:0/1309713446 shutdown_connections 2024-09-11T22:16:51.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.989+0000 7f141c0f5640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f14000a2d70 0x7f14000a5230 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.989+0000 7f141c0f5640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1414102ef0 0x7f141419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.989+0000 7f141c0f5640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1414102570 0x7f141419ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.989+0000 7f141c0f5640 1 --2- 172.21.15.152:0/1309713446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1414100e20 0x7f141419a700 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:51.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.989+0000 7f141c0f5640 1 -- 172.21.15.152:0/1309713446 >> 172.21.15.152:0/1309713446 conn(0x7f14140fc7d0 msgr2=0x7f141406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:51.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.989+0000 7f141c0f5640 1 -- 172.21.15.152:0/1309713446 shutdown_connections 2024-09-11T22:16:51.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:51.989+0000 7f141c0f5640 1 -- 172.21.15.152:0/1309713446 wait complete. 2024-09-11T22:16:52.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:51 smithi179 ceph-mon[35603]: pgmap v392: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-09-11T22:16:52.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:51 smithi193 ceph-mon[35545]: pgmap v392: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-09-11T22:16:52.881 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '255c99d', total seconds elapsed: 30.6 2024-09-11T22:16:53.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:53 smithi152 ceph-mon[31188]: pgmap v393: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 65 KiB/s wr, 13 op/s 2024-09-11T22:16:54.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:53 smithi179 ceph-mon[35603]: pgmap v393: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 65 KiB/s wr, 13 op/s 2024-09-11T22:16:54.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:53 smithi193 ceph-mon[35545]: pgmap v393: 97 pgs: 97 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 65 KiB/s wr, 13 op/s 2024-09-11T22:16:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 680.0 s, 1519.5 tps, lat 370.144 ms stddev 2892.893 2024-09-11T22:16:54.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:16:55.296 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:55.951 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:55 smithi152 ceph-mon[31188]: pgmap v394: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.6 MiB/s wr, 113 op/s 2024-09-11T22:16:55.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.951+0000 7f435c296640 1 -- 172.21.15.152:0/524693264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4354108160 msgr2=0x7f435410eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:55.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.951+0000 7f435c296640 1 --2- 172.21.15.152:0/524693264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4354108160 0x7f435410eb00 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f434c009cd0 tx=0x7f434c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.951+0000 7f435c296640 1 -- 172.21.15.152:0/524693264 shutdown_connections 2024-09-11T22:16:55.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.951+0000 7f435c296640 1 --2- 172.21.15.152:0/524693264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4354108160 0x7f435410eb00 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.951+0000 7f435c296640 1 --2- 172.21.15.152:0/524693264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4354101290 0x7f4354107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.951+0000 7f435c296640 1 --2- 172.21.15.152:0/524693264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43541008e0 0x7f4354100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.951+0000 7f435c296640 1 -- 172.21.15.152:0/524693264 >> 172.21.15.152:0/524693264 conn(0x7f4354077210 msgr2=0x7f4354077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:55.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.951+0000 7f435c296640 1 -- 172.21.15.152:0/524693264 shutdown_connections 2024-09-11T22:16:55.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.951+0000 7f435c296640 1 -- 172.21.15.152:0/524693264 wait complete. 2024-09-11T22:16:55.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f435c296640 1 Processor -- start 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f435c296640 1 -- start start 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f435c296640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43541008e0 0x7f4354196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f435c296640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4354101290 0x7f43541967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f435c296640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354108160 0x7f435419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f435c296640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f435410fe30 con 0x7f4354101290 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f435c296640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f435410fcb0 con 0x7f4354108160 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f435c296640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f435410ffb0 con 0x7f43541008e0 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f4359831640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4354101290 0x7f43541967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f4359831640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4354101290 0x7f43541967b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38496/0 (socket says 172.21.15.152:38496) 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f4359831640 1 -- 172.21.15.152:0/2763968196 learned_addr learned my addr 172.21.15.152:0/2763968196 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f435a833640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354108160 0x7f435419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.952+0000 7f435a032640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43541008e0 0x7f4354196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f435a833640 1 -- 172.21.15.152:0/2763968196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43541008e0 msgr2=0x7f4354196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:55.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f435a833640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43541008e0 0x7f4354196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f435a833640 1 -- 172.21.15.152:0/2763968196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4354101290 msgr2=0x7f43541967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:55.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f435a833640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4354101290 0x7f43541967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f435a833640 1 -- 172.21.15.152:0/2763968196 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435419b220 con 0x7f4354108160 2024-09-11T22:16:55.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f435a032640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43541008e0 0x7f4354196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:55.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f435a833640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354108160 0x7f435419ab40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f434c009ca0 tx=0x7f434c031e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:55.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f434b7fe640 1 -- 172.21.15.152:0/2763968196 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c004040 con 0x7f4354108160 2024-09-11T22:16:55.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f435c296640 1 -- 172.21.15.152:0/2763968196 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435419b4b0 con 0x7f4354108160 2024-09-11T22:16:55.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f435c296640 1 -- 172.21.15.152:0/2763968196 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43541a2df0 con 0x7f4354108160 2024-09-11T22:16:55.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f434b7fe640 1 -- 172.21.15.152:0/2763968196 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f434c0046c0 con 0x7f4354108160 2024-09-11T22:16:55.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.953+0000 7f434b7fe640 1 -- 172.21.15.152:0/2763968196 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c030c70 con 0x7f4354108160 2024-09-11T22:16:55.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.956+0000 7f435e66f740 1 Processor -- start 2024-09-11T22:16:55.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.957+0000 7f434b7fe640 1 -- 172.21.15.152:0/2763968196 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f434c046480 con 0x7f4354108160 2024-09-11T22:16:55.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.957+0000 7f435e66f740 1 -- start start 2024-09-11T22:16:55.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435e66f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f162880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435e66f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f162dc0 0x55a81f16d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435e66f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f16d680 0x55a81f16fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435e66f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a81f0c82e0 con 0x55a81f1624a0 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435e66f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a81f06fce0 con 0x55a81f162dc0 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435e66f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a81f0c42a0 con 0x55a81f16d680 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f4359831640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f162880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f4359831640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f162880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38502/0 (socket says 172.21.15.152:38502) 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f4359831640 1 -- 172.21.15.152:0/1100836376 learned_addr learned my addr 172.21.15.152:0/1100836376 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435a032640 1 --2- 172.21.15.152:0/1100836376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f162dc0 0x55a81f16d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f4359831640 1 --2- 172.21.15.152:0/1100836376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f16d680 0x55a81f16fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f434b7fe640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f43400a7100 0x7f43400a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435a032640 1 -- 172.21.15.152:0/1100836376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f16d680 msgr2=0x55a81f16fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:55.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435a032640 1 --2- 172.21.15.152:0/1100836376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f16d680 0x55a81f16fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435a032640 1 -- 172.21.15.152:0/1100836376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 msgr2=0x55a81f162880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:55.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435a032640 1 --2- 172.21.15.152:0/1100836376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f162880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435a032640 1 -- 172.21.15.152:0/1100836376 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a81f054440 con 0x55a81f162dc0 2024-09-11T22:16:55.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f435a833640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f43400a7100 0x7f43400a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.958+0000 7f434b7fe640 1 -- 172.21.15.152:0/2763968196 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f434c0f06c0 con 0x7f4354108160 2024-09-11T22:16:55.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.959+0000 7f435a032640 1 --2- 172.21.15.152:0/1100836376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f162dc0 0x55a81f16d140 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4350009fd0 tx=0x7f43500118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7d17d8b360d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:55.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.959+0000 7f4348dea640 1 -- 172.21.15.152:0/1100836376 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350004030 con 0x55a81f162dc0 2024-09-11T22:16:55.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.959+0000 7f4348dea640 1 -- 172.21.15.152:0/1100836376 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4350005500 con 0x55a81f162dc0 2024-09-11T22:16:55.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.959+0000 7f435a833640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f43400a7100 0x7f43400a95c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f434c0edf70 tx=0x7f434c041000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:55.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f4348dea640 1 -- 172.21.15.152:0/1100836376 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350004da0 con 0x55a81f162dc0 2024-09-11T22:16:55.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f435e66f740 1 -- 172.21.15.152:0/1100836376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f162dc0 msgr2=0x55a81f16d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:55.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f435e66f740 1 --2- 172.21.15.152:0/1100836376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f162dc0 0x55a81f16d140 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4350009fd0 tx=0x7f43500118d0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f435e66f740 1 -- 172.21.15.152:0/1100836376 shutdown_connections 2024-09-11T22:16:55.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f435e66f740 1 --2- 172.21.15.152:0/1100836376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f16d680 0x55a81f16fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f435e66f740 1 --2- 172.21.15.152:0/1100836376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f162dc0 0x55a81f16d140 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f435e66f740 1 --2- 172.21.15.152:0/1100836376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f162880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f435e66f740 1 -- 172.21.15.152:0/1100836376 >> 172.21.15.152:0/1100836376 conn(0x55a81f15ea30 msgr2=0x55a81f15ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:55.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f435e66f740 1 -- 172.21.15.152:0/1100836376 shutdown_connections 2024-09-11T22:16:55.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f435e66f740 1 -- 172.21.15.152:0/1100836376 wait complete. 2024-09-11T22:16:55.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f435e66f740 1 -- start start 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.960+0000 7f435e66f740 1 Processor -- start 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435e66f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f16ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435e66f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f16a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f4359831640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f16ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f4359831640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f16ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38508/0 (socket says 172.21.15.152:38508) 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435e66f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f16d680 0x55a81f16a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f4359831640 1 -- 172.21.15.152:0/2761754748 learned_addr learned my addr 172.21.15.152:0/2761754748 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435e66f740 1 -- 172.21.15.152:0/2761754748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a81f1702f0 con 0x55a81f1624a0 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435e66f740 1 -- 172.21.15.152:0/2761754748 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a81f083050 con 0x55a81f16d680 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435e66f740 1 -- 172.21.15.152:0/2761754748 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a81f170470 con 0x55a81f162dc0 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435a032640 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f16a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435e66f740 10 client.0 _ll_register_callbacks cb 0x55a81f0c3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:55.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f4359831640 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f16d680 0x55a81f16a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435a032640 1 -- 172.21.15.152:0/2761754748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f16d680 msgr2=0x55a81f16a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435a032640 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f16d680 0x55a81f16a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435a032640 1 -- 172.21.15.152:0/2761754748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 msgr2=0x55a81f16ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435a032640 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f16ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f435a032640 1 -- 172.21.15.152:0/2761754748 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a81ee393c0 con 0x55a81f162dc0 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.961+0000 7f4359831640 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f16d680 0x55a81f16a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f435a032640 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f16a120 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4350011dd0 tx=0x7f4350005160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f87ef824cdbb747 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f433dffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f433dffb640 1 -- 172.21.15.152:0/2761754748 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350029020 con 0x55a81f162dc0 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f433dffb640 1 -- 172.21.15.152:0/2761754748 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f435000f5a0 con 0x55a81f162dc0 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f435e66f740 1 -- 172.21.15.152:0/2761754748 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4350005500 con 0x55a81f162dc0 2024-09-11T22:16:55.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f433dffb640 1 -- 172.21.15.152:0/2761754748 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4350034050 con 0x55a81f162dc0 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f435e66f740 10 client.27958 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f435e66f740 1 -- 172.21.15.152:0/2761754748 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a81f17bbc0 con 0x55a81f162dc0 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f433dffb640 1 -- 172.21.15.152:0/2761754748 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4350005500 con 0x55a81f162dc0 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f433dffb640 1 -- 172.21.15.152:0/2761754748 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f4350025600 con 0x55a81f162dc0 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f435e66f740 10 client.27958 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f435e66f740 10 client.27958 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f435e66f740 20 client.27958 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f435e66f740 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a81f17d020 0x55a81f17f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f435e66f740 4 client.27958 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.962+0000 7f435e66f740 1 -- 172.21.15.152:0/2761754748 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a81f0d5850 con 0x55a81f17d020 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.964+0000 7f4359831640 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a81f17d020 0x55a81f17f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.964+0000 7f433dffb640 10 client.27958 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:55.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.964+0000 7f4359831640 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a81f17d020 0x55a81f17f410 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bd5d61dd862930f server_cookie=2e726298f5857e2b in_seq=0 out_seq=0 2024-09-11T22:16:55.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f433dffb640 1 -- 172.21.15.152:0/2761754748 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a81f0d5850 con 0x55a81f17d020 2024-09-11T22:16:55.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f433dffb640 10 client.27958 handle_command_reply: tid=0 2024-09-11T22:16:55.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 1 client.27958 shutdown 2024-09-11T22:16:55.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 1 -- 172.21.15.152:0/2761754748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 msgr2=0x55a81f16a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:55.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f16a120 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4350011dd0 tx=0x7f4350005160 comp rx=0 tx=0).stop 2024-09-11T22:16:55.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 1 -- 172.21.15.152:0/2761754748 shutdown_connections 2024-09-11T22:16:55.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a81f17d020 0x55a81f17f410 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f16d680 0x55a81f16a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f16a120 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f433dffb640 0 client.27958 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:55.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 1 --2- 172.21.15.152:0/2761754748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f16ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 1 -- 172.21.15.152:0/2761754748 >> 172.21.15.152:0/2761754748 conn(0x55a81f15ea30 msgr2=0x55a81f15db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:55.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 1 -- 172.21.15.152:0/2761754748 shutdown_connections 2024-09-11T22:16:55.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 1 -- 172.21.15.152:0/2761754748 wait complete. 2024-09-11T22:16:55.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.965+0000 7f435e66f740 20 client.27958 trim_cache size 0 max 16384 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f435e66f740 1 Processor -- start 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f435e66f740 1 -- start start 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f435e66f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f165900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f435e66f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f1689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f435e66f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f16d680 0x55a81f16c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f435e66f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f43541ae0b0 con 0x55a81f1624a0 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f435e66f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f43541ab980 con 0x55a81f16d680 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f435e66f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f43541a97f0 con 0x55a81f162dc0 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f4359831640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f165900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f4359831640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f165900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38516/0 (socket says 172.21.15.152:38516) 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f4359831640 1 -- 172.21.15.152:0/3597018264 learned_addr learned my addr 172.21.15.152:0/3597018264 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:55.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f435a032640 1 --2- 172.21.15.152:0/3597018264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f1689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.987+0000 7f4359831640 1 --2- 172.21.15.152:0/3597018264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f16d680 0x55a81f16c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.988+0000 7f435a032640 1 -- 172.21.15.152:0/3597018264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f16d680 msgr2=0x55a81f16c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:55.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.988+0000 7f435a032640 1 --2- 172.21.15.152:0/3597018264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f16d680 0x55a81f16c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.988+0000 7f435a032640 1 -- 172.21.15.152:0/3597018264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 msgr2=0x55a81f165900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:55.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.988+0000 7f435a032640 1 --2- 172.21.15.152:0/3597018264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f165900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.988+0000 7f435a032640 1 -- 172.21.15.152:0/3597018264 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a81f1690d0 con 0x55a81f162dc0 2024-09-11T22:16:55.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.988+0000 7f435a032640 1 --2- 172.21.15.152:0/3597018264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f1689f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4350025bc0 tx=0x7f4350005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eda661b6561c6829 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:55.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.988+0000 7f433ffff640 1 -- 172.21.15.152:0/3597018264 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350029040 con 0x55a81f162dc0 2024-09-11T22:16:55.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.988+0000 7f433ffff640 1 -- 172.21.15.152:0/3597018264 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43500051d0 con 0x55a81f162dc0 2024-09-11T22:16:55.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.988+0000 7f433ffff640 1 -- 172.21.15.152:0/3597018264 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435000f890 con 0x55a81f162dc0 2024-09-11T22:16:55.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.989+0000 7f435e66f740 1 -- 172.21.15.152:0/3597018264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 msgr2=0x55a81f1689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:55.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.989+0000 7f435e66f740 1 --2- 172.21.15.152:0/3597018264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f1689f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4350025bc0 tx=0x7f4350005970 comp rx=0 tx=0).stop 2024-09-11T22:16:55.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.989+0000 7f435e66f740 1 -- 172.21.15.152:0/3597018264 shutdown_connections 2024-09-11T22:16:55.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.989+0000 7f435e66f740 1 --2- 172.21.15.152:0/3597018264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f16d680 0x55a81f16c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.989+0000 7f435e66f740 1 --2- 172.21.15.152:0/3597018264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f1689f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.989+0000 7f435e66f740 1 --2- 172.21.15.152:0/3597018264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f1624a0 0x55a81f165900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.989+0000 7f435e66f740 1 -- 172.21.15.152:0/3597018264 >> 172.21.15.152:0/3597018264 conn(0x55a81f15ea30 msgr2=0x55a81f16b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.989+0000 7f435e66f740 1 -- 172.21.15.152:0/3597018264 shutdown_connections 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.989+0000 7f435e66f740 1 -- 172.21.15.152:0/3597018264 wait complete. 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f435e66f740 1 -- start start 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f435e66f740 1 Processor -- start 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f435e66f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f1624a0 0x55a81f175b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f435e66f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f1645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f435e66f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f16d680 0x55a81f164b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f435e66f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f43541a9e40 con 0x55a81f16d680 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f435e66f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f43541ab2b0 con 0x55a81f1624a0 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f435e66f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f43541aa510 con 0x55a81f162dc0 2024-09-11T22:16:55.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f4359831640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f1624a0 0x55a81f175b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f435a032640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f1645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f4359831640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f1624a0 0x55a81f175b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:44446/0 (socket says 172.21.15.152:44446) 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f4359831640 1 -- 172.21.15.152:0/1509737106 learned_addr learned my addr 172.21.15.152:0/1509737106 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f4359831640 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f16d680 0x55a81f164b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.990+0000 7f435e66f740 10 client.0 _ll_register_callbacks cb 0x7f4344009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f4359831640 1 -- 172.21.15.152:0/1509737106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 msgr2=0x55a81f1645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f4359831640 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f1645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f4359831640 1 -- 172.21.15.152:0/1509737106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f16d680 msgr2=0x55a81f164b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f4359831640 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f16d680 0x55a81f164b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f4359831640 1 -- 172.21.15.152:0/1509737106 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a81f165060 con 0x55a81f1624a0 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f4359831640 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f1624a0 0x55a81f175b70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55a81f17faa0 tx=0x7f4344009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a851493a401c6c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:55.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f433dffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f433dffb640 1 -- 172.21.15.152:0/1509737106 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344003e10 con 0x55a81f1624a0 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f435e66f740 1 -- 172.21.15.152:0/1509737106 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43500051d0 con 0x55a81f1624a0 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f433dffb640 1 -- 172.21.15.152:0/1509737106 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f4344026040 con 0x55a81f1624a0 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f433dffb640 1 -- 172.21.15.152:0/1509737106 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4344005020 con 0x55a81f1624a0 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f435e66f740 10 client.27812 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f435e66f740 1 -- 172.21.15.152:0/1509737106 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a81f1753b0 con 0x55a81f1624a0 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.991+0000 7f433dffb640 1 -- 172.21.15.152:0/1509737106 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43500051d0 con 0x55a81f1624a0 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.992+0000 7f433dffb640 1 -- 172.21.15.152:0/1509737106 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f4344004cc0 con 0x55a81f1624a0 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.992+0000 7f435e66f740 10 client.27812 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.992+0000 7f435e66f740 10 client.27812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.992+0000 7f435e66f740 20 client.27812 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.992+0000 7f435e66f740 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a81f1e7e90 0x55a81f1ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:55.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.992+0000 7f435e66f740 4 client.27812 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:16:55.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.992+0000 7f435e66f740 1 -- 172.21.15.152:0/1509737106 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a81f0cfd60 con 0x55a81f1e7e90 2024-09-11T22:16:55.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.992+0000 7f435a032640 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a81f1e7e90 0x55a81f1ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:55.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.993+0000 7f435a032640 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a81f1e7e90 0x55a81f1ea2d0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db059c64aeaa5559 server_cookie=facaf6eedb0b8179 in_seq=0 out_seq=0 2024-09-11T22:16:55.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.993+0000 7f433dffb640 10 client.27812 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:55.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.993+0000 7f433dffb640 1 -- 172.21.15.152:0/1509737106 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a81f0cfd60 con 0x55a81f1e7e90 2024-09-11T22:16:55.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.993+0000 7f433dffb640 10 client.27812 handle_command_reply: tid=0 2024-09-11T22:16:55.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.993+0000 7f435e66f740 1 client.27812 shutdown 2024-09-11T22:16:55.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.994+0000 7f435e66f740 1 -- 172.21.15.152:0/1509737106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f1624a0 msgr2=0x55a81f175b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:55.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.994+0000 7f435e66f740 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f1624a0 0x55a81f175b70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55a81f17faa0 tx=0x7f4344009bd0 comp rx=0 tx=0).stop 2024-09-11T22:16:55.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.994+0000 7f435e66f740 1 -- 172.21.15.152:0/1509737106 shutdown_connections 2024-09-11T22:16:56.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.994+0000 7f435e66f740 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a81f1e7e90 0x55a81f1ea2d0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.994+0000 7f435e66f740 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a81f16d680 0x55a81f164b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.994+0000 7f435e66f740 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a81f162dc0 0x55a81f1645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.994+0000 7f435e66f740 1 --2- 172.21.15.152:0/1509737106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a81f1624a0 0x55a81f175b70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.994+0000 7f435e66f740 1 -- 172.21.15.152:0/1509737106 >> 172.21.15.152:0/1509737106 conn(0x55a81f15ea30 msgr2=0x55a81f16c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:56.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.994+0000 7f433dffb640 0 client.27812 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:56.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.994+0000 7f435e66f740 1 -- 172.21.15.152:0/1509737106 shutdown_connections 2024-09-11T22:16:56.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.994+0000 7f435e66f740 1 -- 172.21.15.152:0/1509737106 wait complete. 2024-09-11T22:16:56.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435e66f740 20 client.27812 trim_cache size 0 max 16384 2024-09-11T22:16:56.001 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:16:56.001 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:16:56.001 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:16:56.001 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:16:56.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 -- 172.21.15.152:0/2763968196 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f43400a7100 msgr2=0x7f43400a95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:56.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f43400a7100 0x7f43400a95c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f434c0edf70 tx=0x7f434c041000 comp rx=0 tx=0).stop 2024-09-11T22:16:56.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 -- 172.21.15.152:0/2763968196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354108160 msgr2=0x7f435419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:56.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354108160 0x7f435419ab40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f434c009ca0 tx=0x7f434c031e60 comp rx=0 tx=0).stop 2024-09-11T22:16:56.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 -- 172.21.15.152:0/2763968196 shutdown_connections 2024-09-11T22:16:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f43400a7100 0x7f43400a95c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354108160 0x7f435419ab40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4354101290 0x7f43541967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 --2- 172.21.15.152:0/2763968196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43541008e0 0x7f4354196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 -- 172.21.15.152:0/2763968196 >> 172.21.15.152:0/2763968196 conn(0x7f4354077210 msgr2=0x7f43540ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 -- 172.21.15.152:0/2763968196 shutdown_connections 2024-09-11T22:16:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:55.995+0000 7f435c296640 1 -- 172.21.15.152:0/2763968196 wait complete. 2024-09-11T22:16:56.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:55 smithi179 ceph-mon[35603]: pgmap v394: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.6 MiB/s wr, 113 op/s 2024-09-11T22:16:56.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:55 smithi193 ceph-mon[35545]: pgmap v394: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.6 MiB/s wr, 113 op/s 2024-09-11T22:16:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.388+0000 7fe15044c640 1 -- 172.21.15.152:0/438976571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe148109b10 msgr2=0x7fe148114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.388+0000 7fe15044c640 1 --2- 172.21.15.152:0/438976571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe148109b10 0x7fe148114570 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe138009860 tx=0x7fe13802a340 comp rx=0 tx=0).stop 2024-09-11T22:16:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.388+0000 7fe15044c640 1 -- 172.21.15.152:0/438976571 shutdown_connections 2024-09-11T22:16:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.388+0000 7fe15044c640 1 --2- 172.21.15.152:0/438976571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe148114ab0 0x7fe148116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.388+0000 7fe15044c640 1 --2- 172.21.15.152:0/438976571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe148109b10 0x7fe148114570 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.388+0000 7fe15044c640 1 --2- 172.21.15.152:0/438976571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1481091f0 0x7fe1481095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.388+0000 7fe15044c640 1 -- 172.21.15.152:0/438976571 >> 172.21.15.152:0/438976571 conn(0x7fe14806ce00 msgr2=0x7fe14806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.388+0000 7fe15044c640 1 -- 172.21.15.152:0/438976571 shutdown_connections 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.388+0000 7fe15044c640 1 -- 172.21.15.152:0/438976571 wait complete. 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.388+0000 7fe15044c640 1 Processor -- start 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe15044c640 1 -- start start 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe15044c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1481091f0 0x7fe1481a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe15044c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe148109b10 0x7fe1481a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe15044c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe148114ab0 0x7fe1481a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe15044c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe14811a6b0 con 0x7fe148114ab0 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe15044c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe14811a530 con 0x7fe148109b10 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe15044c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe14811a830 con 0x7fe1481091f0 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14e9e9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe148114ab0 0x7fe1481a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14e9e9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe148114ab0 0x7fe1481a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38528/0 (socket says 172.21.15.152:38528) 2024-09-11T22:16:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14e9e9640 1 -- 172.21.15.152:0/3839811078 learned_addr learned my addr 172.21.15.152:0/3839811078 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe148109b10 0x7fe1481a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1481091f0 0x7fe1481a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14e9e9640 1 -- 172.21.15.152:0/3839811078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1481091f0 msgr2=0x7fe1481a67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14e9e9640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1481091f0 0x7fe1481a67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14e9e9640 1 -- 172.21.15.152:0/3839811078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe148109b10 msgr2=0x7fe1481a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14e9e9640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe148109b10 0x7fe1481a6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14e9e9640 1 -- 172.21.15.152:0/3839811078 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1481a10e0 con 0x7fe148114ab0 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe148109b10 0x7fe1481a6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.389+0000 7fe14e9e9640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe148114ab0 0x7fe1481a0960 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe144009fd0 tx=0x7fe14400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.390+0000 7fe13f7fe640 1 -- 172.21.15.152:0/3839811078 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14400cd80 con 0x7fe148114ab0 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.390+0000 7fe13f7fe640 1 -- 172.21.15.152:0/3839811078 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1440035f0 con 0x7fe148114ab0 2024-09-11T22:16:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.390+0000 7fe15044c640 1 -- 172.21.15.152:0/3839811078 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1481a13d0 con 0x7fe148114ab0 2024-09-11T22:16:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.390+0000 7fe13f7fe640 1 -- 172.21.15.152:0/3839811078 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144010670 con 0x7fe148114ab0 2024-09-11T22:16:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.390+0000 7fe15044c640 1 -- 172.21.15.152:0/3839811078 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1481ad670 con 0x7fe148114ab0 2024-09-11T22:16:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.393+0000 7fe13f7fe640 1 -- 172.21.15.152:0/3839811078 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe1440037a0 con 0x7fe148114ab0 2024-09-11T22:16:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.393+0000 7fe1531e7740 1 Processor -- start 2024-09-11T22:16:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.393+0000 7fe1531e7740 1 -- start start 2024-09-11T22:16:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd06ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd07410 0x55752dd11770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd140a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe1531e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55752dc6b2f0 con 0x55752dd11cb0 2024-09-11T22:16:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe1531e7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55752dc13270 con 0x55752dd07410 2024-09-11T22:16:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe1531e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55752dc672b0 con 0x55752dd06af0 2024-09-11T22:16:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14d9e7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd06ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14e1e8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd07410 0x55752dd11770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14d9e7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd06ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:32922/0 (socket says 172.21.15.152:32922) 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14d9e7640 1 -- 172.21.15.152:0/1355845144 learned_addr learned my addr 172.21.15.152:0/1355845144 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/1355845144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14e1e8640 1 -- 172.21.15.152:0/1355845144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 msgr2=0x55752dd06ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe13f7fe640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1340a2da0 0x7fe1340a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/1355845144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd06ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14e1e8640 1 -- 172.21.15.152:0/1355845144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 msgr2=0x55752dd140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/1355845144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14e1e8640 1 -- 172.21.15.152:0/1355845144 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752dc12340 con 0x55752dd07410 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/1355845144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14e9e9640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1340a2da0 0x7fe1340a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe13f7fe640 1 -- 172.21.15.152:0/3839811078 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7fe1440cf6e0 con 0x7fe148114ab0 2024-09-11T22:16:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.394+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/1355845144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd07410 0x55752dd11770 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe140005fd0 tx=0x7fe1400095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72637e9dfa8f3140 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.395+0000 7fe13cbfe640 1 -- 172.21.15.152:0/1355845144 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14001d070 con 0x55752dd07410 2024-09-11T22:16:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.395+0000 7fe14e9e9640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1340a2da0 0x7fe1340a5260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe1440cce80 tx=0x7fe14406ba00 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.395+0000 7fe13cbfe640 1 -- 172.21.15.152:0/1355845144 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe140003e40 con 0x55752dd07410 2024-09-11T22:16:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.395+0000 7fe13cbfe640 1 -- 172.21.15.152:0/1355845144 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14000dba0 con 0x55752dd07410 2024-09-11T22:16:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.396+0000 7fe1531e7740 1 -- 172.21.15.152:0/1355845144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd07410 msgr2=0x55752dd11770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.396+0000 7fe1531e7740 1 --2- 172.21.15.152:0/1355845144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd07410 0x55752dd11770 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe140005fd0 tx=0x7fe1400095c0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.396+0000 7fe1531e7740 1 -- 172.21.15.152:0/1355845144 shutdown_connections 2024-09-11T22:16:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.396+0000 7fe1531e7740 1 --2- 172.21.15.152:0/1355845144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.396+0000 7fe1531e7740 1 --2- 172.21.15.152:0/1355845144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd07410 0x55752dd11770 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.396+0000 7fe1531e7740 1 --2- 172.21.15.152:0/1355845144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd06ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.396+0000 7fe1531e7740 1 -- 172.21.15.152:0/1355845144 >> 172.21.15.152:0/1355845144 conn(0x55752dd03060 msgr2=0x55752dd03440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.396+0000 7fe1531e7740 1 -- 172.21.15.152:0/1355845144 shutdown_connections 2024-09-11T22:16:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.396+0000 7fe1531e7740 1 -- 172.21.15.152:0/1355845144 wait complete. 2024-09-11T22:16:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.396+0000 7fe1531e7740 1 -- start start 2024-09-11T22:16:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe1531e7740 1 Processor -- start 2024-09-11T22:16:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd06af0 0x55752dd0eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd07410 0x55752dd0f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd0f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe1531e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55752dd14880 con 0x55752dd11cb0 2024-09-11T22:16:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe1531e7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55752dbf4290 con 0x55752dd06af0 2024-09-11T22:16:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe1531e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55752dd14a00 con 0x55752dd07410 2024-09-11T22:16:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe1531e7740 10 client.0 _ll_register_callbacks cb 0x55752dc25140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe14d9e7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd0f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe14d9e7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd0f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38550/0 (socket says 172.21.15.152:38550) 2024-09-11T22:16:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd07410 0x55752dd0f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe14d9e7640 1 -- 172.21.15.152:0/264324963 learned_addr learned my addr 172.21.15.152:0/264324963 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.397+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd06af0 0x55752dd0eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.398+0000 7fe14e1e8640 1 -- 172.21.15.152:0/264324963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd06af0 msgr2=0x55752dd0eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.398+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd06af0 0x55752dd0eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.398+0000 7fe14e1e8640 1 -- 172.21.15.152:0/264324963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 msgr2=0x55752dd0f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.398+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd0f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.398+0000 7fe14e1e8640 1 -- 172.21.15.152:0/264324963 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55752d97e210 con 0x55752dd07410 2024-09-11T22:16:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.398+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd07410 0x55752dd0f070 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe14000d4e0 tx=0x7fe14000dbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=765e7e4211ee06bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.398+0000 7fe131ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.398+0000 7fe131ffb640 1 -- 172.21.15.152:0/264324963 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14001d070 con 0x55752dd07410 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.398+0000 7fe131ffb640 1 -- 172.21.15.152:0/264324963 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7fe140004a40 con 0x55752dd07410 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe1531e7740 1 -- 172.21.15.152:0/264324963 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55752dc78a20 con 0x55752dd07410 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe131ffb640 1 -- 172.21.15.152:0/264324963 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe140004c80 con 0x55752dd07410 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe1531e7740 10 client.27976 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe1531e7740 1 -- 172.21.15.152:0/264324963 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55752da4a620 con 0x55752dd07410 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe131ffb640 1 -- 172.21.15.152:0/264324963 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55752dc78a20 con 0x55752dd07410 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe131ffb640 1 -- 172.21.15.152:0/264324963 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe140023070 con 0x55752dd07410 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe1531e7740 10 client.27976 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe1531e7740 10 client.27976 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe1531e7740 20 client.27976 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe1531e7740 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55752dd263b0 0x55752dd287d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe1531e7740 4 client.27976 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.399+0000 7fe1531e7740 1 -- 172.21.15.152:0/264324963 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55752dc72d70 con 0x55752dd263b0 2024-09-11T22:16:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.400+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55752dd263b0 0x55752dd287d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.400+0000 7fe131ffb640 10 client.27976 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.400+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55752dd263b0 0x55752dd287d0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5566187dee0cec9e server_cookie=ea3f35490e8d8484 in_seq=0 out_seq=0 2024-09-11T22:16:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe131ffb640 1 -- 172.21.15.152:0/264324963 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55752dc72d70 con 0x55752dd263b0 2024-09-11T22:16:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe131ffb640 10 client.27976 handle_command_reply: tid=0 2024-09-11T22:16:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 1 client.27976 shutdown 2024-09-11T22:16:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 1 -- 172.21.15.152:0/264324963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd07410 msgr2=0x55752dd0f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd07410 0x55752dd0f070 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe14000d4e0 tx=0x7fe14000dbd0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 1 -- 172.21.15.152:0/264324963 shutdown_connections 2024-09-11T22:16:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55752dd263b0 0x55752dd287d0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd0f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd07410 0x55752dd0f070 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 1 --2- 172.21.15.152:0/264324963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd06af0 0x55752dd0eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 1 -- 172.21.15.152:0/264324963 >> 172.21.15.152:0/264324963 conn(0x55752dd03060 msgr2=0x55752dd021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe131ffb640 0 client.27976 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 1 -- 172.21.15.152:0/264324963 shutdown_connections 2024-09-11T22:16:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 1 -- 172.21.15.152:0/264324963 wait complete. 2024-09-11T22:16:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.401+0000 7fe1531e7740 20 client.27976 trim_cache size 0 max 16384 2024-09-11T22:16:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.419+0000 7fe1531e7740 1 Processor -- start 2024-09-11T22:16:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.419+0000 7fe1531e7740 1 -- start start 2024-09-11T22:16:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.419+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd0f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.419+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd07410 0x55752dd2e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.419+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd2e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.419+0000 7fe1531e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b6830 con 0x55752dd11cb0 2024-09-11T22:16:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.419+0000 7fe1531e7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b4100 con 0x55752dd07410 2024-09-11T22:16:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.419+0000 7fe1531e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b1f70 con 0x55752dd06af0 2024-09-11T22:16:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.419+0000 7fe14d9e7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd2e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.419+0000 7fe14d9e7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd0f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.420+0000 7fe14d9e7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd0f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:32954/0 (socket says 172.21.15.152:32954) 2024-09-11T22:16:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.420+0000 7fe14d9e7640 1 -- 172.21.15.152:0/2787805950 learned_addr learned my addr 172.21.15.152:0/2787805950 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.420+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/2787805950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd07410 0x55752dd2e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.420+0000 7fe14d9e7640 1 -- 172.21.15.152:0/2787805950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 msgr2=0x55752dd0f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.420+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/2787805950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd0f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.420+0000 7fe14d9e7640 1 -- 172.21.15.152:0/2787805950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd07410 msgr2=0x55752dd2e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.420+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/2787805950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd07410 0x55752dd2e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.420+0000 7fe14d9e7640 1 -- 172.21.15.152:0/2787805950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752dd0d060 con 0x55752dd11cb0 2024-09-11T22:16:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.420+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/2787805950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd2e5e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe138005e00 tx=0x7fe138009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeab4bb6a5481a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.421+0000 7fe133fff640 1 -- 172.21.15.152:0/2787805950 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe138037040 con 0x55752dd11cb0 2024-09-11T22:16:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.421+0000 7fe133fff640 1 -- 172.21.15.152:0/2787805950 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe138032ab0 con 0x55752dd11cb0 2024-09-11T22:16:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.421+0000 7fe133fff640 1 -- 172.21.15.152:0/2787805950 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1380419b0 con 0x55752dd11cb0 2024-09-11T22:16:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.422+0000 7fe1531e7740 1 -- 172.21.15.152:0/2787805950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 msgr2=0x55752dd2e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.422+0000 7fe1531e7740 1 --2- 172.21.15.152:0/2787805950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd2e5e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe138005e00 tx=0x7fe138009590 comp rx=0 tx=0).stop 2024-09-11T22:16:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.422+0000 7fe1531e7740 1 -- 172.21.15.152:0/2787805950 shutdown_connections 2024-09-11T22:16:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.422+0000 7fe1531e7740 1 --2- 172.21.15.152:0/2787805950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd11cb0 0x55752dd2e5e0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.422+0000 7fe1531e7740 1 --2- 172.21.15.152:0/2787805950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd07410 0x55752dd2e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.422+0000 7fe1531e7740 1 --2- 172.21.15.152:0/2787805950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd0f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.422+0000 7fe1531e7740 1 -- 172.21.15.152:0/2787805950 >> 172.21.15.152:0/2787805950 conn(0x55752dd03060 msgr2=0x55752dd10bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.422+0000 7fe1531e7740 1 -- 172.21.15.152:0/2787805950 shutdown_connections 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.422+0000 7fe1531e7740 1 -- 172.21.15.152:0/2787805950 wait complete. 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe1531e7740 1 -- start start 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe1531e7740 1 Processor -- start 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd15420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd07410 0x55752dd15960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe1531e7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd11cb0 0x55752dd89030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe1531e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b25c0 con 0x55752dd07410 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe1531e7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b3a30 con 0x55752dd11cb0 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe1531e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b2c90 con 0x55752dd06af0 2024-09-11T22:16:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe1531e7740 10 client.0 _ll_register_callbacks cb 0x7fe14001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe14e1e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd07410 0x55752dd15960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe14e1e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd07410 0x55752dd15960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38576/0 (socket says 172.21.15.152:38576) 2024-09-11T22:16:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe14e1e8640 1 -- 172.21.15.152:0/1097208386 learned_addr learned my addr 172.21.15.152:0/1097208386 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd11cb0 0x55752dd89030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd15420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe14e1e8640 1 -- 172.21.15.152:0/1097208386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 msgr2=0x55752dd15420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd15420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe14e1e8640 1 -- 172.21.15.152:0/1097208386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd11cb0 msgr2=0x55752dd89030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd11cb0 0x55752dd89030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe14e1e8640 1 -- 172.21.15.152:0/1097208386 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55752dd89670 con 0x55752dd07410 2024-09-11T22:16:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.423+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd11cb0 0x55752dd89030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe14e1e8640 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd07410 0x55752dd15960 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe14000e010 tx=0x7fe140009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad37b945961105f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe131ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe131ffb640 1 -- 172.21.15.152:0/1097208386 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14001d070 con 0x55752dd07410 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe131ffb640 1 -- 172.21.15.152:0/1097208386 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7fe140003c40 con 0x55752dd07410 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe1531e7740 1 -- 172.21.15.152:0/1097208386 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe138032ab0 con 0x55752dd07410 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe131ffb640 1 -- 172.21.15.152:0/1097208386 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe140009640 con 0x55752dd07410 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe1531e7740 10 client.18582 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe1531e7740 1 -- 172.21.15.152:0/1097208386 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55752dd90a30 con 0x55752dd07410 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe131ffb640 1 -- 172.21.15.152:0/1097208386 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe138032ab0 con 0x55752dd07410 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe131ffb640 1 -- 172.21.15.152:0/1097208386 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe140023040 con 0x55752dd07410 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe1531e7740 10 client.18582 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe1531e7740 10 client.18582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:16:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe1531e7740 20 client.18582 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe1531e7740 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55752dd91180 0x55752dd935a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe1531e7740 4 client.18582 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:16:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.424+0000 7fe1531e7740 1 -- 172.21.15.152:0/1097208386 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55752dbef900 con 0x55752dd91180 2024-09-11T22:16:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.425+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55752dd91180 0x55752dd935a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.425+0000 7fe131ffb640 10 client.18582 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.425+0000 7fe14d9e7640 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55752dd91180 0x55752dd935a0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff31d9afc6d1d4c7 server_cookie=c381f8308595e88d in_seq=0 out_seq=0 2024-09-11T22:16:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.433+0000 7fe131ffb640 1 -- 172.21.15.152:0/1097208386 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55752dbef900 con 0x55752dd91180 2024-09-11T22:16:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.433+0000 7fe131ffb640 10 client.18582 handle_command_reply: tid=0 2024-09-11T22:16:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.433+0000 7fe1531e7740 1 client.18582 shutdown 2024-09-11T22:16:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.437+0000 7fe1531e7740 1 -- 172.21.15.152:0/1097208386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd07410 msgr2=0x55752dd15960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.437+0000 7fe1531e7740 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd07410 0x55752dd15960 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe14000e010 tx=0x7fe140009ad0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.443+0000 7fe1531e7740 1 -- 172.21.15.152:0/1097208386 shutdown_connections 2024-09-11T22:16:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.443+0000 7fe1531e7740 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55752dd91180 0x55752dd935a0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.443+0000 7fe1531e7740 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55752dd11cb0 0x55752dd89030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.443+0000 7fe1531e7740 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55752dd07410 0x55752dd15960 secure :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe14000e010 tx=0x7fe140009ad0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.443+0000 7fe1531e7740 1 --2- 172.21.15.152:0/1097208386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55752dd06af0 0x55752dd15420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.443+0000 7fe1531e7740 1 -- 172.21.15.152:0/1097208386 >> 172.21.15.152:0/1097208386 conn(0x55752dd03060 msgr2=0x55752dd019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.444+0000 7fe131ffb640 0 client.18582 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:16:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.459+0000 7fe1531e7740 1 -- 172.21.15.152:0/1097208386 shutdown_connections 2024-09-11T22:16:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.460+0000 7fe1531e7740 1 -- 172.21.15.152:0/1097208386 wait complete. 2024-09-11T22:16:56.464 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.464+0000 7fe1531e7740 20 client.18582 trim_cache size 0 max 16384 2024-09-11T22:16:56.465 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:16:56.465 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:16:56.465 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:16:56.465 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:16:56.467 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.466+0000 7fe15044c640 1 -- 172.21.15.152:0/3839811078 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1340a2da0 msgr2=0x7fe1340a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:56.467 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.466+0000 7fe15044c640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1340a2da0 0x7fe1340a5260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe1440cce80 tx=0x7fe14406ba00 comp rx=0 tx=0).stop 2024-09-11T22:16:56.468 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.466+0000 7fe15044c640 1 -- 172.21.15.152:0/3839811078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe148114ab0 msgr2=0x7fe1481a0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:56.468 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.466+0000 7fe15044c640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe148114ab0 0x7fe1481a0960 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe144009fd0 tx=0x7fe14400edd0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.468 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.467+0000 7fe15044c640 1 -- 172.21.15.152:0/3839811078 shutdown_connections 2024-09-11T22:16:56.468 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.467+0000 7fe15044c640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe1340a2da0 0x7fe1340a5260 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.468 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.467+0000 7fe15044c640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe148114ab0 0x7fe1481a0960 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.467+0000 7fe15044c640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe148109b10 0x7fe1481a6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.467+0000 7fe15044c640 1 --2- 172.21.15.152:0/3839811078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1481091f0 0x7fe1481a67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.467+0000 7fe15044c640 1 -- 172.21.15.152:0/3839811078 >> 172.21.15.152:0/3839811078 conn(0x7fe14806ce00 msgr2=0x7fe148070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.472+0000 7fe15044c640 1 -- 172.21.15.152:0/3839811078 shutdown_connections 2024-09-11T22:16:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:16:56.472+0000 7fe15044c640 1 -- 172.21.15.152:0/3839811078 wait complete. 2024-09-11T22:16:56.783 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:16:56.783 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:16:57.137 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:57.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.720+0000 7fce61023640 1 -- 172.21.15.152:0/2622065677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce5c101460 msgr2=0x7fce5c105930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:57.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.720+0000 7fce61023640 1 --2- 172.21.15.152:0/2622065677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce5c101460 0x7fce5c105930 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fce50009900 tx=0x7fce5002a470 comp rx=0 tx=0).stop 2024-09-11T22:16:57.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.721+0000 7fce61023640 1 -- 172.21.15.152:0/2622065677 shutdown_connections 2024-09-11T22:16:57.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.721+0000 7fce61023640 1 --2- 172.21.15.152:0/2622065677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce5c105f50 0x7fce5c1063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:57.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.721+0000 7fce61023640 1 --2- 172.21.15.152:0/2622065677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce5c101460 0x7fce5c105930 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:57.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.721+0000 7fce61023640 1 --2- 172.21.15.152:0/2622065677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce5c100b40 0x7fce5c100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:57.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.721+0000 7fce61023640 1 -- 172.21.15.152:0/2622065677 >> 172.21.15.152:0/2622065677 conn(0x7fce5c0fc7d0 msgr2=0x7fce5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:57.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.721+0000 7fce61023640 1 -- 172.21.15.152:0/2622065677 shutdown_connections 2024-09-11T22:16:57.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.721+0000 7fce61023640 1 -- 172.21.15.152:0/2622065677 wait complete. 2024-09-11T22:16:57.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.722+0000 7fce61023640 1 Processor -- start 2024-09-11T22:16:57.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.723+0000 7fce61023640 1 -- start start 2024-09-11T22:16:57.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.723+0000 7fce61023640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce5c100b40 0x7fce5c072b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:57.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.723+0000 7fce61023640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce5c101460 0x7fce5c0730d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:57.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.723+0000 7fce61023640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce5c105f50 0x7fce5c109fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:57.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.724+0000 7fce61023640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c1185a0 con 0x7fce5c105f50 2024-09-11T22:16:57.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.724+0000 7fce61023640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c118420 con 0x7fce5c100b40 2024-09-11T22:16:57.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.724+0000 7fce61023640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c118720 con 0x7fce5c101460 2024-09-11T22:16:57.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.724+0000 7fce5b59e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce5c105f50 0x7fce5c109fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:57.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.724+0000 7fce5b59e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce5c105f50 0x7fce5c109fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38596/0 (socket says 172.21.15.152:38596) 2024-09-11T22:16:57.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.724+0000 7fce5b59e640 1 -- 172.21.15.152:0/3047938490 learned_addr learned my addr 172.21.15.152:0/3047938490 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:57.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.724+0000 7fce5b59e640 1 -- 172.21.15.152:0/3047938490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce5c101460 msgr2=0x7fce5c0730d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:16:57.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.724+0000 7fce5b59e640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce5c101460 0x7fce5c0730d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:57.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.724+0000 7fce5b59e640 1 -- 172.21.15.152:0/3047938490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce5c100b40 msgr2=0x7fce5c072b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:16:57.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.724+0000 7fce5b59e640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce5c100b40 0x7fce5c072b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:57.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.724+0000 7fce5b59e640 1 -- 172.21.15.152:0/3047938490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c10a6b0 con 0x7fce5c105f50 2024-09-11T22:16:57.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.725+0000 7fce5b59e640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce5c105f50 0x7fce5c109fd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fce5400cce0 tx=0x7fce5400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:57.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.726+0000 7fce43fff640 1 -- 172.21.15.152:0/3047938490 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5400f450 con 0x7fce5c105f50 2024-09-11T22:16:57.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.726+0000 7fce61023640 1 -- 172.21.15.152:0/3047938490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5c10a9a0 con 0x7fce5c105f50 2024-09-11T22:16:57.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.726+0000 7fce61023640 1 -- 172.21.15.152:0/3047938490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5c1121f0 con 0x7fce5c105f50 2024-09-11T22:16:57.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.726+0000 7fce43fff640 1 -- 172.21.15.152:0/3047938490 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce5400fad0 con 0x7fce5c105f50 2024-09-11T22:16:57.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.726+0000 7fce43fff640 1 -- 172.21.15.152:0/3047938490 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54018c50 con 0x7fce5c105f50 2024-09-11T22:16:57.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.728+0000 7fce61023640 1 -- 172.21.15.152:0/3047938490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce48005290 con 0x7fce5c105f50 2024-09-11T22:16:57.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.736+0000 7fce43fff640 1 -- 172.21.15.152:0/3047938490 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fce5400fc80 con 0x7fce5c105f50 2024-09-11T22:16:57.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.736+0000 7fce43fff640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fce440a2f00 0x7fce440a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:57.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.737+0000 7fce43fff640 1 -- 172.21.15.152:0/3047938490 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7fce540cfac0 con 0x7fce5c105f50 2024-09-11T22:16:57.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.744+0000 7fce5ad9d640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fce440a2f00 0x7fce440a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:57.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.746+0000 7fce43fff640 1 -- 172.21.15.152:0/3047938490 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce54014030 con 0x7fce5c105f50 2024-09-11T22:16:57.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:57.751+0000 7fce5ad9d640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fce440a2f00 0x7fce440a53c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00a930 tx=0x7fce4c005c00 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:57.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:57 smithi152 ceph-mon[31188]: pgmap v395: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.6 MiB/s wr, 108 op/s 2024-09-11T22:16:58.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:57 smithi179 ceph-mon[35603]: pgmap v395: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.6 MiB/s wr, 108 op/s 2024-09-11T22:16:58.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:57 smithi193 ceph-mon[35545]: pgmap v395: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.6 MiB/s wr, 108 op/s 2024-09-11T22:16:58.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.076+0000 7fce61023640 1 -- 172.21.15.152:0/3047938490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce48005580 con 0x7fce5c105f50 2024-09-11T22:16:58.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.077+0000 7fce43fff640 1 -- 172.21.15.152:0/3047938490 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7fce5409c7b0 con 0x7fce5c105f50 2024-09-11T22:16:58.078 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:16:58.078 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:16:58.078 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:16:58.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 -- 172.21.15.152:0/3047938490 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fce440a2f00 msgr2=0x7fce440a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:58.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fce440a2f00 0x7fce440a53c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00a930 tx=0x7fce4c005c00 comp rx=0 tx=0).stop 2024-09-11T22:16:58.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 -- 172.21.15.152:0/3047938490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce5c105f50 msgr2=0x7fce5c109fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:58.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce5c105f50 0x7fce5c109fd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fce5400cce0 tx=0x7fce5400a620 comp rx=0 tx=0).stop 2024-09-11T22:16:58.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 -- 172.21.15.152:0/3047938490 shutdown_connections 2024-09-11T22:16:58.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fce440a2f00 0x7fce440a53c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:58.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce5c105f50 0x7fce5c109fd0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:58.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce5c101460 0x7fce5c0730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:58.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 --2- 172.21.15.152:0/3047938490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce5c100b40 0x7fce5c072b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:58.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 -- 172.21.15.152:0/3047938490 >> 172.21.15.152:0/3047938490 conn(0x7fce5c0fc7d0 msgr2=0x7fce5c0fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:58.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 -- 172.21.15.152:0/3047938490 shutdown_connections 2024-09-11T22:16:58.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:58.080+0000 7fce61023640 1 -- 172.21.15.152:0/3047938490 wait complete. 2024-09-11T22:16:58.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:58 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3047938490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:58.862 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:16:59.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:58 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3047938490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:59.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:58 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3047938490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:16:59.226 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:16:59.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.749+0000 7f6f7c89a640 1 -- 172.21.15.152:0/449812616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f78100e20 msgr2=0x7f6f78101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:59.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.749+0000 7f6f7c89a640 1 --2- 172.21.15.152:0/449812616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f78100e20 0x7f6f78101200 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009900 tx=0x7f6f6802a480 comp rx=0 tx=0).stop 2024-09-11T22:16:59.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.750+0000 7f6f7c89a640 1 -- 172.21.15.152:0/449812616 shutdown_connections 2024-09-11T22:16:59.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.750+0000 7f6f7c89a640 1 --2- 172.21.15.152:0/449812616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f78102ef0 0x7f6f7810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.750+0000 7f6f7c89a640 1 --2- 172.21.15.152:0/449812616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f78102570 0x7f6f781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.750+0000 7f6f7c89a640 1 --2- 172.21.15.152:0/449812616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f78100e20 0x7f6f78101200 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.750+0000 7f6f7c89a640 1 -- 172.21.15.152:0/449812616 >> 172.21.15.152:0/449812616 conn(0x7f6f780fc7d0 msgr2=0x7f6f780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.750+0000 7f6f7c89a640 1 -- 172.21.15.152:0/449812616 shutdown_connections 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.750+0000 7f6f7c89a640 1 -- 172.21.15.152:0/449812616 wait complete. 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.750+0000 7f6f7c89a640 1 Processor -- start 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.750+0000 7f6f7c89a640 1 -- start start 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7c89a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f78100e20 0x7f6f78198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7c89a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f78102570 0x7f6f78198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7c89a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f78102ef0 0x7f6f7819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7c89a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f78112090 con 0x7f6f78102570 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7c89a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6f78111f10 con 0x7f6f78102ef0 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7c89a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6f78112210 con 0x7f6f78100e20 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f75d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f78102570 0x7f6f78198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f78100e20 0x7f6f78198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f75d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f78102570 0x7f6f78198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38608/0 (socket says 172.21.15.152:38608) 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f75d9b640 1 -- 172.21.15.152:0/228575646 learned_addr learned my addr 172.21.15.152:0/228575646 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f76d9d640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f78102ef0 0x7f6f7819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7659c640 1 -- 172.21.15.152:0/228575646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f78102ef0 msgr2=0x7f6f7819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7659c640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f78102ef0 0x7f6f7819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7659c640 1 -- 172.21.15.152:0/228575646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f78102570 msgr2=0x7f6f78198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7659c640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f78102570 0x7f6f78198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7659c640 1 -- 172.21.15.152:0/228575646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7819d500 con 0x7f6f78100e20 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f78102570 0x7f6f78198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.751+0000 7f6f7659c640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f78100e20 0x7f6f78198550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6f68005940 tx=0x7f6f68003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.752+0000 7f6f677fe640 1 -- 172.21.15.152:0/228575646 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6803f070 con 0x7f6f78100e20 2024-09-11T22:16:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.752+0000 7f6f7c89a640 1 -- 172.21.15.152:0/228575646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7819d790 con 0x7f6f78100e20 2024-09-11T22:16:59.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.752+0000 7f6f677fe640 1 -- 172.21.15.152:0/228575646 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f68031c30 con 0x7f6f78100e20 2024-09-11T22:16:59.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.752+0000 7f6f677fe640 1 -- 172.21.15.152:0/228575646 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68035030 con 0x7f6f78100e20 2024-09-11T22:16:59.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.752+0000 7f6f7c89a640 1 -- 172.21.15.152:0/228575646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f781a50d0 con 0x7f6f78100e20 2024-09-11T22:16:59.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.755+0000 7f6f677fe640 1 -- 172.21.15.152:0/228575646 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f6f68042070 con 0x7f6f78100e20 2024-09-11T22:16:59.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f677fe640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6f600a2d70 0x7f6f600a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f7ec73740 1 Processor -- start 2024-09-11T22:16:59.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f677fe640 1 -- 172.21.15.152:0/228575646 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f6f680efa40 con 0x7f6f78100e20 2024-09-11T22:16:59.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6f600a2d70 0x7f6f600a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f7ec73740 1 -- start start 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 0x55b7bc23c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc23c5d0 0x55b7bc23ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 0x55b7bc24db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f7ec73740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b7bc1a22f0 con 0x55b7bc23c5d0 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f7ec73740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b7bc149cf0 con 0x55b7bc24b780 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f7ec73740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b7bc19e2b0 con 0x55b7bc23db40 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f7659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 0x55b7bc23c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f76d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 0x55b7bc24db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f7659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 0x55b7bc23c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:33030/0 (socket says 172.21.15.152:33030) 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f7659c640 1 -- 172.21.15.152:0/1003112470 learned_addr learned my addr 172.21.15.152:0/1003112470 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.756+0000 7f6f76d9d640 1 --2- 172.21.15.152:0/1003112470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 0x55b7bc24db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:44574/0 (socket says 172.21.15.152:44574) 2024-09-11T22:16:59.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/1003112470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc23c5d0 0x55b7bc23ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6f600a2d70 0x7f6f600a5230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6f780fffa0 tx=0x7f6f6c005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f76d9d640 1 -- 172.21.15.152:0/1003112470 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 msgr2=0x55b7bc23c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f76d9d640 1 --2- 172.21.15.152:0/1003112470 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 0x55b7bc23c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f76d9d640 1 -- 172.21.15.152:0/1003112470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc23c5d0 msgr2=0x55b7bc23ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f76d9d640 1 --2- 172.21.15.152:0/1003112470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc23c5d0 0x55b7bc23ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f76d9d640 1 -- 172.21.15.152:0/1003112470 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7bc12e3a0 con 0x55b7bc24b780 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/1003112470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc23c5d0 0x55b7bc23ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f7659c640 1 --2- 172.21.15.152:0/1003112470 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 0x55b7bc23c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f76d9d640 1 --2- 172.21.15.152:0/1003112470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 0x55b7bc24db70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009ed0 tx=0x7f6f700107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0c02ded6f13e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f64ff9640 1 -- 172.21.15.152:0/1003112470 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f70003b70 con 0x55b7bc24b780 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f64ff9640 1 -- 172.21.15.152:0/1003112470 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f70015070 con 0x55b7bc24b780 2024-09-11T22:16:59.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.757+0000 7f6f64ff9640 1 -- 172.21.15.152:0/1003112470 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f70011820 con 0x55b7bc24b780 2024-09-11T22:16:59.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.758+0000 7f6f7ec73740 1 -- 172.21.15.152:0/1003112470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 msgr2=0x55b7bc24db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:59.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.758+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/1003112470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 0x55b7bc24db70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009ed0 tx=0x7f6f700107a0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.758+0000 7f6f7ec73740 1 -- 172.21.15.152:0/1003112470 shutdown_connections 2024-09-11T22:16:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.758+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/1003112470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 0x55b7bc24db70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.758+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/1003112470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc23c5d0 0x55b7bc23ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.758+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/1003112470 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 0x55b7bc23c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.758+0000 7f6f7ec73740 1 -- 172.21.15.152:0/1003112470 >> 172.21.15.152:0/1003112470 conn(0x55b7bc205310 msgr2=0x55b7bc238c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.758+0000 7f6f7ec73740 1 -- 172.21.15.152:0/1003112470 shutdown_connections 2024-09-11T22:16:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.758+0000 7f6f7ec73740 1 -- 172.21.15.152:0/1003112470 wait complete. 2024-09-11T22:16:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.758+0000 7f6f7ec73740 1 -- start start 2024-09-11T22:16:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.759+0000 7f6f7ec73740 1 Processor -- start 2024-09-11T22:16:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.759+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23c5d0 0x55b7bc24ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.759+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc2483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.759+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc24b780 0x55b7bc2488f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.759+0000 7f6f7ec73740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b7bc24e480 con 0x55b7bc24b780 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.759+0000 7f6f7ec73740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b7bc15d060 con 0x55b7bc23db40 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f75d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc2483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f75d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc2483b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:44590/0 (socket says 172.21.15.152:44590) 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f76d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc24b780 0x55b7bc2488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f75d9b640 1 -- 172.21.15.152:0/578395549 learned_addr learned my addr 172.21.15.152:0/578395549 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f7ec73740 1 -- 172.21.15.152:0/578395549 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b7bc24e600 con 0x55b7bc23c5d0 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f7659c640 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23c5d0 0x55b7bc24ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f75d9b640 1 -- 172.21.15.152:0/578395549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23c5d0 msgr2=0x55b7bc24ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f7ec73740 10 client.0 _ll_register_callbacks cb 0x55b7bbeb08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23c5d0 0x55b7bc24ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f75d9b640 1 -- 172.21.15.152:0/578395549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc24b780 msgr2=0x55b7bc2488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:59.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc24b780 0x55b7bc2488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f75d9b640 1 -- 172.21.15.152:0/578395549 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7bbf133c0 con 0x55b7bc23db40 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f7659c640 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23c5d0 0x55b7bc24ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f7ec73740 1 -- 172.21.15.152:0/578395549 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f70015070 con 0x55b7bc23db40 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f5dffb640 10 client.27842 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.760+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc2483b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00fbb0 tx=0x7f6f6c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=778584e95f9daad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f5dffb640 1 -- 172.21.15.152:0/578395549 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c01cde0 con 0x55b7bc23db40 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f5dffb640 1 -- 172.21.15.152:0/578395549 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f6f6c009040 con 0x55b7bc23db40 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f5dffb640 1 -- 172.21.15.152:0/578395549 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6f6c005020 con 0x55b7bc23db40 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f7ec73740 10 client.27842 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f7ec73740 1 -- 172.21.15.152:0/578395549 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b7bc25e290 con 0x55b7bc23db40 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f5dffb640 1 -- 172.21.15.152:0/578395549 <== mon.2 v2:172.21.15.179:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f6f6c024030 con 0x55b7bc23db40 2024-09-11T22:16:59.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f7ec73740 10 client.27842 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f7ec73740 10 client.27842 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f7ec73740 20 client.27842 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55b7bc25f630 0x55b7bc261a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f7ec73740 4 client.27842 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.761+0000 7f6f7ec73740 1 -- 172.21.15.152:0/578395549 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7bc1af860 con 0x55b7bc25f630 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.762+0000 7f6f7659c640 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55b7bc25f630 0x55b7bc261a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.762+0000 7f6f5dffb640 10 client.27842 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.762+0000 7f6f7659c640 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55b7bc25f630 0x55b7bc261a60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=58ca13199230f38b server_cookie=f2aea52c85054f6e in_seq=0 out_seq=0 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f5dffb640 1 -- 172.21.15.152:0/578395549 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7bc1af860 con 0x55b7bc25f630 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f5dffb640 10 client.27842 handle_command_reply: tid=0 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 1 client.27842 shutdown 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 1 -- 172.21.15.152:0/578395549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 msgr2=0x55b7bc2483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:59.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc2483b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00fbb0 tx=0x7f6f6c004730 comp rx=0 tx=0).stop 2024-09-11T22:16:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 1 -- 172.21.15.152:0/578395549 shutdown_connections 2024-09-11T22:16:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55b7bc25f630 0x55b7bc261a60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f5dffb640 0 client.27842 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:16:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc24b780 0x55b7bc2488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc2483b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/578395549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23c5d0 0x55b7bc24ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 1 -- 172.21.15.152:0/578395549 >> 172.21.15.152:0/578395549 conn(0x55b7bc205310 msgr2=0x55b7bc23e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 1 -- 172.21.15.152:0/578395549 shutdown_connections 2024-09-11T22:16:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 1 -- 172.21.15.152:0/578395549 wait complete. 2024-09-11T22:16:59.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.763+0000 7f6f7ec73740 20 client.27842 trim_cache size 0 max 16384 2024-09-11T22:16:59.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.778+0000 7f6f7ec73740 1 Processor -- start 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f7ec73740 1 -- start start 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc23c5d0 0x55b7bc267330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 0x55b7bc267870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 0x55b7bc245650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f7ec73740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781ae0d0 con 0x55b7bc23c5d0 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f7ec73740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781ab9a0 con 0x55b7bc24b780 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f7ec73740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781a9810 con 0x55b7bc23db40 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f7659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc23c5d0 0x55b7bc267330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f76d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 0x55b7bc245650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f75d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 0x55b7bc267870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f76d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 0x55b7bc245650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:44602/0 (socket says 172.21.15.152:44602) 2024-09-11T22:16:59.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f76d9d640 1 -- 172.21.15.152:0/816669820 learned_addr learned my addr 172.21.15.152:0/816669820 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:59.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f75d9b640 1 -- 172.21.15.152:0/816669820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 msgr2=0x55b7bc245650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:59.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/816669820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 0x55b7bc245650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f75d9b640 1 -- 172.21.15.152:0/816669820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc23c5d0 msgr2=0x55b7bc267330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/816669820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc23c5d0 0x55b7bc267330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.779+0000 7f6f75d9b640 1 -- 172.21.15.152:0/816669820 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7bc2620e0 con 0x55b7bc23db40 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.780+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/816669820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 0x55b7bc267870 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c01cfd0 tx=0x7f6f6c021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b346bff306b53ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.780+0000 7f6f5ffff640 1 -- 172.21.15.152:0/816669820 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0055b0 con 0x55b7bc23db40 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.780+0000 7f6f5ffff640 1 -- 172.21.15.152:0/816669820 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f70015070 con 0x55b7bc23db40 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.780+0000 7f6f5ffff640 1 -- 172.21.15.152:0/816669820 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c02f430 con 0x55b7bc23db40 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.780+0000 7f6f7ec73740 1 -- 172.21.15.152:0/816669820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 msgr2=0x55b7bc267870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.780+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/816669820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 0x55b7bc267870 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c01cfd0 tx=0x7f6f6c021000 comp rx=0 tx=0).stop 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.780+0000 7f6f7ec73740 1 -- 172.21.15.152:0/816669820 shutdown_connections 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.780+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/816669820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc24b780 0x55b7bc245650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.780+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/816669820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23db40 0x55b7bc267870 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.780+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/816669820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc23c5d0 0x55b7bc267330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 1 -- 172.21.15.152:0/816669820 >> 172.21.15.152:0/816669820 conn(0x55b7bc205310 msgr2=0x55b7bc24a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 1 -- 172.21.15.152:0/816669820 shutdown_connections 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 1 -- 172.21.15.152:0/816669820 wait complete. 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 1 -- start start 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 1 Processor -- start 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23c5d0 0x55b7bc25a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc25a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc24b780 0x55b7bc25ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781a9e60 con 0x55b7bc24b780 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781ab2d0 con 0x55b7bc23db40 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781aa530 con 0x55b7bc23c5d0 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7ec73740 10 client.0 _ll_register_callbacks cb 0x7f6f6c00f540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f75d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc25a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f7659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23c5d0 0x55b7bc25a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f75d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc25a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:44608/0 (socket says 172.21.15.152:44608) 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f75d9b640 1 -- 172.21.15.152:0/2610174718 learned_addr learned my addr 172.21.15.152:0/2610174718 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.781+0000 7f6f76d9d640 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc24b780 0x55b7bc25ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f75d9b640 1 -- 172.21.15.152:0/2610174718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23c5d0 msgr2=0x55b7bc25a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23c5d0 0x55b7bc25a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f75d9b640 1 -- 172.21.15.152:0/2610174718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc24b780 msgr2=0x55b7bc25ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc24b780 0x55b7bc25ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f75d9b640 1 -- 172.21.15.152:0/2610174718 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7bc2c9560 con 0x55b7bc23db40 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f75d9b640 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc25a7a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c011d60 tx=0x7f6f6c004bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32e14c937f5054a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f5dffb640 1 -- 172.21.15.152:0/2610174718 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c005bb0 con 0x55b7bc23db40 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f5dffb640 1 -- 172.21.15.152:0/2610174718 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f6f6c009040 con 0x55b7bc23db40 2024-09-11T22:16:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f7ec73740 1 -- 172.21.15.152:0/2610174718 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f70015070 con 0x55b7bc23db40 2024-09-11T22:16:59.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f5dffb640 1 -- 172.21.15.152:0/2610174718 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6f6c02f430 con 0x55b7bc23db40 2024-09-11T22:16:59.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.782+0000 7f6f7ec73740 10 client.27848 fetch_fsmap learned FSMap version 30 2024-09-11T22:16:59.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.783+0000 7f6f7ec73740 1 -- 172.21.15.152:0/2610174718 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b7bc2ca840 con 0x55b7bc23db40 2024-09-11T22:16:59.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.783+0000 7f6f5dffb640 1 -- 172.21.15.152:0/2610174718 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f70015070 con 0x55b7bc23db40 2024-09-11T22:16:59.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.783+0000 7f6f5dffb640 1 -- 172.21.15.152:0/2610174718 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f6f6c024040 con 0x55b7bc23db40 2024-09-11T22:16:59.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.784+0000 7f6f7ec73740 10 client.27848 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.784+0000 7f6f7ec73740 10 client.27848 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.784+0000 7f6f7ec73740 20 client.27848 populate_metadata read hostname 'smithi152' 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.784+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55b7bc2caea0 0x55b7bc2cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.784+0000 7f6f7ec73740 4 client.27848 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.784+0000 7f6f7ec73740 1 -- 172.21.15.152:0/2610174718 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7bc1a9d70 con 0x55b7bc2caea0 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.784+0000 7f6f7659c640 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55b7bc2caea0 0x55b7bc2cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f5dffb640 10 client.27848 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f7659c640 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55b7bc2caea0 0x55b7bc2cd290 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=32d001f1211f9a15 server_cookie=9b24d8aa33884b78 in_seq=0 out_seq=0 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f5dffb640 1 -- 172.21.15.152:0/2610174718 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7bc1a9d70 con 0x55b7bc2caea0 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f5dffb640 10 client.27848 handle_command_reply: tid=0 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f7ec73740 1 client.27848 shutdown 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f7ec73740 1 -- 172.21.15.152:0/2610174718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 msgr2=0x55b7bc25a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc25a7a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c011d60 tx=0x7f6f6c004bf0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f7ec73740 1 -- 172.21.15.152:0/2610174718 shutdown_connections 2024-09-11T22:16:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55b7bc2caea0 0x55b7bc2cd290 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f5dffb640 0 client.27848 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:16:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7bc24b780 0x55b7bc25ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b7bc23db40 0x55b7bc25a7a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f7ec73740 1 --2- 172.21.15.152:0/2610174718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7bc23c5d0 0x55b7bc25a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f7ec73740 1 -- 172.21.15.152:0/2610174718 >> 172.21.15.152:0/2610174718 conn(0x55b7bc205310 msgr2=0x55b7bc237310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.785+0000 7f6f7ec73740 1 -- 172.21.15.152:0/2610174718 shutdown_connections 2024-09-11T22:16:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7ec73740 1 -- 172.21.15.152:0/2610174718 wait complete. 2024-09-11T22:16:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7ec73740 20 client.27848 trim_cache size 0 max 16384 2024-09-11T22:16:59.793 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:16:59.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 -- 172.21.15.152:0/228575646 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6f600a2d70 msgr2=0x7f6f600a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:59.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6f600a2d70 0x7f6f600a5230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6f780fffa0 tx=0x7f6f6c005f90 comp rx=0 tx=0).stop 2024-09-11T22:16:59.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 -- 172.21.15.152:0/228575646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f78100e20 msgr2=0x7f6f78198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:59.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f78100e20 0x7f6f78198550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6f68005940 tx=0x7f6f68003c10 comp rx=0 tx=0).stop 2024-09-11T22:16:59.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 -- 172.21.15.152:0/228575646 shutdown_connections 2024-09-11T22:16:59.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6f600a2d70 0x7f6f600a5230 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f78102ef0 0x7f6f7819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f78102570 0x7f6f78198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 --2- 172.21.15.152:0/228575646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f78100e20 0x7f6f78198550 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:59.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 -- 172.21.15.152:0/228575646 >> 172.21.15.152:0/228575646 conn(0x7f6f780fc7d0 msgr2=0x7f6f780fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:59.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 -- 172.21.15.152:0/228575646 shutdown_connections 2024-09-11T22:16:59.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:16:59.786+0000 7f6f7c89a640 1 -- 172.21.15.152:0/228575646 wait complete. 2024-09-11T22:16:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 685.0 s, 2063.4 tps, lat 48.660 ms stddev 56.229 2024-09-11T22:16:59.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:16:59 smithi152 ceph-mon[31188]: pgmap v396: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 390 op/s 2024-09-11T22:17:00.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:16:59 smithi179 ceph-mon[35603]: pgmap v396: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 390 op/s 2024-09-11T22:17:00.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:16:59 smithi193 ceph-mon[35545]: pgmap v396: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 390 op/s 2024-09-11T22:17:00.520 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:17:00.849 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:01.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.413+0000 7f8c2180c640 1 -- 172.21.15.152:0/2941525957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c1c100a70 msgr2=0x7f8c1c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:01.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.413+0000 7f8c2180c640 1 --2- 172.21.15.152:0/2941525957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c1c100a70 0x7f8c1c100ed0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009930 tx=0x7f8c1002a420 comp rx=0 tx=0).stop 2024-09-11T22:17:01.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.413+0000 7f8c2180c640 1 -- 172.21.15.152:0/2941525957 shutdown_connections 2024-09-11T22:17:01.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.413+0000 7f8c2180c640 1 --2- 172.21.15.152:0/2941525957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c1c101410 0x7f8c1c10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.413+0000 7f8c2180c640 1 --2- 172.21.15.152:0/2941525957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c1c100a70 0x7f8c1c100ed0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.413+0000 7f8c2180c640 1 --2- 172.21.15.152:0/2941525957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1c106a70 0x7f8c1c106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.413+0000 7f8c2180c640 1 -- 172.21.15.152:0/2941525957 >> 172.21.15.152:0/2941525957 conn(0x7f8c1c0fc7d0 msgr2=0x7f8c1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.413+0000 7f8c2180c640 1 -- 172.21.15.152:0/2941525957 shutdown_connections 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.413+0000 7f8c2180c640 1 -- 172.21.15.152:0/2941525957 wait complete. 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.414+0000 7f8c2180c640 1 Processor -- start 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.414+0000 7f8c2180c640 1 -- start start 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c2180c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c1c100a70 0x7f8c1c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c2180c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c1c101410 0x7f8c1c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c2180c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1c106a70 0x7f8c1c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c2180c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c110e30 con 0x7f8c1c100a70 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c1c100a70 0x7f8c1c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c2180c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c110cb0 con 0x7f8c1c106a70 2024-09-11T22:17:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c2180c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c110fb0 con 0x7f8c1c101410 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1a7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c1c101410 0x7f8c1c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c1c100a70 0x7f8c1c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38652/0 (socket says 172.21.15.152:38652) 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1affd640 1 -- 172.21.15.152:0/3090649612 learned_addr learned my addr 172.21.15.152:0/3090649612 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1c106a70 0x7f8c1c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1b7fe640 1 -- 172.21.15.152:0/3090649612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c1c101410 msgr2=0x7f8c1c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c1c101410 0x7f8c1c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1b7fe640 1 -- 172.21.15.152:0/3090649612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c1c100a70 msgr2=0x7f8c1c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c1c100a70 0x7f8c1c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1b7fe640 1 -- 172.21.15.152:0/3090649612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c19d430 con 0x7f8c1c106a70 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1a7fc640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c1c101410 0x7f8c1c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1affd640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c1c100a70 0x7f8c1c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.415+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1c106a70 0x7f8c1c19cd50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400e940 tx=0x7f8c1400ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.416+0000 7f8c2080a640 1 -- 172.21.15.152:0/3090649612 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14004d20 con 0x7f8c1c106a70 2024-09-11T22:17:01.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.416+0000 7f8c2080a640 1 -- 172.21.15.152:0/3090649612 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c14005020 con 0x7f8c1c106a70 2024-09-11T22:17:01.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.416+0000 7f8c2180c640 1 -- 172.21.15.152:0/3090649612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c19d720 con 0x7f8c1c106a70 2024-09-11T22:17:01.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.416+0000 7f8c2080a640 1 -- 172.21.15.152:0/3090649612 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c140116b0 con 0x7f8c1c106a70 2024-09-11T22:17:01.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.416+0000 7f8c2180c640 1 -- 172.21.15.152:0/3090649612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c1a5000 con 0x7f8c1c106a70 2024-09-11T22:17:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.419+0000 7f8c23be5740 1 Processor -- start 2024-09-11T22:17:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.419+0000 7f8c2080a640 1 -- 172.21.15.152:0/3090649612 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8c140054d0 con 0x7f8c1c106a70 2024-09-11T22:17:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c23be5740 1 -- start start 2024-09-11T22:17:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c2080a640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c040a2d70 0x7f8c040a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a9b40 0x5589df6a8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a85d0 0x5589df6a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 0x5589df6b9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c23be5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5589df60e2f0 con 0x5589df6a9b40 2024-09-11T22:17:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c23be5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5589df5b5cf0 con 0x5589df6a85d0 2024-09-11T22:17:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c23be5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5589df60a2b0 con 0x5589df6b7780 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c1a7fc640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c040a2d70 0x7f8c040a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c2080a640 1 -- 172.21.15.152:0/3090649612 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f8c140cf510 con 0x7f8c1c106a70 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c1a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a85d0 0x5589df6a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.420+0000 7f8c1affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a9b40 0x5589df6a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c1a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a85d0 0x5589df6a8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:44642/0 (socket says 172.21.15.152:44642) 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c1a7fc640 1 -- 172.21.15.152:0/649477352 learned_addr learned my addr 172.21.15.152:0/649477352 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c1a7fc640 1 -- 172.21.15.152:0/649477352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 msgr2=0x5589df6b9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/649477352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 0x5589df6b9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c1a7fc640 1 --2- 172.21.15.152:0/649477352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 0x5589df6b9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c1a7fc640 1 -- 172.21.15.152:0/649477352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a9b40 msgr2=0x5589df6a8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c1a7fc640 1 --2- 172.21.15.152:0/649477352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a9b40 0x5589df6a8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c1a7fc640 1 -- 172.21.15.152:0/649477352 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589df59a3a0 con 0x5589df6a85d0 2024-09-11T22:17:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/649477352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 0x5589df6b9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c1a7fc640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c040a2d70 0x7f8c040a5230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8c10005ec0 tx=0x7f8c10005dd0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c1a7fc640 1 --2- 172.21.15.152:0/649477352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a85d0 0x5589df6a8a10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8c10005c40 tx=0x7f8c10046000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=235f95d6234e7971 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c01ffb640 1 -- 172.21.15.152:0/649477352 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10050070 con 0x5589df6a85d0 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c01ffb640 1 -- 172.21.15.152:0/649477352 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c10005030 con 0x5589df6a85d0 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.421+0000 7f8c01ffb640 1 -- 172.21.15.152:0/649477352 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10035040 con 0x5589df6a85d0 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.422+0000 7f8c23be5740 1 -- 172.21.15.152:0/649477352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a85d0 msgr2=0x5589df6a8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.422+0000 7f8c23be5740 1 --2- 172.21.15.152:0/649477352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a85d0 0x5589df6a8a10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8c10005c40 tx=0x7f8c10046000 comp rx=0 tx=0).stop 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.423+0000 7f8c23be5740 1 -- 172.21.15.152:0/649477352 shutdown_connections 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.423+0000 7f8c23be5740 1 --2- 172.21.15.152:0/649477352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 0x5589df6b9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.423+0000 7f8c23be5740 1 --2- 172.21.15.152:0/649477352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a85d0 0x5589df6a8a10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.423+0000 7f8c23be5740 1 --2- 172.21.15.152:0/649477352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a9b40 0x5589df6a8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.423+0000 7f8c23be5740 1 -- 172.21.15.152:0/649477352 >> 172.21.15.152:0/649477352 conn(0x5589df671310 msgr2=0x5589df6a4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.423+0000 7f8c23be5740 1 -- 172.21.15.152:0/649477352 shutdown_connections 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.423+0000 7f8c23be5740 1 -- 172.21.15.152:0/649477352 wait complete. 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.423+0000 7f8c23be5740 1 -- start start 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c23be5740 1 Processor -- start 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a9b40 0x5589df6b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 0x5589df6b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c23be5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5589df6ba420 con 0x5589df6a85d0 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c23be5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5589df5c9060 con 0x5589df6a9b40 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c23be5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5589df6ba5a0 con 0x5589df6b7780 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c23be5740 10 client.0 _ll_register_callbacks cb 0x5589df31c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c1a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a9b40 0x5589df6b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c1a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a9b40 0x5589df6b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:44652/0 (socket says 172.21.15.152:44652) 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c1a7fc640 1 -- 172.21.15.152:0/510805828 learned_addr learned my addr 172.21.15.152:0/510805828 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 0x5589df6b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c1affd640 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c1b7fe640 1 -- 172.21.15.152:0/510805828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a9b40 msgr2=0x5589df6b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a9b40 0x5589df6b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c1b7fe640 1 -- 172.21.15.152:0/510805828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 msgr2=0x5589df6b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c1b7fe640 1 -- 172.21.15.152:0/510805828 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589df37f3c0 con 0x5589df6b7780 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.424+0000 7f8c1a7fc640 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a9b40 0x5589df6b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.425+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 0x5589df6b0550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8c140ccba0 tx=0x7f8c1409b380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ea8e5afca5cdc92 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.425+0000 7f8bfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.425+0000 7f8bfaffd640 1 -- 172.21.15.152:0/510805828 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1401f040 con 0x5589df6b7780 2024-09-11T22:17:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.425+0000 7f8c23be5740 1 -- 172.21.15.152:0/510805828 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c10005030 con 0x5589df6b7780 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.425+0000 7f8bfaffd640 1 -- 172.21.15.152:0/510805828 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f8c14099d20 con 0x5589df6b7780 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.425+0000 7f8bfaffd640 1 -- 172.21.15.152:0/510805828 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8c140a45e0 con 0x5589df6b7780 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.425+0000 7f8c23be5740 10 client.28006 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.425+0000 7f8c23be5740 1 -- 172.21.15.152:0/510805828 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5589df6ca290 con 0x5589df6b7780 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.425+0000 7f8bfaffd640 1 -- 172.21.15.152:0/510805828 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c10005030 con 0x5589df6b7780 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.425+0000 7f8bfaffd640 1 -- 172.21.15.152:0/510805828 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8c140ce070 con 0x5589df6b7780 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.426+0000 7f8c23be5740 10 client.28006 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.426+0000 7f8c23be5740 10 client.28006 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.426+0000 7f8c23be5740 20 client.28006 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.426+0000 7f8c23be5740 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5589df6cbb10 0x5589df6cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.426+0000 7f8c23be5740 4 client.28006 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.426+0000 7f8c23be5740 1 -- 172.21.15.152:0/510805828 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589df61b860 con 0x5589df6cbb10 2024-09-11T22:17:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.426+0000 7f8c1affd640 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5589df6cbb10 0x5589df6cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.426+0000 7f8c1affd640 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5589df6cbb10 0x5589df6cdf50 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e228f6f5d63abd95 server_cookie=2ee71b2ad1b58ed7 in_seq=0 out_seq=0 2024-09-11T22:17:01.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.426+0000 7f8bfaffd640 10 client.28006 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:17:01.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.427+0000 7f8bfaffd640 1 -- 172.21.15.152:0/510805828 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5589df61b860 con 0x5589df6cbb10 2024-09-11T22:17:01.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.427+0000 7f8bfaffd640 10 client.28006 handle_command_reply: tid=0 2024-09-11T22:17:01.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.427+0000 7f8c23be5740 1 client.28006 shutdown 2024-09-11T22:17:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8c23be5740 1 -- 172.21.15.152:0/510805828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 msgr2=0x5589df6b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8c23be5740 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 0x5589df6b0550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8c140ccba0 tx=0x7f8c1409b380 comp rx=0 tx=0).stop 2024-09-11T22:17:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8c23be5740 1 -- 172.21.15.152:0/510805828 shutdown_connections 2024-09-11T22:17:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8c23be5740 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5589df6cbb10 0x5589df6cdf50 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8c23be5740 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6b7780 0x5589df6b0550 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8c23be5740 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6a9b40 0x5589df6b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8c23be5740 1 --2- 172.21.15.152:0/510805828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8c23be5740 1 -- 172.21.15.152:0/510805828 >> 172.21.15.152:0/510805828 conn(0x5589df671310 msgr2=0x5589df6aa930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8bfaffd640 0 client.28006 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:17:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8c23be5740 1 -- 172.21.15.152:0/510805828 shutdown_connections 2024-09-11T22:17:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8c23be5740 1 -- 172.21.15.152:0/510805828 wait complete. 2024-09-11T22:17:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.428+0000 7f8c23be5740 20 client.28006 trim_cache size 0 max 16384 2024-09-11T22:17:01.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.447+0000 7f8c23be5740 1 Processor -- start 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.447+0000 7f8c23be5740 1 -- start start 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6a9b40 0x5589df6a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6b7780 0x5589df6ab120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c23be5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c1ae0c0 con 0x5589df6a85d0 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c23be5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c1ab990 con 0x5589df6b7780 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c1affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c1a7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6a9b40 0x5589df6a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c1affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38686/0 (socket says 172.21.15.152:38686) 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c1affd640 1 -- 172.21.15.152:0/1002905183 learned_addr learned my addr 172.21.15.152:0/1002905183 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c23be5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c1a9820 con 0x5589df6a9b40 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/1002905183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6b7780 0x5589df6ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c1a7fc640 1 -- 172.21.15.152:0/1002905183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6b7780 msgr2=0x5589df6ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:01.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c1a7fc640 1 --2- 172.21.15.152:0/1002905183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6b7780 0x5589df6ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c1a7fc640 1 -- 172.21.15.152:0/1002905183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 msgr2=0x5589df6aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:01.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c1a7fc640 1 --2- 172.21.15.152:0/1002905183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c1a7fc640 1 -- 172.21.15.152:0/1002905183 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589df6a5960 con 0x5589df6a9b40 2024-09-11T22:17:01.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.448+0000 7f8c1affd640 1 --2- 172.21.15.152:0/1002905183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:01.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.449+0000 7f8c1a7fc640 1 --2- 172.21.15.152:0/1002905183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6a9b40 0x5589df6a3bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5589df6b1650 tx=0x7f8c10009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba31d74f53ac76a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:01.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.449+0000 7f8c017fa640 1 -- 172.21.15.152:0/1002905183 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10050070 con 0x5589df6a9b40 2024-09-11T22:17:01.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.449+0000 7f8c017fa640 1 -- 172.21.15.152:0/1002905183 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c10005040 con 0x5589df6a9b40 2024-09-11T22:17:01.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.449+0000 7f8c017fa640 1 -- 172.21.15.152:0/1002905183 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10004a60 con 0x5589df6a9b40 2024-09-11T22:17:01.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.450+0000 7f8c23be5740 1 -- 172.21.15.152:0/1002905183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6a9b40 msgr2=0x5589df6a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:01.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.450+0000 7f8c23be5740 1 --2- 172.21.15.152:0/1002905183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6a9b40 0x5589df6a3bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5589df6b1650 tx=0x7f8c10009560 comp rx=0 tx=0).stop 2024-09-11T22:17:01.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.450+0000 7f8c23be5740 1 -- 172.21.15.152:0/1002905183 shutdown_connections 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.450+0000 7f8c23be5740 1 --2- 172.21.15.152:0/1002905183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6b7780 0x5589df6ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.450+0000 7f8c23be5740 1 --2- 172.21.15.152:0/1002905183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6a9b40 0x5589df6a3bf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.450+0000 7f8c23be5740 1 --2- 172.21.15.152:0/1002905183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.450+0000 7f8c23be5740 1 -- 172.21.15.152:0/1002905183 >> 172.21.15.152:0/1002905183 conn(0x5589df671310 msgr2=0x5589df6a34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.450+0000 7f8c23be5740 1 -- 172.21.15.152:0/1002905183 shutdown_connections 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.450+0000 7f8c23be5740 1 -- 172.21.15.152:0/1002905183 wait complete. 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.450+0000 7f8c23be5740 1 -- start start 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c23be5740 1 Processor -- start 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6a9b40 0x5589df6c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c23be5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6b7780 0x5589df6c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c23be5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c1a9e70 con 0x5589df6a85d0 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c23be5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c1ab2c0 con 0x5589df6b7780 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c23be5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c1aa520 con 0x5589df6a9b40 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c23be5740 10 client.0 _ll_register_callbacks cb 0x7f8c1400ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c1affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c1b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6b7780 0x5589df6c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c1affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38700/0 (socket says 172.21.15.152:38700) 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c1affd640 1 -- 172.21.15.152:0/2954358837 learned_addr learned my addr 172.21.15.152:0/2954358837 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c1a7fc640 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6a9b40 0x5589df6c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c1b7fe640 1 -- 172.21.15.152:0/2954358837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6a9b40 msgr2=0x5589df6c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6a9b40 0x5589df6c3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c1b7fe640 1 -- 172.21.15.152:0/2954358837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 msgr2=0x5589df6c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.451+0000 7f8c1b7fe640 1 -- 172.21.15.152:0/2954358837 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589df6c3e70 con 0x5589df6b7780 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8c1b7fe640 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6b7780 0x5589df6c3670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8c140a4230 tx=0x7f8c140058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98d6d3f99c945af0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8bfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8bfaffd640 1 -- 172.21.15.152:0/2954358837 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1401f070 con 0x5589df6b7780 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8c23be5740 1 -- 172.21.15.152:0/2954358837 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c10005040 con 0x5589df6b7780 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8bfaffd640 1 -- 172.21.15.152:0/2954358837 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f8c140861f0 con 0x5589df6b7780 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8bfaffd640 1 -- 172.21.15.152:0/2954358837 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8c1409b7f0 con 0x5589df6b7780 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8c23be5740 10 client.27866 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8c23be5740 1 -- 172.21.15.152:0/2954358837 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5589df735900 con 0x5589df6b7780 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8bfaffd640 1 -- 172.21.15.152:0/2954358837 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c10005040 con 0x5589df6b7780 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8bfaffd640 1 -- 172.21.15.152:0/2954358837 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8c140ce040 con 0x5589df6b7780 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8c23be5740 10 client.27866 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8c23be5740 10 client.27866 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:17:01.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8c23be5740 20 client.27866 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:01.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8c23be5740 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5589df736070 0x5589df738490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:01.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8c23be5740 4 client.27866 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:17:01.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.452+0000 7f8c23be5740 1 -- 172.21.15.152:0/2954358837 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589df615d70 con 0x5589df736070 2024-09-11T22:17:01.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.453+0000 7f8c1affd640 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5589df736070 0x5589df738490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:01.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.453+0000 7f8bfaffd640 10 client.27866 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:17:01.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.453+0000 7f8c1affd640 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5589df736070 0x5589df738490 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b645483723fdcd0d server_cookie=180c3a6b356e3fe5 in_seq=0 out_seq=0 2024-09-11T22:17:01.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8bfaffd640 1 -- 172.21.15.152:0/2954358837 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589df615d70 con 0x5589df736070 2024-09-11T22:17:01.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8bfaffd640 10 client.27866 handle_command_reply: tid=0 2024-09-11T22:17:01.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 1 client.27866 shutdown 2024-09-11T22:17:01.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 1 -- 172.21.15.152:0/2954358837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6b7780 msgr2=0x5589df6c3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:01.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6b7780 0x5589df6c3670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8c140a4230 tx=0x7f8c140058d0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 1 -- 172.21.15.152:0/2954358837 shutdown_connections 2024-09-11T22:17:01.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5589df736070 0x5589df738490 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5589df6b7780 0x5589df6c3670 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5589df6a9b40 0x5589df6c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 1 --2- 172.21.15.152:0/2954358837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5589df6a85d0 0x5589df6c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 1 -- 172.21.15.152:0/2954358837 >> 172.21.15.152:0/2954358837 conn(0x5589df671310 msgr2=0x5589df6a3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:01.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8bfaffd640 0 client.27866 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:17:01.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 1 -- 172.21.15.152:0/2954358837 shutdown_connections 2024-09-11T22:17:01.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 1 -- 172.21.15.152:0/2954358837 wait complete. 2024-09-11T22:17:01.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.454+0000 7f8c23be5740 20 client.27866 trim_cache size 0 max 16384 2024-09-11T22:17:01.460 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:17:01.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 -- 172.21.15.152:0/3090649612 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c040a2d70 msgr2=0x7f8c040a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:01.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c040a2d70 0x7f8c040a5230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8c10005ec0 tx=0x7f8c10005dd0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 -- 172.21.15.152:0/3090649612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1c106a70 msgr2=0x7f8c1c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:01.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1c106a70 0x7f8c1c19cd50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400e940 tx=0x7f8c1400ee00 comp rx=0 tx=0).stop 2024-09-11T22:17:01.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 -- 172.21.15.152:0/3090649612 shutdown_connections 2024-09-11T22:17:01.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8c040a2d70 0x7f8c040a5230 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1c106a70 0x7f8c1c19cd50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c1c101410 0x7f8c1c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 --2- 172.21.15.152:0/3090649612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c1c100a70 0x7f8c1c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:01.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 -- 172.21.15.152:0/3090649612 >> 172.21.15.152:0/3090649612 conn(0x7f8c1c0fc7d0 msgr2=0x7f8c1c104840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:01.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 -- 172.21.15.152:0/3090649612 shutdown_connections 2024-09-11T22:17:01.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:01.456+0000 7f8c2180c640 1 -- 172.21.15.152:0/3090649612 wait complete. 2024-09-11T22:17:01.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:01 smithi152 ceph-mon[31188]: pgmap v397: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.9 MiB/s wr, 387 op/s 2024-09-11T22:17:02.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:01 smithi179 ceph-mon[35603]: pgmap v397: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.9 MiB/s wr, 387 op/s 2024-09-11T22:17:02.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:01 smithi193 ceph-mon[35545]: pgmap v397: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.9 MiB/s wr, 387 op/s 2024-09-11T22:17:02.161 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:17:02.572 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:03.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.132+0000 7faedf0e1640 1 -- 172.21.15.152:0/3751623199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faed8110190 msgr2=0x7faed806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:03.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.132+0000 7faedf0e1640 1 --2- 172.21.15.152:0/3751623199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faed8110190 0x7faed806e4f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7faed0009ca0 tx=0x7faed002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.132+0000 7faedf0e1640 1 -- 172.21.15.152:0/3751623199 shutdown_connections 2024-09-11T22:17:03.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.132+0000 7faedf0e1640 1 --2- 172.21.15.152:0/3751623199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed811b140 0x7faed811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.132+0000 7faedf0e1640 1 --2- 172.21.15.152:0/3751623199 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed806ea30 0x7faed806ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.132+0000 7faedf0e1640 1 --2- 172.21.15.152:0/3751623199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faed8110190 0x7faed806e4f0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.132+0000 7faedf0e1640 1 -- 172.21.15.152:0/3751623199 >> 172.21.15.152:0/3751623199 conn(0x7faed8073180 msgr2=0x7faed8073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:03.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.133+0000 7faedf0e1640 1 -- 172.21.15.152:0/3751623199 shutdown_connections 2024-09-11T22:17:03.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.133+0000 7faedf0e1640 1 -- 172.21.15.152:0/3751623199 wait complete. 2024-09-11T22:17:03.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.133+0000 7faedf0e1640 1 Processor -- start 2024-09-11T22:17:03.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.133+0000 7faedf0e1640 1 -- start start 2024-09-11T22:17:03.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.134+0000 7faedf0e1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed806ea30 0x7faed81a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.134+0000 7faedf0e1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faed8110190 0x7faed81a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.134+0000 7faedf0e1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed811b140 0x7faed81ab970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.134+0000 7faedf0e1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faed8120be0 con 0x7faed8110190 2024-09-11T22:17:03.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.134+0000 7faedf0e1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faed8120a60 con 0x7faed811b140 2024-09-11T22:17:03.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.134+0000 7faedf0e1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faed8120d60 con 0x7faed806ea30 2024-09-11T22:17:03.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.134+0000 7faede0df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed806ea30 0x7faed81a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.134+0000 7faede0df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed806ea30 0x7faed81a70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:33114/0 (socket says 172.21.15.152:33114) 2024-09-11T22:17:03.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.134+0000 7faede8e0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed811b140 0x7faed81ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.134+0000 7faede0df640 1 -- 172.21.15.152:0/1504691170 learned_addr learned my addr 172.21.15.152:0/1504691170 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:03.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.135+0000 7faede8e0640 1 -- 172.21.15.152:0/1504691170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed806ea30 msgr2=0x7faed81a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:03.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.135+0000 7faede8e0640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed806ea30 0x7faed81a70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.135+0000 7faede8e0640 1 -- 172.21.15.152:0/1504691170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faed8110190 msgr2=0x7faed81a75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:03.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.135+0000 7faede8e0640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faed8110190 0x7faed81a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.135+0000 7faede8e0640 1 -- 172.21.15.152:0/1504691170 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed81ac070 con 0x7faed811b140 2024-09-11T22:17:03.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.135+0000 7faede8e0640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed811b140 0x7faed81ab970 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faed806b4a0 tx=0x7faec800da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:03.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.136+0000 7faecf7fe640 1 -- 172.21.15.152:0/1504691170 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8017070 con 0x7faed811b140 2024-09-11T22:17:03.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.136+0000 7faedf0e1640 1 -- 172.21.15.152:0/1504691170 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed81ac360 con 0x7faed811b140 2024-09-11T22:17:03.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.136+0000 7faedf0e1640 1 -- 172.21.15.152:0/1504691170 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed8110920 con 0x7faed811b140 2024-09-11T22:17:03.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.136+0000 7faecf7fe640 1 -- 172.21.15.152:0/1504691170 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faec80047a0 con 0x7faed811b140 2024-09-11T22:17:03.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.136+0000 7faecf7fe640 1 -- 172.21.15.152:0/1504691170 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8009c30 con 0x7faed811b140 2024-09-11T22:17:03.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.139+0000 7faee271c740 1 Processor -- start 2024-09-11T22:17:03.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.139+0000 7faecf7fe640 1 -- 172.21.15.152:0/1504691170 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7faec8005220 con 0x7faed811b140 2024-09-11T22:17:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faee271c740 1 -- start start 2024-09-11T22:17:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faee271c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130ecf0 0x55db1130d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faee271c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130d780 0x55db1130dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faee271c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db11318520 0x55db1131a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faee271c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55db112732f0 con 0x55db11318520 2024-09-11T22:17:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faee271c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55db1121acf0 con 0x55db1130d780 2024-09-11T22:17:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faee271c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55db1126f2b0 con 0x55db1130ecf0 2024-09-11T22:17:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faede0df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130d780 0x55db1130dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faedd8de640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130ecf0 0x55db1130d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faede0df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130d780 0x55db1130dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:44696/0 (socket says 172.21.15.152:44696) 2024-09-11T22:17:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faede0df640 1 -- 172.21.15.152:0/1152547728 learned_addr learned my addr 172.21.15.152:0/1152547728 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:03.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.140+0000 7faedd8de640 1 --2- 172.21.15.152:0/1152547728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db11318520 0x55db1131a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.141+0000 7faede0df640 1 -- 172.21.15.152:0/1152547728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130ecf0 msgr2=0x55db1130d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.141+0000 7faede0df640 1 --2- 172.21.15.152:0/1152547728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130ecf0 0x55db1130d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.141+0000 7faede0df640 1 -- 172.21.15.152:0/1152547728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db11318520 msgr2=0x55db1131a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.141+0000 7faede0df640 1 --2- 172.21.15.152:0/1152547728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db11318520 0x55db1131a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.141+0000 7faede0df640 1 -- 172.21.15.152:0/1152547728 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db111ff3a0 con 0x55db1130d780 2024-09-11T22:17:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.141+0000 7faedd8de640 1 --2- 172.21.15.152:0/1152547728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130ecf0 0x55db1130d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.141+0000 7faede0df640 1 --2- 172.21.15.152:0/1152547728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130d780 0x55db1130dbc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faed0030670 tx=0x7faed00306a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a736b76155abe7b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.141+0000 7faeccdea640 1 -- 172.21.15.152:0/1152547728 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0031db0 con 0x55db1130d780 2024-09-11T22:17:03.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.141+0000 7faecf7fe640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faec40a2e80 0x7faec40a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.141+0000 7faeccdea640 1 -- 172.21.15.152:0/1152547728 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed0036030 con 0x55db1130d780 2024-09-11T22:17:03.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.141+0000 7faeccdea640 1 -- 172.21.15.152:0/1152547728 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0031740 con 0x55db1130d780 2024-09-11T22:17:03.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.142+0000 7faecf7fe640 1 -- 172.21.15.152:0/1504691170 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7faec80cea00 con 0x7faed811b140 2024-09-11T22:17:03.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.142+0000 7faedd8de640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faec40a2e80 0x7faec40a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.142+0000 7faee271c740 1 -- 172.21.15.152:0/1152547728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130d780 msgr2=0x55db1130dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:03.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.142+0000 7faee271c740 1 --2- 172.21.15.152:0/1152547728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130d780 0x55db1130dbc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faed0030670 tx=0x7faed00306a0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.143+0000 7faee271c740 1 -- 172.21.15.152:0/1152547728 shutdown_connections 2024-09-11T22:17:03.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.143+0000 7faee271c740 1 --2- 172.21.15.152:0/1152547728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db11318520 0x55db1131a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.143+0000 7faee271c740 1 --2- 172.21.15.152:0/1152547728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130d780 0x55db1130dbc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.143+0000 7faee271c740 1 --2- 172.21.15.152:0/1152547728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130ecf0 0x55db1130d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.143+0000 7faee271c740 1 -- 172.21.15.152:0/1152547728 >> 172.21.15.152:0/1152547728 conn(0x55db112d6310 msgr2=0x55db11309e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:03.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.143+0000 7faee271c740 1 -- 172.21.15.152:0/1152547728 shutdown_connections 2024-09-11T22:17:03.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.143+0000 7faedd8de640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faec40a2e80 0x7faec40a5340 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55db1130e220 tx=0x7faed4005850 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:03.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.143+0000 7faee271c740 1 -- 172.21.15.152:0/1152547728 wait complete. 2024-09-11T22:17:03.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.143+0000 7faee271c740 1 -- start start 2024-09-11T22:17:03.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.143+0000 7faee271c740 1 Processor -- start 2024-09-11T22:17:03.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.144+0000 7faee271c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130d780 0x55db11317dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.144+0000 7faee271c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db1130ecf0 0x55db11315070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.144+0000 7faee271c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db11318520 0x55db113155b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faee271c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55db1131b040 con 0x55db1130ecf0 2024-09-11T22:17:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faee271c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55db1122e060 con 0x55db1130d780 2024-09-11T22:17:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faede8e0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db11318520 0x55db113155b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faede8e0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db11318520 0x55db113155b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:33128/0 (socket says 172.21.15.152:33128) 2024-09-11T22:17:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faede8e0640 1 -- 172.21.15.152:0/2234937085 learned_addr learned my addr 172.21.15.152:0/2234937085 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faee271c740 1 -- 172.21.15.152:0/2234937085 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55db1131b1c0 con 0x55db11318520 2024-09-11T22:17:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faee271c740 10 client.0 _ll_register_callbacks cb 0x55db10f818c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faede8e0640 1 -- 172.21.15.152:0/2234937085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130d780 msgr2=0x55db11317dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:17:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faede8e0640 1 --2- 172.21.15.152:0/2234937085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130d780 0x55db11317dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faede8e0640 1 -- 172.21.15.152:0/2234937085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db1130ecf0 msgr2=0x55db11315070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faede8e0640 1 --2- 172.21.15.152:0/2234937085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db1130ecf0 0x55db11315070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.145+0000 7faede8e0640 1 -- 172.21.15.152:0/2234937085 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db10fe43c0 con 0x55db11318520 2024-09-11T22:17:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.146+0000 7faede8e0640 1 --2- 172.21.15.152:0/2234937085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db11318520 0x55db113155b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faec800b360 tx=0x7faec809b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3deeac6d093aa2fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.146+0000 7faec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:17:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.146+0000 7faec1ffb640 1 -- 172.21.15.152:0/2234937085 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8020040 con 0x55db11318520 2024-09-11T22:17:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.146+0000 7faee271c740 1 -- 172.21.15.152:0/2234937085 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed0036030 con 0x55db11318520 2024-09-11T22:17:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.146+0000 7faec1ffb640 1 -- 172.21.15.152:0/2234937085 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7faec8097530 con 0x55db11318520 2024-09-11T22:17:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.146+0000 7faec1ffb640 1 -- 172.21.15.152:0/2234937085 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faec80a3b30 con 0x55db11318520 2024-09-11T22:17:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.147+0000 7faee271c740 10 client.28024 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.147+0000 7faee271c740 1 -- 172.21.15.152:0/2234937085 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55db11326a30 con 0x55db11318520 2024-09-11T22:17:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.147+0000 7faec1ffb640 1 -- 172.21.15.152:0/2234937085 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed0036030 con 0x55db11318520 2024-09-11T22:17:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.147+0000 7faec1ffb640 1 -- 172.21.15.152:0/2234937085 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7faec8096c10 con 0x55db11318520 2024-09-11T22:17:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.147+0000 7faee271c740 10 client.28024 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.148+0000 7faee271c740 10 client.28024 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.148+0000 7faee271c740 20 client.28024 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.148+0000 7faee271c740 1 --2- 172.21.15.152:0/2234937085 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55db11328440 0x55db1132a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.148+0000 7faee271c740 4 client.28024 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.148+0000 7faee271c740 1 -- 172.21.15.152:0/2234937085 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db11280860 con 0x55db11328440 2024-09-11T22:17:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.148+0000 7faede0df640 1 --2- 172.21.15.152:0/2234937085 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55db11328440 0x55db1132a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.148+0000 7faede0df640 1 --2- 172.21.15.152:0/2234937085 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55db11328440 0x55db1132a900 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ccc429e9960275 server_cookie=dde7dd4ecb48d9f2 in_seq=0 out_seq=0 2024-09-11T22:17:03.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.148+0000 7faec1ffb640 10 client.28024 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faec1ffb640 1 -- 172.21.15.152:0/2234937085 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db11280860 con 0x55db11328440 2024-09-11T22:17:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faec1ffb640 10 client.28024 handle_command_reply: tid=0 2024-09-11T22:17:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faee271c740 1 client.28024 shutdown 2024-09-11T22:17:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faee271c740 1 -- 172.21.15.152:0/2234937085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db11318520 msgr2=0x55db113155b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faee271c740 1 --2- 172.21.15.152:0/2234937085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db11318520 0x55db113155b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faec800b360 tx=0x7faec809b680 comp rx=0 tx=0).stop 2024-09-11T22:17:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faee271c740 1 -- 172.21.15.152:0/2234937085 shutdown_connections 2024-09-11T22:17:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faee271c740 1 --2- 172.21.15.152:0/2234937085 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55db11328440 0x55db1132a900 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faee271c740 1 --2- 172.21.15.152:0/2234937085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db11318520 0x55db113155b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faee271c740 1 --2- 172.21.15.152:0/2234937085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db1130ecf0 0x55db11315070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faee271c740 1 --2- 172.21.15.152:0/2234937085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130d780 0x55db11317dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faee271c740 1 -- 172.21.15.152:0/2234937085 >> 172.21.15.152:0/2234937085 conn(0x55db112d6310 msgr2=0x55db1130fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faec1ffb640 0 client.28024 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faee271c740 1 -- 172.21.15.152:0/2234937085 shutdown_connections 2024-09-11T22:17:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.149+0000 7faee271c740 1 -- 172.21.15.152:0/2234937085 wait complete. 2024-09-11T22:17:03.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.150+0000 7faee271c740 20 client.28024 trim_cache size 0 max 16384 2024-09-11T22:17:03.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.168+0000 7faee271c740 1 Processor -- start 2024-09-11T22:17:03.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.168+0000 7faee271c740 1 -- start start 2024-09-11T22:17:03.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.168+0000 7faee271c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130d780 0x55db11324370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.168+0000 7faee271c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130ecf0 0x55db11315030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.168+0000 7faee271c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db11318520 0x55db11315570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.168+0000 7faee271c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faebc0111e0 con 0x55db11318520 2024-09-11T22:17:03.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.168+0000 7faee271c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faebc00eab0 con 0x55db1130ecf0 2024-09-11T22:17:03.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.168+0000 7faee271c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faebc00c920 con 0x55db1130d780 2024-09-11T22:17:03.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.169+0000 7faede0df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130d780 0x55db11324370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.169+0000 7faede0df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130d780 0x55db11324370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:33142/0 (socket says 172.21.15.152:33142) 2024-09-11T22:17:03.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.169+0000 7faede0df640 1 -- 172.21.15.152:0/4000705193 learned_addr learned my addr 172.21.15.152:0/4000705193 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:03.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.169+0000 7faedd8de640 1 --2- 172.21.15.152:0/4000705193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130ecf0 0x55db11315030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.169+0000 7faedd8de640 1 -- 172.21.15.152:0/4000705193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130d780 msgr2=0x55db11324370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:03.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.169+0000 7faedd8de640 1 --2- 172.21.15.152:0/4000705193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130d780 0x55db11324370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.169+0000 7faedd8de640 1 -- 172.21.15.152:0/4000705193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db11318520 msgr2=0x55db11315570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:03.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.169+0000 7faedd8de640 1 --2- 172.21.15.152:0/4000705193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db11318520 0x55db11315570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.169+0000 7faedd8de640 1 -- 172.21.15.152:0/4000705193 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db113163f0 con 0x55db1130ecf0 2024-09-11T22:17:03.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.170+0000 7faedd8de640 1 --2- 172.21.15.152:0/4000705193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130ecf0 0x55db11315030 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55db11314900 tx=0x7faed40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a5cec268bb65019 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.170+0000 7faec3fff640 1 -- 172.21.15.152:0/4000705193 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed400fa10 con 0x55db1130ecf0 2024-09-11T22:17:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.171+0000 7faec3fff640 1 -- 172.21.15.152:0/4000705193 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed4023070 con 0x55db1130ecf0 2024-09-11T22:17:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.171+0000 7faec3fff640 1 -- 172.21.15.152:0/4000705193 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed401e400 con 0x55db1130ecf0 2024-09-11T22:17:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 -- 172.21.15.152:0/4000705193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130ecf0 msgr2=0x55db11315030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 --2- 172.21.15.152:0/4000705193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130ecf0 0x55db11315030 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55db11314900 tx=0x7faed40046c0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 -- 172.21.15.152:0/4000705193 shutdown_connections 2024-09-11T22:17:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 --2- 172.21.15.152:0/4000705193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db11318520 0x55db11315570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 --2- 172.21.15.152:0/4000705193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db1130ecf0 0x55db11315030 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 --2- 172.21.15.152:0/4000705193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130d780 0x55db11324370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 -- 172.21.15.152:0/4000705193 >> 172.21.15.152:0/4000705193 conn(0x55db112d6310 msgr2=0x55db1131a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 -- 172.21.15.152:0/4000705193 shutdown_connections 2024-09-11T22:17:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 -- 172.21.15.152:0/4000705193 wait complete. 2024-09-11T22:17:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 -- start start 2024-09-11T22:17:03.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 Processor -- start 2024-09-11T22:17:03.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130d780 0x55db113116a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db1130ecf0 0x55db11311be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db11318520 0x55db1131f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faebc00cf70 con 0x55db1130ecf0 2024-09-11T22:17:03.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.172+0000 7faee271c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faebc00e3e0 con 0x55db11318520 2024-09-11T22:17:03.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faee271c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faebc00d640 con 0x55db1130d780 2024-09-11T22:17:03.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faee271c740 10 client.0 _ll_register_callbacks cb 0x7faec80096d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:03.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faedd8de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db1130ecf0 0x55db11311be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faede0df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130d780 0x55db113116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faede8e0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db11318520 0x55db1131f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faedd8de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db1130ecf0 0x55db11311be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38756/0 (socket says 172.21.15.152:38756) 2024-09-11T22:17:03.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faedd8de640 1 -- 172.21.15.152:0/733765751 learned_addr learned my addr 172.21.15.152:0/733765751 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:03.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faede8e0640 1 -- 172.21.15.152:0/733765751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130d780 msgr2=0x55db113116a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:03.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faede8e0640 1 --2- 172.21.15.152:0/733765751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130d780 0x55db113116a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faede8e0640 1 -- 172.21.15.152:0/733765751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db1130ecf0 msgr2=0x55db11311be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:03.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faede8e0640 1 --2- 172.21.15.152:0/733765751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db1130ecf0 0x55db11311be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faede8e0640 1 -- 172.21.15.152:0/733765751 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1131fa20 con 0x55db11318520 2024-09-11T22:17:03.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faede8e0640 1 --2- 172.21.15.152:0/733765751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db11318520 0x55db1131f4e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faec8097320 tx=0x7faec809b680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ec2a5ceff1f493a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:03.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:17:03.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faec1ffb640 1 -- 172.21.15.152:0/733765751 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec80a7070 con 0x55db11318520 2024-09-11T22:17:03.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faec1ffb640 1 -- 172.21.15.152:0/733765751 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7faec8097530 con 0x55db11318520 2024-09-11T22:17:03.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.173+0000 7faee271c740 1 -- 172.21.15.152:0/733765751 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed4023070 con 0x55db11318520 2024-09-11T22:17:03.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faec1ffb640 1 -- 172.21.15.152:0/733765751 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faec8020050 con 0x55db11318520 2024-09-11T22:17:03.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faee271c740 10 client.27881 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:03.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faee271c740 1 -- 172.21.15.152:0/733765751 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55db11320ce0 con 0x55db11318520 2024-09-11T22:17:03.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faec1ffb640 1 -- 172.21.15.152:0/733765751 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed4023070 con 0x55db11318520 2024-09-11T22:17:03.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faec1ffb640 1 -- 172.21.15.152:0/733765751 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7faec8005510 con 0x55db11318520 2024-09-11T22:17:03.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faee271c740 10 client.27881 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:03.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faee271c740 10 client.27881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:03.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faee271c740 20 client.27881 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:03.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faee271c740 1 --2- 172.21.15.152:0/733765751 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55db113931e0 0x55db113955d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:03.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faee271c740 4 client.27881 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:17:03.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faee271c740 1 -- 172.21.15.152:0/733765751 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55db1127ad70 con 0x55db113931e0 2024-09-11T22:17:03.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.174+0000 7faede0df640 1 --2- 172.21.15.152:0/733765751 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55db113931e0 0x55db113955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:03.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.175+0000 7faec1ffb640 10 client.27881 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:03.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.175+0000 7faede0df640 1 --2- 172.21.15.152:0/733765751 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55db113931e0 0x55db113955d0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c906eef4a84b8ede server_cookie=40f75f585d4ce0ac in_seq=0 out_seq=0 2024-09-11T22:17:03.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.175+0000 7faec1ffb640 1 -- 172.21.15.152:0/733765751 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55db1127ad70 con 0x55db113931e0 2024-09-11T22:17:03.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.175+0000 7faec1ffb640 10 client.27881 handle_command_reply: tid=0 2024-09-11T22:17:03.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.175+0000 7faee271c740 1 client.27881 shutdown 2024-09-11T22:17:03.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.175+0000 7faee271c740 1 -- 172.21.15.152:0/733765751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db11318520 msgr2=0x55db1131f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:03.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.175+0000 7faee271c740 1 --2- 172.21.15.152:0/733765751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db11318520 0x55db1131f4e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faec8097320 tx=0x7faec809b680 comp rx=0 tx=0).stop 2024-09-11T22:17:03.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.176+0000 7faee271c740 1 -- 172.21.15.152:0/733765751 shutdown_connections 2024-09-11T22:17:03.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.176+0000 7faee271c740 1 --2- 172.21.15.152:0/733765751 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55db113931e0 0x55db113955d0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.176+0000 7faee271c740 1 --2- 172.21.15.152:0/733765751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55db11318520 0x55db1131f4e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.176+0000 7faee271c740 1 --2- 172.21.15.152:0/733765751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db1130ecf0 0x55db11311be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.176+0000 7faee271c740 1 --2- 172.21.15.152:0/733765751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1130d780 0x55db113116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.176+0000 7faee271c740 1 -- 172.21.15.152:0/733765751 >> 172.21.15.152:0/733765751 conn(0x55db112d6310 msgr2=0x55db11313750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:03.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.176+0000 7faec1ffb640 0 client.27881 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:03.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.176+0000 7faee271c740 1 -- 172.21.15.152:0/733765751 shutdown_connections 2024-09-11T22:17:03.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.176+0000 7faee271c740 1 -- 172.21.15.152:0/733765751 wait complete. 2024-09-11T22:17:03.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.176+0000 7faee271c740 20 client.27881 trim_cache size 0 max 16384 2024-09-11T22:17:03.184 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:17:03.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 -- 172.21.15.152:0/1504691170 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faec40a2e80 msgr2=0x7faec40a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:03.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faec40a2e80 0x7faec40a5340 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55db1130e220 tx=0x7faed4005850 comp rx=0 tx=0).stop 2024-09-11T22:17:03.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 -- 172.21.15.152:0/1504691170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed811b140 msgr2=0x7faed81ab970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:03.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed811b140 0x7faed81ab970 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faed806b4a0 tx=0x7faec800da20 comp rx=0 tx=0).stop 2024-09-11T22:17:03.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 -- 172.21.15.152:0/1504691170 shutdown_connections 2024-09-11T22:17:03.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7faec40a2e80 0x7faec40a5340 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed811b140 0x7faed81ab970 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faed8110190 0x7faed81a75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 --2- 172.21.15.152:0/1504691170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed806ea30 0x7faed81a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:03.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 -- 172.21.15.152:0/1504691170 >> 172.21.15.152:0/1504691170 conn(0x7faed8073180 msgr2=0x7faed810e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:03.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 -- 172.21.15.152:0/1504691170 shutdown_connections 2024-09-11T22:17:03.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:03.177+0000 7faedf0e1640 1 -- 172.21.15.152:0/1504691170 wait complete. 2024-09-11T22:17:03.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:03 smithi152 ceph-mon[31188]: pgmap v398: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 462 op/s 2024-09-11T22:17:04.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:03 smithi179 ceph-mon[35603]: pgmap v398: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 462 op/s 2024-09-11T22:17:04.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:03 smithi193 ceph-mon[35545]: pgmap v398: 97 pgs: 97 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 462 op/s 2024-09-11T22:17:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 690.0 s, 1448.6 tps, lat 69.197 ms stddev 108.944 2024-09-11T22:17:05.215 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:17:05.216 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:17:05.633 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:05.703 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:05 smithi152 ceph-mon[31188]: pgmap v399: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 17 MiB/s wr, 1.50k op/s 2024-09-11T22:17:06.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:05 smithi179 ceph-mon[35603]: pgmap v399: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 17 MiB/s wr, 1.50k op/s 2024-09-11T22:17:06.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:05 smithi193 ceph-mon[35545]: pgmap v399: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 17 MiB/s wr, 1.50k op/s 2024-09-11T22:17:06.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.393+0000 7f6876279640 1 -- 172.21.15.152:0/2927956410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6870100a70 msgr2=0x7f6870100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:06.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.393+0000 7f6876279640 1 --2- 172.21.15.152:0/2927956410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6870100a70 0x7f6870100ed0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6864009930 tx=0x7f686402a420 comp rx=0 tx=0).stop 2024-09-11T22:17:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.393+0000 7f6876279640 1 -- 172.21.15.152:0/2927956410 shutdown_connections 2024-09-11T22:17:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.393+0000 7f6876279640 1 --2- 172.21.15.152:0/2927956410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6870101410 0x7f687010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.393+0000 7f6876279640 1 --2- 172.21.15.152:0/2927956410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6870100a70 0x7f6870100ed0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.393+0000 7f6876279640 1 --2- 172.21.15.152:0/2927956410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6870106a70 0x7f6870106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.393+0000 7f6876279640 1 -- 172.21.15.152:0/2927956410 >> 172.21.15.152:0/2927956410 conn(0x7f68700fc790 msgr2=0x7f68700febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.393+0000 7f6876279640 1 -- 172.21.15.152:0/2927956410 shutdown_connections 2024-09-11T22:17:06.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.393+0000 7f6876279640 1 -- 172.21.15.152:0/2927956410 wait complete. 2024-09-11T22:17:06.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.394+0000 7f6876279640 1 Processor -- start 2024-09-11T22:17:06.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.394+0000 7f6876279640 1 -- start start 2024-09-11T22:17:06.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.395+0000 7f6876279640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6870100a70 0x7f6870198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.395+0000 7f6876279640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6870101410 0x7f68701989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.395+0000 7f6876279640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6870106a70 0x7f687019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.395+0000 7f6876279640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6870111fc0 con 0x7f6870101410 2024-09-11T22:17:06.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.395+0000 7f6876279640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6870111e40 con 0x7f6870106a70 2024-09-11T22:17:06.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.395+0000 7f6874816640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6870106a70 0x7f687019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.395+0000 7f6874816640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6870106a70 0x7f687019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:56000/0 (socket says 172.21.15.152:56000) 2024-09-11T22:17:06.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.395+0000 7f6874816640 1 -- 172.21.15.152:0/2921031650 learned_addr learned my addr 172.21.15.152:0/2921031650 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:06.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.395+0000 7f6876279640 1 -- 172.21.15.152:0/2921031650 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6870112140 con 0x7f6870100a70 2024-09-11T22:17:06.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.395+0000 7f686f7fe640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6870101410 0x7f68701989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.396+0000 7f6874816640 1 -- 172.21.15.152:0/2921031650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6870100a70 msgr2=0x7f6870198460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:17:06.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.396+0000 7f6874816640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6870100a70 0x7f6870198460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.396+0000 7f6874816640 1 -- 172.21.15.152:0/2921031650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6870101410 msgr2=0x7f68701989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:06.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.396+0000 7f6874816640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6870101410 0x7f68701989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.396+0000 7f6874816640 1 -- 172.21.15.152:0/2921031650 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687019d410 con 0x7f6870106a70 2024-09-11T22:17:06.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.396+0000 7f686f7fe640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6870101410 0x7f68701989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:06.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.396+0000 7f6874816640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6870106a70 0x7f687019cd30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f686800eb10 tx=0x7f686800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:06.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.397+0000 7f686d7fa640 1 -- 172.21.15.152:0/2921031650 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868004b20 con 0x7f6870106a70 2024-09-11T22:17:06.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.397+0000 7f686d7fa640 1 -- 172.21.15.152:0/2921031650 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6868004cc0 con 0x7f6870106a70 2024-09-11T22:17:06.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.398+0000 7f686d7fa640 1 -- 172.21.15.152:0/2921031650 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868005650 con 0x7f6870106a70 2024-09-11T22:17:06.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.398+0000 7f6876279640 1 -- 172.21.15.152:0/2921031650 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687019d700 con 0x7f6870106a70 2024-09-11T22:17:06.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.398+0000 7f6876279640 1 -- 172.21.15.152:0/2921031650 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f687019db50 con 0x7f6870106a70 2024-09-11T22:17:06.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.401+0000 7f686d7fa640 1 -- 172.21.15.152:0/2921031650 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f6868005810 con 0x7f6870106a70 2024-09-11T22:17:06.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.401+0000 7f6878652740 1 Processor -- start 2024-09-11T22:17:06.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.402+0000 7f686d7fa640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68580a2e40 0x7f68580a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.403+0000 7f686d7fa640 1 -- 172.21.15.152:0/2921031650 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f68680d3a90 con 0x7f6870106a70 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.403+0000 7f686f7fe640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68580a2e40 0x7f68580a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.404+0000 7f6878652740 1 -- start start 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.404+0000 7f6878652740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.404+0000 7f6878652740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309a1480 0x55fa309ab800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.404+0000 7f6878652740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309abd40 0x55fa309ae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.404+0000 7f6878652740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fa30906280 con 0x55fa309abd40 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.404+0000 7f6878652740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fa308adb10 con 0x55fa309a1480 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.404+0000 7f6878652740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fa30902240 con 0x55fa309a0b60 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.404+0000 7f6874816640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309abd40 0x55fa309ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.404+0000 7f686ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.404+0000 7f686ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:45228/0 (socket says 172.21.15.152:45228) 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.404+0000 7f686ffff640 1 -- 172.21.15.152:0/1294631088 learned_addr learned my addr 172.21.15.152:0/1294631088 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.405+0000 7f686f7fe640 1 --2- 172.21.15.152:0/1294631088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309a1480 0x55fa309ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f686ffff640 1 -- 172.21.15.152:0/1294631088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309a1480 msgr2=0x55fa309ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f686ffff640 1 --2- 172.21.15.152:0/1294631088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309a1480 0x55fa309ab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f686ffff640 1 -- 172.21.15.152:0/1294631088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309abd40 msgr2=0x55fa309ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f686ffff640 1 --2- 172.21.15.152:0/1294631088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309abd40 0x55fa309ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f686ffff640 1 -- 172.21.15.152:0/1294631088 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa308ba1f0 con 0x55fa309a0b60 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f6874816640 1 --2- 172.21.15.152:0/1294631088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309abd40 0x55fa309ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f686f7fe640 1 --2- 172.21.15.152:0/1294631088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309a1480 0x55fa309ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f686f7fe640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68580a2e40 0x7f68580a5300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6864006010 tx=0x7f6864004230 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f686ffff640 1 --2- 172.21.15.152:0/1294631088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a0f40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6860009b50 tx=0x7f686000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9ec1315ec058871 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f68567fc640 1 -- 172.21.15.152:0/1294631088 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860009e40 con 0x55fa309a0b60 2024-09-11T22:17:06.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f68567fc640 1 -- 172.21.15.152:0/1294631088 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6860005500 con 0x55fa309a0b60 2024-09-11T22:17:06.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.406+0000 7f68567fc640 1 -- 172.21.15.152:0/1294631088 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860010690 con 0x55fa309a0b60 2024-09-11T22:17:06.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.407+0000 7f6878652740 1 -- 172.21.15.152:0/1294631088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 msgr2=0x55fa309a0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:06.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.407+0000 7f6878652740 1 --2- 172.21.15.152:0/1294631088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a0f40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6860009b50 tx=0x7f686000e720 comp rx=0 tx=0).stop 2024-09-11T22:17:06.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 -- 172.21.15.152:0/1294631088 shutdown_connections 2024-09-11T22:17:06.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 --2- 172.21.15.152:0/1294631088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309abd40 0x55fa309ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 --2- 172.21.15.152:0/1294631088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309a1480 0x55fa309ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 --2- 172.21.15.152:0/1294631088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a0f40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 -- 172.21.15.152:0/1294631088 >> 172.21.15.152:0/1294631088 conn(0x55fa3099d0f0 msgr2=0x55fa3099d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 -- 172.21.15.152:0/1294631088 shutdown_connections 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 -- 172.21.15.152:0/1294631088 wait complete. 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 -- start start 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 Processor -- start 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a1480 0x55fa309a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309abd40 0x55fa309a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fa309bf970 con 0x55fa309a1480 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fa308c0f10 con 0x55fa309abd40 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.408+0000 7f6878652740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fa309bfaf0 con 0x55fa309a0b60 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f6878652740 10 client.0 _ll_register_callbacks cb 0x55fa30889a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a1480 0x55fa309a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a1480 0x55fa309a8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57794/0 (socket says 172.21.15.152:57794) 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f686f7fe640 1 -- 172.21.15.152:0/1227283729 learned_addr learned my addr 172.21.15.152:0/1227283729 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f686ffff640 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f6874816640 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309abd40 0x55fa309a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f6874816640 1 -- 172.21.15.152:0/1227283729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 msgr2=0x55fa309ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f6874816640 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f6874816640 1 -- 172.21.15.152:0/1227283729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a1480 msgr2=0x55fa309a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f6874816640 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a1480 0x55fa309a8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f6874816640 1 -- 172.21.15.152:0/1227283729 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa306776a0 con 0x55fa309abd40 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f686ffff640 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f6874816640 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309abd40 0x55fa309a92c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f68680d1230 tx=0x7f68680a00c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b53d7312d5a8c397 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f684f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f684f7fe640 1 -- 172.21.15.152:0/1227283729 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68680d15a0 con 0x55fa309abd40 2024-09-11T22:17:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f6878652740 1 -- 172.21.15.152:0/1227283729 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6860005500 con 0x55fa309abd40 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.409+0000 7f684f7fe640 1 -- 172.21.15.152:0/1227283729 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f68680a87e0 con 0x55fa309abd40 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f684f7fe640 1 -- 172.21.15.152:0/1227283729 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f68680a89e0 con 0x55fa309abd40 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f6878652740 10 client.27893 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f6878652740 1 -- 172.21.15.152:0/1227283729 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fa309d3cf0 con 0x55fa309abd40 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f684f7fe640 1 -- 172.21.15.152:0/1227283729 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6860005500 con 0x55fa309abd40 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f684f7fe640 1 -- 172.21.15.152:0/1227283729 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f686809eec0 con 0x55fa309abd40 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f6878652740 10 client.27893 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f6878652740 10 client.27893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f6878652740 20 client.27893 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f6878652740 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fa309d5100 0x55fa309d7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f6878652740 4 client.27893 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f6878652740 1 -- 172.21.15.152:0/1227283729 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa309137f0 con 0x55fa309d5100 2024-09-11T22:17:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f686ffff640 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fa309d5100 0x55fa309d7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f684f7fe640 10 client.27893 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.410+0000 7f686ffff640 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fa309d5100 0x55fa309d7530 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=984d9c38bd62bb3f server_cookie=602d0c2fda437f20 in_seq=0 out_seq=0 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f684f7fe640 1 -- 172.21.15.152:0/1227283729 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa309137f0 con 0x55fa309d5100 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f684f7fe640 10 client.27893 handle_command_reply: tid=0 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f6878652740 1 client.27893 shutdown 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f6878652740 1 -- 172.21.15.152:0/1227283729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309abd40 msgr2=0x55fa309a92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f6878652740 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309abd40 0x55fa309a92c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f68680d1230 tx=0x7f68680a00c0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f6878652740 1 -- 172.21.15.152:0/1227283729 shutdown_connections 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f6878652740 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fa309d5100 0x55fa309d7530 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f6878652740 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309abd40 0x55fa309a92c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f6878652740 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a1480 0x55fa309a8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f6878652740 1 --2- 172.21.15.152:0/1227283729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f6878652740 1 -- 172.21.15.152:0/1227283729 >> 172.21.15.152:0/1227283729 conn(0x55fa3099d0f0 msgr2=0x55fa3099c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f684f7fe640 0 client.27893 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f6878652740 1 -- 172.21.15.152:0/1227283729 shutdown_connections 2024-09-11T22:17:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.411+0000 7f6878652740 1 -- 172.21.15.152:0/1227283729 wait complete. 2024-09-11T22:17:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.412+0000 7f6878652740 20 client.27893 trim_cache size 0 max 16384 2024-09-11T22:17:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f6878652740 1 Processor -- start 2024-09-11T22:17:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f6878652740 1 -- start start 2024-09-11T22:17:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f6878652740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f6878652740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309a1480 0x55fa309aa990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f6878652740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309abd40 0x55fa309dce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f6878652740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68701a5840 con 0x55fa309abd40 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f6878652740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6870072540 con 0x55fa309a1480 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f6878652740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f68700703b0 con 0x55fa309a0b60 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f686ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f686ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:45236/0 (socket says 172.21.15.152:45236) 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f686ffff640 1 -- 172.21.15.152:0/3549570692 learned_addr learned my addr 172.21.15.152:0/3549570692 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.438+0000 7f686f7fe640 1 --2- 172.21.15.152:0/3549570692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309a1480 0x55fa309aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.439+0000 7f6874816640 1 --2- 172.21.15.152:0/3549570692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309abd40 0x55fa309dce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.439+0000 7f686ffff640 1 -- 172.21.15.152:0/3549570692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309a1480 msgr2=0x55fa309aa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.439+0000 7f686ffff640 1 --2- 172.21.15.152:0/3549570692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309a1480 0x55fa309aa990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.439+0000 7f686ffff640 1 -- 172.21.15.152:0/3549570692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309abd40 msgr2=0x55fa309dce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.439+0000 7f686ffff640 1 --2- 172.21.15.152:0/3549570692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309abd40 0x55fa309dce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.439+0000 7f686ffff640 1 -- 172.21.15.152:0/3549570692 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3099cf20 con 0x55fa309a0b60 2024-09-11T22:17:06.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.439+0000 7f686ffff640 1 --2- 172.21.15.152:0/3549570692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a7a70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6860004d50 tx=0x7f68600096e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc71b66129356b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:06.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.439+0000 7f6855ffb640 1 -- 172.21.15.152:0/3549570692 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686001d040 con 0x55fa309a0b60 2024-09-11T22:17:06.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.439+0000 7f6855ffb640 1 -- 172.21.15.152:0/3549570692 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68600052d0 con 0x55fa309a0b60 2024-09-11T22:17:06.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.439+0000 7f6855ffb640 1 -- 172.21.15.152:0/3549570692 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860003d70 con 0x55fa309a0b60 2024-09-11T22:17:06.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.440+0000 7f6878652740 1 -- 172.21.15.152:0/3549570692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 msgr2=0x55fa309a7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:06.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.440+0000 7f6878652740 1 --2- 172.21.15.152:0/3549570692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a7a70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6860004d50 tx=0x7f68600096e0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.440+0000 7f6878652740 1 -- 172.21.15.152:0/3549570692 shutdown_connections 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.441+0000 7f6878652740 1 --2- 172.21.15.152:0/3549570692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309abd40 0x55fa309dce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.441+0000 7f6878652740 1 --2- 172.21.15.152:0/3549570692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309a1480 0x55fa309aa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.441+0000 7f6878652740 1 --2- 172.21.15.152:0/3549570692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a0b60 0x55fa309a7a70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.441+0000 7f6878652740 1 -- 172.21.15.152:0/3549570692 >> 172.21.15.152:0/3549570692 conn(0x55fa3099d0f0 msgr2=0x55fa309aa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.441+0000 7f6878652740 1 -- 172.21.15.152:0/3549570692 shutdown_connections 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.441+0000 7f6878652740 1 -- 172.21.15.152:0/3549570692 wait complete. 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.441+0000 7f6878652740 1 -- start start 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.441+0000 7f6878652740 1 Processor -- start 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.442+0000 7f6878652740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a0b60 0x55fa309cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.442+0000 7f6878652740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a1480 0x55fa309c8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.442+0000 7f6878652740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309abd40 0x55fa309c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.442+0000 7f6878652740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6870070a00 con 0x55fa309a0b60 2024-09-11T22:17:06.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.442+0000 7f6878652740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6870071e70 con 0x55fa309abd40 2024-09-11T22:17:06.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.442+0000 7f6878652740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f68700710d0 con 0x55fa309a1480 2024-09-11T22:17:06.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.442+0000 7f6878652740 10 client.0 _ll_register_callbacks cb 0x7f68680a0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:06.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.442+0000 7f6874816640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309abd40 0x55fa309c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.443+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a1480 0x55fa309c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.444+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a1480 0x55fa309c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:45242/0 (socket says 172.21.15.152:45242) 2024-09-11T22:17:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.444+0000 7f686f7fe640 1 -- 172.21.15.152:0/2962321334 learned_addr learned my addr 172.21.15.152:0/2962321334 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.444+0000 7f686ffff640 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a0b60 0x55fa309cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.444+0000 7f686ffff640 1 -- 172.21.15.152:0/2962321334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a1480 msgr2=0x55fa309c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.444+0000 7f686ffff640 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a1480 0x55fa309c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.444+0000 7f686ffff640 1 -- 172.21.15.152:0/2962321334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309abd40 msgr2=0x55fa309c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.444+0000 7f686ffff640 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309abd40 0x55fa309c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.444+0000 7f686ffff640 1 -- 172.21.15.152:0/2962321334 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa309c9040 con 0x55fa309a0b60 2024-09-11T22:17:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.445+0000 7f686ffff640 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a0b60 0x55fa309cdaf0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6860009250 tx=0x7f68600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f5a2e4f35e0a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.445+0000 7f684f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.445+0000 7f684f7fe640 1 -- 172.21.15.152:0/2962321334 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600035f0 con 0x55fa309a0b60 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.445+0000 7f684f7fe640 1 -- 172.21.15.152:0/2962321334 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f6860003950 con 0x55fa309a0b60 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.445+0000 7f6878652740 1 -- 172.21.15.152:0/2962321334 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68600052d0 con 0x55fa309a0b60 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.445+0000 7f684f7fe640 1 -- 172.21.15.152:0/2962321334 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6860040050 con 0x55fa309a0b60 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.445+0000 7f6878652740 10 client.18651 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.445+0000 7f6878652740 1 -- 172.21.15.152:0/2962321334 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fa30a40b70 con 0x55fa309a0b60 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.446+0000 7f684f7fe640 1 -- 172.21.15.152:0/2962321334 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6860032070 con 0x55fa309a0b60 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.446+0000 7f684f7fe640 1 -- 172.21.15.152:0/2962321334 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f6860029770 con 0x55fa309a0b60 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.446+0000 7f6878652740 10 client.18651 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.446+0000 7f6878652740 10 client.18651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.446+0000 7f6878652740 20 client.18651 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.446+0000 7f6878652740 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fa30a40fe0 0x55fa30a433d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:06.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.446+0000 7f6878652740 4 client.18651 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:17:06.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.446+0000 7f6878652740 1 -- 172.21.15.152:0/2962321334 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f68600052d0 con 0x55fa30a40fe0 2024-09-11T22:17:06.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.446+0000 7f686f7fe640 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fa30a40fe0 0x55fa30a433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:06.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.447+0000 7f686f7fe640 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fa30a40fe0 0x55fa30a433d0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d181f38e0f3e308 server_cookie=8acab9ca5baeadf2 in_seq=0 out_seq=0 2024-09-11T22:17:06.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.447+0000 7f684f7fe640 10 client.18651 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:06.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f684f7fe640 1 -- 172.21.15.152:0/2962321334 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f68600052d0 con 0x55fa30a40fe0 2024-09-11T22:17:06.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f684f7fe640 10 client.18651 handle_command_reply: tid=0 2024-09-11T22:17:06.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 1 client.18651 shutdown 2024-09-11T22:17:06.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 1 -- 172.21.15.152:0/2962321334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a0b60 msgr2=0x55fa309cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:06.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a0b60 0x55fa309cdaf0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6860009250 tx=0x7f68600057f0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 1 -- 172.21.15.152:0/2962321334 shutdown_connections 2024-09-11T22:17:06.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fa30a40fe0 0x55fa30a433d0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fa309abd40 0x55fa309c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fa309a1480 0x55fa309c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 1 --2- 172.21.15.152:0/2962321334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa309a0b60 0x55fa309cdaf0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f684f7fe640 0 client.18651 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:06.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 1 -- 172.21.15.152:0/2962321334 >> 172.21.15.152:0/2962321334 conn(0x55fa3099d0f0 msgr2=0x55fa3099c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:06.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 1 -- 172.21.15.152:0/2962321334 shutdown_connections 2024-09-11T22:17:06.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 1 -- 172.21.15.152:0/2962321334 wait complete. 2024-09-11T22:17:06.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.448+0000 7f6878652740 20 client.18651 trim_cache size 0 max 16384 2024-09-11T22:17:06.451 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:17:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:17:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "a12ffe09-698a-4823-9002-76047df573c9", 2024-09-11T22:17:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:17:06.452 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:17:06.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.449+0000 7f6876279640 1 -- 172.21.15.152:0/2921031650 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68580a2e40 msgr2=0x7f68580a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:06.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.449+0000 7f6876279640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68580a2e40 0x7f68580a5300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6864006010 tx=0x7f6864004230 comp rx=0 tx=0).stop 2024-09-11T22:17:06.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.449+0000 7f6876279640 1 -- 172.21.15.152:0/2921031650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6870106a70 msgr2=0x7f687019cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:06.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.449+0000 7f6876279640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6870106a70 0x7f687019cd30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f686800eb10 tx=0x7f686800c2d0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.449+0000 7f6876279640 1 -- 172.21.15.152:0/2921031650 shutdown_connections 2024-09-11T22:17:06.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.449+0000 7f6876279640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f68580a2e40 0x7f68580a5300 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.449+0000 7f6876279640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6870106a70 0x7f687019cd30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.449+0000 7f6876279640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6870101410 0x7f68701989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.449+0000 7f6876279640 1 --2- 172.21.15.152:0/2921031650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6870100a70 0x7f6870198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:06.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.449+0000 7f6876279640 1 -- 172.21.15.152:0/2921031650 >> 172.21.15.152:0/2921031650 conn(0x7f68700fc790 msgr2=0x7f68700fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:06.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.451+0000 7f6876279640 1 -- 172.21.15.152:0/2921031650 shutdown_connections 2024-09-11T22:17:06.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:06.451+0000 7f6876279640 1 -- 172.21.15.152:0/2921031650 wait complete. 2024-09-11T22:17:07.209 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:06 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:17:07.209 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:06 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:07.209 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:06 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:17:07.209 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:06 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:07.250 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:17:07.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:06 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:17:07.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:06 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:07.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:06 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:17:07.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:06 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:07.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:06 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:17:07.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:06 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:07.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:06 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:17:07.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:06 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:07.656 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:08.088 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:07 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:17:08.088 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:08 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:08.088 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:08 smithi152 ceph-mon[31188]: pgmap v400: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 16 MiB/s wr, 1.39k op/s 2024-09-11T22:17:08.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.218+0000 7f4897a07640 1 -- 172.21.15.152:0/3139600683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48901091f0 msgr2=0x7f48901095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:08.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.218+0000 7f4897a07640 1 --2- 172.21.15.152:0/3139600683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48901091f0 0x7f48901095d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4888009ca0 tx=0x7f488802a980 comp rx=0 tx=0).stop 2024-09-11T22:17:08.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.219+0000 7f4897a07640 1 -- 172.21.15.152:0/3139600683 shutdown_connections 2024-09-11T22:17:08.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.219+0000 7f4897a07640 1 --2- 172.21.15.152:0/3139600683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4890114ab0 0x7f4890116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.219+0000 7f4897a07640 1 --2- 172.21.15.152:0/3139600683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4890109b10 0x7f4890114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.219+0000 7f4897a07640 1 --2- 172.21.15.152:0/3139600683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48901091f0 0x7f48901095d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.219+0000 7f4897a07640 1 -- 172.21.15.152:0/3139600683 >> 172.21.15.152:0/3139600683 conn(0x7f489006e140 msgr2=0x7f489006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:08.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.221+0000 7f4897a07640 1 -- 172.21.15.152:0/3139600683 shutdown_connections 2024-09-11T22:17:08.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.221+0000 7f4897a07640 1 -- 172.21.15.152:0/3139600683 wait complete. 2024-09-11T22:17:08.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.222+0000 7f4897a07640 1 Processor -- start 2024-09-11T22:17:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.222+0000 7f4897a07640 1 -- start start 2024-09-11T22:17:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.223+0000 7f4897a07640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48901091f0 0x7f489010a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.223+0000 7f4897a07640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4890109b10 0x7f489010a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.223+0000 7f4897a07640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4890114ab0 0x7f489010ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.223+0000 7f4897a07640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f489011a850 con 0x7f4890109b10 2024-09-11T22:17:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.223+0000 7f4897a07640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f489011a6d0 con 0x7f48901091f0 2024-09-11T22:17:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.223+0000 7f4897a07640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f489011a9d0 con 0x7f4890114ab0 2024-09-11T22:17:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.223+0000 7f4894fa2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4890109b10 0x7f489010a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.223+0000 7f4894fa2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4890109b10 0x7f489010a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57812/0 (socket says 172.21.15.152:57812) 2024-09-11T22:17:08.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.223+0000 7f4894fa2640 1 -- 172.21.15.152:0/1836807787 learned_addr learned my addr 172.21.15.152:0/1836807787 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:08.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.223+0000 7f48957a3640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48901091f0 0x7f489010a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.224+0000 7f4895fa4640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4890114ab0 0x7f489010ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.224+0000 7f4894fa2640 1 -- 172.21.15.152:0/1836807787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4890114ab0 msgr2=0x7f489010ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:08.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.224+0000 7f4894fa2640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4890114ab0 0x7f489010ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.224+0000 7f4894fa2640 1 -- 172.21.15.152:0/1836807787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48901091f0 msgr2=0x7f489010a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:08.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.224+0000 7f4894fa2640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48901091f0 0x7f489010a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.224+0000 7f4894fa2640 1 -- 172.21.15.152:0/1836807787 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48901b3700 con 0x7f4890109b10 2024-09-11T22:17:08.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.224+0000 7f4895fa4640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4890114ab0 0x7f489010ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:17:08.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.224+0000 7f48957a3640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48901091f0 0x7f489010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:08.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.224+0000 7f4894fa2640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4890109b10 0x7f489010a910 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f488c00e9f0 tx=0x7f488c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:08.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.226+0000 7f48867fc640 1 -- 172.21.15.152:0/1836807787 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c00cd80 con 0x7f4890109b10 2024-09-11T22:17:08.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.226+0000 7f48867fc640 1 -- 172.21.15.152:0/1836807787 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f488c010910 con 0x7f4890109b10 2024-09-11T22:17:08.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.226+0000 7f48867fc640 1 -- 172.21.15.152:0/1836807787 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c018990 con 0x7f4890109b10 2024-09-11T22:17:08.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.226+0000 7f4897a07640 1 -- 172.21.15.152:0/1836807787 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48901b3930 con 0x7f4890109b10 2024-09-11T22:17:08.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.226+0000 7f4897a07640 1 -- 172.21.15.152:0/1836807787 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48901b3e20 con 0x7f4890109b10 2024-09-11T22:17:08.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.230+0000 7f48867fc640 1 -- 172.21.15.152:0/1836807787 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f488c010ac0 con 0x7f4890109b10 2024-09-11T22:17:08.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.231+0000 7f48867fc640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f487c0a2e80 0x7f487c0a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.231+0000 7f48957a3640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f487c0a2e80 0x7f487c0a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.232+0000 7f48867fc640 1 -- 172.21.15.152:0/1836807787 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f488c0cf800 con 0x7f4890109b10 2024-09-11T22:17:08.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.232+0000 7f4899de0740 1 Processor -- start 2024-09-11T22:17:08.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.233+0000 7f4899de0740 1 -- start start 2024-09-11T22:17:08.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.233+0000 7f4899de0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da25d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.234+0000 7f48957a3640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f487c0a2e80 0x7f487c0a5340 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4888000f80 tx=0x7f48880097e0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:08.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.234+0000 7f4899de0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da268140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.234+0000 7f48957a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da25d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.234+0000 7f48957a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da25d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:45284/0 (socket says 172.21.15.152:45284) 2024-09-11T22:17:08.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.234+0000 7f48957a3640 1 -- 172.21.15.152:0/3349926186 learned_addr learned my addr 172.21.15.152:0/3349926186 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:08.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.234+0000 7f4899de0740 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da26aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.234+0000 7f4899de0740 1 -- 172.21.15.152:0/3349926186 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5629da1c32e0 con 0x5629da25ddc0 2024-09-11T22:17:08.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.234+0000 7f4899de0740 1 -- 172.21.15.152:0/3349926186 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5629da16ace0 con 0x5629da268680 2024-09-11T22:17:08.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.234+0000 7f4899de0740 1 -- 172.21.15.152:0/3349926186 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5629da1bf2a0 con 0x5629da25d4a0 2024-09-11T22:17:08.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.234+0000 7f4895fa4640 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da26aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.235+0000 7f4894fa2640 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da268140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.235+0000 7f4894fa2640 1 -- 172.21.15.152:0/3349926186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 msgr2=0x5629da25d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:08.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.235+0000 7f4894fa2640 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da25d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.235+0000 7f4894fa2640 1 -- 172.21.15.152:0/3349926186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 msgr2=0x5629da26aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.235+0000 7f4894fa2640 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da26aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.235+0000 7f4894fa2640 1 -- 172.21.15.152:0/3349926186 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629da14f440 con 0x5629da25ddc0 2024-09-11T22:17:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.235+0000 7f4895fa4640 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da26aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.235+0000 7f48957a3640 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da25d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.236+0000 7f4894fa2640 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da268140 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f488c0ccef0 tx=0x7f488c09bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecdf67e4cae6a81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.236+0000 7f487b7fe640 1 -- 172.21.15.152:0/3349926186 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c0a4930 con 0x5629da25ddc0 2024-09-11T22:17:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.236+0000 7f487b7fe640 1 -- 172.21.15.152:0/3349926186 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f488c0cd170 con 0x5629da25ddc0 2024-09-11T22:17:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.236+0000 7f487b7fe640 1 -- 172.21.15.152:0/3349926186 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c09b370 con 0x5629da25ddc0 2024-09-11T22:17:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.238+0000 7f4899de0740 1 -- 172.21.15.152:0/3349926186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 msgr2=0x5629da268140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.238+0000 7f4899de0740 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da268140 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f488c0ccef0 tx=0x7f488c09bbc0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.238+0000 7f4899de0740 1 -- 172.21.15.152:0/3349926186 shutdown_connections 2024-09-11T22:17:08.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.238+0000 7f4899de0740 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da26aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.238+0000 7f4899de0740 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da268140 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.238+0000 7f4899de0740 1 --2- 172.21.15.152:0/3349926186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da25d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.238+0000 7f4899de0740 1 -- 172.21.15.152:0/3349926186 >> 172.21.15.152:0/3349926186 conn(0x5629da259a30 msgr2=0x5629da259e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:08.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.238+0000 7f4899de0740 1 -- 172.21.15.152:0/3349926186 shutdown_connections 2024-09-11T22:17:08.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.239+0000 7f4899de0740 1 -- 172.21.15.152:0/3349926186 wait complete. 2024-09-11T22:17:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.239+0000 7f4899de0740 1 -- start start 2024-09-11T22:17:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.239+0000 7f4899de0740 1 Processor -- start 2024-09-11T22:17:08.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.240+0000 7f4899de0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da2680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.241+0000 7f4899de0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da265360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.241+0000 7f4899de0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da265af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.241+0000 7f48957a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da2680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.241+0000 7f48957a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da2680b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:45290/0 (socket says 172.21.15.152:45290) 2024-09-11T22:17:08.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.241+0000 7f48957a3640 1 -- 172.21.15.152:0/1793777722 learned_addr learned my addr 172.21.15.152:0/1793777722 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:08.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.241+0000 7f4899de0740 1 -- 172.21.15.152:0/1793777722 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5629da26b250 con 0x5629da25ddc0 2024-09-11T22:17:08.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.241+0000 7f4899de0740 1 -- 172.21.15.152:0/1793777722 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5629da17e050 con 0x5629da268680 2024-09-11T22:17:08.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.241+0000 7f4899de0740 1 -- 172.21.15.152:0/1793777722 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5629da26b3d0 con 0x5629da25d4a0 2024-09-11T22:17:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.241+0000 7f4894fa2640 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da265360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.242+0000 7f48957a3640 1 -- 172.21.15.152:0/1793777722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 msgr2=0x5629da265af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.242+0000 7f48957a3640 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da265af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.242+0000 7f48957a3640 1 -- 172.21.15.152:0/1793777722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 msgr2=0x5629da265360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.242+0000 7f48957a3640 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da265360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.242+0000 7f48957a3640 1 -- 172.21.15.152:0/1793777722 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629d9f343c0 con 0x5629da25d4a0 2024-09-11T22:17:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.242+0000 7f4894fa2640 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da265360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.242+0000 7f4899de0740 10 client.0 _ll_register_callbacks cb 0x5629da1be160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.242+0000 7f48957a3640 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da2680b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4888003e70 tx=0x7f48880095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51b23fc0d4278b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.243+0000 7f4899de0740 1 -- 172.21.15.152:0/1793777722 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f488c0cd170 con 0x5629da25d4a0 2024-09-11T22:17:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.243+0000 7f4878ff9640 10 client.28054 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:17:08.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.243+0000 7f4878ff9640 1 -- 172.21.15.152:0/1793777722 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488802f860 con 0x5629da25d4a0 2024-09-11T22:17:08.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.243+0000 7f4878ff9640 1 -- 172.21.15.152:0/1793777722 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f4888030c00 con 0x5629da25d4a0 2024-09-11T22:17:08.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.243+0000 7f4878ff9640 1 -- 172.21.15.152:0/1793777722 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4888030e00 con 0x5629da25d4a0 2024-09-11T22:17:08.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.244+0000 7f4899de0740 10 client.28054 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:08.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.244+0000 7f4899de0740 1 -- 172.21.15.152:0/1793777722 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5629da276bc0 con 0x5629da25d4a0 2024-09-11T22:17:08.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.244+0000 7f4878ff9640 1 -- 172.21.15.152:0/1793777722 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f488804f020 con 0x5629da25d4a0 2024-09-11T22:17:08.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.245+0000 7f4899de0740 10 client.28054 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:08.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.245+0000 7f4899de0740 10 client.28054 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:08.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.245+0000 7f4899de0740 20 client.28054 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:08.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.245+0000 7f4899de0740 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5629da277fc0 0x5629da27a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.245+0000 7f4899de0740 4 client.28054 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:08.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.245+0000 7f4899de0740 1 -- 172.21.15.152:0/1793777722 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f488c0cd170 con 0x5629da277fc0 2024-09-11T22:17:08.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.245+0000 7f4894fa2640 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5629da277fc0 0x5629da27a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.245+0000 7f4878ff9640 10 client.28054 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:08.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.245+0000 7f4894fa2640 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5629da277fc0 0x5629da27a430 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6a4d88c6679eac6 server_cookie=95cf1c35c9502ed2 in_seq=0 out_seq=0 2024-09-11T22:17:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.246+0000 7f4878ff9640 1 -- 172.21.15.152:0/1793777722 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f488c0cd170 con 0x5629da277fc0 2024-09-11T22:17:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.246+0000 7f4878ff9640 10 client.28054 handle_command_reply: tid=0 2024-09-11T22:17:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 1 client.28054 shutdown 2024-09-11T22:17:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 1 -- 172.21.15.152:0/1793777722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 msgr2=0x5629da2680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da2680b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4888003e70 tx=0x7f48880095c0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 1 -- 172.21.15.152:0/1793777722 shutdown_connections 2024-09-11T22:17:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5629da277fc0 0x5629da27a430 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da265af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da265360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 1 --2- 172.21.15.152:0/1793777722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da2680b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 1 -- 172.21.15.152:0/1793777722 >> 172.21.15.152:0/1793777722 conn(0x5629da259a30 msgr2=0x5629da25f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4878ff9640 0 client.28054 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 1 -- 172.21.15.152:0/1793777722 shutdown_connections 2024-09-11T22:17:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 1 -- 172.21.15.152:0/1793777722 wait complete. 2024-09-11T22:17:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.247+0000 7f4899de0740 20 client.28054 trim_cache size 0 max 16384 2024-09-11T22:17:08.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.275+0000 7f4899de0740 1 Processor -- start 2024-09-11T22:17:08.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.275+0000 7f4899de0740 1 -- start start 2024-09-11T22:17:08.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f4899de0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25d4a0 0x5629da25e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f4899de0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da25ddc0 0x5629da264c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f4899de0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da268680 0x5629da258a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f48957a3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25d4a0 0x5629da25e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f48957a3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25d4a0 0x5629da25e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57840/0 (socket says 172.21.15.152:57840) 2024-09-11T22:17:08.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f48957a3640 1 -- 172.21.15.152:0/620290965 learned_addr learned my addr 172.21.15.152:0/620290965 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:08.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f4899de0740 1 -- 172.21.15.152:0/620290965 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f48901bf190 con 0x5629da25d4a0 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f4899de0740 1 -- 172.21.15.152:0/620290965 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f48901bca60 con 0x5629da25ddc0 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f4899de0740 1 -- 172.21.15.152:0/620290965 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f48901ba8d0 con 0x5629da268680 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f4894fa2640 1 --2- 172.21.15.152:0/620290965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da25ddc0 0x5629da264c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f4895fa4640 1 --2- 172.21.15.152:0/620290965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da268680 0x5629da258a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f48957a3640 1 -- 172.21.15.152:0/620290965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da268680 msgr2=0x5629da258a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f48957a3640 1 --2- 172.21.15.152:0/620290965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da268680 0x5629da258a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f48957a3640 1 -- 172.21.15.152:0/620290965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da25ddc0 msgr2=0x5629da264c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f48957a3640 1 --2- 172.21.15.152:0/620290965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da25ddc0 0x5629da264c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f48957a3640 1 -- 172.21.15.152:0/620290965 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629da25a6c0 con 0x5629da25d4a0 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.276+0000 7f4895fa4640 1 --2- 172.21.15.152:0/620290965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da268680 0x5629da258a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.277+0000 7f48957a3640 1 --2- 172.21.15.152:0/620290965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25d4a0 0x5629da25e640 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f4888009ca0 tx=0x7f488804b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42033c46bcc8ca30 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:08.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.277+0000 7f487affd640 1 -- 172.21.15.152:0/620290965 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488802f860 con 0x5629da25d4a0 2024-09-11T22:17:08.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.277+0000 7f487affd640 1 -- 172.21.15.152:0/620290965 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4888051440 con 0x5629da25d4a0 2024-09-11T22:17:08.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.277+0000 7f487affd640 1 -- 172.21.15.152:0/620290965 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888030c60 con 0x5629da25d4a0 2024-09-11T22:17:08.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.278+0000 7f4899de0740 1 -- 172.21.15.152:0/620290965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25d4a0 msgr2=0x5629da25e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:08.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.278+0000 7f4899de0740 1 --2- 172.21.15.152:0/620290965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25d4a0 0x5629da25e640 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f4888009ca0 tx=0x7f488804b000 comp rx=0 tx=0).stop 2024-09-11T22:17:08.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.278+0000 7f4899de0740 1 -- 172.21.15.152:0/620290965 shutdown_connections 2024-09-11T22:17:08.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.278+0000 7f4899de0740 1 --2- 172.21.15.152:0/620290965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da268680 0x5629da258a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.278+0000 7f4899de0740 1 --2- 172.21.15.152:0/620290965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da25ddc0 0x5629da264c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.278+0000 7f4899de0740 1 --2- 172.21.15.152:0/620290965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25d4a0 0x5629da25e640 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.278+0000 7f4899de0740 1 -- 172.21.15.152:0/620290965 >> 172.21.15.152:0/620290965 conn(0x5629da259a30 msgr2=0x5629da258350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.278+0000 7f4899de0740 1 -- 172.21.15.152:0/620290965 shutdown_connections 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.278+0000 7f4899de0740 1 -- 172.21.15.152:0/620290965 wait complete. 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.279+0000 7f4899de0740 1 -- start start 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.279+0000 7f4899de0740 1 Processor -- start 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.280+0000 7f4899de0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da26bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.280+0000 7f4899de0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da26c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.280+0000 7f4899de0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da2dad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.280+0000 7f4899de0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f48901baf20 con 0x5629da25ddc0 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.280+0000 7f4899de0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f48901bc390 con 0x5629da268680 2024-09-11T22:17:08.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.280+0000 7f4899de0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f48901bb5f0 con 0x5629da25d4a0 2024-09-11T22:17:08.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.280+0000 7f4899de0740 10 client.0 _ll_register_callbacks cb 0x7f488c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:08.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.280+0000 7f48957a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da26bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.280+0000 7f48957a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da26bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:45304/0 (socket says 172.21.15.152:45304) 2024-09-11T22:17:08.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.280+0000 7f48957a3640 1 -- 172.21.15.152:0/1996861610 learned_addr learned my addr 172.21.15.152:0/1996861610 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:08.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.280+0000 7f4895fa4640 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da2dad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f4894fa2640 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da26c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f48957a3640 1 -- 172.21.15.152:0/1996861610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 msgr2=0x5629da2dad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:08.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f48957a3640 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da2dad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f48957a3640 1 -- 172.21.15.152:0/1996861610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 msgr2=0x5629da26c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:08.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f48957a3640 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da26c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f48957a3640 1 -- 172.21.15.152:0/1996861610 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629da2db340 con 0x5629da25d4a0 2024-09-11T22:17:08.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f4895fa4640 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da2dad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:08.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f48957a3640 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da26bd60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f488802a9c0 tx=0x7f4888051aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a0413cddb50e25b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:08.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f4878ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:17:08.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f4878ff9640 1 -- 172.21.15.152:0/1996861610 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888030c60 con 0x5629da25d4a0 2024-09-11T22:17:08.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f4878ff9640 1 -- 172.21.15.152:0/1996861610 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8614+0+0 (secure 0 0 0) 0x7f48880045f0 con 0x5629da25d4a0 2024-09-11T22:17:08.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.281+0000 7f4899de0740 1 -- 172.21.15.152:0/1996861610 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4888051440 con 0x5629da25d4a0 2024-09-11T22:17:08.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4878ff9640 1 -- 172.21.15.152:0/1996861610 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f488802f860 con 0x5629da25d4a0 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4899de0740 10 client.28060 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4899de0740 1 -- 172.21.15.152:0/1996861610 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5629da2e26c0 con 0x5629da25d4a0 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4878ff9640 1 -- 172.21.15.152:0/1996861610 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4888051440 con 0x5629da25d4a0 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4878ff9640 1 -- 172.21.15.152:0/1996861610 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f488804f070 con 0x5629da25d4a0 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4899de0740 10 client.28060 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4899de0740 10 client.28060 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4899de0740 20 client.28060 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4899de0740 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5629da2e2d80 0x5629da2e5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4899de0740 4 client.28060 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4899de0740 1 -- 172.21.15.152:0/1996861610 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5629da1d0850 con 0x5629da2e2d80 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.282+0000 7f4894fa2640 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5629da2e2d80 0x5629da2e5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4894fa2640 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5629da2e2d80 0x5629da2e5170 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd9da6a0fbd95d3a server_cookie=1d2b26c0834e14b7 in_seq=0 out_seq=0 2024-09-11T22:17:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4878ff9640 10 client.28060 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4878ff9640 1 -- 172.21.15.152:0/1996861610 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5629da1d0850 con 0x5629da2e2d80 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4878ff9640 10 client.28060 handle_command_reply: tid=0 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4899de0740 1 client.28060 shutdown 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4899de0740 1 -- 172.21.15.152:0/1996861610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 msgr2=0x5629da26bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4899de0740 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da26bd60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f488802a9c0 tx=0x7f4888051aa0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4899de0740 1 -- 172.21.15.152:0/1996861610 shutdown_connections 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4899de0740 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5629da2e2d80 0x5629da2e5170 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4899de0740 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629da268680 0x5629da2dad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4899de0740 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629da25ddc0 0x5629da26c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4878ff9640 0 client.28060 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4899de0740 1 --2- 172.21.15.152:0/1996861610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5629da25d4a0 0x5629da26bd60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4899de0740 1 -- 172.21.15.152:0/1996861610 >> 172.21.15.152:0/1996861610 conn(0x5629da259a30 msgr2=0x5629da258350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:08.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4899de0740 1 -- 172.21.15.152:0/1996861610 shutdown_connections 2024-09-11T22:17:08.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.283+0000 7f4899de0740 1 -- 172.21.15.152:0/1996861610 wait complete. 2024-09-11T22:17:08.291 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:17:08.291 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:17:08.291 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:17:08.291 INFO:teuthology.orchestra.run.smithi152.stdout: "a12ffe09-698a-4823-9002-76047df573c9": { 2024-09-11T22:17:08.291 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:17:08.291 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "a12ffe09-698a-4823-9002-76047df573c9", 2024-09-11T22:17:08.291 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:17:08.292 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:17:08.292 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:17:08.292 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:17:08.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.284+0000 7f4899de0740 20 client.28060 trim_cache size 0 max 16384 2024-09-11T22:17:08.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.286+0000 7f4897a07640 1 -- 172.21.15.152:0/1836807787 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f487c0a2e80 msgr2=0x7f487c0a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:08.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.286+0000 7f4897a07640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f487c0a2e80 0x7f487c0a5340 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4888000f80 tx=0x7f48880097e0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.286+0000 7f4897a07640 1 -- 172.21.15.152:0/1836807787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4890109b10 msgr2=0x7f489010a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:08.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.286+0000 7f4897a07640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4890109b10 0x7f489010a910 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f488c00e9f0 tx=0x7f488c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.286+0000 7f4897a07640 1 -- 172.21.15.152:0/1836807787 shutdown_connections 2024-09-11T22:17:08.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.286+0000 7f4897a07640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f487c0a2e80 0x7f487c0a5340 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.286+0000 7f4897a07640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4890114ab0 0x7f489010ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.286+0000 7f4897a07640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4890109b10 0x7f489010a910 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.286+0000 7f4897a07640 1 --2- 172.21.15.152:0/1836807787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48901091f0 0x7f489010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:08.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.287+0000 7f4897a07640 1 -- 172.21.15.152:0/1836807787 >> 172.21.15.152:0/1836807787 conn(0x7f489006e140 msgr2=0x7f4890070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:08.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.287+0000 7f4897a07640 1 -- 172.21.15.152:0/1836807787 shutdown_connections 2024-09-11T22:17:08.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:08.287+0000 7f4897a07640 1 -- 172.21.15.152:0/1836807787 wait complete. 2024-09-11T22:17:08.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:07 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:17:08.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:07 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:08.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:07 smithi179 ceph-mon[35603]: pgmap v400: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 16 MiB/s wr, 1.39k op/s 2024-09-11T22:17:08.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:07 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:17:08.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:07 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:08.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:07 smithi193 ceph-mon[35545]: pgmap v400: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 16 MiB/s wr, 1.39k op/s 2024-09-11T22:17:09.306 INFO:tasks.cephfs.filesystem:scrub status for tag:a12ffe09-698a-4823-9002-76047df573c9 - {'path': '/', 'tag': 'a12ffe09-698a-4823-9002-76047df573c9', 'options': 'recursive,force'} 2024-09-11T22:17:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.605+0000 7f1591b9f640 1 -- 172.21.15.152:0/2109387156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f158c100890 msgr2=0x7f158c100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.605+0000 7f1591b9f640 1 --2- 172.21.15.152:0/2109387156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f158c100890 0x7f158c100c70 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f157c009900 tx=0x7f157c02a410 comp rx=0 tx=0).stop 2024-09-11T22:17:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.606+0000 7f1591b9f640 1 -- 172.21.15.152:0/2109387156 shutdown_connections 2024-09-11T22:17:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.606+0000 7f1591b9f640 1 --2- 172.21.15.152:0/2109387156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f158c10e440 0x7f158c110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.606+0000 7f1591b9f640 1 --2- 172.21.15.152:0/2109387156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158c101240 0x7f158c10de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.606+0000 7f1591b9f640 1 --2- 172.21.15.152:0/2109387156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f158c100890 0x7f158c100c70 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.606+0000 7f1591b9f640 1 -- 172.21.15.152:0/2109387156 >> 172.21.15.152:0/2109387156 conn(0x7f158c077990 msgr2=0x7f158c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.606+0000 7f1591b9f640 1 -- 172.21.15.152:0/2109387156 shutdown_connections 2024-09-11T22:17:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.606+0000 7f1591b9f640 1 -- 172.21.15.152:0/2109387156 wait complete. 2024-09-11T22:17:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.607+0000 7f1591b9f640 1 Processor -- start 2024-09-11T22:17:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.607+0000 7f1591b9f640 1 -- start start 2024-09-11T22:17:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f1591b9f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f158c100890 0x7f158c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f1591b9f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f158c101240 0x7f158c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f1591b9f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158c10e440 0x7f158c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f1591b9f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1140c0 con 0x7f158c100890 2024-09-11T22:17:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f1591b9f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f158c113f40 con 0x7f158c101240 2024-09-11T22:17:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f1591b9f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f158c114240 con 0x7f158c10e440 2024-09-11T22:17:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f158c100890 0x7f158c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f158affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f158c101240 0x7f158c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f158bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158c10e440 0x7f158c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f158bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158c10e440 0x7f158c19eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:45324/0 (socket says 172.21.15.152:45324) 2024-09-11T22:17:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f158bfff640 1 -- 172.21.15.152:0/187672034 learned_addr learned my addr 172.21.15.152:0/187672034 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f158bfff640 1 -- 172.21.15.152:0/187672034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f158c101240 msgr2=0x7f158c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f158bfff640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f158c101240 0x7f158c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f158bfff640 1 -- 172.21.15.152:0/187672034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f158c100890 msgr2=0x7f158c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f158bfff640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f158c100890 0x7f158c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f158bfff640 1 -- 172.21.15.152:0/187672034 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c19f600 con 0x7f158c10e440 2024-09-11T22:17:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f158bfff640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158c10e440 0x7f158c19eed0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f158400eb40 tx=0x7f158400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.608+0000 7f1588ff9640 1 -- 172.21.15.152:0/187672034 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584004b20 con 0x7f158c10e440 2024-09-11T22:17:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.609+0000 7f1588ff9640 1 -- 172.21.15.152:0/187672034 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1584004cc0 con 0x7f158c10e440 2024-09-11T22:17:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.609+0000 7f1588ff9640 1 -- 172.21.15.152:0/187672034 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584010850 con 0x7f158c10e440 2024-09-11T22:17:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.609+0000 7f1591b9f640 1 -- 172.21.15.152:0/187672034 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c19f8f0 con 0x7f158c10e440 2024-09-11T22:17:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.609+0000 7f1591b9f640 1 -- 172.21.15.152:0/187672034 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c102a10 con 0x7f158c10e440 2024-09-11T22:17:09.612 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.611+0000 7f1588ff9640 1 -- 172.21.15.152:0/187672034 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f1584005020 con 0x7f158c10e440 2024-09-11T22:17:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.613+0000 7f1588ff9640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f15740a2e20 0x7f15740a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.613+0000 7f158b7fe640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f15740a2e20 0x7f15740a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.613+0000 7f1588ff9640 1 -- 172.21.15.152:0/187672034 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8658+0+0 (secure 0 0 0) 0x7f15840cfc00 con 0x7f158c10e440 2024-09-11T22:17:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f1594a16740 1 Processor -- start 2024-09-11T22:17:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f1594a16740 1 -- start start 2024-09-11T22:17:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158b7fe640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f15740a2e20 0x7f15740a52e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f157c009230 tx=0x7f157c0058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f1594a16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 0x55963d5eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f1594a16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 0x55963d5f9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f1594a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f1594a16740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55963d5532f0 con 0x55963d5ef410 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f1594a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55963d4fb270 con 0x55963d5f9cb0 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f1594a16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55963d54f2b0 con 0x55963d5eeaf0 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 0x55963d5f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 0x55963d5eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 0x55963d5eeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:45330/0 (socket says 172.21.15.152:45330) 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158b7fe640 1 -- 172.21.15.152:0/3377915238 learned_addr learned my addr 172.21.15.152:0/3377915238 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158bfff640 1 --2- 172.21.15.152:0/3377915238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158b7fe640 1 -- 172.21.15.152:0/3377915238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 msgr2=0x55963d5fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158b7fe640 1 --2- 172.21.15.152:0/3377915238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5fc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158b7fe640 1 -- 172.21.15.152:0/3377915238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 msgr2=0x55963d5f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158b7fe640 1 --2- 172.21.15.152:0/3377915238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 0x55963d5f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158b7fe640 1 -- 172.21.15.152:0/3377915238 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55963d4fa340 con 0x55963d5eeaf0 2024-09-11T22:17:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.614+0000 7f158affd640 1 --2- 172.21.15.152:0/3377915238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 0x55963d5f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.615+0000 7f158b7fe640 1 --2- 172.21.15.152:0/3377915238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 0x55963d5eeed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f157c009900 tx=0x7f157c03d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7376d31dae62ddb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.615+0000 7f1571ffb640 1 -- 172.21.15.152:0/3377915238 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c035040 con 0x55963d5eeaf0 2024-09-11T22:17:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.615+0000 7f1571ffb640 1 -- 172.21.15.152:0/3377915238 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f157c04e070 con 0x55963d5eeaf0 2024-09-11T22:17:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.615+0000 7f1571ffb640 1 -- 172.21.15.152:0/3377915238 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c0496e0 con 0x55963d5eeaf0 2024-09-11T22:17:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.616+0000 7f1594a16740 1 -- 172.21.15.152:0/3377915238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 msgr2=0x55963d5eeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.616+0000 7f1594a16740 1 --2- 172.21.15.152:0/3377915238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 0x55963d5eeed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f157c009900 tx=0x7f157c03d000 comp rx=0 tx=0).stop 2024-09-11T22:17:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.616+0000 7f1594a16740 1 -- 172.21.15.152:0/3377915238 shutdown_connections 2024-09-11T22:17:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.616+0000 7f1594a16740 1 --2- 172.21.15.152:0/3377915238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.616+0000 7f1594a16740 1 --2- 172.21.15.152:0/3377915238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 0x55963d5f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.616+0000 7f1594a16740 1 --2- 172.21.15.152:0/3377915238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 0x55963d5eeed0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.616+0000 7f1594a16740 1 -- 172.21.15.152:0/3377915238 >> 172.21.15.152:0/3377915238 conn(0x55963d5eb060 msgr2=0x55963d5eb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.617+0000 7f1594a16740 1 -- 172.21.15.152:0/3377915238 shutdown_connections 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.617+0000 7f1594a16740 1 -- 172.21.15.152:0/3377915238 wait complete. 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.617+0000 7f1594a16740 1 -- start start 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.617+0000 7f1594a16740 1 Processor -- start 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.617+0000 7f1594a16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5eeaf0 0x55963d5f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.617+0000 7f1594a16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5ef410 0x55963d5f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f1594a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5f7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f1594a16740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55963d5fc8d0 con 0x55963d5eeaf0 2024-09-11T22:17:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f1594a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55963d4dc290 con 0x55963d5f9cb0 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f1594a16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55963d5fca50 con 0x55963d5ef410 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5eeaf0 0x55963d5f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f1594a16740 10 client.0 _ll_register_callbacks cb 0x55963d50d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5eeaf0 0x55963d5f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57890/0 (socket says 172.21.15.152:57890) 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f158b7fe640 1 -- 172.21.15.152:0/1480128371 learned_addr learned my addr 172.21.15.152:0/1480128371 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f158affd640 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5ef410 0x55963d5f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f158bfff640 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f158bfff640 1 -- 172.21.15.152:0/1480128371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5ef410 msgr2=0x55963d5f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f158bfff640 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5ef410 0x55963d5f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f158bfff640 1 -- 172.21.15.152:0/1480128371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5eeaf0 msgr2=0x55963d5f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f158bfff640 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5eeaf0 0x55963d5f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f158bfff640 1 -- 172.21.15.152:0/1480128371 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963d266210 con 0x55963d5f9cb0 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.618+0000 7f158bfff640 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5f7620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f15840cd270 tx=0x7f158409bb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61efbada7beb7f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.619+0000 7f156affd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.619+0000 7f156affd640 1 -- 172.21.15.152:0/1480128371 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840a0420 con 0x55963d5f9cb0 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.619+0000 7f156affd640 1 -- 172.21.15.152:0/1480128371 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8658+0+0 (secure 0 0 0) 0x7f1584005310 con 0x55963d5f9cb0 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.619+0000 7f1594a16740 1 -- 172.21.15.152:0/1480128371 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f157c04e070 con 0x55963d5f9cb0 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.619+0000 7f156affd640 1 -- 172.21.15.152:0/1480128371 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f15840a4ce0 con 0x55963d5f9cb0 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.619+0000 7f1594a16740 10 client.27923 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.619+0000 7f1594a16740 1 -- 172.21.15.152:0/1480128371 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55963d332620 con 0x55963d5f9cb0 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.620+0000 7f156affd640 1 -- 172.21.15.152:0/1480128371 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f157c04e070 con 0x55963d5f9cb0 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.620+0000 7f156affd640 1 -- 172.21.15.152:0/1480128371 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f15840a4850 con 0x55963d5f9cb0 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.620+0000 7f1594a16740 10 client.27923 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.620+0000 7f1594a16740 10 client.27923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.620+0000 7f1594a16740 20 client.27923 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.620+0000 7f1594a16740 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55963d609c60 0x55963d60c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.620+0000 7f1594a16740 4 client.27923 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.620+0000 7f1594a16740 1 -- 172.21.15.152:0/1480128371 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55963d560a20 con 0x55963d609c60 2024-09-11T22:17:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.620+0000 7f158b7fe640 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55963d609c60 0x55963d60c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.621+0000 7f158b7fe640 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55963d609c60 0x55963d60c070 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f68f002672862bf server_cookie=550c0ae2bf0eac74 in_seq=0 out_seq=0 2024-09-11T22:17:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.621+0000 7f156affd640 10 client.27923 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f156affd640 1 -- 172.21.15.152:0/1480128371 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55963d560a20 con 0x55963d609c60 2024-09-11T22:17:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f156affd640 10 client.27923 handle_command_reply: tid=0 2024-09-11T22:17:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f1594a16740 1 client.27923 shutdown 2024-09-11T22:17:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f1594a16740 1 -- 172.21.15.152:0/1480128371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 msgr2=0x55963d5f7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f1594a16740 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5f7620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f15840cd270 tx=0x7f158409bb00 comp rx=0 tx=0).stop 2024-09-11T22:17:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f1594a16740 1 -- 172.21.15.152:0/1480128371 shutdown_connections 2024-09-11T22:17:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f1594a16740 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55963d609c60 0x55963d60c070 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f156affd640 0 client.27923 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f1594a16740 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5f7620 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f1594a16740 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5ef410 0x55963d5f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f1594a16740 1 --2- 172.21.15.152:0/1480128371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5eeaf0 0x55963d5f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f1594a16740 1 -- 172.21.15.152:0/1480128371 >> 172.21.15.152:0/1480128371 conn(0x55963d5eb060 msgr2=0x55963d5f0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f1594a16740 1 -- 172.21.15.152:0/1480128371 shutdown_connections 2024-09-11T22:17:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.622+0000 7f1594a16740 1 -- 172.21.15.152:0/1480128371 wait complete. 2024-09-11T22:17:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.623+0000 7f1594a16740 20 client.27923 trim_cache size 0 max 16384 2024-09-11T22:17:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.656+0000 7f1594a16740 1 Processor -- start 2024-09-11T22:17:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.656+0000 7f1594a16740 1 -- start start 2024-09-11T22:17:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.656+0000 7f1594a16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 0x55963d5f7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.656+0000 7f1594a16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 0x55963d611980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.656+0000 7f1594a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d611ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.656+0000 7f1594a16740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1b6900 con 0x55963d5ef410 2024-09-11T22:17:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.656+0000 7f1594a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1b41d0 con 0x55963d5f9cb0 2024-09-11T22:17:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.656+0000 7f1594a16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1b2060 con 0x55963d5eeaf0 2024-09-11T22:17:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.657+0000 7f158bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d611ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.657+0000 7f158bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d611ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:56160/0 (socket says 172.21.15.152:56160) 2024-09-11T22:17:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.657+0000 7f158bfff640 1 -- 172.21.15.152:0/795057343 learned_addr learned my addr 172.21.15.152:0/795057343 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.658+0000 7f158b7fe640 1 --2- 172.21.15.152:0/795057343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 0x55963d5f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.660+0000 7f158affd640 1 --2- 172.21.15.152:0/795057343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 0x55963d611980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.666+0000 7f158bfff640 1 -- 172.21.15.152:0/795057343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 msgr2=0x55963d5f7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.668+0000 7f158bfff640 1 --2- 172.21.15.152:0/795057343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 0x55963d5f7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.669+0000 7f158bfff640 1 -- 172.21.15.152:0/795057343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 msgr2=0x55963d611980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.669+0000 7f158bfff640 1 --2- 172.21.15.152:0/795057343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 0x55963d611980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.669+0000 7f158bfff640 1 -- 172.21.15.152:0/795057343 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55963d5eae90 con 0x55963d5f9cb0 2024-09-11T22:17:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.669+0000 7f158affd640 1 --2- 172.21.15.152:0/795057343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 0x55963d611980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.671+0000 7f158b7fe640 1 --2- 172.21.15.152:0/795057343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 0x55963d5f7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.673+0000 7f158bfff640 1 --2- 172.21.15.152:0/795057343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d611ec0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f15840984d0 tx=0x7f158409c640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b09de2a3d8a031d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:09.677 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.676+0000 7f15717fa640 1 -- 172.21.15.152:0/795057343 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840a0420 con 0x55963d5f9cb0 2024-09-11T22:17:09.677 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.677+0000 7f15717fa640 1 -- 172.21.15.152:0/795057343 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f158407e020 con 0x55963d5f9cb0 2024-09-11T22:17:09.677 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.677+0000 7f15717fa640 1 -- 172.21.15.152:0/795057343 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158409b510 con 0x55963d5f9cb0 2024-09-11T22:17:09.678 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.678+0000 7f1594a16740 1 -- 172.21.15.152:0/795057343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 msgr2=0x55963d611ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.678+0000 7f1594a16740 1 --2- 172.21.15.152:0/795057343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d611ec0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f15840984d0 tx=0x7f158409c640 comp rx=0 tx=0).stop 2024-09-11T22:17:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.682+0000 7f1594a16740 1 -- 172.21.15.152:0/795057343 shutdown_connections 2024-09-11T22:17:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.682+0000 7f1594a16740 1 --2- 172.21.15.152:0/795057343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d611ec0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.682+0000 7f1594a16740 1 --2- 172.21.15.152:0/795057343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5ef410 0x55963d611980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.682+0000 7f1594a16740 1 --2- 172.21.15.152:0/795057343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5eeaf0 0x55963d5f7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.682+0000 7f1594a16740 1 -- 172.21.15.152:0/795057343 >> 172.21.15.152:0/795057343 conn(0x55963d5eb060 msgr2=0x55963d5f8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.686+0000 7f1594a16740 1 -- 172.21.15.152:0/795057343 shutdown_connections 2024-09-11T22:17:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.687+0000 7f1594a16740 1 -- 172.21.15.152:0/795057343 wait complete. 2024-09-11T22:17:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.688+0000 7f1594a16740 1 -- start start 2024-09-11T22:17:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.689+0000 7f1594a16740 1 Processor -- start 2024-09-11T22:17:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.689+0000 7f1594a16740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5eeaf0 0x55963d5f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.690+0000 7f1594a16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5ef410 0x55963d5f4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.690+0000 7f1594a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5f4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.690+0000 7f1594a16740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1b26b0 con 0x55963d5eeaf0 2024-09-11T22:17:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.690+0000 7f1594a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1b3b00 con 0x55963d5f9cb0 2024-09-11T22:17:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.690+0000 7f1594a16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1b2d60 con 0x55963d5ef410 2024-09-11T22:17:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.690+0000 7f1594a16740 10 client.0 _ll_register_callbacks cb 0x7f1584098360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.690+0000 7f158bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.690+0000 7f158bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5f4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:56164/0 (socket says 172.21.15.152:56164) 2024-09-11T22:17:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.690+0000 7f158bfff640 1 -- 172.21.15.152:0/2668393467 learned_addr learned my addr 172.21.15.152:0/2668393467 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.691+0000 7f158bfff640 1 -- 172.21.15.152:0/2668393467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5ef410 msgr2=0x55963d5f4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.691+0000 7f158bfff640 1 --2- 172.21.15.152:0/2668393467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5ef410 0x55963d5f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.691+0000 7f158bfff640 1 -- 172.21.15.152:0/2668393467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5eeaf0 msgr2=0x55963d5f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.691+0000 7f158bfff640 1 --2- 172.21.15.152:0/2668393467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5eeaf0 0x55963d5f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.691+0000 7f158bfff640 1 -- 172.21.15.152:0/2668393467 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963d5ebcf0 con 0x55963d5f9cb0 2024-09-11T22:17:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.691+0000 7f158bfff640 1 --2- 172.21.15.152:0/2668393467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5f4790 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f15840a47b0 tx=0x7f158409bb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=971cce6eebf8dfa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.691+0000 7f156affd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:17:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.692+0000 7f156affd640 1 -- 172.21.15.152:0/2668393467 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158409b510 con 0x55963d5f9cb0 2024-09-11T22:17:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.692+0000 7f156affd640 1 -- 172.21.15.152:0/2668393467 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8658+0+0 (secure 0 0 0) 0x7f15840a4850 con 0x55963d5f9cb0 2024-09-11T22:17:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.692+0000 7f1594a16740 1 -- 172.21.15.152:0/2668393467 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f158407e020 con 0x55963d5f9cb0 2024-09-11T22:17:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.692+0000 7f156affd640 1 -- 172.21.15.152:0/2668393467 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f15840a9030 con 0x55963d5f9cb0 2024-09-11T22:17:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.692+0000 7f1594a16740 10 client.27929 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.692+0000 7f1594a16740 1 -- 172.21.15.152:0/2668393467 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55963d5ec110 con 0x55963d5f9cb0 2024-09-11T22:17:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.692+0000 7f156affd640 1 -- 172.21.15.152:0/2668393467 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15840850b0 con 0x55963d5f9cb0 2024-09-11T22:17:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.693+0000 7f156affd640 1 -- 172.21.15.152:0/2668393467 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f158409af30 con 0x55963d5f9cb0 2024-09-11T22:17:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.693+0000 7f1594a16740 10 client.27929 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.693+0000 7f1594a16740 10 client.27929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.693+0000 7f1594a16740 20 client.27929 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.693+0000 7f1594a16740 1 --2- 172.21.15.152:0/2668393467 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55963d609c60 0x55963d687e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.693+0000 7f1594a16740 4 client.27929 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:17:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.693+0000 7f1594a16740 1 -- 172.21.15.152:0/2668393467 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f158407e020 con 0x55963d609c60 2024-09-11T22:17:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.693+0000 7f158b7fe640 1 --2- 172.21.15.152:0/2668393467 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55963d609c60 0x55963d687e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.694+0000 7f158b7fe640 1 --2- 172.21.15.152:0/2668393467 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55963d609c60 0x55963d687e20 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ae2b1bde67d50ce server_cookie=187d2a5820d9e1db in_seq=0 out_seq=0 2024-09-11T22:17:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.694+0000 7f156affd640 10 client.27929 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f156affd640 1 -- 172.21.15.152:0/2668393467 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f158407e020 con 0x55963d609c60 2024-09-11T22:17:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f156affd640 10 client.27929 handle_command_reply: tid=0 2024-09-11T22:17:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f1594a16740 1 client.27929 shutdown 2024-09-11T22:17:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f1594a16740 1 -- 172.21.15.152:0/2668393467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 msgr2=0x55963d5f4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f1594a16740 1 --2- 172.21.15.152:0/2668393467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5f4790 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f15840a47b0 tx=0x7f158409bb00 comp rx=0 tx=0).stop 2024-09-11T22:17:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f1594a16740 1 -- 172.21.15.152:0/2668393467 shutdown_connections 2024-09-11T22:17:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f1594a16740 1 --2- 172.21.15.152:0/2668393467 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55963d609c60 0x55963d687e20 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f1594a16740 1 --2- 172.21.15.152:0/2668393467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55963d5f9cb0 0x55963d5f4790 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f1594a16740 1 --2- 172.21.15.152:0/2668393467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55963d5ef410 0x55963d5f4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f1594a16740 1 --2- 172.21.15.152:0/2668393467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55963d5eeaf0 0x55963d5f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f1594a16740 1 -- 172.21.15.152:0/2668393467 >> 172.21.15.152:0/2668393467 conn(0x55963d5eb060 msgr2=0x55963d5f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.716+0000 7f156affd640 0 client.27929 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.717+0000 7f1594a16740 1 -- 172.21.15.152:0/2668393467 shutdown_connections 2024-09-11T22:17:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.717+0000 7f1594a16740 1 -- 172.21.15.152:0/2668393467 wait complete. 2024-09-11T22:17:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.717+0000 7f1594a16740 20 client.27929 trim_cache size 0 max 16384 2024-09-11T22:17:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:17:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:17:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:17:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:17:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 -- 172.21.15.152:0/187672034 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f15740a2e20 msgr2=0x7f15740a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f15740a2e20 0x7f15740a52e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f157c009230 tx=0x7f157c0058d0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 -- 172.21.15.152:0/187672034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158c10e440 msgr2=0x7f158c19eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158c10e440 0x7f158c19eed0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f158400eb40 tx=0x7f158400c2d0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 -- 172.21.15.152:0/187672034 shutdown_connections 2024-09-11T22:17:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f15740a2e20 0x7f15740a52e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158c10e440 0x7f158c19eed0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f158c101240 0x7f158c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 --2- 172.21.15.152:0/187672034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f158c100890 0x7f158c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 -- 172.21.15.152:0/187672034 >> 172.21.15.152:0/187672034 conn(0x7f158c077990 msgr2=0x7f158c0ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 -- 172.21.15.152:0/187672034 shutdown_connections 2024-09-11T22:17:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:09.719+0000 7f1591b9f640 1 -- 172.21.15.152:0/187672034 wait complete. 2024-09-11T22:17:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 695.0 s, 2629.6 tps, lat 38.071 ms stddev 49.791 2024-09-11T22:17:10.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:09 smithi179 ceph-mon[35603]: osdmap e98: 12 total, 12 up, 12 in 2024-09-11T22:17:10.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:09 smithi179 ceph-mon[35603]: pgmap v402: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 19 MiB/s wr, 1.68k op/s 2024-09-11T22:17:10.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:09 smithi193 ceph-mon[35545]: osdmap e98: 12 total, 12 up, 12 in 2024-09-11T22:17:10.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:09 smithi193 ceph-mon[35545]: pgmap v402: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 19 MiB/s wr, 1.68k op/s 2024-09-11T22:17:10.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:09 smithi152 ceph-mon[31188]: osdmap e98: 12 total, 12 up, 12 in 2024-09-11T22:17:10.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:09 smithi152 ceph-mon[31188]: pgmap v402: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 19 MiB/s wr, 1.68k op/s 2024-09-11T22:17:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:11 smithi152 ceph-mon[31188]: pgmap v403: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 19 MiB/s wr, 1.68k op/s 2024-09-11T22:17:12.048 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:11 smithi179 ceph-mon[35603]: pgmap v403: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 19 MiB/s wr, 1.68k op/s 2024-09-11T22:17:12.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:11 smithi193 ceph-mon[35545]: pgmap v403: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 19 MiB/s wr, 1.68k op/s 2024-09-11T22:17:13.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:13 smithi152 ceph-mon[31188]: pgmap v404: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 18 MiB/s wr, 1.59k op/s 2024-09-11T22:17:14.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:13 smithi179 ceph-mon[35603]: pgmap v404: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 18 MiB/s wr, 1.59k op/s 2024-09-11T22:17:14.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:13 smithi193 ceph-mon[35545]: pgmap v404: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 18 MiB/s wr, 1.59k op/s 2024-09-11T22:17:14.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 700.0 s, 2262.8 tps, lat 44.179 ms stddev 52.301 2024-09-11T22:17:14.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:14 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:17:14.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:14 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:17:15.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:14 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:17:15.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:14 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:17:15.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:14 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:17:15.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:14 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:17:15.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:15 smithi152 ceph-mon[31188]: pgmap v405: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.0 MiB/s wr, 673 op/s 2024-09-11T22:17:16.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:15 smithi179 ceph-mon[35603]: pgmap v405: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.0 MiB/s wr, 673 op/s 2024-09-11T22:17:16.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:15 smithi193 ceph-mon[35545]: pgmap v405: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.0 MiB/s wr, 673 op/s 2024-09-11T22:17:17.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:17 smithi152 ceph-mon[31188]: pgmap v406: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.0 MiB/s wr, 673 op/s 2024-09-11T22:17:18.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:17 smithi179 ceph-mon[35603]: pgmap v406: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.0 MiB/s wr, 673 op/s 2024-09-11T22:17:18.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:17 smithi193 ceph-mon[35545]: pgmap v406: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.0 MiB/s wr, 673 op/s 2024-09-11T22:17:19.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 705.0 s, 2552.2 tps, lat 39.194 ms stddev 45.110 2024-09-11T22:17:20.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:20 smithi193 ceph-mon[35545]: osdmap e99: 12 total, 12 up, 12 in 2024-09-11T22:17:20.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:20 smithi193 ceph-mon[35545]: pgmap v408: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 654 op/s 2024-09-11T22:17:20.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:20 smithi152 ceph-mon[31188]: osdmap e99: 12 total, 12 up, 12 in 2024-09-11T22:17:20.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:20 smithi152 ceph-mon[31188]: pgmap v408: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 654 op/s 2024-09-11T22:17:20.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:20 smithi179 ceph-mon[35603]: osdmap e99: 12 total, 12 up, 12 in 2024-09-11T22:17:20.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:20 smithi179 ceph-mon[35603]: pgmap v408: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 654 op/s 2024-09-11T22:17:21.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:21 smithi152 ceph-mon[31188]: pgmap v409: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 654 op/s 2024-09-11T22:17:22.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:21 smithi179 ceph-mon[35603]: pgmap v409: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 654 op/s 2024-09-11T22:17:22.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:21 smithi193 ceph-mon[35545]: pgmap v409: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 654 op/s 2024-09-11T22:17:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.848+0000 7ff37d1cf640 1 -- 172.21.15.152:0/533631528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3781090c0 msgr2=0x7ff378110c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.848+0000 7ff37d1cf640 1 --2- 172.21.15.152:0/533631528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3781090c0 0x7ff378110c10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ff370009ca0 tx=0x7ff37002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.848+0000 7ff37d1cf640 1 -- 172.21.15.152:0/533631528 shutdown_connections 2024-09-11T22:17:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.848+0000 7ff37d1cf640 1 --2- 172.21.15.152:0/533631528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3781090c0 0x7ff378110c10 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.848+0000 7ff37d1cf640 1 --2- 172.21.15.152:0/533631528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff378104920 0x7ff378108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.848+0000 7ff37d1cf640 1 --2- 172.21.15.152:0/533631528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378103f70 0x7ff378104350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.848+0000 7ff37d1cf640 1 -- 172.21.15.152:0/533631528 >> 172.21.15.152:0/533631528 conn(0x7ff3780ff980 msgr2=0x7ff378101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.848+0000 7ff37d1cf640 1 -- 172.21.15.152:0/533631528 shutdown_connections 2024-09-11T22:17:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.848+0000 7ff37d1cf640 1 -- 172.21.15.152:0/533631528 wait complete. 2024-09-11T22:17:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.849+0000 7ff37d1cf640 1 Processor -- start 2024-09-11T22:17:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.849+0000 7ff37d1cf640 1 -- start start 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.849+0000 7ff37d1cf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378103f70 0x7ff37819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.849+0000 7ff37d1cf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3781090c0 0x7ff37819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.849+0000 7ff37d1cf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff37819ede0 0x7ff37819f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.849+0000 7ff37d1cf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff378114110 con 0x7ff3781090c0 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.849+0000 7ff37d1cf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff378113f90 con 0x7ff378103f70 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.849+0000 7ff37d1cf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff378114290 con 0x7ff37819ede0 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.849+0000 7ff36ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3781090c0 0x7ff37819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff36ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3781090c0 0x7ff37819aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38394/0 (socket says 172.21.15.152:38394) 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff36ffff640 1 -- 172.21.15.152:0/2917637091 learned_addr learned my addr 172.21.15.152:0/2917637091 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff376d9d640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378103f70 0x7ff37819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff37759e640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff37819ede0 0x7ff37819f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff36ffff640 1 -- 172.21.15.152:0/2917637091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff37819ede0 msgr2=0x7ff37819f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff36ffff640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff37819ede0 0x7ff37819f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff36ffff640 1 -- 172.21.15.152:0/2917637091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378103f70 msgr2=0x7ff37819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff36ffff640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378103f70 0x7ff37819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff36ffff640 1 -- 172.21.15.152:0/2917637091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37819f8d0 con 0x7ff3781090c0 2024-09-11T22:17:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff36ffff640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3781090c0 0x7ff37819aa60 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ff36000e9f0 tx=0x7ff36000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff374d99640 1 -- 172.21.15.152:0/2917637091 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36000ccc0 con 0x7ff3781090c0 2024-09-11T22:17:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff374d99640 1 -- 172.21.15.152:0/2917637091 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff360005500 con 0x7ff3781090c0 2024-09-11T22:17:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff37d1cf640 1 -- 172.21.15.152:0/2917637091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff37819fbc0 con 0x7ff3781090c0 2024-09-11T22:17:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff374d99640 1 -- 172.21.15.152:0/2917637091 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360010690 con 0x7ff3781090c0 2024-09-11T22:17:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.850+0000 7ff37d1cf640 1 -- 172.21.15.152:0/2917637091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3781a73b0 con 0x7ff3781090c0 2024-09-11T22:17:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.853+0000 7ff380044740 1 Processor -- start 2024-09-11T22:17:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.854+0000 7ff374d99640 1 -- 172.21.15.152:0/2917637091 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff360004f20 con 0x7ff3781090c0 2024-09-11T22:17:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.854+0000 7ff380044740 1 -- start start 2024-09-11T22:17:22.857 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff380044740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b8af0 0x55b5f84b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff380044740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b9410 0x55b5f84c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff380044740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff380044740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b5f841d2f0 con 0x55b5f84b9410 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff380044740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b5f83c5270 con 0x55b5f84b8af0 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff380044740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b5f84192b0 con 0x55b5f84c3cb0 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff37759e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b8af0 0x55b5f84b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff376d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b9410 0x55b5f84c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff36ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff376d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b9410 0x55b5f84c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:38400/0 (socket says 172.21.15.152:38400) 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff376d9d640 1 -- 172.21.15.152:0/922797658 learned_addr learned my addr 172.21.15.152:0/922797658 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff37759e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b8af0 0x55b5f84b8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37984/0 (socket says 172.21.15.152:37984) 2024-09-11T22:17:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff36ffff640 1 -- 172.21.15.152:0/922797658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b8af0 msgr2=0x55b5f84b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff36ffff640 1 --2- 172.21.15.152:0/922797658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b8af0 0x55b5f84b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff36ffff640 1 -- 172.21.15.152:0/922797658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b9410 msgr2=0x55b5f84c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff36ffff640 1 --2- 172.21.15.152:0/922797658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b9410 0x55b5f84c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.855+0000 7ff36ffff640 1 -- 172.21.15.152:0/922797658 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f83c4340 con 0x55b5f84c3cb0 2024-09-11T22:17:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.856+0000 7ff36ffff640 1 --2- 172.21.15.152:0/922797658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c60a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff3600cced0 tx=0x7ff3600d5b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10d790fd2d81b30f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.856+0000 7ff374d99640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3640a2ea0 0x7ff3640a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.856+0000 7ff374d99640 1 -- 172.21.15.152:0/2917637091 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7ff3600cf840 con 0x7ff3781090c0 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.857+0000 7ff36d7fa640 1 -- 172.21.15.152:0/922797658 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3600de070 con 0x55b5f84c3cb0 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.857+0000 7ff36d7fa640 1 -- 172.21.15.152:0/922797658 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff36009c3a0 con 0x55b5f84c3cb0 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.857+0000 7ff36d7fa640 1 -- 172.21.15.152:0/922797658 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36009b7e0 con 0x55b5f84c3cb0 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.857+0000 7ff37759e640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3640a2ea0 0x7ff3640a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.858+0000 7ff380044740 1 -- 172.21.15.152:0/922797658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84c3cb0 msgr2=0x55b5f84c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.858+0000 7ff380044740 1 --2- 172.21.15.152:0/922797658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c60a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff3600cced0 tx=0x7ff3600d5b20 comp rx=0 tx=0).stop 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.858+0000 7ff37759e640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3640a2ea0 0x7ff3640a5360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff370005e30 tx=0x7ff370005c30 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.858+0000 7ff380044740 1 -- 172.21.15.152:0/922797658 shutdown_connections 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.858+0000 7ff380044740 1 --2- 172.21.15.152:0/922797658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c60a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.858+0000 7ff380044740 1 --2- 172.21.15.152:0/922797658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b9410 0x55b5f84c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.858+0000 7ff380044740 1 --2- 172.21.15.152:0/922797658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b8af0 0x55b5f84b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.858+0000 7ff380044740 1 -- 172.21.15.152:0/922797658 >> 172.21.15.152:0/922797658 conn(0x55b5f84b5060 msgr2=0x55b5f84b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.858+0000 7ff380044740 1 -- 172.21.15.152:0/922797658 shutdown_connections 2024-09-11T22:17:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.858+0000 7ff380044740 1 -- 172.21.15.152:0/922797658 wait complete. 2024-09-11T22:17:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.859+0000 7ff380044740 1 -- start start 2024-09-11T22:17:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.859+0000 7ff380044740 1 Processor -- start 2024-09-11T22:17:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.859+0000 7ff380044740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 0x55b5f84c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.859+0000 7ff380044740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 0x55b5f84c1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.859+0000 7ff380044740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff376d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 0x55b5f84c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff376d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 0x55b5f84c0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:36736/0 (socket says 172.21.15.152:36736) 2024-09-11T22:17:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff380044740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b5f84c6880 con 0x55b5f84c3cb0 2024-09-11T22:17:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff380044740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b5f83a6290 con 0x55b5f84b9410 2024-09-11T22:17:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff380044740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b5f84c6a00 con 0x55b5f84b8af0 2024-09-11T22:17:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff36ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 0x55b5f84c1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff36ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 0x55b5f84c1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:38000/0 (socket says 172.21.15.152:38000) 2024-09-11T22:17:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff36ffff640 1 -- 172.21.15.152:0/1040108837 learned_addr learned my addr 172.21.15.152:0/1040108837 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff380044740 10 client.0 _ll_register_callbacks cb 0x55b5f83d7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff37759e640 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff376d9d640 1 -- 172.21.15.152:0/1040108837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 msgr2=0x55b5f84c1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff376d9d640 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 0x55b5f84c1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff376d9d640 1 -- 172.21.15.152:0/1040108837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84c3cb0 msgr2=0x55b5f84c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff376d9d640 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff376d9d640 1 -- 172.21.15.152:0/1040108837 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f8130210 con 0x55b5f84b8af0 2024-09-11T22:17:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.860+0000 7ff37759e640 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.861+0000 7ff376d9d640 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 0x55b5f84c0c50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff368005bc0 tx=0x7ff368012b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33b367fb40127988 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.861+0000 7ff35e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:17:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.861+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1040108837 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368004050 con 0x55b5f84b8af0 2024-09-11T22:17:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.861+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1040108837 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7ff3680041f0 con 0x55b5f84b8af0 2024-09-11T22:17:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.862+0000 7ff380044740 1 -- 172.21.15.152:0/1040108837 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff36009c3a0 con 0x55b5f84b8af0 2024-09-11T22:17:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.862+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1040108837 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff3680043f0 con 0x55b5f84b8af0 2024-09-11T22:17:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.862+0000 7ff380044740 10 client.28087 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.862+0000 7ff380044740 1 -- 172.21.15.152:0/1040108837 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b5f81fc620 con 0x55b5f84b8af0 2024-09-11T22:17:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.862+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1040108837 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff36800fe00 con 0x55b5f84b8af0 2024-09-11T22:17:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.863+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1040108837 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff368010430 con 0x55b5f84b8af0 2024-09-11T22:17:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.863+0000 7ff380044740 10 client.28087 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.863+0000 7ff380044740 10 client.28087 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.863+0000 7ff380044740 20 client.28087 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.863+0000 7ff380044740 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5f84d4110 0x55b5f84d65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.863+0000 7ff380044740 4 client.28087 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.863+0000 7ff380044740 1 -- 172.21.15.152:0/1040108837 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff36009c3a0 con 0x55b5f84d4110 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.863+0000 7ff36ffff640 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5f84d4110 0x55b5f84d65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.864+0000 7ff36ffff640 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5f84d4110 0x55b5f84d65d0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=712d3d65dd80add2 server_cookie=92acb53346a81d62 in_seq=0 out_seq=0 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.864+0000 7ff35e7fc640 10 client.28087 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1040108837 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff36009c3a0 con 0x55b5f84d4110 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff35e7fc640 10 client.28087 handle_command_reply: tid=0 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff380044740 1 client.28087 shutdown 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff380044740 1 -- 172.21.15.152:0/1040108837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 msgr2=0x55b5f84c0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff380044740 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 0x55b5f84c0c50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff368005bc0 tx=0x7ff368012b80 comp rx=0 tx=0).stop 2024-09-11T22:17:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff380044740 1 -- 172.21.15.152:0/1040108837 shutdown_connections 2024-09-11T22:17:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff380044740 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5f84d4110 0x55b5f84d65d0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff380044740 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff380044740 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 0x55b5f84c1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff35e7fc640 0 client.28087 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff380044740 1 --2- 172.21.15.152:0/1040108837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 0x55b5f84c0c50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff380044740 1 -- 172.21.15.152:0/1040108837 >> 172.21.15.152:0/1040108837 conn(0x55b5f84b5060 msgr2=0x55b5f84badc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff380044740 1 -- 172.21.15.152:0/1040108837 shutdown_connections 2024-09-11T22:17:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.865+0000 7ff380044740 1 -- 172.21.15.152:0/1040108837 wait complete. 2024-09-11T22:17:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.866+0000 7ff380044740 20 client.28087 trim_cache size 0 max 16384 2024-09-11T22:17:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.892+0000 7ff380044740 1 Processor -- start 2024-09-11T22:17:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.892+0000 7ff380044740 1 -- start start 2024-09-11T22:17:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.893+0000 7ff380044740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 0x55b5f84c1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.893+0000 7ff380044740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 0x55b5f84bacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.893+0000 7ff376d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 0x55b5f84c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.893+0000 7ff376d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 0x55b5f84c1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:36746/0 (socket says 172.21.15.152:36746) 2024-09-11T22:17:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.893+0000 7ff376d9d640 1 -- 172.21.15.152:0/688938076 learned_addr learned my addr 172.21.15.152:0/688938076 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.893+0000 7ff36ffff640 1 --2- 172.21.15.152:0/688938076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 0x55b5f84bacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.893+0000 7ff380044740 1 --2- 172.21.15.152:0/688938076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84c3cb0 0x55b5f84dbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.894+0000 7ff380044740 1 -- 172.21.15.152:0/688938076 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3781b2410 con 0x55b5f84c3cb0 2024-09-11T22:17:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.894+0000 7ff380044740 1 -- 172.21.15.152:0/688938076 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff3781afce0 con 0x55b5f84b9410 2024-09-11T22:17:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.894+0000 7ff380044740 1 -- 172.21.15.152:0/688938076 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff3781adb50 con 0x55b5f84b8af0 2024-09-11T22:17:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.894+0000 7ff37759e640 1 --2- 172.21.15.152:0/688938076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84c3cb0 0x55b5f84dbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.894+0000 7ff36ffff640 1 -- 172.21.15.152:0/688938076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 msgr2=0x55b5f84c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.894+0000 7ff36ffff640 1 --2- 172.21.15.152:0/688938076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 0x55b5f84c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.894+0000 7ff36ffff640 1 -- 172.21.15.152:0/688938076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84c3cb0 msgr2=0x55b5f84dbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.894+0000 7ff36ffff640 1 --2- 172.21.15.152:0/688938076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84c3cb0 0x55b5f84dbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.894+0000 7ff36ffff640 1 -- 172.21.15.152:0/688938076 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f84b4e90 con 0x55b5f84b9410 2024-09-11T22:17:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.895+0000 7ff36ffff640 1 --2- 172.21.15.152:0/688938076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 0x55b5f84bacb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff3600a43e0 tx=0x7ff36000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93cc2f45b538df62 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.895+0000 7ff36cff9640 1 -- 172.21.15.152:0/688938076 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3600de040 con 0x55b5f84b9410 2024-09-11T22:17:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.895+0000 7ff36cff9640 1 -- 172.21.15.152:0/688938076 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff36009c3a0 con 0x55b5f84b9410 2024-09-11T22:17:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.895+0000 7ff36cff9640 1 -- 172.21.15.152:0/688938076 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3600056b0 con 0x55b5f84b9410 2024-09-11T22:17:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.896+0000 7ff380044740 1 -- 172.21.15.152:0/688938076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 msgr2=0x55b5f84bacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.896+0000 7ff380044740 1 --2- 172.21.15.152:0/688938076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 0x55b5f84bacb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff3600a43e0 tx=0x7ff36000cf60 comp rx=0 tx=0).stop 2024-09-11T22:17:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.897+0000 7ff380044740 1 -- 172.21.15.152:0/688938076 shutdown_connections 2024-09-11T22:17:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.897+0000 7ff380044740 1 --2- 172.21.15.152:0/688938076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84c3cb0 0x55b5f84dbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.897+0000 7ff380044740 1 --2- 172.21.15.152:0/688938076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84b9410 0x55b5f84bacb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.897+0000 7ff380044740 1 --2- 172.21.15.152:0/688938076 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b8af0 0x55b5f84c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.897+0000 7ff380044740 1 -- 172.21.15.152:0/688938076 >> 172.21.15.152:0/688938076 conn(0x55b5f84b5060 msgr2=0x55b5f84ba5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.897+0000 7ff380044740 1 -- 172.21.15.152:0/688938076 shutdown_connections 2024-09-11T22:17:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.897+0000 7ff380044740 1 -- 172.21.15.152:0/688938076 wait complete. 2024-09-11T22:17:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff380044740 1 -- start start 2024-09-11T22:17:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff380044740 1 Processor -- start 2024-09-11T22:17:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff380044740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b8af0 0x55b5f84cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff380044740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b9410 0x55b5f84c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff380044740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff380044740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3781ae1a0 con 0x55b5f84b8af0 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff37759e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff37759e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:38030/0 (socket says 172.21.15.152:38030) 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff37759e640 1 -- 172.21.15.152:0/1238556351 learned_addr learned my addr 172.21.15.152:0/1238556351 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff36ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b9410 0x55b5f84c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff380044740 1 -- 172.21.15.152:0/1238556351 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff3781af610 con 0x55b5f84c3cb0 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.898+0000 7ff380044740 1 -- 172.21.15.152:0/1238556351 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff3781ae870 con 0x55b5f84b9410 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.899+0000 7ff380044740 10 client.0 _ll_register_callbacks cb 0x7ff368009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.899+0000 7ff376d9d640 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b8af0 0x55b5f84cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.899+0000 7ff376d9d640 1 -- 172.21.15.152:0/1238556351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b9410 msgr2=0x55b5f84c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.899+0000 7ff376d9d640 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b9410 0x55b5f84c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.899+0000 7ff376d9d640 1 -- 172.21.15.152:0/1238556351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84c3cb0 msgr2=0x55b5f84c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.899+0000 7ff376d9d640 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.899+0000 7ff376d9d640 1 -- 172.21.15.152:0/1238556351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f84c1a40 con 0x55b5f84b8af0 2024-09-11T22:17:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.899+0000 7ff36ffff640 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b9410 0x55b5f84c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.899+0000 7ff37759e640 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.900+0000 7ff376d9d640 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b8af0 0x55b5f84cc190 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff368005b90 tx=0x7ff36800fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d7d61e84f72df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.900+0000 7ff35e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.900+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1238556351 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36802b040 con 0x55b5f84b8af0 2024-09-11T22:17:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.900+0000 7ff380044740 1 -- 172.21.15.152:0/1238556351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff36009c3a0 con 0x55b5f84b8af0 2024-09-11T22:17:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.900+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1238556351 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7ff36800fcc0 con 0x55b5f84b8af0 2024-09-11T22:17:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.900+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1238556351 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff368012320 con 0x55b5f84b8af0 2024-09-11T22:17:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.900+0000 7ff380044740 10 client.18699 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.900+0000 7ff380044740 1 -- 172.21.15.152:0/1238556351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b5f854fab0 con 0x55b5f84b8af0 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.901+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1238556351 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff36009c3a0 con 0x55b5f84b8af0 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.901+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1238556351 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff3680046a0 con 0x55b5f84b8af0 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.901+0000 7ff380044740 10 client.18699 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.901+0000 7ff380044740 10 client.18699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.901+0000 7ff380044740 20 client.18699 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.901+0000 7ff380044740 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5f85501c0 0x55b5f85525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.901+0000 7ff380044740 4 client.18699 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.901+0000 7ff380044740 1 -- 172.21.15.152:0/1238556351 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5f842aa20 con 0x55b5f85501c0 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.901+0000 7ff36ffff640 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5f85501c0 0x55b5f85525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.902+0000 7ff35e7fc640 10 client.18699 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.902+0000 7ff36ffff640 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5f85501c0 0x55b5f85525e0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ddf1cf04e4fdc80 server_cookie=aea0f986da3d86e in_seq=0 out_seq=0 2024-09-11T22:17:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff35e7fc640 1 -- 172.21.15.152:0/1238556351 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5f842aa20 con 0x55b5f85501c0 2024-09-11T22:17:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff35e7fc640 10 client.18699 handle_command_reply: tid=0 2024-09-11T22:17:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff380044740 1 client.18699 shutdown 2024-09-11T22:17:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff380044740 1 -- 172.21.15.152:0/1238556351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b8af0 msgr2=0x55b5f84cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff380044740 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b8af0 0x55b5f84cc190 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff368005b90 tx=0x7ff36800fb50 comp rx=0 tx=0).stop 2024-09-11T22:17:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff380044740 1 -- 172.21.15.152:0/1238556351 shutdown_connections 2024-09-11T22:17:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff380044740 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b5f85501c0 0x55b5f85525e0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff380044740 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5f84c3cb0 0x55b5f84c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff380044740 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b5f84b9410 0x55b5f84c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff380044740 1 --2- 172.21.15.152:0/1238556351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5f84b8af0 0x55b5f84cc190 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff35e7fc640 0 client.18699 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff380044740 1 -- 172.21.15.152:0/1238556351 >> 172.21.15.152:0/1238556351 conn(0x55b5f84b5060 msgr2=0x55b5f84c2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff380044740 1 -- 172.21.15.152:0/1238556351 shutdown_connections 2024-09-11T22:17:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.909+0000 7ff380044740 1 -- 172.21.15.152:0/1238556351 wait complete. 2024-09-11T22:17:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.910+0000 7ff380044740 20 client.18699 trim_cache size 0 max 16384 2024-09-11T22:17:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:17:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:17:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:17:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:17:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 -- 172.21.15.152:0/2917637091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3640a2ea0 msgr2=0x7ff3640a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3640a2ea0 0x7ff3640a5360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff370005e30 tx=0x7ff370005c30 comp rx=0 tx=0).stop 2024-09-11T22:17:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 -- 172.21.15.152:0/2917637091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3781090c0 msgr2=0x7ff37819aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3781090c0 0x7ff37819aa60 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ff36000e9f0 tx=0x7ff36000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 -- 172.21.15.152:0/2917637091 shutdown_connections 2024-09-11T22:17:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff3640a2ea0 0x7ff3640a5360 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff37819ede0 0x7ff37819f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3781090c0 0x7ff37819aa60 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 --2- 172.21.15.152:0/2917637091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378103f70 0x7ff37819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 -- 172.21.15.152:0/2917637091 >> 172.21.15.152:0/2917637091 conn(0x7ff3780ff980 msgr2=0x7ff378100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 -- 172.21.15.152:0/2917637091 shutdown_connections 2024-09-11T22:17:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:22.912+0000 7ff37d1cf640 1 -- 172.21.15.152:0/2917637091 wait complete. 2024-09-11T22:17:23.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:23 smithi152 ceph-mon[31188]: pgmap v410: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 650 op/s 2024-09-11T22:17:24.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:23 smithi179 ceph-mon[35603]: pgmap v410: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 650 op/s 2024-09-11T22:17:24.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:23 smithi193 ceph-mon[35545]: pgmap v410: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 650 op/s 2024-09-11T22:17:24.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 710.0 s, 2791.2 tps, lat 35.343 ms stddev 43.915 2024-09-11T22:17:25.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:25 smithi152 ceph-mon[31188]: pgmap v411: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 690 op/s 2024-09-11T22:17:26.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:25 smithi179 ceph-mon[35603]: pgmap v411: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 690 op/s 2024-09-11T22:17:26.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:25 smithi193 ceph-mon[35545]: pgmap v411: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 690 op/s 2024-09-11T22:17:27.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:27 smithi152 ceph-mon[31188]: pgmap v412: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 690 op/s 2024-09-11T22:17:28.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:27 smithi179 ceph-mon[35603]: pgmap v412: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 690 op/s 2024-09-11T22:17:28.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:27 smithi193 ceph-mon[35545]: pgmap v412: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 690 op/s 2024-09-11T22:17:29.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 715.0 s, 2781.8 tps, lat 36.622 ms stddev 51.947 2024-09-11T22:17:29.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:29 smithi152 ceph-mon[31188]: pgmap v413: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 881 op/s 2024-09-11T22:17:30.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:29 smithi179 ceph-mon[35603]: pgmap v413: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 881 op/s 2024-09-11T22:17:30.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:29 smithi193 ceph-mon[35545]: pgmap v413: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 881 op/s 2024-09-11T22:17:31.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:31 smithi152 ceph-mon[31188]: pgmap v414: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.3 MiB/s wr, 685 op/s 2024-09-11T22:17:32.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:31 smithi179 ceph-mon[35603]: pgmap v414: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.3 MiB/s wr, 685 op/s 2024-09-11T22:17:32.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:31 smithi193 ceph-mon[35545]: pgmap v414: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.3 MiB/s wr, 685 op/s 2024-09-11T22:17:33.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:33 smithi152 ceph-mon[31188]: pgmap v415: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.3 MiB/s wr, 685 op/s 2024-09-11T22:17:34.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:33 smithi179 ceph-mon[35603]: pgmap v415: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.3 MiB/s wr, 685 op/s 2024-09-11T22:17:34.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:33 smithi193 ceph-mon[35545]: pgmap v415: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.3 MiB/s wr, 685 op/s 2024-09-11T22:17:34.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 720.0 s, 2289.2 tps, lat 43.070 ms stddev 50.397 2024-09-11T22:17:35.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:35 smithi152 ceph-mon[31188]: pgmap v416: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 12 MiB/s wr, 983 op/s 2024-09-11T22:17:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.022+0000 7f131c38d640 1 -- 172.21.15.152:0/4054707824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1314101370 msgr2=0x7f131410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.022+0000 7f131c38d640 1 --2- 172.21.15.152:0/4054707824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1314101370 0x7f131410d8a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f130c009cd0 tx=0x7f130c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.023+0000 7f131c38d640 1 -- 172.21.15.152:0/4054707824 shutdown_connections 2024-09-11T22:17:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.023+0000 7f131c38d640 1 --2- 172.21.15.152:0/4054707824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1314101370 0x7f131410d8a0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.023+0000 7f131c38d640 1 --2- 172.21.15.152:0/4054707824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13141009d0 0x7f1314100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.023+0000 7f131c38d640 1 --2- 172.21.15.152:0/4054707824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141069e0 0x7f1314106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.023+0000 7f131c38d640 1 -- 172.21.15.152:0/4054707824 >> 172.21.15.152:0/4054707824 conn(0x7f13140fc6b0 msgr2=0x7f13140fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.025+0000 7f131c38d640 1 -- 172.21.15.152:0/4054707824 shutdown_connections 2024-09-11T22:17:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.025+0000 7f131c38d640 1 -- 172.21.15.152:0/4054707824 wait complete. 2024-09-11T22:17:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131c38d640 1 Processor -- start 2024-09-11T22:17:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131c38d640 1 -- start start 2024-09-11T22:17:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131c38d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141009d0 0x7f131419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131c38d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1314101370 0x7f131419a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131c38d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13141069e0 0x7f131419ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131c38d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1314110e20 con 0x7f1314101370 2024-09-11T22:17:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131c38d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1314110ca0 con 0x7f13141069e0 2024-09-11T22:17:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131c38d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1314110fa0 con 0x7f13141009d0 2024-09-11T22:17:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f1319928640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1314101370 0x7f131419a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131a129640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141009d0 0x7f131419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131a129640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141009d0 0x7f131419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37352/0 (socket says 172.21.15.152:37352) 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131a129640 1 -- 172.21.15.152:0/3731941739 learned_addr learned my addr 172.21.15.152:0/3731941739 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f1319928640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1314101370 0x7f131419a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43728/0 (socket says 172.21.15.152:43728) 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131a92a640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13141069e0 0x7f131419ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131a129640 1 -- 172.21.15.152:0/3731941739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13141069e0 msgr2=0x7f131419ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131a129640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13141069e0 0x7f131419ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131a129640 1 -- 172.21.15.152:0/3731941739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1314101370 msgr2=0x7f131419a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131a129640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1314101370 0x7f131419a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f131a129640 1 -- 172.21.15.152:0/3731941739 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131419f3b0 con 0x7f13141009d0 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.026+0000 7f1319928640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1314101370 0x7f131419a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.027+0000 7f131a129640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141009d0 0x7f131419a3c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f131000e9f0 tx=0x7f131000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.027+0000 7f130b7fe640 1 -- 172.21.15.152:0/3731941739 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131000cd80 con 0x7f13141009d0 2024-09-11T22:17:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.027+0000 7f131c38d640 1 -- 172.21.15.152:0/3731941739 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131419f6a0 con 0x7f13141009d0 2024-09-11T22:17:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.027+0000 7f130b7fe640 1 -- 172.21.15.152:0/3731941739 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1310005500 con 0x7f13141009d0 2024-09-11T22:17:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.027+0000 7f130b7fe640 1 -- 172.21.15.152:0/3731941739 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310010690 con 0x7f13141009d0 2024-09-11T22:17:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.027+0000 7f131c38d640 1 -- 172.21.15.152:0/3731941739 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13141a6f30 con 0x7f13141009d0 2024-09-11T22:17:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f131f202740 1 Processor -- start 2024-09-11T22:17:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f131f202740 1 -- start start 2024-09-11T22:17:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f130b7fe640 1 -- 172.21.15.152:0/3731941739 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f1310010830 con 0x7f13141009d0 2024-09-11T22:17:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f131f202740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758daf0 0x5636a758ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f131f202740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a758e410 0x5636a7598770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f131f202740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 0x5636a759b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f131f202740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5636a74f22f0 con 0x5636a758e410 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f131f202740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5636a749a270 con 0x5636a758daf0 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f131f202740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5636a74ee2b0 con 0x5636a7598cb0 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f1319928640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 0x5636a759b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f131a129640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a758e410 0x5636a7598770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f1319928640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 0x5636a759b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37356/0 (socket says 172.21.15.152:37356) 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f1319928640 1 -- 172.21.15.152:0/2493739240 learned_addr learned my addr 172.21.15.152:0/2493739240 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.030+0000 7f131a92a640 1 --2- 172.21.15.152:0/2493739240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758daf0 0x5636a758ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f1319928640 1 -- 172.21.15.152:0/2493739240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758daf0 msgr2=0x5636a758ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f1319928640 1 --2- 172.21.15.152:0/2493739240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758daf0 0x5636a758ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f1319928640 1 -- 172.21.15.152:0/2493739240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a758e410 msgr2=0x5636a7598770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f1319928640 1 --2- 172.21.15.152:0/2493739240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a758e410 0x5636a7598770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f1319928640 1 -- 172.21.15.152:0/2493739240 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a7499340 con 0x5636a7598cb0 2024-09-11T22:17:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f1319928640 1 --2- 172.21.15.152:0/2493739240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 0x5636a759b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f13040114f0 tx=0x7f13040119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a1c06c6a3939006 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f130b7fe640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f13000a2da0 0x7f13000a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f1308bfe640 1 -- 172.21.15.152:0/2493739240 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130401e070 con 0x5636a7598cb0 2024-09-11T22:17:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f131a92a640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f13000a2da0 0x7f13000a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f1308bfe640 1 -- 172.21.15.152:0/2493739240 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13040035f0 con 0x5636a7598cb0 2024-09-11T22:17:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f130b7fe640 1 -- 172.21.15.152:0/3731941739 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f13100cf830 con 0x7f13141009d0 2024-09-11T22:17:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.031+0000 7f1308bfe640 1 -- 172.21.15.152:0/2493739240 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130400f820 con 0x5636a7598cb0 2024-09-11T22:17:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131f202740 1 -- 172.21.15.152:0/2493739240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 msgr2=0x5636a759b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131f202740 1 --2- 172.21.15.152:0/2493739240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 0x5636a759b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f13040114f0 tx=0x7f13040119b0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131a92a640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f13000a2da0 0x7f13000a5260 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f130c009ca0 tx=0x7f130c005c50 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131f202740 1 -- 172.21.15.152:0/2493739240 shutdown_connections 2024-09-11T22:17:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131f202740 1 --2- 172.21.15.152:0/2493739240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 0x5636a759b0a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131f202740 1 --2- 172.21.15.152:0/2493739240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a758e410 0x5636a7598770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131f202740 1 --2- 172.21.15.152:0/2493739240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758daf0 0x5636a758ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131f202740 1 -- 172.21.15.152:0/2493739240 >> 172.21.15.152:0/2493739240 conn(0x5636a758a060 msgr2=0x5636a758a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131f202740 1 -- 172.21.15.152:0/2493739240 shutdown_connections 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131f202740 1 -- 172.21.15.152:0/2493739240 wait complete. 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131f202740 1 -- start start 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.032+0000 7f131f202740 1 Processor -- start 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.033+0000 7f131f202740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a758daf0 0x5636a7595b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.033+0000 7f131f202740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a7596080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.033+0000 7f131f202740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 0x5636a75965c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.033+0000 7f131f202740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5636a759b880 con 0x5636a758daf0 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.033+0000 7f131f202740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5636a747b290 con 0x5636a758e410 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.033+0000 7f131f202740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5636a759ba00 con 0x5636a7598cb0 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.033+0000 7f131f202740 10 client.0 _ll_register_callbacks cb 0x5636a74ac140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.033+0000 7f1319928640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a7596080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.033+0000 7f1319928640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a7596080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41348/0 (socket says 172.21.15.152:41348) 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.033+0000 7f1319928640 1 -- 172.21.15.152:0/2860711890 learned_addr learned my addr 172.21.15.152:0/2860711890 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.033+0000 7f131a129640 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a758daf0 0x5636a7595b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.034+0000 7f131a92a640 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 0x5636a75965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.034+0000 7f1319928640 1 -- 172.21.15.152:0/2860711890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 msgr2=0x5636a75965c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.034+0000 7f1319928640 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 0x5636a75965c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.034+0000 7f1319928640 1 -- 172.21.15.152:0/2860711890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a758daf0 msgr2=0x5636a7595b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.034+0000 7f1319928640 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a758daf0 0x5636a7595b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.034+0000 7f1319928640 1 -- 172.21.15.152:0/2860711890 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636a7205210 con 0x5636a758e410 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.034+0000 7f131a92a640 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 0x5636a75965c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.034+0000 7f131a129640 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a758daf0 0x5636a7595b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.034+0000 7f1319928640 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a7596080 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f13040114c0 tx=0x7f13040039d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91228feaa3a4f9b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.035+0000 7f12fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:17:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.035+0000 7f12fdffb640 1 -- 172.21.15.152:0/2860711890 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304026020 con 0x5636a758e410 2024-09-11T22:17:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.035+0000 7f12fdffb640 1 -- 172.21.15.152:0/2860711890 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f1304003b70 con 0x5636a758e410 2024-09-11T22:17:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.035+0000 7f131f202740 1 -- 172.21.15.152:0/2860711890 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13040035f0 con 0x5636a758e410 2024-09-11T22:17:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.036+0000 7f12fdffb640 1 -- 172.21.15.152:0/2860711890 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1304031050 con 0x5636a758e410 2024-09-11T22:17:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.036+0000 7f131f202740 10 client.27959 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.036+0000 7f131f202740 1 -- 172.21.15.152:0/2860711890 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5636a72d1620 con 0x5636a758e410 2024-09-11T22:17:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.038+0000 7f12fdffb640 1 -- 172.21.15.152:0/2860711890 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13040035f0 con 0x5636a758e410 2024-09-11T22:17:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.038+0000 7f12fdffb640 1 -- 172.21.15.152:0/2860711890 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f1304021030 con 0x5636a758e410 2024-09-11T22:17:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.038+0000 7f131f202740 10 client.27959 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.038+0000 7f131f202740 10 client.27959 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.038+0000 7f131f202740 20 client.27959 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.038+0000 7f131f202740 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5636a75a8ba0 0x5636a75aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.038+0000 7f131f202740 4 client.27959 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.038+0000 7f131f202740 1 -- 172.21.15.152:0/2860711890 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636a74ffa20 con 0x5636a75a8ba0 2024-09-11T22:17:36.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:35 smithi179 ceph-mon[35603]: pgmap v416: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 12 MiB/s wr, 983 op/s 2024-09-11T22:17:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.049+0000 7f131a129640 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5636a75a8ba0 0x5636a75aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.054+0000 7f12fdffb640 10 client.27959 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.054+0000 7f131a129640 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5636a75a8ba0 0x5636a75aaf90 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85e5a785b91e11fa server_cookie=d18039bcac9f8d5f in_seq=0 out_seq=0 2024-09-11T22:17:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.056+0000 7f12fdffb640 1 -- 172.21.15.152:0/2860711890 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636a74ffa20 con 0x5636a75a8ba0 2024-09-11T22:17:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.056+0000 7f12fdffb640 10 client.27959 handle_command_reply: tid=0 2024-09-11T22:17:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.056+0000 7f131f202740 1 client.27959 shutdown 2024-09-11T22:17:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.056+0000 7f131f202740 1 -- 172.21.15.152:0/2860711890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 msgr2=0x5636a7596080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.056+0000 7f131f202740 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a7596080 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f13040114c0 tx=0x7f13040039d0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.056+0000 7f131f202740 1 -- 172.21.15.152:0/2860711890 shutdown_connections 2024-09-11T22:17:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.056+0000 7f131f202740 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5636a75a8ba0 0x5636a75aaf90 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.057+0000 7f131f202740 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a7598cb0 0x5636a75965c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.057+0000 7f12fdffb640 0 client.27959 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.057+0000 7f131f202740 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a7596080 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.057+0000 7f131f202740 1 --2- 172.21.15.152:0/2860711890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a758daf0 0x5636a7595b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.057+0000 7f131f202740 1 -- 172.21.15.152:0/2860711890 >> 172.21.15.152:0/2860711890 conn(0x5636a758a060 msgr2=0x5636a758fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.057+0000 7f131f202740 1 -- 172.21.15.152:0/2860711890 shutdown_connections 2024-09-11T22:17:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.057+0000 7f131f202740 1 -- 172.21.15.152:0/2860711890 wait complete. 2024-09-11T22:17:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.057+0000 7f131f202740 20 client.27959 trim_cache size 0 max 16384 2024-09-11T22:17:36.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:35 smithi193 ceph-mon[35545]: pgmap v416: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 12 MiB/s wr, 983 op/s 2024-09-11T22:17:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f131f202740 1 Processor -- start 2024-09-11T22:17:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f131f202740 1 -- start start 2024-09-11T22:17:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f131f202740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a758daf0 0x5636a7594a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f131f202740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a75963f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f131f202740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 0x5636a75b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f131f202740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f13141b2540 con 0x5636a7598cb0 2024-09-11T22:17:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f131f202740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13141afe10 con 0x5636a758e410 2024-09-11T22:17:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f131f202740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f13141adc80 con 0x5636a758daf0 2024-09-11T22:17:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f131a92a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 0x5636a75b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f1319928640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a75963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f1319928640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a75963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41360/0 (socket says 172.21.15.152:41360) 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f131a92a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 0x5636a75b06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43764/0 (socket says 172.21.15.152:43764) 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f1319928640 1 -- 172.21.15.152:0/3950085306 learned_addr learned my addr 172.21.15.152:0/3950085306 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.077+0000 7f131a129640 1 --2- 172.21.15.152:0/3950085306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a758daf0 0x5636a7594a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.078+0000 7f131a92a640 1 -- 172.21.15.152:0/3950085306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a758daf0 msgr2=0x5636a7594a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.078+0000 7f131a92a640 1 --2- 172.21.15.152:0/3950085306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a758daf0 0x5636a7594a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.078+0000 7f131a92a640 1 -- 172.21.15.152:0/3950085306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 msgr2=0x5636a75963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.078+0000 7f131a92a640 1 --2- 172.21.15.152:0/3950085306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a75963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.078+0000 7f131a92a640 1 -- 172.21.15.152:0/3950085306 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a7589e90 con 0x5636a7598cb0 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.078+0000 7f1319928640 1 --2- 172.21.15.152:0/3950085306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a75963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.078+0000 7f131a92a640 1 --2- 172.21.15.152:0/3950085306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 0x5636a75b06b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f130c005cc0 tx=0x7f130c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bb7f45f854ed70 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.078+0000 7f12fffff640 1 -- 172.21.15.152:0/3950085306 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c003a30 con 0x5636a7598cb0 2024-09-11T22:17:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.078+0000 7f12fffff640 1 -- 172.21.15.152:0/3950085306 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f130c056070 con 0x5636a7598cb0 2024-09-11T22:17:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.078+0000 7f12fffff640 1 -- 172.21.15.152:0/3950085306 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c030800 con 0x5636a7598cb0 2024-09-11T22:17:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.079+0000 7f131f202740 1 -- 172.21.15.152:0/3950085306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 msgr2=0x5636a75b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.079+0000 7f131f202740 1 --2- 172.21.15.152:0/3950085306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 0x5636a75b06b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f130c005cc0 tx=0x7f130c040000 comp rx=0 tx=0).stop 2024-09-11T22:17:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.079+0000 7f131f202740 1 -- 172.21.15.152:0/3950085306 shutdown_connections 2024-09-11T22:17:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.079+0000 7f131f202740 1 --2- 172.21.15.152:0/3950085306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 0x5636a75b06b0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.079+0000 7f131f202740 1 --2- 172.21.15.152:0/3950085306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a75963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.079+0000 7f131f202740 1 --2- 172.21.15.152:0/3950085306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a758daf0 0x5636a7594a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.079+0000 7f131f202740 1 -- 172.21.15.152:0/3950085306 >> 172.21.15.152:0/3950085306 conn(0x5636a758a060 msgr2=0x5636a7597bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.079+0000 7f131f202740 1 -- 172.21.15.152:0/3950085306 shutdown_connections 2024-09-11T22:17:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.079+0000 7f131f202740 1 -- 172.21.15.152:0/3950085306 wait complete. 2024-09-11T22:17:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131f202740 1 -- start start 2024-09-11T22:17:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131f202740 1 Processor -- start 2024-09-11T22:17:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131f202740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a758daf0 0x5636a75a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131f202740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a75a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131f202740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 0x5636a7592330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131f202740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f13141ae2d0 con 0x5636a7598cb0 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131f202740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13141af740 con 0x5636a758e410 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131f202740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f13141ae9a0 con 0x5636a758daf0 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131f202740 10 client.0 _ll_register_callbacks cb 0x7f130401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f1319928640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a75a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131a129640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a758daf0 0x5636a75a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131a92a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 0x5636a7592330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131a129640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a758daf0 0x5636a75a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37364/0 (socket says 172.21.15.152:37364) 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.080+0000 7f131a129640 1 -- 172.21.15.152:0/2825176077 learned_addr learned my addr 172.21.15.152:0/2825176077 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f1319928640 1 -- 172.21.15.152:0/2825176077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a758daf0 msgr2=0x5636a75a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f1319928640 1 --2- 172.21.15.152:0/2825176077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a758daf0 0x5636a75a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f1319928640 1 -- 172.21.15.152:0/2825176077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 msgr2=0x5636a7592330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f1319928640 1 --2- 172.21.15.152:0/2825176077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 0x5636a7592330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f1319928640 1 -- 172.21.15.152:0/2825176077 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636a758acf0 con 0x5636a758e410 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f1319928640 1 --2- 172.21.15.152:0/2825176077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a75a13c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f13040114f0 tx=0x7f130400f630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56179f5cf96206ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f12fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f12fdffb640 1 -- 172.21.15.152:0/2825176077 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130403a060 con 0x5636a758e410 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f131f202740 1 -- 172.21.15.152:0/2825176077 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f130c056070 con 0x5636a758e410 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f12fdffb640 1 -- 172.21.15.152:0/2825176077 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f1304003a70 con 0x5636a758e410 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f12fdffb640 1 -- 172.21.15.152:0/2825176077 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1304026070 con 0x5636a758e410 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f131f202740 10 client.27965 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f131f202740 1 -- 172.21.15.152:0/2825176077 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5636a7612e30 con 0x5636a758e410 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.081+0000 7f12fdffb640 1 -- 172.21.15.152:0/2825176077 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f130c056070 con 0x5636a758e410 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.082+0000 7f12fdffb640 1 -- 172.21.15.152:0/2825176077 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f1304021050 con 0x5636a758e410 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.082+0000 7f131f202740 10 client.27965 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.082+0000 7f131f202740 10 client.27965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.082+0000 7f131f202740 20 client.27965 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.082+0000 7f131f202740 1 --2- 172.21.15.152:0/2825176077 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5636a75a8ba0 0x5636a76154e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.082+0000 7f131f202740 4 client.27965 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:17:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.082+0000 7f131f202740 1 -- 172.21.15.152:0/2825176077 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5636a74f9d70 con 0x5636a75a8ba0 2024-09-11T22:17:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.082+0000 7f131a129640 1 --2- 172.21.15.152:0/2825176077 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5636a75a8ba0 0x5636a76154e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.082+0000 7f131a129640 1 --2- 172.21.15.152:0/2825176077 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5636a75a8ba0 0x5636a76154e0 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcdcafd145c67a19 server_cookie=341e42908ccfe807 in_seq=0 out_seq=0 2024-09-11T22:17:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.082+0000 7f12fdffb640 10 client.27965 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f12fdffb640 1 -- 172.21.15.152:0/2825176077 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5636a74f9d70 con 0x5636a75a8ba0 2024-09-11T22:17:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f12fdffb640 10 client.27965 handle_command_reply: tid=0 2024-09-11T22:17:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 1 client.27965 shutdown 2024-09-11T22:17:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 1 -- 172.21.15.152:0/2825176077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 msgr2=0x5636a75a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 1 --2- 172.21.15.152:0/2825176077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a75a13c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f13040114f0 tx=0x7f130400f630 comp rx=0 tx=0).stop 2024-09-11T22:17:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 1 -- 172.21.15.152:0/2825176077 shutdown_connections 2024-09-11T22:17:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 1 --2- 172.21.15.152:0/2825176077 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5636a75a8ba0 0x5636a76154e0 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 1 --2- 172.21.15.152:0/2825176077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636a7598cb0 0x5636a7592330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 1 --2- 172.21.15.152:0/2825176077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5636a758e410 0x5636a75a13c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f12fdffb640 0 client.27965 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 1 --2- 172.21.15.152:0/2825176077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5636a758daf0 0x5636a75a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 1 -- 172.21.15.152:0/2825176077 >> 172.21.15.152:0/2825176077 conn(0x5636a758a060 msgr2=0x5636a758f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 1 -- 172.21.15.152:0/2825176077 shutdown_connections 2024-09-11T22:17:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 1 -- 172.21.15.152:0/2825176077 wait complete. 2024-09-11T22:17:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.092+0000 7f131f202740 20 client.27965 trim_cache size 0 max 16384 2024-09-11T22:17:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:17:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:17:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:17:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:17:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 -- 172.21.15.152:0/3731941739 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f13000a2da0 msgr2=0x7f13000a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f13000a2da0 0x7f13000a5260 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f130c009ca0 tx=0x7f130c005c50 comp rx=0 tx=0).stop 2024-09-11T22:17:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 -- 172.21.15.152:0/3731941739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141009d0 msgr2=0x7f131419a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141009d0 0x7f131419a3c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f131000e9f0 tx=0x7f131000edf0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 -- 172.21.15.152:0/3731941739 shutdown_connections 2024-09-11T22:17:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f13000a2da0 0x7f13000a5260 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13141069e0 0x7f131419ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1314101370 0x7f131419a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 --2- 172.21.15.152:0/3731941739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13141009d0 0x7f131419a3c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 -- 172.21.15.152:0/3731941739 >> 172.21.15.152:0/3731941739 conn(0x7f13140fc6b0 msgr2=0x7f131406a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 -- 172.21.15.152:0/3731941739 shutdown_connections 2024-09-11T22:17:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:36.093+0000 7f131c38d640 1 -- 172.21.15.152:0/3731941739 wait complete. 2024-09-11T22:17:37.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:37 smithi152 ceph-mon[31188]: pgmap v417: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.9 MiB/s wr, 680 op/s 2024-09-11T22:17:38.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:37 smithi179 ceph-mon[35603]: pgmap v417: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.9 MiB/s wr, 680 op/s 2024-09-11T22:17:38.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:37 smithi193 ceph-mon[35545]: pgmap v417: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.9 MiB/s wr, 680 op/s 2024-09-11T22:17:39.307 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:17:39.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:39 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:17:39.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:39 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:17:39.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:39 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:17:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 725.0 s, 1664.3 tps, lat 51.906 ms stddev 57.747 2024-09-11T22:17:39.958 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:40.410 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:40 smithi152 ceph-mon[31188]: pgmap v418: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 971 op/s 2024-09-11T22:17:40.410 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:40 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:17:40.410 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:40 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:17:40.410 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:40 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:17:40.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:40 smithi179 ceph-mon[35603]: pgmap v418: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 971 op/s 2024-09-11T22:17:40.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:40 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:17:40.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:40 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:17:40.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:40 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:17:40.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:40 smithi193 ceph-mon[35545]: pgmap v418: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 971 op/s 2024-09-11T22:17:40.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:40 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:17:40.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:40 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:17:40.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:40 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:17:40.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.833+0000 7f59823c0640 1 -- 172.21.15.152:0/3634191410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f597c103650 msgr2=0x7f597c10bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:40.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.833+0000 7f59823c0640 1 --2- 172.21.15.152:0/3634191410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f597c103650 0x7f597c10bb40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5970009900 tx=0x7f597002a480 comp rx=0 tx=0).stop 2024-09-11T22:17:40.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.833+0000 7f59823c0640 1 -- 172.21.15.152:0/3634191410 shutdown_connections 2024-09-11T22:17:40.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.833+0000 7f59823c0640 1 --2- 172.21.15.152:0/3634191410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f597c10c160 0x7f597c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.833+0000 7f59823c0640 1 --2- 172.21.15.152:0/3634191410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f597c103650 0x7f597c10bb40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.833+0000 7f59823c0640 1 --2- 172.21.15.152:0/3634191410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f597c102d30 0x7f597c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.833+0000 7f59823c0640 1 -- 172.21.15.152:0/3634191410 >> 172.21.15.152:0/3634191410 conn(0x7f597c0fc7d0 msgr2=0x7f597c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.833+0000 7f59823c0640 1 -- 172.21.15.152:0/3634191410 shutdown_connections 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.833+0000 7f59823c0640 1 -- 172.21.15.152:0/3634191410 wait complete. 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.834+0000 7f59823c0640 1 Processor -- start 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.834+0000 7f59823c0640 1 -- start start 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.834+0000 7f59823c0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f597c102d30 0x7f597c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.834+0000 7f59823c0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f597c103650 0x7f597c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.834+0000 7f59823c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f597c10c160 0x7f597c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.834+0000 7f59823c0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f597c111f60 con 0x7f597c10c160 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.834+0000 7f59823c0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f597c111de0 con 0x7f597c102d30 2024-09-11T22:17:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.834+0000 7f59823c0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f597c1120e0 con 0x7f597c103650 2024-09-11T22:17:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.834+0000 7f598095d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f597c10c160 0x7f597c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.835+0000 7f597bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f597c102d30 0x7f597c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.835+0000 7f598095d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f597c10c160 0x7f597c19cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43782/0 (socket says 172.21.15.152:43782) 2024-09-11T22:17:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.835+0000 7f598095d640 1 -- 172.21.15.152:0/2013034573 learned_addr learned my addr 172.21.15.152:0/2013034573 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.835+0000 7f597b7fe640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f597c103650 0x7f597c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.835+0000 7f598095d640 1 -- 172.21.15.152:0/2013034573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f597c103650 msgr2=0x7f597c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.835+0000 7f598095d640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f597c103650 0x7f597c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.835+0000 7f598095d640 1 -- 172.21.15.152:0/2013034573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f597c102d30 msgr2=0x7f597c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.835+0000 7f598095d640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f597c102d30 0x7f597c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.835+0000 7f598095d640 1 -- 172.21.15.152:0/2013034573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597c19d490 con 0x7f597c10c160 2024-09-11T22:17:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.835+0000 7f598095d640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f597c10c160 0x7f597c19cdb0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f597400eaa0 tx=0x7f597400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.836+0000 7f59797fa640 1 -- 172.21.15.152:0/2013034573 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597400cdb0 con 0x7f597c10c160 2024-09-11T22:17:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.836+0000 7f59797fa640 1 -- 172.21.15.152:0/2013034573 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5974005020 con 0x7f597c10c160 2024-09-11T22:17:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.836+0000 7f59797fa640 1 -- 172.21.15.152:0/2013034573 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59740116d0 con 0x7f597c10c160 2024-09-11T22:17:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.836+0000 7f59823c0640 1 -- 172.21.15.152:0/2013034573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597c19d780 con 0x7f597c10c160 2024-09-11T22:17:40.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.836+0000 7f59823c0640 1 -- 172.21.15.152:0/2013034573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f597c1a5060 con 0x7f597c10c160 2024-09-11T22:17:40.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.839+0000 7f59797fa640 1 -- 172.21.15.152:0/2013034573 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f5974005540 con 0x7f597c10c160 2024-09-11T22:17:40.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.841+0000 7f59797fa640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59640a2d70 0x7f59640a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.841+0000 7f59797fa640 1 -- 172.21.15.152:0/2013034573 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f59740cf510 con 0x7f597c10c160 2024-09-11T22:17:40.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.843+0000 7f5984799740 1 Processor -- start 2024-09-11T22:17:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.843+0000 7f5984799740 1 -- start start 2024-09-11T22:17:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.843+0000 7f597bfff640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59640a2d70 0x7f59640a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.843+0000 7f5984799740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203b4a0 0x55fb7203b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.843+0000 7f5984799740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb7203bdc0 0x55fb72046140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.843+0000 7f5984799740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb72046680 0x55fb72048a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.843+0000 7f5984799740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fb71fa12e0 con 0x55fb72046680 2024-09-11T22:17:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.843+0000 7f5984799740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fb71f48ce0 con 0x55fb7203b4a0 2024-09-11T22:17:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.843+0000 7f5984799740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fb71f9d2a0 con 0x55fb7203bdc0 2024-09-11T22:17:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.844+0000 7f597b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb7203bdc0 0x55fb72046140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.844+0000 7f597b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb7203bdc0 0x55fb72046140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37376/0 (socket says 172.21.15.152:37376) 2024-09-11T22:17:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.844+0000 7f597b7fe640 1 -- 172.21.15.152:0/3547019345 learned_addr learned my addr 172.21.15.152:0/3547019345 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.844+0000 7f598095d640 1 --2- 172.21.15.152:0/3547019345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb72046680 0x55fb72048a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.844+0000 7f597b7fe640 1 -- 172.21.15.152:0/3547019345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203b4a0 msgr2=0x55fb7203b880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:17:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.844+0000 7f597b7fe640 1 --2- 172.21.15.152:0/3547019345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203b4a0 0x55fb7203b880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.844+0000 7f597b7fe640 1 -- 172.21.15.152:0/3547019345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb72046680 msgr2=0x55fb72048a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.844+0000 7f597b7fe640 1 --2- 172.21.15.152:0/3547019345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb72046680 0x55fb72048a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.845+0000 7f597b7fe640 1 -- 172.21.15.152:0/3547019345 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb71f2d440 con 0x55fb7203bdc0 2024-09-11T22:17:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.845+0000 7f597b7fe640 1 --2- 172.21.15.152:0/3547019345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb7203bdc0 0x55fb72046140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5970033000 tx=0x7f5970005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4b71e97719924da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.848+0000 7f59627fc640 1 -- 172.21.15.152:0/3547019345 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970040070 con 0x55fb7203bdc0 2024-09-11T22:17:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.848+0000 7f59627fc640 1 -- 172.21.15.152:0/3547019345 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59700318f0 con 0x55fb7203bdc0 2024-09-11T22:17:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.848+0000 7f59627fc640 1 -- 172.21.15.152:0/3547019345 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970035040 con 0x55fb7203bdc0 2024-09-11T22:17:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.849+0000 7f5984799740 1 -- 172.21.15.152:0/3547019345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb7203bdc0 msgr2=0x55fb72046140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.849+0000 7f5984799740 1 --2- 172.21.15.152:0/3547019345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb7203bdc0 0x55fb72046140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5970033000 tx=0x7f5970005be0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.850+0000 7f5984799740 1 -- 172.21.15.152:0/3547019345 shutdown_connections 2024-09-11T22:17:40.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.850+0000 7f5984799740 1 --2- 172.21.15.152:0/3547019345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb72046680 0x55fb72048a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.850+0000 7f5984799740 1 --2- 172.21.15.152:0/3547019345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb7203bdc0 0x55fb72046140 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.850+0000 7f5984799740 1 --2- 172.21.15.152:0/3547019345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203b4a0 0x55fb7203b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.850+0000 7f5984799740 1 -- 172.21.15.152:0/3547019345 >> 172.21.15.152:0/3547019345 conn(0x55fb72037a30 msgr2=0x55fb72037e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:40.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.856+0000 7f5984799740 1 -- 172.21.15.152:0/3547019345 shutdown_connections 2024-09-11T22:17:40.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.866+0000 7f5984799740 1 -- 172.21.15.152:0/3547019345 wait complete. 2024-09-11T22:17:40.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.867+0000 7f5984799740 1 -- start start 2024-09-11T22:17:40.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.867+0000 7f5984799740 1 Processor -- start 2024-09-11T22:17:40.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.868+0000 7f5984799740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203b4a0 0x55fb720460d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.868+0000 7f5984799740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203bdc0 0x55fb72043380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.868+0000 7f5984799740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72043b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.869+0000 7f5984799740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fb7204d600 con 0x55fb7203bdc0 2024-09-11T22:17:40.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.869+0000 7f5984799740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fb71f5c050 con 0x55fb7203b4a0 2024-09-11T22:17:40.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.869+0000 7f598095d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72043b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.869+0000 7f598095d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72043b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37384/0 (socket says 172.21.15.152:37384) 2024-09-11T22:17:40.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.869+0000 7f598095d640 1 -- 172.21.15.152:0/4173584765 learned_addr learned my addr 172.21.15.152:0/4173584765 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:40.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.869+0000 7f5984799740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fb7204d780 con 0x55fb72046680 2024-09-11T22:17:40.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.869+0000 7f5984799740 10 client.0 _ll_register_callbacks cb 0x55fb71f9c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:40.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.870+0000 7f597bfff640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59640a2d70 0x7f59640a5230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f596c009c70 tx=0x7f596c005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:40.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.871+0000 7f597b7fe640 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203bdc0 0x55fb72043380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.871+0000 7f597b7fe640 1 -- 172.21.15.152:0/4173584765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 msgr2=0x55fb72043b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:40.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.872+0000 7f597b7fe640 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72043b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.872+0000 7f597b7fe640 1 -- 172.21.15.152:0/4173584765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203b4a0 msgr2=0x55fb720460d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:17:40.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.872+0000 7f597b7fe640 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203b4a0 0x55fb720460d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.872+0000 7f597b7fe640 1 -- 172.21.15.152:0/4173584765 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb71d123c0 con 0x55fb7203bdc0 2024-09-11T22:17:40.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.872+0000 7f598095d640 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72043b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.872+0000 7f597b7fe640 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203bdc0 0x55fb72043380 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5970005d50 tx=0x7f5970005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568bbc1005a1ebff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.872+0000 7f595b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.873+0000 7f595b7fe640 1 -- 172.21.15.152:0/4173584765 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970040070 con 0x55fb7203bdc0 2024-09-11T22:17:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.873+0000 7f5984799740 1 -- 172.21.15.152:0/4173584765 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59700318f0 con 0x55fb7203bdc0 2024-09-11T22:17:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.873+0000 7f595b7fe640 1 -- 172.21.15.152:0/4173584765 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f5970004240 con 0x55fb7203bdc0 2024-09-11T22:17:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.873+0000 7f595b7fe640 1 -- 172.21.15.152:0/4173584765 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5970056050 con 0x55fb7203bdc0 2024-09-11T22:17:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.873+0000 7f5984799740 10 client.18729 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.873+0000 7f5984799740 1 -- 172.21.15.152:0/4173584765 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fb720590d0 con 0x55fb7203bdc0 2024-09-11T22:17:40.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.874+0000 7f595b7fe640 1 -- 172.21.15.152:0/4173584765 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59700318f0 con 0x55fb7203bdc0 2024-09-11T22:17:40.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.874+0000 7f595b7fe640 1 -- 172.21.15.152:0/4173584765 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f59700035f0 con 0x55fb7203bdc0 2024-09-11T22:17:40.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.875+0000 7f5984799740 10 client.18729 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:40.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.875+0000 7f5984799740 10 client.18729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:40.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.875+0000 7f5984799740 20 client.18729 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:40.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.875+0000 7f5984799740 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fb7205a580 0x55fb7205c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.875+0000 7f5984799740 4 client.18729 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:40.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.875+0000 7f5984799740 1 -- 172.21.15.152:0/4173584765 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb71fae850 con 0x55fb7205a580 2024-09-11T22:17:40.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.886+0000 7f597bfff640 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fb7205a580 0x55fb7205c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.895+0000 7f597bfff640 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fb7205a580 0x55fb7205c990 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8669c7ce7bd4c29c server_cookie=cfc42ae070a8ac00 in_seq=0 out_seq=0 2024-09-11T22:17:40.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.896+0000 7f595b7fe640 10 client.18729 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:40.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.897+0000 7f595b7fe640 1 -- 172.21.15.152:0/4173584765 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb71fae850 con 0x55fb7205a580 2024-09-11T22:17:40.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.897+0000 7f595b7fe640 10 client.18729 handle_command_reply: tid=0 2024-09-11T22:17:40.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.897+0000 7f5984799740 1 client.18729 shutdown 2024-09-11T22:17:40.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.897+0000 7f5984799740 1 -- 172.21.15.152:0/4173584765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203bdc0 msgr2=0x55fb72043380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:40.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.897+0000 7f5984799740 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203bdc0 0x55fb72043380 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5970005d50 tx=0x7f5970005e80 comp rx=0 tx=0).stop 2024-09-11T22:17:40.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.897+0000 7f5984799740 1 -- 172.21.15.152:0/4173584765 shutdown_connections 2024-09-11T22:17:40.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.897+0000 7f5984799740 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fb7205a580 0x55fb7205c990 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.897+0000 7f5984799740 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72043b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.897+0000 7f5984799740 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203bdc0 0x55fb72043380 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.897+0000 7f5984799740 1 --2- 172.21.15.152:0/4173584765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203b4a0 0x55fb720460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.897+0000 7f5984799740 1 -- 172.21.15.152:0/4173584765 >> 172.21.15.152:0/4173584765 conn(0x55fb72037a30 msgr2=0x55fb7203d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:40.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.898+0000 7f595b7fe640 0 client.18729 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:40.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.898+0000 7f5984799740 1 -- 172.21.15.152:0/4173584765 shutdown_connections 2024-09-11T22:17:40.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.898+0000 7f5984799740 1 -- 172.21.15.152:0/4173584765 wait complete. 2024-09-11T22:17:40.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.898+0000 7f5984799740 20 client.18729 trim_cache size 0 max 16384 2024-09-11T22:17:40.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f5984799740 1 Processor -- start 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f5984799740 1 -- start start 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f5984799740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203b4a0 0x55fb7203d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f5984799740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72062200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f5984799740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72062740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f5984799740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f597c1ae270 con 0x55fb7203b4a0 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f5984799740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f597c1abb40 con 0x55fb7203bdc0 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f5984799740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f597c1a99b0 con 0x55fb72046680 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f597bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203b4a0 0x55fb7203d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f597b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72062200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f597b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72062200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41426/0 (socket says 172.21.15.152:41426) 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.923+0000 7f597b7fe640 1 -- 172.21.15.152:0/2241298084 learned_addr learned my addr 172.21.15.152:0/2241298084 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.924+0000 7f598095d640 1 --2- 172.21.15.152:0/2241298084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72062740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.924+0000 7f597b7fe640 1 -- 172.21.15.152:0/2241298084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 msgr2=0x55fb72062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.924+0000 7f597b7fe640 1 --2- 172.21.15.152:0/2241298084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72062740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.924+0000 7f597b7fe640 1 -- 172.21.15.152:0/2241298084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203b4a0 msgr2=0x55fb7203d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.924+0000 7f597b7fe640 1 --2- 172.21.15.152:0/2241298084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203b4a0 0x55fb7203d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.924+0000 7f597b7fe640 1 -- 172.21.15.152:0/2241298084 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb72056860 con 0x55fb7203bdc0 2024-09-11T22:17:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.924+0000 7f598095d640 1 --2- 172.21.15.152:0/2241298084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72062740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.924+0000 7f597b7fe640 1 --2- 172.21.15.152:0/2241298084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72062200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5970005250 tx=0x7f5970005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb175ad8e841d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.924+0000 7f5961ffb640 1 -- 172.21.15.152:0/2241298084 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970040040 con 0x55fb7203bdc0 2024-09-11T22:17:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.925+0000 7f5961ffb640 1 -- 172.21.15.152:0/2241298084 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f597004d070 con 0x55fb7203bdc0 2024-09-11T22:17:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.926+0000 7f5984799740 1 -- 172.21.15.152:0/2241298084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 msgr2=0x55fb72062200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.926+0000 7f5984799740 1 --2- 172.21.15.152:0/2241298084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72062200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5970005250 tx=0x7f5970005fd0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.926+0000 7f5984799740 1 -- 172.21.15.152:0/2241298084 shutdown_connections 2024-09-11T22:17:40.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.926+0000 7f5984799740 1 --2- 172.21.15.152:0/2241298084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72062740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.926+0000 7f5984799740 1 --2- 172.21.15.152:0/2241298084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72062200 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.926+0000 7f5984799740 1 --2- 172.21.15.152:0/2241298084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203b4a0 0x55fb7203d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.926+0000 7f5984799740 1 -- 172.21.15.152:0/2241298084 >> 172.21.15.152:0/2241298084 conn(0x55fb72037a30 msgr2=0x55fb7203cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:40.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.926+0000 7f5984799740 1 -- 172.21.15.152:0/2241298084 shutdown_connections 2024-09-11T22:17:40.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.926+0000 7f5984799740 1 -- 172.21.15.152:0/2241298084 wait complete. 2024-09-11T22:17:40.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.927+0000 7f5984799740 1 -- start start 2024-09-11T22:17:40.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.927+0000 7f5984799740 1 Processor -- start 2024-09-11T22:17:40.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f5984799740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203b4a0 0x55fb72052d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f5984799740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72053240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f5984799740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72049c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f5984799740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f597c1aa000 con 0x55fb7203b4a0 2024-09-11T22:17:40.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f5984799740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f597c1ab470 con 0x55fb7203bdc0 2024-09-11T22:17:40.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f5984799740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f597c1aa6d0 con 0x55fb72046680 2024-09-11T22:17:40.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f5984799740 10 client.0 _ll_register_callbacks cb 0x7f5974097de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:40.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f597b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72053240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f597b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72053240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:41434/0 (socket says 172.21.15.152:41434) 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f597b7fe640 1 -- 172.21.15.152:0/729881225 learned_addr learned my addr 172.21.15.152:0/729881225 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f598095d640 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72049c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.928+0000 7f597bfff640 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203b4a0 0x55fb72052d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.929+0000 7f597b7fe640 1 -- 172.21.15.152:0/729881225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 msgr2=0x55fb72049c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.929+0000 7f597b7fe640 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72049c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.929+0000 7f597b7fe640 1 -- 172.21.15.152:0/729881225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203b4a0 msgr2=0x55fb72052d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.929+0000 7f597b7fe640 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203b4a0 0x55fb72052d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.929+0000 7f597b7fe640 1 -- 172.21.15.152:0/729881225 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb7204a430 con 0x55fb7203bdc0 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.929+0000 7f597b7fe640 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72053240 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5970005d50 tx=0x7f5970005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6625b719d39aaae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.930+0000 7f595b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.930+0000 7f595b7fe640 1 -- 172.21.15.152:0/729881225 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970040070 con 0x55fb7203bdc0 2024-09-11T22:17:40.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.930+0000 7f5984799740 1 -- 172.21.15.152:0/729881225 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f597004d070 con 0x55fb7203bdc0 2024-09-11T22:17:40.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.930+0000 7f595b7fe640 1 -- 172.21.15.152:0/729881225 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f5970004240 con 0x55fb7203bdc0 2024-09-11T22:17:40.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.930+0000 7f595b7fe640 1 -- 172.21.15.152:0/729881225 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5970009520 con 0x55fb7203bdc0 2024-09-11T22:17:40.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.931+0000 7f5984799740 10 client.27977 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.931+0000 7f5984799740 1 -- 172.21.15.152:0/729881225 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fb720505d0 con 0x55fb7203bdc0 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.931+0000 7f595b7fe640 1 -- 172.21.15.152:0/729881225 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f597004d070 con 0x55fb7203bdc0 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.931+0000 7f595b7fe640 1 -- 172.21.15.152:0/729881225 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f597003c440 con 0x55fb7203bdc0 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.931+0000 7f5984799740 10 client.27977 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.931+0000 7f5984799740 10 client.27977 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.931+0000 7f5984799740 20 client.27977 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.931+0000 7f5984799740 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fb720c1410 0x55fb720c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.931+0000 7f5984799740 4 client.27977 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.931+0000 7f5984799740 1 -- 172.21.15.152:0/729881225 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fb71fa8d60 con 0x55fb720c1410 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.932+0000 7f597bfff640 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fb720c1410 0x55fb720c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.932+0000 7f595b7fe640 10 client.27977 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:40.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.932+0000 7f597bfff640 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fb720c1410 0x55fb720c3830 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae5cfdf8fcda9505 server_cookie=412651b9f0e6d58b in_seq=0 out_seq=0 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.933+0000 7f595b7fe640 1 -- 172.21.15.152:0/729881225 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fb71fa8d60 con 0x55fb720c1410 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.933+0000 7f595b7fe640 10 client.27977 handle_command_reply: tid=0 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.933+0000 7f5984799740 1 client.27977 shutdown 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f5984799740 1 -- 172.21.15.152:0/729881225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 msgr2=0x55fb72053240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f5984799740 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72053240 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5970005d50 tx=0x7f5970005be0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f5984799740 1 -- 172.21.15.152:0/729881225 shutdown_connections 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f5984799740 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fb720c1410 0x55fb720c3830 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f5984799740 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb72046680 0x55fb72049c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f5984799740 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb7203bdc0 0x55fb72053240 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5970005d50 tx=0x7f5970005be0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f5984799740 1 --2- 172.21.15.152:0/729881225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb7203b4a0 0x55fb72052d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f5984799740 1 -- 172.21.15.152:0/729881225 >> 172.21.15.152:0/729881225 conn(0x55fb72037a30 msgr2=0x55fb72056070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f595b7fe640 0 client.27977 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:40.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f5984799740 1 -- 172.21.15.152:0/729881225 shutdown_connections 2024-09-11T22:17:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f5984799740 1 -- 172.21.15.152:0/729881225 wait complete. 2024-09-11T22:17:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.934+0000 7f5984799740 20 client.27977 trim_cache size 0 max 16384 2024-09-11T22:17:40.938 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:17:40.938 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:17:40.938 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:17:40.938 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:17:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.935+0000 7f59823c0640 1 -- 172.21.15.152:0/2013034573 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59640a2d70 msgr2=0x7f59640a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.935+0000 7f59823c0640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59640a2d70 0x7f59640a5230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f596c009c70 tx=0x7f596c005f90 comp rx=0 tx=0).stop 2024-09-11T22:17:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.935+0000 7f59823c0640 1 -- 172.21.15.152:0/2013034573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f597c10c160 msgr2=0x7f597c19cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.935+0000 7f59823c0640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f597c10c160 0x7f597c19cdb0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f597400eaa0 tx=0x7f597400ef60 comp rx=0 tx=0).stop 2024-09-11T22:17:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.936+0000 7f59823c0640 1 -- 172.21.15.152:0/2013034573 shutdown_connections 2024-09-11T22:17:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.936+0000 7f59823c0640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59640a2d70 0x7f59640a5230 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.936+0000 7f59823c0640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f597c10c160 0x7f597c19cdb0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.936+0000 7f59823c0640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f597c103650 0x7f597c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.936+0000 7f59823c0640 1 --2- 172.21.15.152:0/2013034573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f597c102d30 0x7f597c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.936+0000 7f59823c0640 1 -- 172.21.15.152:0/2013034573 >> 172.21.15.152:0/2013034573 conn(0x7f597c0fc7d0 msgr2=0x7f597c0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.936+0000 7f59823c0640 1 -- 172.21.15.152:0/2013034573 shutdown_connections 2024-09-11T22:17:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:40.936+0000 7f59823c0640 1 -- 172.21.15.152:0/2013034573 wait complete. 2024-09-11T22:17:41.879 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:17:41.879 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:17:41.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:41 smithi152 ceph-mon[31188]: pgmap v419: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.3 MiB/s wr, 745 op/s 2024-09-11T22:17:42.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:41 smithi179 ceph-mon[35603]: pgmap v419: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.3 MiB/s wr, 745 op/s 2024-09-11T22:17:42.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:41 smithi193 ceph-mon[35545]: pgmap v419: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.3 MiB/s wr, 745 op/s 2024-09-11T22:17:42.257 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:42.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.849+0000 7f78fe7fc640 1 -- 172.21.15.152:0/115127093 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4030950 con 0x7f790010e890 2024-09-11T22:17:42.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.849+0000 7f7905ff9640 1 -- 172.21.15.152:0/115127093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f790010e890 msgr2=0x7f790010ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:42.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.849+0000 7f7905ff9640 1 --2- 172.21.15.152:0/115127093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f790010e890 0x7f790010ed10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009860 tx=0x7f78f402a340 comp rx=0 tx=0).stop 2024-09-11T22:17:42.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.849+0000 7f7905ff9640 1 -- 172.21.15.152:0/115127093 shutdown_connections 2024-09-11T22:17:42.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.849+0000 7f7905ff9640 1 --2- 172.21.15.152:0/115127093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f790010e890 0x7f790010ed10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:42.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.849+0000 7f7905ff9640 1 --2- 172.21.15.152:0/115127093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7900109d70 0x7f790010e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:42.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.849+0000 7f7905ff9640 1 --2- 172.21.15.152:0/115127093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7900109450 0x7f7900109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:42.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.849+0000 7f7905ff9640 1 -- 172.21.15.152:0/115127093 >> 172.21.15.152:0/115127093 conn(0x7f790006e2d0 msgr2=0x7f790006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:42.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.849+0000 7f7905ff9640 1 -- 172.21.15.152:0/115127093 shutdown_connections 2024-09-11T22:17:42.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.849+0000 7f7905ff9640 1 -- 172.21.15.152:0/115127093 wait complete. 2024-09-11T22:17:42.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.850+0000 7f7905ff9640 1 Processor -- start 2024-09-11T22:17:42.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.850+0000 7f7905ff9640 1 -- start start 2024-09-11T22:17:42.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.851+0000 7f7905ff9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7900109450 0x7f79001a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:42.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.851+0000 7f7905ff9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7900109d70 0x7f79001a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.851+0000 7f7905ff9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f790010e890 0x7f79001a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.851+0000 7f78ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7900109450 0x7f79001a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.851+0000 7f78ff7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7900109450 0x7f79001a6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43838/0 (socket says 172.21.15.152:43838) 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.851+0000 7f78ff7fe640 1 -- 172.21.15.152:0/1382097578 learned_addr learned my addr 172.21.15.152:0/1382097578 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.851+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f790011a720 con 0x7f7900109450 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.851+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f790011a5a0 con 0x7f7900109d70 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.851+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f790011a8a0 con 0x7f790010e890 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.851+0000 7f78feffd640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7900109d70 0x7f79001a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.852+0000 7f78fffff640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f790010e890 0x7f79001a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.852+0000 7f78feffd640 1 -- 172.21.15.152:0/1382097578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f790010e890 msgr2=0x7f79001a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.852+0000 7f78feffd640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f790010e890 0x7f79001a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:42.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.852+0000 7f78feffd640 1 -- 172.21.15.152:0/1382097578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7900109450 msgr2=0x7f79001a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.852+0000 7f78feffd640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7900109450 0x7f79001a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.852+0000 7f78feffd640 1 -- 172.21.15.152:0/1382097578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79001a1220 con 0x7f7900109d70 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.852+0000 7f78feffd640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7900109d70 0x7f79001a6e70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f78f800ef60 tx=0x7f78f800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.852+0000 7f78fcff9640 1 -- 172.21.15.152:0/1382097578 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f801b070 con 0x7f7900109d70 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.852+0000 7f78fcff9640 1 -- 172.21.15.152:0/1382097578 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78f800ba50 con 0x7f7900109d70 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.852+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79001a1510 con 0x7f7900109d70 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.852+0000 7f78fcff9640 1 -- 172.21.15.152:0/1382097578 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8016bd0 con 0x7f7900109d70 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.853+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79001ad800 con 0x7f7900109d70 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.854+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790010e350 con 0x7f7900109d70 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.857+0000 7f78fcff9640 1 -- 172.21.15.152:0/1382097578 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f78f801e070 con 0x7f7900109d70 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.858+0000 7f78fcff9640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e80a2d70 0x7f78e80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:42.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.858+0000 7f78fcff9640 1 -- 172.21.15.152:0/1382097578 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f78f80cf600 con 0x7f7900109d70 2024-09-11T22:17:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.858+0000 7f78ff7fe640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e80a2d70 0x7f78e80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.859+0000 7f78ff7fe640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e80a2d70 0x7f78e80a5230 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f78f0005fd0 tx=0x7f78f000b480 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:42.862+0000 7f78fcff9640 1 -- 172.21.15.152:0/1382097578 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f78f809c1c0 con 0x7f7900109d70 2024-09-11T22:17:43.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.207+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79001ada30 con 0x7f7900109d70 2024-09-11T22:17:43.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.208+0000 7f78fcff9640 1 -- 172.21.15.152:0/1382097578 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f78f809bac0 con 0x7f7900109d70 2024-09-11T22:17:43.209 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:17:43.210 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:17:43.210 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:17:43.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e80a2d70 msgr2=0x7f78e80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:43.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e80a2d70 0x7f78e80a5230 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f78f0005fd0 tx=0x7f78f000b480 comp rx=0 tx=0).stop 2024-09-11T22:17:43.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7900109d70 msgr2=0x7f79001a6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:43.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7900109d70 0x7f79001a6e70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f78f800ef60 tx=0x7f78f800ef90 comp rx=0 tx=0).stop 2024-09-11T22:17:43.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 shutdown_connections 2024-09-11T22:17:43.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e80a2d70 0x7f78e80a5230 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:43.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f790010e890 0x7f79001a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:43.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7900109d70 0x7f79001a6e70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:43.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 --2- 172.21.15.152:0/1382097578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7900109450 0x7f79001a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:43.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 >> 172.21.15.152:0/1382097578 conn(0x7f790006e2d0 msgr2=0x7f790010c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:43.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 shutdown_connections 2024-09-11T22:17:43.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:43.211+0000 7f7905ff9640 1 -- 172.21.15.152:0/1382097578 wait complete. 2024-09-11T22:17:43.397 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T22:17:43.397 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T22:17:43.397 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:17:43.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:43 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1382097578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:17:43.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:43 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1382097578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:17:43.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:43 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1382097578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:17:44.028 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:17:44.125 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:44.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:44 smithi179 ceph-mon[35603]: pgmap v420: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.4 MiB/s wr, 750 op/s 2024-09-11T22:17:44.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:44 smithi193 ceph-mon[35545]: pgmap v420: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.4 MiB/s wr, 750 op/s 2024-09-11T22:17:44.592 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:44 smithi152 ceph-mon[31188]: pgmap v420: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.4 MiB/s wr, 750 op/s 2024-09-11T22:17:44.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.726+0000 7f119f569640 1 -- 172.21.15.152:0/3071247896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1198108e00 msgr2=0x7f119810ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:44.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.726+0000 7f119f569640 1 --2- 172.21.15.152:0/3071247896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1198108e00 0x7f119810ce00 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f1188009900 tx=0x7f118802a410 comp rx=0 tx=0).stop 2024-09-11T22:17:44.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.727+0000 7f119f569640 1 -- 172.21.15.152:0/3071247896 shutdown_connections 2024-09-11T22:17:44.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.727+0000 7f119f569640 1 --2- 172.21.15.152:0/3071247896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f119810d530 0x7f11981150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:44.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.727+0000 7f119f569640 1 --2- 172.21.15.152:0/3071247896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1198108e00 0x7f119810ce00 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:44.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.727+0000 7f119f569640 1 --2- 172.21.15.152:0/3071247896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1198108450 0x7f1198108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:44.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.727+0000 7f119f569640 1 -- 172.21.15.152:0/3071247896 >> 172.21.15.152:0/3071247896 conn(0x7f1198077ba0 msgr2=0x7f1198079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:44.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.728+0000 7f119f569640 1 -- 172.21.15.152:0/3071247896 shutdown_connections 2024-09-11T22:17:44.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.728+0000 7f119f569640 1 -- 172.21.15.152:0/3071247896 wait complete. 2024-09-11T22:17:44.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.729+0000 7f119f569640 1 Processor -- start 2024-09-11T22:17:44.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.729+0000 7f119f569640 1 -- start start 2024-09-11T22:17:44.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.730+0000 7f119f569640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1198108450 0x7f11981a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:44.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.730+0000 7f119f569640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1198108e00 0x7f11981a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:44.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.730+0000 7f119d305640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1198108450 0x7f11981a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:44.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.730+0000 7f119d305640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1198108450 0x7f11981a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:39922/0 (socket says 172.21.15.152:39922) 2024-09-11T22:17:44.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.731+0000 7f119d305640 1 -- 172.21.15.152:0/1569986501 learned_addr learned my addr 172.21.15.152:0/1569986501 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:44.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.731+0000 7f119f569640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119810d530 0x7f119819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:44.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.731+0000 7f119cb04640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1198108e00 0x7f11981a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:44.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.731+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1198118580 con 0x7f119810d530 2024-09-11T22:17:44.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.731+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1198118400 con 0x7f1198108450 2024-09-11T22:17:44.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.731+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1198118700 con 0x7f1198108e00 2024-09-11T22:17:44.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.732+0000 7f119db06640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119810d530 0x7f119819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:44.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.732+0000 7f119d305640 1 -- 172.21.15.152:0/1569986501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1198108e00 msgr2=0x7f11981a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:44.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.732+0000 7f119d305640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1198108e00 0x7f11981a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:44.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.732+0000 7f119d305640 1 -- 172.21.15.152:0/1569986501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119810d530 msgr2=0x7f119819e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:44.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.732+0000 7f119d305640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119810d530 0x7f119819e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:44.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.732+0000 7f119d305640 1 -- 172.21.15.152:0/1569986501 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119819efa0 con 0x7f1198108450 2024-09-11T22:17:44.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.732+0000 7f119d305640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1198108450 0x7f11981a46b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f119400d950 tx=0x7f119400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:44.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.733+0000 7f118e7fc640 1 -- 172.21.15.152:0/1569986501 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194017070 con 0x7f1198108450 2024-09-11T22:17:44.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.733+0000 7f118e7fc640 1 -- 172.21.15.152:0/1569986501 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1194009c30 con 0x7f1198108450 2024-09-11T22:17:44.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.733+0000 7f118e7fc640 1 -- 172.21.15.152:0/1569986501 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119400f690 con 0x7f1198108450 2024-09-11T22:17:44.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.733+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119819f290 con 0x7f1198108450 2024-09-11T22:17:44.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.733+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11981ab580 con 0x7f1198108450 2024-09-11T22:17:44.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.734+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117c005290 con 0x7f1198108450 2024-09-11T22:17:44.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.736+0000 7f118e7fc640 1 -- 172.21.15.152:0/1569986501 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f119400f830 con 0x7f1198108450 2024-09-11T22:17:44.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.737+0000 7f118e7fc640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f11840a2f00 0x7f11840a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:44.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.737+0000 7f118e7fc640 1 -- 172.21.15.152:0/1569986501 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f11940cef60 con 0x7f1198108450 2024-09-11T22:17:44.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.738+0000 7f119cb04640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f11840a2f00 0x7f11840a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:44.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.738+0000 7f119cb04640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f11840a2f00 0x7f11840a53c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1188005ab0 tx=0x7f118802a910 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:44.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:44.741+0000 7f118e7fc640 1 -- 172.21.15.152:0/1569986501 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f119409bac0 con 0x7f1198108450 2024-09-11T22:17:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:44.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 730.0 s, 1965.3 tps, lat 58.322 ms stddev 128.733 2024-09-11T22:17:45.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.094+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f117c005850 con 0x7f1198108450 2024-09-11T22:17:45.097 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:17:45.097 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:17:45.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.095+0000 7f118e7fc640 1 -- 172.21.15.152:0/1569986501 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f1194009de0 con 0x7f1198108450 2024-09-11T22:17:45.098 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:17:45.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f11840a2f00 msgr2=0x7f11840a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:45.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f11840a2f00 0x7f11840a53c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1188005ab0 tx=0x7f118802a910 comp rx=0 tx=0).stop 2024-09-11T22:17:45.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1198108450 msgr2=0x7f11981a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:45.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1198108450 0x7f11981a46b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f119400d950 tx=0x7f119400de10 comp rx=0 tx=0).stop 2024-09-11T22:17:45.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 shutdown_connections 2024-09-11T22:17:45.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f11840a2f00 0x7f11840a53c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119810d530 0x7f119819e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1198108e00 0x7f11981a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 --2- 172.21.15.152:0/1569986501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1198108450 0x7f11981a46b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 >> 172.21.15.152:0/1569986501 conn(0x7f1198077ba0 msgr2=0x7f1198078f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:45.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 shutdown_connections 2024-09-11T22:17:45.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.099+0000 7f119f569640 1 -- 172.21.15.152:0/1569986501 wait complete. 2024-09-11T22:17:45.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.352+0000 7f7be0600640 1 -- 172.21.15.152:0/1053372957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd8101470 msgr2=0x7f7bd8101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:45.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.353+0000 7f7be0600640 1 --2- 172.21.15.152:0/1053372957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd8101470 0x7f7bd8101850 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400fb10 tx=0x7f7bd402e570 comp rx=0 tx=0).stop 2024-09-11T22:17:45.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.353+0000 7f7be0600640 1 -- 172.21.15.152:0/1053372957 shutdown_connections 2024-09-11T22:17:45.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.353+0000 7f7be0600640 1 --2- 172.21.15.152:0/1053372957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bd8105de0 0x7f7bd810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.353+0000 7f7be0600640 1 --2- 172.21.15.152:0/1053372957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd8101e20 0x7f7bd81056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.353+0000 7f7be0600640 1 --2- 172.21.15.152:0/1053372957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd8101470 0x7f7bd8101850 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.353+0000 7f7be0600640 1 -- 172.21.15.152:0/1053372957 >> 172.21.15.152:0/1053372957 conn(0x7f7bd8077230 msgr2=0x7f7bd80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:45.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.354+0000 7f7be0600640 1 -- 172.21.15.152:0/1053372957 shutdown_connections 2024-09-11T22:17:45.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.354+0000 7f7be0600640 1 -- 172.21.15.152:0/1053372957 wait complete. 2024-09-11T22:17:45.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.355+0000 7f7be0600640 1 Processor -- start 2024-09-11T22:17:45.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.355+0000 7f7be0600640 1 -- start start 2024-09-11T22:17:45.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.355+0000 7f7be0600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bd8101470 0x7f7bd81a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.355+0000 7f7be0600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd8101e20 0x7f7bd81a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.355+0000 7f7bde39c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bd8101470 0x7f7bd81a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.355+0000 7f7bde39c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bd8101470 0x7f7bd81a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:39950/0 (socket says 172.21.15.152:39950) 2024-09-11T22:17:45.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.355+0000 7f7be0600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd8105de0 0x7f7bd819e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7bddb9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd8101e20 0x7f7bd81a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7bddb9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd8101e20 0x7f7bd81a4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38932/0 (socket says 172.21.15.152:38932) 2024-09-11T22:17:45.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7bde39c640 1 -- 172.21.15.152:0/4267147451 learned_addr learned my addr 172.21.15.152:0/4267147451 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:45.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7be0600640 1 -- 172.21.15.152:0/4267147451 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8118590 con 0x7f7bd8105de0 2024-09-11T22:17:45.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7be0600640 1 -- 172.21.15.152:0/4267147451 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8118410 con 0x7f7bd8101470 2024-09-11T22:17:45.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7be0600640 1 -- 172.21.15.152:0/4267147451 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8118710 con 0x7f7bd8101e20 2024-09-11T22:17:45.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7bdeb9d640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd8105de0 0x7f7bd819e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7bde39c640 1 -- 172.21.15.152:0/4267147451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd8101e20 msgr2=0x7f7bd81a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:45.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7bde39c640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd8101e20 0x7f7bd81a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7bde39c640 1 -- 172.21.15.152:0/4267147451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd8105de0 msgr2=0x7f7bd819e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:45.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7bde39c640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd8105de0 0x7f7bd819e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7bde39c640 1 -- 172.21.15.152:0/4267147451 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd819efb0 con 0x7f7bd8101470 2024-09-11T22:17:45.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.356+0000 7f7bde39c640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bd8101470 0x7f7bd81a46c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4005ab0 tx=0x7f7bd4004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:45.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.357+0000 7f7bcf7fe640 1 -- 172.21.15.152:0/4267147451 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400e7d0 con 0x7f7bd8101470 2024-09-11T22:17:45.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.357+0000 7f7bcf7fe640 1 -- 172.21.15.152:0/4267147451 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd4004030 con 0x7f7bd8101470 2024-09-11T22:17:45.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.357+0000 7f7be0600640 1 -- 172.21.15.152:0/4267147451 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd819f240 con 0x7f7bd8101470 2024-09-11T22:17:45.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.357+0000 7f7be0600640 1 -- 172.21.15.152:0/4267147451 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd81ab590 con 0x7f7bd8101470 2024-09-11T22:17:45.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.357+0000 7f7bcf7fe640 1 -- 172.21.15.152:0/4267147451 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4003ac0 con 0x7f7bd8101470 2024-09-11T22:17:45.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.359+0000 7f7bcf7fe640 1 -- 172.21.15.152:0/4267147451 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f7bd400c070 con 0x7f7bd8101470 2024-09-11T22:17:45.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.361+0000 7f7bcf7fe640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7bc40a2f10 0x7f7bc40a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.361+0000 7f7bddb9b640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7bc40a2f10 0x7f7bc40a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.361+0000 7f7bcf7fe640 1 -- 172.21.15.152:0/4267147451 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f7bd40f0be0 con 0x7f7bd8101470 2024-09-11T22:17:45.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.361+0000 7f7bddb9b640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7bc40a2f10 0x7f7bc40a53d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80095f0 tx=0x7f7bc8005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:45.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.362+0000 7f7be29d9740 1 Processor -- start 2024-09-11T22:17:45.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.362+0000 7f7be29d9740 1 -- start start 2024-09-11T22:17:45.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.362+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d7b40 0x55a9417d6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.362+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d65d0 0x55a9417d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.362+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 0x55a9417e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.362+0000 7f7be29d9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a94173c2f0 con 0x55a9417e1370 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.362+0000 7f7be29d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a9416e3cf0 con 0x55a9417d65d0 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.362+0000 7f7be29d9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a9417382b0 con 0x55a9417d7b40 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bddb9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d65d0 0x55a9417d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bdeb9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 0x55a9417e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bddb9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d65d0 0x55a9417d6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:39952/0 (socket says 172.21.15.152:39952) 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bddb9b640 1 -- 172.21.15.152:0/924510410 learned_addr learned my addr 172.21.15.152:0/924510410 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bde39c640 1 --2- 172.21.15.152:0/924510410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d7b40 0x55a9417d6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bddb9b640 1 -- 172.21.15.152:0/924510410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d7b40 msgr2=0x55a9417d6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bddb9b640 1 --2- 172.21.15.152:0/924510410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d7b40 0x55a9417d6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bddb9b640 1 -- 172.21.15.152:0/924510410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 msgr2=0x55a9417e3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:45.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bddb9b640 1 --2- 172.21.15.152:0/924510410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 0x55a9417e3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bddb9b640 1 -- 172.21.15.152:0/924510410 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9416c83a0 con 0x55a9417d65d0 2024-09-11T22:17:45.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bdeb9d640 1 --2- 172.21.15.152:0/924510410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 0x55a9417e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:45.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bddb9b640 1 --2- 172.21.15.152:0/924510410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d65d0 0x55a9417d6a10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800e600 tx=0x7f7bc8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f99dbafde00e6a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:45.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bccff9640 1 -- 172.21.15.152:0/924510410 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8004030 con 0x55a9417d65d0 2024-09-11T22:17:45.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bccff9640 1 -- 172.21.15.152:0/924510410 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bc80041d0 con 0x55a9417d65d0 2024-09-11T22:17:45.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.363+0000 7f7bccff9640 1 -- 172.21.15.152:0/924510410 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc801c870 con 0x55a9417d65d0 2024-09-11T22:17:45.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.364+0000 7f7be29d9740 1 -- 172.21.15.152:0/924510410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d65d0 msgr2=0x55a9417d6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:45.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.364+0000 7f7be29d9740 1 --2- 172.21.15.152:0/924510410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d65d0 0x55a9417d6a10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800e600 tx=0x7f7bc8014000 comp rx=0 tx=0).stop 2024-09-11T22:17:45.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.364+0000 7f7be29d9740 1 -- 172.21.15.152:0/924510410 shutdown_connections 2024-09-11T22:17:45.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.364+0000 7f7be29d9740 1 --2- 172.21.15.152:0/924510410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 0x55a9417e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.364+0000 7f7be29d9740 1 --2- 172.21.15.152:0/924510410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d65d0 0x55a9417d6a10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.364+0000 7f7be29d9740 1 --2- 172.21.15.152:0/924510410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d7b40 0x55a9417d6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.364+0000 7f7be29d9740 1 -- 172.21.15.152:0/924510410 >> 172.21.15.152:0/924510410 conn(0x55a94179f310 msgr2=0x55a9417d2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:45.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.364+0000 7f7be29d9740 1 -- 172.21.15.152:0/924510410 shutdown_connections 2024-09-11T22:17:45.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.364+0000 7f7be29d9740 1 -- 172.21.15.152:0/924510410 wait complete. 2024-09-11T22:17:45.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7be29d9740 1 -- start start 2024-09-11T22:17:45.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7be29d9740 1 Processor -- start 2024-09-11T22:17:45.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417e0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d7b40 0x55a9417de040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 0x55a9417de650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7be29d9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a9417e4070 con 0x55a9417e1370 2024-09-11T22:17:45.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7be29d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a9416f7060 con 0x55a9417d7b40 2024-09-11T22:17:45.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7be29d9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a9417e41f0 con 0x55a9417d65d0 2024-09-11T22:17:45.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7be29d9740 10 client.0 _ll_register_callbacks cb 0x55a94144a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7bdeb9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 0x55a9417de650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7bdeb9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 0x55a9417de650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51570/0 (socket says 172.21.15.152:51570) 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7bdeb9d640 1 -- 172.21.15.152:0/3526678734 learned_addr learned my addr 172.21.15.152:0/3526678734 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7bddb9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d7b40 0x55a9417de040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.365+0000 7f7bde39c640 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417e0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.366+0000 7f7bde39c640 1 -- 172.21.15.152:0/3526678734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d7b40 msgr2=0x55a9417de040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.366+0000 7f7bde39c640 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d7b40 0x55a9417de040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.366+0000 7f7bde39c640 1 -- 172.21.15.152:0/3526678734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 msgr2=0x55a9417de650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.366+0000 7f7bde39c640 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 0x55a9417de650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.366+0000 7f7bde39c640 1 -- 172.21.15.152:0/3526678734 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9414ad3c0 con 0x55a9417d65d0 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.366+0000 7f7bde39c640 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417e0d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40ee270 tx=0x7f7bd40bca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93d5a4c30f13cc8d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:45.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.366+0000 7f7bc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.366+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3526678734 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40d5070 con 0x55a9417d65d0 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.366+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3526678734 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f7bd40041e0 con 0x55a9417d65d0 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.366+0000 7f7be29d9740 1 -- 172.21.15.152:0/3526678734 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bc80041d0 con 0x55a9417d65d0 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3526678734 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7bd409be60 con 0x55a9417d65d0 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7be29d9740 10 client.28153 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7be29d9740 1 -- 172.21.15.152:0/3526678734 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a9417e4070 con 0x55a9417d65d0 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3526678734 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd40c13f0 con 0x55a9417d65d0 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3526678734 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7bd404f060 con 0x55a9417d65d0 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7be29d9740 10 client.28153 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7be29d9740 10 client.28153 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7be29d9740 20 client.28153 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55a9417f0d40 0x55a9417f3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7be29d9740 4 client.28153 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:45.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7be29d9740 1 -- 172.21.15.152:0/3526678734 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7bc80041d0 con 0x55a9417f0d40 2024-09-11T22:17:45.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.367+0000 7f7bddb9b640 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55a9417f0d40 0x55a9417f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.368+0000 7f7bc1ffb640 10 client.28153 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:17:45.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.368+0000 7f7bddb9b640 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55a9417f0d40 0x55a9417f3130 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e27cbdb5cd26716b server_cookie=63903ffd1872a481 in_seq=0 out_seq=0 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.369+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3526678734 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7bc80041d0 con 0x55a9417f0d40 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.369+0000 7f7bc1ffb640 10 client.28153 handle_command_reply: tid=0 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.369+0000 7f7be29d9740 1 client.28153 shutdown 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7be29d9740 1 -- 172.21.15.152:0/3526678734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 msgr2=0x55a9417e0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417e0d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40ee270 tx=0x7f7bd40bca60 comp rx=0 tx=0).stop 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7be29d9740 1 -- 172.21.15.152:0/3526678734 shutdown_connections 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55a9417f0d40 0x55a9417f3130 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417e1370 0x55a9417de650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7bc1ffb640 0 client.28153 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417d7b40 0x55a9417de040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3526678734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417e0d90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7be29d9740 1 -- 172.21.15.152:0/3526678734 >> 172.21.15.152:0/3526678734 conn(0x55a94179f310 msgr2=0x55a9417d8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:45.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7be29d9740 1 -- 172.21.15.152:0/3526678734 shutdown_connections 2024-09-11T22:17:45.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7be29d9740 1 -- 172.21.15.152:0/3526678734 wait complete. 2024-09-11T22:17:45.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.370+0000 7f7be29d9740 20 client.28153 trim_cache size 0 max 16384 2024-09-11T22:17:45.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.387+0000 7f7be29d9740 1 Processor -- start 2024-09-11T22:17:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.387+0000 7f7be29d9740 1 -- start start 2024-09-11T22:17:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.387+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417d5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.387+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417d7b40 0x55a9417d9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.387+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 0x55a9417d9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7be29d9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd81ae150 con 0x55a9417d7b40 2024-09-11T22:17:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7be29d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd81aba20 con 0x55a9417e1370 2024-09-11T22:17:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7be29d9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd80724f0 con 0x55a9417d65d0 2024-09-11T22:17:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7bde39c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417d5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7bdeb9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 0x55a9417d9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7bdeb9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 0x55a9417d9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:39972/0 (socket says 172.21.15.152:39972) 2024-09-11T22:17:45.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7bdeb9d640 1 -- 172.21.15.152:0/477508957 learned_addr learned my addr 172.21.15.152:0/477508957 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:45.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7bde39c640 1 -- 172.21.15.152:0/477508957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 msgr2=0x55a9417d9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:45.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7bde39c640 1 --2- 172.21.15.152:0/477508957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 0x55a9417d9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7bde39c640 1 -- 172.21.15.152:0/477508957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417d7b40 msgr2=0x55a9417d9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:45.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7bde39c640 1 --2- 172.21.15.152:0/477508957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417d7b40 0x55a9417d9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7bde39c640 1 -- 172.21.15.152:0/477508957 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9417dd010 con 0x55a9417d65d0 2024-09-11T22:17:45.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7bdeb9d640 1 --2- 172.21.15.152:0/477508957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 0x55a9417d9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:45.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.388+0000 7f7bde39c640 1 --2- 172.21.15.152:0/477508957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417d5de0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009430 tx=0x7f7bd402e570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a03f6acd45fe77d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:45.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.389+0000 7f7bc3fff640 1 -- 172.21.15.152:0/477508957 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40d5030 con 0x55a9417d65d0 2024-09-11T22:17:45.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.389+0000 7f7bc3fff640 1 -- 172.21.15.152:0/477508957 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd40c13f0 con 0x55a9417d65d0 2024-09-11T22:17:45.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.389+0000 7f7bc3fff640 1 -- 172.21.15.152:0/477508957 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40c5870 con 0x55a9417d65d0 2024-09-11T22:17:45.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.390+0000 7f7be29d9740 1 -- 172.21.15.152:0/477508957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 msgr2=0x55a9417d5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:45.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.390+0000 7f7be29d9740 1 --2- 172.21.15.152:0/477508957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417d5de0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009430 tx=0x7f7bd402e570 comp rx=0 tx=0).stop 2024-09-11T22:17:45.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.390+0000 7f7be29d9740 1 -- 172.21.15.152:0/477508957 shutdown_connections 2024-09-11T22:17:45.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.390+0000 7f7be29d9740 1 --2- 172.21.15.152:0/477508957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 0x55a9417d9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.390+0000 7f7be29d9740 1 --2- 172.21.15.152:0/477508957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417d7b40 0x55a9417d9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.390+0000 7f7be29d9740 1 --2- 172.21.15.152:0/477508957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417d5de0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.390+0000 7f7be29d9740 1 -- 172.21.15.152:0/477508957 >> 172.21.15.152:0/477508957 conn(0x55a94179f310 msgr2=0x55a9417d1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.391+0000 7f7be29d9740 1 -- 172.21.15.152:0/477508957 shutdown_connections 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.391+0000 7f7be29d9740 1 -- 172.21.15.152:0/477508957 wait complete. 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.391+0000 7f7be29d9740 1 -- start start 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.391+0000 7f7be29d9740 1 Processor -- start 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417e94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417d7b40 0x55a9417e99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7be29d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 0x55a9417e6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7be29d9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8072b40 con 0x55a9417d7b40 2024-09-11T22:17:45.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7be29d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8073fb0 con 0x55a9417e1370 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7be29d9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8073210 con 0x55a9417d65d0 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bddb9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417d7b40 0x55a9417e99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7be29d9740 10 client.0 _ll_register_callbacks cb 0x7f7bd400f7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bddb9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417d7b40 0x55a9417e99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51580/0 (socket says 172.21.15.152:51580) 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bddb9b640 1 -- 172.21.15.152:0/3279148814 learned_addr learned my addr 172.21.15.152:0/3279148814 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bdeb9d640 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 0x55a9417e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bde39c640 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417e94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bddb9b640 1 -- 172.21.15.152:0/3279148814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 msgr2=0x55a9417e94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bddb9b640 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417e94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bddb9b640 1 -- 172.21.15.152:0/3279148814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 msgr2=0x55a9417e6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bddb9b640 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 0x55a9417e6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bddb9b640 1 -- 172.21.15.152:0/3279148814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9417e69c0 con 0x55a9417d7b40 2024-09-11T22:17:45.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bddb9b640 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417d7b40 0x55a9417e99f0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800e5d0 tx=0x7f7bc800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fee28c4b9d7261 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.392+0000 7f7bc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.393+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3279148814 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8037020 con 0x55a9417d7b40 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.393+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3279148814 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f7bc8005240 con 0x55a9417d7b40 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.393+0000 7f7be29d9740 1 -- 172.21.15.152:0/3279148814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bd40c13f0 con 0x55a9417d7b40 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.393+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3279148814 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7bc803f050 con 0x55a9417d7b40 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.393+0000 7f7be29d9740 10 client.18759 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.393+0000 7f7be29d9740 1 -- 172.21.15.152:0/3279148814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a94185bf90 con 0x55a9417d7b40 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.393+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3279148814 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd40c13f0 con 0x55a9417d7b40 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.394+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3279148814 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f7bc801c5d0 con 0x55a9417d7b40 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.394+0000 7f7be29d9740 10 client.18759 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.394+0000 7f7be29d9740 10 client.18759 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.394+0000 7f7be29d9740 20 client.18759 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.394+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55a9417f0d40 0x55a94185e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:45.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.394+0000 7f7be29d9740 4 client.18759 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:17:45.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.394+0000 7f7be29d9740 1 -- 172.21.15.152:0/3279148814 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a941749860 con 0x55a9417f0d40 2024-09-11T22:17:45.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.394+0000 7f7bde39c640 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55a9417f0d40 0x55a94185e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:45.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.394+0000 7f7bc1ffb640 10 client.18759 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:17:45.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.395+0000 7f7bde39c640 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55a9417f0d40 0x55a94185e5f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=327de18402ca733f server_cookie=eb25783aa55e73bf in_seq=0 out_seq=0 2024-09-11T22:17:45.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.395+0000 7f7bc1ffb640 1 -- 172.21.15.152:0/3279148814 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a941749860 con 0x55a9417f0d40 2024-09-11T22:17:45.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.395+0000 7f7bc1ffb640 10 client.18759 handle_command_reply: tid=0 2024-09-11T22:17:45.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.395+0000 7f7be29d9740 1 client.18759 shutdown 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.395+0000 7f7be29d9740 1 -- 172.21.15.152:0/3279148814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417d7b40 msgr2=0x55a9417e99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.395+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417d7b40 0x55a9417e99f0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800e5d0 tx=0x7f7bc800edc0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.396+0000 7f7be29d9740 1 -- 172.21.15.152:0/3279148814 shutdown_connections 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.396+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x55a9417f0d40 0x55a94185e5f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.396+0000 7f7bc1ffb640 0 client.18759 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.396+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a9417e1370 0x55a9417e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.396+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9417d7b40 0x55a9417e99f0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.396+0000 7f7be29d9740 1 --2- 172.21.15.152:0/3279148814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9417d65d0 0x55a9417e94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.396+0000 7f7be29d9740 1 -- 172.21.15.152:0/3279148814 >> 172.21.15.152:0/3279148814 conn(0x55a94179f310 msgr2=0x55a9417df8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.396+0000 7f7be29d9740 1 -- 172.21.15.152:0/3279148814 shutdown_connections 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.396+0000 7f7be29d9740 1 -- 172.21.15.152:0/3279148814 wait complete. 2024-09-11T22:17:45.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.396+0000 7f7be29d9740 20 client.18759 trim_cache size 0 max 16384 2024-09-11T22:17:45.402 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:17:45.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 -- 172.21.15.152:0/4267147451 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7bc40a2f10 msgr2=0x7f7bc40a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:45.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7bc40a2f10 0x7f7bc40a53d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80095f0 tx=0x7f7bc8005f90 comp rx=0 tx=0).stop 2024-09-11T22:17:45.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 -- 172.21.15.152:0/4267147451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bd8101470 msgr2=0x7f7bd81a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:45.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bd8101470 0x7f7bd81a46c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4005ab0 tx=0x7f7bd4004970 comp rx=0 tx=0).stop 2024-09-11T22:17:45.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 -- 172.21.15.152:0/4267147451 shutdown_connections 2024-09-11T22:17:45.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7bc40a2f10 0x7f7bc40a53d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd8105de0 0x7f7bd819e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd8101e20 0x7f7bd81a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 --2- 172.21.15.152:0/4267147451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bd8101470 0x7f7bd81a46c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:45.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 -- 172.21.15.152:0/4267147451 >> 172.21.15.152:0/4267147451 conn(0x7f7bd8077230 msgr2=0x7f7bd80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:45.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 -- 172.21.15.152:0/4267147451 shutdown_connections 2024-09-11T22:17:45.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:45.397+0000 7f7be0600640 1 -- 172.21.15.152:0/4267147451 wait complete. 2024-09-11T22:17:45.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:45 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1569986501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:17:45.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:45 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1569986501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:17:45.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:45 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1569986501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:17:46.378 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:46 smithi152 ceph-mon[31188]: pgmap v421: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 31 MiB/s wr, 1.90k op/s 2024-09-11T22:17:46.420 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T22:17:46.420 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T22:17:46.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:46 smithi179 ceph-mon[35603]: pgmap v421: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 31 MiB/s wr, 1.90k op/s 2024-09-11T22:17:46.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:46 smithi193 ceph-mon[35545]: pgmap v421: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 31 MiB/s wr, 1.90k op/s 2024-09-11T22:17:47.126 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:17:47.276 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:47.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:47 smithi152 ceph-mon[31188]: pgmap v422: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 1.60k op/s 2024-09-11T22:17:48.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.032+0000 7fd984bb2640 1 -- 172.21.15.152:0/1244294777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd980102570 msgr2=0x7fd9801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:48.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.032+0000 7fd984bb2640 1 --2- 172.21.15.152:0/1244294777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd980102570 0x7fd9801029b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd974009890 tx=0x7fd97402a410 comp rx=0 tx=0).stop 2024-09-11T22:17:48.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.032+0000 7fd984bb2640 1 -- 172.21.15.152:0/1244294777 shutdown_connections 2024-09-11T22:17:48.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.032+0000 7fd984bb2640 1 --2- 172.21.15.152:0/1244294777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd980102ef0 0x7fd98010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.032+0000 7fd984bb2640 1 --2- 172.21.15.152:0/1244294777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd980102570 0x7fd9801029b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.032+0000 7fd984bb2640 1 --2- 172.21.15.152:0/1244294777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd980100e20 0x7fd980101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.032+0000 7fd984bb2640 1 -- 172.21.15.152:0/1244294777 >> 172.21.15.152:0/1244294777 conn(0x7fd9800fc7d0 msgr2=0x7fd9800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:48.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.033+0000 7fd984bb2640 1 -- 172.21.15.152:0/1244294777 shutdown_connections 2024-09-11T22:17:48.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.033+0000 7fd984bb2640 1 -- 172.21.15.152:0/1244294777 wait complete. 2024-09-11T22:17:48.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd984bb2640 1 Processor -- start 2024-09-11T22:17:48.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd984bb2640 1 -- start start 2024-09-11T22:17:48.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd984bb2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd980100e20 0x7fd980197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd984bb2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd980102570 0x7fd9801976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd984bb2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd980102ef0 0x7fd98019c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd984bb2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd980110f80 con 0x7fd980102570 2024-09-11T22:17:48.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd984bb2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd980110e00 con 0x7fd980102ef0 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd984bb2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd980111100 con 0x7fd980100e20 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd97e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd980100e20 0x7fd980197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd97e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd980100e20 0x7fd980197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38984/0 (socket says 172.21.15.152:38984) 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd97e59c640 1 -- 172.21.15.152:0/299167013 learned_addr learned my addr 172.21.15.152:0/299167013 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.035+0000 7fd97dd9b640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd980102570 0x7fd9801976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd97e59c640 1 -- 172.21.15.152:0/299167013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd980102ef0 msgr2=0x7fd98019c1d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd97e59c640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd980102ef0 0x7fd98019c1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd97e59c640 1 -- 172.21.15.152:0/299167013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd980102570 msgr2=0x7fd9801976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd97e59c640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd980102570 0x7fd9801976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd97e59c640 1 -- 172.21.15.152:0/299167013 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98019c710 con 0x7fd980100e20 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd97dd9b640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd980102570 0x7fd9801976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd97e59c640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd980100e20 0x7fd980197180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd97000e9f0 tx=0x7fd97000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd96f7fe640 1 -- 172.21.15.152:0/299167013 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97000cd80 con 0x7fd980100e20 2024-09-11T22:17:48.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd96f7fe640 1 -- 172.21.15.152:0/299167013 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd970010910 con 0x7fd980100e20 2024-09-11T22:17:48.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd984bb2640 1 -- 172.21.15.152:0/299167013 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd98019ca00 con 0x7fd980100e20 2024-09-11T22:17:48.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd96f7fe640 1 -- 172.21.15.152:0/299167013 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970018960 con 0x7fd980100e20 2024-09-11T22:17:48.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.036+0000 7fd984bb2640 1 -- 172.21.15.152:0/299167013 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd98019cf40 con 0x7fd980100e20 2024-09-11T22:17:48.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.039+0000 7fd96f7fe640 1 -- 172.21.15.152:0/299167013 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd970010ac0 con 0x7fd980100e20 2024-09-11T22:17:48.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.039+0000 7fd986f8b740 1 Processor -- start 2024-09-11T22:17:48.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.039+0000 7fd986f8b740 1 -- start start 2024-09-11T22:17:48.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.040+0000 7fd986f8b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.040+0000 7fd97ed9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.040+0000 7fd97ed9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:39992/0 (socket says 172.21.15.152:39992) 2024-09-11T22:17:48.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.040+0000 7fd97ed9d640 1 -- 172.21.15.152:0/596615520 learned_addr learned my addr 172.21.15.152:0/596615520 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:48.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.041+0000 7fd96f7fe640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd9680a2cf0 0x7fd9680a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.041+0000 7fd96f7fe640 1 -- 172.21.15.152:0/299167013 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7fd9700cf9d0 con 0x7fd980100e20 2024-09-11T22:17:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd97e59c640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd9680a2cf0 0x7fd9680a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd986f8b740 1 --2- 172.21.15.152:0/596615520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 0x55f75f1ba400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd986f8b740 1 --2- 172.21.15.152:0/596615520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1ba940 0x55f75f1bcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd986f8b740 1 -- 172.21.15.152:0/596615520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f75f1152a0 con 0x55f75f1ba940 2024-09-11T22:17:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd986f8b740 1 -- 172.21.15.152:0/596615520 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f75f0bcb10 con 0x55f75f1af760 2024-09-11T22:17:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd986f8b740 1 -- 172.21.15.152:0/596615520 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f75f111260 con 0x55f75f1b0080 2024-09-11T22:17:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd97dd9b640 1 --2- 172.21.15.152:0/596615520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 0x55f75f1ba400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd97ed9d640 1 -- 172.21.15.152:0/596615520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 msgr2=0x55f75f1ba400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/596615520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 0x55f75f1ba400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd97ed9d640 1 -- 172.21.15.152:0/596615520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1ba940 msgr2=0x55f75f1bcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/596615520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1ba940 0x55f75f1bcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.042+0000 7fd97ed9d640 1 -- 172.21.15.152:0/596615520 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f75ee86b90 con 0x55f75f1af760 2024-09-11T22:17:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.043+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/596615520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1afb40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd978005c40 tx=0x7fd9780108a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b39d0c10c894f558 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.043+0000 7fd96cff9640 1 -- 172.21.15.152:0/596615520 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978003b70 con 0x55f75f1af760 2024-09-11T22:17:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.043+0000 7fd97e59c640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd9680a2cf0 0x7fd9680a51b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd970098290 tx=0x7fd9700097d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:48.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.043+0000 7fd96cff9640 1 -- 172.21.15.152:0/596615520 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd978014070 con 0x55f75f1af760 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.044+0000 7fd96cff9640 1 -- 172.21.15.152:0/596615520 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97800e740 con 0x55f75f1af760 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.044+0000 7fd986f8b740 1 -- 172.21.15.152:0/596615520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 msgr2=0x55f75f1afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.044+0000 7fd986f8b740 1 --2- 172.21.15.152:0/596615520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1afb40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd978005c40 tx=0x7fd9780108a0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.044+0000 7fd986f8b740 1 -- 172.21.15.152:0/596615520 shutdown_connections 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.044+0000 7fd986f8b740 1 --2- 172.21.15.152:0/596615520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1ba940 0x55f75f1bcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.044+0000 7fd986f8b740 1 --2- 172.21.15.152:0/596615520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 0x55f75f1ba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.044+0000 7fd986f8b740 1 --2- 172.21.15.152:0/596615520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1afb40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.044+0000 7fd986f8b740 1 -- 172.21.15.152:0/596615520 >> 172.21.15.152:0/596615520 conn(0x55f75f1abcf0 msgr2=0x55f75f1ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.045+0000 7fd986f8b740 1 -- 172.21.15.152:0/596615520 shutdown_connections 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.045+0000 7fd986f8b740 1 -- 172.21.15.152:0/596615520 wait complete. 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.045+0000 7fd986f8b740 1 -- start start 2024-09-11T22:17:48.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.045+0000 7fd986f8b740 1 Processor -- start 2024-09-11T22:17:48.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:47 smithi179 ceph-mon[35603]: pgmap v422: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 1.60k op/s 2024-09-11T22:17:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd986f8b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1b7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd986f8b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 0x55f75f1b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd986f8b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1ba940 0x55f75f1b8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd986f8b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f75f1bd560 con 0x55f75f1b0080 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd986f8b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f75f09d6e0 con 0x55f75f1af760 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd986f8b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f75f1bd6e0 con 0x55f75f1ba940 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd986f8b740 10 client.0 _ll_register_callbacks cb 0x55f75f0c1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd97dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 0x55f75f1b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd97dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 0x55f75f1b7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51628/0 (socket says 172.21.15.152:51628) 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd97dd9b640 1 -- 172.21.15.152:0/3136511471 learned_addr learned my addr 172.21.15.152:0/3136511471 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd97dd9b640 1 -- 172.21.15.152:0/3136511471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1ba940 msgr2=0x55f75f1b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.046+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1ba940 0x55f75f1b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.047+0000 7fd97dd9b640 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1ba940 0x55f75f1b8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.047+0000 7fd97dd9b640 1 -- 172.21.15.152:0/3136511471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 msgr2=0x55f75f1b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.047+0000 7fd97dd9b640 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.047+0000 7fd97dd9b640 1 -- 172.21.15.152:0/3136511471 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f75f1c6b20 con 0x55f75f1b0080 2024-09-11T22:17:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.047+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1ba940 0x55f75f1b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:17:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.047+0000 7fd97dd9b640 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 0x55f75f1b7dd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd974009890 tx=0x7fd974030f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4c288b30c6f0c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.047+0000 7fd965ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.047+0000 7fd965ffb640 1 -- 172.21.15.152:0/3136511471 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9740303a0 con 0x55f75f1b0080 2024-09-11T22:17:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.047+0000 7fd965ffb640 1 -- 172.21.15.152:0/3136511471 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7fd974030540 con 0x55f75f1b0080 2024-09-11T22:17:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.047+0000 7fd986f8b740 1 -- 172.21.15.152:0/3136511471 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd978014070 con 0x55f75f1b0080 2024-09-11T22:17:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.048+0000 7fd965ffb640 1 -- 172.21.15.152:0/3136511471 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd97405e050 con 0x55f75f1b0080 2024-09-11T22:17:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.048+0000 7fd986f8b740 10 client.18768 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:48.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.048+0000 7fd986f8b740 1 -- 172.21.15.152:0/3136511471 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f75f1c9490 con 0x55f75f1b0080 2024-09-11T22:17:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.048+0000 7fd965ffb640 1 -- 172.21.15.152:0/3136511471 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd974005520 con 0x55f75f1b0080 2024-09-11T22:17:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.048+0000 7fd965ffb640 1 -- 172.21.15.152:0/3136511471 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd974004ae0 con 0x55f75f1b0080 2024-09-11T22:17:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.048+0000 7fd986f8b740 10 client.18768 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.048+0000 7fd986f8b740 10 client.18768 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:17:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.048+0000 7fd986f8b740 20 client.18768 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.048+0000 7fd986f8b740 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f75f1ca8a0 0x55f75f1ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.049+0000 7fd986f8b740 4 client.18768 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.049+0000 7fd986f8b740 1 -- 172.21.15.152:0/3136511471 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd978014070 con 0x55f75f1ca8a0 2024-09-11T22:17:48.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.049+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f75f1ca8a0 0x55f75f1ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.051+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f75f1ca8a0 0x55f75f1ccce0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1f6a2eb66ad026f server_cookie=66a7fbfc22827c63 in_seq=0 out_seq=0 2024-09-11T22:17:48.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.051+0000 7fd965ffb640 10 client.18768 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:48.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.052+0000 7fd965ffb640 1 -- 172.21.15.152:0/3136511471 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd978014070 con 0x55f75f1ca8a0 2024-09-11T22:17:48.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.052+0000 7fd965ffb640 10 client.18768 handle_command_reply: tid=0 2024-09-11T22:17:48.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd986f8b740 1 client.18768 shutdown 2024-09-11T22:17:48.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd986f8b740 1 -- 172.21.15.152:0/3136511471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 msgr2=0x55f75f1b7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd986f8b740 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 0x55f75f1b7dd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd974009890 tx=0x7fd974030f70 comp rx=0 tx=0).stop 2024-09-11T22:17:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd986f8b740 1 -- 172.21.15.152:0/3136511471 shutdown_connections 2024-09-11T22:17:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd986f8b740 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f75f1ca8a0 0x55f75f1ccce0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd965ffb640 0 client.18768 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd986f8b740 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1ba940 0x55f75f1b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd986f8b740 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 0x55f75f1b7dd0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd986f8b740 1 --2- 172.21.15.152:0/3136511471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd986f8b740 1 -- 172.21.15.152:0/3136511471 >> 172.21.15.152:0/3136511471 conn(0x55f75f1abcf0 msgr2=0x55f75f1aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd986f8b740 1 -- 172.21.15.152:0/3136511471 shutdown_connections 2024-09-11T22:17:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.053+0000 7fd986f8b740 1 -- 172.21.15.152:0/3136511471 wait complete. 2024-09-11T22:17:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.054+0000 7fd986f8b740 20 client.18768 trim_cache size 0 max 16384 2024-09-11T22:17:48.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:47 smithi193 ceph-mon[35545]: pgmap v422: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 1.60k op/s 2024-09-11T22:17:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.083+0000 7fd986f8b740 1 Processor -- start 2024-09-11T22:17:48.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.083+0000 7fd986f8b740 1 -- start start 2024-09-11T22:17:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.083+0000 7fd986f8b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.084+0000 7fd986f8b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 0x55f75f1d2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.084+0000 7fd97ed9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.084+0000 7fd97ed9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1d25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:39996/0 (socket says 172.21.15.152:39996) 2024-09-11T22:17:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.084+0000 7fd97ed9d640 1 -- 172.21.15.152:0/3416541974 learned_addr learned my addr 172.21.15.152:0/3416541974 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.084+0000 7fd97dd9b640 1 --2- 172.21.15.152:0/3416541974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 0x55f75f1d2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.084+0000 7fd986f8b740 1 --2- 172.21.15.152:0/3416541974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1ba940 0x55f75f1b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.084+0000 7fd986f8b740 1 -- 172.21.15.152:0/3416541974 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801ae160 con 0x55f75f1b0080 2024-09-11T22:17:48.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.084+0000 7fd986f8b740 1 -- 172.21.15.152:0/3416541974 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801a5a00 con 0x55f75f1af760 2024-09-11T22:17:48.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.085+0000 7fd986f8b740 1 -- 172.21.15.152:0/3416541974 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801a3870 con 0x55f75f1ba940 2024-09-11T22:17:48.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.085+0000 7fd97ed9d640 1 -- 172.21.15.152:0/3416541974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1ba940 msgr2=0x55f75f1b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:48.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.085+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/3416541974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1ba940 0x55f75f1b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.085+0000 7fd97ed9d640 1 -- 172.21.15.152:0/3416541974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 msgr2=0x55f75f1d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:48.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.085+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/3416541974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 0x55f75f1d2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.086+0000 7fd97ed9d640 1 -- 172.21.15.152:0/3416541974 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f75f1ab790 con 0x55f75f1af760 2024-09-11T22:17:48.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.086+0000 7fd97dd9b640 1 --2- 172.21.15.152:0/3416541974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 0x55f75f1d2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:48.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.086+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/3416541974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1d25b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd978006010 tx=0x7fd978012040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd0c4af1afeaf32f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:48.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.086+0000 7fd967fff640 1 -- 172.21.15.152:0/3416541974 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978009b30 con 0x55f75f1af760 2024-09-11T22:17:48.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.086+0000 7fd967fff640 1 -- 172.21.15.152:0/3416541974 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd97802c020 con 0x55f75f1af760 2024-09-11T22:17:48.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.086+0000 7fd967fff640 1 -- 172.21.15.152:0/3416541974 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978004000 con 0x55f75f1af760 2024-09-11T22:17:48.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.087+0000 7fd986f8b740 1 -- 172.21.15.152:0/3416541974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 msgr2=0x55f75f1d25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:48.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.087+0000 7fd986f8b740 1 --2- 172.21.15.152:0/3416541974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1d25b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd978006010 tx=0x7fd978012040 comp rx=0 tx=0).stop 2024-09-11T22:17:48.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.087+0000 7fd986f8b740 1 -- 172.21.15.152:0/3416541974 shutdown_connections 2024-09-11T22:17:48.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.087+0000 7fd986f8b740 1 --2- 172.21.15.152:0/3416541974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1ba940 0x55f75f1b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.087+0000 7fd986f8b740 1 --2- 172.21.15.152:0/3416541974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1b0080 0x55f75f1d2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.087+0000 7fd986f8b740 1 --2- 172.21.15.152:0/3416541974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1af760 0x55f75f1d25b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.087+0000 7fd986f8b740 1 -- 172.21.15.152:0/3416541974 >> 172.21.15.152:0/3416541974 conn(0x55f75f1abcf0 msgr2=0x55f75f1b9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:48.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.088+0000 7fd986f8b740 1 -- 172.21.15.152:0/3416541974 shutdown_connections 2024-09-11T22:17:48.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.088+0000 7fd986f8b740 1 -- 172.21.15.152:0/3416541974 wait complete. 2024-09-11T22:17:48.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.088+0000 7fd986f8b740 1 -- start start 2024-09-11T22:17:48.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd986f8b740 1 Processor -- start 2024-09-11T22:17:48.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd986f8b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1af760 0x55f75f1c2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd986f8b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 0x55f75f1c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd986f8b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1ba940 0x55f75f1bf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd986f8b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801a3ec0 con 0x55f75f1af760 2024-09-11T22:17:48.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd986f8b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801a5330 con 0x55f75f1ba940 2024-09-11T22:17:48.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd986f8b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801a4590 con 0x55f75f1b0080 2024-09-11T22:17:48.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd986f8b740 10 client.0 _ll_register_callbacks cb 0x7fd9740096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:48.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd97dd9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 0x55f75f1c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd97dd9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 0x55f75f1c2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:39026/0 (socket says 172.21.15.152:39026) 2024-09-11T22:17:48.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd97dd9b640 1 -- 172.21.15.152:0/4293229388 learned_addr learned my addr 172.21.15.152:0/4293229388 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:48.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.089+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1ba940 0x55f75f1bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.090+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1af760 0x55f75f1c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.090+0000 7fd97dd9b640 1 -- 172.21.15.152:0/4293229388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1ba940 msgr2=0x55f75f1bf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:48.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.090+0000 7fd97dd9b640 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1ba940 0x55f75f1bf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.090+0000 7fd97dd9b640 1 -- 172.21.15.152:0/4293229388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1af760 msgr2=0x55f75f1c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:48.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.090+0000 7fd97dd9b640 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1af760 0x55f75f1c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.090+0000 7fd97dd9b640 1 -- 172.21.15.152:0/4293229388 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f75f1bff40 con 0x55f75f1b0080 2024-09-11T22:17:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.090+0000 7fd97dd9b640 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 0x55f75f1c2ec0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd974031000 tx=0x7fd974004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea14a44a3a0d1da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.090+0000 7fd965ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:17:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.090+0000 7fd965ffb640 1 -- 172.21.15.152:0/4293229388 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974003d60 con 0x55f75f1b0080 2024-09-11T22:17:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.091+0000 7fd965ffb640 1 -- 172.21.15.152:0/4293229388 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7fd9740303a0 con 0x55f75f1b0080 2024-09-11T22:17:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.091+0000 7fd986f8b740 1 -- 172.21.15.152:0/4293229388 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd97802c020 con 0x55f75f1b0080 2024-09-11T22:17:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.091+0000 7fd965ffb640 1 -- 172.21.15.152:0/4293229388 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd9740038d0 con 0x55f75f1b0080 2024-09-11T22:17:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.091+0000 7fd986f8b740 10 client.28171 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.091+0000 7fd986f8b740 1 -- 172.21.15.152:0/4293229388 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f75f246e90 con 0x55f75f1b0080 2024-09-11T22:17:48.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.092+0000 7fd965ffb640 1 -- 172.21.15.152:0/4293229388 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd974066070 con 0x55f75f1b0080 2024-09-11T22:17:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.092+0000 7fd965ffb640 1 -- 172.21.15.152:0/4293229388 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd974005000 con 0x55f75f1b0080 2024-09-11T22:17:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.092+0000 7fd986f8b740 10 client.28171 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.092+0000 7fd986f8b740 10 client.28171 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:17:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.092+0000 7fd986f8b740 20 client.28171 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.092+0000 7fd986f8b740 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f75f1ca8a0 0x55f75f2496f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.092+0000 7fd986f8b740 4 client.28171 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T22:17:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.092+0000 7fd986f8b740 1 -- 172.21.15.152:0/4293229388 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x7fd97802c020 con 0x55f75f1ca8a0 2024-09-11T22:17:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.094+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f75f1ca8a0 0x55f75f2496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:48.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.094+0000 7fd97ed9d640 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f75f1ca8a0 0x55f75f2496f0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f60e9a869968f1c server_cookie=42326481ec009c6e in_seq=0 out_seq=0 2024-09-11T22:17:48.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.094+0000 7fd965ffb640 10 client.28171 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:48.099 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:48.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd965ffb640 1 -- 172.21.15.152:0/4293229388 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fd97802c020 con 0x55f75f1ca8a0 2024-09-11T22:17:48.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd965ffb640 10 client.28171 handle_command_reply: tid=0 2024-09-11T22:17:48.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd986f8b740 1 client.28171 shutdown 2024-09-11T22:17:48.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd986f8b740 1 -- 172.21.15.152:0/4293229388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 msgr2=0x55f75f1c2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:48.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd986f8b740 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 0x55f75f1c2ec0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd974031000 tx=0x7fd974004530 comp rx=0 tx=0).stop 2024-09-11T22:17:48.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd986f8b740 1 -- 172.21.15.152:0/4293229388 shutdown_connections 2024-09-11T22:17:48.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd986f8b740 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f75f1ca8a0 0x55f75f2496f0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd986f8b740 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75f1ba940 0x55f75f1bf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd986f8b740 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75f1b0080 0x55f75f1c2ec0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd965ffb640 0 client.28171 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:48.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd986f8b740 1 --2- 172.21.15.152:0/4293229388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75f1af760 0x55f75f1c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd986f8b740 1 -- 172.21.15.152:0/4293229388 >> 172.21.15.152:0/4293229388 conn(0x55f75f1abcf0 msgr2=0x55f75f1aa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:48.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.444+0000 7fd986f8b740 1 -- 172.21.15.152:0/4293229388 shutdown_connections 2024-09-11T22:17:48.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd986f8b740 1 -- 172.21.15.152:0/4293229388 wait complete. 2024-09-11T22:17:48.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd986f8b740 20 client.28171 trim_cache size 0 max 16384 2024-09-11T22:17:48.447 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:17:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:17:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:17:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 50, 2024-09-11T22:17:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:17:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "cad1d1c0": { 2024-09-11T22:17:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 50, 2024-09-11T22:17:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:17:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:17:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:17:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:17:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 150.0, 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:17:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:17:48.450 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:17:48.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 -- 172.21.15.152:0/299167013 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd9680a2cf0 msgr2=0x7fd9680a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:48.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd9680a2cf0 0x7fd9680a51b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd970098290 tx=0x7fd9700097d0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 -- 172.21.15.152:0/299167013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd980100e20 msgr2=0x7fd980197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:48.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd980100e20 0x7fd980197180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd97000e9f0 tx=0x7fd97000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 -- 172.21.15.152:0/299167013 shutdown_connections 2024-09-11T22:17:48.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd9680a2cf0 0x7fd9680a51b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd980102ef0 0x7fd98019c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd980102570 0x7fd9801976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 --2- 172.21.15.152:0/299167013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd980100e20 0x7fd980197180 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:48.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 -- 172.21.15.152:0/299167013 >> 172.21.15.152:0/299167013 conn(0x7fd9800fc7d0 msgr2=0x7fd9801048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:48.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 -- 172.21.15.152:0/299167013 shutdown_connections 2024-09-11T22:17:48.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.445+0000 7fd984bb2640 1 -- 172.21.15.152:0/299167013 wait complete. 2024-09-11T22:17:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.184+0000 7f47eacc0640 1 -- 172.21.15.152:0/1496263036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47e4101350 msgr2=0x7f47e410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.184+0000 7f47eacc0640 1 --2- 172.21.15.152:0/1496263036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47e4101350 0x7f47e410d880 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009cd0 tx=0x7f47dc02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.184+0000 7f47eacc0640 1 -- 172.21.15.152:0/1496263036 shutdown_connections 2024-09-11T22:17:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.184+0000 7f47eacc0640 1 --2- 172.21.15.152:0/1496263036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47e4101350 0x7f47e410d880 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.184+0000 7f47eacc0640 1 --2- 172.21.15.152:0/1496263036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e41009b0 0x7f47e4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.184+0000 7f47eacc0640 1 --2- 172.21.15.152:0/1496263036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e41069c0 0x7f47e4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.184+0000 7f47eacc0640 1 -- 172.21.15.152:0/1496263036 >> 172.21.15.152:0/1496263036 conn(0x7f47e4077990 msgr2=0x7f47e40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.184+0000 7f47eacc0640 1 -- 172.21.15.152:0/1496263036 shutdown_connections 2024-09-11T22:17:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.184+0000 7f47eacc0640 1 -- 172.21.15.152:0/1496263036 wait complete. 2024-09-11T22:17:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47eacc0640 1 Processor -- start 2024-09-11T22:17:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47eacc0640 1 -- start start 2024-09-11T22:17:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47eacc0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e41009b0 0x7f47e40fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47eacc0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47e4101350 0x7f47e40fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47eacc0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e41069c0 0x7f47e40fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47eacc0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f47e4110e00 con 0x7f47e4101350 2024-09-11T22:17:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47eacc0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f47e4110c80 con 0x7f47e41009b0 2024-09-11T22:17:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47eacc0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f47e4110f80 con 0x7f47e41069c0 2024-09-11T22:17:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47e4101350 0x7f47e40fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47e4101350 0x7f47e40fd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51726/0 (socket says 172.21.15.152:51726) 2024-09-11T22:17:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47dbfff640 1 -- 172.21.15.152:0/3794713265 learned_addr learned my addr 172.21.15.152:0/3794713265 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.185+0000 7f47e925d640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e41069c0 0x7f47e40fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47dbfff640 1 -- 172.21.15.152:0/3794713265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e41069c0 msgr2=0x7f47e40fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e41009b0 0x7f47e40fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47dbfff640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e41069c0 0x7f47e40fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47dbfff640 1 -- 172.21.15.152:0/3794713265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e41009b0 msgr2=0x7f47e40fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47dbfff640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e41009b0 0x7f47e40fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47dbfff640 1 -- 172.21.15.152:0/3794713265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e41a6870 con 0x7f47e4101350 2024-09-11T22:17:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47e925d640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e41069c0 0x7f47e40fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:17:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47dbfff640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47e4101350 0x7f47e40fd320 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f47d400d950 tx=0x7f47d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47d9ffb640 1 -- 172.21.15.152:0/3794713265 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4017070 con 0x7f47e4101350 2024-09-11T22:17:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47d9ffb640 1 -- 172.21.15.152:0/3794713265 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d4009c30 con 0x7f47e4101350 2024-09-11T22:17:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47eacc0640 1 -- 172.21.15.152:0/3794713265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e41a6b60 con 0x7f47e4101350 2024-09-11T22:17:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47d9ffb640 1 -- 172.21.15.152:0/3794713265 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d400f6b0 con 0x7f47e4101350 2024-09-11T22:17:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.186+0000 7f47eacc0640 1 -- 172.21.15.152:0/3794713265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e41a70b0 con 0x7f47e4101350 2024-09-11T22:17:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.189+0000 7f47d9ffb640 1 -- 172.21.15.152:0/3794713265 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f47d40109d0 con 0x7f47e4101350 2024-09-11T22:17:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.189+0000 7f47eda54740 1 Processor -- start 2024-09-11T22:17:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.189+0000 7f47eda54740 1 -- start start 2024-09-11T22:17:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.189+0000 7f47eda54740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a09af0 0x55b9e3a09ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.189+0000 7f47eda54740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a14770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.189+0000 7f47eda54740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a170a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.189+0000 7f47eda54740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b9e396e2f0 con 0x55b9e3a0a410 2024-09-11T22:17:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.189+0000 7f47eda54740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b9e3916270 con 0x55b9e3a14cb0 2024-09-11T22:17:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.189+0000 7f47d9ffb640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47cc0a2da0 0x7f47cc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.189+0000 7f47eda54740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b9e396a2b0 con 0x55b9e3a09af0 2024-09-11T22:17:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e8a5c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a14770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e925d640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47cc0a2da0 0x7f47cc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e8a5c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a14770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51742/0 (socket says 172.21.15.152:51742) 2024-09-11T22:17:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e8a5c640 1 -- 172.21.15.152:0/124121845 learned_addr learned my addr 172.21.15.152:0/124121845 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e925d640 1 --2- 172.21.15.152:0/124121845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a09af0 0x55b9e3a09ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47d9ffb640 1 -- 172.21.15.152:0/3794713265 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f47d40cf1b0 con 0x7f47e4101350 2024-09-11T22:17:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47dbfff640 1 --2- 172.21.15.152:0/124121845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a170a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e8a5c640 1 -- 172.21.15.152:0/124121845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a09af0 msgr2=0x55b9e3a09ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/124121845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a09af0 0x55b9e3a09ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e8a5c640 1 -- 172.21.15.152:0/124121845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a14cb0 msgr2=0x55b9e3a170a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/124121845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a170a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e8a5c640 1 -- 172.21.15.152:0/124121845 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e3915340 con 0x55b9e3a0a410 2024-09-11T22:17:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e925d640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47cc0a2da0 0x7f47cc0a5260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f47dc031860 tx=0x7f47dc009910 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/124121845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a14770 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009b30 tx=0x7f47e000e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5fb5cc23b3f969 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47caffd640 1 -- 172.21.15.152:0/124121845 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0016070 con 0x55b9e3a0a410 2024-09-11T22:17:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47caffd640 1 -- 172.21.15.152:0/124121845 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e000ed20 con 0x55b9e3a0a410 2024-09-11T22:17:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.190+0000 7f47caffd640 1 -- 172.21.15.152:0/124121845 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0010750 con 0x55b9e3a0a410 2024-09-11T22:17:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.191+0000 7f47eda54740 1 -- 172.21.15.152:0/124121845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 msgr2=0x55b9e3a14770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.191+0000 7f47eda54740 1 --2- 172.21.15.152:0/124121845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a14770 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009b30 tx=0x7f47e000e2f0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.191+0000 7f47eda54740 1 -- 172.21.15.152:0/124121845 shutdown_connections 2024-09-11T22:17:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.191+0000 7f47eda54740 1 --2- 172.21.15.152:0/124121845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a170a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.191+0000 7f47eda54740 1 --2- 172.21.15.152:0/124121845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a14770 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.191+0000 7f47eda54740 1 --2- 172.21.15.152:0/124121845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a09af0 0x55b9e3a09ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.191+0000 7f47eda54740 1 -- 172.21.15.152:0/124121845 >> 172.21.15.152:0/124121845 conn(0x55b9e3a06060 msgr2=0x55b9e3a06440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.191+0000 7f47eda54740 1 -- 172.21.15.152:0/124121845 shutdown_connections 2024-09-11T22:17:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.191+0000 7f47eda54740 1 -- 172.21.15.152:0/124121845 wait complete. 2024-09-11T22:17:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.191+0000 7f47eda54740 1 -- start start 2024-09-11T22:17:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.191+0000 7f47eda54740 1 Processor -- start 2024-09-11T22:17:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47eda54740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 0x55b9e3a11b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47eda54740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a12080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47eda54740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47eda54740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b9e3a17880 con 0x55b9e3a0a410 2024-09-11T22:17:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47eda54740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b9e38f7290 con 0x55b9e3a09af0 2024-09-11T22:17:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47eda54740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b9e3a17a00 con 0x55b9e3a14cb0 2024-09-11T22:17:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47eda54740 10 client.0 _ll_register_callbacks cb 0x55b9e3928140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a12080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a12080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51744/0 (socket says 172.21.15.152:51744) 2024-09-11T22:17:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47dbfff640 1 -- 172.21.15.152:0/3993885341 learned_addr learned my addr 172.21.15.152:0/3993885341 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 0x55b9e3a11b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47e925d640 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47dbfff640 1 -- 172.21.15.152:0/3993885341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a14cb0 msgr2=0x55b9e3a125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47dbfff640 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a125c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47dbfff640 1 -- 172.21.15.152:0/3993885341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 msgr2=0x55b9e3a11b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47dbfff640 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 0x55b9e3a11b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47dbfff640 1 -- 172.21.15.152:0/3993885341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9e3681210 con 0x55b9e3a0a410 2024-09-11T22:17:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 0x55b9e3a11b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47dbfff640 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a12080 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f47d4098040 tx=0x7f47d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fb0611fcab9c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47c3fff640 1 -- 172.21.15.152:0/3993885341 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4020050 con 0x55b9e3a0a410 2024-09-11T22:17:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47c3fff640 1 -- 172.21.15.152:0/3993885341 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f47d40b3260 con 0x55b9e3a0a410 2024-09-11T22:17:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.192+0000 7f47eda54740 1 -- 172.21.15.152:0/3993885341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e000ed20 con 0x55b9e3a0a410 2024-09-11T22:17:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47c3fff640 1 -- 172.21.15.152:0/3993885341 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f47d409bd70 con 0x55b9e3a0a410 2024-09-11T22:17:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47eda54740 10 client.18804 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47eda54740 1 -- 172.21.15.152:0/3993885341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b9e374d620 con 0x55b9e3a0a410 2024-09-11T22:17:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47c3fff640 1 -- 172.21.15.152:0/3993885341 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e000ed20 con 0x55b9e3a0a410 2024-09-11T22:17:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47c3fff640 1 -- 172.21.15.152:0/3993885341 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f47d4084bb0 con 0x55b9e3a0a410 2024-09-11T22:17:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47eda54740 10 client.18804 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47eda54740 10 client.18804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47eda54740 20 client.18804 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47eda54740 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b9e3a24b50 0x55b9e3a26f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47eda54740 4 client.18804 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47eda54740 1 -- 172.21.15.152:0/3993885341 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9e397ba20 con 0x55b9e3a24b50 2024-09-11T22:17:49.205 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.193+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b9e3a24b50 0x55b9e3a26f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.205 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b9e3a24b50 0x55b9e3a26f60 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=567a023fee6cc5cd server_cookie=1444d649958de430 in_seq=0 out_seq=0 2024-09-11T22:17:49.205 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47c3fff640 10 client.18804 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:49.205 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47c3fff640 1 -- 172.21.15.152:0/3993885341 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9e397ba20 con 0x55b9e3a24b50 2024-09-11T22:17:49.205 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47c3fff640 10 client.18804 handle_command_reply: tid=0 2024-09-11T22:17:49.205 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47eda54740 1 client.18804 shutdown 2024-09-11T22:17:49.205 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47eda54740 1 -- 172.21.15.152:0/3993885341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 msgr2=0x55b9e3a12080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.205 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47eda54740 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a12080 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f47d4098040 tx=0x7f47d4005880 comp rx=0 tx=0).stop 2024-09-11T22:17:49.205 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47eda54740 1 -- 172.21.15.152:0/3993885341 shutdown_connections 2024-09-11T22:17:49.205 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47eda54740 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b9e3a24b50 0x55b9e3a26f60 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47eda54740 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47eda54740 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a12080 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47eda54740 1 --2- 172.21.15.152:0/3993885341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 0x55b9e3a11b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47c3fff640 0 client.18804 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.194+0000 7f47eda54740 1 -- 172.21.15.152:0/3993885341 >> 172.21.15.152:0/3993885341 conn(0x55b9e3a06060 msgr2=0x55b9e3a0bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.195+0000 7f47eda54740 1 -- 172.21.15.152:0/3993885341 shutdown_connections 2024-09-11T22:17:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.195+0000 7f47eda54740 1 -- 172.21.15.152:0/3993885341 wait complete. 2024-09-11T22:17:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.195+0000 7f47eda54740 20 client.18804 trim_cache size 0 max 16384 2024-09-11T22:17:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47eda54740 1 Processor -- start 2024-09-11T22:17:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47eda54740 1 -- start start 2024-09-11T22:17:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47eda54740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a09af0 0x55b9e3a123f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47eda54740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a2c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47eda54740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a2cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47eda54740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41b23e0 con 0x55b9e3a0a410 2024-09-11T22:17:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47eda54740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41afcb0 con 0x55b9e3a14cb0 2024-09-11T22:17:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47eda54740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41adb20 con 0x55b9e3a09af0 2024-09-11T22:17:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a2c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a2c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51758/0 (socket says 172.21.15.152:51758) 2024-09-11T22:17:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47dbfff640 1 -- 172.21.15.152:0/730728413 learned_addr learned my addr 172.21.15.152:0/730728413 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/730728413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a09af0 0x55b9e3a123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.210+0000 7f47e925d640 1 --2- 172.21.15.152:0/730728413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a2cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.211+0000 7f47dbfff640 1 -- 172.21.15.152:0/730728413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a09af0 msgr2=0x55b9e3a123f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.211+0000 7f47dbfff640 1 --2- 172.21.15.152:0/730728413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a09af0 0x55b9e3a123f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.211+0000 7f47dbfff640 1 -- 172.21.15.152:0/730728413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a14cb0 msgr2=0x55b9e3a2cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.211+0000 7f47dbfff640 1 --2- 172.21.15.152:0/730728413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a2cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.211+0000 7f47dbfff640 1 -- 172.21.15.152:0/730728413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e3a06cf0 con 0x55b9e3a0a410 2024-09-11T22:17:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.211+0000 7f47dbfff640 1 --2- 172.21.15.152:0/730728413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a2c820 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f47d4099920 tx=0x7f47d4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a95d9599db5331 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.211+0000 7f47ca7fc640 1 -- 172.21.15.152:0/730728413 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4020070 con 0x55b9e3a0a410 2024-09-11T22:17:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.211+0000 7f47ca7fc640 1 -- 172.21.15.152:0/730728413 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d409fa20 con 0x55b9e3a0a410 2024-09-11T22:17:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.211+0000 7f47ca7fc640 1 -- 172.21.15.152:0/730728413 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4010460 con 0x55b9e3a0a410 2024-09-11T22:17:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.212+0000 7f47eda54740 1 -- 172.21.15.152:0/730728413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 msgr2=0x55b9e3a2c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.212+0000 7f47eda54740 1 --2- 172.21.15.152:0/730728413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a2c820 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f47d4099920 tx=0x7f47d4000bc0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.212+0000 7f47eda54740 1 -- 172.21.15.152:0/730728413 shutdown_connections 2024-09-11T22:17:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.212+0000 7f47eda54740 1 --2- 172.21.15.152:0/730728413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a2cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.212+0000 7f47eda54740 1 --2- 172.21.15.152:0/730728413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a0a410 0x55b9e3a2c820 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.212+0000 7f47eda54740 1 --2- 172.21.15.152:0/730728413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a09af0 0x55b9e3a123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.212+0000 7f47eda54740 1 -- 172.21.15.152:0/730728413 >> 172.21.15.152:0/730728413 conn(0x55b9e3a06060 msgr2=0x55b9e3a13bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.212+0000 7f47eda54740 1 -- 172.21.15.152:0/730728413 shutdown_connections 2024-09-11T22:17:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.212+0000 7f47eda54740 1 -- 172.21.15.152:0/730728413 wait complete. 2024-09-11T22:17:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.212+0000 7f47eda54740 1 -- start start 2024-09-11T22:17:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.212+0000 7f47eda54740 1 Processor -- start 2024-09-11T22:17:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47eda54740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 0x55b9e3a1d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47eda54740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a0a410 0x55b9e3a0e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47eda54740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a0ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47eda54740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41ae170 con 0x55b9e3a14cb0 2024-09-11T22:17:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47eda54740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41af5e0 con 0x55b9e3a09af0 2024-09-11T22:17:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47eda54740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41ae840 con 0x55b9e3a0a410 2024-09-11T22:17:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47eda54740 10 client.0 _ll_register_callbacks cb 0x7f47d409b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47e925d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a0ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a0a410 0x55b9e3a0e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47e925d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a0ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51768/0 (socket says 172.21.15.152:51768) 2024-09-11T22:17:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a0a410 0x55b9e3a0e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:39130/0 (socket says 172.21.15.152:39130) 2024-09-11T22:17:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47e8a5c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 0x55b9e3a1d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47e925d640 1 -- 172.21.15.152:0/2927999040 learned_addr learned my addr 172.21.15.152:0/2927999040 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47e925d640 1 -- 172.21.15.152:0/2927999040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a0a410 msgr2=0x55b9e3a0e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47e925d640 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a0a410 0x55b9e3a0e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47e925d640 1 -- 172.21.15.152:0/2927999040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 msgr2=0x55b9e3a1d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47e925d640 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 0x55b9e3a1d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47e925d640 1 -- 172.21.15.152:0/2927999040 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9e3a012d0 con 0x55b9e3a14cb0 2024-09-11T22:17:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47dbfff640 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a0a410 0x55b9e3a0e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 0x55b9e3a1d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47e925d640 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a0ec50 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009ca0 tx=0x7f47dc046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00606cff73e3077 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47c3fff640 1 -- 172.21.15.152:0/2927999040 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc004240 con 0x55b9e3a14cb0 2024-09-11T22:17:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47c3fff640 1 -- 172.21.15.152:0/2927999040 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f47dc0043e0 con 0x55b9e3a14cb0 2024-09-11T22:17:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.213+0000 7f47eda54740 1 -- 172.21.15.152:0/2927999040 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47d409fa20 con 0x55b9e3a14cb0 2024-09-11T22:17:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47c3fff640 1 -- 172.21.15.152:0/2927999040 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f47dc0045e0 con 0x55b9e3a14cb0 2024-09-11T22:17:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47eda54740 10 client.18810 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47eda54740 1 -- 172.21.15.152:0/2927999040 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b9e3a8f4e0 con 0x55b9e3a14cb0 2024-09-11T22:17:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47c3fff640 1 -- 172.21.15.152:0/2927999040 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d409fa20 con 0x55b9e3a14cb0 2024-09-11T22:17:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47c3fff640 1 -- 172.21.15.152:0/2927999040 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f47dc030070 con 0x55b9e3a14cb0 2024-09-11T22:17:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47eda54740 10 client.18810 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47eda54740 10 client.18810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47eda54740 20 client.18810 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47eda54740 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b9e3a8fcb0 0x55b9e3a920d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47eda54740 4 client.18810 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:17:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47eda54740 1 -- 172.21.15.152:0/2927999040 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b9e3975d70 con 0x55b9e3a8fcb0 2024-09-11T22:17:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.214+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b9e3a8fcb0 0x55b9e3a920d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.215+0000 7f47e8a5c640 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b9e3a8fcb0 0x55b9e3a920d0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db949954836d3cc server_cookie=ec8a133387c0ac27 in_seq=0 out_seq=0 2024-09-11T22:17:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.215+0000 7f47c3fff640 10 client.18810 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47c3fff640 1 -- 172.21.15.152:0/2927999040 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b9e3975d70 con 0x55b9e3a8fcb0 2024-09-11T22:17:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47c3fff640 10 client.18810 handle_command_reply: tid=0 2024-09-11T22:17:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 1 client.18810 shutdown 2024-09-11T22:17:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 1 -- 172.21.15.152:0/2927999040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a14cb0 msgr2=0x55b9e3a0ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a0ec50 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009ca0 tx=0x7f47dc046000 comp rx=0 tx=0).stop 2024-09-11T22:17:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 1 -- 172.21.15.152:0/2927999040 shutdown_connections 2024-09-11T22:17:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b9e3a8fcb0 0x55b9e3a920d0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e3a14cb0 0x55b9e3a0ec50 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47c3fff640 0 client.18810 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b9e3a0a410 0x55b9e3a0e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 1 --2- 172.21.15.152:0/2927999040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9e3a09af0 0x55b9e3a1d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 1 -- 172.21.15.152:0/2927999040 >> 172.21.15.152:0/2927999040 conn(0x55b9e3a06060 msgr2=0x55b9e3a049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 1 -- 172.21.15.152:0/2927999040 shutdown_connections 2024-09-11T22:17:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 1 -- 172.21.15.152:0/2927999040 wait complete. 2024-09-11T22:17:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.223+0000 7f47eda54740 20 client.18810 trim_cache size 0 max 16384 2024-09-11T22:17:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:17:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:17:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:17:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:17:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 -- 172.21.15.152:0/3794713265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47cc0a2da0 msgr2=0x7f47cc0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47cc0a2da0 0x7f47cc0a5260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f47dc031860 tx=0x7f47dc009910 comp rx=0 tx=0).stop 2024-09-11T22:17:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 -- 172.21.15.152:0/3794713265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47e4101350 msgr2=0x7f47e40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47e4101350 0x7f47e40fd320 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f47d400d950 tx=0x7f47d400de10 comp rx=0 tx=0).stop 2024-09-11T22:17:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 -- 172.21.15.152:0/3794713265 shutdown_connections 2024-09-11T22:17:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f47cc0a2da0 0x7f47cc0a5260 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e41069c0 0x7f47e40fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47e4101350 0x7f47e40fd320 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 --2- 172.21.15.152:0/3794713265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e41009b0 0x7f47e40fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 -- 172.21.15.152:0/3794713265 >> 172.21.15.152:0/3794713265 conn(0x7f47e4077990 msgr2=0x7f47e4069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 -- 172.21.15.152:0/3794713265 shutdown_connections 2024-09-11T22:17:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:17:49.224+0000 7f47eacc0640 1 -- 172.21.15.152:0/3794713265 wait complete. 2024-09-11T22:17:49.239 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'cad1d1c0', quiesce took 5.8 seconds. Will release after: 24.2 2024-09-11T22:17:49.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.588+0000 7f2e4af24640 1 -- 172.21.15.152:0/1823728146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44101420 msgr2=0x7f2e4410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.588+0000 7f2e4af24640 1 --2- 172.21.15.152:0/1823728146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44101420 0x7f2e4410d950 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009cd0 tx=0x7f2e3c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.588+0000 7f2e4af24640 1 -- 172.21.15.152:0/1823728146 shutdown_connections 2024-09-11T22:17:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.588+0000 7f2e4af24640 1 --2- 172.21.15.152:0/1823728146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44101420 0x7f2e4410d950 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.588+0000 7f2e4af24640 1 --2- 172.21.15.152:0/1823728146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e44100a80 0x7f2e44100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.588+0000 7f2e4af24640 1 --2- 172.21.15.152:0/1823728146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e44106a80 0x7f2e44106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.588+0000 7f2e4af24640 1 -- 172.21.15.152:0/1823728146 >> 172.21.15.152:0/1823728146 conn(0x7f2e440fc7a0 msgr2=0x7f2e440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.588+0000 7f2e4af24640 1 -- 172.21.15.152:0/1823728146 shutdown_connections 2024-09-11T22:17:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.588+0000 7f2e4af24640 1 -- 172.21.15.152:0/1823728146 wait complete. 2024-09-11T22:17:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e4af24640 1 Processor -- start 2024-09-11T22:17:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e4af24640 1 -- start start 2024-09-11T22:17:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e4af24640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e44100a80 0x7f2e44198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e4af24640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e44101420 0x7f2e44198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e4af24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44106a80 0x7f2e4419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e4af24640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2e44111fa0 con 0x7f2e44106a80 2024-09-11T22:17:49.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e4af24640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2e44111e20 con 0x7f2e44100a80 2024-09-11T22:17:49.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e4af24640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2e44112120 con 0x7f2e44101420 2024-09-11T22:17:49.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e494c1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44106a80 0x7f2e4419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e43fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e44101420 0x7f2e44198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e494c1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44106a80 0x7f2e4419cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51664/0 (socket says 172.21.15.152:51664) 2024-09-11T22:17:49.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e494c1640 1 -- 172.21.15.152:0/2335742016 learned_addr learned my addr 172.21.15.152:0/2335742016 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:49.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e48cc0640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e44100a80 0x7f2e44198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e43fff640 1 -- 172.21.15.152:0/2335742016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e44100a80 msgr2=0x7f2e44198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e43fff640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e44100a80 0x7f2e44198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e43fff640 1 -- 172.21.15.152:0/2335742016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44106a80 msgr2=0x7f2e4419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.589+0000 7f2e43fff640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44106a80 0x7f2e4419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.590+0000 7f2e43fff640 1 -- 172.21.15.152:0/2335742016 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4419d3f0 con 0x7f2e44101420 2024-09-11T22:17:49.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.590+0000 7f2e494c1640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44106a80 0x7f2e4419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:49.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.590+0000 7f2e43fff640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e44101420 0x7f2e44198980 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000e9f0 tx=0x7f2e3000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.590+0000 7f2e41ffb640 1 -- 172.21.15.152:0/2335742016 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3000ccc0 con 0x7f2e44101420 2024-09-11T22:17:49.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.590+0000 7f2e4af24640 1 -- 172.21.15.152:0/2335742016 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e4419d6e0 con 0x7f2e44101420 2024-09-11T22:17:49.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.590+0000 7f2e41ffb640 1 -- 172.21.15.152:0/2335742016 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e30005020 con 0x7f2e44101420 2024-09-11T22:17:49.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.590+0000 7f2e41ffb640 1 -- 172.21.15.152:0/2335742016 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3001c070 con 0x7f2e44101420 2024-09-11T22:17:49.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.590+0000 7f2e4af24640 1 -- 172.21.15.152:0/2335742016 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e441a4fc0 con 0x7f2e44101420 2024-09-11T22:17:49.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.592+0000 7f2e41ffb640 1 -- 172.21.15.152:0/2335742016 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f2e30005540 con 0x7f2e44101420 2024-09-11T22:17:49.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e4d2fd740 1 Processor -- start 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e4d2fd740 1 -- start start 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb4b40 0x55f75ebb3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebb3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebbe370 0x55f75ebc0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f75eb192f0 con 0x55f75ebb35d0 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f75eac0cf0 con 0x55f75ebb4b40 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f75eb152b0 con 0x55f75ebbe370 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e41ffb640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2e340a2cf0 0x7f2e340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e48cc0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebb3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e48cc0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebb3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51680/0 (socket says 172.21.15.152:51680) 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e48cc0640 1 -- 172.21.15.152:0/3106622203 learned_addr learned my addr 172.21.15.152:0/3106622203 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e494c1640 1 --2- 172.21.15.152:0/3106622203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb4b40 0x55f75ebb3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e43fff640 1 --2- 172.21.15.152:0/3106622203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebbe370 0x55f75ebc0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e494c1640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2e340a2cf0 0x7f2e340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e41ffb640 1 -- 172.21.15.152:0/2335742016 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f2e300cf4b0 con 0x7f2e44101420 2024-09-11T22:17:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e48cc0640 1 -- 172.21.15.152:0/3106622203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebbe370 msgr2=0x55f75ebc0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e48cc0640 1 --2- 172.21.15.152:0/3106622203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebbe370 0x55f75ebc0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e48cc0640 1 -- 172.21.15.152:0/3106622203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb4b40 msgr2=0x55f75ebb3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e48cc0640 1 --2- 172.21.15.152:0/3106622203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb4b40 0x55f75ebb3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e48cc0640 1 -- 172.21.15.152:0/3106622203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f75eaa53a0 con 0x55f75ebb35d0 2024-09-11T22:17:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e494c1640 1 --2- 172.21.15.152:0/3106622203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb4b40 0x55f75ebb3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.593+0000 7f2e43fff640 1 --2- 172.21.15.152:0/3106622203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebbe370 0x55f75ebc0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e48cc0640 1 --2- 172.21.15.152:0/3106622203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebb3a10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800bc90 tx=0x7f2e380107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ece2fa6c9fe994d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e2effd640 1 -- 172.21.15.152:0/3106622203 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3801c480 con 0x55f75ebb35d0 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e494c1640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2e340a2cf0 0x7f2e340a51b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c031860 tx=0x7f2e3c005c50 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e2effd640 1 -- 172.21.15.152:0/3106622203 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e3801cb00 con 0x55f75ebb35d0 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e2effd640 1 -- 172.21.15.152:0/3106622203 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38011bb0 con 0x55f75ebb35d0 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3106622203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 msgr2=0x55f75ebb3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/3106622203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebb3a10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800bc90 tx=0x7f2e380107a0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3106622203 shutdown_connections 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/3106622203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebbe370 0x55f75ebc0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/3106622203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebb3a10 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/3106622203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb4b40 0x55f75ebb3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.594+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3106622203 >> 172.21.15.152:0/3106622203 conn(0x55f75eb7c310 msgr2=0x55f75ebafc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3106622203 shutdown_connections 2024-09-11T22:17:49.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3106622203 wait complete. 2024-09-11T22:17:49.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e4d2fd740 1 -- start start 2024-09-11T22:17:49.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e4d2fd740 1 Processor -- start 2024-09-11T22:17:49.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebbdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb4b40 0x55f75ebbafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebbe370 0x55f75ebbb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f75ebc1070 con 0x55f75ebb35d0 2024-09-11T22:17:49.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f75ead4060 con 0x55f75ebb4b40 2024-09-11T22:17:49.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f75ebc11f0 con 0x55f75ebbe370 2024-09-11T22:17:49.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e4d2fd740 10 client.0 _ll_register_callbacks cb 0x55f75e8278c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:49.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e48cc0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebbdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e48cc0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebbdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51688/0 (socket says 172.21.15.152:51688) 2024-09-11T22:17:49.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.595+0000 7f2e48cc0640 1 -- 172.21.15.152:0/3831344058 learned_addr learned my addr 172.21.15.152:0/3831344058 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:49.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e494c1640 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebbe370 0x55f75ebbb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e43fff640 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb4b40 0x55f75ebbafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e48cc0640 1 -- 172.21.15.152:0/3831344058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebbe370 msgr2=0x55f75ebbb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e48cc0640 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebbe370 0x55f75ebbb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e48cc0640 1 -- 172.21.15.152:0/3831344058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb4b40 msgr2=0x55f75ebbafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e48cc0640 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb4b40 0x55f75ebbafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e48cc0640 1 -- 172.21.15.152:0/3831344058 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f75e88a3c0 con 0x55f75ebb35d0 2024-09-11T22:17:49.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e48cc0640 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebbdcf0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f2e38010ca0 tx=0x7f2e3801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb6d9b5d444d7c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e23fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:49.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e23fff640 1 -- 172.21.15.152:0/3831344058 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3801c920 con 0x55f75ebb35d0 2024-09-11T22:17:49.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e23fff640 1 -- 172.21.15.152:0/3831344058 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f2e38011b40 con 0x55f75ebb35d0 2024-09-11T22:17:49.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3831344058 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e3801cb00 con 0x55f75ebb35d0 2024-09-11T22:17:49.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e23fff640 1 -- 172.21.15.152:0/3831344058 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2e38011d40 con 0x55f75ebb35d0 2024-09-11T22:17:49.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e4d2fd740 10 client.18786 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:49.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.596+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3831344058 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f75ebccad0 con 0x55f75ebb35d0 2024-09-11T22:17:49.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.597+0000 7f2e23fff640 1 -- 172.21.15.152:0/3831344058 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e3801cb00 con 0x55f75ebb35d0 2024-09-11T22:17:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.597+0000 7f2e23fff640 1 -- 172.21.15.152:0/3831344058 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f2e38004a70 con 0x55f75ebb35d0 2024-09-11T22:17:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.597+0000 7f2e4d2fd740 10 client.18786 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.597+0000 7f2e4d2fd740 10 client.18786 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:17:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.597+0000 7f2e4d2fd740 20 client.18786 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.597+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55f75ebcded0 0x55f75ebd02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.597+0000 7f2e4d2fd740 4 client.18786 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.597+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3831344058 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f75eb26860 con 0x55f75ebcded0 2024-09-11T22:17:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.597+0000 7f2e43fff640 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55f75ebcded0 0x55f75ebd02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.598+0000 7f2e23fff640 10 client.18786 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:17:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.598+0000 7f2e43fff640 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55f75ebcded0 0x55f75ebd02c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df68eba344ec3d6a server_cookie=2efdc350704d5a45 in_seq=0 out_seq=0 2024-09-11T22:17:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.598+0000 7f2e23fff640 1 -- 172.21.15.152:0/3831344058 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f75eb26860 con 0x55f75ebcded0 2024-09-11T22:17:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.598+0000 7f2e23fff640 10 client.18786 handle_command_reply: tid=0 2024-09-11T22:17:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.598+0000 7f2e4d2fd740 1 client.18786 shutdown 2024-09-11T22:17:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.598+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3831344058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 msgr2=0x55f75ebbdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.598+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebbdcf0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f2e38010ca0 tx=0x7f2e3801c730 comp rx=0 tx=0).stop 2024-09-11T22:17:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.599+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3831344058 shutdown_connections 2024-09-11T22:17:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.599+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55f75ebcded0 0x55f75ebd02c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.599+0000 7f2e23fff640 0 client.18786 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:17:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.599+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebbe370 0x55f75ebbb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.599+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb4b40 0x55f75ebbafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.599+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/3831344058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebb35d0 0x55f75ebbdcf0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.599+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3831344058 >> 172.21.15.152:0/3831344058 conn(0x55f75eb7c310 msgr2=0x55f75ebb5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.599+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3831344058 shutdown_connections 2024-09-11T22:17:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.599+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/3831344058 wait complete. 2024-09-11T22:17:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.599+0000 7f2e4d2fd740 20 client.18786 trim_cache size 0 max 16384 2024-09-11T22:17:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e4d2fd740 1 Processor -- start 2024-09-11T22:17:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e4d2fd740 1 -- start start 2024-09-11T22:17:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb35d0 0x55f75ebb4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebb4b40 0x55f75ebca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 0x55f75ebb9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441b0350 con 0x55f75ebbe370 2024-09-11T22:17:49.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441adc20 con 0x55f75ebb35d0 2024-09-11T22:17:49.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441aba90 con 0x55f75ebb4b40 2024-09-11T22:17:49.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e494c1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 0x55f75ebb9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e43fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebb4b40 0x55f75ebca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e494c1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 0x55f75ebb9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51700/0 (socket says 172.21.15.152:51700) 2024-09-11T22:17:49.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e494c1640 1 -- 172.21.15.152:0/2305232501 learned_addr learned my addr 172.21.15.152:0/2305232501 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e48cc0640 1 --2- 172.21.15.152:0/2305232501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb35d0 0x55f75ebb4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e43fff640 1 -- 172.21.15.152:0/2305232501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb35d0 msgr2=0x55f75ebb4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e43fff640 1 --2- 172.21.15.152:0/2305232501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb35d0 0x55f75ebb4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e43fff640 1 -- 172.21.15.152:0/2305232501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 msgr2=0x55f75ebb9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e43fff640 1 --2- 172.21.15.152:0/2305232501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 0x55f75ebb9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e43fff640 1 -- 172.21.15.152:0/2305232501 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f75ebb9550 con 0x55f75ebb4b40 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.612+0000 7f2e43fff640 1 --2- 172.21.15.152:0/2305232501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebb4b40 0x55f75ebca340 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2e300ccb40 tx=0x7f2e3006e980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac77f2ad3be208d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e2e7fc640 1 -- 172.21.15.152:0/2305232501 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e300a4580 con 0x55f75ebb4b40 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e2e7fc640 1 -- 172.21.15.152:0/2305232501 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e30084e50 con 0x55f75ebb4b40 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e2e7fc640 1 -- 172.21.15.152:0/2305232501 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e300a40f0 con 0x55f75ebb4b40 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2305232501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebb4b40 msgr2=0x55f75ebca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/2305232501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebb4b40 0x55f75ebca340 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2e300ccb40 tx=0x7f2e3006e980 comp rx=0 tx=0).stop 2024-09-11T22:17:49.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2305232501 shutdown_connections 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/2305232501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 0x55f75ebb9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/2305232501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebb4b40 0x55f75ebca340 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/2305232501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb35d0 0x55f75ebb4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2305232501 >> 172.21.15.152:0/2305232501 conn(0x55f75eb7c310 msgr2=0x55f75ebb98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2305232501 shutdown_connections 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.613+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2305232501 wait complete. 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e4d2fd740 1 -- start start 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e4d2fd740 1 Processor -- start 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb35d0 0x55f75ebc6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebb4b40 0x55f75ebb7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e4d2fd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 0x55f75ebb8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441ac0e0 con 0x55f75ebbe370 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441ad550 con 0x55f75ebb35d0 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e4d2fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441ac7b0 con 0x55f75ebb4b40 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e4d2fd740 10 client.0 _ll_register_callbacks cb 0x7f2e3800bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e494c1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 0x55f75ebb8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e494c1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 0x55f75ebb8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51712/0 (socket says 172.21.15.152:51712) 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e494c1640 1 -- 172.21.15.152:0/2306596609 learned_addr learned my addr 172.21.15.152:0/2306596609 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e43fff640 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebb4b40 0x55f75ebb7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.614+0000 7f2e48cc0640 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb35d0 0x55f75ebc6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e494c1640 1 -- 172.21.15.152:0/2306596609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebb4b40 msgr2=0x55f75ebb7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e494c1640 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebb4b40 0x55f75ebb7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e494c1640 1 -- 172.21.15.152:0/2306596609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb35d0 msgr2=0x55f75ebc6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e494c1640 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb35d0 0x55f75ebc6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e494c1640 1 -- 172.21.15.152:0/2306596609 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f75ebb87d0 con 0x55f75ebbe370 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e494c1640 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 0x55f75ebb8130 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009a60 tx=0x7f2e3c02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d722bd52f6efa028 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e23fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e23fff640 1 -- 172.21.15.152:0/2306596609 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c058060 con 0x55f75ebbe370 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e23fff640 1 -- 172.21.15.152:0/2306596609 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f2e3c030bf0 con 0x55f75ebbe370 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2306596609 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e30084e50 con 0x55f75ebbe370 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e23fff640 1 -- 172.21.15.152:0/2306596609 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2e3c030df0 con 0x55f75ebbe370 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e4d2fd740 10 client.18792 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2306596609 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f75ec38860 con 0x55f75ebbe370 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e23fff640 1 -- 172.21.15.152:0/2306596609 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e30084e50 con 0x55f75ebbe370 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e23fff640 1 -- 172.21.15.152:0/2306596609 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f2e3c030070 con 0x55f75ebbe370 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e4d2fd740 10 client.18792 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e4d2fd740 10 client.18792 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:17:49.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e4d2fd740 20 client.18792 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:49.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.615+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55f75ebcded0 0x55f75ec3b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:49.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e4d2fd740 4 client.18792 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:17:49.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2306596609 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f75eb20d70 con 0x55f75ebcded0 2024-09-11T22:17:49.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e48cc0640 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55f75ebcded0 0x55f75ec3b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:49.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e23fff640 10 client.18792 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:17:49.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e48cc0640 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55f75ebcded0 0x55f75ec3b050 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3ba3a7ccfc2d28bb server_cookie=a71992cfe3875712 in_seq=0 out_seq=0 2024-09-11T22:17:49.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e23fff640 1 -- 172.21.15.152:0/2306596609 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f75eb20d70 con 0x55f75ebcded0 2024-09-11T22:17:49.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e23fff640 10 client.18792 handle_command_reply: tid=0 2024-09-11T22:17:49.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e4d2fd740 1 client.18792 shutdown 2024-09-11T22:17:49.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2306596609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 msgr2=0x55f75ebb8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 0x55f75ebb8130 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009a60 tx=0x7f2e3c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2306596609 shutdown_connections 2024-09-11T22:17:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:17:49.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55f75ebcded0 0x55f75ec3b050 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f75ebbe370 0x55f75ebb8130 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f75ebb4b40 0x55f75ebb7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e4d2fd740 1 --2- 172.21.15.152:0/2306596609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f75ebb35d0 0x55f75ebc6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e23fff640 0 client.18792 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.616+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2306596609 >> 172.21.15.152:0/2306596609 conn(0x55f75eb7c310 msgr2=0x55f75ebba0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2306596609 shutdown_connections 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4d2fd740 1 -- 172.21.15.152:0/2306596609 wait complete. 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4d2fd740 20 client.18792 trim_cache size 0 max 16384 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 -- 172.21.15.152:0/2335742016 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2e340a2cf0 msgr2=0x7f2e340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2e340a2cf0 0x7f2e340a51b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c031860 tx=0x7f2e3c005c50 comp rx=0 tx=0).stop 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 -- 172.21.15.152:0/2335742016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e44101420 msgr2=0x7f2e44198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e44101420 0x7f2e44198980 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000e9f0 tx=0x7f2e3000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 -- 172.21.15.152:0/2335742016 shutdown_connections 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2e340a2cf0 0x7f2e340a51b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44106a80 0x7f2e4419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e44101420 0x7f2e44198980 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 --2- 172.21.15.152:0/2335742016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e44100a80 0x7f2e44198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:49.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 -- 172.21.15.152:0/2335742016 >> 172.21.15.152:0/2335742016 conn(0x7f2e440fc7a0 msgr2=0x7f2e440fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:49.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 -- 172.21.15.152:0/2335742016 shutdown_connections 2024-09-11T22:17:49.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:48.617+0000 7f2e4af24640 1 -- 172.21.15.152:0/2335742016 wait complete. 2024-09-11T22:17:49.820 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 735.0 s, 1181.6 tps, lat 55.271 ms stddev 59.417 2024-09-11T22:17:49.944 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:49 smithi152 ceph-mon[31188]: pgmap v423: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 30 MiB/s wr, 1.80k op/s 2024-09-11T22:17:49.971 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:17:50.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:49 smithi179 ceph-mon[35603]: pgmap v423: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 30 MiB/s wr, 1.80k op/s 2024-09-11T22:17:50.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:49 smithi193 ceph-mon[35545]: pgmap v423: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 30 MiB/s wr, 1.80k op/s 2024-09-11T22:17:50.216 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:50.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.627+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/746003389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2edc106a80 msgr2=0x7f2edc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:50.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.627+0000 7f2ee0a8d640 1 --2- 172.21.15.152:0/746003389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2edc106a80 0x7f2edc106e60 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009930 tx=0x7f2ecc02a420 comp rx=0 tx=0).stop 2024-09-11T22:17:50.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.627+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/746003389 shutdown_connections 2024-09-11T22:17:50.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.627+0000 7f2ee0a8d640 1 --2- 172.21.15.152:0/746003389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2edc101420 0x7f2edc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.627+0000 7f2ee0a8d640 1 --2- 172.21.15.152:0/746003389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2edc100a80 0x7f2edc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.627+0000 7f2ee0a8d640 1 --2- 172.21.15.152:0/746003389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2edc106a80 0x7f2edc106e60 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.627+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/746003389 >> 172.21.15.152:0/746003389 conn(0x7f2edc0fc7a0 msgr2=0x7f2edc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:50.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.628+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/746003389 shutdown_connections 2024-09-11T22:17:50.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.628+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/746003389 wait complete. 2024-09-11T22:17:50.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.628+0000 7f2ee0a8d640 1 Processor -- start 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.628+0000 7f2ee0a8d640 1 -- start start 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2ee0a8d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2edc100a80 0x7f2edc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2ee0a8d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2edc101420 0x7f2edc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2ee0a8d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2edc106a80 0x7f2edc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2ee0a8d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc111fa0 con 0x7f2edc100a80 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2ee0a8d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc111e20 con 0x7f2edc106a80 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2ee0a8d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc112120 con 0x7f2edc101420 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2eda59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2edc100a80 0x7f2edc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2eda59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2edc100a80 0x7f2edc198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51790/0 (socket says 172.21.15.152:51790) 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2eda59c640 1 -- 172.21.15.152:0/3665345409 learned_addr learned my addr 172.21.15.152:0/3665345409 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2edc101420 0x7f2edc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2edad9d640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2edc106a80 0x7f2edc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2eda59c640 1 -- 172.21.15.152:0/3665345409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2edc101420 msgr2=0x7f2edc198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2eda59c640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2edc101420 0x7f2edc198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2eda59c640 1 -- 172.21.15.152:0/3665345409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2edc106a80 msgr2=0x7f2edc19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2eda59c640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2edc106a80 0x7f2edc19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2eda59c640 1 -- 172.21.15.152:0/3665345409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2edc19d3b0 con 0x7f2edc100a80 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2edad9d640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2edc106a80 0x7f2edc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2eda59c640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2edc100a80 0x7f2edc198400 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009a50 tx=0x7f2ecc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2ecb7fe640 1 -- 172.21.15.152:0/3665345409 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc03f030 con 0x7f2edc100a80 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2ecb7fe640 1 -- 172.21.15.152:0/3665345409 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ecc003ce0 con 0x7f2edc100a80 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/3665345409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2edc19d640 con 0x7f2edc100a80 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.629+0000 7f2ecb7fe640 1 -- 172.21.15.152:0/3665345409 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc035070 con 0x7f2edc100a80 2024-09-11T22:17:50.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.630+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/3665345409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2edc1a4f80 con 0x7f2edc100a80 2024-09-11T22:17:50.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.632+0000 7f2ecb7fe640 1 -- 172.21.15.152:0/3665345409 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f2ecc042030 con 0x7f2edc100a80 2024-09-11T22:17:50.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.632+0000 7f2ee2e66740 1 Processor -- start 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.632+0000 7f2ee2e66740 1 -- start start 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.632+0000 7f2ecb7fe640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2ec40a2cf0 0x7f2ec40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc396b40 0x55e5dc395090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc395a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2edad9d640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2ec40a2cf0 0x7f2ec40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e5dc2fb2f0 con 0x55e5dc3955d0 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e5dc2a2cf0 con 0x55e5dc3a4780 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e5dc2f72b0 con 0x55e5dc396b40 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ecb7fe640 1 -- 172.21.15.152:0/3665345409 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f2ecc0efaa0 con 0x7f2edc100a80 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ed9d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc395a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ed9d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc395a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51806/0 (socket says 172.21.15.152:51806) 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ed9d9b640 1 -- 172.21.15.152:0/2895976974 learned_addr learned my addr 172.21.15.152:0/2895976974 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2edad9d640 1 --2- 172.21.15.152:0/2895976974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2eda59c640 1 --2- 172.21.15.152:0/2895976974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc396b40 0x55e5dc395090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ed9d9b640 1 -- 172.21.15.152:0/2895976974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc396b40 msgr2=0x55e5dc395090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/2895976974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc396b40 0x55e5dc395090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ed9d9b640 1 -- 172.21.15.152:0/2895976974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc3a4780 msgr2=0x55e5dc3a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/2895976974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ed9d9b640 1 -- 172.21.15.152:0/2895976974 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5dc2873a0 con 0x55e5dc3955d0 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2edad9d640 1 --2- 172.21.15.152:0/2895976974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2edad9d640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2ec40a2cf0 0x7f2ec40a51b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4005cc0 tx=0x7f2ed4014a30 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.633+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/2895976974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc395a10 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000abe0 tx=0x7f2ed000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6663b764a2268a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ec8ff9640 1 -- 172.21.15.152:0/2895976974 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed001d070 con 0x55e5dc3955d0 2024-09-11T22:17:50.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ec8ff9640 1 -- 172.21.15.152:0/2895976974 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ed0018b20 con 0x55e5dc3955d0 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ec8ff9640 1 -- 172.21.15.152:0/2895976974 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0010a90 con 0x55e5dc3955d0 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2895976974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 msgr2=0x55e5dc395a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/2895976974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc395a10 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000abe0 tx=0x7f2ed000f790 comp rx=0 tx=0).stop 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2895976974 shutdown_connections 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/2895976974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/2895976974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc395a10 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/2895976974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc396b40 0x55e5dc395090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2895976974 >> 172.21.15.152:0/2895976974 conn(0x55e5dc35e310 msgr2=0x55e5dc391c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2895976974 shutdown_connections 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.634+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2895976974 wait complete. 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2ee2e66740 1 -- start start 2024-09-11T22:17:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2ee2e66740 1 Processor -- start 2024-09-11T22:17:50.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc3a4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 0x55e5dc3a1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e5dc3a7480 con 0x55e5dc3955d0 2024-09-11T22:17:50.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e5dc2b6060 con 0x55e5dc396b40 2024-09-11T22:17:50.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e5dc3a7600 con 0x55e5dc3a4780 2024-09-11T22:17:50.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2ee2e66740 10 client.0 _ll_register_callbacks cb 0x55e5dc0098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2eda59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc3a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2eda59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc3a4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51822/0 (socket says 172.21.15.152:51822) 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.635+0000 7f2eda59c640 1 -- 172.21.15.152:0/374923871 learned_addr learned my addr 172.21.15.152:0/374923871 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2edad9d640 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 0x55e5dc3a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2eda59c640 1 -- 172.21.15.152:0/374923871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3a4780 msgr2=0x55e5dc3a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2eda59c640 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2eda59c640 1 -- 172.21.15.152:0/374923871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 msgr2=0x55e5dc3a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2eda59c640 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 0x55e5dc3a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2eda59c640 1 -- 172.21.15.152:0/374923871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5dc06c3c0 con 0x55e5dc3955d0 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 0x55e5dc3a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2eda59c640 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc3a4190 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0bbe90 tx=0x7f2ecc0bb920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e31f03808711d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2ec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/374923871 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc049050 con 0x55e5dc3955d0 2024-09-11T22:17:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/374923871 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f2ecc03b460 con 0x55e5dc3955d0 2024-09-11T22:17:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2ee2e66740 1 -- 172.21.15.152:0/374923871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ed0018b20 con 0x55e5dc3955d0 2024-09-11T22:17:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/374923871 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2ecc0c02b0 con 0x55e5dc3955d0 2024-09-11T22:17:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2ee2e66740 10 client.18822 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2ee2e66740 1 -- 172.21.15.152:0/374923871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e5dc3b2ec0 con 0x55e5dc3955d0 2024-09-11T22:17:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.636+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/374923871 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ed0018b20 con 0x55e5dc3955d0 2024-09-11T22:17:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.637+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/374923871 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f2ecc031bd0 con 0x55e5dc3955d0 2024-09-11T22:17:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.637+0000 7f2ee2e66740 10 client.18822 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.637+0000 7f2ee2e66740 10 client.18822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.637+0000 7f2ee2e66740 20 client.18822 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.637+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e5dc3b43c0 0x55e5dc3b6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.637+0000 7f2ee2e66740 4 client.18822 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.637+0000 7f2ee2e66740 1 -- 172.21.15.152:0/374923871 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5dc308860 con 0x55e5dc3b43c0 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.637+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e5dc3b43c0 0x55e5dc3b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.637+0000 7f2ec1ffb640 10 client.18822 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.637+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e5dc3b43c0 0x55e5dc3b6830 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1867d53e3022fa41 server_cookie=2c67945a56dbe282 in_seq=0 out_seq=0 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/374923871 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5dc308860 con 0x55e5dc3b43c0 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ec1ffb640 10 client.18822 handle_command_reply: tid=0 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ee2e66740 1 client.18822 shutdown 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ee2e66740 1 -- 172.21.15.152:0/374923871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 msgr2=0x55e5dc3a4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc3a4190 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0bbe90 tx=0x7f2ecc0bb920 comp rx=0 tx=0).stop 2024-09-11T22:17:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ee2e66740 1 -- 172.21.15.152:0/374923871 shutdown_connections 2024-09-11T22:17:50.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e5dc3b43c0 0x55e5dc3b6830 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ec1ffb640 0 client.18822 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:50.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 0x55e5dc3a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/374923871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3955d0 0x55e5dc3a4190 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ee2e66740 1 -- 172.21.15.152:0/374923871 >> 172.21.15.152:0/374923871 conn(0x55e5dc35e310 msgr2=0x55e5dc397960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:50.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ee2e66740 1 -- 172.21.15.152:0/374923871 shutdown_connections 2024-09-11T22:17:50.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.638+0000 7f2ee2e66740 1 -- 172.21.15.152:0/374923871 wait complete. 2024-09-11T22:17:50.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.639+0000 7f2ee2e66740 20 client.18822 trim_cache size 0 max 16384 2024-09-11T22:17:50.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.651+0000 7f2ee2e66740 1 Processor -- start 2024-09-11T22:17:50.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.651+0000 7f2ee2e66740 1 -- start start 2024-09-11T22:17:50.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.651+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc3955d0 0x55e5dc3b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.651+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc396b40 0x55e5dc3a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.651+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3a4780 0x55e5dc397820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc1ae050 con 0x55e5dc396b40 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc1ab920 con 0x55e5dc3955d0 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc1a9790 con 0x55e5dc3a4780 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ed9d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc396b40 0x55e5dc3a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ed9d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc396b40 0x55e5dc3a0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51830/0 (socket says 172.21.15.152:51830) 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ed9d9b640 1 -- 172.21.15.152:0/1218777424 learned_addr learned my addr 172.21.15.152:0/1218777424 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2edad9d640 1 --2- 172.21.15.152:0/1218777424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3a4780 0x55e5dc397820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2eda59c640 1 --2- 172.21.15.152:0/1218777424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc3955d0 0x55e5dc3b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ed9d9b640 1 -- 172.21.15.152:0/1218777424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3a4780 msgr2=0x55e5dc397820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/1218777424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3a4780 0x55e5dc397820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ed9d9b640 1 -- 172.21.15.152:0/1218777424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc3955d0 msgr2=0x55e5dc3b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/1218777424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc3955d0 0x55e5dc3b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ed9d9b640 1 -- 172.21.15.152:0/1218777424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5dc3a0410 con 0x55e5dc396b40 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/1218777424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc396b40 0x55e5dc3a0d00 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000fc90 tx=0x7f2ed000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bbee0b55246fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ec3fff640 1 -- 172.21.15.152:0/1218777424 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed001d040 con 0x55e5dc396b40 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ec3fff640 1 -- 172.21.15.152:0/1218777424 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ed0018a20 con 0x55e5dc396b40 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.652+0000 7f2ec3fff640 1 -- 172.21.15.152:0/1218777424 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00055e0 con 0x55e5dc396b40 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.653+0000 7f2ee2e66740 1 -- 172.21.15.152:0/1218777424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc396b40 msgr2=0x55e5dc3a0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.653+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/1218777424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc396b40 0x55e5dc3a0d00 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000fc90 tx=0x7f2ed000a570 comp rx=0 tx=0).stop 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.653+0000 7f2ee2e66740 1 -- 172.21.15.152:0/1218777424 shutdown_connections 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.653+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/1218777424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3a4780 0x55e5dc397820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.653+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/1218777424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc396b40 0x55e5dc3a0d00 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.653+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/1218777424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc3955d0 0x55e5dc3b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.653+0000 7f2ee2e66740 1 -- 172.21.15.152:0/1218777424 >> 172.21.15.152:0/1218777424 conn(0x55e5dc35e310 msgr2=0x55e5dc397110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.653+0000 7f2ee2e66740 1 -- 172.21.15.152:0/1218777424 shutdown_connections 2024-09-11T22:17:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.653+0000 7f2ee2e66740 1 -- 172.21.15.152:0/1218777424 wait complete. 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.653+0000 7f2ee2e66740 1 -- start start 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.653+0000 7f2ee2e66740 1 Processor -- start 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3955d0 0x55e5dc3acf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 0x55e5dc3a8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ee2e66740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc1a9de0 con 0x55e5dc3a4780 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc1ab250 con 0x55e5dc396b40 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ee2e66740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc1aa4b0 con 0x55e5dc3955d0 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2edad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ed9d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 0x55e5dc3a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2edad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51834/0 (socket says 172.21.15.152:51834) 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2eda59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3955d0 0x55e5dc3acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2edad9d640 1 -- 172.21.15.152:0/2446554150 learned_addr learned my addr 172.21.15.152:0/2446554150 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ee2e66740 10 client.0 _ll_register_callbacks cb 0x7f2ecc0bbcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ed9d9b640 1 -- 172.21.15.152:0/2446554150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3955d0 msgr2=0x55e5dc3acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3955d0 0x55e5dc3acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ed9d9b640 1 -- 172.21.15.152:0/2446554150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3a4780 msgr2=0x55e5dc3a8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ed9d9b640 1 -- 172.21.15.152:0/2446554150 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5dc3a8fa0 con 0x55e5dc396b40 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2edad9d640 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ed9d9b640 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 0x55e5dc3a8230 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55e5dc29de40 tx=0x7f2ed000a7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0fd27e8949c3508 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.654+0000 7f2ec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/2446554150 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed001d040 con 0x55e5dc396b40 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2446554150 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ed0018a20 con 0x55e5dc396b40 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/2446554150 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f2ed0018740 con 0x55e5dc396b40 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/2446554150 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2ed0042050 con 0x55e5dc396b40 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ee2e66740 10 client.28064 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2446554150 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e5dc3984d0 con 0x55e5dc396b40 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/2446554150 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ed0018a20 con 0x55e5dc396b40 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/2446554150 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f2ed002b070 con 0x55e5dc396b40 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ee2e66740 10 client.28064 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ee2e66740 10 client.28064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ee2e66740 20 client.28064 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e5dc3b43c0 0x55e5dc39aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ee2e66740 4 client.28064 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.655+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2446554150 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e5dc302d70 con 0x55e5dc3b43c0 2024-09-11T22:17:50.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2eda59c640 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e5dc3b43c0 0x55e5dc39aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:50.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2eda59c640 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e5dc3b43c0 0x55e5dc39aaa0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f30cd7cbd4427d8 server_cookie=3a7022df46433259 in_seq=0 out_seq=0 2024-09-11T22:17:50.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ec1ffb640 10 client.28064 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:50.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ec1ffb640 1 -- 172.21.15.152:0/2446554150 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e5dc302d70 con 0x55e5dc3b43c0 2024-09-11T22:17:50.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ec1ffb640 10 client.28064 handle_command_reply: tid=0 2024-09-11T22:17:50.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ee2e66740 1 client.28064 shutdown 2024-09-11T22:17:50.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2446554150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 msgr2=0x55e5dc3a8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:50.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 0x55e5dc3a8230 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55e5dc29de40 tx=0x7f2ed000a7e0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2446554150 shutdown_connections 2024-09-11T22:17:50.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e5dc3b43c0 0x55e5dc39aaa0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5dc3a4780 0x55e5dc3a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ec1ffb640 0 client.28064 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:50.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e5dc396b40 0x55e5dc3a8230 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ee2e66740 1 --2- 172.21.15.152:0/2446554150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5dc3955d0 0x55e5dc3acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2446554150 >> 172.21.15.152:0/2446554150 conn(0x55e5dc35e310 msgr2=0x55e5dc397930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:50.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2446554150 shutdown_connections 2024-09-11T22:17:50.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.656+0000 7f2ee2e66740 1 -- 172.21.15.152:0/2446554150 wait complete. 2024-09-11T22:17:50.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee2e66740 20 client.28064 trim_cache size 0 max 16384 2024-09-11T22:17:50.664 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:17:50.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/3665345409 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2ec40a2cf0 msgr2=0x7f2ec40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:50.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2ec40a2cf0 0x7f2ec40a51b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4005cc0 tx=0x7f2ed4014a30 comp rx=0 tx=0).stop 2024-09-11T22:17:50.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/3665345409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2edc100a80 msgr2=0x7f2edc198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:50.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2edc100a80 0x7f2edc198400 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009a50 tx=0x7f2ecc004270 comp rx=0 tx=0).stop 2024-09-11T22:17:50.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/3665345409 shutdown_connections 2024-09-11T22:17:50.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2ec40a2cf0 0x7f2ec40a51b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2edc106a80 0x7f2edc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2edc101420 0x7f2edc198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 --2- 172.21.15.152:0/3665345409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2edc100a80 0x7f2edc198400 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:50.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/3665345409 >> 172.21.15.152:0/3665345409 conn(0x7f2edc0fc7a0 msgr2=0x7f2edc0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:50.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/3665345409 shutdown_connections 2024-09-11T22:17:50.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:50.657+0000 7f2ee0a8d640 1 -- 172.21.15.152:0/3665345409 wait complete. 2024-09-11T22:17:51.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:51 smithi152 ceph-mon[31188]: pgmap v424: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 26 MiB/s wr, 1.54k op/s 2024-09-11T22:17:52.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:51 smithi179 ceph-mon[35603]: pgmap v424: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 26 MiB/s wr, 1.54k op/s 2024-09-11T22:17:52.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:51 smithi193 ceph-mon[35545]: pgmap v424: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 26 MiB/s wr, 1.54k op/s 2024-09-11T22:17:52.542 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:17:53.193 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:17:53.457 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:53.908 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:53 smithi152 ceph-mon[31188]: pgmap v425: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 24 MiB/s wr, 1.38k op/s 2024-09-11T22:17:53.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.907+0000 7f5293a2a640 1 -- 172.21.15.152:0/2492896647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f528c106f10 msgr2=0x7f528c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:53.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.907+0000 7f5293a2a640 1 --2- 172.21.15.152:0/2492896647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f528c106f10 0x7f528c10ea90 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f5284009ca0 tx=0x7f528402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.907+0000 7f5293a2a640 1 -- 172.21.15.152:0/2492896647 shutdown_connections 2024-09-11T22:17:53.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.907+0000 7f5293a2a640 1 --2- 172.21.15.152:0/2492896647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f528c106f10 0x7f528c10ea90 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.907+0000 7f5293a2a640 1 --2- 172.21.15.152:0/2492896647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f528c102790 0x7f528c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.907+0000 7f5293a2a640 1 --2- 172.21.15.152:0/2492896647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f528c101de0 0x7f528c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.907+0000 7f5293a2a640 1 -- 172.21.15.152:0/2492896647 >> 172.21.15.152:0/2492896647 conn(0x7f528c0fd8c0 msgr2=0x7f528c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:53.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.907+0000 7f5293a2a640 1 -- 172.21.15.152:0/2492896647 shutdown_connections 2024-09-11T22:17:53.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.907+0000 7f5293a2a640 1 -- 172.21.15.152:0/2492896647 wait complete. 2024-09-11T22:17:53.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.907+0000 7f5293a2a640 1 Processor -- start 2024-09-11T22:17:53.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5293a2a640 1 -- start start 2024-09-11T22:17:53.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5293a2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f528c101de0 0x7f528c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5293a2a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f528c102790 0x7f528c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5293a2a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f528c106f10 0x7f528c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5293a2a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f528c111f70 con 0x7f528c102790 2024-09-11T22:17:53.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5293a2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f528c111df0 con 0x7f528c101de0 2024-09-11T22:17:53.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5293a2a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1120f0 con 0x7f528c106f10 2024-09-11T22:17:53.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5290fc5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f528c102790 0x7f528c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5290fc5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f528c102790 0x7f528c198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35144/0 (socket says 172.21.15.152:35144) 2024-09-11T22:17:53.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5290fc5640 1 -- 172.21.15.152:0/3482619500 learned_addr learned my addr 172.21.15.152:0/3482619500 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f52917c6640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f528c101de0 0x7f528c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5291fc7640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f528c106f10 0x7f528c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5290fc5640 1 -- 172.21.15.152:0/3482619500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f528c106f10 msgr2=0x7f528c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5290fc5640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f528c106f10 0x7f528c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5290fc5640 1 -- 172.21.15.152:0/3482619500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f528c101de0 msgr2=0x7f528c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5290fc5640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f528c101de0 0x7f528c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5290fc5640 1 -- 172.21.15.152:0/3482619500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c19d3a0 con 0x7f528c102790 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.908+0000 7f5290fc5640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f528c102790 0x7f528c198930 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f527c00d950 tx=0x7f527c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.909+0000 7f52827fc640 1 -- 172.21.15.152:0/3482619500 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c017070 con 0x7f528c102790 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.909+0000 7f52827fc640 1 -- 172.21.15.152:0/3482619500 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f527c009c30 con 0x7f528c102790 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.909+0000 7f5293a2a640 1 -- 172.21.15.152:0/3482619500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c19d690 con 0x7f528c102790 2024-09-11T22:17:53.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.909+0000 7f52827fc640 1 -- 172.21.15.152:0/3482619500 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c00f6b0 con 0x7f528c102790 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.909+0000 7f5293a2a640 1 -- 172.21.15.152:0/3482619500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c1a4f70 con 0x7f528c102790 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.911+0000 7f52827fc640 1 -- 172.21.15.152:0/3482619500 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f527c0109d0 con 0x7f528c102790 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.911+0000 7f5295e03740 1 Processor -- start 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.911+0000 7f5295e03740 1 -- start start 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.911+0000 7f5295e03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daa97f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.911+0000 7f5295e03740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.911+0000 7f5295e03740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daaa2d40 0x55f4daaa5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.911+0000 7f5295e03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f4da9fd280 con 0x55f4daa97b60 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5295e03740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f4da9a4b10 con 0x55f4daaa2d40 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5295e03740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f4da9f9240 con 0x55f4daa98480 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f52827fc640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f52780a2cf0 0x7f52780a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5291fc7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daa97f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5291fc7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daa97f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35152/0 (socket says 172.21.15.152:35152) 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5291fc7640 1 -- 172.21.15.152:0/3408071362 learned_addr learned my addr 172.21.15.152:0/3408071362 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5290fc5640 1 --2- 172.21.15.152:0/3408071362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daaa2d40 0x55f4daaa5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f52917c6640 1 --2- 172.21.15.152:0/3408071362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5291fc7640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f52780a2cf0 0x7f52780a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f52827fc640 1 -- 172.21.15.152:0/3482619500 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f527c0cf040 con 0x7f528c102790 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5291fc7640 1 -- 172.21.15.152:0/3408071362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 msgr2=0x55f4daaa2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5291fc7640 1 --2- 172.21.15.152:0/3408071362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5291fc7640 1 -- 172.21.15.152:0/3408071362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daaa2d40 msgr2=0x55f4daaa5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5291fc7640 1 --2- 172.21.15.152:0/3408071362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daaa2d40 0x55f4daaa5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5291fc7640 1 -- 172.21.15.152:0/3408071362 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4da9b11f0 con 0x55f4daa97b60 2024-09-11T22:17:53.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5291fc7640 1 --2- 172.21.15.152:0/3408071362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daa97f40 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5284005fe0 tx=0x7f5284009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31d474161f0346a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.912+0000 7f5291fc7640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f52780a2cf0 0x7f52780a51b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5284047000 tx=0x7f5284049000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f52777fe640 1 -- 172.21.15.152:0/3408071362 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528404e070 con 0x55f4daa97b60 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f52777fe640 1 -- 172.21.15.152:0/3408071362 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5284036070 con 0x55f4daa97b60 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f52777fe640 1 -- 172.21.15.152:0/3408071362 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528402f9d0 con 0x55f4daa97b60 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f5295e03740 1 -- 172.21.15.152:0/3408071362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 msgr2=0x55f4daa97f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f5295e03740 1 --2- 172.21.15.152:0/3408071362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daa97f40 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5284005fe0 tx=0x7f5284009a00 comp rx=0 tx=0).stop 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f5295e03740 1 -- 172.21.15.152:0/3408071362 shutdown_connections 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f5295e03740 1 --2- 172.21.15.152:0/3408071362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daaa2d40 0x55f4daaa5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f5295e03740 1 --2- 172.21.15.152:0/3408071362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f5295e03740 1 --2- 172.21.15.152:0/3408071362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daa97f40 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f5295e03740 1 -- 172.21.15.152:0/3408071362 >> 172.21.15.152:0/3408071362 conn(0x55f4daa940f0 msgr2=0x55f4daa944d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:53.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f5295e03740 1 -- 172.21.15.152:0/3408071362 shutdown_connections 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.913+0000 7f5295e03740 1 -- 172.21.15.152:0/3408071362 wait complete. 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.914+0000 7f5295e03740 1 -- start start 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.914+0000 7f5295e03740 1 Processor -- start 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.914+0000 7f5295e03740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa97b60 0x55f4daa9fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.914+0000 7f5295e03740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.914+0000 7f5295e03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daaa2d40 0x55f4daaa06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.914+0000 7f5295e03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f4daaa5790 con 0x55f4daaa2d40 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.914+0000 7f5295e03740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f4da9b7f10 con 0x55f4daa97b60 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.914+0000 7f5295e03740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f4daaa5910 con 0x55f4daa98480 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.914+0000 7f5295e03740 10 client.0 _ll_register_callbacks cb 0x55f4da980a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.914+0000 7f5291fc7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daaa2d40 0x55f4daaa06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5291fc7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daaa2d40 0x55f4daaa06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35156/0 (socket says 172.21.15.152:35156) 2024-09-11T22:17:53.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5291fc7640 1 -- 172.21.15.152:0/92475083 learned_addr learned my addr 172.21.15.152:0/92475083 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5290fc5640 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f52917c6640 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa97b60 0x55f4daa9fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5291fc7640 1 -- 172.21.15.152:0/92475083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 msgr2=0x55f4daaa01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5291fc7640 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5291fc7640 1 -- 172.21.15.152:0/92475083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa97b60 msgr2=0x55f4daa9fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5291fc7640 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa97b60 0x55f4daa9fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5291fc7640 1 -- 172.21.15.152:0/92475083 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4da76e6a0 con 0x55f4daaa2d40 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5291fc7640 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daaa2d40 0x55f4daaa06e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f5284006010 tx=0x7f5284005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbee251eefd90a0b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5274ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5274ff9640 1 -- 172.21.15.152:0/92475083 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284055020 con 0x55f4daaa2d40 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5274ff9640 1 -- 172.21.15.152:0/92475083 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f528402f6f0 con 0x55f4daaa2d40 2024-09-11T22:17:53.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5295e03740 1 -- 172.21.15.152:0/92475083 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5284036070 con 0x55f4daaa2d40 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5274ff9640 1 -- 172.21.15.152:0/92475083 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5284060050 con 0x55f4daaa2d40 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5295e03740 10 client.18840 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.915+0000 7f5295e03740 1 -- 172.21.15.152:0/92475083 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f4daaa5790 con 0x55f4daaa2d40 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.916+0000 7f5274ff9640 1 -- 172.21.15.152:0/92475083 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5284036070 con 0x55f4daaa2d40 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.916+0000 7f5274ff9640 1 -- 172.21.15.152:0/92475083 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f52840309a0 con 0x55f4daaa2d40 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.916+0000 7f5295e03740 10 client.18840 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.916+0000 7f5295e03740 10 client.18840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.916+0000 7f5295e03740 20 client.18840 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.916+0000 7f5295e03740 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4daab25a0 0x55f4daab4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.916+0000 7f5295e03740 4 client.18840 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.916+0000 7f5295e03740 1 -- 172.21.15.152:0/92475083 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4daa0a7f0 con 0x55f4daab25a0 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.916+0000 7f52917c6640 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4daab25a0 0x55f4daab4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.917+0000 7f52917c6640 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4daab25a0 0x55f4daab4990 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9b91e0de9e6a5be server_cookie=ab1fdbabc4a0fecb in_seq=0 out_seq=0 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.917+0000 7f5274ff9640 10 client.18840 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.917+0000 7f5274ff9640 1 -- 172.21.15.152:0/92475083 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4daa0a7f0 con 0x55f4daab25a0 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.917+0000 7f5274ff9640 10 client.18840 handle_command_reply: tid=0 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.917+0000 7f5295e03740 1 client.18840 shutdown 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.917+0000 7f5295e03740 1 -- 172.21.15.152:0/92475083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daaa2d40 msgr2=0x55f4daaa06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.917+0000 7f5295e03740 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daaa2d40 0x55f4daaa06e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f5284006010 tx=0x7f5284005d80 comp rx=0 tx=0).stop 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.917+0000 7f5295e03740 1 -- 172.21.15.152:0/92475083 shutdown_connections 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.917+0000 7f5295e03740 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4daab25a0 0x55f4daab4990 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.918+0000 7f5295e03740 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daaa2d40 0x55f4daaa06e0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.918+0000 7f5295e03740 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.918+0000 7f5295e03740 1 --2- 172.21.15.152:0/92475083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa97b60 0x55f4daa9fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.918+0000 7f5295e03740 1 -- 172.21.15.152:0/92475083 >> 172.21.15.152:0/92475083 conn(0x55f4daa940f0 msgr2=0x55f4daa93270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:53.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.918+0000 7f5274ff9640 0 client.18840 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:53.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.918+0000 7f5295e03740 1 -- 172.21.15.152:0/92475083 shutdown_connections 2024-09-11T22:17:53.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.918+0000 7f5295e03740 1 -- 172.21.15.152:0/92475083 wait complete. 2024-09-11T22:17:53.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.918+0000 7f5295e03740 20 client.18840 trim_cache size 0 max 16384 2024-09-11T22:17:53.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.935+0000 7f5295e03740 1 Processor -- start 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.935+0000 7f5295e03740 1 -- start start 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.935+0000 7f5295e03740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa940f0 0x55f4daaa0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.935+0000 7f5295e03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.935+0000 7f5295e03740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa98480 0x55f4daaba780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.935+0000 7f5295e03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1b02d0 con 0x55f4daa97b60 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.935+0000 7f5295e03740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1adba0 con 0x55f4daa98480 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5295e03740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1aba10 con 0x55f4daa940f0 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5290fc5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5290fc5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaba240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35162/0 (socket says 172.21.15.152:35162) 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5290fc5640 1 -- 172.21.15.152:0/182062678 learned_addr learned my addr 172.21.15.152:0/182062678 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f52917c6640 1 --2- 172.21.15.152:0/182062678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa940f0 0x55f4daaa0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5291fc7640 1 --2- 172.21.15.152:0/182062678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa98480 0x55f4daaba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5290fc5640 1 -- 172.21.15.152:0/182062678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa940f0 msgr2=0x55f4daaa0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5290fc5640 1 --2- 172.21.15.152:0/182062678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa940f0 0x55f4daaa0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5290fc5640 1 -- 172.21.15.152:0/182062678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa98480 msgr2=0x55f4daaba780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5290fc5640 1 --2- 172.21.15.152:0/182062678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa98480 0x55f4daaba780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5290fc5640 1 -- 172.21.15.152:0/182062678 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4daa982b0 con 0x55f4daa97b60 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f52917c6640 1 --2- 172.21.15.152:0/182062678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa940f0 0x55f4daaa0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5290fc5640 1 --2- 172.21.15.152:0/182062678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaba240 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f527c010fd0 tx=0x7f527c00dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60136c21b62d824 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5276ffd640 1 -- 172.21.15.152:0/182062678 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c020040 con 0x55f4daa97b60 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5276ffd640 1 -- 172.21.15.152:0/182062678 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f527c009de0 con 0x55f4daa97b60 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.936+0000 7f5276ffd640 1 -- 172.21.15.152:0/182062678 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c09a950 con 0x55f4daa97b60 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.937+0000 7f5295e03740 1 -- 172.21.15.152:0/182062678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 msgr2=0x55f4daaba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.937+0000 7f5295e03740 1 --2- 172.21.15.152:0/182062678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaba240 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f527c010fd0 tx=0x7f527c00dfa0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.937+0000 7f5295e03740 1 -- 172.21.15.152:0/182062678 shutdown_connections 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.937+0000 7f5295e03740 1 --2- 172.21.15.152:0/182062678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa98480 0x55f4daaba780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.937+0000 7f5295e03740 1 --2- 172.21.15.152:0/182062678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaba240 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.937+0000 7f5295e03740 1 --2- 172.21.15.152:0/182062678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa940f0 0x55f4daaa0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.937+0000 7f5295e03740 1 -- 172.21.15.152:0/182062678 >> 172.21.15.152:0/182062678 conn(0x55f4daa94b70 msgr2=0x55f4daaa1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.937+0000 7f5295e03740 1 -- 172.21.15.152:0/182062678 shutdown_connections 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5295e03740 1 -- 172.21.15.152:0/182062678 wait complete. 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5295e03740 1 -- start start 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5295e03740 1 Processor -- start 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5295e03740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa940f0 0x55f4daaaab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5295e03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5295e03740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5295e03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1ac060 con 0x55f4daa97b60 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5295e03740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1ad4d0 con 0x55f4daa940f0 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5295e03740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1ac730 con 0x55f4daa98480 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5295e03740 10 client.0 _ll_register_callbacks cb 0x7f528404c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5290fc5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5290fc5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaab0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35176/0 (socket says 172.21.15.152:35176) 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.938+0000 7f5290fc5640 1 -- 172.21.15.152:0/2058728029 learned_addr learned my addr 172.21.15.152:0/2058728029 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5291fc7640 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f52917c6640 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa940f0 0x55f4daaaab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5290fc5640 1 -- 172.21.15.152:0/2058728029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 msgr2=0x55f4daaa7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5290fc5640 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5290fc5640 1 -- 172.21.15.152:0/2058728029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa940f0 msgr2=0x55f4daaaab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5290fc5640 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa940f0 0x55f4daaaab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5290fc5640 1 -- 172.21.15.152:0/2058728029 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4daaa8070 con 0x55f4daa97b60 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5290fc5640 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaab0a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f527c09b490 tx=0x7f527c09aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a2440373b7c928 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5274ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5274ff9640 1 -- 172.21.15.152:0/2058728029 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c020040 con 0x55f4daa97b60 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5274ff9640 1 -- 172.21.15.152:0/2058728029 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7f527c09ab50 con 0x55f4daa97b60 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5295e03740 1 -- 172.21.15.152:0/2058728029 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f527c009de0 con 0x55f4daa97b60 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5274ff9640 1 -- 172.21.15.152:0/2058728029 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f527c09f8b0 con 0x55f4daa97b60 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5295e03740 10 client.18846 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.939+0000 7f5295e03740 1 -- 172.21.15.152:0/2058728029 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f4dab21e10 con 0x55f4daa97b60 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.940+0000 7f5274ff9640 1 -- 172.21.15.152:0/2058728029 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f527c009de0 con 0x55f4daa97b60 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.940+0000 7f5274ff9640 1 -- 172.21.15.152:0/2058728029 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f527c010460 con 0x55f4daa97b60 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.940+0000 7f5295e03740 10 client.18846 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:53.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.940+0000 7f5295e03740 10 client.18846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.940+0000 7f5295e03740 20 client.18846 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.940+0000 7f5295e03740 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4daaa2d40 0x55f4dab24570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.940+0000 7f5295e03740 4 client.18846 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.940+0000 7f5295e03740 1 -- 172.21.15.152:0/2058728029 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f4daa04d00 con 0x55f4daaa2d40 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.940+0000 7f52917c6640 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4daaa2d40 0x55f4dab24570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.940+0000 7f5274ff9640 10 client.18846 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.940+0000 7f52917c6640 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4daaa2d40 0x55f4dab24570 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9951ed403e18fef5 server_cookie=115d1528a6bc2aab in_seq=0 out_seq=0 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.941+0000 7f5274ff9640 1 -- 172.21.15.152:0/2058728029 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f4daa04d00 con 0x55f4daaa2d40 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.941+0000 7f5274ff9640 10 client.18846 handle_command_reply: tid=0 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.941+0000 7f5295e03740 1 client.18846 shutdown 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5295e03740 1 -- 172.21.15.152:0/2058728029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 msgr2=0x55f4daaab0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5295e03740 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaab0a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f527c09b490 tx=0x7f527c09aee0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5295e03740 1 -- 172.21.15.152:0/2058728029 shutdown_connections 2024-09-11T22:17:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5295e03740 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f4daaa2d40 0x55f4dab24570 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5295e03740 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4daa98480 0x55f4daaa7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5274ff9640 0 client.18846 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5295e03740 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4daa97b60 0x55f4daaab0a0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5295e03740 1 --2- 172.21.15.152:0/2058728029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4daa940f0 0x55f4daaaab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5295e03740 1 -- 172.21.15.152:0/2058728029 >> 172.21.15.152:0/2058728029 conn(0x55f4daa94b70 msgr2=0x55f4daa92a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5295e03740 1 -- 172.21.15.152:0/2058728029 shutdown_connections 2024-09-11T22:17:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5295e03740 1 -- 172.21.15.152:0/2058728029 wait complete. 2024-09-11T22:17:53.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.942+0000 7f5295e03740 20 client.18846 trim_cache size 0 max 16384 2024-09-11T22:17:53.960 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:17:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:17:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "cfeb11e6-adbb-44d4-b62d-280928e25cde", 2024-09-11T22:17:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:17:53.961 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:17:53.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 -- 172.21.15.152:0/3482619500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f52780a2cf0 msgr2=0x7f52780a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:53.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f52780a2cf0 0x7f52780a51b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5284047000 tx=0x7f5284049000 comp rx=0 tx=0).stop 2024-09-11T22:17:53.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 -- 172.21.15.152:0/3482619500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f528c102790 msgr2=0x7f528c198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:53.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f528c102790 0x7f528c198930 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f527c00d950 tx=0x7f527c00de10 comp rx=0 tx=0).stop 2024-09-11T22:17:53.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 -- 172.21.15.152:0/3482619500 shutdown_connections 2024-09-11T22:17:53.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f52780a2cf0 0x7f52780a51b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f528c106f10 0x7f528c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f528c102790 0x7f528c198930 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 --2- 172.21.15.152:0/3482619500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f528c101de0 0x7f528c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:53.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 -- 172.21.15.152:0/3482619500 >> 172.21.15.152:0/3482619500 conn(0x7f528c0fd8c0 msgr2=0x7f528c0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:53.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 -- 172.21.15.152:0/3482619500 shutdown_connections 2024-09-11T22:17:53.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:53.943+0000 7f5293a2a640 1 -- 172.21.15.152:0/3482619500 wait complete. 2024-09-11T22:17:54.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:53 smithi179 ceph-mon[35603]: pgmap v425: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 24 MiB/s wr, 1.38k op/s 2024-09-11T22:17:54.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:53 smithi193 ceph-mon[35545]: pgmap v425: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 24 MiB/s wr, 1.38k op/s 2024-09-11T22:17:54.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:17:54.928 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:54 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:17:54.928 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:54 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:54.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:17:55.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:54 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:17:55.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:54 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:55.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:54 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:17:55.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:54 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:55.212 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:17:55.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.664+0000 7fa2916af640 1 -- 172.21.15.152:0/1668519427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa28c102ef0 msgr2=0x7fa28c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:55.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.664+0000 7fa2916af640 1 --2- 172.21.15.152:0/1668519427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa28c102ef0 0x7fa28c10da40 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa284009900 tx=0x7fa28402a480 comp rx=0 tx=0).stop 2024-09-11T22:17:55.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.664+0000 7fa2916af640 1 -- 172.21.15.152:0/1668519427 shutdown_connections 2024-09-11T22:17:55.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.664+0000 7fa2916af640 1 --2- 172.21.15.152:0/1668519427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa28c102ef0 0x7fa28c10da40 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.664+0000 7fa2916af640 1 --2- 172.21.15.152:0/1668519427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c102570 0x7fa28c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.664+0000 7fa2916af640 1 --2- 172.21.15.152:0/1668519427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa28c100e20 0x7fa28c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.664+0000 7fa2916af640 1 -- 172.21.15.152:0/1668519427 >> 172.21.15.152:0/1668519427 conn(0x7fa28c0fc7d0 msgr2=0x7fa28c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.664+0000 7fa2916af640 1 -- 172.21.15.152:0/1668519427 shutdown_connections 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.664+0000 7fa2916af640 1 -- 172.21.15.152:0/1668519427 wait complete. 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.664+0000 7fa2916af640 1 Processor -- start 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa2916af640 1 -- start start 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa2916af640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa28c100e20 0x7fa28c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa2916af640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa28c102570 0x7fa28c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa2916af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c102ef0 0x7fa28c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa2916af640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1120a0 con 0x7fa28c100e20 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa2916af640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c111f20 con 0x7fa28c102ef0 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa2916af640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c112220 con 0x7fa28c102570 2024-09-11T22:17:55.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa28affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa28c100e20 0x7fa28c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa28affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa28c100e20 0x7fa28c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35204/0 (socket says 172.21.15.152:35204) 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa28affd640 1 -- 172.21.15.152:0/4113179981 learned_addr learned my addr 172.21.15.152:0/4113179981 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa28a7fc640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa28c102570 0x7fa28c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c102ef0 0x7fa28c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa28affd640 1 -- 172.21.15.152:0/4113179981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa28c102570 msgr2=0x7fa28c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa28affd640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa28c102570 0x7fa28c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa28affd640 1 -- 172.21.15.152:0/4113179981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c102ef0 msgr2=0x7fa28c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa28affd640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c102ef0 0x7fa28c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa28affd640 1 -- 172.21.15.152:0/4113179981 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c19d3d0 con 0x7fa28c100e20 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.665+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c102ef0 0x7fa28c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.666+0000 7fa28affd640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa28c100e20 0x7fa28c198420 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00ea80 tx=0x7fa27c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:55.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.666+0000 7fa283fff640 1 -- 172.21.15.152:0/4113179981 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00ce40 con 0x7fa28c100e20 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.666+0000 7fa283fff640 1 -- 172.21.15.152:0/4113179981 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa27c005020 con 0x7fa28c100e20 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.666+0000 7fa2916af640 1 -- 172.21.15.152:0/4113179981 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28c19d6c0 con 0x7fa28c100e20 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.666+0000 7fa283fff640 1 -- 172.21.15.152:0/4113179981 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c011760 con 0x7fa28c100e20 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.666+0000 7fa2916af640 1 -- 172.21.15.152:0/4113179981 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28c1a4fa0 con 0x7fa28c100e20 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.668+0000 7fa283fff640 1 -- 172.21.15.152:0/4113179981 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa27c0051d0 con 0x7fa28c100e20 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.668+0000 7fa293a88740 1 Processor -- start 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.668+0000 7fa293a88740 1 -- start start 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa293a88740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218b380 0x55a02218b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa293a88740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218bca0 0x55a02219a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa293a88740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa293a88740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a0220f12e0 con 0x55a02219aa90 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa293a88740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a022098ce0 con 0x55a02218bca0 2024-09-11T22:17:55.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa293a88740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a0220ed2a0 con 0x55a02218b380 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28a7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa283fff640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa2780a2cf0 0x7fa2780a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28a7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35218/0 (socket says 172.21.15.152:35218) 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28a7fc640 1 -- 172.21.15.152:0/1695793872 learned_addr learned my addr 172.21.15.152:0/1695793872 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/1695793872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218b380 0x55a02218b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28affd640 1 --2- 172.21.15.152:0/1695793872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218bca0 0x55a02219a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28a7fc640 1 -- 172.21.15.152:0/1695793872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218b380 msgr2=0x55a02218b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa283fff640 1 -- 172.21.15.152:0/4113179981 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7fa27c0cfb80 con 0x7fa28c100e20 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28a7fc640 1 --2- 172.21.15.152:0/1695793872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218b380 0x55a02218b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28a7fc640 1 -- 172.21.15.152:0/1695793872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218bca0 msgr2=0x55a02219a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa2780a2cf0 0x7fa2780a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28a7fc640 1 --2- 172.21.15.152:0/1695793872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218bca0 0x55a02219a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28a7fc640 1 -- 172.21.15.152:0/1695793872 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a02207d440 con 0x55a02219aa90 2024-09-11T22:17:55.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28affd640 1 --2- 172.21.15.152:0/1695793872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218bca0 0x55a02219a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:55.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa28a7fc640 1 --2- 172.21.15.152:0/1695793872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219ce80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fa27400cc40 tx=0x7fa27400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43456647f59c04c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:55.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.669+0000 7fa2817fa640 1 -- 172.21.15.152:0/1695793872 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274014070 con 0x55a02219aa90 2024-09-11T22:17:55.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa2817fa640 1 -- 172.21.15.152:0/1695793872 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2740047a0 con 0x55a02219aa90 2024-09-11T22:17:55.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa2817fa640 1 -- 172.21.15.152:0/1695793872 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274010760 con 0x55a02219aa90 2024-09-11T22:17:55.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa293a88740 1 -- 172.21.15.152:0/1695793872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 msgr2=0x55a02219ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:55.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa293a88740 1 --2- 172.21.15.152:0/1695793872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219ce80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fa27400cc40 tx=0x7fa27400e720 comp rx=0 tx=0).stop 2024-09-11T22:17:55.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa2780a2cf0 0x7fa2780a51b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa284005c40 tx=0x7fa28402a480 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:55.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa293a88740 1 -- 172.21.15.152:0/1695793872 shutdown_connections 2024-09-11T22:17:55.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa293a88740 1 --2- 172.21.15.152:0/1695793872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219ce80 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa293a88740 1 --2- 172.21.15.152:0/1695793872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218bca0 0x55a02219a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa293a88740 1 --2- 172.21.15.152:0/1695793872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218b380 0x55a02218b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa293a88740 1 -- 172.21.15.152:0/1695793872 >> 172.21.15.152:0/1695793872 conn(0x55a022187a30 msgr2=0x55a022187e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa293a88740 1 -- 172.21.15.152:0/1695793872 shutdown_connections 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.670+0000 7fa293a88740 1 -- 172.21.15.152:0/1695793872 wait complete. 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa293a88740 1 -- start start 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa293a88740 1 Processor -- start 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa293a88740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218b380 0x55a02219a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa293a88740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218bca0 0x55a022197690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa293a88740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a022197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa293a88740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a02219d660 con 0x55a02219aa90 2024-09-11T22:17:55.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa293a88740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a0220ac050 con 0x55a02218b380 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa293a88740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a02219d7e0 con 0x55a02218bca0 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa293a88740 10 client.0 _ll_register_callbacks cb 0x55a0220ec160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a022197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a022197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35234/0 (socket says 172.21.15.152:35234) 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28b7fe640 1 -- 172.21.15.152:0/3259262333 learned_addr learned my addr 172.21.15.152:0/3259262333 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28affd640 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218b380 0x55a02219a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28a7fc640 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218bca0 0x55a022197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28b7fe640 1 -- 172.21.15.152:0/3259262333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218bca0 msgr2=0x55a022197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218bca0 0x55a022197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28b7fe640 1 -- 172.21.15.152:0/3259262333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218b380 msgr2=0x55a02219a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218b380 0x55a02219a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28b7fe640 1 -- 172.21.15.152:0/3259262333 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a021e623c0 con 0x55a02219aa90 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28a7fc640 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218bca0 0x55a022197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.671+0000 7fa28affd640 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218b380 0x55a02219a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a022197bf0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fa284005750 tx=0x7fa284009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec8d33dea289acf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa2727fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa2727fc640 1 -- 172.21.15.152:0/3259262333 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28404f060 con 0x55a02219aa90 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa2727fc640 1 -- 172.21.15.152:0/3259262333 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7fa2840037f0 con 0x55a02219aa90 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa293a88740 1 -- 172.21.15.152:0/3259262333 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2740047a0 con 0x55a02219aa90 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa2727fc640 1 -- 172.21.15.152:0/3259262333 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa284035040 con 0x55a02219aa90 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa293a88740 10 client.18858 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa293a88740 1 -- 172.21.15.152:0/3259262333 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a0221a90a0 con 0x55a02219aa90 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa2727fc640 1 -- 172.21.15.152:0/3259262333 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2740047a0 con 0x55a02219aa90 2024-09-11T22:17:55.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa2727fc640 1 -- 172.21.15.152:0/3259262333 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa284031b40 con 0x55a02219aa90 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa293a88740 10 client.18858 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa293a88740 10 client.18858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa293a88740 20 client.18858 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa293a88740 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a0221aa560 0x55a0221aca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa293a88740 4 client.18858 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.672+0000 7fa293a88740 1 -- 172.21.15.152:0/3259262333 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0220fe850 con 0x55a0221aa560 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.673+0000 7fa28affd640 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a0221aa560 0x55a0221aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.673+0000 7fa28affd640 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a0221aa560 0x55a0221aca20 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bb814c775d9df51 server_cookie=cf8c36203e3d6aa1 in_seq=0 out_seq=0 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.673+0000 7fa2727fc640 10 client.18858 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa2727fc640 1 -- 172.21.15.152:0/3259262333 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0220fe850 con 0x55a0221aa560 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa2727fc640 10 client.18858 handle_command_reply: tid=0 2024-09-11T22:17:55.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 1 client.18858 shutdown 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 1 -- 172.21.15.152:0/3259262333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 msgr2=0x55a022197bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a022197bf0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fa284005750 tx=0x7fa284009260 comp rx=0 tx=0).stop 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 1 -- 172.21.15.152:0/3259262333 shutdown_connections 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a0221aa560 0x55a0221aca20 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a022197bf0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218bca0 0x55a022197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 1 --2- 172.21.15.152:0/3259262333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218b380 0x55a02219a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 1 -- 172.21.15.152:0/3259262333 >> 172.21.15.152:0/3259262333 conn(0x55a022187a30 msgr2=0x55a02218d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa2727fc640 0 client.18858 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 1 -- 172.21.15.152:0/3259262333 shutdown_connections 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 1 -- 172.21.15.152:0/3259262333 wait complete. 2024-09-11T22:17:55.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.674+0000 7fa293a88740 20 client.18858 trim_cache size 0 max 16384 2024-09-11T22:17:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.691+0000 7fa293a88740 1 Processor -- start 2024-09-11T22:17:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.691+0000 7fa293a88740 1 -- start start 2024-09-11T22:17:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.691+0000 7fa293a88740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02218b380 0x55a0221a6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.691+0000 7fa293a88740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218bca0 0x55a0221b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.691+0000 7fa293a88740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02219aa90 0x55a0221b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.691+0000 7fa293a88740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1adfa0 con 0x55a02218b380 2024-09-11T22:17:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.691+0000 7fa293a88740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1ab870 con 0x55a02219aa90 2024-09-11T22:17:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.691+0000 7fa293a88740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1a96e0 con 0x55a02218bca0 2024-09-11T22:17:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02218b380 0x55a0221a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02218b380 0x55a0221a6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35248/0 (socket says 172.21.15.152:35248) 2024-09-11T22:17:55.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28affd640 1 -- 172.21.15.152:0/2051627335 learned_addr learned my addr 172.21.15.152:0/2051627335 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/2051627335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02219aa90 0x55a0221b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28a7fc640 1 --2- 172.21.15.152:0/2051627335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218bca0 0x55a0221b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28affd640 1 -- 172.21.15.152:0/2051627335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218bca0 msgr2=0x55a0221b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28affd640 1 --2- 172.21.15.152:0/2051627335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218bca0 0x55a0221b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28affd640 1 -- 172.21.15.152:0/2051627335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02219aa90 msgr2=0x55a0221b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28affd640 1 --2- 172.21.15.152:0/2051627335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02219aa90 0x55a0221b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28affd640 1 -- 172.21.15.152:0/2051627335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a02219a750 con 0x55a02218b380 2024-09-11T22:17:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/2051627335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02219aa90 0x55a0221b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:17:55.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa28affd640 1 --2- 172.21.15.152:0/2051627335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02218b380 0x55a0221a6930 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0984a0 tx=0x7fa27c06f0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20ec95ba9535e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa280ff9640 1 -- 172.21.15.152:0/2051627335 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c07ae60 con 0x55a02218b380 2024-09-11T22:17:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa280ff9640 1 -- 172.21.15.152:0/2051627335 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa27c0a4cb0 con 0x55a02218b380 2024-09-11T22:17:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.692+0000 7fa280ff9640 1 -- 172.21.15.152:0/2051627335 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c01f040 con 0x55a02218b380 2024-09-11T22:17:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.693+0000 7fa293a88740 1 -- 172.21.15.152:0/2051627335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02218b380 msgr2=0x55a0221a6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.693+0000 7fa293a88740 1 --2- 172.21.15.152:0/2051627335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02218b380 0x55a0221a6930 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0984a0 tx=0x7fa27c06f0b0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.693+0000 7fa293a88740 1 -- 172.21.15.152:0/2051627335 shutdown_connections 2024-09-11T22:17:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.693+0000 7fa293a88740 1 --2- 172.21.15.152:0/2051627335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02219aa90 0x55a0221b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.693+0000 7fa293a88740 1 --2- 172.21.15.152:0/2051627335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218bca0 0x55a0221b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.693+0000 7fa293a88740 1 --2- 172.21.15.152:0/2051627335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02218b380 0x55a0221a6930 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.693+0000 7fa293a88740 1 -- 172.21.15.152:0/2051627335 >> 172.21.15.152:0/2051627335 conn(0x55a022187a30 msgr2=0x55a022195f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:55.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.693+0000 7fa293a88740 1 -- 172.21.15.152:0/2051627335 shutdown_connections 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.693+0000 7fa293a88740 1 -- 172.21.15.152:0/2051627335 wait complete. 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.693+0000 7fa293a88740 1 -- start start 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.693+0000 7fa293a88740 1 Processor -- start 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa293a88740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218b380 0x55a02219e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa293a88740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218bca0 0x55a02219ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa293a88740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa293a88740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1a9d30 con 0x55a02219aa90 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa293a88740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1ab1a0 con 0x55a02218bca0 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa293a88740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1aa400 con 0x55a02218b380 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa293a88740 10 client.0 _ll_register_callbacks cb 0x7fa284041040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa28b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa28b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35260/0 (socket says 172.21.15.152:35260) 2024-09-11T22:17:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa28a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218bca0 0x55a02219ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa28b7fe640 1 -- 172.21.15.152:0/2447205069 learned_addr learned my addr 172.21.15.152:0/2447205069 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:17:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa28affd640 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218b380 0x55a02219e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa28b7fe640 1 -- 172.21.15.152:0/2447205069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218b380 msgr2=0x55a02219e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218b380 0x55a02219e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa28b7fe640 1 -- 172.21.15.152:0/2447205069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218bca0 msgr2=0x55a02219ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218bca0 0x55a02219ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa28b7fe640 1 -- 172.21.15.152:0/2447205069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0222142c0 con 0x55a02219aa90 2024-09-11T22:17:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa28b7fe640 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219f1d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa28402ac70 tx=0x7fa28403afb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661d65458f538794 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa2727fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:17:55.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.694+0000 7fa2727fc640 1 -- 172.21.15.152:0/2447205069 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28405f070 con 0x55a02219aa90 2024-09-11T22:17:55.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa2727fc640 1 -- 172.21.15.152:0/2447205069 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7fa284031740 con 0x55a02219aa90 2024-09-11T22:17:55.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa293a88740 1 -- 172.21.15.152:0/2447205069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa27c0a4cb0 con 0x55a02219aa90 2024-09-11T22:17:55.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa2727fc640 1 -- 172.21.15.152:0/2447205069 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa284068050 con 0x55a02219aa90 2024-09-11T22:17:55.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa293a88740 10 client.18864 fetch_fsmap learned FSMap version 30 2024-09-11T22:17:55.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa293a88740 1 -- 172.21.15.152:0/2447205069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a022215480 con 0x55a02219aa90 2024-09-11T22:17:55.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa2727fc640 1 -- 172.21.15.152:0/2447205069 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa27c0a4cb0 con 0x55a02219aa90 2024-09-11T22:17:55.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa2727fc640 1 -- 172.21.15.152:0/2447205069 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa284062020 con 0x55a02219aa90 2024-09-11T22:17:55.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa293a88740 10 client.18864 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:17:55.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa293a88740 10 client.18864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:17:55.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa293a88740 20 client.18864 populate_metadata read hostname 'smithi152' 2024-09-11T22:17:55.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa293a88740 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a022215b70 0x55a022217f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:55.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa293a88740 4 client.18864 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:17:55.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa293a88740 1 -- 172.21.15.152:0/2447205069 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0220f8d60 con 0x55a022215b70 2024-09-11T22:17:55.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.695+0000 7fa28affd640 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a022215b70 0x55a022217f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:55.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa28affd640 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a022215b70 0x55a022217f90 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3ca20cc47399ac2 server_cookie=5380bcb103c67a6a in_seq=0 out_seq=0 2024-09-11T22:17:55.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa2727fc640 10 client.18864 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:55.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa2727fc640 1 -- 172.21.15.152:0/2447205069 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a0220f8d60 con 0x55a022215b70 2024-09-11T22:17:55.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa2727fc640 10 client.18864 handle_command_reply: tid=0 2024-09-11T22:17:55.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 1 client.18864 shutdown 2024-09-11T22:17:55.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 1 -- 172.21.15.152:0/2447205069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 msgr2=0x55a02219f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:55.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219f1d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa28402ac70 tx=0x7fa28403afb0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 1 -- 172.21.15.152:0/2447205069 shutdown_connections 2024-09-11T22:17:55.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55a022215b70 0x55a022217f90 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a02219aa90 0x55a02219f1d0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a02218bca0 0x55a02219ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 1 --2- 172.21.15.152:0/2447205069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a02218b380 0x55a02219e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 1 -- 172.21.15.152:0/2447205069 >> 172.21.15.152:0/2447205069 conn(0x55a022187a30 msgr2=0x55a022198ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:55.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa2727fc640 0 client.18864 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:17:55.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 1 -- 172.21.15.152:0/2447205069 shutdown_connections 2024-09-11T22:17:55.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 1 -- 172.21.15.152:0/2447205069 wait complete. 2024-09-11T22:17:55.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.696+0000 7fa293a88740 20 client.18864 trim_cache size 0 max 16384 2024-09-11T22:17:55.707 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:17:55.707 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:17:55.707 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:17:55.708 INFO:teuthology.orchestra.run.smithi152.stdout: "cfeb11e6-adbb-44d4-b62d-280928e25cde": { 2024-09-11T22:17:55.708 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:17:55.708 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "cfeb11e6-adbb-44d4-b62d-280928e25cde", 2024-09-11T22:17:55.708 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:17:55.708 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:17:55.708 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:17:55.708 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:17:55.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 -- 172.21.15.152:0/4113179981 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa2780a2cf0 msgr2=0x7fa2780a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa2780a2cf0 0x7fa2780a51b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa284005c40 tx=0x7fa28402a480 comp rx=0 tx=0).stop 2024-09-11T22:17:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 -- 172.21.15.152:0/4113179981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa28c100e20 msgr2=0x7fa28c198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa28c100e20 0x7fa28c198420 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00ea80 tx=0x7fa27c00ef40 comp rx=0 tx=0).stop 2024-09-11T22:17:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 -- 172.21.15.152:0/4113179981 shutdown_connections 2024-09-11T22:17:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa2780a2cf0 0x7fa2780a51b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c102ef0 0x7fa28c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa28c102570 0x7fa28c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 --2- 172.21.15.152:0/4113179981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa28c100e20 0x7fa28c198420 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 -- 172.21.15.152:0/4113179981 >> 172.21.15.152:0/4113179981 conn(0x7fa28c0fc7d0 msgr2=0x7fa28c1067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 -- 172.21.15.152:0/4113179981 shutdown_connections 2024-09-11T22:17:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:17:55.697+0000 7fa2916af640 1 -- 172.21.15.152:0/4113179981 wait complete. 2024-09-11T22:17:55.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:55 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:17:55.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:55 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:55.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:55 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:17:55.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:55 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:55.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:55 smithi152 ceph-mon[31188]: pgmap v426: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 1.38k op/s 2024-09-11T22:17:56.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:55 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:17:56.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:55 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:56.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:55 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:17:56.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:55 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:56.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:55 smithi179 ceph-mon[35603]: pgmap v426: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 1.38k op/s 2024-09-11T22:17:56.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:55 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:17:56.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:55 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:56.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:55 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:17:56.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:55 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:17:56.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:55 smithi193 ceph-mon[35545]: pgmap v426: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 1.38k op/s 2024-09-11T22:17:56.420 INFO:tasks.cephfs.filesystem:scrub status for tag:cfeb11e6-adbb-44d4-b62d-280928e25cde - {'path': '/', 'tag': 'cfeb11e6-adbb-44d4-b62d-280928e25cde', 'options': 'recursive,force'} 2024-09-11T22:17:57.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:57 smithi152 ceph-mon[31188]: pgmap v427: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.3 MiB/s wr, 229 op/s 2024-09-11T22:17:58.069 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:57 smithi179 ceph-mon[35603]: pgmap v427: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.3 MiB/s wr, 229 op/s 2024-09-11T22:17:58.086 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:57 smithi193 ceph-mon[35545]: pgmap v427: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.3 MiB/s wr, 229 op/s 2024-09-11T22:17:59.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:17:59.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:17:59 smithi152 ceph-mon[31188]: pgmap v428: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.3 MiB/s wr, 332 op/s 2024-09-11T22:18:00.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:17:59 smithi179 ceph-mon[35603]: pgmap v428: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.3 MiB/s wr, 332 op/s 2024-09-11T22:18:00.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:17:59 smithi193 ceph-mon[35545]: pgmap v428: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.3 MiB/s wr, 332 op/s 2024-09-11T22:18:01.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:01 smithi152 ceph-mon[31188]: pgmap v429: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-09-11T22:18:02.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:01 smithi179 ceph-mon[35603]: pgmap v429: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-09-11T22:18:02.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:01 smithi193 ceph-mon[35545]: pgmap v429: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-09-11T22:18:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.323+0000 7fe3453f6640 1 -- 172.21.15.152:0/2279180016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3401009b0 msgr2=0x7fe340100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.323+0000 7fe3453f6640 1 --2- 172.21.15.152:0/2279180016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3401009b0 0x7fe340100e10 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe328009930 tx=0x7fe32802a420 comp rx=0 tx=0).stop 2024-09-11T22:18:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.323+0000 7fe3453f6640 1 -- 172.21.15.152:0/2279180016 shutdown_connections 2024-09-11T22:18:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.323+0000 7fe3453f6640 1 --2- 172.21.15.152:0/2279180016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe340101350 0x7fe34010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.323+0000 7fe3453f6640 1 --2- 172.21.15.152:0/2279180016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3401009b0 0x7fe340100e10 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.323+0000 7fe3453f6640 1 --2- 172.21.15.152:0/2279180016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3401069c0 0x7fe340106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.323+0000 7fe3453f6640 1 -- 172.21.15.152:0/2279180016 >> 172.21.15.152:0/2279180016 conn(0x7fe340077990 msgr2=0x7fe3400fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.323+0000 7fe3453f6640 1 -- 172.21.15.152:0/2279180016 shutdown_connections 2024-09-11T22:18:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.323+0000 7fe3453f6640 1 -- 172.21.15.152:0/2279180016 wait complete. 2024-09-11T22:18:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe3453f6640 1 Processor -- start 2024-09-11T22:18:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe3453f6640 1 -- start start 2024-09-11T22:18:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe3453f6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3401009b0 0x7fe340198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe3453f6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe340101350 0x7fe3401988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe3453f6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3401069c0 0x7fe34019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe3453f6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe340111f00 con 0x7fe340101350 2024-09-11T22:18:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe3453f6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe340111d80 con 0x7fe3401009b0 2024-09-11T22:18:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe3453f6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe340112080 con 0x7fe3401069c0 2024-09-11T22:18:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe33e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe340101350 0x7fe3401988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe33e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe340101350 0x7fe3401988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35282/0 (socket says 172.21.15.152:35282) 2024-09-11T22:18:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe33e7fc640 1 -- 172.21.15.152:0/87883048 learned_addr learned my addr 172.21.15.152:0/87883048 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.324+0000 7fe33effd640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3401009b0 0x7fe340198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3401069c0 0x7fe34019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe33e7fc640 1 -- 172.21.15.152:0/87883048 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3401069c0 msgr2=0x7fe34019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3401069c0 0x7fe34019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe33e7fc640 1 -- 172.21.15.152:0/87883048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3401009b0 msgr2=0x7fe340198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3401009b0 0x7fe340198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe33e7fc640 1 -- 172.21.15.152:0/87883048 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34019d370 con 0x7fe340101350 2024-09-11T22:18:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3401069c0 0x7fe34019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe340101350 0x7fe3401988c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe32802a940 tx=0x7fe328003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe337fff640 1 -- 172.21.15.152:0/87883048 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32803f070 con 0x7fe340101350 2024-09-11T22:18:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe337fff640 1 -- 172.21.15.152:0/87883048 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe328031c90 con 0x7fe340101350 2024-09-11T22:18:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe3453f6640 1 -- 172.21.15.152:0/87883048 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34019d600 con 0x7fe340101350 2024-09-11T22:18:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe337fff640 1 -- 172.21.15.152:0/87883048 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328035030 con 0x7fe340101350 2024-09-11T22:18:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.325+0000 7fe3453f6640 1 -- 172.21.15.152:0/87883048 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3401a4ef0 con 0x7fe340101350 2024-09-11T22:18:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.327+0000 7fe337fff640 1 -- 172.21.15.152:0/87883048 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe328042070 con 0x7fe340101350 2024-09-11T22:18:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.328+0000 7fe34826c740 1 Processor -- start 2024-09-11T22:18:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.328+0000 7fe34826c740 1 -- start start 2024-09-11T22:18:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.328+0000 7fe34826c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 0x559f8bc29ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.328+0000 7fe34826c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc2a410 0x559f8bc34770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.328+0000 7fe34826c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc370a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.328+0000 7fe34826c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559f8bb8e2f0 con 0x559f8bc34cb0 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.328+0000 7fe34826c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559f8bb36270 con 0x559f8bc29af0 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.328+0000 7fe34826c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559f8bb8a2b0 con 0x559f8bc2a410 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.328+0000 7fe337fff640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe32c0a2da0 0x7fe32c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.328+0000 7fe33e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc370a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35296/0 (socket says 172.21.15.152:35296) 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 0x559f8bc29ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33e7fc640 1 -- 172.21.15.152:0/1221733358 learned_addr learned my addr 172.21.15.152:0/1221733358 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33effd640 1 --2- 172.21.15.152:0/1221733358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc2a410 0x559f8bc34770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe32c0a2da0 0x7fe32c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe337fff640 1 -- 172.21.15.152:0/87883048 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7fe3280efc50 con 0x7fe340101350 2024-09-11T22:18:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33e7fc640 1 -- 172.21.15.152:0/1221733358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc2a410 msgr2=0x559f8bc34770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/1221733358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc2a410 0x559f8bc34770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33e7fc640 1 -- 172.21.15.152:0/1221733358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 msgr2=0x559f8bc29ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/1221733358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 0x559f8bc29ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33e7fc640 1 -- 172.21.15.152:0/1221733358 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8bb35340 con 0x559f8bc34cb0 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/1221733358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 0x559f8bc29ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/1221733358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc370a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe3280b8ae0 tx=0x7fe3280bc010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24291afe7cb2b175 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe32c0a2da0 0x7fe32c0a5260 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe338005d50 tx=0x7fe338005ce0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe3357fa640 1 -- 172.21.15.152:0/1221733358 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328049070 con 0x559f8bc34cb0 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe3357fa640 1 -- 172.21.15.152:0/1221733358 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3280bc810 con 0x559f8bc34cb0 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.329+0000 7fe3357fa640 1 -- 172.21.15.152:0/1221733358 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3280ed5c0 con 0x559f8bc34cb0 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.330+0000 7fe34826c740 1 -- 172.21.15.152:0/1221733358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 msgr2=0x559f8bc370a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.330+0000 7fe34826c740 1 --2- 172.21.15.152:0/1221733358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc370a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe3280b8ae0 tx=0x7fe3280bc010 comp rx=0 tx=0).stop 2024-09-11T22:18:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.330+0000 7fe34826c740 1 -- 172.21.15.152:0/1221733358 shutdown_connections 2024-09-11T22:18:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.330+0000 7fe34826c740 1 --2- 172.21.15.152:0/1221733358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc370a0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.330+0000 7fe34826c740 1 --2- 172.21.15.152:0/1221733358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc2a410 0x559f8bc34770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.330+0000 7fe34826c740 1 --2- 172.21.15.152:0/1221733358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 0x559f8bc29ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.330+0000 7fe34826c740 1 -- 172.21.15.152:0/1221733358 >> 172.21.15.152:0/1221733358 conn(0x559f8bc26060 msgr2=0x559f8bc26440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.330+0000 7fe34826c740 1 -- 172.21.15.152:0/1221733358 shutdown_connections 2024-09-11T22:18:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.330+0000 7fe34826c740 1 -- 172.21.15.152:0/1221733358 wait complete. 2024-09-11T22:18:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe34826c740 1 -- start start 2024-09-11T22:18:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe34826c740 1 Processor -- start 2024-09-11T22:18:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe34826c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc29af0 0x559f8bc31b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe34826c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 0x559f8bc320d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe34826c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc34cb0 0x559f8bc32610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe34826c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559f8bc37640 con 0x559f8bc29af0 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe34826c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559f8bb17290 con 0x559f8bc2a410 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe34826c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559f8bc377c0 con 0x559f8bc34cb0 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe34826c740 10 client.0 _ll_register_callbacks cb 0x559f8bb48140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe33effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc29af0 0x559f8bc31b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe33effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc29af0 0x559f8bc31b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35304/0 (socket says 172.21.15.152:35304) 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe33effd640 1 -- 172.21.15.152:0/2307209069 learned_addr learned my addr 172.21.15.152:0/2307209069 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 0x559f8bc320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc34cb0 0x559f8bc32610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe33effd640 1 -- 172.21.15.152:0/2307209069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc34cb0 msgr2=0x559f8bc32610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe33effd640 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc34cb0 0x559f8bc32610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe33effd640 1 -- 172.21.15.152:0/2307209069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 msgr2=0x559f8bc320d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe33effd640 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 0x559f8bc320d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe33effd640 1 -- 172.21.15.152:0/2307209069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f8b8a1210 con 0x559f8bc29af0 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.331+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 0x559f8bc320d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe33effd640 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc29af0 0x559f8bc31b90 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe330011770 tx=0x7fe330011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff705df056b2ead server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe3267fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe3267fc640 1 -- 172.21.15.152:0/2307209069 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330010ba0 con 0x559f8bc29af0 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe3267fc640 1 -- 172.21.15.152:0/2307209069 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7fe330010d40 con 0x559f8bc29af0 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe34826c740 1 -- 172.21.15.152:0/2307209069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3280bc810 con 0x559f8bc29af0 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe3267fc640 1 -- 172.21.15.152:0/2307209069 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe33001b420 con 0x559f8bc29af0 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe34826c740 10 client.18876 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe34826c740 1 -- 172.21.15.152:0/2307209069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559f8b96d620 con 0x559f8bc29af0 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe3267fc640 1 -- 172.21.15.152:0/2307209069 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3280bc810 con 0x559f8bc29af0 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe3267fc640 1 -- 172.21.15.152:0/2307209069 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe33001a6f0 con 0x559f8bc29af0 2024-09-11T22:18:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe34826c740 10 client.18876 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe34826c740 10 client.18876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe34826c740 20 client.18876 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe34826c740 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559f8bc449e0 0x559f8bc46e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe34826c740 4 client.18876 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.332+0000 7fe34826c740 1 -- 172.21.15.152:0/2307209069 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f8bb9ba20 con 0x559f8bc449e0 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.333+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559f8bc449e0 0x559f8bc46e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.333+0000 7fe3267fc640 10 client.18876 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.333+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559f8bc449e0 0x559f8bc46e30 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcf2c464d8b049cb server_cookie=85039b204b6e8b3b in_seq=0 out_seq=0 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe3267fc640 1 -- 172.21.15.152:0/2307209069 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f8bb9ba20 con 0x559f8bc449e0 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe3267fc640 10 client.18876 handle_command_reply: tid=0 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 1 client.18876 shutdown 2024-09-11T22:18:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 1 -- 172.21.15.152:0/2307209069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc29af0 msgr2=0x559f8bc31b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc29af0 0x559f8bc31b90 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe330011770 tx=0x7fe330011c30 comp rx=0 tx=0).stop 2024-09-11T22:18:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 1 -- 172.21.15.152:0/2307209069 shutdown_connections 2024-09-11T22:18:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559f8bc449e0 0x559f8bc46e30 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc34cb0 0x559f8bc32610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 0x559f8bc320d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 1 --2- 172.21.15.152:0/2307209069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc29af0 0x559f8bc31b90 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe3267fc640 0 client.18876 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 1 -- 172.21.15.152:0/2307209069 >> 172.21.15.152:0/2307209069 conn(0x559f8bc26060 msgr2=0x559f8bc2bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 1 -- 172.21.15.152:0/2307209069 shutdown_connections 2024-09-11T22:18:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 1 -- 172.21.15.152:0/2307209069 wait complete. 2024-09-11T22:18:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.334+0000 7fe34826c740 20 client.18876 trim_cache size 0 max 16384 2024-09-11T22:18:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.348+0000 7fe34826c740 1 Processor -- start 2024-09-11T22:18:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe34826c740 1 -- start start 2024-09-11T22:18:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe34826c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc29af0 0x559f8bc32440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe34826c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 0x559f8bc4c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe34826c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc4cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe34826c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe3401b0200 con 0x559f8bc34cb0 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe34826c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3401adad0 con 0x559f8bc2a410 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe34826c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3401ab940 con 0x559f8bc29af0 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe33f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc4cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe33f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc4cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35320/0 (socket says 172.21.15.152:35320) 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe33f7fe640 1 -- 172.21.15.152:0/3573005618 learned_addr learned my addr 172.21.15.152:0/3573005618 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe33effd640 1 --2- 172.21.15.152:0/3573005618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc29af0 0x559f8bc32440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/3573005618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 0x559f8bc4c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe33f7fe640 1 -- 172.21.15.152:0/3573005618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc29af0 msgr2=0x559f8bc32440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/3573005618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc29af0 0x559f8bc32440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe33f7fe640 1 -- 172.21.15.152:0/3573005618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 msgr2=0x559f8bc4c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/3573005618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 0x559f8bc4c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe33f7fe640 1 -- 172.21.15.152:0/3573005618 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8bc29920 con 0x559f8bc34cb0 2024-09-11T22:18:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.349+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/3573005618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 0x559f8bc4c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/3573005618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc4cc80 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe338013930 tx=0x7fe33800e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af25247b226a3d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe334ff9640 1 -- 172.21.15.152:0/3573005618 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338010dc0 con 0x559f8bc34cb0 2024-09-11T22:18:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe334ff9640 1 -- 172.21.15.152:0/3573005618 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe33801dde0 con 0x559f8bc34cb0 2024-09-11T22:18:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe334ff9640 1 -- 172.21.15.152:0/3573005618 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338004a00 con 0x559f8bc34cb0 2024-09-11T22:18:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe34826c740 1 -- 172.21.15.152:0/3573005618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 msgr2=0x559f8bc4cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe34826c740 1 --2- 172.21.15.152:0/3573005618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc4cc80 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe338013930 tx=0x7fe33800e430 comp rx=0 tx=0).stop 2024-09-11T22:18:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe34826c740 1 -- 172.21.15.152:0/3573005618 shutdown_connections 2024-09-11T22:18:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe34826c740 1 --2- 172.21.15.152:0/3573005618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc4cc80 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe34826c740 1 --2- 172.21.15.152:0/3573005618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc2a410 0x559f8bc4c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe34826c740 1 --2- 172.21.15.152:0/3573005618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc29af0 0x559f8bc32440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe34826c740 1 -- 172.21.15.152:0/3573005618 >> 172.21.15.152:0/3573005618 conn(0x559f8bc26060 msgr2=0x559f8bc33c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe34826c740 1 -- 172.21.15.152:0/3573005618 shutdown_connections 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.350+0000 7fe34826c740 1 -- 172.21.15.152:0/3573005618 wait complete. 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe34826c740 1 -- start start 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe34826c740 1 Processor -- start 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe34826c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 0x559f8bc3ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe34826c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc2a410 0x559f8bc3cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe34826c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc399e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe34826c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe3401abf90 con 0x559f8bc34cb0 2024-09-11T22:18:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe34826c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3401ad400 con 0x559f8bc29af0 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe34826c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3401ac660 con 0x559f8bc2a410 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe34826c740 10 client.0 _ll_register_callbacks cb 0x7fe330009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe33f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe33f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc399e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35336/0 (socket says 172.21.15.152:35336) 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe33f7fe640 1 -- 172.21.15.152:0/4089488673 learned_addr learned my addr 172.21.15.152:0/4089488673 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe33effd640 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 0x559f8bc3ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe33e7fc640 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc2a410 0x559f8bc3cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe33f7fe640 1 -- 172.21.15.152:0/4089488673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc2a410 msgr2=0x559f8bc3cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc2a410 0x559f8bc3cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe33f7fe640 1 -- 172.21.15.152:0/4089488673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 msgr2=0x559f8bc3ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 0x559f8bc3ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe33f7fe640 1 -- 172.21.15.152:0/4089488673 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f8bc408a0 con 0x559f8bc34cb0 2024-09-11T22:18:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.351+0000 7fe33effd640 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 0x559f8bc3ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe33f7fe640 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc399e0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fe33800eef0 tx=0x7fe338005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6c2a4bc6ea8258 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe3267fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe3267fc640 1 -- 172.21.15.152:0/4089488673 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338013640 con 0x559f8bc34cb0 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe3267fc640 1 -- 172.21.15.152:0/4089488673 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8614+0+0 (secure 0 0 0) 0x7fe338023040 con 0x559f8bc34cb0 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe34826c740 1 -- 172.21.15.152:0/4089488673 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe33801dde0 con 0x559f8bc34cb0 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe3267fc640 1 -- 172.21.15.152:0/4089488673 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe3380046c0 con 0x559f8bc34cb0 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe34826c740 10 client.18882 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe34826c740 1 -- 172.21.15.152:0/4089488673 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559f8bcafbe0 con 0x559f8bc34cb0 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe3267fc640 1 -- 172.21.15.152:0/4089488673 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe33801dde0 con 0x559f8bc34cb0 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe3267fc640 1 -- 172.21.15.152:0/4089488673 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe338031070 con 0x559f8bc34cb0 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe34826c740 10 client.18882 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe34826c740 10 client.18882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe34826c740 20 client.18882 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe34826c740 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559f8bcb0240 0x559f8bcb2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe34826c740 4 client.18882 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:18:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.352+0000 7fe34826c740 1 -- 172.21.15.152:0/4089488673 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559f8bb95d70 con 0x559f8bcb0240 2024-09-11T22:18:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.353+0000 7fe33effd640 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559f8bcb0240 0x559f8bcb2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.353+0000 7fe33effd640 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559f8bcb0240 0x559f8bcb2630 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=920984f715cd35bd server_cookie=72c6e38cf3f0ed7 in_seq=0 out_seq=0 2024-09-11T22:18:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:02.353+0000 7fe3267fc640 10 client.18882 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.826+0000 7fe3267fc640 1 -- 172.21.15.152:0/4089488673 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f8bb95d70 con 0x559f8bcb0240 2024-09-11T22:18:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.826+0000 7fe3267fc640 10 client.18882 handle_command_reply: tid=0 2024-09-11T22:18:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.826+0000 7fe34826c740 1 client.18882 shutdown 2024-09-11T22:18:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe34826c740 1 -- 172.21.15.152:0/4089488673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 msgr2=0x559f8bc399e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe34826c740 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc399e0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fe33800eef0 tx=0x7fe338005620 comp rx=0 tx=0).stop 2024-09-11T22:18:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe34826c740 1 -- 172.21.15.152:0/4089488673 shutdown_connections 2024-09-11T22:18:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe34826c740 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x559f8bcb0240 0x559f8bcb2630 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe34826c740 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559f8bc34cb0 0x559f8bc399e0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe34826c740 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f8bc2a410 0x559f8bc3cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe34826c740 1 --2- 172.21.15.152:0/4089488673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f8bc29af0 0x559f8bc3ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe3267fc640 0 client.18882 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe34826c740 1 -- 172.21.15.152:0/4089488673 >> 172.21.15.152:0/4089488673 conn(0x559f8bc26060 msgr2=0x559f8bc249a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe34826c740 1 -- 172.21.15.152:0/4089488673 shutdown_connections 2024-09-11T22:18:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe34826c740 1 -- 172.21.15.152:0/4089488673 wait complete. 2024-09-11T22:18:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.827+0000 7fe34826c740 20 client.18882 trim_cache size 0 max 16384 2024-09-11T22:18:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:18:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:18:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:18:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:18:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 -- 172.21.15.152:0/87883048 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe32c0a2da0 msgr2=0x7fe32c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe32c0a2da0 0x7fe32c0a5260 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe338005d50 tx=0x7fe338005ce0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 -- 172.21.15.152:0/87883048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe340101350 msgr2=0x7fe3401988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe340101350 0x7fe3401988c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe32802a940 tx=0x7fe328003b90 comp rx=0 tx=0).stop 2024-09-11T22:18:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 -- 172.21.15.152:0/87883048 shutdown_connections 2024-09-11T22:18:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe32c0a2da0 0x7fe32c0a5260 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3401069c0 0x7fe34019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe340101350 0x7fe3401988c0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 --2- 172.21.15.152:0/87883048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3401009b0 0x7fe340198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 -- 172.21.15.152:0/87883048 >> 172.21.15.152:0/87883048 conn(0x7fe340077990 msgr2=0x7fe3401037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 -- 172.21.15.152:0/87883048 shutdown_connections 2024-09-11T22:18:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:03.828+0000 7fe3453f6640 1 -- 172.21.15.152:0/87883048 wait complete. 2024-09-11T22:18:03.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:03 smithi152 ceph-mon[31188]: pgmap v430: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-09-11T22:18:04.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:03 smithi179 ceph-mon[35603]: pgmap v430: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-09-11T22:18:04.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:03 smithi193 ceph-mon[35545]: pgmap v430: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-09-11T22:18:04.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:18:05.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:04 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:18:05.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:04 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:18:05.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:04 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:18:05.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:04 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:18:05.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:04 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:18:05.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:04 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:18:06.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:05 smithi179 ceph-mon[35603]: osdmap e100: 12 total, 12 up, 12 in 2024-09-11T22:18:06.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:05 smithi179 ceph-mon[35603]: pgmap v432: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-09-11T22:18:06.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:05 smithi193 ceph-mon[35545]: osdmap e100: 12 total, 12 up, 12 in 2024-09-11T22:18:06.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:05 smithi193 ceph-mon[35545]: pgmap v432: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-09-11T22:18:06.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:05 smithi152 ceph-mon[31188]: osdmap e100: 12 total, 12 up, 12 in 2024-09-11T22:18:06.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:05 smithi152 ceph-mon[31188]: pgmap v432: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-09-11T22:18:07.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:07 smithi152 ceph-mon[31188]: pgmap v433: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-09-11T22:18:08.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:07 smithi179 ceph-mon[35603]: pgmap v433: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-09-11T22:18:08.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:07 smithi193 ceph-mon[35545]: pgmap v433: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-09-11T22:18:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:18:09.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:09 smithi152 ceph-mon[31188]: pgmap v434: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 489 KiB/s wr, 75 op/s 2024-09-11T22:18:10.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:09 smithi179 ceph-mon[35603]: pgmap v434: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 489 KiB/s wr, 75 op/s 2024-09-11T22:18:10.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:09 smithi193 ceph-mon[35545]: pgmap v434: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 489 KiB/s wr, 75 op/s 2024-09-11T22:18:11.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:11 smithi152 ceph-mon[31188]: pgmap v435: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 66 KiB/s wr, 30 op/s 2024-09-11T22:18:12.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:11 smithi179 ceph-mon[35603]: pgmap v435: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 66 KiB/s wr, 30 op/s 2024-09-11T22:18:12.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:11 smithi193 ceph-mon[35545]: pgmap v435: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 66 KiB/s wr, 30 op/s 2024-09-11T22:18:13.440 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:18:13.701 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:13.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:13 smithi152 ceph-mon[31188]: pgmap v436: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-09-11T22:18:14.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:13 smithi179 ceph-mon[35603]: pgmap v436: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-09-11T22:18:14.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:13 smithi193 ceph-mon[35545]: pgmap v436: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-09-11T22:18:14.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.171+0000 7f90ed1b6640 1 -- 172.21.15.152:0/2143567684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90e8101de0 msgr2=0x7f90e81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:14.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.171+0000 7f90ed1b6640 1 --2- 172.21.15.152:0/2143567684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90e8101de0 0x7f90e81021c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009900 tx=0x7f90d802a410 comp rx=0 tx=0).stop 2024-09-11T22:18:14.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.171+0000 7f90ed1b6640 1 -- 172.21.15.152:0/2143567684 shutdown_connections 2024-09-11T22:18:14.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.171+0000 7f90ed1b6640 1 --2- 172.21.15.152:0/2143567684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e8106f10 0x7f90e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.171+0000 7f90ed1b6640 1 --2- 172.21.15.152:0/2143567684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e8102790 0x7f90e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.171+0000 7f90ed1b6640 1 --2- 172.21.15.152:0/2143567684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90e8101de0 0x7f90e81021c0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.171+0000 7f90ed1b6640 1 -- 172.21.15.152:0/2143567684 >> 172.21.15.152:0/2143567684 conn(0x7f90e80fd8c0 msgr2=0x7f90e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:14.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.171+0000 7f90ed1b6640 1 -- 172.21.15.152:0/2143567684 shutdown_connections 2024-09-11T22:18:14.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.171+0000 7f90ed1b6640 1 -- 172.21.15.152:0/2143567684 wait complete. 2024-09-11T22:18:14.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.172+0000 7f90ed1b6640 1 Processor -- start 2024-09-11T22:18:14.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.172+0000 7f90ed1b6640 1 -- start start 2024-09-11T22:18:14.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90ed1b6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90e8101de0 0x7f90e81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:14.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90ed1b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e8102790 0x7f90e8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:14.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90ed1b6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e8106f10 0x7f90e819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:14.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90ed1b6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f90e8111f70 con 0x7f90e8101de0 2024-09-11T22:18:14.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90ed1b6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f90e8111df0 con 0x7f90e8106f10 2024-09-11T22:18:14.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90ed1b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f90e81120f0 con 0x7f90e8102790 2024-09-11T22:18:14.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90e6d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90e8101de0 0x7f90e81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:14.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90e6d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90e8101de0 0x7f90e81984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53144/0 (socket says 172.21.15.152:53144) 2024-09-11T22:18:14.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90e6d9d640 1 -- 172.21.15.152:0/4043731809 learned_addr learned my addr 172.21.15.152:0/4043731809 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:14.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90e759e640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e8106f10 0x7f90e819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:14.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90e659c640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e8102790 0x7f90e8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:14.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90e6d9d640 1 -- 172.21.15.152:0/4043731809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e8102790 msgr2=0x7f90e8198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:14.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90e6d9d640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e8102790 0x7f90e8198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90e6d9d640 1 -- 172.21.15.152:0/4043731809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e8106f10 msgr2=0x7f90e819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:14.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90e6d9d640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e8106f10 0x7f90e819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90e6d9d640 1 -- 172.21.15.152:0/4043731809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e819d480 con 0x7f90e8101de0 2024-09-11T22:18:14.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90e6d9d640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90e8101de0 0x7f90e81984d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f90d8006010 tx=0x7f90d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:14.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90cffff640 1 -- 172.21.15.152:0/4043731809 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d803f030 con 0x7f90e8101de0 2024-09-11T22:18:14.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90cffff640 1 -- 172.21.15.152:0/4043731809 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90d8003ce0 con 0x7f90e8101de0 2024-09-11T22:18:14.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90ed1b6640 1 -- 172.21.15.152:0/4043731809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e819d710 con 0x7f90e8101de0 2024-09-11T22:18:14.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.173+0000 7f90cffff640 1 -- 172.21.15.152:0/4043731809 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8035070 con 0x7f90e8101de0 2024-09-11T22:18:14.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.174+0000 7f90ed1b6640 1 -- 172.21.15.152:0/4043731809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e81a5050 con 0x7f90e8101de0 2024-09-11T22:18:14.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.174+0000 7f90ed1b6640 1 -- 172.21.15.152:0/4043731809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e81021c0 con 0x7f90e8101de0 2024-09-11T22:18:14.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.176+0000 7f90cffff640 1 -- 172.21.15.152:0/4043731809 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f90d8042030 con 0x7f90e8101de0 2024-09-11T22:18:14.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.176+0000 7f90cffff640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90d00a2cf0 0x7f90d00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:14.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.176+0000 7f90e659c640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90d00a2cf0 0x7f90d00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:14.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.176+0000 7f90cffff640 1 -- 172.21.15.152:0/4043731809 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f90d80efd20 con 0x7f90e8101de0 2024-09-11T22:18:14.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.177+0000 7f90e659c640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90d00a2cf0 0x7f90d00a51b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f90e80ff840 tx=0x7f90dc00b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:14.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.179+0000 7f90cffff640 1 -- 172.21.15.152:0/4043731809 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90d80bc350 con 0x7f90e8101de0 2024-09-11T22:18:14.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.385+0000 7f90ed1b6640 1 -- 172.21.15.152:0/4043731809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90e810a0f0 con 0x7f90e8101de0 2024-09-11T22:18:14.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.386+0000 7f90cffff640 1 -- 172.21.15.152:0/4043731809 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f90d80dae20 con 0x7f90e8101de0 2024-09-11T22:18:14.387 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:18:14.387 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:18:14.388 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:18:14.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.388+0000 7f90ed1b6640 1 -- 172.21.15.152:0/4043731809 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90d00a2cf0 msgr2=0x7f90d00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:14.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.388+0000 7f90ed1b6640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90d00a2cf0 0x7f90d00a51b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f90e80ff840 tx=0x7f90dc00b390 comp rx=0 tx=0).stop 2024-09-11T22:18:14.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.388+0000 7f90ed1b6640 1 -- 172.21.15.152:0/4043731809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90e8101de0 msgr2=0x7f90e81984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:14.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.388+0000 7f90ed1b6640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90e8101de0 0x7f90e81984d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f90d8006010 tx=0x7f90d80042f0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.388+0000 7f90ed1b6640 1 -- 172.21.15.152:0/4043731809 shutdown_connections 2024-09-11T22:18:14.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.388+0000 7f90ed1b6640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f90d00a2cf0 0x7f90d00a51b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.388+0000 7f90ed1b6640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e8106f10 0x7f90e819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.388+0000 7f90ed1b6640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e8102790 0x7f90e8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.389+0000 7f90ed1b6640 1 --2- 172.21.15.152:0/4043731809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90e8101de0 0x7f90e81984d0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.389+0000 7f90ed1b6640 1 -- 172.21.15.152:0/4043731809 >> 172.21.15.152:0/4043731809 conn(0x7f90e80fd8c0 msgr2=0x7f90e80fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:14.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.389+0000 7f90ed1b6640 1 -- 172.21.15.152:0/4043731809 shutdown_connections 2024-09-11T22:18:14.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:14.389+0000 7f90ed1b6640 1 -- 172.21.15.152:0/4043731809 wait complete. 2024-09-11T22:18:14.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:18:15.092 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:15 smithi152 ceph-mon[31188]: osdmap e101: 12 total, 12 up, 12 in 2024-09-11T22:18:15.092 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:15 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/4043731809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:15.094 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id cad1d1c0 --release --await' 2024-09-11T22:18:15.094 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id cad1d1c0 --release --await 2024-09-11T22:18:15.343 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:15.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:15 smithi179 ceph-mon[35603]: osdmap e101: 12 total, 12 up, 12 in 2024-09-11T22:18:15.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:15 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/4043731809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:15.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:15 smithi193 ceph-mon[35545]: osdmap e101: 12 total, 12 up, 12 in 2024-09-11T22:18:15.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:15 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/4043731809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:15.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.813+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/16803677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4e0100e20 msgr2=0x7ff4e0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.813+0000 7ff4e6ffe640 1 --2- 172.21.15.152:0/16803677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4e0100e20 0x7ff4e0101200 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0009ca0 tx=0x7ff4d002a950 comp rx=0 tx=0).stop 2024-09-11T22:18:15.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.813+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/16803677 shutdown_connections 2024-09-11T22:18:15.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.813+0000 7ff4e6ffe640 1 --2- 172.21.15.152:0/16803677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e0102ef0 0x7ff4e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.813+0000 7ff4e6ffe640 1 --2- 172.21.15.152:0/16803677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4e0102570 0x7ff4e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.813+0000 7ff4e6ffe640 1 --2- 172.21.15.152:0/16803677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4e0100e20 0x7ff4e0101200 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.813+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/16803677 >> 172.21.15.152:0/16803677 conn(0x7ff4e00fc7d0 msgr2=0x7ff4e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:15.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.813+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/16803677 shutdown_connections 2024-09-11T22:18:15.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.813+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/16803677 wait complete. 2024-09-11T22:18:15.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e6ffe640 1 Processor -- start 2024-09-11T22:18:15.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e6ffe640 1 -- start start 2024-09-11T22:18:15.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e6ffe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4e0100e20 0x7ff4e01993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e6ffe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4e0102570 0x7ff4e0199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e6ffe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e0102ef0 0x7ff4e01a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e6ffe640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e0110fc0 con 0x7ff4e0100e20 2024-09-11T22:18:15.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e6ffe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e0110e40 con 0x7ff4e0102ef0 2024-09-11T22:18:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e6ffe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e0111140 con 0x7ff4e0102570 2024-09-11T22:18:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e4d9a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4e0100e20 0x7ff4e01993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e4d9a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4e0100e20 0x7ff4e01993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53162/0 (socket says 172.21.15.152:53162) 2024-09-11T22:18:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/2711059870 learned_addr learned my addr 172.21.15.152:0/2711059870 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4dffff640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4e0102570 0x7ff4e0199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e559b640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e0102ef0 0x7ff4e01a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/2711059870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4e0102570 msgr2=0x7ff4e0199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4e0102570 0x7ff4e0199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/2711059870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e0102ef0 msgr2=0x7ff4e01a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e0102ef0 0x7ff4e01a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/2711059870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e01a4980 con 0x7ff4e0100e20 2024-09-11T22:18:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.814+0000 7ff4e559b640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e0102ef0 0x7ff4e01a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.815+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4e0100e20 0x7ff4e01993c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0005cc0 tx=0x7ff4d002f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.815+0000 7ff4ddffb640 1 -- 172.21.15.152:0/2711059870 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0034040 con 0x7ff4e0100e20 2024-09-11T22:18:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.815+0000 7ff4ddffb640 1 -- 172.21.15.152:0/2711059870 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4d0030920 con 0x7ff4e0100e20 2024-09-11T22:18:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.815+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/2711059870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e01a4b50 con 0x7ff4e0100e20 2024-09-11T22:18:15.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.815+0000 7ff4ddffb640 1 -- 172.21.15.152:0/2711059870 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0004830 con 0x7ff4e0100e20 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.815+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/2711059870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e01a4fa0 con 0x7ff4e0100e20 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.817+0000 7ff4ddffb640 1 -- 172.21.15.152:0/2711059870 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff4d0037020 con 0x7ff4e0100e20 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.817+0000 7ff4e93d7740 1 Processor -- start 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.817+0000 7ff4e93d7740 1 -- start start 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c09411d060 0x55c09411d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c094127d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 0x55c09412a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c094082620 con 0x55c09411d980 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c094029e50 con 0x55c094128240 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c09407e5e0 con 0x55c09411d060 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e4d9a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c094127d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4ddffb640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4c80a2d70 0x7ff4c80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e4d9a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c094127d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53164/0 (socket says 172.21.15.152:53164) 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/1008869324 learned_addr learned my addr 172.21.15.152:0/1008869324 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e559b640 1 --2- 172.21.15.152:0/1008869324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c09411d060 0x55c09411d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e559b640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4c80a2d70 0x7ff4c80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4dffff640 1 --2- 172.21.15.152:0/1008869324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 0x55c09412a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4ddffb640 1 -- 172.21.15.152:0/2711059870 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7ff4d00f03c0 con 0x7ff4e0100e20 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/1008869324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c09411d060 msgr2=0x55c09411d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/1008869324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c09411d060 0x55c09411d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/1008869324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 msgr2=0x55c09412a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/1008869324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 0x55c09412a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/1008869324 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c09401ad40 con 0x55c09411d980 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4dffff640 1 --2- 172.21.15.152:0/1008869324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 0x55c09412a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e559b640 1 --2- 172.21.15.152:0/1008869324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c09411d060 0x55c09411d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.818+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/1008869324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c094127d00 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00a5e70 tx=0x7ff4d00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fda63c99631a921 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.819+0000 7ff4e559b640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4c80a2d70 0x7ff4c80a5230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8006fd0 tx=0x7ff4d8006c00 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.819+0000 7ff4c6ffd640 1 -- 172.21.15.152:0/1008869324 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d002c040 con 0x55c09411d980 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.819+0000 7ff4c6ffd640 1 -- 172.21.15.152:0/1008869324 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4d00bc930 con 0x55c09411d980 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.819+0000 7ff4c6ffd640 1 -- 172.21.15.152:0/1008869324 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00b8fa0 con 0x55c09411d980 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.819+0000 7ff4e93d7740 1 -- 172.21.15.152:0/1008869324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 msgr2=0x55c094127d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.819+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/1008869324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c094127d00 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00a5e70 tx=0x7ff4d00095c0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.819+0000 7ff4e93d7740 1 -- 172.21.15.152:0/1008869324 shutdown_connections 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.819+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/1008869324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 0x55c09412a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.819+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/1008869324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c094127d00 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.819+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/1008869324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c09411d060 0x55c09411d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.819+0000 7ff4e93d7740 1 -- 172.21.15.152:0/1008869324 >> 172.21.15.152:0/1008869324 conn(0x55c0941195f0 msgr2=0x55c0941199d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.820+0000 7ff4e93d7740 1 -- 172.21.15.152:0/1008869324 shutdown_connections 2024-09-11T22:18:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.820+0000 7ff4e93d7740 1 -- 172.21.15.152:0/1008869324 wait complete. 2024-09-11T22:18:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.820+0000 7ff4e93d7740 1 -- start start 2024-09-11T22:18:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.820+0000 7ff4e93d7740 1 Processor -- start 2024-09-11T22:18:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.820+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c0941251b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.820+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d980 0x55c0941256f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.820+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c094128240 0x55c094125c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.820+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c09412abd0 con 0x55c09411d060 2024-09-11T22:18:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.820+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c09400af10 con 0x55c09411d980 2024-09-11T22:18:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.820+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c09412ad50 con 0x55c094128240 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e93d7740 10 client.0 _ll_register_callbacks cb 0x55c09402edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e4d9a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c0941251b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e4d9a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c0941251b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53170/0 (socket says 172.21.15.152:53170) 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/600491266 learned_addr learned my addr 172.21.15.152:0/600491266 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4dffff640 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d980 0x55c0941256f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/600491266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c094128240 msgr2=0x55c094125c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c094128240 0x55c094125c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/600491266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d980 msgr2=0x55c0941256f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d980 0x55c0941256f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/600491266 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c093d91580 con 0x55c09411d060 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4dffff640 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d980 0x55c0941256f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c0941251b0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00bc630 tx=0x7ff4d00b8c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d1bd08e45fb8c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4bffff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4bffff640 1 -- 172.21.15.152:0/600491266 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00c55a0 con 0x55c09411d060 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4bffff640 1 -- 172.21.15.152:0/600491266 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7ff4d00c5110 con 0x55c09411d060 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e93d7740 1 -- 172.21.15.152:0/600491266 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4d00bc930 con 0x55c09411d060 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4bffff640 1 -- 172.21.15.152:0/600491266 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff4d00c0ce0 con 0x55c09411d060 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e93d7740 10 client.18900 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4e93d7740 1 -- 172.21.15.152:0/600491266 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c093e5b960 con 0x55c09411d060 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.821+0000 7ff4bffff640 1 -- 172.21.15.152:0/600491266 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4d00bc930 con 0x55c09411d060 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.822+0000 7ff4bffff640 1 -- 172.21.15.152:0/600491266 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff4d004d030 con 0x55c09411d060 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.822+0000 7ff4e93d7740 10 client.18900 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.822+0000 7ff4e93d7740 10 client.18900 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.822+0000 7ff4e93d7740 20 client.18900 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.822+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c0941379f0 0x55c094139de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.822+0000 7ff4e93d7740 4 client.18900 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.822+0000 7ff4e93d7740 1 -- 172.21.15.152:0/600491266 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c09408fb90 con 0x55c0941379f0 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.822+0000 7ff4dffff640 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c0941379f0 0x55c094139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.822+0000 7ff4dffff640 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c0941379f0 0x55c094139de0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0693c979870708f server_cookie=1ee25830408eb0da in_seq=0 out_seq=0 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.822+0000 7ff4bffff640 10 client.18900 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4bffff640 1 -- 172.21.15.152:0/600491266 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c09408fb90 con 0x55c0941379f0 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4bffff640 10 client.18900 handle_command_reply: tid=0 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4e93d7740 1 client.18900 shutdown 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4e93d7740 1 -- 172.21.15.152:0/600491266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 msgr2=0x55c0941251b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c0941251b0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00bc630 tx=0x7ff4d00b8c50 comp rx=0 tx=0).stop 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4e93d7740 1 -- 172.21.15.152:0/600491266 shutdown_connections 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c0941379f0 0x55c094139de0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c094128240 0x55c094125c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d980 0x55c0941256f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4bffff640 0 client.18900 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/600491266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c0941251b0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.823+0000 7ff4e93d7740 1 -- 172.21.15.152:0/600491266 >> 172.21.15.152:0/600491266 conn(0x55c0941195f0 msgr2=0x55c09411f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.824+0000 7ff4e93d7740 1 -- 172.21.15.152:0/600491266 shutdown_connections 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.824+0000 7ff4e93d7740 1 -- 172.21.15.152:0/600491266 wait complete. 2024-09-11T22:18:15.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.824+0000 7ff4e93d7740 20 client.18900 trim_cache size 0 max 16384 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.840+0000 7ff4e93d7740 1 Processor -- start 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.840+0000 7ff4e93d7740 1 -- start start 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c094118640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c09411d980 0x55c09413f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 0x55c09413f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e01b01e0 con 0x55c09411d060 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e01adab0 con 0x55c094128240 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e01ab920 con 0x55c09411d980 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e4d9a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c094118640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e4d9a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c094118640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53176/0 (socket says 172.21.15.152:53176) 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/21523709 learned_addr learned my addr 172.21.15.152:0/21523709 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4dffff640 1 --2- 172.21.15.152:0/21523709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c09411d980 0x55c09413f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e559b640 1 --2- 172.21.15.152:0/21523709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 0x55c09413f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/21523709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c09411d980 msgr2=0x55c09413f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/21523709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c09411d980 0x55c09413f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/21523709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 msgr2=0x55c09413f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/21523709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 0x55c09413f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e4d9a640 1 -- 172.21.15.152:0/21523709 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c09411d7b0 con 0x55c09411d060 2024-09-11T22:18:15.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e559b640 1 --2- 172.21.15.152:0/21523709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 0x55c09413f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:15.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/21523709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c094118640 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00bc8c0 tx=0x7ff4d00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173fd9dae4f063ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.841+0000 7ff4c67fc640 1 -- 172.21.15.152:0/21523709 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00c55a0 con 0x55c09411d060 2024-09-11T22:18:15.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.842+0000 7ff4c67fc640 1 -- 172.21.15.152:0/21523709 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4d00d0e50 con 0x55c09411d060 2024-09-11T22:18:15.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.842+0000 7ff4c67fc640 1 -- 172.21.15.152:0/21523709 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00b87f0 con 0x55c09411d060 2024-09-11T22:18:15.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.842+0000 7ff4e93d7740 1 -- 172.21.15.152:0/21523709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 msgr2=0x55c094118640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.842+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/21523709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c094118640 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00bc8c0 tx=0x7ff4d00095c0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.842+0000 7ff4e93d7740 1 -- 172.21.15.152:0/21523709 shutdown_connections 2024-09-11T22:18:15.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.842+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/21523709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c094128240 0x55c09413f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.842+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/21523709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c09411d980 0x55c09413f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.842+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/21523709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d060 0x55c094118640 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.842+0000 7ff4e93d7740 1 -- 172.21.15.152:0/21523709 >> 172.21.15.152:0/21523709 conn(0x55c0941195f0 msgr2=0x55c094117f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:15.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.842+0000 7ff4e93d7740 1 -- 172.21.15.152:0/21523709 shutdown_connections 2024-09-11T22:18:15.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.842+0000 7ff4e93d7740 1 -- 172.21.15.152:0/21523709 wait complete. 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4e93d7740 1 -- start start 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4e93d7740 1 Processor -- start 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d060 0x55c094130070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c0941305b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4e93d7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c094128240 0x55c09412c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e01abf70 con 0x55c09411d980 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e01ad3e0 con 0x55c09411d060 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4e93d7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e01ac640 con 0x55c094128240 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4e93d7740 10 client.0 _ll_register_callbacks cb 0x7ff4d00bd0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4dffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c0941305b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4dffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c0941305b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53190/0 (socket says 172.21.15.152:53190) 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4dffff640 1 -- 172.21.15.152:0/3355586001 learned_addr learned my addr 172.21.15.152:0/3355586001 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:15.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4e559b640 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c094128240 0x55c09412c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d060 0x55c094130070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4dffff640 1 -- 172.21.15.152:0/3355586001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c094128240 msgr2=0x55c09412c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4dffff640 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c094128240 0x55c09412c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4dffff640 1 -- 172.21.15.152:0/3355586001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d060 msgr2=0x55c094130070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.843+0000 7ff4dffff640 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d060 0x55c094130070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4dffff640 1 -- 172.21.15.152:0/3355586001 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c09412ccb0 con 0x55c09411d980 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d060 0x55c094130070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4dffff640 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c0941305b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x55c09411a970 tx=0x7ff4d400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cbc1ea3b221adb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4bffff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4bffff640 1 -- 172.21.15.152:0/3355586001 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4005220 con 0x55c09411d980 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4bffff640 1 -- 172.21.15.152:0/3355586001 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7ff4d40053c0 con 0x55c09411d980 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4e93d7740 1 -- 172.21.15.152:0/3355586001 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4d00d0e50 con 0x55c09411d980 2024-09-11T22:18:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4bffff640 1 -- 172.21.15.152:0/3355586001 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff4d4003f70 con 0x55c09411d980 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4e93d7740 10 client.18906 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4e93d7740 1 -- 172.21.15.152:0/3355586001 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c0941a3030 con 0x55c09411d980 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4bffff640 1 -- 172.21.15.152:0/3355586001 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4d00d0e50 con 0x55c09411d980 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4bffff640 1 -- 172.21.15.152:0/3355586001 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff4d401d710 con 0x55c09411d980 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4e93d7740 10 client.18906 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4e93d7740 10 client.18906 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4e93d7740 20 client.18906 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.844+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c0941379f0 0x55c0941a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.845+0000 7ff4e93d7740 4 client.18906 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cad1d1c0", "release": true, "await": true}] 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.845+0000 7ff4e93d7740 1 -- 172.21.15.152:0/3355586001 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cad1d1c0", "release": true, "await": true}) -- 0x55c09408a0a0 con 0x55c0941379f0 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.845+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c0941379f0 0x55c0941a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.845+0000 7ff4e4d9a640 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c0941379f0 0x55c0941a57d0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8f8e51b55331df8 server_cookie=c37ac0f6523d021c in_seq=0 out_seq=0 2024-09-11T22:18:15.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.845+0000 7ff4bffff640 10 client.18906 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:15.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.893+0000 7ff4bffff640 1 -- 172.21.15.152:0/3355586001 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c09408a0a0 con 0x55c0941379f0 2024-09-11T22:18:15.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.893+0000 7ff4bffff640 10 client.18906 handle_command_reply: tid=0 2024-09-11T22:18:15.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.893+0000 7ff4e93d7740 1 client.18906 shutdown 2024-09-11T22:18:15.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.893+0000 7ff4e93d7740 1 -- 172.21.15.152:0/3355586001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 msgr2=0x55c0941305b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.893+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c0941305b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x55c09411a970 tx=0x7ff4d400bfd0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.893+0000 7ff4e93d7740 1 -- 172.21.15.152:0/3355586001 shutdown_connections 2024-09-11T22:18:15.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.893+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c0941379f0 0x55c0941a57d0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.894+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c094128240 0x55c09412c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.894+0000 7ff4bffff640 0 client.18906 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:15.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.894+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c09411d980 0x55c0941305b0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.894+0000 7ff4e93d7740 1 --2- 172.21.15.152:0/3355586001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c09411d060 0x55c094130070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.894+0000 7ff4e93d7740 1 -- 172.21.15.152:0/3355586001 >> 172.21.15.152:0/3355586001 conn(0x55c0941195f0 msgr2=0x55c094125910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:15.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.894+0000 7ff4e93d7740 1 -- 172.21.15.152:0/3355586001 shutdown_connections 2024-09-11T22:18:15.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.894+0000 7ff4e93d7740 1 -- 172.21.15.152:0/3355586001 wait complete. 2024-09-11T22:18:15.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.894+0000 7ff4e93d7740 20 client.18906 trim_cache size 0 max 16384 2024-09-11T22:18:15.896 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 52, 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: "cad1d1c0": { 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 52, 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:18:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 150.0, 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:15.898 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:18:15.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.895+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/2711059870 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4c80a2d70 msgr2=0x7ff4c80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.895+0000 7ff4e6ffe640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4c80a2d70 0x7ff4c80a5230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8006fd0 tx=0x7ff4d8006c00 comp rx=0 tx=0).stop 2024-09-11T22:18:15.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.895+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/2711059870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4e0100e20 msgr2=0x7ff4e01993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.895+0000 7ff4e6ffe640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4e0100e20 0x7ff4e01993c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0005cc0 tx=0x7ff4d002f650 comp rx=0 tx=0).stop 2024-09-11T22:18:15.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.895+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/2711059870 shutdown_connections 2024-09-11T22:18:15.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.895+0000 7ff4e6ffe640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff4c80a2d70 0x7ff4c80a5230 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.895+0000 7ff4e6ffe640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e0102ef0 0x7ff4e01a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.895+0000 7ff4e6ffe640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4e0102570 0x7ff4e0199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.895+0000 7ff4e6ffe640 1 --2- 172.21.15.152:0/2711059870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4e0100e20 0x7ff4e01993c0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.895+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/2711059870 >> 172.21.15.152:0/2711059870 conn(0x7ff4e00fc7d0 msgr2=0x7ff4e00fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:15.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.896+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/2711059870 shutdown_connections 2024-09-11T22:18:15.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:15.896+0000 7ff4e6ffe640 1 -- 172.21.15.152:0/2711059870 wait complete. 2024-09-11T22:18:16.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:16 smithi152 ceph-mon[31188]: pgmap v438: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-09-11T22:18:16.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:16 smithi179 ceph-mon[35603]: pgmap v438: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-09-11T22:18:16.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:16 smithi193 ceph-mon[35545]: pgmap v438: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-09-11T22:18:16.765 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'cad1d1c0', total seconds elapsed: 33.4 2024-09-11T22:18:16.765 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T22:18:16.765 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:18:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:16.988+0000 7fb6db3bc640 1 -- 172.21.15.152:0/2348954853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d41095d0 msgr2=0x7fb6d4109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:16.988+0000 7fb6db3bc640 1 --2- 172.21.15.152:0/2348954853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d41095d0 0x7fb6d4109a30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009900 tx=0x7fb6d002a420 comp rx=0 tx=0).stop 2024-09-11T22:18:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:16.991+0000 7fb6db3bc640 1 -- 172.21.15.152:0/2348954853 shutdown_connections 2024-09-11T22:18:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:16.991+0000 7fb6db3bc640 1 --2- 172.21.15.152:0/2348954853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d411b140 0x7fb6d411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:16.991+0000 7fb6db3bc640 1 --2- 172.21.15.152:0/2348954853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d41095d0 0x7fb6d4109a30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:16.991+0000 7fb6db3bc640 1 --2- 172.21.15.152:0/2348954853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6d41091f0 0x7fb6d4110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:16.991+0000 7fb6db3bc640 1 -- 172.21.15.152:0/2348954853 >> 172.21.15.152:0/2348954853 conn(0x7fb6d406cbf0 msgr2=0x7fb6d406d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:16.996+0000 7fb6db3bc640 1 -- 172.21.15.152:0/2348954853 shutdown_connections 2024-09-11T22:18:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:16.998+0000 7fb6db3bc640 1 -- 172.21.15.152:0/2348954853 wait complete. 2024-09-11T22:18:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:16.999+0000 7fb6db3bc640 1 Processor -- start 2024-09-11T22:18:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:16.999+0000 7fb6db3bc640 1 -- start start 2024-09-11T22:18:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.000+0000 7fb6db3bc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d41091f0 0x7fb6d4118700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.000+0000 7fb6db3bc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6d41095d0 0x7fb6d4111780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.000+0000 7fb6db3bc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d411b140 0x7fb6d4111cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.000+0000 7fb6db3bc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d4120b50 con 0x7fb6d41095d0 2024-09-11T22:18:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.000+0000 7fb6db3bc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d41209d0 con 0x7fb6d41091f0 2024-09-11T22:18:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.000+0000 7fb6db3bc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d4120cd0 con 0x7fb6d411b140 2024-09-11T22:18:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.000+0000 7fb6dabbb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d411b140 0x7fb6d4111cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.000+0000 7fb6dabbb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d411b140 0x7fb6d4111cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37394/0 (socket says 172.21.15.152:37394) 2024-09-11T22:18:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.000+0000 7fb6dabbb640 1 -- 172.21.15.152:0/549403522 learned_addr learned my addr 172.21.15.152:0/549403522 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.000+0000 7fb6da3ba640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d41091f0 0x7fb6d4118700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.001+0000 7fb6dabbb640 1 -- 172.21.15.152:0/549403522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d41091f0 msgr2=0x7fb6d4118700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.001+0000 7fb6dabbb640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d41091f0 0x7fb6d4118700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.001+0000 7fb6dabbb640 1 -- 172.21.15.152:0/549403522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6d41095d0 msgr2=0x7fb6d4111780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.001+0000 7fb6dabbb640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6d41095d0 0x7fb6d4111780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.001+0000 7fb6dabbb640 1 -- 172.21.15.152:0/549403522 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d4112280 con 0x7fb6d411b140 2024-09-11T22:18:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.001+0000 7fb6dabbb640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d411b140 0x7fb6d4111cc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00ead0 tx=0x7fb6cc00ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.001+0000 7fb6cb7fe640 1 -- 172.21.15.152:0/549403522 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc00cde0 con 0x7fb6d411b140 2024-09-11T22:18:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.001+0000 7fb6cb7fe640 1 -- 172.21.15.152:0/549403522 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6cc005020 con 0x7fb6d411b140 2024-09-11T22:18:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.001+0000 7fb6cb7fe640 1 -- 172.21.15.152:0/549403522 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc0116d0 con 0x7fb6d411b140 2024-09-11T22:18:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.002+0000 7fb6db3bc640 1 -- 172.21.15.152:0/549403522 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d4112570 con 0x7fb6d411b140 2024-09-11T22:18:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.002+0000 7fb6db3bc640 1 -- 172.21.15.152:0/549403522 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d4116550 con 0x7fb6d411b140 2024-09-11T22:18:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.007+0000 7fb6deffd740 1 Processor -- start 2024-09-11T22:18:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.009+0000 7fb6deffd740 1 -- start start 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.009+0000 7fb6deffd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e15acc0 0x563a0e15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.009+0000 7fb6deffd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e15b5e0 0x563a0e165940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.009+0000 7fb6deffd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e165e80 0x563a0e168270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.009+0000 7fb6deffd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563a0e0bf2f0 con 0x563a0e165e80 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.009+0000 7fb6deffd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563a0e067270 con 0x563a0e15acc0 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.009+0000 7fb6deffd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563a0e0bb2b0 con 0x563a0e15b5e0 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.009+0000 7fb6cb7fe640 1 -- 172.21.15.152:0/549403522 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb6cc005540 con 0x7fb6d411b140 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.011+0000 7fb6cb7fe640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb6c00a2f00 0x7fb6c00a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.011+0000 7fb6cb7fe640 1 -- 172.21.15.152:0/549403522 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fb6cc0cf790 con 0x7fb6d411b140 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.011+0000 7fb6d9bb9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e15acc0 0x563a0e15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.011+0000 7fb6d9bb9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e15acc0 0x563a0e15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:53230/0 (socket says 172.21.15.152:53230) 2024-09-11T22:18:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.011+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1458042593 learned_addr learned my addr 172.21.15.152:0/1458042593 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.012+0000 7fb6da3ba640 1 --2- 172.21.15.152:0/1458042593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e15b5e0 0x563a0e165940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.012+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/1458042593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e165e80 0x563a0e168270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.013+0000 7fb6dabbb640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb6c00a2f00 0x7fb6c00a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.015+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1458042593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e15b5e0 msgr2=0x563a0e165940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.016+0000 7fb6dabbb640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb6c00a2f00 0x7fb6c00a53c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc098050 tx=0x7fb6cc0cf9e0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.019+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/1458042593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e15b5e0 0x563a0e165940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.019+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1458042593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e165e80 msgr2=0x563a0e168270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.019+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/1458042593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e165e80 0x563a0e168270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.019+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1458042593 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a0e066340 con 0x563a0e15acc0 2024-09-11T22:18:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.020+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/1458042593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e15acc0 0x563a0e15b0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0004fd0 tx=0x7fb6d002a920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7b5a6d7eee57ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.021+0000 7fb6c8bfe640 1 -- 172.21.15.152:0/1458042593 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0004850 con 0x563a0e15acc0 2024-09-11T22:18:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.021+0000 7fb6c8bfe640 1 -- 172.21.15.152:0/1458042593 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6d00049f0 con 0x563a0e15acc0 2024-09-11T22:18:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.022+0000 7fb6deffd740 1 -- 172.21.15.152:0/1458042593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e15acc0 msgr2=0x563a0e15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.022+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1458042593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e15acc0 0x563a0e15b0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0004fd0 tx=0x7fb6d002a920 comp rx=0 tx=0).stop 2024-09-11T22:18:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.023+0000 7fb6deffd740 1 -- 172.21.15.152:0/1458042593 shutdown_connections 2024-09-11T22:18:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.023+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1458042593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e165e80 0x563a0e168270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.023+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1458042593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e15b5e0 0x563a0e165940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.023+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1458042593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e15acc0 0x563a0e15b0a0 secure :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0004fd0 tx=0x7fb6d002a920 comp rx=0 tx=0).stop 2024-09-11T22:18:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.023+0000 7fb6deffd740 1 -- 172.21.15.152:0/1458042593 >> 172.21.15.152:0/1458042593 conn(0x563a0e157230 msgr2=0x563a0e157610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:17.027 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.024+0000 7fb6da3ba640 1 --2- 172.21.15.152:0/1458042593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e15b5e0 0x563a0e165940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:17.027 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.024+0000 7fb6deffd740 1 -- 172.21.15.152:0/1458042593 shutdown_connections 2024-09-11T22:18:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.027+0000 7fb6deffd740 1 -- 172.21.15.152:0/1458042593 wait complete. 2024-09-11T22:18:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.028+0000 7fb6deffd740 1 -- start start 2024-09-11T22:18:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.028+0000 7fb6deffd740 1 Processor -- start 2024-09-11T22:18:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.028+0000 7fb6deffd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e165e80 0x563a0e162fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.028+0000 7fb6deffd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e1634f0 0x563a0e163970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.028+0000 7fb6deffd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e16ff90 0x563a0e172380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.028+0000 7fb6deffd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563a0e168aa0 con 0x563a0e165e80 2024-09-11T22:18:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.028+0000 7fb6deffd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563a0e048290 con 0x563a0e16ff90 2024-09-11T22:18:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.028+0000 7fb6deffd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563a0e168c20 con 0x563a0e1634f0 2024-09-11T22:18:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.028+0000 7fb6deffd740 10 client.0 _ll_register_callbacks cb 0x563a0e079140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.031+0000 7fb6d9bb9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e16ff90 0x563a0e172380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.031+0000 7fb6d9bb9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e16ff90 0x563a0e172380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:53242/0 (socket says 172.21.15.152:53242) 2024-09-11T22:18:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.031+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1603388731 learned_addr learned my addr 172.21.15.152:0/1603388731 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.033+0000 7fb6da3ba640 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e1634f0 0x563a0e163970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.033+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e165e80 0x563a0e162fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.033+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1603388731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e1634f0 msgr2=0x563a0e163970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.033+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e1634f0 0x563a0e163970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.033+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1603388731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e165e80 msgr2=0x563a0e162fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.033+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e165e80 0x563a0e162fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.033+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1603388731 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a0ddd2210 con 0x563a0e16ff90 2024-09-11T22:18:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.035+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e16ff90 0x563a0e172380 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0033040 tx=0x7fb6d0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41868176c549128 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.036+0000 7fb6bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:18:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.038+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1603388731 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0005200 con 0x563a0e16ff90 2024-09-11T22:18:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.038+0000 7fb6deffd740 1 -- 172.21.15.152:0/1603388731 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6d00049f0 con 0x563a0e16ff90 2024-09-11T22:18:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.038+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1603388731 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fb6d00053a0 con 0x563a0e16ff90 2024-09-11T22:18:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.045+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1603388731 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb6d00055a0 con 0x563a0e16ff90 2024-09-11T22:18:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.045+0000 7fb6deffd740 10 client.28127 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.045+0000 7fb6deffd740 1 -- 172.21.15.152:0/1603388731 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563a0de9e620 con 0x563a0e16ff90 2024-09-11T22:18:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.048+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1603388731 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6d00049f0 con 0x563a0e16ff90 2024-09-11T22:18:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.048+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1603388731 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb6d004d460 con 0x563a0e16ff90 2024-09-11T22:18:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.048+0000 7fb6deffd740 10 client.28127 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.048+0000 7fb6deffd740 10 client.28127 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.048+0000 7fb6deffd740 20 client.28127 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.048+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563a0e1766e0 0x563a0e178ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.048+0000 7fb6deffd740 4 client.28127 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.048+0000 7fb6deffd740 1 -- 172.21.15.152:0/1603388731 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a0e0cca20 con 0x563a0e1766e0 2024-09-11T22:18:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.051+0000 7fb6da3ba640 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563a0e1766e0 0x563a0e178ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.052+0000 7fb6da3ba640 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563a0e1766e0 0x563a0e178ad0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf08299a85a97b03 server_cookie=d3d7caf2293de9bd in_seq=0 out_seq=0 2024-09-11T22:18:17.053 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.052+0000 7fb6bdffb640 10 client.28127 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.053+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1603388731 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a0e0cca20 con 0x563a0e1766e0 2024-09-11T22:18:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.053+0000 7fb6bdffb640 10 client.28127 handle_command_reply: tid=0 2024-09-11T22:18:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.053+0000 7fb6deffd740 1 client.28127 shutdown 2024-09-11T22:18:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6deffd740 1 -- 172.21.15.152:0/1603388731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e16ff90 msgr2=0x563a0e172380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e16ff90 0x563a0e172380 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0033040 tx=0x7fb6d0005fd0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6deffd740 1 -- 172.21.15.152:0/1603388731 shutdown_connections 2024-09-11T22:18:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563a0e1766e0 0x563a0e178ad0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e16ff90 0x563a0e172380 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e1634f0 0x563a0e163970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1603388731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e165e80 0x563a0e162fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6deffd740 1 -- 172.21.15.152:0/1603388731 >> 172.21.15.152:0/1603388731 conn(0x563a0e157230 msgr2=0x563a0e15cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6bdffb640 0 client.28127 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6deffd740 1 -- 172.21.15.152:0/1603388731 shutdown_connections 2024-09-11T22:18:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6deffd740 1 -- 172.21.15.152:0/1603388731 wait complete. 2024-09-11T22:18:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.054+0000 7fb6deffd740 20 client.28127 trim_cache size 0 max 16384 2024-09-11T22:18:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.080+0000 7fb6deffd740 1 Processor -- start 2024-09-11T22:18:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.080+0000 7fb6deffd740 1 -- start start 2024-09-11T22:18:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.081+0000 7fb6deffd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e1634f0 0x563a0e162850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.081+0000 7fb6deffd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e165e80 0x563a0e162d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.081+0000 7fb6deffd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e16ff90 0x563a0e160250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.081+0000 7fb6da3ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e165e80 0x563a0e162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.081+0000 7fb6d9bb9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e1634f0 0x563a0e162850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.081+0000 7fb6da3ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e165e80 0x563a0e162d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:53246/0 (socket says 172.21.15.152:53246) 2024-09-11T22:18:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.081+0000 7fb6da3ba640 1 -- 172.21.15.152:0/766781866 learned_addr learned my addr 172.21.15.152:0/766781866 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.081+0000 7fb6deffd740 1 -- 172.21.15.152:0/766781866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d41b6840 con 0x563a0e16ff90 2024-09-11T22:18:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.081+0000 7fb6deffd740 1 -- 172.21.15.152:0/766781866 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d41b4110 con 0x563a0e165e80 2024-09-11T22:18:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.081+0000 7fb6deffd740 1 -- 172.21.15.152:0/766781866 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d41b1f80 con 0x563a0e1634f0 2024-09-11T22:18:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.082+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/766781866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e16ff90 0x563a0e160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.082+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/766781866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e165e80 msgr2=0x563a0e162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.082+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/766781866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e165e80 0x563a0e162d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.082+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/766781866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e16ff90 msgr2=0x563a0e160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.082+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/766781866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e16ff90 0x563a0e160250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.082+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/766781866 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a0e157ec0 con 0x563a0e1634f0 2024-09-11T22:18:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.082+0000 7fb6da3ba640 1 --2- 172.21.15.152:0/766781866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e165e80 0x563a0e162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.083+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/766781866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e1634f0 0x563a0e162850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb6d004d8b0 tx=0x7fb6d0001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6d442fcb7da915 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.083+0000 7fb6bffff640 1 -- 172.21.15.152:0/766781866 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d004d440 con 0x563a0e1634f0 2024-09-11T22:18:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.083+0000 7fb6bffff640 1 -- 172.21.15.152:0/766781866 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6d004d5e0 con 0x563a0e1634f0 2024-09-11T22:18:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.083+0000 7fb6bffff640 1 -- 172.21.15.152:0/766781866 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0005340 con 0x563a0e1634f0 2024-09-11T22:18:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.084+0000 7fb6deffd740 1 -- 172.21.15.152:0/766781866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e1634f0 msgr2=0x563a0e162850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.084+0000 7fb6deffd740 1 --2- 172.21.15.152:0/766781866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e1634f0 0x563a0e162850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb6d004d8b0 tx=0x7fb6d0001e70 comp rx=0 tx=0).stop 2024-09-11T22:18:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.085+0000 7fb6deffd740 1 -- 172.21.15.152:0/766781866 shutdown_connections 2024-09-11T22:18:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.085+0000 7fb6deffd740 1 --2- 172.21.15.152:0/766781866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e16ff90 0x563a0e160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.085+0000 7fb6deffd740 1 --2- 172.21.15.152:0/766781866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e165e80 0x563a0e162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.085+0000 7fb6deffd740 1 --2- 172.21.15.152:0/766781866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e1634f0 0x563a0e162850 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.085+0000 7fb6deffd740 1 -- 172.21.15.152:0/766781866 >> 172.21.15.152:0/766781866 conn(0x563a0e157230 msgr2=0x563a0e15e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.085+0000 7fb6deffd740 1 -- 172.21.15.152:0/766781866 shutdown_connections 2024-09-11T22:18:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.085+0000 7fb6deffd740 1 -- 172.21.15.152:0/766781866 wait complete. 2024-09-11T22:18:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.086+0000 7fb6deffd740 1 -- start start 2024-09-11T22:18:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.086+0000 7fb6deffd740 1 Processor -- start 2024-09-11T22:18:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.086+0000 7fb6deffd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e1634f0 0x563a0e16c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.086+0000 7fb6deffd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e165e80 0x563a0e16ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.087+0000 7fb6d9bb9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e1634f0 0x563a0e16c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.087+0000 7fb6d9bb9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e1634f0 0x563a0e16c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:53250/0 (socket says 172.21.15.152:53250) 2024-09-11T22:18:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.087+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1337885617 learned_addr learned my addr 172.21.15.152:0/1337885617 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.087+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e16ff90 0x563a0e16ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.087+0000 7fb6da3ba640 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e165e80 0x563a0e16ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.087+0000 7fb6deffd740 1 -- 172.21.15.152:0/1337885617 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d41b25d0 con 0x563a0e16ff90 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.087+0000 7fb6deffd740 1 -- 172.21.15.152:0/1337885617 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d41b3a40 con 0x563a0e1634f0 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.087+0000 7fb6deffd740 1 -- 172.21.15.152:0/1337885617 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d41b2ca0 con 0x563a0e165e80 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.087+0000 7fb6deffd740 10 client.0 _ll_register_callbacks cb 0x7fb6d0003760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1337885617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e165e80 msgr2=0x563a0e16ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e165e80 0x563a0e16ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1337885617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e16ff90 msgr2=0x563a0e16ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e16ff90 0x563a0e16ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6d9bb9640 1 -- 172.21.15.152:0/1337885617 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a0e16f5d0 con 0x563a0e1634f0 2024-09-11T22:18:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6d9bb9640 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e1634f0 0x563a0e16c950 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0006010 tx=0x7fb6d0004cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ad88efbb3c6c3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1337885617 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0066070 con 0x563a0e1634f0 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1337885617 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fb6d0005040 con 0x563a0e1634f0 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6deffd740 1 -- 172.21.15.152:0/1337885617 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6d004d5e0 con 0x563a0e1634f0 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1337885617 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb6d004d440 con 0x563a0e1634f0 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.088+0000 7fb6deffd740 10 client.28133 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.089+0000 7fb6deffd740 1 -- 172.21.15.152:0/1337885617 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563a0e1e0ba0 con 0x563a0e1634f0 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.089+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1337885617 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6d004d5e0 con 0x563a0e1634f0 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.089+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1337885617 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb6d004b930 con 0x563a0e1634f0 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.089+0000 7fb6deffd740 10 client.28133 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.089+0000 7fb6deffd740 10 client.28133 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.089+0000 7fb6deffd740 20 client.28133 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.089+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563a0e1e1020 0x563a0e1e3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.089+0000 7fb6deffd740 4 client.28133 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:18:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.089+0000 7fb6deffd740 1 -- 172.21.15.152:0/1337885617 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a0e0c6d70 con 0x563a0e1e1020 2024-09-11T22:18:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.090+0000 7fb6da3ba640 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563a0e1e1020 0x563a0e1e3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.090+0000 7fb6bdffb640 10 client.28133 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.090+0000 7fb6da3ba640 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563a0e1e1020 0x563a0e1e3410 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a15ec69c2509efcf server_cookie=24ebd42dd9bf46d2 in_seq=0 out_seq=0 2024-09-11T22:18:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.100+0000 7fb6bdffb640 1 -- 172.21.15.152:0/1337885617 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a0e0c6d70 con 0x563a0e1e1020 2024-09-11T22:18:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.100+0000 7fb6bdffb640 10 client.28133 handle_command_reply: tid=0 2024-09-11T22:18:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.100+0000 7fb6deffd740 1 client.28133 shutdown 2024-09-11T22:18:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.100+0000 7fb6deffd740 1 -- 172.21.15.152:0/1337885617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e1634f0 msgr2=0x563a0e16c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.100+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e1634f0 0x563a0e16c950 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0006010 tx=0x7fb6d0004cb0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.100+0000 7fb6deffd740 1 -- 172.21.15.152:0/1337885617 shutdown_connections 2024-09-11T22:18:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.100+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563a0e1e1020 0x563a0e1e3410 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.101+0000 7fb6bdffb640 0 client.28133 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.101+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a0e16ff90 0x563a0e16ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.101+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563a0e165e80 0x563a0e16ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.101+0000 7fb6deffd740 1 --2- 172.21.15.152:0/1337885617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563a0e1634f0 0x563a0e16c950 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.101+0000 7fb6deffd740 1 -- 172.21.15.152:0/1337885617 >> 172.21.15.152:0/1337885617 conn(0x563a0e157230 msgr2=0x563a0e162850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.101+0000 7fb6deffd740 1 -- 172.21.15.152:0/1337885617 shutdown_connections 2024-09-11T22:18:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.101+0000 7fb6deffd740 1 -- 172.21.15.152:0/1337885617 wait complete. 2024-09-11T22:18:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.101+0000 7fb6deffd740 20 client.28133 trim_cache size 0 max 16384 2024-09-11T22:18:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:18:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:18:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:18:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:18:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 -- 172.21.15.152:0/549403522 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb6c00a2f00 msgr2=0x7fb6c00a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb6c00a2f00 0x7fb6c00a53c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc098050 tx=0x7fb6cc0cf9e0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 -- 172.21.15.152:0/549403522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d411b140 msgr2=0x7fb6d4111cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d411b140 0x7fb6d4111cc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00ead0 tx=0x7fb6cc00ef90 comp rx=0 tx=0).stop 2024-09-11T22:18:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 -- 172.21.15.152:0/549403522 shutdown_connections 2024-09-11T22:18:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb6c00a2f00 0x7fb6c00a53c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d411b140 0x7fb6d4111cc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6d41095d0 0x7fb6d4111780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 --2- 172.21.15.152:0/549403522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d41091f0 0x7fb6d4118700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 -- 172.21.15.152:0/549403522 >> 172.21.15.152:0/549403522 conn(0x7fb6d406cbf0 msgr2=0x7fb6d411b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 -- 172.21.15.152:0/549403522 shutdown_connections 2024-09-11T22:18:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:17.102+0000 7fb6db3bc640 1 -- 172.21.15.152:0/549403522 wait complete. 2024-09-11T22:18:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:17.743 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:17 smithi152 ceph-mon[31188]: pgmap v439: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-09-11T22:18:17.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.741+0000 7fd5df8cd640 1 -- 172.21.15.152:0/3442676403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d8100ca0 msgr2=0x7fd5d8106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.741+0000 7fd5df8cd640 1 --2- 172.21.15.152:0/3442676403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d8100ca0 0x7fd5d8106840 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009930 tx=0x7fd5c802e850 comp rx=0 tx=0).stop 2024-09-11T22:18:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.741+0000 7fd5df8cd640 1 -- 172.21.15.152:0/3442676403 shutdown_connections 2024-09-11T22:18:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.741+0000 7fd5df8cd640 1 --2- 172.21.15.152:0/3442676403 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5d8106f50 0x7fd5d810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.741+0000 7fd5df8cd640 1 --2- 172.21.15.152:0/3442676403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d8100ca0 0x7fd5d8106840 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.741+0000 7fd5df8cd640 1 --2- 172.21.15.152:0/3442676403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5d81002f0 0x7fd5d81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.741+0000 7fd5df8cd640 1 -- 172.21.15.152:0/3442676403 >> 172.21.15.152:0/3442676403 conn(0x7fd5d8077220 msgr2=0x7fd5d80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.741+0000 7fd5df8cd640 1 -- 172.21.15.152:0/3442676403 shutdown_connections 2024-09-11T22:18:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.741+0000 7fd5df8cd640 1 -- 172.21.15.152:0/3442676403 wait complete. 2024-09-11T22:18:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.742+0000 7fd5df8cd640 1 Processor -- start 2024-09-11T22:18:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5df8cd640 1 -- start start 2024-09-11T22:18:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5df8cd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5d81002f0 0x7fd5d806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5df8cd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5d8100ca0 0x7fd5d806d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5df8cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d8106f50 0x7fd5d8071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5df8cd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d806bfa0 con 0x7fd5d8106f50 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5df8cd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d806be20 con 0x7fd5d8100ca0 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5df8cd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d806c120 con 0x7fd5d81002f0 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5dd669640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5d81002f0 0x7fd5d806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5dce68640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5d8100ca0 0x7fd5d806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5dd669640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5d81002f0 0x7fd5d806d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37452/0 (socket says 172.21.15.152:37452) 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5dd669640 1 -- 172.21.15.152:0/435297916 learned_addr learned my addr 172.21.15.152:0/435297916 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5dde6a640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d8106f50 0x7fd5d8071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5dd669640 1 -- 172.21.15.152:0/435297916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5d8100ca0 msgr2=0x7fd5d806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.743+0000 7fd5dd669640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5d8100ca0 0x7fd5d806d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.744+0000 7fd5dd669640 1 -- 172.21.15.152:0/435297916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d8106f50 msgr2=0x7fd5d8071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.744+0000 7fd5dd669640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d8106f50 0x7fd5d8071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.744+0000 7fd5dd669640 1 -- 172.21.15.152:0/435297916 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d80723f0 con 0x7fd5d81002f0 2024-09-11T22:18:17.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.744+0000 7fd5dd669640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5d81002f0 0x7fd5d806d410 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400d950 tx=0x7fd5d400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:17.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.744+0000 7fd5ce7fc640 1 -- 172.21.15.152:0/435297916 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4017070 con 0x7fd5d81002f0 2024-09-11T22:18:17.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.744+0000 7fd5ce7fc640 1 -- 172.21.15.152:0/435297916 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5d4009c30 con 0x7fd5d81002f0 2024-09-11T22:18:17.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.744+0000 7fd5df8cd640 1 -- 172.21.15.152:0/435297916 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d80726e0 con 0x7fd5d81002f0 2024-09-11T22:18:17.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.744+0000 7fd5ce7fc640 1 -- 172.21.15.152:0/435297916 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d400f6b0 con 0x7fd5d81002f0 2024-09-11T22:18:17.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.744+0000 7fd5df8cd640 1 -- 172.21.15.152:0/435297916 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d8072c40 con 0x7fd5d81002f0 2024-09-11T22:18:17.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.745+0000 7fd5df8cd640 1 -- 172.21.15.152:0/435297916 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d81033b0 con 0x7fd5d81002f0 2024-09-11T22:18:17.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.750+0000 7fd5ce7fc640 1 -- 172.21.15.152:0/435297916 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd5d4010460 con 0x7fd5d81002f0 2024-09-11T22:18:17.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.751+0000 7fd5ce7fc640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5c40a2dc0 0x7fd5c40a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.751+0000 7fd5ce7fc640 1 -- 172.21.15.152:0/435297916 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fd5d40ceff0 con 0x7fd5d81002f0 2024-09-11T22:18:17.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.751+0000 7fd5dce68640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5c40a2dc0 0x7fd5c40a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.752+0000 7fd5dce68640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5c40a2dc0 0x7fd5c40a5280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8005ab0 tx=0x7fd5c800b040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:17.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:17.755+0000 7fd5ce7fc640 1 -- 172.21.15.152:0/435297916 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5d4009de0 con 0x7fd5d81002f0 2024-09-11T22:18:18.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:17 smithi179 ceph-mon[35603]: pgmap v439: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-09-11T22:18:18.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:17 smithi193 ceph-mon[35545]: pgmap v439: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-09-11T22:18:18.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.085+0000 7fd5df8cd640 1 -- 172.21.15.152:0/435297916 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5d810a120 con 0x7fd5d81002f0 2024-09-11T22:18:18.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.086+0000 7fd5ce7fc640 1 -- 172.21.15.152:0/435297916 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7fd5d409b560 con 0x7fd5d81002f0 2024-09-11T22:18:18.088 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:18:18.089 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:18:18.090 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:18:18.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.091+0000 7fd5df8cd640 1 -- 172.21.15.152:0/435297916 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5c40a2dc0 msgr2=0x7fd5c40a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.091+0000 7fd5df8cd640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5c40a2dc0 0x7fd5c40a5280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8005ab0 tx=0x7fd5c800b040 comp rx=0 tx=0).stop 2024-09-11T22:18:18.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.091+0000 7fd5df8cd640 1 -- 172.21.15.152:0/435297916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5d81002f0 msgr2=0x7fd5d806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.091+0000 7fd5df8cd640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5d81002f0 0x7fd5d806d410 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400d950 tx=0x7fd5d400de10 comp rx=0 tx=0).stop 2024-09-11T22:18:18.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.092+0000 7fd5df8cd640 1 -- 172.21.15.152:0/435297916 shutdown_connections 2024-09-11T22:18:18.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.092+0000 7fd5df8cd640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5c40a2dc0 0x7fd5c40a5280 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.092+0000 7fd5df8cd640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d8106f50 0x7fd5d8071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.092+0000 7fd5df8cd640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5d8100ca0 0x7fd5d806d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.092+0000 7fd5df8cd640 1 --2- 172.21.15.152:0/435297916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5d81002f0 0x7fd5d806d410 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.092+0000 7fd5df8cd640 1 -- 172.21.15.152:0/435297916 >> 172.21.15.152:0/435297916 conn(0x7fd5d8077220 msgr2=0x7fd5d81056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:18.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.092+0000 7fd5df8cd640 1 -- 172.21.15.152:0/435297916 shutdown_connections 2024-09-11T22:18:18.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:18.092+0000 7fd5df8cd640 1 -- 172.21.15.152:0/435297916 wait complete. 2024-09-11T22:18:18.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:18 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/435297916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:19.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:18 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/435297916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:19.070 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T22:18:19.070 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T22:18:19.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:18 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/435297916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:19.476 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:19.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 765.0 s, 1234.0 tps, lat 514.670 ms stddev 3543.774 2024-09-11T22:18:19.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:19 smithi152 ceph-mon[31188]: pgmap v440: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-09-11T22:18:20.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:19 smithi179 ceph-mon[35603]: pgmap v440: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-09-11T22:18:20.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:19 smithi193 ceph-mon[35545]: pgmap v440: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-09-11T22:18:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.118+0000 7efe382f9640 1 -- 172.21.15.152:0/3475747965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3011b140 msgr2=0x7efe3011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.118+0000 7efe382f9640 1 --2- 172.21.15.152:0/3475747965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3011b140 0x7efe3011d530 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009860 tx=0x7efe2c02a360 comp rx=0 tx=0).stop 2024-09-11T22:18:20.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.119+0000 7efe382f9640 1 -- 172.21.15.152:0/3475747965 shutdown_connections 2024-09-11T22:18:20.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.119+0000 7efe382f9640 1 --2- 172.21.15.152:0/3475747965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3011b140 0x7efe3011d530 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.119+0000 7efe382f9640 1 --2- 172.21.15.152:0/3475747965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe30109830 0x7efe30109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.119+0000 7efe382f9640 1 --2- 172.21.15.152:0/3475747965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe30109450 0x7efe30110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.119+0000 7efe382f9640 1 -- 172.21.15.152:0/3475747965 >> 172.21.15.152:0/3475747965 conn(0x7efe3006e140 msgr2=0x7efe3006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:20.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.120+0000 7efe382f9640 1 -- 172.21.15.152:0/3475747965 shutdown_connections 2024-09-11T22:18:20.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.122+0000 7efe382f9640 1 -- 172.21.15.152:0/3475747965 wait complete. 2024-09-11T22:18:20.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.123+0000 7efe382f9640 1 Processor -- start 2024-09-11T22:18:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.126+0000 7efe382f9640 1 -- start start 2024-09-11T22:18:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.126+0000 7efe382f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe30109450 0x7efe301a7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.126+0000 7efe382f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe30109830 0x7efe301a7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.126+0000 7efe382f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe3011b140 0x7efe301abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.126+0000 7efe382f9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efe30120de0 con 0x7efe3011b140 2024-09-11T22:18:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.126+0000 7efe382f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efe30120c60 con 0x7efe30109450 2024-09-11T22:18:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.126+0000 7efe382f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efe30120f60 con 0x7efe30109830 2024-09-11T22:18:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.127+0000 7efe36896640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe3011b140 0x7efe301abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.127+0000 7efe36896640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe3011b140 0x7efe301abc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53284/0 (socket says 172.21.15.152:53284) 2024-09-11T22:18:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.127+0000 7efe36896640 1 -- 172.21.15.152:0/3593424804 learned_addr learned my addr 172.21.15.152:0/3593424804 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.127+0000 7efe36095640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe30109450 0x7efe301a7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.128+0000 7efe36095640 1 -- 172.21.15.152:0/3593424804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe30109830 msgr2=0x7efe301a7880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:18:20.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.128+0000 7efe36095640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe30109830 0x7efe301a7880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.128+0000 7efe36095640 1 -- 172.21.15.152:0/3593424804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe3011b140 msgr2=0x7efe301abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.128+0000 7efe36095640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe3011b140 0x7efe301abc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.128+0000 7efe36095640 1 -- 172.21.15.152:0/3593424804 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe301ac2f0 con 0x7efe30109450 2024-09-11T22:18:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.128+0000 7efe36095640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe30109450 0x7efe301a7340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efe2800bd50 tx=0x7efe2800be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.132+0000 7efe277fe640 1 -- 172.21.15.152:0/3593424804 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28019070 con 0x7efe30109450 2024-09-11T22:18:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.132+0000 7efe277fe640 1 -- 172.21.15.152:0/3593424804 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe28014920 con 0x7efe30109450 2024-09-11T22:18:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.132+0000 7efe277fe640 1 -- 172.21.15.152:0/3593424804 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28012990 con 0x7efe30109450 2024-09-11T22:18:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.132+0000 7efe382f9640 1 -- 172.21.15.152:0/3593424804 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe301ac5e0 con 0x7efe30109450 2024-09-11T22:18:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.132+0000 7efe382f9640 1 -- 172.21.15.152:0/3593424804 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe301b3ec0 con 0x7efe30109450 2024-09-11T22:18:20.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.136+0000 7efe3a6d2740 1 Processor -- start 2024-09-11T22:18:20.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.136+0000 7efe3a6d2740 1 -- start start 2024-09-11T22:18:20.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.137+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc89b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.137+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc8a080 0x55715fc94400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.137+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc94940 0x55715fc96d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.137+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55715fbef2a0 con 0x55715fc8a080 2024-09-11T22:18:20.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.137+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55715fb96b10 con 0x55715fc89760 2024-09-11T22:18:20.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.137+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55715fbeb260 con 0x55715fc94940 2024-09-11T22:18:20.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.137+0000 7efe35894640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc94940 0x55715fc96d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.137+0000 7efe35894640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc94940 0x55715fc96d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:37480/0 (socket says 172.21.15.152:37480) 2024-09-11T22:18:20.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.137+0000 7efe35894640 1 -- 172.21.15.152:0/1230643758 learned_addr learned my addr 172.21.15.152:0/1230643758 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:20.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.137+0000 7efe36896640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc89b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.138+0000 7efe36896640 1 -- 172.21.15.152:0/1230643758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc94940 msgr2=0x55715fc96d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:20.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.138+0000 7efe36896640 1 --2- 172.21.15.152:0/1230643758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc94940 0x55715fc96d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.138+0000 7efe36896640 1 -- 172.21.15.152:0/1230643758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc8a080 msgr2=0x55715fc94400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:18:20.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.139+0000 7efe277fe640 1 -- 172.21.15.152:0/3593424804 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7efe2801c070 con 0x7efe30109450 2024-09-11T22:18:20.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.139+0000 7efe36896640 1 --2- 172.21.15.152:0/1230643758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc8a080 0x55715fc94400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.139+0000 7efe36896640 1 -- 172.21.15.152:0/1230643758 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715f960b90 con 0x55715fc89760 2024-09-11T22:18:20.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.139+0000 7efe36896640 1 --2- 172.21.15.152:0/1230643758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc89b40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009830 tx=0x7efe2c0303d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b393cf7e8bf47bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:20.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.140+0000 7efe277fe640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efe1c0a2f00 0x7efe1c0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.140+0000 7efe24dea640 1 -- 172.21.15.152:0/1230643758 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c040020 con 0x55715fc89760 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.140+0000 7efe36095640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efe1c0a2f00 0x7efe1c0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.140+0000 7efe277fe640 1 -- 172.21.15.152:0/3593424804 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7efe280cec50 con 0x7efe30109450 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.140+0000 7efe24dea640 1 -- 172.21.15.152:0/1230643758 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe2c038040 con 0x55715fc89760 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.141+0000 7efe3a6d2740 1 -- 172.21.15.152:0/1230643758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 msgr2=0x55715fc89b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.141+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/1230643758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc89b40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009830 tx=0x7efe2c0303d0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.142+0000 7efe3a6d2740 1 -- 172.21.15.152:0/1230643758 shutdown_connections 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.142+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/1230643758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc94940 0x55715fc96d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.142+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/1230643758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc8a080 0x55715fc94400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.142+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/1230643758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc89b40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.142+0000 7efe3a6d2740 1 -- 172.21.15.152:0/1230643758 >> 172.21.15.152:0/1230643758 conn(0x55715fc85cf0 msgr2=0x55715fc860d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:20.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.142+0000 7efe36095640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efe1c0a2f00 0x7efe1c0a53c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55715fc86b50 tx=0x7efe280bb040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:20.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.142+0000 7efe3a6d2740 1 -- 172.21.15.152:0/1230643758 shutdown_connections 2024-09-11T22:18:20.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.142+0000 7efe3a6d2740 1 -- 172.21.15.152:0/1230643758 wait complete. 2024-09-11T22:18:20.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.143+0000 7efe3a6d2740 1 -- start start 2024-09-11T22:18:20.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.143+0000 7efe3a6d2740 1 Processor -- start 2024-09-11T22:18:20.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.143+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc91700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.143+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc8a080 0x55715fc91c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.143+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc94940 0x55715fc92180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.143+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55715fc975b0 con 0x55715fc8a080 2024-09-11T22:18:20.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.143+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55715fb776e0 con 0x55715fc89760 2024-09-11T22:18:20.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.143+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55715fc97730 con 0x55715fc94940 2024-09-11T22:18:20.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.143+0000 7efe3a6d2740 10 client.0 _ll_register_callbacks cb 0x55715fb9ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:20.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.144+0000 7efe35894640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc8a080 0x55715fc91c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.144+0000 7efe35894640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc8a080 0x55715fc91c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53302/0 (socket says 172.21.15.152:53302) 2024-09-11T22:18:20.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.144+0000 7efe35894640 1 -- 172.21.15.152:0/3778896610 learned_addr learned my addr 172.21.15.152:0/3778896610 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:20.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.145+0000 7efe35894640 1 -- 172.21.15.152:0/3778896610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc94940 msgr2=0x55715fc92180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:20.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.145+0000 7efe35894640 1 --2- 172.21.15.152:0/3778896610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc94940 0x55715fc92180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.145+0000 7efe35894640 1 -- 172.21.15.152:0/3778896610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 msgr2=0x55715fc91700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:20.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.145+0000 7efe35894640 1 --2- 172.21.15.152:0/3778896610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc91700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.145+0000 7efe35894640 1 -- 172.21.15.152:0/3778896610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715fca0b00 con 0x55715fc8a080 2024-09-11T22:18:20.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.145+0000 7efe35894640 1 --2- 172.21.15.152:0/3778896610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc8a080 0x55715fc91c40 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7efe2000b8e0 tx=0x7efe2000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786bbef171dc8a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:20.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.145+0000 7efe19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:20.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.146+0000 7efe19ffb640 1 -- 172.21.15.152:0/3778896610 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20005220 con 0x55715fc8a080 2024-09-11T22:18:20.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.146+0000 7efe19ffb640 1 -- 172.21.15.152:0/3778896610 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7efe200053c0 con 0x55715fc8a080 2024-09-11T22:18:20.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.146+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3778896610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe2c038040 con 0x55715fc8a080 2024-09-11T22:18:20.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.147+0000 7efe19ffb640 1 -- 172.21.15.152:0/3778896610 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efe200055c0 con 0x55715fc8a080 2024-09-11T22:18:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.147+0000 7efe3a6d2740 10 client.18930 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.147+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3778896610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55715fca3480 con 0x55715fc8a080 2024-09-11T22:18:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.147+0000 7efe19ffb640 1 -- 172.21.15.152:0/3778896610 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe2c038040 con 0x55715fc8a080 2024-09-11T22:18:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.148+0000 7efe19ffb640 1 -- 172.21.15.152:0/3778896610 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7efe200118b0 con 0x55715fc8a080 2024-09-11T22:18:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.148+0000 7efe3a6d2740 10 client.18930 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.148+0000 7efe3a6d2740 10 client.18930 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:18:20.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.148+0000 7efe3a6d2740 20 client.18930 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:20.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.148+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/3778896610 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55715fca4890 0x55715fca6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.148+0000 7efe3a6d2740 4 client.18930 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:20.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.148+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3778896610 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55715fbfc9d0 con 0x55715fca4890 2024-09-11T22:18:20.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.149+0000 7efe36896640 1 --2- 172.21.15.152:0/3778896610 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55715fca4890 0x55715fca6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.149+0000 7efe36896640 1 --2- 172.21.15.152:0/3778896610 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55715fca4890 0x55715fca6c80 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3ae499e2012fb0 server_cookie=3451fa9712ee6d9d in_seq=0 out_seq=0 2024-09-11T22:18:20.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.149+0000 7efe19ffb640 10 client.18930 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:20.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.150+0000 7efe19ffb640 1 -- 172.21.15.152:0/3778896610 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55715fbfc9d0 con 0x55715fca4890 2024-09-11T22:18:20.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.150+0000 7efe19ffb640 10 client.18930 handle_command_reply: tid=0 2024-09-11T22:18:20.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.150+0000 7efe3a6d2740 1 client.18930 shutdown 2024-09-11T22:18:20.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.150+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3778896610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc8a080 msgr2=0x55715fc91c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.150+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/3778896610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc8a080 0x55715fc91c40 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7efe2000b8e0 tx=0x7efe2000bda0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.150+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3778896610 shutdown_connections 2024-09-11T22:18:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.150+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/3778896610 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55715fca4890 0x55715fca6c80 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.150+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/3778896610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc94940 0x55715fc92180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.150+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/3778896610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc8a080 0x55715fc91c40 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.150+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/3778896610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc91700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.150+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3778896610 >> 172.21.15.152:0/3778896610 conn(0x55715fc85cf0 msgr2=0x55715fc8ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.151+0000 7efe19ffb640 0 client.18930 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.151+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3778896610 shutdown_connections 2024-09-11T22:18:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.151+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3778896610 wait complete. 2024-09-11T22:18:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.151+0000 7efe3a6d2740 20 client.18930 trim_cache size 0 max 16384 2024-09-11T22:18:20.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe3a6d2740 1 Processor -- start 2024-09-11T22:18:20.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe3a6d2740 1 -- start start 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc93670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc8a080 0x55715fcac590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc94940 0x55715fcacad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efe14011240 con 0x55715fc94940 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efe1400eb10 con 0x55715fc89760 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efe1400c980 con 0x55715fc8a080 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe36896640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc94940 0x55715fcacad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe36896640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc94940 0x55715fcacad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53304/0 (socket says 172.21.15.152:53304) 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe36896640 1 -- 172.21.15.152:0/3164327802 learned_addr learned my addr 172.21.15.152:0/3164327802 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe36896640 1 --2- 172.21.15.152:0/3164327802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc93670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.180+0000 7efe36896640 1 -- 172.21.15.152:0/3164327802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc8a080 msgr2=0x55715fcac590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:18:20.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.181+0000 7efe36896640 1 --2- 172.21.15.152:0/3164327802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc8a080 0x55715fcac590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.181+0000 7efe36896640 1 -- 172.21.15.152:0/3164327802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 msgr2=0x55715fc93670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:20.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.181+0000 7efe36896640 1 --2- 172.21.15.152:0/3164327802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc93670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.181+0000 7efe36896640 1 -- 172.21.15.152:0/3164327802 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715fc85b20 con 0x55715fc94940 2024-09-11T22:18:20.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.181+0000 7efe36896640 1 --2- 172.21.15.152:0/3164327802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc94940 0x55715fcacad0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7efe2c030ab0 tx=0x7efe2c030a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c2a5a5330a1332 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.181+0000 7efe1bfff640 1 -- 172.21.15.152:0/3164327802 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c040040 con 0x55715fc94940 2024-09-11T22:18:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.181+0000 7efe1bfff640 1 -- 172.21.15.152:0/3164327802 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe2c030580 con 0x55715fc94940 2024-09-11T22:18:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.181+0000 7efe1bfff640 1 -- 172.21.15.152:0/3164327802 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c040040 con 0x55715fc94940 2024-09-11T22:18:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.182+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3164327802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc94940 msgr2=0x55715fcacad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.182+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/3164327802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc94940 0x55715fcacad0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7efe2c030ab0 tx=0x7efe2c030a40 comp rx=0 tx=0).stop 2024-09-11T22:18:20.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.182+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3164327802 shutdown_connections 2024-09-11T22:18:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.182+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/3164327802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc94940 0x55715fcacad0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.182+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/3164327802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc8a080 0x55715fcac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.182+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/3164327802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc89760 0x55715fc93670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.182+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3164327802 >> 172.21.15.152:0/3164327802 conn(0x55715fc85cf0 msgr2=0x55715fc92f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.182+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3164327802 shutdown_connections 2024-09-11T22:18:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.182+0000 7efe3a6d2740 1 -- 172.21.15.152:0/3164327802 wait complete. 2024-09-11T22:18:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe3a6d2740 1 -- start start 2024-09-11T22:18:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe3a6d2740 1 Processor -- start 2024-09-11T22:18:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc89760 0x55715fc8e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc8a080 0x55715fc8ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe3a6d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc94940 0x55715fc8f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efe1400cfd0 con 0x55715fc89760 2024-09-11T22:18:20.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efe1400e440 con 0x55715fc94940 2024-09-11T22:18:20.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe3a6d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efe1400d6a0 con 0x55715fc8a080 2024-09-11T22:18:20.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe3a6d2740 10 client.0 _ll_register_callbacks cb 0x7efe200043e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:20.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe36896640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc89760 0x55715fc8e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe36896640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc89760 0x55715fc8e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53308/0 (socket says 172.21.15.152:53308) 2024-09-11T22:18:20.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe35894640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc8a080 0x55715fc8ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe36896640 1 -- 172.21.15.152:0/2826236089 learned_addr learned my addr 172.21.15.152:0/2826236089 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:20.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.183+0000 7efe36896640 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc94940 0x55715fc8f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe36896640 1 -- 172.21.15.152:0/2826236089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc8a080 msgr2=0x55715fc8ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:20.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe36896640 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc8a080 0x55715fc8ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe36896640 1 -- 172.21.15.152:0/2826236089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc94940 msgr2=0x55715fc8f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe36896640 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc94940 0x55715fc8f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe36896640 1 -- 172.21.15.152:0/2826236089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715fc9b170 con 0x55715fc89760 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe36896640 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc89760 0x55715fc8e820 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7efe2c030b80 tx=0x7efe2c02aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd8fc4c1fd7e91c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe19ffb640 1 -- 172.21.15.152:0/2826236089 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c040040 con 0x55715fc89760 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe19ffb640 1 -- 172.21.15.152:0/2826236089 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7efe2c004100 con 0x55715fc89760 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe3a6d2740 1 -- 172.21.15.152:0/2826236089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe2c030580 con 0x55715fc89760 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe19ffb640 1 -- 172.21.15.152:0/2826236089 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efe2c004300 con 0x55715fc89760 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe3a6d2740 10 client.18936 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.184+0000 7efe3a6d2740 1 -- 172.21.15.152:0/2826236089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55715fd0f8e0 con 0x55715fc89760 2024-09-11T22:18:20.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.185+0000 7efe19ffb640 1 -- 172.21.15.152:0/2826236089 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe2c030580 con 0x55715fc89760 2024-09-11T22:18:20.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.185+0000 7efe19ffb640 1 -- 172.21.15.152:0/2826236089 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7efe2c0035f0 con 0x55715fc89760 2024-09-11T22:18:20.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.185+0000 7efe3a6d2740 10 client.18936 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:20.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.185+0000 7efe3a6d2740 10 client.18936 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:18:20.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.185+0000 7efe3a6d2740 20 client.18936 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:20.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.185+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55715fd0fb10 0x55715fd11f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.185+0000 7efe3a6d2740 4 client.18936 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T22:18:20.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.185+0000 7efe3a6d2740 1 -- 172.21.15.152:0/2826236089 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55715fbf6d20 con 0x55715fd0fb10 2024-09-11T22:18:20.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.185+0000 7efe35894640 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55715fd0fb10 0x55715fd11f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.187+0000 7efe35894640 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55715fd0fb10 0x55715fd11f00 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ea1e88bb4ce4423 server_cookie=780c1aa1e5225c36 in_seq=0 out_seq=0 2024-09-11T22:18:20.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.187+0000 7efe19ffb640 10 client.18936 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:20.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.490+0000 7efe19ffb640 1 -- 172.21.15.152:0/2826236089 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55715fbf6d20 con 0x55715fd0fb10 2024-09-11T22:18:20.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.490+0000 7efe19ffb640 10 client.18936 handle_command_reply: tid=0 2024-09-11T22:18:20.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.490+0000 7efe3a6d2740 1 client.18936 shutdown 2024-09-11T22:18:20.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe3a6d2740 1 -- 172.21.15.152:0/2826236089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc89760 msgr2=0x55715fc8e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc89760 0x55715fc8e820 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7efe2c030b80 tx=0x7efe2c02aae0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe3a6d2740 1 -- 172.21.15.152:0/2826236089 shutdown_connections 2024-09-11T22:18:20.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55715fd0fb10 0x55715fd11f00 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55715fc94940 0x55715fc8f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe19ffb640 0 client.18936 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:20.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55715fc8a080 0x55715fc8ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe3a6d2740 1 --2- 172.21.15.152:0/2826236089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55715fc89760 0x55715fc8e820 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe3a6d2740 1 -- 172.21.15.152:0/2826236089 >> 172.21.15.152:0/2826236089 conn(0x55715fc85cf0 msgr2=0x55715fc93780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:20.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe3a6d2740 1 -- 172.21.15.152:0/2826236089 shutdown_connections 2024-09-11T22:18:20.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe3a6d2740 1 -- 172.21.15.152:0/2826236089 wait complete. 2024-09-11T22:18:20.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe3a6d2740 20 client.18936 trim_cache size 0 max 16384 2024-09-11T22:18:20.494 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:18:20.494 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:18:20.494 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:18:20.494 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 54, 2024-09-11T22:18:20.494 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:18:20.494 INFO:teuthology.orchestra.run.smithi152.stdout: "16898df1": { 2024-09-11T22:18:20.494 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 54, 2024-09-11T22:18:20.494 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 150.0, 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:18:20.495 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:20.496 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:20.496 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:20.496 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:20.496 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:20.496 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:18:20.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe382f9640 1 -- 172.21.15.152:0/3593424804 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efe1c0a2f00 msgr2=0x7efe1c0a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe382f9640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efe1c0a2f00 0x7efe1c0a53c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55715fc86b50 tx=0x7efe280bb040 comp rx=0 tx=0).stop 2024-09-11T22:18:20.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe382f9640 1 -- 172.21.15.152:0/3593424804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe30109450 msgr2=0x7efe301a7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.491+0000 7efe382f9640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe30109450 0x7efe301a7340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efe2800bd50 tx=0x7efe2800be40 comp rx=0 tx=0).stop 2024-09-11T22:18:20.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.492+0000 7efe382f9640 1 -- 172.21.15.152:0/3593424804 shutdown_connections 2024-09-11T22:18:20.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.492+0000 7efe382f9640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efe1c0a2f00 0x7efe1c0a53c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.492+0000 7efe382f9640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe3011b140 0x7efe301abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.492+0000 7efe382f9640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe30109830 0x7efe301a7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.492+0000 7efe382f9640 1 --2- 172.21.15.152:0/3593424804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe30109450 0x7efe301a7340 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.492+0000 7efe382f9640 1 -- 172.21.15.152:0/3593424804 >> 172.21.15.152:0/3593424804 conn(0x7efe3006e140 msgr2=0x7efe3011be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:20.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.492+0000 7efe382f9640 1 -- 172.21.15.152:0/3593424804 shutdown_connections 2024-09-11T22:18:20.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:20.492+0000 7efe382f9640 1 -- 172.21.15.152:0/3593424804 wait complete. 2024-09-11T22:18:21.348 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '16898df1', quiesce took 4.6 seconds. Will release after: 25.4 2024-09-11T22:18:21.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:21 smithi152 ceph-mon[31188]: pgmap v441: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 8.0 MiB/s wr, 842 op/s 2024-09-11T22:18:22.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:21 smithi179 ceph-mon[35603]: pgmap v441: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 8.0 MiB/s wr, 842 op/s 2024-09-11T22:18:22.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:21 smithi193 ceph-mon[35545]: pgmap v441: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 8.0 MiB/s wr, 842 op/s 2024-09-11T22:18:23.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:23 smithi152 ceph-mon[31188]: pgmap v442: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 8.0 MiB/s wr, 839 op/s 2024-09-11T22:18:24.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:23 smithi179 ceph-mon[35603]: pgmap v442: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 8.0 MiB/s wr, 839 op/s 2024-09-11T22:18:24.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:23 smithi193 ceph-mon[35545]: pgmap v442: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 8.0 MiB/s wr, 839 op/s 2024-09-11T22:18:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 770.0 s, 139.1 tps, lat 52.065 ms stddev 56.224 2024-09-11T22:18:25.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:25 smithi152 ceph-mon[31188]: pgmap v443: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 7.7 MiB/s wr, 803 op/s 2024-09-11T22:18:26.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:25 smithi179 ceph-mon[35603]: pgmap v443: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 7.7 MiB/s wr, 803 op/s 2024-09-11T22:18:26.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:25 smithi193 ceph-mon[35545]: pgmap v443: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 7.7 MiB/s wr, 803 op/s 2024-09-11T22:18:26.426 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:18:26.687 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:27.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.158+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/2885090614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c28100b30 msgr2=0x7f9c28100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:27.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.158+0000 7f9c2ff3f640 1 --2- 172.21.15.152:0/2885090614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c28100b30 0x7f9c28100f10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009900 tx=0x7f9c2402a470 comp rx=0 tx=0).stop 2024-09-11T22:18:27.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.158+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/2885090614 shutdown_connections 2024-09-11T22:18:27.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.158+0000 7f9c2ff3f640 1 --2- 172.21.15.152:0/2885090614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c28105f40 0x7f9c281063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.158+0000 7f9c2ff3f640 1 --2- 172.21.15.152:0/2885090614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c28101450 0x7f9c28105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.158+0000 7f9c2ff3f640 1 --2- 172.21.15.152:0/2885090614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c28100b30 0x7f9c28100f10 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.158+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/2885090614 >> 172.21.15.152:0/2885090614 conn(0x7f9c280fc7a0 msgr2=0x7f9c280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:27.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.158+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/2885090614 shutdown_connections 2024-09-11T22:18:27.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.158+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/2885090614 wait complete. 2024-09-11T22:18:27.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.159+0000 7f9c2ff3f640 1 Processor -- start 2024-09-11T22:18:27.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.159+0000 7f9c2ff3f640 1 -- start start 2024-09-11T22:18:27.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.159+0000 7f9c2ff3f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c28100b30 0x7f9c281a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.159+0000 7f9c2ff3f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c28101450 0x7f9c281a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.159+0000 7f9c2ff3f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c28105f40 0x7f9c2819e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.159+0000 7f9c2ff3f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281185c0 con 0x7f9c28100b30 2024-09-11T22:18:27.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.159+0000 7f9c2ff3f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28118440 con 0x7f9c28105f40 2024-09-11T22:18:27.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.159+0000 7f9c2ff3f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28118740 con 0x7f9c28101450 2024-09-11T22:18:27.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.159+0000 7f9c2dcdb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c28100b30 0x7f9c281a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.159+0000 7f9c2dcdb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c28100b30 0x7f9c281a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33180/0 (socket says 172.21.15.152:33180) 2024-09-11T22:18:27.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.159+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/853158789 learned_addr learned my addr 172.21.15.152:0/853158789 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:27.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2e4dc640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c28105f40 0x7f9c2819e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/853158789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c28101450 msgr2=0x7f9c281a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:27.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c28101450 0x7f9c281a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c28101450 0x7f9c281a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/853158789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c28105f40 msgr2=0x7f9c2819e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:27.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c28105f40 0x7f9c2819e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/853158789 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2819f060 con 0x7f9c28100b30 2024-09-11T22:18:27.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2e4dc640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c28105f40 0x7f9c2819e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:27.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c28101450 0x7f9c281a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:27.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c28100b30 0x7f9c281a4770 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f9c24004770 tx=0x7f9c24003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:27.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c1effd640 1 -- 172.21.15.152:0/853158789 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2403f070 con 0x7f9c28100b30 2024-09-11T22:18:27.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c1effd640 1 -- 172.21.15.152:0/853158789 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c24031ca0 con 0x7f9c28100b30 2024-09-11T22:18:27.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/853158789 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2819f2f0 con 0x7f9c28100b30 2024-09-11T22:18:27.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c1effd640 1 -- 172.21.15.152:0/853158789 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24035030 con 0x7f9c28100b30 2024-09-11T22:18:27.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.160+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/853158789 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c281ab640 con 0x7f9c28100b30 2024-09-11T22:18:27.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.162+0000 7f9c1effd640 1 -- 172.21.15.152:0/853158789 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9c24042070 con 0x7f9c28100b30 2024-09-11T22:18:27.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c32318740 1 Processor -- start 2024-09-11T22:18:27.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c32318740 1 -- start start 2024-09-11T22:18:27.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c1effd640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c140a2cf0 0x7f9c140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c32318740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01c4a0 0x55b4bb01c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c32318740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 0x55b4bb027140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c32318740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb027680 0x55b4bb029a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c32318740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b4baf822e0 con 0x55b4bb027680 2024-09-11T22:18:27.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c32318740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b4baf29ce0 con 0x55b4bb01cdc0 2024-09-11T22:18:27.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c32318740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b4baf7e2a0 con 0x55b4bb01c4a0 2024-09-11T22:18:27.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c2e4dc640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c140a2cf0 0x7f9c140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c1effd640 1 -- 172.21.15.152:0/853158789 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f9c240efd50 con 0x7f9c28100b30 2024-09-11T22:18:27.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c2d4da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 0x55b4bb027140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c2d4da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 0x55b4bb027140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:47230/0 (socket says 172.21.15.152:47230) 2024-09-11T22:18:27.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c2e4dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb027680 0x55b4bb029a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.163+0000 7f9c2d4da640 1 -- 172.21.15.152:0/2971166386 learned_addr learned my addr 172.21.15.152:0/2971166386 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:27.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/2971166386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01c4a0 0x55b4bb01c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c2e4dc640 1 -- 172.21.15.152:0/2971166386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01c4a0 msgr2=0x55b4bb01c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:27.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c2e4dc640 1 --2- 172.21.15.152:0/2971166386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01c4a0 0x55b4bb01c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c2e4dc640 1 -- 172.21.15.152:0/2971166386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 msgr2=0x55b4bb027140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:27.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c2e4dc640 1 --2- 172.21.15.152:0/2971166386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 0x55b4bb027140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c2e4dc640 1 -- 172.21.15.152:0/2971166386 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4baf0e440 con 0x55b4bb027680 2024-09-11T22:18:27.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/2971166386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 0x55b4bb027140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:27.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c2e4dc640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c140a2cf0 0x7f9c140a51b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009fd0 tx=0x7f9c20009d80 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:27.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c2e4dc640 1 --2- 172.21.15.152:0/2971166386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb027680 0x55b4bb029a70 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f9c200092f0 tx=0x7f9c2001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50c368a95747107 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:27.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c13fff640 1 -- 172.21.15.152:0/2971166386 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20004b20 con 0x55b4bb027680 2024-09-11T22:18:27.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c13fff640 1 -- 172.21.15.152:0/2971166386 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c20004cc0 con 0x55b4bb027680 2024-09-11T22:18:27.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.164+0000 7f9c13fff640 1 -- 172.21.15.152:0/2971166386 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c200054c0 con 0x55b4bb027680 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.165+0000 7f9c32318740 1 -- 172.21.15.152:0/2971166386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb027680 msgr2=0x55b4bb029a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.165+0000 7f9c32318740 1 --2- 172.21.15.152:0/2971166386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb027680 0x55b4bb029a70 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f9c200092f0 tx=0x7f9c2001c000 comp rx=0 tx=0).stop 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.165+0000 7f9c32318740 1 -- 172.21.15.152:0/2971166386 shutdown_connections 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.165+0000 7f9c32318740 1 --2- 172.21.15.152:0/2971166386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb027680 0x55b4bb029a70 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.165+0000 7f9c32318740 1 --2- 172.21.15.152:0/2971166386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 0x55b4bb027140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.165+0000 7f9c32318740 1 --2- 172.21.15.152:0/2971166386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01c4a0 0x55b4bb01c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.165+0000 7f9c32318740 1 -- 172.21.15.152:0/2971166386 >> 172.21.15.152:0/2971166386 conn(0x55b4bb018a30 msgr2=0x55b4bb018e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.165+0000 7f9c32318740 1 -- 172.21.15.152:0/2971166386 shutdown_connections 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.165+0000 7f9c32318740 1 -- 172.21.15.152:0/2971166386 wait complete. 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.165+0000 7f9c32318740 1 -- start start 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.165+0000 7f9c32318740 1 Processor -- start 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c32318740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb026f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c32318740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 0x55b4bb024240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c32318740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb027680 0x55b4bb024780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c32318740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b4bb02a1f0 con 0x55b4bb01c4a0 2024-09-11T22:18:27.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c32318740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b4baf3d050 con 0x55b4bb01cdc0 2024-09-11T22:18:27.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c32318740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b4bb02a370 con 0x55b4bb027680 2024-09-11T22:18:27.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c32318740 10 client.0 _ll_register_callbacks cb 0x55b4baf7d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:27.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2dcdb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb026f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2dcdb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb026f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33192/0 (socket says 172.21.15.152:33192) 2024-09-11T22:18:27.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/2408975212 learned_addr learned my addr 172.21.15.152:0/2408975212 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:27.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 0x55b4bb024240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/2408975212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb027680 msgr2=0x55b4bb024780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:27.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2e4dc640 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb027680 0x55b4bb024780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb027680 0x55b4bb024780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/2408975212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 msgr2=0x55b4bb024240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:27.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 0x55b4bb024240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/2408975212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4bacf33c0 con 0x55b4bb01c4a0 2024-09-11T22:18:27.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 0x55b4bb024240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:27.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb026f90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f9c24000c00 tx=0x7f9c240bbb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4920997251f3028f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:27.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.166+0000 7f9c117fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:27.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c117fa640 1 -- 172.21.15.152:0/2408975212 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24049070 con 0x55b4bb01c4a0 2024-09-11T22:18:27.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c117fa640 1 -- 172.21.15.152:0/2408975212 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f9c240b8880 con 0x55b4bb01c4a0 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c32318740 1 -- 172.21.15.152:0/2408975212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c20004cc0 con 0x55b4bb01c4a0 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c117fa640 1 -- 172.21.15.152:0/2408975212 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9c240bc210 con 0x55b4bb01c4a0 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c32318740 10 client.18948 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c32318740 1 -- 172.21.15.152:0/2408975212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b4bb035bf0 con 0x55b4bb01c4a0 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c117fa640 1 -- 172.21.15.152:0/2408975212 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c20004cc0 con 0x55b4bb01c4a0 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c117fa640 1 -- 172.21.15.152:0/2408975212 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9c2403b5f0 con 0x55b4bb01c4a0 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c32318740 10 client.18948 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c32318740 10 client.18948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c32318740 20 client.18948 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c32318740 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b4bb0370a0 0x55b4bb039510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c32318740 4 client.18948 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.167+0000 7f9c32318740 1 -- 172.21.15.152:0/2408975212 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4baf8f850 con 0x55b4bb0370a0 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.168+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b4bb0370a0 0x55b4bb039510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.168+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b4bb0370a0 0x55b4bb039510 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=322ae1ba71eab51 server_cookie=ba75f2d0c15befde in_seq=0 out_seq=0 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.168+0000 7f9c117fa640 10 client.18948 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c117fa640 1 -- 172.21.15.152:0/2408975212 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4baf8f850 con 0x55b4bb0370a0 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c117fa640 10 client.18948 handle_command_reply: tid=0 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 1 client.18948 shutdown 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 1 -- 172.21.15.152:0/2408975212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 msgr2=0x55b4bb026f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb026f90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f9c24000c00 tx=0x7f9c240bbb70 comp rx=0 tx=0).stop 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 1 -- 172.21.15.152:0/2408975212 shutdown_connections 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b4bb0370a0 0x55b4bb039510 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb027680 0x55b4bb024780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01cdc0 0x55b4bb024240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c117fa640 0 client.18948 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:27.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 1 --2- 172.21.15.152:0/2408975212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb026f90 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 1 -- 172.21.15.152:0/2408975212 >> 172.21.15.152:0/2408975212 conn(0x55b4bb018a30 msgr2=0x55b4bb01e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:27.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 1 -- 172.21.15.152:0/2408975212 shutdown_connections 2024-09-11T22:18:27.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 1 -- 172.21.15.152:0/2408975212 wait complete. 2024-09-11T22:18:27.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.169+0000 7f9c32318740 20 client.18948 trim_cache size 0 max 16384 2024-09-11T22:18:27.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c32318740 1 Processor -- start 2024-09-11T22:18:27.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c32318740 1 -- start start 2024-09-11T22:18:27.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c32318740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb018a30 0x55b4bb0334d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c32318740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb01f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c32318740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01cdc0 0x55b4bb03edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c32318740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281b6800 con 0x55b4bb01c4a0 2024-09-11T22:18:27.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c32318740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281b40d0 con 0x55b4bb018a30 2024-09-11T22:18:27.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c32318740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281b1f40 con 0x55b4bb01cdc0 2024-09-11T22:18:27.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c2d4da640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb01f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c2d4da640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb01f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33202/0 (socket says 172.21.15.152:33202) 2024-09-11T22:18:27.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c2d4da640 1 -- 172.21.15.152:0/3579973894 learned_addr learned my addr 172.21.15.152:0/3579973894 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:27.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/3579973894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb018a30 0x55b4bb0334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c2d4da640 1 -- 172.21.15.152:0/3579973894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01cdc0 msgr2=0x55b4bb03edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/3579973894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01cdc0 0x55b4bb03edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c2d4da640 1 -- 172.21.15.152:0/3579973894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb018a30 msgr2=0x55b4bb0334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/3579973894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb018a30 0x55b4bb0334d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c2d4da640 1 -- 172.21.15.152:0/3579973894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4bb01c2d0 con 0x55b4bb01c4a0 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/3579973894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb018a30 0x55b4bb0334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/3579973894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb01f7a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x55b4bb023ad0 tx=0x7f9c1800b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b39eeb5e41e98d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.186+0000 7f9c137fe640 1 -- 172.21.15.152:0/3579973894 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1801e070 con 0x55b4bb01c4a0 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.187+0000 7f9c137fe640 1 -- 172.21.15.152:0/3579973894 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c1801a9a0 con 0x55b4bb01c4a0 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.187+0000 7f9c137fe640 1 -- 172.21.15.152:0/3579973894 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800fbb0 con 0x55b4bb01c4a0 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.187+0000 7f9c32318740 1 -- 172.21.15.152:0/3579973894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 msgr2=0x55b4bb01f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.187+0000 7f9c32318740 1 --2- 172.21.15.152:0/3579973894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb01f7a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x55b4bb023ad0 tx=0x7f9c1800b440 comp rx=0 tx=0).stop 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.187+0000 7f9c32318740 1 -- 172.21.15.152:0/3579973894 shutdown_connections 2024-09-11T22:18:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.187+0000 7f9c32318740 1 --2- 172.21.15.152:0/3579973894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01cdc0 0x55b4bb03edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.187+0000 7f9c32318740 1 --2- 172.21.15.152:0/3579973894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb01c4a0 0x55b4bb01f7a0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.187+0000 7f9c32318740 1 --2- 172.21.15.152:0/3579973894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb018a30 0x55b4bb0334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.187+0000 7f9c32318740 1 -- 172.21.15.152:0/3579973894 >> 172.21.15.152:0/3579973894 conn(0x55b4bb0248e0 msgr2=0x55b4bb01f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.187+0000 7f9c32318740 1 -- 172.21.15.152:0/3579973894 shutdown_connections 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.187+0000 7f9c32318740 1 -- 172.21.15.152:0/3579973894 wait complete. 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c32318740 1 -- start start 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c32318740 1 Processor -- start 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c32318740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb018a30 0x55b4bb02fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c32318740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01c4a0 0x55b4bb02b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c32318740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01cdc0 0x55b4bb02b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c32318740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281b2590 con 0x55b4bb018a30 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c32318740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281b3a00 con 0x55b4bb01c4a0 2024-09-11T22:18:27.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c32318740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281b2c60 con 0x55b4bb01cdc0 2024-09-11T22:18:27.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c32318740 10 client.0 _ll_register_callbacks cb 0x7f9c240bbd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:27.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c2dcdb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb018a30 0x55b4bb02fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c2dcdb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb018a30 0x55b4bb02fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33218/0 (socket says 172.21.15.152:33218) 2024-09-11T22:18:27.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/963213970 learned_addr learned my addr 172.21.15.152:0/963213970 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:27.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01c4a0 0x55b4bb02b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/963213970 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01cdc0 msgr2=0x55b4bb02b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:27.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c2e4dc640 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01cdc0 0x55b4bb02b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01cdc0 0x55b4bb02b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/963213970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01c4a0 msgr2=0x55b4bb02b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01c4a0 0x55b4bb02b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.188+0000 7f9c2dcdb640 1 -- 172.21.15.152:0/963213970 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4bb02bee0 con 0x55b4bb018a30 2024-09-11T22:18:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01c4a0 0x55b4bb02b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c2dcdb640 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb018a30 0x55b4bb02fdf0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9c240bc1a0 tx=0x7f9c24034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdfb6b4932a3110 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c117fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c117fa640 1 -- 172.21.15.152:0/963213970 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24049040 con 0x55b4bb018a30 2024-09-11T22:18:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c117fa640 1 -- 172.21.15.152:0/963213970 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f9c2403b5f0 con 0x55b4bb018a30 2024-09-11T22:18:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c32318740 1 -- 172.21.15.152:0/963213970 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c1801a9a0 con 0x55b4bb018a30 2024-09-11T22:18:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c117fa640 1 -- 172.21.15.152:0/963213970 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9c24087370 con 0x55b4bb018a30 2024-09-11T22:18:27.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c32318740 10 client.18954 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:27.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c32318740 1 -- 172.21.15.152:0/963213970 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b4bb0a1d80 con 0x55b4bb018a30 2024-09-11T22:18:27.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c117fa640 1 -- 172.21.15.152:0/963213970 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c1801a9a0 con 0x55b4bb018a30 2024-09-11T22:18:27.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c117fa640 1 -- 172.21.15.152:0/963213970 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f9c240c0170 con 0x55b4bb018a30 2024-09-11T22:18:27.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c32318740 10 client.18954 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:27.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c32318740 10 client.18954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:27.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c32318740 20 client.18954 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:27.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c32318740 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b4bb027680 0x55b4bb0a4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:27.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c32318740 4 client.18954 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:18:27.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.189+0000 7f9c32318740 1 -- 172.21.15.152:0/963213970 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b4baf89d60 con 0x55b4bb027680 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b4bb027680 0x55b4bb0a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c117fa640 10 client.18954 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c2d4da640 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b4bb027680 0x55b4bb0a4380 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4793d4f756b7446a server_cookie=d048f9130c901ea1 in_seq=0 out_seq=0 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c117fa640 1 -- 172.21.15.152:0/963213970 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b4baf89d60 con 0x55b4bb027680 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c117fa640 10 client.18954 handle_command_reply: tid=0 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c32318740 1 client.18954 shutdown 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c32318740 1 -- 172.21.15.152:0/963213970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb018a30 msgr2=0x55b4bb02fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c32318740 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb018a30 0x55b4bb02fdf0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9c240bc1a0 tx=0x7f9c24034000 comp rx=0 tx=0).stop 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c32318740 1 -- 172.21.15.152:0/963213970 shutdown_connections 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c32318740 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b4bb027680 0x55b4bb0a4380 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c32318740 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4bb01cdc0 0x55b4bb02b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c32318740 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b4bb01c4a0 0x55b4bb02b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c32318740 1 --2- 172.21.15.152:0/963213970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b4bb018a30 0x55b4bb02fdf0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c117fa640 0 client.18954 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:27.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.190+0000 7f9c32318740 1 -- 172.21.15.152:0/963213970 >> 172.21.15.152:0/963213970 conn(0x55b4bb0248e0 msgr2=0x55b4bb025aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:27.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.191+0000 7f9c32318740 1 -- 172.21.15.152:0/963213970 shutdown_connections 2024-09-11T22:18:27.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.191+0000 7f9c32318740 1 -- 172.21.15.152:0/963213970 wait complete. 2024-09-11T22:18:27.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.191+0000 7f9c32318740 20 client.18954 trim_cache size 0 max 16384 2024-09-11T22:18:27.212 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:18:27.213 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:18:27.213 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:18:27.213 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:18:27.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/853158789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c140a2cf0 msgr2=0x7f9c140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:27.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c140a2cf0 0x7f9c140a51b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009fd0 tx=0x7f9c20009d80 comp rx=0 tx=0).stop 2024-09-11T22:18:27.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/853158789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c28100b30 msgr2=0x7f9c281a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:27.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c28100b30 0x7f9c281a4770 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f9c24004770 tx=0x7f9c24003c10 comp rx=0 tx=0).stop 2024-09-11T22:18:27.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/853158789 shutdown_connections 2024-09-11T22:18:27.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f9c140a2cf0 0x7f9c140a51b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c28105f40 0x7f9c2819e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c28101450 0x7f9c281a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 --2- 172.21.15.152:0/853158789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c28100b30 0x7f9c281a4770 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:27.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/853158789 >> 172.21.15.152:0/853158789 conn(0x7f9c280fc7a0 msgr2=0x7f9c2810f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:27.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/853158789 shutdown_connections 2024-09-11T22:18:27.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:27.192+0000 7f9c2ff3f640 1 -- 172.21.15.152:0/853158789 wait complete. 2024-09-11T22:18:27.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:27 smithi152 ceph-mon[31188]: pgmap v444: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 7.4 MiB/s wr, 773 op/s 2024-09-11T22:18:28.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:27 smithi179 ceph-mon[35603]: pgmap v444: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 7.4 MiB/s wr, 773 op/s 2024-09-11T22:18:28.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:27 smithi193 ceph-mon[35545]: pgmap v444: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 7.4 MiB/s wr, 773 op/s 2024-09-11T22:18:28.092 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:18:28.092 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:18:28.367 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:28.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.856+0000 7fe4f346f640 1 -- 172.21.15.152:0/3387005230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4ec1082a0 msgr2=0x7fe4ec10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:28.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.856+0000 7fe4f346f640 1 --2- 172.21.15.152:0/3387005230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4ec1082a0 0x7fe4ec10ec40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009930 tx=0x7fe4e402a440 comp rx=0 tx=0).stop 2024-09-11T22:18:28.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.856+0000 7fe4f346f640 1 -- 172.21.15.152:0/3387005230 shutdown_connections 2024-09-11T22:18:28.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.856+0000 7fe4f346f640 1 --2- 172.21.15.152:0/3387005230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4ec1082a0 0x7fe4ec10ec40 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:28.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 --2- 172.21.15.152:0/3387005230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4ec1036e0 0x7fe4ec107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:28.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 --2- 172.21.15.152:0/3387005230 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4ec102d30 0x7fe4ec103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:28.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 -- 172.21.15.152:0/3387005230 >> 172.21.15.152:0/3387005230 conn(0x7fe4ec0fc7d0 msgr2=0x7fe4ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 -- 172.21.15.152:0/3387005230 shutdown_connections 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 -- 172.21.15.152:0/3387005230 wait complete. 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 Processor -- start 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 -- start start 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4ec102d30 0x7fe4ec1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4ec1036e0 0x7fe4ec1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4ec1082a0 0x7fe4ec19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec112160 con 0x7fe4ec1036e0 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec111fe0 con 0x7fe4ec102d30 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.857+0000 7fe4f346f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec1122e0 con 0x7fe4ec1082a0 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f0a0a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4ec1036e0 0x7fe4ec1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f0a0a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4ec1036e0 0x7fe4ec1a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33240/0 (socket says 172.21.15.152:33240) 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f0a0a640 1 -- 172.21.15.152:0/3771695956 learned_addr learned my addr 172.21.15.152:0/3771695956 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f120b640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4ec102d30 0x7fe4ec1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f1a0c640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4ec1082a0 0x7fe4ec19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f0a0a640 1 -- 172.21.15.152:0/3771695956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4ec1082a0 msgr2=0x7fe4ec19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f0a0a640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4ec1082a0 0x7fe4ec19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f0a0a640 1 -- 172.21.15.152:0/3771695956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4ec102d30 msgr2=0x7fe4ec1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f0a0a640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4ec102d30 0x7fe4ec1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f0a0a640 1 -- 172.21.15.152:0/3771695956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec19af60 con 0x7fe4ec1036e0 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f120b640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4ec102d30 0x7fe4ec1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f1a0c640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4ec1082a0 0x7fe4ec19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f0a0a640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4ec1036e0 0x7fe4ec1a0b60 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0006fd0 tx=0x7fe4e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4ea7fc640 1 -- 172.21.15.152:0/3771695956 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0011830 con 0x7fe4ec1036e0 2024-09-11T22:18:28.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f346f640 1 -- 172.21.15.152:0/3771695956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ec19b250 con 0x7fe4ec1036e0 2024-09-11T22:18:28.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4ea7fc640 1 -- 172.21.15.152:0/3771695956 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4e0016070 con 0x7fe4ec1036e0 2024-09-11T22:18:28.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4ea7fc640 1 -- 172.21.15.152:0/3771695956 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000f2e0 con 0x7fe4ec1036e0 2024-09-11T22:18:28.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.858+0000 7fe4f346f640 1 -- 172.21.15.152:0/3771695956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4ec1a75a0 con 0x7fe4ec1036e0 2024-09-11T22:18:28.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.859+0000 7fe4f346f640 1 -- 172.21.15.152:0/3771695956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4ec06a850 con 0x7fe4ec1036e0 2024-09-11T22:18:28.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.861+0000 7fe4ea7fc640 1 -- 172.21.15.152:0/3771695956 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe4e001b460 con 0x7fe4ec1036e0 2024-09-11T22:18:28.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.862+0000 7fe4ea7fc640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4d40a2cf0 0x7fe4d40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:28.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.862+0000 7fe4ea7fc640 1 -- 172.21.15.152:0/3771695956 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fe4e00cf1a0 con 0x7fe4ec1036e0 2024-09-11T22:18:28.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.862+0000 7fe4f120b640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4d40a2cf0 0x7fe4d40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:28.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.862+0000 7fe4f120b640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4d40a2cf0 0x7fe4d40a51b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc007eb0 tx=0x7fe4dc0073c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:28.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:28.865+0000 7fe4ea7fc640 1 -- 172.21.15.152:0/3771695956 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4e009be70 con 0x7fe4ec1036e0 2024-09-11T22:18:29.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.069+0000 7fe4f346f640 1 -- 172.21.15.152:0/3771695956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4ec19bc20 con 0x7fe4ec1036e0 2024-09-11T22:18:30.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.070+0000 7fe4ea7fc640 1 -- 172.21.15.152:0/3771695956 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7fe4e009b770 con 0x7fe4ec1036e0 2024-09-11T22:18:30.679 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:29 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3771695956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:30.679 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:30 smithi193 ceph-mon[35545]: pgmap v445: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.1 MiB/s wr, 820 op/s 2024-09-11T22:18:30.679 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:29 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3771695956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:30.679 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:30 smithi179 ceph-mon[35603]: pgmap v445: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.1 MiB/s wr, 820 op/s 2024-09-11T22:18:30.680 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:18:30.680 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:18:30.681 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:18:30.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 -- 172.21.15.152:0/3771695956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4d40a2cf0 msgr2=0x7fe4d40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:30.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4d40a2cf0 0x7fe4d40a51b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc007eb0 tx=0x7fe4dc0073c0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 -- 172.21.15.152:0/3771695956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4ec1036e0 msgr2=0x7fe4ec1a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:30.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4ec1036e0 0x7fe4ec1a0b60 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0006fd0 tx=0x7fe4e000b8e0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 -- 172.21.15.152:0/3771695956 shutdown_connections 2024-09-11T22:18:30.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe4d40a2cf0 0x7fe4d40a51b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4ec1082a0 0x7fe4ec19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4ec1036e0 0x7fe4ec1a0b60 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 --2- 172.21.15.152:0/3771695956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4ec102d30 0x7fe4ec1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 -- 172.21.15.152:0/3771695956 >> 172.21.15.152:0/3771695956 conn(0x7fe4ec0fc7d0 msgr2=0x7fe4ec0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:30.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 -- 172.21.15.152:0/3771695956 shutdown_connections 2024-09-11T22:18:30.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:29.072+0000 7fe4f346f640 1 -- 172.21.15.152:0/3771695956 wait complete. 2024-09-11T22:18:30.682 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:29 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3771695956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:30.684 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:18:30.684 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:18:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.207+0000 7fe6968a6640 1 -- 172.21.15.152:0/804620659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe690102470 msgr2=0x7fe69010e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.207+0000 7fe6968a6640 1 --2- 172.21.15.152:0/804620659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe690102470 0x7fe69010e9a0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fe688009cd0 tx=0x7fe68802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.207+0000 7fe6968a6640 1 -- 172.21.15.152:0/804620659 shutdown_connections 2024-09-11T22:18:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.207+0000 7fe6968a6640 1 --2- 172.21.15.152:0/804620659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe690102470 0x7fe69010e9a0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.207+0000 7fe6968a6640 1 --2- 172.21.15.152:0/804620659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe690101ad0 0x7fe690101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.207+0000 7fe6968a6640 1 --2- 172.21.15.152:0/804620659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe690107b70 0x7fe690107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.207+0000 7fe6968a6640 1 -- 172.21.15.152:0/804620659 >> 172.21.15.152:0/804620659 conn(0x7fe6900fd7d0 msgr2=0x7fe6900ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.207+0000 7fe6968a6640 1 -- 172.21.15.152:0/804620659 shutdown_connections 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.207+0000 7fe6968a6640 1 -- 172.21.15.152:0/804620659 wait complete. 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.207+0000 7fe6968a6640 1 Processor -- start 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.207+0000 7fe6968a6640 1 -- start start 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe6968a6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe690101ad0 0x7fe6900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe6968a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe690102470 0x7fe690074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe6968a6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe690107b70 0x7fe690074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe6968a6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe690111f30 con 0x7fe690102470 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe6968a6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe690111db0 con 0x7fe690107b70 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe6968a6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901120b0 con 0x7fe690101ad0 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe68f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe690102470 0x7fe690074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe68f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe690102470 0x7fe690074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33254/0 (socket says 172.21.15.152:33254) 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe68f7fe640 1 -- 172.21.15.152:0/3583464075 learned_addr learned my addr 172.21.15.152:0/3583464075 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe68ffff640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe690101ad0 0x7fe6900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe68f7fe640 1 -- 172.21.15.152:0/3583464075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe690101ad0 msgr2=0x7fe6900744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe690101ad0 0x7fe6900744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe694e43640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe690107b70 0x7fe690074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe68f7fe640 1 -- 172.21.15.152:0/3583464075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe690107b70 msgr2=0x7fe690074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe690107b70 0x7fe690074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe68f7fe640 1 -- 172.21.15.152:0/3583464075 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6901a66b0 con 0x7fe690102470 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.208+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe690102470 0x7fe690074a30 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c920 tx=0x7fe68400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.209+0000 7fe68d7fa640 1 -- 172.21.15.152:0/3583464075 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe684007bb0 con 0x7fe690102470 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.209+0000 7fe6968a6640 1 -- 172.21.15.152:0/3583464075 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6901a69a0 con 0x7fe690102470 2024-09-11T22:18:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.209+0000 7fe68d7fa640 1 -- 172.21.15.152:0/3583464075 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe684007d50 con 0x7fe690102470 2024-09-11T22:18:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.209+0000 7fe68d7fa640 1 -- 172.21.15.152:0/3583464075 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6840187d0 con 0x7fe690102470 2024-09-11T22:18:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.209+0000 7fe6968a6640 1 -- 172.21.15.152:0/3583464075 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6901a6ef0 con 0x7fe690102470 2024-09-11T22:18:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.211+0000 7fe68d7fa640 1 -- 172.21.15.152:0/3583464075 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe68400f450 con 0x7fe690102470 2024-09-11T22:18:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.211+0000 7fe69963b740 1 Processor -- start 2024-09-11T22:18:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.211+0000 7fe69963b740 1 -- start start 2024-09-11T22:18:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.211+0000 7fe69963b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309a3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.211+0000 7fe69963b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309a4410 0x560c309ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.211+0000 7fe69963b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309aecb0 0x560c309b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.211+0000 7fe69963b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560c309082f0 con 0x560c309a3af0 2024-09-11T22:18:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.211+0000 7fe69963b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560c308b0270 con 0x560c309aecb0 2024-09-11T22:18:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.211+0000 7fe69963b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560c309042b0 con 0x560c309a4410 2024-09-11T22:18:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe694e43640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309a3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe694e43640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309a3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33270/0 (socket says 172.21.15.152:33270) 2024-09-11T22:18:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe694e43640 1 -- 172.21.15.152:0/2312159869 learned_addr learned my addr 172.21.15.152:0/2312159869 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/2312159869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309aecb0 0x560c309b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe68ffff640 1 --2- 172.21.15.152:0/2312159869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309a4410 0x560c309ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe68d7fa640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe6780a2da0 0x7fe6780a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe694e43640 1 -- 172.21.15.152:0/2312159869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309a4410 msgr2=0x560c309ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe694e43640 1 --2- 172.21.15.152:0/2312159869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309a4410 0x560c309ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe694e43640 1 -- 172.21.15.152:0/2312159869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309aecb0 msgr2=0x560c309b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe694e43640 1 --2- 172.21.15.152:0/2312159869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309aecb0 0x560c309b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe694e43640 1 -- 172.21.15.152:0/2312159869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c308af340 con 0x560c309a3af0 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/2312159869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309aecb0 0x560c309b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe68d7fa640 1 -- 172.21.15.152:0/3583464075 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fe6840cf5f0 con 0x7fe690102470 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe694e43640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe6780a2da0 0x7fe6780a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe694e43640 1 --2- 172.21.15.152:0/2312159869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309a3ed0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe688009df0 tx=0x7fe688031570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ea00ca8a0d9a34 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.212+0000 7fe6767fc640 1 -- 172.21.15.152:0/2312159869 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688003970 con 0x560c309a3af0 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe6767fc640 1 -- 172.21.15.152:0/2312159869 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe688036040 con 0x560c309a3af0 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe6767fc640 1 -- 172.21.15.152:0/2312159869 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688047410 con 0x560c309a3af0 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe69963b740 1 -- 172.21.15.152:0/2312159869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 msgr2=0x560c309a3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe694e43640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe6780a2da0 0x7fe6780a5260 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe688048000 tx=0x7fe68804b000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe69963b740 1 --2- 172.21.15.152:0/2312159869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309a3ed0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe688009df0 tx=0x7fe688031570 comp rx=0 tx=0).stop 2024-09-11T22:18:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe69963b740 1 -- 172.21.15.152:0/2312159869 shutdown_connections 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe69963b740 1 --2- 172.21.15.152:0/2312159869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309aecb0 0x560c309b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe69963b740 1 --2- 172.21.15.152:0/2312159869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309a4410 0x560c309ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe69963b740 1 --2- 172.21.15.152:0/2312159869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309a3ed0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe69963b740 1 -- 172.21.15.152:0/2312159869 >> 172.21.15.152:0/2312159869 conn(0x560c309a0060 msgr2=0x560c309a0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe69963b740 1 -- 172.21.15.152:0/2312159869 shutdown_connections 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.213+0000 7fe69963b740 1 -- 172.21.15.152:0/2312159869 wait complete. 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe69963b740 1 -- start start 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe69963b740 1 Processor -- start 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe69963b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe69963b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a4410 0x560c309ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe69963b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309aecb0 0x560c309ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe69963b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560c309b1880 con 0x560c309a3af0 2024-09-11T22:18:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe69963b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560c30891290 con 0x560c309a4410 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe69963b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560c309b1a00 con 0x560c309aecb0 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe69963b740 10 client.0 _ll_register_callbacks cb 0x560c308c2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe68ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe68ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33280/0 (socket says 172.21.15.152:33280) 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe68ffff640 1 -- 172.21.15.152:0/3109751719 learned_addr learned my addr 172.21.15.152:0/3109751719 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.214+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a4410 0x560c309ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe694e43640 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309aecb0 0x560c309ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe68ffff640 1 -- 172.21.15.152:0/3109751719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309aecb0 msgr2=0x560c309ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe68ffff640 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309aecb0 0x560c309ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe68ffff640 1 -- 172.21.15.152:0/3109751719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a4410 msgr2=0x560c309ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe68ffff640 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a4410 0x560c309ac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe68ffff640 1 -- 172.21.15.152:0/3109751719 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c3061b210 con 0x560c309a3af0 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe68ffff640 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309abb80 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe680012780 tx=0x7fe680012b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5441db7b0e5abf94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe66f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3109751719 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68001f060 con 0x560c309a3af0 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3109751719 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fe680010dc0 con 0x560c309a3af0 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe69963b740 1 -- 172.21.15.152:0/3109751719 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe688036040 con 0x560c309a3af0 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3109751719 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe68001a430 con 0x560c309a3af0 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe69963b740 10 client.18972 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe69963b740 1 -- 172.21.15.152:0/3109751719 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560c306e7620 con 0x560c309a3af0 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.215+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3109751719 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe688036040 con 0x560c309a3af0 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.216+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3109751719 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe68000e590 con 0x560c309a3af0 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.216+0000 7fe69963b740 10 client.18972 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.216+0000 7fe69963b740 10 client.18972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.216+0000 7fe69963b740 20 client.18972 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:30.709 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.216+0000 7fe69963b740 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c309bec50 0x560c309c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.709 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.216+0000 7fe69963b740 4 client.18972 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.216+0000 7fe69963b740 1 -- 172.21.15.152:0/3109751719 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c30915a20 con 0x560c309bec50 2024-09-11T22:18:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.216+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c309bec50 0x560c309c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.216+0000 7fe66f7fe640 10 client.18972 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.216+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c309bec50 0x560c309c10a0 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7d7b097e3b98d4b server_cookie=c2c0e1bbff47cc9a in_seq=0 out_seq=0 2024-09-11T22:18:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3109751719 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c30915a20 con 0x560c309bec50 2024-09-11T22:18:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe66f7fe640 10 client.18972 handle_command_reply: tid=0 2024-09-11T22:18:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 1 client.18972 shutdown 2024-09-11T22:18:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 1 -- 172.21.15.152:0/3109751719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 msgr2=0x560c309abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309abb80 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe680012780 tx=0x7fe680012b80 comp rx=0 tx=0).stop 2024-09-11T22:18:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 1 -- 172.21.15.152:0/3109751719 shutdown_connections 2024-09-11T22:18:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c309bec50 0x560c309c10a0 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309aecb0 0x560c309ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a4410 0x560c309ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 1 --2- 172.21.15.152:0/3109751719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a3af0 0x560c309abb80 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe66f7fe640 0 client.18972 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 1 -- 172.21.15.152:0/3109751719 >> 172.21.15.152:0/3109751719 conn(0x560c309a0060 msgr2=0x560c3099f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 1 -- 172.21.15.152:0/3109751719 shutdown_connections 2024-09-11T22:18:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 1 -- 172.21.15.152:0/3109751719 wait complete. 2024-09-11T22:18:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.217+0000 7fe69963b740 20 client.18972 trim_cache size 0 max 16384 2024-09-11T22:18:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.231+0000 7fe69963b740 1 Processor -- start 2024-09-11T22:18:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe69963b740 1 -- start start 2024-09-11T22:18:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe69963b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309a3af0 0x560c309ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe69963b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a4410 0x560c309c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe69963b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309aecb0 0x560c309c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe69963b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901b2250 con 0x560c309aecb0 2024-09-11T22:18:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe69963b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901afb20 con 0x560c309a4410 2024-09-11T22:18:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe69963b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901ad990 con 0x560c309a3af0 2024-09-11T22:18:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe694e43640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309aecb0 0x560c309c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe694e43640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309aecb0 0x560c309c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33284/0 (socket says 172.21.15.152:33284) 2024-09-11T22:18:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe694e43640 1 -- 172.21.15.152:0/627744221 learned_addr learned my addr 172.21.15.152:0/627744221 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/627744221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a4410 0x560c309c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe68ffff640 1 --2- 172.21.15.152:0/627744221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309a3af0 0x560c309ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe694e43640 1 -- 172.21.15.152:0/627744221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309a3af0 msgr2=0x560c309ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe694e43640 1 --2- 172.21.15.152:0/627744221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309a3af0 0x560c309ac430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe694e43640 1 -- 172.21.15.152:0/627744221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a4410 msgr2=0x560c309c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe694e43640 1 --2- 172.21.15.152:0/627744221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a4410 0x560c309c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe694e43640 1 -- 172.21.15.152:0/627744221 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c3099a2f0 con 0x560c309aecb0 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe694e43640 1 --2- 172.21.15.152:0/627744221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309aecb0 0x560c309c6ef0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe688049040 tx=0x7fe68804f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef36cb582feae5d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.232+0000 7fe675ffb640 1 -- 172.21.15.152:0/627744221 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688003970 con 0x560c309aecb0 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe675ffb640 1 -- 172.21.15.152:0/627744221 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe688060070 con 0x560c309aecb0 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe675ffb640 1 -- 172.21.15.152:0/627744221 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688004da0 con 0x560c309aecb0 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe69963b740 1 -- 172.21.15.152:0/627744221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309aecb0 msgr2=0x560c309c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe69963b740 1 --2- 172.21.15.152:0/627744221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309aecb0 0x560c309c6ef0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe688049040 tx=0x7fe68804f000 comp rx=0 tx=0).stop 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe69963b740 1 -- 172.21.15.152:0/627744221 shutdown_connections 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe69963b740 1 --2- 172.21.15.152:0/627744221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309aecb0 0x560c309c6ef0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe69963b740 1 --2- 172.21.15.152:0/627744221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a4410 0x560c309c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe69963b740 1 --2- 172.21.15.152:0/627744221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309a3af0 0x560c309ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe69963b740 1 -- 172.21.15.152:0/627744221 >> 172.21.15.152:0/627744221 conn(0x560c309a0060 msgr2=0x560c309adc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe69963b740 1 -- 172.21.15.152:0/627744221 shutdown_connections 2024-09-11T22:18:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe69963b740 1 -- 172.21.15.152:0/627744221 wait complete. 2024-09-11T22:18:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.233+0000 7fe69963b740 1 -- start start 2024-09-11T22:18:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe69963b740 1 Processor -- start 2024-09-11T22:18:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe69963b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a3af0 0x560c309b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe69963b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a4410 0x560c309b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe69963b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309aecb0 0x560c309b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe69963b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901adfe0 con 0x560c309a4410 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe69963b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901af450 con 0x560c309a3af0 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe69963b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901ae6b0 con 0x560c309aecb0 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe69963b740 10 client.0 _ll_register_callbacks cb 0x7fe68000a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe68f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a4410 0x560c309b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe68f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a4410 0x560c309b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33294/0 (socket says 172.21.15.152:33294) 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe68f7fe640 1 -- 172.21.15.152:0/3311217827 learned_addr learned my addr 172.21.15.152:0/3311217827 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe694e43640 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309aecb0 0x560c309b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe68ffff640 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a3af0 0x560c309b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe68f7fe640 1 -- 172.21.15.152:0/3311217827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309aecb0 msgr2=0x560c309b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309aecb0 0x560c309b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe68f7fe640 1 -- 172.21.15.152:0/3311217827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a3af0 msgr2=0x560c309b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a3af0 0x560c309b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe68f7fe640 1 -- 172.21.15.152:0/3311217827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c309b30b0 con 0x560c309a4410 2024-09-11T22:18:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe694e43640 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309aecb0 0x560c309b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe68ffff640 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a3af0 0x560c309b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe68f7fe640 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a4410 0x560c309b2530 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe6840ccd40 tx=0x7fe68400fe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f7a8e9ab09aa86 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.234+0000 7fe66f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3311217827 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6840b3070 con 0x560c309a4410 2024-09-11T22:18:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3311217827 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fe68400fa30 con 0x560c309a4410 2024-09-11T22:18:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe69963b740 1 -- 172.21.15.152:0/3311217827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe688060070 con 0x560c309a4410 2024-09-11T22:18:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3311217827 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe6840d5040 con 0x560c309a4410 2024-09-11T22:18:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe69963b740 10 client.18978 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe69963b740 1 -- 172.21.15.152:0/3311217827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560c30a29820 con 0x560c309a4410 2024-09-11T22:18:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3311217827 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe688060070 con 0x560c309a4410 2024-09-11T22:18:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3311217827 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fe684098120 con 0x560c309a4410 2024-09-11T22:18:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe69963b740 10 client.18978 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe69963b740 10 client.18978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe69963b740 20 client.18978 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe69963b740 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c30a29f80 0x560c30a2c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe69963b740 4 client.18978 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:18:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe69963b740 1 -- 172.21.15.152:0/3311217827 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560c3090fd70 con 0x560c30a29f80 2024-09-11T22:18:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.235+0000 7fe68ffff640 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c30a29f80 0x560c30a2c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.236+0000 7fe66f7fe640 10 client.18978 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.236+0000 7fe68ffff640 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c30a29f80 0x560c30a2c3a0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7150557edcfa7030 server_cookie=c14c28a4d8d343d0 in_seq=0 out_seq=0 2024-09-11T22:18:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe66f7fe640 1 -- 172.21.15.152:0/3311217827 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560c3090fd70 con 0x560c30a29f80 2024-09-11T22:18:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe66f7fe640 10 client.18978 handle_command_reply: tid=0 2024-09-11T22:18:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 1 client.18978 shutdown 2024-09-11T22:18:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 1 -- 172.21.15.152:0/3311217827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a4410 msgr2=0x560c309b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a4410 0x560c309b2530 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe6840ccd40 tx=0x7fe68400fe30 comp rx=0 tx=0).stop 2024-09-11T22:18:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 1 -- 172.21.15.152:0/3311217827 shutdown_connections 2024-09-11T22:18:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560c30a29f80 0x560c30a2c3a0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c309aecb0 0x560c309b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe66f7fe640 0 client.18978 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c309a4410 0x560c309b2530 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 1 --2- 172.21.15.152:0/3311217827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c309a3af0 0x560c309b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 1 -- 172.21.15.152:0/3311217827 >> 172.21.15.152:0/3311217827 conn(0x560c309a0060 msgr2=0x560c3099e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 1 -- 172.21.15.152:0/3311217827 shutdown_connections 2024-09-11T22:18:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 1 -- 172.21.15.152:0/3311217827 wait complete. 2024-09-11T22:18:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.245+0000 7fe69963b740 20 client.18978 trim_cache size 0 max 16384 2024-09-11T22:18:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:18:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:18:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:18:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:18:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 -- 172.21.15.152:0/3583464075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe6780a2da0 msgr2=0x7fe6780a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe6780a2da0 0x7fe6780a5260 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe688048000 tx=0x7fe68804b000 comp rx=0 tx=0).stop 2024-09-11T22:18:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 -- 172.21.15.152:0/3583464075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe690102470 msgr2=0x7fe690074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe690102470 0x7fe690074a30 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c920 tx=0x7fe68400cd20 comp rx=0 tx=0).stop 2024-09-11T22:18:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 -- 172.21.15.152:0/3583464075 shutdown_connections 2024-09-11T22:18:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fe6780a2da0 0x7fe6780a5260 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe690107b70 0x7fe690074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe690102470 0x7fe690074a30 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 --2- 172.21.15.152:0/3583464075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe690101ad0 0x7fe6900744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 -- 172.21.15.152:0/3583464075 >> 172.21.15.152:0/3583464075 conn(0x7fe6900fd7d0 msgr2=0x7fe6900fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 -- 172.21.15.152:0/3583464075 shutdown_connections 2024-09-11T22:18:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:30.246+0000 7fe6968a6640 1 -- 172.21.15.152:0/3583464075 wait complete. 2024-09-11T22:18:30.727 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:30 smithi152 ceph-mon[31188]: pgmap v445: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.1 MiB/s wr, 820 op/s 2024-09-11T22:18:30.977 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:31.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.416+0000 7f597c2ae640 1 -- 172.21.15.152:0/2040835609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5974103660 msgr2=0x7f597410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:31.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.416+0000 7f597c2ae640 1 --2- 172.21.15.152:0/2040835609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5974103660 0x7f597410bb50 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f5964009900 tx=0x7f596402a480 comp rx=0 tx=0).stop 2024-09-11T22:18:31.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.417+0000 7f597c2ae640 1 -- 172.21.15.152:0/2040835609 shutdown_connections 2024-09-11T22:18:31.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.417+0000 7f597c2ae640 1 --2- 172.21.15.152:0/2040835609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f597410c170 0x7f597410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.417+0000 7f597c2ae640 1 --2- 172.21.15.152:0/2040835609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5974103660 0x7f597410bb50 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.417+0000 7f597c2ae640 1 --2- 172.21.15.152:0/2040835609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5974102d40 0x7f5974103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.417+0000 7f597c2ae640 1 -- 172.21.15.152:0/2040835609 >> 172.21.15.152:0/2040835609 conn(0x7f59740fc7a0 msgr2=0x7f59740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:31.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.417+0000 7f597c2ae640 1 -- 172.21.15.152:0/2040835609 shutdown_connections 2024-09-11T22:18:31.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.417+0000 7f597c2ae640 1 -- 172.21.15.152:0/2040835609 wait complete. 2024-09-11T22:18:31.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.417+0000 7f597c2ae640 1 Processor -- start 2024-09-11T22:18:31.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.418+0000 7f597c2ae640 1 -- start start 2024-09-11T22:18:31.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.418+0000 7f597c2ae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5974102d40 0x7f5974198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.418+0000 7f597c2ae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5974103660 0x7f59741989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.418+0000 7f597c2ae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f597410c170 0x7f597419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.418+0000 7f597c2ae640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5974111fd0 con 0x7f5974103660 2024-09-11T22:18:31.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.418+0000 7f597c2ae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5974111e50 con 0x7f5974102d40 2024-09-11T22:18:31.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.418+0000 7f597c2ae640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5974112150 con 0x7f597410c170 2024-09-11T22:18:31.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f5979849640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5974103660 0x7f59741989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f5979849640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5974103660 0x7f59741989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33316/0 (socket says 172.21.15.152:33316) 2024-09-11T22:18:31.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f5979849640 1 -- 172.21.15.152:0/1184255672 learned_addr learned my addr 172.21.15.152:0/1184255672 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:31.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f597a04a640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5974102d40 0x7f5974198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f597a84b640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f597410c170 0x7f597419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f5979849640 1 -- 172.21.15.152:0/1184255672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f597410c170 msgr2=0x7f597419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:31.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f5979849640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f597410c170 0x7f597419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f5979849640 1 -- 172.21.15.152:0/1184255672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5974102d40 msgr2=0x7f5974198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:31.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f5979849640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5974102d40 0x7f5974198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f5979849640 1 -- 172.21.15.152:0/1184255672 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597419d440 con 0x7f5974103660 2024-09-11T22:18:31.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f5979849640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5974103660 0x7f59741989d0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f5964005ab0 tx=0x7f59640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:31.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f596b7fe640 1 -- 172.21.15.152:0/1184255672 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596403f030 con 0x7f5974103660 2024-09-11T22:18:31.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f596b7fe640 1 -- 172.21.15.152:0/1184255672 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5964003ce0 con 0x7f5974103660 2024-09-11T22:18:31.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f597c2ae640 1 -- 172.21.15.152:0/1184255672 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597419d6d0 con 0x7f5974103660 2024-09-11T22:18:31.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.419+0000 7f596b7fe640 1 -- 172.21.15.152:0/1184255672 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964035070 con 0x7f5974103660 2024-09-11T22:18:31.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.420+0000 7f597c2ae640 1 -- 172.21.15.152:0/1184255672 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59741a5010 con 0x7f5974103660 2024-09-11T22:18:31.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.422+0000 7f596b7fe640 1 -- 172.21.15.152:0/1184255672 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f5964042030 con 0x7f5974103660 2024-09-11T22:18:31.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.422+0000 7f597e687740 1 Processor -- start 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.422+0000 7f597e687740 1 -- start start 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.422+0000 7f596b7fe640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59600a2cf0 0x7f59600a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f597e687740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f2b40 0x560c204f1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f597e687740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f597e687740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204fe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f597e687740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560c204572f0 con 0x560c204f15d0 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f597e687740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560c203fecf0 con 0x560c204fc370 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f597e687740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560c204532b0 con 0x560c204f2b40 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f597a84b640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59600a2cf0 0x7f59600a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f596b7fe640 1 -- 172.21.15.152:0/1184255672 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f59640efcc0 con 0x7f5974103660 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f5979849640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f5979849640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204f1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33332/0 (socket says 172.21.15.152:33332) 2024-09-11T22:18:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f5979849640 1 -- 172.21.15.152:0/4140243040 learned_addr learned my addr 172.21.15.152:0/4140243040 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f597a04a640 1 --2- 172.21.15.152:0/4140243040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f2b40 0x560c204f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f597a84b640 1 --2- 172.21.15.152:0/4140243040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f5979849640 1 -- 172.21.15.152:0/4140243040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f2b40 msgr2=0x560c204f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f5979849640 1 --2- 172.21.15.152:0/4140243040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f2b40 0x560c204f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f5979849640 1 -- 172.21.15.152:0/4140243040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 msgr2=0x560c204fe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f5979849640 1 --2- 172.21.15.152:0/4140243040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204fe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f5979849640 1 -- 172.21.15.152:0/4140243040 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c203e33a0 con 0x560c204f15d0 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f597a84b640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59600a2cf0 0x7f59600a51b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f596c009900 tx=0x7f596c00aba0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.423+0000 7f5979849640 1 --2- 172.21.15.152:0/4140243040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204f1a10 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f59640b8ba0 tx=0x7f59640bc060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f7efd43b67212a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f5968dea640 1 -- 172.21.15.152:0/4140243040 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964049070 con 0x560c204f15d0 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f5968dea640 1 -- 172.21.15.152:0/4140243040 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f596402d1c0 con 0x560c204f15d0 2024-09-11T22:18:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f5968dea640 1 -- 172.21.15.152:0/4140243040 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596403bd00 con 0x560c204f15d0 2024-09-11T22:18:31.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f597e687740 1 -- 172.21.15.152:0/4140243040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 msgr2=0x560c204f1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:31.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f597e687740 1 --2- 172.21.15.152:0/4140243040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204f1a10 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f59640b8ba0 tx=0x7f59640bc060 comp rx=0 tx=0).stop 2024-09-11T22:18:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f597e687740 1 -- 172.21.15.152:0/4140243040 shutdown_connections 2024-09-11T22:18:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f597e687740 1 --2- 172.21.15.152:0/4140243040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204fe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f597e687740 1 --2- 172.21.15.152:0/4140243040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204f1a10 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f597e687740 1 --2- 172.21.15.152:0/4140243040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f2b40 0x560c204f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f597e687740 1 -- 172.21.15.152:0/4140243040 >> 172.21.15.152:0/4140243040 conn(0x560c204ba310 msgr2=0x560c204edc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f597e687740 1 -- 172.21.15.152:0/4140243040 shutdown_connections 2024-09-11T22:18:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.424+0000 7f597e687740 1 -- 172.21.15.152:0/4140243040 wait complete. 2024-09-11T22:18:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597e687740 1 -- start start 2024-09-11T22:18:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597e687740 1 Processor -- start 2024-09-11T22:18:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597e687740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204fbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597e687740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f2b40 0x560c204f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597e687740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597e687740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560c204572f0 con 0x560c204f15d0 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597e687740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560c20412060 con 0x560c204fc370 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597e687740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560c204fee30 con 0x560c204f2b40 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597e687740 10 client.0 _ll_register_callbacks cb 0x560c201658c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597a04a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204fbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597a04a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204fbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33342/0 (socket says 172.21.15.152:33342) 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597a04a640 1 -- 172.21.15.152:0/4017649871 learned_addr learned my addr 172.21.15.152:0/4017649871 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f5979849640 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f2b40 0x560c204f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597a04a640 1 -- 172.21.15.152:0/4017649871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f2b40 msgr2=0x560c204f90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597a04a640 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f2b40 0x560c204f90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597a04a640 1 -- 172.21.15.152:0/4017649871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 msgr2=0x560c204f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.425+0000 7f597a04a640 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f597a04a640 1 -- 172.21.15.152:0/4017649871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c201c83c0 con 0x560c204f15d0 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f597a04a640 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204fbdf0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5970010a50 tx=0x7f5970010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7003977237bde03 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f595dffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f595dffb640 1 -- 172.21.15.152:0/4017649871 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597000fbd0 con 0x560c204f15d0 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f595dffb640 1 -- 172.21.15.152:0/4017649871 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f597000fd70 con 0x560c204f15d0 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f597e687740 1 -- 172.21.15.152:0/4017649871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f596402d1c0 con 0x560c204f15d0 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f595dffb640 1 -- 172.21.15.152:0/4017649871 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5970004020 con 0x560c204f15d0 2024-09-11T22:18:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f597e687740 10 client.18990 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f597e687740 1 -- 172.21.15.152:0/4017649871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560c2050a840 con 0x560c204f15d0 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f595dffb640 1 -- 172.21.15.152:0/4017649871 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f596402d1c0 con 0x560c204f15d0 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f595dffb640 1 -- 172.21.15.152:0/4017649871 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5970019410 con 0x560c204f15d0 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f597e687740 10 client.18990 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f597e687740 10 client.18990 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f597e687740 20 client.18990 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f597e687740 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x560c2050bdf0 0x560c2050e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f597e687740 4 client.18990 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.426+0000 7f597e687740 1 -- 172.21.15.152:0/4017649871 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c20464860 con 0x560c2050bdf0 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.427+0000 7f5979849640 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x560c2050bdf0 0x560c2050e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.427+0000 7f5979849640 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x560c2050bdf0 0x560c2050e290 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a9ab5e93bcf1ce1 server_cookie=33840dd7f7424094 in_seq=0 out_seq=0 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.427+0000 7f595dffb640 10 client.18990 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:18:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f595dffb640 1 -- 172.21.15.152:0/4017649871 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c20464860 con 0x560c2050bdf0 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f595dffb640 10 client.18990 handle_command_reply: tid=0 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 1 client.18990 shutdown 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 1 -- 172.21.15.152:0/4017649871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 msgr2=0x560c204fbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204fbdf0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5970010a50 tx=0x7f5970010f10 comp rx=0 tx=0).stop 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 1 -- 172.21.15.152:0/4017649871 shutdown_connections 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x560c2050bdf0 0x560c2050e290 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f2b40 0x560c204f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f595dffb640 0 client.18990 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 1 --2- 172.21.15.152:0/4017649871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f15d0 0x560c204fbdf0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 1 -- 172.21.15.152:0/4017649871 >> 172.21.15.152:0/4017649871 conn(0x560c204ba310 msgr2=0x560c204f3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 1 -- 172.21.15.152:0/4017649871 shutdown_connections 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 1 -- 172.21.15.152:0/4017649871 wait complete. 2024-09-11T22:18:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.428+0000 7f597e687740 20 client.18990 trim_cache size 0 max 16384 2024-09-11T22:18:31.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f597e687740 1 Processor -- start 2024-09-11T22:18:31.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f597e687740 1 -- start start 2024-09-11T22:18:31.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f597e687740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204f15d0 0x560c204f8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f597e687740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c20507f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f597e687740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204fc370 0x560c204f4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f597e687740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59741b02a0 con 0x560c204f2b40 2024-09-11T22:18:31.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f597e687740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f59741adb70 con 0x560c204f15d0 2024-09-11T22:18:31.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f597e687740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f59741ab9e0 con 0x560c204fc370 2024-09-11T22:18:31.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f5979849640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c20507f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f5979849640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c20507f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33354/0 (socket says 172.21.15.152:33354) 2024-09-11T22:18:31.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f5979849640 1 -- 172.21.15.152:0/2049883590 learned_addr learned my addr 172.21.15.152:0/2049883590 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:31.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f597a04a640 1 --2- 172.21.15.152:0/2049883590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204f15d0 0x560c204f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f597a84b640 1 --2- 172.21.15.152:0/2049883590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204fc370 0x560c204f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f5979849640 1 -- 172.21.15.152:0/2049883590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204fc370 msgr2=0x560c204f4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f5979849640 1 --2- 172.21.15.152:0/2049883590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204fc370 0x560c204f4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f5979849640 1 -- 172.21.15.152:0/2049883590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204f15d0 msgr2=0x560c204f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f5979849640 1 --2- 172.21.15.152:0/2049883590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204f15d0 0x560c204f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f5979849640 1 -- 172.21.15.152:0/2049883590 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c204fc160 con 0x560c204f2b40 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.441+0000 7f597a04a640 1 --2- 172.21.15.152:0/2049883590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204f15d0 0x560c204f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f597a84b640 1 --2- 172.21.15.152:0/2049883590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204fc370 0x560c204f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f5979849640 1 --2- 172.21.15.152:0/2049883590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c20507f50 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f5964005ec0 tx=0x7f596402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f81f020597a8e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f595ffff640 1 -- 172.21.15.152:0/2049883590 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640d4030 con 0x560c204f2b40 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f595ffff640 1 -- 172.21.15.152:0/2049883590 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59640bc1d0 con 0x560c204f2b40 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f595ffff640 1 -- 172.21.15.152:0/2049883590 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964049040 con 0x560c204f2b40 2024-09-11T22:18:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f597e687740 1 -- 172.21.15.152:0/2049883590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 msgr2=0x560c20507f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f597e687740 1 --2- 172.21.15.152:0/2049883590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c20507f50 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f5964005ec0 tx=0x7f596402a480 comp rx=0 tx=0).stop 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f597e687740 1 -- 172.21.15.152:0/2049883590 shutdown_connections 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f597e687740 1 --2- 172.21.15.152:0/2049883590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204fc370 0x560c204f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f597e687740 1 --2- 172.21.15.152:0/2049883590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c20507f50 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f597e687740 1 --2- 172.21.15.152:0/2049883590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204f15d0 0x560c204f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.442+0000 7f597e687740 1 -- 172.21.15.152:0/2049883590 >> 172.21.15.152:0/2049883590 conn(0x560c204ba310 msgr2=0x560c204f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597e687740 1 -- 172.21.15.152:0/2049883590 shutdown_connections 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597e687740 1 -- 172.21.15.152:0/2049883590 wait complete. 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597e687740 1 -- start start 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597e687740 1 Processor -- start 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597e687740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f15d0 0x560c205044a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597e687740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c205049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597e687740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204ffa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597e687740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59741ac030 con 0x560c204f2b40 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597e687740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f59741ad4a0 con 0x560c204fc370 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597e687740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f59741ac700 con 0x560c204f15d0 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597e687740 10 client.0 _ll_register_callbacks cb 0x7f597000a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f5979849640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c205049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f5979849640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c205049e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33366/0 (socket says 172.21.15.152:33366) 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f5979849640 1 -- 172.21.15.152:0/2518145447 learned_addr learned my addr 172.21.15.152:0/2518145447 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597a04a640 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f15d0 0x560c205044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.443+0000 7f597a84b640 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204ffa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f5979849640 1 -- 172.21.15.152:0/2518145447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f15d0 msgr2=0x560c205044a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f5979849640 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f15d0 0x560c205044a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f5979849640 1 -- 172.21.15.152:0/2518145447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 msgr2=0x560c204ffa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f5979849640 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204ffa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f5979849640 1 -- 172.21.15.152:0/2518145447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c20500250 con 0x560c204f2b40 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f597a84b640 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f5979849640 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c205049e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f59640bbed0 tx=0x7f5964005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1719d4b0e63782 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f595dffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f595dffb640 1 -- 172.21.15.152:0/2518145447 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640d4040 con 0x560c204f2b40 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f595dffb640 1 -- 172.21.15.152:0/2518145447 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f59640ba4d0 con 0x560c204f2b40 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f597e687740 1 -- 172.21.15.152:0/2518145447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59640bc1d0 con 0x560c204f2b40 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f595dffb640 1 -- 172.21.15.152:0/2518145447 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5964049040 con 0x560c204f2b40 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f597e687740 10 client.18996 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f597e687740 1 -- 172.21.15.152:0/2518145447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560c20576750 con 0x560c204f2b40 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f595dffb640 1 -- 172.21.15.152:0/2518145447 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59640bc1d0 con 0x560c204f2b40 2024-09-11T22:18:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f595dffb640 1 -- 172.21.15.152:0/2518145447 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5964047120 con 0x560c204f2b40 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f597e687740 10 client.18996 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f597e687740 10 client.18996 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f597e687740 20 client.18996 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f597e687740 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x560c20576a40 0x560c20578e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f597e687740 4 client.18996 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.444+0000 7f597e687740 1 -- 172.21.15.152:0/2518145447 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c2045ed70 con 0x560c20576a40 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.445+0000 7f597a04a640 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x560c20576a40 0x560c20578e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.445+0000 7f597a04a640 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x560c20576a40 0x560c20578e60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7d9b3595bb4b0872 server_cookie=51497fae1b964c46 in_seq=0 out_seq=0 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.445+0000 7f595dffb640 10 client.18996 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.445+0000 7f595dffb640 1 -- 172.21.15.152:0/2518145447 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c2045ed70 con 0x560c20576a40 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.445+0000 7f595dffb640 10 client.18996 handle_command_reply: tid=0 2024-09-11T22:18:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.445+0000 7f597e687740 1 client.18996 shutdown 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597e687740 1 -- 172.21.15.152:0/2518145447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 msgr2=0x560c205049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597e687740 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c205049e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f59640bbed0 tx=0x7f5964005b70 comp rx=0 tx=0).stop 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597e687740 1 -- 172.21.15.152:0/2518145447 shutdown_connections 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597e687740 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x560c20576a40 0x560c20578e60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597e687740 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c204fc370 0x560c204ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597e687740 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560c204f2b40 0x560c205049e0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f595dffb640 0 client.18996 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597e687740 1 --2- 172.21.15.152:0/2518145447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560c204f15d0 0x560c205044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597e687740 1 -- 172.21.15.152:0/2518145447 >> 172.21.15.152:0/2518145447 conn(0x560c204ba310 msgr2=0x560c204ec4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597e687740 1 -- 172.21.15.152:0/2518145447 shutdown_connections 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597e687740 1 -- 172.21.15.152:0/2518145447 wait complete. 2024-09-11T22:18:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597e687740 20 client.18996 trim_cache size 0 max 16384 2024-09-11T22:18:31.454 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:18:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597c2ae640 1 -- 172.21.15.152:0/1184255672 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59600a2cf0 msgr2=0x7f59600a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597c2ae640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59600a2cf0 0x7f59600a51b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f596c009900 tx=0x7f596c00aba0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597c2ae640 1 -- 172.21.15.152:0/1184255672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5974103660 msgr2=0x7f59741989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597c2ae640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5974103660 0x7f59741989d0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f5964005ab0 tx=0x7f59640042f0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597c2ae640 1 -- 172.21.15.152:0/1184255672 shutdown_connections 2024-09-11T22:18:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597c2ae640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59600a2cf0 0x7f59600a51b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597c2ae640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f597410c170 0x7f597419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597c2ae640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5974103660 0x7f59741989d0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597c2ae640 1 --2- 172.21.15.152:0/1184255672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5974102d40 0x7f5974198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597c2ae640 1 -- 172.21.15.152:0/1184255672 >> 172.21.15.152:0/1184255672 conn(0x7f59740fc7a0 msgr2=0x7f59740fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.446+0000 7f597c2ae640 1 -- 172.21.15.152:0/1184255672 shutdown_connections 2024-09-11T22:18:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:31.447+0000 7f597c2ae640 1 -- 172.21.15.152:0/1184255672 wait complete. 2024-09-11T22:18:32.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:31 smithi179 ceph-mon[35603]: pgmap v446: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.7 MiB/s wr, 266 op/s 2024-09-11T22:18:32.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:31 smithi193 ceph-mon[35545]: pgmap v446: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.7 MiB/s wr, 266 op/s 2024-09-11T22:18:32.216 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:31 smithi152 ceph-mon[31188]: pgmap v446: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.7 MiB/s wr, 266 op/s 2024-09-11T22:18:32.247 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:18:32.495 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:33.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.957+0000 7f571b12d640 1 -- 172.21.15.152:0/1331461976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714101de0 msgr2=0x7f57141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:33.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.957+0000 7f571b12d640 1 --2- 172.21.15.152:0/1331461976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714101de0 0x7f57141021c0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f5708009900 tx=0x7f570802a410 comp rx=0 tx=0).stop 2024-09-11T22:18:33.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.957+0000 7f571b12d640 1 -- 172.21.15.152:0/1331461976 shutdown_connections 2024-09-11T22:18:33.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.957+0000 7f571b12d640 1 --2- 172.21.15.152:0/1331461976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5714106f10 0x7f571410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.957+0000 7f571b12d640 1 --2- 172.21.15.152:0/1331461976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5714102790 0x7f57141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.957+0000 7f571b12d640 1 --2- 172.21.15.152:0/1331461976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714101de0 0x7f57141021c0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.957+0000 7f571b12d640 1 -- 172.21.15.152:0/1331461976 >> 172.21.15.152:0/1331461976 conn(0x7f57140fd8c0 msgr2=0x7f57140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:33.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.957+0000 7f571b12d640 1 -- 172.21.15.152:0/1331461976 shutdown_connections 2024-09-11T22:18:33.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.957+0000 7f571b12d640 1 -- 172.21.15.152:0/1331461976 wait complete. 2024-09-11T22:18:33.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f571b12d640 1 Processor -- start 2024-09-11T22:18:33.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f571b12d640 1 -- start start 2024-09-11T22:18:33.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f571b12d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5714101de0 0x7f57140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f571b12d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5714102790 0x7f5714074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f571b12d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714106f10 0x7f5714074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f571b12d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5714111f70 con 0x7f5714106f10 2024-09-11T22:18:33.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f571b12d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5714111df0 con 0x7f5714101de0 2024-09-11T22:18:33.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f571b12d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57141120f0 con 0x7f5714102790 2024-09-11T22:18:33.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f57196ca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714106f10 0x7f5714074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f57196ca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714106f10 0x7f5714074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33374/0 (socket says 172.21.15.152:33374) 2024-09-11T22:18:33.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f57196ca640 1 -- 172.21.15.152:0/68366790 learned_addr learned my addr 172.21.15.152:0/68366790 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f5718ec9640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5714101de0 0x7f57140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f5713fff640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5714102790 0x7f5714074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f57196ca640 1 -- 172.21.15.152:0/68366790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5714102790 msgr2=0x7f5714074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f57196ca640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5714102790 0x7f5714074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f57196ca640 1 -- 172.21.15.152:0/68366790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5714101de0 msgr2=0x7f57140744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f57196ca640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5714101de0 0x7f57140744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f57196ca640 1 -- 172.21.15.152:0/68366790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57141a6910 con 0x7f5714106f10 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f5713fff640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5714102790 0x7f5714074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.958+0000 7f57196ca640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714106f10 0x7f5714074f70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f570c00eaa0 tx=0x7f570c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.959+0000 7f5711ffb640 1 -- 172.21.15.152:0/68366790 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c00cdb0 con 0x7f5714106f10 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.959+0000 7f571b12d640 1 -- 172.21.15.152:0/68366790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57141a6c00 con 0x7f5714106f10 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.959+0000 7f5711ffb640 1 -- 172.21.15.152:0/68366790 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f570c005020 con 0x7f5714106f10 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.959+0000 7f5711ffb640 1 -- 172.21.15.152:0/68366790 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0116b0 con 0x7f5714106f10 2024-09-11T22:18:33.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.959+0000 7f571b12d640 1 -- 172.21.15.152:0/68366790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57141a7140 con 0x7f5714106f10 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.961+0000 7f5711ffb640 1 -- 172.21.15.152:0/68366790 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f570c005560 con 0x7f5714106f10 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f571d506740 1 Processor -- start 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f571d506740 1 -- start start 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f571d506740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba7771d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f571d506740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba7771da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f571d506740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba7772a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f5711ffb640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57040a2cf0 0x7f57040a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f571d506740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ba776832f0 con 0x55ba7771d5d0 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f571d506740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ba7762acf0 con 0x55ba77728370 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f571d506740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ba7767f2b0 con 0x55ba7771eb40 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f5718ec9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba7771da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f5713fff640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57040a2cf0 0x7f57040a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f5718ec9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba7771da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33388/0 (socket says 172.21.15.152:33388) 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f5718ec9640 1 -- 172.21.15.152:0/2345364756 learned_addr learned my addr 172.21.15.152:0/2345364756 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f5711ffb640 1 -- 172.21.15.152:0/68366790 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f570c0cf710 con 0x7f5714106f10 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f57196ca640 1 --2- 172.21.15.152:0/2345364756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba7772a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.962+0000 7f5713fff640 1 --2- 172.21.15.152:0/2345364756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba7771d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.963+0000 7f5718ec9640 1 -- 172.21.15.152:0/2345364756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 msgr2=0x55ba7771d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.963+0000 7f5718ec9640 1 --2- 172.21.15.152:0/2345364756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba7771d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.963+0000 7f5718ec9640 1 -- 172.21.15.152:0/2345364756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 msgr2=0x55ba7772a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.963+0000 7f5718ec9640 1 --2- 172.21.15.152:0/2345364756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba7772a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.963+0000 7f5718ec9640 1 -- 172.21.15.152:0/2345364756 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba7760f3a0 con 0x55ba7771d5d0 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.963+0000 7f5713fff640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57040a2cf0 0x7f57040a51b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5700005d00 tx=0x7f57000127c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.963+0000 7f5718ec9640 1 --2- 172.21.15.152:0/2345364756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba7771da10 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f5708009900 tx=0x7f5708005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e11cd35ad60ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.963+0000 7f56feffd640 1 -- 172.21.15.152:0/2345364756 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708040070 con 0x55ba7771d5d0 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.963+0000 7f56feffd640 1 -- 172.21.15.152:0/2345364756 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57080319f0 con 0x55ba7771d5d0 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.963+0000 7f56feffd640 1 -- 172.21.15.152:0/2345364756 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708035040 con 0x55ba7771d5d0 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.964+0000 7f571d506740 1 -- 172.21.15.152:0/2345364756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 msgr2=0x55ba7771da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.964+0000 7f571d506740 1 --2- 172.21.15.152:0/2345364756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba7771da10 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f5708009900 tx=0x7f5708005e80 comp rx=0 tx=0).stop 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.964+0000 7f571d506740 1 -- 172.21.15.152:0/2345364756 shutdown_connections 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.964+0000 7f571d506740 1 --2- 172.21.15.152:0/2345364756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba7772a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.964+0000 7f571d506740 1 --2- 172.21.15.152:0/2345364756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba7771da10 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.964+0000 7f571d506740 1 --2- 172.21.15.152:0/2345364756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba7771d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.964+0000 7f571d506740 1 -- 172.21.15.152:0/2345364756 >> 172.21.15.152:0/2345364756 conn(0x55ba776e6310 msgr2=0x55ba77719c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.964+0000 7f571d506740 1 -- 172.21.15.152:0/2345364756 shutdown_connections 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.964+0000 7f571d506740 1 -- 172.21.15.152:0/2345364756 wait complete. 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.964+0000 7f571d506740 1 -- start start 2024-09-11T22:18:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.964+0000 7f571d506740 1 Processor -- start 2024-09-11T22:18:33.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f571d506740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba77727cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f571d506740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba77724f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f571d506740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba777254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f571d506740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ba7772b010 con 0x55ba7771d5d0 2024-09-11T22:18:33.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f571d506740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ba7763e060 con 0x55ba77728370 2024-09-11T22:18:33.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f571d506740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ba7772b190 con 0x55ba7771eb40 2024-09-11T22:18:33.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f571d506740 10 client.0 _ll_register_callbacks cb 0x55ba773918c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:33.010 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:18:33.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f5718ec9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba77727cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f5718ec9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba77727cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33396/0 (socket says 172.21.15.152:33396) 2024-09-11T22:18:33.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f5718ec9640 1 -- 172.21.15.152:0/1688948168 learned_addr learned my addr 172.21.15.152:0/1688948168 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:33.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f5713fff640 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba77724f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f57196ca640 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba777254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f5718ec9640 1 -- 172.21.15.152:0/1688948168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 msgr2=0x55ba77724f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:33.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f5718ec9640 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba77724f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f5718ec9640 1 -- 172.21.15.152:0/1688948168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 msgr2=0x55ba777254d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f5718ec9640 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba777254d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f5718ec9640 1 -- 172.21.15.152:0/1688948168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba773f43c0 con 0x55ba7771d5d0 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f5718ec9640 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba77727cc0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f5708031520 tx=0x7f57080052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d049a00862300219 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f56f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f56f3fff640 1 -- 172.21.15.152:0/1688948168 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708040030 con 0x55ba7771d5d0 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f56f3fff640 1 -- 172.21.15.152:0/1688948168 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f5708004260 con 0x55ba7771d5d0 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.965+0000 7f571d506740 1 -- 172.21.15.152:0/1688948168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57080319f0 con 0x55ba7771d5d0 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f56f3fff640 1 -- 172.21.15.152:0/1688948168 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5708056050 con 0x55ba7771d5d0 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f571d506740 10 client.19008 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f571d506740 1 -- 172.21.15.152:0/1688948168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ba77736a20 con 0x55ba7771d5d0 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f56f3fff640 1 -- 172.21.15.152:0/1688948168 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57080319f0 con 0x55ba7771d5d0 2024-09-11T22:18:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f56f3fff640 1 -- 172.21.15.152:0/1688948168 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f57080037a0 con 0x55ba7771d5d0 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f571d506740 10 client.19008 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f571d506740 10 client.19008 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f571d506740 20 client.19008 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f571d506740 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ba77737d70 0x55ba7773a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f571d506740 4 client.19008 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f571d506740 1 -- 172.21.15.152:0/1688948168 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba77690860 con 0x55ba77737d70 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.966+0000 7f5713fff640 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ba77737d70 0x55ba7773a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.967+0000 7f56f3fff640 10 client.19008 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.967+0000 7f5713fff640 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ba77737d70 0x55ba7773a160 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4db926403643333 server_cookie=96c70597ed66cc24 in_seq=0 out_seq=0 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.967+0000 7f56f3fff640 1 -- 172.21.15.152:0/1688948168 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba77690860 con 0x55ba77737d70 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.967+0000 7f56f3fff640 10 client.19008 handle_command_reply: tid=0 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.967+0000 7f571d506740 1 client.19008 shutdown 2024-09-11T22:18:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f571d506740 1 -- 172.21.15.152:0/1688948168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 msgr2=0x55ba77727cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f571d506740 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba77727cc0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f5708031520 tx=0x7f57080052d0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f571d506740 1 -- 172.21.15.152:0/1688948168 shutdown_connections 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f571d506740 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ba77737d70 0x55ba7773a160 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f571d506740 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba777254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f571d506740 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba77724f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f571d506740 1 --2- 172.21.15.152:0/1688948168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771d5d0 0x55ba77727cc0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f571d506740 1 -- 172.21.15.152:0/1688948168 >> 172.21.15.152:0/1688948168 conn(0x55ba776e6310 msgr2=0x55ba7771f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f56f3fff640 0 client.19008 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f571d506740 1 -- 172.21.15.152:0/1688948168 shutdown_connections 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f571d506740 1 -- 172.21.15.152:0/1688948168 wait complete. 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.968+0000 7f571d506740 20 client.19008 trim_cache size 0 max 16384 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f571d506740 1 Processor -- start 2024-09-11T22:18:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f571d506740 1 -- start start 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f571d506740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771d5d0 0x55ba777342b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f571d506740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771eb40 0x55ba77739d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f571d506740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba77729760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f571d506740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f57141b24d0 con 0x55ba7771eb40 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f571d506740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f57141afda0 con 0x55ba77728370 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f571d506740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57141adc10 con 0x55ba7771d5d0 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f5713fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771eb40 0x55ba77739d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f5713fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771eb40 0x55ba77739d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33400/0 (socket says 172.21.15.152:33400) 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f5713fff640 1 -- 172.21.15.152:0/1829448210 learned_addr learned my addr 172.21.15.152:0/1829448210 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f57196ca640 1 --2- 172.21.15.152:0/1829448210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba77729760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f5718ec9640 1 --2- 172.21.15.152:0/1829448210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771d5d0 0x55ba777342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f5713fff640 1 -- 172.21.15.152:0/1829448210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771d5d0 msgr2=0x55ba777342b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f5713fff640 1 --2- 172.21.15.152:0/1829448210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771d5d0 0x55ba777342b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f5713fff640 1 -- 172.21.15.152:0/1829448210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 msgr2=0x55ba77729760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f5713fff640 1 --2- 172.21.15.152:0/1829448210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba77729760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f5713fff640 1 -- 172.21.15.152:0/1829448210 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba777234c0 con 0x55ba7771eb40 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f57196ca640 1 --2- 172.21.15.152:0/1829448210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba77729760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.981+0000 7f5713fff640 1 --2- 172.21.15.152:0/1829448210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771eb40 0x55ba77739d80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f570000b570 tx=0x7f570001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bfcd520d8620fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f56fe7fc640 1 -- 172.21.15.152:0/1829448210 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570002d070 con 0x55ba7771eb40 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f56fe7fc640 1 -- 172.21.15.152:0/1829448210 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f570001f940 con 0x55ba7771eb40 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f56fe7fc640 1 -- 172.21.15.152:0/1829448210 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700005280 con 0x55ba7771eb40 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f571d506740 1 -- 172.21.15.152:0/1829448210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771eb40 msgr2=0x55ba77739d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f571d506740 1 --2- 172.21.15.152:0/1829448210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771eb40 0x55ba77739d80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f570000b570 tx=0x7f570001b000 comp rx=0 tx=0).stop 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f571d506740 1 -- 172.21.15.152:0/1829448210 shutdown_connections 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f571d506740 1 --2- 172.21.15.152:0/1829448210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba77728370 0x55ba77729760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f571d506740 1 --2- 172.21.15.152:0/1829448210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba7771eb40 0x55ba77739d80 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f571d506740 1 --2- 172.21.15.152:0/1829448210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771d5d0 0x55ba777342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f571d506740 1 -- 172.21.15.152:0/1829448210 >> 172.21.15.152:0/1829448210 conn(0x55ba776e6310 msgr2=0x55ba77724060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f571d506740 1 -- 172.21.15.152:0/1829448210 shutdown_connections 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.982+0000 7f571d506740 1 -- 172.21.15.152:0/1829448210 wait complete. 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f571d506740 1 -- start start 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f571d506740 1 Processor -- start 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f571d506740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba7771d5d0 0x55ba7773f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f571d506740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba7773f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f571d506740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba77728370 0x55ba7773fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f571d506740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f57141ae260 con 0x55ba77728370 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f571d506740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f57141af6d0 con 0x55ba7771d5d0 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f571d506740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57141ae930 con 0x55ba7771eb40 2024-09-11T22:18:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f571d506740 10 client.0 _ll_register_callbacks cb 0x7f5708005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f57196ca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba77728370 0x55ba7773fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f57196ca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba77728370 0x55ba7773fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33414/0 (socket says 172.21.15.152:33414) 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f57196ca640 1 -- 172.21.15.152:0/1385054291 learned_addr learned my addr 172.21.15.152:0/1385054291 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f5713fff640 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba7773f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f5718ec9640 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba7771d5d0 0x55ba7773f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f57196ca640 1 -- 172.21.15.152:0/1385054291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 msgr2=0x55ba7773f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f57196ca640 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba7773f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f57196ca640 1 -- 172.21.15.152:0/1385054291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba7771d5d0 msgr2=0x55ba7773f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f57196ca640 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba7771d5d0 0x55ba7773f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.983+0000 7f57196ca640 1 -- 172.21.15.152:0/1385054291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba7772e8c0 con 0x55ba77728370 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f57196ca640 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba77728370 0x55ba7773fdb0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f570c0cce00 tx=0x7f570c09bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd8138a1e77f0f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f56f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:33.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f56f3fff640 1 -- 172.21.15.152:0/1385054291 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0bf070 con 0x55ba77728370 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f56f3fff640 1 -- 172.21.15.152:0/1385054291 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f570c0cd020 con 0x55ba77728370 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f571d506740 1 -- 172.21.15.152:0/1385054291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f570001f940 con 0x55ba77728370 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f56f3fff640 1 -- 172.21.15.152:0/1385054291 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f570c01f040 con 0x55ba77728370 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f571d506740 10 client.19014 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f571d506740 1 -- 172.21.15.152:0/1385054291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ba777a2aa0 con 0x55ba77728370 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f56f3fff640 1 -- 172.21.15.152:0/1385054291 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f570001f940 con 0x55ba77728370 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f56f3fff640 1 -- 172.21.15.152:0/1385054291 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f570c00f040 con 0x55ba77728370 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f571d506740 10 client.19014 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f571d506740 10 client.19014 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f571d506740 20 client.19014 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f571d506740 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ba777a3260 0x55ba777a5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f571d506740 4 client.19014 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:18:33.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.984+0000 7f571d506740 1 -- 172.21.15.152:0/1385054291 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ba7768ad70 con 0x55ba777a3260 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f5718ec9640 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ba777a3260 0x55ba777a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f56f3fff640 10 client.19014 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f5718ec9640 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ba777a3260 0x55ba777a5650 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1cfa5802fb67593e server_cookie=a8e5b2965cce2fa in_seq=0 out_seq=0 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f56f3fff640 1 -- 172.21.15.152:0/1385054291 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ba7768ad70 con 0x55ba777a3260 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f56f3fff640 10 client.19014 handle_command_reply: tid=0 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f571d506740 1 client.19014 shutdown 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f571d506740 1 -- 172.21.15.152:0/1385054291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba77728370 msgr2=0x55ba7773fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f571d506740 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba77728370 0x55ba7773fdb0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f570c0cce00 tx=0x7f570c09bb70 comp rx=0 tx=0).stop 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f571d506740 1 -- 172.21.15.152:0/1385054291 shutdown_connections 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f571d506740 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55ba777a3260 0x55ba777a5650 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f571d506740 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba77728370 0x55ba7773fdb0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f56f3fff640 0 client.19014 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f571d506740 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7771eb40 0x55ba7773f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f571d506740 1 --2- 172.21.15.152:0/1385054291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ba7771d5d0 0x55ba7773f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.985+0000 7f571d506740 1 -- 172.21.15.152:0/1385054291 >> 172.21.15.152:0/1385054291 conn(0x55ba776e6310 msgr2=0x55ba777184e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571d506740 1 -- 172.21.15.152:0/1385054291 shutdown_connections 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571d506740 1 -- 172.21.15.152:0/1385054291 wait complete. 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571d506740 20 client.19014 trim_cache size 0 max 16384 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 -- 172.21.15.152:0/68366790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57040a2cf0 msgr2=0x7f57040a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57040a2cf0 0x7f57040a51b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5700005d00 tx=0x7f57000127c0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 -- 172.21.15.152:0/68366790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714106f10 msgr2=0x7f5714074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714106f10 0x7f5714074f70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f570c00eaa0 tx=0x7f570c00ef60 comp rx=0 tx=0).stop 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 -- 172.21.15.152:0/68366790 shutdown_connections 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f57040a2cf0 0x7f57040a51b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714106f10 0x7f5714074f70 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5714102790 0x7f5714074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 --2- 172.21.15.152:0/68366790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5714101de0 0x7f57140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:33.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 -- 172.21.15.152:0/68366790 >> 172.21.15.152:0/68366790 conn(0x7f57140fd8c0 msgr2=0x7f57140fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:33.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 -- 172.21.15.152:0/68366790 shutdown_connections 2024-09-11T22:18:33.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:32.986+0000 7f571b12d640 1 -- 172.21.15.152:0/68366790 wait complete. 2024-09-11T22:18:33.670 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:18:33.920 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:33.981 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:33 smithi152 ceph-mon[31188]: pgmap v447: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 124 op/s 2024-09-11T22:18:34.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:33 smithi179 ceph-mon[35603]: pgmap v447: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 124 op/s 2024-09-11T22:18:34.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:33 smithi193 ceph-mon[35545]: pgmap v447: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 124 op/s 2024-09-11T22:18:34.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.493+0000 7fecbcefa640 1 -- 172.21.15.152:0/1613148857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecb8100e20 msgr2=0x7fecb8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:34.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.493+0000 7fecbcefa640 1 --2- 172.21.15.152:0/1613148857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecb8100e20 0x7fecb8101200 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7feca8009900 tx=0x7feca802a480 comp rx=0 tx=0).stop 2024-09-11T22:18:34.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.493+0000 7fecbcefa640 1 -- 172.21.15.152:0/1613148857 shutdown_connections 2024-09-11T22:18:34.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.493+0000 7fecbcefa640 1 --2- 172.21.15.152:0/1613148857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fecb8102ef0 0x7fecb810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.493+0000 7fecbcefa640 1 --2- 172.21.15.152:0/1613148857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecb8102570 0x7fecb81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.493+0000 7fecbcefa640 1 --2- 172.21.15.152:0/1613148857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecb8100e20 0x7fecb8101200 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.493+0000 7fecbcefa640 1 -- 172.21.15.152:0/1613148857 >> 172.21.15.152:0/1613148857 conn(0x7fecb80fc7d0 msgr2=0x7fecb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:34.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.493+0000 7fecbcefa640 1 -- 172.21.15.152:0/1613148857 shutdown_connections 2024-09-11T22:18:34.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.493+0000 7fecbcefa640 1 -- 172.21.15.152:0/1613148857 wait complete. 2024-09-11T22:18:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecbcefa640 1 Processor -- start 2024-09-11T22:18:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecbcefa640 1 -- start start 2024-09-11T22:18:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecbcefa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecb8100e20 0x7fecb819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecbcefa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fecb8102570 0x7fecb819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecbcefa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecb8102ef0 0x7fecb819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecbcefa640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fecb8110f80 con 0x7fecb8102ef0 2024-09-11T22:18:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecbcefa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fecb8110e00 con 0x7fecb8100e20 2024-09-11T22:18:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecbcefa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fecb8111100 con 0x7fecb8102570 2024-09-11T22:18:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecb6d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecb8102ef0 0x7fecb819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecb659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecb8100e20 0x7fecb819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecb6d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecb8102ef0 0x7fecb819efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33672/0 (socket says 172.21.15.152:33672) 2024-09-11T22:18:34.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecb6d9d640 1 -- 172.21.15.152:0/2857922645 learned_addr learned my addr 172.21.15.152:0/2857922645 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:34.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecaffff640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fecb8102570 0x7fecb819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecb6d9d640 1 -- 172.21.15.152:0/2857922645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fecb8102570 msgr2=0x7fecb819ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:34.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fecb8102570 0x7fecb819ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecb6d9d640 1 -- 172.21.15.152:0/2857922645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecb8100e20 msgr2=0x7fecb819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:34.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecb8100e20 0x7fecb819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecb6d9d640 1 -- 172.21.15.152:0/2857922645 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb819f680 con 0x7fecb8102ef0 2024-09-11T22:18:34.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.494+0000 7fecaffff640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fecb8102570 0x7fecb819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:34.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.495+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecb8102ef0 0x7fecb819efa0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fecb000eb10 tx=0x7fecb000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:34.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.495+0000 7fecaf7fe640 1 -- 172.21.15.152:0/2857922645 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0004b20 con 0x7fecb8102ef0 2024-09-11T22:18:34.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.495+0000 7fecaf7fe640 1 -- 172.21.15.152:0/2857922645 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecb0004cc0 con 0x7fecb8102ef0 2024-09-11T22:18:34.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.495+0000 7fecbcefa640 1 -- 172.21.15.152:0/2857922645 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb819f970 con 0x7fecb8102ef0 2024-09-11T22:18:34.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.495+0000 7fecbcefa640 1 -- 172.21.15.152:0/2857922645 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb81a7250 con 0x7fecb8102ef0 2024-09-11T22:18:34.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.495+0000 7fecaf7fe640 1 -- 172.21.15.152:0/2857922645 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0010760 con 0x7fecb8102ef0 2024-09-11T22:18:34.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.498+0000 7fecaf7fe640 1 -- 172.21.15.152:0/2857922645 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fecb0005020 con 0x7fecb8102ef0 2024-09-11T22:18:34.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.498+0000 7fecaf7fe640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7feca40a2df0 0x7feca40a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.498+0000 7fecbf2d3740 1 Processor -- start 2024-09-11T22:18:34.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.498+0000 7fecaf7fe640 1 -- 172.21.15.152:0/2857922645 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fecb00cfbe0 con 0x7fecb8102ef0 2024-09-11T22:18:34.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.498+0000 7fecb659c640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7feca40a2df0 0x7feca40a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecbf2d3740 1 -- start start 2024-09-11T22:18:34.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce2b40 0x562de7ce1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7ce15d0 0x562de7ce1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 0x562de7cee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562de7c472f0 con 0x562de7cec370 2024-09-11T22:18:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562de7beecf0 con 0x562de7ce15d0 2024-09-11T22:18:34.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562de7c432b0 con 0x562de7ce2b40 2024-09-11T22:18:34.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecb6d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 0x562de7cee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecb6d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 0x562de7cee760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33678/0 (socket says 172.21.15.152:33678) 2024-09-11T22:18:34.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecb6d9d640 1 -- 172.21.15.152:0/2718032591 learned_addr learned my addr 172.21.15.152:0/2718032591 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:34.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecaffff640 1 --2- 172.21.15.152:0/2718032591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7ce15d0 0x562de7ce1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecb659c640 1 --2- 172.21.15.152:0/2718032591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce2b40 0x562de7ce1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecb6d9d640 1 -- 172.21.15.152:0/2718032591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce2b40 msgr2=0x562de7ce1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:34.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/2718032591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce2b40 0x562de7ce1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecb6d9d640 1 -- 172.21.15.152:0/2718032591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7ce15d0 msgr2=0x562de7ce1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/2718032591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7ce15d0 0x562de7ce1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecb6d9d640 1 -- 172.21.15.152:0/2718032591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562de7bd33a0 con 0x562de7cec370 2024-09-11T22:18:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecb659c640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7feca40a2df0 0x7feca40a52b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feca8009230 tx=0x7feca8004160 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.499+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/2718032591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 0x562de7cee760 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fecb00a4780 tx=0x7fecb0098410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e069148223e22be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.500+0000 7fecacff9640 1 -- 172.21.15.152:0/2718032591 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb009c740 con 0x562de7cec370 2024-09-11T22:18:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.500+0000 7fecacff9640 1 -- 172.21.15.152:0/2718032591 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecb009c040 con 0x562de7cec370 2024-09-11T22:18:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.500+0000 7fecacff9640 1 -- 172.21.15.152:0/2718032591 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb00cd4f0 con 0x562de7cec370 2024-09-11T22:18:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.500+0000 7fecbf2d3740 1 -- 172.21.15.152:0/2718032591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 msgr2=0x562de7cee760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.500+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/2718032591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 0x562de7cee760 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fecb00a4780 tx=0x7fecb0098410 comp rx=0 tx=0).stop 2024-09-11T22:18:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.501+0000 7fecbf2d3740 1 -- 172.21.15.152:0/2718032591 shutdown_connections 2024-09-11T22:18:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.501+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/2718032591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 0x562de7cee760 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.501+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/2718032591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7ce15d0 0x562de7ce1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.501+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/2718032591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce2b40 0x562de7ce1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.501+0000 7fecbf2d3740 1 -- 172.21.15.152:0/2718032591 >> 172.21.15.152:0/2718032591 conn(0x562de7caa310 msgr2=0x562de7cddc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:34.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.501+0000 7fecbf2d3740 1 -- 172.21.15.152:0/2718032591 shutdown_connections 2024-09-11T22:18:34.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.501+0000 7fecbf2d3740 1 -- 172.21.15.152:0/2718032591 wait complete. 2024-09-11T22:18:34.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.501+0000 7fecbf2d3740 1 -- start start 2024-09-11T22:18:34.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.501+0000 7fecbf2d3740 1 Processor -- start 2024-09-11T22:18:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce15d0 0x562de7cebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce2b40 0x562de7ce8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 0x562de7ce94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562de7cef070 con 0x562de7ce15d0 2024-09-11T22:18:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562de7c02060 con 0x562de7cec370 2024-09-11T22:18:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562de7cef1f0 con 0x562de7ce2b40 2024-09-11T22:18:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecbf2d3740 10 client.0 _ll_register_callbacks cb 0x562de79558c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecb659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce15d0 0x562de7cebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecb659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce15d0 0x562de7cebcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33682/0 (socket says 172.21.15.152:33682) 2024-09-11T22:18:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecb659c640 1 -- 172.21.15.152:0/1367377325 learned_addr learned my addr 172.21.15.152:0/1367377325 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 0x562de7ce94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecaffff640 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce2b40 0x562de7ce8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecb659c640 1 -- 172.21.15.152:0/1367377325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce2b40 msgr2=0x562de7ce8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:34.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecb659c640 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce2b40 0x562de7ce8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecb659c640 1 -- 172.21.15.152:0/1367377325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 msgr2=0x562de7ce94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:34.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecb659c640 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 0x562de7ce94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecb659c640 1 -- 172.21.15.152:0/1367377325 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562de79b83c0 con 0x562de7ce15d0 2024-09-11T22:18:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.502+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 0x562de7ce94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.503+0000 7fecb659c640 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce15d0 0x562de7cebcc0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7feca802a9a0 tx=0x7feca802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a15dba019df7b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.503+0000 7fec9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.503+0000 7fec9dffb640 1 -- 172.21.15.152:0/1367377325 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8035050 con 0x562de7ce15d0 2024-09-11T22:18:34.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.503+0000 7fec9dffb640 1 -- 172.21.15.152:0/1367377325 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7feca80037f0 con 0x562de7ce15d0 2024-09-11T22:18:34.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.503+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1367377325 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecb009c040 con 0x562de7ce15d0 2024-09-11T22:18:34.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.503+0000 7fec9dffb640 1 -- 172.21.15.152:0/1367377325 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7feca8031e60 con 0x562de7ce15d0 2024-09-11T22:18:34.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.503+0000 7fecbf2d3740 10 client.19026 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:34.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.503+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1367377325 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562de7cfaa80 con 0x562de7ce15d0 2024-09-11T22:18:34.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.503+0000 7fec9dffb640 1 -- 172.21.15.152:0/1367377325 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca8003ed0 con 0x562de7ce15d0 2024-09-11T22:18:34.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.504+0000 7fec9dffb640 1 -- 172.21.15.152:0/1367377325 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7feca803cc30 con 0x562de7ce15d0 2024-09-11T22:18:34.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.504+0000 7fecbf2d3740 10 client.19026 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:34.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.504+0000 7fecbf2d3740 10 client.19026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.504+0000 7fecbf2d3740 20 client.19026 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.504+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562de7cfc3d0 0x562de7cfe830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.504+0000 7fecbf2d3740 4 client.19026 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.504+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1367377325 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fecb009c040 con 0x562de7cfc3d0 2024-09-11T22:18:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.507+0000 7fecaffff640 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562de7cfc3d0 0x562de7cfe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.507+0000 7fecaffff640 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562de7cfc3d0 0x562de7cfe830 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51f324691beb9c02 server_cookie=f819580e2f66b051 in_seq=0 out_seq=0 2024-09-11T22:18:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.508+0000 7fec9dffb640 10 client.19026 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.508+0000 7fec9dffb640 1 -- 172.21.15.152:0/1367377325 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fecb009c040 con 0x562de7cfc3d0 2024-09-11T22:18:34.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.508+0000 7fec9dffb640 10 client.19026 handle_command_reply: tid=0 2024-09-11T22:18:34.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 1 client.19026 shutdown 2024-09-11T22:18:34.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1367377325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce15d0 msgr2=0x562de7cebcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:34.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce15d0 0x562de7cebcc0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7feca802a9a0 tx=0x7feca802a480 comp rx=0 tx=0).stop 2024-09-11T22:18:34.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1367377325 shutdown_connections 2024-09-11T22:18:34.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562de7cfc3d0 0x562de7cfe830 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 0x562de7ce94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce2b40 0x562de7ce8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/1367377325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce15d0 0x562de7cebcc0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fec9dffb640 0 client.19026 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:34.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1367377325 >> 172.21.15.152:0/1367377325 conn(0x562de7caa310 msgr2=0x562de7ce3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:34.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1367377325 shutdown_connections 2024-09-11T22:18:34.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1367377325 wait complete. 2024-09-11T22:18:34.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.509+0000 7fecbf2d3740 20 client.19026 trim_cache size 0 max 16384 2024-09-11T22:18:34.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecbf2d3740 1 Processor -- start 2024-09-11T22:18:34.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecbf2d3740 1 -- start start 2024-09-11T22:18:34.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce15d0 0x562de7cf8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce2b40 0x562de7ce8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 0x562de7cdcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81b2500 con 0x562de7ce2b40 2024-09-11T22:18:34.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81afdd0 con 0x562de7cec370 2024-09-11T22:18:34.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81adc40 con 0x562de7ce15d0 2024-09-11T22:18:34.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecb6d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 0x562de7cdcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecb659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce15d0 0x562de7cf8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecb6d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 0x562de7cdcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54212/0 (socket says 172.21.15.152:54212) 2024-09-11T22:18:34.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecb6d9d640 1 -- 172.21.15.152:0/1315590358 learned_addr learned my addr 172.21.15.152:0/1315590358 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:34.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.524+0000 7fecaffff640 1 --2- 172.21.15.152:0/1315590358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce2b40 0x562de7ce8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.525+0000 7fecb6d9d640 1 -- 172.21.15.152:0/1315590358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce15d0 msgr2=0x562de7cf8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:34.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.525+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/1315590358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce15d0 0x562de7cf8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.525+0000 7fecb6d9d640 1 -- 172.21.15.152:0/1315590358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce2b40 msgr2=0x562de7ce8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:34.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.525+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/1315590358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce2b40 0x562de7ce8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.525+0000 7fecb6d9d640 1 -- 172.21.15.152:0/1315590358 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562de7ce9840 con 0x562de7cec370 2024-09-11T22:18:34.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.525+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/1315590358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 0x562de7cdcbf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fecb0000f80 tx=0x7fecb000efd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1488c93fee864337 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:34.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.525+0000 7fec9ffff640 1 -- 172.21.15.152:0/1315590358 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb00bc0c0 con 0x562de7cec370 2024-09-11T22:18:34.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.525+0000 7fec9ffff640 1 -- 172.21.15.152:0/1315590358 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecb00a4cb0 con 0x562de7cec370 2024-09-11T22:18:34.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.525+0000 7fec9ffff640 1 -- 172.21.15.152:0/1315590358 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb00b00d0 con 0x562de7cec370 2024-09-11T22:18:34.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.526+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1315590358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 msgr2=0x562de7cdcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:34.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.526+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/1315590358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 0x562de7cdcbf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fecb0000f80 tx=0x7fecb000efd0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.526+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1315590358 shutdown_connections 2024-09-11T22:18:34.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.527+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/1315590358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7cec370 0x562de7cdcbf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.527+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/1315590358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7ce2b40 0x562de7ce8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.527+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/1315590358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce15d0 0x562de7cf8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.527+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1315590358 >> 172.21.15.152:0/1315590358 conn(0x562de7caa310 msgr2=0x562de7cdc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:34.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.527+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1315590358 shutdown_connections 2024-09-11T22:18:34.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.527+0000 7fecbf2d3740 1 -- 172.21.15.152:0/1315590358 wait complete. 2024-09-11T22:18:34.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecbf2d3740 1 -- start start 2024-09-11T22:18:34.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecbf2d3740 1 Processor -- start 2024-09-11T22:18:34.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce15d0 0x562de7cf04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7ce2b40 0x562de7cf09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecbf2d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 0x562de7cf0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81ae290 con 0x562de7cec370 2024-09-11T22:18:34.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81af700 con 0x562de7ce2b40 2024-09-11T22:18:34.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecbf2d3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81ae960 con 0x562de7ce15d0 2024-09-11T22:18:34.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecbf2d3740 10 client.0 _ll_register_callbacks cb 0x7feca80043a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:34.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecaffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7ce2b40 0x562de7cf09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecaffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7ce2b40 0x562de7cf09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54214/0 (socket says 172.21.15.152:54214) 2024-09-11T22:18:34.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecb659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce15d0 0x562de7cf04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecaffff640 1 -- 172.21.15.152:0/3864691409 learned_addr learned my addr 172.21.15.152:0/3864691409 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.528+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 0x562de7cf0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.529+0000 7fecb6d9d640 1 -- 172.21.15.152:0/3864691409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce15d0 msgr2=0x562de7cf04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.529+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce15d0 0x562de7cf04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.529+0000 7fecb6d9d640 1 -- 172.21.15.152:0/3864691409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7ce2b40 msgr2=0x562de7cf09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.529+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7ce2b40 0x562de7cf09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.529+0000 7fecb6d9d640 1 -- 172.21.15.152:0/3864691409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562de7d663e0 con 0x562de7cec370 2024-09-11T22:18:34.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.529+0000 7fecb6d9d640 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 0x562de7cf0f50 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fecb009bfd0 tx=0x7fecb000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0402ce6098a1296 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:34.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.529+0000 7fec9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:34.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.529+0000 7fec9dffb640 1 -- 172.21.15.152:0/3864691409 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb009c740 con 0x562de7cec370 2024-09-11T22:18:34.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.529+0000 7fec9dffb640 1 -- 172.21.15.152:0/3864691409 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fecb00b00d0 con 0x562de7cec370 2024-09-11T22:18:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.529+0000 7fecbf2d3740 1 -- 172.21.15.152:0/3864691409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecb00a4cb0 con 0x562de7cec370 2024-09-11T22:18:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.529+0000 7fec9dffb640 1 -- 172.21.15.152:0/3864691409 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fecb00b02d0 con 0x562de7cec370 2024-09-11T22:18:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.530+0000 7fecbf2d3740 10 client.19032 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.530+0000 7fecbf2d3740 1 -- 172.21.15.152:0/3864691409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562de7d676e0 con 0x562de7cec370 2024-09-11T22:18:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.530+0000 7fec9dffb640 1 -- 172.21.15.152:0/3864691409 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecb00a4cb0 con 0x562de7cec370 2024-09-11T22:18:34.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.530+0000 7fec9dffb640 1 -- 172.21.15.152:0/3864691409 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fecb00053e0 con 0x562de7cec370 2024-09-11T22:18:34.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.530+0000 7fecbf2d3740 10 client.19032 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:34.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.530+0000 7fecbf2d3740 10 client.19032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:34.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.530+0000 7fecbf2d3740 20 client.19032 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:34.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.530+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562de7d67910 0x562de7d69d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:34.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.530+0000 7fecbf2d3740 4 client.19032 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:18:34.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.530+0000 7fecbf2d3740 1 -- 172.21.15.152:0/3864691409 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562de7c54860 con 0x562de7d67910 2024-09-11T22:18:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.530+0000 7fecb659c640 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562de7d67910 0x562de7d69d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.531+0000 7fec9dffb640 10 client.19032 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.531+0000 7fecb659c640 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562de7d67910 0x562de7d69d00 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6e903567c13f97f server_cookie=466c1e44aebf1c22 in_seq=0 out_seq=0 2024-09-11T22:18:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.531+0000 7fec9dffb640 1 -- 172.21.15.152:0/3864691409 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562de7c54860 con 0x562de7d67910 2024-09-11T22:18:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.531+0000 7fec9dffb640 10 client.19032 handle_command_reply: tid=0 2024-09-11T22:18:34.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.531+0000 7fecbf2d3740 1 client.19032 shutdown 2024-09-11T22:18:34.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.531+0000 7fecbf2d3740 1 -- 172.21.15.152:0/3864691409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 msgr2=0x562de7cf0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:34.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.531+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 0x562de7cf0f50 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fecb009bfd0 tx=0x7fecb000c8d0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.531+0000 7fecbf2d3740 1 -- 172.21.15.152:0/3864691409 shutdown_connections 2024-09-11T22:18:34.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.531+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x562de7d67910 0x562de7d69d00 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fec9dffb640 0 client.19032 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562de7cec370 0x562de7cf0f50 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562de7ce2b40 0x562de7cf09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbf2d3740 1 --2- 172.21.15.152:0/3864691409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562de7ce15d0 0x562de7cf04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbf2d3740 1 -- 172.21.15.152:0/3864691409 >> 172.21.15.152:0/3864691409 conn(0x562de7caa310 msgr2=0x562de7cdcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbf2d3740 1 -- 172.21.15.152:0/3864691409 shutdown_connections 2024-09-11T22:18:34.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbf2d3740 1 -- 172.21.15.152:0/3864691409 wait complete. 2024-09-11T22:18:34.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbf2d3740 20 client.19032 trim_cache size 0 max 16384 2024-09-11T22:18:34.563 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:18:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbcefa640 1 -- 172.21.15.152:0/2857922645 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7feca40a2df0 msgr2=0x7feca40a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbcefa640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7feca40a2df0 0x7feca40a52b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feca8009230 tx=0x7feca8004160 comp rx=0 tx=0).stop 2024-09-11T22:18:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbcefa640 1 -- 172.21.15.152:0/2857922645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecb8102ef0 msgr2=0x7fecb819efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:34.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbcefa640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecb8102ef0 0x7fecb819efa0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fecb000eb10 tx=0x7fecb000c2d0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbcefa640 1 -- 172.21.15.152:0/2857922645 shutdown_connections 2024-09-11T22:18:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbcefa640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7feca40a2df0 0x7feca40a52b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbcefa640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecb8102ef0 0x7fecb819efa0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbcefa640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fecb8102570 0x7fecb819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbcefa640 1 --2- 172.21.15.152:0/2857922645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecb8100e20 0x7fecb819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.532+0000 7fecbcefa640 1 -- 172.21.15.152:0/2857922645 >> 172.21.15.152:0/2857922645 conn(0x7fecb80fc7d0 msgr2=0x7fecb806a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.533+0000 7fecbcefa640 1 -- 172.21.15.152:0/2857922645 shutdown_connections 2024-09-11T22:18:34.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:34.533+0000 7fecbcefa640 1 -- 172.21.15.152:0/2857922645 wait complete. 2024-09-11T22:18:34.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:18:36.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:35 smithi179 ceph-mon[35603]: pgmap v448: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 348 op/s 2024-09-11T22:18:36.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:35 smithi193 ceph-mon[35545]: pgmap v448: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 348 op/s 2024-09-11T22:18:36.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:35 smithi152 ceph-mon[31188]: pgmap v448: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 348 op/s 2024-09-11T22:18:36.314 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:18:36.314 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:18:36.573 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:37.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.138+0000 7f7371db9640 1 -- 172.21.15.152:0/706745129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f736c101de0 msgr2=0x7f736c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:37.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.138+0000 7f7371db9640 1 --2- 172.21.15.152:0/706745129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f736c101de0 0x7f736c1021c0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f735c009900 tx=0x7f735c02a410 comp rx=0 tx=0).stop 2024-09-11T22:18:37.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.138+0000 7f7371db9640 1 -- 172.21.15.152:0/706745129 shutdown_connections 2024-09-11T22:18:37.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.138+0000 7f7371db9640 1 --2- 172.21.15.152:0/706745129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736c106f10 0x7f736c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.138+0000 7f7371db9640 1 --2- 172.21.15.152:0/706745129 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f736c102790 0x7f736c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.138+0000 7f7371db9640 1 --2- 172.21.15.152:0/706745129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f736c101de0 0x7f736c1021c0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.138+0000 7f7371db9640 1 -- 172.21.15.152:0/706745129 >> 172.21.15.152:0/706745129 conn(0x7f736c0fd8c0 msgr2=0x7f736c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.138+0000 7f7371db9640 1 -- 172.21.15.152:0/706745129 shutdown_connections 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.138+0000 7f7371db9640 1 -- 172.21.15.152:0/706745129 wait complete. 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.138+0000 7f7371db9640 1 Processor -- start 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f7371db9640 1 -- start start 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f7371db9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f736c101de0 0x7f736c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f7371db9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f736c102790 0x7f736c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f7371db9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736c106f10 0x7f736c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f7371db9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f736c111fb0 con 0x7f736c101de0 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f7371db9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f736c111e30 con 0x7f736c106f10 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f7371db9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f736c112130 con 0x7f736c102790 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f736b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f736c101de0 0x7f736c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f736b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f736c101de0 0x7f736c1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33716/0 (socket says 172.21.15.152:33716) 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f736b7fe640 1 -- 172.21.15.152:0/2951036361 learned_addr learned my addr 172.21.15.152:0/2951036361 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f736bfff640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736c106f10 0x7f736c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f736affd640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f736c102790 0x7f736c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f736b7fe640 1 -- 172.21.15.152:0/2951036361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f736c102790 msgr2=0x7f736c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f736b7fe640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f736c102790 0x7f736c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f736b7fe640 1 -- 172.21.15.152:0/2951036361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736c106f10 msgr2=0x7f736c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f736b7fe640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736c106f10 0x7f736c19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f736b7fe640 1 -- 172.21.15.152:0/2951036361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c19d460 con 0x7f736c101de0 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.139+0000 7f736b7fe640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f736c101de0 0x7f736c1984b0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f735c005ab0 tx=0x7f735c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.140+0000 7f7368ff9640 1 -- 172.21.15.152:0/2951036361 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c03f030 con 0x7f736c101de0 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.140+0000 7f7371db9640 1 -- 172.21.15.152:0/2951036361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736c19d6f0 con 0x7f736c101de0 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.140+0000 7f7368ff9640 1 -- 172.21.15.152:0/2951036361 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f735c003ce0 con 0x7f736c101de0 2024-09-11T22:18:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.140+0000 7f7368ff9640 1 -- 172.21.15.152:0/2951036361 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c035070 con 0x7f736c101de0 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.140+0000 7f7371db9640 1 -- 172.21.15.152:0/2951036361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736c1a5030 con 0x7f736c101de0 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.142+0000 7f7368ff9640 1 -- 172.21.15.152:0/2951036361 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f735c042030 con 0x7f736c101de0 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.142+0000 7f7374192740 1 Processor -- start 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.142+0000 7f7374192740 1 -- start start 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.142+0000 7f7374192740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa0b60 0x560100aa0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.142+0000 7f7374192740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa1480 0x560100aab800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.142+0000 7f7374192740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aabd40 0x560100aae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.142+0000 7f7374192740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560100a06280 con 0x560100aa1480 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.142+0000 7f7374192740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5601009adb10 con 0x560100aabd40 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.142+0000 7f7374192740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560100a02240 con 0x560100aa0b60 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.142+0000 7f736b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa1480 0x560100aab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa1480 0x560100aab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33730/0 (socket says 172.21.15.152:33730) 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736b7fe640 1 -- 172.21.15.152:0/1038928493 learned_addr learned my addr 172.21.15.152:0/1038928493 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736bfff640 1 --2- 172.21.15.152:0/1038928493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa0b60 0x560100aa0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f7368ff9640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73540a2cf0 0x7f73540a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736affd640 1 --2- 172.21.15.152:0/1038928493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aabd40 0x560100aae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736bfff640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73540a2cf0 0x7f73540a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736b7fe640 1 -- 172.21.15.152:0/1038928493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa0b60 msgr2=0x560100aa0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736b7fe640 1 --2- 172.21.15.152:0/1038928493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa0b60 0x560100aa0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736b7fe640 1 -- 172.21.15.152:0/1038928493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aabd40 msgr2=0x560100aae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736b7fe640 1 --2- 172.21.15.152:0/1038928493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aabd40 0x560100aae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f7368ff9640 1 -- 172.21.15.152:0/2951036361 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f735c0efe50 con 0x7f736c101de0 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736b7fe640 1 -- 172.21.15.152:0/1038928493 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601009ba1f0 con 0x560100aa1480 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736b7fe640 1 --2- 172.21.15.152:0/1038928493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa1480 0x560100aab800 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f735c0bc010 tx=0x7f735c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bda5faa0c275fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f736bfff640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73540a2cf0 0x7f73540a51b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7364009fd0 tx=0x7f7364004a40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f7351ffb640 1 -- 172.21.15.152:0/1038928493 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c049070 con 0x560100aa1480 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f7351ffb640 1 -- 172.21.15.152:0/1038928493 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f735c0bca10 con 0x560100aa1480 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.143+0000 7f7351ffb640 1 -- 172.21.15.152:0/1038928493 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c0ed7c0 con 0x560100aa1480 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.144+0000 7f7374192740 1 -- 172.21.15.152:0/1038928493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa1480 msgr2=0x560100aab800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.144+0000 7f7374192740 1 --2- 172.21.15.152:0/1038928493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa1480 0x560100aab800 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f735c0bc010 tx=0x7f735c02a410 comp rx=0 tx=0).stop 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.144+0000 7f7374192740 1 -- 172.21.15.152:0/1038928493 shutdown_connections 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.144+0000 7f7374192740 1 --2- 172.21.15.152:0/1038928493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aabd40 0x560100aae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.144+0000 7f7374192740 1 --2- 172.21.15.152:0/1038928493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa1480 0x560100aab800 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.144+0000 7f7374192740 1 --2- 172.21.15.152:0/1038928493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa0b60 0x560100aa0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.144+0000 7f7374192740 1 -- 172.21.15.152:0/1038928493 >> 172.21.15.152:0/1038928493 conn(0x560100a9d0f0 msgr2=0x560100a9d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.144+0000 7f7374192740 1 -- 172.21.15.152:0/1038928493 shutdown_connections 2024-09-11T22:18:37.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.144+0000 7f7374192740 1 -- 172.21.15.152:0/1038928493 wait complete. 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.144+0000 7f7374192740 1 -- start start 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f7374192740 1 Processor -- start 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f7374192740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa0b60 0x560100aa8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f7374192740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa1480 0x560100aa90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f7374192740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aabd40 0x560100aa9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f7374192740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560100aae6d0 con 0x560100aabd40 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f7374192740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5601009c0f10 con 0x560100aa0b60 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f7374192740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560100aae850 con 0x560100aa1480 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f7374192740 10 client.0 _ll_register_callbacks cb 0x560100989a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f736bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aabd40 0x560100aa9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f736bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aabd40 0x560100aa9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33736/0 (socket says 172.21.15.152:33736) 2024-09-11T22:18:37.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f736bfff640 1 -- 172.21.15.152:0/762415814 learned_addr learned my addr 172.21.15.152:0/762415814 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f736b7fe640 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa0b60 0x560100aa8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f736affd640 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa1480 0x560100aa90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f736bfff640 1 -- 172.21.15.152:0/762415814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa1480 msgr2=0x560100aa90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f736bfff640 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa1480 0x560100aa90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f736bfff640 1 -- 172.21.15.152:0/762415814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa0b60 msgr2=0x560100aa8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f736bfff640 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa0b60 0x560100aa8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f736bfff640 1 -- 172.21.15.152:0/762415814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601007776a0 con 0x560100aabd40 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.145+0000 7f736b7fe640 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa0b60 0x560100aa8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f736bfff640 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aabd40 0x560100aa9620 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f736400f040 tx=0x7f7364004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99707050e3fc5359 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f734affd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f734affd640 1 -- 172.21.15.152:0/762415814 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364020070 con 0x560100aabd40 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f7374192740 1 -- 172.21.15.152:0/762415814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f735c0bca10 con 0x560100aabd40 2024-09-11T22:18:37.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f734affd640 1 -- 172.21.15.152:0/762415814 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f7364025660 con 0x560100aabd40 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f734affd640 1 -- 172.21.15.152:0/762415814 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7364015050 con 0x560100aabd40 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f7374192740 10 client.19044 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f7374192740 1 -- 172.21.15.152:0/762415814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560100aba200 con 0x560100aabd40 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f734affd640 1 -- 172.21.15.152:0/762415814 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f735c0bca10 con 0x560100aabd40 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f734affd640 1 -- 172.21.15.152:0/762415814 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f736401c400 con 0x560100aabd40 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f7374192740 10 client.19044 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.146+0000 7f7374192740 10 client.19044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.147+0000 7f7374192740 20 client.19044 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.147+0000 7f7374192740 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560100abb660 0x560100abdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.147+0000 7f7374192740 4 client.19044 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.147+0000 7f7374192740 1 -- 172.21.15.152:0/762415814 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560100a137f0 con 0x560100abb660 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.147+0000 7f736b7fe640 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560100abb660 0x560100abdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.147+0000 7f734affd640 10 client.19044 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:37.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.147+0000 7f736b7fe640 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560100abb660 0x560100abdac0 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61f64a20592179fa server_cookie=1f98ac22c2380d2e in_seq=0 out_seq=0 2024-09-11T22:18:37.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f734affd640 1 -- 172.21.15.152:0/762415814 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560100a137f0 con 0x560100abb660 2024-09-11T22:18:37.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f734affd640 10 client.19044 handle_command_reply: tid=0 2024-09-11T22:18:37.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f7374192740 1 client.19044 shutdown 2024-09-11T22:18:37.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f7374192740 1 -- 172.21.15.152:0/762415814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aabd40 msgr2=0x560100aa9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:37.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f7374192740 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aabd40 0x560100aa9620 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f736400f040 tx=0x7f7364004b50 comp rx=0 tx=0).stop 2024-09-11T22:18:37.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f7374192740 1 -- 172.21.15.152:0/762415814 shutdown_connections 2024-09-11T22:18:37.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f7374192740 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560100abb660 0x560100abdac0 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f7374192740 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aabd40 0x560100aa9620 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f7374192740 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa1480 0x560100aa90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f7374192740 1 --2- 172.21.15.152:0/762415814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa0b60 0x560100aa8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f734affd640 0 client.19044 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:37.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.148+0000 7f7374192740 1 -- 172.21.15.152:0/762415814 >> 172.21.15.152:0/762415814 conn(0x560100a9d0f0 msgr2=0x560100aa2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:37.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.149+0000 7f7374192740 1 -- 172.21.15.152:0/762415814 shutdown_connections 2024-09-11T22:18:37.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.149+0000 7f7374192740 1 -- 172.21.15.152:0/762415814 wait complete. 2024-09-11T22:18:37.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.149+0000 7f7374192740 20 client.19044 trim_cache size 0 max 16384 2024-09-11T22:18:37.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.165+0000 7f7374192740 1 Processor -- start 2024-09-11T22:18:37.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f7374192740 1 -- start start 2024-09-11T22:18:37.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f7374192740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aa2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f7374192740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa1480 0x560100ac3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f7374192740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aabd40 0x560100ac38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f7374192740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1b0340 con 0x560100aa0b60 2024-09-11T22:18:37.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f7374192740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1adc10 con 0x560100aa1480 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f7374192740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1aba80 con 0x560100aabd40 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aa2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aa2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33740/0 (socket says 172.21.15.152:33740) 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736b7fe640 1 -- 172.21.15.152:0/3210104233 learned_addr learned my addr 172.21.15.152:0/3210104233 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736affd640 1 --2- 172.21.15.152:0/3210104233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa1480 0x560100ac3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736bfff640 1 --2- 172.21.15.152:0/3210104233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aabd40 0x560100ac38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736b7fe640 1 -- 172.21.15.152:0/3210104233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aabd40 msgr2=0x560100ac38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736b7fe640 1 --2- 172.21.15.152:0/3210104233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aabd40 0x560100ac38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736b7fe640 1 -- 172.21.15.152:0/3210104233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa1480 msgr2=0x560100ac3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736b7fe640 1 --2- 172.21.15.152:0/3210104233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa1480 0x560100ac3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736b7fe640 1 -- 172.21.15.152:0/3210104233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560100a9cf20 con 0x560100aa0b60 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736bfff640 1 --2- 172.21.15.152:0/3210104233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aabd40 0x560100ac38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:37.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736affd640 1 --2- 172.21.15.152:0/3210104233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa1480 0x560100ac3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:37.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f736b7fe640 1 --2- 172.21.15.152:0/3210104233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aa2cc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f735c0092a0 tx=0x7f735c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55608d0916184e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:37.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f73517fa640 1 -- 172.21.15.152:0/3210104233 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c0a5070 con 0x560100aa0b60 2024-09-11T22:18:37.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f73517fa640 1 -- 172.21.15.152:0/3210104233 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f735c0bc310 con 0x560100aa0b60 2024-09-11T22:18:37.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.166+0000 7f73517fa640 1 -- 172.21.15.152:0/3210104233 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c049040 con 0x560100aa0b60 2024-09-11T22:18:37.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.167+0000 7f7374192740 1 -- 172.21.15.152:0/3210104233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 msgr2=0x560100aa2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:37.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.167+0000 7f7374192740 1 --2- 172.21.15.152:0/3210104233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aa2cc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f735c0092a0 tx=0x7f735c0045e0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.167+0000 7f7374192740 1 -- 172.21.15.152:0/3210104233 shutdown_connections 2024-09-11T22:18:37.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.167+0000 7f7374192740 1 --2- 172.21.15.152:0/3210104233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aabd40 0x560100ac38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.167+0000 7f7374192740 1 --2- 172.21.15.152:0/3210104233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aa1480 0x560100ac3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.167+0000 7f7374192740 1 --2- 172.21.15.152:0/3210104233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aa2cc0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.167+0000 7f7374192740 1 -- 172.21.15.152:0/3210104233 >> 172.21.15.152:0/3210104233 conn(0x560100a9d0f0 msgr2=0x560100aa25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.167+0000 7f7374192740 1 -- 172.21.15.152:0/3210104233 shutdown_connections 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.167+0000 7f7374192740 1 -- 172.21.15.152:0/3210104233 wait complete. 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.167+0000 7f7374192740 1 -- start start 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f7374192740 1 Processor -- start 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f7374192740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aaf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f7374192740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa1480 0x560100aafbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f7374192740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aabd40 0x560100ab0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f7374192740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1ac0d0 con 0x560100aa0b60 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f7374192740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1ad540 con 0x560100aabd40 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f7374192740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1ac7a0 con 0x560100aa1480 2024-09-11T22:18:37.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f7374192740 10 client.0 _ll_register_callbacks cb 0x7f736400c500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aaf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aaf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33742/0 (socket says 172.21.15.152:33742) 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736b7fe640 1 -- 172.21.15.152:0/1598574746 learned_addr learned my addr 172.21.15.152:0/1598574746 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736bfff640 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aabd40 0x560100ab0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736affd640 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa1480 0x560100aafbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736b7fe640 1 -- 172.21.15.152:0/1598574746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa1480 msgr2=0x560100aafbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736b7fe640 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa1480 0x560100aafbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736b7fe640 1 -- 172.21.15.152:0/1598574746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aabd40 msgr2=0x560100ab0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736b7fe640 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aabd40 0x560100ab0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736b7fe640 1 -- 172.21.15.152:0/1598574746 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560100b25360 con 0x560100aa0b60 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736bfff640 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aabd40 0x560100ab0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f736b7fe640 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aaf6b0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f735c006010 tx=0x7f735c003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e40729f59497359 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:37.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.168+0000 7f734affd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f734affd640 1 -- 172.21.15.152:0/1598574746 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c049070 con 0x560100aa0b60 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f734affd640 1 -- 172.21.15.152:0/1598574746 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f735c0ed7c0 con 0x560100aa0b60 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f7374192740 1 -- 172.21.15.152:0/1598574746 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f735c0bc310 con 0x560100aa0b60 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f734affd640 1 -- 172.21.15.152:0/1598574746 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f735c0a5040 con 0x560100aa0b60 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f7374192740 10 client.19050 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f7374192740 1 -- 172.21.15.152:0/1598574746 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560100b265c0 con 0x560100aa0b60 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f734affd640 1 -- 172.21.15.152:0/1598574746 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f735c0bc310 con 0x560100aa0b60 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f734affd640 1 -- 172.21.15.152:0/1598574746 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f735c0bc570 con 0x560100aa0b60 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f7374192740 10 client.19050 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f7374192740 10 client.19050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f7374192740 20 client.19050 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f7374192740 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560100b269a0 0x560100b28d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:37.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f7374192740 4 client.19050 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.169+0000 7f7374192740 1 -- 172.21.15.152:0/1598574746 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560100a0dd00 con 0x560100b269a0 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.170+0000 7f736affd640 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560100b269a0 0x560100b28d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.170+0000 7f734affd640 10 client.19050 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.170+0000 7f736affd640 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560100b269a0 0x560100b28d90 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22fd49adb9ebbbd7 server_cookie=a035abb34662ec44 in_seq=0 out_seq=0 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f734affd640 1 -- 172.21.15.152:0/1598574746 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560100a0dd00 con 0x560100b269a0 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f734affd640 10 client.19050 handle_command_reply: tid=0 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 1 client.19050 shutdown 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 1 -- 172.21.15.152:0/1598574746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 msgr2=0x560100aaf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aaf6b0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f735c006010 tx=0x7f735c003f50 comp rx=0 tx=0).stop 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 1 -- 172.21.15.152:0/1598574746 shutdown_connections 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x560100b269a0 0x560100b28d90 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560100aabd40 0x560100ab0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560100aa1480 0x560100aafbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 1 --2- 172.21.15.152:0/1598574746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560100aa0b60 0x560100aaf6b0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 1 -- 172.21.15.152:0/1598574746 >> 172.21.15.152:0/1598574746 conn(0x560100a9d0f0 msgr2=0x560100a9c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:37.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f734affd640 0 client.19050 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:37.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 1 -- 172.21.15.152:0/1598574746 shutdown_connections 2024-09-11T22:18:37.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 1 -- 172.21.15.152:0/1598574746 wait complete. 2024-09-11T22:18:37.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.171+0000 7f7374192740 20 client.19050 trim_cache size 0 max 16384 2024-09-11T22:18:37.177 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:18:37.177 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:18:37.178 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "1c749fbb-208b-413e-ac76-141b2303d0d6", 2024-09-11T22:18:37.178 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:18:37.178 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:18:37.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 -- 172.21.15.152:0/2951036361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73540a2cf0 msgr2=0x7f73540a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:37.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73540a2cf0 0x7f73540a51b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7364009fd0 tx=0x7f7364004a40 comp rx=0 tx=0).stop 2024-09-11T22:18:37.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 -- 172.21.15.152:0/2951036361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f736c101de0 msgr2=0x7f736c1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:37.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f736c101de0 0x7f736c1984b0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f735c005ab0 tx=0x7f735c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 -- 172.21.15.152:0/2951036361 shutdown_connections 2024-09-11T22:18:37.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f73540a2cf0 0x7f73540a51b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736c106f10 0x7f736c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f736c102790 0x7f736c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 --2- 172.21.15.152:0/2951036361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f736c101de0 0x7f736c1984b0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:37.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 -- 172.21.15.152:0/2951036361 >> 172.21.15.152:0/2951036361 conn(0x7f736c0fd8c0 msgr2=0x7f736c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:37.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 -- 172.21.15.152:0/2951036361 shutdown_connections 2024-09-11T22:18:37.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:37.172+0000 7f7371db9640 1 -- 172.21.15.152:0/2951036361 wait complete. 2024-09-11T22:18:37.964 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:18:37.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:37 smithi152 ceph-mon[31188]: pgmap v449: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 MiB/s wr, 271 op/s 2024-09-11T22:18:38.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:37 smithi179 ceph-mon[35603]: pgmap v449: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 MiB/s wr, 271 op/s 2024-09-11T22:18:38.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:37 smithi193 ceph-mon[35545]: pgmap v449: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 MiB/s wr, 271 op/s 2024-09-11T22:18:38.210 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:38.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.628+0000 7fd58e097640 1 -- 172.21.15.152:0/668291022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588101de0 msgr2=0x7fd5881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.628+0000 7fd58e097640 1 --2- 172.21.15.152:0/668291022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588101de0 0x7fd5881021c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fd578009900 tx=0x7fd57802a410 comp rx=0 tx=0).stop 2024-09-11T22:18:38.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.628+0000 7fd58e097640 1 -- 172.21.15.152:0/668291022 shutdown_connections 2024-09-11T22:18:38.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.628+0000 7fd58e097640 1 --2- 172.21.15.152:0/668291022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588106f10 0x7fd58810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.628+0000 7fd58e097640 1 --2- 172.21.15.152:0/668291022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588102790 0x7fd5881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.628+0000 7fd58e097640 1 --2- 172.21.15.152:0/668291022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588101de0 0x7fd5881021c0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.628+0000 7fd58e097640 1 -- 172.21.15.152:0/668291022 >> 172.21.15.152:0/668291022 conn(0x7fd5880fd8c0 msgr2=0x7fd5880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.628+0000 7fd58e097640 1 -- 172.21.15.152:0/668291022 shutdown_connections 2024-09-11T22:18:38.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.628+0000 7fd58e097640 1 -- 172.21.15.152:0/668291022 wait complete. 2024-09-11T22:18:38.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd58e097640 1 Processor -- start 2024-09-11T22:18:38.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd58e097640 1 -- start start 2024-09-11T22:18:38.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd58e097640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588101de0 0x7fd5881984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd58e097640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588102790 0x7fd588198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd58e097640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588106f10 0x7fd58819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd58e097640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd588111f90 con 0x7fd588106f10 2024-09-11T22:18:38.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd58e097640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd588111e10 con 0x7fd588102790 2024-09-11T22:18:38.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd58e097640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd588112110 con 0x7fd588101de0 2024-09-11T22:18:38.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd587fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588106f10 0x7fd58819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd587fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588106f10 0x7fd58819cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33760/0 (socket says 172.21.15.152:33760) 2024-09-11T22:18:38.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd587fff640 1 -- 172.21.15.152:0/3145475374 learned_addr learned my addr 172.21.15.152:0/3145475374 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:38.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588101de0 0x7fd5881984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd57ffff640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588102790 0x7fd588198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd587fff640 1 -- 172.21.15.152:0/3145475374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588101de0 msgr2=0x7fd5881984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.629+0000 7fd587fff640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588101de0 0x7fd5881984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.630+0000 7fd587fff640 1 -- 172.21.15.152:0/3145475374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588102790 msgr2=0x7fd588198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.630+0000 7fd587fff640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588102790 0x7fd588198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.630+0000 7fd587fff640 1 -- 172.21.15.152:0/3145475374 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58819d480 con 0x7fd588106f10 2024-09-11T22:18:38.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.630+0000 7fd587fff640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588106f10 0x7fd58819cda0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fd58000cad0 tx=0x7fd58000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.630+0000 7fd5857fa640 1 -- 172.21.15.152:0/3145475374 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58000ae20 con 0x7fd588106f10 2024-09-11T22:18:38.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.630+0000 7fd58e097640 1 -- 172.21.15.152:0/3145475374 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58819d770 con 0x7fd588106f10 2024-09-11T22:18:38.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.630+0000 7fd5857fa640 1 -- 172.21.15.152:0/3145475374 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd580005020 con 0x7fd588106f10 2024-09-11T22:18:38.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.630+0000 7fd5857fa640 1 -- 172.21.15.152:0/3145475374 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58000f6f0 con 0x7fd588106f10 2024-09-11T22:18:38.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.630+0000 7fd58e097640 1 -- 172.21.15.152:0/3145475374 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5881a5050 con 0x7fd588106f10 2024-09-11T22:18:38.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd590470740 1 Processor -- start 2024-09-11T22:18:38.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd5857fa640 1 -- 172.21.15.152:0/3145475374 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd5800051d0 con 0x7fd588106f10 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd590470740 1 -- start start 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd590470740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64048b0 0x5555e6404c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd590470740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64051d0 0x5555e640f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd590470740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6411e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd590470740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5555e63662e0 con 0x5555e640fa90 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd590470740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5555e630dce0 con 0x5555e64048b0 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd590470740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5555e63622a0 con 0x5555e64051d0 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd57ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6411e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd57ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6411e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33776/0 (socket says 172.21.15.152:33776) 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd57ffff640 1 -- 172.21.15.152:0/1363597481 learned_addr learned my addr 172.21.15.152:0/1363597481 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd5877fe640 1 --2- 172.21.15.152:0/1363597481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64051d0 0x5555e640f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd57ffff640 1 --2- 172.21.15.152:0/1363597481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64048b0 0x5555e6404c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd57ffff640 1 -- 172.21.15.152:0/1363597481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64051d0 msgr2=0x5555e640f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd57ffff640 1 --2- 172.21.15.152:0/1363597481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64051d0 0x5555e640f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd57ffff640 1 -- 172.21.15.152:0/1363597481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64048b0 msgr2=0x5555e6404c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.633+0000 7fd57ffff640 1 --2- 172.21.15.152:0/1363597481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64048b0 0x5555e6404c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.634+0000 7fd57ffff640 1 -- 172.21.15.152:0/1363597481 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e62f2440 con 0x5555e640fa90 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.634+0000 7fd5857fa640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5740a2cf0 0x7fd5740a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.634+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5740a2cf0 0x7fd5740a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.634+0000 7fd57ffff640 1 --2- 172.21.15.152:0/1363597481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6411e80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fd57000ae00 tx=0x7fd57000a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcd254d43653823 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.634+0000 7fd5857fa640 1 -- 172.21.15.152:0/3145475374 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fd5800cf600 con 0x7fd588106f10 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.634+0000 7fd57dffb640 1 -- 172.21.15.152:0/1363597481 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57001b070 con 0x5555e640fa90 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.634+0000 7fd57dffb640 1 -- 172.21.15.152:0/1363597481 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57000fd70 con 0x5555e640fa90 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.634+0000 7fd57dffb640 1 -- 172.21.15.152:0/1363597481 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5700146e0 con 0x5555e640fa90 2024-09-11T22:18:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd590470740 1 -- 172.21.15.152:0/1363597481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 msgr2=0x5555e6411e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5740a2cf0 0x7fd5740a51b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5555e6401ca0 tx=0x7fd578005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd590470740 1 --2- 172.21.15.152:0/1363597481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6411e80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fd57000ae00 tx=0x7fd57000a490 comp rx=0 tx=0).stop 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd590470740 1 -- 172.21.15.152:0/1363597481 shutdown_connections 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd590470740 1 --2- 172.21.15.152:0/1363597481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6411e80 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd590470740 1 --2- 172.21.15.152:0/1363597481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64051d0 0x5555e640f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd590470740 1 --2- 172.21.15.152:0/1363597481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64048b0 0x5555e6404c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd590470740 1 -- 172.21.15.152:0/1363597481 >> 172.21.15.152:0/1363597481 conn(0x5555e6400e40 msgr2=0x5555e6401220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd590470740 1 -- 172.21.15.152:0/1363597481 shutdown_connections 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd590470740 1 -- 172.21.15.152:0/1363597481 wait complete. 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd590470740 1 -- start start 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.635+0000 7fd590470740 1 Processor -- start 2024-09-11T22:18:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd590470740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64048b0 0x5555e640f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd590470740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64051d0 0x5555e640c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd590470740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e640fa90 0x5555e640cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd590470740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5555e6412660 con 0x5555e64051d0 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd590470740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5555e6321050 con 0x5555e640fa90 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd590470740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5555e64127e0 con 0x5555e64048b0 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd590470740 10 client.0 _ll_register_callbacks cb 0x5555e6361160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd57ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64051d0 0x5555e640c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd57ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64051d0 0x5555e640c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33780/0 (socket says 172.21.15.152:33780) 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd57ffff640 1 -- 172.21.15.152:0/3096046013 learned_addr learned my addr 172.21.15.152:0/3096046013 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64048b0 0x5555e640f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd587fff640 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e640fa90 0x5555e640cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd57ffff640 1 -- 172.21.15.152:0/3096046013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64048b0 msgr2=0x5555e640f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd57ffff640 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64048b0 0x5555e640f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd57ffff640 1 -- 172.21.15.152:0/3096046013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e640fa90 msgr2=0x5555e640cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd57ffff640 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e640fa90 0x5555e640cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd57ffff640 1 -- 172.21.15.152:0/3096046013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555e60d73c0 con 0x5555e64051d0 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd587fff640 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e640fa90 0x5555e640cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd57ffff640 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64051d0 0x5555e640c6f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fd570019040 tx=0x7fd570016a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e506c7db2c3e935d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.636+0000 7fd566ffd640 1 -- 172.21.15.152:0/3096046013 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570023020 con 0x5555e64051d0 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd590470740 1 -- 172.21.15.152:0/3096046013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd57000fd70 con 0x5555e64051d0 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd566ffd640 1 -- 172.21.15.152:0/3096046013 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fd570014460 con 0x5555e64051d0 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd566ffd640 1 -- 172.21.15.152:0/3096046013 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd57002e050 con 0x5555e64051d0 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd590470740 10 client.19062 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd590470740 1 -- 172.21.15.152:0/3096046013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5555e641e070 con 0x5555e64051d0 2024-09-11T22:18:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd566ffd640 1 -- 172.21.15.152:0/3096046013 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57000fd70 con 0x5555e64051d0 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd566ffd640 1 -- 172.21.15.152:0/3096046013 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd570015040 con 0x5555e64051d0 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd590470740 10 client.19062 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd590470740 10 client.19062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd590470740 20 client.19062 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd590470740 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5555e641f420 0x5555e6421810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd590470740 4 client.19062 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd590470740 1 -- 172.21.15.152:0/3096046013 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555e6373850 con 0x5555e641f420 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.637+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5555e641f420 0x5555e6421810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.638+0000 7fd566ffd640 10 client.19062 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.638+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5555e641f420 0x5555e6421810 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8726e8ce7a634d5e server_cookie=35bca7fb127eb9f9 in_seq=0 out_seq=0 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd566ffd640 1 -- 172.21.15.152:0/3096046013 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555e6373850 con 0x5555e641f420 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd566ffd640 10 client.19062 handle_command_reply: tid=0 2024-09-11T22:18:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 1 client.19062 shutdown 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 1 -- 172.21.15.152:0/3096046013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64051d0 msgr2=0x5555e640c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64051d0 0x5555e640c6f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fd570019040 tx=0x7fd570016a00 comp rx=0 tx=0).stop 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 1 -- 172.21.15.152:0/3096046013 shutdown_connections 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5555e641f420 0x5555e6421810 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e640fa90 0x5555e640cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64051d0 0x5555e640c6f0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd566ffd640 0 client.19062 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 1 --2- 172.21.15.152:0/3096046013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64048b0 0x5555e640f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 1 -- 172.21.15.152:0/3096046013 >> 172.21.15.152:0/3096046013 conn(0x5555e6400e40 msgr2=0x5555e63fbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 1 -- 172.21.15.152:0/3096046013 shutdown_connections 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 1 -- 172.21.15.152:0/3096046013 wait complete. 2024-09-11T22:18:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.639+0000 7fd590470740 20 client.19062 trim_cache size 0 max 16384 2024-09-11T22:18:38.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd590470740 1 Processor -- start 2024-09-11T22:18:38.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd590470740 1 -- start start 2024-09-11T22:18:38.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd590470740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64048b0 0x5555e641b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd590470740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64051d0 0x5555e63fbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd590470740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6426e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd590470740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd5881ae120 con 0x5555e640fa90 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd590470740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd5881ab9f0 con 0x5555e64051d0 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd590470740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd5881a9860 con 0x5555e64048b0 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd587fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6426e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd587fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6426e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33792/0 (socket says 172.21.15.152:33792) 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd587fff640 1 -- 172.21.15.152:0/1299310332 learned_addr learned my addr 172.21.15.152:0/1299310332 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd57ffff640 1 --2- 172.21.15.152:0/1299310332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64051d0 0x5555e63fbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd5877fe640 1 --2- 172.21.15.152:0/1299310332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64048b0 0x5555e641b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd587fff640 1 -- 172.21.15.152:0/1299310332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64048b0 msgr2=0x5555e641b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd587fff640 1 --2- 172.21.15.152:0/1299310332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64048b0 0x5555e641b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd587fff640 1 -- 172.21.15.152:0/1299310332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64051d0 msgr2=0x5555e63fbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd587fff640 1 --2- 172.21.15.152:0/1299310332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64051d0 0x5555e63fbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd587fff640 1 -- 172.21.15.152:0/1299310332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e640c690 con 0x5555e640fa90 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.656+0000 7fd57ffff640 1 --2- 172.21.15.152:0/1299310332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64051d0 0x5555e63fbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd587fff640 1 --2- 172.21.15.152:0/1299310332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6426e70 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd58009b7c0 tx=0x7fd58009bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b452325a2f8a68d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd57d7fa640 1 -- 172.21.15.152:0/1299310332 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5800b4070 con 0x5555e640fa90 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd57d7fa640 1 -- 172.21.15.152:0/1299310332 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd580099dc0 con 0x5555e640fa90 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd57d7fa640 1 -- 172.21.15.152:0/1299310332 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58001d040 con 0x5555e640fa90 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd590470740 1 -- 172.21.15.152:0/1299310332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 msgr2=0x5555e6426e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd590470740 1 --2- 172.21.15.152:0/1299310332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6426e70 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd58009b7c0 tx=0x7fd58009bb80 comp rx=0 tx=0).stop 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd590470740 1 -- 172.21.15.152:0/1299310332 shutdown_connections 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd590470740 1 --2- 172.21.15.152:0/1299310332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e640fa90 0x5555e6426e70 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd590470740 1 --2- 172.21.15.152:0/1299310332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64051d0 0x5555e63fbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd590470740 1 --2- 172.21.15.152:0/1299310332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e64048b0 0x5555e641b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd590470740 1 -- 172.21.15.152:0/1299310332 >> 172.21.15.152:0/1299310332 conn(0x5555e6400e40 msgr2=0x5555e6407cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd590470740 1 -- 172.21.15.152:0/1299310332 shutdown_connections 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.657+0000 7fd590470740 1 -- 172.21.15.152:0/1299310332 wait complete. 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd590470740 1 -- start start 2024-09-11T22:18:38.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd590470740 1 Processor -- start 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd590470740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64048b0 0x5555e6413890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd590470740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64051d0 0x5555e6413dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd590470740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e640fa90 0x5555e6414310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd590470740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd5881a9eb0 con 0x5555e64048b0 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd590470740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd5881ab320 con 0x5555e64051d0 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd590470740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd5881aa580 con 0x5555e640fa90 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd590470740 10 client.0 _ll_register_callbacks cb 0x7fd570019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd5877fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64048b0 0x5555e6413890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd5877fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64048b0 0x5555e6413890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33804/0 (socket says 172.21.15.152:33804) 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd5877fe640 1 -- 172.21.15.152:0/3812598723 learned_addr learned my addr 172.21.15.152:0/3812598723 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.658+0000 7fd57ffff640 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64051d0 0x5555e6413dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd587fff640 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e640fa90 0x5555e6414310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd5877fe640 1 -- 172.21.15.152:0/3812598723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e640fa90 msgr2=0x5555e6414310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e640fa90 0x5555e6414310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd5877fe640 1 -- 172.21.15.152:0/3812598723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64051d0 msgr2=0x5555e6413dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64051d0 0x5555e6413dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd5877fe640 1 -- 172.21.15.152:0/3812598723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555e6488ec0 con 0x5555e64048b0 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd5877fe640 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64048b0 0x5555e6413890 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd57802a930 tx=0x7fd578009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432c77d02c2b5da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd566ffd640 1 -- 172.21.15.152:0/3812598723 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578035050 con 0x5555e64048b0 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd590470740 1 -- 172.21.15.152:0/3812598723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd580099dc0 con 0x5555e64048b0 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd566ffd640 1 -- 172.21.15.152:0/3812598723 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7fd578003a00 con 0x5555e64048b0 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd566ffd640 1 -- 172.21.15.152:0/3812598723 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd578003c00 con 0x5555e64048b0 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd590470740 10 client.19068 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:38.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd590470740 1 -- 172.21.15.152:0/3812598723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5555e648a160 con 0x5555e64048b0 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd566ffd640 1 -- 172.21.15.152:0/3812598723 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd580099dc0 con 0x5555e64048b0 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.659+0000 7fd566ffd640 1 -- 172.21.15.152:0/3812598723 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fd57803b430 con 0x5555e64048b0 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd590470740 10 client.19068 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd590470740 10 client.19068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd590470740 20 client.19068 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd590470740 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5555e648a860 0x5555e648cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd590470740 4 client.19068 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd590470740 1 -- 172.21.15.152:0/3812598723 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5555e636dd60 con 0x5555e648a860 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd57ffff640 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5555e648a860 0x5555e648cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd566ffd640 10 client.19068 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd57ffff640 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5555e648a860 0x5555e648cc80 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22ea13e35fd78fba server_cookie=b864ee18f307f28 in_seq=0 out_seq=0 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd566ffd640 1 -- 172.21.15.152:0/3812598723 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5555e636dd60 con 0x5555e648a860 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd566ffd640 10 client.19068 handle_command_reply: tid=0 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.660+0000 7fd590470740 1 client.19068 shutdown 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd590470740 1 -- 172.21.15.152:0/3812598723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64048b0 msgr2=0x5555e6413890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd590470740 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64048b0 0x5555e6413890 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd57802a930 tx=0x7fd578009260 comp rx=0 tx=0).stop 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd590470740 1 -- 172.21.15.152:0/3812598723 shutdown_connections 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd590470740 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5555e648a860 0x5555e648cc80 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd590470740 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5555e640fa90 0x5555e6414310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd590470740 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5555e64051d0 0x5555e6413dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd566ffd640 0 client.19068 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd590470740 1 --2- 172.21.15.152:0/3812598723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5555e64048b0 0x5555e6413890 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd590470740 1 -- 172.21.15.152:0/3812598723 >> 172.21.15.152:0/3812598723 conn(0x5555e6400e40 msgr2=0x5555e6406b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd590470740 1 -- 172.21.15.152:0/3812598723 shutdown_connections 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd590470740 1 -- 172.21.15.152:0/3812598723 wait complete. 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd590470740 20 client.19068 trim_cache size 0 max 16384 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi152.stdout: "1c749fbb-208b-413e-ac76-141b2303d0d6": { 2024-09-11T22:18:38.671 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:18:38.671 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "1c749fbb-208b-413e-ac76-141b2303d0d6", 2024-09-11T22:18:38.671 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:18:38.671 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:38.671 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:38.672 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:18:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd58e097640 1 -- 172.21.15.152:0/3145475374 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5740a2cf0 msgr2=0x7fd5740a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd58e097640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5740a2cf0 0x7fd5740a51b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5555e6401ca0 tx=0x7fd578005a20 comp rx=0 tx=0).stop 2024-09-11T22:18:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd58e097640 1 -- 172.21.15.152:0/3145475374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588106f10 msgr2=0x7fd58819cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd58e097640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588106f10 0x7fd58819cda0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fd58000cad0 tx=0x7fd58000cf90 comp rx=0 tx=0).stop 2024-09-11T22:18:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd58e097640 1 -- 172.21.15.152:0/3145475374 shutdown_connections 2024-09-11T22:18:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd58e097640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fd5740a2cf0 0x7fd5740a51b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd58e097640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd588106f10 0x7fd58819cda0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd58e097640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588102790 0x7fd588198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd58e097640 1 --2- 172.21.15.152:0/3145475374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd588101de0 0x7fd5881984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd58e097640 1 -- 172.21.15.152:0/3145475374 >> 172.21.15.152:0/3145475374 conn(0x7fd5880fd8c0 msgr2=0x7fd5880fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.661+0000 7fd58e097640 1 -- 172.21.15.152:0/3145475374 shutdown_connections 2024-09-11T22:18:38.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:38.662+0000 7fd58e097640 1 -- 172.21.15.152:0/3145475374 wait complete. 2024-09-11T22:18:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:38 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:18:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:38 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:18:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:38 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:18:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:38 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:18:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:38 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:18:38.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:38 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:18:39.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:38 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:18:39.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:38 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:18:39.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:38 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:18:39.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:38 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:18:39.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:38 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:18:39.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:38 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:18:39.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:38 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:18:39.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:38 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:18:39.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:38 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:18:39.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:38 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:18:39.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:38 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:18:39.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:38 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:18:39.447 INFO:tasks.cephfs.filesystem:scrub status for tag:1c749fbb-208b-413e-ac76-141b2303d0d6 - {'path': '/', 'tag': '1c749fbb-208b-413e-ac76-141b2303d0d6', 'options': 'recursive,force'} 2024-09-11T22:18:39.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:18:40.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:39 smithi179 ceph-mon[35603]: pgmap v450: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.5 MiB/s wr, 655 op/s 2024-09-11T22:18:40.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:39 smithi193 ceph-mon[35545]: pgmap v450: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.5 MiB/s wr, 655 op/s 2024-09-11T22:18:40.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:39 smithi152 ceph-mon[31188]: pgmap v450: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.5 MiB/s wr, 655 op/s 2024-09-11T22:18:41.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:40 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:18:41.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:40 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:18:41.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:40 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:18:41.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:40 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:18:41.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:40 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:18:41.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:40 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:18:41.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:40 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:18:41.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:40 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:18:41.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:40 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:18:41.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:40 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:18:41.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:40 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:18:41.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:40 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:18:42.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:41 smithi179 ceph-mon[35603]: pgmap v451: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.9 MiB/s wr, 609 op/s 2024-09-11T22:18:42.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:41 smithi193 ceph-mon[35545]: pgmap v451: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.9 MiB/s wr, 609 op/s 2024-09-11T22:18:42.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:41 smithi152 ceph-mon[31188]: pgmap v451: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.9 MiB/s wr, 609 op/s 2024-09-11T22:18:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.343+0000 7f78fbcb7640 1 -- 172.21.15.152:0/986140050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78f4101150 msgr2=0x7f78f410dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.343+0000 7f78fbcb7640 1 --2- 172.21.15.152:0/986140050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78f4101150 0x7f78f410dd30 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009900 tx=0x7f78e802a480 comp rx=0 tx=0).stop 2024-09-11T22:18:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.343+0000 7f78fbcb7640 1 -- 172.21.15.152:0/986140050 shutdown_connections 2024-09-11T22:18:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.343+0000 7f78fbcb7640 1 --2- 172.21.15.152:0/986140050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f410e300 0x7f78f41107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.343+0000 7f78fbcb7640 1 --2- 172.21.15.152:0/986140050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78f4101150 0x7f78f410dd30 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.343+0000 7f78fbcb7640 1 --2- 172.21.15.152:0/986140050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4100830 0x7f78f4100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.343+0000 7f78fbcb7640 1 -- 172.21.15.152:0/986140050 >> 172.21.15.152:0/986140050 conn(0x7f78f4075f20 msgr2=0x7f78f4076330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.343+0000 7f78fbcb7640 1 -- 172.21.15.152:0/986140050 shutdown_connections 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.343+0000 7f78fbcb7640 1 -- 172.21.15.152:0/986140050 wait complete. 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.343+0000 7f78fbcb7640 1 Processor -- start 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.343+0000 7f78fbcb7640 1 -- start start 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fbcb7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f4100830 0x7f78f419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fbcb7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4101150 0x7f78f419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fbcb7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78f410e300 0x7f78f419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fbcb7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41140e0 con 0x7f78f410e300 2024-09-11T22:18:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fbcb7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78f4113f60 con 0x7f78f4100830 2024-09-11T22:18:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fbcb7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78f4114260 con 0x7f78f4101150 2024-09-11T22:18:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fa254640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78f410e300 0x7f78f419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fa254640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78f410e300 0x7f78f419edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33826/0 (socket says 172.21.15.152:33826) 2024-09-11T22:18:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fa254640 1 -- 172.21.15.152:0/2041743869 learned_addr learned my addr 172.21.15.152:0/2041743869 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78f9252640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4101150 0x7f78f419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78f9a53640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f4100830 0x7f78f419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fa254640 1 -- 172.21.15.152:0/2041743869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4101150 msgr2=0x7f78f419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fa254640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4101150 0x7f78f419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fa254640 1 -- 172.21.15.152:0/2041743869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f4100830 msgr2=0x7f78f419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fa254640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f4100830 0x7f78f419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fa254640 1 -- 172.21.15.152:0/2041743869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f419f520 con 0x7f78f410e300 2024-09-11T22:18:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fa254640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78f410e300 0x7f78f419edf0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00eb10 tx=0x7f78ec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78e6ffd640 1 -- 172.21.15.152:0/2041743869 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec004b20 con 0x7f78f410e300 2024-09-11T22:18:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78fbcb7640 1 -- 172.21.15.152:0/2041743869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f419f810 con 0x7f78f410e300 2024-09-11T22:18:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.344+0000 7f78e6ffd640 1 -- 172.21.15.152:0/2041743869 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78ec004cc0 con 0x7f78f410e300 2024-09-11T22:18:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.345+0000 7f78e6ffd640 1 -- 172.21.15.152:0/2041743869 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec010760 con 0x7f78f410e300 2024-09-11T22:18:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.345+0000 7f78fbcb7640 1 -- 172.21.15.152:0/2041743869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f41a70a0 con 0x7f78f410e300 2024-09-11T22:18:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.347+0000 7f78e6ffd640 1 -- 172.21.15.152:0/2041743869 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f78ec005020 con 0x7f78f410e300 2024-09-11T22:18:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.347+0000 7f78fea52740 1 Processor -- start 2024-09-11T22:18:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78fea52740 1 -- start start 2024-09-11T22:18:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78fea52740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978baf0 0x564ce978bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78fea52740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978c410 0x564ce9796770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78fea52740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce9796cb0 0x564ce97990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78fea52740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564ce96f02f0 con 0x564ce978baf0 2024-09-11T22:18:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78fea52740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564ce9698270 con 0x564ce9796cb0 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78fea52740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564ce96ec2b0 con 0x564ce978c410 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78f9252640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978baf0 0x564ce978bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78f9252640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978baf0 0x564ce978bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33836/0 (socket says 172.21.15.152:33836) 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78f9252640 1 -- 172.21.15.152:0/1378539489 learned_addr learned my addr 172.21.15.152:0/1378539489 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78e6ffd640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e00a2da0 0x7f78e00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78f9a53640 1 --2- 172.21.15.152:0/1378539489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978c410 0x564ce9796770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78f9252640 1 --2- 172.21.15.152:0/1378539489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce9796cb0 0x564ce97990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.348+0000 7f78fa254640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e00a2da0 0x7f78e00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.349+0000 7f78e6ffd640 1 -- 172.21.15.152:0/2041743869 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f78ec0cf9a0 con 0x7f78f410e300 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.349+0000 7f78f9252640 1 -- 172.21.15.152:0/1378539489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978c410 msgr2=0x564ce9796770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.349+0000 7f78f9252640 1 --2- 172.21.15.152:0/1378539489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978c410 0x564ce9796770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.349+0000 7f78f9252640 1 -- 172.21.15.152:0/1378539489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce9796cb0 msgr2=0x564ce97990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.349+0000 7f78f9252640 1 --2- 172.21.15.152:0/1378539489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce9796cb0 0x564ce97990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.349+0000 7f78f9252640 1 -- 172.21.15.152:0/1378539489 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ce9697340 con 0x564ce978baf0 2024-09-11T22:18:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.349+0000 7f78f9252640 1 --2- 172.21.15.152:0/1378539489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978baf0 0x564ce978bed0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f78e8005c40 tx=0x7f78e8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d589906d211667 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.349+0000 7f78fa254640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e00a2da0 0x7f78e00a5260 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f78ec09bb60 tx=0x7f78ec0912f0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.349+0000 7f78dffff640 1 -- 172.21.15.152:0/1378539489 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8044070 con 0x564ce978baf0 2024-09-11T22:18:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.349+0000 7f78dffff640 1 -- 172.21.15.152:0/1378539489 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78e8005500 con 0x564ce978baf0 2024-09-11T22:18:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.349+0000 7f78dffff640 1 -- 172.21.15.152:0/1378539489 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8035040 con 0x564ce978baf0 2024-09-11T22:18:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.350+0000 7f78fea52740 1 -- 172.21.15.152:0/1378539489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978baf0 msgr2=0x564ce978bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.350+0000 7f78fea52740 1 --2- 172.21.15.152:0/1378539489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978baf0 0x564ce978bed0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f78e8005c40 tx=0x7f78e8000bc0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.350+0000 7f78fea52740 1 -- 172.21.15.152:0/1378539489 shutdown_connections 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.350+0000 7f78fea52740 1 --2- 172.21.15.152:0/1378539489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce9796cb0 0x564ce97990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.350+0000 7f78fea52740 1 --2- 172.21.15.152:0/1378539489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978c410 0x564ce9796770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.350+0000 7f78fea52740 1 --2- 172.21.15.152:0/1378539489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978baf0 0x564ce978bed0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.350+0000 7f78fea52740 1 -- 172.21.15.152:0/1378539489 >> 172.21.15.152:0/1378539489 conn(0x564ce9788060 msgr2=0x564ce9788440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.350+0000 7f78fea52740 1 -- 172.21.15.152:0/1378539489 shutdown_connections 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.350+0000 7f78fea52740 1 -- 172.21.15.152:0/1378539489 wait complete. 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.350+0000 7f78fea52740 1 -- start start 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.350+0000 7f78fea52740 1 Processor -- start 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78fea52740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978baf0 0x564ce9793b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78fea52740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978c410 0x564ce97940b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78fea52740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce9796cb0 0x564ce97945f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78fea52740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564ce9799880 con 0x564ce978c410 2024-09-11T22:18:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78fea52740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564ce9679290 con 0x564ce978baf0 2024-09-11T22:18:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78fea52740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564ce9799a00 con 0x564ce9796cb0 2024-09-11T22:18:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78fea52740 10 client.0 _ll_register_callbacks cb 0x564ce96aa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9a53640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978c410 0x564ce97940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9a53640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978c410 0x564ce97940b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33844/0 (socket says 172.21.15.152:33844) 2024-09-11T22:18:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9a53640 1 -- 172.21.15.152:0/3778222859 learned_addr learned my addr 172.21.15.152:0/3778222859 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9252640 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce9796cb0 0x564ce97945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9252640 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978baf0 0x564ce9793b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9a53640 1 -- 172.21.15.152:0/3778222859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce9796cb0 msgr2=0x564ce97945f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9a53640 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce9796cb0 0x564ce97945f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9a53640 1 -- 172.21.15.152:0/3778222859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978baf0 msgr2=0x564ce9793b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9a53640 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978baf0 0x564ce9793b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9a53640 1 -- 172.21.15.152:0/3778222859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ce9403210 con 0x564ce978c410 2024-09-11T22:18:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9252640 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978baf0 0x564ce9793b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78f9a53640 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978c410 0x564ce97940b0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f78f000ba40 tx=0x7f78f000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0b22d8040cf7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.351+0000 7f78dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3778222859 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0011440 con 0x564ce978c410 2024-09-11T22:18:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3778222859 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f78f00115e0 con 0x564ce978c410 2024-09-11T22:18:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78fea52740 1 -- 172.21.15.152:0/3778222859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78e8005500 con 0x564ce978c410 2024-09-11T22:18:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3778222859 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f78f00117e0 con 0x564ce978c410 2024-09-11T22:18:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78fea52740 10 client.19080 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78fea52740 1 -- 172.21.15.152:0/3778222859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564ce94cf620 con 0x564ce978c410 2024-09-11T22:18:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3778222859 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78e8005500 con 0x564ce978c410 2024-09-11T22:18:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3778222859 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f78f001b9f0 con 0x564ce978c410 2024-09-11T22:18:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78fea52740 10 client.19080 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78fea52740 10 client.19080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78fea52740 20 client.19080 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78fea52740 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564ce97a6c60 0x564ce97a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78fea52740 4 client.19080 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.352+0000 7f78fea52740 1 -- 172.21.15.152:0/3778222859 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ce96fda20 con 0x564ce97a6c60 2024-09-11T22:18:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.353+0000 7f78f9252640 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564ce97a6c60 0x564ce97a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.353+0000 7f78dd7fa640 10 client.19080 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.353+0000 7f78f9252640 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564ce97a6c60 0x564ce97a90b0 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d6e79db8a4b2d70 server_cookie=ae1bfa4b252d7a76 in_seq=0 out_seq=0 2024-09-11T22:18:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3778222859 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ce96fda20 con 0x564ce97a6c60 2024-09-11T22:18:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78dd7fa640 10 client.19080 handle_command_reply: tid=0 2024-09-11T22:18:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 1 client.19080 shutdown 2024-09-11T22:18:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 1 -- 172.21.15.152:0/3778222859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978c410 msgr2=0x564ce97940b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978c410 0x564ce97940b0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f78f000ba40 tx=0x7f78f000bf00 comp rx=0 tx=0).stop 2024-09-11T22:18:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 1 -- 172.21.15.152:0/3778222859 shutdown_connections 2024-09-11T22:18:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564ce97a6c60 0x564ce97a90b0 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce9796cb0 0x564ce97945f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce978c410 0x564ce97940b0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 1 --2- 172.21.15.152:0/3778222859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978baf0 0x564ce9793b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78dd7fa640 0 client.19080 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 1 -- 172.21.15.152:0/3778222859 >> 172.21.15.152:0/3778222859 conn(0x564ce9788060 msgr2=0x564ce978ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 1 -- 172.21.15.152:0/3778222859 shutdown_connections 2024-09-11T22:18:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 1 -- 172.21.15.152:0/3778222859 wait complete. 2024-09-11T22:18:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.354+0000 7f78fea52740 20 client.19080 trim_cache size 0 max 16384 2024-09-11T22:18:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.368+0000 7f78fea52740 1 Processor -- start 2024-09-11T22:18:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.368+0000 7f78fea52740 1 -- start start 2024-09-11T22:18:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78fea52740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978baf0 0x564ce978e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78fea52740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978c410 0x564ce9794420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78fea52740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce97ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78fea52740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41b2350 con 0x564ce9796cb0 2024-09-11T22:18:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78fea52740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41afc20 con 0x564ce978c410 2024-09-11T22:18:43.371 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78fea52740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41ada90 con 0x564ce978baf0 2024-09-11T22:18:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78f9252640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce97ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78f9252640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce97ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53156/0 (socket says 172.21.15.152:53156) 2024-09-11T22:18:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78f9252640 1 -- 172.21.15.152:0/832527982 learned_addr learned my addr 172.21.15.152:0/832527982 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78f9a53640 1 --2- 172.21.15.152:0/832527982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978c410 0x564ce9794420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78f9252640 1 --2- 172.21.15.152:0/832527982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978baf0 0x564ce978e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78f9252640 1 -- 172.21.15.152:0/832527982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978baf0 msgr2=0x564ce978e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78f9252640 1 --2- 172.21.15.152:0/832527982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978baf0 0x564ce978e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78f9252640 1 -- 172.21.15.152:0/832527982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978c410 msgr2=0x564ce9794420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78f9252640 1 --2- 172.21.15.152:0/832527982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978c410 0x564ce9794420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78f9252640 1 -- 172.21.15.152:0/832527982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ce97a9730 con 0x564ce9796cb0 2024-09-11T22:18:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78f9252640 1 --2- 172.21.15.152:0/832527982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce97ae9c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f78e8004810 tx=0x7f78e8004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b1b7638e394e40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78df7fe640 1 -- 172.21.15.152:0/832527982 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8035070 con 0x564ce9796cb0 2024-09-11T22:18:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78df7fe640 1 -- 172.21.15.152:0/832527982 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78e80035f0 con 0x564ce9796cb0 2024-09-11T22:18:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.369+0000 7f78df7fe640 1 -- 172.21.15.152:0/832527982 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8044040 con 0x564ce9796cb0 2024-09-11T22:18:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.370+0000 7f78fea52740 1 -- 172.21.15.152:0/832527982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 msgr2=0x564ce97ae9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.370+0000 7f78fea52740 1 --2- 172.21.15.152:0/832527982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce97ae9c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f78e8004810 tx=0x7f78e8004840 comp rx=0 tx=0).stop 2024-09-11T22:18:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.370+0000 7f78fea52740 1 -- 172.21.15.152:0/832527982 shutdown_connections 2024-09-11T22:18:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.370+0000 7f78fea52740 1 --2- 172.21.15.152:0/832527982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce97ae9c0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.370+0000 7f78fea52740 1 --2- 172.21.15.152:0/832527982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978c410 0x564ce9794420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.370+0000 7f78fea52740 1 --2- 172.21.15.152:0/832527982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978baf0 0x564ce978e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.370+0000 7f78fea52740 1 -- 172.21.15.152:0/832527982 >> 172.21.15.152:0/832527982 conn(0x564ce9788060 msgr2=0x564ce9795bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.370+0000 7f78fea52740 1 -- 172.21.15.152:0/832527982 shutdown_connections 2024-09-11T22:18:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.370+0000 7f78fea52740 1 -- 172.21.15.152:0/832527982 wait complete. 2024-09-11T22:18:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.370+0000 7f78fea52740 1 -- start start 2024-09-11T22:18:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.370+0000 7f78fea52740 1 Processor -- start 2024-09-11T22:18:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78fea52740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978baf0 0x564ce979f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78fea52740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978c410 0x564ce979f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78fea52740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce979a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78fea52740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41ae0e0 con 0x564ce9796cb0 2024-09-11T22:18:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78fea52740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41af550 con 0x564ce978c410 2024-09-11T22:18:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78fea52740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41ae7b0 con 0x564ce978baf0 2024-09-11T22:18:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78fea52740 10 client.0 _ll_register_callbacks cb 0x7f78f00042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9252640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce979a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9252640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce979a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53166/0 (socket says 172.21.15.152:53166) 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9252640 1 -- 172.21.15.152:0/3359266113 learned_addr learned my addr 172.21.15.152:0/3359266113 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9252640 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978baf0 0x564ce979f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9a53640 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978c410 0x564ce979f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9252640 1 -- 172.21.15.152:0/3359266113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978baf0 msgr2=0x564ce979f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9252640 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978baf0 0x564ce979f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9252640 1 -- 172.21.15.152:0/3359266113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978c410 msgr2=0x564ce979f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9252640 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978c410 0x564ce979f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9252640 1 -- 172.21.15.152:0/3359266113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ce97832d0 con 0x564ce9796cb0 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9a53640 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978c410 0x564ce979f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78f9252640 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce979a610 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f78e8031bf0 tx=0x7f78e8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3823cd980c8ef2d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3359266113 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8044070 con 0x564ce9796cb0 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3359266113 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f78e80037a0 con 0x564ce9796cb0 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.371+0000 7f78fea52740 1 -- 172.21.15.152:0/3359266113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78e80035f0 con 0x564ce9796cb0 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3359266113 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f78e8035040 con 0x564ce9796cb0 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78fea52740 10 client.19086 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78fea52740 1 -- 172.21.15.152:0/3359266113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564ce9811480 con 0x564ce9796cb0 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3359266113 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78e80035f0 con 0x564ce9796cb0 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3359266113 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f78e803d590 con 0x564ce9796cb0 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78fea52740 10 client.19086 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78fea52740 10 client.19086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78fea52740 20 client.19086 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78fea52740 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564ce98116b0 0x564ce9813aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78fea52740 4 client.19086 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:18:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78fea52740 1 -- 172.21.15.152:0/3359266113 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ce96f7d70 con 0x564ce98116b0 2024-09-11T22:18:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.372+0000 7f78f9a53640 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564ce98116b0 0x564ce9813aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.373+0000 7f78dd7fa640 10 client.19086 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.373+0000 7f78f9a53640 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564ce98116b0 0x564ce9813aa0 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d50ca8110facb2f0 server_cookie=33ec13ce50611dc0 in_seq=0 out_seq=0 2024-09-11T22:18:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78dd7fa640 1 -- 172.21.15.152:0/3359266113 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ce96f7d70 con 0x564ce98116b0 2024-09-11T22:18:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78dd7fa640 10 client.19086 handle_command_reply: tid=0 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78fea52740 1 client.19086 shutdown 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78fea52740 1 -- 172.21.15.152:0/3359266113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 msgr2=0x564ce979a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78fea52740 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce979a610 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f78e8031bf0 tx=0x7f78e8003f10 comp rx=0 tx=0).stop 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78fea52740 1 -- 172.21.15.152:0/3359266113 shutdown_connections 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78fea52740 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564ce98116b0 0x564ce9813aa0 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78fea52740 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ce9796cb0 0x564ce979a610 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78fea52740 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ce978c410 0x564ce979f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78fea52740 1 --2- 172.21.15.152:0/3359266113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564ce978baf0 0x564ce979f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78dd7fa640 0 client.19086 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78fea52740 1 -- 172.21.15.152:0/3359266113 >> 172.21.15.152:0/3359266113 conn(0x564ce9788060 msgr2=0x564ce97869a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78fea52740 1 -- 172.21.15.152:0/3359266113 shutdown_connections 2024-09-11T22:18:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.381+0000 7f78fea52740 1 -- 172.21.15.152:0/3359266113 wait complete. 2024-09-11T22:18:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fea52740 20 client.19086 trim_cache size 0 max 16384 2024-09-11T22:18:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:18:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:18:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:18:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:18:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 -- 172.21.15.152:0/2041743869 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e00a2da0 msgr2=0x7f78e00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e00a2da0 0x7f78e00a5260 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f78ec09bb60 tx=0x7f78ec0912f0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 -- 172.21.15.152:0/2041743869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78f410e300 msgr2=0x7f78f419edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78f410e300 0x7f78f419edf0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00eb10 tx=0x7f78ec00c2d0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 -- 172.21.15.152:0/2041743869 shutdown_connections 2024-09-11T22:18:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f78e00a2da0 0x7f78e00a5260 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78f410e300 0x7f78f419edf0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4101150 0x7f78f419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 --2- 172.21.15.152:0/2041743869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f4100830 0x7f78f419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 -- 172.21.15.152:0/2041743869 >> 172.21.15.152:0/2041743869 conn(0x7f78f4075f20 msgr2=0x7f78f410e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 -- 172.21.15.152:0/2041743869 shutdown_connections 2024-09-11T22:18:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:43.382+0000 7f78fbcb7640 1 -- 172.21.15.152:0/2041743869 wait complete. 2024-09-11T22:18:44.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:43 smithi179 ceph-mon[35603]: pgmap v452: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.9 MiB/s wr, 608 op/s 2024-09-11T22:18:44.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:43 smithi193 ceph-mon[35545]: pgmap v452: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.9 MiB/s wr, 608 op/s 2024-09-11T22:18:44.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:43 smithi152 ceph-mon[31188]: pgmap v452: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.9 MiB/s wr, 608 op/s 2024-09-11T22:18:44.823 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T22:18:45.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:44 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:18:45.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:44 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:18:45.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:44 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:18:45.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:44 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:18:45.131 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:44 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:18:45.131 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:44 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:18:46.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:45 smithi179 ceph-mon[35603]: pgmap v453: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 MiB/s wr, 612 op/s 2024-09-11T22:18:46.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:45 smithi193 ceph-mon[35545]: pgmap v453: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 MiB/s wr, 612 op/s 2024-09-11T22:18:46.152 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:45 smithi152 ceph-mon[31188]: pgmap v453: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 MiB/s wr, 612 op/s 2024-09-11T22:18:46.749 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:18:47.005 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:47.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.441+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2242652435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b04103660 msgr2=0x7f8b0410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.441+0000 7f8b0ad64640 1 --2- 172.21.15.152:0/2242652435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b04103660 0x7f8b0410bb50 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009900 tx=0x7f8af002a480 comp rx=0 tx=0).stop 2024-09-11T22:18:47.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.441+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2242652435 shutdown_connections 2024-09-11T22:18:47.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.441+0000 7f8b0ad64640 1 --2- 172.21.15.152:0/2242652435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b0410c170 0x7f8b0410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.441+0000 7f8b0ad64640 1 --2- 172.21.15.152:0/2242652435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b04103660 0x7f8b0410bb50 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.441+0000 7f8b0ad64640 1 --2- 172.21.15.152:0/2242652435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b04102d40 0x7f8b04103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.441+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2242652435 >> 172.21.15.152:0/2242652435 conn(0x7f8b040fc7a0 msgr2=0x7f8b040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:47.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.441+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2242652435 shutdown_connections 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.441+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2242652435 wait complete. 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b0ad64640 1 Processor -- start 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b0ad64640 1 -- start start 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b0ad64640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b04102d40 0x7f8b041984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b0ad64640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b04103660 0x7f8b04198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b0ad64640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b0410c170 0x7f8b0419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b0ad64640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04111fd0 con 0x7f8b04103660 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b0ad64640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04111e50 con 0x7f8b04102d40 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b0ad64640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04112150 con 0x7f8b0410c170 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b03fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b04103660 0x7f8b04198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b03fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b04103660 0x7f8b04198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53174/0 (socket says 172.21.15.152:53174) 2024-09-11T22:18:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b03fff640 1 -- 172.21.15.152:0/2450657447 learned_addr learned my addr 172.21.15.152:0/2450657447 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b09301640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b0410c170 0x7f8b0419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b08b00640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b04102d40 0x7f8b041984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b03fff640 1 -- 172.21.15.152:0/2450657447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b0410c170 msgr2=0x7f8b0419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b03fff640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b0410c170 0x7f8b0419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b03fff640 1 -- 172.21.15.152:0/2450657447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b04102d40 msgr2=0x7f8b041984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.442+0000 7f8b03fff640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b04102d40 0x7f8b041984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.443+0000 7f8b03fff640 1 -- 172.21.15.152:0/2450657447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0419d4a0 con 0x7f8b04103660 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.443+0000 7f8b08b00640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b04102d40 0x7f8b041984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.443+0000 7f8b03fff640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b04103660 0x7f8b04198a30 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8af0006010 tx=0x7f8af00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.443+0000 7f8b01ffb640 1 -- 172.21.15.152:0/2450657447 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af003f030 con 0x7f8b04103660 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.443+0000 7f8b01ffb640 1 -- 172.21.15.152:0/2450657447 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8af0003ce0 con 0x7f8b04103660 2024-09-11T22:18:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.443+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2450657447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0419d730 con 0x7f8b04103660 2024-09-11T22:18:47.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.443+0000 7f8b01ffb640 1 -- 172.21.15.152:0/2450657447 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0035070 con 0x7f8b04103660 2024-09-11T22:18:47.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.443+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2450657447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b041a5070 con 0x7f8b04103660 2024-09-11T22:18:47.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.444+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2450657447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b04103120 con 0x7f8b04103660 2024-09-11T22:18:47.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.445+0000 7f8b01ffb640 1 -- 172.21.15.152:0/2450657447 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8af0042030 con 0x7f8b04103660 2024-09-11T22:18:47.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.446+0000 7f8b01ffb640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8af40a2d70 0x7f8af40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.446+0000 7f8b08b00640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8af40a2d70 0x7f8af40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.446+0000 7f8b01ffb640 1 -- 172.21.15.152:0/2450657447 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f8af00efcd0 con 0x7f8b04103660 2024-09-11T22:18:47.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.447+0000 7f8b08b00640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8af40a2d70 0x7f8af40a5230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8af8006fd0 tx=0x7f8af8008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:47.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.449+0000 7f8b01ffb640 1 -- 172.21.15.152:0/2450657447 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8af00bc950 con 0x7f8b04103660 2024-09-11T22:18:47.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.650+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2450657447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b04199850 con 0x7f8b04103660 2024-09-11T22:18:47.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.650+0000 7f8b01ffb640 1 -- 172.21.15.152:0/2450657447 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f8b04199850 con 0x7f8b04103660 2024-09-11T22:18:47.651 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:18:47.651 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:18:47.652 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:18:47.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.652+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2450657447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8af40a2d70 msgr2=0x7f8af40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.653+0000 7f8b0ad64640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8af40a2d70 0x7f8af40a5230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8af8006fd0 tx=0x7f8af8008040 comp rx=0 tx=0).stop 2024-09-11T22:18:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.653+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2450657447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b04103660 msgr2=0x7f8b04198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.653+0000 7f8b0ad64640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b04103660 0x7f8b04198a30 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8af0006010 tx=0x7f8af00042f0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.653+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2450657447 shutdown_connections 2024-09-11T22:18:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.653+0000 7f8b0ad64640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8af40a2d70 0x7f8af40a5230 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.653+0000 7f8b0ad64640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b0410c170 0x7f8b0419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.653+0000 7f8b0ad64640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b04103660 0x7f8b04198a30 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.653+0000 7f8b0ad64640 1 --2- 172.21.15.152:0/2450657447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b04102d40 0x7f8b041984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.653+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2450657447 >> 172.21.15.152:0/2450657447 conn(0x7f8b040fc7a0 msgr2=0x7f8b040fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.653+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2450657447 shutdown_connections 2024-09-11T22:18:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:47.653+0000 7f8b0ad64640 1 -- 172.21.15.152:0/2450657447 wait complete. 2024-09-11T22:18:47.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:47 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2450657447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:47.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:47 smithi152 ceph-mon[31188]: pgmap v454: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 388 op/s 2024-09-11T22:18:48.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:47 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2450657447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:48.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:47 smithi179 ceph-mon[35603]: pgmap v454: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 388 op/s 2024-09-11T22:18:48.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:47 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2450657447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:18:48.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:47 smithi193 ceph-mon[35545]: pgmap v454: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 388 op/s 2024-09-11T22:18:48.266 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 16898df1 --release --await' 2024-09-11T22:18:48.266 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 16898df1 --release --await 2024-09-11T22:18:48.517 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:18:49.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.001+0000 7f8d44bc1640 1 -- 172.21.15.152:0/1243151709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d40101de0 msgr2=0x7f8d401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.001+0000 7f8d44bc1640 1 --2- 172.21.15.152:0/1243151709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d40101de0 0x7f8d401021c0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009900 tx=0x7f8d3002a410 comp rx=0 tx=0).stop 2024-09-11T22:18:49.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.001+0000 7f8d44bc1640 1 -- 172.21.15.152:0/1243151709 shutdown_connections 2024-09-11T22:18:49.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.001+0000 7f8d44bc1640 1 --2- 172.21.15.152:0/1243151709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d40106f10 0x7f8d4010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.001+0000 7f8d44bc1640 1 --2- 172.21.15.152:0/1243151709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d40102790 0x7f8d401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.001+0000 7f8d44bc1640 1 --2- 172.21.15.152:0/1243151709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d40101de0 0x7f8d401021c0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.001+0000 7f8d44bc1640 1 -- 172.21.15.152:0/1243151709 >> 172.21.15.152:0/1243151709 conn(0x7f8d400fd8c0 msgr2=0x7f8d400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:49.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.001+0000 7f8d44bc1640 1 -- 172.21.15.152:0/1243151709 shutdown_connections 2024-09-11T22:18:49.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.001+0000 7f8d44bc1640 1 -- 172.21.15.152:0/1243151709 wait complete. 2024-09-11T22:18:49.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d44bc1640 1 Processor -- start 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d44bc1640 1 -- start start 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d44bc1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d40101de0 0x7f8d400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d44bc1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d40102790 0x7f8d40074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d44bc1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d40106f10 0x7f8d40074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d44bc1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40111f70 con 0x7f8d40106f10 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d44bc1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40111df0 con 0x7f8d40101de0 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d44bc1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401120f0 con 0x7f8d40102790 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d3ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d40106f10 0x7f8d40074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d3ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d40106f10 0x7f8d40074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53186/0 (socket says 172.21.15.152:53186) 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d3ed9d640 1 -- 172.21.15.152:0/225572854 learned_addr learned my addr 172.21.15.152:0/225572854 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d40102790 0x7f8d40074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.002+0000 7f8d3e59c640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d40101de0 0x7f8d400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d3ed9d640 1 -- 172.21.15.152:0/225572854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d40102790 msgr2=0x7f8d40074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d3ed9d640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d40102790 0x7f8d40074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d3ed9d640 1 -- 172.21.15.152:0/225572854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d40101de0 msgr2=0x7f8d400744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d3ed9d640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d40101de0 0x7f8d400744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d3ed9d640 1 -- 172.21.15.152:0/225572854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d401a6960 con 0x7f8d40106f10 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d3e59c640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d40101de0 0x7f8d400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d3ed9d640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d40106f10 0x7f8d40074f70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800cad0 tx=0x7f8d3800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d2f7fe640 1 -- 172.21.15.152:0/225572854 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800ae20 con 0x7f8d40106f10 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d2f7fe640 1 -- 172.21.15.152:0/225572854 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d38005020 con 0x7f8d40106f10 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d44bc1640 1 -- 172.21.15.152:0/225572854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d401a6c50 con 0x7f8d40106f10 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d2f7fe640 1 -- 172.21.15.152:0/225572854 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800f6f0 con 0x7f8d40106f10 2024-09-11T22:18:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.003+0000 7f8d44bc1640 1 -- 172.21.15.152:0/225572854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d401a7190 con 0x7f8d40106f10 2024-09-11T22:18:49.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.005+0000 7f8d2f7fe640 1 -- 172.21.15.152:0/225572854 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8d380051d0 con 0x7f8d40106f10 2024-09-11T22:18:49.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d46f9a740 1 Processor -- start 2024-09-11T22:18:49.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d46f9a740 1 -- start start 2024-09-11T22:18:49.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a49560440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a4956ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a4956d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564a494c5620 con 0x564a4956b240 2024-09-11T22:18:49.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564a4946ce50 con 0x564a49560060 2024-09-11T22:18:49.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564a494c15e0 con 0x564a49560980 2024-09-11T22:18:49.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d2f7fe640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d280a2d70 0x7f8d280a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d3dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a4956d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d3e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a4956ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d3e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a4956ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:53012/0 (socket says 172.21.15.152:53012) 2024-09-11T22:18:49.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d3e59c640 1 -- 172.21.15.152:0/3598308344 learned_addr learned my addr 172.21.15.152:0/3598308344 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:49.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d3ed9d640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d280a2d70 0x7f8d280a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.006+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/3598308344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a49560440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d2f7fe640 1 -- 172.21.15.152:0/225572854 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f8d380cf500 con 0x7f8d40106f10 2024-09-11T22:18:49.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/3598308344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 msgr2=0x564a4956ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:49.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/3598308344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a4956ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/3598308344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 msgr2=0x564a49560440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/3598308344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a49560440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/3598308344 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4945dd40 con 0x564a4956b240 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d3e59c640 1 --2- 172.21.15.152:0/3598308344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a4956ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/3598308344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a4956d630 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8d40075f80 tx=0x7f8d3400e410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28c6cddd8508b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d3ed9d640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d280a2d70 0x7f8d280a5230 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8d380cd1f0 tx=0x7f8d380669e0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d2cff9640 1 -- 172.21.15.152:0/3598308344 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34004020 con 0x564a4956b240 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d2cff9640 1 -- 172.21.15.152:0/3598308344 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d3400bd80 con 0x564a4956b240 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.007+0000 7f8d2cff9640 1 -- 172.21.15.152:0/3598308344 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34005310 con 0x564a4956b240 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.008+0000 7f8d46f9a740 1 -- 172.21.15.152:0/3598308344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 msgr2=0x564a4956d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.008+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/3598308344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a4956d630 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8d40075f80 tx=0x7f8d3400e410 comp rx=0 tx=0).stop 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.008+0000 7f8d46f9a740 1 -- 172.21.15.152:0/3598308344 shutdown_connections 2024-09-11T22:18:49.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.008+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/3598308344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a4956d630 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.008+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/3598308344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a4956ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.008+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/3598308344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a49560440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.008+0000 7f8d46f9a740 1 -- 172.21.15.152:0/3598308344 >> 172.21.15.152:0/3598308344 conn(0x564a4955c5f0 msgr2=0x564a4955c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.008+0000 7f8d46f9a740 1 -- 172.21.15.152:0/3598308344 shutdown_connections 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.008+0000 7f8d46f9a740 1 -- 172.21.15.152:0/3598308344 wait complete. 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.008+0000 7f8d46f9a740 1 -- start start 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.008+0000 7f8d46f9a740 1 Processor -- start 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a49560060 0x564a49568110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560980 0x564a49568650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a4956b240 0x564a49568b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564a4956de10 con 0x564a49560060 2024-09-11T22:18:49.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564a4944df10 con 0x564a49560980 2024-09-11T22:18:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564a4956df90 con 0x564a4956b240 2024-09-11T22:18:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d46f9a740 10 client.0 _ll_register_callbacks cb 0x564a49471db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d3dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a49560060 0x564a49568110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d3dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a49560060 0x564a49568110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53204/0 (socket says 172.21.15.152:53204) 2024-09-11T22:18:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/2820801202 learned_addr learned my addr 172.21.15.152:0/2820801202 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d3e59c640 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560980 0x564a49568650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/2820801202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a4956b240 msgr2=0x564a49568b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a4956b240 0x564a49568b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/2820801202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560980 msgr2=0x564a49568650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560980 0x564a49568650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/2820801202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a491d4580 con 0x564a49560060 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a49560060 0x564a49568110 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8d34006010 tx=0x7f8d3400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255b38f6fa858604 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d25ffb640 1 -- 172.21.15.152:0/2820801202 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400baa0 con 0x564a49560060 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d25ffb640 1 -- 172.21.15.152:0/2820801202 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f8d34005090 con 0x564a49560060 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.009+0000 7f8d46f9a740 1 -- 172.21.15.152:0/2820801202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d3400bd80 con 0x564a49560060 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d25ffb640 1 -- 172.21.15.152:0/2820801202 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8d34005290 con 0x564a49560060 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d46f9a740 10 client.19104 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d46f9a740 1 -- 172.21.15.152:0/2820801202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564a4929e960 con 0x564a49560060 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d25ffb640 1 -- 172.21.15.152:0/2820801202 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d3400bd80 con 0x564a49560060 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d25ffb640 1 -- 172.21.15.152:0/2820801202 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8d34024020 con 0x564a49560060 2024-09-11T22:18:49.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d46f9a740 10 client.19104 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d46f9a740 10 client.19104 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d46f9a740 20 client.19104 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a4957ad00 0x564a4957d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d46f9a740 4 client.19104 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d46f9a740 1 -- 172.21.15.152:0/2820801202 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a494d2b90 con 0x564a4957ad00 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.010+0000 7f8d3e59c640 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a4957ad00 0x564a4957d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d25ffb640 10 client.19104 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d3e59c640 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a4957ad00 0x564a4957d0f0 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceeb1c1c9f5c1a79 server_cookie=c0fc455ae06cb21a in_seq=0 out_seq=0 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d25ffb640 1 -- 172.21.15.152:0/2820801202 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a494d2b90 con 0x564a4957ad00 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d25ffb640 10 client.19104 handle_command_reply: tid=0 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d46f9a740 1 client.19104 shutdown 2024-09-11T22:18:49.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d46f9a740 1 -- 172.21.15.152:0/2820801202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a49560060 msgr2=0x564a49568110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a49560060 0x564a49568110 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8d34006010 tx=0x7f8d3400ee00 comp rx=0 tx=0).stop 2024-09-11T22:18:49.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d46f9a740 1 -- 172.21.15.152:0/2820801202 shutdown_connections 2024-09-11T22:18:49.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a4957ad00 0x564a4957d0f0 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a4956b240 0x564a49568b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560980 0x564a49568650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/2820801202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a49560060 0x564a49568110 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d46f9a740 1 -- 172.21.15.152:0/2820801202 >> 172.21.15.152:0/2820801202 conn(0x564a4955c5f0 msgr2=0x564a495622d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:49.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.011+0000 7f8d25ffb640 0 client.19104 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:49.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.012+0000 7f8d46f9a740 1 -- 172.21.15.152:0/2820801202 shutdown_connections 2024-09-11T22:18:49.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.012+0000 7f8d46f9a740 1 -- 172.21.15.152:0/2820801202 wait complete. 2024-09-11T22:18:49.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.012+0000 7f8d46f9a740 20 client.19104 trim_cache size 0 max 16384 2024-09-11T22:18:49.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.028+0000 7f8d46f9a740 1 Processor -- start 2024-09-11T22:18:49.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.028+0000 7f8d46f9a740 1 -- start start 2024-09-11T22:18:49.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.028+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a4955b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.028+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a495827a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.028+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a49582ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.028+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401b2550 con 0x564a4956b240 2024-09-11T22:18:49.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.028+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401afe20 con 0x564a49560060 2024-09-11T22:18:49.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.028+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401adc90 con 0x564a49560980 2024-09-11T22:18:49.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d3dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a49582ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d3dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a49582ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53220/0 (socket says 172.21.15.152:53220) 2024-09-11T22:18:49.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/3760817617 learned_addr learned my addr 172.21.15.152:0/3760817617 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:49.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d3e59c640 1 --2- 172.21.15.152:0/3760817617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a495827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/3760817617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a4955b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/3760817617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 msgr2=0x564a495827a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:49.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/3760817617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a495827a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/3760817617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 msgr2=0x564a4955b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:49.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/3760817617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a4955b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/3760817617 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a495690e0 con 0x564a4956b240 2024-09-11T22:18:49.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/3760817617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a49582ce0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8d3401d510 tx=0x7f8d3400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b76071f35de682 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:49.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d27fff640 1 -- 172.21.15.152:0/3760817617 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34033040 con 0x564a4956b240 2024-09-11T22:18:49.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d27fff640 1 -- 172.21.15.152:0/3760817617 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d3400bd80 con 0x564a4956b240 2024-09-11T22:18:49.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.029+0000 7f8d27fff640 1 -- 172.21.15.152:0/3760817617 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3401dd90 con 0x564a4956b240 2024-09-11T22:18:49.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.030+0000 7f8d46f9a740 1 -- 172.21.15.152:0/3760817617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 msgr2=0x564a49582ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.030+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/3760817617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a49582ce0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8d3401d510 tx=0x7f8d3400eb50 comp rx=0 tx=0).stop 2024-09-11T22:18:49.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.030+0000 7f8d46f9a740 1 -- 172.21.15.152:0/3760817617 shutdown_connections 2024-09-11T22:18:49.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.030+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/3760817617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a49582ce0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.030+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/3760817617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a495827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.030+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/3760817617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a4955b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.030+0000 7f8d46f9a740 1 -- 172.21.15.152:0/3760817617 >> 172.21.15.152:0/3760817617 conn(0x564a4955c5f0 msgr2=0x564a4955af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:49.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.030+0000 7f8d46f9a740 1 -- 172.21.15.152:0/3760817617 shutdown_connections 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.030+0000 7f8d46f9a740 1 -- 172.21.15.152:0/3760817617 wait complete. 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.030+0000 7f8d46f9a740 1 -- start start 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.030+0000 7f8d46f9a740 1 Processor -- start 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a49573af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a4956ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d46f9a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a4956f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401ae2e0 con 0x564a4956b240 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401af750 con 0x564a49560060 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d46f9a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401ae9b0 con 0x564a49560980 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d46f9a740 10 client.0 _ll_register_callbacks cb 0x7f8d340137f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a4956f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3dd9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a4956f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53230/0 (socket says 172.21.15.152:53230) 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3dd9b640 1 -- 172.21.15.152:0/1500729070 learned_addr learned my addr 172.21.15.152:0/1500729070 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:49.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3e59c640 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a4956ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a49573af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3e59c640 1 -- 172.21.15.152:0/1500729070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 msgr2=0x564a49573af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3e59c640 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a49573af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3e59c640 1 -- 172.21.15.152:0/1500729070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 msgr2=0x564a4956f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3e59c640 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a4956f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3e59c640 1 -- 172.21.15.152:0/1500729070 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a495e4770 con 0x564a49560980 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a4956f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d3e59c640 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a4956ee20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009900 tx=0x7f8d30004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=130e18e938d30532 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.031+0000 7f8d25ffb640 1 -- 172.21.15.152:0/1500729070 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30035040 con 0x564a49560980 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d46f9a740 1 -- 172.21.15.152:0/1500729070 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d3400bd80 con 0x564a49560980 2024-09-11T22:18:49.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d25ffb640 1 -- 172.21.15.152:0/1500729070 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7f8d30005040 con 0x564a49560980 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d25ffb640 1 -- 172.21.15.152:0/1500729070 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8d30005240 con 0x564a49560980 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d46f9a740 10 client.28417 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d46f9a740 1 -- 172.21.15.152:0/1500729070 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564a495e59b0 con 0x564a49560980 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d25ffb640 1 -- 172.21.15.152:0/1500729070 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d3400bd80 con 0x564a49560980 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d25ffb640 1 -- 172.21.15.152:0/1500729070 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8d30004850 con 0x564a49560980 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d46f9a740 10 client.28417 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d46f9a740 10 client.28417 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d46f9a740 20 client.28417 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a495e6160 0x564a495e8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d46f9a740 4 client.28417 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "16898df1", "release": true, "await": true}] 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d46f9a740 1 -- 172.21.15.152:0/1500729070 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "set_id": "16898df1", "release": true, "await": true}) -- 0x564a494cd0a0 con 0x564a495e6160 2024-09-11T22:18:49.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.032+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a495e6160 0x564a495e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.033+0000 7f8d3dd9b640 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a495e6160 0x564a495e8580 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cb3b019ff0ffdac server_cookie=8d89993cd332df5c in_seq=0 out_seq=0 2024-09-11T22:18:49.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.033+0000 7f8d25ffb640 10 client.28417 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:49.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.086+0000 7f8d25ffb640 1 -- 172.21.15.152:0/1500729070 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564a494cd0a0 con 0x564a495e6160 2024-09-11T22:18:49.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.086+0000 7f8d25ffb640 10 client.28417 handle_command_reply: tid=0 2024-09-11T22:18:49.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.086+0000 7f8d46f9a740 1 client.28417 shutdown 2024-09-11T22:18:49.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.086+0000 7f8d46f9a740 1 -- 172.21.15.152:0/1500729070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 msgr2=0x564a4956ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.086+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a4956ee20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009900 tx=0x7f8d30004040 comp rx=0 tx=0).stop 2024-09-11T22:18:49.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.086+0000 7f8d46f9a740 1 -- 172.21.15.152:0/1500729070 shutdown_connections 2024-09-11T22:18:49.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.086+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564a495e6160 0x564a495e8580 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.086+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a4956b240 0x564a4956f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.086+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a49560980 0x564a4956ee20 secure :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009900 tx=0x7f8d30004040 comp rx=0 tx=0).stop 2024-09-11T22:18:49.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.086+0000 7f8d46f9a740 1 --2- 172.21.15.152:0/1500729070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a49560060 0x564a49573af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.086+0000 7f8d46f9a740 1 -- 172.21.15.152:0/1500729070 >> 172.21.15.152:0/1500729070 conn(0x564a4955c5f0 msgr2=0x564a4956a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:49.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.087+0000 7f8d25ffb640 0 client.28417 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:49.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.087+0000 7f8d46f9a740 1 -- 172.21.15.152:0/1500729070 shutdown_connections 2024-09-11T22:18:49.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.087+0000 7f8d46f9a740 1 -- 172.21.15.152:0/1500729070 wait complete. 2024-09-11T22:18:49.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.087+0000 7f8d46f9a740 20 client.28417 trim_cache size 0 max 16384 2024-09-11T22:18:49.092 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:18:49.092 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:18:49.092 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:18:49.092 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 56, 2024-09-11T22:18:49.092 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:18:49.092 INFO:teuthology.orchestra.run.smithi152.stdout: "16898df1": { 2024-09-11T22:18:49.092 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 56, 2024-09-11T22:18:49.092 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:18:49.093 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:18:49.093 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:18:49.093 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:18:49.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:18:49.093 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:18:49.093 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 150.0, 2024-09-11T22:18:49.093 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:18:49.093 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:18:49.093 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:18:49.093 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:18:49.094 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RELEASED", 2024-09-11T22:18:49.094 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:18:49.094 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:49.094 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:49.094 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:49.094 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:49.094 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:18:49.094 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:18:49.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.089+0000 7f8d44bc1640 1 -- 172.21.15.152:0/225572854 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d280a2d70 msgr2=0x7f8d280a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.089+0000 7f8d44bc1640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d280a2d70 0x7f8d280a5230 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8d380cd1f0 tx=0x7f8d380669e0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.089+0000 7f8d44bc1640 1 -- 172.21.15.152:0/225572854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d40106f10 msgr2=0x7f8d40074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.089+0000 7f8d44bc1640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d40106f10 0x7f8d40074f70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800cad0 tx=0x7f8d3800cf90 comp rx=0 tx=0).stop 2024-09-11T22:18:49.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.089+0000 7f8d44bc1640 1 -- 172.21.15.152:0/225572854 shutdown_connections 2024-09-11T22:18:49.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.089+0000 7f8d44bc1640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8d280a2d70 0x7f8d280a5230 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.089+0000 7f8d44bc1640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d40106f10 0x7f8d40074f70 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.089+0000 7f8d44bc1640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d40102790 0x7f8d40074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.089+0000 7f8d44bc1640 1 --2- 172.21.15.152:0/225572854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d40101de0 0x7f8d400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.089+0000 7f8d44bc1640 1 -- 172.21.15.152:0/225572854 >> 172.21.15.152:0/225572854 conn(0x7f8d400fd8c0 msgr2=0x7f8d400fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:49.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.092+0000 7f8d44bc1640 1 -- 172.21.15.152:0/225572854 shutdown_connections 2024-09-11T22:18:49.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:18:49.092+0000 7f8d44bc1640 1 -- 172.21.15.152:0/225572854 wait complete. 2024-09-11T22:18:49.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 795.0 s, 301.9 tps, lat 1965.717 ms stddev 7208.958 2024-09-11T22:18:49.900 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:49 smithi152 ceph-mon[31188]: pgmap v455: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.9 MiB/s wr, 396 op/s 2024-09-11T22:18:49.954 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '16898df1', total seconds elapsed: 33.2 2024-09-11T22:18:50.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:49 smithi179 ceph-mon[35603]: pgmap v455: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.9 MiB/s wr, 396 op/s 2024-09-11T22:18:50.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:49 smithi193 ceph-mon[35545]: pgmap v455: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.9 MiB/s wr, 396 op/s 2024-09-11T22:18:52.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:51 smithi179 ceph-mon[35603]: pgmap v456: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 99 KiB/s wr, 19 op/s 2024-09-11T22:18:52.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:51 smithi193 ceph-mon[35545]: pgmap v456: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 99 KiB/s wr, 19 op/s 2024-09-11T22:18:52.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:51 smithi152 ceph-mon[31188]: pgmap v456: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 99 KiB/s wr, 19 op/s 2024-09-11T22:18:54.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:53 smithi179 ceph-mon[35603]: pgmap v457: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 99 KiB/s wr, 19 op/s 2024-09-11T22:18:54.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:53 smithi193 ceph-mon[35545]: pgmap v457: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 99 KiB/s wr, 19 op/s 2024-09-11T22:18:54.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:53 smithi152 ceph-mon[31188]: pgmap v457: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 99 KiB/s wr, 19 op/s 2024-09-11T22:18:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 800.0 s, 2229.6 tps, lat 44.655 ms stddev 53.271 2024-09-11T22:18:56.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:55 smithi179 ceph-mon[35603]: pgmap v458: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.1 MiB/s wr, 284 op/s 2024-09-11T22:18:56.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:55 smithi193 ceph-mon[35545]: pgmap v458: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.1 MiB/s wr, 284 op/s 2024-09-11T22:18:56.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:55 smithi152 ceph-mon[31188]: pgmap v458: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.1 MiB/s wr, 284 op/s 2024-09-11T22:18:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.504+0000 7ff2506d0640 1 -- 172.21.15.152:0/3764504905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff248101d70 msgr2=0x7ff248102200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.504+0000 7ff2506d0640 1 --2- 172.21.15.152:0/3764504905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff248101d70 0x7ff248102200 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ff240009ca0 tx=0x7ff24002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.504+0000 7ff2506d0640 1 -- 172.21.15.152:0/3764504905 shutdown_connections 2024-09-11T22:18:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.504+0000 7ff2506d0640 1 --2- 172.21.15.152:0/3764504905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff248101d70 0x7ff248102200 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.504+0000 7ff2506d0640 1 --2- 172.21.15.152:0/3764504905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff248069480 0x7ff2481009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.504+0000 7ff2506d0640 1 --2- 172.21.15.152:0/3764504905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff248069010 0x7ff248100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.504+0000 7ff2506d0640 1 -- 172.21.15.152:0/3764504905 >> 172.21.15.152:0/3764504905 conn(0x7ff2480770f0 msgr2=0x7ff2480fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.511+0000 7ff2506d0640 1 -- 172.21.15.152:0/3764504905 shutdown_connections 2024-09-11T22:18:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.515+0000 7ff2506d0640 1 -- 172.21.15.152:0/3764504905 wait complete. 2024-09-11T22:18:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.515+0000 7ff2506d0640 1 Processor -- start 2024-09-11T22:18:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.516+0000 7ff2506d0640 1 -- start start 2024-09-11T22:18:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.516+0000 7ff2506d0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff248069010 0x7ff248114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.516+0000 7ff2506d0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff248069480 0x7ff248111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.516+0000 7ff2506d0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff248101d70 0x7ff248111660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.516+0000 7ff2506d0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff24810ddb0 con 0x7ff248069010 2024-09-11T22:18:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.516+0000 7ff2506d0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff24810dc30 con 0x7ff248101d70 2024-09-11T22:18:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.516+0000 7ff2506d0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff24810df30 con 0x7ff248069480 2024-09-11T22:18:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.516+0000 7ff24dc6b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff248069480 0x7ff248111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.516+0000 7ff24dc6b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff248069480 0x7ff248111120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54124/0 (socket says 172.21.15.152:54124) 2024-09-11T22:18:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.516+0000 7ff24dc6b640 1 -- 172.21.15.152:0/817100318 learned_addr learned my addr 172.21.15.152:0/817100318 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.516+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff248101d70 0x7ff248111660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.519+0000 7ff24e46c640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff248069010 0x7ff248114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.525 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.520+0000 7ff24ec6d640 1 -- 172.21.15.152:0/817100318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff248069480 msgr2=0x7ff248111120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:56.525 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.520+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff248069480 0x7ff248111120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.525 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.520+0000 7ff24ec6d640 1 -- 172.21.15.152:0/817100318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff248069010 msgr2=0x7ff248114080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:56.525 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.520+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff248069010 0x7ff248114080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.525 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.520+0000 7ff24ec6d640 1 -- 172.21.15.152:0/817100318 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff248111ed0 con 0x7ff248101d70 2024-09-11T22:18:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.521+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff248101d70 0x7ff248111660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff240009bf0 tx=0x7ff240003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.522+0000 7ff23f7fe640 1 -- 172.21.15.152:0/817100318 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240031650 con 0x7ff248101d70 2024-09-11T22:18:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.522+0000 7ff23f7fe640 1 -- 172.21.15.152:0/817100318 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff24002f380 con 0x7ff248101d70 2024-09-11T22:18:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.522+0000 7ff23f7fe640 1 -- 172.21.15.152:0/817100318 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24002f920 con 0x7ff248101d70 2024-09-11T22:18:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.522+0000 7ff2506d0640 1 -- 172.21.15.152:0/817100318 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2481a26c0 con 0x7ff248101d70 2024-09-11T22:18:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.522+0000 7ff24dc6b640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff248069480 0x7ff248111120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.523+0000 7ff2506d0640 1 -- 172.21.15.152:0/817100318 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2481a2b90 con 0x7ff248101d70 2024-09-11T22:18:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.523+0000 7ff24e46c640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff248069010 0x7ff248114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.526+0000 7ff25346b740 1 Processor -- start 2024-09-11T22:18:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.527+0000 7ff23f7fe640 1 -- 172.21.15.152:0/817100318 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff2400317f0 con 0x7ff248101d70 2024-09-11T22:18:56.529 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.528+0000 7ff25346b740 1 -- start start 2024-09-11T22:18:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.528+0000 7ff25346b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d99af0 0x55e021d99ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.528+0000 7ff23f7fe640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2340a2f50 0x7ff2340a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.528+0000 7ff25346b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d9a410 0x55e021da4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.528+0000 7ff25346b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.528+0000 7ff25346b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e021cfe2f0 con 0x55e021d99af0 2024-09-11T22:18:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.528+0000 7ff25346b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e021ca6270 con 0x55e021d9a410 2024-09-11T22:18:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.528+0000 7ff25346b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e021cfa2b0 con 0x55e021da4cb0 2024-09-11T22:18:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.528+0000 7ff24e46c640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2340a2f50 0x7ff2340a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.528+0000 7ff24dc6b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d99af0 0x55e021d99ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff24dc6b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d99af0 0x55e021d99ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53284/0 (socket says 172.21.15.152:53284) 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff24dc6b640 1 -- 172.21.15.152:0/1297500260 learned_addr learned my addr 172.21.15.152:0/1297500260 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff24dc6b640 1 --2- 172.21.15.152:0/1297500260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d9a410 0x55e021da4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff23f7fe640 1 -- 172.21.15.152:0/817100318 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7ff2400f07e0 con 0x7ff248101d70 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/1297500260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff24dc6b640 1 -- 172.21.15.152:0/1297500260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 msgr2=0x55e021da70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff24dc6b640 1 --2- 172.21.15.152:0/1297500260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff24dc6b640 1 -- 172.21.15.152:0/1297500260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d99af0 msgr2=0x55e021d99ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff24dc6b640 1 --2- 172.21.15.152:0/1297500260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d99af0 0x55e021d99ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff24dc6b640 1 -- 172.21.15.152:0/1297500260 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e021ca5340 con 0x55e021d9a410 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff24dc6b640 1 --2- 172.21.15.152:0/1297500260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d9a410 0x55e021da4770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff244011c70 tx=0x7ff244005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3172ee4e1b62636 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.529+0000 7ff24e46c640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2340a2f50 0x7ff2340a5410 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff238009b50 tx=0x7ff238005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.530+0000 7ff23cff9640 1 -- 172.21.15.152:0/1297500260 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff244011d60 con 0x55e021d9a410 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.530+0000 7ff23cff9640 1 -- 172.21.15.152:0/1297500260 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff24400fc50 con 0x55e021d9a410 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.530+0000 7ff23cff9640 1 -- 172.21.15.152:0/1297500260 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24400e5e0 con 0x55e021d9a410 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.531+0000 7ff25346b740 1 -- 172.21.15.152:0/1297500260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d9a410 msgr2=0x55e021da4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.531+0000 7ff25346b740 1 --2- 172.21.15.152:0/1297500260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d9a410 0x55e021da4770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff244011c70 tx=0x7ff244005f90 comp rx=0 tx=0).stop 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.531+0000 7ff25346b740 1 -- 172.21.15.152:0/1297500260 shutdown_connections 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.531+0000 7ff25346b740 1 --2- 172.21.15.152:0/1297500260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.531+0000 7ff25346b740 1 --2- 172.21.15.152:0/1297500260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d9a410 0x55e021da4770 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.531+0000 7ff25346b740 1 --2- 172.21.15.152:0/1297500260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d99af0 0x55e021d99ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.531+0000 7ff25346b740 1 -- 172.21.15.152:0/1297500260 >> 172.21.15.152:0/1297500260 conn(0x55e021d96060 msgr2=0x55e021d96440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.531+0000 7ff25346b740 1 -- 172.21.15.152:0/1297500260 shutdown_connections 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.531+0000 7ff25346b740 1 -- 172.21.15.152:0/1297500260 wait complete. 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.531+0000 7ff25346b740 1 -- start start 2024-09-11T22:18:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff25346b740 1 Processor -- start 2024-09-11T22:18:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff25346b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021da1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff25346b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d9a410 0x55e021da1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff25346b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff25346b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e021da7880 con 0x55e021d9a410 2024-09-11T22:18:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff24e46c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021da1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff24e46c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021da1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:44518/0 (socket says 172.21.15.152:44518) 2024-09-11T22:18:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff24e46c640 1 -- 172.21.15.152:0/965049446 learned_addr learned my addr 172.21.15.152:0/965049446 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff24dc6b640 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d9a410 0x55e021da1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff25346b740 1 -- 172.21.15.152:0/965049446 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e021c87290 con 0x55e021d99af0 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff25346b740 1 -- 172.21.15.152:0/965049446 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e021da7a00 con 0x55e021da4cb0 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.532+0000 7ff25346b740 10 client.0 _ll_register_callbacks cb 0x55e021cb8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff24ec6d640 1 -- 172.21.15.152:0/965049446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 msgr2=0x55e021da1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021da1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff24ec6d640 1 -- 172.21.15.152:0/965049446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d9a410 msgr2=0x55e021da1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d9a410 0x55e021da1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff24ec6d640 1 -- 172.21.15.152:0/965049446 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e021a11210 con 0x55e021da4cb0 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff24dc6b640 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d9a410 0x55e021da1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da2530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff2400edfe0 tx=0x7ff2400bd570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e480eb8c05e6432 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff231ffb640 1 -- 172.21.15.152:0/965049446 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2400bcdb0 con 0x55e021da4cb0 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff25346b740 1 -- 172.21.15.152:0/965049446 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff24400fc50 con 0x55e021da4cb0 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff231ffb640 1 -- 172.21.15.152:0/965049446 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7ff24008d080 con 0x55e021da4cb0 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff231ffb640 1 -- 172.21.15.152:0/965049446 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff2400c1160 con 0x55e021da4cb0 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff25346b740 10 client.28429 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff25346b740 1 -- 172.21.15.152:0/965049446 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e021add620 con 0x55e021da4cb0 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff231ffb640 1 -- 172.21.15.152:0/965049446 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff24400fc50 con 0x55e021da4cb0 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.533+0000 7ff231ffb640 1 -- 172.21.15.152:0/965049446 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff24008dc00 con 0x55e021da4cb0 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.534+0000 7ff25346b740 10 client.28429 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.534+0000 7ff25346b740 10 client.28429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.534+0000 7ff25346b740 20 client.28429 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.534+0000 7ff25346b740 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e021db4ac0 0x55e021db6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.534+0000 7ff25346b740 4 client.28429 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.534+0000 7ff25346b740 1 -- 172.21.15.152:0/965049446 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e021d0ba20 con 0x55e021db4ac0 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.534+0000 7ff24e46c640 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e021db4ac0 0x55e021db6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.534+0000 7ff24e46c640 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e021db4ac0 0x55e021db6f20 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c39ab34ab47faed server_cookie=94a80a72f5ee4245 in_seq=0 out_seq=0 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.534+0000 7ff231ffb640 10 client.28429 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff231ffb640 1 -- 172.21.15.152:0/965049446 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e021d0ba20 con 0x55e021db4ac0 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff231ffb640 10 client.28429 handle_command_reply: tid=0 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff25346b740 1 client.28429 shutdown 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff25346b740 1 -- 172.21.15.152:0/965049446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 msgr2=0x55e021da2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff25346b740 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da2530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff2400edfe0 tx=0x7ff2400bd570 comp rx=0 tx=0).stop 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff25346b740 1 -- 172.21.15.152:0/965049446 shutdown_connections 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff25346b740 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e021db4ac0 0x55e021db6f20 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff231ffb640 0 client.28429 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff25346b740 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da2530 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff25346b740 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d9a410 0x55e021da1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff25346b740 1 --2- 172.21.15.152:0/965049446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021da1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.535+0000 7ff25346b740 1 -- 172.21.15.152:0/965049446 >> 172.21.15.152:0/965049446 conn(0x55e021d96060 msgr2=0x55e021d9bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.536+0000 7ff25346b740 1 -- 172.21.15.152:0/965049446 shutdown_connections 2024-09-11T22:18:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.536+0000 7ff25346b740 1 -- 172.21.15.152:0/965049446 wait complete. 2024-09-11T22:18:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.536+0000 7ff25346b740 20 client.28429 trim_cache size 0 max 16384 2024-09-11T22:18:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.554+0000 7ff25346b740 1 Processor -- start 2024-09-11T22:18:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.554+0000 7ff25346b740 1 -- start start 2024-09-11T22:18:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.555+0000 7ff25346b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021d9c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.555+0000 7ff25346b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d9a410 0x55e021da0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.555+0000 7ff25346b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.555+0000 7ff25346b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff2481adfb0 con 0x55e021d9a410 2024-09-11T22:18:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.555+0000 7ff25346b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff2481ab8c0 con 0x55e021d99af0 2024-09-11T22:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.555+0000 7ff25346b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff248102200 con 0x55e021da4cb0 2024-09-11T22:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.555+0000 7ff24ec6d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.555+0000 7ff24e46c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021d9c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.555+0000 7ff24ec6d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54146/0 (socket says 172.21.15.152:54146) 2024-09-11T22:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.555+0000 7ff24ec6d640 1 -- 172.21.15.152:0/1060457 learned_addr learned my addr 172.21.15.152:0/1060457 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.556+0000 7ff24ec6d640 1 -- 172.21.15.152:0/1060457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 msgr2=0x55e021d9c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.556+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/1060457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021d9c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.556+0000 7ff24ec6d640 1 -- 172.21.15.152:0/1060457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d9a410 msgr2=0x55e021da0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.556+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/1060457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d9a410 0x55e021da0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.556+0000 7ff24ec6d640 1 -- 172.21.15.152:0/1060457 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e021d95e90 con 0x55e021da4cb0 2024-09-11T22:18:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.556+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/1060457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da2360 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff240005e30 tx=0x7ff2400047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfc7a7f2baab0937 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.556+0000 7ff233fff640 1 -- 172.21.15.152:0/1060457 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2400bcdb0 con 0x55e021da4cb0 2024-09-11T22:18:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.556+0000 7ff233fff640 1 -- 172.21.15.152:0/1060457 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2400c0070 con 0x55e021da4cb0 2024-09-11T22:18:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.556+0000 7ff233fff640 1 -- 172.21.15.152:0/1060457 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2400b9050 con 0x55e021da4cb0 2024-09-11T22:18:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.557+0000 7ff25346b740 1 -- 172.21.15.152:0/1060457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 msgr2=0x55e021da2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.557+0000 7ff25346b740 1 --2- 172.21.15.152:0/1060457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da2360 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff240005e30 tx=0x7ff2400047e0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.557+0000 7ff25346b740 1 -- 172.21.15.152:0/1060457 shutdown_connections 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.557+0000 7ff25346b740 1 --2- 172.21.15.152:0/1060457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021da4cb0 0x55e021da2360 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.557+0000 7ff25346b740 1 --2- 172.21.15.152:0/1060457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021d9a410 0x55e021da0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.557+0000 7ff25346b740 1 --2- 172.21.15.152:0/1060457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021d9c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.557+0000 7ff25346b740 1 -- 172.21.15.152:0/1060457 >> 172.21.15.152:0/1060457 conn(0x55e021d96060 msgr2=0x55e021da3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.557+0000 7ff25346b740 1 -- 172.21.15.152:0/1060457 shutdown_connections 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.557+0000 7ff25346b740 1 -- 172.21.15.152:0/1060457 wait complete. 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.557+0000 7ff25346b740 1 -- start start 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.557+0000 7ff25346b740 1 Processor -- start 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff25346b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021dacf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff25346b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021d9a410 0x55e021dad470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff25346b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021da4cb0 0x55e021d9e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff25346b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff2481a9d80 con 0x55e021da4cb0 2024-09-11T22:18:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff25346b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff2481ab1f0 con 0x55e021d99af0 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff25346b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff2481aa450 con 0x55e021d9a410 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff25346b740 10 client.0 _ll_register_callbacks cb 0x7ff2400bc980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff24ec6d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021da4cb0 0x55e021d9e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff24e46c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021dacf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff24ec6d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021da4cb0 0x55e021d9e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53316/0 (socket says 172.21.15.152:53316) 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff24ec6d640 1 -- 172.21.15.152:0/852778131 learned_addr learned my addr 172.21.15.152:0/852778131 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff24dc6b640 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021d9a410 0x55e021dad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff24ec6d640 1 -- 172.21.15.152:0/852778131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021d9a410 msgr2=0x55e021dad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021d9a410 0x55e021dad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff24ec6d640 1 -- 172.21.15.152:0/852778131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 msgr2=0x55e021dacf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021dacf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff24ec6d640 1 -- 172.21.15.152:0/852778131 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e021d9ec30 con 0x55e021da4cb0 2024-09-11T22:18:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff24ec6d640 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021da4cb0 0x55e021d9e430 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7ff2400b9780 tx=0x7ff2400b9650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484fc998bb3aa05a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.558+0000 7ff231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff231ffb640 1 -- 172.21.15.152:0/852778131 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2400c9070 con 0x55e021da4cb0 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff231ffb640 1 -- 172.21.15.152:0/852778131 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8614+0+0 (secure 0 0 0) 0x7ff2400c5590 con 0x55e021da4cb0 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff25346b740 1 -- 172.21.15.152:0/852778131 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2400c0070 con 0x55e021da4cb0 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff231ffb640 1 -- 172.21.15.152:0/852778131 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff2400b9050 con 0x55e021da4cb0 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff25346b740 10 client.19122 fetch_fsmap learned FSMap version 30 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff25346b740 1 -- 172.21.15.152:0/852778131 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e021d9ec30 con 0x55e021da4cb0 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff231ffb640 1 -- 172.21.15.152:0/852778131 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2400c0070 con 0x55e021da4cb0 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff231ffb640 1 -- 172.21.15.152:0/852778131 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff2400cc020 con 0x55e021da4cb0 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff25346b740 10 client.19122 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff25346b740 10 client.19122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff25346b740 20 client.19122 populate_metadata read hostname 'smithi152' 2024-09-11T22:18:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff25346b740 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e021db4ac0 0x55e021e21640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff25346b740 4 client.19122 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:18:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff25346b740 1 -- 172.21.15.152:0/852778131 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e021d05d70 con 0x55e021db4ac0 2024-09-11T22:18:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.559+0000 7ff24e46c640 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e021db4ac0 0x55e021e21640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.561+0000 7ff231ffb640 10 client.19122 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.561+0000 7ff24e46c640 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e021db4ac0 0x55e021e21640 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c48712f9edd5b13 server_cookie=26b188ae884378ee in_seq=0 out_seq=0 2024-09-11T22:18:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff231ffb640 1 -- 172.21.15.152:0/852778131 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e021d05d70 con 0x55e021db4ac0 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff231ffb640 10 client.19122 handle_command_reply: tid=0 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff25346b740 1 client.19122 shutdown 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff25346b740 1 -- 172.21.15.152:0/852778131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021da4cb0 msgr2=0x55e021d9e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff25346b740 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021da4cb0 0x55e021d9e430 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7ff2400b9780 tx=0x7ff2400b9650 comp rx=0 tx=0).stop 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff25346b740 1 -- 172.21.15.152:0/852778131 shutdown_connections 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff25346b740 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55e021db4ac0 0x55e021e21640 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff25346b740 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e021da4cb0 0x55e021d9e430 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff25346b740 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e021d9a410 0x55e021dad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff25346b740 1 --2- 172.21.15.152:0/852778131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e021d99af0 0x55e021dacf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff25346b740 1 -- 172.21.15.152:0/852778131 >> 172.21.15.152:0/852778131 conn(0x55e021d96060 msgr2=0x55e021dafb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.570+0000 7ff231ffb640 0 client.19122 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.571+0000 7ff25346b740 1 -- 172.21.15.152:0/852778131 shutdown_connections 2024-09-11T22:18:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.571+0000 7ff25346b740 1 -- 172.21.15.152:0/852778131 wait complete. 2024-09-11T22:18:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.571+0000 7ff25346b740 20 client.19122 trim_cache size 0 max 16384 2024-09-11T22:18:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:18:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:18:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:18:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:18:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 -- 172.21.15.152:0/817100318 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2340a2f50 msgr2=0x7ff2340a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2340a2f50 0x7ff2340a5410 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff238009b50 tx=0x7ff238005f90 comp rx=0 tx=0).stop 2024-09-11T22:18:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 -- 172.21.15.152:0/817100318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff248101d70 msgr2=0x7ff248111660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff248101d70 0x7ff248111660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff240009bf0 tx=0x7ff240003f10 comp rx=0 tx=0).stop 2024-09-11T22:18:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 -- 172.21.15.152:0/817100318 shutdown_connections 2024-09-11T22:18:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff2340a2f50 0x7ff2340a5410 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff248101d70 0x7ff248111660 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff248069480 0x7ff248111120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 --2- 172.21.15.152:0/817100318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff248069010 0x7ff248114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 -- 172.21.15.152:0/817100318 >> 172.21.15.152:0/817100318 conn(0x7ff2480770f0 msgr2=0x7ff24810eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 -- 172.21.15.152:0/817100318 shutdown_connections 2024-09-11T22:18:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:18:56.572+0000 7ff2506d0640 1 -- 172.21.15.152:0/817100318 wait complete. 2024-09-11T22:18:58.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:57 smithi179 ceph-mon[35603]: pgmap v459: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 280 op/s 2024-09-11T22:18:58.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:57 smithi193 ceph-mon[35545]: pgmap v459: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 280 op/s 2024-09-11T22:18:58.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:57 smithi152 ceph-mon[31188]: pgmap v459: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 280 op/s 2024-09-11T22:18:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 805.0 s, 2751.6 tps, lat 36.112 ms stddev 44.366 2024-09-11T22:19:00.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:18:59 smithi179 ceph-mon[35603]: pgmap v460: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 5.4 MiB/s wr, 501 op/s 2024-09-11T22:19:00.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:18:59 smithi193 ceph-mon[35545]: pgmap v460: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 5.4 MiB/s wr, 501 op/s 2024-09-11T22:19:00.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:18:59 smithi152 ceph-mon[31188]: pgmap v460: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 5.4 MiB/s wr, 501 op/s 2024-09-11T22:19:02.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:01 smithi179 ceph-mon[35603]: pgmap v461: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.4 MiB/s wr, 584 op/s 2024-09-11T22:19:02.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:01 smithi193 ceph-mon[35545]: pgmap v461: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.4 MiB/s wr, 584 op/s 2024-09-11T22:19:02.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:01 smithi152 ceph-mon[31188]: pgmap v461: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.4 MiB/s wr, 584 op/s 2024-09-11T22:19:04.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:03 smithi179 ceph-mon[35603]: pgmap v462: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.3 MiB/s wr, 578 op/s 2024-09-11T22:19:04.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:03 smithi193 ceph-mon[35545]: pgmap v462: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.3 MiB/s wr, 578 op/s 2024-09-11T22:19:04.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:03 smithi152 ceph-mon[31188]: pgmap v462: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.3 MiB/s wr, 578 op/s 2024-09-11T22:19:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 810.0 s, 504.6 tps, lat 192.576 ms stddev 208.939 2024-09-11T22:19:06.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:05 smithi179 ceph-mon[35603]: pgmap v463: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 8.2 MiB/s wr, 812 op/s 2024-09-11T22:19:06.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:05 smithi193 ceph-mon[35545]: pgmap v463: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 8.2 MiB/s wr, 812 op/s 2024-09-11T22:19:06.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:05 smithi152 ceph-mon[31188]: pgmap v463: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 8.2 MiB/s wr, 812 op/s 2024-09-11T22:19:08.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:07 smithi179 ceph-mon[35603]: pgmap v464: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 5.2 MiB/s wr, 546 op/s 2024-09-11T22:19:08.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:07 smithi193 ceph-mon[35545]: pgmap v464: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 5.2 MiB/s wr, 546 op/s 2024-09-11T22:19:08.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:07 smithi152 ceph-mon[31188]: pgmap v464: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 5.2 MiB/s wr, 546 op/s 2024-09-11T22:19:09.448 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:19:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.686+0000 7f5e48cc6640 1 -- 172.21.15.152:0/3696196208 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34035020 con 0x7f5e3c095520 2024-09-11T22:19:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.686+0000 7f5e4acca640 1 -- 172.21.15.152:0/3696196208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c095520 msgr2=0x7f5e3c099170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.686+0000 7f5e4acca640 1 --2- 172.21.15.152:0/3696196208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c095520 0x7f5e3c099170 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009930 tx=0x7f5e3402a420 comp rx=0 tx=0).stop 2024-09-11T22:19:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.686+0000 7f5e4acca640 1 -- 172.21.15.152:0/3696196208 shutdown_connections 2024-09-11T22:19:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.686+0000 7f5e4acca640 1 --2- 172.21.15.152:0/3696196208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e3c099880 0x7f5e3c0a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.686+0000 7f5e4acca640 1 --2- 172.21.15.152:0/3696196208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c095520 0x7f5e3c099170 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.686+0000 7f5e4acca640 1 --2- 172.21.15.152:0/3696196208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e3c094b70 0x7f5e3c094f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.686+0000 7f5e4acca640 1 -- 172.21.15.152:0/3696196208 >> 172.21.15.152:0/3696196208 conn(0x7f5e3c00a1e0 msgr2=0x7f5e3c00a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.686+0000 7f5e4acca640 1 -- 172.21.15.152:0/3696196208 shutdown_connections 2024-09-11T22:19:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.686+0000 7f5e4acca640 1 -- 172.21.15.152:0/3696196208 wait complete. 2024-09-11T22:19:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.687+0000 7f5e4acca640 1 Processor -- start 2024-09-11T22:19:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.687+0000 7f5e4acca640 1 -- start start 2024-09-11T22:19:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.688+0000 7f5e4acca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c094b70 0x7f5e3c12ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.688+0000 7f5e4acca640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e3c099880 0x7f5e3c12b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.688+0000 7f5e4acca640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e3c12f660 0x7f5e3c12fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.688+0000 7f5e4acca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c0a4900 con 0x7f5e3c094b70 2024-09-11T22:19:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.688+0000 7f5e4acca640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c0a4780 con 0x7f5e3c12f660 2024-09-11T22:19:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.688+0000 7f5e4acca640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c0a4a80 con 0x7f5e3c099880 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.688+0000 7f5e49cc8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c094b70 0x7f5e3c12ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.688+0000 7f5e49cc8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c094b70 0x7f5e3c12ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47420/0 (socket says 172.21.15.152:47420) 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.688+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3477804161 learned_addr learned my addr 172.21.15.152:0/3477804161 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.688+0000 7f5e4a4c9640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e3c12f660 0x7f5e3c12fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e494c7640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e3c099880 0x7f5e3c12b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3477804161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e3c099880 msgr2=0x7f5e3c12b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e3c099880 0x7f5e3c12b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3477804161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e3c12f660 msgr2=0x7f5e3c12fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e3c12f660 0x7f5e3c12fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3477804161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c130150 con 0x7f5e3c094b70 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e494c7640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e3c099880 0x7f5e3c12b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c094b70 0x7f5e3c12ada0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000e9f0 tx=0x7f5e4000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e3affd640 1 -- 172.21.15.152:0/3477804161 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000cd80 con 0x7f5e3c094b70 2024-09-11T22:19:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e3affd640 1 -- 172.21.15.152:0/3477804161 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e40010910 con 0x7f5e3c094b70 2024-09-11T22:19:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e4acca640 1 -- 172.21.15.152:0/3477804161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3c130440 con 0x7f5e3c094b70 2024-09-11T22:19:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e3affd640 1 -- 172.21.15.152:0/3477804161 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40018990 con 0x7f5e3c094b70 2024-09-11T22:19:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.689+0000 7f5e4acca640 1 -- 172.21.15.152:0/3477804161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3c004a10 con 0x7f5e3c094b70 2024-09-11T22:19:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.692+0000 7f5e3affd640 1 -- 172.21.15.152:0/3477804161 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f5e40010ac0 con 0x7f5e3c094b70 2024-09-11T22:19:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.692+0000 7f5e4ecbf740 1 Processor -- start 2024-09-11T22:19:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.692+0000 7f5e4ecbf740 1 -- start start 2024-09-11T22:19:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.692+0000 7f5e3affd640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e300a2d00 0x7f5e300a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bfc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bff270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e4ecbf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f3d6b562f0 con 0x55f3d6bfce80 2024-09-11T22:19:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e4ecbf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f3d6afe270 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e4ecbf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f3d6b522b0 con 0x55f3d6bf25e0 2024-09-11T22:19:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e3affd640 1 -- 172.21.15.152:0/3477804161 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f5e400cf8a0 con 0x7f5e3c094b70 2024-09-11T22:19:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e49cc8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e4a4c9640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e300a2d00 0x7f5e300a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e49cc8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37738/0 (socket says 172.21.15.152:37738) 2024-09-11T22:19:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3353064395 learned_addr learned my addr 172.21.15.152:0/3353064395 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e494c7640 1 --2- 172.21.15.152:0/3353064395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bfc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e4a4c9640 1 --2- 172.21.15.152:0/3353064395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bff270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3353064395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 msgr2=0x55f3d6bfc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/3353064395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bfc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3353064395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 msgr2=0x55f3d6bff270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/3353064395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bff270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3353064395 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3d6afd340 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e4a4c9640 1 --2- 172.21.15.152:0/3353064395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/3353064395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf20a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5e40098700 tx=0x7f5e4009c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60912970322bf5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.693+0000 7f5e4a4c9640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e300a2d00 0x7f5e300a51c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5e44067ea0 tx=0x7f5e44067990 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.694+0000 7f5e2ffff640 1 -- 172.21.15.152:0/3353064395 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e400a49a0 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.694+0000 7f5e2ffff640 1 -- 172.21.15.152:0/3353064395 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e400cd1e0 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.694+0000 7f5e2ffff640 1 -- 172.21.15.152:0/3353064395 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40018d90 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.695+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3353064395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 msgr2=0x55f3d6bf20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.695+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/3353064395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf20a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5e40098700 tx=0x7f5e4009c430 comp rx=0 tx=0).stop 2024-09-11T22:19:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.697+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3353064395 shutdown_connections 2024-09-11T22:19:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.697+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/3353064395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.697+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/3353064395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bfc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.697+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/3353064395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf20a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.697+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3353064395 >> 172.21.15.152:0/3353064395 conn(0x55f3d6bee230 msgr2=0x55f3d6bee610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.697+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3353064395 shutdown_connections 2024-09-11T22:19:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.698+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3353064395 wait complete. 2024-09-11T22:19:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.698+0000 7f5e4ecbf740 1 -- start start 2024-09-11T22:19:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.698+0000 7f5e4ecbf740 1 Processor -- start 2024-09-11T22:19:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bfa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bfa770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e4ecbf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f3d6bffa50 con 0x55f3d6bfce80 2024-09-11T22:19:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e4ecbf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f3d6adf290 con 0x55f3d6bf25e0 2024-09-11T22:19:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e4ecbf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f3d6bffbd0 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e4ecbf740 10 client.0 _ll_register_callbacks cb 0x55f3d6b10140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e494c7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bfa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e49cc8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e49cc8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38166/0 (socket says 172.21.15.152:38166) 2024-09-11T22:19:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e4a4c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bfa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e494c7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bfa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37754/0 (socket says 172.21.15.152:37754) 2024-09-11T22:19:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e49cc8640 1 -- 172.21.15.152:0/28901944 learned_addr learned my addr 172.21.15.152:0/28901944 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e49cc8640 1 -- 172.21.15.152:0/28901944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf25e0 msgr2=0x55f3d6bfa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/28901944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bfa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e49cc8640 1 -- 172.21.15.152:0/28901944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 msgr2=0x55f3d6bfa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/28901944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bfa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.699+0000 7f5e49cc8640 1 -- 172.21.15.152:0/28901944 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3d6869210 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/28901944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf9cf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000c6a0 tx=0x7f5e40060870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a287cf5bfa60b880 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/28901944 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e400a49a0 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/28901944 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f5e40018d40 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/28901944 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e400cd1e0 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/28901944 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5e4009b180 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e4ecbf740 10 client.28444 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/28901944 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f3d6935620 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/28901944 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e400cd1e0 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/28901944 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5e400ba030 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e4ecbf740 10 client.28444 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e4ecbf740 10 client.28444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e4ecbf740 20 client.28444 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/28901944 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f3d6c0cb30 0x55f3d6c0ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e4ecbf740 4 client.28444 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.700+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/28901944 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3d6b63a20 con 0x55f3d6c0cb30 2024-09-11T22:19:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.701+0000 7f5e494c7640 1 --2- 172.21.15.152:0/28901944 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f3d6c0cb30 0x55f3d6c0ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.701+0000 7f5e2d7fa640 10 client.28444 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.701+0000 7f5e494c7640 1 --2- 172.21.15.152:0/28901944 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f3d6c0cb30 0x55f3d6c0ef20 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1da7450baaaf798a server_cookie=b703f3536caad98e in_seq=0 out_seq=0 2024-09-11T22:19:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/28901944 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3d6b63a20 con 0x55f3d6c0cb30 2024-09-11T22:19:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e2d7fa640 10 client.28444 handle_command_reply: tid=0 2024-09-11T22:19:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 1 client.28444 shutdown 2024-09-11T22:19:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/28901944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 msgr2=0x55f3d6bf9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/28901944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf9cf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000c6a0 tx=0x7f5e40060870 comp rx=0 tx=0).stop 2024-09-11T22:19:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/28901944 shutdown_connections 2024-09-11T22:19:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/28901944 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f3d6c0cb30 0x55f3d6c0ef20 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/28901944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bfa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e2d7fa640 0 client.28444 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/28901944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bfa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/28901944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf9cf0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/28901944 >> 172.21.15.152:0/28901944 conn(0x55f3d6bee230 msgr2=0x55f3d6bf3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/28901944 shutdown_connections 2024-09-11T22:19:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/28901944 wait complete. 2024-09-11T22:19:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.702+0000 7f5e4ecbf740 20 client.28444 trim_cache size 0 max 16384 2024-09-11T22:19:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.724+0000 7f5e4ecbf740 1 Processor -- start 2024-09-11T22:19:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.724+0000 7f5e4ecbf740 1 -- start start 2024-09-11T22:19:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bfa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bed170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bfce80 0x55f3d6c14640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e49cc8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bfa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e4ecbf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c141bf0 con 0x55f3d6bf25e0 2024-09-11T22:19:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e4ecbf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c13f4c0 con 0x55f3d6bfce80 2024-09-11T22:19:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e4ecbf740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c13d330 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e49cc8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bfa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38174/0 (socket says 172.21.15.152:38174) 2024-09-11T22:19:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e49cc8640 1 -- 172.21.15.152:0/2570478149 learned_addr learned my addr 172.21.15.152:0/2570478149 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e494c7640 1 --2- 172.21.15.152:0/2570478149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e49cc8640 1 -- 172.21.15.152:0/2570478149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bfce80 msgr2=0x55f3d6c14640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e4a4c9640 1 --2- 172.21.15.152:0/2570478149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bfce80 0x55f3d6c14640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/2570478149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bfce80 0x55f3d6c14640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e49cc8640 1 -- 172.21.15.152:0/2570478149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bf25e0 msgr2=0x55f3d6bed170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/2570478149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bed170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e49cc8640 1 -- 172.21.15.152:0/2570478149 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3d6bef2e0 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e4a4c9640 1 --2- 172.21.15.152:0/2570478149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bfce80 0x55f3d6c14640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.725+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/2570478149 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bfa5a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5e4009bef0 tx=0x7f5e40018420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3840343d1d4b0da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.726+0000 7f5e2f7fe640 1 -- 172.21.15.152:0/2570478149 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e400608e0 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.726+0000 7f5e2f7fe640 1 -- 172.21.15.152:0/2570478149 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e4009ae70 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.726+0000 7f5e2f7fe640 1 -- 172.21.15.152:0/2570478149 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e400a1270 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.727+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/2570478149 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 msgr2=0x55f3d6bfa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.727+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/2570478149 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bfa5a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5e4009bef0 tx=0x7f5e40018420 comp rx=0 tx=0).stop 2024-09-11T22:19:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.727+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/2570478149 shutdown_connections 2024-09-11T22:19:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.727+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/2570478149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bfce80 0x55f3d6c14640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.727+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/2570478149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.727+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/2570478149 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bfa5a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.727+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/2570478149 >> 172.21.15.152:0/2570478149 conn(0x55f3d6bee230 msgr2=0x55f3d6beca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.727+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/2570478149 shutdown_connections 2024-09-11T22:19:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.727+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/2570478149 wait complete. 2024-09-11T22:19:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.728+0000 7f5e4ecbf740 1 -- start start 2024-09-11T22:19:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.728+0000 7f5e4ecbf740 1 Processor -- start 2024-09-11T22:19:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.728+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.728+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bf7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.728+0000 7f5e4ecbf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bf78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.728+0000 7f5e49cc8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.728+0000 7f5e49cc8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37766/0 (socket says 172.21.15.152:37766) 2024-09-11T22:19:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.728+0000 7f5e494c7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bf7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e494c7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bf7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38178/0 (socket says 172.21.15.152:38178) 2024-09-11T22:19:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3658499668 learned_addr learned my addr 172.21.15.152:0/3658499668 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e4a4c9640 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bf78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3658499668 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c13d980 con 0x55f3d6bfce80 2024-09-11T22:19:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3658499668 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c13edf0 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3658499668 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c13e050 con 0x55f3d6bf25e0 2024-09-11T22:19:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e4ecbf740 10 client.0 _ll_register_callbacks cb 0x7f5e400a01a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3658499668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 msgr2=0x55f3d6bf7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bf7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3658499668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 msgr2=0x55f3d6bf78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bf78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e49cc8640 1 -- 172.21.15.152:0/3658499668 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3d6c03620 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e494c7640 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bf7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e49cc8640 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf6e20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5e4009ba30 tx=0x7f5e400106e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6aab03ec592c04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:19:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.729+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/3658499668 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40097fd0 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3658499668 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e4009ae70 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/3658499668 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f5e4009a030 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/3658499668 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5e400cd350 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e4ecbf740 10 client.28307 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3658499668 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f3d6c03620 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/3658499668 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e4009ae70 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/3658499668 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5e400ba040 con 0x55f3d6bf1cc0 2024-09-11T22:19:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e4ecbf740 10 client.28307 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e4ecbf740 10 client.28307 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e4ecbf740 20 client.28307 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f3d6c77be0 0x55f3d6c79fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e4ecbf740 4 client.28307 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:19:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3658499668 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f3d6b5dd70 con 0x55f3d6c77be0 2024-09-11T22:19:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.730+0000 7f5e494c7640 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f3d6c77be0 0x55f3d6c79fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.731+0000 7f5e2d7fa640 10 client.28307 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.731+0000 7f5e494c7640 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f3d6c77be0 0x55f3d6c79fd0 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb42afede15105c8 server_cookie=d7ae2470f4ffc963 in_seq=0 out_seq=0 2024-09-11T22:19:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e2d7fa640 1 -- 172.21.15.152:0/3658499668 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f3d6b5dd70 con 0x55f3d6c77be0 2024-09-11T22:19:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e2d7fa640 10 client.28307 handle_command_reply: tid=0 2024-09-11T22:19:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 1 client.28307 shutdown 2024-09-11T22:19:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3658499668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 msgr2=0x55f3d6bf6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf6e20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5e4009ba30 tx=0x7f5e400106e0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3658499668 shutdown_connections 2024-09-11T22:19:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f3d6c77be0 0x55f3d6c79fd0 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3d6bfce80 0x55f3d6bf78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3d6bf25e0 0x55f3d6bf7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e2d7fa640 0 client.28307 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 1 --2- 172.21.15.152:0/3658499668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f3d6bf1cc0 0x55f3d6bf6e20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3658499668 >> 172.21.15.152:0/3658499668 conn(0x55f3d6bee230 msgr2=0x55f3d6bed260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3658499668 shutdown_connections 2024-09-11T22:19:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 1 -- 172.21.15.152:0/3658499668 wait complete. 2024-09-11T22:19:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.741+0000 7f5e4ecbf740 20 client.28307 trim_cache size 0 max 16384 2024-09-11T22:19:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:19:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:19:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:19:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:19:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 -- 172.21.15.152:0/3477804161 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e300a2d00 msgr2=0x7f5e300a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e300a2d00 0x7f5e300a51c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5e44067ea0 tx=0x7f5e44067990 comp rx=0 tx=0).stop 2024-09-11T22:19:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 -- 172.21.15.152:0/3477804161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c094b70 msgr2=0x7f5e3c12ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c094b70 0x7f5e3c12ada0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000e9f0 tx=0x7f5e4000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 -- 172.21.15.152:0/3477804161 shutdown_connections 2024-09-11T22:19:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5e300a2d00 0x7f5e300a51c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e3c12f660 0x7f5e3c12fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e3c099880 0x7f5e3c12b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 --2- 172.21.15.152:0/3477804161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c094b70 0x7f5e3c12ada0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 -- 172.21.15.152:0/3477804161 >> 172.21.15.152:0/3477804161 conn(0x7f5e3c00a1e0 msgr2=0x7f5e3c092ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 -- 172.21.15.152:0/3477804161 shutdown_connections 2024-09-11T22:19:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:09.742+0000 7f5e4acca640 1 -- 172.21.15.152:0/3477804161 wait complete. 2024-09-11T22:19:09.812 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:19:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 815.0 s, 949.4 tps, lat 107.585 ms stddev 268.764 2024-09-11T22:19:10.132 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:09 smithi152 ceph-mon[31188]: osdmap e102: 12 total, 12 up, 12 in 2024-09-11T22:19:10.132 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:09 smithi152 ceph-mon[31188]: pgmap v466: 97 pgs: 11 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 70 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 22 MiB/s wr, 1.48k op/s 2024-09-11T22:19:10.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:09 smithi179 ceph-mon[35603]: osdmap e102: 12 total, 12 up, 12 in 2024-09-11T22:19:10.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:09 smithi179 ceph-mon[35603]: pgmap v466: 97 pgs: 11 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 70 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 22 MiB/s wr, 1.48k op/s 2024-09-11T22:19:10.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:09 smithi193 ceph-mon[35545]: osdmap e102: 12 total, 12 up, 12 in 2024-09-11T22:19:10.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:09 smithi193 ceph-mon[35545]: pgmap v466: 97 pgs: 11 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 70 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 22 MiB/s wr, 1.48k op/s 2024-09-11T22:19:10.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.545+0000 7f8df7c5c640 1 -- 172.21.15.152:0/3539366740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df0102790 msgr2=0x7f8df01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.545+0000 7f8df7c5c640 1 --2- 172.21.15.152:0/3539366740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df0102790 0x7f8df01067e0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009900 tx=0x7f8de002a410 comp rx=0 tx=0).stop 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.545+0000 7f8df7c5c640 1 -- 172.21.15.152:0/3539366740 shutdown_connections 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.545+0000 7f8df7c5c640 1 --2- 172.21.15.152:0/3539366740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8df0106f10 0x7f8df010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.545+0000 7f8df7c5c640 1 --2- 172.21.15.152:0/3539366740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df0102790 0x7f8df01067e0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.545+0000 7f8df7c5c640 1 --2- 172.21.15.152:0/3539366740 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8df0101de0 0x7f8df01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.545+0000 7f8df7c5c640 1 -- 172.21.15.152:0/3539366740 >> 172.21.15.152:0/3539366740 conn(0x7f8df00fd880 msgr2=0x7f8df00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.545+0000 7f8df7c5c640 1 -- 172.21.15.152:0/3539366740 shutdown_connections 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.545+0000 7f8df7c5c640 1 -- 172.21.15.152:0/3539366740 wait complete. 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df7c5c640 1 Processor -- start 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df7c5c640 1 -- start start 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df7c5c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df0101de0 0x7f8df0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df7c5c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8df0102790 0x7f8df01987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df7c5c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8df0106f10 0x7f8df019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df7c5c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8df0111fc0 con 0x7f8df0101de0 2024-09-11T22:19:10.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df7c5c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8df0111e40 con 0x7f8df0102790 2024-09-11T22:19:10.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df7c5c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8df0112140 con 0x7f8df0106f10 2024-09-11T22:19:10.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df59f8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df0101de0 0x7f8df0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df59f8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df0101de0 0x7f8df0198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47476/0 (socket says 172.21.15.152:47476) 2024-09-11T22:19:10.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df59f8640 1 -- 172.21.15.152:0/2720446996 learned_addr learned my addr 172.21.15.152:0/2720446996 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:10.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df51f7640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8df0102790 0x7f8df01987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df61f9640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8df0106f10 0x7f8df019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df59f8640 1 -- 172.21.15.152:0/2720446996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8df0106f10 msgr2=0x7f8df019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df59f8640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8df0106f10 0x7f8df019cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df59f8640 1 -- 172.21.15.152:0/2720446996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8df0102790 msgr2=0x7f8df01987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.546+0000 7f8df59f8640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8df0102790 0x7f8df01987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.547+0000 7f8df59f8640 1 -- 172.21.15.152:0/2720446996 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df019d230 con 0x7f8df0101de0 2024-09-11T22:19:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.547+0000 7f8df61f9640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8df0106f10 0x7f8df019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.547+0000 7f8df59f8640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df0101de0 0x7f8df0198280 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00eb90 tx=0x7f8dec00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.547+0000 7f8de6ffd640 1 -- 172.21.15.152:0/2720446996 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec004d20 con 0x7f8df0101de0 2024-09-11T22:19:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.547+0000 7f8de6ffd640 1 -- 172.21.15.152:0/2720446996 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dec00ee90 con 0x7f8df0101de0 2024-09-11T22:19:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.547+0000 7f8df7c5c640 1 -- 172.21.15.152:0/2720446996 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df019d520 con 0x7f8df0101de0 2024-09-11T22:19:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.547+0000 7f8de6ffd640 1 -- 172.21.15.152:0/2720446996 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec010830 con 0x7f8df0101de0 2024-09-11T22:19:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.547+0000 7f8df7c5c640 1 -- 172.21.15.152:0/2720446996 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df01a4e00 con 0x7f8df0101de0 2024-09-11T22:19:10.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.550+0000 7f8de6ffd640 1 -- 172.21.15.152:0/2720446996 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8dec005020 con 0x7f8df0101de0 2024-09-11T22:19:10.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.551+0000 7f8de6ffd640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ddc0a2df0 0x7f8ddc0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.552+0000 7f8de6ffd640 1 -- 172.21.15.152:0/2720446996 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f8dec0cfb90 con 0x7f8df0101de0 2024-09-11T22:19:10.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.552+0000 7f8df51f7640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ddc0a2df0 0x7f8ddc0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.552+0000 7f8df51f7640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ddc0a2df0 0x7f8ddc0a52b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8df0108280 tx=0x7f8de000b040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:10.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.552+0000 7f8dfa035740 1 Processor -- start 2024-09-11T22:19:10.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8dfa035740 1 -- start start 2024-09-11T22:19:10.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb74a0 0x5652cbcb7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcc2680 0x5652cbcc4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8dfa035740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5652cbc1d2e0 con 0x5652cbcc2680 2024-09-11T22:19:10.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8dfa035740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5652cbbc4ce0 con 0x5652cbcb7dc0 2024-09-11T22:19:10.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8dfa035740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5652cbc192a0 con 0x5652cbcb74a0 2024-09-11T22:19:10.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8df51f7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8df61f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcc2680 0x5652cbcc4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8df51f7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37786/0 (socket says 172.21.15.152:37786) 2024-09-11T22:19:10.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8df51f7640 1 -- 172.21.15.152:0/2721991434 learned_addr learned my addr 172.21.15.152:0/2721991434 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:10.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8df59f8640 1 --2- 172.21.15.152:0/2721991434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb74a0 0x5652cbcb7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8df51f7640 1 -- 172.21.15.152:0/2721991434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb74a0 msgr2=0x5652cbcb7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:10.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8df51f7640 1 --2- 172.21.15.152:0/2721991434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb74a0 0x5652cbcb7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8df51f7640 1 -- 172.21.15.152:0/2721991434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcc2680 msgr2=0x5652cbcc4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8df51f7640 1 --2- 172.21.15.152:0/2721991434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcc2680 0x5652cbcc4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8df51f7640 1 -- 172.21.15.152:0/2721991434 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cbba9440 con 0x5652cbcb7dc0 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.553+0000 7f8df51f7640 1 --2- 172.21.15.152:0/2721991434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc2140 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009900 tx=0x7f8de003d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a1e5938946f16de server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.554+0000 7f8ddbfff640 1 -- 172.21.15.152:0/2721991434 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0035040 con 0x5652cbcb7dc0 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.554+0000 7f8ddbfff640 1 -- 172.21.15.152:0/2721991434 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8de004e070 con 0x5652cbcb7dc0 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.554+0000 7f8ddbfff640 1 -- 172.21.15.152:0/2721991434 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de003c440 con 0x5652cbcb7dc0 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.554+0000 7f8dfa035740 1 -- 172.21.15.152:0/2721991434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb7dc0 msgr2=0x5652cbcc2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.554+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2721991434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc2140 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009900 tx=0x7f8de003d000 comp rx=0 tx=0).stop 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.555+0000 7f8dfa035740 1 -- 172.21.15.152:0/2721991434 shutdown_connections 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.555+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2721991434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcc2680 0x5652cbcc4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.555+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2721991434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc2140 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.555+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2721991434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb74a0 0x5652cbcb7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.555+0000 7f8dfa035740 1 -- 172.21.15.152:0/2721991434 >> 172.21.15.152:0/2721991434 conn(0x5652cbcb3a30 msgr2=0x5652cbcb3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:10.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.555+0000 7f8dfa035740 1 -- 172.21.15.152:0/2721991434 shutdown_connections 2024-09-11T22:19:10.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.555+0000 7f8dfa035740 1 -- 172.21.15.152:0/2721991434 wait complete. 2024-09-11T22:19:10.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.555+0000 7f8dfa035740 1 -- start start 2024-09-11T22:19:10.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.555+0000 7f8dfa035740 1 Processor -- start 2024-09-11T22:19:10.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcc1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcbf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcc2680 0x5652cbcbf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8df59f8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcc1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8df59f8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcc1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47488/0 (socket says 172.21.15.152:47488) 2024-09-11T22:19:10.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8df51f7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcbf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8df51f7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcbf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38208/0 (socket says 172.21.15.152:38208) 2024-09-11T22:19:10.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8df59f8640 1 -- 172.21.15.152:0/451944953 learned_addr learned my addr 172.21.15.152:0/451944953 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8dfa035740 1 -- 172.21.15.152:0/451944953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5652cbcc5250 con 0x5652cbcb74a0 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8dfa035740 1 -- 172.21.15.152:0/451944953 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5652cbbd8050 con 0x5652cbcc2680 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8dfa035740 1 -- 172.21.15.152:0/451944953 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5652cbcc53d0 con 0x5652cbcb7dc0 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.556+0000 7f8df61f9640 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcc2680 0x5652cbcbf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8df59f8640 1 -- 172.21.15.152:0/451944953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 msgr2=0x5652cbcbf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8df59f8640 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcbf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8df59f8640 1 -- 172.21.15.152:0/451944953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcc2680 msgr2=0x5652cbcbf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8df59f8640 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcc2680 0x5652cbcbf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8dfa035740 10 client.0 _ll_register_callbacks cb 0x5652cbc18160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8df59f8640 1 -- 172.21.15.152:0/451944953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652cb98e3c0 con 0x5652cbcb74a0 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8dfa035740 1 -- 172.21.15.152:0/451944953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8de004e070 con 0x5652cbcb74a0 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8df59f8640 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcc1fd0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f8dec098990 tx=0x7f8dec09b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c9f8c268add50f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8dd97fa640 10 client.19152 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8dd97fa640 1 -- 172.21.15.152:0/451944953 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec0a0370 con 0x5652cbcb74a0 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8dd97fa640 1 -- 172.21.15.152:0/451944953 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f8dec0cd470 con 0x5652cbcb74a0 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8dd97fa640 1 -- 172.21.15.152:0/451944953 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8dec0cd670 con 0x5652cbcb74a0 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8dfa035740 10 client.19152 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.557+0000 7f8dfa035740 1 -- 172.21.15.152:0/451944953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5652cbcd0a70 con 0x5652cbcb74a0 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.558+0000 7f8dd97fa640 1 -- 172.21.15.152:0/451944953 <== mon.0 v2:172.21.15.152:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8dec09e070 con 0x5652cbcb74a0 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.558+0000 7f8dfa035740 10 client.19152 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.558+0000 7f8dfa035740 10 client.19152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.558+0000 7f8dfa035740 20 client.19152 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.558+0000 7f8dfa035740 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652cbcd1e20 0x5652cbcd42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.558+0000 7f8dfa035740 4 client.19152 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.558+0000 7f8dfa035740 1 -- 172.21.15.152:0/451944953 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652cbc2a850 con 0x5652cbcd1e20 2024-09-11T22:19:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.558+0000 7f8df51f7640 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652cbcd1e20 0x5652cbcd42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.558+0000 7f8dd97fa640 10 client.19152 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.558+0000 7f8df51f7640 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652cbcd1e20 0x5652cbcd42e0 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10cbfdacbdc72de4 server_cookie=c7fd27255a389d52 in_seq=0 out_seq=0 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dd97fa640 1 -- 172.21.15.152:0/451944953 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652cbc2a850 con 0x5652cbcd1e20 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dd97fa640 10 client.19152 handle_command_reply: tid=0 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 1 client.19152 shutdown 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 1 -- 172.21.15.152:0/451944953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 msgr2=0x5652cbcc1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcc1fd0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f8dec098990 tx=0x7f8dec09b9e0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 1 -- 172.21.15.152:0/451944953 shutdown_connections 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652cbcd1e20 0x5652cbcd42e0 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcc2680 0x5652cbcbf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcbf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 1 --2- 172.21.15.152:0/451944953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcc1fd0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dd97fa640 0 client.19152 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:10.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 1 -- 172.21.15.152:0/451944953 >> 172.21.15.152:0/451944953 conn(0x5652cbcb3a30 msgr2=0x5652cbcb9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:10.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 1 -- 172.21.15.152:0/451944953 shutdown_connections 2024-09-11T22:19:10.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 1 -- 172.21.15.152:0/451944953 wait complete. 2024-09-11T22:19:10.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.559+0000 7f8dfa035740 20 client.19152 trim_cache size 0 max 16384 2024-09-11T22:19:10.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.581+0000 7f8dfa035740 1 Processor -- start 2024-09-11T22:19:10.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.581+0000 7f8dfa035740 1 -- start start 2024-09-11T22:19:10.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcd9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcc2680 0x5652cbcda0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8dfa035740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8df01ae0b0 con 0x5652cbcb74a0 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8dfa035740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8df01ab980 con 0x5652cbcc2680 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8dfa035740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8df01a97f0 con 0x5652cbcb7dc0 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df59f8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df51f7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcd9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df59f8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47500/0 (socket says 172.21.15.152:47500) 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df59f8640 1 -- 172.21.15.152:0/2250471685 learned_addr learned my addr 172.21.15.152:0/2250471685 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df61f9640 1 --2- 172.21.15.152:0/2250471685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcc2680 0x5652cbcda0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df59f8640 1 -- 172.21.15.152:0/2250471685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 msgr2=0x5652cbcd9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df59f8640 1 --2- 172.21.15.152:0/2250471685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcd9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df59f8640 1 -- 172.21.15.152:0/2250471685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcc2680 msgr2=0x5652cbcda0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:10.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df59f8640 1 --2- 172.21.15.152:0/2250471685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcc2680 0x5652cbcda0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df59f8640 1 -- 172.21.15.152:0/2250471685 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cbcd4910 con 0x5652cbcb74a0 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df51f7640 1 --2- 172.21.15.152:0/2250471685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcd9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.582+0000 7f8df59f8640 1 --2- 172.21.15.152:0/2250471685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcce4b0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f8dec09bcc0 tx=0x7f8dec09e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd071afb46e4b0f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.583+0000 7f8ddb7fe640 1 -- 172.21.15.152:0/2250471685 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec09bb00 con 0x5652cbcb74a0 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.583+0000 7f8ddb7fe640 1 -- 172.21.15.152:0/2250471685 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8de004e070 con 0x5652cbcb74a0 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.583+0000 7f8ddb7fe640 1 -- 172.21.15.152:0/2250471685 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec0a47a0 con 0x5652cbcb74a0 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.584+0000 7f8dfa035740 1 -- 172.21.15.152:0/2250471685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 msgr2=0x5652cbcce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.584+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2250471685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcce4b0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f8dec09bcc0 tx=0x7f8dec09e000 comp rx=0 tx=0).stop 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.584+0000 7f8dfa035740 1 -- 172.21.15.152:0/2250471685 shutdown_connections 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.584+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2250471685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcc2680 0x5652cbcda0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.584+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2250471685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcd9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.584+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2250471685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcb74a0 0x5652cbcce4b0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.584+0000 7f8dfa035740 1 -- 172.21.15.152:0/2250471685 >> 172.21.15.152:0/2250471685 conn(0x5652cbcb3a30 msgr2=0x5652cbcba850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:10.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.584+0000 7f8dfa035740 1 -- 172.21.15.152:0/2250471685 shutdown_connections 2024-09-11T22:19:10.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.584+0000 7f8dfa035740 1 -- 172.21.15.152:0/2250471685 wait complete. 2024-09-11T22:19:10.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.584+0000 7f8dfa035740 1 -- start start 2024-09-11T22:19:10.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.584+0000 7f8dfa035740 1 Processor -- start 2024-09-11T22:19:10.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb74a0 0x5652cbcc6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8dfa035740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcc2680 0x5652cbcc7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8dfa035740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8df01a9e40 con 0x5652cbcc2680 2024-09-11T22:19:10.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8df51f7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8df59f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb74a0 0x5652cbcc6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8df51f7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38224/0 (socket says 172.21.15.152:38224) 2024-09-11T22:19:10.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8df61f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcc2680 0x5652cbcc7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8df51f7640 1 -- 172.21.15.152:0/2317502300 learned_addr learned my addr 172.21.15.152:0/2317502300 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:10.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8dfa035740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8df01ab2b0 con 0x5652cbcb74a0 2024-09-11T22:19:10.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8dfa035740 1 -- 172.21.15.152:0/2317502300 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8df01aa510 con 0x5652cbcb7dc0 2024-09-11T22:19:10.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8dfa035740 10 client.0 _ll_register_callbacks cb 0x7f8dec0982f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8df51f7640 1 -- 172.21.15.152:0/2317502300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb74a0 msgr2=0x5652cbcc6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8df51f7640 1 --2- 172.21.15.152:0/2317502300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb74a0 0x5652cbcc6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8df51f7640 1 -- 172.21.15.152:0/2317502300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcc2680 msgr2=0x5652cbcc7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.585+0000 7f8df51f7640 1 --2- 172.21.15.152:0/2317502300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcc2680 0x5652cbcc7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8df51f7640 1 -- 172.21.15.152:0/2317502300 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652cbd3be50 con 0x5652cbcb7dc0 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8df51f7640 1 --2- 172.21.15.152:0/2317502300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc6ba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8de002aa00 tx=0x7f8de0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=790fb6cd091782ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8dd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8dd97fa640 1 -- 172.21.15.152:0/2317502300 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0035040 con 0x5652cbcb7dc0 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8dd97fa640 1 -- 172.21.15.152:0/2317502300 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f8de0032b70 con 0x5652cbcb7dc0 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8dfa035740 1 -- 172.21.15.152:0/2317502300 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8de004e070 con 0x5652cbcb7dc0 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8dd97fa640 1 -- 172.21.15.152:0/2317502300 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8de006f050 con 0x5652cbcb7dc0 2024-09-11T22:19:10.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8dfa035740 10 client.28468 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8dfa035740 1 -- 172.21.15.152:0/2317502300 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5652cbd3d180 con 0x5652cbcb7dc0 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8dd97fa640 1 -- 172.21.15.152:0/2317502300 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8de004e070 con 0x5652cbcb7dc0 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8dd97fa640 1 -- 172.21.15.152:0/2317502300 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f8de003c4d0 con 0x5652cbcb7dc0 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.586+0000 7f8dfa035740 10 client.28468 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8dfa035740 10 client.28468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8dfa035740 20 client.28468 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2317502300 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652cbd3d4c0 0x5652cbd3f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8dfa035740 4 client.28468 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8dfa035740 1 -- 172.21.15.152:0/2317502300 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5652cbc24d60 con 0x5652cbd3d4c0 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8df59f8640 1 --2- 172.21.15.152:0/2317502300 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652cbd3d4c0 0x5652cbd3f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8dd97fa640 10 client.28468 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8df59f8640 1 --2- 172.21.15.152:0/2317502300 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652cbd3d4c0 0x5652cbd3f8b0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a0a61c6d70a7b7b server_cookie=720941f4b36eeb64 in_seq=0 out_seq=0 2024-09-11T22:19:10.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8dd97fa640 1 -- 172.21.15.152:0/2317502300 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5652cbc24d60 con 0x5652cbd3d4c0 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8dd97fa640 10 client.28468 handle_command_reply: tid=0 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8dfa035740 1 client.28468 shutdown 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8dfa035740 1 -- 172.21.15.152:0/2317502300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 msgr2=0x5652cbcc6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.587+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2317502300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc6ba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8de002aa00 tx=0x7f8de0000bc0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.588+0000 7f8dfa035740 1 -- 172.21.15.152:0/2317502300 shutdown_connections 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.588+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2317502300 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5652cbd3d4c0 0x5652cbd3f8b0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.588+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2317502300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652cbcc2680 0x5652cbcc7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.588+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2317502300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652cbcb7dc0 0x5652cbcc6ba0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.588+0000 7f8dfa035740 1 --2- 172.21.15.152:0/2317502300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652cbcb74a0 0x5652cbcc6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.588+0000 7f8dd97fa640 0 client.28468 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.588+0000 7f8dfa035740 1 -- 172.21.15.152:0/2317502300 >> 172.21.15.152:0/2317502300 conn(0x5652cbcb3a30 msgr2=0x5652cbcb2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:10.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.588+0000 7f8dfa035740 1 -- 172.21.15.152:0/2317502300 shutdown_connections 2024-09-11T22:19:10.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.588+0000 7f8dfa035740 1 -- 172.21.15.152:0/2317502300 wait complete. 2024-09-11T22:19:10.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.588+0000 7f8dfa035740 20 client.28468 trim_cache size 0 max 16384 2024-09-11T22:19:10.600 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:19:10.600 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:19:10.600 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:19:10.600 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:19:10.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.590+0000 7f8df7c5c640 1 -- 172.21.15.152:0/2720446996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ddc0a2df0 msgr2=0x7f8ddc0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:10.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.590+0000 7f8df7c5c640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ddc0a2df0 0x7f8ddc0a52b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8df0108280 tx=0x7f8de000b040 comp rx=0 tx=0).stop 2024-09-11T22:19:10.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.590+0000 7f8df7c5c640 1 -- 172.21.15.152:0/2720446996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df0101de0 msgr2=0x7f8df0198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:10.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.590+0000 7f8df7c5c640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df0101de0 0x7f8df0198280 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00eb90 tx=0x7f8dec00c6a0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.590+0000 7f8df7c5c640 1 -- 172.21.15.152:0/2720446996 shutdown_connections 2024-09-11T22:19:10.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.590+0000 7f8df7c5c640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8ddc0a2df0 0x7f8ddc0a52b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.590+0000 7f8df7c5c640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8df0106f10 0x7f8df019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.590+0000 7f8df7c5c640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8df0102790 0x7f8df01987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.590+0000 7f8df7c5c640 1 --2- 172.21.15.152:0/2720446996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df0101de0 0x7f8df0198280 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.590+0000 7f8df7c5c640 1 -- 172.21.15.152:0/2720446996 >> 172.21.15.152:0/2720446996 conn(0x7f8df00fd880 msgr2=0x7f8df00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:10.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.591+0000 7f8df7c5c640 1 -- 172.21.15.152:0/2720446996 shutdown_connections 2024-09-11T22:19:10.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:10.591+0000 7f8df7c5c640 1 -- 172.21.15.152:0/2720446996 wait complete. 2024-09-11T22:19:11.731 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:19:11.731 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:19:11.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:11 smithi152 ceph-mon[31188]: pgmap v467: 97 pgs: 11 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 70 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 25 MiB/s wr, 1.69k op/s 2024-09-11T22:19:12.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:11 smithi179 ceph-mon[35603]: pgmap v467: 97 pgs: 11 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 70 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 25 MiB/s wr, 1.69k op/s 2024-09-11T22:19:12.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:11 smithi193 ceph-mon[35545]: pgmap v467: 97 pgs: 11 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 70 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 25 MiB/s wr, 1.69k op/s 2024-09-11T22:19:12.119 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:19:12.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.683+0000 7f91788fe640 1 -- 172.21.15.152:0/3541794706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9174106f20 msgr2=0x7f917410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:12.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.683+0000 7f91788fe640 1 --2- 172.21.15.152:0/3541794706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9174106f20 0x7f917410eaa0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f916c009ca0 tx=0x7f916c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:19:12.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.683+0000 7f91788fe640 1 -- 172.21.15.152:0/3541794706 shutdown_connections 2024-09-11T22:19:12.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.683+0000 7f91788fe640 1 --2- 172.21.15.152:0/3541794706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9174106f20 0x7f917410eaa0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:12.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.683+0000 7f91788fe640 1 --2- 172.21.15.152:0/3541794706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91741027a0 0x7f91741067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:12.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.683+0000 7f91788fe640 1 --2- 172.21.15.152:0/3541794706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9174101df0 0x7f91741021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:12.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.683+0000 7f91788fe640 1 -- 172.21.15.152:0/3541794706 >> 172.21.15.152:0/3541794706 conn(0x7f91740fd8b0 msgr2=0x7f91740ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:12.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.683+0000 7f91788fe640 1 -- 172.21.15.152:0/3541794706 shutdown_connections 2024-09-11T22:19:12.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.683+0000 7f91788fe640 1 -- 172.21.15.152:0/3541794706 wait complete. 2024-09-11T22:19:12.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.684+0000 7f91788fe640 1 Processor -- start 2024-09-11T22:19:12.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.684+0000 7f91788fe640 1 -- start start 2024-09-11T22:19:12.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.684+0000 7f91788fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9174101df0 0x7f91741983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:12.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f91788fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91741027a0 0x7f9174198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:12.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f91788fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9174106f20 0x7f917419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:12.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f91788fe640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9174111f80 con 0x7f9174101df0 2024-09-11T22:19:12.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f91788fe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9174111e00 con 0x7f9174106f20 2024-09-11T22:19:12.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f91788fe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9174112100 con 0x7f91741027a0 2024-09-11T22:19:12.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f917259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9174101df0 0x7f91741983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:12.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f917259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9174101df0 0x7f91741983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47520/0 (socket says 172.21.15.152:47520) 2024-09-11T22:19:12.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f917259c640 1 -- 172.21.15.152:0/3145166626 learned_addr learned my addr 172.21.15.152:0/3145166626 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:12.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f916bfff640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91741027a0 0x7f9174198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f9172d9d640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9174106f20 0x7f917419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f917259c640 1 -- 172.21.15.152:0/3145166626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91741027a0 msgr2=0x7f9174198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f917259c640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91741027a0 0x7f9174198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f917259c640 1 -- 172.21.15.152:0/3145166626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9174106f20 msgr2=0x7f917419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f917259c640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9174106f20 0x7f917419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f917259c640 1 -- 172.21.15.152:0/3145166626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917419d370 con 0x7f9174101df0 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f917259c640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9174101df0 0x7f91741983c0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f916400ea60 tx=0x7f916400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f916b7fe640 1 -- 172.21.15.152:0/3145166626 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916400cde0 con 0x7f9174101df0 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f916b7fe640 1 -- 172.21.15.152:0/3145166626 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91640035f0 con 0x7f9174101df0 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.685+0000 7f91788fe640 1 -- 172.21.15.152:0/3145166626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917419d660 con 0x7f9174101df0 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.686+0000 7f916b7fe640 1 -- 172.21.15.152:0/3145166626 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164010670 con 0x7f9174101df0 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.686+0000 7f91788fe640 1 -- 172.21.15.152:0/3145166626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91741a4f40 con 0x7f9174101df0 2024-09-11T22:19:12.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.687+0000 7f91788fe640 1 -- 172.21.15.152:0/3145166626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91741021d0 con 0x7f9174101df0 2024-09-11T22:19:12.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.689+0000 7f916b7fe640 1 -- 172.21.15.152:0/3145166626 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f91640037a0 con 0x7f9174101df0 2024-09-11T22:19:12.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.690+0000 7f916b7fe640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f91600a2d70 0x7f91600a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:12.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.690+0000 7f916b7fe640 1 -- 172.21.15.152:0/3145166626 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f91640cf750 con 0x7f9174101df0 2024-09-11T22:19:12.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.690+0000 7f916bfff640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f91600a2d70 0x7f91600a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:12.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.691+0000 7f916bfff640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f91600a2d70 0x7f91600a5230 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f91741083e0 tx=0x7f915c005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:12.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:12.695+0000 7f916b7fe640 1 -- 172.21.15.152:0/3145166626 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f916409c2e0 con 0x7f9174101df0 2024-09-11T22:19:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.012+0000 7f91788fe640 1 -- 172.21.15.152:0/3145166626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f917410a160 con 0x7f9174101df0 2024-09-11T22:19:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.013+0000 7f916b7fe640 1 -- 172.21.15.152:0/3145166626 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f916409bbe0 con 0x7f9174101df0 2024-09-11T22:19:13.014 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:19:13.014 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:19:13.014 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:19:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 -- 172.21.15.152:0/3145166626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f91600a2d70 msgr2=0x7f91600a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f91600a2d70 0x7f91600a5230 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f91741083e0 tx=0x7f915c005f90 comp rx=0 tx=0).stop 2024-09-11T22:19:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 -- 172.21.15.152:0/3145166626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9174101df0 msgr2=0x7f91741983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9174101df0 0x7f91741983c0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f916400ea60 tx=0x7f916400ef20 comp rx=0 tx=0).stop 2024-09-11T22:19:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 -- 172.21.15.152:0/3145166626 shutdown_connections 2024-09-11T22:19:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f91600a2d70 0x7f91600a5230 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9174106f20 0x7f917419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91741027a0 0x7f9174198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 --2- 172.21.15.152:0/3145166626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9174101df0 0x7f91741983c0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 -- 172.21.15.152:0/3145166626 >> 172.21.15.152:0/3145166626 conn(0x7f91740fd8b0 msgr2=0x7f91740feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 -- 172.21.15.152:0/3145166626 shutdown_connections 2024-09-11T22:19:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:13.015+0000 7f91788fe640 1 -- 172.21.15.152:0/3145166626 wait complete. 2024-09-11T22:19:13.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:13 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3145166626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:19:13.342 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:13 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3145166626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:19:13.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:13 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3145166626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:19:14.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:19:14.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:14 smithi152 ceph-mon[31188]: pgmap v468: 97 pgs: 11 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 70 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 25 MiB/s wr, 1.69k op/s 2024-09-11T22:19:14.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:14 smithi193 ceph-mon[35545]: pgmap v468: 97 pgs: 11 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 70 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 25 MiB/s wr, 1.69k op/s 2024-09-11T22:19:14.386 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:19:14.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:14 smithi179 ceph-mon[35603]: pgmap v468: 97 pgs: 11 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 70 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 25 MiB/s wr, 1.69k op/s 2024-09-11T22:19:14.822 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 820.0 s, 1589.2 tps, lat 63.512 ms stddev 72.619 2024-09-11T22:19:14.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.960+0000 7f0afddd3640 1 -- 172.21.15.152:0/4154419846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0af8109b10 msgr2=0x7f0af8114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.960+0000 7f0afddd3640 1 --2- 172.21.15.152:0/4154419846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0af8109b10 0x7f0af8114570 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009900 tx=0x7f0aec02a480 comp rx=0 tx=0).stop 2024-09-11T22:19:14.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.960+0000 7f0afddd3640 1 -- 172.21.15.152:0/4154419846 shutdown_connections 2024-09-11T22:19:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.960+0000 7f0afddd3640 1 --2- 172.21.15.152:0/4154419846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af8114ab0 0x7f0af8116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.960+0000 7f0afddd3640 1 --2- 172.21.15.152:0/4154419846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0af8109b10 0x7f0af8114570 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.960+0000 7f0afddd3640 1 --2- 172.21.15.152:0/4154419846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af81091f0 0x7f0af81095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.960+0000 7f0afddd3640 1 -- 172.21.15.152:0/4154419846 >> 172.21.15.152:0/4154419846 conn(0x7f0af806e140 msgr2=0x7f0af806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.960+0000 7f0afddd3640 1 -- 172.21.15.152:0/4154419846 shutdown_connections 2024-09-11T22:19:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.960+0000 7f0afddd3640 1 -- 172.21.15.152:0/4154419846 wait complete. 2024-09-11T22:19:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.962+0000 7f0afddd3640 1 Processor -- start 2024-09-11T22:19:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.962+0000 7f0afddd3640 1 -- start start 2024-09-11T22:19:14.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.962+0000 7f0afddd3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0af81091f0 0x7f0af81a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.962+0000 7f0afddd3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8109b10 0x7f0af81a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0afddd3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af8114ab0 0x7f0af81a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0afddd3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0af811a7b0 con 0x7f0af81091f0 2024-09-11T22:19:14.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0af77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0af81091f0 0x7f0af81a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0af77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0af81091f0 0x7f0af81a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51452/0 (socket says 172.21.15.152:51452) 2024-09-11T22:19:14.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0af77fe640 1 -- 172.21.15.152:0/4157937423 learned_addr learned my addr 172.21.15.152:0/4157937423 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:14.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8109b10 0x7f0af81a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0afddd3640 1 -- 172.21.15.152:0/4157937423 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0af811a630 con 0x7f0af8109b10 2024-09-11T22:19:14.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0af7fff640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af8114ab0 0x7f0af81a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0afddd3640 1 -- 172.21.15.152:0/4157937423 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0af811a930 con 0x7f0af8114ab0 2024-09-11T22:19:14.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0af77fe640 1 -- 172.21.15.152:0/4157937423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af8114ab0 msgr2=0x7f0af81a5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0af77fe640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af8114ab0 0x7f0af81a5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0af77fe640 1 -- 172.21.15.152:0/4157937423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8109b10 msgr2=0x7f0af81a12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0af77fe640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8109b10 0x7f0af81a12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.963+0000 7f0af77fe640 1 -- 172.21.15.152:0/4157937423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af81a5d20 con 0x7f0af81091f0 2024-09-11T22:19:14.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.964+0000 7f0af77fe640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0af81091f0 0x7f0af81a0d70 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800c890 tx=0x7f0ae800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.964+0000 7f0af4ff9640 1 -- 172.21.15.152:0/4157937423 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8004220 con 0x7f0af81091f0 2024-09-11T22:19:14.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.964+0000 7f0af4ff9640 1 -- 172.21.15.152:0/4157937423 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ae80043c0 con 0x7f0af81091f0 2024-09-11T22:19:14.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.964+0000 7f0afddd3640 1 -- 172.21.15.152:0/4157937423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af81a6010 con 0x7f0af81091f0 2024-09-11T22:19:14.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.964+0000 7f0af4ff9640 1 -- 172.21.15.152:0/4157937423 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80049e0 con 0x7f0af81091f0 2024-09-11T22:19:14.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.964+0000 7f0afddd3640 1 -- 172.21.15.152:0/4157937423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af81ad8f0 con 0x7f0af81091f0 2024-09-11T22:19:14.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.968+0000 7f0af4ff9640 1 -- 172.21.15.152:0/4157937423 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0ae80079b0 con 0x7f0af81091f0 2024-09-11T22:19:14.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.968+0000 7f0b001ac740 1 Processor -- start 2024-09-11T22:19:14.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.968+0000 7f0b001ac740 1 -- start start 2024-09-11T22:19:14.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.968+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.968+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4280 0x559c437b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.968+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 0x559c437c0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.968+0000 7f0b001ac740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559c437102f0 con 0x559c437b95d0 2024-09-11T22:19:14.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.968+0000 7f0b001ac740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559c436b7cf0 con 0x559c437b4280 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.968+0000 7f0b001ac740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c4370c2b0 con 0x559c437b4c00 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437b99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51460/0 (socket says 172.21.15.152:51460) 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af7fff640 1 -- 172.21.15.152:0/2824984617 learned_addr learned my addr 172.21.15.152:0/2824984617 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/2824984617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 0x559c437c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af4ff9640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0ae00a2d70 0x7f0ae00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af77fe640 1 --2- 172.21.15.152:0/2824984617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4280 0x559c437b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af7fff640 1 -- 172.21.15.152:0/2824984617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 msgr2=0x559c437c0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af7fff640 1 --2- 172.21.15.152:0/2824984617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 0x559c437c0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af7fff640 1 -- 172.21.15.152:0/2824984617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4280 msgr2=0x559c437b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af7fff640 1 --2- 172.21.15.152:0/2824984617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4280 0x559c437b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af7fff640 1 -- 172.21.15.152:0/2824984617 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c4369c3a0 con 0x559c437b95d0 2024-09-11T22:19:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/2824984617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 0x559c437c0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:14.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af7fff640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0ae00a2d70 0x7f0ae00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af4ff9640 1 -- 172.21.15.152:0/4157937423 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f0ae80cf4f0 con 0x7f0af81091f0 2024-09-11T22:19:14.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0af7fff640 1 --2- 172.21.15.152:0/2824984617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437b99b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f0af0011470 tx=0x7f0af0011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c3e20be94e4007 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.969+0000 7f0addffb640 1 -- 172.21.15.152:0/2824984617 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0017070 con 0x559c437b95d0 2024-09-11T22:19:14.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.970+0000 7f0addffb640 1 -- 172.21.15.152:0/2824984617 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0af0003df0 con 0x559c437b95d0 2024-09-11T22:19:14.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.970+0000 7f0addffb640 1 -- 172.21.15.152:0/2824984617 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af001c430 con 0x559c437b95d0 2024-09-11T22:19:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.970+0000 7f0af7fff640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0ae00a2d70 0x7f0ae00a5230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0af0000f80 tx=0x7f0af001cac0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.970+0000 7f0b001ac740 1 -- 172.21.15.152:0/2824984617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 msgr2=0x559c437b99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.970+0000 7f0b001ac740 1 --2- 172.21.15.152:0/2824984617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437b99b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f0af0011470 tx=0x7f0af0011930 comp rx=0 tx=0).stop 2024-09-11T22:19:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.971+0000 7f0b001ac740 1 -- 172.21.15.152:0/2824984617 shutdown_connections 2024-09-11T22:19:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.971+0000 7f0b001ac740 1 --2- 172.21.15.152:0/2824984617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 0x559c437c0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.971+0000 7f0b001ac740 1 --2- 172.21.15.152:0/2824984617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4280 0x559c437b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.971+0000 7f0b001ac740 1 --2- 172.21.15.152:0/2824984617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437b99b0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.971+0000 7f0b001ac740 1 -- 172.21.15.152:0/2824984617 >> 172.21.15.152:0/2824984617 conn(0x559c43773310 msgr2=0x559c437a66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.971+0000 7f0b001ac740 1 -- 172.21.15.152:0/2824984617 shutdown_connections 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.971+0000 7f0b001ac740 1 -- 172.21.15.152:0/2824984617 wait complete. 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.971+0000 7f0b001ac740 1 -- start start 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.972+0000 7f0b001ac740 1 Processor -- start 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.972+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 0x559c437c01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.972+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 0x559c437bd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.972+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437bd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.972+0000 7f0b001ac740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559c437c08d0 con 0x559c437b95d0 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.972+0000 7f0b001ac740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559c436cb060 con 0x559c437b4c00 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.972+0000 7f0b001ac740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c437c0a50 con 0x559c437b4280 2024-09-11T22:19:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.972+0000 7f0b001ac740 10 client.0 _ll_register_callbacks cb 0x559c4341e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:14.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.973+0000 7f0af6ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 0x559c437bd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.973+0000 7f0af6ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 0x559c437bd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37188/0 (socket says 172.21.15.152:37188) 2024-09-11T22:19:14.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.973+0000 7f0af6ffd640 1 -- 172.21.15.152:0/934284862 learned_addr learned my addr 172.21.15.152:0/934284862 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.973+0000 7f0af7fff640 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437bd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.973+0000 7f0af77fe640 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 0x559c437c01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.973+0000 7f0af6ffd640 1 -- 172.21.15.152:0/934284862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 msgr2=0x559c437c01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.973+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 0x559c437c01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.973+0000 7f0af6ffd640 1 -- 172.21.15.152:0/934284862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 msgr2=0x559c437bd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.973+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437bd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.973+0000 7f0af6ffd640 1 -- 172.21.15.152:0/934284862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c434813c0 con 0x559c437b4c00 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.974+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 0x559c437bd470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0aec02a9a0 tx=0x7f0aec0319b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff94b9f87c2bc3a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.974+0000 7f0ad6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.974+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/934284862 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec035040 con 0x559c437b4c00 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.974+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/934284862 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f0aec004300 con 0x559c437b4c00 2024-09-11T22:19:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.974+0000 7f0b001ac740 1 -- 172.21.15.152:0/934284862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0af0003df0 con 0x559c437b4c00 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.974+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/934284862 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0aec005020 con 0x559c437b4c00 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.974+0000 7f0b001ac740 10 client.28340 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.974+0000 7f0b001ac740 1 -- 172.21.15.152:0/934284862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559c437cc2a0 con 0x559c437b4c00 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.975+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/934284862 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0af0003df0 con 0x559c437b4c00 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.975+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/934284862 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f0aec0035f0 con 0x559c437b4c00 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.975+0000 7f0b001ac740 10 client.28340 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.975+0000 7f0b001ac740 10 client.28340 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.975+0000 7f0b001ac740 20 client.28340 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.975+0000 7f0b001ac740 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c437cd760 0x559c437cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.975+0000 7f0b001ac740 4 client.28340 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.975+0000 7f0b001ac740 1 -- 172.21.15.152:0/934284862 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c4371d860 con 0x559c437cd760 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.975+0000 7f0af77fe640 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c437cd760 0x559c437cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.975+0000 7f0ad6ffd640 10 client.28340 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:19:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.975+0000 7f0af77fe640 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c437cd760 0x559c437cfb80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b098c6efb9f8d210 server_cookie=6d9845df19c7081f in_seq=0 out_seq=0 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.976+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/934284862 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c4371d860 con 0x559c437cd760 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.976+0000 7f0ad6ffd640 10 client.28340 handle_command_reply: tid=0 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.976+0000 7f0b001ac740 1 client.28340 shutdown 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.976+0000 7f0b001ac740 1 -- 172.21.15.152:0/934284862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 msgr2=0x559c437bd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.976+0000 7f0b001ac740 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 0x559c437bd470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0aec02a9a0 tx=0x7f0aec0319b0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.977+0000 7f0b001ac740 1 -- 172.21.15.152:0/934284862 shutdown_connections 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.977+0000 7f0b001ac740 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c437cd760 0x559c437cfb80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.977+0000 7f0ad6ffd640 0 client.28340 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.977+0000 7f0b001ac740 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437bd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.977+0000 7f0b001ac740 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 0x559c437bd470 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.977+0000 7f0b001ac740 1 --2- 172.21.15.152:0/934284862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 0x559c437c01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.977+0000 7f0b001ac740 1 -- 172.21.15.152:0/934284862 >> 172.21.15.152:0/934284862 conn(0x559c43773310 msgr2=0x559c437b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:14.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.978+0000 7f0b001ac740 1 -- 172.21.15.152:0/934284862 shutdown_connections 2024-09-11T22:19:14.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.978+0000 7f0b001ac740 1 -- 172.21.15.152:0/934284862 wait complete. 2024-09-11T22:19:14.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.978+0000 7f0b001ac740 20 client.28340 trim_cache size 0 max 16384 2024-09-11T22:19:14.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.997+0000 7f0b001ac740 1 Processor -- start 2024-09-11T22:19:14.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.997+0000 7f0b001ac740 1 -- start start 2024-09-11T22:19:14.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4280 0x559c437c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 0x559c437b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0b001ac740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0af81b69f0 con 0x559c437b95d0 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0af77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4280 0x559c437c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0af6ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 0x559c437b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0af77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4280 0x559c437c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37196/0 (socket says 172.21.15.152:37196) 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0af77fe640 1 -- 172.21.15.152:0/1277704768 learned_addr learned my addr 172.21.15.152:0/1277704768 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0af7fff640 1 --2- 172.21.15.152:0/1277704768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0b001ac740 1 -- 172.21.15.152:0/1277704768 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0af81b42c0 con 0x559c437b4280 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0b001ac740 1 -- 172.21.15.152:0/1277704768 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0af81b2130 con 0x559c437b4c00 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0af6ffd640 1 -- 172.21.15.152:0/1277704768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4280 msgr2=0x559c437c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/1277704768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4280 0x559c437c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0af6ffd640 1 -- 172.21.15.152:0/1277704768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 msgr2=0x559c437b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:15.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/1277704768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.998+0000 7f0af6ffd640 1 -- 172.21.15.152:0/1277704768 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c437c07a0 con 0x559c437b4c00 2024-09-11T22:19:15.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.999+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/1277704768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 0x559c437b72a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009900 tx=0x7f0aec02a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31d1b903384cba44 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:15.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.999+0000 7f0add7fa640 1 -- 172.21.15.152:0/1277704768 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec035030 con 0x559c437b4c00 2024-09-11T22:19:15.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.999+0000 7f0add7fa640 1 -- 172.21.15.152:0/1277704768 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aec0051c0 con 0x559c437b4c00 2024-09-11T22:19:15.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:14.999+0000 7f0add7fa640 1 -- 172.21.15.152:0/1277704768 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec004900 con 0x559c437b4c00 2024-09-11T22:19:15.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.000+0000 7f0b001ac740 1 -- 172.21.15.152:0/1277704768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 msgr2=0x559c437b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:15.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.000+0000 7f0b001ac740 1 --2- 172.21.15.152:0/1277704768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 0x559c437b72a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009900 tx=0x7f0aec02a480 comp rx=0 tx=0).stop 2024-09-11T22:19:15.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.000+0000 7f0b001ac740 1 -- 172.21.15.152:0/1277704768 shutdown_connections 2024-09-11T22:19:15.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.000+0000 7f0b001ac740 1 --2- 172.21.15.152:0/1277704768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.000+0000 7f0b001ac740 1 --2- 172.21.15.152:0/1277704768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4c00 0x559c437b72a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.000+0000 7f0b001ac740 1 --2- 172.21.15.152:0/1277704768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4280 0x559c437c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.000+0000 7f0b001ac740 1 -- 172.21.15.152:0/1277704768 >> 172.21.15.152:0/1277704768 conn(0x559c43773310 msgr2=0x559c437b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.000+0000 7f0b001ac740 1 -- 172.21.15.152:0/1277704768 shutdown_connections 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.000+0000 7f0b001ac740 1 -- 172.21.15.152:0/1277704768 wait complete. 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.000+0000 7f0b001ac740 1 -- start start 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.000+0000 7f0b001ac740 1 Processor -- start 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 0x559c437c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 0x559c437c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0b001ac740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0b001ac740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0af81b2780 con 0x559c437b95d0 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0b001ac740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0af81b3bf0 con 0x559c437b4c00 2024-09-11T22:19:15.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0b001ac740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0af81b2e50 con 0x559c437b4280 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0b001ac740 10 client.0 _ll_register_callbacks cb 0x7f0aec009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0af77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 0x559c437c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0af77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 0x559c437c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52444/0 (socket says 172.21.15.152:52444) 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0af77fe640 1 -- 172.21.15.152:0/250704916 learned_addr learned my addr 172.21.15.152:0/250704916 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 0x559c437c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0af77fe640 1 -- 172.21.15.152:0/250704916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 msgr2=0x559c437c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0af77fe640 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 0x559c437c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0af77fe640 1 -- 172.21.15.152:0/250704916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 msgr2=0x559c437c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0af77fe640 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0af77fe640 1 -- 172.21.15.152:0/250704916 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c437bdd40 con 0x559c437b4280 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0af77fe640 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 0x559c437c5ca0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8007590 tx=0x7f0ae80054a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fd5d86c0192740 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.001+0000 7f0ad6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.002+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/250704916 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae801d040 con 0x559c437b4280 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.002+0000 7f0b001ac740 1 -- 172.21.15.152:0/250704916 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aec0051c0 con 0x559c437b4280 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.002+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/250704916 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f0ae8098040 con 0x559c437b4280 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.002+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/250704916 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0ae809fcd0 con 0x559c437b4280 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.002+0000 7f0b001ac740 10 client.28492 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.002+0000 7f0b001ac740 1 -- 172.21.15.152:0/250704916 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559c43838950 con 0x559c437b4280 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.002+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/250704916 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aec0051c0 con 0x559c437b4280 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.002+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/250704916 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f0ae80a4100 con 0x559c437b4280 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.003+0000 7f0b001ac740 10 client.28492 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.003+0000 7f0b001ac740 10 client.28492 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.003+0000 7f0b001ac740 20 client.28492 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.003+0000 7f0b001ac740 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c437cd760 0x559c4383b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:15.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.003+0000 7f0b001ac740 4 client.28492 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:19:15.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.003+0000 7f0b001ac740 1 -- 172.21.15.152:0/250704916 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c43717d70 con 0x559c437cd760 2024-09-11T22:19:15.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.003+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c437cd760 0x559c4383b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:15.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0af6ffd640 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c437cd760 0x559c4383b130 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=14667e93d866a95c server_cookie=41d4a58ad82f03a8 in_seq=0 out_seq=0 2024-09-11T22:19:15.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0ad6ffd640 10 client.28492 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:19:15.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0ad6ffd640 1 -- 172.21.15.152:0/250704916 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c43717d70 con 0x559c437cd760 2024-09-11T22:19:15.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0ad6ffd640 10 client.28492 handle_command_reply: tid=0 2024-09-11T22:19:15.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0b001ac740 1 client.28492 shutdown 2024-09-11T22:19:15.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0b001ac740 1 -- 172.21.15.152:0/250704916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 msgr2=0x559c437c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:15.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0b001ac740 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 0x559c437c5ca0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8007590 tx=0x7f0ae80054a0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0b001ac740 1 -- 172.21.15.152:0/250704916 shutdown_connections 2024-09-11T22:19:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0b001ac740 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x559c437cd760 0x559c4383b130 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0b001ac740 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c437b95d0 0x559c437c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0b001ac740 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559c437b4c00 0x559c437c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0ad6ffd640 0 client.28492 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:19:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0b001ac740 1 --2- 172.21.15.152:0/250704916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c437b4280 0x559c437c5ca0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.004+0000 7f0b001ac740 1 -- 172.21.15.152:0/250704916 >> 172.21.15.152:0/250704916 conn(0x559c43773310 msgr2=0x559c437a54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0b001ac740 1 -- 172.21.15.152:0/250704916 shutdown_connections 2024-09-11T22:19:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0b001ac740 1 -- 172.21.15.152:0/250704916 wait complete. 2024-09-11T22:19:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0b001ac740 20 client.28492 trim_cache size 0 max 16384 2024-09-11T22:19:15.010 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:19:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0afddd3640 1 -- 172.21.15.152:0/4157937423 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0ae00a2d70 msgr2=0x7f0ae00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0afddd3640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0ae00a2d70 0x7f0ae00a5230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0af0000f80 tx=0x7f0af001cac0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0afddd3640 1 -- 172.21.15.152:0/4157937423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0af81091f0 msgr2=0x7f0af81a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0afddd3640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0af81091f0 0x7f0af81a0d70 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800c890 tx=0x7f0ae800cd50 comp rx=0 tx=0).stop 2024-09-11T22:19:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0afddd3640 1 -- 172.21.15.152:0/4157937423 shutdown_connections 2024-09-11T22:19:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0afddd3640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0ae00a2d70 0x7f0ae00a5230 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0afddd3640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af8114ab0 0x7f0af81a5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0afddd3640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8109b10 0x7f0af81a12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0afddd3640 1 --2- 172.21.15.152:0/4157937423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0af81091f0 0x7f0af81a0d70 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.005+0000 7f0afddd3640 1 -- 172.21.15.152:0/4157937423 >> 172.21.15.152:0/4157937423 conn(0x7f0af806e140 msgr2=0x7f0af8070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.006+0000 7f0afddd3640 1 -- 172.21.15.152:0/4157937423 shutdown_connections 2024-09-11T22:19:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:15.006+0000 7f0afddd3640 1 -- 172.21.15.152:0/4157937423 wait complete. 2024-09-11T22:19:15.728 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:19:15.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:15 smithi152 ceph-mon[31188]: pgmap v469: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 26 MiB/s wr, 1.71k op/s 2024-09-11T22:19:16.049 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:15 smithi179 ceph-mon[35603]: pgmap v469: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 26 MiB/s wr, 1.71k op/s 2024-09-11T22:19:16.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:15 smithi193 ceph-mon[35545]: pgmap v469: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 26 MiB/s wr, 1.71k op/s 2024-09-11T22:19:16.099 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:19:16.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.689+0000 7f026f3ef640 1 -- 172.21.15.152:0/3205979844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0268102ef0 msgr2=0x7f026810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:16.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.689+0000 7f026f3ef640 1 --2- 172.21.15.152:0/3205979844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0268102ef0 0x7f026810da40 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f0260009ca0 tx=0x7f026002a950 comp rx=0 tx=0).stop 2024-09-11T22:19:16.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.690+0000 7f026f3ef640 1 -- 172.21.15.152:0/3205979844 shutdown_connections 2024-09-11T22:19:16.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.690+0000 7f026f3ef640 1 --2- 172.21.15.152:0/3205979844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0268102ef0 0x7f026810da40 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.690+0000 7f026f3ef640 1 --2- 172.21.15.152:0/3205979844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268102570 0x7f02681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.690+0000 7f026f3ef640 1 --2- 172.21.15.152:0/3205979844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268100e20 0x7f0268101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.690+0000 7f026f3ef640 1 -- 172.21.15.152:0/3205979844 >> 172.21.15.152:0/3205979844 conn(0x7f02680fc7d0 msgr2=0x7f02680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.691+0000 7f026f3ef640 1 -- 172.21.15.152:0/3205979844 shutdown_connections 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.691+0000 7f026f3ef640 1 -- 172.21.15.152:0/3205979844 wait complete. 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026f3ef640 1 Processor -- start 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026f3ef640 1 -- start start 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026f3ef640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268100e20 0x7f02681992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026f3ef640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268102570 0x7f0268199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026f3ef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0268102ef0 0x7f02681a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026f3ef640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0268110f80 con 0x7f0268102ef0 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026f3ef640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0268110e00 con 0x7f0268102570 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026f3ef640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0268111100 con 0x7f0268100e20 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026c98a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268102570 0x7f0268199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026d98c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0268102ef0 0x7f02681a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026d98c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0268102ef0 0x7f02681a4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51514/0 (socket says 172.21.15.152:51514) 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026d18b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268100e20 0x7f02681992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026c98a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268102570 0x7f0268199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37232/0 (socket says 172.21.15.152:37232) 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.692+0000 7f026d98c640 1 -- 172.21.15.152:0/2000509420 learned_addr learned my addr 172.21.15.152:0/2000509420 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f026d18b640 1 -- 172.21.15.152:0/2000509420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268102570 msgr2=0x7f0268199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f026d18b640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268102570 0x7f0268199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f026d18b640 1 -- 172.21.15.152:0/2000509420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0268102ef0 msgr2=0x7f02681a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f026d18b640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0268102ef0 0x7f02681a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f026d18b640 1 -- 172.21.15.152:0/2000509420 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02681a48b0 con 0x7f0268100e20 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f026d98c640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0268102ef0 0x7f02681a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f026c98a640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268102570 0x7f0268199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:16.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f026d18b640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268100e20 0x7f02681992f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f026400e9f0 tx=0x7f026400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:16.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f025e7fc640 1 -- 172.21.15.152:0/2000509420 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026400ccc0 con 0x7f0268100e20 2024-09-11T22:19:16.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f026f3ef640 1 -- 172.21.15.152:0/2000509420 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02681970e0 con 0x7f0268100e20 2024-09-11T22:19:16.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f025e7fc640 1 -- 172.21.15.152:0/2000509420 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0264010910 con 0x7f0268100e20 2024-09-11T22:19:16.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f025e7fc640 1 -- 172.21.15.152:0/2000509420 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264018960 con 0x7f0268100e20 2024-09-11T22:19:16.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.693+0000 7f026f3ef640 1 -- 172.21.15.152:0/2000509420 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0268197620 con 0x7f0268100e20 2024-09-11T22:19:16.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.696+0000 7f02717c8740 1 Processor -- start 2024-09-11T22:19:16.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.696+0000 7f025e7fc640 1 -- 172.21.15.152:0/2000509420 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0264018b00 con 0x7f0268100e20 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.696+0000 7f02717c8740 1 -- start start 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f02717c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e3933090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f02717c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e3933a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f02717c8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3946b80 0x55d0e3948f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f02717c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d0e38992f0 con 0x55d0e3934b40 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f02717c8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d0e3840cf0 con 0x55d0e3946b80 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f02717c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d0e38952b0 con 0x55d0e39335d0 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f026d98c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e3933090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f026d98c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e3933090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51530/0 (socket says 172.21.15.152:51530) 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f026d98c640 1 -- 172.21.15.152:0/335424855 learned_addr learned my addr 172.21.15.152:0/335424855 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f026d18b640 1 --2- 172.21.15.152:0/335424855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e3933a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f026c98a640 1 --2- 172.21.15.152:0/335424855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3946b80 0x55d0e3948f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f026d98c640 1 -- 172.21.15.152:0/335424855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 msgr2=0x55d0e3933a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f026d98c640 1 --2- 172.21.15.152:0/335424855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e3933a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f026d98c640 1 -- 172.21.15.152:0/335424855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3946b80 msgr2=0x55d0e3948f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f026d98c640 1 --2- 172.21.15.152:0/335424855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3946b80 0x55d0e3948f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.697+0000 7f026d98c640 1 -- 172.21.15.152:0/335424855 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0e38253a0 con 0x55d0e3934b40 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.698+0000 7f026d98c640 1 --2- 172.21.15.152:0/335424855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e3933090 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f0260009400 tx=0x7f026002fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4086e9a3b421c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.698+0000 7f025e7fc640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02540a2cf0 0x7f02540a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.698+0000 7f02537fe640 1 -- 172.21.15.152:0/335424855 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260048070 con 0x55d0e3934b40 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.698+0000 7f026d18b640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02540a2cf0 0x7f02540a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.698+0000 7f02537fe640 1 -- 172.21.15.152:0/335424855 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0260003970 con 0x55d0e3934b40 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.698+0000 7f02537fe640 1 -- 172.21.15.152:0/335424855 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260034040 con 0x55d0e3934b40 2024-09-11T22:19:16.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.698+0000 7f025e7fc640 1 -- 172.21.15.152:0/2000509420 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f02640cf8e0 con 0x7f0268100e20 2024-09-11T22:19:16.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f02717c8740 1 -- 172.21.15.152:0/335424855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 msgr2=0x55d0e3933090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:16.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f026d18b640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02540a2cf0 0x7f02540a51b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55d0e3930ac0 tx=0x7f02640d5260 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:16.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f02717c8740 1 --2- 172.21.15.152:0/335424855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e3933090 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f0260009400 tx=0x7f026002fe00 comp rx=0 tx=0).stop 2024-09-11T22:19:16.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f02717c8740 1 -- 172.21.15.152:0/335424855 shutdown_connections 2024-09-11T22:19:16.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f02717c8740 1 --2- 172.21.15.152:0/335424855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3946b80 0x55d0e3948f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f02717c8740 1 --2- 172.21.15.152:0/335424855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e3933a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f02717c8740 1 --2- 172.21.15.152:0/335424855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e3933090 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f02717c8740 1 -- 172.21.15.152:0/335424855 >> 172.21.15.152:0/335424855 conn(0x55d0e38fc310 msgr2=0x55d0e392fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:16.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f02717c8740 1 -- 172.21.15.152:0/335424855 shutdown_connections 2024-09-11T22:19:16.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f02717c8740 1 -- 172.21.15.152:0/335424855 wait complete. 2024-09-11T22:19:16.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f02717c8740 1 -- start start 2024-09-11T22:19:16.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.699+0000 7f02717c8740 1 Processor -- start 2024-09-11T22:19:16.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f02717c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e39465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f02717c8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 0x55d0e3943870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f02717c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3946b80 0x55d0e3944000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f02717c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d0e3949820 con 0x55d0e3946b80 2024-09-11T22:19:16.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f02717c8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d0e3854060 con 0x55d0e3934b40 2024-09-11T22:19:16.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f02717c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d0e39499a0 con 0x55d0e39335d0 2024-09-11T22:19:16.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f026c98a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 0x55d0e3943870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f026d98c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e39465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f026c98a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 0x55d0e3943870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37252/0 (socket says 172.21.15.152:37252) 2024-09-11T22:19:16.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f026d98c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e39465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52478/0 (socket says 172.21.15.152:52478) 2024-09-11T22:19:16.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f026c98a640 1 -- 172.21.15.152:0/4034889804 learned_addr learned my addr 172.21.15.152:0/4034889804 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:16.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f02717c8740 10 client.0 _ll_register_callbacks cb 0x55d0e35a78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:16.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f026d98c640 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3946b80 0x55d0e3944000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f026c98a640 1 -- 172.21.15.152:0/4034889804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 msgr2=0x55d0e39465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:16.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f026c98a640 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e39465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f026c98a640 1 -- 172.21.15.152:0/4034889804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3946b80 msgr2=0x55d0e3944000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:16.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f026c98a640 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3946b80 0x55d0e3944000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.700+0000 7f026c98a640 1 -- 172.21.15.152:0/4034889804 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0e360a3c0 con 0x55d0e3934b40 2024-09-11T22:19:16.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.701+0000 7f026c98a640 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 0x55d0e3943870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0258009e70 tx=0x7f025800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d9b58b28d4da9f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:16.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.701+0000 7f0250ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:19:16.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.701+0000 7f0250ff9640 1 -- 172.21.15.152:0/4034889804 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258020020 con 0x55d0e3934b40 2024-09-11T22:19:16.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.701+0000 7f02717c8740 1 -- 172.21.15.152:0/4034889804 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0260003970 con 0x55d0e3934b40 2024-09-11T22:19:16.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.701+0000 7f0250ff9640 1 -- 172.21.15.152:0/4034889804 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f0258005220 con 0x55d0e3934b40 2024-09-11T22:19:16.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.702+0000 7f0250ff9640 1 -- 172.21.15.152:0/4034889804 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0258028050 con 0x55d0e3934b40 2024-09-11T22:19:16.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.704+0000 7f02717c8740 10 client.28358 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:16.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.704+0000 7f02717c8740 1 -- 172.21.15.152:0/4034889804 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0e39553a0 con 0x55d0e3934b40 2024-09-11T22:19:16.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.704+0000 7f0250ff9640 1 -- 172.21.15.152:0/4034889804 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0260003970 con 0x55d0e3934b40 2024-09-11T22:19:16.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.704+0000 7f0250ff9640 1 -- 172.21.15.152:0/4034889804 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f025801c490 con 0x55d0e3934b40 2024-09-11T22:19:16.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.704+0000 7f02717c8740 10 client.28358 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:16.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.704+0000 7f02717c8740 10 client.28358 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:19:16.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.704+0000 7f02717c8740 20 client.28358 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:16.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.704+0000 7f02717c8740 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d0e3956850 0x55d0e3958c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.704+0000 7f02717c8740 4 client.28358 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:16.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.704+0000 7f02717c8740 1 -- 172.21.15.152:0/4034889804 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0e38a6860 con 0x55d0e3956850 2024-09-11T22:19:16.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.705+0000 7f026d98c640 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d0e3956850 0x55d0e3958c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.705+0000 7f0250ff9640 10 client.28358 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:19:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.705+0000 7f026d98c640 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d0e3956850 0x55d0e3958c70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=46d11225f4ba0039 server_cookie=aeb68c09ea715ff in_seq=0 out_seq=0 2024-09-11T22:19:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f0250ff9640 1 -- 172.21.15.152:0/4034889804 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0e38a6860 con 0x55d0e3956850 2024-09-11T22:19:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f0250ff9640 10 client.28358 handle_command_reply: tid=0 2024-09-11T22:19:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 1 client.28358 shutdown 2024-09-11T22:19:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 1 -- 172.21.15.152:0/4034889804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 msgr2=0x55d0e3943870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 0x55d0e3943870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0258009e70 tx=0x7f025800e720 comp rx=0 tx=0).stop 2024-09-11T22:19:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 1 -- 172.21.15.152:0/4034889804 shutdown_connections 2024-09-11T22:19:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d0e3956850 0x55d0e3958c70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3946b80 0x55d0e3944000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 0x55d0e3943870 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 1 --2- 172.21.15.152:0/4034889804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e39465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f0250ff9640 0 client.28358 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:19:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 1 -- 172.21.15.152:0/4034889804 >> 172.21.15.152:0/4034889804 conn(0x55d0e38fc310 msgr2=0x55d0e3935960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 1 -- 172.21.15.152:0/4034889804 shutdown_connections 2024-09-11T22:19:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 1 -- 172.21.15.152:0/4034889804 wait complete. 2024-09-11T22:19:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.706+0000 7f02717c8740 20 client.28358 trim_cache size 0 max 16384 2024-09-11T22:19:16.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.723+0000 7f02717c8740 1 Processor -- start 2024-09-11T22:19:16.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.723+0000 7f02717c8740 1 -- start start 2024-09-11T22:19:16.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.723+0000 7f02717c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e395e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.723+0000 7f02717c8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 0x55d0e395ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.723+0000 7f02717c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3946b80 0x55d0e3940ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.723+0000 7f02717c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f02681ae130 con 0x55d0e3946b80 2024-09-11T22:19:16.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.723+0000 7f02717c8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f02681aba00 con 0x55d0e3934b40 2024-09-11T22:19:16.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.723+0000 7f02717c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f02681a9870 con 0x55d0e39335d0 2024-09-11T22:19:16.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.724+0000 7f026d98c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e395e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.724+0000 7f026d98c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e395e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52482/0 (socket says 172.21.15.152:52482) 2024-09-11T22:19:16.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.724+0000 7f026d98c640 1 -- 172.21.15.152:0/2375242555 learned_addr learned my addr 172.21.15.152:0/2375242555 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:16.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.724+0000 7f026d98c640 1 --2- 172.21.15.152:0/2375242555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3946b80 0x55d0e3940ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.724+0000 7f026c98a640 1 --2- 172.21.15.152:0/2375242555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 0x55d0e395ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.724+0000 7f026d98c640 1 -- 172.21.15.152:0/2375242555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 msgr2=0x55d0e395ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:16.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.724+0000 7f026d98c640 1 --2- 172.21.15.152:0/2375242555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 0x55d0e395ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.724+0000 7f026d98c640 1 -- 172.21.15.152:0/2375242555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3946b80 msgr2=0x55d0e3940ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:16.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.724+0000 7f026d98c640 1 --2- 172.21.15.152:0/2375242555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3946b80 0x55d0e3940ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.724+0000 7f026d98c640 1 -- 172.21.15.152:0/2375242555 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0e39445e0 con 0x55d0e39335d0 2024-09-11T22:19:16.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.725+0000 7f026d98c640 1 --2- 172.21.15.152:0/2375242555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e395e540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0260002230 tx=0x7f026003d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4183110c819d9ce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:16.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.725+0000 7f0252ffd640 1 -- 172.21.15.152:0/2375242555 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260048070 con 0x55d0e39335d0 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.725+0000 7f0252ffd640 1 -- 172.21.15.152:0/2375242555 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0260049040 con 0x55d0e39335d0 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.725+0000 7f0252ffd640 1 -- 172.21.15.152:0/2375242555 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260034040 con 0x55d0e39335d0 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.726+0000 7f02717c8740 1 -- 172.21.15.152:0/2375242555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 msgr2=0x55d0e395e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.726+0000 7f02717c8740 1 --2- 172.21.15.152:0/2375242555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e395e540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0260002230 tx=0x7f026003d040 comp rx=0 tx=0).stop 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.726+0000 7f02717c8740 1 -- 172.21.15.152:0/2375242555 shutdown_connections 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.726+0000 7f02717c8740 1 --2- 172.21.15.152:0/2375242555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3946b80 0x55d0e3940ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.726+0000 7f02717c8740 1 --2- 172.21.15.152:0/2375242555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3934b40 0x55d0e395ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.726+0000 7f02717c8740 1 --2- 172.21.15.152:0/2375242555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e395e540 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.726+0000 7f02717c8740 1 -- 172.21.15.152:0/2375242555 >> 172.21.15.152:0/2375242555 conn(0x55d0e38fc310 msgr2=0x55d0e3942960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.726+0000 7f02717c8740 1 -- 172.21.15.152:0/2375242555 shutdown_connections 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.726+0000 7f02717c8740 1 -- 172.21.15.152:0/2375242555 wait complete. 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.726+0000 7f02717c8740 1 -- start start 2024-09-11T22:19:16.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f02717c8740 1 Processor -- start 2024-09-11T22:19:16.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f02717c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e394ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f02717c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e394b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f02717c8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3946b80 0x55d0e39c0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f02717c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f02681a9ec0 con 0x55d0e3934b40 2024-09-11T22:19:16.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f02717c8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f02681ab330 con 0x55d0e3946b80 2024-09-11T22:19:16.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f02717c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f02681aa590 con 0x55d0e39335d0 2024-09-11T22:19:16.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f02717c8740 10 client.0 _ll_register_callbacks cb 0x7f02580103d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:16.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f026c98a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e394b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f026d98c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e394ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f026c98a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e394b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51556/0 (socket says 172.21.15.152:51556) 2024-09-11T22:19:16.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.727+0000 7f026c98a640 1 -- 172.21.15.152:0/1611622888 learned_addr learned my addr 172.21.15.152:0/1611622888 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:16.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.728+0000 7f026d98c640 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3946b80 0x55d0e39c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.728+0000 7f026d98c640 1 -- 172.21.15.152:0/1611622888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3946b80 msgr2=0x55d0e39c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.728+0000 7f026d98c640 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3946b80 0x55d0e39c0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.728+0000 7f026d98c640 1 -- 172.21.15.152:0/1611622888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 msgr2=0x55d0e394b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.728+0000 7f026d98c640 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e394b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.728+0000 7f026d98c640 1 -- 172.21.15.152:0/1611622888 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0e39c0a50 con 0x55d0e39335d0 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.728+0000 7f026c98a640 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e394b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.728+0000 7f026d98c640 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e394ada0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0260000f80 tx=0x7f0260009860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ced179bd79dc8de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.728+0000 7f0250ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.728+0000 7f0250ff9640 1 -- 172.21.15.152:0/1611622888 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260048030 con 0x55d0e39335d0 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f0250ff9640 1 -- 172.21.15.152:0/1611622888 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f0260003970 con 0x55d0e39335d0 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f02717c8740 1 -- 172.21.15.152:0/1611622888 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0260049040 con 0x55d0e39335d0 2024-09-11T22:19:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f0250ff9640 1 -- 172.21.15.152:0/1611622888 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0260034040 con 0x55d0e39335d0 2024-09-11T22:19:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f02717c8740 10 client.28510 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f02717c8740 1 -- 172.21.15.152:0/1611622888 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0e39c1c10 con 0x55d0e39335d0 2024-09-11T22:19:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f0250ff9640 1 -- 172.21.15.152:0/1611622888 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0260049040 con 0x55d0e39335d0 2024-09-11T22:19:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f0250ff9640 1 -- 172.21.15.152:0/1611622888 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f026004e040 con 0x55d0e39335d0 2024-09-11T22:19:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f02717c8740 10 client.28510 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f02717c8740 10 client.28510 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:19:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f02717c8740 20 client.28510 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f02717c8740 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d0e39c1e40 0x55d0e39c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f02717c8740 4 client.28510 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:19:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.729+0000 7f02717c8740 1 -- 172.21.15.152:0/1611622888 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0e38a0d70 con 0x55d0e39c1e40 2024-09-11T22:19:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f026c98a640 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d0e39c1e40 0x55d0e39c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f0250ff9640 10 client.28510 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:19:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f026c98a640 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d0e39c1e40 0x55d0e39c4230 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=94a24d1a0460fb85 server_cookie=3624b176ed6bec3c in_seq=0 out_seq=0 2024-09-11T22:19:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f0250ff9640 1 -- 172.21.15.152:0/1611622888 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0e38a0d70 con 0x55d0e39c1e40 2024-09-11T22:19:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f0250ff9640 10 client.28510 handle_command_reply: tid=0 2024-09-11T22:19:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f02717c8740 1 client.28510 shutdown 2024-09-11T22:19:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f02717c8740 1 -- 172.21.15.152:0/1611622888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 msgr2=0x55d0e394ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f02717c8740 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e394ada0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0260000f80 tx=0x7f0260009860 comp rx=0 tx=0).stop 2024-09-11T22:19:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f02717c8740 1 -- 172.21.15.152:0/1611622888 shutdown_connections 2024-09-11T22:19:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f02717c8740 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55d0e39c1e40 0x55d0e39c4230 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f02717c8740 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0e3946b80 0x55d0e39c0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f02717c8740 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0e3934b40 0x55d0e394b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f02717c8740 1 --2- 172.21.15.152:0/1611622888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0e39335d0 0x55d0e394ada0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f02717c8740 1 -- 172.21.15.152:0/1611622888 >> 172.21.15.152:0/1611622888 conn(0x55d0e38fc310 msgr2=0x55d0e39450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.730+0000 7f0250ff9640 0 client.28510 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:19:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f02717c8740 1 -- 172.21.15.152:0/1611622888 shutdown_connections 2024-09-11T22:19:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f02717c8740 1 -- 172.21.15.152:0/1611622888 wait complete. 2024-09-11T22:19:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f02717c8740 20 client.28510 trim_cache size 0 max 16384 2024-09-11T22:19:16.739 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:19:16.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f026f3ef640 1 -- 172.21.15.152:0/2000509420 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02540a2cf0 msgr2=0x7f02540a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:16.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f026f3ef640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02540a2cf0 0x7f02540a51b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55d0e3930ac0 tx=0x7f02640d5260 comp rx=0 tx=0).stop 2024-09-11T22:19:16.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f026f3ef640 1 -- 172.21.15.152:0/2000509420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268100e20 msgr2=0x7f02681992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:16.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f026f3ef640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268100e20 0x7f02681992f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f026400e9f0 tx=0x7f026400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f026f3ef640 1 -- 172.21.15.152:0/2000509420 shutdown_connections 2024-09-11T22:19:16.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f026f3ef640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f02540a2cf0 0x7f02540a51b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f026f3ef640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0268102ef0 0x7f02681a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f026f3ef640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268102570 0x7f0268199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f026f3ef640 1 --2- 172.21.15.152:0/2000509420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268100e20 0x7f02681992f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:16.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f026f3ef640 1 -- 172.21.15.152:0/2000509420 >> 172.21.15.152:0/2000509420 conn(0x7f02680fc7d0 msgr2=0x7f0268106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:16.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.731+0000 7f026f3ef640 1 -- 172.21.15.152:0/2000509420 shutdown_connections 2024-09-11T22:19:16.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:16.732+0000 7f026f3ef640 1 -- 172.21.15.152:0/2000509420 wait complete. 2024-09-11T22:19:17.705 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:19:17.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:17 smithi152 ceph-mon[31188]: pgmap v470: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 26 MiB/s wr, 1.71k op/s 2024-09-11T22:19:18.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:17 smithi179 ceph-mon[35603]: pgmap v470: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 26 MiB/s wr, 1.71k op/s 2024-09-11T22:19:18.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:17 smithi193 ceph-mon[35545]: pgmap v470: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 26 MiB/s wr, 1.71k op/s 2024-09-11T22:19:18.118 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:19:18.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.632+0000 7f1a970a1640 1 -- 172.21.15.152:0/257866624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a90106a90 msgr2=0x7f1a90106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:18.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.632+0000 7f1a970a1640 1 --2- 172.21.15.152:0/257866624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a90106a90 0x7f1a90106e70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009900 tx=0x7f1a8002a3f0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.632+0000 7f1a970a1640 1 -- 172.21.15.152:0/257866624 shutdown_connections 2024-09-11T22:19:18.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.632+0000 7f1a970a1640 1 --2- 172.21.15.152:0/257866624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a90101430 0x7f1a9006a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.632+0000 7f1a970a1640 1 --2- 172.21.15.152:0/257866624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a90100a90 0x7f1a90100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.632+0000 7f1a970a1640 1 --2- 172.21.15.152:0/257866624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a90106a90 0x7f1a90106e70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.632+0000 7f1a970a1640 1 -- 172.21.15.152:0/257866624 >> 172.21.15.152:0/257866624 conn(0x7f1a900fc7d0 msgr2=0x7f1a900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:18.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.633+0000 7f1a970a1640 1 -- 172.21.15.152:0/257866624 shutdown_connections 2024-09-11T22:19:18.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.633+0000 7f1a970a1640 1 -- 172.21.15.152:0/257866624 wait complete. 2024-09-11T22:19:18.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.633+0000 7f1a970a1640 1 Processor -- start 2024-09-11T22:19:18.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a970a1640 1 -- start start 2024-09-11T22:19:18.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a970a1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a90100a90 0x7f1a9019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a970a1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a90101430 0x7f1a9019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a970a1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a90106a90 0x7f1a9019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a970a1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901141f0 con 0x7f1a90106a90 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a970a1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1a90114070 con 0x7f1a90100a90 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a970a1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1a90114370 con 0x7f1a90101430 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a9563e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a90106a90 0x7f1a9019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a9563e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a90106a90 0x7f1a9019ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51582/0 (socket says 172.21.15.152:51582) 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a94e3d640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a90100a90 0x7f1a9019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a9563e640 1 -- 172.21.15.152:0/2002294383 learned_addr learned my addr 172.21.15.152:0/2002294383 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.634+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a90101430 0x7f1a9019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.635+0000 7f1a94e3d640 1 -- 172.21.15.152:0/2002294383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a90101430 msgr2=0x7f1a9019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.635+0000 7f1a94e3d640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a90101430 0x7f1a9019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.635+0000 7f1a94e3d640 1 -- 172.21.15.152:0/2002294383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a90106a90 msgr2=0x7f1a9019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:18.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.635+0000 7f1a94e3d640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a90106a90 0x7f1a9019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.635+0000 7f1a94e3d640 1 -- 172.21.15.152:0/2002294383 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9019f620 con 0x7f1a90100a90 2024-09-11T22:19:18.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.635+0000 7f1a94e3d640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a90100a90 0x7f1a9019a670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1a80005940 tx=0x7f1a80004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:18.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.635+0000 7f1a8dffb640 1 -- 172.21.15.152:0/2002294383 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8003f030 con 0x7f1a90100a90 2024-09-11T22:19:18.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.635+0000 7f1a8dffb640 1 -- 172.21.15.152:0/2002294383 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a80003ad0 con 0x7f1a90100a90 2024-09-11T22:19:18.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.635+0000 7f1a970a1640 1 -- 172.21.15.152:0/2002294383 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9019f8b0 con 0x7f1a90100a90 2024-09-11T22:19:18.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.635+0000 7f1a8dffb640 1 -- 172.21.15.152:0/2002294383 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a80035070 con 0x7f1a90100a90 2024-09-11T22:19:18.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.635+0000 7f1a970a1640 1 -- 172.21.15.152:0/2002294383 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a901a71f0 con 0x7f1a90100a90 2024-09-11T22:19:18.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.638+0000 7f1a8dffb640 1 -- 172.21.15.152:0/2002294383 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f1a80042030 con 0x7f1a90100a90 2024-09-11T22:19:18.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.639+0000 7f1a9947a740 1 Processor -- start 2024-09-11T22:19:18.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.639+0000 7f1a9947a740 1 -- start start 2024-09-11T22:19:18.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.639+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf16b40 0x55b6cdf15090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.639+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf155d0 0x55b6cdf15a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.639+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 0x55b6cdf22760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a9947a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b6cde7b2f0 con 0x55b6cdf155d0 2024-09-11T22:19:18.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a9947a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b6cde22cf0 con 0x55b6cdf20370 2024-09-11T22:19:18.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a9947a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b6cde772b0 con 0x55b6cdf16b40 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 0x55b6cdf22760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 0x55b6cdf22760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37282/0 (socket says 172.21.15.152:37282) 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a8ffff640 1 -- 172.21.15.152:0/944007140 learned_addr learned my addr 172.21.15.152:0/944007140 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a94e3d640 1 --2- 172.21.15.152:0/944007140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf155d0 0x55b6cdf15a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a9563e640 1 --2- 172.21.15.152:0/944007140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf16b40 0x55b6cdf15090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a8ffff640 1 -- 172.21.15.152:0/944007140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf16b40 msgr2=0x55b6cdf15090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/944007140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf16b40 0x55b6cdf15090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a8ffff640 1 -- 172.21.15.152:0/944007140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf155d0 msgr2=0x55b6cdf15a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/944007140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf155d0 0x55b6cdf15a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.641+0000 7f1a8dffb640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1a780a2df0 0x7f1a780a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.640+0000 7f1a8ffff640 1 -- 172.21.15.152:0/944007140 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6cde073a0 con 0x55b6cdf20370 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.641+0000 7f1a94e3d640 1 --2- 172.21.15.152:0/944007140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf155d0 0x55b6cdf15a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:18.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.641+0000 7f1a9563e640 1 --2- 172.21.15.152:0/944007140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf16b40 0x55b6cdf15090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:18.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.641+0000 7f1a9563e640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1a780a2df0 0x7f1a780a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.641+0000 7f1a8dffb640 1 -- 172.21.15.152:0/2002294383 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f1a800efa20 con 0x7f1a90100a90 2024-09-11T22:19:18.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.641+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/944007140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 0x55b6cdf22760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400abe0 tx=0x7f1a8400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2110f5763c82fb53 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:18.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.642+0000 7f1a9563e640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1a780a2df0 0x7f1a780a52b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1a880049d0 tx=0x7f1a88009500 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:18.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.642+0000 7f1a76ffd640 1 -- 172.21.15.152:0/944007140 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84025070 con 0x55b6cdf20370 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.642+0000 7f1a76ffd640 1 -- 172.21.15.152:0/944007140 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a84020b20 con 0x55b6cdf20370 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.642+0000 7f1a76ffd640 1 -- 172.21.15.152:0/944007140 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8401ea50 con 0x55b6cdf20370 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.643+0000 7f1a9947a740 1 -- 172.21.15.152:0/944007140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 msgr2=0x55b6cdf22760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.643+0000 7f1a9947a740 1 --2- 172.21.15.152:0/944007140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 0x55b6cdf22760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400abe0 tx=0x7f1a8400f790 comp rx=0 tx=0).stop 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.643+0000 7f1a9947a740 1 -- 172.21.15.152:0/944007140 shutdown_connections 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.643+0000 7f1a9947a740 1 --2- 172.21.15.152:0/944007140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 0x55b6cdf22760 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.643+0000 7f1a9947a740 1 --2- 172.21.15.152:0/944007140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf155d0 0x55b6cdf15a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.643+0000 7f1a9947a740 1 --2- 172.21.15.152:0/944007140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf16b40 0x55b6cdf15090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.643+0000 7f1a9947a740 1 -- 172.21.15.152:0/944007140 >> 172.21.15.152:0/944007140 conn(0x55b6cdede310 msgr2=0x55b6cdf11c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.643+0000 7f1a9947a740 1 -- 172.21.15.152:0/944007140 shutdown_connections 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.644+0000 7f1a9947a740 1 -- 172.21.15.152:0/944007140 wait complete. 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.644+0000 7f1a9947a740 1 -- start start 2024-09-11T22:19:18.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.644+0000 7f1a9947a740 1 Processor -- start 2024-09-11T22:19:18.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.646+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf155d0 0x55b6cdf1fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.646+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 0x55b6cdf1cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.646+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 0x55b6cdf1d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.646+0000 7f1a9947a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b6cdf23070 con 0x55b6cdf16b40 2024-09-11T22:19:18.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.646+0000 7f1a9947a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b6cde36060 con 0x55b6cdf20370 2024-09-11T22:19:18.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.646+0000 7f1a9947a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b6cdf231f0 con 0x55b6cdf155d0 2024-09-11T22:19:18.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.646+0000 7f1a9947a740 10 client.0 _ll_register_callbacks cb 0x55b6cdb898c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:18.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.646+0000 7f1a9563e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 0x55b6cdf1d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.646+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 0x55b6cdf1cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.647+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 0x55b6cdf1cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51598/0 (socket says 172.21.15.152:51598) 2024-09-11T22:19:18.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.647+0000 7f1a8ffff640 1 -- 172.21.15.152:0/461114686 learned_addr learned my addr 172.21.15.152:0/461114686 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:18.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.647+0000 7f1a8ffff640 1 -- 172.21.15.152:0/461114686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf155d0 msgr2=0x55b6cdf1fd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:19:18.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.647+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/461114686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf155d0 0x55b6cdf1fd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.647+0000 7f1a8ffff640 1 -- 172.21.15.152:0/461114686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 msgr2=0x55b6cdf1d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:18.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.647+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/461114686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 0x55b6cdf1d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.647+0000 7f1a8ffff640 1 -- 172.21.15.152:0/461114686 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6cdbec3c0 con 0x55b6cdf16b40 2024-09-11T22:19:18.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.648+0000 7f1a6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:19:18.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.648+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/461114686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 0x55b6cdf1cff0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f1a8401e590 tx=0x7f1a84020670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524e95f781765b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:18.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.649+0000 7f1a6ffff640 1 -- 172.21.15.152:0/461114686 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84025050 con 0x55b6cdf16b40 2024-09-11T22:19:18.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.649+0000 7f1a6ffff640 1 -- 172.21.15.152:0/461114686 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f1a84005240 con 0x55b6cdf16b40 2024-09-11T22:19:18.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.649+0000 7f1a9947a740 1 -- 172.21.15.152:0/461114686 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a84020b20 con 0x55b6cdf16b40 2024-09-11T22:19:18.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.649+0000 7f1a6ffff640 1 -- 172.21.15.152:0/461114686 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a8401e340 con 0x55b6cdf16b40 2024-09-11T22:19:18.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.649+0000 7f1a9947a740 10 client.19212 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:18.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.649+0000 7f1a9947a740 1 -- 172.21.15.152:0/461114686 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b6cdf2eae0 con 0x55b6cdf16b40 2024-09-11T22:19:18.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.650+0000 7f1a6ffff640 1 -- 172.21.15.152:0/461114686 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a84031070 con 0x55b6cdf16b40 2024-09-11T22:19:18.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.650+0000 7f1a6ffff640 1 -- 172.21.15.152:0/461114686 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f1a840046c0 con 0x55b6cdf16b40 2024-09-11T22:19:18.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.650+0000 7f1a9947a740 10 client.19212 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:18.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.650+0000 7f1a9947a740 10 client.19212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:18.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.650+0000 7f1a9947a740 20 client.19212 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:18.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.650+0000 7f1a9947a740 1 --2- 172.21.15.152:0/461114686 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b6cdf2fee0 0x55b6cdf322d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.650+0000 7f1a9947a740 4 client.19212 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:18.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.650+0000 7f1a9947a740 1 -- 172.21.15.152:0/461114686 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1a84020b20 con 0x55b6cdf2fee0 2024-09-11T22:19:18.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.653+0000 7f1a94e3d640 1 --2- 172.21.15.152:0/461114686 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b6cdf2fee0 0x55b6cdf322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.655+0000 7f1a6ffff640 10 client.19212 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:18.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.655+0000 7f1a94e3d640 1 --2- 172.21.15.152:0/461114686 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b6cdf2fee0 0x55b6cdf322d0 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88146de34a2543be server_cookie=7fe6730f657ffc6b in_seq=0 out_seq=0 2024-09-11T22:19:18.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.665+0000 7f1a6ffff640 1 -- 172.21.15.152:0/461114686 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f1a84020b20 con 0x55b6cdf2fee0 2024-09-11T22:19:18.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.665+0000 7f1a6ffff640 10 client.19212 handle_command_reply: tid=0 2024-09-11T22:19:18.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.665+0000 7f1a9947a740 1 client.19212 shutdown 2024-09-11T22:19:18.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.666+0000 7f1a9947a740 1 -- 172.21.15.152:0/461114686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 msgr2=0x55b6cdf1cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:18.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.666+0000 7f1a9947a740 1 --2- 172.21.15.152:0/461114686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 0x55b6cdf1cff0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f1a8401e590 tx=0x7f1a84020670 comp rx=0 tx=0).stop 2024-09-11T22:19:18.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.673+0000 7f1a9947a740 1 -- 172.21.15.152:0/461114686 shutdown_connections 2024-09-11T22:19:18.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.673+0000 7f1a9947a740 1 --2- 172.21.15.152:0/461114686 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b6cdf2fee0 0x55b6cdf322d0 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.673+0000 7f1a6ffff640 0 client.19212 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:18.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.673+0000 7f1a9947a740 1 --2- 172.21.15.152:0/461114686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf20370 0x55b6cdf1d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.673+0000 7f1a9947a740 1 --2- 172.21.15.152:0/461114686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 0x55b6cdf1cff0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.673+0000 7f1a9947a740 1 --2- 172.21.15.152:0/461114686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf155d0 0x55b6cdf1fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.673+0000 7f1a9947a740 1 -- 172.21.15.152:0/461114686 >> 172.21.15.152:0/461114686 conn(0x55b6cdede310 msgr2=0x55b6cdf17960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:18.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.675+0000 7f1a9947a740 1 -- 172.21.15.152:0/461114686 shutdown_connections 2024-09-11T22:19:18.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.675+0000 7f1a9947a740 1 -- 172.21.15.152:0/461114686 wait complete. 2024-09-11T22:19:18.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.675+0000 7f1a9947a740 20 client.19212 trim_cache size 0 max 16384 2024-09-11T22:19:18.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.698+0000 7f1a9947a740 1 Processor -- start 2024-09-11T22:19:18.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.698+0000 7f1a9947a740 1 -- start start 2024-09-11T22:19:18.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.698+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf155d0 0x55b6cdf11d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.699+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 0x55b6cdf18120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.699+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf20370 0x55b6cdf18660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.699+0000 7f1a9947a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901ae260 con 0x55b6cdf16b40 2024-09-11T22:19:18.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.699+0000 7f1a9947a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901abb30 con 0x55b6cdf155d0 2024-09-11T22:19:18.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.699+0000 7f1a9947a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901a99c0 con 0x55b6cdf20370 2024-09-11T22:19:18.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.699+0000 7f1a9563e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf20370 0x55b6cdf18660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.699+0000 7f1a9563e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf20370 0x55b6cdf18660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52524/0 (socket says 172.21.15.152:52524) 2024-09-11T22:19:18.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.699+0000 7f1a9563e640 1 -- 172.21.15.152:0/2899660515 learned_addr learned my addr 172.21.15.152:0/2899660515 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:18.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.700+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/2899660515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 0x55b6cdf18120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.701+0000 7f1a8ffff640 1 -- 172.21.15.152:0/2899660515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf20370 msgr2=0x55b6cdf18660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:18.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.701+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/2899660515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf20370 0x55b6cdf18660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.701+0000 7f1a8ffff640 1 -- 172.21.15.152:0/2899660515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf155d0 msgr2=0x55b6cdf11d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:18.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.701+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/2899660515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf155d0 0x55b6cdf11d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.701+0000 7f1a8ffff640 1 -- 172.21.15.152:0/2899660515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6cdf12bc0 con 0x55b6cdf16b40 2024-09-11T22:19:18.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.701+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/2899660515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 0x55b6cdf18120 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x55b6cdf1e5a0 tx=0x7f1a8401e500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fa3b1344927699 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:18.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.704+0000 7f1a767fc640 1 -- 172.21.15.152:0/2899660515 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84044070 con 0x55b6cdf16b40 2024-09-11T22:19:18.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.704+0000 7f1a767fc640 1 -- 172.21.15.152:0/2899660515 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a84031040 con 0x55b6cdf16b40 2024-09-11T22:19:18.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.704+0000 7f1a767fc640 1 -- 172.21.15.152:0/2899660515 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84025070 con 0x55b6cdf16b40 2024-09-11T22:19:18.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.706+0000 7f1a9947a740 1 -- 172.21.15.152:0/2899660515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 msgr2=0x55b6cdf18120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:18.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.706+0000 7f1a9947a740 1 --2- 172.21.15.152:0/2899660515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 0x55b6cdf18120 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x55b6cdf1e5a0 tx=0x7f1a8401e500 comp rx=0 tx=0).stop 2024-09-11T22:19:18.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.707+0000 7f1a9947a740 1 -- 172.21.15.152:0/2899660515 shutdown_connections 2024-09-11T22:19:18.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.707+0000 7f1a9947a740 1 --2- 172.21.15.152:0/2899660515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf20370 0x55b6cdf18660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.707+0000 7f1a9947a740 1 --2- 172.21.15.152:0/2899660515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf16b40 0x55b6cdf18120 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.707+0000 7f1a9947a740 1 --2- 172.21.15.152:0/2899660515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf155d0 0x55b6cdf11d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.707+0000 7f1a9947a740 1 -- 172.21.15.152:0/2899660515 >> 172.21.15.152:0/2899660515 conn(0x55b6cdede310 msgr2=0x55b6cdf10d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:18.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.709+0000 7f1a9947a740 1 -- 172.21.15.152:0/2899660515 shutdown_connections 2024-09-11T22:19:18.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.710+0000 7f1a9947a740 1 -- 172.21.15.152:0/2899660515 wait complete. 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.710+0000 7f1a9947a740 1 -- start start 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.710+0000 7f1a9947a740 1 Processor -- start 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.711+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf155d0 0x55b6cdf1a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.711+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf16b40 0x55b6cdf1a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.711+0000 7f1a9947a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf20370 0x55b6cdf1abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.711+0000 7f1a9947a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901aa010 con 0x55b6cdf20370 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.711+0000 7f1a9947a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901ab460 con 0x55b6cdf16b40 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.711+0000 7f1a9947a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901aa6c0 con 0x55b6cdf155d0 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.711+0000 7f1a9947a740 10 client.0 _ll_register_callbacks cb 0x7f1a84023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.711+0000 7f1a94e3d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf155d0 0x55b6cdf1a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.711+0000 7f1a94e3d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf155d0 0x55b6cdf1a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52540/0 (socket says 172.21.15.152:52540) 2024-09-11T22:19:18.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.711+0000 7f1a94e3d640 1 -- 172.21.15.152:0/3612122261 learned_addr learned my addr 172.21.15.152:0/3612122261 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:18.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.713+0000 7f1a9563e640 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf20370 0x55b6cdf1abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.713+0000 7f1a8ffff640 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf16b40 0x55b6cdf1a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.714+0000 7f1a9563e640 1 -- 172.21.15.152:0/3612122261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf155d0 msgr2=0x55b6cdf1a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:18.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.714+0000 7f1a9563e640 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf155d0 0x55b6cdf1a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.714+0000 7f1a9563e640 1 -- 172.21.15.152:0/3612122261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf16b40 msgr2=0x55b6cdf1a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:18.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.714+0000 7f1a9563e640 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf16b40 0x55b6cdf1a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.714+0000 7f1a9563e640 1 -- 172.21.15.152:0/3612122261 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6cdfaabe0 con 0x55b6cdf20370 2024-09-11T22:19:18.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.715+0000 7f1a9563e640 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf20370 0x55b6cdf1abf0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009f40 tx=0x7f1a88004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f1daab86d054c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:18.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.715+0000 7f1a6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:19:18.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.715+0000 7f1a6ffff640 1 -- 172.21.15.152:0/3612122261 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8802d070 con 0x55b6cdf20370 2024-09-11T22:19:18.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.715+0000 7f1a9947a740 1 -- 172.21.15.152:0/3612122261 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a84031040 con 0x55b6cdf20370 2024-09-11T22:19:18.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.716+0000 7f1a6ffff640 1 -- 172.21.15.152:0/3612122261 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8658+0+0 (secure 0 0 0) 0x7f1a88004b20 con 0x55b6cdf20370 2024-09-11T22:19:18.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.716+0000 7f1a6ffff640 1 -- 172.21.15.152:0/3612122261 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a88036050 con 0x55b6cdf20370 2024-09-11T22:19:18.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.716+0000 7f1a9947a740 10 client.19218 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:18.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.716+0000 7f1a9947a740 1 -- 172.21.15.152:0/3612122261 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b6cdfabf00 con 0x55b6cdf20370 2024-09-11T22:19:18.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.719+0000 7f1a6ffff640 1 -- 172.21.15.152:0/3612122261 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a84031040 con 0x55b6cdf20370 2024-09-11T22:19:18.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.720+0000 7f1a6ffff640 1 -- 172.21.15.152:0/3612122261 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f1a88030020 con 0x55b6cdf20370 2024-09-11T22:19:18.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.721+0000 7f1a9947a740 10 client.19218 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:18.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.721+0000 7f1a9947a740 10 client.19218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:18.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.721+0000 7f1a9947a740 20 client.19218 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:18.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.721+0000 7f1a9947a740 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b6cdf2fee0 0x55b6cdfae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:18.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.721+0000 7f1a9947a740 4 client.19218 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:19:18.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.721+0000 7f1a9947a740 1 -- 172.21.15.152:0/3612122261 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b6cde88860 con 0x55b6cdf2fee0 2024-09-11T22:19:18.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.722+0000 7f1a94e3d640 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b6cdf2fee0 0x55b6cdfae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:18.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.726+0000 7f1a94e3d640 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b6cdf2fee0 0x55b6cdfae690 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79c01dc400c5abc9 server_cookie=efa36e4966b145b1 in_seq=0 out_seq=0 2024-09-11T22:19:18.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.726+0000 7f1a6ffff640 10 client.19218 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:18.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.727+0000 7f1a6ffff640 1 -- 172.21.15.152:0/3612122261 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b6cde88860 con 0x55b6cdf2fee0 2024-09-11T22:19:18.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.727+0000 7f1a6ffff640 10 client.19218 handle_command_reply: tid=0 2024-09-11T22:19:18.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.727+0000 7f1a9947a740 1 client.19218 shutdown 2024-09-11T22:19:18.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.727+0000 7f1a9947a740 1 -- 172.21.15.152:0/3612122261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf20370 msgr2=0x55b6cdf1abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:18.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.727+0000 7f1a9947a740 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf20370 0x55b6cdf1abf0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009f40 tx=0x7f1a88004ab0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.728+0000 7f1a9947a740 1 -- 172.21.15.152:0/3612122261 shutdown_connections 2024-09-11T22:19:18.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.728+0000 7f1a9947a740 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b6cdf2fee0 0x55b6cdfae690 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.728+0000 7f1a9947a740 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6cdf20370 0x55b6cdf1abf0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.728+0000 7f1a9947a740 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6cdf16b40 0x55b6cdf1a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.728+0000 7f1a9947a740 1 --2- 172.21.15.152:0/3612122261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b6cdf155d0 0x55b6cdf1a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.728+0000 7f1a9947a740 1 -- 172.21.15.152:0/3612122261 >> 172.21.15.152:0/3612122261 conn(0x55b6cdede310 msgr2=0x55b6cdf1e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:18.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.728+0000 7f1a6ffff640 0 client.19218 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:18.730 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:19:18.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.729+0000 7f1a9947a740 1 -- 172.21.15.152:0/3612122261 shutdown_connections 2024-09-11T22:19:18.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.729+0000 7f1a9947a740 1 -- 172.21.15.152:0/3612122261 wait complete. 2024-09-11T22:19:18.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.729+0000 7f1a9947a740 20 client.19218 trim_cache size 0 max 16384 2024-09-11T22:19:18.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 -- 172.21.15.152:0/2002294383 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1a780a2df0 msgr2=0x7f1a780a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:18.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1a780a2df0 0x7f1a780a52b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1a880049d0 tx=0x7f1a88009500 comp rx=0 tx=0).stop 2024-09-11T22:19:18.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 -- 172.21.15.152:0/2002294383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a90100a90 msgr2=0x7f1a9019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:18.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a90100a90 0x7f1a9019a670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1a80005940 tx=0x7f1a80004270 comp rx=0 tx=0).stop 2024-09-11T22:19:18.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 -- 172.21.15.152:0/2002294383 shutdown_connections 2024-09-11T22:19:18.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f1a780a2df0 0x7f1a780a52b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a90106a90 0x7f1a9019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a90101430 0x7f1a9019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 --2- 172.21.15.152:0/2002294383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a90100a90 0x7f1a9019a670 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:18.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 -- 172.21.15.152:0/2002294383 >> 172.21.15.152:0/2002294383 conn(0x7f1a900fc7d0 msgr2=0x7f1a900fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:18.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 -- 172.21.15.152:0/2002294383 shutdown_connections 2024-09-11T22:19:18.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:18.730+0000 7f1a970a1640 1 -- 172.21.15.152:0/2002294383 wait complete. 2024-09-11T22:19:19.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 825.0 s, 1667.2 tps, lat 60.385 ms stddev 66.841 2024-09-11T22:19:20.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:20 smithi152 ceph-mon[31188]: osdmap e103: 12 total, 12 up, 12 in 2024-09-11T22:19:20.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:20 smithi152 ceph-mon[31188]: pgmap v472: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 9.9 MiB/s wr, 829 op/s 2024-09-11T22:19:20.502 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:19:20.502 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:19:20.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:20 smithi179 ceph-mon[35603]: osdmap e103: 12 total, 12 up, 12 in 2024-09-11T22:19:20.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:20 smithi179 ceph-mon[35603]: pgmap v472: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 9.9 MiB/s wr, 829 op/s 2024-09-11T22:19:20.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:20 smithi193 ceph-mon[35545]: osdmap e103: 12 total, 12 up, 12 in 2024-09-11T22:19:20.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:20 smithi193 ceph-mon[35545]: pgmap v472: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 9.9 MiB/s wr, 829 op/s 2024-09-11T22:19:20.880 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:19:21.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.442+0000 7f77fa12b640 1 -- 172.21.15.152:0/1617810094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4109450 msgr2=0x7f77f4110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:21.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.442+0000 7f77fa12b640 1 --2- 172.21.15.152:0/1617810094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4109450 0x7f77f4110250 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009900 tx=0x7f77e402a440 comp rx=0 tx=0).stop 2024-09-11T22:19:21.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.445+0000 7f77fa12b640 1 -- 172.21.15.152:0/1617810094 shutdown_connections 2024-09-11T22:19:21.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.445+0000 7f77fa12b640 1 --2- 172.21.15.152:0/1617810094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77f411b140 0x7f77f411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.445+0000 7f77fa12b640 1 --2- 172.21.15.152:0/1617810094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77f4109830 0x7f77f4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.445+0000 7f77fa12b640 1 --2- 172.21.15.152:0/1617810094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4109450 0x7f77f4110250 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.445+0000 7f77fa12b640 1 -- 172.21.15.152:0/1617810094 >> 172.21.15.152:0/1617810094 conn(0x7f77f406e140 msgr2=0x7f77f406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:21.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.446+0000 7f77fa12b640 1 -- 172.21.15.152:0/1617810094 shutdown_connections 2024-09-11T22:19:21.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.446+0000 7f77fa12b640 1 -- 172.21.15.152:0/1617810094 wait complete. 2024-09-11T22:19:21.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.447+0000 7f77fa12b640 1 Processor -- start 2024-09-11T22:19:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.448+0000 7f77fa12b640 1 -- start start 2024-09-11T22:19:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.448+0000 7f77fa12b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77f4109450 0x7f77f41a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.448+0000 7f77fa12b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4109830 0x7f77f41a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.449+0000 7f77f37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77f4109450 0x7f77f41a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.449+0000 7f77f37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77f4109450 0x7f77f41a7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52560/0 (socket says 172.21.15.152:52560) 2024-09-11T22:19:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.449+0000 7f77f37fe640 1 -- 172.21.15.152:0/1397667005 learned_addr learned my addr 172.21.15.152:0/1397667005 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.449+0000 7f77fa12b640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77f411b140 0x7f77f41abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.449+0000 7f77fa12b640 1 -- 172.21.15.152:0/1397667005 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4120eb0 con 0x7f77f4109830 2024-09-11T22:19:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.449+0000 7f77fa12b640 1 -- 172.21.15.152:0/1397667005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4120d30 con 0x7f77f411b140 2024-09-11T22:19:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.449+0000 7f77f3fff640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77f411b140 0x7f77f41abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.449+0000 7f77fa12b640 1 -- 172.21.15.152:0/1397667005 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4121030 con 0x7f77f4109450 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.450+0000 7f77f2ffd640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4109830 0x7f77f41a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.450+0000 7f77f3fff640 1 -- 172.21.15.152:0/1397667005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77f4109450 msgr2=0x7f77f41a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.450+0000 7f77f3fff640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77f4109450 0x7f77f41a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.450+0000 7f77f3fff640 1 -- 172.21.15.152:0/1397667005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4109830 msgr2=0x7f77f41a78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.450+0000 7f77f3fff640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4109830 0x7f77f41a78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.450+0000 7f77f3fff640 1 -- 172.21.15.152:0/1397667005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f41ac320 con 0x7f77f411b140 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.451+0000 7f77f3fff640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77f411b140 0x7f77f41abc40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00be00 tx=0x7f77ec00be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.451+0000 7f77f0ff9640 1 -- 172.21.15.152:0/1397667005 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec019070 con 0x7f77f411b140 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.451+0000 7f77f0ff9640 1 -- 172.21.15.152:0/1397667005 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77ec00ccb0 con 0x7f77f411b140 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.451+0000 7f77fa12b640 1 -- 172.21.15.152:0/1397667005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f41ac610 con 0x7f77f411b140 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.451+0000 7f77fa12b640 1 -- 172.21.15.152:0/1397667005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f41b3ef0 con 0x7f77f411b140 2024-09-11T22:19:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.452+0000 7f77f0ff9640 1 -- 172.21.15.152:0/1397667005 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec012880 con 0x7f77f411b140 2024-09-11T22:19:21.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.455+0000 7f77fc504740 1 Processor -- start 2024-09-11T22:19:21.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.457+0000 7f77f0ff9640 1 -- 172.21.15.152:0/1397667005 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f77ec01c070 con 0x7f77f411b140 2024-09-11T22:19:21.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.459+0000 7f77f0ff9640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77dc0a2d40 0x7f77dc0a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.459+0000 7f77f0ff9640 1 -- 172.21.15.152:0/1397667005 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f77ec0ceab0 con 0x7f77f411b140 2024-09-11T22:19:21.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.460+0000 7f77fc504740 1 -- start start 2024-09-11T22:19:21.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.460+0000 7f77fc504740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 0x564e10775e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.460+0000 7f77fc504740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e107767f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.460+0000 7f77fc504740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e10782f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.460+0000 7f77fc504740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564e106db280 con 0x564e107763b0 2024-09-11T22:19:21.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.460+0000 7f77fc504740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e10682b10 con 0x564e10780b30 2024-09-11T22:19:21.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.460+0000 7f77fc504740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564e106d7240 con 0x564e107774c0 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.462+0000 7f77f2ffd640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77dc0a2d40 0x7f77dc0a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.463+0000 7f77f3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e10782f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.463+0000 7f77f3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e10782f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37342/0 (socket says 172.21.15.152:37342) 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.463+0000 7f77f3fff640 1 -- 172.21.15.152:0/4165056796 learned_addr learned my addr 172.21.15.152:0/4165056796 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.467+0000 7f77f37fe640 1 --2- 172.21.15.152:0/4165056796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 0x564e10775e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.467+0000 7f77f2ffd640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77dc0a2d40 0x7f77dc0a5200 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f77e8006e10 tx=0x7f77e8006d60 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.467+0000 7f77f3fff640 1 -- 172.21.15.152:0/4165056796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 msgr2=0x564e10775e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.467+0000 7f77f3fff640 1 --2- 172.21.15.152:0/4165056796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 0x564e10775e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.467+0000 7f77f3fff640 1 -- 172.21.15.152:0/4165056796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 msgr2=0x564e107767f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.467+0000 7f77f3fff640 1 --2- 172.21.15.152:0/4165056796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e107767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.467+0000 7f77f3fff640 1 -- 172.21.15.152:0/4165056796 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e1068f1f0 con 0x564e10780b30 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.467+0000 7f77f37fe640 1 --2- 172.21.15.152:0/4165056796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 0x564e10775e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.468+0000 7f77f3fff640 1 --2- 172.21.15.152:0/4165056796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e10782f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0a3760 tx=0x7f77ec09aaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=712ccf0824e6aca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.469+0000 7f77d97fa640 1 -- 172.21.15.152:0/4165056796 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec09f3d0 con 0x564e10780b30 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.469+0000 7f77d97fa640 1 -- 172.21.15.152:0/4165056796 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77ec0a3c90 con 0x564e10780b30 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.469+0000 7f77d97fa640 1 -- 172.21.15.152:0/4165056796 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec0a3a60 con 0x564e10780b30 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.470+0000 7f77fc504740 1 -- 172.21.15.152:0/4165056796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 msgr2=0x564e10782f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.470+0000 7f77fc504740 1 --2- 172.21.15.152:0/4165056796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e10782f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0a3760 tx=0x7f77ec09aaf0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.470+0000 7f77fc504740 1 -- 172.21.15.152:0/4165056796 shutdown_connections 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.470+0000 7f77fc504740 1 --2- 172.21.15.152:0/4165056796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e10782f20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.470+0000 7f77fc504740 1 --2- 172.21.15.152:0/4165056796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e107767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.470+0000 7f77fc504740 1 --2- 172.21.15.152:0/4165056796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 0x564e10775e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.470+0000 7f77fc504740 1 -- 172.21.15.152:0/4165056796 >> 172.21.15.152:0/4165056796 conn(0x564e10772420 msgr2=0x564e10772800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.470+0000 7f77fc504740 1 -- 172.21.15.152:0/4165056796 shutdown_connections 2024-09-11T22:19:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.470+0000 7f77fc504740 1 -- 172.21.15.152:0/4165056796 wait complete. 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.471+0000 7f77fc504740 1 -- start start 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.471+0000 7f77fc504740 1 Processor -- start 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.472+0000 7f77fc504740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e1077db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.472+0000 7f77fc504740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 0x564e1077e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.472+0000 7f77fc504740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e1077e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.472+0000 7f77f2ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 0x564e1077e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.472+0000 7f77f2ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 0x564e1077e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52582/0 (socket says 172.21.15.152:52582) 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.472+0000 7f77f2ffd640 1 -- 172.21.15.152:0/456356659 learned_addr learned my addr 172.21.15.152:0/456356659 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.472+0000 7f77fc504740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564e107839a0 con 0x564e107763b0 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.472+0000 7f77fc504740 1 -- 172.21.15.152:0/456356659 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e10695f10 con 0x564e10780b30 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.472+0000 7f77f3fff640 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e1077e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.472+0000 7f77fc504740 1 -- 172.21.15.152:0/456356659 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564e10783b20 con 0x564e107774c0 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.473+0000 7f77fc504740 10 client.0 _ll_register_callbacks cb 0x564e1065ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.473+0000 7f77f37fe640 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e1077db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.473+0000 7f77f3fff640 1 -- 172.21.15.152:0/456356659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 msgr2=0x564e1077e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.473+0000 7f77f3fff640 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 0x564e1077e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.473+0000 7f77f3fff640 1 -- 172.21.15.152:0/456356659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 msgr2=0x564e1077db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.473+0000 7f77f3fff640 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e1077db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.473+0000 7f77f3fff640 1 -- 172.21.15.152:0/456356659 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e1044c6a0 con 0x564e10780b30 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.474+0000 7f77f3fff640 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e1077e5b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f77ec09add0 tx=0x7f77ec0a3a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5f5e8ffcf53d65f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.474+0000 7f77d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.475+0000 7f77d2ffd640 1 -- 172.21.15.152:0/456356659 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec0b4020 con 0x564e10780b30 2024-09-11T22:19:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.475+0000 7f77d2ffd640 1 -- 172.21.15.152:0/456356659 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f77ec09a730 con 0x564e10780b30 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.475+0000 7f77fc504740 1 -- 172.21.15.152:0/456356659 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77ec0a3c90 con 0x564e10780b30 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.476+0000 7f77d2ffd640 1 -- 172.21.15.152:0/456356659 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77ec0978c0 con 0x564e10780b30 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.476+0000 7f77fc504740 10 client.28388 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.476+0000 7f77fc504740 1 -- 172.21.15.152:0/456356659 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e1078f680 con 0x564e10780b30 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.476+0000 7f77d2ffd640 1 -- 172.21.15.152:0/456356659 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77ec0a3c90 con 0x564e10780b30 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.476+0000 7f77d2ffd640 1 -- 172.21.15.152:0/456356659 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f77ec0a0560 con 0x564e10780b30 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.476+0000 7f77fc504740 10 client.28388 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.476+0000 7f77fc504740 10 client.28388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.476+0000 7f77fc504740 20 client.28388 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.476+0000 7f77fc504740 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e107909d0 0x564e10792dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.476+0000 7f77fc504740 4 client.28388 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:21.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.476+0000 7f77fc504740 1 -- 172.21.15.152:0/456356659 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e106e87f0 con 0x564e107909d0 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.477+0000 7f77f37fe640 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e107909d0 0x564e10792dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.478+0000 7f77f37fe640 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e107909d0 0x564e10792dc0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a47e8d504eefb3d server_cookie=9f3106f01abb81db in_seq=0 out_seq=0 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.478+0000 7f77d2ffd640 10 client.28388 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77d2ffd640 1 -- 172.21.15.152:0/456356659 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e106e87f0 con 0x564e107909d0 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77d2ffd640 10 client.28388 handle_command_reply: tid=0 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77fc504740 1 client.28388 shutdown 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77fc504740 1 -- 172.21.15.152:0/456356659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 msgr2=0x564e1077e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77fc504740 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e1077e5b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f77ec09add0 tx=0x7f77ec0a3a30 comp rx=0 tx=0).stop 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77fc504740 1 -- 172.21.15.152:0/456356659 shutdown_connections 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77fc504740 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e107909d0 0x564e10792dc0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77fc504740 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e1077e5b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77fc504740 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107774c0 0x564e1077e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77fc504740 1 --2- 172.21.15.152:0/456356659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e1077db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77d2ffd640 0 client.28388 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77fc504740 1 -- 172.21.15.152:0/456356659 >> 172.21.15.152:0/456356659 conn(0x564e10772420 msgr2=0x564e10778150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77fc504740 1 -- 172.21.15.152:0/456356659 shutdown_connections 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.479+0000 7f77fc504740 1 -- 172.21.15.152:0/456356659 wait complete. 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.480+0000 7f77fc504740 20 client.28388 trim_cache size 0 max 16384 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77fc504740 1 Processor -- start 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77fc504740 1 -- start start 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77fc504740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107763b0 0x564e1078c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77fc504740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107774c0 0x564e1077add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77fc504740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e1077b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77fc504740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41bf2a0 con 0x564e107774c0 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77fc504740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41bcb70 con 0x564e10780b30 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77fc504740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41ba9e0 con 0x564e107763b0 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77f2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107774c0 0x564e1077add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77f2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107774c0 0x564e1077add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51666/0 (socket says 172.21.15.152:51666) 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77f2ffd640 1 -- 172.21.15.152:0/1200649541 learned_addr learned my addr 172.21.15.152:0/1200649541 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77f37fe640 1 --2- 172.21.15.152:0/1200649541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107763b0 0x564e1078c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.497+0000 7f77f3fff640 1 --2- 172.21.15.152:0/1200649541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e1077b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.498+0000 7f77f2ffd640 1 -- 172.21.15.152:0/1200649541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107763b0 msgr2=0x564e1078c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.498+0000 7f77f2ffd640 1 --2- 172.21.15.152:0/1200649541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107763b0 0x564e1078c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.498+0000 7f77f2ffd640 1 -- 172.21.15.152:0/1200649541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 msgr2=0x564e1077b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.498+0000 7f77f2ffd640 1 --2- 172.21.15.152:0/1200649541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e1077b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.498+0000 7f77f2ffd640 1 -- 172.21.15.152:0/1200649541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e107454f0 con 0x564e107774c0 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.498+0000 7f77f2ffd640 1 --2- 172.21.15.152:0/1200649541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107774c0 0x564e1077add0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f77e8010cf0 tx=0x7f77e8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283d197865b2b2e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.498+0000 7f77d8ff9640 1 -- 172.21.15.152:0/1200649541 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e801c040 con 0x564e107774c0 2024-09-11T22:19:21.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.498+0000 7f77d8ff9640 1 -- 172.21.15.152:0/1200649541 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e8027070 con 0x564e107774c0 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.498+0000 7f77d8ff9640 1 -- 172.21.15.152:0/1200649541 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e8014690 con 0x564e107774c0 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.499+0000 7f77fc504740 1 -- 172.21.15.152:0/1200649541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107774c0 msgr2=0x564e1077add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.499+0000 7f77fc504740 1 --2- 172.21.15.152:0/1200649541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107774c0 0x564e1077add0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f77e8010cf0 tx=0x7f77e8013000 comp rx=0 tx=0).stop 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.499+0000 7f77fc504740 1 -- 172.21.15.152:0/1200649541 shutdown_connections 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.499+0000 7f77fc504740 1 --2- 172.21.15.152:0/1200649541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e10780b30 0x564e1077b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.499+0000 7f77fc504740 1 --2- 172.21.15.152:0/1200649541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107774c0 0x564e1077add0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.499+0000 7f77fc504740 1 --2- 172.21.15.152:0/1200649541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e107763b0 0x564e1078c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.499+0000 7f77fc504740 1 -- 172.21.15.152:0/1200649541 >> 172.21.15.152:0/1200649541 conn(0x564e10772420 msgr2=0x564e1078bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.499+0000 7f77fc504740 1 -- 172.21.15.152:0/1200649541 shutdown_connections 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.499+0000 7f77fc504740 1 -- 172.21.15.152:0/1200649541 wait complete. 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.499+0000 7f77fc504740 1 -- start start 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77fc504740 1 Processor -- start 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77fc504740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e10795eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77fc504740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e107774c0 0x564e107963f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77fc504740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e10780b30 0x564e10794360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77fc504740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41bb030 con 0x564e107763b0 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77fc504740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41bc4a0 con 0x564e107774c0 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77fc504740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41bb700 con 0x564e10780b30 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e10795eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e10795eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51682/0 (socket says 172.21.15.152:51682) 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f37fe640 1 -- 172.21.15.152:0/1630827243 learned_addr learned my addr 172.21.15.152:0/1630827243 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77fc504740 10 client.0 _ll_register_callbacks cb 0x7f77ec0b2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f2ffd640 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e107774c0 0x564e107963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f3fff640 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e10780b30 0x564e10794360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f37fe640 1 -- 172.21.15.152:0/1630827243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e10780b30 msgr2=0x564e10794360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:21.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f37fe640 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e10780b30 0x564e10794360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f37fe640 1 -- 172.21.15.152:0/1630827243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e107774c0 msgr2=0x564e107963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f37fe640 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e107774c0 0x564e107963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f37fe640 1 -- 172.21.15.152:0/1630827243 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e10794b90 con 0x564e107763b0 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f2ffd640 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e107774c0 0x564e107963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77f37fe640 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e10795eb0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f77e40044c0 tx=0x7f77e4005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86bde922213567e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.500+0000 7f77d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77d27fc640 1 -- 172.21.15.152:0/1630827243 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e404a070 con 0x564e107763b0 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77d27fc640 1 -- 172.21.15.152:0/1630827243 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f77e40046c0 con 0x564e107763b0 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77fc504740 1 -- 172.21.15.152:0/1630827243 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77e8027070 con 0x564e107763b0 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77d27fc640 1 -- 172.21.15.152:0/1630827243 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77e4056050 con 0x564e107763b0 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77fc504740 10 client.19233 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77fc504740 1 -- 172.21.15.152:0/1630827243 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e107fbe00 con 0x564e107763b0 2024-09-11T22:19:21.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77d27fc640 1 -- 172.21.15.152:0/1630827243 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e8027070 con 0x564e107763b0 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77d27fc640 1 -- 172.21.15.152:0/1630827243 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f77e4003b90 con 0x564e107763b0 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77fc504740 10 client.19233 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77fc504740 10 client.19233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77fc504740 20 client.19233 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77fc504740 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e107fc520 0x564e107fe930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77fc504740 4 client.19233 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77fc504740 1 -- 172.21.15.152:0/1630827243 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564e106e2d00 con 0x564e107fc520 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.501+0000 7f77f2ffd640 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e107fc520 0x564e107fe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.502+0000 7f77d27fc640 10 client.19233 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.502+0000 7f77f2ffd640 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e107fc520 0x564e107fe930 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6315e31fd78e737c server_cookie=91f00917040bc6e3 in_seq=0 out_seq=0 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.503+0000 7f77d27fc640 1 -- 172.21.15.152:0/1630827243 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564e106e2d00 con 0x564e107fc520 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.503+0000 7f77d27fc640 10 client.19233 handle_command_reply: tid=0 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.503+0000 7f77fc504740 1 client.19233 shutdown 2024-09-11T22:19:21.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.504+0000 7f77fc504740 1 -- 172.21.15.152:0/1630827243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 msgr2=0x564e10795eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:21.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.504+0000 7f77fc504740 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e10795eb0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f77e40044c0 tx=0x7f77e4005040 comp rx=0 tx=0).stop 2024-09-11T22:19:21.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.505+0000 7f77fc504740 1 -- 172.21.15.152:0/1630827243 shutdown_connections 2024-09-11T22:19:21.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.505+0000 7f77fc504740 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564e107fc520 0x564e107fe930 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.505+0000 7f77fc504740 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564e10780b30 0x564e10794360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.505+0000 7f77fc504740 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e107774c0 0x564e107963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.505+0000 7f77fc504740 1 --2- 172.21.15.152:0/1630827243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564e107763b0 0x564e10795eb0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.505+0000 7f77fc504740 1 -- 172.21.15.152:0/1630827243 >> 172.21.15.152:0/1630827243 conn(0x564e10772420 msgr2=0x564e10778150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:21.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.505+0000 7f77d27fc640 0 client.19233 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:21.551 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:19:21.552 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:19:21.552 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "3c9941f0-cec9-45eb-9e12-c6bc054cd07c", 2024-09-11T22:19:21.552 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:19:21.552 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:19:21.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77fc504740 1 -- 172.21.15.152:0/1630827243 shutdown_connections 2024-09-11T22:19:21.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77fc504740 1 -- 172.21.15.152:0/1630827243 wait complete. 2024-09-11T22:19:21.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77fc504740 20 client.19233 trim_cache size 0 max 16384 2024-09-11T22:19:21.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77da7fc640 1 -- 172.21.15.152:0/1397667005 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77dc0a2d40 msgr2=0x7f77dc0a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:21.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77da7fc640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77dc0a2d40 0x7f77dc0a5200 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f77e8006e10 tx=0x7f77e8006d60 comp rx=0 tx=0).stop 2024-09-11T22:19:21.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77da7fc640 1 -- 172.21.15.152:0/1397667005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77f411b140 msgr2=0x7f77f41abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:21.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77da7fc640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77f411b140 0x7f77f41abc40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00be00 tx=0x7f77ec00be30 comp rx=0 tx=0).stop 2024-09-11T22:19:21.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77da7fc640 1 -- 172.21.15.152:0/1397667005 shutdown_connections 2024-09-11T22:19:21.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77da7fc640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f77dc0a2d40 0x7f77dc0a5200 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77da7fc640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77f411b140 0x7f77f41abc40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77da7fc640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4109830 0x7f77f41a78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.506+0000 7f77da7fc640 1 --2- 172.21.15.152:0/1397667005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77f4109450 0x7f77f41a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:21.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.507+0000 7f77da7fc640 1 -- 172.21.15.152:0/1397667005 >> 172.21.15.152:0/1397667005 conn(0x7f77f406e140 msgr2=0x7f77f411be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:21.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.507+0000 7f77da7fc640 1 -- 172.21.15.152:0/1397667005 shutdown_connections 2024-09-11T22:19:21.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:21.507+0000 7f77da7fc640 1 -- 172.21.15.152:0/1397667005 wait complete. 2024-09-11T22:19:22.046 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:21 smithi152 ceph-mon[31188]: pgmap v473: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 6.1 MiB/s wr, 640 op/s 2024-09-11T22:19:22.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:21 smithi179 ceph-mon[35603]: pgmap v473: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 6.1 MiB/s wr, 640 op/s 2024-09-11T22:19:22.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:21 smithi193 ceph-mon[35545]: pgmap v473: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 6.1 MiB/s wr, 640 op/s 2024-09-11T22:19:22.216 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:19:22.590 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:19:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.861+0000 7f24f6ef1640 1 -- 172.21.15.152:0/4124417335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f24f0101390 msgr2=0x7f24f0105850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.861+0000 7f24f6ef1640 1 --2- 172.21.15.152:0/4124417335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f24f0101390 0x7f24f0105850 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009900 tx=0x7f24d802a480 comp rx=0 tx=0).stop 2024-09-11T22:19:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.866+0000 7f24f6ef1640 1 -- 172.21.15.152:0/4124417335 shutdown_connections 2024-09-11T22:19:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.866+0000 7f24f6ef1640 1 --2- 172.21.15.152:0/4124417335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f0105ea0 0x7f24f0106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.866+0000 7f24f6ef1640 1 --2- 172.21.15.152:0/4124417335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f24f0101390 0x7f24f0105850 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.866+0000 7f24f6ef1640 1 --2- 172.21.15.152:0/4124417335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f0100a70 0x7f24f0100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.866+0000 7f24f6ef1640 1 -- 172.21.15.152:0/4124417335 >> 172.21.15.152:0/4124417335 conn(0x7f24f0077990 msgr2=0x7f24f00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.876+0000 7f24f6ef1640 1 -- 172.21.15.152:0/4124417335 shutdown_connections 2024-09-11T22:19:22.882 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.878+0000 7f24f6ef1640 1 -- 172.21.15.152:0/4124417335 wait complete. 2024-09-11T22:19:22.882 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.879+0000 7f24f6ef1640 1 Processor -- start 2024-09-11T22:19:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.885+0000 7f24f6ef1640 1 -- start start 2024-09-11T22:19:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.885+0000 7f24f6ef1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f0100a70 0x7f24f01149f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.885+0000 7f24f6ef1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f0101390 0x7f24f0114f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.885+0000 7f24f6ef1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f24f0105ea0 0x7f24f010da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.885+0000 7f24f6ef1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24f01184d0 con 0x7f24f0100a70 2024-09-11T22:19:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.885+0000 7f24f6ef1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24f0118350 con 0x7f24f0101390 2024-09-11T22:19:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.885+0000 7f24f6ef1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f24f0118650 con 0x7f24f0105ea0 2024-09-11T22:19:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.885+0000 7f24f4c8d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f0100a70 0x7f24f01149f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.885+0000 7f24effff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f0101390 0x7f24f0114f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.885+0000 7f24effff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f0101390 0x7f24f0114f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37394/0 (socket says 172.21.15.152:37394) 2024-09-11T22:19:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.885+0000 7f24effff640 1 -- 172.21.15.152:0/4273960697 learned_addr learned my addr 172.21.15.152:0/4273960697 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.886+0000 7f24effff640 1 -- 172.21.15.152:0/4273960697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f24f0105ea0 msgr2=0x7f24f010da70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:19:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.886+0000 7f24effff640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f24f0105ea0 0x7f24f010da70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.886+0000 7f24effff640 1 -- 172.21.15.152:0/4273960697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f0100a70 msgr2=0x7f24f01149f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.886+0000 7f24effff640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f0100a70 0x7f24f01149f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.886+0000 7f24effff640 1 -- 172.21.15.152:0/4273960697 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f010e330 con 0x7f24f0101390 2024-09-11T22:19:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.886+0000 7f24effff640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f0101390 0x7f24f0114f30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009850 tx=0x7f24d8030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.889+0000 7f24edffb640 1 -- 172.21.15.152:0/4273960697 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d803f070 con 0x7f24f0101390 2024-09-11T22:19:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.889+0000 7f24edffb640 1 -- 172.21.15.152:0/4273960697 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24d8004460 con 0x7f24f0101390 2024-09-11T22:19:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.889+0000 7f24edffb640 1 -- 172.21.15.152:0/4273960697 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8035030 con 0x7f24f0101390 2024-09-11T22:19:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.889+0000 7f24f6ef1640 1 -- 172.21.15.152:0/4273960697 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f010e5c0 con 0x7f24f0101390 2024-09-11T22:19:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.889+0000 7f24f6ef1640 1 -- 172.21.15.152:0/4273960697 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f0112510 con 0x7f24f0101390 2024-09-11T22:19:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.895+0000 7f24edffb640 1 -- 172.21.15.152:0/4273960697 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f24d8042070 con 0x7f24f0101390 2024-09-11T22:19:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.896+0000 7f24edffb640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24dc0a2f80 0x7f24dc0a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.896+0000 7f24edffb640 1 -- 172.21.15.152:0/4273960697 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f24d80f10e0 con 0x7f24f0101390 2024-09-11T22:19:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.896+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24dc0a2f80 0x7f24dc0a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.897+0000 7f24f9c8c740 1 Processor -- start 2024-09-11T22:19:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.897+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24dc0a2f80 0x7f24dc0a5440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009aa0 tx=0x7f24e0005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.897+0000 7f24f9c8c740 1 -- start start 2024-09-11T22:19:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.897+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb043c0 0x55964eb029c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.897+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 0x55964eb033b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.897+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb1e9a0 0x55964eb20db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24f9c8c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55964ea672f0 con 0x55964eb02f90 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24f9c8c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55964ea0f270 con 0x55964eb1e9a0 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24f9c8c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55964ea632b0 con 0x55964eb043c0 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24effff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 0x55964eb033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24effff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 0x55964eb033b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51712/0 (socket says 172.21.15.152:51712) 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24effff640 1 -- 172.21.15.152:0/1270122677 learned_addr learned my addr 172.21.15.152:0/1270122677 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24f548e640 1 --2- 172.21.15.152:0/1270122677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb1e9a0 0x55964eb20db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24f548e640 1 -- 172.21.15.152:0/1270122677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb043c0 msgr2=0x55964eb029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24f548e640 1 --2- 172.21.15.152:0/1270122677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb043c0 0x55964eb029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24f548e640 1 -- 172.21.15.152:0/1270122677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 msgr2=0x55964eb033b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24f548e640 1 --2- 172.21.15.152:0/1270122677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 0x55964eb033b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24f548e640 1 -- 172.21.15.152:0/1270122677 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55964ea0e340 con 0x55964eb1e9a0 2024-09-11T22:19:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.898+0000 7f24f548e640 1 --2- 172.21.15.152:0/1270122677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb1e9a0 0x55964eb20db0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009d00 tx=0x7f24e800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4c0b42fbbeb1a6a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.899+0000 7f24f6ef1640 1 -- 172.21.15.152:0/1270122677 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e8004b20 con 0x55964eb1e9a0 2024-09-11T22:19:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.899+0000 7f24f6ef1640 1 -- 172.21.15.152:0/1270122677 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24e8003e50 con 0x55964eb1e9a0 2024-09-11T22:19:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.899+0000 7f24f6ef1640 1 -- 172.21.15.152:0/1270122677 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e80047f0 con 0x55964eb1e9a0 2024-09-11T22:19:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.900+0000 7f24f9c8c740 1 -- 172.21.15.152:0/1270122677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb1e9a0 msgr2=0x55964eb20db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.900+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/1270122677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb1e9a0 0x55964eb20db0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009d00 tx=0x7f24e800e720 comp rx=0 tx=0).stop 2024-09-11T22:19:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.901+0000 7f24f9c8c740 1 -- 172.21.15.152:0/1270122677 shutdown_connections 2024-09-11T22:19:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.901+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/1270122677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb1e9a0 0x55964eb20db0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.901+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/1270122677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 0x55964eb033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.901+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/1270122677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb043c0 0x55964eb029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.901+0000 7f24f9c8c740 1 -- 172.21.15.152:0/1270122677 >> 172.21.15.152:0/1270122677 conn(0x55964eaff280 msgr2=0x55964eaff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.901+0000 7f24f9c8c740 1 -- 172.21.15.152:0/1270122677 shutdown_connections 2024-09-11T22:19:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.901+0000 7f24f9c8c740 1 -- 172.21.15.152:0/1270122677 wait complete. 2024-09-11T22:19:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.902+0000 7f24f9c8c740 1 -- start start 2024-09-11T22:19:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.902+0000 7f24f9c8c740 1 Processor -- start 2024-09-11T22:19:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.902+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 0x55964eb0fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.902+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb043c0 0x55964eb10240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.902+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb1e9a0 0x55964eb0b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.903+0000 7f24effff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb043c0 0x55964eb10240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.903+0000 7f24effff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb043c0 0x55964eb10240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37420/0 (socket says 172.21.15.152:37420) 2024-09-11T22:19:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.903+0000 7f24f9c8c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55964eb05b70 con 0x55964eb02f90 2024-09-11T22:19:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.903+0000 7f24f9c8c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55964e9f0290 con 0x55964eb043c0 2024-09-11T22:19:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.903+0000 7f24f9c8c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55964eb05cf0 con 0x55964eb1e9a0 2024-09-11T22:19:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.903+0000 7f24effff640 1 -- 172.21.15.152:0/103446846 learned_addr learned my addr 172.21.15.152:0/103446846 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.903+0000 7f24f9c8c740 10 client.0 _ll_register_callbacks cb 0x55964ea21140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.904+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 0x55964eb0fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.905+0000 7f24f4c8d640 1 -- 172.21.15.152:0/103446846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb1e9a0 msgr2=0x55964eb0b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.905+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb1e9a0 0x55964eb0b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.905+0000 7f24f4c8d640 1 -- 172.21.15.152:0/103446846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb043c0 msgr2=0x55964eb10240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.905+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb043c0 0x55964eb10240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.905+0000 7f24f4c8d640 1 -- 172.21.15.152:0/103446846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55964e77a210 con 0x55964eb02f90 2024-09-11T22:19:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.905+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 0x55964eb0fd00 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f24e0010ed0 tx=0x7f24e0009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd16aa50c1b88428 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.906+0000 7f24cffff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:19:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.906+0000 7f24cffff640 1 -- 172.21.15.152:0/103446846 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e0023070 con 0x55964eb02f90 2024-09-11T22:19:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.906+0000 7f24cffff640 1 -- 172.21.15.152:0/103446846 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f24e001f650 con 0x55964eb02f90 2024-09-11T22:19:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.907+0000 7f24f9c8c740 1 -- 172.21.15.152:0/103446846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24e8003e50 con 0x55964eb02f90 2024-09-11T22:19:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.907+0000 7f24cffff640 1 -- 172.21.15.152:0/103446846 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f24e002d050 con 0x55964eb02f90 2024-09-11T22:19:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.907+0000 7f24f9c8c740 10 client.19242 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.907+0000 7f24f9c8c740 1 -- 172.21.15.152:0/103446846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55964e846620 con 0x55964eb02f90 2024-09-11T22:19:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.908+0000 7f24cffff640 1 -- 172.21.15.152:0/103446846 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24e0028440 con 0x55964eb02f90 2024-09-11T22:19:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.908+0000 7f24cffff640 1 -- 172.21.15.152:0/103446846 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f24e000f040 con 0x55964eb02f90 2024-09-11T22:19:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.909+0000 7f24f9c8c740 10 client.19242 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.909+0000 7f24f9c8c740 10 client.19242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.909+0000 7f24f9c8c740 20 client.19242 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.909+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55964eb1b4d0 0x55964eb1d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.909+0000 7f24f9c8c740 4 client.19242 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.909+0000 7f24f9c8c740 1 -- 172.21.15.152:0/103446846 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f24e8003e50 con 0x55964eb1b4d0 2024-09-11T22:19:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.909+0000 7f24effff640 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55964eb1b4d0 0x55964eb1d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.910+0000 7f24effff640 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55964eb1b4d0 0x55964eb1d970 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cb9c18cdbbe7f78 server_cookie=9acc76855fc2fd6b in_seq=0 out_seq=0 2024-09-11T22:19:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.910+0000 7f24cffff640 10 client.19242 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.911+0000 7f24cffff640 1 -- 172.21.15.152:0/103446846 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f24e8003e50 con 0x55964eb1b4d0 2024-09-11T22:19:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.911+0000 7f24cffff640 10 client.19242 handle_command_reply: tid=0 2024-09-11T22:19:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.911+0000 7f24f9c8c740 1 client.19242 shutdown 2024-09-11T22:19:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.917+0000 7f24f9c8c740 1 -- 172.21.15.152:0/103446846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 msgr2=0x55964eb0fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.917+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 0x55964eb0fd00 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f24e0010ed0 tx=0x7f24e0009420 comp rx=0 tx=0).stop 2024-09-11T22:19:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.921+0000 7f24f9c8c740 1 -- 172.21.15.152:0/103446846 shutdown_connections 2024-09-11T22:19:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.921+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55964eb1b4d0 0x55964eb1d970 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.921+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb1e9a0 0x55964eb0b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.921+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb043c0 0x55964eb10240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.921+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/103446846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb02f90 0x55964eb0fd00 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.921+0000 7f24f9c8c740 1 -- 172.21.15.152:0/103446846 >> 172.21.15.152:0/103446846 conn(0x55964eaff280 msgr2=0x55964eb04fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.921+0000 7f24cffff640 0 client.19242 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.925+0000 7f24f9c8c740 1 -- 172.21.15.152:0/103446846 shutdown_connections 2024-09-11T22:19:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.925+0000 7f24f9c8c740 1 -- 172.21.15.152:0/103446846 wait complete. 2024-09-11T22:19:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.925+0000 7f24f9c8c740 20 client.19242 trim_cache size 0 max 16384 2024-09-11T22:19:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f9c8c740 1 Processor -- start 2024-09-11T22:19:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f9c8c740 1 -- start start 2024-09-11T22:19:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eaff280 0x55964eb0afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb02f90 0x55964eb1fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 0x55964eb202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f9c8c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24f01b6890 con 0x55964eb043c0 2024-09-11T22:19:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f9c8c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24f0073ba0 con 0x55964eb02f90 2024-09-11T22:19:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f9c8c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f24f0071a10 con 0x55964eaff280 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f548e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 0x55964eb202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f4c8d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eaff280 0x55964eb0afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f4c8d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eaff280 0x55964eb0afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52644/0 (socket says 172.21.15.152:52644) 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f548e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 0x55964eb202d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51718/0 (socket says 172.21.15.152:51718) 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f4c8d640 1 -- 172.21.15.152:0/3390921341 learned_addr learned my addr 172.21.15.152:0/3390921341 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24effff640 1 --2- 172.21.15.152:0/3390921341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb02f90 0x55964eb1fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f4c8d640 1 -- 172.21.15.152:0/3390921341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb02f90 msgr2=0x55964eb1fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/3390921341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb02f90 0x55964eb1fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f4c8d640 1 -- 172.21.15.152:0/3390921341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 msgr2=0x55964eb202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/3390921341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 0x55964eb202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f4c8d640 1 -- 172.21.15.152:0/3390921341 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55964eafa100 con 0x55964eaff280 2024-09-11T22:19:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/3390921341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eaff280 0x55964eb0afc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f24e0010740 tx=0x7f24e0011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72343f79bf9784a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24e67fc640 1 -- 172.21.15.152:0/3390921341 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e0023040 con 0x55964eaff280 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24e67fc640 1 -- 172.21.15.152:0/3390921341 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24e0036030 con 0x55964eaff280 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.947+0000 7f24e67fc640 1 -- 172.21.15.152:0/3390921341 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e001fd30 con 0x55964eaff280 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.950+0000 7f24f9c8c740 1 -- 172.21.15.152:0/3390921341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eaff280 msgr2=0x55964eb0afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.950+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/3390921341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eaff280 0x55964eb0afc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f24e0010740 tx=0x7f24e0011900 comp rx=0 tx=0).stop 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.950+0000 7f24f9c8c740 1 -- 172.21.15.152:0/3390921341 shutdown_connections 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.950+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/3390921341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 0x55964eb202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.950+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/3390921341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eb02f90 0x55964eb1fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.950+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/3390921341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eaff280 0x55964eb0afc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.950+0000 7f24f9c8c740 1 -- 172.21.15.152:0/3390921341 >> 172.21.15.152:0/3390921341 conn(0x55964eb1e5c0 msgr2=0x55964eb0a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.950+0000 7f24f9c8c740 1 -- 172.21.15.152:0/3390921341 shutdown_connections 2024-09-11T22:19:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.950+0000 7f24f9c8c740 1 -- 172.21.15.152:0/3390921341 wait complete. 2024-09-11T22:19:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.950+0000 7f24f9c8c740 1 -- start start 2024-09-11T22:19:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 1 Processor -- start 2024-09-11T22:19:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eaff280 0x55964eb16ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb02f90 0x55964eb17010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 0x55964eb175b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24f0072060 con 0x55964eb043c0 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f548e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 0x55964eb175b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f548e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 0x55964eb175b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51730/0 (socket says 172.21.15.152:51730) 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f548e640 1 -- 172.21.15.152:0/2967603028 learned_addr learned my addr 172.21.15.152:0/2967603028 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24effff640 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb02f90 0x55964eb17010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 1 -- 172.21.15.152:0/2967603028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24f00734d0 con 0x55964eaff280 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 1 -- 172.21.15.152:0/2967603028 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f24f0072730 con 0x55964eb02f90 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eaff280 0x55964eb16ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 10 client.0 _ll_register_callbacks cb 0x7f24e0010b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24effff640 1 -- 172.21.15.152:0/2967603028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eaff280 msgr2=0x55964eb16ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24effff640 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eaff280 0x55964eb16ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24effff640 1 -- 172.21.15.152:0/2967603028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 msgr2=0x55964eb175b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24effff640 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 0x55964eb175b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24effff640 1 -- 172.21.15.152:0/2967603028 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55964eb072c0 con 0x55964eb02f90 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f548e640 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 0x55964eb175b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24effff640 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb02f90 0x55964eb17010 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f24d80306c0 tx=0x7f24d800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be114f734cabe20a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24cffff640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24cffff640 1 -- 172.21.15.152:0/2967603028 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d80db060 con 0x55964eb02f90 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24cffff640 1 -- 172.21.15.152:0/2967603028 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f24d80b9bb0 con 0x55964eb02f90 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 1 -- 172.21.15.152:0/2967603028 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24e0036030 con 0x55964eb02f90 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24cffff640 1 -- 172.21.15.152:0/2967603028 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f24d80cd050 con 0x55964eb02f90 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 10 client.28543 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 1 -- 172.21.15.152:0/2967603028 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55964eb085d0 con 0x55964eb02f90 2024-09-11T22:19:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24cffff640 1 -- 172.21.15.152:0/2967603028 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24e0036030 con 0x55964eb02f90 2024-09-11T22:19:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24cffff640 1 -- 172.21.15.152:0/2967603028 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f24d80ee9f0 con 0x55964eb02f90 2024-09-11T22:19:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 10 client.28543 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 10 client.28543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 20 client.28543 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55964eb1e9a0 0x55964eb8b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 4 client.28543 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:19:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f9c8c740 1 -- 172.21.15.152:0/2967603028 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55964ea74a20 con 0x55964eb1e9a0 2024-09-11T22:19:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55964eb1e9a0 0x55964eb8b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24cffff640 10 client.28543 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.951+0000 7f24f4c8d640 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55964eb1e9a0 0x55964eb8b6a0 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ace29ca5efc69d6 server_cookie=27db00621680ee82 in_seq=0 out_seq=0 2024-09-11T22:19:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24cffff640 1 -- 172.21.15.152:0/2967603028 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55964ea74a20 con 0x55964eb1e9a0 2024-09-11T22:19:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24cffff640 10 client.28543 handle_command_reply: tid=0 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 1 client.28543 shutdown 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 1 -- 172.21.15.152:0/2967603028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb02f90 msgr2=0x55964eb17010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb02f90 0x55964eb17010 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f24d80306c0 tx=0x7f24d800b040 comp rx=0 tx=0).stop 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 1 -- 172.21.15.152:0/2967603028 shutdown_connections 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55964eb1e9a0 0x55964eb8b6a0 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55964eb043c0 0x55964eb175b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55964eb02f90 0x55964eb17010 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24cffff640 0 client.28543 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 1 --2- 172.21.15.152:0/2967603028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55964eaff280 0x55964eb16ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 1 -- 172.21.15.152:0/2967603028 >> 172.21.15.152:0/2967603028 conn(0x55964eb1e5c0 msgr2=0x55964eb09ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 1 -- 172.21.15.152:0/2967603028 shutdown_connections 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 1 -- 172.21.15.152:0/2967603028 wait complete. 2024-09-11T22:19:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24f9c8c740 20 client.28543 trim_cache size 0 max 16384 2024-09-11T22:19:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:19:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:19:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:19:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:19:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 -- 172.21.15.152:0/4273960697 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24dc0a2f80 msgr2=0x7f24dc0a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24dc0a2f80 0x7f24dc0a5440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009aa0 tx=0x7f24e0005f90 comp rx=0 tx=0).stop 2024-09-11T22:19:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 -- 172.21.15.152:0/4273960697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f0101390 msgr2=0x7f24f0114f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f0101390 0x7f24f0114f30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009850 tx=0x7f24d8030650 comp rx=0 tx=0).stop 2024-09-11T22:19:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 -- 172.21.15.152:0/4273960697 shutdown_connections 2024-09-11T22:19:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f24dc0a2f80 0x7f24dc0a5440 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f24f0105ea0 0x7f24f010da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f0101390 0x7f24f0114f30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 --2- 172.21.15.152:0/4273960697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f0100a70 0x7f24f01149f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 -- 172.21.15.152:0/4273960697 >> 172.21.15.152:0/4273960697 conn(0x7f24f0077990 msgr2=0x7f24f00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 -- 172.21.15.152:0/4273960697 shutdown_connections 2024-09-11T22:19:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:22.975+0000 7f24e77fe640 1 -- 172.21.15.152:0/4273960697 wait complete. 2024-09-11T22:19:22.985 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:22 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:19:22.985 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:22 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:19:22.985 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:22 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:19:22.985 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:22 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:19:22.985 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:22 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:19:22.985 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:22 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:19:23.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:22 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:19:23.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:22 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:19:23.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:22 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:19:23.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:22 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:19:23.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:22 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:19:23.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:22 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:19:23.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:22 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:19:23.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:22 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:19:23.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:22 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:19:23.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:22 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:19:23.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:22 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:19:23.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:22 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:19:23.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.211+0000 7ff5aa173640 1 -- 172.21.15.152:0/2613305287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a41008c0 msgr2=0x7ff5a4100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:23.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.211+0000 7ff5aa173640 1 --2- 172.21.15.152:0/2613305287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a41008c0 0x7ff5a4100ca0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff594009900 tx=0x7ff59402a410 comp rx=0 tx=0).stop 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.211+0000 7ff5aa173640 1 -- 172.21.15.152:0/2613305287 shutdown_connections 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.211+0000 7ff5aa173640 1 --2- 172.21.15.152:0/2613305287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a4105ec0 0x7ff5a4106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.211+0000 7ff5aa173640 1 --2- 172.21.15.152:0/2613305287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5a41011e0 0x7ff5a4105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.211+0000 7ff5aa173640 1 --2- 172.21.15.152:0/2613305287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a41008c0 0x7ff5a4100ca0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.211+0000 7ff5aa173640 1 -- 172.21.15.152:0/2613305287 >> 172.21.15.152:0/2613305287 conn(0x7ff5a40fc7d0 msgr2=0x7ff5a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.211+0000 7ff5aa173640 1 -- 172.21.15.152:0/2613305287 shutdown_connections 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.211+0000 7ff5aa173640 1 -- 172.21.15.152:0/2613305287 wait complete. 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.212+0000 7ff5aa173640 1 Processor -- start 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.212+0000 7ff5aa173640 1 -- start start 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.212+0000 7ff5aa173640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5a41008c0 0x7ff5a41a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5aa173640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a41011e0 0x7ff5a41a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5aa173640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a4105ec0 0x7ff5a419ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5aa173640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a4118610 con 0x7ff5a4105ec0 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5aa173640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a4118490 con 0x7ff5a41011e0 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5aa173640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a4118790 con 0x7ff5a41008c0 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a4105ec0 0x7ff5a419ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a41011e0 0x7ff5a41a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a4105ec0 0x7ff5a419ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51748/0 (socket says 172.21.15.152:51748) 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a41011e0 0x7ff5a41a4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37464/0 (socket says 172.21.15.152:37464) 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a3fff640 1 -- 172.21.15.152:0/93499173 learned_addr learned my addr 172.21.15.152:0/93499173 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a37fe640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5a41008c0 0x7ff5a41a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a3fff640 1 -- 172.21.15.152:0/93499173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5a41008c0 msgr2=0x7ff5a41a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a3fff640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5a41008c0 0x7ff5a41a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a3fff640 1 -- 172.21.15.152:0/93499173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a41011e0 msgr2=0x7ff5a41a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a3fff640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a41011e0 0x7ff5a41a4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a3fff640 1 -- 172.21.15.152:0/93499173 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a419f130 con 0x7ff5a4105ec0 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a37fe640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5a41008c0 0x7ff5a41a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a3fff640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a4105ec0 0x7ff5a419ea00 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00eb10 tx=0x7ff59c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.213+0000 7ff5a17fa640 1 -- 172.21.15.152:0/93499173 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c004b20 con 0x7ff5a4105ec0 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.214+0000 7ff5a17fa640 1 -- 172.21.15.152:0/93499173 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff59c004cc0 con 0x7ff5a4105ec0 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.214+0000 7ff5aa173640 1 -- 172.21.15.152:0/93499173 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a419f420 con 0x7ff5a4105ec0 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.214+0000 7ff5a17fa640 1 -- 172.21.15.152:0/93499173 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c010760 con 0x7ff5a4105ec0 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.214+0000 7ff5aa173640 1 -- 172.21.15.152:0/93499173 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a41ab710 con 0x7ff5a4105ec0 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.216+0000 7ff5a17fa640 1 -- 172.21.15.152:0/93499173 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff59c005020 con 0x7ff5a4105ec0 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.216+0000 7ff5ac54c740 1 Processor -- start 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.216+0000 7ff5ac54c740 1 -- start start 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.216+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 0x563d5b6d9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.216+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.216+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6e4680 0x563d5b6e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563d5b63f2e0 con 0x563d5b6e4680 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563d5b5e6ce0 con 0x563d5b6d94a0 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563d5b63b2a0 con 0x563d5b6d9dc0 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5a37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5a37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52674/0 (socket says 172.21.15.152:52674) 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5a37fe640 1 -- 172.21.15.152:0/2017128942 learned_addr learned my addr 172.21.15.152:0/2017128942 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff59bfff640 1 --2- 172.21.15.152:0/2017128942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6e4680 0x563d5b6e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff59bfff640 1 --2- 172.21.15.152:0/2017128942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 0x563d5b6d9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5a37fe640 1 -- 172.21.15.152:0/2017128942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 msgr2=0x563d5b6d9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5a37fe640 1 --2- 172.21.15.152:0/2017128942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 0x563d5b6d9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5a37fe640 1 -- 172.21.15.152:0/2017128942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6e4680 msgr2=0x563d5b6e6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5a37fe640 1 --2- 172.21.15.152:0/2017128942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6e4680 0x563d5b6e6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5a37fe640 1 -- 172.21.15.152:0/2017128942 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d5b5cb440 con 0x563d5b6d9dc0 2024-09-11T22:19:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5a17fa640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5900a2cf0 0x7ff5900a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5a37fe640 1 --2- 172.21.15.152:0/2017128942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e4140 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff594009900 tx=0x7ff5940040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39bad31fca0b25c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff5a17fa640 1 -- 172.21.15.152:0/93499173 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7ff59c0cfa50 con 0x7ff5a4105ec0 2024-09-11T22:19:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.217+0000 7ff59bfff640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5900a2cf0 0x7ff5900a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.218+0000 7ff599ffb640 1 -- 172.21.15.152:0/2017128942 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594035030 con 0x563d5b6d9dc0 2024-09-11T22:19:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.218+0000 7ff599ffb640 1 -- 172.21.15.152:0/2017128942 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff594004430 con 0x563d5b6d9dc0 2024-09-11T22:19:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.218+0000 7ff599ffb640 1 -- 172.21.15.152:0/2017128942 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5940035f0 con 0x563d5b6d9dc0 2024-09-11T22:19:23.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.219+0000 7ff5ac54c740 1 -- 172.21.15.152:0/2017128942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 msgr2=0x563d5b6e4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:23.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.219+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/2017128942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e4140 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff594009900 tx=0x7ff5940040c0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.219+0000 7ff59bfff640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5900a2cf0 0x7ff5900a51b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x563d5b6d6db0 tx=0x7ff58c015040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:23.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.219+0000 7ff5ac54c740 1 -- 172.21.15.152:0/2017128942 shutdown_connections 2024-09-11T22:19:23.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.219+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/2017128942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6e4680 0x563d5b6e6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.219+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/2017128942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e4140 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.219+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/2017128942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 0x563d5b6d9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.219+0000 7ff5ac54c740 1 -- 172.21.15.152:0/2017128942 >> 172.21.15.152:0/2017128942 conn(0x563d5b6d5a30 msgr2=0x563d5b6d5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.221+0000 7ff5ac54c740 1 -- 172.21.15.152:0/2017128942 shutdown_connections 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.221+0000 7ff5ac54c740 1 -- 172.21.15.152:0/2017128942 wait complete. 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.222+0000 7ff5ac54c740 1 -- start start 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.222+0000 7ff5ac54c740 1 Processor -- start 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.222+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d94a0 0x563d5b6e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.222+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.222+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6e4680 0x563d5b6e1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.222+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563d5b6e7250 con 0x563d5b6d94a0 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.222+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563d5b5fa050 con 0x563d5b6e4680 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.222+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563d5b6e73d0 con 0x563d5b6d9dc0 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.222+0000 7ff5ac54c740 10 client.0 _ll_register_callbacks cb 0x563d5b63a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:23.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff5a37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d94a0 0x563d5b6e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52680/0 (socket says 172.21.15.152:52680) 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff59bfff640 1 -- 172.21.15.152:0/3998658642 learned_addr learned my addr 172.21.15.152:0/3998658642 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff5a3fff640 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6e4680 0x563d5b6e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff59bfff640 1 -- 172.21.15.152:0/3998658642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6e4680 msgr2=0x563d5b6e1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff59bfff640 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6e4680 0x563d5b6e1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff59bfff640 1 -- 172.21.15.152:0/3998658642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d94a0 msgr2=0x563d5b6e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff59bfff640 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d94a0 0x563d5b6e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff59bfff640 1 -- 172.21.15.152:0/3998658642 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d5b3b03c0 con 0x563d5b6d9dc0 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff59bfff640 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e11d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00eba0 tx=0x7ff58c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b80acbbeb96d244 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff582ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff582ffd640 1 -- 172.21.15.152:0/3998658642 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c021970 con 0x563d5b6d9dc0 2024-09-11T22:19:23.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff5ac54c740 1 -- 172.21.15.152:0/3998658642 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff594004430 con 0x563d5b6d9dc0 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.223+0000 7ff582ffd640 1 -- 172.21.15.152:0/3998658642 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7ff58c021b10 con 0x563d5b6d9dc0 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff582ffd640 1 -- 172.21.15.152:0/3998658642 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff58c021d10 con 0x563d5b6d9dc0 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff5ac54c740 10 client.28555 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff5ac54c740 1 -- 172.21.15.152:0/3998658642 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563d5b6f2bd0 con 0x563d5b6d9dc0 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff582ffd640 1 -- 172.21.15.152:0/3998658642 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff594004430 con 0x563d5b6d9dc0 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff582ffd640 1 -- 172.21.15.152:0/3998658642 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff58c022530 con 0x563d5b6d9dc0 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff5ac54c740 10 client.28555 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff5ac54c740 10 client.28555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff5ac54c740 20 client.28555 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563d5b6f4090 0x563d5b6f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff5ac54c740 4 client.28555 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff5ac54c740 1 -- 172.21.15.152:0/3998658642 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d5b64c850 con 0x563d5b6f4090 2024-09-11T22:19:23.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.224+0000 7ff5a37fe640 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563d5b6f4090 0x563d5b6f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.225+0000 7ff5a37fe640 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563d5b6f4090 0x563d5b6f64f0 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd29015f49916564 server_cookie=f1c8491a61517b4e in_seq=0 out_seq=0 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.225+0000 7ff582ffd640 10 client.28555 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.225+0000 7ff582ffd640 1 -- 172.21.15.152:0/3998658642 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d5b64c850 con 0x563d5b6f4090 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.225+0000 7ff582ffd640 10 client.28555 handle_command_reply: tid=0 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.225+0000 7ff5ac54c740 1 client.28555 shutdown 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff5ac54c740 1 -- 172.21.15.152:0/3998658642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 msgr2=0x563d5b6e11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e11d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00eba0 tx=0x7ff58c005f90 comp rx=0 tx=0).stop 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff5ac54c740 1 -- 172.21.15.152:0/3998658642 shutdown_connections 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563d5b6f4090 0x563d5b6f64f0 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6e4680 0x563d5b6e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d9dc0 0x563d5b6e11d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/3998658642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d94a0 0x563d5b6e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff5ac54c740 1 -- 172.21.15.152:0/3998658642 >> 172.21.15.152:0/3998658642 conn(0x563d5b6d5a30 msgr2=0x563d5b6db710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:23.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff582ffd640 0 client.28555 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:23.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff5ac54c740 1 -- 172.21.15.152:0/3998658642 shutdown_connections 2024-09-11T22:19:23.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff5ac54c740 1 -- 172.21.15.152:0/3998658642 wait complete. 2024-09-11T22:19:23.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.226+0000 7ff5ac54c740 20 client.28555 trim_cache size 0 max 16384 2024-09-11T22:19:23.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.247+0000 7ff5ac54c740 1 Processor -- start 2024-09-11T22:19:23.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.247+0000 7ff5ac54c740 1 -- start start 2024-09-11T22:19:23.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.247+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d5a30 0x563d5b6e3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.247+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 0x563d5b6fbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.247+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d9dc0 0x563d5b6fc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.247+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a41b6850 con 0x563d5b6d9dc0 2024-09-11T22:19:23.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.247+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a41b4120 con 0x563d5b6d94a0 2024-09-11T22:19:23.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.247+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a41b1f90 con 0x563d5b6d5a30 2024-09-11T22:19:23.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 0x563d5b6fbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff5a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d9dc0 0x563d5b6fc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff5a37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d5a30 0x563d5b6e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 0x563d5b6fbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37494/0 (socket says 172.21.15.152:37494) 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff5a3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d9dc0 0x563d5b6fc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51790/0 (socket says 172.21.15.152:51790) 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff59bfff640 1 -- 172.21.15.152:0/131270541 learned_addr learned my addr 172.21.15.152:0/131270541 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff59bfff640 1 -- 172.21.15.152:0/131270541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d5a30 msgr2=0x563d5b6e3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff59bfff640 1 --2- 172.21.15.152:0/131270541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d5a30 0x563d5b6e3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff59bfff640 1 -- 172.21.15.152:0/131270541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d9dc0 msgr2=0x563d5b6fc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff59bfff640 1 --2- 172.21.15.152:0/131270541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d9dc0 0x563d5b6fc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff59bfff640 1 -- 172.21.15.152:0/131270541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d5b6e4290 con 0x563d5b6d94a0 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff59bfff640 1 --2- 172.21.15.152:0/131270541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 0x563d5b6fbdc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff58c022950 tx=0x7ff58c0213a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1945fce01ed8303 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:23.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff5997fa640 1 -- 172.21.15.152:0/131270541 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c038070 con 0x563d5b6d94a0 2024-09-11T22:19:23.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff5997fa640 1 -- 172.21.15.152:0/131270541 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff58c022dc0 con 0x563d5b6d94a0 2024-09-11T22:19:23.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.248+0000 7ff5997fa640 1 -- 172.21.15.152:0/131270541 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c004330 con 0x563d5b6d94a0 2024-09-11T22:19:23.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.249+0000 7ff5ac54c740 1 -- 172.21.15.152:0/131270541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 msgr2=0x563d5b6fbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:23.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.249+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/131270541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 0x563d5b6fbdc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff58c022950 tx=0x7ff58c0213a0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.249+0000 7ff5ac54c740 1 -- 172.21.15.152:0/131270541 shutdown_connections 2024-09-11T22:19:23.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.249+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/131270541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d9dc0 0x563d5b6fc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.249+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/131270541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d94a0 0x563d5b6fbdc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.249+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/131270541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d5a30 0x563d5b6e3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.249+0000 7ff5ac54c740 1 -- 172.21.15.152:0/131270541 >> 172.21.15.152:0/131270541 conn(0x563d5b6e1870 msgr2=0x563d5b6e2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.249+0000 7ff5ac54c740 1 -- 172.21.15.152:0/131270541 shutdown_connections 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.249+0000 7ff5ac54c740 1 -- 172.21.15.152:0/131270541 wait complete. 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.250+0000 7ff5ac54c740 1 -- start start 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.250+0000 7ff5ac54c740 1 Processor -- start 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.250+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d5a30 0x563d5b6ecec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.250+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d94a0 0x563d5b6ea210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.250+0000 7ff5ac54c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d9dc0 0x563d5b6ea9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.250+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a41b25e0 con 0x563d5b6d5a30 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.250+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a41b3a50 con 0x563d5b6d9dc0 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.250+0000 7ff5ac54c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a41b2cb0 con 0x563d5b6d94a0 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff5ac54c740 10 client.0 _ll_register_callbacks cb 0x7ff58c010f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff5a3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d9dc0 0x563d5b6ea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d94a0 0x563d5b6ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d94a0 0x563d5b6ea210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52700/0 (socket says 172.21.15.152:52700) 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff5a3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d9dc0 0x563d5b6ea9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37506/0 (socket says 172.21.15.152:37506) 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff59bfff640 1 -- 172.21.15.152:0/1441854889 learned_addr learned my addr 172.21.15.152:0/1441854889 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff5a37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d5a30 0x563d5b6ecec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff59bfff640 1 -- 172.21.15.152:0/1441854889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d9dc0 msgr2=0x563d5b6ea9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff59bfff640 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d9dc0 0x563d5b6ea9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff59bfff640 1 -- 172.21.15.152:0/1441854889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d5a30 msgr2=0x563d5b6ecec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff59bfff640 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d5a30 0x563d5b6ecec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff59bfff640 1 -- 172.21.15.152:0/1441854889 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d5b75dda0 con 0x563d5b6d94a0 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff5a3fff640 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d9dc0 0x563d5b6ea9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff59bfff640 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d94a0 0x563d5b6ea210 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00eba0 tx=0x7ff58c021b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=565a38f8a13d0081 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff582ffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff582ffd640 1 -- 172.21.15.152:0/1441854889 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c038070 con 0x563d5b6d94a0 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff5ac54c740 1 -- 172.21.15.152:0/1441854889 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff58c022dc0 con 0x563d5b6d94a0 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff582ffd640 1 -- 172.21.15.152:0/1441854889 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7ff58c004030 con 0x563d5b6d94a0 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff582ffd640 1 -- 172.21.15.152:0/1441854889 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff58c04a050 con 0x563d5b6d94a0 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff5ac54c740 10 client.28561 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.251+0000 7ff5ac54c740 1 -- 172.21.15.152:0/1441854889 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563d5b75ef00 con 0x563d5b6d94a0 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.252+0000 7ff582ffd640 1 -- 172.21.15.152:0/1441854889 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff58c022dc0 con 0x563d5b6d94a0 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.252+0000 7ff582ffd640 1 -- 172.21.15.152:0/1441854889 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7ff58c045030 con 0x563d5b6d94a0 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.252+0000 7ff5ac54c740 10 client.28561 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.252+0000 7ff5ac54c740 10 client.28561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.252+0000 7ff5ac54c740 20 client.28561 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.252+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563d5b6e4680 0x563d5b7615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.252+0000 7ff5ac54c740 4 client.28561 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.252+0000 7ff5ac54c740 1 -- 172.21.15.152:0/1441854889 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563d5b646d60 con 0x563d5b6e4680 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.252+0000 7ff5a37fe640 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563d5b6e4680 0x563d5b7615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.252+0000 7ff582ffd640 10 client.28561 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5a37fe640 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563d5b6e4680 0x563d5b7615d0 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae460db03943c4d3 server_cookie=f3eb52606d30fdbb in_seq=0 out_seq=0 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff582ffd640 1 -- 172.21.15.152:0/1441854889 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563d5b646d60 con 0x563d5b6e4680 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff582ffd640 10 client.28561 handle_command_reply: tid=0 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 1 client.28561 shutdown 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 1 -- 172.21.15.152:0/1441854889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d94a0 msgr2=0x563d5b6ea210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d94a0 0x563d5b6ea210 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00eba0 tx=0x7ff58c021b00 comp rx=0 tx=0).stop 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 1 -- 172.21.15.152:0/1441854889 shutdown_connections 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x563d5b6e4680 0x563d5b7615d0 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b6d9dc0 0x563d5b6ea9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d5b6d94a0 0x563d5b6ea210 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 1 --2- 172.21.15.152:0/1441854889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563d5b6d5a30 0x563d5b6ecec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 1 -- 172.21.15.152:0/1441854889 >> 172.21.15.152:0/1441854889 conn(0x563d5b6e1870 msgr2=0x563d5b6e3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff582ffd640 0 client.28561 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 1 -- 172.21.15.152:0/1441854889 shutdown_connections 2024-09-11T22:19:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 1 -- 172.21.15.152:0/1441854889 wait complete. 2024-09-11T22:19:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.253+0000 7ff5ac54c740 20 client.28561 trim_cache size 0 max 16384 2024-09-11T22:19:23.260 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:19:23.260 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:19:23.261 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:19:23.261 INFO:teuthology.orchestra.run.smithi152.stdout: "3c9941f0-cec9-45eb-9e12-c6bc054cd07c": { 2024-09-11T22:19:23.261 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:19:23.261 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "3c9941f0-cec9-45eb-9e12-c6bc054cd07c", 2024-09-11T22:19:23.261 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:19:23.261 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:19:23.261 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:19:23.261 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:19:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 -- 172.21.15.152:0/93499173 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5900a2cf0 msgr2=0x7ff5900a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5900a2cf0 0x7ff5900a51b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x563d5b6d6db0 tx=0x7ff58c015040 comp rx=0 tx=0).stop 2024-09-11T22:19:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 -- 172.21.15.152:0/93499173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a4105ec0 msgr2=0x7ff5a419ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a4105ec0 0x7ff5a419ea00 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00eb10 tx=0x7ff59c00c2d0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 -- 172.21.15.152:0/93499173 shutdown_connections 2024-09-11T22:19:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7ff5900a2cf0 0x7ff5900a51b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a4105ec0 0x7ff5a419ea00 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a41011e0 0x7ff5a41a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 --2- 172.21.15.152:0/93499173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5a41008c0 0x7ff5a41a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 -- 172.21.15.152:0/93499173 >> 172.21.15.152:0/93499173 conn(0x7ff5a40fc7d0 msgr2=0x7ff5a4103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:23.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 -- 172.21.15.152:0/93499173 shutdown_connections 2024-09-11T22:19:23.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:23.254+0000 7ff5aa173640 1 -- 172.21.15.152:0/93499173 wait complete. 2024-09-11T22:19:23.967 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:23 smithi152 ceph-mon[31188]: pgmap v474: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 6.3 MiB/s wr, 669 op/s 2024-09-11T22:19:24.010 INFO:tasks.cephfs.filesystem:scrub status for tag:3c9941f0-cec9-45eb-9e12-c6bc054cd07c - {'path': '/', 'tag': '3c9941f0-cec9-45eb-9e12-c6bc054cd07c', 'options': 'recursive,force'} 2024-09-11T22:19:24.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:23 smithi179 ceph-mon[35603]: pgmap v474: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 6.3 MiB/s wr, 669 op/s 2024-09-11T22:19:24.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:23 smithi193 ceph-mon[35545]: pgmap v474: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 6.3 MiB/s wr, 669 op/s 2024-09-11T22:19:24.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 830.0 s, 1552.0 tps, lat 64.157 ms stddev 74.156 2024-09-11T22:19:26.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:25 smithi179 ceph-mon[35603]: pgmap v475: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.5 MiB/s wr, 693 op/s 2024-09-11T22:19:26.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:25 smithi193 ceph-mon[35545]: pgmap v475: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.5 MiB/s wr, 693 op/s 2024-09-11T22:19:26.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:25 smithi152 ceph-mon[31188]: pgmap v475: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.5 MiB/s wr, 693 op/s 2024-09-11T22:19:28.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:27 smithi179 ceph-mon[35603]: pgmap v476: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.5 MiB/s wr, 693 op/s 2024-09-11T22:19:28.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:27 smithi193 ceph-mon[35545]: pgmap v476: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.5 MiB/s wr, 693 op/s 2024-09-11T22:19:28.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:27 smithi152 ceph-mon[31188]: pgmap v476: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.5 MiB/s wr, 693 op/s 2024-09-11T22:19:29.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:28 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:19:29.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:28 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:19:29.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:28 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:19:29.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 835.0 s, 2042.4 tps, lat 49.346 ms stddev 56.868 2024-09-11T22:19:30.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:30 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:19:30.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:30 smithi179 ceph-mon[35603]: pgmap v477: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 681 op/s 2024-09-11T22:19:30.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:30 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:19:30.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:30 smithi193 ceph-mon[35545]: pgmap v477: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 681 op/s 2024-09-11T22:19:30.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:30 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:19:30.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:30 smithi152 ceph-mon[31188]: pgmap v477: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 681 op/s 2024-09-11T22:19:32.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:31 smithi179 ceph-mon[35603]: pgmap v478: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.4 MiB/s wr, 682 op/s 2024-09-11T22:19:32.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:31 smithi193 ceph-mon[35545]: pgmap v478: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.4 MiB/s wr, 682 op/s 2024-09-11T22:19:32.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:31 smithi152 ceph-mon[31188]: pgmap v478: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.4 MiB/s wr, 682 op/s 2024-09-11T22:19:34.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:33 smithi179 ceph-mon[35603]: pgmap v479: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.7 MiB/s wr, 597 op/s 2024-09-11T22:19:34.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:33 smithi193 ceph-mon[35545]: pgmap v479: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.7 MiB/s wr, 597 op/s 2024-09-11T22:19:34.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:33 smithi152 ceph-mon[31188]: pgmap v479: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.7 MiB/s wr, 597 op/s 2024-09-11T22:19:34.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 840.0 s, 2877.2 tps, lat 34.447 ms stddev 40.974 2024-09-11T22:19:36.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:35 smithi179 ceph-mon[35603]: pgmap v480: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.7 MiB/s wr, 890 op/s 2024-09-11T22:19:36.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:35 smithi193 ceph-mon[35545]: pgmap v480: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.7 MiB/s wr, 890 op/s 2024-09-11T22:19:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.092+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/1652599529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78074590 msgr2=0x7f6c78074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.092+0000 7f6c7cf5f640 1 --2- 172.21.15.152:0/1652599529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78074590 0x7f6c78074970 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009be0 tx=0x7f6c7002a750 comp rx=0 tx=0).stop 2024-09-11T22:19:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.092+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/1652599529 shutdown_connections 2024-09-11T22:19:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.092+0000 7f6c7cf5f640 1 --2- 172.21.15.152:0/1652599529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c78112ae0 0x7f6c78114ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.092+0000 7f6c7cf5f640 1 --2- 172.21.15.152:0/1652599529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c78074eb0 0x7f6c781125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.092+0000 7f6c7cf5f640 1 --2- 172.21.15.152:0/1652599529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78074590 0x7f6c78074970 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.092+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/1652599529 >> 172.21.15.152:0/1652599529 conn(0x7f6c780fd7b0 msgr2=0x7f6c780ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.092+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/1652599529 shutdown_connections 2024-09-11T22:19:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.092+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/1652599529 wait complete. 2024-09-11T22:19:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c7cf5f640 1 Processor -- start 2024-09-11T22:19:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c7cf5f640 1 -- start start 2024-09-11T22:19:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c7cf5f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c78074590 0x7f6c781a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c7cf5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78074eb0 0x7f6c781a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c7cf5f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c78112ae0 0x7f6c7819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c7cf5f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78118450 con 0x7f6c78074590 2024-09-11T22:19:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c7cf5f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781182d0 con 0x7f6c78074eb0 2024-09-11T22:19:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c7cf5f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781185d0 con 0x7f6c78112ae0 2024-09-11T22:19:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c7659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c78074590 0x7f6c781a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c7659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c78074590 0x7f6c781a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33648/0 (socket says 172.21.15.152:33648) 2024-09-11T22:19:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c7659c640 1 -- 172.21.15.152:0/333376887 learned_addr learned my addr 172.21.15.152:0/333376887 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c75d9b640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78074eb0 0x7f6c781a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.093+0000 7f6c76d9d640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c78112ae0 0x7f6c7819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.094+0000 7f6c7659c640 1 -- 172.21.15.152:0/333376887 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c78112ae0 msgr2=0x7f6c7819e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.094+0000 7f6c7659c640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c78112ae0 0x7f6c7819e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.094+0000 7f6c7659c640 1 -- 172.21.15.152:0/333376887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78074eb0 msgr2=0x7f6c781a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.094+0000 7f6c7659c640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78074eb0 0x7f6c781a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.094+0000 7f6c7659c640 1 -- 172.21.15.152:0/333376887 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7819efb0 con 0x7f6c78074590 2024-09-11T22:19:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.094+0000 7f6c7659c640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c78074590 0x7f6c781a4670 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f6c70000f80 tx=0x7f6c70030630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.094+0000 7f6c677fe640 1 -- 172.21.15.152:0/333376887 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70041020 con 0x7f6c78074590 2024-09-11T22:19:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.094+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/333376887 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7819f240 con 0x7f6c78074590 2024-09-11T22:19:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.094+0000 7f6c677fe640 1 -- 172.21.15.152:0/333376887 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c70037040 con 0x7f6c78074590 2024-09-11T22:19:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.094+0000 7f6c677fe640 1 -- 172.21.15.152:0/333376887 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70036070 con 0x7f6c78074590 2024-09-11T22:19:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.095+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/333376887 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c781ab4c0 con 0x7f6c78074590 2024-09-11T22:19:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.097+0000 7f6c7fdd4740 1 Processor -- start 2024-09-11T22:19:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.097+0000 7f6c677fe640 1 -- 172.21.15.152:0/333376887 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f6c70044020 con 0x7f6c78074590 2024-09-11T22:19:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.097+0000 7f6c7fdd4740 1 -- start start 2024-09-11T22:19:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.097+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2cdeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.097+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdf410 0x55fac2ce9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.097+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce9cb0 0x55fac2cec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.097+0000 7f6c7fdd4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fac2c432f0 con 0x55fac2cdeaf0 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.097+0000 7f6c7fdd4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fac2beb270 con 0x55fac2ce9cb0 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.097+0000 7f6c7fdd4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fac2c3f2b0 con 0x55fac2cdf410 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c7659c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdf410 0x55fac2ce9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c76d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2cdeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c76d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2cdeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33656/0 (socket says 172.21.15.152:33656) 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c76d9d640 1 -- 172.21.15.152:0/289107280 learned_addr learned my addr 172.21.15.152:0/289107280 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c75d9b640 1 --2- 172.21.15.152:0/289107280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce9cb0 0x55fac2cec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c7659c640 1 -- 172.21.15.152:0/289107280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce9cb0 msgr2=0x55fac2cec0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c677fe640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c600a2da0 0x7f6c600a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c7659c640 1 --2- 172.21.15.152:0/289107280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce9cb0 0x55fac2cec0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c7659c640 1 -- 172.21.15.152:0/289107280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 msgr2=0x55fac2cdeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c7659c640 1 --2- 172.21.15.152:0/289107280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2cdeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c7659c640 1 -- 172.21.15.152:0/289107280 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac2bea340 con 0x55fac2cdf410 2024-09-11T22:19:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c76d9d640 1 --2- 172.21.15.152:0/289107280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2cdeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c76d9d640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c600a2da0 0x7f6c600a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c677fe640 1 -- 172.21.15.152:0/333376887 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f6c700f0070 con 0x7f6c78074590 2024-09-11T22:19:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c7659c640 1 --2- 172.21.15.152:0/289107280 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdf410 0x55fac2ce9770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6c700ed760 tx=0x7f6c700b8600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89fb1938e07fce8e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.098+0000 7f6c64ff9640 1 -- 172.21.15.152:0/289107280 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700dc040 con 0x55fac2cdf410 2024-09-11T22:19:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.099+0000 7f6c64ff9640 1 -- 172.21.15.152:0/289107280 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c70030820 con 0x55fac2cdf410 2024-09-11T22:19:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.099+0000 7f6c64ff9640 1 -- 172.21.15.152:0/289107280 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700bc070 con 0x55fac2cdf410 2024-09-11T22:19:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.100+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/289107280 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdf410 msgr2=0x55fac2ce9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.100+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/289107280 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdf410 0x55fac2ce9770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6c700ed760 tx=0x7f6c700b8600 comp rx=0 tx=0).stop 2024-09-11T22:19:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.100+0000 7f6c76d9d640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c600a2da0 0x7f6c600a5260 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0104f0 tx=0x7f6c6c0046c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.101+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/289107280 shutdown_connections 2024-09-11T22:19:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.101+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/289107280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce9cb0 0x55fac2cec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.101+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/289107280 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdf410 0x55fac2ce9770 secure :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6c700ed760 tx=0x7f6c700b8600 comp rx=0 tx=0).stop 2024-09-11T22:19:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.101+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/289107280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2cdeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.101+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/289107280 >> 172.21.15.152:0/289107280 conn(0x55fac2cdb060 msgr2=0x55fac2cdb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.101+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/289107280 shutdown_connections 2024-09-11T22:19:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.101+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/289107280 wait complete. 2024-09-11T22:19:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c7fdd4740 1 -- start start 2024-09-11T22:19:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c7fdd4740 1 Processor -- start 2024-09-11T22:19:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2ce6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 0x55fac2ce7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2cf5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c7fdd4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fac2cec640 con 0x55fac2cdeaf0 2024-09-11T22:19:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c7fdd4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fac2bcc290 con 0x55fac2ce7880 2024-09-11T22:19:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c7fdd4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fac2cec7c0 con 0x55fac2ce9cb0 2024-09-11T22:19:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c7fdd4740 10 client.0 _ll_register_callbacks cb 0x55fac2bfd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c76d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2cf5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c76d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2cf5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:45890/0 (socket says 172.21.15.152:45890) 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c76d9d640 1 -- 172.21.15.152:0/1470474529 learned_addr learned my addr 172.21.15.152:0/1470474529 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c75d9b640 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 0x55fac2ce7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.102+0000 7f6c7659c640 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2ce6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c75d9b640 1 -- 172.21.15.152:0/1470474529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 msgr2=0x55fac2cf5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c75d9b640 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2cf5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c75d9b640 1 -- 172.21.15.152:0/1470474529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 msgr2=0x55fac2ce6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c75d9b640 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2ce6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c75d9b640 1 -- 172.21.15.152:0/1470474529 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fac2956210 con 0x55fac2ce9cb0 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c76d9d640 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2cf5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c75d9b640 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 0x55fac2ce7340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55fac2ce1690 tx=0x7f6c68012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a39a401339699e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c5dffb640 1 -- 172.21.15.152:0/1470474529 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68004320 con 0x55fac2ce9cb0 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c5dffb640 1 -- 172.21.15.152:0/1470474529 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f6c680118f0 con 0x55fac2ce9cb0 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1470474529 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fac2c50a20 con 0x55fac2ce9cb0 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c5dffb640 1 -- 172.21.15.152:0/1470474529 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6c680044c0 con 0x55fac2ce9cb0 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c7fdd4740 10 client.28573 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1470474529 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fac2a22620 con 0x55fac2ce9cb0 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.103+0000 7f6c5dffb640 1 -- 172.21.15.152:0/1470474529 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55fac2c50a20 con 0x55fac2ce9cb0 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.104+0000 7f6c5dffb640 1 -- 172.21.15.152:0/1470474529 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f6c6800f440 con 0x55fac2ce9cb0 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.104+0000 7f6c7fdd4740 10 client.28573 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.104+0000 7f6c7fdd4740 10 client.28573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.104+0000 7f6c7fdd4740 20 client.28573 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.104+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fac2cfa000 0x55fac2cfc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.104+0000 7f6c7fdd4740 4 client.28573 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.104+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1470474529 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fac2c4ad70 con 0x55fac2cfa000 2024-09-11T22:19:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.104+0000 7f6c7659c640 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fac2cfa000 0x55fac2cfc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.105+0000 7f6c5dffb640 10 client.28573 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.105+0000 7f6c7659c640 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fac2cfa000 0x55fac2cfc410 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b19263813d507d1 server_cookie=7d0de211c0b457b9 in_seq=0 out_seq=0 2024-09-11T22:19:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.105+0000 7f6c5dffb640 1 -- 172.21.15.152:0/1470474529 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fac2c4ad70 con 0x55fac2cfa000 2024-09-11T22:19:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c5dffb640 10 client.28573 handle_command_reply: tid=0 2024-09-11T22:19:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 1 client.28573 shutdown 2024-09-11T22:19:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1470474529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 msgr2=0x55fac2ce7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 0x55fac2ce7340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55fac2ce1690 tx=0x7f6c68012b60 comp rx=0 tx=0).stop 2024-09-11T22:19:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1470474529 shutdown_connections 2024-09-11T22:19:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fac2cfa000 0x55fac2cfc410 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2cf5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 0x55fac2ce7340 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/1470474529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2ce6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1470474529 >> 172.21.15.152:0/1470474529 conn(0x55fac2cdb060 msgr2=0x55fac2ce0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c5dffb640 0 client.28573 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1470474529 shutdown_connections 2024-09-11T22:19:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1470474529 wait complete. 2024-09-11T22:19:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.106+0000 7f6c7fdd4740 20 client.28573 trim_cache size 0 max 16384 2024-09-11T22:19:36.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.129+0000 7f6c7fdd4740 1 Processor -- start 2024-09-11T22:19:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.133+0000 7f6c7fdd4740 1 -- start start 2024-09-11T22:19:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.133+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdeaf0 0x55fac2cf58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.133+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2cda0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.133+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2ce9cb0 0x55fac2d01d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.134+0000 7f6c7fdd4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781b6860 con 0x55fac2ce9cb0 2024-09-11T22:19:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.134+0000 7f6c76d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2ce9cb0 0x55fac2d01d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.134+0000 7f6c76d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2ce9cb0 0x55fac2d01d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33674/0 (socket says 172.21.15.152:33674) 2024-09-11T22:19:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.134+0000 7f6c76d9d640 1 -- 172.21.15.152:0/1521667204 learned_addr learned my addr 172.21.15.152:0/1521667204 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.134+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1521667204 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781b4130 con 0x55fac2ce7880 2024-09-11T22:19:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.134+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1521667204 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781b1fa0 con 0x55fac2cdeaf0 2024-09-11T22:19:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.135+0000 7f6c7659c640 1 --2- 172.21.15.152:0/1521667204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdeaf0 0x55fac2cf58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.138+0000 7f6c75d9b640 1 --2- 172.21.15.152:0/1521667204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2cda0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.139+0000 7f6c7659c640 1 -- 172.21.15.152:0/1521667204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 msgr2=0x55fac2cda0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.139+0000 7f6c7659c640 1 --2- 172.21.15.152:0/1521667204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2cda0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.140+0000 7f6c7659c640 1 -- 172.21.15.152:0/1521667204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2ce9cb0 msgr2=0x55fac2d01d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.140+0000 7f6c7659c640 1 --2- 172.21.15.152:0/1521667204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2ce9cb0 0x55fac2d01d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.140+0000 7f6c7659c640 1 -- 172.21.15.152:0/1521667204 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac2ce76b0 con 0x55fac2cdeaf0 2024-09-11T22:19:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.142+0000 7f6c7659c640 1 --2- 172.21.15.152:0/1521667204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdeaf0 0x55fac2cf58a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6c70005000 tx=0x7f6c70005e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6293e1062b17c60 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.144+0000 7f6c5ffff640 1 -- 172.21.15.152:0/1521667204 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700dc040 con 0x55fac2cdeaf0 2024-09-11T22:19:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.144+0000 7f6c5ffff640 1 -- 172.21.15.152:0/1521667204 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c700bcc30 con 0x55fac2cdeaf0 2024-09-11T22:19:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.144+0000 7f6c5ffff640 1 -- 172.21.15.152:0/1521667204 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700bbe90 con 0x55fac2cdeaf0 2024-09-11T22:19:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.146+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1521667204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdeaf0 msgr2=0x55fac2cf58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.146+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/1521667204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdeaf0 0x55fac2cf58a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6c70005000 tx=0x7f6c70005e30 comp rx=0 tx=0).stop 2024-09-11T22:19:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.148+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1521667204 shutdown_connections 2024-09-11T22:19:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.148+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/1521667204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2ce9cb0 0x55fac2d01d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.148+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/1521667204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2cda0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.148+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/1521667204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2cdeaf0 0x55fac2cf58a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.148+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1521667204 >> 172.21.15.152:0/1521667204 conn(0x55fac2cdb060 msgr2=0x55fac2cd99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.151+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1521667204 shutdown_connections 2024-09-11T22:19:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.152+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/1521667204 wait complete. 2024-09-11T22:19:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.153+0000 7f6c7fdd4740 1 -- start start 2024-09-11T22:19:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.153+0000 7f6c7fdd4740 1 Processor -- start 2024-09-11T22:19:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.153+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2cf1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.153+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2ce39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.153+0000 7f6c7fdd4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 0x55fac2ce3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.153+0000 7f6c7fdd4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781b25f0 con 0x55fac2cdeaf0 2024-09-11T22:19:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.153+0000 7f6c7fdd4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781b3a60 con 0x55fac2ce7880 2024-09-11T22:19:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.153+0000 7f6c7fdd4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781b2cc0 con 0x55fac2ce9cb0 2024-09-11T22:19:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.154+0000 7f6c7fdd4740 10 client.0 _ll_register_callbacks cb 0x7f6c680097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.154+0000 7f6c76d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 0x55fac2ce3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.154+0000 7f6c76d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 0x55fac2ce3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:38456/0 (socket says 172.21.15.152:38456) 2024-09-11T22:19:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.154+0000 7f6c76d9d640 1 -- 172.21.15.152:0/421830294 learned_addr learned my addr 172.21.15.152:0/421830294 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.154+0000 7f6c7659c640 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2cf1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.154+0000 7f6c76d9d640 1 -- 172.21.15.152:0/421830294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 msgr2=0x55fac2ce39a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:19:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.154+0000 7f6c76d9d640 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2ce39a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.154+0000 7f6c76d9d640 1 -- 172.21.15.152:0/421830294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 msgr2=0x55fac2cf1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.154+0000 7f6c76d9d640 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2cf1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.154+0000 7f6c76d9d640 1 -- 172.21.15.152:0/421830294 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fac2ce4550 con 0x55fac2ce9cb0 2024-09-11T22:19:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.155+0000 7f6c76d9d640 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 0x55fac2ce3ee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00fde0 tx=0x7f6c6c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ceb61af6f08c333 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.155+0000 7f6c5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:19:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.155+0000 7f6c5dffb640 1 -- 172.21.15.152:0/421830294 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c02d030 con 0x55fac2ce9cb0 2024-09-11T22:19:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.155+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/421830294 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c700bcc30 con 0x55fac2ce9cb0 2024-09-11T22:19:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.155+0000 7f6c5dffb640 1 -- 172.21.15.152:0/421830294 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f6c6c01d930 con 0x55fac2ce9cb0 2024-09-11T22:19:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.156+0000 7f6c5dffb640 1 -- 172.21.15.152:0/421830294 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6c6c037050 con 0x55fac2ce9cb0 2024-09-11T22:19:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.156+0000 7f6c7fdd4740 10 client.28579 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.156+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/421830294 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fac2d75c30 con 0x55fac2ce9cb0 2024-09-11T22:19:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.156+0000 7f6c5dffb640 1 -- 172.21.15.152:0/421830294 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c700bcc30 con 0x55fac2ce9cb0 2024-09-11T22:19:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.156+0000 7f6c5dffb640 1 -- 172.21.15.152:0/421830294 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f6c6c004800 con 0x55fac2ce9cb0 2024-09-11T22:19:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.157+0000 7f6c7fdd4740 10 client.28579 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.157+0000 7f6c7fdd4740 10 client.28579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.157+0000 7f6c7fdd4740 20 client.28579 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.157+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fac2d763b0 0x55fac2d78810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.157+0000 7f6c7fdd4740 4 client.28579 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:19:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.157+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/421830294 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fac2bc7900 con 0x55fac2d763b0 2024-09-11T22:19:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.161+0000 7f6c7659c640 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fac2d763b0 0x55fac2d78810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.166+0000 7f6c7659c640 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fac2d763b0 0x55fac2d78810 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90f7915d16f4fc20 server_cookie=a835e898b59dff50 in_seq=0 out_seq=0 2024-09-11T22:19:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.166+0000 7f6c5dffb640 10 client.28579 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:36.214 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c5dffb640 1 -- 172.21.15.152:0/421830294 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fac2bc7900 con 0x55fac2d763b0 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c5dffb640 10 client.28579 handle_command_reply: tid=0 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c7fdd4740 1 client.28579 shutdown 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/421830294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 msgr2=0x55fac2ce3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 0x55fac2ce3ee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00fde0 tx=0x7f6c6c004730 comp rx=0 tx=0).stop 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/421830294 shutdown_connections 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55fac2d763b0 0x55fac2d78810 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fac2ce9cb0 0x55fac2ce3ee0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac2ce7880 0x55fac2ce39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c5dffb640 0 client.28579 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c7fdd4740 1 --2- 172.21.15.152:0/421830294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fac2cdeaf0 0x55fac2cf1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/421830294 >> 172.21.15.152:0/421830294 conn(0x55fac2cdb060 msgr2=0x55fac2ce6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/421830294 shutdown_connections 2024-09-11T22:19:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.213+0000 7f6c7fdd4740 1 -- 172.21.15.152:0/421830294 wait complete. 2024-09-11T22:19:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7fdd4740 20 client.28579 trim_cache size 0 max 16384 2024-09-11T22:19:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:19:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:19:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:19:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:19:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/333376887 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c600a2da0 msgr2=0x7f6c600a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c600a2da0 0x7f6c600a5260 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0104f0 tx=0x7f6c6c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/333376887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c78074590 msgr2=0x7f6c781a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c78074590 0x7f6c781a4670 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f6c70000f80 tx=0x7f6c70030630 comp rx=0 tx=0).stop 2024-09-11T22:19:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/333376887 shutdown_connections 2024-09-11T22:19:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6c600a2da0 0x7f6c600a5260 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c78112ae0 0x7f6c7819e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78074eb0 0x7f6c781a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 --2- 172.21.15.152:0/333376887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c78074590 0x7f6c781a4670 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/333376887 >> 172.21.15.152:0/333376887 conn(0x7f6c780fd7b0 msgr2=0x7f6c780ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/333376887 shutdown_connections 2024-09-11T22:19:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:36.214+0000 7f6c7cf5f640 1 -- 172.21.15.152:0/333376887 wait complete. 2024-09-11T22:19:36.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:35 smithi152 ceph-mon[31188]: pgmap v480: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.7 MiB/s wr, 890 op/s 2024-09-11T22:19:38.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:37 smithi179 ceph-mon[35603]: pgmap v481: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.1 MiB/s wr, 616 op/s 2024-09-11T22:19:38.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:37 smithi193 ceph-mon[35545]: pgmap v481: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.1 MiB/s wr, 616 op/s 2024-09-11T22:19:38.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:37 smithi152 ceph-mon[31188]: pgmap v481: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.1 MiB/s wr, 616 op/s 2024-09-11T22:19:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 845.0 s, 2453.2 tps, lat 40.875 ms stddev 48.779 2024-09-11T22:19:40.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:39 smithi179 ceph-mon[35603]: pgmap v482: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 836 op/s 2024-09-11T22:19:40.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:39 smithi193 ceph-mon[35545]: pgmap v482: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 836 op/s 2024-09-11T22:19:40.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:39 smithi152 ceph-mon[31188]: pgmap v482: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 836 op/s 2024-09-11T22:19:41.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:40 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:19:41.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:40 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:19:41.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:40 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:19:42.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:41 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:19:42.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:41 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:19:42.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:41 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:19:42.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:41 smithi179 ceph-mon[35603]: pgmap v483: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 742 op/s 2024-09-11T22:19:42.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:41 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:19:42.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:41 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:19:42.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:41 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:19:42.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:41 smithi193 ceph-mon[35545]: pgmap v483: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 742 op/s 2024-09-11T22:19:42.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:41 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:19:42.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:41 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:19:42.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:41 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:19:42.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:41 smithi152 ceph-mon[31188]: pgmap v483: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 742 op/s 2024-09-11T22:19:44.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:43 smithi179 ceph-mon[35603]: pgmap v484: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.3 MiB/s wr, 652 op/s 2024-09-11T22:19:44.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:43 smithi193 ceph-mon[35545]: pgmap v484: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.3 MiB/s wr, 652 op/s 2024-09-11T22:19:44.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:43 smithi152 ceph-mon[31188]: pgmap v484: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.3 MiB/s wr, 652 op/s 2024-09-11T22:19:44.821 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 850.0 s, 1617.7 tps, lat 53.189 ms stddev 64.212 2024-09-11T22:19:46.031 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:45 smithi152 ceph-mon[31188]: pgmap v485: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 14 MiB/s wr, 1.19k op/s 2024-09-11T22:19:46.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:45 smithi179 ceph-mon[35603]: pgmap v485: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 14 MiB/s wr, 1.19k op/s 2024-09-11T22:19:46.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:45 smithi193 ceph-mon[35545]: pgmap v485: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 14 MiB/s wr, 1.19k op/s 2024-09-11T22:19:48.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:47 smithi179 ceph-mon[35603]: pgmap v486: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-09-11T22:19:48.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:47 smithi193 ceph-mon[35545]: pgmap v486: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-09-11T22:19:48.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:47 smithi152 ceph-mon[31188]: pgmap v486: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-09-11T22:19:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.318+0000 7f2f63e82640 1 -- 172.21.15.152:0/2201012583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5c101350 msgr2=0x7f2f5c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.318+0000 7f2f63e82640 1 --2- 172.21.15.152:0/2201012583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5c101350 0x7f2f5c10d880 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009cd0 tx=0x7f2f5402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.318+0000 7f2f63e82640 1 -- 172.21.15.152:0/2201012583 shutdown_connections 2024-09-11T22:19:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.318+0000 7f2f63e82640 1 --2- 172.21.15.152:0/2201012583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5c101350 0x7f2f5c10d880 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.318+0000 7f2f63e82640 1 --2- 172.21.15.152:0/2201012583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f5c1009b0 0x7f2f5c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.318+0000 7f2f63e82640 1 --2- 172.21.15.152:0/2201012583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f5c1069c0 0x7f2f5c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.318+0000 7f2f63e82640 1 -- 172.21.15.152:0/2201012583 >> 172.21.15.152:0/2201012583 conn(0x7f2f5c077990 msgr2=0x7f2f5c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.318+0000 7f2f63e82640 1 -- 172.21.15.152:0/2201012583 shutdown_connections 2024-09-11T22:19:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.320+0000 7f2f63e82640 1 -- 172.21.15.152:0/2201012583 wait complete. 2024-09-11T22:19:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.320+0000 7f2f63e82640 1 Processor -- start 2024-09-11T22:19:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.320+0000 7f2f63e82640 1 -- start start 2024-09-11T22:19:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f63e82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f5c1009b0 0x7f2f5c199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f63e82640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5c101350 0x7f2f5c1996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f63e82640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f5c1069c0 0x7f2f5c1a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f63e82640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c110e00 con 0x7f2f5c101350 2024-09-11T22:19:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f63e82640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c110c80 con 0x7f2f5c1009b0 2024-09-11T22:19:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f63e82640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c110f80 con 0x7f2f5c1069c0 2024-09-11T22:19:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f6141d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5c101350 0x7f2f5c1996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f61c1e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f5c1009b0 0x7f2f5c199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f6141d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5c101350 0x7f2f5c1996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56218/0 (socket says 172.21.15.152:56218) 2024-09-11T22:19:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f6141d640 1 -- 172.21.15.152:0/1334400752 learned_addr learned my addr 172.21.15.152:0/1334400752 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f6241f640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f5c1069c0 0x7f2f5c1a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f6141d640 1 -- 172.21.15.152:0/1334400752 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f5c1069c0 msgr2=0x7f2f5c1a41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f6141d640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f5c1069c0 0x7f2f5c1a41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f6141d640 1 -- 172.21.15.152:0/1334400752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f5c1009b0 msgr2=0x7f2f5c199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f6141d640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f5c1009b0 0x7f2f5c199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f6141d640 1 -- 172.21.15.152:0/1334400752 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c1a4730 con 0x7f2f5c101350 2024-09-11T22:19:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f5c1009b0 0x7f2f5c199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f6141d640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5c101350 0x7f2f5c1996b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00d950 tx=0x7f2f4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f52ffd640 1 -- 172.21.15.152:0/1334400752 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c017070 con 0x7f2f5c101350 2024-09-11T22:19:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f63e82640 1 -- 172.21.15.152:0/1334400752 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c1a4900 con 0x7f2f5c101350 2024-09-11T22:19:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f52ffd640 1 -- 172.21.15.152:0/1334400752 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f4c009c30 con 0x7f2f5c101350 2024-09-11T22:19:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f52ffd640 1 -- 172.21.15.152:0/1334400752 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00f6b0 con 0x7f2f5c101350 2024-09-11T22:19:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.321+0000 7f2f63e82640 1 -- 172.21.15.152:0/1334400752 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c1a4e70 con 0x7f2f5c101350 2024-09-11T22:19:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.324+0000 7f2f52ffd640 1 -- 172.21.15.152:0/1334400752 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f2f4c0109d0 con 0x7f2f5c101350 2024-09-11T22:19:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.324+0000 7f2f66c22740 1 Processor -- start 2024-09-11T22:19:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f66c22740 1 -- start start 2024-09-11T22:19:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f52ffd640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2f480a2da0 0x7f2f480a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 0x5632ca637ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 0x5632ca642770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca6450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f66c22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5632ca59c2f0 con 0x5632ca638410 2024-09-11T22:19:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f52ffd640 1 -- 172.21.15.152:0/1334400752 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f2f4c0cf010 con 0x7f2f5c101350 2024-09-11T22:19:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f66c22740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5632ca544270 con 0x5632ca637af0 2024-09-11T22:19:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f66c22740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5632ca5982b0 con 0x5632ca642cb0 2024-09-11T22:19:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f6241f640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2f480a2da0 0x7f2f480a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f6241f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca6450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f6241f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca6450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:60730/0 (socket says 172.21.15.152:60730) 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f61c1e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 0x5632ca637ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f6241f640 1 -- 172.21.15.152:0/3180323053 learned_addr learned my addr 172.21.15.152:0/3180323053 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f6141d640 1 --2- 172.21.15.152:0/3180323053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 0x5632ca642770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f61c1e640 1 -- 172.21.15.152:0/3180323053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 msgr2=0x5632ca6450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/3180323053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca6450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f61c1e640 1 -- 172.21.15.152:0/3180323053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 msgr2=0x5632ca642770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/3180323053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 0x5632ca642770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f61c1e640 1 -- 172.21.15.152:0/3180323053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ca543340 con 0x5632ca637af0 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f6241f640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2f480a2da0 0x7f2f480a5260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2f5402ae00 tx=0x7f2f540316c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.325+0000 7f2f6141d640 1 --2- 172.21.15.152:0/3180323053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 0x5632ca642770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.326+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/3180323053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 0x5632ca637ed0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009f30 tx=0x7f2f58013c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=271089a7c1392c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.326+0000 7f2f47fff640 1 -- 172.21.15.152:0/3180323053 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f58004110 con 0x5632ca637af0 2024-09-11T22:19:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.326+0000 7f2f47fff640 1 -- 172.21.15.152:0/3180323053 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f58013e50 con 0x5632ca637af0 2024-09-11T22:19:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.326+0000 7f2f47fff640 1 -- 172.21.15.152:0/3180323053 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f58003bc0 con 0x5632ca637af0 2024-09-11T22:19:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.326+0000 7f2f66c22740 1 -- 172.21.15.152:0/3180323053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 msgr2=0x5632ca637ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.326+0000 7f2f66c22740 1 --2- 172.21.15.152:0/3180323053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 0x5632ca637ed0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009f30 tx=0x7f2f58013c60 comp rx=0 tx=0).stop 2024-09-11T22:19:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.326+0000 7f2f66c22740 1 -- 172.21.15.152:0/3180323053 shutdown_connections 2024-09-11T22:19:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.326+0000 7f2f66c22740 1 --2- 172.21.15.152:0/3180323053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca6450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.326+0000 7f2f66c22740 1 --2- 172.21.15.152:0/3180323053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 0x5632ca642770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.326+0000 7f2f66c22740 1 --2- 172.21.15.152:0/3180323053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 0x5632ca637ed0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.326+0000 7f2f66c22740 1 -- 172.21.15.152:0/3180323053 >> 172.21.15.152:0/3180323053 conn(0x5632ca634060 msgr2=0x5632ca634440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.327+0000 7f2f66c22740 1 -- 172.21.15.152:0/3180323053 shutdown_connections 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.327+0000 7f2f66c22740 1 -- 172.21.15.152:0/3180323053 wait complete. 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.327+0000 7f2f66c22740 1 -- start start 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.327+0000 7f2f66c22740 1 Processor -- start 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.327+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 0x5632ca63fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.327+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 0x5632ca640010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.327+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca640550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.327+0000 7f2f66c22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5632ca645880 con 0x5632ca638410 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.327+0000 7f2f66c22740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5632ca525290 con 0x5632ca637af0 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.327+0000 7f2f66c22740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5632ca645a00 con 0x5632ca642cb0 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.328+0000 7f2f6141d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 0x5632ca640010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.328+0000 7f2f66c22740 10 client.0 _ll_register_callbacks cb 0x5632ca556140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.328+0000 7f2f61c1e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 0x5632ca63fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.328+0000 7f2f6141d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 0x5632ca640010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56236/0 (socket says 172.21.15.152:56236) 2024-09-11T22:19:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.328+0000 7f2f6141d640 1 -- 172.21.15.152:0/218000005 learned_addr learned my addr 172.21.15.152:0/218000005 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.328+0000 7f2f6241f640 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca640550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.328+0000 7f2f61c1e640 1 -- 172.21.15.152:0/218000005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 msgr2=0x5632ca640550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.328+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca640550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.328+0000 7f2f61c1e640 1 -- 172.21.15.152:0/218000005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 msgr2=0x5632ca640010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.328+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 0x5632ca640010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.328+0000 7f2f61c1e640 1 -- 172.21.15.152:0/218000005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ca2af210 con 0x5632ca637af0 2024-09-11T22:19:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.329+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 0x5632ca63fad0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f58003740 tx=0x7f2f58004600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aa5be49e44a328f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.329+0000 7f2f457fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:19:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.329+0000 7f2f457fa640 1 -- 172.21.15.152:0/218000005 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5802a020 con 0x5632ca637af0 2024-09-11T22:19:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.329+0000 7f2f457fa640 1 -- 172.21.15.152:0/218000005 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f2f58019050 con 0x5632ca637af0 2024-09-11T22:19:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.329+0000 7f2f66c22740 1 -- 172.21.15.152:0/218000005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f58013e50 con 0x5632ca637af0 2024-09-11T22:19:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.330+0000 7f2f457fa640 1 -- 172.21.15.152:0/218000005 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2f58035050 con 0x5632ca637af0 2024-09-11T22:19:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.330+0000 7f2f66c22740 10 client.28451 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.330+0000 7f2f66c22740 1 -- 172.21.15.152:0/218000005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5632ca37b620 con 0x5632ca637af0 2024-09-11T22:19:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.330+0000 7f2f457fa640 1 -- 172.21.15.152:0/218000005 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f58013e50 con 0x5632ca637af0 2024-09-11T22:19:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.330+0000 7f2f457fa640 1 -- 172.21.15.152:0/218000005 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f2f5801d5b0 con 0x5632ca637af0 2024-09-11T22:19:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.330+0000 7f2f66c22740 10 client.28451 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.330+0000 7f2f66c22740 10 client.28451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.330+0000 7f2f66c22740 20 client.28451 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.330+0000 7f2f66c22740 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5632ca652b40 0x5632ca654f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.330+0000 7f2f66c22740 4 client.28451 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.330+0000 7f2f66c22740 1 -- 172.21.15.152:0/218000005 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632ca5a9a20 con 0x5632ca652b40 2024-09-11T22:19:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.331+0000 7f2f6141d640 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5632ca652b40 0x5632ca654f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.331+0000 7f2f6141d640 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5632ca652b40 0x5632ca654f30 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23aab06ba79ea975 server_cookie=84f4a1529d462d45 in_seq=0 out_seq=0 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.331+0000 7f2f457fa640 10 client.28451 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f457fa640 1 -- 172.21.15.152:0/218000005 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5632ca5a9a20 con 0x5632ca652b40 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f457fa640 10 client.28451 handle_command_reply: tid=0 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 1 client.28451 shutdown 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 1 -- 172.21.15.152:0/218000005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 msgr2=0x5632ca63fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 0x5632ca63fad0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f58003740 tx=0x7f2f58004600 comp rx=0 tx=0).stop 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 1 -- 172.21.15.152:0/218000005 shutdown_connections 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5632ca652b40 0x5632ca654f30 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca640550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f457fa640 0 client.28451 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca638410 0x5632ca640010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 1 --2- 172.21.15.152:0/218000005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca637af0 0x5632ca63fad0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 1 -- 172.21.15.152:0/218000005 >> 172.21.15.152:0/218000005 conn(0x5632ca634060 msgr2=0x5632ca639dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 1 -- 172.21.15.152:0/218000005 shutdown_connections 2024-09-11T22:19:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 1 -- 172.21.15.152:0/218000005 wait complete. 2024-09-11T22:19:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.332+0000 7f2f66c22740 20 client.28451 trim_cache size 0 max 16384 2024-09-11T22:19:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f66c22740 1 Processor -- start 2024-09-11T22:19:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f66c22740 1 -- start start 2024-09-11T22:19:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca637af0 0x5632ca63e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 0x5632ca640380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca65a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f66c22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1adff0 con 0x5632ca637af0 2024-09-11T22:19:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f66c22740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1ab8c0 con 0x5632ca638410 2024-09-11T22:19:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f66c22740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1a9730 con 0x5632ca642cb0 2024-09-11T22:19:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f61c1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca637af0 0x5632ca63e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f6241f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca65a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f61c1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca637af0 0x5632ca63e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56246/0 (socket says 172.21.15.152:56246) 2024-09-11T22:19:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f61c1e640 1 -- 172.21.15.152:0/2563396832 learned_addr learned my addr 172.21.15.152:0/2563396832 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f6141d640 1 --2- 172.21.15.152:0/2563396832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 0x5632ca640380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f61c1e640 1 -- 172.21.15.152:0/2563396832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 msgr2=0x5632ca65a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/2563396832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca65a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f61c1e640 1 -- 172.21.15.152:0/2563396832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 msgr2=0x5632ca640380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/2563396832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 0x5632ca640380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f61c1e640 1 -- 172.21.15.152:0/2563396832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ca633e90 con 0x5632ca637af0 2024-09-11T22:19:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f6141d640 1 --2- 172.21.15.152:0/2563396832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 0x5632ca640380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.350+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/2563396832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca637af0 0x5632ca63e380 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f2f5801d9d0 tx=0x7f2f58005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba9a4562e24e441 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.351+0000 7f2f477fe640 1 -- 172.21.15.152:0/2563396832 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5802a030 con 0x5632ca637af0 2024-09-11T22:19:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.351+0000 7f2f477fe640 1 -- 172.21.15.152:0/2563396832 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f58013e50 con 0x5632ca637af0 2024-09-11T22:19:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.351+0000 7f2f477fe640 1 -- 172.21.15.152:0/2563396832 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f58005030 con 0x5632ca637af0 2024-09-11T22:19:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.351+0000 7f2f66c22740 1 -- 172.21.15.152:0/2563396832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca637af0 msgr2=0x5632ca63e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.351+0000 7f2f66c22740 1 --2- 172.21.15.152:0/2563396832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca637af0 0x5632ca63e380 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f2f5801d9d0 tx=0x7f2f58005d30 comp rx=0 tx=0).stop 2024-09-11T22:19:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.352+0000 7f2f66c22740 1 -- 172.21.15.152:0/2563396832 shutdown_connections 2024-09-11T22:19:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.352+0000 7f2f66c22740 1 --2- 172.21.15.152:0/2563396832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca642cb0 0x5632ca65a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.352+0000 7f2f66c22740 1 --2- 172.21.15.152:0/2563396832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 0x5632ca640380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.352+0000 7f2f66c22740 1 --2- 172.21.15.152:0/2563396832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca637af0 0x5632ca63e380 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.352+0000 7f2f66c22740 1 -- 172.21.15.152:0/2563396832 >> 172.21.15.152:0/2563396832 conn(0x5632ca634060 msgr2=0x5632ca641b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.352+0000 7f2f66c22740 1 -- 172.21.15.152:0/2563396832 shutdown_connections 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.352+0000 7f2f66c22740 1 -- 172.21.15.152:0/2563396832 wait complete. 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.352+0000 7f2f66c22740 1 -- start start 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.352+0000 7f2f66c22740 1 Processor -- start 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca637af0 0x5632ca63cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 0x5632ca63d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f66c22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca642cb0 0x5632ca63d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f66c22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1a9d80 con 0x5632ca642cb0 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f66c22740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1ab1f0 con 0x5632ca638410 2024-09-11T22:19:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f66c22740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1aa450 con 0x5632ca637af0 2024-09-11T22:19:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f66c22740 10 client.0 _ll_register_callbacks cb 0x7f2f4c097100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f6241f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca642cb0 0x5632ca63d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f6241f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca642cb0 0x5632ca63d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56260/0 (socket says 172.21.15.152:56260) 2024-09-11T22:19:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f6241f640 1 -- 172.21.15.152:0/1863694134 learned_addr learned my addr 172.21.15.152:0/1863694134 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca637af0 0x5632ca63cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f6141d640 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 0x5632ca63d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f6241f640 1 -- 172.21.15.152:0/1863694134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca637af0 msgr2=0x5632ca63cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f6241f640 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca637af0 0x5632ca63cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f6241f640 1 -- 172.21.15.152:0/1863694134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 msgr2=0x5632ca63d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f6241f640 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 0x5632ca63d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f6241f640 1 -- 172.21.15.152:0/1863694134 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ca637920 con 0x5632ca642cb0 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f6141d640 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 0x5632ca63d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f6241f640 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca642cb0 0x5632ca63d6f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f2f54006010 tx=0x7f2f5402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87aaa4bf89a3f48f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.353+0000 7f2f457fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f457fa640 1 -- 172.21.15.152:0/1863694134 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5405a060 con 0x5632ca642cb0 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f457fa640 1 -- 172.21.15.152:0/1863694134 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f2f540305a0 con 0x5632ca642cb0 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f66c22740 1 -- 172.21.15.152:0/1863694134 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f58013e50 con 0x5632ca642cb0 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f457fa640 1 -- 172.21.15.152:0/1863694134 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2f540307a0 con 0x5632ca642cb0 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f66c22740 10 client.19302 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f66c22740 1 -- 172.21.15.152:0/1863694134 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5632ca6bd790 con 0x5632ca642cb0 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f457fa640 1 -- 172.21.15.152:0/1863694134 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f58013e50 con 0x5632ca642cb0 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f457fa640 1 -- 172.21.15.152:0/1863694134 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f2f54049070 con 0x5632ca642cb0 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f66c22740 10 client.19302 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f66c22740 10 client.19302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f66c22740 20 client.19302 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f66c22740 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5632ca652b40 0x5632ca6bff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f66c22740 4 client.19302 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:19:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f66c22740 1 -- 172.21.15.152:0/1863694134 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5632ca5a3d70 con 0x5632ca652b40 2024-09-11T22:19:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.354+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5632ca652b40 0x5632ca6bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.355+0000 7f2f61c1e640 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5632ca652b40 0x5632ca6bff50 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ac1ad1af792908e server_cookie=88b2cc2b822b9ed6 in_seq=0 out_seq=0 2024-09-11T22:19:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.355+0000 7f2f457fa640 10 client.19302 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.363+0000 7f2f457fa640 1 -- 172.21.15.152:0/1863694134 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5632ca5a3d70 con 0x5632ca652b40 2024-09-11T22:19:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.363+0000 7f2f457fa640 10 client.19302 handle_command_reply: tid=0 2024-09-11T22:19:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.363+0000 7f2f66c22740 1 client.19302 shutdown 2024-09-11T22:19:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.363+0000 7f2f66c22740 1 -- 172.21.15.152:0/1863694134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca642cb0 msgr2=0x5632ca63d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.363+0000 7f2f66c22740 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca642cb0 0x5632ca63d6f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f2f54006010 tx=0x7f2f5402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f66c22740 1 -- 172.21.15.152:0/1863694134 shutdown_connections 2024-09-11T22:19:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f66c22740 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5632ca652b40 0x5632ca6bff50 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f66c22740 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632ca642cb0 0x5632ca63d6f0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f66c22740 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632ca638410 0x5632ca63d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f457fa640 0 client.19302 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f66c22740 1 --2- 172.21.15.152:0/1863694134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632ca637af0 0x5632ca63cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f66c22740 1 -- 172.21.15.152:0/1863694134 >> 172.21.15.152:0/1863694134 conn(0x5632ca634060 msgr2=0x5632ca639550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f66c22740 1 -- 172.21.15.152:0/1863694134 shutdown_connections 2024-09-11T22:19:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f66c22740 1 -- 172.21.15.152:0/1863694134 wait complete. 2024-09-11T22:19:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f66c22740 20 client.19302 trim_cache size 0 max 16384 2024-09-11T22:19:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:19:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:19:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:19:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:19:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f63e82640 1 -- 172.21.15.152:0/1334400752 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2f480a2da0 msgr2=0x7f2f480a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f63e82640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2f480a2da0 0x7f2f480a5260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2f5402ae00 tx=0x7f2f540316c0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f63e82640 1 -- 172.21.15.152:0/1334400752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5c101350 msgr2=0x7f2f5c1996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f63e82640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5c101350 0x7f2f5c1996b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00d950 tx=0x7f2f4c00de10 comp rx=0 tx=0).stop 2024-09-11T22:19:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f63e82640 1 -- 172.21.15.152:0/1334400752 shutdown_connections 2024-09-11T22:19:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f63e82640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2f480a2da0 0x7f2f480a5260 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f63e82640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f5c1069c0 0x7f2f5c1a41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f63e82640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5c101350 0x7f2f5c1996b0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.364+0000 7f2f63e82640 1 --2- 172.21.15.152:0/1334400752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f5c1009b0 0x7f2f5c199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.365+0000 7f2f63e82640 1 -- 172.21.15.152:0/1334400752 >> 172.21.15.152:0/1334400752 conn(0x7f2f5c077990 msgr2=0x7f2f5c103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.365+0000 7f2f63e82640 1 -- 172.21.15.152:0/1334400752 shutdown_connections 2024-09-11T22:19:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:19:49.365+0000 7f2f63e82640 1 -- 172.21.15.152:0/1334400752 wait complete. 2024-09-11T22:19:49.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 855.0 s, 1680.9 tps, lat 67.832 ms stddev 125.338 2024-09-11T22:19:50.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:49 smithi179 ceph-mon[35603]: pgmap v487: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 24 MiB/s wr, 1.67k op/s 2024-09-11T22:19:50.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:49 smithi193 ceph-mon[35545]: pgmap v487: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 24 MiB/s wr, 1.67k op/s 2024-09-11T22:19:50.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:49 smithi152 ceph-mon[31188]: pgmap v487: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 24 MiB/s wr, 1.67k op/s 2024-09-11T22:19:52.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:51 smithi179 ceph-mon[35603]: pgmap v488: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 1.68k op/s 2024-09-11T22:19:52.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:51 smithi193 ceph-mon[35545]: pgmap v488: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 1.68k op/s 2024-09-11T22:19:52.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:51 smithi152 ceph-mon[31188]: pgmap v488: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 1.68k op/s 2024-09-11T22:19:54.012 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:19:54.038 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:53 smithi152 ceph-mon[31188]: pgmap v489: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 1.62k op/s 2024-09-11T22:19:54.048 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:53 smithi179 ceph-mon[35603]: pgmap v489: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 1.62k op/s 2024-09-11T22:19:54.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:53 smithi193 ceph-mon[35545]: pgmap v489: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 1.62k op/s 2024-09-11T22:19:54.351 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:19:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 860.0 s, 1874.8 tps, lat 52.888 ms stddev 55.301 2024-09-11T22:19:54.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.886+0000 7fbf181b7640 1 -- 172.21.15.152:0/2337858844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf10100a80 msgr2=0x7fbf10100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.886+0000 7fbf181b7640 1 --2- 172.21.15.152:0/2337858844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf10100a80 0x7fbf10100ee0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009890 tx=0x7fbf0002a380 comp rx=0 tx=0).stop 2024-09-11T22:19:54.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.886+0000 7fbf181b7640 1 -- 172.21.15.152:0/2337858844 shutdown_connections 2024-09-11T22:19:54.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.886+0000 7fbf181b7640 1 --2- 172.21.15.152:0/2337858844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf10101420 0x7fbf1010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.886+0000 7fbf181b7640 1 --2- 172.21.15.152:0/2337858844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf10100a80 0x7fbf10100ee0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.886+0000 7fbf181b7640 1 --2- 172.21.15.152:0/2337858844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf10106a80 0x7fbf10106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.886+0000 7fbf181b7640 1 -- 172.21.15.152:0/2337858844 >> 172.21.15.152:0/2337858844 conn(0x7fbf100fc7a0 msgr2=0x7fbf100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:54.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.886+0000 7fbf181b7640 1 -- 172.21.15.152:0/2337858844 shutdown_connections 2024-09-11T22:19:54.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.886+0000 7fbf181b7640 1 -- 172.21.15.152:0/2337858844 wait complete. 2024-09-11T22:19:54.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf181b7640 1 Processor -- start 2024-09-11T22:19:54.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf181b7640 1 -- start start 2024-09-11T22:19:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf181b7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf10100a80 0x7fbf10198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf181b7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf10101420 0x7fbf101989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf181b7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf10106a80 0x7fbf1019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf181b7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10111fe0 con 0x7fbf10106a80 2024-09-11T22:19:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf181b7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10111e60 con 0x7fbf10100a80 2024-09-11T22:19:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf181b7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10112160 con 0x7fbf10101420 2024-09-11T22:19:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf15f53640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf10100a80 0x7fbf10198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf15f53640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf10100a80 0x7fbf10198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33750/0 (socket says 172.21.15.152:33750) 2024-09-11T22:19:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf15752640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf10101420 0x7fbf101989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.887+0000 7fbf15f53640 1 -- 172.21.15.152:0/1670507498 learned_addr learned my addr 172.21.15.152:0/1670507498 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf16754640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf10106a80 0x7fbf1019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf15f53640 1 -- 172.21.15.152:0/1670507498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf10101420 msgr2=0x7fbf101989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf15f53640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf10101420 0x7fbf101989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf15f53640 1 -- 172.21.15.152:0/1670507498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf10106a80 msgr2=0x7fbf1019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf15f53640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf10106a80 0x7fbf1019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf15f53640 1 -- 172.21.15.152:0/1670507498 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1019d430 con 0x7fbf10100a80 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf16754640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf10106a80 0x7fbf1019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf15f53640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf10100a80 0x7fbf10198480 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00d950 tx=0x7fbf0c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf06ffd640 1 -- 172.21.15.152:0/1670507498 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c017070 con 0x7fbf10100a80 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf181b7640 1 -- 172.21.15.152:0/1670507498 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1019d720 con 0x7fbf10100a80 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf06ffd640 1 -- 172.21.15.152:0/1670507498 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf0c009c30 con 0x7fbf10100a80 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf06ffd640 1 -- 172.21.15.152:0/1670507498 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00f6b0 con 0x7fbf10100a80 2024-09-11T22:19:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.888+0000 7fbf181b7640 1 -- 172.21.15.152:0/1670507498 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf101a5000 con 0x7fbf10100a80 2024-09-11T22:19:54.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.890+0000 7fbf06ffd640 1 -- 172.21.15.152:0/1670507498 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fbf0c0109d0 con 0x7fbf10100a80 2024-09-11T22:19:54.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.891+0000 7fbf1a590740 1 Processor -- start 2024-09-11T22:19:54.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.891+0000 7fbf1a590740 1 -- start start 2024-09-11T22:19:54.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.891+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7b4a0 0x557fecf7b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.891+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7bdc0 0x557fecf86140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.891+0000 7fbf06ffd640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbefc0a2cf0 0x7fbefc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.892+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf86680 0x557fecf88a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.892+0000 7fbf06ffd640 1 -- 172.21.15.152:0/1670507498 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7fbf0c0cf110 con 0x7fbf10100a80 2024-09-11T22:19:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.892+0000 7fbf16754640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7b4a0 0x557fecf7b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.892+0000 7fbf16754640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7b4a0 0x557fecf7b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33752/0 (socket says 172.21.15.152:33752) 2024-09-11T22:19:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.892+0000 7fbf1a590740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557fecee12e0 con 0x557fecf7bdc0 2024-09-11T22:19:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.892+0000 7fbf1a590740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557fece88ce0 con 0x557fecf7b4a0 2024-09-11T22:19:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.892+0000 7fbf1a590740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557fecedd2a0 con 0x557fecf86680 2024-09-11T22:19:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.892+0000 7fbf16754640 1 -- 172.21.15.152:0/593414057 learned_addr learned my addr 172.21.15.152:0/593414057 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.892+0000 7fbf15f53640 1 --2- 172.21.15.152:0/593414057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7bdc0 0x557fecf86140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.892+0000 7fbf15752640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbefc0a2cf0 0x7fbefc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.893+0000 7fbf15f53640 1 -- 172.21.15.152:0/593414057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf86680 msgr2=0x557fecf88a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.893+0000 7fbf15f53640 1 --2- 172.21.15.152:0/593414057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf86680 0x557fecf88a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.893+0000 7fbf15f53640 1 -- 172.21.15.152:0/593414057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7b4a0 msgr2=0x557fecf7b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.893+0000 7fbf15f53640 1 --2- 172.21.15.152:0/593414057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7b4a0 0x557fecf7b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.893+0000 7fbf15f53640 1 -- 172.21.15.152:0/593414057 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fece6d440 con 0x557fecf7bdc0 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.893+0000 7fbf15752640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbefc0a2cf0 0x7fbefc0a51b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009860 tx=0x7fbf000056d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.894+0000 7fbf15f53640 1 --2- 172.21.15.152:0/593414057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7bdc0 0x557fecf86140 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0cc7a0 tx=0x7fbf0c09af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3722a495aa3d1137 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.894+0000 7fbefbfff640 1 -- 172.21.15.152:0/593414057 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c020040 con 0x557fecf7bdc0 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.894+0000 7fbefbfff640 1 -- 172.21.15.152:0/593414057 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf0c09b570 con 0x557fecf7bdc0 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.894+0000 7fbefbfff640 1 -- 172.21.15.152:0/593414057 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c09a9c0 con 0x557fecf7bdc0 2024-09-11T22:19:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.895+0000 7fbf1a590740 1 -- 172.21.15.152:0/593414057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7bdc0 msgr2=0x557fecf86140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.895+0000 7fbf1a590740 1 --2- 172.21.15.152:0/593414057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7bdc0 0x557fecf86140 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0cc7a0 tx=0x7fbf0c09af90 comp rx=0 tx=0).stop 2024-09-11T22:19:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.895+0000 7fbf1a590740 1 -- 172.21.15.152:0/593414057 shutdown_connections 2024-09-11T22:19:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.895+0000 7fbf1a590740 1 --2- 172.21.15.152:0/593414057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf86680 0x557fecf88a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.895+0000 7fbf1a590740 1 --2- 172.21.15.152:0/593414057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7bdc0 0x557fecf86140 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.895+0000 7fbf1a590740 1 --2- 172.21.15.152:0/593414057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7b4a0 0x557fecf7b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.895+0000 7fbf1a590740 1 -- 172.21.15.152:0/593414057 >> 172.21.15.152:0/593414057 conn(0x557fecf77a30 msgr2=0x557fecf77e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.895+0000 7fbf1a590740 1 -- 172.21.15.152:0/593414057 shutdown_connections 2024-09-11T22:19:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.895+0000 7fbf1a590740 1 -- 172.21.15.152:0/593414057 wait complete. 2024-09-11T22:19:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.896+0000 7fbf1a590740 1 -- start start 2024-09-11T22:19:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.896+0000 7fbf1a590740 1 Processor -- start 2024-09-11T22:19:54.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.896+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf7b4a0 0x557fecf86040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 0x557fecf832f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf86680 0x557fecf838e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf1a590740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557fecf89250 con 0x557fecf86680 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf1a590740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557fece9c050 con 0x557fecf7bdc0 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf1a590740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557fecf893d0 con 0x557fecf7b4a0 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf1a590740 10 client.0 _ll_register_callbacks cb 0x557fecedc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf15752640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 0x557fecf832f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf15752640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 0x557fecf832f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33768/0 (socket says 172.21.15.152:33768) 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf15752640 1 -- 172.21.15.152:0/859996305 learned_addr learned my addr 172.21.15.152:0/859996305 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf16754640 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf86680 0x557fecf838e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf15f53640 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf7b4a0 0x557fecf86040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf15752640 1 -- 172.21.15.152:0/859996305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf7b4a0 msgr2=0x557fecf86040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf15752640 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf7b4a0 0x557fecf86040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf15752640 1 -- 172.21.15.152:0/859996305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf86680 msgr2=0x557fecf838e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf15752640 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf86680 0x557fecf838e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf15752640 1 -- 172.21.15.152:0/859996305 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fecc523c0 con 0x557fecf7bdc0 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbf15752640 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 0x557fecf832f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbf000095f0 tx=0x7fbf00005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=206adf490f278aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbef97fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.897+0000 7fbef97fa640 1 -- 172.21.15.152:0/859996305 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00041070 con 0x557fecf7bdc0 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbef97fa640 1 -- 172.21.15.152:0/859996305 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7fbf000037f0 con 0x557fecf7bdc0 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbf1a590740 1 -- 172.21.15.152:0/859996305 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf0c09b570 con 0x557fecf7bdc0 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbef97fa640 1 -- 172.21.15.152:0/859996305 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbf00056050 con 0x557fecf7bdc0 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbf1a590740 10 client.28469 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbf1a590740 1 -- 172.21.15.152:0/859996305 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557fecf9d4d0 con 0x557fecf7bdc0 2024-09-11T22:19:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbef97fa640 1 -- 172.21.15.152:0/859996305 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf0c09b570 con 0x557fecf7bdc0 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbef97fa640 1 -- 172.21.15.152:0/859996305 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fbf00048bc0 con 0x557fecf7bdc0 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbf1a590740 10 client.28469 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbf1a590740 10 client.28469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbf1a590740 20 client.28469 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbf1a590740 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557fecf9edf0 0x557fecfa1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbf1a590740 4 client.28469 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbf1a590740 1 -- 172.21.15.152:0/859996305 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557feceee850 con 0x557fecf9edf0 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.898+0000 7fbf15f53640 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557fecf9edf0 0x557fecfa1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.899+0000 7fbef97fa640 10 client.28469 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.899+0000 7fbf15f53640 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557fecf9edf0 0x557fecfa1210 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a98bafaf7d77b7 server_cookie=bda1e92d2b227f5c in_seq=0 out_seq=0 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbef97fa640 1 -- 172.21.15.152:0/859996305 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557feceee850 con 0x557fecf9edf0 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbef97fa640 10 client.28469 handle_command_reply: tid=0 2024-09-11T22:19:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 1 client.28469 shutdown 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 1 -- 172.21.15.152:0/859996305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 msgr2=0x557fecf832f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 0x557fecf832f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbf000095f0 tx=0x7fbf00005f90 comp rx=0 tx=0).stop 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 1 -- 172.21.15.152:0/859996305 shutdown_connections 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557fecf9edf0 0x557fecfa1210 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf86680 0x557fecf838e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbef97fa640 0 client.28469 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 0x557fecf832f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 1 --2- 172.21.15.152:0/859996305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf7b4a0 0x557fecf86040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 1 -- 172.21.15.152:0/859996305 >> 172.21.15.152:0/859996305 conn(0x557fecf77a30 msgr2=0x557fecf7d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 1 -- 172.21.15.152:0/859996305 shutdown_connections 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 1 -- 172.21.15.152:0/859996305 wait complete. 2024-09-11T22:19:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.900+0000 7fbf1a590740 20 client.28469 trim_cache size 0 max 16384 2024-09-11T22:19:54.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf1a590740 1 Processor -- start 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf1a590740 1 -- start start 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf9ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 0x557fecf82bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf86680 0x557fecf7e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf1a590740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf101a5850 con 0x557fecf7b4a0 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf1a590740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10072370 con 0x557fecf7bdc0 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf1a590740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbf100701e0 con 0x557fecf86680 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf15f53640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf9ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf15752640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 0x557fecf82bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf15f53640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf9ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41024/0 (socket says 172.21.15.152:41024) 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf15f53640 1 -- 172.21.15.152:0/1700771052 learned_addr learned my addr 172.21.15.152:0/1700771052 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf16754640 1 --2- 172.21.15.152:0/1700771052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf86680 0x557fecf7e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf15752640 1 -- 172.21.15.152:0/1700771052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf86680 msgr2=0x557fecf7e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf15752640 1 --2- 172.21.15.152:0/1700771052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf86680 0x557fecf7e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf15752640 1 -- 172.21.15.152:0/1700771052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 msgr2=0x557fecf9ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf15752640 1 --2- 172.21.15.152:0/1700771052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf9ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf15752640 1 -- 172.21.15.152:0/1700771052 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fecf863b0 con 0x557fecf7bdc0 2024-09-11T22:19:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.924+0000 7fbf15f53640 1 --2- 172.21.15.152:0/1700771052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf9ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.925+0000 7fbf15752640 1 --2- 172.21.15.152:0/1700771052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 0x557fecf82bb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbf0002a8a0 tx=0x7fbf00049fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70789310361d6e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.925+0000 7fbefb7fe640 1 -- 172.21.15.152:0/1700771052 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0005e070 con 0x557fecf7bdc0 2024-09-11T22:19:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.925+0000 7fbefb7fe640 1 -- 172.21.15.152:0/1700771052 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf0004d070 con 0x557fecf7bdc0 2024-09-11T22:19:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.925+0000 7fbefb7fe640 1 -- 172.21.15.152:0/1700771052 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00041070 con 0x557fecf7bdc0 2024-09-11T22:19:54.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.925+0000 7fbf1a590740 1 -- 172.21.15.152:0/1700771052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 msgr2=0x557fecf82bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.925+0000 7fbf1a590740 1 --2- 172.21.15.152:0/1700771052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 0x557fecf82bb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbf0002a8a0 tx=0x7fbf00049fc0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.926+0000 7fbf1a590740 1 -- 172.21.15.152:0/1700771052 shutdown_connections 2024-09-11T22:19:54.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.926+0000 7fbf1a590740 1 --2- 172.21.15.152:0/1700771052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf86680 0x557fecf7e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.926+0000 7fbf1a590740 1 --2- 172.21.15.152:0/1700771052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf7bdc0 0x557fecf82bb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.926+0000 7fbf1a590740 1 --2- 172.21.15.152:0/1700771052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf9ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.926+0000 7fbf1a590740 1 -- 172.21.15.152:0/1700771052 >> 172.21.15.152:0/1700771052 conn(0x557fecf77a30 msgr2=0x557fecf77e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.926+0000 7fbf1a590740 1 -- 172.21.15.152:0/1700771052 shutdown_connections 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.926+0000 7fbf1a590740 1 -- 172.21.15.152:0/1700771052 wait complete. 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.926+0000 7fbf1a590740 1 -- start start 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.926+0000 7fbf1a590740 1 Processor -- start 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf97220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf7bdc0 0x557fecf97760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf1a590740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf86680 0x557fecf927a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf1a590740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10070830 con 0x557fecf7b4a0 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf1a590740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10071ca0 con 0x557fecf86680 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf1a590740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10070f00 con 0x557fecf7bdc0 2024-09-11T22:19:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf1a590740 10 client.0 _ll_register_callbacks cb 0x7fbf08009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf15f53640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf97220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf15f53640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf97220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41028/0 (socket says 172.21.15.152:41028) 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf15f53640 1 -- 172.21.15.152:0/1972795991 learned_addr learned my addr 172.21.15.152:0/1972795991 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf15752640 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf7bdc0 0x557fecf97760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.927+0000 7fbf16754640 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf86680 0x557fecf927a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.928+0000 7fbf15f53640 1 -- 172.21.15.152:0/1972795991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf7bdc0 msgr2=0x557fecf97760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.928+0000 7fbf15f53640 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf7bdc0 0x557fecf97760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.928+0000 7fbf15f53640 1 -- 172.21.15.152:0/1972795991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf86680 msgr2=0x557fecf927a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.928+0000 7fbf15f53640 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf86680 0x557fecf927a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.928+0000 7fbf15f53640 1 -- 172.21.15.152:0/1972795991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fecf92fd0 con 0x557fecf7b4a0 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.928+0000 7fbf15f53640 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf97220 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0978f0 tx=0x7fbf0c09b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81659a72e5698cde server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.928+0000 7fbef97fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:19:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.928+0000 7fbef97fa640 1 -- 172.21.15.152:0/1972795991 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c020040 con 0x557fecf7b4a0 2024-09-11T22:19:54.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.928+0000 7fbef97fa640 1 -- 172.21.15.152:0/1972795991 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7fbf0c099870 con 0x557fecf7b4a0 2024-09-11T22:19:54.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.928+0000 7fbf1a590740 1 -- 172.21.15.152:0/1972795991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf0004d070 con 0x557fecf7b4a0 2024-09-11T22:19:54.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.929+0000 7fbef97fa640 1 -- 172.21.15.152:0/1972795991 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbf0c0cca20 con 0x557fecf7b4a0 2024-09-11T22:19:54.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.929+0000 7fbf1a590740 10 client.19320 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:54.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.929+0000 7fbf1a590740 1 -- 172.21.15.152:0/1972795991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557fed009720 con 0x557fecf7b4a0 2024-09-11T22:19:54.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.929+0000 7fbef97fa640 1 -- 172.21.15.152:0/1972795991 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf0004d070 con 0x557fecf7b4a0 2024-09-11T22:19:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.929+0000 7fbef97fa640 1 -- 172.21.15.152:0/1972795991 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fbf0c071b30 con 0x557fecf7b4a0 2024-09-11T22:19:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.929+0000 7fbf1a590740 10 client.19320 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.929+0000 7fbf1a590740 10 client.19320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:19:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.929+0000 7fbf1a590740 20 client.19320 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.929+0000 7fbf1a590740 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557fecf9edf0 0x557fed00be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.929+0000 7fbf1a590740 4 client.19320 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:19:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.929+0000 7fbf1a590740 1 -- 172.21.15.152:0/1972795991 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557fecee8d60 con 0x557fecf9edf0 2024-09-11T22:19:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.930+0000 7fbf15752640 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557fecf9edf0 0x557fed00be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.930+0000 7fbf15752640 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557fecf9edf0 0x557fed00be80 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c800d7f43ee916e server_cookie=5897f967608f6fe4 in_seq=0 out_seq=0 2024-09-11T22:19:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.930+0000 7fbef97fa640 10 client.19320 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.930+0000 7fbef97fa640 1 -- 172.21.15.152:0/1972795991 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557fecee8d60 con 0x557fecf9edf0 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.930+0000 7fbef97fa640 10 client.19320 handle_command_reply: tid=0 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.930+0000 7fbf1a590740 1 client.19320 shutdown 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.930+0000 7fbf1a590740 1 -- 172.21.15.152:0/1972795991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 msgr2=0x557fecf97220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.930+0000 7fbf1a590740 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf97220 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0978f0 tx=0x7fbf0c09b000 comp rx=0 tx=0).stop 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.931+0000 7fbf1a590740 1 -- 172.21.15.152:0/1972795991 shutdown_connections 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.931+0000 7fbf1a590740 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x557fecf9edf0 0x557fed00be80 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.931+0000 7fbf1a590740 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fecf86680 0x557fecf927a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.931+0000 7fbef97fa640 0 client.19320 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.931+0000 7fbf1a590740 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557fecf7bdc0 0x557fecf97760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.931+0000 7fbf1a590740 1 --2- 172.21.15.152:0/1972795991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fecf7b4a0 0x557fecf97220 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.931+0000 7fbf1a590740 1 -- 172.21.15.152:0/1972795991 >> 172.21.15.152:0/1972795991 conn(0x557fecf77a30 msgr2=0x557fecf7d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.931+0000 7fbf1a590740 1 -- 172.21.15.152:0/1972795991 shutdown_connections 2024-09-11T22:19:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.931+0000 7fbf1a590740 1 -- 172.21.15.152:0/1972795991 wait complete. 2024-09-11T22:19:54.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.931+0000 7fbf1a590740 20 client.19320 trim_cache size 0 max 16384 2024-09-11T22:19:54.936 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:19:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:19:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:19:54.936 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:19:54.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 -- 172.21.15.152:0/1670507498 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbefc0a2cf0 msgr2=0x7fbefc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbefc0a2cf0 0x7fbefc0a51b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009860 tx=0x7fbf000056d0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 -- 172.21.15.152:0/1670507498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf10100a80 msgr2=0x7fbf10198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf10100a80 0x7fbf10198480 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00d950 tx=0x7fbf0c00de10 comp rx=0 tx=0).stop 2024-09-11T22:19:54.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 -- 172.21.15.152:0/1670507498 shutdown_connections 2024-09-11T22:19:54.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fbefc0a2cf0 0x7fbefc0a51b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf10106a80 0x7fbf1019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf10101420 0x7fbf101989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 --2- 172.21.15.152:0/1670507498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf10100a80 0x7fbf10198480 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 -- 172.21.15.152:0/1670507498 >> 172.21.15.152:0/1670507498 conn(0x7fbf100fc7a0 msgr2=0x7fbf100fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:54.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 -- 172.21.15.152:0/1670507498 shutdown_connections 2024-09-11T22:19:54.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:54.932+0000 7fbf181b7640 1 -- 172.21.15.152:0/1670507498 wait complete. 2024-09-11T22:19:55.812 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:19:55.812 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:19:55.899 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:55 smithi152 ceph-mon[31188]: pgmap v490: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 1.89k op/s 2024-09-11T22:19:56.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:55 smithi179 ceph-mon[35603]: pgmap v490: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 1.89k op/s 2024-09-11T22:19:56.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:55 smithi193 ceph-mon[35545]: pgmap v490: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 1.89k op/s 2024-09-11T22:19:56.210 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:19:56.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.791+0000 7f09f0564640 1 -- 172.21.15.152:0/2330306031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09e81036e0 msgr2=0x7f09e8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.791+0000 7f09f0564640 1 --2- 172.21.15.152:0/2330306031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09e81036e0 0x7f09e8107b90 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009930 tx=0x7f09d802a420 comp rx=0 tx=0).stop 2024-09-11T22:19:56.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.792+0000 7f09f0564640 1 -- 172.21.15.152:0/2330306031 shutdown_connections 2024-09-11T22:19:56.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.792+0000 7f09f0564640 1 --2- 172.21.15.152:0/2330306031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e81082a0 0x7f09e810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.792+0000 7f09f0564640 1 --2- 172.21.15.152:0/2330306031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09e81036e0 0x7f09e8107b90 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.792+0000 7f09f0564640 1 --2- 172.21.15.152:0/2330306031 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09e8102d30 0x7f09e8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.792+0000 7f09f0564640 1 -- 172.21.15.152:0/2330306031 >> 172.21.15.152:0/2330306031 conn(0x7f09e80fc7d0 msgr2=0x7f09e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.792+0000 7f09f0564640 1 -- 172.21.15.152:0/2330306031 shutdown_connections 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.792+0000 7f09f0564640 1 -- 172.21.15.152:0/2330306031 wait complete. 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.793+0000 7f09f0564640 1 Processor -- start 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.793+0000 7f09f0564640 1 -- start start 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.793+0000 7f09f0564640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e8102d30 0x7f09e81985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.793+0000 7f09f0564640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09e81036e0 0x7f09e8198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.793+0000 7f09f0564640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09e81082a0 0x7f09e819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.793+0000 7f09f0564640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f09e81120a0 con 0x7f09e81082a0 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.793+0000 7f09f0564640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8111f20 con 0x7f09e8102d30 2024-09-11T22:19:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.793+0000 7f09f0564640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8112220 con 0x7f09e81036e0 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.793+0000 7f09eeb01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09e81082a0 0x7f09e819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09ee300640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e8102d30 0x7f09e81985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09eeb01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09e81082a0 0x7f09e819ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41044/0 (socket says 172.21.15.152:41044) 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09eeb01640 1 -- 172.21.15.152:0/2314014216 learned_addr learned my addr 172.21.15.152:0/2314014216 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09edaff640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09e81036e0 0x7f09e8198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09edaff640 1 -- 172.21.15.152:0/2314014216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e8102d30 msgr2=0x7f09e81985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09edaff640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e8102d30 0x7f09e81985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09edaff640 1 -- 172.21.15.152:0/2314014216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09e81082a0 msgr2=0x7f09e819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09edaff640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09e81082a0 0x7f09e819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09edaff640 1 -- 172.21.15.152:0/2314014216 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e819d590 con 0x7f09e81036e0 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09ee300640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e8102d30 0x7f09e81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09edaff640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09e81036e0 0x7f09e8198b20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f09d802a940 tx=0x7f09d8005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09df7fe640 1 -- 172.21.15.152:0/2314014216 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d803e070 con 0x7f09e81036e0 2024-09-11T22:19:56.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.794+0000 7f09f0564640 1 -- 172.21.15.152:0/2314014216 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e819d820 con 0x7f09e81036e0 2024-09-11T22:19:56.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.795+0000 7f09df7fe640 1 -- 172.21.15.152:0/2314014216 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09d8003ad0 con 0x7f09e81036e0 2024-09-11T22:19:56.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.795+0000 7f09df7fe640 1 -- 172.21.15.152:0/2314014216 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d8035070 con 0x7f09e81036e0 2024-09-11T22:19:56.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.795+0000 7f09f0564640 1 -- 172.21.15.152:0/2314014216 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e81008c0 con 0x7f09e81036e0 2024-09-11T22:19:56.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.795+0000 7f09f0564640 1 -- 172.21.15.152:0/2314014216 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e806a850 con 0x7f09e81036e0 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.797+0000 7f09df7fe640 1 -- 172.21.15.152:0/2314014216 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f09d803abe0 con 0x7f09e81036e0 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.797+0000 7f09df7fe640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f09d40a2cf0 0x7f09d40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.797+0000 7f09ee300640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f09d40a2cf0 0x7f09d40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.798+0000 7f09df7fe640 1 -- 172.21.15.152:0/2314014216 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f09d80ef4a0 con 0x7f09e81036e0 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.798+0000 7f09ee300640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f09d40a2cf0 0x7f09d40a51b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009fc0 tx=0x7f09e4005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:56.801+0000 7f09df7fe640 1 -- 172.21.15.152:0/2314014216 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09d80bb9b0 con 0x7f09e81036e0 2024-09-11T22:19:57.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.081+0000 7f09f0564640 1 -- 172.21.15.152:0/2314014216 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09e8103110 con 0x7f09e81036e0 2024-09-11T22:19:57.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.082+0000 7f09df7fe640 1 -- 172.21.15.152:0/2314014216 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f09d80cfe20 con 0x7f09e81036e0 2024-09-11T22:19:57.083 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:19:57.083 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:19:57.083 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:19:57.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 -- 172.21.15.152:0/2314014216 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f09d40a2cf0 msgr2=0x7f09d40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f09d40a2cf0 0x7f09d40a51b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009fc0 tx=0x7f09e4005f90 comp rx=0 tx=0).stop 2024-09-11T22:19:57.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 -- 172.21.15.152:0/2314014216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09e81036e0 msgr2=0x7f09e8198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09e81036e0 0x7f09e8198b20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f09d802a940 tx=0x7f09d8005e50 comp rx=0 tx=0).stop 2024-09-11T22:19:57.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 -- 172.21.15.152:0/2314014216 shutdown_connections 2024-09-11T22:19:57.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f09d40a2cf0 0x7f09d40a51b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09e81082a0 0x7f09e819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09e81036e0 0x7f09e8198b20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 --2- 172.21.15.152:0/2314014216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e8102d30 0x7f09e81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 -- 172.21.15.152:0/2314014216 >> 172.21.15.152:0/2314014216 conn(0x7f09e80fc7d0 msgr2=0x7f09e8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 -- 172.21.15.152:0/2314014216 shutdown_connections 2024-09-11T22:19:57.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:57.084+0000 7f09f0564640 1 -- 172.21.15.152:0/2314014216 wait complete. 2024-09-11T22:19:57.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:57 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2314014216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:19:57.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:57 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2314014216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:19:57.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:57 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2314014216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:19:57.912 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:19:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:19:58.398 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:58 smithi152 ceph-mon[31188]: pgmap v491: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 1.34k op/s 2024-09-11T22:19:58.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:58 smithi179 ceph-mon[35603]: pgmap v491: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 1.34k op/s 2024-09-11T22:19:58.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:58 smithi193 ceph-mon[35545]: pgmap v491: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 1.34k op/s 2024-09-11T22:19:58.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.855+0000 7f487a781640 1 -- 172.21.15.152:0/1968003861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874105d90 msgr2=0x7f4874106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.855+0000 7f487a781640 1 --2- 172.21.15.152:0/1968003861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874105d90 0x7f4874106220 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f486c009ca0 tx=0x7f486c02a940 comp rx=0 tx=0).stop 2024-09-11T22:19:58.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.855+0000 7f487a781640 1 -- 172.21.15.152:0/1968003861 shutdown_connections 2024-09-11T22:19:58.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.855+0000 7f487a781640 1 --2- 172.21.15.152:0/1968003861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874105d90 0x7f4874106220 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.856+0000 7f487a781640 1 --2- 172.21.15.152:0/1968003861 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48741012a0 0x7f4874105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.856+0000 7f487a781640 1 --2- 172.21.15.152:0/1968003861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4874100980 0x7f4874100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.856+0000 7f487a781640 1 -- 172.21.15.152:0/1968003861 >> 172.21.15.152:0/1968003861 conn(0x7f48740fc610 msgr2=0x7f48740fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.856+0000 7f487a781640 1 -- 172.21.15.152:0/1968003861 shutdown_connections 2024-09-11T22:19:58.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.856+0000 7f487a781640 1 -- 172.21.15.152:0/1968003861 wait complete. 2024-09-11T22:19:58.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f487a781640 1 Processor -- start 2024-09-11T22:19:58.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f487a781640 1 -- start start 2024-09-11T22:19:58.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f487a781640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4874100980 0x7f4874073a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f487a781640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48741012a0 0x7f487406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f487a781640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874105d90 0x7f487406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f487a781640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4874118350 con 0x7f48741012a0 2024-09-11T22:19:58.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f487a781640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f48741181d0 con 0x7f4874105d90 2024-09-11T22:19:58.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f487a781640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f48741184d0 con 0x7f4874100980 2024-09-11T22:19:58.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f4878f7e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48741012a0 0x7f487406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f487977f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4874100980 0x7f4874073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f487977f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4874100980 0x7f4874073a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52758/0 (socket says 172.21.15.152:52758) 2024-09-11T22:19:58.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.857+0000 7f487977f640 1 -- 172.21.15.152:0/2588058009 learned_addr learned my addr 172.21.15.152:0/2588058009 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:58.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.858+0000 7f4879f80640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874105d90 0x7f487406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.858+0000 7f4878f7e640 1 -- 172.21.15.152:0/2588058009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4874100980 msgr2=0x7f4874073a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.858+0000 7f4878f7e640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4874100980 0x7f4874073a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.858+0000 7f4878f7e640 1 -- 172.21.15.152:0/2588058009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874105d90 msgr2=0x7f487406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.858+0000 7f4878f7e640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874105d90 0x7f487406cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.858+0000 7f4878f7e640 1 -- 172.21.15.152:0/2588058009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487406d5e0 con 0x7f48741012a0 2024-09-11T22:19:58.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.858+0000 7f4878f7e640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48741012a0 0x7f487406cab0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f486400d680 tx=0x7f486400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.859+0000 7f486a7fc640 1 -- 172.21.15.152:0/2588058009 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864017070 con 0x7f48741012a0 2024-09-11T22:19:58.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.859+0000 7f486a7fc640 1 -- 172.21.15.152:0/2588058009 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48640097c0 con 0x7f48741012a0 2024-09-11T22:19:58.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.859+0000 7f487a781640 1 -- 172.21.15.152:0/2588058009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487406d8d0 con 0x7f48741012a0 2024-09-11T22:19:58.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.859+0000 7f487a781640 1 -- 172.21.15.152:0/2588058009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48740718c0 con 0x7f48741012a0 2024-09-11T22:19:58.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.859+0000 7f486a7fc640 1 -- 172.21.15.152:0/2588058009 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864004bc0 con 0x7f48741012a0 2024-09-11T22:19:58.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.862+0000 7f486a7fc640 1 -- 172.21.15.152:0/2588058009 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f4864009970 con 0x7f48741012a0 2024-09-11T22:19:58.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.863+0000 7f487ddbc740 1 Processor -- start 2024-09-11T22:19:58.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.863+0000 7f487ddbc740 1 -- start start 2024-09-11T22:19:58.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.863+0000 7f486a7fc640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f48600a2dc0 0x7f48600a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.863+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 0x56542a14e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 0x56542a14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f486a7fc640 1 -- 172.21.15.152:0/2588058009 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f48640cea10 con 0x7f48741012a0 2024-09-11T22:19:58.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a159520 0x56542a15b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487ddbc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56542a0b42f0 con 0x56542a159520 2024-09-11T22:19:58.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487ddbc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56542a05bcf0 con 0x56542a14e780 2024-09-11T22:19:58.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487ddbc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56542a0b02b0 con 0x56542a14fcf0 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f4879f80640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f48600a2dc0 0x7f48600a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487977f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 0x56542a14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487977f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 0x56542a14e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52772/0 (socket says 172.21.15.152:52772) 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487977f640 1 -- 172.21.15.152:0/2730214083 learned_addr learned my addr 172.21.15.152:0/2730214083 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f4878f7e640 1 --2- 172.21.15.152:0/2730214083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 0x56542a14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f4879f80640 1 --2- 172.21.15.152:0/2730214083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a159520 0x56542a15b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487977f640 1 -- 172.21.15.152:0/2730214083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 msgr2=0x56542a14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487977f640 1 --2- 172.21.15.152:0/2730214083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 0x56542a14ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487977f640 1 -- 172.21.15.152:0/2730214083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a159520 msgr2=0x56542a15b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487977f640 1 --2- 172.21.15.152:0/2730214083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a159520 0x56542a15b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487977f640 1 -- 172.21.15.152:0/2730214083 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56542a0403a0 con 0x56542a14fcf0 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f4878f7e640 1 --2- 172.21.15.152:0/2730214083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 0x56542a14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f4879f80640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f48600a2dc0 0x7f48600a5280 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f486c006010 tx=0x7f486c02f6b0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.864+0000 7f487977f640 1 --2- 172.21.15.152:0/2730214083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 0x56542a14e240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4870009dc0 tx=0x7f4870011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6246f720b8fabdf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.865+0000 7f485f7fe640 1 -- 172.21.15.152:0/2730214083 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870005220 con 0x56542a14fcf0 2024-09-11T22:19:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.865+0000 7f485f7fe640 1 -- 172.21.15.152:0/2730214083 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4870004c80 con 0x56542a14fcf0 2024-09-11T22:19:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.865+0000 7f485f7fe640 1 -- 172.21.15.152:0/2730214083 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870019810 con 0x56542a14fcf0 2024-09-11T22:19:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.866+0000 7f487ddbc740 1 -- 172.21.15.152:0/2730214083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 msgr2=0x56542a14e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.866+0000 7f487ddbc740 1 --2- 172.21.15.152:0/2730214083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 0x56542a14e240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4870009dc0 tx=0x7f4870011810 comp rx=0 tx=0).stop 2024-09-11T22:19:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.866+0000 7f487ddbc740 1 -- 172.21.15.152:0/2730214083 shutdown_connections 2024-09-11T22:19:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.866+0000 7f487ddbc740 1 --2- 172.21.15.152:0/2730214083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a159520 0x56542a15b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.866+0000 7f487ddbc740 1 --2- 172.21.15.152:0/2730214083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 0x56542a14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.866+0000 7f487ddbc740 1 --2- 172.21.15.152:0/2730214083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 0x56542a14e240 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.866+0000 7f487ddbc740 1 -- 172.21.15.152:0/2730214083 >> 172.21.15.152:0/2730214083 conn(0x56542a117310 msgr2=0x56542a14ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.866+0000 7f487ddbc740 1 -- 172.21.15.152:0/2730214083 shutdown_connections 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.866+0000 7f487ddbc740 1 -- 172.21.15.152:0/2730214083 wait complete. 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.866+0000 7f487ddbc740 1 -- start start 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.866+0000 7f487ddbc740 1 Processor -- start 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14e780 0x56542a158e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a14fcf0 0x56542a156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a159520 0x56542a156690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f487ddbc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56542a15c220 con 0x56542a14fcf0 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f487ddbc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56542a06f060 con 0x56542a159520 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f487ddbc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56542a15c3a0 con 0x56542a14e780 2024-09-11T22:19:58.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f487977f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14e780 0x56542a158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f4879f80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a159520 0x56542a156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f4878f7e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a14fcf0 0x56542a156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f487977f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14e780 0x56542a158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52778/0 (socket says 172.21.15.152:52778) 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f487977f640 1 -- 172.21.15.152:0/1467309599 learned_addr learned my addr 172.21.15.152:0/1467309599 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f487ddbc740 10 client.0 _ll_register_callbacks cb 0x565429dc28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f4879f80640 1 -- 172.21.15.152:0/1467309599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14e780 msgr2=0x56542a158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f4879f80640 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14e780 0x56542a158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f4879f80640 1 -- 172.21.15.152:0/1467309599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a14fcf0 msgr2=0x56542a156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.867+0000 7f4879f80640 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a14fcf0 0x56542a156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.868+0000 7f4879f80640 1 -- 172.21.15.152:0/1467309599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565429e253c0 con 0x56542a159520 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.868+0000 7f487977f640 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14e780 0x56542a158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:58.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.868+0000 7f4879f80640 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a159520 0x56542a156690 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f486c009ca0 tx=0x7f486c02a940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caaa04f715b334c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.868+0000 7f485cff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.868+0000 7f485cff9640 1 -- 172.21.15.152:0/1467309599 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c034040 con 0x56542a159520 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.868+0000 7f485cff9640 1 -- 172.21.15.152:0/1467309599 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f486c030a50 con 0x56542a159520 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.868+0000 7f487ddbc740 1 -- 172.21.15.152:0/1467309599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4870004c80 con 0x56542a159520 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.868+0000 7f485cff9640 1 -- 172.21.15.152:0/1467309599 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f486c058050 con 0x56542a159520 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.868+0000 7f487ddbc740 10 client.28493 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.868+0000 7f487ddbc740 1 -- 172.21.15.152:0/1467309599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56542a167c30 con 0x56542a159520 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.868+0000 7f485cff9640 1 -- 172.21.15.152:0/1467309599 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f486c04f070 con 0x56542a159520 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.869+0000 7f485cff9640 1 -- 172.21.15.152:0/1467309599 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f486c02f070 con 0x56542a159520 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.869+0000 7f487ddbc740 10 client.28493 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.869+0000 7f487ddbc740 10 client.28493 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:19:58.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.869+0000 7f487ddbc740 20 client.28493 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:58.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.869+0000 7f487ddbc740 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56542a1690f0 0x56542a16b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.869+0000 7f487ddbc740 4 client.28493 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:58.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.869+0000 7f487ddbc740 1 -- 172.21.15.152:0/1467309599 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4870004c80 con 0x56542a1690f0 2024-09-11T22:19:58.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.869+0000 7f487977f640 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56542a1690f0 0x56542a16b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.870+0000 7f487977f640 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56542a1690f0 0x56542a16b570 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea3baaaebd9a6457 server_cookie=a5a82d26f1bab963 in_seq=0 out_seq=0 2024-09-11T22:19:58.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.870+0000 7f485cff9640 10 client.28493 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:19:58.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.870+0000 7f485cff9640 1 -- 172.21.15.152:0/1467309599 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f4870004c80 con 0x56542a1690f0 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.870+0000 7f485cff9640 10 client.28493 handle_command_reply: tid=0 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 1 client.28493 shutdown 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 1 -- 172.21.15.152:0/1467309599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a159520 msgr2=0x56542a156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a159520 0x56542a156690 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f486c009ca0 tx=0x7f486c02a940 comp rx=0 tx=0).stop 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 1 -- 172.21.15.152:0/1467309599 shutdown_connections 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56542a1690f0 0x56542a16b570 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a159520 0x56542a156690 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a14fcf0 0x56542a156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 1 --2- 172.21.15.152:0/1467309599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14e780 0x56542a158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f485cff9640 0 client.28493 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 1 -- 172.21.15.152:0/1467309599 >> 172.21.15.152:0/1467309599 conn(0x56542a117310 msgr2=0x56542a150b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 1 -- 172.21.15.152:0/1467309599 shutdown_connections 2024-09-11T22:19:58.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 1 -- 172.21.15.152:0/1467309599 wait complete. 2024-09-11T22:19:58.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.871+0000 7f487ddbc740 20 client.28493 trim_cache size 0 max 16384 2024-09-11T22:19:58.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.886+0000 7f487ddbc740 1 Processor -- start 2024-09-11T22:19:58.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.886+0000 7f487ddbc740 1 -- start start 2024-09-11T22:19:58.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a14e780 0x56542a16b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14fcf0 0x56542a1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a159520 0x56542a1512d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f487ddbc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f48741adf30 con 0x56542a14e780 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f487ddbc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f48741ab800 con 0x56542a14fcf0 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f487ddbc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f48741a9670 con 0x56542a159520 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f4879f80640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a159520 0x56542a1512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f4879f80640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a159520 0x56542a1512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52784/0 (socket says 172.21.15.152:52784) 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f4879f80640 1 -- 172.21.15.152:0/4248109572 learned_addr learned my addr 172.21.15.152:0/4248109572 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f4878f7e640 1 --2- 172.21.15.152:0/4248109572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14fcf0 0x56542a1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f487977f640 1 --2- 172.21.15.152:0/4248109572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a14e780 0x56542a16b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f4879f80640 1 -- 172.21.15.152:0/4248109572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14fcf0 msgr2=0x56542a1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f4879f80640 1 --2- 172.21.15.152:0/4248109572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14fcf0 0x56542a1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f4879f80640 1 -- 172.21.15.152:0/4248109572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a14e780 msgr2=0x56542a16b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f4879f80640 1 --2- 172.21.15.152:0/4248109572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a14e780 0x56542a16b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f4879f80640 1 -- 172.21.15.152:0/4248109572 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56542a1546b0 con 0x56542a159520 2024-09-11T22:19:58.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.887+0000 7f4879f80640 1 --2- 172.21.15.152:0/4248109572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a159520 0x56542a1512d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f486c009840 tx=0x7f486c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375a885453ef6201 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.888+0000 7f485effd640 1 -- 172.21.15.152:0/4248109572 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c034040 con 0x56542a159520 2024-09-11T22:19:58.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.888+0000 7f485effd640 1 -- 172.21.15.152:0/4248109572 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f486c04f040 con 0x56542a159520 2024-09-11T22:19:58.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.888+0000 7f485effd640 1 -- 172.21.15.152:0/4248109572 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c03d530 con 0x56542a159520 2024-09-11T22:19:58.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.888+0000 7f487ddbc740 1 -- 172.21.15.152:0/4248109572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a159520 msgr2=0x56542a1512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.888+0000 7f487ddbc740 1 --2- 172.21.15.152:0/4248109572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a159520 0x56542a1512d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f486c009840 tx=0x7f486c009b20 comp rx=0 tx=0).stop 2024-09-11T22:19:58.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.889+0000 7f487ddbc740 1 -- 172.21.15.152:0/4248109572 shutdown_connections 2024-09-11T22:19:58.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.889+0000 7f487ddbc740 1 --2- 172.21.15.152:0/4248109572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a159520 0x56542a1512d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.889+0000 7f487ddbc740 1 --2- 172.21.15.152:0/4248109572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14fcf0 0x56542a1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.889+0000 7f487ddbc740 1 --2- 172.21.15.152:0/4248109572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a14e780 0x56542a16b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.889+0000 7f487ddbc740 1 -- 172.21.15.152:0/4248109572 >> 172.21.15.152:0/4248109572 conn(0x56542a117310 msgr2=0x56542a157990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.889+0000 7f487ddbc740 1 -- 172.21.15.152:0/4248109572 shutdown_connections 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.889+0000 7f487ddbc740 1 -- 172.21.15.152:0/4248109572 wait complete. 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.889+0000 7f487ddbc740 1 -- start start 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.889+0000 7f487ddbc740 1 Processor -- start 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.889+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 0x56542a161770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.889+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 0x56542a161cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487977f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 0x56542a161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487977f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 0x56542a161770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33886/0 (socket says 172.21.15.152:33886) 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487ddbc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a159520 0x56542a15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487977f640 1 -- 172.21.15.152:0/3444668434 learned_addr learned my addr 172.21.15.152:0/3444668434 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487ddbc740 1 -- 172.21.15.152:0/3444668434 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f48741a9cc0 con 0x56542a159520 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487ddbc740 1 -- 172.21.15.152:0/3444668434 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f48741ab130 con 0x56542a14e780 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487ddbc740 1 -- 172.21.15.152:0/3444668434 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f48741aa390 con 0x56542a14fcf0 2024-09-11T22:19:58.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f4878f7e640 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 0x56542a161cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f4879f80640 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a159520 0x56542a15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487ddbc740 10 client.0 _ll_register_callbacks cb 0x7f4870005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487977f640 1 -- 172.21.15.152:0/3444668434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 msgr2=0x56542a161cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487977f640 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 0x56542a161cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487977f640 1 -- 172.21.15.152:0/3444668434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a159520 msgr2=0x56542a15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487977f640 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a159520 0x56542a15cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487977f640 1 -- 172.21.15.152:0/3444668434 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56542a15d3e0 con 0x56542a14e780 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f4879f80640 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a159520 0x56542a15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487977f640 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 0x56542a161770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4870000c00 tx=0x7f4870005610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=717c3d1be130babf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f485cff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f485cff9640 1 -- 172.21.15.152:0/3444668434 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870003a00 con 0x56542a14e780 2024-09-11T22:19:58.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f487ddbc740 1 -- 172.21.15.152:0/3444668434 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f486c04f040 con 0x56542a14e780 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.890+0000 7f485cff9640 1 -- 172.21.15.152:0/3444668434 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f4870003ba0 con 0x56542a14e780 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f485cff9640 1 -- 172.21.15.152:0/3444668434 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4870003da0 con 0x56542a14e780 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f487ddbc740 10 client.28499 fetch_fsmap learned FSMap version 30 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f487ddbc740 1 -- 172.21.15.152:0/3444668434 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56542a1d39c0 con 0x56542a14e780 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f485cff9640 1 -- 172.21.15.152:0/3444668434 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f486c04f040 con 0x56542a14e780 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f485cff9640 1 -- 172.21.15.152:0/3444668434 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f4870019430 con 0x56542a14e780 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f487ddbc740 10 client.28499 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f487ddbc740 10 client.28499 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f487ddbc740 20 client.28499 populate_metadata read hostname 'smithi152' 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f487ddbc740 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56542a1d3fa0 0x56542a1d6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f487ddbc740 4 client.28499 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f487ddbc740 1 -- 172.21.15.152:0/3444668434 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56542a0c1860 con 0x56542a1d3fa0 2024-09-11T22:19:58.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.891+0000 7f4878f7e640 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56542a1d3fa0 0x56542a1d6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f485cff9640 10 client.28499 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f4878f7e640 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56542a1d3fa0 0x56542a1d6390 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5b4623bf46c74a1 server_cookie=50d00574ceedcc50 in_seq=0 out_seq=0 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f485cff9640 1 -- 172.21.15.152:0/3444668434 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56542a0c1860 con 0x56542a1d3fa0 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f485cff9640 10 client.28499 handle_command_reply: tid=0 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f487ddbc740 1 client.28499 shutdown 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f487ddbc740 1 -- 172.21.15.152:0/3444668434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 msgr2=0x56542a161770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f487ddbc740 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 0x56542a161770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4870000c00 tx=0x7f4870005610 comp rx=0 tx=0).stop 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f487ddbc740 1 -- 172.21.15.152:0/3444668434 shutdown_connections 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f487ddbc740 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x56542a1d3fa0 0x56542a1d6390 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f487ddbc740 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56542a159520 0x56542a15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f487ddbc740 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56542a14fcf0 0x56542a161cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f487ddbc740 1 --2- 172.21.15.152:0/3444668434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56542a14e780 0x56542a161770 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f487ddbc740 1 -- 172.21.15.152:0/3444668434 >> 172.21.15.152:0/3444668434 conn(0x56542a117310 msgr2=0x56542a1581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f485cff9640 0 client.28499 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:19:58.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.892+0000 7f487ddbc740 1 -- 172.21.15.152:0/3444668434 shutdown_connections 2024-09-11T22:19:58.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.893+0000 7f487ddbc740 1 -- 172.21.15.152:0/3444668434 wait complete. 2024-09-11T22:19:58.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.893+0000 7f487ddbc740 20 client.28499 trim_cache size 0 max 16384 2024-09-11T22:19:58.899 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:19:58.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.894+0000 7f487a781640 1 -- 172.21.15.152:0/2588058009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f48600a2dc0 msgr2=0x7f48600a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.894+0000 7f487a781640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f48600a2dc0 0x7f48600a5280 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f486c006010 tx=0x7f486c02f6b0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.894+0000 7f487a781640 1 -- 172.21.15.152:0/2588058009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48741012a0 msgr2=0x7f487406cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.894+0000 7f487a781640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48741012a0 0x7f487406cab0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f486400d680 tx=0x7f486400db40 comp rx=0 tx=0).stop 2024-09-11T22:19:58.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.894+0000 7f487a781640 1 -- 172.21.15.152:0/2588058009 shutdown_connections 2024-09-11T22:19:58.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.894+0000 7f487a781640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f48600a2dc0 0x7f48600a5280 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.894+0000 7f487a781640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874105d90 0x7f487406cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.894+0000 7f487a781640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48741012a0 0x7f487406cab0 secure :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f486400d680 tx=0x7f486400db40 comp rx=0 tx=0).stop 2024-09-11T22:19:58.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.894+0000 7f487a781640 1 --2- 172.21.15.152:0/2588058009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4874100980 0x7f4874073a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.895+0000 7f487a781640 1 -- 172.21.15.152:0/2588058009 >> 172.21.15.152:0/2588058009 conn(0x7f48740fc610 msgr2=0x7f48740fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.895+0000 7f487a781640 1 -- 172.21.15.152:0/2588058009 shutdown_connections 2024-09-11T22:19:58.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:19:58.895+0000 7f487a781640 1 -- 172.21.15.152:0/2588058009 wait complete. 2024-09-11T22:19:59.766 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:19:59.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 865.0 s, 1721.4 tps, lat 58.609 ms stddev 64.294 2024-09-11T22:19:59.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:19:59 smithi152 ceph-mon[31188]: pgmap v492: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 1.50k op/s 2024-09-11T22:20:00.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:19:59 smithi179 ceph-mon[35603]: pgmap v492: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 1.50k op/s 2024-09-11T22:20:00.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:19:59 smithi193 ceph-mon[35545]: pgmap v492: 97 pgs: 97 active+clean; 4.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 1.50k op/s 2024-09-11T22:20:00.140 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:00.870 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:00 smithi152 ceph-mon[31188]: overall HEALTH_OK 2024-09-11T22:20:01.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:00 smithi179 ceph-mon[35603]: overall HEALTH_OK 2024-09-11T22:20:01.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:00 smithi193 ceph-mon[35545]: overall HEALTH_OK 2024-09-11T22:20:01.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.868+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/3037177207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c78102ef0 msgr2=0x7f2c7810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:01.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.868+0000 7f2c7dfc2640 1 --2- 172.21.15.152:0/3037177207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c78102ef0 0x7f2c7810da40 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f2c70009ca0 tx=0x7f2c7002a980 comp rx=0 tx=0).stop 2024-09-11T22:20:01.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.869+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/3037177207 shutdown_connections 2024-09-11T22:20:01.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.869+0000 7f2c7dfc2640 1 --2- 172.21.15.152:0/3037177207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c78102ef0 0x7f2c7810da40 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.869+0000 7f2c7dfc2640 1 --2- 172.21.15.152:0/3037177207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c78102570 0x7f2c781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.869+0000 7f2c7dfc2640 1 --2- 172.21.15.152:0/3037177207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c78100e20 0x7f2c78101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.869+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/3037177207 >> 172.21.15.152:0/3037177207 conn(0x7f2c780fc7d0 msgr2=0x7f2c780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:01.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.869+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/3037177207 shutdown_connections 2024-09-11T22:20:01.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.869+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/3037177207 wait complete. 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.870+0000 7f2c7dfc2640 1 Processor -- start 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.870+0000 7f2c7dfc2640 1 -- start start 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.870+0000 7f2c7dfc2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c78100e20 0x7f2c78197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c7dfc2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c78102570 0x7f2c781978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c7dfc2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c78102ef0 0x7f2c7819bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c7dfc2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c78110f80 con 0x7f2c78102ef0 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c7dfc2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2c78110e00 con 0x7f2c78100e20 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c7dfc2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2c78111100 con 0x7f2c78102570 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c77fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c78102ef0 0x7f2c7819bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c76ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c78102570 0x7f2c781978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c77fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c78102ef0 0x7f2c7819bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41112/0 (socket says 172.21.15.152:41112) 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c77fff640 1 -- 172.21.15.152:0/77792255 learned_addr learned my addr 172.21.15.152:0/77792255 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c77fff640 1 -- 172.21.15.152:0/77792255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c78102570 msgr2=0x7f2c781978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:01.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c77fff640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c78102570 0x7f2c781978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c77fff640 1 -- 172.21.15.152:0/77792255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c78100e20 msgr2=0x7f2c78197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c77fff640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c78100e20 0x7f2c78197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c77fff640 1 -- 172.21.15.152:0/77792255 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7819c310 con 0x7f2c78102ef0 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.871+0000 7f2c77fff640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c78102ef0 0x7f2c7819bc30 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f2c70009dc0 tx=0x7f2c70030890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.872+0000 7f2c74ff9640 1 -- 172.21.15.152:0/77792255 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c70047070 con 0x7f2c78102ef0 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.872+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/77792255 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c7819c540 con 0x7f2c78102ef0 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.872+0000 7f2c74ff9640 1 -- 172.21.15.152:0/77792255 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c70030b70 con 0x7f2c78102ef0 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.872+0000 7f2c74ff9640 1 -- 172.21.15.152:0/77792255 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c70034040 con 0x7f2c78102ef0 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.872+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/77792255 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c78069f70 con 0x7f2c78102ef0 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.874+0000 7f2c74ff9640 1 -- 172.21.15.152:0/77792255 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f2c7004a070 con 0x7f2c78102ef0 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.874+0000 7f2c8039b740 1 Processor -- start 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.874+0000 7f2c8039b740 1 -- start start 2024-09-11T22:20:01.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.874+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.874+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.874+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1df760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.874+0000 7f2c8039b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a2ba1382f0 con 0x55a2ba1dd370 2024-09-11T22:20:01.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.874+0000 7f2c8039b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a2ba0dfcf0 con 0x55a2ba1d25d0 2024-09-11T22:20:01.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.874+0000 7f2c8039b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a2ba1342b0 con 0x55a2ba1d3b40 2024-09-11T22:20:01.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c76ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c76ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1df760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41122/0 (socket says 172.21.15.152:41122) 2024-09-11T22:20:01.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c76ffd640 1 -- 172.21.15.152:0/2610163610 learned_addr learned my addr 172.21.15.152:0/2610163610 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:01.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/2610163610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c777fe640 1 --2- 172.21.15.152:0/2610163610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c74ff9640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c600a7180 0x7f2c600a9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c76ffd640 1 -- 172.21.15.152:0/2610163610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d3b40 msgr2=0x55a2ba1d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/2610163610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c76ffd640 1 -- 172.21.15.152:0/2610163610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d25d0 msgr2=0x55a2ba1d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/2610163610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1d2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c76ffd640 1 -- 172.21.15.152:0/2610163610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ba0c43a0 con 0x55a2ba1dd370 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/2610163610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1df760 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009fc0 tx=0x7f2c6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53dbd8123d1f4977 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c77fff640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c600a7180 0x7f2c600a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c74ff9640 1 -- 172.21.15.152:0/77792255 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f2c700efbc0 con 0x7f2c78102ef0 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c5dffb640 1 -- 172.21.15.152:0/2610163610 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c004050 con 0x55a2ba1dd370 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c5dffb640 1 -- 172.21.15.152:0/2610163610 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c6c005500 con 0x55a2ba1dd370 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.875+0000 7f2c5dffb640 1 -- 172.21.15.152:0/2610163610 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c004e00 con 0x55a2ba1dd370 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.876+0000 7f2c8039b740 1 -- 172.21.15.152:0/2610163610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 msgr2=0x55a2ba1df760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.876+0000 7f2c77fff640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c600a7180 0x7f2c600a9640 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2c700bbd80 tx=0x7f2c70047be0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.876+0000 7f2c8039b740 1 --2- 172.21.15.152:0/2610163610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1df760 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009fc0 tx=0x7f2c6c004730 comp rx=0 tx=0).stop 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.876+0000 7f2c8039b740 1 -- 172.21.15.152:0/2610163610 shutdown_connections 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.876+0000 7f2c8039b740 1 --2- 172.21.15.152:0/2610163610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1df760 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.876+0000 7f2c8039b740 1 --2- 172.21.15.152:0/2610163610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.876+0000 7f2c8039b740 1 --2- 172.21.15.152:0/2610163610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.876+0000 7f2c8039b740 1 -- 172.21.15.152:0/2610163610 >> 172.21.15.152:0/2610163610 conn(0x55a2ba19b310 msgr2=0x55a2ba1cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.876+0000 7f2c8039b740 1 -- 172.21.15.152:0/2610163610 shutdown_connections 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.876+0000 7f2c8039b740 1 -- 172.21.15.152:0/2610163610 wait complete. 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.876+0000 7f2c8039b740 1 -- start start 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c8039b740 1 Processor -- start 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1dcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1da030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1da640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c8039b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a2ba1e0070 con 0x55a2ba1dd370 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c8039b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a2ba0f3060 con 0x55a2ba1d3b40 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c8039b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a2ba1e01f0 con 0x55a2ba1d25d0 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c8039b740 10 client.0 _ll_register_callbacks cb 0x55a2b9e468c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c76ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1da640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c76ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1da640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41128/0 (socket says 172.21.15.152:41128) 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c76ffd640 1 -- 172.21.15.152:0/390243361 learned_addr learned my addr 172.21.15.152:0/390243361 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1dcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c777fe640 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1da030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c76ffd640 1 -- 172.21.15.152:0/390243361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d25d0 msgr2=0x55a2ba1dcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1dcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c76ffd640 1 -- 172.21.15.152:0/390243361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d3b40 msgr2=0x55a2ba1da030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1da030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.877+0000 7f2c76ffd640 1 -- 172.21.15.152:0/390243361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b9ea93c0 con 0x55a2ba1dd370 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1da640 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c004ae0 tx=0x7f2c6c0049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fd5fdab94e3145 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c56ffd640 1 -- 172.21.15.152:0/390243361 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c004260 con 0x55a2ba1dd370 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c56ffd640 1 -- 172.21.15.152:0/390243361 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f2c6c004400 con 0x55a2ba1dd370 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c8039b740 1 -- 172.21.15.152:0/390243361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c6c005500 con 0x55a2ba1dd370 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c56ffd640 1 -- 172.21.15.152:0/390243361 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2c6c0035f0 con 0x55a2ba1dd370 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c8039b740 10 client.19356 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c8039b740 1 -- 172.21.15.152:0/390243361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a2ba1f4350 con 0x55a2ba1dd370 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c56ffd640 1 -- 172.21.15.152:0/390243361 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c6c005500 con 0x55a2ba1dd370 2024-09-11T22:20:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c56ffd640 1 -- 172.21.15.152:0/390243361 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f2c6c01e790 con 0x55a2ba1dd370 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c8039b740 10 client.19356 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c8039b740 10 client.19356 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c8039b740 20 client.19356 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c8039b740 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a2ba1f56a0 0x55a2ba1f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c8039b740 4 client.19356 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.878+0000 7f2c8039b740 1 -- 172.21.15.152:0/390243361 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2ba145860 con 0x55a2ba1f56a0 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.879+0000 7f2c777fe640 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a2ba1f56a0 0x55a2ba1f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.879+0000 7f2c777fe640 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a2ba1f56a0 0x55a2ba1f7a90 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=11f4f46709dfaed8 server_cookie=d208455e71e6d0bf in_seq=0 out_seq=0 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.879+0000 7f2c56ffd640 10 client.19356 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c56ffd640 1 -- 172.21.15.152:0/390243361 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2ba145860 con 0x55a2ba1f56a0 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c56ffd640 10 client.19356 handle_command_reply: tid=0 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 1 client.19356 shutdown 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 1 -- 172.21.15.152:0/390243361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 msgr2=0x55a2ba1da640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1da640 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c004ae0 tx=0x7f2c6c0049e0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 1 -- 172.21.15.152:0/390243361 shutdown_connections 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a2ba1f56a0 0x55a2ba1f7a90 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1da640 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1da030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c56ffd640 0 client.19356 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 1 --2- 172.21.15.152:0/390243361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1dcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 1 -- 172.21.15.152:0/390243361 >> 172.21.15.152:0/390243361 conn(0x55a2ba19b310 msgr2=0x55a2ba1d4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 1 -- 172.21.15.152:0/390243361 shutdown_connections 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 1 -- 172.21.15.152:0/390243361 wait complete. 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.880+0000 7f2c8039b740 20 client.19356 trim_cache size 0 max 16384 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.894+0000 7f2c8039b740 1 Processor -- start 2024-09-11T22:20:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.894+0000 7f2c8039b740 1 -- start start 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.894+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.894+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1d5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.894+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1dd370 0x55a2ba1d5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.894+0000 7f2c8039b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c781adfe0 con 0x55a2ba1d3b40 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.894+0000 7f2c8039b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2c781ab8b0 con 0x55a2ba1dd370 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.894+0000 7f2c8039b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2c781a9720 con 0x55a2ba1d25d0 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.894+0000 7f2c777fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1d5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.894+0000 7f2c777fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1d5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41132/0 (socket says 172.21.15.152:41132) 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.894+0000 7f2c777fe640 1 -- 172.21.15.152:0/2028090334 learned_addr learned my addr 172.21.15.152:0/2028090334 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.895+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/2028090334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.895+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/2028090334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1dd370 0x55a2ba1d5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.895+0000 7f2c777fe640 1 -- 172.21.15.152:0/2028090334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d25d0 msgr2=0x55a2ba1cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.895+0000 7f2c777fe640 1 --2- 172.21.15.152:0/2028090334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.895+0000 7f2c777fe640 1 -- 172.21.15.152:0/2028090334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1dd370 msgr2=0x55a2ba1d5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.895+0000 7f2c777fe640 1 --2- 172.21.15.152:0/2028090334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1dd370 0x55a2ba1d5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.895+0000 7f2c777fe640 1 -- 172.21.15.152:0/2028090334 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ba1d5ba0 con 0x55a2ba1d3b40 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.895+0000 7f2c777fe640 1 --2- 172.21.15.152:0/2028090334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1d5120 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009c50 tx=0x7f2c68009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fda9f7e34d048ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.895+0000 7f2c5d7fa640 1 -- 172.21.15.152:0/2028090334 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68005220 con 0x55a2ba1d3b40 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.895+0000 7f2c5d7fa640 1 -- 172.21.15.152:0/2028090334 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c6801e030 con 0x55a2ba1d3b40 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.895+0000 7f2c5d7fa640 1 -- 172.21.15.152:0/2028090334 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6801a590 con 0x55a2ba1d3b40 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.896+0000 7f2c8039b740 1 -- 172.21.15.152:0/2028090334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1d3b40 msgr2=0x55a2ba1d5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.896+0000 7f2c8039b740 1 --2- 172.21.15.152:0/2028090334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1d5120 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009c50 tx=0x7f2c68009570 comp rx=0 tx=0).stop 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.896+0000 7f2c8039b740 1 -- 172.21.15.152:0/2028090334 shutdown_connections 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.896+0000 7f2c8039b740 1 --2- 172.21.15.152:0/2028090334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1dd370 0x55a2ba1d5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.896+0000 7f2c8039b740 1 --2- 172.21.15.152:0/2028090334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1d5120 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.896+0000 7f2c8039b740 1 --2- 172.21.15.152:0/2028090334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.896+0000 7f2c8039b740 1 -- 172.21.15.152:0/2028090334 >> 172.21.15.152:0/2028090334 conn(0x55a2ba19b310 msgr2=0x55a2ba1cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.896+0000 7f2c8039b740 1 -- 172.21.15.152:0/2028090334 shutdown_connections 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.896+0000 7f2c8039b740 1 -- 172.21.15.152:0/2028090334 wait complete. 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.896+0000 7f2c8039b740 1 -- start start 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c8039b740 1 Processor -- start 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1ee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1ee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c8039b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1e9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c8039b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c781a9d70 con 0x55a2ba1dd370 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c8039b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2c781ab1e0 con 0x55a2ba1d25d0 2024-09-11T22:20:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c8039b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2c781aa440 con 0x55a2ba1d3b40 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c76ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1e9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c8039b740 10 client.0 _ll_register_callbacks cb 0x7f2c6c009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c76ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1e9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41134/0 (socket says 172.21.15.152:41134) 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c76ffd640 1 -- 172.21.15.152:0/3269320312 learned_addr learned my addr 172.21.15.152:0/3269320312 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c777fe640 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c76ffd640 1 -- 172.21.15.152:0/3269320312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d3b40 msgr2=0x55a2ba1ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1ee640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c76ffd640 1 -- 172.21.15.152:0/3269320312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d25d0 msgr2=0x55a2ba1ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1ee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c76ffd640 1 -- 172.21.15.152:0/3269320312 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2ba1e9eb0 con 0x55a2ba1dd370 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.897+0000 7f2c777fe640 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c76ffd640 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1e9680 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c005c20 tx=0x7f2c6c0049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577a7be376ce9a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c56ffd640 1 -- 172.21.15.152:0/3269320312 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c00f3c0 con 0x55a2ba1dd370 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c56ffd640 1 -- 172.21.15.152:0/3269320312 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f2c6c0054a0 con 0x55a2ba1dd370 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c8039b740 1 -- 172.21.15.152:0/3269320312 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c6801e030 con 0x55a2ba1dd370 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c56ffd640 1 -- 172.21.15.152:0/3269320312 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2c6c004260 con 0x55a2ba1dd370 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c8039b740 10 client.19362 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c8039b740 1 -- 172.21.15.152:0/3269320312 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a2ba25fd30 con 0x55a2ba1dd370 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c56ffd640 1 -- 172.21.15.152:0/3269320312 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c6c035070 con 0x55a2ba1dd370 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c56ffd640 1 -- 172.21.15.152:0/3269320312 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f2c6c00f5d0 con 0x55a2ba1dd370 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c8039b740 10 client.19362 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c8039b740 10 client.19362 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c8039b740 20 client.19362 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c8039b740 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a2ba2603f0 0x55a2ba262810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c8039b740 4 client.19362 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.898+0000 7f2c8039b740 1 -- 172.21.15.152:0/3269320312 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f2c6801e030 con 0x55a2ba2603f0 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.899+0000 7f2c777fe640 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a2ba2603f0 0x55a2ba262810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.899+0000 7f2c777fe640 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a2ba2603f0 0x55a2ba262810 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb6c2970067b17d0 server_cookie=e075c2cea4bdb391 in_seq=0 out_seq=0 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.899+0000 7f2c56ffd640 10 client.19362 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.899+0000 7f2c56ffd640 1 -- 172.21.15.152:0/3269320312 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f2c6801e030 con 0x55a2ba2603f0 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c56ffd640 10 client.19362 handle_command_reply: tid=0 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 1 client.19362 shutdown 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 1 -- 172.21.15.152:0/3269320312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 msgr2=0x55a2ba1e9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1e9680 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c005c20 tx=0x7f2c6c0049e0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 1 -- 172.21.15.152:0/3269320312 shutdown_connections 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x55a2ba2603f0 0x55a2ba262810 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a2ba1dd370 0x55a2ba1e9680 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2ba1d3b40 0x55a2ba1ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 1 --2- 172.21.15.152:0/3269320312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2ba1d25d0 0x55a2ba1ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c56ffd640 0 client.19362 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:20:01.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 1 -- 172.21.15.152:0/3269320312 >> 172.21.15.152:0/3269320312 conn(0x55a2ba19b310 msgr2=0x55a2ba1dc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:01.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 1 -- 172.21.15.152:0/3269320312 shutdown_connections 2024-09-11T22:20:01.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 1 -- 172.21.15.152:0/3269320312 wait complete. 2024-09-11T22:20:01.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c8039b740 20 client.19362 trim_cache size 0 max 16384 2024-09-11T22:20:01.204 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:20:01.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/77792255 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c600a7180 msgr2=0x7f2c600a9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:01.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c7dfc2640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c600a7180 0x7f2c600a9640 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2c700bbd80 tx=0x7f2c70047be0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/77792255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c78102ef0 msgr2=0x7f2c7819bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:01.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.900+0000 7f2c7dfc2640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c78102ef0 0x7f2c7819bc30 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f2c70009dc0 tx=0x7f2c70030890 comp rx=0 tx=0).stop 2024-09-11T22:20:01.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.901+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/77792255 shutdown_connections 2024-09-11T22:20:01.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.901+0000 7f2c7dfc2640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c600a7180 0x7f2c600a9640 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.901+0000 7f2c7dfc2640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c78102ef0 0x7f2c7819bc30 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.901+0000 7f2c7dfc2640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c78102570 0x7f2c781978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.901+0000 7f2c7dfc2640 1 --2- 172.21.15.152:0/77792255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c78100e20 0x7f2c78197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:01.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.901+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/77792255 >> 172.21.15.152:0/77792255 conn(0x7f2c780fc7d0 msgr2=0x7f2c78106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:01.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.901+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/77792255 shutdown_connections 2024-09-11T22:20:01.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:00.901+0000 7f2c7dfc2640 1 -- 172.21.15.152:0/77792255 wait complete. 2024-09-11T22:20:01.908 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:01 smithi152 ceph-mon[31188]: pgmap v493: 97 pgs: 97 active+clean; 4.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.9 MiB/s wr, 802 op/s 2024-09-11T22:20:01.948 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:20:02.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:01 smithi179 ceph-mon[35603]: pgmap v493: 97 pgs: 97 active+clean; 4.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.9 MiB/s wr, 802 op/s 2024-09-11T22:20:02.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:01 smithi193 ceph-mon[35545]: pgmap v493: 97 pgs: 97 active+clean; 4.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.9 MiB/s wr, 802 op/s 2024-09-11T22:20:02.280 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.473+0000 7fb2775d6640 1 -- 172.21.15.152:0/1715913705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb270101350 msgr2=0x7fb27010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.473+0000 7fb2775d6640 1 --2- 172.21.15.152:0/1715913705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb270101350 0x7fb27010d880 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb268009cd0 tx=0x7fb26802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.474+0000 7fb2775d6640 1 -- 172.21.15.152:0/1715913705 shutdown_connections 2024-09-11T22:20:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.474+0000 7fb2775d6640 1 --2- 172.21.15.152:0/1715913705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb270101350 0x7fb27010d880 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.474+0000 7fb2775d6640 1 --2- 172.21.15.152:0/1715913705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2701009b0 0x7fb270100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.474+0000 7fb2775d6640 1 --2- 172.21.15.152:0/1715913705 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2701069c0 0x7fb270106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.474+0000 7fb2775d6640 1 -- 172.21.15.152:0/1715913705 >> 172.21.15.152:0/1715913705 conn(0x7fb270077990 msgr2=0x7fb2700fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.474+0000 7fb2775d6640 1 -- 172.21.15.152:0/1715913705 shutdown_connections 2024-09-11T22:20:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.474+0000 7fb2775d6640 1 -- 172.21.15.152:0/1715913705 wait complete. 2024-09-11T22:20:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.475+0000 7fb2775d6640 1 Processor -- start 2024-09-11T22:20:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.475+0000 7fb2775d6640 1 -- start start 2024-09-11T22:20:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.475+0000 7fb2775d6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2701009b0 0x7fb270198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.475+0000 7fb2775d6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb270101350 0x7fb2701987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.475+0000 7fb2775d6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2701069c0 0x7fb27019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.475+0000 7fb2775d6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb270110e00 con 0x7fb2701009b0 2024-09-11T22:20:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.475+0000 7fb2775d6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb270110c80 con 0x7fb2701069c0 2024-09-11T22:20:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.475+0000 7fb2775d6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb270110f80 con 0x7fb270101350 2024-09-11T22:20:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb275372640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2701009b0 0x7fb270198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb274b71640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb270101350 0x7fb2701987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb275372640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2701009b0 0x7fb270198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41156/0 (socket says 172.21.15.152:41156) 2024-09-11T22:20:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb275b73640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2701069c0 0x7fb27019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb275372640 1 -- 172.21.15.152:0/3561778228 learned_addr learned my addr 172.21.15.152:0/3561778228 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb275372640 1 -- 172.21.15.152:0/3561778228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb270101350 msgr2=0x7fb2701987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb275372640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb270101350 0x7fb2701987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb275372640 1 -- 172.21.15.152:0/3561778228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2701069c0 msgr2=0x7fb27019cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb275372640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2701069c0 0x7fb27019cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb275372640 1 -- 172.21.15.152:0/3561778228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27019d270 con 0x7fb2701009b0 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb274b71640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb270101350 0x7fb2701987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb275372640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2701009b0 0x7fb270198280 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00c920 tx=0x7fb26c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb2667fc640 1 -- 172.21.15.152:0/3561778228 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c007c70 con 0x7fb2701009b0 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb2667fc640 1 -- 172.21.15.152:0/3561778228 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb26c007e10 con 0x7fb2701009b0 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb2775d6640 1 -- 172.21.15.152:0/3561778228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27019d560 con 0x7fb2701009b0 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb2667fc640 1 -- 172.21.15.152:0/3561778228 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c018890 con 0x7fb2701009b0 2024-09-11T22:20:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.476+0000 7fb2775d6640 1 -- 172.21.15.152:0/3561778228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2701a4df0 con 0x7fb2701009b0 2024-09-11T22:20:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.479+0000 7fb2667fc640 1 -- 172.21.15.152:0/3561778228 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb26c018a70 con 0x7fb2701009b0 2024-09-11T22:20:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.480+0000 7fb27a44e740 1 Processor -- start 2024-09-11T22:20:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb27a44e740 1 -- start start 2024-09-11T22:20:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb2667fc640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb25c0a2e20 0x7fb25c0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f2990 0x5641873f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f32b0 0x564187401b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641874020c0 0x5641874044b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb27a44e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5641873572f0 con 0x5641874020c0 2024-09-11T22:20:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb27a44e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5641872ff270 con 0x5641873f32b0 2024-09-11T22:20:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb27a44e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5641873532b0 con 0x5641873f2990 2024-09-11T22:20:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb2667fc640 1 -- 172.21.15.152:0/3561778228 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7fb26c0cf5b0 con 0x7fb2701009b0 2024-09-11T22:20:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb275372640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f2990 0x5641873f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb275b73640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb25c0a2e20 0x7fb25c0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb274b71640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f32b0 0x564187401b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb275372640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f2990 0x5641873f2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52888/0 (socket says 172.21.15.152:52888) 2024-09-11T22:20:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb274b71640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f32b0 0x564187401b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:33982/0 (socket says 172.21.15.152:33982) 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb275372640 1 -- 172.21.15.152:0/4119282586 learned_addr learned my addr 172.21.15.152:0/4119282586 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb275b73640 1 --2- 172.21.15.152:0/4119282586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641874020c0 0x5641874044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb275372640 1 -- 172.21.15.152:0/4119282586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f32b0 msgr2=0x564187401b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb275372640 1 --2- 172.21.15.152:0/4119282586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f32b0 0x564187401b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb275372640 1 -- 172.21.15.152:0/4119282586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641874020c0 msgr2=0x5641874044b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb275372640 1 --2- 172.21.15.152:0/4119282586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641874020c0 0x5641874044b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb275372640 1 -- 172.21.15.152:0/4119282586 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641872fe340 con 0x5641873f2990 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.481+0000 7fb275b73640 1 --2- 172.21.15.152:0/4119282586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641874020c0 0x5641874044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.482+0000 7fb275372640 1 --2- 172.21.15.152:0/4119282586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f2990 0x5641873f2d70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0a4150 tx=0x7fb26c09b470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc5fc97877ccbb57 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.482+0000 7fb275b73640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb25c0a2e20 0x7fb25c0a52e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb268005fe0 tx=0x7fb268005ef0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.482+0000 7fb25b7fe640 1 -- 172.21.15.152:0/4119282586 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c09fdc0 con 0x5641873f2990 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.482+0000 7fb25b7fe640 1 -- 172.21.15.152:0/4119282586 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb26c0a4680 con 0x5641873f2990 2024-09-11T22:20:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.482+0000 7fb25b7fe640 1 -- 172.21.15.152:0/4119282586 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c098210 con 0x5641873f2990 2024-09-11T22:20:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 -- 172.21.15.152:0/4119282586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f2990 msgr2=0x5641873f2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 --2- 172.21.15.152:0/4119282586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f2990 0x5641873f2d70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0a4150 tx=0x7fb26c09b470 comp rx=0 tx=0).stop 2024-09-11T22:20:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 -- 172.21.15.152:0/4119282586 shutdown_connections 2024-09-11T22:20:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 --2- 172.21.15.152:0/4119282586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641874020c0 0x5641874044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 --2- 172.21.15.152:0/4119282586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f32b0 0x564187401b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 --2- 172.21.15.152:0/4119282586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f2990 0x5641873f2d70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 -- 172.21.15.152:0/4119282586 >> 172.21.15.152:0/4119282586 conn(0x5641873ef060 msgr2=0x5641873ef440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 -- 172.21.15.152:0/4119282586 shutdown_connections 2024-09-11T22:20:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 -- 172.21.15.152:0/4119282586 wait complete. 2024-09-11T22:20:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 -- start start 2024-09-11T22:20:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 Processor -- start 2024-09-11T22:20:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x5641873fefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.483+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 0x5641873ff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 0x5641873ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb27a44e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564187404cf0 con 0x5641873f32b0 2024-09-11T22:20:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb27a44e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5641872e0290 con 0x5641873f2990 2024-09-11T22:20:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb27a44e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564187404e70 con 0x5641874020c0 2024-09-11T22:20:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb27a44e740 10 client.0 _ll_register_callbacks cb 0x564187311140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb274b71640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 0x5641873ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb274b71640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 0x5641873ff520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41176/0 (socket says 172.21.15.152:41176) 2024-09-11T22:20:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb274b71640 1 -- 172.21.15.152:0/3258236321 learned_addr learned my addr 172.21.15.152:0/3258236321 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb275372640 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x5641873fefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb275b73640 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 0x5641873ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb275372640 1 -- 172.21.15.152:0/3258236321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 msgr2=0x5641873ffa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb275372640 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 0x5641873ffa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb275372640 1 -- 172.21.15.152:0/3258236321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 msgr2=0x5641873ff520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb275372640 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 0x5641873ff520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb275372640 1 -- 172.21.15.152:0/3258236321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56418706a210 con 0x5641873f2990 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb274b71640 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 0x5641873ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb275372640 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x5641873fefe0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb26c007590 tx=0x7fb26c0cd1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2294b77c18e3ae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb258ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb258ff9640 1 -- 172.21.15.152:0/3258236321 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c07e020 con 0x5641873f2990 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb27a44e740 1 -- 172.21.15.152:0/3258236321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb26c0a4680 con 0x5641873f2990 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.484+0000 7fb258ff9640 1 -- 172.21.15.152:0/3258236321 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7fb26c018d60 con 0x5641873f2990 2024-09-11T22:20:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.485+0000 7fb258ff9640 1 -- 172.21.15.152:0/3258236321 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb26c086040 con 0x5641873f2990 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.485+0000 7fb27a44e740 10 client.28523 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.485+0000 7fb27a44e740 1 -- 172.21.15.152:0/3258236321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564187136620 con 0x5641873f2990 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.485+0000 7fb258ff9640 1 -- 172.21.15.152:0/3258236321 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb26c0a4680 con 0x5641873f2990 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.485+0000 7fb258ff9640 1 -- 172.21.15.152:0/3258236321 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb26c0a41f0 con 0x5641873f2990 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.485+0000 7fb27a44e740 10 client.28523 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.485+0000 7fb27a44e740 10 client.28523 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.485+0000 7fb27a44e740 20 client.28523 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.485+0000 7fb27a44e740 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564187411f40 0x564187414330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.485+0000 7fb27a44e740 4 client.28523 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.485+0000 7fb27a44e740 1 -- 172.21.15.152:0/3258236321 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564187364a20 con 0x564187411f40 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.486+0000 7fb274b71640 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564187411f40 0x564187414330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.487+0000 7fb274b71640 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564187411f40 0x564187414330 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9872b5d7c438805b server_cookie=52dbb7c1628c7e06 in_seq=0 out_seq=0 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.487+0000 7fb258ff9640 10 client.28523 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb258ff9640 1 -- 172.21.15.152:0/3258236321 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564187364a20 con 0x564187411f40 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb258ff9640 10 client.28523 handle_command_reply: tid=0 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 1 client.28523 shutdown 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 1 -- 172.21.15.152:0/3258236321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 msgr2=0x5641873fefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x5641873fefe0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb26c007590 tx=0x7fb26c0cd1d0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 1 -- 172.21.15.152:0/3258236321 shutdown_connections 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564187411f40 0x564187414330 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 0x5641873ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb258ff9640 0 client.28523 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 0x5641873ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 1 --2- 172.21.15.152:0/3258236321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x5641873fefe0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 1 -- 172.21.15.152:0/3258236321 >> 172.21.15.152:0/3258236321 conn(0x5641873ef060 msgr2=0x5641873f4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 1 -- 172.21.15.152:0/3258236321 shutdown_connections 2024-09-11T22:20:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 1 -- 172.21.15.152:0/3258236321 wait complete. 2024-09-11T22:20:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.488+0000 7fb27a44e740 20 client.28523 trim_cache size 0 max 16384 2024-09-11T22:20:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb27a44e740 1 Processor -- start 2024-09-11T22:20:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb27a44e740 1 -- start start 2024-09-11T22:20:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x564187419900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 0x564187419e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 0x5641873fc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb27a44e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb2701adf70 con 0x5641873f32b0 2024-09-11T22:20:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb27a44e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb2701ab840 con 0x5641873f2990 2024-09-11T22:20:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb27a44e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2701a96b0 con 0x5641874020c0 2024-09-11T22:20:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb275b73640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 0x5641873fc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb275b73640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 0x5641873fc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52898/0 (socket says 172.21.15.152:52898) 2024-09-11T22:20:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb275b73640 1 -- 172.21.15.152:0/3828286621 learned_addr learned my addr 172.21.15.152:0/3828286621 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.506+0000 7fb275372640 1 --2- 172.21.15.152:0/3828286621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x564187419900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.507+0000 7fb275b73640 1 -- 172.21.15.152:0/3828286621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 msgr2=0x564187419900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.507+0000 7fb275b73640 1 --2- 172.21.15.152:0/3828286621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x564187419900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.507+0000 7fb274b71640 1 --2- 172.21.15.152:0/3828286621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 0x564187419e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.507+0000 7fb275b73640 1 -- 172.21.15.152:0/3828286621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 msgr2=0x564187419e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.507+0000 7fb275b73640 1 --2- 172.21.15.152:0/3828286621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 0x564187419e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.507+0000 7fb275b73640 1 -- 172.21.15.152:0/3828286621 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641873fdf70 con 0x5641874020c0 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.507+0000 7fb274b71640 1 --2- 172.21.15.152:0/3828286621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 0x564187419e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.507+0000 7fb275b73640 1 --2- 172.21.15.152:0/3828286621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 0x5641873fc220 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb268035000 tx=0x7fb26803e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1610665cc5813b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb25affd640 1 -- 172.21.15.152:0/3828286621 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268031ba0 con 0x5641874020c0 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb25affd640 1 -- 172.21.15.152:0/3828286621 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb26804f070 con 0x5641874020c0 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb25affd640 1 -- 172.21.15.152:0/3828286621 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26804b450 con 0x5641874020c0 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb27a44e740 1 -- 172.21.15.152:0/3828286621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 msgr2=0x5641873fc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb27a44e740 1 --2- 172.21.15.152:0/3828286621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 0x5641873fc220 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb268035000 tx=0x7fb26803e040 comp rx=0 tx=0).stop 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb27a44e740 1 -- 172.21.15.152:0/3828286621 shutdown_connections 2024-09-11T22:20:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb27a44e740 1 --2- 172.21.15.152:0/3828286621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641874020c0 0x5641873fc220 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb27a44e740 1 --2- 172.21.15.152:0/3828286621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641873f32b0 0x564187419e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb27a44e740 1 --2- 172.21.15.152:0/3828286621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x564187419900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb27a44e740 1 -- 172.21.15.152:0/3828286621 >> 172.21.15.152:0/3828286621 conn(0x5641873ef060 msgr2=0x564187401060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb27a44e740 1 -- 172.21.15.152:0/3828286621 shutdown_connections 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.508+0000 7fb27a44e740 1 -- 172.21.15.152:0/3828286621 wait complete. 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.509+0000 7fb27a44e740 1 -- start start 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.509+0000 7fb27a44e740 1 Processor -- start 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.509+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x56418740a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.509+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f32b0 0x56418740a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.509+0000 7fb27a44e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641874020c0 0x5641873f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb27a44e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb2701a9d00 con 0x5641874020c0 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb27a44e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb2701ab170 con 0x5641873f2990 2024-09-11T22:20:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb27a44e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2701aa3d0 con 0x5641873f32b0 2024-09-11T22:20:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb274b71640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f32b0 0x56418740a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb274b71640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f32b0 0x56418740a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52912/0 (socket says 172.21.15.152:52912) 2024-09-11T22:20:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb274b71640 1 -- 172.21.15.152:0/915693052 learned_addr learned my addr 172.21.15.152:0/915693052 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb27a44e740 10 client.0 _ll_register_callbacks cb 0x7fb26000a980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb274b71640 1 -- 172.21.15.152:0/915693052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 msgr2=0x56418740a100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:20:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb274b71640 1 --2- 172.21.15.152:0/915693052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x56418740a100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb274b71640 1 -- 172.21.15.152:0/915693052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641874020c0 msgr2=0x5641873f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb274b71640 1 --2- 172.21.15.152:0/915693052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641874020c0 0x5641873f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.510+0000 7fb274b71640 1 -- 172.21.15.152:0/915693052 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641874146a0 con 0x5641873f32b0 2024-09-11T22:20:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.511+0000 7fb274b71640 1 --2- 172.21.15.152:0/915693052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f32b0 0x56418740a640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x564187400590 tx=0x7fb26000f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f0140333a3861d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.511+0000 7fb27a44e740 1 -- 172.21.15.152:0/915693052 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb26804f070 con 0x5641873f32b0 2024-09-11T22:20:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.514+0000 7fb258ff9640 10 client.28669 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:20:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.514+0000 7fb258ff9640 1 -- 172.21.15.152:0/915693052 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260004220 con 0x5641873f32b0 2024-09-11T22:20:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.514+0000 7fb258ff9640 1 -- 172.21.15.152:0/915693052 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7fb2600043c0 con 0x5641873f32b0 2024-09-11T22:20:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.514+0000 7fb258ff9640 1 -- 172.21.15.152:0/915693052 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb26001d600 con 0x5641873f32b0 2024-09-11T22:20:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.516+0000 7fb27a44e740 10 client.28669 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.516+0000 7fb27a44e740 1 -- 172.21.15.152:0/915693052 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) -- 0x564187481260 con 0x5641873f32b0 2024-09-11T22:20:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.519+0000 7fb258ff9640 1 -- 172.21.15.152:0/915693052 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fb26001d7a0 con 0x5641873f32b0 2024-09-11T22:20:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.520+0000 7fb27a44e740 10 client.28669 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.520+0000 7fb27a44e740 10 client.28669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.520+0000 7fb27a44e740 20 client.28669 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.520+0000 7fb27a44e740 1 --2- 172.21.15.152:0/915693052 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564187481880 0x564187483ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.520+0000 7fb27a44e740 4 client.28669 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:20:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.520+0000 7fb27a44e740 1 -- 172.21.15.152:0/915693052 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fb26804f070 con 0x564187481880 2024-09-11T22:20:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.522+0000 7fb275372640 1 --2- 172.21.15.152:0/915693052 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564187481880 0x564187483ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.534+0000 7fb275372640 1 --2- 172.21.15.152:0/915693052 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564187481880 0x564187483ca0 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c6fb5cf82546d5c server_cookie=c7124e88697de9a5 in_seq=0 out_seq=0 2024-09-11T22:20:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:02.535+0000 7fb258ff9640 10 client.28669 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:02.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.840+0000 7f600f686640 1 -- 172.21.15.152:0/2655423858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6008108300 msgr2=0x7f600810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.840+0000 7f600f686640 1 --2- 172.21.15.152:0/2655423858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6008108300 0x7f600810ec70 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6000009930 tx=0x7f600002a420 comp rx=0 tx=0).stop 2024-09-11T22:20:02.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.840+0000 7f600f686640 1 -- 172.21.15.152:0/2655423858 shutdown_connections 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.840+0000 7f600f686640 1 --2- 172.21.15.152:0/2655423858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6008108300 0x7f600810ec70 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.840+0000 7f600f686640 1 --2- 172.21.15.152:0/2655423858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6008103780 0x7f6008107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.840+0000 7f600f686640 1 --2- 172.21.15.152:0/2655423858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6008102dd0 0x7f60081031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.840+0000 7f600f686640 1 -- 172.21.15.152:0/2655423858 >> 172.21.15.152:0/2655423858 conn(0x7f60080fc7d0 msgr2=0x7f60080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.840+0000 7f600f686640 1 -- 172.21.15.152:0/2655423858 shutdown_connections 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.840+0000 7f600f686640 1 -- 172.21.15.152:0/2655423858 wait complete. 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600f686640 1 Processor -- start 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600f686640 1 -- start start 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600f686640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6008102dd0 0x7f6008198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600f686640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6008103780 0x7f6008198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600f686640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6008108300 0x7f600819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600f686640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6008112120 con 0x7f6008102dd0 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600f686640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6008111fa0 con 0x7f6008108300 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600f686640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f60081122a0 con 0x7f6008103780 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600d422640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6008102dd0 0x7f6008198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600d422640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6008102dd0 0x7f6008198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41206/0 (socket says 172.21.15.152:41206) 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600d422640 1 -- 172.21.15.152:0/1500625088 learned_addr learned my addr 172.21.15.152:0/1500625088 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600dc23640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6008108300 0x7f600819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.841+0000 7f600cc21640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6008103780 0x7f6008198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.842+0000 7f600d422640 1 -- 172.21.15.152:0/1500625088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6008103780 msgr2=0x7f6008198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.842+0000 7f600d422640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6008103780 0x7f6008198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.842+0000 7f600d422640 1 -- 172.21.15.152:0/1500625088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6008108300 msgr2=0x7f600819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.842+0000 7f600d422640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6008108300 0x7f600819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.842+0000 7f600d422640 1 -- 172.21.15.152:0/1500625088 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600819d530 con 0x7f6008102dd0 2024-09-11T22:20:02.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.842+0000 7f600d422640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6008102dd0 0x7f6008198580 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f600400ea80 tx=0x7f600400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.842+0000 7f5ffe7fc640 1 -- 172.21.15.152:0/1500625088 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600400ce40 con 0x7f6008102dd0 2024-09-11T22:20:02.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.842+0000 7f600f686640 1 -- 172.21.15.152:0/1500625088 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600819d820 con 0x7f6008102dd0 2024-09-11T22:20:02.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.842+0000 7f5ffe7fc640 1 -- 172.21.15.152:0/1500625088 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6004005020 con 0x7f6008102dd0 2024-09-11T22:20:02.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.842+0000 7f5ffe7fc640 1 -- 172.21.15.152:0/1500625088 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004011760 con 0x7f6008102dd0 2024-09-11T22:20:02.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.842+0000 7f600f686640 1 -- 172.21.15.152:0/1500625088 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60081a5100 con 0x7f6008102dd0 2024-09-11T22:20:02.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.846+0000 7f5ffe7fc640 1 -- 172.21.15.152:0/1500625088 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f60040051d0 con 0x7f6008102dd0 2024-09-11T22:20:02.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f6011a5f740 1 Processor -- start 2024-09-11T22:20:02.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f6011a5f740 1 -- start start 2024-09-11T22:20:02.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f6011a5f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 0x55da4e35d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f6011a5f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 0x55da4e35da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f6011a5f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e368370 0x55da4e36a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f5ffe7fc640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ff40a2d70 0x7f5ff40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f6011a5f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da4e2c32f0 con 0x55da4e368370 2024-09-11T22:20:02.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f6011a5f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55da4e26acf0 con 0x55da4e35eb40 2024-09-11T22:20:02.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f6011a5f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55da4e2bf2b0 con 0x55da4e35d5d0 2024-09-11T22:20:02.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f600dc23640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 0x55da4e35d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f600d422640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 0x55da4e35da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f600dc23640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 0x55da4e35d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34054/0 (socket says 172.21.15.152:34054) 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f600dc23640 1 -- 172.21.15.152:0/1625669308 learned_addr learned my addr 172.21.15.152:0/1625669308 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f600dc23640 1 --2- 172.21.15.152:0/1625669308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e368370 0x55da4e36a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f5ffe7fc640 1 -- 172.21.15.152:0/1500625088 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f60040cfb10 con 0x7f6008102dd0 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.847+0000 7f600cc21640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ff40a2d70 0x7f5ff40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.848+0000 7f600dc23640 1 -- 172.21.15.152:0/1625669308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 msgr2=0x55da4e35da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.848+0000 7f600dc23640 1 --2- 172.21.15.152:0/1625669308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 0x55da4e35da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.848+0000 7f600dc23640 1 -- 172.21.15.152:0/1625669308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e368370 msgr2=0x55da4e36a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.848+0000 7f600dc23640 1 --2- 172.21.15.152:0/1625669308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e368370 0x55da4e36a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.848+0000 7f600dc23640 1 -- 172.21.15.152:0/1625669308 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4e24f3a0 con 0x55da4e35eb40 2024-09-11T22:20:02.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.848+0000 7f600dc23640 1 --2- 172.21.15.152:0/1625669308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 0x55da4e35d090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6000005ec0 tx=0x7f6000005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8bcb6bc3812b6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.848+0000 7f5ff37fe640 1 -- 172.21.15.152:0/1625669308 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000035030 con 0x55da4e35eb40 2024-09-11T22:20:02.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.848+0000 7f600cc21640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ff40a2d70 0x7f5ff40a5230 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8005fd0 tx=0x7f5ff8005850 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.848+0000 7f5ff37fe640 1 -- 172.21.15.152:0/1625669308 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60000047a0 con 0x55da4e35eb40 2024-09-11T22:20:02.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.848+0000 7f5ff37fe640 1 -- 172.21.15.152:0/1625669308 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000003900 con 0x55da4e35eb40 2024-09-11T22:20:02.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.849+0000 7f6011a5f740 1 -- 172.21.15.152:0/1625669308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 msgr2=0x55da4e35d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.849+0000 7f6011a5f740 1 --2- 172.21.15.152:0/1625669308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 0x55da4e35d090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6000005ec0 tx=0x7f6000005fd0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.849+0000 7f6011a5f740 1 -- 172.21.15.152:0/1625669308 shutdown_connections 2024-09-11T22:20:02.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.849+0000 7f6011a5f740 1 --2- 172.21.15.152:0/1625669308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e368370 0x55da4e36a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.849+0000 7f6011a5f740 1 --2- 172.21.15.152:0/1625669308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 0x55da4e35da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.849+0000 7f6011a5f740 1 --2- 172.21.15.152:0/1625669308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 0x55da4e35d090 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.849+0000 7f6011a5f740 1 -- 172.21.15.152:0/1625669308 >> 172.21.15.152:0/1625669308 conn(0x55da4e326310 msgr2=0x55da4e359c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.849+0000 7f6011a5f740 1 -- 172.21.15.152:0/1625669308 shutdown_connections 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.849+0000 7f6011a5f740 1 -- 172.21.15.152:0/1625669308 wait complete. 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.849+0000 7f6011a5f740 1 -- start start 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.850+0000 7f6011a5f740 1 Processor -- start 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.850+0000 7f6011a5f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 0x55da4e367de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.850+0000 7f6011a5f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 0x55da4e365090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.850+0000 7f6011a5f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e368370 0x55da4e3657d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.850+0000 7f6011a5f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da4e36b010 con 0x55da4e368370 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f6011a5f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55da4e27e060 con 0x55da4e35eb40 2024-09-11T22:20:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600d422640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 0x55da4e367de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f6011a5f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55da4e36b190 con 0x55da4e35d5d0 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600d422640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 0x55da4e367de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52942/0 (socket says 172.21.15.152:52942) 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600d422640 1 -- 172.21.15.152:0/1546799776 learned_addr learned my addr 172.21.15.152:0/1546799776 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f6011a5f740 10 client.0 _ll_register_callbacks cb 0x55da4dfd18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600cc21640 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 0x55da4e365090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600dc23640 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e368370 0x55da4e3657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600d422640 1 -- 172.21.15.152:0/1546799776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 msgr2=0x55da4e365090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600d422640 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 0x55da4e365090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600d422640 1 -- 172.21.15.152:0/1546799776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e368370 msgr2=0x55da4e3657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600d422640 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e368370 0x55da4e3657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600d422640 1 -- 172.21.15.152:0/1546799776 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da4e0343c0 con 0x55da4e35d5d0 2024-09-11T22:20:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600dc23640 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e368370 0x55da4e3657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f600d422640 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 0x55da4e367de0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f60040cd200 tx=0x7f600400a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6de1ef1c60eb83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.851+0000 7f5ff0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.852+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/1546799776 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004096060 con 0x55da4e35d5d0 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.852+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/1546799776 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f600409c1d0 con 0x55da4e35d5d0 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.852+0000 7f6011a5f740 1 -- 172.21.15.152:0/1546799776 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60000047a0 con 0x55da4e35d5d0 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.852+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/1546799776 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f600401f040 con 0x55da4e35d5d0 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.853+0000 7f6011a5f740 10 client.28681 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.853+0000 7f6011a5f740 1 -- 172.21.15.152:0/1546799776 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55da4e376bf0 con 0x55da4e35d5d0 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.853+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/1546799776 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60000047a0 con 0x55da4e35d5d0 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.853+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/1546799776 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f600400f040 con 0x55da4e35d5d0 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.853+0000 7f6011a5f740 10 client.28681 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:02.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.853+0000 7f6011a5f740 10 client.28681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.853+0000 7f6011a5f740 20 client.28681 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.853+0000 7f6011a5f740 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55da4e3780b0 0x55da4e37a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.853+0000 7f6011a5f740 4 client.28681 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.853+0000 7f6011a5f740 1 -- 172.21.15.152:0/1546799776 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da4e2d0860 con 0x55da4e3780b0 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.854+0000 7f600cc21640 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55da4e3780b0 0x55da4e37a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.854+0000 7f5ff0ff9640 10 client.28681 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.854+0000 7f600cc21640 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55da4e3780b0 0x55da4e37a4a0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d1c02791f5efe43 server_cookie=131a4d59fb2fbf43 in_seq=0 out_seq=0 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/1546799776 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da4e2d0860 con 0x55da4e3780b0 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f5ff0ff9640 10 client.28681 handle_command_reply: tid=0 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f6011a5f740 1 client.28681 shutdown 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f6011a5f740 1 -- 172.21.15.152:0/1546799776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 msgr2=0x55da4e367de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f6011a5f740 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 0x55da4e367de0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f60040cd200 tx=0x7f600400a440 comp rx=0 tx=0).stop 2024-09-11T22:20:02.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f6011a5f740 1 -- 172.21.15.152:0/1546799776 shutdown_connections 2024-09-11T22:20:02.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f6011a5f740 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55da4e3780b0 0x55da4e37a4a0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f6011a5f740 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e368370 0x55da4e3657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f6011a5f740 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35eb40 0x55da4e365090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f6011a5f740 1 --2- 172.21.15.152:0/1546799776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e35d5d0 0x55da4e367de0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f6011a5f740 1 -- 172.21.15.152:0/1546799776 >> 172.21.15.152:0/1546799776 conn(0x55da4e326310 msgr2=0x55da4e35f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:02.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f5ff0ff9640 0 client.28681 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:02.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f6011a5f740 1 -- 172.21.15.152:0/1546799776 shutdown_connections 2024-09-11T22:20:02.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.855+0000 7f6011a5f740 1 -- 172.21.15.152:0/1546799776 wait complete. 2024-09-11T22:20:02.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.856+0000 7f6011a5f740 20 client.28681 trim_cache size 0 max 16384 2024-09-11T22:20:02.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.874+0000 7f6011a5f740 1 Processor -- start 2024-09-11T22:20:02.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.874+0000 7f6011a5f740 1 -- start start 2024-09-11T22:20:02.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.875+0000 7f6011a5f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 0x55da4e3742b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.875+0000 7f6011a5f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35d5d0 0x55da4e360120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.875+0000 7f600d422640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 0x55da4e3742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.875+0000 7f600d422640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 0x55da4e3742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52944/0 (socket says 172.21.15.152:52944) 2024-09-11T22:20:02.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.875+0000 7f600d422640 1 -- 172.21.15.152:0/3445582932 learned_addr learned my addr 172.21.15.152:0/3445582932 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:02.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.875+0000 7f6011a5f740 1 --2- 172.21.15.152:0/3445582932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 0x55da4e360660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.875+0000 7f600dc23640 1 --2- 172.21.15.152:0/3445582932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 0x55da4e360660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.876+0000 7f6011a5f740 1 -- 172.21.15.152:0/3445582932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f60081ae1d0 con 0x55da4e35eb40 2024-09-11T22:20:02.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.876+0000 7f6011a5f740 1 -- 172.21.15.152:0/3445582932 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60081abaa0 con 0x55da4e35d5d0 2024-09-11T22:20:02.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.876+0000 7f6011a5f740 1 -- 172.21.15.152:0/3445582932 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f60081a9910 con 0x55da4e326310 2024-09-11T22:20:02.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.876+0000 7f600cc21640 1 --2- 172.21.15.152:0/3445582932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35d5d0 0x55da4e360120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.876+0000 7f600d422640 1 -- 172.21.15.152:0/3445582932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35d5d0 msgr2=0x55da4e360120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.876+0000 7f600d422640 1 --2- 172.21.15.152:0/3445582932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35d5d0 0x55da4e360120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.876+0000 7f600d422640 1 -- 172.21.15.152:0/3445582932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 msgr2=0x55da4e360660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.876+0000 7f600d422640 1 --2- 172.21.15.152:0/3445582932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 0x55da4e360660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.876+0000 7f600d422640 1 -- 172.21.15.152:0/3445582932 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4e37aad0 con 0x55da4e326310 2024-09-11T22:20:02.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.877+0000 7f600dc23640 1 --2- 172.21.15.152:0/3445582932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 0x55da4e360660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:02.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.877+0000 7f600d422640 1 --2- 172.21.15.152:0/3445582932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 0x55da4e3742b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f600400efd0 tx=0x7f60040a04a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10cc37a25b808f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.877+0000 7f5ff2ffd640 1 -- 172.21.15.152:0/3445582932 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60040b6020 con 0x55da4e326310 2024-09-11T22:20:02.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.877+0000 7f5ff2ffd640 1 -- 172.21.15.152:0/3445582932 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60040cd620 con 0x55da4e326310 2024-09-11T22:20:02.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.877+0000 7f5ff2ffd640 1 -- 172.21.15.152:0/3445582932 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004015e50 con 0x55da4e326310 2024-09-11T22:20:02.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.878+0000 7f6011a5f740 1 -- 172.21.15.152:0/3445582932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 msgr2=0x55da4e3742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.878+0000 7f6011a5f740 1 --2- 172.21.15.152:0/3445582932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 0x55da4e3742b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f600400efd0 tx=0x7f60040a04a0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.878+0000 7f6011a5f740 1 -- 172.21.15.152:0/3445582932 shutdown_connections 2024-09-11T22:20:02.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.878+0000 7f6011a5f740 1 --2- 172.21.15.152:0/3445582932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 0x55da4e360660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.878+0000 7f6011a5f740 1 --2- 172.21.15.152:0/3445582932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35d5d0 0x55da4e360120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.878+0000 7f6011a5f740 1 --2- 172.21.15.152:0/3445582932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 0x55da4e3742b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.878+0000 7f6011a5f740 1 -- 172.21.15.152:0/3445582932 >> 172.21.15.152:0/3445582932 conn(0x55da4e359130 msgr2=0x55da4e367110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:02.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.878+0000 7f6011a5f740 1 -- 172.21.15.152:0/3445582932 shutdown_connections 2024-09-11T22:20:02.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.878+0000 7f6011a5f740 1 -- 172.21.15.152:0/3445582932 wait complete. 2024-09-11T22:20:02.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f6011a5f740 1 -- start start 2024-09-11T22:20:02.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f6011a5f740 1 Processor -- start 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f6011a5f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 0x55da4e370420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f6011a5f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35d5d0 0x55da4e370960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f6011a5f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 0x55da4e36d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f6011a5f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f60081a9f60 con 0x55da4e35eb40 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f6011a5f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60081ab3d0 con 0x55da4e35d5d0 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f6011a5f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f60081aa630 con 0x55da4e326310 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f6011a5f740 10 client.0 _ll_register_callbacks cb 0x7f600409bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f600cc21640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35d5d0 0x55da4e370960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f600cc21640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35d5d0 0x55da4e370960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:34084/0 (socket says 172.21.15.152:34084) 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f600dc23640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 0x55da4e36d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.879+0000 7f600cc21640 1 -- 172.21.15.152:0/4139304890 learned_addr learned my addr 172.21.15.152:0/4139304890 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:02.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f600d422640 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 0x55da4e370420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f600dc23640 1 -- 172.21.15.152:0/4139304890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 msgr2=0x55da4e370420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f600dc23640 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 0x55da4e370420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f600dc23640 1 -- 172.21.15.152:0/4139304890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35d5d0 msgr2=0x55da4e370960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f600dc23640 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35d5d0 0x55da4e370960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f600dc23640 1 -- 172.21.15.152:0/4139304890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da4e358310 con 0x55da4e35eb40 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f600dc23640 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 0x55da4e36d3f0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f600002a940 tx=0x7f600002aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372ecafce567e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f5ff0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/4139304890 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000035070 con 0x55da4e35eb40 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/4139304890 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8614+0+0 (secure 0 0 0) 0x7f6000003ab0 con 0x55da4e35eb40 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f6011a5f740 1 -- 172.21.15.152:0/4139304890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60040cd620 con 0x55da4e35eb40 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/4139304890 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6000003cb0 con 0x55da4e35eb40 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f6011a5f740 10 client.19389 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:02.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.880+0000 7f6011a5f740 1 -- 172.21.15.152:0/4139304890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55da4e3e3250 con 0x55da4e35eb40 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.881+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/4139304890 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60040cd620 con 0x55da4e35eb40 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.881+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/4139304890 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f600003d660 con 0x55da4e35eb40 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.881+0000 7f6011a5f740 10 client.19389 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.881+0000 7f6011a5f740 10 client.19389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.881+0000 7f6011a5f740 20 client.19389 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.881+0000 7f6011a5f740 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55da4e368370 0x55da4e3e5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.881+0000 7f6011a5f740 4 client.19389 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.881+0000 7f6011a5f740 1 -- 172.21.15.152:0/4139304890 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da4e2cad70 con 0x55da4e368370 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.881+0000 7f600d422640 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55da4e368370 0x55da4e3e5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.882+0000 7f600d422640 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55da4e368370 0x55da4e3e5540 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaca32c1566e6cd0 server_cookie=2765031f93ccb150 in_seq=0 out_seq=0 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.882+0000 7f5ff0ff9640 10 client.19389 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.882+0000 7f5ff0ff9640 1 -- 172.21.15.152:0/4139304890 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da4e2cad70 con 0x55da4e368370 2024-09-11T22:20:02.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.882+0000 7f5ff0ff9640 10 client.19389 handle_command_reply: tid=0 2024-09-11T22:20:02.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.882+0000 7f6011a5f740 1 client.19389 shutdown 2024-09-11T22:20:02.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.883+0000 7f6011a5f740 1 -- 172.21.15.152:0/4139304890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 msgr2=0x55da4e36d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.883+0000 7f6011a5f740 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 0x55da4e36d3f0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f600002a940 tx=0x7f600002aae0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.883+0000 7f6011a5f740 1 -- 172.21.15.152:0/4139304890 shutdown_connections 2024-09-11T22:20:02.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.883+0000 7f6011a5f740 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55da4e368370 0x55da4e3e5540 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.883+0000 7f6011a5f740 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da4e35eb40 0x55da4e36d3f0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.883+0000 7f6011a5f740 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55da4e35d5d0 0x55da4e370960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.883+0000 7f5ff0ff9640 0 client.19389 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:02.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.883+0000 7f6011a5f740 1 --2- 172.21.15.152:0/4139304890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da4e326310 0x55da4e370420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.883+0000 7f6011a5f740 1 -- 172.21.15.152:0/4139304890 >> 172.21.15.152:0/4139304890 conn(0x55da4e359130 msgr2=0x55da4e3732a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:02.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.883+0000 7f6011a5f740 1 -- 172.21.15.152:0/4139304890 shutdown_connections 2024-09-11T22:20:02.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f6011a5f740 1 -- 172.21.15.152:0/4139304890 wait complete. 2024-09-11T22:20:02.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f6011a5f740 20 client.19389 trim_cache size 0 max 16384 2024-09-11T22:20:02.889 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:20:02.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f600f686640 1 -- 172.21.15.152:0/1500625088 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ff40a2d70 msgr2=0x7f5ff40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f600f686640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ff40a2d70 0x7f5ff40a5230 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8005fd0 tx=0x7f5ff8005850 comp rx=0 tx=0).stop 2024-09-11T22:20:02.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f600f686640 1 -- 172.21.15.152:0/1500625088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6008102dd0 msgr2=0x7f6008198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:02.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f600f686640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6008102dd0 0x7f6008198580 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f600400ea80 tx=0x7f600400ef40 comp rx=0 tx=0).stop 2024-09-11T22:20:02.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f600f686640 1 -- 172.21.15.152:0/1500625088 shutdown_connections 2024-09-11T22:20:02.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f600f686640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f5ff40a2d70 0x7f5ff40a5230 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f600f686640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6008108300 0x7f600819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f600f686640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6008103780 0x7f6008198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f600f686640 1 --2- 172.21.15.152:0/1500625088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6008102dd0 0x7f6008198580 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:02.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.884+0000 7f600f686640 1 -- 172.21.15.152:0/1500625088 >> 172.21.15.152:0/1500625088 conn(0x7f60080fc7d0 msgr2=0x7f6008105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:02.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.885+0000 7f600f686640 1 -- 172.21.15.152:0/1500625088 shutdown_connections 2024-09-11T22:20:02.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:02.885+0000 7f600f686640 1 -- 172.21.15.152:0/1500625088 wait complete. 2024-09-11T22:20:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb258ff9640 1 -- 172.21.15.152:0/915693052 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fb26804f070 con 0x564187481880 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb258ff9640 10 client.28669 handle_command_reply: tid=0 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 1 client.28669 shutdown 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 1 -- 172.21.15.152:0/915693052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f32b0 msgr2=0x56418740a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 1 --2- 172.21.15.152:0/915693052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f32b0 0x56418740a640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x564187400590 tx=0x7fb26000f7f0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 1 -- 172.21.15.152:0/915693052 shutdown_connections 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 1 --2- 172.21.15.152:0/915693052 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x564187481880 0x564187483ca0 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 1 --2- 172.21.15.152:0/915693052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5641874020c0 0x5641873f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 1 --2- 172.21.15.152:0/915693052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5641873f32b0 0x56418740a640 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 1 --2- 172.21.15.152:0/915693052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641873f2990 0x56418740a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb258ff9640 0 client.28669 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 1 -- 172.21.15.152:0/915693052 >> 172.21.15.152:0/915693052 conn(0x5641873ef060 msgr2=0x564187400840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 1 -- 172.21.15.152:0/915693052 shutdown_connections 2024-09-11T22:20:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 1 -- 172.21.15.152:0/915693052 wait complete. 2024-09-11T22:20:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.827+0000 7fb27a44e740 20 client.28669 trim_cache size 0 max 16384 2024-09-11T22:20:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:20:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:20:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:20:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:20:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 -- 172.21.15.152:0/3561778228 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb25c0a2e20 msgr2=0x7fb25c0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb25c0a2e20 0x7fb25c0a52e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb268005fe0 tx=0x7fb268005ef0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 -- 172.21.15.152:0/3561778228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2701009b0 msgr2=0x7fb270198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2701009b0 0x7fb270198280 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00c920 tx=0x7fb26c00cde0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 -- 172.21.15.152:0/3561778228 shutdown_connections 2024-09-11T22:20:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb25c0a2e20 0x7fb25c0a52e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2701069c0 0x7fb27019cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb270101350 0x7fb2701987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 --2- 172.21.15.152:0/3561778228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2701009b0 0x7fb270198280 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 -- 172.21.15.152:0/3561778228 >> 172.21.15.152:0/3561778228 conn(0x7fb270077990 msgr2=0x7fb2700fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 -- 172.21.15.152:0/3561778228 shutdown_connections 2024-09-11T22:20:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:03.828+0000 7fb2775d6640 1 -- 172.21.15.152:0/3561778228 wait complete. 2024-09-11T22:20:04.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:03 smithi179 ceph-mon[35603]: pgmap v494: 97 pgs: 97 active+clean; 4.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 669 op/s 2024-09-11T22:20:04.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:03 smithi193 ceph-mon[35545]: pgmap v494: 97 pgs: 97 active+clean; 4.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 669 op/s 2024-09-11T22:20:04.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:03 smithi152 ceph-mon[31188]: pgmap v494: 97 pgs: 97 active+clean; 4.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 669 op/s 2024-09-11T22:20:04.643 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:20:04.644 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:20:04.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 870.0 s, 1202.8 tps, lat 82.213 ms stddev 146.807 2024-09-11T22:20:05.083 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:05.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.796+0000 7fdd018cd640 1 -- 172.21.15.152:0/1367901058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc102dd0 msgr2=0x7fdcfc1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.796+0000 7fdd018cd640 1 --2- 172.21.15.152:0/1367901058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc102dd0 0x7fdcfc1031b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009cd0 tx=0x7fdcf402a8d0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.796+0000 7fdd018cd640 1 -- 172.21.15.152:0/1367901058 shutdown_connections 2024-09-11T22:20:05.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.796+0000 7fdd018cd640 1 --2- 172.21.15.152:0/1367901058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcfc108300 0x7fdcfc10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.796+0000 7fdd018cd640 1 --2- 172.21.15.152:0/1367901058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcfc103780 0x7fdcfc107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.796+0000 7fdd018cd640 1 --2- 172.21.15.152:0/1367901058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc102dd0 0x7fdcfc1031b0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.796+0000 7fdd018cd640 1 -- 172.21.15.152:0/1367901058 >> 172.21.15.152:0/1367901058 conn(0x7fdcfc0fc7d0 msgr2=0x7fdcfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.796+0000 7fdd018cd640 1 -- 172.21.15.152:0/1367901058 shutdown_connections 2024-09-11T22:20:05.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.796+0000 7fdd018cd640 1 -- 172.21.15.152:0/1367901058 wait complete. 2024-09-11T22:20:05.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdd018cd640 1 Processor -- start 2024-09-11T22:20:05.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdd018cd640 1 -- start start 2024-09-11T22:20:05.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdd018cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc102dd0 0x7fdcfc100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdd018cd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcfc103780 0x7fdcfc100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdd018cd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcfc108300 0x7fdcfc1014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdd018cd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc112090 con 0x7fdcfc102dd0 2024-09-11T22:20:05.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdd018cd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc111f10 con 0x7fdcfc103780 2024-09-11T22:20:05.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdd018cd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc112210 con 0x7fdcfc108300 2024-09-11T22:20:05.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdcfaffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc102dd0 0x7fdcfc100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdcfb7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcfc108300 0x7fdcfc1014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdcfa7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcfc103780 0x7fdcfc100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdcfaffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc102dd0 0x7fdcfc100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54634/0 (socket says 172.21.15.152:54634) 2024-09-11T22:20:05.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.797+0000 7fdcfaffd640 1 -- 172.21.15.152:0/2469189995 learned_addr learned my addr 172.21.15.152:0/2469189995 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:05.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.798+0000 7fdcfb7fe640 1 -- 172.21.15.152:0/2469189995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcfc103780 msgr2=0x7fdcfc100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.798+0000 7fdcfb7fe640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcfc103780 0x7fdcfc100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.798+0000 7fdcfb7fe640 1 -- 172.21.15.152:0/2469189995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc102dd0 msgr2=0x7fdcfc100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.798+0000 7fdcfb7fe640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc102dd0 0x7fdcfc100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.798+0000 7fdcfb7fe640 1 -- 172.21.15.152:0/2469189995 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc1a6a60 con 0x7fdcfc108300 2024-09-11T22:20:05.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.798+0000 7fdcfb7fe640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcfc108300 0x7fdcfc1014b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000e970 tx=0x7fdcf000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.798+0000 7fdd008cb640 1 -- 172.21.15.152:0/2469189995 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000ccc0 con 0x7fdcfc108300 2024-09-11T22:20:05.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.798+0000 7fdd018cd640 1 -- 172.21.15.152:0/2469189995 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcfc1a6d50 con 0x7fdcfc108300 2024-09-11T22:20:05.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.798+0000 7fdd008cb640 1 -- 172.21.15.152:0/2469189995 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcf0005020 con 0x7fdcfc108300 2024-09-11T22:20:05.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.798+0000 7fdd008cb640 1 -- 172.21.15.152:0/2469189995 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0004a00 con 0x7fdcfc108300 2024-09-11T22:20:05.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.798+0000 7fdd018cd640 1 -- 172.21.15.152:0/2469189995 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcfc1a7230 con 0x7fdcfc108300 2024-09-11T22:20:05.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.801+0000 7fdd008cb640 1 -- 172.21.15.152:0/2469189995 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fdcf00051d0 con 0x7fdcfc108300 2024-09-11T22:20:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.801+0000 7fdd008cb640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdce40a2cf0 0x7fdce40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdd03ca6740 1 Processor -- start 2024-09-11T22:20:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdd008cb640 1 -- 172.21.15.152:0/2469189995 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8658+0+0 (secure 0 0 0) 0x7fdcf00cf410 con 0x7fdcfc108300 2024-09-11T22:20:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdce40a2cf0 0x7fdce40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdd03ca6740 1 -- start start 2024-09-11T22:20:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3efb60 0x56134c3eff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c3fa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3fad40 0x56134c3fd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdd03ca6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56134c355280 con 0x56134c3efb60 2024-09-11T22:20:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdd03ca6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56134c2fcb10 con 0x56134c3f0480 2024-09-11T22:20:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdd03ca6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56134c351240 con 0x56134c3fad40 2024-09-11T22:20:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdcfaffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3efb60 0x56134c3eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdcfaffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3efb60 0x56134c3eff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54650/0 (socket says 172.21.15.152:54650) 2024-09-11T22:20:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdcfaffd640 1 -- 172.21.15.152:0/3316534576 learned_addr learned my addr 172.21.15.152:0/3316534576 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdcfb7fe640 1 --2- 172.21.15.152:0/3316534576 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3fad40 0x56134c3fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.802+0000 7fdcfa7fc640 1 --2- 172.21.15.152:0/3316534576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c3fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.803+0000 7fdcfaffd640 1 -- 172.21.15.152:0/3316534576 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3fad40 msgr2=0x56134c3fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.803+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/3316534576 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3fad40 0x56134c3fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.803+0000 7fdcfaffd640 1 -- 172.21.15.152:0/3316534576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 msgr2=0x56134c3fa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.803+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/3316534576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c3fa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.803+0000 7fdcfaffd640 1 -- 172.21.15.152:0/3316534576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134c3091f0 con 0x56134c3efb60 2024-09-11T22:20:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.803+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/3316534576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3efb60 0x56134c3eff40 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009df0 tx=0x7fdcf4048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16debfc39884d21f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.803+0000 7fdce1ffb640 1 -- 172.21.15.152:0/3316534576 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf404f070 con 0x56134c3efb60 2024-09-11T22:20:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.803+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdce40a2cf0 0x7fdce40a51b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009ca0 tx=0x7fdcf4031bb0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.803+0000 7fdce1ffb640 1 -- 172.21.15.152:0/3316534576 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcf4043070 con 0x56134c3efb60 2024-09-11T22:20:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.803+0000 7fdce1ffb640 1 -- 172.21.15.152:0/3316534576 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4045050 con 0x56134c3efb60 2024-09-11T22:20:05.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.804+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3316534576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3efb60 msgr2=0x56134c3eff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.804+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/3316534576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3efb60 0x56134c3eff40 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009df0 tx=0x7fdcf4048000 comp rx=0 tx=0).stop 2024-09-11T22:20:05.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.804+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3316534576 shutdown_connections 2024-09-11T22:20:05.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.805+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/3316534576 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3fad40 0x56134c3fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.805+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/3316534576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c3fa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.805+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/3316534576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3efb60 0x56134c3eff40 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.805+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3316534576 >> 172.21.15.152:0/3316534576 conn(0x56134c3ec0f0 msgr2=0x56134c3ec4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.805+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3316534576 shutdown_connections 2024-09-11T22:20:05.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.805+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3316534576 wait complete. 2024-09-11T22:20:05.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.805+0000 7fdd03ca6740 1 -- start start 2024-09-11T22:20:05.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.806+0000 7fdd03ca6740 1 Processor -- start 2024-09-11T22:20:05.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.806+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3efb60 0x56134c3f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.807+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3f0480 0x56134c3f8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.807+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3fad40 0x56134c3f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.807+0000 7fdcfaffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3efb60 0x56134c3f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.807+0000 7fdcfaffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3efb60 0x56134c3f7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:46618/0 (socket says 172.21.15.152:46618) 2024-09-11T22:20:05.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.807+0000 7fdcfaffd640 1 -- 172.21.15.152:0/1674527777 learned_addr learned my addr 172.21.15.152:0/1674527777 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:05.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.807+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1674527777 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56134c3fd960 con 0x56134c3f0480 2024-09-11T22:20:05.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.807+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1674527777 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56134c30ff10 con 0x56134c3efb60 2024-09-11T22:20:05.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.807+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1674527777 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56134c3fdae0 con 0x56134c3fad40 2024-09-11T22:20:05.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.807+0000 7fdcfb7fe640 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3fad40 0x56134c3f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.807+0000 7fdcfa7fc640 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3f0480 0x56134c3f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.807+0000 7fdd03ca6740 10 client.0 _ll_register_callbacks cb 0x56134c2d8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:05.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdcfb7fe640 1 -- 172.21.15.152:0/1674527777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3efb60 msgr2=0x56134c3f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdcfb7fe640 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3efb60 0x56134c3f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdcfb7fe640 1 -- 172.21.15.152:0/1674527777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3f0480 msgr2=0x56134c3f8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdcfb7fe640 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3f0480 0x56134c3f8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdcfb7fe640 1 -- 172.21.15.152:0/1674527777 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134c0c66a0 con 0x56134c3fad40 2024-09-11T22:20:05.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdcfb7fe640 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3fad40 0x56134c3f86d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00ccad0 tx=0x7fdcf009c060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29e2a28b94b10d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdcdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:20:05.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdcdaffd640 1 -- 172.21.15.152:0/1674527777 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00b3070 con 0x56134c3fad40 2024-09-11T22:20:05.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdcdaffd640 1 -- 172.21.15.152:0/1674527777 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8658+0+0 (secure 0 0 0) 0x7fdcf009bd00 con 0x56134c3fad40 2024-09-11T22:20:05.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1674527777 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf4043070 con 0x56134c3fad40 2024-09-11T22:20:05.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdcdaffd640 1 -- 172.21.15.152:0/1674527777 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdcf001c040 con 0x56134c3fad40 2024-09-11T22:20:05.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdd03ca6740 10 client.28699 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:05.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1674527777 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56134c4095b0 con 0x56134c3fad40 2024-09-11T22:20:05.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.808+0000 7fdcdaffd640 1 -- 172.21.15.152:0/1674527777 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcf4043070 con 0x56134c3fad40 2024-09-11T22:20:05.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.809+0000 7fdcdaffd640 1 -- 172.21.15.152:0/1674527777 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fdcf00a4080 con 0x56134c3fad40 2024-09-11T22:20:05.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.809+0000 7fdd03ca6740 10 client.28699 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:05.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.809+0000 7fdd03ca6740 10 client.28699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:05.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.809+0000 7fdd03ca6740 20 client.28699 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:05.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.809+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56134c40aa10 0x56134c40ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.809+0000 7fdd03ca6740 4 client.28699 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:05.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.809+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1674527777 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56134c3627f0 con 0x56134c40aa10 2024-09-11T22:20:05.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.809+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56134c40aa10 0x56134c40ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.810+0000 7fdcdaffd640 10 client.28699 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:05.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.810+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56134c40aa10 0x56134c40ce80 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0ecac94e0bd36ce server_cookie=d8dd8bd48e9b97dd in_seq=0 out_seq=0 2024-09-11T22:20:05.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.810+0000 7fdcdaffd640 1 -- 172.21.15.152:0/1674527777 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56134c3627f0 con 0x56134c40aa10 2024-09-11T22:20:05.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.810+0000 7fdcdaffd640 10 client.28699 handle_command_reply: tid=0 2024-09-11T22:20:05.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.810+0000 7fdd03ca6740 1 client.28699 shutdown 2024-09-11T22:20:05.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1674527777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3fad40 msgr2=0x56134c3f86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3fad40 0x56134c3f86d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00ccad0 tx=0x7fdcf009c060 comp rx=0 tx=0).stop 2024-09-11T22:20:05.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1674527777 shutdown_connections 2024-09-11T22:20:05.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56134c40aa10 0x56134c40ce80 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3fad40 0x56134c3f86d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3f0480 0x56134c3f8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/1674527777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3efb60 0x56134c3f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdcdaffd640 0 client.28699 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:05.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1674527777 >> 172.21.15.152:0/1674527777 conn(0x56134c3ec0f0 msgr2=0x56134c3f1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1674527777 shutdown_connections 2024-09-11T22:20:05.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1674527777 wait complete. 2024-09-11T22:20:05.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.811+0000 7fdd03ca6740 20 client.28699 trim_cache size 0 max 16384 2024-09-11T22:20:05.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.836+0000 7fdd03ca6740 1 Processor -- start 2024-09-11T22:20:05.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.836+0000 7fdd03ca6740 1 -- start start 2024-09-11T22:20:05.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.836+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 0x56134c3f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.836+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c412750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.836+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 0x56134c412c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.836+0000 7fdd03ca6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1b2580 con 0x56134c3fad40 2024-09-11T22:20:05.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.836+0000 7fdd03ca6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1afe50 con 0x56134c3f0480 2024-09-11T22:20:05.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.836+0000 7fdd03ca6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1adcc0 con 0x56134c3efb60 2024-09-11T22:20:05.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.836+0000 7fdcfb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 0x56134c412c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfa7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c412750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfaffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 0x56134c3f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 0x56134c412c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54664/0 (socket says 172.21.15.152:54664) 2024-09-11T22:20:05.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfa7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c412750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:46630/0 (socket says 172.21.15.152:46630) 2024-09-11T22:20:05.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfb7fe640 1 -- 172.21.15.152:0/1474443254 learned_addr learned my addr 172.21.15.152:0/1474443254 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:05.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfaffd640 1 -- 172.21.15.152:0/1474443254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 msgr2=0x56134c412750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/1474443254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c412750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfaffd640 1 -- 172.21.15.152:0/1474443254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 msgr2=0x56134c412c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/1474443254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 0x56134c412c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfaffd640 1 -- 172.21.15.152:0/1474443254 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134c3ed1a0 con 0x56134c3efb60 2024-09-11T22:20:05.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfa7fc640 1 --2- 172.21.15.152:0/1474443254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c412750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:05.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfb7fe640 1 --2- 172.21.15.152:0/1474443254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 0x56134c412c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:05.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/1474443254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 0x56134c3f25c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40093e0 tx=0x7fdcf4031f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=762c603dde154d62 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdce17fa640 1 -- 172.21.15.152:0/1474443254 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf404f040 con 0x56134c3efb60 2024-09-11T22:20:05.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdce17fa640 1 -- 172.21.15.152:0/1474443254 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcf405c070 con 0x56134c3efb60 2024-09-11T22:20:05.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.837+0000 7fdce17fa640 1 -- 172.21.15.152:0/1474443254 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4045040 con 0x56134c3efb60 2024-09-11T22:20:05.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.838+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1474443254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 msgr2=0x56134c3f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.838+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/1474443254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 0x56134c3f25c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40093e0 tx=0x7fdcf4031f90 comp rx=0 tx=0).stop 2024-09-11T22:20:05.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.838+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1474443254 shutdown_connections 2024-09-11T22:20:05.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.838+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/1474443254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 0x56134c412c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.838+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/1474443254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c412750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.838+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/1474443254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 0x56134c3f25c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.838+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1474443254 >> 172.21.15.152:0/1474443254 conn(0x56134c3ec0f0 msgr2=0x56134c3f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.838+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1474443254 shutdown_connections 2024-09-11T22:20:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.838+0000 7fdd03ca6740 1 -- 172.21.15.152:0/1474443254 wait complete. 2024-09-11T22:20:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.839+0000 7fdd03ca6740 1 -- start start 2024-09-11T22:20:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.839+0000 7fdd03ca6740 1 Processor -- start 2024-09-11T22:20:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.839+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 0x56134c3fed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.839+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c3ff2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.839+0000 7fdd03ca6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 0x56134c3ff810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.839+0000 7fdcfa7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c3ff2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.839+0000 7fdcfaffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 0x56134c3fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcfa7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c3ff2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:46638/0 (socket says 172.21.15.152:46638) 2024-09-11T22:20:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcfaffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 0x56134c3fed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:54998/0 (socket says 172.21.15.152:54998) 2024-09-11T22:20:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcfaffd640 1 -- 172.21.15.152:0/3094330659 learned_addr learned my addr 172.21.15.152:0/3094330659 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3094330659 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1ae310 con 0x56134c3fad40 2024-09-11T22:20:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3094330659 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1af780 con 0x56134c3f0480 2024-09-11T22:20:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcfb7fe640 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 0x56134c3ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3094330659 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1ae9e0 con 0x56134c3efb60 2024-09-11T22:20:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdd03ca6740 10 client.0 _ll_register_callbacks cb 0x7fdcf00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcfaffd640 1 -- 172.21.15.152:0/3094330659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 msgr2=0x56134c3ff2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c3ff2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcfaffd640 1 -- 172.21.15.152:0/3094330659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 msgr2=0x56134c3ff810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 0x56134c3ff810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcfaffd640 1 -- 172.21.15.152:0/3094330659 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134c3ecd80 con 0x56134c3efb60 2024-09-11T22:20:05.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcfa7fc640 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c3ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:05.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcfaffd640 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 0x56134c3fed70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40315a0 tx=0x7fdcf40048e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6052882e138c50c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.840+0000 7fdcdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:20:05.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.841+0000 7fdcdaffd640 1 -- 172.21.15.152:0/3094330659 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4060030 con 0x56134c3efb60 2024-09-11T22:20:05.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.841+0000 7fdcdaffd640 1 -- 172.21.15.152:0/3094330659 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8658+0+0 (secure 0 0 0) 0x7fdcf4009800 con 0x56134c3efb60 2024-09-11T22:20:05.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.842+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3094330659 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf405c070 con 0x56134c3efb60 2024-09-11T22:20:05.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.842+0000 7fdcdaffd640 1 -- 172.21.15.152:0/3094330659 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdcf406b050 con 0x56134c3efb60 2024-09-11T22:20:05.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.842+0000 7fdd03ca6740 10 client.28705 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:05.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.842+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3094330659 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56134c475b20 con 0x56134c3efb60 2024-09-11T22:20:05.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.843+0000 7fdcdaffd640 1 -- 172.21.15.152:0/3094330659 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcf4043040 con 0x56134c3efb60 2024-09-11T22:20:05.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.843+0000 7fdcdaffd640 1 -- 172.21.15.152:0/3094330659 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fdcf402fa70 con 0x56134c3efb60 2024-09-11T22:20:05.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.843+0000 7fdd03ca6740 10 client.28705 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:05.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.843+0000 7fdd03ca6740 10 client.28705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:05.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.843+0000 7fdd03ca6740 20 client.28705 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:05.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.843+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56134c475cf0 0x56134c4780e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.843+0000 7fdd03ca6740 4 client.28705 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:20:05.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.843+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3094330659 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fdcf405c070 con 0x56134c475cf0 2024-09-11T22:20:05.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.844+0000 7fdcfa7fc640 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56134c475cf0 0x56134c4780e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.845+0000 7fdcfa7fc640 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56134c475cf0 0x56134c4780e0 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7862659d2672bbc2 server_cookie=3da4ecf636ef6549 in_seq=0 out_seq=0 2024-09-11T22:20:05.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.845+0000 7fdcdaffd640 10 client.28705 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:05.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.845+0000 7fdcdaffd640 1 -- 172.21.15.152:0/3094330659 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fdcf405c070 con 0x56134c475cf0 2024-09-11T22:20:05.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdcdaffd640 10 client.28705 handle_command_reply: tid=0 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdd03ca6740 1 client.28705 shutdown 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3094330659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 msgr2=0x56134c3fed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 0x56134c3fed70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40315a0 tx=0x7fdcf40048e0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3094330659 shutdown_connections 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56134c475cf0 0x56134c4780e0 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56134c3fad40 0x56134c3ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134c3f0480 0x56134c3ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdd03ca6740 1 --2- 172.21.15.152:0/3094330659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56134c3efb60 0x56134c3fed70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3094330659 >> 172.21.15.152:0/3094330659 conn(0x56134c3ec0f0 msgr2=0x56134c3eb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdcdaffd640 0 client.28705 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3094330659 shutdown_connections 2024-09-11T22:20:05.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.846+0000 7fdd03ca6740 1 -- 172.21.15.152:0/3094330659 wait complete. 2024-09-11T22:20:05.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.847+0000 7fdd03ca6740 20 client.28705 trim_cache size 0 max 16384 2024-09-11T22:20:05.851 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:20:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "return_code": 0, 2024-09-11T22:20:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_tag": "545b6a26-e200-4791-8b06-58f5a8a8626c", 2024-09-11T22:20:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": "asynchronous" 2024-09-11T22:20:05.851 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:20:05.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.847+0000 7fdd018cd640 1 -- 172.21.15.152:0/2469189995 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdce40a2cf0 msgr2=0x7fdce40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.847+0000 7fdd018cd640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdce40a2cf0 0x7fdce40a51b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009ca0 tx=0x7fdcf4031bb0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.847+0000 7fdd018cd640 1 -- 172.21.15.152:0/2469189995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcfc108300 msgr2=0x7fdcfc1014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.847+0000 7fdd018cd640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcfc108300 0x7fdcfc1014b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000e970 tx=0x7fdcf000ee30 comp rx=0 tx=0).stop 2024-09-11T22:20:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.848+0000 7fdd018cd640 1 -- 172.21.15.152:0/2469189995 shutdown_connections 2024-09-11T22:20:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.848+0000 7fdd018cd640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fdce40a2cf0 0x7fdce40a51b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.848+0000 7fdd018cd640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcfc108300 0x7fdcfc1014b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.848+0000 7fdd018cd640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcfc103780 0x7fdcfc100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.848+0000 7fdd018cd640 1 --2- 172.21.15.152:0/2469189995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc102dd0 0x7fdcfc100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.848+0000 7fdd018cd640 1 -- 172.21.15.152:0/2469189995 >> 172.21.15.152:0/2469189995 conn(0x7fdcfc0fc7d0 msgr2=0x7fdcfc105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.848+0000 7fdd018cd640 1 -- 172.21.15.152:0/2469189995 shutdown_connections 2024-09-11T22:20:05.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:05.848+0000 7fdd018cd640 1 -- 172.21.15.152:0/2469189995 wait complete. 2024-09-11T22:20:05.967 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:05 smithi152 ceph-mon[31188]: osdmap e104: 12 total, 12 up, 12 in 2024-09-11T22:20:05.967 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:05 smithi152 ceph-mon[31188]: pgmap v496: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 1.68k op/s 2024-09-11T22:20:06.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:05 smithi179 ceph-mon[35603]: osdmap e104: 12 total, 12 up, 12 in 2024-09-11T22:20:06.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:05 smithi179 ceph-mon[35603]: pgmap v496: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 1.68k op/s 2024-09-11T22:20:06.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:05 smithi193 ceph-mon[35545]: osdmap e104: 12 total, 12 up, 12 in 2024-09-11T22:20:06.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:05 smithi193 ceph-mon[35545]: pgmap v496: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 1.68k op/s 2024-09-11T22:20:06.871 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:06 smithi152 ceph-mon[31188]: scrub queued for path: / 2024-09-11T22:20:06.871 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:06 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:20:06.871 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:06 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:20:06.871 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:06 smithi152 ceph-mon[31188]: scrub summary: active paths [/] 2024-09-11T22:20:06.871 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:06 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:20:06.871 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:06 smithi152 ceph-mon[31188]: scrub summary: idle+waiting paths [/] 2024-09-11T22:20:06.907 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:20:07.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:06 smithi179 ceph-mon[35603]: scrub queued for path: / 2024-09-11T22:20:07.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:06 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:20:07.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:06 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:20:07.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:06 smithi179 ceph-mon[35603]: scrub summary: active paths [/] 2024-09-11T22:20:07.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:06 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:20:07.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:06 smithi179 ceph-mon[35603]: scrub summary: idle+waiting paths [/] 2024-09-11T22:20:07.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:06 smithi193 ceph-mon[35545]: scrub queued for path: / 2024-09-11T22:20:07.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:06 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:20:07.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:06 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:20:07.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:06 smithi193 ceph-mon[35545]: scrub summary: active paths [/] 2024-09-11T22:20:07.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:06 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:20:07.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:06 smithi193 ceph-mon[35545]: scrub summary: idle+waiting paths [/] 2024-09-11T22:20:07.268 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:07.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.826+0000 7fa4d404a640 1 -- 172.21.15.152:0/3179576550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4cc109450 msgr2=0x7fa4cc110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:07.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.826+0000 7fa4d404a640 1 --2- 172.21.15.152:0/3179576550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4cc109450 0x7fa4cc110250 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa4c801a910 tx=0x7fa4c803b470 comp rx=0 tx=0).stop 2024-09-11T22:20:07.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.830+0000 7fa4d404a640 1 -- 172.21.15.152:0/3179576550 shutdown_connections 2024-09-11T22:20:07.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.830+0000 7fa4d404a640 1 --2- 172.21.15.152:0/3179576550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc11b140 0x7fa4cc11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.830+0000 7fa4d404a640 1 --2- 172.21.15.152:0/3179576550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4cc109830 0x7fa4cc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.830+0000 7fa4d404a640 1 --2- 172.21.15.152:0/3179576550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4cc109450 0x7fa4cc110250 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.830+0000 7fa4d404a640 1 -- 172.21.15.152:0/3179576550 >> 172.21.15.152:0/3179576550 conn(0x7fa4cc06e140 msgr2=0x7fa4cc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:07.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.830+0000 7fa4d404a640 1 -- 172.21.15.152:0/3179576550 shutdown_connections 2024-09-11T22:20:07.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.830+0000 7fa4d404a640 1 -- 172.21.15.152:0/3179576550 wait complete. 2024-09-11T22:20:07.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.831+0000 7fa4d404a640 1 Processor -- start 2024-09-11T22:20:07.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.831+0000 7fa4d404a640 1 -- start start 2024-09-11T22:20:07.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.831+0000 7fa4d404a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc109450 0x7fa4cc11a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.831+0000 7fa4d404a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4cc109830 0x7fa4cc116a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.831+0000 7fa4d404a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4cc11b140 0x7fa4cc116f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.832+0000 7fa4d404a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc1133e0 con 0x7fa4cc109830 2024-09-11T22:20:07.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.832+0000 7fa4d1de6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc109450 0x7fa4cc11a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.832+0000 7fa4d1de6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc109450 0x7fa4cc11a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:55006/0 (socket says 172.21.15.152:55006) 2024-09-11T22:20:07.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.832+0000 7fa4d1de6640 1 -- 172.21.15.152:0/3634631918 learned_addr learned my addr 172.21.15.152:0/3634631918 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:07.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.832+0000 7fa4d25e7640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4cc11b140 0x7fa4cc116f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.832+0000 7fa4d404a640 1 -- 172.21.15.152:0/3634631918 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc113260 con 0x7fa4cc11b140 2024-09-11T22:20:07.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.832+0000 7fa4d404a640 1 -- 172.21.15.152:0/3634631918 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc113560 con 0x7fa4cc109450 2024-09-11T22:20:07.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.833+0000 7fa4d1de6640 1 -- 172.21.15.152:0/3634631918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4cc11b140 msgr2=0x7fa4cc116f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:07.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.833+0000 7fa4d1de6640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4cc11b140 0x7fa4cc116f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.833+0000 7fa4d1de6640 1 -- 172.21.15.152:0/3634631918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4cc109830 msgr2=0x7fa4cc116a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:07.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.833+0000 7fa4d1de6640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4cc109830 0x7fa4cc116a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.833+0000 7fa4d1de6640 1 -- 172.21.15.152:0/3634631918 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc117810 con 0x7fa4cc109450 2024-09-11T22:20:07.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.834+0000 7fa4d1de6640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc109450 0x7fa4cc11a9a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa4c801aa30 tx=0x7fa4c8004c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:07.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.834+0000 7fa4c2ffd640 1 -- 172.21.15.152:0/3634631918 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c804f020 con 0x7fa4cc109450 2024-09-11T22:20:07.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.835+0000 7fa4c2ffd640 1 -- 172.21.15.152:0/3634631918 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4c8004260 con 0x7fa4cc109450 2024-09-11T22:20:07.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.835+0000 7fa4c2ffd640 1 -- 172.21.15.152:0/3634631918 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8046070 con 0x7fa4cc109450 2024-09-11T22:20:07.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.836+0000 7fa4d404a640 1 -- 172.21.15.152:0/3634631918 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc1ab170 con 0x7fa4cc109450 2024-09-11T22:20:07.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.836+0000 7fa4d404a640 1 -- 172.21.15.152:0/3634631918 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc1ab630 con 0x7fa4cc109450 2024-09-11T22:20:07.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.840+0000 7fa4d6423740 1 Processor -- start 2024-09-11T22:20:07.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.840+0000 7fa4d6423740 1 -- start start 2024-09-11T22:20:07.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.840+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b65774a0 0x5648b6577880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.840+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6577dc0 0x5648b6582140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6582680 0x5648b6584a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d6423740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5648b64dd2e0 con 0x5648b6577dc0 2024-09-11T22:20:07.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d6423740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5648b6484ce0 con 0x5648b65774a0 2024-09-11T22:20:07.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d6423740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5648b64d92a0 con 0x5648b6582680 2024-09-11T22:20:07.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d25e7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b65774a0 0x5648b6577880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d25e7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b65774a0 0x5648b6577880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:46670/0 (socket says 172.21.15.152:46670) 2024-09-11T22:20:07.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d25e7640 1 -- 172.21.15.152:0/2261792815 learned_addr learned my addr 172.21.15.152:0/2261792815 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:07.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/2261792815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6582680 0x5648b6584a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d25e7640 1 -- 172.21.15.152:0/2261792815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6582680 msgr2=0x5648b6584a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:07.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d25e7640 1 --2- 172.21.15.152:0/2261792815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6582680 0x5648b6584a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d25e7640 1 -- 172.21.15.152:0/2261792815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6577dc0 msgr2=0x5648b6582140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:20:07.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d25e7640 1 --2- 172.21.15.152:0/2261792815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6577dc0 0x5648b6582140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.841+0000 7fa4d25e7640 1 -- 172.21.15.152:0/2261792815 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b6469440 con 0x5648b65774a0 2024-09-11T22:20:07.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.842+0000 7fa4d25e7640 1 --2- 172.21.15.152:0/2261792815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b65774a0 0x5648b6577880 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400b450 tx=0x7fa4c4009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9586ae99a44969ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:07.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.842+0000 7fa4b7fff640 1 -- 172.21.15.152:0/2261792815 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c400a910 con 0x5648b65774a0 2024-09-11T22:20:07.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.842+0000 7fa4b7fff640 1 -- 172.21.15.152:0/2261792815 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4c4019070 con 0x5648b65774a0 2024-09-11T22:20:07.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.842+0000 7fa4b7fff640 1 -- 172.21.15.152:0/2261792815 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4013380 con 0x5648b65774a0 2024-09-11T22:20:07.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.843+0000 7fa4c2ffd640 1 -- 172.21.15.152:0/3634631918 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa4c8052020 con 0x7fa4cc109450 2024-09-11T22:20:07.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.843+0000 7fa4d6423740 1 -- 172.21.15.152:0/2261792815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b65774a0 msgr2=0x5648b6577880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:07.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.843+0000 7fa4d6423740 1 --2- 172.21.15.152:0/2261792815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b65774a0 0x5648b6577880 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400b450 tx=0x7fa4c4009580 comp rx=0 tx=0).stop 2024-09-11T22:20:07.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.844+0000 7fa4d6423740 1 -- 172.21.15.152:0/2261792815 shutdown_connections 2024-09-11T22:20:07.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.844+0000 7fa4d6423740 1 --2- 172.21.15.152:0/2261792815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6582680 0x5648b6584a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.844+0000 7fa4d6423740 1 --2- 172.21.15.152:0/2261792815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6577dc0 0x5648b6582140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.844+0000 7fa4d6423740 1 --2- 172.21.15.152:0/2261792815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b65774a0 0x5648b6577880 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.844+0000 7fa4d6423740 1 -- 172.21.15.152:0/2261792815 >> 172.21.15.152:0/2261792815 conn(0x5648b6573a30 msgr2=0x5648b6573e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:07.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.844+0000 7fa4c2ffd640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4b80a2d70 0x7fa4b80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.844+0000 7fa4c2ffd640 1 -- 172.21.15.152:0/3634631918 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8658+0+0 (secure 0 0 0) 0x7fa4c81005a0 con 0x7fa4cc109450 2024-09-11T22:20:07.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.845+0000 7fa4d6423740 1 -- 172.21.15.152:0/2261792815 shutdown_connections 2024-09-11T22:20:07.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.845+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4b80a2d70 0x7fa4b80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.845+0000 7fa4d6423740 1 -- 172.21.15.152:0/2261792815 wait complete. 2024-09-11T22:20:07.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.845+0000 7fa4d6423740 1 -- start start 2024-09-11T22:20:07.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.846+0000 7fa4d6423740 1 Processor -- start 2024-09-11T22:20:07.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.846+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4b80a2d70 0x7fa4b80a5230 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x5648b6574db0 tx=0x7fa4bc008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:07.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.846+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b65774a0 0x5648b6581f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.846+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6577dc0 0x5648b657f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.846+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6582680 0x5648b657f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.846+0000 7fa4d6423740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5648b65852a0 con 0x5648b6577dc0 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.846+0000 7fa4d6423740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5648b6498050 con 0x5648b6582680 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.846+0000 7fa4d6423740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5648b6585420 con 0x5648b65774a0 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.847+0000 7fa4d6423740 10 client.0 _ll_register_callbacks cb 0x5648b64d8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.847+0000 7fa4d15e5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6577dc0 0x5648b657f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.847+0000 7fa4d15e5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6577dc0 0x5648b657f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54704/0 (socket says 172.21.15.152:54704) 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.847+0000 7fa4d15e5640 1 -- 172.21.15.152:0/2968695030 learned_addr learned my addr 172.21.15.152:0/2968695030 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.847+0000 7fa4d25e7640 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6582680 0x5648b657f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.847+0000 7fa4d1de6640 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b65774a0 0x5648b6581f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.847+0000 7fa4d15e5640 1 -- 172.21.15.152:0/2968695030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b65774a0 msgr2=0x5648b6581f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:07.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.847+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b65774a0 0x5648b6581f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.848+0000 7fa4d15e5640 1 -- 172.21.15.152:0/2968695030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6582680 msgr2=0x5648b657f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:07.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.848+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6582680 0x5648b657f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.848+0000 7fa4d15e5640 1 -- 172.21.15.152:0/2968695030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648b624e3c0 con 0x5648b6577dc0 2024-09-11T22:20:07.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.848+0000 7fa4d25e7640 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6582680 0x5648b657f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:07.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.848+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6577dc0 0x5648b657f220 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00dc80 tx=0x7fa4bc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b564affcf536e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:07.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.848+0000 7fa4b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:07.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.849+0000 7fa4b57fa640 1 -- 172.21.15.152:0/2968695030 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc024060 con 0x5648b6577dc0 2024-09-11T22:20:07.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.849+0000 7fa4b57fa640 1 -- 172.21.15.152:0/2968695030 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8658+0+0 (secure 0 0 0) 0x7fa4bc01f400 con 0x5648b6577dc0 2024-09-11T22:20:07.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.849+0000 7fa4d6423740 1 -- 172.21.15.152:0/2968695030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4c4019070 con 0x5648b6577dc0 2024-09-11T22:20:07.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.849+0000 7fa4b57fa640 1 -- 172.21.15.152:0/2968695030 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa4bc01f600 con 0x5648b6577dc0 2024-09-11T22:20:07.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.849+0000 7fa4d6423740 10 client.19413 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:07.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.849+0000 7fa4d6423740 1 -- 172.21.15.152:0/2968695030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5648b6590ca0 con 0x5648b6577dc0 2024-09-11T22:20:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.850+0000 7fa4b57fa640 1 -- 172.21.15.152:0/2968695030 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4c4019070 con 0x5648b6577dc0 2024-09-11T22:20:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.850+0000 7fa4b57fa640 1 -- 172.21.15.152:0/2968695030 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa4bc013070 con 0x5648b6577dc0 2024-09-11T22:20:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.850+0000 7fa4d6423740 10 client.19413 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.850+0000 7fa4d6423740 10 client.19413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.850+0000 7fa4d6423740 20 client.19413 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.850+0000 7fa4d6423740 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5648b6592100 0x5648b6594520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.850+0000 7fa4d6423740 4 client.19413 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.850+0000 7fa4d6423740 1 -- 172.21.15.152:0/2968695030 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648b64ea850 con 0x5648b6592100 2024-09-11T22:20:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.850+0000 7fa4d1de6640 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5648b6592100 0x5648b6594520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.852+0000 7fa4b57fa640 10 client.19413 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.852+0000 7fa4d1de6640 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5648b6592100 0x5648b6594520 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1f66f14ec164cbf server_cookie=6d5c51925a6f4445 in_seq=0 out_seq=0 2024-09-11T22:20:07.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.853+0000 7fa4b57fa640 1 -- 172.21.15.152:0/2968695030 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648b64ea850 con 0x5648b6592100 2024-09-11T22:20:07.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.853+0000 7fa4b57fa640 10 client.19413 handle_command_reply: tid=0 2024-09-11T22:20:07.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.853+0000 7fa4d6423740 1 client.19413 shutdown 2024-09-11T22:20:07.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4d6423740 1 -- 172.21.15.152:0/2968695030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6577dc0 msgr2=0x5648b657f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:07.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4d6423740 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6577dc0 0x5648b657f220 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00dc80 tx=0x7fa4bc0047e0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4d6423740 1 -- 172.21.15.152:0/2968695030 shutdown_connections 2024-09-11T22:20:07.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4d6423740 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5648b6592100 0x5648b6594520 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4d6423740 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6582680 0x5648b657f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4b57fa640 0 client.19413 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:07.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4d6423740 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6577dc0 0x5648b657f220 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4d6423740 1 --2- 172.21.15.152:0/2968695030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b65774a0 0x5648b6581f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4d6423740 1 -- 172.21.15.152:0/2968695030 >> 172.21.15.152:0/2968695030 conn(0x5648b6573a30 msgr2=0x5648b6579760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4d6423740 1 -- 172.21.15.152:0/2968695030 shutdown_connections 2024-09-11T22:20:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4d6423740 1 -- 172.21.15.152:0/2968695030 wait complete. 2024-09-11T22:20:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.854+0000 7fa4d6423740 20 client.19413 trim_cache size 0 max 16384 2024-09-11T22:20:07.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d6423740 1 Processor -- start 2024-09-11T22:20:07.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d6423740 1 -- start start 2024-09-11T22:20:07.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b65774a0 0x5648b6581190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6577dc0 0x5648b6599dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6582680 0x5648b659a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d6423740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc1b6a30 con 0x5648b65774a0 2024-09-11T22:20:07.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d6423740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc1b4300 con 0x5648b6582680 2024-09-11T22:20:07.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d6423740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc1b2170 con 0x5648b6577dc0 2024-09-11T22:20:07.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d15e5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6577dc0 0x5648b6599dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d15e5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6577dc0 0x5648b6599dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:55032/0 (socket says 172.21.15.152:55032) 2024-09-11T22:20:07.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d1de6640 1 --2- 172.21.15.152:0/280747393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b65774a0 0x5648b6581190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d15e5640 1 -- 172.21.15.152:0/280747393 learned_addr learned my addr 172.21.15.152:0/280747393 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:07.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.875+0000 7fa4d25e7640 1 --2- 172.21.15.152:0/280747393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6582680 0x5648b659a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.876+0000 7fa4d15e5640 1 -- 172.21.15.152:0/280747393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6582680 msgr2=0x5648b659a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:07.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.876+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/280747393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6582680 0x5648b659a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.876+0000 7fa4d15e5640 1 -- 172.21.15.152:0/280747393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b65774a0 msgr2=0x5648b6581190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:07.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.876+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/280747393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b65774a0 0x5648b6581190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.876+0000 7fa4d15e5640 1 -- 172.21.15.152:0/280747393 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b6573860 con 0x5648b6577dc0 2024-09-11T22:20:07.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.876+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/280747393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6577dc0 0x5648b6599dd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00b170 tx=0x7fa4bc00df80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe6e9b5f257e9f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:07.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.876+0000 7fa4b77fe640 1 -- 172.21.15.152:0/280747393 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc02e080 con 0x5648b6577dc0 2024-09-11T22:20:07.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.876+0000 7fa4b77fe640 1 -- 172.21.15.152:0/280747393 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4bc01f400 con 0x5648b6577dc0 2024-09-11T22:20:07.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.876+0000 7fa4b77fe640 1 -- 172.21.15.152:0/280747393 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc004280 con 0x5648b6577dc0 2024-09-11T22:20:07.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.877+0000 7fa4d6423740 1 -- 172.21.15.152:0/280747393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6577dc0 msgr2=0x5648b6599dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:07.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.877+0000 7fa4d6423740 1 --2- 172.21.15.152:0/280747393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6577dc0 0x5648b6599dd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00b170 tx=0x7fa4bc00df80 comp rx=0 tx=0).stop 2024-09-11T22:20:07.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.877+0000 7fa4d6423740 1 -- 172.21.15.152:0/280747393 shutdown_connections 2024-09-11T22:20:07.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.877+0000 7fa4d6423740 1 --2- 172.21.15.152:0/280747393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6582680 0x5648b659a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.877+0000 7fa4d6423740 1 --2- 172.21.15.152:0/280747393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b6577dc0 0x5648b6599dd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.877+0000 7fa4d6423740 1 --2- 172.21.15.152:0/280747393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b65774a0 0x5648b6581190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.877+0000 7fa4d6423740 1 -- 172.21.15.152:0/280747393 >> 172.21.15.152:0/280747393 conn(0x5648b6573a30 msgr2=0x5648b6580a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:07.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.877+0000 7fa4d6423740 1 -- 172.21.15.152:0/280747393 shutdown_connections 2024-09-11T22:20:07.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.877+0000 7fa4d6423740 1 -- 172.21.15.152:0/280747393 wait complete. 2024-09-11T22:20:07.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.878+0000 7fa4d6423740 1 -- start start 2024-09-11T22:20:07.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.878+0000 7fa4d6423740 1 Processor -- start 2024-09-11T22:20:07.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b65774a0 0x5648b658ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6577dc0 0x5648b6588100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d6423740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6582680 0x5648b6588640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d6423740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc1b27c0 con 0x5648b6582680 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d6423740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc1b3c30 con 0x5648b6577dc0 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d1de6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b65774a0 0x5648b658ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d6423740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc1b2e90 con 0x5648b65774a0 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d15e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6577dc0 0x5648b6588100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d1de6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b65774a0 0x5648b658ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:55044/0 (socket says 172.21.15.152:55044) 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d1de6640 1 -- 172.21.15.152:0/3546797316 learned_addr learned my addr 172.21.15.152:0/3546797316 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d6423740 10 client.0 _ll_register_callbacks cb 0x7fa4bc00b4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d25e7640 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6582680 0x5648b6588640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d15e5640 1 -- 172.21.15.152:0/3546797316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b65774a0 msgr2=0x5648b658ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b65774a0 0x5648b658ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d15e5640 1 -- 172.21.15.152:0/3546797316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6582680 msgr2=0x5648b6588640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6582680 0x5648b6588640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.879+0000 7fa4d15e5640 1 -- 172.21.15.152:0/3546797316 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648b6588e50 con 0x5648b6577dc0 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.880+0000 7fa4d15e5640 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6577dc0 0x5648b6588100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x5648b65748d0 tx=0x7fa4bc00be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ed13af2f9a7d1b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.880+0000 7fa4b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.880+0000 7fa4b57fa640 1 -- 172.21.15.152:0/3546797316 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc036070 con 0x5648b6577dc0 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.880+0000 7fa4d6423740 1 -- 172.21.15.152:0/3546797316 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4bc01f400 con 0x5648b6577dc0 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.880+0000 7fa4b57fa640 1 -- 172.21.15.152:0/3546797316 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8658+0+0 (secure 0 0 0) 0x7fa4bc004220 con 0x5648b6577dc0 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.880+0000 7fa4b57fa640 1 -- 172.21.15.152:0/3546797316 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa4bc03f050 con 0x5648b6577dc0 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.880+0000 7fa4d6423740 10 client.28571 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.880+0000 7fa4d6423740 1 -- 172.21.15.152:0/3546797316 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5648b65fcd30 con 0x5648b6577dc0 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.880+0000 7fa4b57fa640 1 -- 172.21.15.152:0/3546797316 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4bc01f400 con 0x5648b6577dc0 2024-09-11T22:20:07.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.881+0000 7fa4b57fa640 1 -- 172.21.15.152:0/3546797316 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa4bc039020 con 0x5648b6577dc0 2024-09-11T22:20:07.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.881+0000 7fa4d6423740 10 client.28571 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:07.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.881+0000 7fa4d6423740 10 client.28571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:07.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.881+0000 7fa4d6423740 20 client.28571 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:07.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.881+0000 7fa4d6423740 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5648b65fd3e0 0x5648b65ff7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:07.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.881+0000 7fa4d6423740 4 client.28571 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:20:07.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.882+0000 7fa4d6423740 1 -- 172.21.15.152:0/3546797316 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5648b657faf0 con 0x5648b65fd3e0 2024-09-11T22:20:07.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.882+0000 7fa4d1de6640 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5648b65fd3e0 0x5648b65ff7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:07.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.882+0000 7fa4d1de6640 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5648b65fd3e0 0x5648b65ff7d0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf2b5b2d723374ef server_cookie=fe366e1fd61a0c25 in_seq=0 out_seq=0 2024-09-11T22:20:07.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.882+0000 7fa4b57fa640 10 client.28571 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:07.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.882+0000 7fa4b57fa640 1 -- 172.21.15.152:0/3546797316 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5648b657faf0 con 0x5648b65fd3e0 2024-09-11T22:20:07.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.882+0000 7fa4b57fa640 10 client.28571 handle_command_reply: tid=0 2024-09-11T22:20:07.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.882+0000 7fa4d6423740 1 client.28571 shutdown 2024-09-11T22:20:07.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.882+0000 7fa4d6423740 1 -- 172.21.15.152:0/3546797316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6577dc0 msgr2=0x5648b6588100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:07.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.882+0000 7fa4d6423740 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6577dc0 0x5648b6588100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x5648b65748d0 tx=0x7fa4bc00be70 comp rx=0 tx=0).stop 2024-09-11T22:20:07.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.883+0000 7fa4d6423740 1 -- 172.21.15.152:0/3546797316 shutdown_connections 2024-09-11T22:20:07.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.883+0000 7fa4d6423740 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5648b65fd3e0 0x5648b65ff7d0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.883+0000 7fa4d6423740 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648b6582680 0x5648b6588640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.883+0000 7fa4d6423740 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648b6577dc0 0x5648b6588100 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.883+0000 7fa4b57fa640 0 client.28571 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:07.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.883+0000 7fa4d6423740 1 --2- 172.21.15.152:0/3546797316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5648b65774a0 0x5648b658ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.883+0000 7fa4d6423740 1 -- 172.21.15.152:0/3546797316 >> 172.21.15.152:0/3546797316 conn(0x5648b6573a30 msgr2=0x5648b65812a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:07.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.883+0000 7fa4d6423740 1 -- 172.21.15.152:0/3546797316 shutdown_connections 2024-09-11T22:20:07.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.883+0000 7fa4d6423740 1 -- 172.21.15.152:0/3546797316 wait complete. 2024-09-11T22:20:07.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.883+0000 7fa4d6423740 20 client.28571 trim_cache size 0 max 16384 2024-09-11T22:20:07.889 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:20:07.889 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:20:07.889 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": { 2024-09-11T22:20:07.889 INFO:teuthology.orchestra.run.smithi152.stdout: "545b6a26-e200-4791-8b06-58f5a8a8626c": { 2024-09-11T22:20:07.889 INFO:teuthology.orchestra.run.smithi152.stdout: "path": "/", 2024-09-11T22:20:07.890 INFO:teuthology.orchestra.run.smithi152.stdout: "tag": "545b6a26-e200-4791-8b06-58f5a8a8626c", 2024-09-11T22:20:07.890 INFO:teuthology.orchestra.run.smithi152.stdout: "options": "recursive,force" 2024-09-11T22:20:07.890 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:07.890 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:07.890 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:20:07.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.884+0000 7fa4d404a640 1 -- 172.21.15.152:0/3634631918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4b80a2d70 msgr2=0x7fa4b80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:07.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.884+0000 7fa4d404a640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4b80a2d70 0x7fa4b80a5230 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x5648b6574db0 tx=0x7fa4bc008040 comp rx=0 tx=0).stop 2024-09-11T22:20:07.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.884+0000 7fa4d404a640 1 -- 172.21.15.152:0/3634631918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc109450 msgr2=0x7fa4cc11a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:07.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.884+0000 7fa4d404a640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc109450 0x7fa4cc11a9a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa4c801aa30 tx=0x7fa4c8004c10 comp rx=0 tx=0).stop 2024-09-11T22:20:07.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.886+0000 7fa4d404a640 1 -- 172.21.15.152:0/3634631918 shutdown_connections 2024-09-11T22:20:07.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.886+0000 7fa4d404a640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa4b80a2d70 0x7fa4b80a5230 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.886+0000 7fa4d404a640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4cc11b140 0x7fa4cc116f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.886+0000 7fa4d404a640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4cc109830 0x7fa4cc116a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.886+0000 7fa4d404a640 1 --2- 172.21.15.152:0/3634631918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc109450 0x7fa4cc11a9a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:07.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.886+0000 7fa4d404a640 1 -- 172.21.15.152:0/3634631918 >> 172.21.15.152:0/3634631918 conn(0x7fa4cc06e140 msgr2=0x7fa4cc072390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:07.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.887+0000 7fa4d404a640 1 -- 172.21.15.152:0/3634631918 shutdown_connections 2024-09-11T22:20:07.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:07.887+0000 7fa4d404a640 1 -- 172.21.15.152:0/3634631918 wait complete. 2024-09-11T22:20:07.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:07 smithi152 ceph-mon[31188]: pgmap v497: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 1.68k op/s 2024-09-11T22:20:08.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:07 smithi179 ceph-mon[35603]: pgmap v497: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 1.68k op/s 2024-09-11T22:20:08.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:07 smithi193 ceph-mon[35545]: pgmap v497: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 1.68k op/s 2024-09-11T22:20:08.709 INFO:tasks.cephfs.filesystem:scrub status for tag:545b6a26-e200-4791-8b06-58f5a8a8626c - {'path': '/', 'tag': '545b6a26-e200-4791-8b06-58f5a8a8626c', 'options': 'recursive,force'} 2024-09-11T22:20:09.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 875.0 s, 2140.2 tps, lat 47.325 ms stddev 72.891 2024-09-11T22:20:10.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:09 smithi179 ceph-mon[35603]: pgmap v498: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 17 MiB/s wr, 1.69k op/s 2024-09-11T22:20:10.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:09 smithi193 ceph-mon[35545]: pgmap v498: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 17 MiB/s wr, 1.69k op/s 2024-09-11T22:20:10.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:09 smithi152 ceph-mon[31188]: pgmap v498: 97 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 78 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 17 MiB/s wr, 1.69k op/s 2024-09-11T22:20:12.049 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:11 smithi179 ceph-mon[35603]: pgmap v499: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 17 MiB/s wr, 1.66k op/s 2024-09-11T22:20:12.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:11 smithi193 ceph-mon[35545]: pgmap v499: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 17 MiB/s wr, 1.66k op/s 2024-09-11T22:20:12.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:11 smithi152 ceph-mon[31188]: pgmap v499: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 17 MiB/s wr, 1.66k op/s 2024-09-11T22:20:14.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:13 smithi179 ceph-mon[35603]: pgmap v500: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 17 MiB/s wr, 1.68k op/s 2024-09-11T22:20:14.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:13 smithi193 ceph-mon[35545]: pgmap v500: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 17 MiB/s wr, 1.68k op/s 2024-09-11T22:20:14.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:13 smithi152 ceph-mon[31188]: pgmap v500: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 17 MiB/s wr, 1.68k op/s 2024-09-11T22:20:14.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 880.0 s, 2749.8 tps, lat 36.058 ms stddev 48.628 2024-09-11T22:20:15.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:14 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:20:15.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:14 smithi179 ceph-mon[35603]: scrub summary: idle 2024-09-11T22:20:15.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:14 smithi179 ceph-mon[35603]: osdmap e105: 12 total, 12 up, 12 in 2024-09-11T22:20:15.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:14 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:20:15.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:14 smithi193 ceph-mon[35545]: scrub summary: idle 2024-09-11T22:20:15.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:14 smithi193 ceph-mon[35545]: osdmap e105: 12 total, 12 up, 12 in 2024-09-11T22:20:15.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:14 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:20:15.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:14 smithi152 ceph-mon[31188]: scrub summary: idle 2024-09-11T22:20:15.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:14 smithi152 ceph-mon[31188]: osdmap e105: 12 total, 12 up, 12 in 2024-09-11T22:20:16.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:15 smithi179 ceph-mon[35603]: pgmap v502: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.6 MiB/s wr, 677 op/s 2024-09-11T22:20:16.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:15 smithi193 ceph-mon[35545]: pgmap v502: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.6 MiB/s wr, 677 op/s 2024-09-11T22:20:16.131 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:15 smithi152 ceph-mon[31188]: pgmap v502: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.6 MiB/s wr, 677 op/s 2024-09-11T22:20:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.950+0000 7f6d59a65640 1 -- 172.21.15.152:0/1940593868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d541091f0 msgr2=0x7f6d54109610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.950+0000 7f6d59a65640 1 --2- 172.21.15.152:0/1940593868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d541091f0 0x7f6d54109610 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800aa40 tx=0x7f6d4802b760 comp rx=0 tx=0).stop 2024-09-11T22:20:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.950+0000 7f6d59a65640 1 -- 172.21.15.152:0/1940593868 shutdown_connections 2024-09-11T22:20:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.950+0000 7f6d59a65640 1 --2- 172.21.15.152:0/1940593868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d54109b50 0x7f6d541158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.950+0000 7f6d59a65640 1 --2- 172.21.15.152:0/1940593868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d541091f0 0x7f6d54109610 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.950+0000 7f6d59a65640 1 --2- 172.21.15.152:0/1940593868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d5410eaf0 0x7f6d5410eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.950+0000 7f6d59a65640 1 -- 172.21.15.152:0/1940593868 >> 172.21.15.152:0/1940593868 conn(0x7f6d5406ce00 msgr2=0x7f6d5406d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.950+0000 7f6d59a65640 1 -- 172.21.15.152:0/1940593868 shutdown_connections 2024-09-11T22:20:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.950+0000 7f6d59a65640 1 -- 172.21.15.152:0/1940593868 wait complete. 2024-09-11T22:20:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d59a65640 1 Processor -- start 2024-09-11T22:20:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d59a65640 1 -- start start 2024-09-11T22:20:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d59a65640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d541091f0 0x7f6d541a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d59a65640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d54109b50 0x7f6d541a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d59a65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d5410eaf0 0x7f6d5419e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d59a65640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541185d0 con 0x7f6d54109b50 2024-09-11T22:20:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d59a65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d54118450 con 0x7f6d5410eaf0 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d59a65640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6d54118750 con 0x7f6d541091f0 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d52ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d54109b50 0x7f6d541a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d52ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d54109b50 0x7f6d541a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57194/0 (socket says 172.21.15.152:57194) 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d52ffd640 1 -- 172.21.15.152:0/2151450529 learned_addr learned my addr 172.21.15.152:0/2151450529 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d537fe640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d541091f0 0x7f6d541a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.951+0000 7f6d53fff640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d5410eaf0 0x7f6d5419e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.952+0000 7f6d52ffd640 1 -- 172.21.15.152:0/2151450529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d541091f0 msgr2=0x7f6d541a47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.952+0000 7f6d52ffd640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d541091f0 0x7f6d541a47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.952+0000 7f6d52ffd640 1 -- 172.21.15.152:0/2151450529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d5410eaf0 msgr2=0x7f6d5419e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.952+0000 7f6d52ffd640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d5410eaf0 0x7f6d5419e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.952+0000 7f6d52ffd640 1 -- 172.21.15.152:0/2151450529 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5419f0e0 con 0x7f6d54109b50 2024-09-11T22:20:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.952+0000 7f6d52ffd640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d54109b50 0x7f6d541a4d20 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800a340 tx=0x7f6d48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.952+0000 7f6d50ff9640 1 -- 172.21.15.152:0/2151450529 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4803f070 con 0x7f6d54109b50 2024-09-11T22:20:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.952+0000 7f6d50ff9640 1 -- 172.21.15.152:0/2151450529 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d48003cd0 con 0x7f6d54109b50 2024-09-11T22:20:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.952+0000 7f6d59a65640 1 -- 172.21.15.152:0/2151450529 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5419f370 con 0x7f6d54109b50 2024-09-11T22:20:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.952+0000 7f6d50ff9640 1 -- 172.21.15.152:0/2151450529 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48036040 con 0x7f6d54109b50 2024-09-11T22:20:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.953+0000 7f6d59a65640 1 -- 172.21.15.152:0/2151450529 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d541ab6a0 con 0x7f6d54109b50 2024-09-11T22:20:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.956+0000 7f6d5c800740 1 Processor -- start 2024-09-11T22:20:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.956+0000 7f6d5c800740 1 -- start start 2024-09-11T22:20:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.957+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6bfaf0 0x55685c6bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6c0410 0x55685c6ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 0x55685c6cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d5c800740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55685c6242f0 con 0x55685c6bfaf0 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d5c800740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55685c5cc270 con 0x55685c6c0410 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d5c800740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55685c6202b0 con 0x55685c6cacb0 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d537fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6c0410 0x55685c6ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d537fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6c0410 0x55685c6ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37954/0 (socket says 172.21.15.152:37954) 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d537fe640 1 -- 172.21.15.152:0/3421061469 learned_addr learned my addr 172.21.15.152:0/3421061469 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d53fff640 1 --2- 172.21.15.152:0/3421061469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6bfaf0 0x55685c6bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d50ff9640 1 -- 172.21.15.152:0/2151450529 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f6d48042070 con 0x7f6d54109b50 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d52ffd640 1 --2- 172.21.15.152:0/3421061469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 0x55685c6cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.958+0000 7f6d537fe640 1 -- 172.21.15.152:0/3421061469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 msgr2=0x55685c6cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.959+0000 7f6d537fe640 1 --2- 172.21.15.152:0/3421061469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 0x55685c6cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.959+0000 7f6d537fe640 1 -- 172.21.15.152:0/3421061469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6bfaf0 msgr2=0x55685c6bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.959+0000 7f6d537fe640 1 --2- 172.21.15.152:0/3421061469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6bfaf0 0x55685c6bfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.959+0000 7f6d537fe640 1 -- 172.21.15.152:0/3421061469 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55685c5cb340 con 0x55685c6c0410 2024-09-11T22:20:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.959+0000 7f6d52ffd640 1 --2- 172.21.15.152:0/3421061469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 0x55685c6cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.959+0000 7f6d537fe640 1 --2- 172.21.15.152:0/3421061469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6c0410 0x55685c6ca770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400bc30 tx=0x7f6d440107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23dafa10eb436258 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.959+0000 7f6d50ff9640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6d3c0a2fc0 0x7f6d3c0a5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.959+0000 7f6d39ffb640 1 -- 172.21.15.152:0/3421061469 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d44004030 con 0x55685c6c0410 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.959+0000 7f6d39ffb640 1 -- 172.21.15.152:0/3421061469 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d440041d0 con 0x55685c6c0410 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.959+0000 7f6d39ffb640 1 -- 172.21.15.152:0/3421061469 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d44011840 con 0x55685c6c0410 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.959+0000 7f6d50ff9640 1 -- 172.21.15.152:0/2151450529 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f6d480ef710 con 0x7f6d54109b50 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.960+0000 7f6d53fff640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6d3c0a2fc0 0x7f6d3c0a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.960+0000 7f6d5c800740 1 -- 172.21.15.152:0/3421061469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6c0410 msgr2=0x55685c6ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.960+0000 7f6d53fff640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6d3c0a2fc0 0x7f6d3c0a5480 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c005fd0 tx=0x7f6d4c009500 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.960+0000 7f6d5c800740 1 --2- 172.21.15.152:0/3421061469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6c0410 0x55685c6ca770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400bc30 tx=0x7f6d440107a0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.961+0000 7f6d5c800740 1 -- 172.21.15.152:0/3421061469 shutdown_connections 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.961+0000 7f6d5c800740 1 --2- 172.21.15.152:0/3421061469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 0x55685c6cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.961+0000 7f6d5c800740 1 --2- 172.21.15.152:0/3421061469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6c0410 0x55685c6ca770 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.961+0000 7f6d5c800740 1 --2- 172.21.15.152:0/3421061469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6bfaf0 0x55685c6bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.961+0000 7f6d5c800740 1 -- 172.21.15.152:0/3421061469 >> 172.21.15.152:0/3421061469 conn(0x55685c6bc060 msgr2=0x55685c6bc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.961+0000 7f6d5c800740 1 -- 172.21.15.152:0/3421061469 shutdown_connections 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.961+0000 7f6d5c800740 1 -- 172.21.15.152:0/3421061469 wait complete. 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.961+0000 7f6d5c800740 1 -- start start 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.961+0000 7f6d5c800740 1 Processor -- start 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.962+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 0x55685c6c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.962+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6c0410 0x55685c6c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.962+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 0x55685c6c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.962+0000 7f6d537fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 0x55685c6c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.962+0000 7f6d5c800740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55685c6cd880 con 0x55685c6c0410 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.962+0000 7f6d5c800740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55685c5ad290 con 0x55685c6bfaf0 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.962+0000 7f6d537fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 0x55685c6c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37958/0 (socket says 172.21.15.152:37958) 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.962+0000 7f6d537fe640 1 -- 172.21.15.152:0/426659573 learned_addr learned my addr 172.21.15.152:0/426659573 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.962+0000 7f6d52ffd640 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6c0410 0x55685c6c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.962+0000 7f6d53fff640 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 0x55685c6c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.962+0000 7f6d5c800740 1 -- 172.21.15.152:0/426659573 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55685c6cda00 con 0x55685c6cacb0 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d537fe640 1 -- 172.21.15.152:0/426659573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 msgr2=0x55685c6c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d537fe640 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 0x55685c6c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d537fe640 1 -- 172.21.15.152:0/426659573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6c0410 msgr2=0x55685c6c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d537fe640 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6c0410 0x55685c6c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d537fe640 1 -- 172.21.15.152:0/426659573 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55685c337210 con 0x55685c6bfaf0 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d53fff640 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 0x55685c6c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d5c800740 10 client.0 _ll_register_callbacks cb 0x55685c5de140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d5c800740 1 -- 172.21.15.152:0/426659573 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d440041d0 con 0x55685c6bfaf0 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d537fe640 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 0x55685c6c7c60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6d44011010 tx=0x7f6d4400b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a4916e9dfdbb070 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d32ffd640 10 client.28583 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:20:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d32ffd640 1 -- 172.21.15.152:0/426659573 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4400bd20 con 0x55685c6bfaf0 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d32ffd640 1 -- 172.21.15.152:0/426659573 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f6d440035f0 con 0x55685c6bfaf0 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d32ffd640 1 -- 172.21.15.152:0/426659573 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6d44003810 con 0x55685c6bfaf0 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d5c800740 10 client.28583 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.963+0000 7f6d5c800740 1 -- 172.21.15.152:0/426659573 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55685c403620 con 0x55685c6bfaf0 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.964+0000 7f6d32ffd640 1 -- 172.21.15.152:0/426659573 <== mon.2 v2:172.21.15.179:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f6d44005040 con 0x55685c6bfaf0 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.964+0000 7f6d5c800740 10 client.28583 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.964+0000 7f6d5c800740 10 client.28583 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.964+0000 7f6d5c800740 20 client.28583 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.964+0000 7f6d5c800740 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55685c6dae10 0x55685c6dd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.964+0000 7f6d5c800740 4 client.28583 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.964+0000 7f6d5c800740 1 -- 172.21.15.152:0/426659573 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55685c631a20 con 0x55685c6dae10 2024-09-11T22:20:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.964+0000 7f6d52ffd640 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55685c6dae10 0x55685c6dd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.965+0000 7f6d52ffd640 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55685c6dae10 0x55685c6dd2d0 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f72e0309fedece92 server_cookie=db08ab79c044706e in_seq=0 out_seq=0 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.965+0000 7f6d32ffd640 10 client.28583 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.965+0000 7f6d32ffd640 1 -- 172.21.15.152:0/426659573 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55685c631a20 con 0x55685c6dae10 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.965+0000 7f6d32ffd640 10 client.28583 handle_command_reply: tid=0 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.965+0000 7f6d5c800740 1 client.28583 shutdown 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d5c800740 1 -- 172.21.15.152:0/426659573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 msgr2=0x55685c6c7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d5c800740 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 0x55685c6c7c60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6d44011010 tx=0x7f6d4400b800 comp rx=0 tx=0).stop 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d5c800740 1 -- 172.21.15.152:0/426659573 shutdown_connections 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d5c800740 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55685c6dae10 0x55685c6dd2d0 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d5c800740 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6cacb0 0x55685c6c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d5c800740 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6c0410 0x55685c6c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d32ffd640 0 client.28583 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d5c800740 1 --2- 172.21.15.152:0/426659573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 0x55685c6c7c60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d5c800740 1 -- 172.21.15.152:0/426659573 >> 172.21.15.152:0/426659573 conn(0x55685c6bc060 msgr2=0x55685c6c1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d5c800740 1 -- 172.21.15.152:0/426659573 shutdown_connections 2024-09-11T22:20:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d5c800740 1 -- 172.21.15.152:0/426659573 wait complete. 2024-09-11T22:20:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.966+0000 7f6d5c800740 20 client.28583 trim_cache size 0 max 16384 2024-09-11T22:20:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d5c800740 1 Processor -- start 2024-09-11T22:20:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d5c800740 1 -- start start 2024-09-11T22:20:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 0x55685c6c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6c0410 0x55685c6c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6cacb0 0x55685c6c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d52ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6c0410 0x55685c6c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d5c800740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541bac10 con 0x55685c6cacb0 2024-09-11T22:20:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d52ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6c0410 0x55685c6c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:35430/0 (socket says 172.21.15.152:35430) 2024-09-11T22:20:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d52ffd640 1 -- 172.21.15.152:0/2891014833 learned_addr learned my addr 172.21.15.152:0/2891014833 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d5c800740 1 -- 172.21.15.152:0/2891014833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541b84e0 con 0x55685c6bfaf0 2024-09-11T22:20:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d5c800740 1 -- 172.21.15.152:0/2891014833 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541b6350 con 0x55685c6c0410 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d53fff640 1 --2- 172.21.15.152:0/2891014833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6cacb0 0x55685c6c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d537fe640 1 --2- 172.21.15.152:0/2891014833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 0x55685c6c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d537fe640 1 -- 172.21.15.152:0/2891014833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6c0410 msgr2=0x55685c6c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d537fe640 1 --2- 172.21.15.152:0/2891014833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6c0410 0x55685c6c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d537fe640 1 -- 172.21.15.152:0/2891014833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6cacb0 msgr2=0x55685c6c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d537fe640 1 --2- 172.21.15.152:0/2891014833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6cacb0 0x55685c6c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.985+0000 7f6d537fe640 1 -- 172.21.15.152:0/2891014833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55685c6c8a50 con 0x55685c6bfaf0 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.986+0000 7f6d52ffd640 1 --2- 172.21.15.152:0/2891014833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6c0410 0x55685c6c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.986+0000 7f6d537fe640 1 --2- 172.21.15.152:0/2891014833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 0x55685c6c2560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6d44000bc0 tx=0x7f6d44021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f6b86cefb2c651 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.986+0000 7f6d397fa640 1 -- 172.21.15.152:0/2891014833 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d44037070 con 0x55685c6bfaf0 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.986+0000 7f6d397fa640 1 -- 172.21.15.152:0/2891014833 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d440041d0 con 0x55685c6bfaf0 2024-09-11T22:20:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.986+0000 7f6d397fa640 1 -- 172.21.15.152:0/2891014833 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d44030950 con 0x55685c6bfaf0 2024-09-11T22:20:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.987+0000 7f6d5c800740 1 -- 172.21.15.152:0/2891014833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 msgr2=0x55685c6c2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.987+0000 7f6d5c800740 1 --2- 172.21.15.152:0/2891014833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 0x55685c6c2560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6d44000bc0 tx=0x7f6d44021000 comp rx=0 tx=0).stop 2024-09-11T22:20:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.987+0000 7f6d5c800740 1 -- 172.21.15.152:0/2891014833 shutdown_connections 2024-09-11T22:20:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.987+0000 7f6d5c800740 1 --2- 172.21.15.152:0/2891014833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6cacb0 0x55685c6c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.987+0000 7f6d5c800740 1 --2- 172.21.15.152:0/2891014833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6c0410 0x55685c6c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.987+0000 7f6d5c800740 1 --2- 172.21.15.152:0/2891014833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6bfaf0 0x55685c6c2560 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.987+0000 7f6d5c800740 1 -- 172.21.15.152:0/2891014833 >> 172.21.15.152:0/2891014833 conn(0x55685c6bc060 msgr2=0x55685c6c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.987+0000 7f6d5c800740 1 -- 172.21.15.152:0/2891014833 shutdown_connections 2024-09-11T22:20:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.987+0000 7f6d5c800740 1 -- 172.21.15.152:0/2891014833 wait complete. 2024-09-11T22:20:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.987+0000 7f6d5c800740 1 -- start start 2024-09-11T22:20:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.987+0000 7f6d5c800740 1 Processor -- start 2024-09-11T22:20:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.988+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6bfaf0 0x55685c6dfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.988+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6c0410 0x55685c6e0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.988+0000 7f6d5c800740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6cacb0 0x55685c743a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.988+0000 7f6d5c800740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541b69a0 con 0x55685c6c0410 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.988+0000 7f6d5c800740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541b7e10 con 0x55685c6cacb0 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.988+0000 7f6d5c800740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541b7070 con 0x55685c6bfaf0 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.988+0000 7f6d5c800740 10 client.0 _ll_register_callbacks cb 0x7f6d4c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.988+0000 7f6d53fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6cacb0 0x55685c743a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.988+0000 7f6d53fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6cacb0 0x55685c743a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:37978/0 (socket says 172.21.15.152:37978) 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.988+0000 7f6d53fff640 1 -- 172.21.15.152:0/3969354102 learned_addr learned my addr 172.21.15.152:0/3969354102 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.988+0000 7f6d52ffd640 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6c0410 0x55685c6e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.989+0000 7f6d53fff640 1 -- 172.21.15.152:0/3969354102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6bfaf0 msgr2=0x55685c6dfb50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.989+0000 7f6d53fff640 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6bfaf0 0x55685c6dfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.989+0000 7f6d53fff640 1 -- 172.21.15.152:0/3969354102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6c0410 msgr2=0x55685c6e0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.989+0000 7f6d53fff640 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6c0410 0x55685c6e0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.989+0000 7f6d53fff640 1 -- 172.21.15.152:0/3969354102 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55685c6e0970 con 0x55685c6cacb0 2024-09-11T22:20:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.989+0000 7f6d53fff640 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6cacb0 0x55685c743a50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c004170 tx=0x7f6d4c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a2fffa741b309d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.989+0000 7f6d32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.989+0000 7f6d32ffd640 1 -- 172.21.15.152:0/3969354102 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c00f930 con 0x55685c6cacb0 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.989+0000 7f6d5c800740 1 -- 172.21.15.152:0/3969354102 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d440041d0 con 0x55685c6cacb0 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.989+0000 7f6d32ffd640 1 -- 172.21.15.152:0/3969354102 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f6d4c00fad0 con 0x55685c6cacb0 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.990+0000 7f6d32ffd640 1 -- 172.21.15.152:0/3969354102 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6d4c037050 con 0x55685c6cacb0 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.990+0000 7f6d5c800740 10 client.28589 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.990+0000 7f6d5c800740 1 -- 172.21.15.152:0/3969354102 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55685c745130 con 0x55685c6cacb0 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.990+0000 7f6d32ffd640 1 -- 172.21.15.152:0/3969354102 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d440041d0 con 0x55685c6cacb0 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.991+0000 7f6d32ffd640 1 -- 172.21.15.152:0/3969354102 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f6d4c029490 con 0x55685c6cacb0 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.991+0000 7f6d5c800740 10 client.28589 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.991+0000 7f6d5c800740 10 client.28589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.991+0000 7f6d5c800740 20 client.28589 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.991+0000 7f6d5c800740 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55685c745880 0x55685c747ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.991+0000 7f6d5c800740 4 client.28589 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:20:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.991+0000 7f6d5c800740 1 -- 172.21.15.152:0/3969354102 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55685c62bd70 con 0x55685c745880 2024-09-11T22:20:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.991+0000 7f6d537fe640 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55685c745880 0x55685c747ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.991+0000 7f6d32ffd640 10 client.28589 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:16.991+0000 7f6d537fe640 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55685c745880 0x55685c747ce0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d0babe5be587d0f server_cookie=5adc817099fba177 in_seq=0 out_seq=0 2024-09-11T22:20:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d32ffd640 1 -- 172.21.15.152:0/3969354102 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55685c62bd70 con 0x55685c745880 2024-09-11T22:20:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d32ffd640 10 client.28589 handle_command_reply: tid=0 2024-09-11T22:20:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 1 client.28589 shutdown 2024-09-11T22:20:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 1 -- 172.21.15.152:0/3969354102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6cacb0 msgr2=0x55685c743a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6cacb0 0x55685c743a50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c004170 tx=0x7f6d4c004ab0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 1 -- 172.21.15.152:0/3969354102 shutdown_connections 2024-09-11T22:20:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55685c745880 0x55685c747ce0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55685c6cacb0 0x55685c743a50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d32ffd640 0 client.28589 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55685c6c0410 0x55685c6e0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 1 --2- 172.21.15.152:0/3969354102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55685c6bfaf0 0x55685c6dfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 1 -- 172.21.15.152:0/3969354102 >> 172.21.15.152:0/3969354102 conn(0x55685c6bc060 msgr2=0x55685c6ba9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 1 -- 172.21.15.152:0/3969354102 shutdown_connections 2024-09-11T22:20:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 1 -- 172.21.15.152:0/3969354102 wait complete. 2024-09-11T22:20:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.000+0000 7f6d5c800740 20 client.28589 trim_cache size 0 max 16384 2024-09-11T22:20:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:20:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:20:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:20:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:20:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 -- 172.21.15.152:0/2151450529 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6d3c0a2fc0 msgr2=0x7f6d3c0a5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6d3c0a2fc0 0x7f6d3c0a5480 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c005fd0 tx=0x7f6d4c009500 comp rx=0 tx=0).stop 2024-09-11T22:20:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 -- 172.21.15.152:0/2151450529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d54109b50 msgr2=0x7f6d541a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d54109b50 0x7f6d541a4d20 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800a340 tx=0x7f6d48004270 comp rx=0 tx=0).stop 2024-09-11T22:20:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 -- 172.21.15.152:0/2151450529 shutdown_connections 2024-09-11T22:20:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f6d3c0a2fc0 0x7f6d3c0a5480 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d5410eaf0 0x7f6d5419e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d54109b50 0x7f6d541a4d20 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 --2- 172.21.15.152:0/2151450529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d541091f0 0x7f6d541a47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 -- 172.21.15.152:0/2151450529 >> 172.21.15.152:0/2151450529 conn(0x7f6d5406ce00 msgr2=0x7f6d5410b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 -- 172.21.15.152:0/2151450529 shutdown_connections 2024-09-11T22:20:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:17.001+0000 7f6d59a65640 1 -- 172.21.15.152:0/2151450529 wait complete. 2024-09-11T22:20:18.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:17 smithi179 ceph-mon[35603]: pgmap v503: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.6 MiB/s wr, 677 op/s 2024-09-11T22:20:18.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:17 smithi193 ceph-mon[35545]: pgmap v503: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.6 MiB/s wr, 677 op/s 2024-09-11T22:20:18.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:17 smithi152 ceph-mon[31188]: pgmap v503: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.6 MiB/s wr, 677 op/s 2024-09-11T22:20:19.821 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 885.0 s, 1934.2 tps, lat 52.054 ms stddev 57.468 2024-09-11T22:20:20.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:19 smithi179 ceph-mon[35603]: pgmap v504: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 MiB/s wr, 650 op/s 2024-09-11T22:20:20.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:19 smithi193 ceph-mon[35545]: pgmap v504: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 MiB/s wr, 650 op/s 2024-09-11T22:20:20.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:19 smithi152 ceph-mon[31188]: pgmap v504: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 MiB/s wr, 650 op/s 2024-09-11T22:20:22.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:21 smithi179 ceph-mon[35603]: pgmap v505: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 708 op/s 2024-09-11T22:20:22.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:21 smithi193 ceph-mon[35545]: pgmap v505: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 708 op/s 2024-09-11T22:20:22.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:21 smithi152 ceph-mon[31188]: pgmap v505: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 708 op/s 2024-09-11T22:20:24.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:23 smithi179 ceph-mon[35603]: pgmap v506: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.5 MiB/s wr, 606 op/s 2024-09-11T22:20:24.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:23 smithi193 ceph-mon[35545]: pgmap v506: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.5 MiB/s wr, 606 op/s 2024-09-11T22:20:24.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:23 smithi152 ceph-mon[31188]: pgmap v506: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.5 MiB/s wr, 606 op/s 2024-09-11T22:20:24.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 890.0 s, 2173.4 tps, lat 45.760 ms stddev 55.105 2024-09-11T22:20:26.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:25 smithi179 ceph-mon[35603]: pgmap v507: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 703 op/s 2024-09-11T22:20:26.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:25 smithi193 ceph-mon[35545]: pgmap v507: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 703 op/s 2024-09-11T22:20:26.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:25 smithi152 ceph-mon[31188]: pgmap v507: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 703 op/s 2024-09-11T22:20:28.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:27 smithi179 ceph-mon[35603]: pgmap v508: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 558 op/s 2024-09-11T22:20:28.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:27 smithi193 ceph-mon[35545]: pgmap v508: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 558 op/s 2024-09-11T22:20:28.142 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:27 smithi152 ceph-mon[31188]: pgmap v508: 97 pgs: 97 active+clean; 4.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 558 op/s 2024-09-11T22:20:29.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 895.0 s, 1695.2 tps, lat 59.073 ms stddev 64.097 2024-09-11T22:20:30.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:29 smithi179 ceph-mon[35603]: pgmap v509: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.9 MiB/s wr, 734 op/s 2024-09-11T22:20:30.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:29 smithi193 ceph-mon[35545]: pgmap v509: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.9 MiB/s wr, 734 op/s 2024-09-11T22:20:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.129+0000 7f110380e640 1 -- 172.21.15.152:0/685108767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10fc1009d0 msgr2=0x7f10fc100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.129+0000 7f110380e640 1 --2- 172.21.15.152:0/685108767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10fc1009d0 0x7f10fc100e30 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009930 tx=0x7f10ec02a420 comp rx=0 tx=0).stop 2024-09-11T22:20:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.130+0000 7f110380e640 1 -- 172.21.15.152:0/685108767 shutdown_connections 2024-09-11T22:20:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.130+0000 7f110380e640 1 --2- 172.21.15.152:0/685108767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10fc101370 0x7f10fc10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.130+0000 7f110380e640 1 --2- 172.21.15.152:0/685108767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10fc1009d0 0x7f10fc100e30 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.130+0000 7f110380e640 1 --2- 172.21.15.152:0/685108767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10fc1069e0 0x7f10fc106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.130+0000 7f110380e640 1 -- 172.21.15.152:0/685108767 >> 172.21.15.152:0/685108767 conn(0x7f10fc0fc6b0 msgr2=0x7f10fc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.130+0000 7f110380e640 1 -- 172.21.15.152:0/685108767 shutdown_connections 2024-09-11T22:20:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.130+0000 7f110380e640 1 -- 172.21.15.152:0/685108767 wait complete. 2024-09-11T22:20:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.131+0000 7f110380e640 1 Processor -- start 2024-09-11T22:20:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.131+0000 7f110380e640 1 -- start start 2024-09-11T22:20:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.131+0000 7f110380e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10fc1009d0 0x7f10fc109b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.131+0000 7f110380e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10fc101370 0x7f10fc10a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.131+0000 7f110380e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10fc1069e0 0x7f10fc10a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.131+0000 7f110380e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc10fd30 con 0x7f10fc1069e0 2024-09-11T22:20:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.131+0000 7f110380e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc10fbb0 con 0x7f10fc101370 2024-09-11T22:20:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.131+0000 7f110380e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc10feb0 con 0x7f10fc1009d0 2024-09-11T22:20:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.132+0000 7f1101dab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10fc1069e0 0x7f10fc10a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.132+0000 7f1100da9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10fc101370 0x7f10fc10a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.132+0000 7f1101dab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10fc1069e0 0x7f10fc10a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43792/0 (socket says 172.21.15.152:43792) 2024-09-11T22:20:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.132+0000 7f1101dab640 1 -- 172.21.15.152:0/250109487 learned_addr learned my addr 172.21.15.152:0/250109487 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.132+0000 7f11015aa640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10fc1009d0 0x7f10fc109b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.132+0000 7f1100da9640 1 -- 172.21.15.152:0/250109487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10fc1009d0 msgr2=0x7f10fc109b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.132+0000 7f1100da9640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10fc1009d0 0x7f10fc109b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.132+0000 7f1100da9640 1 -- 172.21.15.152:0/250109487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10fc1069e0 msgr2=0x7f10fc10a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.132+0000 7f1100da9640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10fc1069e0 0x7f10fc10a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.132+0000 7f1100da9640 1 -- 172.21.15.152:0/250109487 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc06bd40 con 0x7f10fc101370 2024-09-11T22:20:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.132+0000 7f1100da9640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10fc101370 0x7f10fc10a0a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f10ec005940 tx=0x7f10ec0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.133+0000 7f10f27fc640 1 -- 172.21.15.152:0/250109487 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec03f070 con 0x7f10fc101370 2024-09-11T22:20:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.133+0000 7f110380e640 1 -- 172.21.15.152:0/250109487 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10fc06bfd0 con 0x7f10fc101370 2024-09-11T22:20:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.133+0000 7f110380e640 1 -- 172.21.15.152:0/250109487 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10fc06c510 con 0x7f10fc101370 2024-09-11T22:20:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.133+0000 7f10f27fc640 1 -- 172.21.15.152:0/250109487 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10ec03b460 con 0x7f10fc101370 2024-09-11T22:20:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.133+0000 7f10f27fc640 1 -- 172.21.15.152:0/250109487 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec035070 con 0x7f10fc101370 2024-09-11T22:20:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.136+0000 7f1106684740 1 Processor -- start 2024-09-11T22:20:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.136+0000 7f1106684740 1 -- start start 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f1106684740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e6aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f1106684740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 0x55f8b0e75770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f1106684740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e780a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f1106684740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f8b0dcf2f0 con 0x55f8b0e6b410 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f10f27fc640 1 -- 172.21.15.152:0/250109487 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f10ec003a00 con 0x7f10fc101370 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f1106684740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f8b0d77270 con 0x55f8b0e75cb0 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f1106684740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f8b0dcb2b0 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f1101dab640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e6aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f1101dab640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e6aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:52380/0 (socket says 172.21.15.152:52380) 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f1101dab640 1 -- 172.21.15.152:0/4057570266 learned_addr learned my addr 172.21.15.152:0/4057570266 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f1100da9640 1 --2- 172.21.15.152:0/4057570266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e780a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f11015aa640 1 --2- 172.21.15.152:0/4057570266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 0x55f8b0e75770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.137+0000 7f10f27fc640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10e80a2ea0 0x7f10e80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f1101dab640 1 -- 172.21.15.152:0/4057570266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 msgr2=0x55f8b0e780a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f1101dab640 1 --2- 172.21.15.152:0/4057570266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e780a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f1101dab640 1 -- 172.21.15.152:0/4057570266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 msgr2=0x55f8b0e75770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f1101dab640 1 --2- 172.21.15.152:0/4057570266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 0x55f8b0e75770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f1101dab640 1 -- 172.21.15.152:0/4057570266 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b0d76340 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f10f27fc640 1 -- 172.21.15.152:0/250109487 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f10ec0ef9e0 con 0x7f10fc101370 2024-09-11T22:20:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f1101dab640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10e80a2ea0 0x7f10e80a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f11015aa640 1 --2- 172.21.15.152:0/4057570266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 0x55f8b0e75770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f1101dab640 1 --2- 172.21.15.152:0/4057570266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e6aed0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f10f400e240 tx=0x7f10f400e700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7434bc9a93c3539a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f1101dab640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10e80a2ea0 0x7f10e80a5360 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f10f4020000 tx=0x7f10f401d000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f10e77fe640 1 -- 172.21.15.152:0/4057570266 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f40208f0 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f10e77fe640 1 -- 172.21.15.152:0/4057570266 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10f401e400 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.138+0000 7f10e77fe640 1 -- 172.21.15.152:0/4057570266 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4015540 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.139+0000 7f1106684740 1 -- 172.21.15.152:0/4057570266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6aaf0 msgr2=0x55f8b0e6aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.139+0000 7f1106684740 1 --2- 172.21.15.152:0/4057570266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e6aed0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f10f400e240 tx=0x7f10f400e700 comp rx=0 tx=0).stop 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.139+0000 7f1106684740 1 -- 172.21.15.152:0/4057570266 shutdown_connections 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.139+0000 7f1106684740 1 --2- 172.21.15.152:0/4057570266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e780a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.139+0000 7f1106684740 1 --2- 172.21.15.152:0/4057570266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 0x55f8b0e75770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.139+0000 7f1106684740 1 --2- 172.21.15.152:0/4057570266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e6aed0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.139+0000 7f1106684740 1 -- 172.21.15.152:0/4057570266 >> 172.21.15.152:0/4057570266 conn(0x55f8b0e67060 msgr2=0x55f8b0e67440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.139+0000 7f1106684740 1 -- 172.21.15.152:0/4057570266 shutdown_connections 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.139+0000 7f1106684740 1 -- 172.21.15.152:0/4057570266 wait complete. 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.140+0000 7f1106684740 1 -- start start 2024-09-11T22:20:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.140+0000 7f1106684740 1 Processor -- start 2024-09-11T22:20:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.140+0000 7f1106684740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e72af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.140+0000 7f1106684740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 0x55f8b0e73030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.140+0000 7f1106684740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e73570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.140+0000 7f1106684740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f8b0e78880 con 0x55f8b0e6b410 2024-09-11T22:20:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.140+0000 7f1106684740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f8b0d58290 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.140+0000 7f1106684740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f8b0e78a00 con 0x55f8b0e75cb0 2024-09-11T22:20:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f1106684740 10 client.0 _ll_register_callbacks cb 0x55f8b0d89140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f11015aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e72af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f11015aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e72af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:59464/0 (socket says 172.21.15.152:59464) 2024-09-11T22:20:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f11015aa640 1 -- 172.21.15.152:0/1794945965 learned_addr learned my addr 172.21.15.152:0/1794945965 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f1100da9640 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 0x55f8b0e73030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f1101dab640 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e73570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f11015aa640 1 -- 172.21.15.152:0/1794945965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e75cb0 msgr2=0x55f8b0e73570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f11015aa640 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e73570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f11015aa640 1 -- 172.21.15.152:0/1794945965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 msgr2=0x55f8b0e73030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f11015aa640 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 0x55f8b0e73030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.147 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f11015aa640 1 -- 172.21.15.152:0/1794945965 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b0ae2210 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f1100da9640 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 0x55f8b0e73030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f11015aa640 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e72af0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f10f8012820 tx=0x7f10f8012c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b186274cf6e6868b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.141+0000 7f10e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1794945965 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8010d60 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1794945965 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f10f8004020 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f1106684740 1 -- 172.21.15.152:0/1794945965 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10f401e400 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1794945965 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f10f8004220 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f1106684740 10 client.28598 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f1106684740 1 -- 172.21.15.152:0/1794945965 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f8b0bae620 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1794945965 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10f401e400 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1794945965 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f10f801a5c0 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f1106684740 10 client.28598 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:30.148 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f1106684740 10 client.28598 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f1106684740 20 client.28598 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f1106684740 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8b0e85ca0 0x55f8b0e88090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f1106684740 4 client.28598 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.142+0000 7f1106684740 1 -- 172.21.15.152:0/1794945965 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8b0ddca20 con 0x55f8b0e85ca0 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.143+0000 7f1100da9640 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8b0e85ca0 0x55f8b0e88090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.143+0000 7f10e4ff9640 10 client.28598 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.143+0000 7f1100da9640 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8b0e85ca0 0x55f8b0e88090 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=667fac60761ee6c7 server_cookie=d9bfc17e917519e9 in_seq=0 out_seq=0 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1794945965 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8b0ddca20 con 0x55f8b0e85ca0 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f10e4ff9640 10 client.28598 handle_command_reply: tid=0 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 1 client.28598 shutdown 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 1 -- 172.21.15.152:0/1794945965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e6aaf0 msgr2=0x55f8b0e72af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e72af0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f10f8012820 tx=0x7f10f8012c20 comp rx=0 tx=0).stop 2024-09-11T22:20:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 1 -- 172.21.15.152:0/1794945965 shutdown_connections 2024-09-11T22:20:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8b0e85ca0 0x55f8b0e88090 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f10e4ff9640 0 client.28598 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e73570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6b410 0x55f8b0e73030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 1 --2- 172.21.15.152:0/1794945965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e72af0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 1 -- 172.21.15.152:0/1794945965 >> 172.21.15.152:0/1794945965 conn(0x55f8b0e67060 msgr2=0x55f8b0e6cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 1 -- 172.21.15.152:0/1794945965 shutdown_connections 2024-09-11T22:20:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 1 -- 172.21.15.152:0/1794945965 wait complete. 2024-09-11T22:20:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.144+0000 7f1106684740 20 client.28598 trim_cache size 0 max 16384 2024-09-11T22:20:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.165+0000 7f1106684740 1 Processor -- start 2024-09-11T22:20:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f1106684740 1 -- start start 2024-09-11T22:20:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f1106684740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e6d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f1106684740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6b410 0x55f8b0e733a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f1106684740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e8d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f1106684740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f10e0011170 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f11015aa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e6d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f11015aa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e6d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43820/0 (socket says 172.21.15.152:43820) 2024-09-11T22:20:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f11015aa640 1 -- 172.21.15.152:0/1328065875 learned_addr learned my addr 172.21.15.152:0/1328065875 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f1100da9640 1 --2- 172.21.15.152:0/1328065875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6b410 0x55f8b0e733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f1106684740 1 -- 172.21.15.152:0/1328065875 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10e000ea40 con 0x55f8b0e75cb0 2024-09-11T22:20:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f1101dab640 1 --2- 172.21.15.152:0/1328065875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e8d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.166+0000 7f1106684740 1 -- 172.21.15.152:0/1328065875 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10e000c8b0 con 0x55f8b0e6b410 2024-09-11T22:20:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.167+0000 7f1101dab640 1 -- 172.21.15.152:0/1328065875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6b410 msgr2=0x55f8b0e733a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.167+0000 7f1101dab640 1 --2- 172.21.15.152:0/1328065875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6b410 0x55f8b0e733a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.167+0000 7f1101dab640 1 -- 172.21.15.152:0/1328065875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 msgr2=0x55f8b0e6d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.167+0000 7f1101dab640 1 --2- 172.21.15.152:0/1328065875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e6d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.167+0000 7f1101dab640 1 -- 172.21.15.152:0/1328065875 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b0e66e90 con 0x55f8b0e75cb0 2024-09-11T22:20:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.167+0000 7f1101dab640 1 --2- 172.21.15.152:0/1328065875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e8d9a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f10f400e240 tx=0x7f10f4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee6565cfcc6ca4cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.167+0000 7f10e6ffd640 1 -- 172.21.15.152:0/1328065875 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4015540 con 0x55f8b0e75cb0 2024-09-11T22:20:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.167+0000 7f10e6ffd640 1 -- 172.21.15.152:0/1328065875 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10f4009d70 con 0x55f8b0e75cb0 2024-09-11T22:20:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.167+0000 7f10e6ffd640 1 -- 172.21.15.152:0/1328065875 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4029460 con 0x55f8b0e75cb0 2024-09-11T22:20:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.168+0000 7f1106684740 1 -- 172.21.15.152:0/1328065875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 msgr2=0x55f8b0e8d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.168+0000 7f1106684740 1 --2- 172.21.15.152:0/1328065875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e8d9a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f10f400e240 tx=0x7f10f4004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.169+0000 7f1106684740 1 -- 172.21.15.152:0/1328065875 shutdown_connections 2024-09-11T22:20:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.169+0000 7f1106684740 1 --2- 172.21.15.152:0/1328065875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e8d9a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.169+0000 7f1106684740 1 --2- 172.21.15.152:0/1328065875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6b410 0x55f8b0e733a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.169+0000 7f1106684740 1 --2- 172.21.15.152:0/1328065875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e6d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.169+0000 7f1106684740 1 -- 172.21.15.152:0/1328065875 >> 172.21.15.152:0/1328065875 conn(0x55f8b0e67060 msgr2=0x55f8b0e74b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.169+0000 7f1106684740 1 -- 172.21.15.152:0/1328065875 shutdown_connections 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.169+0000 7f1106684740 1 -- 172.21.15.152:0/1328065875 wait complete. 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.169+0000 7f1106684740 1 -- start start 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.170+0000 7f1106684740 1 Processor -- start 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.170+0000 7f1106684740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e7e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.170+0000 7f1106684740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6b410 0x55f8b0e796e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.170+0000 7f1106684740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e79c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.170+0000 7f1106684740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f10e000cf00 con 0x55f8b0e6aaf0 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.170+0000 7f1106684740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10e000e370 con 0x55f8b0e75cb0 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.170+0000 7f1106684740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10e000d5d0 con 0x55f8b0e6b410 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.170+0000 7f1106684740 10 client.0 _ll_register_callbacks cb 0x7f10f800a650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.170+0000 7f1101dab640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e79c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f1101dab640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e79c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:59470/0 (socket says 172.21.15.152:59470) 2024-09-11T22:20:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f1101dab640 1 -- 172.21.15.152:0/1759971310 learned_addr learned my addr 172.21.15.152:0/1759971310 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f11015aa640 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e7e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f1100da9640 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6b410 0x55f8b0e796e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f1101dab640 1 -- 172.21.15.152:0/1759971310 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6b410 msgr2=0x55f8b0e796e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f1101dab640 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6b410 0x55f8b0e796e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f1101dab640 1 -- 172.21.15.152:0/1759971310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 msgr2=0x55f8b0e7e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f1101dab640 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e7e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f1101dab640 1 -- 172.21.15.152:0/1759971310 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b0e622d0 con 0x55f8b0e75cb0 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f1100da9640 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6b410 0x55f8b0e796e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f11015aa640 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e7e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f1101dab640 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e79c20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f10f401ed80 tx=0x7f10f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc01bfbf5da3cd9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.171+0000 7f10e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.172+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1759971310 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4015540 con 0x55f8b0e75cb0 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.172+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1759971310 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f10f4020a70 con 0x55f8b0e75cb0 2024-09-11T22:20:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.172+0000 7f1106684740 1 -- 172.21.15.152:0/1759971310 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10f4009d70 con 0x55f8b0e75cb0 2024-09-11T22:20:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.173+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1759971310 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f10f4020c70 con 0x55f8b0e75cb0 2024-09-11T22:20:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.173+0000 7f1106684740 10 client.28604 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.173+0000 7f1106684740 1 -- 172.21.15.152:0/1759971310 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f8b0e68110 con 0x55f8b0e75cb0 2024-09-11T22:20:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.173+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1759971310 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10f4042030 con 0x55f8b0e75cb0 2024-09-11T22:20:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.174+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1759971310 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f10f4029460 con 0x55f8b0e75cb0 2024-09-11T22:20:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.174+0000 7f1106684740 10 client.28604 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.174+0000 7f1106684740 10 client.28604 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.175+0000 7f1106684740 20 client.28604 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.175+0000 7f1106684740 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8b0e85ca0 0x55f8b0ef2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.175+0000 7f1106684740 4 client.28604 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:20:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.175+0000 7f1106684740 1 -- 172.21.15.152:0/1759971310 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f10f4009d70 con 0x55f8b0e85ca0 2024-09-11T22:20:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.175+0000 7f11015aa640 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8b0e85ca0 0x55f8b0ef2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.176+0000 7f11015aa640 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8b0e85ca0 0x55f8b0ef2a10 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea1260069076d79d server_cookie=331829cba25fef08 in_seq=0 out_seq=0 2024-09-11T22:20:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.176+0000 7f10e4ff9640 10 client.28604 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f10e4ff9640 1 -- 172.21.15.152:0/1759971310 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f10f4009d70 con 0x55f8b0e85ca0 2024-09-11T22:20:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f10e4ff9640 10 client.28604 handle_command_reply: tid=0 2024-09-11T22:20:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f1106684740 1 client.28604 shutdown 2024-09-11T22:20:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f1106684740 1 -- 172.21.15.152:0/1759971310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 msgr2=0x55f8b0e79c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f1106684740 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e79c20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f10f401ed80 tx=0x7f10f4009b50 comp rx=0 tx=0).stop 2024-09-11T22:20:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f1106684740 1 -- 172.21.15.152:0/1759971310 shutdown_connections 2024-09-11T22:20:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f1106684740 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55f8b0e85ca0 0x55f8b0ef2a10 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f1106684740 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8b0e75cb0 0x55f8b0e79c20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f1106684740 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8b0e6b410 0x55f8b0e796e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f1106684740 1 --2- 172.21.15.152:0/1759971310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8b0e6aaf0 0x55f8b0e7e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f1106684740 1 -- 172.21.15.152:0/1759971310 >> 172.21.15.152:0/1759971310 conn(0x55f8b0e67060 msgr2=0x55f8b0e659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f10e4ff9640 0 client.28604 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f1106684740 1 -- 172.21.15.152:0/1759971310 shutdown_connections 2024-09-11T22:20:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.184+0000 7f1106684740 1 -- 172.21.15.152:0/1759971310 wait complete. 2024-09-11T22:20:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.185+0000 7f1106684740 20 client.28604 trim_cache size 0 max 16384 2024-09-11T22:20:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:20:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:20:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:20:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:20:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.185+0000 7f110380e640 1 -- 172.21.15.152:0/250109487 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10e80a2ea0 msgr2=0x7f10e80a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.185+0000 7f110380e640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10e80a2ea0 0x7f10e80a5360 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f10f4020000 tx=0x7f10f401d000 comp rx=0 tx=0).stop 2024-09-11T22:20:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.185+0000 7f110380e640 1 -- 172.21.15.152:0/250109487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10fc101370 msgr2=0x7f10fc10a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.185+0000 7f110380e640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10fc101370 0x7f10fc10a0a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f10ec005940 tx=0x7f10ec0042f0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.185+0000 7f110380e640 1 -- 172.21.15.152:0/250109487 shutdown_connections 2024-09-11T22:20:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.186+0000 7f110380e640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f10e80a2ea0 0x7f10e80a5360 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.186+0000 7f110380e640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10fc1069e0 0x7f10fc10a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.186+0000 7f110380e640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10fc101370 0x7f10fc10a0a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.186+0000 7f110380e640 1 --2- 172.21.15.152:0/250109487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10fc1009d0 0x7f10fc109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.186+0000 7f110380e640 1 -- 172.21.15.152:0/250109487 >> 172.21.15.152:0/250109487 conn(0x7f10fc0fc6b0 msgr2=0x7f10fc0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.186+0000 7f110380e640 1 -- 172.21.15.152:0/250109487 shutdown_connections 2024-09-11T22:20:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:30.186+0000 7f110380e640 1 -- 172.21.15.152:0/250109487 wait complete. 2024-09-11T22:20:30.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:29 smithi152 ceph-mon[31188]: pgmap v509: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.9 MiB/s wr, 734 op/s 2024-09-11T22:20:32.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:31 smithi179 ceph-mon[35603]: pgmap v510: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.5 MiB/s wr, 682 op/s 2024-09-11T22:20:32.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:31 smithi193 ceph-mon[35545]: pgmap v510: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.5 MiB/s wr, 682 op/s 2024-09-11T22:20:32.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:31 smithi152 ceph-mon[31188]: pgmap v510: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.5 MiB/s wr, 682 op/s 2024-09-11T22:20:34.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:33 smithi179 ceph-mon[35603]: pgmap v511: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.3 MiB/s wr, 572 op/s 2024-09-11T22:20:34.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:33 smithi193 ceph-mon[35545]: pgmap v511: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.3 MiB/s wr, 572 op/s 2024-09-11T22:20:34.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:33 smithi152 ceph-mon[31188]: pgmap v511: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.3 MiB/s wr, 572 op/s 2024-09-11T22:20:34.818 INFO:teuthology.orchestra.run.smithi152.stderr:progress: 900.0 s, 1881.4 tps, lat 53.487 ms stddev 62.375 2024-09-11T22:20:34.945 INFO:teuthology.orchestra.run.smithi152.stdout:transaction type: 2024-09-11T22:20:34.946 INFO:teuthology.orchestra.run.smithi152.stdout:scaling factor: 32 2024-09-11T22:20:34.946 INFO:teuthology.orchestra.run.smithi152.stdout:query mode: simple 2024-09-11T22:20:34.946 INFO:teuthology.orchestra.run.smithi152.stdout:number of clients: 100 2024-09-11T22:20:34.946 INFO:teuthology.orchestra.run.smithi152.stdout:number of threads: 4 2024-09-11T22:20:34.946 INFO:teuthology.orchestra.run.smithi152.stdout:duration: 900 s 2024-09-11T22:20:34.946 INFO:teuthology.orchestra.run.smithi152.stdout:number of transactions actually processed: 1984983 2024-09-11T22:20:34.946 INFO:teuthology.orchestra.run.smithi152.stdout:latency average = 45.336 ms 2024-09-11T22:20:34.946 INFO:teuthology.orchestra.run.smithi152.stdout:latency stddev = 552.500 ms 2024-09-11T22:20:34.947 INFO:teuthology.orchestra.run.smithi152.stdout:tps = 2205.223935 (including connections establishing) 2024-09-11T22:20:34.947 INFO:teuthology.orchestra.run.smithi152.stdout:tps = 2205.230015 (excluding connections establishing) 2024-09-11T22:20:34.949 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-11T22:20:36.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:35 smithi179 ceph-mon[35603]: pgmap v512: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.3 MiB/s wr, 845 op/s 2024-09-11T22:20:36.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:35 smithi193 ceph-mon[35545]: pgmap v512: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.3 MiB/s wr, 845 op/s 2024-09-11T22:20:36.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:35 smithi152 ceph-mon[31188]: pgmap v512: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.3 MiB/s wr, 845 op/s 2024-09-11T22:20:38.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:37 smithi179 ceph-mon[35603]: pgmap v513: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.9 MiB/s wr, 588 op/s 2024-09-11T22:20:38.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:37 smithi193 ceph-mon[35545]: pgmap v513: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.9 MiB/s wr, 588 op/s 2024-09-11T22:20:38.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:37 smithi152 ceph-mon[31188]: pgmap v513: 97 pgs: 97 active+clean; 4.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.9 MiB/s wr, 588 op/s 2024-09-11T22:20:38.711 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:20:39.137 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:39.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.737+0000 7fa78746e640 1 -- 172.21.15.152:0/4089626123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa780116ea0 msgr2=0x7fa780119290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.737+0000 7fa78746e640 1 --2- 172.21.15.152:0/4089626123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa780116ea0 0x7fa780119290 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa778009be0 tx=0x7fa778032ed0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.739+0000 7fa78746e640 1 -- 172.21.15.152:0/4089626123 shutdown_connections 2024-09-11T22:20:39.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.739+0000 7fa78746e640 1 --2- 172.21.15.152:0/4089626123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa780116ea0 0x7fa780119290 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.739+0000 7fa78746e640 1 --2- 172.21.15.152:0/4089626123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa780109b10 0x7fa780116960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.739+0000 7fa78746e640 1 --2- 172.21.15.152:0/4089626123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7801091f0 0x7fa7801095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.739+0000 7fa78746e640 1 -- 172.21.15.152:0/4089626123 >> 172.21.15.152:0/4089626123 conn(0x7fa78006e2d0 msgr2=0x7fa78006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:39.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.739+0000 7fa78746e640 1 -- 172.21.15.152:0/4089626123 shutdown_connections 2024-09-11T22:20:39.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.739+0000 7fa78746e640 1 -- 172.21.15.152:0/4089626123 wait complete. 2024-09-11T22:20:39.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.740+0000 7fa78746e640 1 Processor -- start 2024-09-11T22:20:39.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.740+0000 7fa78746e640 1 -- start start 2024-09-11T22:20:39.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.740+0000 7fa78746e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7801091f0 0x7fa7801a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa78746e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa780109b10 0x7fa7801a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa78746e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa780116ea0 0x7fa78019ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa78746e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa78010eea0 con 0x7fa780116ea0 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa78746e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa78010ed20 con 0x7fa780109b10 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa78746e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa78010f020 con 0x7fa7801091f0 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa784a09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa780109b10 0x7fa7801a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa784a09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa780109b10 0x7fa7801a4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:48874/0 (socket says 172.21.15.152:48874) 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa784a09640 1 -- 172.21.15.152:0/2704488767 learned_addr learned my addr 172.21.15.152:0/2704488767 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa78520a640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7801091f0 0x7fa7801a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa785a0b640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa780116ea0 0x7fa78019ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa784a09640 1 -- 172.21.15.152:0/2704488767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7801091f0 msgr2=0x7fa7801a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa784a09640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7801091f0 0x7fa7801a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa784a09640 1 -- 172.21.15.152:0/2704488767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa780116ea0 msgr2=0x7fa78019ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa784a09640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa780116ea0 0x7fa78019ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.741+0000 7fa784a09640 1 -- 172.21.15.152:0/2704488767 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78019f610 con 0x7fa780109b10 2024-09-11T22:20:39.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.742+0000 7fa784a09640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa780109b10 0x7fa7801a4cb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa77000e9c0 tx=0x7fa77000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.744+0000 7fa7767fc640 1 -- 172.21.15.152:0/2704488767 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77000ccc0 con 0x7fa780109b10 2024-09-11T22:20:39.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.744+0000 7fa78746e640 1 -- 172.21.15.152:0/2704488767 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78019f900 con 0x7fa780109b10 2024-09-11T22:20:39.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.744+0000 7fa7767fc640 1 -- 172.21.15.152:0/2704488767 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa770005500 con 0x7fa780109b10 2024-09-11T22:20:39.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.744+0000 7fa78746e640 1 -- 172.21.15.152:0/2704488767 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7801ab6f0 con 0x7fa780109b10 2024-09-11T22:20:39.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.744+0000 7fa7767fc640 1 -- 172.21.15.152:0/2704488767 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770010430 con 0x7fa780109b10 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.748+0000 7fa7767fc640 1 -- 172.21.15.152:0/2704488767 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa7700105d0 con 0x7fa780109b10 2024-09-11T22:20:39.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.748+0000 7fa789847740 1 Processor -- start 2024-09-11T22:20:39.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.748+0000 7fa789847740 1 -- start start 2024-09-11T22:20:39.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.749+0000 7fa789847740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac144a0 0x55c9cac14880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.749+0000 7fa789847740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac14dc0 0x55c9cac1f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.749+0000 7fa789847740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac21a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.749+0000 7fa789847740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c9cab7a2e0 con 0x55c9cac144a0 2024-09-11T22:20:39.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.749+0000 7fa789847740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c9cab21ce0 con 0x55c9cac1f680 2024-09-11T22:20:39.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.749+0000 7fa789847740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c9cab762a0 con 0x55c9cac14dc0 2024-09-11T22:20:39.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.749+0000 7fa785a0b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac144a0 0x55c9cac14880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.749+0000 7fa784a09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac21a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.749+0000 7fa785a0b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac144a0 0x55c9cac14880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51016/0 (socket says 172.21.15.152:51016) 2024-09-11T22:20:39.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.749+0000 7fa785a0b640 1 -- 172.21.15.152:0/3457027234 learned_addr learned my addr 172.21.15.152:0/3457027234 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:39.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.750+0000 7fa784a09640 1 -- 172.21.15.152:0/3457027234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac14dc0 msgr2=0x55c9cac1f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:39.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.750+0000 7fa784a09640 1 --2- 172.21.15.152:0/3457027234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac14dc0 0x55c9cac1f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.750+0000 7fa784a09640 1 -- 172.21.15.152:0/3457027234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac144a0 msgr2=0x55c9cac14880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:39.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.750+0000 7fa784a09640 1 --2- 172.21.15.152:0/3457027234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac144a0 0x55c9cac14880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.750+0000 7fa784a09640 1 -- 172.21.15.152:0/3457027234 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9cab06440 con 0x55c9cac1f680 2024-09-11T22:20:39.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.750+0000 7fa784a09640 1 --2- 172.21.15.152:0/3457027234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac21a70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa7700ccd70 tx=0x7fa7700d5b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a373ce988234766f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.750+0000 7fa7767fc640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 0x7fa76c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.750+0000 7fa76b7fe640 1 -- 172.21.15.152:0/3457027234 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7700de070 con 0x55c9cac1f680 2024-09-11T22:20:39.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.750+0000 7fa785a0b640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 0x7fa76c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.751+0000 7fa76b7fe640 1 -- 172.21.15.152:0/3457027234 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa77009c240 con 0x55c9cac1f680 2024-09-11T22:20:39.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.751+0000 7fa76b7fe640 1 -- 172.21.15.152:0/3457027234 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77009b680 con 0x55c9cac1f680 2024-09-11T22:20:39.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.751+0000 7fa7767fc640 1 -- 172.21.15.152:0/2704488767 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7fa7700cf6e0 con 0x7fa780109b10 2024-09-11T22:20:39.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.752+0000 7fa789847740 1 -- 172.21.15.152:0/3457027234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 msgr2=0x55c9cac21a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.752+0000 7fa789847740 1 --2- 172.21.15.152:0/3457027234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac21a70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa7700ccd70 tx=0x7fa7700d5b20 comp rx=0 tx=0).stop 2024-09-11T22:20:39.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.752+0000 7fa785a0b640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 0x7fa76c0a5230 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa7780099a0 tx=0x7fa778004a40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.752+0000 7fa789847740 1 -- 172.21.15.152:0/3457027234 shutdown_connections 2024-09-11T22:20:39.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.752+0000 7fa789847740 1 --2- 172.21.15.152:0/3457027234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac21a70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.752+0000 7fa789847740 1 --2- 172.21.15.152:0/3457027234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac14dc0 0x55c9cac1f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.752+0000 7fa789847740 1 --2- 172.21.15.152:0/3457027234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac144a0 0x55c9cac14880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.752+0000 7fa789847740 1 -- 172.21.15.152:0/3457027234 >> 172.21.15.152:0/3457027234 conn(0x55c9cac10a30 msgr2=0x55c9cac10e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:39.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.752+0000 7fa789847740 1 -- 172.21.15.152:0/3457027234 shutdown_connections 2024-09-11T22:20:39.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.752+0000 7fa789847740 1 -- 172.21.15.152:0/3457027234 wait complete. 2024-09-11T22:20:39.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.753+0000 7fa789847740 1 -- start start 2024-09-11T22:20:39.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.753+0000 7fa789847740 1 Processor -- start 2024-09-11T22:20:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.754+0000 7fa789847740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 0x55c9cac1ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.754+0000 7fa789847740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac1c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.754+0000 7fa78520a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 0x55c9cac1ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.754+0000 7fa78520a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 0x55c9cac1ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:44378/0 (socket says 172.21.15.152:44378) 2024-09-11T22:20:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.754+0000 7fa78520a640 1 -- 172.21.15.152:0/3686710936 learned_addr learned my addr 172.21.15.152:0/3686710936 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.754+0000 7fa789847740 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac1c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.754+0000 7fa789847740 1 -- 172.21.15.152:0/3686710936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c9cac22250 con 0x55c9cac14dc0 2024-09-11T22:20:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.755+0000 7fa789847740 1 -- 172.21.15.152:0/3686710936 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c9cab35050 con 0x55c9cac1f680 2024-09-11T22:20:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.755+0000 7fa789847740 1 -- 172.21.15.152:0/3686710936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c9cac223d0 con 0x55c9cac144a0 2024-09-11T22:20:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.755+0000 7fa784a09640 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac1c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.755+0000 7fa785a0b640 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac1c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.755+0000 7fa78520a640 1 -- 172.21.15.152:0/3686710936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 msgr2=0x55c9cac1c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.755+0000 7fa78520a640 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac1c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.755+0000 7fa78520a640 1 -- 172.21.15.152:0/3686710936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 msgr2=0x55c9cac1c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.755+0000 7fa78520a640 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac1c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.755+0000 7fa78520a640 1 -- 172.21.15.152:0/3686710936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9ca8eb3c0 con 0x55c9cac144a0 2024-09-11T22:20:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.755+0000 7fa78520a640 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 0x55c9cac1ef50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0116c0 tx=0x7fa77c011b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68fe885d995cf778 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.755+0000 7fa768ff9640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:20:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.756+0000 7fa768ff9640 1 -- 172.21.15.152:0/3686710936 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c004460 con 0x55c9cac144a0 2024-09-11T22:20:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.756+0000 7fa768ff9640 1 -- 172.21.15.152:0/3686710936 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7fa77c00f920 con 0x55c9cac144a0 2024-09-11T22:20:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.756+0000 7fa768ff9640 10 client.0 inactive, discarding osd_map(105..105 src has 1..105) 2024-09-11T22:20:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.756+0000 7fa789847740 10 client.0 _ll_register_callbacks cb 0x55c9cab75160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.756+0000 7fa789847740 1 -- 172.21.15.152:0/3686710936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa77009c240 con 0x55c9cac144a0 2024-09-11T22:20:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.757+0000 7fa768ff9640 1 -- 172.21.15.152:0/3686710936 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa77c00fb20 con 0x55c9cac144a0 2024-09-11T22:20:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.757+0000 7fa789847740 10 client.28753 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.757+0000 7fa789847740 1 -- 172.21.15.152:0/3686710936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c9cac2d9e0 con 0x55c9cac144a0 2024-09-11T22:20:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.757+0000 7fa768ff9640 1 -- 172.21.15.152:0/3686710936 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa77c018070 con 0x55c9cac144a0 2024-09-11T22:20:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.757+0000 7fa789847740 10 client.28753 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:39.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.757+0000 7fa789847740 10 client.28753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:39.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.757+0000 7fa789847740 20 client.28753 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:39.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.757+0000 7fa789847740 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c9cac2ede0 0x55c9cac31280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.757+0000 7fa789847740 4 client.28753 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:39.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.757+0000 7fa789847740 1 -- 172.21.15.152:0/3686710936 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa77009c240 con 0x55c9cac2ede0 2024-09-11T22:20:39.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.758+0000 7fa784a09640 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c9cac2ede0 0x55c9cac31280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.758+0000 7fa784a09640 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c9cac2ede0 0x55c9cac31280 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=931f4886892a2cd5 server_cookie=435bc53aee753e19 in_seq=0 out_seq=0 2024-09-11T22:20:39.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.758+0000 7fa768ff9640 10 client.28753 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:39.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.759+0000 7fa768ff9640 1 -- 172.21.15.152:0/3686710936 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa77009c240 con 0x55c9cac2ede0 2024-09-11T22:20:39.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.759+0000 7fa768ff9640 10 client.28753 handle_command_reply: tid=0 2024-09-11T22:20:39.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.759+0000 7fa789847740 1 client.28753 shutdown 2024-09-11T22:20:39.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa789847740 1 -- 172.21.15.152:0/3686710936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 msgr2=0x55c9cac1ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa789847740 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 0x55c9cac1ef50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0116c0 tx=0x7fa77c011b80 comp rx=0 tx=0).stop 2024-09-11T22:20:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa789847740 1 -- 172.21.15.152:0/3686710936 shutdown_connections 2024-09-11T22:20:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa789847740 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c9cac2ede0 0x55c9cac31280 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa789847740 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac1c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa789847740 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac1c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa789847740 1 --2- 172.21.15.152:0/3686710936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 0x55c9cac1ef50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa768ff9640 0 client.28753 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa789847740 1 -- 172.21.15.152:0/3686710936 >> 172.21.15.152:0/3686710936 conn(0x55c9cac10a30 msgr2=0x55c9cac16760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa789847740 1 -- 172.21.15.152:0/3686710936 shutdown_connections 2024-09-11T22:20:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa789847740 1 -- 172.21.15.152:0/3686710936 wait complete. 2024-09-11T22:20:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.760+0000 7fa789847740 20 client.28753 trim_cache size 0 max 16384 2024-09-11T22:20:39.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.786+0000 7fa789847740 1 Processor -- start 2024-09-11T22:20:39.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.786+0000 7fa789847740 1 -- start start 2024-09-11T22:20:39.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa789847740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac144a0 0x55c9cac0f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa789847740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac36b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa789847740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac1f680 0x55c9cac370d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa789847740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa7640110e0 con 0x55c9cac14dc0 2024-09-11T22:20:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa789847740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa76400e9b0 con 0x55c9cac144a0 2024-09-11T22:20:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa789847740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa76400c820 con 0x55c9cac1f680 2024-09-11T22:20:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa784a09640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac36b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa785a0b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac1f680 0x55c9cac370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa785a0b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac1f680 0x55c9cac370d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:44390/0 (socket says 172.21.15.152:44390) 2024-09-11T22:20:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa785a0b640 1 -- 172.21.15.152:0/1318149599 learned_addr learned my addr 172.21.15.152:0/1318149599 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa78520a640 1 --2- 172.21.15.152:0/1318149599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac144a0 0x55c9cac0f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa785a0b640 1 -- 172.21.15.152:0/1318149599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac144a0 msgr2=0x55c9cac0f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa785a0b640 1 --2- 172.21.15.152:0/1318149599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac144a0 0x55c9cac0f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa785a0b640 1 -- 172.21.15.152:0/1318149599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 msgr2=0x55c9cac36b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:39.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa785a0b640 1 --2- 172.21.15.152:0/1318149599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac36b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.787+0000 7fa785a0b640 1 -- 172.21.15.152:0/1318149599 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9cac10860 con 0x55c9cac1f680 2024-09-11T22:20:39.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.788+0000 7fa785a0b640 1 --2- 172.21.15.152:0/1318149599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac1f680 0x55c9cac370d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa77803c000 tx=0x7fa778035050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=963804d996af1900 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.788+0000 7fa76affd640 1 -- 172.21.15.152:0/1318149599 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778033a10 con 0x55c9cac1f680 2024-09-11T22:20:39.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.788+0000 7fa76affd640 1 -- 172.21.15.152:0/1318149599 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa778058070 con 0x55c9cac1f680 2024-09-11T22:20:39.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.788+0000 7fa76affd640 1 -- 172.21.15.152:0/1318149599 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778054690 con 0x55c9cac1f680 2024-09-11T22:20:39.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.789+0000 7fa789847740 1 -- 172.21.15.152:0/1318149599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac1f680 msgr2=0x55c9cac370d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.789+0000 7fa789847740 1 --2- 172.21.15.152:0/1318149599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac1f680 0x55c9cac370d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa77803c000 tx=0x7fa778035050 comp rx=0 tx=0).stop 2024-09-11T22:20:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.790+0000 7fa789847740 1 -- 172.21.15.152:0/1318149599 shutdown_connections 2024-09-11T22:20:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.790+0000 7fa789847740 1 --2- 172.21.15.152:0/1318149599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac1f680 0x55c9cac370d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.790+0000 7fa789847740 1 --2- 172.21.15.152:0/1318149599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac36b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.790+0000 7fa789847740 1 --2- 172.21.15.152:0/1318149599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac144a0 0x55c9cac0f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.790+0000 7fa789847740 1 -- 172.21.15.152:0/1318149599 >> 172.21.15.152:0/1318149599 conn(0x55c9cac10a30 msgr2=0x55c9cac1e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.790+0000 7fa789847740 1 -- 172.21.15.152:0/1318149599 shutdown_connections 2024-09-11T22:20:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.790+0000 7fa789847740 1 -- 172.21.15.152:0/1318149599 wait complete. 2024-09-11T22:20:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.790+0000 7fa789847740 1 -- start start 2024-09-11T22:20:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.790+0000 7fa789847740 1 Processor -- start 2024-09-11T22:20:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.791+0000 7fa789847740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 0x55c9cac27f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.791+0000 7fa789847740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac25330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.791+0000 7fa789847740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac25a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.791+0000 7fa789847740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa76400ce70 con 0x55c9cac14dc0 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.791+0000 7fa789847740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa76400e2e0 con 0x55c9cac1f680 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.791+0000 7fa789847740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa76400d540 con 0x55c9cac144a0 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.791+0000 7fa789847740 10 client.0 _ll_register_callbacks cb 0x7fa77c009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.791+0000 7fa785a0b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac25a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.791+0000 7fa78520a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 0x55c9cac27f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.791+0000 7fa78520a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 0x55c9cac27f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:44406/0 (socket says 172.21.15.152:44406) 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.791+0000 7fa78520a640 1 -- 172.21.15.152:0/4075055587 learned_addr learned my addr 172.21.15.152:0/4075055587 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa784a09640 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac25330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa785a0b640 1 -- 172.21.15.152:0/4075055587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 msgr2=0x55c9cac27f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa785a0b640 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 0x55c9cac27f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa785a0b640 1 -- 172.21.15.152:0/4075055587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 msgr2=0x55c9cac25330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa785a0b640 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac25330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa785a0b640 1 -- 172.21.15.152:0/4075055587 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9cac98b70 con 0x55c9cac1f680 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa784a09640 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac25330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa785a0b640 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac25a70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa778009be0 tx=0x7fa778009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39fa4b1956c880a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa768ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa768ff9640 1 -- 172.21.15.152:0/4075055587 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778064070 con 0x55c9cac1f680 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa768ff9640 1 -- 172.21.15.152:0/4075055587 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7fa778054630 con 0x55c9cac1f680 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.792+0000 7fa789847740 1 -- 172.21.15.152:0/4075055587 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa778058070 con 0x55c9cac1f680 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.793+0000 7fa768ff9640 1 -- 172.21.15.152:0/4075055587 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa778070050 con 0x55c9cac1f680 2024-09-11T22:20:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.793+0000 7fa789847740 10 client.28622 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:39.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.793+0000 7fa789847740 1 -- 172.21.15.152:0/4075055587 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c9cac99d20 con 0x55c9cac1f680 2024-09-11T22:20:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.793+0000 7fa768ff9640 1 -- 172.21.15.152:0/4075055587 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa778058070 con 0x55c9cac1f680 2024-09-11T22:20:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.793+0000 7fa768ff9640 1 -- 172.21.15.152:0/4075055587 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fa77803b9c0 con 0x55c9cac1f680 2024-09-11T22:20:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.793+0000 7fa789847740 10 client.28622 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.793+0000 7fa789847740 10 client.28622 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.793+0000 7fa789847740 20 client.28622 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.794+0000 7fa789847740 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c9cac9a340 0x55c9cac9c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.794+0000 7fa789847740 4 client.28622 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:20:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.794+0000 7fa789847740 1 -- 172.21.15.152:0/4075055587 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c9cab87850 con 0x55c9cac9a340 2024-09-11T22:20:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.794+0000 7fa78520a640 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c9cac9a340 0x55c9cac9c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa78520a640 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c9cac9a340 0x55c9cac9c730 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b019ceb71c4027b9 server_cookie=a273d25aba21d17c in_seq=0 out_seq=0 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa768ff9640 10 client.28622 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa768ff9640 1 -- 172.21.15.152:0/4075055587 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c9cab87850 con 0x55c9cac9a340 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa768ff9640 10 client.28622 handle_command_reply: tid=0 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa789847740 1 client.28622 shutdown 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa789847740 1 -- 172.21.15.152:0/4075055587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 msgr2=0x55c9cac25a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa789847740 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac25a70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa778009be0 tx=0x7fa778009500 comp rx=0 tx=0).stop 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa789847740 1 -- 172.21.15.152:0/4075055587 shutdown_connections 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa789847740 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55c9cac9a340 0x55c9cac9c730 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa789847740 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9cac1f680 0x55c9cac25a70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa789847740 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9cac14dc0 0x55c9cac25330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa789847740 1 --2- 172.21.15.152:0/4075055587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c9cac144a0 0x55c9cac27f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.795+0000 7fa789847740 1 -- 172.21.15.152:0/4075055587 >> 172.21.15.152:0/4075055587 conn(0x55c9cac10a30 msgr2=0x55c9cac1b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:39.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.796+0000 7fa768ff9640 0 client.28622 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:39.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.796+0000 7fa789847740 1 -- 172.21.15.152:0/4075055587 shutdown_connections 2024-09-11T22:20:39.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.796+0000 7fa789847740 1 -- 172.21.15.152:0/4075055587 wait complete. 2024-09-11T22:20:39.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.796+0000 7fa789847740 20 client.28622 trim_cache size 0 max 16384 2024-09-11T22:20:39.801 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:20:39.801 INFO:teuthology.orchestra.run.smithi152.stdout: "status": "no active scrubs running", 2024-09-11T22:20:39.801 INFO:teuthology.orchestra.run.smithi152.stdout: "scrubs": {} 2024-09-11T22:20:39.801 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:20:39.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 -- 172.21.15.152:0/2704488767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 msgr2=0x7fa76c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 0x7fa76c0a5230 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa7780099a0 tx=0x7fa778004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:39.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 -- 172.21.15.152:0/2704488767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa780109b10 msgr2=0x7fa7801a4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa780109b10 0x7fa7801a4cb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa77000e9c0 tx=0x7fa77000ee80 comp rx=0 tx=0).stop 2024-09-11T22:20:39.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 -- 172.21.15.152:0/2704488767 shutdown_connections 2024-09-11T22:20:39.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa76c0a2d70 0x7fa76c0a5230 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa780116ea0 0x7fa78019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa780109b10 0x7fa7801a4cb0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 --2- 172.21.15.152:0/2704488767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7801091f0 0x7fa7801a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 -- 172.21.15.152:0/2704488767 >> 172.21.15.152:0/2704488767 conn(0x7fa78006e2d0 msgr2=0x7fa7801173c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:39.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 -- 172.21.15.152:0/2704488767 shutdown_connections 2024-09-11T22:20:39.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:39.797+0000 7fa78746e640 1 -- 172.21.15.152:0/2704488767 wait complete. 2024-09-11T22:20:39.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:39 smithi152 ceph-mon[31188]: pgmap v514: 97 pgs: 97 active+clean; 4.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 1.04k op/s 2024-09-11T22:20:40.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:39 smithi179 ceph-mon[35603]: pgmap v514: 97 pgs: 97 active+clean; 4.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 1.04k op/s 2024-09-11T22:20:40.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:39 smithi193 ceph-mon[35545]: pgmap v514: 97 pgs: 97 active+clean; 4.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 1.04k op/s 2024-09-11T22:20:40.620 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:20:40.620 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:20:40.904 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:41.384 INFO:tasks.quiescer.fs.[cephfs]:Total duration (48.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T22:20:41.384 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.25 2024-09-11T22:20:41.385 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:20:41.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.443+0000 7f599e7fc640 1 -- 172.21.15.152:0/1626334830 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5998034020 con 0x7f59a0114ab0 2024-09-11T22:20:41.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.444+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1626334830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0114ab0 msgr2=0x7f59a0116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:41.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.444+0000 7f59a5eb1640 1 --2- 172.21.15.152:0/1626334830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0114ab0 0x7f59a0116ea0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5998009ca0 tx=0x7f599802a950 comp rx=0 tx=0).stop 2024-09-11T22:20:41.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.444+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1626334830 shutdown_connections 2024-09-11T22:20:41.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.444+0000 7f59a5eb1640 1 --2- 172.21.15.152:0/1626334830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0114ab0 0x7f59a0116ea0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.444+0000 7f59a5eb1640 1 --2- 172.21.15.152:0/1626334830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a0109b10 0x7f59a0114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.444+0000 7f59a5eb1640 1 --2- 172.21.15.152:0/1626334830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a01091f0 0x7f59a01095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.444+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1626334830 >> 172.21.15.152:0/1626334830 conn(0x7f59a006e140 msgr2=0x7f59a006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:41.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.444+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1626334830 shutdown_connections 2024-09-11T22:20:41.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.444+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1626334830 wait complete. 2024-09-11T22:20:41.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.445+0000 7f59a5eb1640 1 Processor -- start 2024-09-11T22:20:41.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f59a5eb1640 1 -- start start 2024-09-11T22:20:41.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f59a5eb1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a01091f0 0x7f59a0111660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:41.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f59a5eb1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a0109b10 0x7f59a0111ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:41.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f59a5eb1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0114ab0 0x7f59a01120e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:41.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f59a5eb1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59a010bf00 con 0x7f59a0109b10 2024-09-11T22:20:41.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f59a5eb1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f59a010bd80 con 0x7f59a0114ab0 2024-09-11T22:20:41.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f59a5eb1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f59a010c080 con 0x7f59a01091f0 2024-09-11T22:20:41.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a01091f0 0x7f59a0111660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:41.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f599effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a0109b10 0x7f59a0111ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:41.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f599effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a0109b10 0x7f59a0111ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51050/0 (socket says 172.21.15.152:51050) 2024-09-11T22:20:41.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f599effd640 1 -- 172.21.15.152:0/1996982285 learned_addr learned my addr 172.21.15.152:0/1996982285 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:41.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a01091f0 0x7f59a0111660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:44422/0 (socket says 172.21.15.152:44422) 2024-09-11T22:20:41.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.446+0000 7f599ffff640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0114ab0 0x7f59a01120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:41.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.447+0000 7f599ffff640 1 -- 172.21.15.152:0/1996982285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a01091f0 msgr2=0x7f59a0111660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:41.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.447+0000 7f599ffff640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a01091f0 0x7f59a0111660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.447+0000 7f599ffff640 1 -- 172.21.15.152:0/1996982285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a0109b10 msgr2=0x7f59a0111ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:41.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.447+0000 7f599ffff640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a0109b10 0x7f59a0111ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.447+0000 7f599ffff640 1 -- 172.21.15.152:0/1996982285 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a01b3550 con 0x7f59a0114ab0 2024-09-11T22:20:41.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.447+0000 7f599effd640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a0109b10 0x7f59a0111ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:41.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.447+0000 7f599ffff640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0114ab0 0x7f59a01120e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5998006010 tx=0x7f599802f420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:41.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.448+0000 7f599cff9640 1 -- 172.21.15.152:0/1996982285 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5998047070 con 0x7f59a0114ab0 2024-09-11T22:20:41.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.448+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1996982285 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a01b37e0 con 0x7f59a0114ab0 2024-09-11T22:20:41.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.448+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1996982285 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a01b3ce0 con 0x7f59a0114ab0 2024-09-11T22:20:41.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.448+0000 7f599cff9640 1 -- 172.21.15.152:0/1996982285 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5998030920 con 0x7f59a0114ab0 2024-09-11T22:20:41.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.449+0000 7f599cff9640 1 -- 172.21.15.152:0/1996982285 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5998034070 con 0x7f59a0114ab0 2024-09-11T22:20:41.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.451+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1996982285 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f598c005290 con 0x7f59a0114ab0 2024-09-11T22:20:41.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.452+0000 7f599cff9640 1 -- 172.21.15.152:0/1996982285 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f5998037020 con 0x7f59a0114ab0 2024-09-11T22:20:41.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.453+0000 7f599cff9640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59880a2df0 0x7f59880a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:41.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.454+0000 7f599cff9640 1 -- 172.21.15.152:0/1996982285 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f59980ef4f0 con 0x7f59a0114ab0 2024-09-11T22:20:41.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.456+0000 7f599f7fe640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59880a2df0 0x7f59880a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:41.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.457+0000 7f599f7fe640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59880a2df0 0x7f59880a52b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5990009b40 tx=0x7f5990005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:41.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.464+0000 7f599cff9640 1 -- 172.21.15.152:0/1996982285 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f599807e1b0 con 0x7f59a0114ab0 2024-09-11T22:20:41.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:41 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:41.790 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:41.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:41 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:41.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:41 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:41.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.850+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1996982285 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f598c005850 con 0x7f59a0114ab0 2024-09-11T22:20:41.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.851+0000 7f599cff9640 1 -- 172.21.15.152:0/1996982285 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f599803f070 con 0x7f59a0114ab0 2024-09-11T22:20:41.852 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:41.853 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:20:41.853 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:20:41.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.854+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1996982285 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59880a2df0 msgr2=0x7f59880a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:41.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.854+0000 7f59a5eb1640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59880a2df0 0x7f59880a52b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5990009b40 tx=0x7f5990005f90 comp rx=0 tx=0).stop 2024-09-11T22:20:41.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.854+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1996982285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0114ab0 msgr2=0x7f59a01120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:41.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.854+0000 7f59a5eb1640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0114ab0 0x7f59a01120e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5998006010 tx=0x7f599802f420 comp rx=0 tx=0).stop 2024-09-11T22:20:41.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.855+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1996982285 shutdown_connections 2024-09-11T22:20:41.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.855+0000 7f59a5eb1640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f59880a2df0 0x7f59880a52b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.855+0000 7f59a5eb1640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0114ab0 0x7f59a01120e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.855+0000 7f59a5eb1640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a0109b10 0x7f59a0111ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.855+0000 7f59a5eb1640 1 --2- 172.21.15.152:0/1996982285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a01091f0 0x7f59a0111660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.855+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1996982285 >> 172.21.15.152:0/1996982285 conn(0x7f59a006e140 msgr2=0x7f59a00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:41.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.855+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1996982285 shutdown_connections 2024-09-11T22:20:41.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:41.855+0000 7f59a5eb1640 1 -- 172.21.15.152:0/1996982285 wait complete. 2024-09-11T22:20:42.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.417+0000 7f3acd498640 1 -- 172.21.15.152:0/15938510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac8106a80 msgr2=0x7f3ac8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.417+0000 7f3acd498640 1 --2- 172.21.15.152:0/15938510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac8106a80 0x7f3ac8106e60 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009930 tx=0x7f3ab802a420 comp rx=0 tx=0).stop 2024-09-11T22:20:42.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.417+0000 7f3acd498640 1 -- 172.21.15.152:0/15938510 shutdown_connections 2024-09-11T22:20:42.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.417+0000 7f3acd498640 1 --2- 172.21.15.152:0/15938510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac8101420 0x7f3ac810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.417+0000 7f3acd498640 1 --2- 172.21.15.152:0/15938510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ac8100a80 0x7f3ac8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.417+0000 7f3acd498640 1 --2- 172.21.15.152:0/15938510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac8106a80 0x7f3ac8106e60 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.417+0000 7f3acd498640 1 -- 172.21.15.152:0/15938510 >> 172.21.15.152:0/15938510 conn(0x7f3ac80fc780 msgr2=0x7f3ac80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:42.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.417+0000 7f3acd498640 1 -- 172.21.15.152:0/15938510 shutdown_connections 2024-09-11T22:20:42.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.417+0000 7f3acd498640 1 -- 172.21.15.152:0/15938510 wait complete. 2024-09-11T22:20:42.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3acd498640 1 Processor -- start 2024-09-11T22:20:42.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3acd498640 1 -- start start 2024-09-11T22:20:42.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3acd498640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac8100a80 0x7f3ac8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3acd498640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac8101420 0x7f3ac8199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3acd498640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ac8106a80 0x7f3ac81a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3acd498640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac8110e80 con 0x7f3ac8101420 2024-09-11T22:20:42.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3acd498640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac8110d00 con 0x7f3ac8100a80 2024-09-11T22:20:42.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3acd498640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac8111000 con 0x7f3ac8106a80 2024-09-11T22:20:42.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3ac67fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac8101420 0x7f3ac8199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3ac67fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac8101420 0x7f3ac8199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51066/0 (socket says 172.21.15.152:51066) 2024-09-11T22:20:42.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3ac67fc640 1 -- 172.21.15.152:0/3066189052 learned_addr learned my addr 172.21.15.152:0/3066189052 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.418+0000 7f3ac6ffd640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac8100a80 0x7f3ac8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3ac77fe640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ac8106a80 0x7f3ac81a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3ac67fc640 1 -- 172.21.15.152:0/3066189052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ac8106a80 msgr2=0x7f3ac81a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3ac67fc640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ac8106a80 0x7f3ac81a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3ac67fc640 1 -- 172.21.15.152:0/3066189052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac8100a80 msgr2=0x7f3ac8199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3ac67fc640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac8100a80 0x7f3ac8199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3ac67fc640 1 -- 172.21.15.152:0/3066189052 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac81a48f0 con 0x7f3ac8101420 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3ac67fc640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac8101420 0x7f3ac8199870 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00e9f0 tx=0x7f3abc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3aaffff640 1 -- 172.21.15.152:0/3066189052 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc00cd80 con 0x7f3ac8101420 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3acd498640 1 -- 172.21.15.152:0/3066189052 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac81a4ac0 con 0x7f3ac8101420 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3aaffff640 1 -- 172.21.15.152:0/3066189052 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3abc005500 con 0x7f3ac8101420 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3aaffff640 1 -- 172.21.15.152:0/3066189052 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc010690 con 0x7f3ac8101420 2024-09-11T22:20:42.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.419+0000 7f3acd498640 1 -- 172.21.15.152:0/3066189052 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac81a5000 con 0x7f3ac8101420 2024-09-11T22:20:42.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.420+0000 7f3acd498640 1 -- 172.21.15.152:0/3066189052 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac8100ee0 con 0x7f3ac8101420 2024-09-11T22:20:42.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.421+0000 7f3aaffff640 1 -- 172.21.15.152:0/3066189052 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3abc0046c0 con 0x7f3ac8101420 2024-09-11T22:20:42.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.422+0000 7f3aaffff640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ab00a2cf0 0x7f3ab00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.423+0000 7f3ac6ffd640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ab00a2cf0 0x7f3ab00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.423+0000 7f3aaffff640 1 -- 172.21.15.152:0/3066189052 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f3abc0cf880 con 0x7f3ac8101420 2024-09-11T22:20:42.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.423+0000 7f3ac6ffd640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ab00a2cf0 0x7f3ab00a51b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009900 tx=0x7f3ab80058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:42.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.428+0000 7f3aaffff640 1 -- 172.21.15.152:0/3066189052 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3abc09c440 con 0x7f3ac8101420 2024-09-11T22:20:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:42 smithi152 ceph-mon[31188]: pgmap v515: 97 pgs: 97 active+clean; 4.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2024-09-11T22:20:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:42 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1996982285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:20:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:42 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:20:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:42 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:20:42.730 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:42 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:20:42.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:42 smithi179 ceph-mon[35603]: pgmap v515: 97 pgs: 97 active+clean; 4.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2024-09-11T22:20:42.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:42 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1996982285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:20:42.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:42 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:20:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:42 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:20:42.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:42 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:20:42.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.798+0000 7f3acd498640 1 -- 172.21.15.152:0/3066189052 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ac8109020 con 0x7f3ac8101420 2024-09-11T22:20:42.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.800+0000 7f3aaffff640 1 -- 172.21.15.152:0/3066189052 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7f3abc09bd40 con 0x7f3ac8101420 2024-09-11T22:20:42.802 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:42.803 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:20:42.803 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:20:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.809+0000 7f3acd498640 1 -- 172.21.15.152:0/3066189052 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ab00a2cf0 msgr2=0x7f3ab00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.809+0000 7f3acd498640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ab00a2cf0 0x7f3ab00a51b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009900 tx=0x7f3ab80058d0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.809+0000 7f3acd498640 1 -- 172.21.15.152:0/3066189052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac8101420 msgr2=0x7f3ac8199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.809+0000 7f3acd498640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac8101420 0x7f3ac8199870 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00e9f0 tx=0x7f3abc00edf0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.809+0000 7f3acd498640 1 -- 172.21.15.152:0/3066189052 shutdown_connections 2024-09-11T22:20:42.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.809+0000 7f3acd498640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f3ab00a2cf0 0x7f3ab00a51b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.809+0000 7f3acd498640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ac8106a80 0x7f3ac81a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.809+0000 7f3acd498640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac8101420 0x7f3ac8199870 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.809+0000 7f3acd498640 1 --2- 172.21.15.152:0/3066189052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac8100a80 0x7f3ac8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.809+0000 7f3acd498640 1 -- 172.21.15.152:0/3066189052 >> 172.21.15.152:0/3066189052 conn(0x7f3ac80fc780 msgr2=0x7f3ac80fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:42.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.810+0000 7f3acd498640 1 -- 172.21.15.152:0/3066189052 shutdown_connections 2024-09-11T22:20:42.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:42.810+0000 7f3acd498640 1 -- 172.21.15.152:0/3066189052 wait complete. 2024-09-11T22:20:42.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:42 smithi193 ceph-mon[35545]: pgmap v515: 97 pgs: 97 active+clean; 4.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2024-09-11T22:20:42.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:42 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1996982285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:20:42.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:42 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:20:42.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:42 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:20:42.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:42 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' 2024-09-11T22:20:42.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T22:20:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.335+0000 7f5674131640 1 -- 172.21.15.152:0/3879270870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f566c101ad0 msgr2=0x7f566c101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.335+0000 7f5674131640 1 --2- 172.21.15.152:0/3879270870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f566c101ad0 0x7f566c101f30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f565c009930 tx=0x7f565c02a440 comp rx=0 tx=0).stop 2024-09-11T22:20:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.339+0000 7f5674131640 1 -- 172.21.15.152:0/3879270870 shutdown_connections 2024-09-11T22:20:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.339+0000 7f5674131640 1 --2- 172.21.15.152:0/3879270870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f566c102470 0x7f566c10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.339+0000 7f5674131640 1 --2- 172.21.15.152:0/3879270870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f566c101ad0 0x7f566c101f30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.339+0000 7f5674131640 1 --2- 172.21.15.152:0/3879270870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f566c107b70 0x7f566c107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.339+0000 7f5674131640 1 -- 172.21.15.152:0/3879270870 >> 172.21.15.152:0/3879270870 conn(0x7f566c0fd7d0 msgr2=0x7f566c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.339+0000 7f5674131640 1 -- 172.21.15.152:0/3879270870 shutdown_connections 2024-09-11T22:20:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.339+0000 7f5674131640 1 -- 172.21.15.152:0/3879270870 wait complete. 2024-09-11T22:20:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.340+0000 7f5674131640 1 Processor -- start 2024-09-11T22:20:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.340+0000 7f5674131640 1 -- start start 2024-09-11T22:20:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.340+0000 7f5674131640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f566c101ad0 0x7f566c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.340+0000 7f5674131640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f566c102470 0x7f566c19f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.340+0000 7f5674131640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f566c107b70 0x7f566c10b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.340+0000 7f5674131640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f566c111f30 con 0x7f566c107b70 2024-09-11T22:20:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.340+0000 7f5674131640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f566c111db0 con 0x7f566c101ad0 2024-09-11T22:20:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.340+0000 7f5674131640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f566c1120b0 con 0x7f566c102470 2024-09-11T22:20:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.341+0000 7f56726ce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f566c107b70 0x7f566c10b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.341+0000 7f56716cc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f566c102470 0x7f566c19f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.341+0000 7f56716cc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f566c102470 0x7f566c19f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:44450/0 (socket says 172.21.15.152:44450) 2024-09-11T22:20:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.341+0000 7f56716cc640 1 -- 172.21.15.152:0/2784208931 learned_addr learned my addr 172.21.15.152:0/2784208931 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.341+0000 7f5671ecd640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f566c101ad0 0x7f566c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.342+0000 7f56716cc640 1 -- 172.21.15.152:0/2784208931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f566c101ad0 msgr2=0x7f566c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.342+0000 7f56716cc640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f566c101ad0 0x7f566c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.342+0000 7f56716cc640 1 -- 172.21.15.152:0/2784208931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f566c107b70 msgr2=0x7f566c10b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.342+0000 7f56716cc640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f566c107b70 0x7f566c10b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.342+0000 7f56716cc640 1 -- 172.21.15.152:0/2784208931 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566c10c160 con 0x7f566c102470 2024-09-11T22:20:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.342+0000 7f56716cc640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f566c102470 0x7f566c19f420 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f565c009230 tx=0x7f565c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.343+0000 7f5662ffd640 1 -- 172.21.15.152:0/2784208931 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c03f070 con 0x7f566c102470 2024-09-11T22:20:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.343+0000 7f5674131640 1 -- 172.21.15.152:0/2784208931 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566c10c3f0 con 0x7f566c102470 2024-09-11T22:20:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.343+0000 7f5674131640 1 -- 172.21.15.152:0/2784208931 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f566c19aa10 con 0x7f566c102470 2024-09-11T22:20:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.346+0000 7f5662ffd640 1 -- 172.21.15.152:0/2784208931 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f565c031c90 con 0x7f566c102470 2024-09-11T22:20:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.346+0000 7f5676ece740 1 Processor -- start 2024-09-11T22:20:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.346+0000 7f5662ffd640 1 -- 172.21.15.152:0/2784208931 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c035030 con 0x7f566c102470 2024-09-11T22:20:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.347+0000 7f5676ece740 1 -- start start 2024-09-11T22:20:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.347+0000 7f5676ece740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.347+0000 7f5676ece740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 0x5587473dc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.347+0000 7f5676ece740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473df0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.347+0000 7f5676ece740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5587473362f0 con 0x5587473d1af0 2024-09-11T22:20:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.347+0000 7f5676ece740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5587472de270 con 0x5587473dccb0 2024-09-11T22:20:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.347+0000 7f5676ece740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5587473322b0 con 0x5587473d2410 2024-09-11T22:20:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.348+0000 7f56726ce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.348+0000 7f56726ce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51080/0 (socket says 172.21.15.152:51080) 2024-09-11T22:20:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.348+0000 7f56726ce640 1 -- 172.21.15.152:0/2194365468 learned_addr learned my addr 172.21.15.152:0/2194365468 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.348+0000 7f56716cc640 1 --2- 172.21.15.152:0/2194365468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473df0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.348+0000 7f5671ecd640 1 --2- 172.21.15.152:0/2194365468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 0x5587473dc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.349+0000 7f5671ecd640 1 -- 172.21.15.152:0/2194365468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 msgr2=0x5587473df0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.350+0000 7f5671ecd640 1 --2- 172.21.15.152:0/2194365468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473df0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.350+0000 7f5671ecd640 1 -- 172.21.15.152:0/2194365468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 msgr2=0x5587473d1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.350+0000 7f5671ecd640 1 --2- 172.21.15.152:0/2194365468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.350+0000 7f5671ecd640 1 -- 172.21.15.152:0/2194365468 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587472dd340 con 0x5587473d2410 2024-09-11T22:20:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.350+0000 7f5671ecd640 1 --2- 172.21.15.152:0/2194365468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 0x5587473dc770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5668007da0 tx=0x7f566800e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=164a01fb50689db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.351+0000 7f5662ffd640 1 -- 172.21.15.152:0/2784208931 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f565c042070 con 0x7f566c102470 2024-09-11T22:20:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.351+0000 7f5657fff640 1 -- 172.21.15.152:0/2194365468 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668014070 con 0x5587473d2410 2024-09-11T22:20:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.351+0000 7f5657fff640 1 -- 172.21.15.152:0/2194365468 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5668004d20 con 0x5587473d2410 2024-09-11T22:20:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.352+0000 7f5676ece740 1 -- 172.21.15.152:0/2194365468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 msgr2=0x5587473dc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.352+0000 7f5676ece740 1 --2- 172.21.15.152:0/2194365468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 0x5587473dc770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5668007da0 tx=0x7f566800e720 comp rx=0 tx=0).stop 2024-09-11T22:20:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.352+0000 7f5676ece740 1 -- 172.21.15.152:0/2194365468 shutdown_connections 2024-09-11T22:20:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.352+0000 7f5676ece740 1 --2- 172.21.15.152:0/2194365468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473df0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.352+0000 7f5676ece740 1 --2- 172.21.15.152:0/2194365468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 0x5587473dc770 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.352+0000 7f5676ece740 1 --2- 172.21.15.152:0/2194365468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.352+0000 7f5676ece740 1 -- 172.21.15.152:0/2194365468 >> 172.21.15.152:0/2194365468 conn(0x5587473ce060 msgr2=0x5587473ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.353+0000 7f5676ece740 1 -- 172.21.15.152:0/2194365468 shutdown_connections 2024-09-11T22:20:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.353+0000 7f5676ece740 1 -- 172.21.15.152:0/2194365468 wait complete. 2024-09-11T22:20:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.353+0000 7f5676ece740 1 -- start start 2024-09-11T22:20:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.353+0000 7f5676ece740 1 Processor -- start 2024-09-11T22:20:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5662ffd640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f56580a2db0 0x7f56580a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5676ece740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5662ffd640 1 -- 172.21.15.152:0/2784208931 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f565c0f6b20 con 0x7f566c102470 2024-09-11T22:20:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5676ece740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473d2410 0x5587473da010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5676ece740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473dccb0 0x5587473da550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5676ece740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5587473df8d0 con 0x5587473d1af0 2024-09-11T22:20:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5676ece740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5587472bf290 con 0x5587473d2410 2024-09-11T22:20:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5676ece740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5587473dfa50 con 0x5587473dccb0 2024-09-11T22:20:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5671ecd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5671ecd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51094/0 (socket says 172.21.15.152:51094) 2024-09-11T22:20:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5671ecd640 1 -- 172.21.15.152:0/370564672 learned_addr learned my addr 172.21.15.152:0/370564672 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f56726ce640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f56580a2db0 0x7f56580a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f56716cc640 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473d2410 0x5587473da010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.354+0000 7f5676ece740 10 client.0 _ll_register_callbacks cb 0x5587472f0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.355+0000 7f56726ce640 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473dccb0 0x5587473da550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.355+0000 7f5671ecd640 1 -- 172.21.15.152:0/370564672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473dccb0 msgr2=0x5587473da550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.355+0000 7f5671ecd640 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473dccb0 0x5587473da550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.355+0000 7f5671ecd640 1 -- 172.21.15.152:0/370564672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473d2410 msgr2=0x5587473da010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.355+0000 7f5671ecd640 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473d2410 0x5587473da010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.355+0000 7f5671ecd640 1 -- 172.21.15.152:0/370564672 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558747049210 con 0x5587473d1af0 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.355+0000 7f56726ce640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f56580a2db0 0x7f56580a5270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f56640125f0 tx=0x7f56640098f0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.355+0000 7f5671ecd640 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d9ad0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5668000f80 tx=0x7f5668010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504b86dd5bd9ad7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.355+0000 7f56557fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.356+0000 7f56557fa640 1 -- 172.21.15.152:0/370564672 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668014070 con 0x5587473d1af0 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.356+0000 7f56557fa640 1 -- 172.21.15.152:0/370564672 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f5668004ed0 con 0x5587473d1af0 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.356+0000 7f5676ece740 1 -- 172.21.15.152:0/370564672 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5668004d20 con 0x5587473d1af0 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.356+0000 7f56557fa640 1 -- 172.21.15.152:0/370564672 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5668007990 con 0x5587473d1af0 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.356+0000 7f5676ece740 10 client.19494 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.356+0000 7f5676ece740 1 -- 172.21.15.152:0/370564672 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558747115620 con 0x5587473d1af0 2024-09-11T22:20:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.357+0000 7f56557fa640 1 -- 172.21.15.152:0/370564672 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5668004d20 con 0x5587473d1af0 2024-09-11T22:20:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.357+0000 7f56557fa640 1 -- 172.21.15.152:0/370564672 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f56680236c0 con 0x5587473d1af0 2024-09-11T22:20:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.358+0000 7f5676ece740 10 client.19494 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.358+0000 7f5676ece740 10 client.19494 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.358+0000 7f5676ece740 20 client.19494 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.358+0000 7f5676ece740 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5587473ecfe0 0x5587473ef440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.358+0000 7f5676ece740 4 client.19494 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.358+0000 7f5676ece740 1 -- 172.21.15.152:0/370564672 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558747343a20 con 0x5587473ecfe0 2024-09-11T22:20:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.358+0000 7f56716cc640 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5587473ecfe0 0x5587473ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.359+0000 7f56716cc640 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5587473ecfe0 0x5587473ef440 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1380e3b397c7020b server_cookie=11d24ad743163cba in_seq=0 out_seq=0 2024-09-11T22:20:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.359+0000 7f56557fa640 10 client.19494 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.361+0000 7f56557fa640 1 -- 172.21.15.152:0/370564672 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558747343a20 con 0x5587473ecfe0 2024-09-11T22:20:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.361+0000 7f56557fa640 10 client.19494 handle_command_reply: tid=0 2024-09-11T22:20:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.361+0000 7f5676ece740 1 client.19494 shutdown 2024-09-11T22:20:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f5676ece740 1 -- 172.21.15.152:0/370564672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 msgr2=0x5587473d9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f5676ece740 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d9ad0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5668000f80 tx=0x7f5668010ed0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f5676ece740 1 -- 172.21.15.152:0/370564672 shutdown_connections 2024-09-11T22:20:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f5676ece740 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x5587473ecfe0 0x5587473ef440 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f5676ece740 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473dccb0 0x5587473da550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f5676ece740 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473d2410 0x5587473da010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f5676ece740 1 --2- 172.21.15.152:0/370564672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d9ad0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f5676ece740 1 -- 172.21.15.152:0/370564672 >> 172.21.15.152:0/370564672 conn(0x5587473ce060 msgr2=0x5587473cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f56557fa640 0 client.19494 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f5676ece740 1 -- 172.21.15.152:0/370564672 shutdown_connections 2024-09-11T22:20:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f5676ece740 1 -- 172.21.15.152:0/370564672 wait complete. 2024-09-11T22:20:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.362+0000 7f5676ece740 20 client.19494 trim_cache size 0 max 16384 2024-09-11T22:20:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.388+0000 7f5676ece740 1 Processor -- start 2024-09-11T22:20:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.388+0000 7f5676ece740 1 -- start start 2024-09-11T22:20:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.389+0000 7f5676ece740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.389+0000 7f5676ece740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 0x5587473d8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.389+0000 7f5676ece740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473da350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.389+0000 7f5676ece740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5650011210 con 0x5587473d1af0 2024-09-11T22:20:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.389+0000 7f56716cc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 0x5587473d8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.389+0000 7f56716cc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 0x5587473d8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:53178/0 (socket says 172.21.15.152:53178) 2024-09-11T22:20:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.389+0000 7f56716cc640 1 -- 172.21.15.152:0/831899083 learned_addr learned my addr 172.21.15.152:0/831899083 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.389+0000 7f56726ce640 1 --2- 172.21.15.152:0/831899083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473da350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.389+0000 7f5676ece740 1 -- 172.21.15.152:0/831899083 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f565000eae0 con 0x5587473dccb0 2024-09-11T22:20:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.389+0000 7f5676ece740 1 -- 172.21.15.152:0/831899083 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f565000c950 con 0x5587473d2410 2024-09-11T22:20:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.389+0000 7f5671ecd640 1 --2- 172.21.15.152:0/831899083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.390+0000 7f56726ce640 1 -- 172.21.15.152:0/831899083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 msgr2=0x5587473d8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.390+0000 7f56726ce640 1 --2- 172.21.15.152:0/831899083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 0x5587473d8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.390+0000 7f56726ce640 1 -- 172.21.15.152:0/831899083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 msgr2=0x5587473d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.390+0000 7f56726ce640 1 --2- 172.21.15.152:0/831899083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.390+0000 7f56726ce640 1 -- 172.21.15.152:0/831899083 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587473cde90 con 0x5587473dccb0 2024-09-11T22:20:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.390+0000 7f56716cc640 1 --2- 172.21.15.152:0/831899083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 0x5587473d8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.390+0000 7f5671ecd640 1 --2- 172.21.15.152:0/831899083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.390+0000 7f56726ce640 1 --2- 172.21.15.152:0/831899083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473da350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5664012e80 tx=0x7f5664022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c17a53d986590ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.391+0000 7f56577fe640 1 -- 172.21.15.152:0/831899083 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56640226f0 con 0x5587473dccb0 2024-09-11T22:20:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.391+0000 7f56577fe640 1 -- 172.21.15.152:0/831899083 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f566401c040 con 0x5587473dccb0 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.391+0000 7f56577fe640 1 -- 172.21.15.152:0/831899083 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5664020c30 con 0x5587473dccb0 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.391+0000 7f5676ece740 1 -- 172.21.15.152:0/831899083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 msgr2=0x5587473da350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.391+0000 7f5676ece740 1 --2- 172.21.15.152:0/831899083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473da350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5664012e80 tx=0x7f5664022000 comp rx=0 tx=0).stop 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.391+0000 7f5676ece740 1 -- 172.21.15.152:0/831899083 shutdown_connections 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.391+0000 7f5676ece740 1 --2- 172.21.15.152:0/831899083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473da350 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.392+0000 7f5676ece740 1 --2- 172.21.15.152:0/831899083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d2410 0x5587473d8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.392+0000 7f5676ece740 1 --2- 172.21.15.152:0/831899083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d1af0 0x5587473d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.392+0000 7f5676ece740 1 -- 172.21.15.152:0/831899083 >> 172.21.15.152:0/831899083 conn(0x5587473ce060 msgr2=0x5587473dbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.392+0000 7f5676ece740 1 -- 172.21.15.152:0/831899083 shutdown_connections 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.392+0000 7f5676ece740 1 -- 172.21.15.152:0/831899083 wait complete. 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.392+0000 7f5676ece740 1 -- start start 2024-09-11T22:20:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.392+0000 7f5676ece740 1 Processor -- start 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5676ece740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d1af0 0x5587473e5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5676ece740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d2410 0x5587473e5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5676ece740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473e03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5676ece740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f565000cfa0 con 0x5587473d2410 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5676ece740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f565000e410 con 0x5587473dccb0 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5676ece740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f565000d670 con 0x5587473d1af0 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f56716cc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d2410 0x5587473e5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5671ecd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d1af0 0x5587473e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f56716cc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d2410 0x5587473e5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58522/0 (socket says 172.21.15.152:58522) 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f56716cc640 1 -- 172.21.15.152:0/3858782336 learned_addr learned my addr 172.21.15.152:0/3858782336 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5676ece740 10 client.0 _ll_register_callbacks cb 0x7f5664009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f56726ce640 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473e03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5671ecd640 1 -- 172.21.15.152:0/3858782336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 msgr2=0x5587473e03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5671ecd640 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473e03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5671ecd640 1 -- 172.21.15.152:0/3858782336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d2410 msgr2=0x5587473e5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5671ecd640 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d2410 0x5587473e5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.393+0000 7f5671ecd640 1 -- 172.21.15.152:0/3858782336 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587473c92d0 con 0x5587473d1af0 2024-09-11T22:20:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.394+0000 7f5671ecd640 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d1af0 0x5587473e5040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5668023ae0 tx=0x7f5668010ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c26cdf03e99a996e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.394+0000 7f56557fa640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:20:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.394+0000 7f56557fa640 1 -- 172.21.15.152:0/3858782336 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668014040 con 0x5587473d1af0 2024-09-11T22:20:43.398 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.394+0000 7f5676ece740 1 -- 172.21.15.152:0/3858782336 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f566401c040 con 0x5587473d1af0 2024-09-11T22:20:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.394+0000 7f56557fa640 1 -- 172.21.15.152:0/3858782336 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f56680075e0 con 0x5587473d1af0 2024-09-11T22:20:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.394+0000 7f56557fa640 1 -- 172.21.15.152:0/3858782336 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5668023630 con 0x5587473d1af0 2024-09-11T22:20:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.394+0000 7f5676ece740 10 client.28789 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.394+0000 7f5676ece740 1 -- 172.21.15.152:0/3858782336 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5587474576b0 con 0x5587473d1af0 2024-09-11T22:20:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.395+0000 7f56557fa640 1 -- 172.21.15.152:0/3858782336 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f566401c040 con 0x5587473d1af0 2024-09-11T22:20:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.395+0000 7f56557fa640 1 -- 172.21.15.152:0/3858782336 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f5668004620 con 0x5587473d1af0 2024-09-11T22:20:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.395+0000 7f5676ece740 10 client.28789 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:43.399 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.395+0000 7f5676ece740 10 client.28789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.395+0000 7f5676ece740 20 client.28789 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.395+0000 7f5676ece740 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558747457d60 0x55874745a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.395+0000 7f5676ece740 4 client.28789 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:20:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.395+0000 7f5676ece740 1 -- 172.21.15.152:0/3858782336 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55874733dd70 con 0x558747457d60 2024-09-11T22:20:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.396+0000 7f56716cc640 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558747457d60 0x55874745a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.396+0000 7f56716cc640 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558747457d60 0x55874745a150 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9724bfad7eb7973b server_cookie=dd210d79557684ef in_seq=0 out_seq=0 2024-09-11T22:20:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.396+0000 7f56557fa640 10 client.28789 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f56557fa640 1 -- 172.21.15.152:0/3858782336 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55874733dd70 con 0x558747457d60 2024-09-11T22:20:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f56557fa640 10 client.28789 handle_command_reply: tid=0 2024-09-11T22:20:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f5676ece740 1 client.28789 shutdown 2024-09-11T22:20:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f5676ece740 1 -- 172.21.15.152:0/3858782336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d1af0 msgr2=0x5587473e5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f5676ece740 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d1af0 0x5587473e5040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5668023ae0 tx=0x7f5668010ad0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f5676ece740 1 -- 172.21.15.152:0/3858782336 shutdown_connections 2024-09-11T22:20:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f5676ece740 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x558747457d60 0x55874745a150 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f5676ece740 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587473dccb0 0x5587473e03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f56557fa640 0 client.28789 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f5676ece740 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587473d2410 0x5587473e5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f5676ece740 1 --2- 172.21.15.152:0/3858782336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5587473d1af0 0x5587473e5040 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f5676ece740 1 -- 172.21.15.152:0/3858782336 >> 172.21.15.152:0/3858782336 conn(0x5587473ce060 msgr2=0x5587473db330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f5676ece740 1 -- 172.21.15.152:0/3858782336 shutdown_connections 2024-09-11T22:20:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.434+0000 7f5676ece740 1 -- 172.21.15.152:0/3858782336 wait complete. 2024-09-11T22:20:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.435+0000 7f5676ece740 20 client.28789 trim_cache size 0 max 16384 2024-09-11T22:20:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:{ 2024-09-11T22:20:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "message": "", 2024-09-11T22:20:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout: "return_code": 0 2024-09-11T22:20:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stdout:} 2024-09-11T22:20:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.435+0000 7f5674131640 1 -- 172.21.15.152:0/2784208931 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f56580a2db0 msgr2=0x7f56580a5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.435+0000 7f5674131640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f56580a2db0 0x7f56580a5270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f56640125f0 tx=0x7f56640098f0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.435+0000 7f5674131640 1 -- 172.21.15.152:0/2784208931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f566c102470 msgr2=0x7f566c19f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.435+0000 7f5674131640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f566c102470 0x7f566c19f420 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f565c009230 tx=0x7f565c003c10 comp rx=0 tx=0).stop 2024-09-11T22:20:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.435+0000 7f5674131640 1 -- 172.21.15.152:0/2784208931 shutdown_connections 2024-09-11T22:20:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.435+0000 7f5674131640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f56580a2db0 0x7f56580a5270 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.435+0000 7f5674131640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f566c107b70 0x7f566c10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.435+0000 7f5674131640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f566c102470 0x7f566c19f420 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.435+0000 7f5674131640 1 --2- 172.21.15.152:0/2784208931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f566c101ad0 0x7f566c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.435+0000 7f5674131640 1 -- 172.21.15.152:0/2784208931 >> 172.21.15.152:0/2784208931 conn(0x7f566c0fd7d0 msgr2=0x7f566c10d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.436+0000 7f5674131640 1 -- 172.21.15.152:0/2784208931 shutdown_connections 2024-09-11T22:20:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi152.front.sepia.ceph.com.smithi152.stderr:2024-09-11T22:20:43.436+0000 7f5674131640 1 -- 172.21.15.152:0/2784208931 wait complete. 2024-09-11T22:20:43.690 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 144.25 --await-for 45.0' 2024-09-11T22:20:43.690 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 144.25 --await-for 45.0 2024-09-11T22:20:43.711 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:43 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3066189052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:20:43.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:43 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3066189052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:20:43.819 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:43.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:43 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3066189052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:20:44.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.622+0000 7f126e882640 1 -- 172.21.15.152:0/3217240110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1268102570 msgr2=0x7f12681029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.622+0000 7f126e882640 1 --2- 172.21.15.152:0/3217240110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1268102570 0x7f12681029b0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f125c009900 tx=0x7f125c02a480 comp rx=0 tx=0).stop 2024-09-11T22:20:44.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.622+0000 7f126e882640 1 -- 172.21.15.152:0/3217240110 shutdown_connections 2024-09-11T22:20:44.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.622+0000 7f126e882640 1 --2- 172.21.15.152:0/3217240110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1268102ef0 0x7f126810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.622+0000 7f126e882640 1 --2- 172.21.15.152:0/3217240110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1268102570 0x7f12681029b0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.622+0000 7f126e882640 1 --2- 172.21.15.152:0/3217240110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1268100e20 0x7f1268101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.623+0000 7f126e882640 1 -- 172.21.15.152:0/3217240110 >> 172.21.15.152:0/3217240110 conn(0x7f12680fc7d0 msgr2=0x7f12680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.623+0000 7f126e882640 1 -- 172.21.15.152:0/3217240110 shutdown_connections 2024-09-11T22:20:44.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.623+0000 7f126e882640 1 -- 172.21.15.152:0/3217240110 wait complete. 2024-09-11T22:20:44.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.623+0000 7f126e882640 1 Processor -- start 2024-09-11T22:20:44.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.623+0000 7f126e882640 1 -- start start 2024-09-11T22:20:44.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f126e882640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1268100e20 0x7f12681984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f126e882640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1268102570 0x7f1268198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f126e882640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1268102ef0 0x7f126819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f126e882640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1268110f80 con 0x7f1268102570 2024-09-11T22:20:44.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f126e882640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1268110e00 con 0x7f1268100e20 2024-09-11T22:20:44.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f126e882640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1268111100 con 0x7f1268102ef0 2024-09-11T22:20:44.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f12677fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1268102570 0x7f1268198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f126ce1f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1268102ef0 0x7f126819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f1267fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1268100e20 0x7f12681984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f12677fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1268102570 0x7f1268198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58548/0 (socket says 172.21.15.152:58548) 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f126ce1f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1268102ef0 0x7f126819cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:53210/0 (socket says 172.21.15.152:53210) 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f12677fe640 1 -- 172.21.15.152:0/1301583160 learned_addr learned my addr 172.21.15.152:0/1301583160 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f12677fe640 1 -- 172.21.15.152:0/1301583160 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1268102ef0 msgr2=0x7f126819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f12677fe640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1268102ef0 0x7f126819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f12677fe640 1 -- 172.21.15.152:0/1301583160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1268100e20 msgr2=0x7f12681984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f12677fe640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1268100e20 0x7f12681984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f12677fe640 1 -- 172.21.15.152:0/1301583160 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126819d480 con 0x7f1268102570 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f126ce1f640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1268102ef0 0x7f126819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.624+0000 7f12677fe640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1268102570 0x7f1268198a10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f125c006010 tx=0x7f125c03ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.625+0000 7f12657fa640 1 -- 172.21.15.152:0/1301583160 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c035070 con 0x7f1268102570 2024-09-11T22:20:44.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.625+0000 7f126e882640 1 -- 172.21.15.152:0/1301583160 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126819d710 con 0x7f1268102570 2024-09-11T22:20:44.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.625+0000 7f12657fa640 1 -- 172.21.15.152:0/1301583160 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f125c003ce0 con 0x7f1268102570 2024-09-11T22:20:44.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.625+0000 7f12657fa640 1 -- 172.21.15.152:0/1301583160 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c031c80 con 0x7f1268102570 2024-09-11T22:20:44.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.625+0000 7f126e882640 1 -- 172.21.15.152:0/1301583160 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12680fcbb0 con 0x7f1268102570 2024-09-11T22:20:44.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.627+0000 7f12657fa640 1 -- 172.21.15.152:0/1301583160 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f125c04d440 con 0x7f1268102570 2024-09-11T22:20:44.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.627+0000 7f1270c5b740 1 Processor -- start 2024-09-11T22:20:44.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.627+0000 7f1270c5b740 1 -- start start 2024-09-11T22:20:44.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322129b40 0x563322128090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x563322128a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322133370 0x563322135760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f1270c5b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56332208e2f0 con 0x563322129b40 2024-09-11T22:20:44.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f1270c5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563322035cf0 con 0x5633221285d0 2024-09-11T22:20:44.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f1270c5b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56332208a2b0 con 0x563322133370 2024-09-11T22:20:44.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f126ce1f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322129b40 0x563322128090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f12677fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322133370 0x563322135760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f126ce1f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322129b40 0x563322128090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58550/0 (socket says 172.21.15.152:58550) 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f12677fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322133370 0x563322135760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:53216/0 (socket says 172.21.15.152:53216) 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f126ce1f640 1 -- 172.21.15.152:0/3043335175 learned_addr learned my addr 172.21.15.152:0/3043335175 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f1267fff640 1 --2- 172.21.15.152:0/3043335175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x563322128a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f12657fa640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12500a2cf0 0x7f12500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f12677fe640 1 -- 172.21.15.152:0/3043335175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 msgr2=0x563322128a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f12677fe640 1 --2- 172.21.15.152:0/3043335175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x563322128a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f12677fe640 1 -- 172.21.15.152:0/3043335175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322129b40 msgr2=0x563322128090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f12677fe640 1 --2- 172.21.15.152:0/3043335175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322129b40 0x563322128090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f12657fa640 1 -- 172.21.15.152:0/1301583160 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f125c0f34a0 con 0x7f1268102570 2024-09-11T22:20:44.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f12677fe640 1 -- 172.21.15.152:0/3043335175 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56332201a3a0 con 0x563322133370 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f126ce1f640 1 --2- 172.21.15.152:0/3043335175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322129b40 0x563322128090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.628+0000 7f126ce1f640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12500a2cf0 0x7f12500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.629+0000 7f12677fe640 1 --2- 172.21.15.152:0/3043335175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322133370 0x563322135760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f125c0f0b90 tx=0x7f125c02a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e19b6d8dc004641 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.629+0000 7f124e7fc640 1 -- 172.21.15.152:0/3043335175 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c0bbc00 con 0x563322133370 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.629+0000 7f124e7fc640 1 -- 172.21.15.152:0/3043335175 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f125c031e20 con 0x563322133370 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.629+0000 7f124e7fc640 1 -- 172.21.15.152:0/3043335175 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c03f1d0 con 0x563322133370 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f1270c5b740 1 -- 172.21.15.152:0/3043335175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322133370 msgr2=0x563322135760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f126ce1f640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12500a2cf0 0x7f12500a51b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1260009fd0 tx=0x7f1260004a40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f1270c5b740 1 --2- 172.21.15.152:0/3043335175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322133370 0x563322135760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f125c0f0b90 tx=0x7f125c02a480 comp rx=0 tx=0).stop 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f1270c5b740 1 -- 172.21.15.152:0/3043335175 shutdown_connections 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f1270c5b740 1 --2- 172.21.15.152:0/3043335175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322133370 0x563322135760 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f1270c5b740 1 --2- 172.21.15.152:0/3043335175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x563322128a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f1270c5b740 1 --2- 172.21.15.152:0/3043335175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322129b40 0x563322128090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f1270c5b740 1 -- 172.21.15.152:0/3043335175 >> 172.21.15.152:0/3043335175 conn(0x5633220f1310 msgr2=0x563322124c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f1270c5b740 1 -- 172.21.15.152:0/3043335175 shutdown_connections 2024-09-11T22:20:44.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f1270c5b740 1 -- 172.21.15.152:0/3043335175 wait complete. 2024-09-11T22:20:44.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f1270c5b740 1 -- start start 2024-09-11T22:20:44.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.630+0000 7f1270c5b740 1 Processor -- start 2024-09-11T22:20:44.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x563322132d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 0x56332212ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x563322130570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f1270c5b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56332208a2b0 con 0x563322133370 2024-09-11T22:20:44.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f1270c5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563322049060 con 0x5633221285d0 2024-09-11T22:20:44.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f1270c5b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563322135e30 con 0x563322129b40 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f1270c5b740 10 client.0 _ll_register_callbacks cb 0x563321d9c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f126ce1f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x563322130570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f12677fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 0x56332212ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f126ce1f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x563322130570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58560/0 (socket says 172.21.15.152:58560) 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f126ce1f640 1 -- 172.21.15.152:0/352435519 learned_addr learned my addr 172.21.15.152:0/352435519 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f12677fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 0x56332212ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:53226/0 (socket says 172.21.15.152:53226) 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f1267fff640 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x563322132d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f12677fe640 1 -- 172.21.15.152:0/352435519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 msgr2=0x563322132d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f12677fe640 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x563322132d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f12677fe640 1 -- 172.21.15.152:0/352435519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 msgr2=0x563322130570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f12677fe640 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x563322130570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f12677fe640 1 -- 172.21.15.152:0/352435519 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563321dff3c0 con 0x563322129b40 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f126ce1f640 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x563322130570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f12677fe640 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 0x56332212ffd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f125c0f6cb0 tx=0x7f125c003e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37c4d929da0a913 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.631+0000 7f12477fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f12477fe640 1 -- 172.21.15.152:0/352435519 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c0bf2c0 con 0x563322129b40 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f12477fe640 1 -- 172.21.15.152:0/352435519 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f125c031540 con 0x563322129b40 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f1270c5b740 1 -- 172.21.15.152:0/352435519 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f125c031e20 con 0x563322129b40 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f12477fe640 1 -- 172.21.15.152:0/352435519 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f125c0bf4a0 con 0x563322129b40 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f1270c5b740 10 client.28801 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f1270c5b740 1 -- 172.21.15.152:0/352435519 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563322141700 con 0x563322129b40 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f12477fe640 1 -- 172.21.15.152:0/352435519 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f125c031e20 con 0x563322129b40 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f12477fe640 1 -- 172.21.15.152:0/352435519 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f125c0aa110 con 0x563322129b40 2024-09-11T22:20:44.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f1270c5b740 10 client.28801 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f1270c5b740 10 client.28801 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f1270c5b740 20 client.28801 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f1270c5b740 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563322142a50 0x563322144e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f1270c5b740 4 client.28801 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.632+0000 7f1270c5b740 1 -- 172.21.15.152:0/352435519 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56332209b860 con 0x563322142a50 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.633+0000 7f1267fff640 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563322142a50 0x563322144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.633+0000 7f12477fe640 10 client.28801 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.633+0000 7f1267fff640 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563322142a50 0x563322144e40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3202395998384d3 server_cookie=9219080d0a5d1a9 in_seq=0 out_seq=0 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.634+0000 7f12477fe640 1 -- 172.21.15.152:0/352435519 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56332209b860 con 0x563322142a50 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.634+0000 7f12477fe640 10 client.28801 handle_command_reply: tid=0 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.634+0000 7f1270c5b740 1 client.28801 shutdown 2024-09-11T22:20:44.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f1270c5b740 1 -- 172.21.15.152:0/352435519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 msgr2=0x56332212ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f1270c5b740 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 0x56332212ffd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f125c0f6cb0 tx=0x7f125c003e90 comp rx=0 tx=0).stop 2024-09-11T22:20:44.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f1270c5b740 1 -- 172.21.15.152:0/352435519 shutdown_connections 2024-09-11T22:20:44.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f1270c5b740 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x563322142a50 0x563322144e40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f1270c5b740 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x563322130570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f1270c5b740 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 0x56332212ffd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f1270c5b740 1 --2- 172.21.15.152:0/352435519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x563322132d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f12477fe640 0 client.28801 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:20:44.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f1270c5b740 1 -- 172.21.15.152:0/352435519 >> 172.21.15.152:0/352435519 conn(0x5633220f1310 msgr2=0x56332212a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f1270c5b740 1 -- 172.21.15.152:0/352435519 shutdown_connections 2024-09-11T22:20:44.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f1270c5b740 1 -- 172.21.15.152:0/352435519 wait complete. 2024-09-11T22:20:44.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.635+0000 7f1270c5b740 20 client.28801 trim_cache size 0 max 16384 2024-09-11T22:20:44.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f1270c5b740 1 Processor -- start 2024-09-11T22:20:44.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f1270c5b740 1 -- start start 2024-09-11T22:20:44.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633221285d0 0x56332213ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563322129b40 0x563322123bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x56332214a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f1270c5b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12681adea0 con 0x563322133370 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f1270c5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12681ab770 con 0x563322129b40 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f1270c5b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12681a95e0 con 0x5633221285d0 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f126ce1f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x56332214a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f126ce1f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x56332214a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58574/0 (socket says 172.21.15.152:58574) 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f126ce1f640 1 -- 172.21.15.152:0/233951485 learned_addr learned my addr 172.21.15.152:0/233951485 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f1267fff640 1 --2- 172.21.15.152:0/233951485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633221285d0 0x56332213ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.651+0000 7f12677fe640 1 --2- 172.21.15.152:0/233951485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563322129b40 0x563322123bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.652+0000 7f126ce1f640 1 -- 172.21.15.152:0/233951485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633221285d0 msgr2=0x56332213ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.652+0000 7f126ce1f640 1 --2- 172.21.15.152:0/233951485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633221285d0 0x56332213ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.652+0000 7f126ce1f640 1 -- 172.21.15.152:0/233951485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563322129b40 msgr2=0x563322123bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.652+0000 7f126ce1f640 1 --2- 172.21.15.152:0/233951485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563322129b40 0x563322123bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.652+0000 7f126ce1f640 1 -- 172.21.15.152:0/233951485 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563322132940 con 0x563322133370 2024-09-11T22:20:44.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.652+0000 7f126ce1f640 1 --2- 172.21.15.152:0/233951485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x56332214a6a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1260004890 tx=0x7f126001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f00b4f952eb8cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.652+0000 7f124dffb640 1 -- 172.21.15.152:0/233951485 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12600293f0 con 0x563322133370 2024-09-11T22:20:44.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.652+0000 7f124dffb640 1 -- 172.21.15.152:0/233951485 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f126002e070 con 0x563322133370 2024-09-11T22:20:44.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.652+0000 7f124dffb640 1 -- 172.21.15.152:0/233951485 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126000f880 con 0x563322133370 2024-09-11T22:20:44.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.653+0000 7f1270c5b740 1 -- 172.21.15.152:0/233951485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 msgr2=0x56332214a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.653+0000 7f1270c5b740 1 --2- 172.21.15.152:0/233951485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x56332214a6a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1260004890 tx=0x7f126001a000 comp rx=0 tx=0).stop 2024-09-11T22:20:44.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.653+0000 7f1270c5b740 1 -- 172.21.15.152:0/233951485 shutdown_connections 2024-09-11T22:20:44.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.653+0000 7f1270c5b740 1 --2- 172.21.15.152:0/233951485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x56332214a6a0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.653+0000 7f1270c5b740 1 --2- 172.21.15.152:0/233951485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563322129b40 0x563322123bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.653+0000 7f1270c5b740 1 --2- 172.21.15.152:0/233951485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633221285d0 0x56332213ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.653+0000 7f1270c5b740 1 -- 172.21.15.152:0/233951485 >> 172.21.15.152:0/233951485 conn(0x5633220f1310 msgr2=0x5633221234e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.653+0000 7f1270c5b740 1 -- 172.21.15.152:0/233951485 shutdown_connections 2024-09-11T22:20:44.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.653+0000 7f1270c5b740 1 -- 172.21.15.152:0/233951485 wait complete. 2024-09-11T22:20:44.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.654+0000 7f1270c5b740 1 -- start start 2024-09-11T22:20:44.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.654+0000 7f1270c5b740 1 Processor -- start 2024-09-11T22:20:44.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.654+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x56332213b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.654+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 0x56332212cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.654+0000 7f1270c5b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x56332212d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.654+0000 7f1270c5b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12681a9c30 con 0x563322133370 2024-09-11T22:20:44.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.654+0000 7f1270c5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12681ab0a0 con 0x5633221285d0 2024-09-11T22:20:44.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.654+0000 7f1270c5b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12681aa300 con 0x563322129b40 2024-09-11T22:20:44.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.654+0000 7f1270c5b740 10 client.0 _ll_register_callbacks cb 0x7f1260009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:44.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.655+0000 7f12677fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 0x56332212cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.655+0000 7f12677fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 0x56332212cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:53244/0 (socket says 172.21.15.152:53244) 2024-09-11T22:20:44.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.655+0000 7f12677fe640 1 -- 172.21.15.152:0/2960439991 learned_addr learned my addr 172.21.15.152:0/2960439991 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:44.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.655+0000 7f126ce1f640 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x56332212d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.655+0000 7f1267fff640 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x56332213b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.655+0000 7f126ce1f640 1 -- 172.21.15.152:0/2960439991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 msgr2=0x56332212cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.655+0000 7f126ce1f640 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 0x56332212cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.655+0000 7f126ce1f640 1 -- 172.21.15.152:0/2960439991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 msgr2=0x56332213b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.655+0000 7f126ce1f640 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x56332213b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.655+0000 7f126ce1f640 1 -- 172.21.15.152:0/2960439991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56332212db60 con 0x563322133370 2024-09-11T22:20:44.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.655+0000 7f1267fff640 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x56332213b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.656+0000 7f126ce1f640 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x56332212d330 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1260011fd0 tx=0x7f126000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb295e9845995e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.656+0000 7f12477fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.656+0000 7f12477fe640 1 -- 172.21.15.152:0/2960439991 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260036070 con 0x563322133370 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.656+0000 7f12477fe640 1 -- 172.21.15.152:0/2960439991 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f126000f800 con 0x563322133370 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.656+0000 7f1270c5b740 1 -- 172.21.15.152:0/2960439991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f126002e070 con 0x563322133370 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.656+0000 7f12477fe640 1 -- 172.21.15.152:0/2960439991 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1260042050 con 0x563322133370 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.656+0000 7f1270c5b740 10 client.19518 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.656+0000 7f1270c5b740 1 -- 172.21.15.152:0/2960439991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5633221b5ee0 con 0x563322133370 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.656+0000 7f12477fe640 1 -- 172.21.15.152:0/2960439991 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f126002e070 con 0x563322133370 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.657+0000 7f12477fe640 1 -- 172.21.15.152:0/2960439991 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f12600324f0 con 0x563322133370 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.657+0000 7f1270c5b740 10 client.19518 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.657+0000 7f1270c5b740 10 client.19518 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.657+0000 7f1270c5b740 20 client.19518 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.657+0000 7f1270c5b740 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5633221b65a0 0x5633221b8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.657+0000 7f1270c5b740 4 client.19518 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.657+0000 7f1270c5b740 1 -- 172.21.15.152:0/2960439991 --> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563322095d70 con 0x5633221b65a0 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.657+0000 7f1267fff640 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5633221b65a0 0x5633221b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.657+0000 7f12477fe640 10 client.19518 ms_handle_connect on v2:172.21.15.193:6836/3273726370 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.657+0000 7f1267fff640 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5633221b65a0 0x5633221b8990 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=105ce15dc22c919c server_cookie=7da7700780bc01cd in_seq=0 out_seq=0 2024-09-11T22:20:44.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f12477fe640 1 -- 172.21.15.152:0/2960439991 <== mds.2 v2:172.21.15.193:6836/3273726370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563322095d70 con 0x5633221b65a0 2024-09-11T22:20:44.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f12477fe640 10 client.19518 handle_command_reply: tid=0 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f1270c5b740 1 client.19518 shutdown 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f1270c5b740 1 -- 172.21.15.152:0/2960439991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 msgr2=0x56332212d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f1270c5b740 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x56332212d330 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1260011fd0 tx=0x7f126000f3c0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f1270c5b740 1 -- 172.21.15.152:0/2960439991 shutdown_connections 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f1270c5b740 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.193:6836/3273726370,v1:172.21.15.193:6837/3273726370] conn(0x5633221b65a0 0x5633221b8990 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f1270c5b740 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563322133370 0x56332212d330 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f12477fe640 0 client.19518 ms_handle_reset on v2:172.21.15.193:6836/3273726370 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f1270c5b740 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563322129b40 0x56332212cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f1270c5b740 1 --2- 172.21.15.152:0/2960439991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633221285d0 0x56332213b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.659+0000 7f1270c5b740 1 -- 172.21.15.152:0/2960439991 >> 172.21.15.152:0/2960439991 conn(0x5633220f1310 msgr2=0x56332212a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f1270c5b740 1 -- 172.21.15.152:0/2960439991 shutdown_connections 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f1270c5b740 1 -- 172.21.15.152:0/2960439991 wait complete. 2024-09-11T22:20:44.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f1270c5b740 20 client.19518 trim_cache size 0 max 16384 2024-09-11T22:20:44.667 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:20:44.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f126e882640 1 -- 172.21.15.152:0/1301583160 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12500a2cf0 msgr2=0x7f12500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f126e882640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12500a2cf0 0x7f12500a51b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1260009fd0 tx=0x7f1260004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:44.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f126e882640 1 -- 172.21.15.152:0/1301583160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1268102570 msgr2=0x7f1268198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f126e882640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1268102570 0x7f1268198a10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f125c006010 tx=0x7f125c03ac10 comp rx=0 tx=0).stop 2024-09-11T22:20:44.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f126e882640 1 -- 172.21.15.152:0/1301583160 shutdown_connections 2024-09-11T22:20:44.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f126e882640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f12500a2cf0 0x7f12500a51b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f126e882640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1268102ef0 0x7f126819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f126e882640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1268102570 0x7f1268198a10 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f126e882640 1 --2- 172.21.15.152:0/1301583160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1268100e20 0x7f12681984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.660+0000 7f126e882640 1 -- 172.21.15.152:0/1301583160 >> 172.21.15.152:0/1301583160 conn(0x7f12680fc7d0 msgr2=0x7f126806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.661+0000 7f126e882640 1 -- 172.21.15.152:0/1301583160 shutdown_connections 2024-09-11T22:20:44.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:44.661+0000 7f126e882640 1 -- 172.21.15.152:0/1301583160 wait complete. 2024-09-11T22:20:44.729 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:44 smithi152 ceph-mon[31188]: pgmap v516: 97 pgs: 97 active+clean; 4.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-11T22:20:44.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:44 smithi179 ceph-mon[35603]: pgmap v516: 97 pgs: 97 active+clean; 4.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-11T22:20:44.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:44 smithi193 ceph-mon[35545]: pgmap v516: 97 pgs: 97 active+clean; 4.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-11T22:20:44.837 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-11T22:20:44.948 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/: 2024-09-11T22:20:44.949 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:44.949 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 . 2024-09-11T22:20:44.949 INFO:teuthology.orchestra.run.smithi152.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 .. 2024-09-11T22:20:44.949 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 data 2024-09-11T22:20:44.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:44.949 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data: 2024-09-11T22:20:44.949 INFO:teuthology.orchestra.run.smithi152.stdout:total 36 2024-09-11T22:20:44.949 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 . 2024-09-11T22:20:44.949 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 .. 2024-09-11T22:20:44.949 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 22:05 base 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 11 22:05 current_logfiles 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 11 22:05 global 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:05 log 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_commit_ts 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_dynshmem 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 11 22:04 pg_hba.conf 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 11 22:04 pg_ident.conf 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:20 pg_logical 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:04 pg_multixact 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_notify 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_replslot 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_serial 2024-09-11T22:20:44.950 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_snapshots 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:20 pg_stat 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:20 pg_stat_tmp 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:20 pg_subtrans 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_tblspc 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 pg_twophase 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 PG_VERSION 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 11 22:20 pg_wal 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:11 pg_xact 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 11 22:04 postgresql.auto.conf 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 11 22:04 postgresql.conf 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 11 22:05 postmaster.opts 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:44.951 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/base: 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 22:05 . 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 22:04 1 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 22:04 13493 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 11 22:09 13494 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:05 pgsql_tmp 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:total 7777 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 22:04 . 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 22:05 .. 2024-09-11T22:20:44.952 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 112 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 113 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:04 1247 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1247_fsm 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1247_vm 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 22:04 1249 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1249_fsm 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1249_vm 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 22:04 1255 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1255_fsm 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1255_vm 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 22:04 1259 2024-09-11T22:20:44.953 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1259_fsm 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1259_vm 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 22:04 13344 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13344_fsm 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13344_vm 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13346 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13348 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13349_fsm 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349_vm 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13351 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13353 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13354_fsm 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354_vm 2024-09-11T22:20:44.954 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13356 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13358 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13359_fsm 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359_vm 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13361 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13363 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1417 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1418 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 174 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 175 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2187 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2224 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2328 2024-09-11T22:20:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2336 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2337 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2579 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2600 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2600_fsm 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2600_vm 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2601_fsm 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601_vm 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2602 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2602_fsm 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2602_vm 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2603 2024-09-11T22:20:44.956 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2603_fsm 2024-09-11T22:20:44.957 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2603_vm 2024-09-11T22:20:44.957 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2604 2024-09-11T22:20:44.957 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2605 2024-09-11T22:20:44.957 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2605_fsm 2024-09-11T22:20:44.957 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2605_vm 2024-09-11T22:20:44.957 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2606 2024-09-11T22:20:44.957 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2606_fsm 2024-09-11T22:20:44.957 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2606_vm 2024-09-11T22:20:44.957 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2607 2024-09-11T22:20:44.957 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2607_fsm 2024-09-11T22:20:44.957 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2607_vm 2024-09-11T22:20:44.958 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 22:04 2608 2024-09-11T22:20:44.958 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2608_fsm 2024-09-11T22:20:44.958 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2608_vm 2024-09-11T22:20:44.958 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 22:04 2609 2024-09-11T22:20:44.958 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2609_fsm 2024-09-11T22:20:44.958 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2609_vm 2024-09-11T22:20:44.958 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2610 2024-09-11T22:20:44.958 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2610_fsm 2024-09-11T22:20:44.958 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2610_vm 2024-09-11T22:20:44.959 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2611 2024-09-11T22:20:44.959 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612 2024-09-11T22:20:44.959 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2612_fsm 2024-09-11T22:20:44.959 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612_vm 2024-09-11T22:20:44.959 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2613 2024-09-11T22:20:44.959 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615 2024-09-11T22:20:44.959 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2615_fsm 2024-09-11T22:20:44.959 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615_vm 2024-09-11T22:20:44.959 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2616 2024-09-11T22:20:44.959 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2616_fsm 2024-09-11T22:20:44.960 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2616_vm 2024-09-11T22:20:44.960 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 22:04 2617 2024-09-11T22:20:44.960 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2617_fsm 2024-09-11T22:20:44.960 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2617_vm 2024-09-11T22:20:44.960 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 22:04 2618 2024-09-11T22:20:44.960 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2618_fsm 2024-09-11T22:20:44.960 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2618_vm 2024-09-11T22:20:44.960 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 11 22:04 2619 2024-09-11T22:20:44.960 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2619_fsm 2024-09-11T22:20:44.960 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2619_vm 2024-09-11T22:20:44.960 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2620 2024-09-11T22:20:44.961 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2650 2024-09-11T22:20:44.961 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2651 2024-09-11T22:20:44.961 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2652 2024-09-11T22:20:44.961 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2653 2024-09-11T22:20:44.961 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2654 2024-09-11T22:20:44.961 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2655 2024-09-11T22:20:44.961 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2656 2024-09-11T22:20:44.961 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2657 2024-09-11T22:20:44.961 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 22:04 2658 2024-09-11T22:20:44.961 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:04 2659 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2660 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2661 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2662 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2663 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2664 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2665 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2666 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2667 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2668 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2669 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2670 2024-09-11T22:20:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 22:04 2673 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 22:04 2674 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 22:04 2675 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2678 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2679 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2680 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2681 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2682 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2683 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2684 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2685 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2686 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2687 2024-09-11T22:20:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2688 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2689 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 22:04 2690 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 22:04 2691 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2692 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2693 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2696 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2699 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2701 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2702 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2703 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2704 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2753 2024-09-11T22:20:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2753_fsm 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2753_vm 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2754 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2755 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2756 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2757 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2830 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2831 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2832 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2833 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2834 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2835 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2836 2024-09-11T22:20:44.965 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2837 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 22:04 2838 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2838_fsm 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2838_vm 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2839 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840_fsm 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2840_vm 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2841 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2995 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2996 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3079_fsm 2024-09-11T22:20:44.966 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079_vm 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3080 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3081 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 3085 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3118 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3119 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 22:04 3164 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3256 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3257 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3258 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3350 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3351 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3379 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3380 2024-09-11T22:20:44.967 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3381 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3394 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3394_fsm 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3394_vm 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3395 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3429 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3430 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3431 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3433 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3439 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3440 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 3455 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 22:04 3456 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3456_fsm 2024-09-11T22:20:44.968 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3456_vm 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3466 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3467 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3468 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3501 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3502 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3503 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3534 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3541_fsm 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541_vm 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3542 2024-09-11T22:20:44.969 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3574 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3575 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3576 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3596 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3597 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3598 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3599 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3600_fsm 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600_vm 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3601_fsm 2024-09-11T22:20:44.970 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601_vm 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3602_fsm 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602_vm 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603_fsm 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3603_vm 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3604 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3605 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3606 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3607 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3608 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 3609 2024-09-11T22:20:44.971 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3712 2024-09-11T22:20:44.972 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764 2024-09-11T22:20:44.972 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3764_fsm 2024-09-11T22:20:44.972 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764_vm 2024-09-11T22:20:44.972 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3766 2024-09-11T22:20:44.972 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3767 2024-09-11T22:20:44.972 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3997 2024-09-11T22:20:44.972 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4143 2024-09-11T22:20:44.972 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4144 2024-09-11T22:20:44.972 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4145 2024-09-11T22:20:44.972 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4146 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4147 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4148 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4149 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4150 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4151 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4152 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4153 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4154 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4155 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4156 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4157 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4158 2024-09-11T22:20:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4159 2024-09-11T22:20:44.974 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4160 2024-09-11T22:20:44.974 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4161 2024-09-11T22:20:44.974 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4162 2024-09-11T22:20:44.975 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4163 2024-09-11T22:20:44.975 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4164 2024-09-11T22:20:44.975 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4165 2024-09-11T22:20:44.975 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4166 2024-09-11T22:20:44.975 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4167 2024-09-11T22:20:44.975 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4168 2024-09-11T22:20:44.975 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4169 2024-09-11T22:20:44.975 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4170 2024-09-11T22:20:44.975 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4171 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4172 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4173 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4174 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 5002 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 548 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 549 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6102 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6104 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6106 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6110 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6111 2024-09-11T22:20:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6112 2024-09-11T22:20:44.977 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6113 2024-09-11T22:20:44.977 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6117 2024-09-11T22:20:44.977 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 826 2024-09-11T22:20:44.977 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 827 2024-09-11T22:20:44.977 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 828 2024-09-11T22:20:44.977 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 22:04 pg_filenode.map 2024-09-11T22:20:44.977 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 PG_VERSION 2024-09-11T22:20:44.977 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:44.977 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-11T22:20:44.977 INFO:teuthology.orchestra.run.smithi152.stdout:total 7777 2024-09-11T22:20:44.977 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 11 22:04 . 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 22:05 .. 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 112 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 113 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:04 1247 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1247_fsm 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1247_vm 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 22:04 1249 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1249_fsm 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1249_vm 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 22:04 1255 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1255_fsm 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1255_vm 2024-09-11T22:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 22:04 1259 2024-09-11T22:20:44.979 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1259_fsm 2024-09-11T22:20:44.979 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1259_vm 2024-09-11T22:20:44.979 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 22:04 13344 2024-09-11T22:20:44.979 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13344_fsm 2024-09-11T22:20:44.979 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13344_vm 2024-09-11T22:20:44.979 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13346 2024-09-11T22:20:44.979 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13348 2024-09-11T22:20:44.979 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13349_fsm 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349_vm 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13351 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13353 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13354_fsm 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354_vm 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13356 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13358 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13359_fsm 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359_vm 2024-09-11T22:20:44.980 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13361 2024-09-11T22:20:44.981 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13363 2024-09-11T22:20:44.981 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1417 2024-09-11T22:20:44.981 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1418 2024-09-11T22:20:44.981 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 174 2024-09-11T22:20:44.981 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 175 2024-09-11T22:20:44.981 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2187 2024-09-11T22:20:44.981 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2224 2024-09-11T22:20:44.981 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2328 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2336 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2337 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2579 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2600 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2600_fsm 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2600_vm 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2601_fsm 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601_vm 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2602 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2602_fsm 2024-09-11T22:20:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2602_vm 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2603 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2603_fsm 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2603_vm 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2604 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2605 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2605_fsm 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2605_vm 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2606 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2606_fsm 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2606_vm 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2607 2024-09-11T22:20:44.983 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2607_fsm 2024-09-11T22:20:44.984 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2607_vm 2024-09-11T22:20:44.984 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 22:04 2608 2024-09-11T22:20:44.984 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2608_fsm 2024-09-11T22:20:44.984 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2608_vm 2024-09-11T22:20:44.984 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 22:04 2609 2024-09-11T22:20:44.984 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2609_fsm 2024-09-11T22:20:44.984 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2609_vm 2024-09-11T22:20:44.984 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2610 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2610_fsm 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2610_vm 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2611 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2612_fsm 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612_vm 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2613 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2615_fsm 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615_vm 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2616 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2616_fsm 2024-09-11T22:20:44.985 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2616_vm 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 22:04 2617 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2617_fsm 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2617_vm 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 22:04 2618 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2618_fsm 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2618_vm 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 11 22:04 2619 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2619_fsm 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2619_vm 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2620 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2650 2024-09-11T22:20:44.986 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2651 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2652 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2653 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2654 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2655 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2656 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2657 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 22:04 2658 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:04 2659 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2660 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2661 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2662 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2663 2024-09-11T22:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2664 2024-09-11T22:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2665 2024-09-11T22:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2666 2024-09-11T22:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2667 2024-09-11T22:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2668 2024-09-11T22:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2669 2024-09-11T22:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2670 2024-09-11T22:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 22:04 2673 2024-09-11T22:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 22:04 2674 2024-09-11T22:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 22:04 2675 2024-09-11T22:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2678 2024-09-11T22:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2679 2024-09-11T22:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2680 2024-09-11T22:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2681 2024-09-11T22:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2682 2024-09-11T22:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2683 2024-09-11T22:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2684 2024-09-11T22:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2685 2024-09-11T22:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2686 2024-09-11T22:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2687 2024-09-11T22:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2688 2024-09-11T22:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2689 2024-09-11T22:20:44.990 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 22:04 2690 2024-09-11T22:20:44.990 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 22:04 2691 2024-09-11T22:20:44.990 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2692 2024-09-11T22:20:44.990 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2693 2024-09-11T22:20:44.990 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2696 2024-09-11T22:20:44.990 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2699 2024-09-11T22:20:44.990 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2701 2024-09-11T22:20:44.990 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2702 2024-09-11T22:20:44.990 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2703 2024-09-11T22:20:44.990 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2704 2024-09-11T22:20:44.990 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2753 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2753_fsm 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2753_vm 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2754 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2755 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2756 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2757 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2830 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2831 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2832 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2833 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2834 2024-09-11T22:20:44.991 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2835 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2836 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2837 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 22:04 2838 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2838_fsm 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2838_vm 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2839 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840_fsm 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2840_vm 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2841 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2995 2024-09-11T22:20:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2996 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3079_fsm 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079_vm 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3080 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3081 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 3085 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3118 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3119 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 22:04 3164 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3256 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3257 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3258 2024-09-11T22:20:44.993 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3350 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3351 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3379 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3380 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3381 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3394 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3394_fsm 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3394_vm 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3395 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3429 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3430 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3431 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3433 2024-09-11T22:20:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3439 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3440 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 3455 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 22:04 3456 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3456_fsm 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3456_vm 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3466 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3467 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3468 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3501 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3502 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3503 2024-09-11T22:20:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3534 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3541_fsm 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541_vm 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3542 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3574 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3575 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3576 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3596 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3597 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3598 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3599 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3600_fsm 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600_vm 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3601_fsm 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601_vm 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3602_fsm 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602_vm 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603_fsm 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3603_vm 2024-09-11T22:20:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3604 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3605 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3606 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3607 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3608 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 3609 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3712 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3764_fsm 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764_vm 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3766 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3767 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3997 2024-09-11T22:20:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4143 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4144 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4145 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4146 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4147 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4148 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4149 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4150 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4151 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4152 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4153 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4154 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4155 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4156 2024-09-11T22:20:44.999 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4157 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4158 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4159 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4160 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4161 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4162 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4163 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4164 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4165 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4166 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4167 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4168 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4169 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4170 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4171 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4172 2024-09-11T22:20:45.012 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4173 2024-09-11T22:20:45.012 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4174 2024-09-11T22:20:45.012 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 5002 2024-09-11T22:20:45.012 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 548 2024-09-11T22:20:45.012 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 549 2024-09-11T22:20:45.012 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6102 2024-09-11T22:20:45.012 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6104 2024-09-11T22:20:45.012 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6106 2024-09-11T22:20:45.012 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6110 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6111 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6112 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6113 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6117 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 826 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 827 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 828 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 22:04 pg_filenode.map 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 PG_VERSION 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-11T22:20:45.013 INFO:teuthology.orchestra.run.smithi152.stdout:total 619046 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 11 22:09 . 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 22:05 .. 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 112 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 113 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:05 1247 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1247_fsm 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:05 1247_vm 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 22:05 1249 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:05 1249_fsm 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:05 1249_vm 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 11 22:04 1255 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1255_fsm 2024-09-11T22:20:45.014 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1255_vm 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 22:20 1259 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1259_fsm 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:05 1259_vm 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 11 22:04 13344 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13344_fsm 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13344_vm 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13346 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13348 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13349_fsm 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13349_vm 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13351 2024-09-11T22:20:45.015 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13353 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13354_fsm 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13354_vm 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13356 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13358 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 13359_fsm 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13359_vm 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 13361 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 13363 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1417 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 1418 2024-09-11T22:20:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 446087168 Sep 11 22:20 16396 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 11 22:20 16396_fsm 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:08 16396_vm 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 786432 Sep 11 22:20 16397 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:20 16397_fsm 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:20 16397_vm 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 2736128 Sep 11 22:20 16399 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:20 16399_fsm 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:20 16399_vm 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:20 16400 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 22:20 16402 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 11 22:20 16404 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 103899136 Sep 11 22:20 16406 2024-09-11T22:20:45.017 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:20 16406_fsm 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:16 16406_vm 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 174 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 175 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2187 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2224 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2328 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2336 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2337 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:05 2579 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2600 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2600_fsm 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2600_vm 2024-09-11T22:20:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2601_fsm 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2601_vm 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2602 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2602_fsm 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2602_vm 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2603 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2603_fsm 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2603_vm 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2604 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2605 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2605_fsm 2024-09-11T22:20:45.019 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2605_vm 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:05 2606 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2606_fsm 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:05 2606_vm 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2607 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2607_fsm 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2607_vm 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 22:05 2608 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2608_fsm 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:05 2608_vm 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 11 22:04 2609 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2609_fsm 2024-09-11T22:20:45.020 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2609_vm 2024-09-11T22:20:45.021 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:05 2610 2024-09-11T22:20:45.021 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2610_fsm 2024-09-11T22:20:45.021 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:05 2610_vm 2024-09-11T22:20:45.021 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2611 2024-09-11T22:20:45.021 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612 2024-09-11T22:20:45.021 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2612_fsm 2024-09-11T22:20:45.021 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2612_vm 2024-09-11T22:20:45.021 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2613 2024-09-11T22:20:45.021 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2615_fsm 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2615_vm 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2616 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2616_fsm 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2616_vm 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 11 22:04 2617 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2617_fsm 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2617_vm 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 11 22:04 2618 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2618_fsm 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2618_vm 2024-09-11T22:20:45.022 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Sep 11 22:20 2619 2024-09-11T22:20:45.023 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:07 2619_fsm 2024-09-11T22:20:45.023 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:05 2619_vm 2024-09-11T22:20:45.023 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2620 2024-09-11T22:20:45.023 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2650 2024-09-11T22:20:45.023 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2651 2024-09-11T22:20:45.023 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2652 2024-09-11T22:20:45.023 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2653 2024-09-11T22:20:45.023 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2654 2024-09-11T22:20:45.023 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2655 2024-09-11T22:20:45.023 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2656 2024-09-11T22:20:45.023 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2657 2024-09-11T22:20:45.024 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 22:05 2658 2024-09-11T22:20:45.024 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:05 2659 2024-09-11T22:20:45.024 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2660 2024-09-11T22:20:45.024 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2661 2024-09-11T22:20:45.024 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:05 2662 2024-09-11T22:20:45.024 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:05 2663 2024-09-11T22:20:45.024 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:05 2664 2024-09-11T22:20:45.024 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:05 2665 2024-09-11T22:20:45.024 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:05 2666 2024-09-11T22:20:45.024 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:05 2667 2024-09-11T22:20:45.024 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2668 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2669 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2670 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 22:05 2673 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 22:05 2674 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 11 22:04 2675 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:05 2678 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:05 2679 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2680 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2681 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2682 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2683 2024-09-11T22:20:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2684 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2685 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2686 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2687 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 2688 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 22:04 2689 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 22:04 2690 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 11 22:04 2691 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2692 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2693 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:10 2696 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2699 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2701 2024-09-11T22:20:45.026 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2702 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:05 2703 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:05 2704 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2753 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2753_fsm 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2753_vm 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2754 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2755 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2756 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 2757 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2830 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2831 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2832 2024-09-11T22:20:45.027 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2833 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2834 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2835 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2836 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2837 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 11 22:04 2838 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2838_fsm 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2838_vm 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2839 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2840_fsm 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2840_vm 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2841 2024-09-11T22:20:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2995 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2996 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3079_fsm 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3079_vm 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3080 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3081 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:04 3085 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3118 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3119 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 22:04 3164 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3256 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3257 2024-09-11T22:20:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3258 2024-09-11T22:20:45.030 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3350 2024-09-11T22:20:45.030 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3351 2024-09-11T22:20:45.030 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3379 2024-09-11T22:20:45.030 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3380 2024-09-11T22:20:45.030 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3381 2024-09-11T22:20:45.030 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3394 2024-09-11T22:20:45.030 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3394_fsm 2024-09-11T22:20:45.030 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3394_vm 2024-09-11T22:20:45.030 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3395 2024-09-11T22:20:45.030 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3429 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3430 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3431 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3433 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3439 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3440 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 22:05 3455 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 11 22:04 3456 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3456_fsm 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3456_vm 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3466 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3467 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3468 2024-09-11T22:20:45.031 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3501 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3502 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3503 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3534 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3541_fsm 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3541_vm 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3542 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3574 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3575 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3576 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3596 2024-09-11T22:20:45.032 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3597 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3598 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3599 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3600_fsm 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3600_vm 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3601_fsm 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3601_vm 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3602_fsm 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3602_vm 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603 2024-09-11T22:20:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3603_fsm 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3603_vm 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3604 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3605 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3606 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3607 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3608 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 22:04 3609 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3712 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 3764_fsm 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3764_vm 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3766 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 3767 2024-09-11T22:20:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3997 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4143 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4144 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4145 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4146 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4147 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4148 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4149 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4150 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4151 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4152 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4153 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4154 2024-09-11T22:20:45.035 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4155 2024-09-11T22:20:45.036 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4156 2024-09-11T22:20:45.036 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4157 2024-09-11T22:20:45.036 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4158 2024-09-11T22:20:45.036 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4159 2024-09-11T22:20:45.037 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4160 2024-09-11T22:20:45.037 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4161 2024-09-11T22:20:45.037 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4162 2024-09-11T22:20:45.037 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4163 2024-09-11T22:20:45.037 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4164 2024-09-11T22:20:45.037 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4165 2024-09-11T22:20:45.037 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4166 2024-09-11T22:20:45.037 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4167 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4168 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4169 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4170 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4171 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4172 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4173 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4174 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 5002 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 548 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 549 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6102 2024-09-11T22:20:45.038 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6104 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6106 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6110 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6111 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6112 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6113 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6117 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 826 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 827 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 828 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 22:04 pg_filenode.map 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 11 22:05 pg_internal.init 2024-09-11T22:20:45.039 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:04 PG_VERSION 2024-09-11T22:20:45.040 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.040 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-11T22:20:45.040 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:05 . 2024-09-11T22:20:45.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 11 22:05 .. 2024-09-11T22:20:45.040 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.040 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/global: 2024-09-11T22:20:45.040 INFO:teuthology.orchestra.run.smithi152.stdout:total 560 2024-09-11T22:20:45.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 11 22:05 . 2024-09-11T22:20:45.040 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.040 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1213 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1213_fsm 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1213_vm 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1214 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1214_fsm 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1214_vm 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 1232 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 1233 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1260 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1260_fsm 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1260_vm 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1261 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1261_fsm 2024-09-11T22:20:45.041 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1261_vm 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1262 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 1262_fsm 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 1262_vm 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2396 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 22:04 2396_fsm 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2396_vm 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2397 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2671 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2672 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2676 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2677 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2694 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2695 2024-09-11T22:20:45.042 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2697 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 22:04 2698 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2846 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2847 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2964 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2965 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 2966 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 2967 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 3592 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 3593 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4060 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4061 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4175 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4176 2024-09-11T22:20:45.043 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4177 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4178 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4181 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4182 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4183 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4184 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 4185 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 4186 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6000 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6001 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6002 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 6100 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6114 2024-09-11T22:20:45.044 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 6115 2024-09-11T22:20:45.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:20 pg_control 2024-09-11T22:20:45.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 11 22:04 pg_filenode.map 2024-09-11T22:20:45.045 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 11 22:05 pg_internal.init 2024-09-11T22:20:45.045 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.045 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/log: 2024-09-11T22:20:45.045 INFO:teuthology.orchestra.run.smithi152.stdout:total 2 2024-09-11T22:20:45.045 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:05 . 2024-09-11T22:20:45.045 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.046 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1892 Sep 11 22:20 postgresql-Wed.log 2024-09-11T22:20:45.046 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.046 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-11T22:20:45.046 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.046 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:20:45.046 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.046 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.046 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-11T22:20:45.046 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:total 1 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:20 . 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 mappings 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 11 22:20 replorigin_checkpoint 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 snapshots 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.047 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:20:45.048 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:20 .. 2024-09-11T22:20:45.048 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.048 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-11T22:20:45.048 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.048 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:20:45.048 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:20 .. 2024-09-11T22:20:45.048 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.048 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-11T22:20:45.048 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.048 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:04 . 2024-09-11T22:20:45.048 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 members 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 offsets 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout:total 8 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 . 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:04 .. 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:04 0000 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout:total 8 2024-09-11T22:20:45.049 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:04 . 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:04 .. 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 22:08 0000 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:20:45.050 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.051 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:total 15 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 11 22:20 . 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 11 22:20 db_0.stat 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 11 22:20 db_13494.stat 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 11 22:20 global.stat 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:20 . 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-11T22:20:45.052 INFO:teuthology.orchestra.run.smithi152.stdout:total 80 2024-09-11T22:20:45.053 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 11 22:20 . 2024-09-11T22:20:45.053 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.053 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 22:20 001E 2024-09-11T22:20:45.053 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.053 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-11T22:20:45.053 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.053 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:20:45.053 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.053 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.053 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-11T22:20:45.053 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:total 1048576 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 11 22:20 . 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:20 0000000100000000000000A6 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000A7 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000A8 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000A9 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000AA 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:12 0000000100000000000000AB 2024-09-11T22:20:45.054 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:12 0000000100000000000000AC 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000AD 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000AE 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:15 0000000100000000000000AF 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000B0 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000B1 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000B2 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000B3 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000B4 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000B5 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000B6 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000B7 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000B8 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:13 0000000100000000000000B9 2024-09-11T22:20:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:12 0000000100000000000000BA 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:15 0000000100000000000000BB 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:14 0000000100000000000000BC 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:13 0000000100000000000000BD 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:11 0000000100000000000000BE 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000BF 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:15 0000000100000000000000C0 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000C1 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:18 0000000100000000000000C2 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:15 0000000100000000000000C3 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:17 0000000100000000000000C4 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:19 0000000100000000000000C5 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:17 0000000100000000000000C6 2024-09-11T22:20:45.056 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:15 0000000100000000000000C7 2024-09-11T22:20:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000C8 2024-09-11T22:20:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000C9 2024-09-11T22:20:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:20 0000000100000000000000CA 2024-09-11T22:20:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:15 0000000100000000000000CB 2024-09-11T22:20:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000CC 2024-09-11T22:20:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:15 0000000100000000000000CD 2024-09-11T22:20:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:18 0000000100000000000000CE 2024-09-11T22:20:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:19 0000000100000000000000CF 2024-09-11T22:20:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:20 0000000100000000000000D0 2024-09-11T22:20:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:15 0000000100000000000000D1 2024-09-11T22:20:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:17 0000000100000000000000D2 2024-09-11T22:20:45.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000D3 2024-09-11T22:20:45.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:17 0000000100000000000000D4 2024-09-11T22:20:45.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000D5 2024-09-11T22:20:45.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:17 0000000100000000000000D6 2024-09-11T22:20:45.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:15 0000000100000000000000D7 2024-09-11T22:20:45.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:19 0000000100000000000000D8 2024-09-11T22:20:45.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000D9 2024-09-11T22:20:45.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:15 0000000100000000000000DA 2024-09-11T22:20:45.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000DB 2024-09-11T22:20:45.058 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000DC 2024-09-11T22:20:45.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000DD 2024-09-11T22:20:45.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:17 0000000100000000000000DE 2024-09-11T22:20:45.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:15 0000000100000000000000DF 2024-09-11T22:20:45.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:17 0000000100000000000000E0 2024-09-11T22:20:45.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:19 0000000100000000000000E1 2024-09-11T22:20:45.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000E2 2024-09-11T22:20:45.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000E3 2024-09-11T22:20:45.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000E4 2024-09-11T22:20:45.059 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 22:16 0000000100000000000000E5 2024-09-11T22:20:45.059 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 archive_status 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout:total 0 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 22:04 . 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 11 22:20 .. 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout:total 488 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 11 22:11 . 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 11 22:20 .. 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 11 22:11 0000 2024-09-11T22:20:45.060 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 237568 Sep 11 22:20 0001 2024-09-11T22:20:45.061 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-11T22:20:45.074 INFO:tasks.quiescer:joining Quiescers 2024-09-11T22:20:45.074 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-11T22:20:45.074 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:20:45.362 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T22:20:45.409 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:45.416 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:45.962 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:45 smithi152 ceph-mon[31188]: pgmap v517: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 27 MiB/s wr, 2.24k op/s 2024-09-11T22:20:45.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.961+0000 7efd0ac38640 1 -- 172.21.15.152:0/2489919451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd04100a80 msgr2=0x7efd04100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.961+0000 7efd0ac38640 1 --2- 172.21.15.152:0/2489919451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd04100a80 0x7efd04100ee0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009930 tx=0x7efcf002a420 comp rx=0 tx=0).stop 2024-09-11T22:20:45.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.961+0000 7efd0ac38640 1 -- 172.21.15.152:0/2489919451 shutdown_connections 2024-09-11T22:20:45.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.961+0000 7efd0ac38640 1 --2- 172.21.15.152:0/2489919451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd04101420 0x7efd0410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.961+0000 7efd0ac38640 1 --2- 172.21.15.152:0/2489919451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd04100a80 0x7efd04100ee0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.961+0000 7efd0ac38640 1 --2- 172.21.15.152:0/2489919451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04106a80 0x7efd04106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.961+0000 7efd0ac38640 1 -- 172.21.15.152:0/2489919451 >> 172.21.15.152:0/2489919451 conn(0x7efd040fc7a0 msgr2=0x7efd040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:45.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.961+0000 7efd0ac38640 1 -- 172.21.15.152:0/2489919451 shutdown_connections 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.961+0000 7efd0ac38640 1 -- 172.21.15.152:0/2489919451 wait complete. 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd0ac38640 1 Processor -- start 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd0ac38640 1 -- start start 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd0ac38640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd04100a80 0x7efd040fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd0ac38640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04101420 0x7efd040fd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd0ac38640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd04106a80 0x7efd040fd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd0ac38640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efd04110e80 con 0x7efd04100a80 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd0ac38640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efd04110d00 con 0x7efd04106a80 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd0ac38640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efd04111000 con 0x7efd04101420 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd089d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd04100a80 0x7efd040fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd089d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd04100a80 0x7efd040fce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58592/0 (socket says 172.21.15.152:58592) 2024-09-11T22:20:45.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd089d4640 1 -- 172.21.15.152:0/980287700 learned_addr learned my addr 172.21.15.152:0/980287700 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd03fff640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04101420 0x7efd040fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd091d5640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd04106a80 0x7efd040fd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd089d4640 1 -- 172.21.15.152:0/980287700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04101420 msgr2=0x7efd040fd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd089d4640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04101420 0x7efd040fd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd089d4640 1 -- 172.21.15.152:0/980287700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd04106a80 msgr2=0x7efd040fd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd089d4640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd04106a80 0x7efd040fd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd089d4640 1 -- 172.21.15.152:0/980287700 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd041a68f0 con 0x7efd04100a80 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd03fff640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04101420 0x7efd040fd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.962+0000 7efd091d5640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd04106a80 0x7efd040fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.963+0000 7efd089d4640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd04100a80 0x7efd040fce30 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7efcf800d770 tx=0x7efcf800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.963+0000 7efd01ffb640 1 -- 172.21.15.152:0/980287700 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8017070 con 0x7efd04100a80 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.963+0000 7efd01ffb640 1 -- 172.21.15.152:0/980287700 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf8005500 con 0x7efd04100a80 2024-09-11T22:20:45.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.963+0000 7efd0ac38640 1 -- 172.21.15.152:0/980287700 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd041a6be0 con 0x7efd04100a80 2024-09-11T22:20:45.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.963+0000 7efd01ffb640 1 -- 172.21.15.152:0/980287700 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8004e00 con 0x7efd04100a80 2024-09-11T22:20:45.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.963+0000 7efd0ac38640 1 -- 172.21.15.152:0/980287700 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd041a70d0 con 0x7efd04100a80 2024-09-11T22:20:45.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.964+0000 7efd0ac38640 1 -- 172.21.15.152:0/980287700 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd04100ee0 con 0x7efd04100a80 2024-09-11T22:20:45.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.965+0000 7efd01ffb640 1 -- 172.21.15.152:0/980287700 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7efcf8004fa0 con 0x7efd04100a80 2024-09-11T22:20:45.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.966+0000 7efd01ffb640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efcf40a2cf0 0x7efcf40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.966+0000 7efd03fff640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efcf40a2cf0 0x7efcf40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.966+0000 7efd01ffb640 1 -- 172.21.15.152:0/980287700 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7efcf80cef30 con 0x7efd04100a80 2024-09-11T22:20:45.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.966+0000 7efd03fff640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efcf40a2cf0 0x7efcf40a51b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efcf0000c00 tx=0x7efcf0032c70 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:45.970+0000 7efd01ffb640 1 -- 172.21.15.152:0/980287700 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcf809baf0 con 0x7efd04100a80 2024-09-11T22:20:46.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:45 smithi179 ceph-mon[35603]: pgmap v517: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 27 MiB/s wr, 2.24k op/s 2024-09-11T22:20:46.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:45 smithi193 ceph-mon[35545]: pgmap v517: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 27 MiB/s wr, 2.24k op/s 2024-09-11T22:20:46.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.174+0000 7efd0ac38640 1 -- 172.21.15.152:0/980287700 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd040fe360 con 0x7efd04100a80 2024-09-11T22:20:46.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.175+0000 7efd01ffb640 1 -- 172.21.15.152:0/980287700 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11923 (secure 0 0 0) 0x7efcf809b3f0 con 0x7efd04100a80 2024-09-11T22:20:46.176 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:46.176 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"btime":"2024-09-11T22:07:38:856769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:07:38.806633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:20:46.177 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-09-11T22:20:46.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.177+0000 7efd0ac38640 1 -- 172.21.15.152:0/980287700 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efcf40a2cf0 msgr2=0x7efcf40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.177+0000 7efd0ac38640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efcf40a2cf0 0x7efcf40a51b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efcf0000c00 tx=0x7efcf0032c70 comp rx=0 tx=0).stop 2024-09-11T22:20:46.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.177+0000 7efd0ac38640 1 -- 172.21.15.152:0/980287700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd04100a80 msgr2=0x7efd040fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.177+0000 7efd0ac38640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd04100a80 0x7efd040fce30 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7efcf800d770 tx=0x7efcf800dc30 comp rx=0 tx=0).stop 2024-09-11T22:20:46.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.177+0000 7efd0ac38640 1 -- 172.21.15.152:0/980287700 shutdown_connections 2024-09-11T22:20:46.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.177+0000 7efd0ac38640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7efcf40a2cf0 0x7efcf40a51b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.177+0000 7efd0ac38640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd04106a80 0x7efd040fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.177+0000 7efd0ac38640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04101420 0x7efd040fd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.177+0000 7efd0ac38640 1 --2- 172.21.15.152:0/980287700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd04100a80 0x7efd040fce30 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.177+0000 7efd0ac38640 1 -- 172.21.15.152:0/980287700 >> 172.21.15.152:0/980287700 conn(0x7efd040fc7a0 msgr2=0x7efd0406aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.178+0000 7efd0ac38640 1 -- 172.21.15.152:0/980287700 shutdown_connections 2024-09-11T22:20:46.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.178+0000 7efd0ac38640 1 -- 172.21.15.152:0/980287700 wait complete. 2024-09-11T22:20:46.759 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --cancel --all' 2024-09-11T22:20:46.759 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --cancel --all 2024-09-11T22:20:46.840 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:46 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/980287700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:20:46.921 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:46.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.939+0000 7fc2da323640 1 -- 172.21.15.152:0/1733506834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d4106a90 msgr2=0x7fc2d4106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.939+0000 7fc2da323640 1 --2- 172.21.15.152:0/1733506834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d4106a90 0x7fc2d4106e70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009930 tx=0x7fc2c402a420 comp rx=0 tx=0).stop 2024-09-11T22:20:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.939+0000 7fc2da323640 1 -- 172.21.15.152:0/1733506834 shutdown_connections 2024-09-11T22:20:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.939+0000 7fc2da323640 1 --2- 172.21.15.152:0/1733506834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4101430 0x7fc2d410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.939+0000 7fc2da323640 1 --2- 172.21.15.152:0/1733506834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2d4100a90 0x7fc2d4100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.939+0000 7fc2da323640 1 --2- 172.21.15.152:0/1733506834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d4106a90 0x7fc2d4106e70 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.939+0000 7fc2da323640 1 -- 172.21.15.152:0/1733506834 >> 172.21.15.152:0/1733506834 conn(0x7fc2d40fc7d0 msgr2=0x7fc2d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.939+0000 7fc2da323640 1 -- 172.21.15.152:0/1733506834 shutdown_connections 2024-09-11T22:20:46.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.939+0000 7fc2da323640 1 -- 172.21.15.152:0/1733506834 wait complete. 2024-09-11T22:20:46.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.940+0000 7fc2da323640 1 Processor -- start 2024-09-11T22:20:46.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.940+0000 7fc2da323640 1 -- start start 2024-09-11T22:20:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.940+0000 7fc2da323640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2d4100a90 0x7fc2d41982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.940+0000 7fc2da323640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d4101430 0x7fc2d4198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2da323640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4106a90 0x7fc2d419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2da323640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d4110ee0 con 0x7fc2d4101430 2024-09-11T22:20:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2da323640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d4110d60 con 0x7fc2d4106a90 2024-09-11T22:20:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2da323640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d4111060 con 0x7fc2d4100a90 2024-09-11T22:20:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d4101430 0x7fc2d4198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d4101430 0x7fc2d4198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58608/0 (socket says 172.21.15.152:58608) 2024-09-11T22:20:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d37fe640 1 -- 172.21.15.152:0/1165277728 learned_addr learned my addr 172.21.15.152:0/1165277728 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:46.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d88c0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4106a90 0x7fc2d419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d3fff640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2d4100a90 0x7fc2d41982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d37fe640 1 -- 172.21.15.152:0/1165277728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2d4100a90 msgr2=0x7fc2d41982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2d4100a90 0x7fc2d41982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d37fe640 1 -- 172.21.15.152:0/1165277728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4106a90 msgr2=0x7fc2d419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4106a90 0x7fc2d419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d37fe640 1 -- 172.21.15.152:0/1165277728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d419d280 con 0x7fc2d4101430 2024-09-11T22:20:46.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d88c0640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4106a90 0x7fc2d419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:46.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.941+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d4101430 0x7fc2d4198810 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800d950 tx=0x7fc2c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.942+0000 7fc2d17fa640 1 -- 172.21.15.152:0/1165277728 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8017070 con 0x7fc2d4101430 2024-09-11T22:20:46.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.942+0000 7fc2d17fa640 1 -- 172.21.15.152:0/1165277728 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2c8009c30 con 0x7fc2d4101430 2024-09-11T22:20:46.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.942+0000 7fc2d17fa640 1 -- 172.21.15.152:0/1165277728 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800f6b0 con 0x7fc2d4101430 2024-09-11T22:20:46.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.942+0000 7fc2da323640 1 -- 172.21.15.152:0/1165277728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d419d570 con 0x7fc2d4101430 2024-09-11T22:20:46.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.942+0000 7fc2da323640 1 -- 172.21.15.152:0/1165277728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d41a4e50 con 0x7fc2d4101430 2024-09-11T22:20:46.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.945+0000 7fc2dc6fc740 1 Processor -- start 2024-09-11T22:20:46.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.945+0000 7fc2dc6fc740 1 -- start start 2024-09-11T22:20:46.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.946+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 0x55b719e10c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.946+0000 7fc2d17fa640 1 -- 172.21.15.152:0/1165277728 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fc2c80109d0 con 0x7fc2d4101430 2024-09-11T22:20:46.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.946+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e11170 0x55b719e1b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.946+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e1de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.946+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b719d75160 con 0x55b719e1ba30 2024-09-11T22:20:46.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.946+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b719d1c720 con 0x55b719e11170 2024-09-11T22:20:46.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.946+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b719d71120 con 0x55b719e10850 2024-09-11T22:20:46.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.946+0000 7fc2d3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e11170 0x55b719e1b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.946+0000 7fc2d3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e11170 0x55b719e1b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.152:54046/0 (socket says 172.21.15.152:54046) 2024-09-11T22:20:46.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.946+0000 7fc2d3fff640 1 -- 172.21.15.152:0/3673679173 learned_addr learned my addr 172.21.15.152:0/3673679173 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:46.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.946+0000 7fc2d88c0640 1 --2- 172.21.15.152:0/3673679173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 0x55b719e10c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/3673679173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e1de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2d88c0640 1 -- 172.21.15.152:0/3673679173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e11170 msgr2=0x55b719e1b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2d88c0640 1 --2- 172.21.15.152:0/3673679173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e11170 0x55b719e1b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2d88c0640 1 -- 172.21.15.152:0/3673679173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 msgr2=0x55b719e1de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2d88c0640 1 --2- 172.21.15.152:0/3673679173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e1de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2d88c0640 1 -- 172.21.15.152:0/3673679173 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b719ae6ba0 con 0x55b719e10850 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/3673679173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e1de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2d17fa640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc2bc0a2d70 0x7fc2bc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2d88c0640 1 --2- 172.21.15.152:0/3673679173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 0x55b719e10c30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc010770 tx=0x7fc2cc010c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a526dc32a00dccb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2d17fa640 1 -- 172.21.15.152:0/1165277728 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7fc2c80cf050 con 0x7fc2d4101430 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2d3fff640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc2bc0a2d70 0x7fc2bc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.947+0000 7fc2ba7fc640 1 -- 172.21.15.152:0/3673679173 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc003970 con 0x55b719e10850 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.948+0000 7fc2ba7fc640 1 -- 172.21.15.152:0/3673679173 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2cc00e930 con 0x55b719e10850 2024-09-11T22:20:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.948+0000 7fc2ba7fc640 1 -- 172.21.15.152:0/3673679173 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc004660 con 0x55b719e10850 2024-09-11T22:20:46.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.948+0000 7fc2d3fff640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc2bc0a2d70 0x7fc2bc0a5230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40096c0 tx=0x7fc2c400b040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.948+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/3673679173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 msgr2=0x55b719e10c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.948+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/3673679173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 0x55b719e10c30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc010770 tx=0x7fc2cc010c30 comp rx=0 tx=0).stop 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.949+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/3673679173 shutdown_connections 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.949+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/3673679173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e1de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.949+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/3673679173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e11170 0x55b719e1b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.949+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/3673679173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 0x55b719e10c30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.949+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/3673679173 >> 172.21.15.152:0/3673679173 conn(0x55b719e0cde0 msgr2=0x55b719e0d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.949+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/3673679173 shutdown_connections 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.949+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/3673679173 wait complete. 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.949+0000 7fc2dc6fc740 1 -- start start 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2dc6fc740 1 Processor -- start 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e10850 0x55b719e18870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 0x55b719e18db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e192f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b719e1e650 con 0x55b719e1ba30 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b719cfd900 con 0x55b719e10850 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b719e1e7d0 con 0x55b719e11170 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2dc6fc740 10 client.0 _ll_register_callbacks cb 0x55b719cfb780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2d88c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2d37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 0x55b719e18db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2d88c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e192f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58628/0 (socket says 172.21.15.152:58628) 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2d88c0640 1 -- 172.21.15.152:0/2162008229 learned_addr learned my addr 172.21.15.152:0/2162008229 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.950+0000 7fc2d3fff640 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e10850 0x55b719e18870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2d37fe640 1 -- 172.21.15.152:0/2162008229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e10850 msgr2=0x55b719e18870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e10850 0x55b719e18870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2d37fe640 1 -- 172.21.15.152:0/2162008229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 msgr2=0x55b719e192f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e192f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2d37fe640 1 -- 172.21.15.152:0/2162008229 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b719d3dc50 con 0x55b719e11170 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2d88c0640 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e192f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 0x55b719e18db0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80cc6e0 tx=0x7fc2c8000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=449488c0d4eb5616 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2162008229 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8020070 con 0x55b719e11170 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2162008229 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7fc2c80cc960 con 0x55b719e11170 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2162008229 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2cc00e930 con 0x55b719e11170 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2162008229 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc2c809b560 con 0x55b719e11170 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2dc6fc740 10 client.28822 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2162008229 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b719e2a2a0 con 0x55b719e11170 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.951+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2162008229 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2cc00e930 con 0x55b719e11170 2024-09-11T22:20:46.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.952+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2162008229 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fc2c809a9b0 con 0x55b719e11170 2024-09-11T22:20:46.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.952+0000 7fc2dc6fc740 10 client.28822 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:46.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.952+0000 7fc2dc6fc740 10 client.28822 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:20:46.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.952+0000 7fc2dc6fc740 20 client.28822 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:46.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.952+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b719e2b810 0x55b719e2dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.952+0000 7fc2dc6fc740 4 client.28822 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:46.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.952+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2162008229 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b719d82890 con 0x55b719e2b810 2024-09-11T22:20:46.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.953+0000 7fc2d3fff640 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b719e2b810 0x55b719e2dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.953+0000 7fc2d3fff640 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b719e2b810 0x55b719e2dc00 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf388a63352bbc99 server_cookie=d0743a8fbb93c24a in_seq=0 out_seq=0 2024-09-11T22:20:46.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.953+0000 7fc2b37fe640 10 client.28822 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:46.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2162008229 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b719d82890 con 0x55b719e2b810 2024-09-11T22:20:46.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2b37fe640 10 client.28822 handle_command_reply: tid=0 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 1 client.28822 shutdown 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2162008229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 msgr2=0x55b719e18db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 0x55b719e18db0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80cc6e0 tx=0x7fc2c8000bc0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2162008229 shutdown_connections 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b719e2b810 0x55b719e2dc00 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e192f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 0x55b719e18db0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2162008229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e10850 0x55b719e18870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2b37fe640 0 client.28822 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2162008229 >> 172.21.15.152:0/2162008229 conn(0x55b719e0cde0 msgr2=0x55b719e12ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2162008229 shutdown_connections 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2162008229 wait complete. 2024-09-11T22:20:46.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.954+0000 7fc2dc6fc740 20 client.28822 trim_cache size 0 max 16384 2024-09-11T22:20:46.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.978+0000 7fc2dc6fc740 1 Processor -- start 2024-09-11T22:20:46.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.978+0000 7fc2dc6fc740 1 -- start start 2024-09-11T22:20:46.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.978+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e10850 0x55b719e1a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.978+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 0x55b719e33350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.978+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e33890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.978+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d41b02c0 con 0x55b719e1ba30 2024-09-11T22:20:46.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.978+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d41adb90 con 0x55b719e10850 2024-09-11T22:20:46.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.978+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d41aba00 con 0x55b719e11170 2024-09-11T22:20:46.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d88c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e33890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 0x55b719e33350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e10850 0x55b719e1a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d88c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e33890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58644/0 (socket says 172.21.15.152:58644) 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 0x55b719e33350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.152:53308/0 (socket says 172.21.15.152:53308) 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d88c0640 1 -- 172.21.15.152:0/1993350701 learned_addr learned my addr 172.21.15.152:0/1993350701 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d37fe640 1 -- 172.21.15.152:0/1993350701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e10850 msgr2=0x55b719e1a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/1993350701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e10850 0x55b719e1a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d37fe640 1 -- 172.21.15.152:0/1993350701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 msgr2=0x55b719e33890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/1993350701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e33890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d37fe640 1 -- 172.21.15.152:0/1993350701 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b719e2df70 con 0x55b719e11170 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/1993350701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 0x55b719e33350 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8099810 tx=0x7fc2c800bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7904243f99c0bd3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2b9ffb640 1 -- 172.21.15.152:0/1993350701 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8020070 con 0x55b719e11170 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2b9ffb640 1 -- 172.21.15.152:0/1993350701 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2c809f860 con 0x55b719e11170 2024-09-11T22:20:46.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.979+0000 7fc2b9ffb640 1 -- 172.21.15.152:0/1993350701 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80b44a0 con 0x55b719e11170 2024-09-11T22:20:46.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.980+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/1993350701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 msgr2=0x55b719e33350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.980+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/1993350701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 0x55b719e33350 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8099810 tx=0x7fc2c800bf60 comp rx=0 tx=0).stop 2024-09-11T22:20:46.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.980+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/1993350701 shutdown_connections 2024-09-11T22:20:46.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.980+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/1993350701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e1ba30 0x55b719e33890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.980+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/1993350701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e11170 0x55b719e33350 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.980+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/1993350701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e10850 0x55b719e1a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.980+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/1993350701 >> 172.21.15.152:0/1993350701 conn(0x55b719e0cde0 msgr2=0x55b719e1a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.980+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/1993350701 shutdown_connections 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.980+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/1993350701 wait complete. 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.981+0000 7fc2dc6fc740 1 -- start start 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.981+0000 7fc2dc6fc740 1 Processor -- start 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.981+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 0x55b719e23a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.981+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e11170 0x55b719e23fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.981+0000 7fc2dc6fc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e1ba30 0x55b719e8f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.981+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d41ac050 con 0x55b719e11170 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.981+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d41ad4c0 con 0x55b719e1ba30 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.981+0000 7fc2d37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e11170 0x55b719e23fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2d37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e11170 0x55b719e23fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58648/0 (socket says 172.21.15.152:58648) 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2d37fe640 1 -- 172.21.15.152:0/2520871755 learned_addr learned my addr 172.21.15.152:0/2520871755 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:46.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2d3fff640 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 0x55b719e23a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2dc6fc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d41ac720 con 0x55b719e10850 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2d88c0640 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e1ba30 0x55b719e8f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2dc6fc740 10 client.0 _ll_register_callbacks cb 0x7fc2c800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2d3fff640 1 -- 172.21.15.152:0/2520871755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e1ba30 msgr2=0x55b719e8f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2d3fff640 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e1ba30 0x55b719e8f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2d3fff640 1 -- 172.21.15.152:0/2520871755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e11170 msgr2=0x55b719e23fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2d3fff640 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e11170 0x55b719e23fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2d3fff640 1 -- 172.21.15.152:0/2520871755 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b719e8f900 con 0x55b719e10850 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e11170 0x55b719e23fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2d3fff640 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 0x55b719e23a70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55b719e0dc40 tx=0x7fc2c4005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14590285ee05a342 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2520871755 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4056060 con 0x55b719e10850 2024-09-11T22:20:46.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2520871755 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7fc2c403dd70 con 0x55b719e10850 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.982+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2520871755 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2c809f860 con 0x55b719e10850 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2520871755 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc2c4035040 con 0x55b719e10850 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2dc6fc740 10 client.28828 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2520871755 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b719e9ad20 con 0x55b719e10850 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2520871755 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2c809f860 con 0x55b719e10850 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2520871755 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fc2c4044040 con 0x55b719e10850 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2dc6fc740 10 client.28828 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2dc6fc740 10 client.28828 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2dc6fc740 20 client.28828 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b719e9b460 0x55b719e9d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2dc6fc740 4 client.28828 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.25, "await_for": 45.0}] 2024-09-11T22:20:46.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2520871755 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.25, "await_for": 45.0}) -- 0x55b719d7cbe0 con 0x55b719e9b460 2024-09-11T22:20:46.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.983+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b719e9b460 0x55b719e9d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.984+0000 7fc2b37fe640 10 client.28828 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:46.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:46.984+0000 7fc2d37fe640 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b719e9b460 0x55b719e9d880 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be27ea82e48da31c server_cookie=f78b3972cca8444c in_seq=0 out_seq=0 2024-09-11T22:20:47.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:46 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/980287700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:20:47.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:46 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/980287700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:20:47.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2b37fe640 1 -- 172.21.15.152:0/2520871755 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b719d7cbe0 con 0x55b719e9b460 2024-09-11T22:20:47.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2b37fe640 10 client.28828 handle_command_reply: tid=0 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 1 client.28828 shutdown 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2520871755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 msgr2=0x55b719e23a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 0x55b719e23a70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55b719e0dc40 tx=0x7fc2c4005fd0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2520871755 shutdown_connections 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55b719e9b460 0x55b719e9d880 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b719e1ba30 0x55b719e8f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b719e11170 0x55b719e23fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2b37fe640 0 client.28828 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 1 --2- 172.21.15.152:0/2520871755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b719e10850 0x55b719e23a70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2520871755 >> 172.21.15.152:0/2520871755 conn(0x55b719e0cde0 msgr2=0x55b719e1a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2520871755 shutdown_connections 2024-09-11T22:20:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 1 -- 172.21.15.152:0/2520871755 wait complete. 2024-09-11T22:20:47.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.498+0000 7fc2dc6fc740 20 client.28828 trim_cache size 0 max 16384 2024-09-11T22:20:47.501 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:20:47.501 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:20:47.501 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:20:47.501 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 58, 2024-09-11T22:20:47.501 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": { 2024-09-11T22:20:47.501 INFO:teuthology.orchestra.run.smithi152.stdout: "b5ffbba5": { 2024-09-11T22:20:47.501 INFO:teuthology.orchestra.run.smithi152.stdout: "version": 58, 2024-09-11T22:20:47.501 INFO:teuthology.orchestra.run.smithi152.stdout: "age_ref": 0.0, 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: "timeout": 90.0, 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: "expiration": 144.2, 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: "members": { 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: "file:/": { 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: "excluded": false, 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: "state": { 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "QUIESCED", 2024-09-11T22:20:47.502 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.0 2024-09-11T22:20:47.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:47.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:47.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:47.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:47.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:47.503 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:20:47.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 -- 172.21.15.152:0/1165277728 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc2bc0a2d70 msgr2=0x7fc2bc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc2bc0a2d70 0x7fc2bc0a5230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40096c0 tx=0x7fc2c400b040 comp rx=0 tx=0).stop 2024-09-11T22:20:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 -- 172.21.15.152:0/1165277728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d4101430 msgr2=0x7fc2d4198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d4101430 0x7fc2d4198810 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800d950 tx=0x7fc2c800de10 comp rx=0 tx=0).stop 2024-09-11T22:20:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 -- 172.21.15.152:0/1165277728 shutdown_connections 2024-09-11T22:20:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fc2bc0a2d70 0x7fc2bc0a5230 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4106a90 0x7fc2d419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d4101430 0x7fc2d4198810 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 --2- 172.21.15.152:0/1165277728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2d4100a90 0x7fc2d41982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 -- 172.21.15.152:0/1165277728 >> 172.21.15.152:0/1165277728 conn(0x7fc2d40fc7d0 msgr2=0x7fc2d4104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 -- 172.21.15.152:0/1165277728 shutdown_connections 2024-09-11T22:20:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.499+0000 7fc2da323640 1 -- 172.21.15.152:0/1165277728 wait complete. 2024-09-11T22:20:47.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.393+0000 7f0a63312640 1 -- 172.21.15.152:0/3947723195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c100e20 msgr2=0x7f0a5c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.393+0000 7f0a63312640 1 --2- 172.21.15.152:0/3947723195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c100e20 0x7f0a5c101200 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009900 tx=0x7f0a5802a480 comp rx=0 tx=0).stop 2024-09-11T22:20:47.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.393+0000 7f0a63312640 1 -- 172.21.15.152:0/3947723195 shutdown_connections 2024-09-11T22:20:47.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.393+0000 7f0a63312640 1 --2- 172.21.15.152:0/3947723195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a5c102ef0 0x7f0a5c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.393+0000 7f0a63312640 1 --2- 172.21.15.152:0/3947723195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a5c102570 0x7f0a5c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.393+0000 7f0a63312640 1 --2- 172.21.15.152:0/3947723195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c100e20 0x7f0a5c101200 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.393+0000 7f0a63312640 1 -- 172.21.15.152:0/3947723195 >> 172.21.15.152:0/3947723195 conn(0x7f0a5c0fc7d0 msgr2=0x7f0a5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.393+0000 7f0a63312640 1 -- 172.21.15.152:0/3947723195 shutdown_connections 2024-09-11T22:20:47.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.393+0000 7f0a63312640 1 -- 172.21.15.152:0/3947723195 wait complete. 2024-09-11T22:20:47.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a63312640 1 Processor -- start 2024-09-11T22:20:47.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a63312640 1 -- start start 2024-09-11T22:20:47.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a63312640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a5c100e20 0x7f0a5c197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a63312640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a5c102570 0x7f0a5c197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a63312640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c102ef0 0x7f0a5c19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a63312640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c110f50 con 0x7f0a5c102ef0 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a63312640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c110dd0 con 0x7f0a5c102570 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a63312640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1110d0 con 0x7f0a5c100e20 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a618af640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c102ef0 0x7f0a5c19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a618af640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c102ef0 0x7f0a5c19bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58664/0 (socket says 172.21.15.152:58664) 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a618af640 1 -- 172.21.15.152:0/297915607 learned_addr learned my addr 172.21.15.152:0/297915607 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.394+0000 7f0a610ae640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a5c100e20 0x7f0a5c197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a608ad640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a5c102570 0x7f0a5c197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a618af640 1 -- 172.21.15.152:0/297915607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a5c100e20 msgr2=0x7f0a5c197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a618af640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a5c100e20 0x7f0a5c197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a618af640 1 -- 172.21.15.152:0/297915607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a5c102570 msgr2=0x7f0a5c197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a618af640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a5c102570 0x7f0a5c197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a618af640 1 -- 172.21.15.152:0/297915607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5c19c400 con 0x7f0a5c102ef0 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a608ad640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a5c102570 0x7f0a5c197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a618af640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c102ef0 0x7f0a5c19bd20 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400eaa0 tx=0x7f0a5400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a527fc640 1 -- 172.21.15.152:0/297915607 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5400cdb0 con 0x7f0a5c102ef0 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a527fc640 1 -- 172.21.15.152:0/297915607 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a54005020 con 0x7f0a5c102ef0 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a63312640 1 -- 172.21.15.152:0/297915607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5c19c6f0 con 0x7f0a5c102ef0 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a527fc640 1 -- 172.21.15.152:0/297915607 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a540116b0 con 0x7f0a5c102ef0 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.395+0000 7f0a63312640 1 -- 172.21.15.152:0/297915607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a5c1a3fd0 con 0x7f0a5c102ef0 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.397+0000 7f0a527fc640 1 -- 172.21.15.152:0/297915607 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0a54005560 con 0x7f0a5c102ef0 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a656eb740 1 Processor -- start 2024-09-11T22:20:47.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a656eb740 1 -- start start 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d5288090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d5288a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5293370 0x5605d5295760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a656eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5605d51ee2f0 con 0x5605d52885d0 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a656eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5605d5195cf0 con 0x5605d5289b40 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a656eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5605d51ea2b0 con 0x5605d5293370 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a527fc640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0a480a2cf0 0x7f0a480a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a610ae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d5288a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a610ae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d5288a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58672/0 (socket says 172.21.15.152:58672) 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a608ad640 1 --2- 172.21.15.152:0/189641321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5293370 0x5605d5295760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a610ae640 1 -- 172.21.15.152:0/189641321 learned_addr learned my addr 172.21.15.152:0/189641321 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a618af640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0a480a2cf0 0x7f0a480a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.398+0000 7f0a608ad640 1 --2- 172.21.15.152:0/189641321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d5288090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a527fc640 1 -- 172.21.15.152:0/297915607 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f0a540cf700 con 0x7f0a5c102ef0 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a610ae640 1 -- 172.21.15.152:0/189641321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5293370 msgr2=0x5605d5295760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a610ae640 1 --2- 172.21.15.152:0/189641321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5293370 0x5605d5295760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a610ae640 1 -- 172.21.15.152:0/189641321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 msgr2=0x5605d5288090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a610ae640 1 --2- 172.21.15.152:0/189641321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d5288090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a610ae640 1 -- 172.21.15.152:0/189641321 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d517a3a0 con 0x5605d52885d0 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a608ad640 1 --2- 172.21.15.152:0/189641321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5293370 0x5605d5295760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a618af640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0a480a2cf0 0x7f0a480a51b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0a5409b860 tx=0x7f0a540054d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a610ae640 1 --2- 172.21.15.152:0/189641321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d5288a10 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f0a5802a9a0 tx=0x7f0a58005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dcdd1be2ffb1b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a477fe640 1 -- 172.21.15.152:0/189641321 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58035030 con 0x5605d52885d0 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a477fe640 1 -- 172.21.15.152:0/189641321 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a58044070 con 0x5605d52885d0 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.399+0000 7f0a477fe640 1 -- 172.21.15.152:0/189641321 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58003bc0 con 0x5605d52885d0 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.400+0000 7f0a656eb740 1 -- 172.21.15.152:0/189641321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 msgr2=0x5605d5288a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.400+0000 7f0a656eb740 1 --2- 172.21.15.152:0/189641321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d5288a10 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f0a5802a9a0 tx=0x7f0a58005e80 comp rx=0 tx=0).stop 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.400+0000 7f0a656eb740 1 -- 172.21.15.152:0/189641321 shutdown_connections 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.400+0000 7f0a656eb740 1 --2- 172.21.15.152:0/189641321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5293370 0x5605d5295760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.400+0000 7f0a656eb740 1 --2- 172.21.15.152:0/189641321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d5288a10 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.400+0000 7f0a656eb740 1 --2- 172.21.15.152:0/189641321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d5288090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.400+0000 7f0a656eb740 1 -- 172.21.15.152:0/189641321 >> 172.21.15.152:0/189641321 conn(0x5605d5251310 msgr2=0x5605d5284c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.400+0000 7f0a656eb740 1 -- 172.21.15.152:0/189641321 shutdown_connections 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.400+0000 7f0a656eb740 1 -- 172.21.15.152:0/189641321 wait complete. 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.400+0000 7f0a656eb740 1 -- start start 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.400+0000 7f0a656eb740 1 Processor -- start 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d52885d0 0x5605d5292d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d528fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d52905e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a656eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5605d5296010 con 0x5605d5293370 2024-09-11T22:20:47.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a656eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5605d51a9060 con 0x5605d5289b40 2024-09-11T22:20:47.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a656eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5605d5296190 con 0x5605d52885d0 2024-09-11T22:20:47.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a656eb740 10 client.0 _ll_register_callbacks cb 0x5605d4efc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:47.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a608ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d52905e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a608ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d52905e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58684/0 (socket says 172.21.15.152:58684) 2024-09-11T22:20:47.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a608ad640 1 -- 172.21.15.152:0/1503434836 learned_addr learned my addr 172.21.15.152:0/1503434836 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:47.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a608ad640 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d52885d0 0x5605d5292d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a610ae640 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d528fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a608ad640 1 -- 172.21.15.152:0/1503434836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d52885d0 msgr2=0x5605d5292d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:47.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a608ad640 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d52885d0 0x5605d5292d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a608ad640 1 -- 172.21.15.152:0/1503434836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 msgr2=0x5605d528fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:47.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a608ad640 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d528fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a608ad640 1 -- 172.21.15.152:0/1503434836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605d4f5f3c0 con 0x5605d5293370 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a608ad640 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d52905e0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c014f10 tx=0x7f0a4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a8db05d2e9206 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a44ff9640 1 -- 172.21.15.152:0/1503434836 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c018020 con 0x5605d5293370 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a44ff9640 1 -- 172.21.15.152:0/1503434836 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f0a4c014070 con 0x5605d5293370 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.401+0000 7f0a656eb740 1 -- 172.21.15.152:0/1503434836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a58044070 con 0x5605d5293370 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a44ff9640 1 -- 172.21.15.152:0/1503434836 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0a4c014270 con 0x5605d5293370 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a656eb740 10 client.19554 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a656eb740 1 -- 172.21.15.152:0/1503434836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5605d52a1a80 con 0x5605d5293370 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a44ff9640 1 -- 172.21.15.152:0/1503434836 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a58044070 con 0x5605d5293370 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a44ff9640 1 -- 172.21.15.152:0/1503434836 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f0a4c012610 con 0x5605d5293370 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a656eb740 10 client.19554 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:47.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a656eb740 10 client.19554 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a656eb740 20 client.19554 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a656eb740 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5605d52a2e90 0x5605d52a5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a656eb740 4 client.19554 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a656eb740 1 -- 172.21.15.152:0/1503434836 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605d51fb860 con 0x5605d52a2e90 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.402+0000 7f0a610ae640 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5605d52a2e90 0x5605d52a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.403+0000 7f0a44ff9640 10 client.19554 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.403+0000 7f0a610ae640 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5605d52a2e90 0x5605d52a5280 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e81de28f6396ac36 server_cookie=3c3c3a08bb1c22b0 in_seq=0 out_seq=0 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.403+0000 7f0a44ff9640 1 -- 172.21.15.152:0/1503434836 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605d51fb860 con 0x5605d52a2e90 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.403+0000 7f0a44ff9640 10 client.19554 handle_command_reply: tid=0 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 1 client.19554 shutdown 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 1 -- 172.21.15.152:0/1503434836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 msgr2=0x5605d52905e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d52905e0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c014f10 tx=0x7f0a4c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 1 -- 172.21.15.152:0/1503434836 shutdown_connections 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5605d52a2e90 0x5605d52a5280 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d52905e0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d528fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 1 --2- 172.21.15.152:0/1503434836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d52885d0 0x5605d5292d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a44ff9640 0 client.19554 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 1 -- 172.21.15.152:0/1503434836 >> 172.21.15.152:0/1503434836 conn(0x5605d5251310 msgr2=0x5605d528a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 1 -- 172.21.15.152:0/1503434836 shutdown_connections 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 1 -- 172.21.15.152:0/1503434836 wait complete. 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.404+0000 7f0a656eb740 20 client.19554 trim_cache size 0 max 16384 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a656eb740 1 Processor -- start 2024-09-11T22:20:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a656eb740 1 -- start start 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d52885d0 0x5605d5291f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5289b40 0x5605d528b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d528b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a656eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1ae120 con 0x5605d5293370 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a656eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1ab9f0 con 0x5605d52885d0 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a656eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1a9860 con 0x5605d5289b40 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a608ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d528b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a608ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d528b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58696/0 (socket says 172.21.15.152:58696) 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a608ad640 1 -- 172.21.15.152:0/260672326 learned_addr learned my addr 172.21.15.152:0/260672326 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a610ae640 1 --2- 172.21.15.152:0/260672326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5289b40 0x5605d528b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a608ad640 1 --2- 172.21.15.152:0/260672326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d52885d0 0x5605d5291f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a608ad640 1 -- 172.21.15.152:0/260672326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5289b40 msgr2=0x5605d528b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a608ad640 1 --2- 172.21.15.152:0/260672326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5289b40 0x5605d528b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a608ad640 1 -- 172.21.15.152:0/260672326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d52885d0 msgr2=0x5605d5291f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.417+0000 7f0a608ad640 1 --2- 172.21.15.152:0/260672326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d52885d0 0x5605d5291f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a608ad640 1 -- 172.21.15.152:0/260672326 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d5292960 con 0x5605d5293370 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a608ad640 1 --2- 172.21.15.152:0/260672326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d528b660 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009610 tx=0x7f0a4c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7beef4931cdbe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a46ffd640 1 -- 172.21.15.152:0/260672326 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c02e020 con 0x5605d5293370 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a46ffd640 1 -- 172.21.15.152:0/260672326 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a4c0140b0 con 0x5605d5293370 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a46ffd640 1 -- 172.21.15.152:0/260672326 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c018040 con 0x5605d5293370 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a656eb740 1 -- 172.21.15.152:0/260672326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 msgr2=0x5605d528b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a656eb740 1 --2- 172.21.15.152:0/260672326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d528b660 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009610 tx=0x7f0a4c005f90 comp rx=0 tx=0).stop 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a656eb740 1 -- 172.21.15.152:0/260672326 shutdown_connections 2024-09-11T22:20:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a656eb740 1 --2- 172.21.15.152:0/260672326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d5293370 0x5605d528b660 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a656eb740 1 --2- 172.21.15.152:0/260672326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5289b40 0x5605d528b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a656eb740 1 --2- 172.21.15.152:0/260672326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d52885d0 0x5605d5291f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.418+0000 7f0a656eb740 1 -- 172.21.15.152:0/260672326 >> 172.21.15.152:0/260672326 conn(0x5605d5251310 msgr2=0x5605d5291850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a656eb740 1 -- 172.21.15.152:0/260672326 shutdown_connections 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a656eb740 1 -- 172.21.15.152:0/260672326 wait complete. 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a656eb740 1 -- start start 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a656eb740 1 Processor -- start 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d529bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d528cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a656eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5293370 0x5605d528d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a656eb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1a9eb0 con 0x5605d52885d0 2024-09-11T22:20:47.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a656eb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1ab320 con 0x5605d5289b40 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a656eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1aa580 con 0x5605d5293370 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a656eb740 10 client.0 _ll_register_callbacks cb 0x7f0a4c009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a608ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d529bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a608ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d529bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58698/0 (socket says 172.21.15.152:58698) 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.419+0000 7f0a608ad640 1 -- 172.21.15.152:0/2306635472 learned_addr learned my addr 172.21.15.152:0/2306635472 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a608ad640 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5293370 0x5605d528d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a610ae640 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d528cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a608ad640 1 -- 172.21.15.152:0/2306635472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5293370 msgr2=0x5605d528d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a608ad640 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5293370 0x5605d528d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a608ad640 1 -- 172.21.15.152:0/2306635472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 msgr2=0x5605d528cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a608ad640 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d528cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a608ad640 1 -- 172.21.15.152:0/2306635472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605d530cb00 con 0x5605d52885d0 2024-09-11T22:20:47.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a610ae640 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d528cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a608ad640 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d529bcc0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c014f10 tx=0x7f0a4c005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323f8b130a89a355 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a44ff9640 1 -- 172.21.15.152:0/2306635472 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c02e070 con 0x5605d52885d0 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a44ff9640 1 -- 172.21.15.152:0/2306635472 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f0a4c011650 con 0x5605d52885d0 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a656eb740 1 -- 172.21.15.152:0/2306635472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605d51f5d70 con 0x5605d52885d0 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a44ff9640 1 -- 172.21.15.152:0/2306635472 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0a4c018070 con 0x5605d52885d0 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a656eb740 10 client.19560 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a656eb740 1 -- 172.21.15.152:0/2306635472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5605d530dc50 con 0x5605d52885d0 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a44ff9640 1 -- 172.21.15.152:0/2306635472 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5605d51f5d70 con 0x5605d52885d0 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.420+0000 7f0a44ff9640 1 -- 172.21.15.152:0/2306635472 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f0a4c0036f0 con 0x5605d52885d0 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a656eb740 10 client.19560 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a656eb740 10 client.19560 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T22:20:47.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a656eb740 20 client.19560 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a656eb740 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5605d530e2c0 0x5605d53106e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a656eb740 4 client.19560 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a656eb740 1 -- 172.21.15.152:0/2306635472 --> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605d5172170 con 0x5605d530e2c0 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a610ae640 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5605d530e2c0 0x5605d53106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a610ae640 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5605d530e2c0 0x5605d53106e0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d89cde16630124af server_cookie=30b5857277c2dfdc in_seq=0 out_seq=0 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a44ff9640 10 client.19560 ms_handle_connect on v2:172.21.15.179:6838/7269368 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a44ff9640 1 -- 172.21.15.152:0/2306635472 <== mds.1 v2:172.21.15.179:6838/7269368 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605d5172170 con 0x5605d530e2c0 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a44ff9640 10 client.19560 handle_command_reply: tid=0 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.421+0000 7f0a656eb740 1 client.19560 shutdown 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a656eb740 1 -- 172.21.15.152:0/2306635472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 msgr2=0x5605d529bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a656eb740 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d529bcc0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c014f10 tx=0x7f0a4c005130 comp rx=0 tx=0).stop 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a656eb740 1 -- 172.21.15.152:0/2306635472 shutdown_connections 2024-09-11T22:20:47.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a656eb740 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.179:6838/7269368,v1:172.21.15.179:6839/7269368] conn(0x5605d530e2c0 0x5605d53106e0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.528 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:20:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a656eb740 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605d5293370 0x5605d528d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a656eb740 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5605d5289b40 0x5605d528cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a44ff9640 0 client.19560 ms_handle_reset on v2:172.21.15.179:6838/7269368 2024-09-11T22:20:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a656eb740 1 --2- 172.21.15.152:0/2306635472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605d52885d0 0x5605d529bcc0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a656eb740 1 -- 172.21.15.152:0/2306635472 >> 172.21.15.152:0/2306635472 conn(0x5605d5251310 msgr2=0x5605d5292070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a656eb740 1 -- 172.21.15.152:0/2306635472 shutdown_connections 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a656eb740 1 -- 172.21.15.152:0/2306635472 wait complete. 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a656eb740 20 client.19560 trim_cache size 0 max 16384 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a63312640 1 -- 172.21.15.152:0/297915607 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0a480a2cf0 msgr2=0x7f0a480a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a63312640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0a480a2cf0 0x7f0a480a51b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0a5409b860 tx=0x7f0a540054d0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a63312640 1 -- 172.21.15.152:0/297915607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c102ef0 msgr2=0x7f0a5c19bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a63312640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c102ef0 0x7f0a5c19bd20 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400eaa0 tx=0x7f0a5400ef60 comp rx=0 tx=0).stop 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a63312640 1 -- 172.21.15.152:0/297915607 shutdown_connections 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a63312640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0a480a2cf0 0x7f0a480a51b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a63312640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c102ef0 0x7f0a5c19bd20 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a63312640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a5c102570 0x7f0a5c197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a63312640 1 --2- 172.21.15.152:0/297915607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a5c100e20 0x7f0a5c197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a63312640 1 -- 172.21.15.152:0/297915607 >> 172.21.15.152:0/297915607 conn(0x7f0a5c0fc7d0 msgr2=0x7f0a5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.422+0000 7f0a63312640 1 -- 172.21.15.152:0/297915607 shutdown_connections 2024-09-11T22:20:47.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:47.423+0000 7f0a63312640 1 -- 172.21.15.152:0/297915607 wait complete. 2024-09-11T22:20:48.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:47 smithi179 ceph-mon[35603]: pgmap v518: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 24 MiB/s wr, 1.94k op/s 2024-09-11T22:20:48.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:47 smithi193 ceph-mon[35545]: pgmap v518: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 24 MiB/s wr, 1.94k op/s 2024-09-11T22:20:48.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:47 smithi152 ceph-mon[31188]: pgmap v518: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 24 MiB/s wr, 1.94k op/s 2024-09-11T22:20:49.000 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:20:49.034 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:49.515 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b5ffbba5', quiesce took 8.1 seconds. Will release after: 16.15 2024-09-11T22:20:49.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.912+0000 7f67965ff640 1 -- 172.21.15.152:0/629079935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6790103740 msgr2=0x7f6790107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.912+0000 7f67965ff640 1 --2- 172.21.15.152:0/629079935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6790103740 0x7f6790107b80 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f6784009930 tx=0x7f678402a420 comp rx=0 tx=0).stop 2024-09-11T22:20:49.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.912+0000 7f67965ff640 1 -- 172.21.15.152:0/629079935 shutdown_connections 2024-09-11T22:20:49.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.912+0000 7f67965ff640 1 --2- 172.21.15.152:0/629079935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6790108290 0x7f679010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.912+0000 7f67965ff640 1 --2- 172.21.15.152:0/629079935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6790103740 0x7f6790107b80 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.912+0000 7f67965ff640 1 --2- 172.21.15.152:0/629079935 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6790102d90 0x7f6790103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.912+0000 7f67965ff640 1 -- 172.21.15.152:0/629079935 >> 172.21.15.152:0/629079935 conn(0x7f67900fc7d0 msgr2=0x7f67900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.912+0000 7f67965ff640 1 -- 172.21.15.152:0/629079935 shutdown_connections 2024-09-11T22:20:49.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.912+0000 7f67965ff640 1 -- 172.21.15.152:0/629079935 wait complete. 2024-09-11T22:20:49.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f67965ff640 1 Processor -- start 2024-09-11T22:20:49.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f67965ff640 1 -- start start 2024-09-11T22:20:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f67965ff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6790102d90 0x7f6790198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f67965ff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6790103740 0x7f6790198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f67965ff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6790108290 0x7f679019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f67965ff640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6790112090 con 0x7f6790108290 2024-09-11T22:20:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f67965ff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6790111f10 con 0x7f6790103740 2024-09-11T22:20:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f67965ff640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6790112210 con 0x7f6790102d90 2024-09-11T22:20:49.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f6794b9c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6790108290 0x7f679019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f6794b9c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6790108290 0x7f679019ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58710/0 (socket says 172.21.15.152:58710) 2024-09-11T22:20:49.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f6794b9c640 1 -- 172.21.15.152:0/416781378 learned_addr learned my addr 172.21.15.152:0/416781378 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f678ffff640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6790102d90 0x7f6790198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.913+0000 7f678f7fe640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6790103740 0x7f6790198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f6794b9c640 1 -- 172.21.15.152:0/416781378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6790102d90 msgr2=0x7f6790198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f6794b9c640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6790102d90 0x7f6790198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f6794b9c640 1 -- 172.21.15.152:0/416781378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6790103740 msgr2=0x7f6790198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f6794b9c640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6790103740 0x7f6790198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f6794b9c640 1 -- 172.21.15.152:0/416781378 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679019d4e0 con 0x7f6790108290 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f678f7fe640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6790103740 0x7f6790198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f6794b9c640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6790108290 0x7f679019ce00 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f678800cce0 tx=0x7f678800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f678d7fa640 1 -- 172.21.15.152:0/416781378 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678800f450 con 0x7f6790108290 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f678d7fa640 1 -- 172.21.15.152:0/416781378 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f678800fad0 con 0x7f6790108290 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f67965ff640 1 -- 172.21.15.152:0/416781378 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679019d7d0 con 0x7f6790108290 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f67965ff640 1 -- 172.21.15.152:0/416781378 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67901a50b0 con 0x7f6790108290 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.914+0000 7f678d7fa640 1 -- 172.21.15.152:0/416781378 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788018c10 con 0x7f6790108290 2024-09-11T22:20:49.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.917+0000 7f678d7fa640 1 -- 172.21.15.152:0/416781378 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f67880213f0 con 0x7f6790108290 2024-09-11T22:20:49.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.917+0000 7f678d7fa640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67780a2d70 0x7f67780a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.917+0000 7f67989d8740 1 Processor -- start 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.917+0000 7f67989d8740 1 -- start start 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.917+0000 7f678ffff640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67780a2d70 0x7f67780a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.917+0000 7f678d7fa640 1 -- 172.21.15.152:0/416781378 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f67880cf890 con 0x7f6790108290 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f67989d8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd1148de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f67989d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1149320 0x55cfd11536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f67989d8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1153be0 0x55cfd1155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f67989d8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cfd10ad200 con 0x55cfd1148a00 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f67989d8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1053dc0 con 0x55cfd1153be0 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f67989d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cfd10a91c0 con 0x55cfd1149320 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f678ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd1148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f678ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd1148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58724/0 (socket says 172.21.15.152:58724) 2024-09-11T22:20:49.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f678ffff640 1 -- 172.21.15.152:0/3620989678 learned_addr learned my addr 172.21.15.152:0/3620989678 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:49.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f678f7fe640 1 --2- 172.21.15.152:0/3620989678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1149320 0x55cfd11536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f6794b9c640 1 --2- 172.21.15.152:0/3620989678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1153be0 0x55cfd1155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f678ffff640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67780a2d70 0x7f67780a5230 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f678000bba0 tx=0x7f67800035f0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f678ffff640 1 -- 172.21.15.152:0/3620989678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1149320 msgr2=0x55cfd11536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f678ffff640 1 --2- 172.21.15.152:0/3620989678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1149320 0x55cfd11536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f678ffff640 1 -- 172.21.15.152:0/3620989678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1153be0 msgr2=0x55cfd1155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f678ffff640 1 --2- 172.21.15.152:0/3620989678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1153be0 0x55cfd1155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f678ffff640 1 -- 172.21.15.152:0/3620989678 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfd0e1e620 con 0x55cfd1148a00 2024-09-11T22:20:49.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f6794b9c640 1 --2- 172.21.15.152:0/3620989678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1153be0 0x55cfd1155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:49.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.918+0000 7f678f7fe640 1 --2- 172.21.15.152:0/3620989678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1149320 0x55cfd11536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:49.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.919+0000 7f678ffff640 1 --2- 172.21.15.152:0/3620989678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd1148de0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f6780003af0 tx=0x7f678001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb04eb7ff3f25635 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.919+0000 7f67767fc640 1 -- 172.21.15.152:0/3620989678 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780014230 con 0x55cfd1148a00 2024-09-11T22:20:49.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.919+0000 7f67767fc640 1 -- 172.21.15.152:0/3620989678 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6780005500 con 0x55cfd1148a00 2024-09-11T22:20:49.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.919+0000 7f67767fc640 1 -- 172.21.15.152:0/3620989678 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67800116a0 con 0x55cfd1148a00 2024-09-11T22:20:49.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.920+0000 7f67989d8740 1 -- 172.21.15.152:0/3620989678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 msgr2=0x55cfd1148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.920+0000 7f67989d8740 1 --2- 172.21.15.152:0/3620989678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd1148de0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f6780003af0 tx=0x7f678001c000 comp rx=0 tx=0).stop 2024-09-11T22:20:49.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.920+0000 7f67989d8740 1 -- 172.21.15.152:0/3620989678 shutdown_connections 2024-09-11T22:20:49.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.920+0000 7f67989d8740 1 --2- 172.21.15.152:0/3620989678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1153be0 0x55cfd1155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.920+0000 7f67989d8740 1 --2- 172.21.15.152:0/3620989678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1149320 0x55cfd11536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.920+0000 7f67989d8740 1 --2- 172.21.15.152:0/3620989678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd1148de0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.920+0000 7f67989d8740 1 -- 172.21.15.152:0/3620989678 >> 172.21.15.152:0/3620989678 conn(0x55cfd1144f90 msgr2=0x55cfd1145370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.920+0000 7f67989d8740 1 -- 172.21.15.152:0/3620989678 shutdown_connections 2024-09-11T22:20:49.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.920+0000 7f67989d8740 1 -- 172.21.15.152:0/3620989678 wait complete. 2024-09-11T22:20:49.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.920+0000 7f67989d8740 1 -- start start 2024-09-11T22:20:49.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f67989d8740 1 Processor -- start 2024-09-11T22:20:49.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f67989d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1148a00 0x55cfd11534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f67989d8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd1150790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f67989d8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd1150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f67989d8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1156750 con 0x55cfd1153be0 2024-09-11T22:20:49.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f67989d8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1047c50 con 0x55cfd1149320 2024-09-11T22:20:49.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f67989d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cfd11568d0 con 0x55cfd1148a00 2024-09-11T22:20:49.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f67989d8740 10 client.0 _ll_register_callbacks cb 0x55cfd1059ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:49.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f6794b9c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd1150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f6794b9c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd1150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58730/0 (socket says 172.21.15.152:58730) 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f6794b9c640 1 -- 172.21.15.152:0/2668926510 learned_addr learned my addr 172.21.15.152:0/2668926510 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f678f7fe640 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd1150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f678ffff640 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1148a00 0x55cfd11534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f6794b9c640 1 -- 172.21.15.152:0/2668926510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1148a00 msgr2=0x55cfd11534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f6794b9c640 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1148a00 0x55cfd11534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f6794b9c640 1 -- 172.21.15.152:0/2668926510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 msgr2=0x55cfd1150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f6794b9c640 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd1150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.921+0000 7f6794b9c640 1 -- 172.21.15.152:0/2668926510 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfd1151520 con 0x55cfd1153be0 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f6794b9c640 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd1150cd0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f678809bce0 tx=0x7f678809c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0e9685e940d163 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f676f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f676f7fe640 1 -- 172.21.15.152:0/2668926510 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67880a49c0 con 0x55cfd1153be0 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f676f7fe640 1 -- 172.21.15.152:0/2668926510 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f67880a4530 con 0x55cfd1153be0 2024-09-11T22:20:49.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f67989d8740 1 -- 172.21.15.152:0/2668926510 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6780005500 con 0x55cfd1153be0 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f676f7fe640 1 -- 172.21.15.152:0/2668926510 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f67880a4730 con 0x55cfd1153be0 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f67989d8740 10 client.19572 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f67989d8740 1 -- 172.21.15.152:0/2668926510 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cfd1162330 con 0x55cfd1153be0 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f676f7fe640 1 -- 172.21.15.152:0/2668926510 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6780005500 con 0x55cfd1153be0 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f676f7fe640 1 -- 172.21.15.152:0/2668926510 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f678809b230 con 0x55cfd1153be0 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f67989d8740 10 client.19572 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f67989d8740 10 client.19572 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.922+0000 7f67989d8740 20 client.19572 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.923+0000 7f67989d8740 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cfd1163790 0x55cfd1165ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.923+0000 7f67989d8740 4 client.19572 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.923+0000 7f67989d8740 1 -- 172.21.15.152:0/2668926510 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfd10ba770 con 0x55cfd1163790 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.923+0000 7f678ffff640 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cfd1163790 0x55cfd1165ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.923+0000 7f676f7fe640 10 client.19572 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.923+0000 7f678ffff640 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cfd1163790 0x55cfd1165ba0 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c74b520d26e9a28 server_cookie=1fcfcf92094a5a22 in_seq=0 out_seq=0 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f676f7fe640 1 -- 172.21.15.152:0/2668926510 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cfd10ba770 con 0x55cfd1163790 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f676f7fe640 10 client.19572 handle_command_reply: tid=0 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f67989d8740 1 client.19572 shutdown 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f67989d8740 1 -- 172.21.15.152:0/2668926510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 msgr2=0x55cfd1150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f67989d8740 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd1150cd0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f678809bce0 tx=0x7f678809c450 comp rx=0 tx=0).stop 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f67989d8740 1 -- 172.21.15.152:0/2668926510 shutdown_connections 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f67989d8740 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cfd1163790 0x55cfd1165ba0 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f67989d8740 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd1150cd0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f67989d8740 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd1150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f67989d8740 1 --2- 172.21.15.152:0/2668926510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1148a00 0x55cfd11534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f67989d8740 1 -- 172.21.15.152:0/2668926510 >> 172.21.15.152:0/2668926510 conn(0x55cfd1144f90 msgr2=0x55cfd11441d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f676f7fe640 0 client.19572 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.924+0000 7f67989d8740 1 -- 172.21.15.152:0/2668926510 shutdown_connections 2024-09-11T22:20:49.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.925+0000 7f67989d8740 1 -- 172.21.15.152:0/2668926510 wait complete. 2024-09-11T22:20:49.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.925+0000 7f67989d8740 20 client.19572 trim_cache size 0 max 16384 2024-09-11T22:20:49.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.942+0000 7f67989d8740 1 Processor -- start 2024-09-11T22:20:49.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.942+0000 7f67989d8740 1 -- start start 2024-09-11T22:20:49.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f67989d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1148a00 0x55cfd114f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f67989d8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd116b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f67989d8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd116b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f67989d8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f677c011170 con 0x55cfd1153be0 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f67989d8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f677c00ea40 con 0x55cfd1149320 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f67989d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f677c00c8b0 con 0x55cfd1148a00 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f6794b9c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd116b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f6794b9c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd116b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58742/0 (socket says 172.21.15.152:58742) 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f6794b9c640 1 -- 172.21.15.152:0/2082594509 learned_addr learned my addr 172.21.15.152:0/2082594509 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f678f7fe640 1 --2- 172.21.15.152:0/2082594509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd116b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f678ffff640 1 --2- 172.21.15.152:0/2082594509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1148a00 0x55cfd114f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f6794b9c640 1 -- 172.21.15.152:0/2082594509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1148a00 msgr2=0x55cfd114f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f6794b9c640 1 --2- 172.21.15.152:0/2082594509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1148a00 0x55cfd114f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f6794b9c640 1 -- 172.21.15.152:0/2082594509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 msgr2=0x55cfd116b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f6794b9c640 1 --2- 172.21.15.152:0/2082594509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd116b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f6794b9c640 1 -- 172.21.15.152:0/2082594509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfd114ece0 con 0x55cfd1153be0 2024-09-11T22:20:49.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.943+0000 7f6794b9c640 1 --2- 172.21.15.152:0/2082594509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd116b9b0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f678809ba50 tx=0x7f6788007670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944779c8effd72be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.944+0000 7f6775ffb640 1 -- 172.21.15.152:0/2082594509 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67880a49c0 con 0x55cfd1153be0 2024-09-11T22:20:49.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.944+0000 7f6775ffb640 1 -- 172.21.15.152:0/2082594509 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6788018400 con 0x55cfd1153be0 2024-09-11T22:20:49.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.944+0000 7f6775ffb640 1 -- 172.21.15.152:0/2082594509 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678807ab70 con 0x55cfd1153be0 2024-09-11T22:20:49.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.944+0000 7f67989d8740 1 -- 172.21.15.152:0/2082594509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 msgr2=0x55cfd116b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.944+0000 7f67989d8740 1 --2- 172.21.15.152:0/2082594509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd116b9b0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f678809ba50 tx=0x7f6788007670 comp rx=0 tx=0).stop 2024-09-11T22:20:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.944+0000 7f67989d8740 1 -- 172.21.15.152:0/2082594509 shutdown_connections 2024-09-11T22:20:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.944+0000 7f67989d8740 1 --2- 172.21.15.152:0/2082594509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1153be0 0x55cfd116b9b0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.944+0000 7f67989d8740 1 --2- 172.21.15.152:0/2082594509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd116b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.944+0000 7f67989d8740 1 --2- 172.21.15.152:0/2082594509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1148a00 0x55cfd114f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.945+0000 7f67989d8740 1 -- 172.21.15.152:0/2082594509 >> 172.21.15.152:0/2082594509 conn(0x55cfd1144f90 msgr2=0x55cfd1152810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.945+0000 7f67989d8740 1 -- 172.21.15.152:0/2082594509 shutdown_connections 2024-09-11T22:20:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.945+0000 7f67989d8740 1 -- 172.21.15.152:0/2082594509 wait complete. 2024-09-11T22:20:49.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.945+0000 7f67989d8740 1 -- start start 2024-09-11T22:20:49.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.945+0000 7f67989d8740 1 Processor -- start 2024-09-11T22:20:49.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.945+0000 7f67989d8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd115c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.945+0000 7f67989d8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd1159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.945+0000 7f67989d8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1153be0 0x55cfd1159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.945+0000 7f67989d8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f677c00cf00 con 0x55cfd1148a00 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f67989d8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f677c00e370 con 0x55cfd1149320 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f67989d8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f677c00d5d0 con 0x55cfd1153be0 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f67989d8740 10 client.0 _ll_register_callbacks cb 0x7f67880077a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f678ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd115c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f678ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd115c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58750/0 (socket says 172.21.15.152:58750) 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f678ffff640 1 -- 172.21.15.152:0/1471702265 learned_addr learned my addr 172.21.15.152:0/1471702265 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f678f7fe640 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd1159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f6794b9c640 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1153be0 0x55cfd1159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f678ffff640 1 -- 172.21.15.152:0/1471702265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1153be0 msgr2=0x55cfd1159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f678ffff640 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1153be0 0x55cfd1159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f678ffff640 1 -- 172.21.15.152:0/1471702265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 msgr2=0x55cfd1159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f678ffff640 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd1159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f678ffff640 1 -- 172.21.15.152:0/1471702265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfd115a540 con 0x55cfd1148a00 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f6794b9c640 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1153be0 0x55cfd1159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f678ffff640 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd115c3a0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f6780014d80 tx=0x7f678000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90aa6a7705fb482 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f676f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f676f7fe640 1 -- 172.21.15.152:0/1471702265 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678003a060 con 0x55cfd1148a00 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f676f7fe640 1 -- 172.21.15.152:0/1471702265 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f6780004580 con 0x55cfd1148a00 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.946+0000 7f67989d8740 1 -- 172.21.15.152:0/1471702265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6788018400 con 0x55cfd1148a00 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f676f7fe640 1 -- 172.21.15.152:0/1471702265 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6780025040 con 0x55cfd1148a00 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f67989d8740 10 client.19578 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f67989d8740 1 -- 172.21.15.152:0/1471702265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cfd11ce570 con 0x55cfd1148a00 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f676f7fe640 1 -- 172.21.15.152:0/1471702265 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6788018400 con 0x55cfd1148a00 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f676f7fe640 1 -- 172.21.15.152:0/1471702265 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7f67800050c0 con 0x55cfd1148a00 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f67989d8740 10 client.19578 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f67989d8740 10 client.19578 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f67989d8740 20 client.19578 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f67989d8740 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cfd11ce970 0x55cfd11d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f67989d8740 4 client.19578 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f67989d8740 1 -- 172.21.15.152:0/1471702265 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55cfd10b4c80 con 0x55cfd11ce970 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.947+0000 7f678f7fe640 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cfd11ce970 0x55cfd11d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f678f7fe640 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cfd11ce970 0x55cfd11d0d90 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25a59ffb22be5978 server_cookie=30bc3957e7c150ba in_seq=0 out_seq=0 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f676f7fe640 10 client.19578 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f676f7fe640 1 -- 172.21.15.152:0/1471702265 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55cfd10b4c80 con 0x55cfd11ce970 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f676f7fe640 10 client.19578 handle_command_reply: tid=0 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f67989d8740 1 client.19578 shutdown 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f67989d8740 1 -- 172.21.15.152:0/1471702265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 msgr2=0x55cfd115c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f67989d8740 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd115c3a0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f6780014d80 tx=0x7f678000b420 comp rx=0 tx=0).stop 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f67989d8740 1 -- 172.21.15.152:0/1471702265 shutdown_connections 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f67989d8740 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x55cfd11ce970 0x55cfd11d0d90 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f67989d8740 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfd1153be0 0x55cfd1159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f676f7fe640 0 client.19578 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f67989d8740 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cfd1149320 0x55cfd1159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f67989d8740 1 --2- 172.21.15.152:0/1471702265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cfd1148a00 0x55cfd115c3a0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.948+0000 7f67989d8740 1 -- 172.21.15.152:0/1471702265 >> 172.21.15.152:0/1471702265 conn(0x55cfd1144f90 msgr2=0x55cfd11439b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67989d8740 1 -- 172.21.15.152:0/1471702265 shutdown_connections 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67989d8740 1 -- 172.21.15.152:0/1471702265 wait complete. 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67989d8740 20 client.19578 trim_cache size 0 max 16384 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 30, 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi152.stdout: "leader": 24472, 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi152.stdout: "set_version": 59, 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi152.stdout: "sets": {} 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 -- 172.21.15.152:0/416781378 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67780a2d70 msgr2=0x7f67780a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67780a2d70 0x7f67780a5230 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f678000bba0 tx=0x7f67800035f0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 -- 172.21.15.152:0/416781378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6790108290 msgr2=0x7f679019ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6790108290 0x7f679019ce00 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f678800cce0 tx=0x7f678800a620 comp rx=0 tx=0).stop 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 -- 172.21.15.152:0/416781378 shutdown_connections 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f67780a2d70 0x7f67780a5230 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6790108290 0x7f679019ce00 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6790103740 0x7f6790198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 --2- 172.21.15.152:0/416781378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6790102d90 0x7f6790198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 -- 172.21.15.152:0/416781378 >> 172.21.15.152:0/416781378 conn(0x7f67900fc7d0 msgr2=0x7f6790105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 -- 172.21.15.152:0/416781378 shutdown_connections 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:49.949+0000 7f67965ff640 1 -- 172.21.15.152:0/416781378 wait complete. 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:50.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:49 smithi179 ceph-mon[35603]: pgmap v519: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 24 MiB/s wr, 1.96k op/s 2024-09-11T22:20:50.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:49 smithi193 ceph-mon[35545]: pgmap v519: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 24 MiB/s wr, 1.96k op/s 2024-09-11T22:20:50.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:49 smithi152 ceph-mon[31188]: pgmap v519: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 24 MiB/s wr, 1.96k op/s 2024-09-11T22:20:51.010 INFO:tasks.quiescer:done joining Quiescers 2024-09-11T22:20:51.010 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-11T22:20:51.022 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T22:20:51.030 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-11T22:20:51.040 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-11T22:20:51.041 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T22:20:51.041 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T22:20:51.041 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-11T22:20:51.099 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-11T22:20:51.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 -- 172.21.15.152:0/598539961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad70100a80 msgr2=0x7fad70100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 --2- 172.21.15.152:0/598539961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad70100a80 0x7fad70100ee0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fad60009930 tx=0x7fad6002a420 comp rx=0 tx=0).stop 2024-09-11T22:20:51.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 -- 172.21.15.152:0/598539961 shutdown_connections 2024-09-11T22:20:51.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 --2- 172.21.15.152:0/598539961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad70101420 0x7fad7010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 --2- 172.21.15.152:0/598539961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad70100a80 0x7fad70100ee0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 --2- 172.21.15.152:0/598539961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad70106a80 0x7fad70106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 -- 172.21.15.152:0/598539961 >> 172.21.15.152:0/598539961 conn(0x7fad700fc7a0 msgr2=0x7fad700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 -- 172.21.15.152:0/598539961 shutdown_connections 2024-09-11T22:20:51.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 -- 172.21.15.152:0/598539961 wait complete. 2024-09-11T22:20:51.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 Processor -- start 2024-09-11T22:20:51.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 -- start start 2024-09-11T22:20:51.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.736+0000 7fad76e4f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad70100a80 0x7fad701992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad76e4f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad70101420 0x7fad701997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad76e4f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad70106a80 0x7fad701a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad76e4f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad70110e80 con 0x7fad70106a80 2024-09-11T22:20:51.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad76e4f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fad70110d00 con 0x7fad70100a80 2024-09-11T22:20:51.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad76e4f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fad70111000 con 0x7fad70101420 2024-09-11T22:20:51.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad753ec640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad70106a80 0x7fad701a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad753ec640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad70106a80 0x7fad701a4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58774/0 (socket says 172.21.15.152:58774) 2024-09-11T22:20:51.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad753ec640 1 -- 172.21.15.152:0/3364670894 learned_addr learned my addr 172.21.15.152:0/3364670894 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:51.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad67fff640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad70101420 0x7fad701997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad74beb640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad70100a80 0x7fad701992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad753ec640 1 -- 172.21.15.152:0/3364670894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad70101420 msgr2=0x7fad701997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad753ec640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad70101420 0x7fad701997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad753ec640 1 -- 172.21.15.152:0/3364670894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad70100a80 msgr2=0x7fad701992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad753ec640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad70100a80 0x7fad701992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad753ec640 1 -- 172.21.15.152:0/3364670894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad701a4860 con 0x7fad70106a80 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad753ec640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad70106a80 0x7fad701a4320 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fad6800eaa0 tx=0x7fad6800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad65ffb640 1 -- 172.21.15.152:0/3364670894 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6800cdb0 con 0x7fad70106a80 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad65ffb640 1 -- 172.21.15.152:0/3364670894 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad68005020 con 0x7fad70106a80 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad76e4f640 1 -- 172.21.15.152:0/3364670894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad701a4a30 con 0x7fad70106a80 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.737+0000 7fad65ffb640 1 -- 172.21.15.152:0/3364670894 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad680116b0 con 0x7fad70106a80 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.738+0000 7fad76e4f640 1 -- 172.21.15.152:0/3364670894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad701a4f40 con 0x7fad70106a80 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.740+0000 7fad65ffb640 1 -- 172.21.15.152:0/3364670894 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fad68005560 con 0x7fad70106a80 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.741+0000 7fad79228740 1 Processor -- start 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.741+0000 7fad65ffb640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fad580a2d70 0x7fad580a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.741+0000 7fad79228740 1 -- start start 2024-09-11T22:20:51.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.741+0000 7fad67fff640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fad580a2d70 0x7fad580a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.741+0000 7fad65ffb640 1 -- 172.21.15.152:0/3364670894 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7fad680cf660 con 0x7fad70106a80 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.741+0000 7fad79228740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b29c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.741+0000 7fad79228740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29c5d0 0x56136b29ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.741+0000 7fad79228740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b2a7370 0x56136b2a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.741+0000 7fad79228740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56136b2022f0 con 0x56136b29db40 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.741+0000 7fad79228740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56136b1a9cf0 con 0x56136b29c5d0 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.741+0000 7fad79228740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56136b1fe2b0 con 0x56136b2a7370 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad74beb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b29c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad74beb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b29c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58776/0 (socket says 172.21.15.152:58776) 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad74beb640 1 -- 172.21.15.152:0/966545605 learned_addr learned my addr 172.21.15.152:0/966545605 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad753ec640 1 --2- 172.21.15.152:0/966545605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b2a7370 0x56136b2a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad67fff640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fad580a2d70 0x7fad580a5230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fad60009900 tx=0x7fad600058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad67fff640 1 --2- 172.21.15.152:0/966545605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29c5d0 0x56136b29ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad74beb640 1 -- 172.21.15.152:0/966545605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b2a7370 msgr2=0x56136b2a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad74beb640 1 --2- 172.21.15.152:0/966545605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b2a7370 0x56136b2a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad74beb640 1 -- 172.21.15.152:0/966545605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29c5d0 msgr2=0x56136b29ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad74beb640 1 --2- 172.21.15.152:0/966545605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29c5d0 0x56136b29ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad74beb640 1 -- 172.21.15.152:0/966545605 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56136b18e3a0 con 0x56136b29db40 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad67fff640 1 --2- 172.21.15.152:0/966545605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29c5d0 0x56136b29ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad74beb640 1 --2- 172.21.15.152:0/966545605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b29c090 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00bc60 tx=0x7fad6c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7496a02fc7849db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad56ffd640 1 -- 172.21.15.152:0/966545605 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c015070 con 0x56136b29db40 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad56ffd640 1 -- 172.21.15.152:0/966545605 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad6c011920 con 0x56136b29db40 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.742+0000 7fad56ffd640 1 -- 172.21.15.152:0/966545605 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c010890 con 0x56136b29db40 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.743+0000 7fad79228740 1 -- 172.21.15.152:0/966545605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 msgr2=0x56136b29c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.743+0000 7fad79228740 1 --2- 172.21.15.152:0/966545605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b29c090 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00bc60 tx=0x7fad6c00f730 comp rx=0 tx=0).stop 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.743+0000 7fad79228740 1 -- 172.21.15.152:0/966545605 shutdown_connections 2024-09-11T22:20:51.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.743+0000 7fad79228740 1 --2- 172.21.15.152:0/966545605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b2a7370 0x56136b2a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.743+0000 7fad79228740 1 --2- 172.21.15.152:0/966545605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29c5d0 0x56136b29ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.743+0000 7fad79228740 1 --2- 172.21.15.152:0/966545605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b29c090 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.743+0000 7fad79228740 1 -- 172.21.15.152:0/966545605 >> 172.21.15.152:0/966545605 conn(0x56136b265310 msgr2=0x56136b298c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.743+0000 7fad79228740 1 -- 172.21.15.152:0/966545605 shutdown_connections 2024-09-11T22:20:51.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.743+0000 7fad79228740 1 -- 172.21.15.152:0/966545605 wait complete. 2024-09-11T22:20:51.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.743+0000 7fad79228740 1 -- start start 2024-09-11T22:20:51.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.743+0000 7fad79228740 1 Processor -- start 2024-09-11T22:20:51.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad79228740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b29c5d0 0x56136b2a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad79228740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2a3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad79228740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b2a7370 0x56136b2a4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad79228740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56136b2aa070 con 0x56136b29db40 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad79228740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56136b1bd060 con 0x56136b2a7370 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad79228740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56136b2aa1f0 con 0x56136b29c5d0 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad79228740 10 client.0 _ll_register_callbacks cb 0x56136af108c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad67fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2a3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad67fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2a3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58792/0 (socket says 172.21.15.152:58792) 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad67fff640 1 -- 172.21.15.152:0/3278376459 learned_addr learned my addr 172.21.15.152:0/3278376459 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad74beb640 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b29c5d0 0x56136b2a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad753ec640 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b2a7370 0x56136b2a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad67fff640 1 -- 172.21.15.152:0/3278376459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b29c5d0 msgr2=0x56136b2a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad67fff640 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b29c5d0 0x56136b2a6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad67fff640 1 -- 172.21.15.152:0/3278376459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b2a7370 msgr2=0x56136b2a4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad67fff640 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b2a7370 0x56136b2a4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad67fff640 1 -- 172.21.15.152:0/3278376459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56136af733c0 con 0x56136b29db40 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad67fff640 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2a3fb0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fad6002a940 tx=0x7fad60009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cc9c891741ae5d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.744+0000 7fad4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad4ffff640 1 -- 172.21.15.152:0/3278376459 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6004e070 con 0x56136b29db40 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad4ffff640 1 -- 172.21.15.152:0/3278376459 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7fad60003a00 con 0x56136b29db40 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad79228740 1 -- 172.21.15.152:0/3278376459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad6c011920 con 0x56136b29db40 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad4ffff640 1 -- 172.21.15.152:0/3278376459 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fad6005a050 con 0x56136b29db40 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad79228740 10 client.19590 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad79228740 1 -- 172.21.15.152:0/3278376459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56136b2b5aa0 con 0x56136b29db40 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad4ffff640 1 -- 172.21.15.152:0/3278376459 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad6c011920 con 0x56136b29db40 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad4ffff640 1 -- 172.21.15.152:0/3278376459 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fad6003c440 con 0x56136b29db40 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad79228740 10 client.19590 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad79228740 10 client.19590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad79228740 20 client.19590 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:51.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad79228740 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56136b2b6f00 0x56136b2b9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad79228740 4 client.19590 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.745+0000 7fad79228740 1 -- 172.21.15.152:0/3278376459 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56136b20f860 con 0x56136b2b6f00 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.746+0000 7fad74beb640 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56136b2b6f00 0x56136b2b9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.746+0000 7fad74beb640 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56136b2b6f00 0x56136b2b9330 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13817dbd66c6a6f0 server_cookie=4986825b15979152 in_seq=0 out_seq=0 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.746+0000 7fad4ffff640 10 client.19590 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad4ffff640 1 -- 172.21.15.152:0/3278376459 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56136b20f860 con 0x56136b2b6f00 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad4ffff640 10 client.19590 handle_command_reply: tid=0 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 1 client.19590 shutdown 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 1 -- 172.21.15.152:0/3278376459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 msgr2=0x56136b2a3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2a3fb0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fad6002a940 tx=0x7fad60009260 comp rx=0 tx=0).stop 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 1 -- 172.21.15.152:0/3278376459 shutdown_connections 2024-09-11T22:20:51.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56136b2b6f00 0x56136b2b9330 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b2a7370 0x56136b2a4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2a3fb0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad4ffff640 0 client.19590 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:51.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 1 --2- 172.21.15.152:0/3278376459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b29c5d0 0x56136b2a6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 1 -- 172.21.15.152:0/3278376459 >> 172.21.15.152:0/3278376459 conn(0x56136b265310 msgr2=0x56136b29e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 1 -- 172.21.15.152:0/3278376459 shutdown_connections 2024-09-11T22:20:51.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 1 -- 172.21.15.152:0/3278376459 wait complete. 2024-09-11T22:20:51.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.747+0000 7fad79228740 20 client.19590 trim_cache size 0 max 16384 2024-09-11T22:20:51.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad79228740 1 Processor -- start 2024-09-11T22:20:51.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad79228740 1 -- start start 2024-09-11T22:20:51.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad79228740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b29c5d0 0x56136b2b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad79228740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2bec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad79228740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b2a7370 0x56136b2bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad79228740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad701b0330 con 0x56136b29db40 2024-09-11T22:20:51.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad79228740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fad701adc00 con 0x56136b2a7370 2024-09-11T22:20:51.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad79228740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fad701aba70 con 0x56136b29c5d0 2024-09-11T22:20:51.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad67fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad67fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2bec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58800/0 (socket says 172.21.15.152:58800) 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad67fff640 1 -- 172.21.15.152:0/2149271716 learned_addr learned my addr 172.21.15.152:0/2149271716 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad74beb640 1 --2- 172.21.15.152:0/2149271716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b29c5d0 0x56136b2b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad67fff640 1 -- 172.21.15.152:0/2149271716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b29c5d0 msgr2=0x56136b2b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad67fff640 1 --2- 172.21.15.152:0/2149271716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b29c5d0 0x56136b2b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad67fff640 1 -- 172.21.15.152:0/2149271716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b2a7370 msgr2=0x56136b2bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad67fff640 1 --2- 172.21.15.152:0/2149271716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b2a7370 0x56136b2bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad67fff640 1 -- 172.21.15.152:0/2149271716 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56136b2b99b0 con 0x56136b29db40 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad67fff640 1 --2- 172.21.15.152:0/2149271716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2bec00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fad60009230 tx=0x7fad6002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2388d19548cc7bd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad567fc640 1 -- 172.21.15.152:0/2149271716 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60062070 con 0x56136b29db40 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad567fc640 1 -- 172.21.15.152:0/2149271716 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad60003ce0 con 0x56136b29db40 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.760+0000 7fad567fc640 1 -- 172.21.15.152:0/2149271716 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6004e040 con 0x56136b29db40 2024-09-11T22:20:51.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.761+0000 7fad79228740 1 -- 172.21.15.152:0/2149271716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 msgr2=0x56136b2bec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.761+0000 7fad79228740 1 --2- 172.21.15.152:0/2149271716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2bec00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fad60009230 tx=0x7fad6002a420 comp rx=0 tx=0).stop 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.761+0000 7fad79228740 1 -- 172.21.15.152:0/2149271716 shutdown_connections 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.761+0000 7fad79228740 1 --2- 172.21.15.152:0/2149271716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b2a7370 0x56136b2bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.761+0000 7fad79228740 1 --2- 172.21.15.152:0/2149271716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29db40 0x56136b2bec00 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.761+0000 7fad79228740 1 --2- 172.21.15.152:0/2149271716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b29c5d0 0x56136b2b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.761+0000 7fad79228740 1 -- 172.21.15.152:0/2149271716 >> 172.21.15.152:0/2149271716 conn(0x56136b265310 msgr2=0x56136b29f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.761+0000 7fad79228740 1 -- 172.21.15.152:0/2149271716 shutdown_connections 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.761+0000 7fad79228740 1 -- 172.21.15.152:0/2149271716 wait complete. 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.761+0000 7fad79228740 1 -- start start 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.761+0000 7fad79228740 1 Processor -- start 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad79228740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29c5d0 0x56136b2ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad79228740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29db40 0x56136b2ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad79228740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b2a7370 0x56136b2abc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad79228740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad701ac0c0 con 0x56136b29c5d0 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad79228740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fad701ad530 con 0x56136b29db40 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad79228740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fad701ac790 con 0x56136b2a7370 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad79228740 10 client.0 _ll_register_callbacks cb 0x7fad60040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad74beb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29c5d0 0x56136b2ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad74beb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29c5d0 0x56136b2ab1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58804/0 (socket says 172.21.15.152:58804) 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad74beb640 1 -- 172.21.15.152:0/2410960600 learned_addr learned my addr 172.21.15.152:0/2410960600 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad753ec640 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b2a7370 0x56136b2abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad67fff640 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29db40 0x56136b2ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad74beb640 1 -- 172.21.15.152:0/2410960600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b2a7370 msgr2=0x56136b2abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad74beb640 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b2a7370 0x56136b2abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad74beb640 1 -- 172.21.15.152:0/2410960600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29db40 msgr2=0x56136b2ab6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad74beb640 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29db40 0x56136b2ab6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad74beb640 1 -- 172.21.15.152:0/2410960600 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56136b320bd0 con 0x56136b29c5d0 2024-09-11T22:20:51.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad67fff640 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29db40 0x56136b2ab6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:51.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad74beb640 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29c5d0 0x56136b2ab1b0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fad6c005fa0 tx=0x7fad6c00b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7675a616730a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.762+0000 7fad4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-11T22:20:51.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad4ffff640 1 -- 172.21.15.152:0/2410960600 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c015040 con 0x56136b29c5d0 2024-09-11T22:20:51.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad4ffff640 1 -- 172.21.15.152:0/2410960600 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7fad6c004440 con 0x56136b29c5d0 2024-09-11T22:20:51.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad79228740 1 -- 172.21.15.152:0/2410960600 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad60003ce0 con 0x56136b29c5d0 2024-09-11T22:20:51.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad4ffff640 1 -- 172.21.15.152:0/2410960600 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fad6c00b3a0 con 0x56136b29c5d0 2024-09-11T22:20:51.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad79228740 10 client.19596 fetch_fsmap learned FSMap version 30 2024-09-11T22:20:51.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad79228740 1 -- 172.21.15.152:0/2410960600 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56136b321ee0 con 0x56136b29c5d0 2024-09-11T22:20:51.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad4ffff640 1 -- 172.21.15.152:0/2410960600 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad60003ce0 con 0x56136b29c5d0 2024-09-11T22:20:51.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad4ffff640 1 -- 172.21.15.152:0/2410960600 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 30) ==== 8346+0+0 (secure 0 0 0) 0x7fad6c0049e0 con 0x56136b29c5d0 2024-09-11T22:20:51.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad79228740 10 client.19596 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T22:20:51.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad79228740 10 client.19596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T22:20:51.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad79228740 20 client.19596 populate_metadata read hostname 'smithi152' 2024-09-11T22:20:51.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad79228740 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56136b3224d0 0x56136b3248f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad79228740 4 client.19596 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:20:51.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad79228740 1 -- 172.21.15.152:0/2410960600 --> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56136b209d70 con 0x56136b3224d0 2024-09-11T22:20:51.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.763+0000 7fad67fff640 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56136b3224d0 0x56136b3248f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad4ffff640 10 client.19596 ms_handle_connect on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:51.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad67fff640 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56136b3224d0 0x56136b3248f0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38de0aed0fc72d23 server_cookie=3aa4603190bde242 in_seq=0 out_seq=0 2024-09-11T22:20:51.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad4ffff640 1 -- 172.21.15.152:0/2410960600 <== mds.0 v2:172.21.15.193:6838/1925980452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56136b209d70 con 0x56136b3224d0 2024-09-11T22:20:51.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad4ffff640 10 client.19596 handle_command_reply: tid=0 2024-09-11T22:20:51.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 1 client.19596 shutdown 2024-09-11T22:20:51.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 1 -- 172.21.15.152:0/2410960600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29c5d0 msgr2=0x56136b2ab1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29c5d0 0x56136b2ab1b0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fad6c005fa0 tx=0x7fad6c00b930 comp rx=0 tx=0).stop 2024-09-11T22:20:51.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 1 -- 172.21.15.152:0/2410960600 shutdown_connections 2024-09-11T22:20:51.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.193:6838/1925980452,v1:172.21.15.193:6839/1925980452] conn(0x56136b3224d0 0x56136b3248f0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56136b2a7370 0x56136b2abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56136b29db40 0x56136b2ab6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad4ffff640 0 client.19596 ms_handle_reset on v2:172.21.15.193:6838/1925980452 2024-09-11T22:20:51.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 1 --2- 172.21.15.152:0/2410960600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56136b29c5d0 0x56136b2ab1b0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 1 -- 172.21.15.152:0/2410960600 >> 172.21.15.152:0/2410960600 conn(0x56136b265310 msgr2=0x56136b2a5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 1 -- 172.21.15.152:0/2410960600 shutdown_connections 2024-09-11T22:20:51.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 1 -- 172.21.15.152:0/2410960600 wait complete. 2024-09-11T22:20:51.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.764+0000 7fad79228740 20 client.19596 trim_cache size 0 max 16384 2024-09-11T22:20:51.153 INFO:teuthology.orchestra.run.smithi152.stdout:[] 2024-09-11T22:20:51.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 -- 172.21.15.152:0/3364670894 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fad580a2d70 msgr2=0x7fad580a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fad580a2d70 0x7fad580a5230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fad60009900 tx=0x7fad600058d0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 -- 172.21.15.152:0/3364670894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad70106a80 msgr2=0x7fad701a4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad70106a80 0x7fad701a4320 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fad6800eaa0 tx=0x7fad6800ef60 comp rx=0 tx=0).stop 2024-09-11T22:20:51.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 -- 172.21.15.152:0/3364670894 shutdown_connections 2024-09-11T22:20:51.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fad580a2d70 0x7fad580a5230 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad70106a80 0x7fad701a4320 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad70101420 0x7fad701997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 --2- 172.21.15.152:0/3364670894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad70100a80 0x7fad701992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 -- 172.21.15.152:0/3364670894 >> 172.21.15.152:0/3364670894 conn(0x7fad700fc7a0 msgr2=0x7fad700fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 -- 172.21.15.152:0/3364670894 shutdown_connections 2024-09-11T22:20:51.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:50.765+0000 7fad76e4f640 1 -- 172.21.15.152:0/3364670894 wait complete. 2024-09-11T22:20:51.160 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-11T22:20:51.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.300+0000 7f8b743c4640 1 -- 172.21.15.152:0/963096216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b6c101350 msgr2=0x7f8b6c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.300+0000 7f8b743c4640 1 --2- 172.21.15.152:0/963096216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b6c101350 0x7f8b6c10d880 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009cd0 tx=0x7f8b5c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.300+0000 7f8b743c4640 1 -- 172.21.15.152:0/963096216 shutdown_connections 2024-09-11T22:20:51.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.300+0000 7f8b743c4640 1 --2- 172.21.15.152:0/963096216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b6c101350 0x7f8b6c10d880 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.300+0000 7f8b743c4640 1 --2- 172.21.15.152:0/963096216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b6c1009b0 0x7f8b6c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.300+0000 7f8b743c4640 1 --2- 172.21.15.152:0/963096216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b6c1069c0 0x7f8b6c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.300+0000 7f8b743c4640 1 -- 172.21.15.152:0/963096216 >> 172.21.15.152:0/963096216 conn(0x7f8b6c077990 msgr2=0x7f8b6c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.300+0000 7f8b743c4640 1 -- 172.21.15.152:0/963096216 shutdown_connections 2024-09-11T22:20:51.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.300+0000 7f8b743c4640 1 -- 172.21.15.152:0/963096216 wait complete. 2024-09-11T22:20:51.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b743c4640 1 Processor -- start 2024-09-11T22:20:51.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b743c4640 1 -- start start 2024-09-11T22:20:51.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b743c4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b6c1009b0 0x7f8b6c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b743c4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b6c101350 0x7f8b6c197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b743c4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b6c1069c0 0x7f8b6c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b743c4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c110e00 con 0x7f8b6c1069c0 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b743c4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c110c80 con 0x7f8b6c101350 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b743c4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c110f80 con 0x7f8b6c1009b0 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b72961640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b6c1069c0 0x7f8b6c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b72961640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b6c1069c0 0x7f8b6c19bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58828/0 (socket says 172.21.15.152:58828) 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b72961640 1 -- 172.21.15.152:0/36556200 learned_addr learned my addr 172.21.15.152:0/36556200 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b7195f640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b6c101350 0x7f8b6c197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.301+0000 7f8b72160640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b6c1009b0 0x7f8b6c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.302+0000 7f8b72961640 1 -- 172.21.15.152:0/36556200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b6c1009b0 msgr2=0x7f8b6c197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.302+0000 7f8b72961640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b6c1009b0 0x7f8b6c197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.302+0000 7f8b72961640 1 -- 172.21.15.152:0/36556200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b6c101350 msgr2=0x7f8b6c197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.302+0000 7f8b72961640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b6c101350 0x7f8b6c197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.302+0000 7f8b72961640 1 -- 172.21.15.152:0/36556200 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c19c230 con 0x7f8b6c1069c0 2024-09-11T22:20:51.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.302+0000 7f8b72961640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b6c1069c0 0x7f8b6c19bb00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c006010 tx=0x7f8b5c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.302+0000 7f8b6b7fe640 1 -- 172.21.15.152:0/36556200 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c004450 con 0x7f8b6c1069c0 2024-09-11T22:20:51.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.302+0000 7f8b743c4640 1 -- 172.21.15.152:0/36556200 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6c19c4c0 con 0x7f8b6c1069c0 2024-09-11T22:20:51.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.302+0000 7f8b6b7fe640 1 -- 172.21.15.152:0/36556200 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b5c003e10 con 0x7f8b6c1069c0 2024-09-11T22:20:51.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.302+0000 7f8b6b7fe640 1 -- 172.21.15.152:0/36556200 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c0466e0 con 0x7f8b6c1069c0 2024-09-11T22:20:51.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.302+0000 7f8b743c4640 1 -- 172.21.15.152:0/36556200 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6c1a3db0 con 0x7f8b6c1069c0 2024-09-11T22:20:51.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.303+0000 7f8b743c4640 1 -- 172.21.15.152:0/36556200 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b6c100e10 con 0x7f8b6c1069c0 2024-09-11T22:20:51.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.304+0000 7f8b6b7fe640 1 -- 172.21.15.152:0/36556200 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8b5c0305a0 con 0x7f8b6c1069c0 2024-09-11T22:20:51.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.305+0000 7f8b6b7fe640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8b540a2da0 0x7f8b540a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.305+0000 7f8b72160640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8b540a2da0 0x7f8b540a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.305+0000 7f8b6b7fe640 1 -- 172.21.15.152:0/36556200 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f8b5c02e030 con 0x7f8b6c1069c0 2024-09-11T22:20:51.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.305+0000 7f8b72160640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8b540a2da0 0x7f8b540a5260 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009890 tx=0x7f8b64008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.308+0000 7f8b6b7fe640 1 -- 172.21.15.152:0/36556200 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b5c04b060 con 0x7f8b6c1069c0 2024-09-11T22:20:51.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.496+0000 7f8b743c4640 1 -- 172.21.15.152:0/36556200 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f8b6c103e80 con 0x7f8b540a2da0 2024-09-11T22:20:51.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.504+0000 7f8b6b7fe640 1 -- 172.21.15.152:0/36556200 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f8b6c103e80 con 0x7f8b540a2da0 2024-09-11T22:20:51.505 INFO:teuthology.orchestra.run.smithi152.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-11T00:00:00", "created": "2024-09-11T22:04:28", "first": "2024-09-11T22:05:00", "last": "2024-09-11T22:20:00", "last_pruned": "2024-09-11T22:20:00", "created_count": 16, "pruned_count": 10, "active": true} 2024-09-11T22:20:51.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 -- 172.21.15.152:0/36556200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8b540a2da0 msgr2=0x7f8b540a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8b540a2da0 0x7f8b540a5260 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009890 tx=0x7f8b64008040 comp rx=0 tx=0).stop 2024-09-11T22:20:51.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 -- 172.21.15.152:0/36556200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b6c1069c0 msgr2=0x7f8b6c19bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b6c1069c0 0x7f8b6c19bb00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c006010 tx=0x7f8b5c003c20 comp rx=0 tx=0).stop 2024-09-11T22:20:51.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 -- 172.21.15.152:0/36556200 shutdown_connections 2024-09-11T22:20:51.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f8b540a2da0 0x7f8b540a5260 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b6c1069c0 0x7f8b6c19bb00 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b6c101350 0x7f8b6c197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 --2- 172.21.15.152:0/36556200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b6c1009b0 0x7f8b6c197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 -- 172.21.15.152:0/36556200 >> 172.21.15.152:0/36556200 conn(0x7f8b6c077990 msgr2=0x7f8b6c103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 -- 172.21.15.152:0/36556200 shutdown_connections 2024-09-11T22:20:51.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.506+0000 7f8b743c4640 1 -- 172.21.15.152:0/36556200 wait complete. 2024-09-11T22:20:51.518 DEBUG:teuthology.orchestra.run.smithi152:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-11T22:20:51.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.619+0000 7fb777e37640 1 -- 172.21.15.152:0/3203777461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770102d20 msgr2=0x7fb770103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.619+0000 7fb777e37640 1 --2- 172.21.15.152:0/3203777461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770102d20 0x7fb770103100 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009900 tx=0x7fb76c02a480 comp rx=0 tx=0).stop 2024-09-11T22:20:51.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 -- 172.21.15.152:0/3203777461 shutdown_connections 2024-09-11T22:20:51.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 --2- 172.21.15.152:0/3203777461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb77010c0f0 0x7fb77010e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 --2- 172.21.15.152:0/3203777461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770103640 0x7fb77010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 --2- 172.21.15.152:0/3203777461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770102d20 0x7fb770103100 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 -- 172.21.15.152:0/3203777461 >> 172.21.15.152:0/3203777461 conn(0x7fb770077990 msgr2=0x7fb7700fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 -- 172.21.15.152:0/3203777461 shutdown_connections 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 -- 172.21.15.152:0/3203777461 wait complete. 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 Processor -- start 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 -- start start 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770102d20 0x7fb770100970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770103640 0x7fb770100eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb77010c0f0 0x7fb7701013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb770111ec0 con 0x7fb770102d20 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb770111d40 con 0x7fb77010c0f0 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.620+0000 7fb777e37640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb770112040 con 0x7fb770103640 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb775bd3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770102d20 0x7fb770100970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb775bd3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770102d20 0x7fb770100970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58838/0 (socket says 172.21.15.152:58838) 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb775bd3640 1 -- 172.21.15.152:0/2847586232 learned_addr learned my addr 172.21.15.152:0/2847586232 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:51.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb7753d2640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770103640 0x7fb770100eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb7763d4640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb77010c0f0 0x7fb7701013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb775bd3640 1 -- 172.21.15.152:0/2847586232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770103640 msgr2=0x7fb770100eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb775bd3640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770103640 0x7fb770100eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb775bd3640 1 -- 172.21.15.152:0/2847586232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb77010c0f0 msgr2=0x7fb7701013f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb775bd3640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb77010c0f0 0x7fb7701013f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb775bd3640 1 -- 172.21.15.152:0/2847586232 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7701a6850 con 0x7fb770102d20 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb7763d4640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb77010c0f0 0x7fb7701013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb7753d2640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770103640 0x7fb770100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb775bd3640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770102d20 0x7fb770100970 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fb76c006010 tx=0x7fb76c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb766ffd640 1 -- 172.21.15.152:0/2847586232 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c03f030 con 0x7fb770102d20 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb777e37640 1 -- 172.21.15.152:0/2847586232 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7701a6ae0 con 0x7fb770102d20 2024-09-11T22:20:51.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb766ffd640 1 -- 172.21.15.152:0/2847586232 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb76c003ce0 con 0x7fb770102d20 2024-09-11T22:20:51.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb766ffd640 1 -- 172.21.15.152:0/2847586232 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c035070 con 0x7fb770102d20 2024-09-11T22:20:51.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.621+0000 7fb777e37640 1 -- 172.21.15.152:0/2847586232 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7701a6fd0 con 0x7fb770102d20 2024-09-11T22:20:51.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.622+0000 7fb777e37640 1 -- 172.21.15.152:0/2847586232 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb770103100 con 0x7fb770102d20 2024-09-11T22:20:51.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.624+0000 7fb766ffd640 1 -- 172.21.15.152:0/2847586232 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb76c042030 con 0x7fb770102d20 2024-09-11T22:20:51.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.625+0000 7fb766ffd640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb75c0a2da0 0x7fb75c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.625+0000 7fb7753d2640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb75c0a2da0 0x7fb75c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.625+0000 7fb766ffd640 1 -- 172.21.15.152:0/2847586232 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7fb76c0efd50 con 0x7fb770102d20 2024-09-11T22:20:51.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.625+0000 7fb7753d2640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb75c0a2da0 0x7fb75c0a5260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb770102400 tx=0x7fb760005e50 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.628+0000 7fb766ffd640 1 -- 172.21.15.152:0/2847586232 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb76c03bcd0 con 0x7fb770102d20 2024-09-11T22:20:51.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.822+0000 7fb777e37640 1 -- 172.21.15.152:0/2847586232 --> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb7700fd6f0 con 0x7fb75c0a2da0 2024-09-11T22:20:51.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.829+0000 7fb766ffd640 1 -- 172.21.15.152:0/2847586232 <== mgr.15129 v2:172.21.15.152:6800/4276759886 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb7700fd6f0 con 0x7fb75c0a2da0 2024-09-11T22:20:51.830 INFO:teuthology.orchestra.run.smithi152.stdout:/ 1m 6m3h 2024-09-11T22:20:51.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.831+0000 7fb777e37640 1 -- 172.21.15.152:0/2847586232 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb75c0a2da0 msgr2=0x7fb75c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.831+0000 7fb777e37640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb75c0a2da0 0x7fb75c0a5260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb770102400 tx=0x7fb760005e50 comp rx=0 tx=0).stop 2024-09-11T22:20:51.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.831+0000 7fb777e37640 1 -- 172.21.15.152:0/2847586232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770102d20 msgr2=0x7fb770100970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.831+0000 7fb777e37640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770102d20 0x7fb770100970 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fb76c006010 tx=0x7fb76c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.831+0000 7fb777e37640 1 -- 172.21.15.152:0/2847586232 shutdown_connections 2024-09-11T22:20:51.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.831+0000 7fb777e37640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fb75c0a2da0 0x7fb75c0a5260 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.831+0000 7fb777e37640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb77010c0f0 0x7fb7701013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.831+0000 7fb777e37640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb770103640 0x7fb770100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.831+0000 7fb777e37640 1 --2- 172.21.15.152:0/2847586232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb770102d20 0x7fb770100970 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.831+0000 7fb777e37640 1 -- 172.21.15.152:0/2847586232 >> 172.21.15.152:0/2847586232 conn(0x7fb770077990 msgr2=0x7fb7700fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.832+0000 7fb777e37640 1 -- 172.21.15.152:0/2847586232 shutdown_connections 2024-09-11T22:20:51.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:51.832+0000 7fb777e37640 1 -- 172.21.15.152:0/2847586232 wait complete. 2024-09-11T22:20:51.842 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:51 smithi152 ceph-mon[31188]: from='client.19602 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:51.842 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:51 smithi152 ceph-mon[31188]: pgmap v520: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 19 MiB/s wr, 1.50k op/s 2024-09-11T22:20:51.843 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-11T22:20:51.853 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-11T22:20:51.874 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-11T22:20:51.875 INFO:tasks.fwd_scrub:done joining 2024-09-11T22:20:51.875 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-11T22:20:51.884 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:52.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.013+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2276853486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3681069c0 msgr2=0x7fa368106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.013+0000 7fa36ffc6640 1 --2- 172.21.15.152:0/2276853486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3681069c0 0x7fa368106da0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009930 tx=0x7fa35c02a420 comp rx=0 tx=0).stop 2024-09-11T22:20:52.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.013+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2276853486 shutdown_connections 2024-09-11T22:20:52.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.013+0000 7fa36ffc6640 1 --2- 172.21.15.152:0/2276853486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa368101350 0x7fa36810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.013+0000 7fa36ffc6640 1 --2- 172.21.15.152:0/2276853486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3681009b0 0x7fa368100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.013+0000 7fa36ffc6640 1 --2- 172.21.15.152:0/2276853486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3681069c0 0x7fa368106da0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.013+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2276853486 >> 172.21.15.152:0/2276853486 conn(0x7fa3680fc690 msgr2=0x7fa3680feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.013+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2276853486 shutdown_connections 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.013+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2276853486 wait complete. 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36ffc6640 1 Processor -- start 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36ffc6640 1 -- start start 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36ffc6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3681009b0 0x7fa3681972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36ffc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa368101350 0x7fa368197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36ffc6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3681069c0 0x7fa36819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36ffc6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa368110dc0 con 0x7fa3681009b0 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36ffc6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa368110c40 con 0x7fa3681069c0 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36ffc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa368110f40 con 0x7fa368101350 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36dd62640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3681009b0 0x7fa3681972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36dd62640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3681009b0 0x7fa3681972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58860/0 (socket says 172.21.15.152:58860) 2024-09-11T22:20:52.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36dd62640 1 -- 172.21.15.152:0/2794821259 learned_addr learned my addr 172.21.15.152:0/2794821259 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36d561640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa368101350 0x7fa368197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36dd62640 1 -- 172.21.15.152:0/2794821259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa368101350 msgr2=0x7fa368197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36e563640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3681069c0 0x7fa36819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36dd62640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa368101350 0x7fa368197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36dd62640 1 -- 172.21.15.152:0/2794821259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3681069c0 msgr2=0x7fa36819bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36dd62640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3681069c0 0x7fa36819bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36dd62640 1 -- 172.21.15.152:0/2794821259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36819c2c0 con 0x7fa3681009b0 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.014+0000 7fa36dd62640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3681009b0 0x7fa3681972d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009230 tx=0x7fa35c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.015+0000 7fa35affd640 1 -- 172.21.15.152:0/2794821259 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c03f030 con 0x7fa3681009b0 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.015+0000 7fa35affd640 1 -- 172.21.15.152:0/2794821259 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa35c003ad0 con 0x7fa3681009b0 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.015+0000 7fa35affd640 1 -- 172.21.15.152:0/2794821259 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c035070 con 0x7fa3681009b0 2024-09-11T22:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.015+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2794821259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36819c550 con 0x7fa3681009b0 2024-09-11T22:20:52.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.015+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2794821259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3681a3e40 con 0x7fa3681009b0 2024-09-11T22:20:52.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.016+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2794821259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa368100e10 con 0x7fa3681009b0 2024-09-11T22:20:52.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.017+0000 7fa35affd640 1 -- 172.21.15.152:0/2794821259 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa35c042030 con 0x7fa3681009b0 2024-09-11T22:20:52.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.018+0000 7fa35affd640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3540a2d00 0x7fa3540a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.018+0000 7fa35affd640 1 -- 172.21.15.152:0/2794821259 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7fa35c0eff60 con 0x7fa3681009b0 2024-09-11T22:20:52.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.018+0000 7fa36d561640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3540a2d00 0x7fa3540a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.018+0000 7fa36d561640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3540a2d00 0x7fa3540a51c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa3680fecf0 tx=0x7fa36400a2d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.021+0000 7fa35affd640 1 -- 172.21.15.152:0/2794821259 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa35c0bcb20 con 0x7fa3681009b0 2024-09-11T22:20:52.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:51 smithi179 ceph-mon[35603]: from='client.19602 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:52.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:51 smithi179 ceph-mon[35603]: pgmap v520: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 19 MiB/s wr, 1.50k op/s 2024-09-11T22:20:52.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:51 smithi193 ceph-mon[35545]: from='client.19602 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:52.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:51 smithi193 ceph-mon[35545]: pgmap v520: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 19 MiB/s wr, 1.50k op/s 2024-09-11T22:20:52.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.191+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2794821259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa368108f20 con 0x7fa3681009b0 2024-09-11T22:20:52.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.193+0000 7fa35affd640 1 -- 172.21.15.152:0/2794821259 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+23360 (secure 0 0 0) 0x7fa35c0bc420 con 0x7fa3681009b0 2024-09-11T22:20:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:52.194 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":105,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:20:14.117833+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2394077400":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/1809855628":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6801/3828412393":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6800/3828412393":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/2661528324":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/321546578":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/1096456467":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2794821259 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3540a2d00 msgr2=0x7fa3540a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3540a2d00 0x7fa3540a51c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa3680fecf0 tx=0x7fa36400a2d0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2794821259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3681009b0 msgr2=0x7fa3681972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3681009b0 0x7fa3681972d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009230 tx=0x7fa35c004270 comp rx=0 tx=0).stop 2024-09-11T22:20:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2794821259 shutdown_connections 2024-09-11T22:20:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7fa3540a2d00 0x7fa3540a51c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3681069c0 0x7fa36819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa368101350 0x7fa368197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 --2- 172.21.15.152:0/2794821259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3681009b0 0x7fa3681972d0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2794821259 >> 172.21.15.152:0/2794821259 conn(0x7fa3680fc690 msgr2=0x7fa3680fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2794821259 shutdown_connections 2024-09-11T22:20:52.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.195+0000 7fa36ffc6640 1 -- 172.21.15.152:0/2794821259 wait complete. 2024-09-11T22:20:52.208 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T21:58:10.500177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T22:02:33.014997+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T22:02:34.841069+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:20:52.208 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:20:52.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.312+0000 7f02b7277640 1 -- 172.21.15.152:0/1445772352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02b0108130 msgr2=0x7f02b010ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.312+0000 7f02b7277640 1 --2- 172.21.15.152:0/1445772352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02b0108130 0x7f02b010ea50 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009ca0 tx=0x7f02a802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.312+0000 7f02b7277640 1 -- 172.21.15.152:0/1445772352 shutdown_connections 2024-09-11T22:20:52.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.312+0000 7f02b7277640 1 --2- 172.21.15.152:0/1445772352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02b0108130 0x7f02b010ea50 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.312+0000 7f02b7277640 1 --2- 172.21.15.152:0/1445772352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b0101290 0x7f02b01079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.312+0000 7f02b7277640 1 --2- 172.21.15.152:0/1445772352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02b01008e0 0x7f02b0100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.312+0000 7f02b7277640 1 -- 172.21.15.152:0/1445772352 >> 172.21.15.152:0/1445772352 conn(0x7f02b0075e00 msgr2=0x7f02b0076210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.312+0000 7f02b7277640 1 -- 172.21.15.152:0/1445772352 shutdown_connections 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.312+0000 7f02b7277640 1 -- 172.21.15.152:0/1445772352 wait complete. 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b7277640 1 Processor -- start 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b7277640 1 -- start start 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b7277640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b01008e0 0x7f02b0101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b7277640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02b0108130 0x7f02b0101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b7277640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02b01022d0 0x7f02b01a6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b7277640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f02b0111f60 con 0x7f02b0108130 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b7277640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f02b0111de0 con 0x7f02b01008e0 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b7277640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f02b01120e0 con 0x7f02b01022d0 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b4812640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02b0108130 0x7f02b0101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b4812640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02b0108130 0x7f02b0101d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58872/0 (socket says 172.21.15.152:58872) 2024-09-11T22:20:52.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b4812640 1 -- 172.21.15.152:0/1514686508 learned_addr learned my addr 172.21.15.152:0/1514686508 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b5814640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02b01022d0 0x7f02b01a6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b5013640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b01008e0 0x7f02b0101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b4812640 1 -- 172.21.15.152:0/1514686508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02b01022d0 msgr2=0x7f02b01a6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b4812640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02b01022d0 0x7f02b01a6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b4812640 1 -- 172.21.15.152:0/1514686508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b01008e0 msgr2=0x7f02b0101850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b4812640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b01008e0 0x7f02b0101850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.313+0000 7f02b4812640 1 -- 172.21.15.152:0/1514686508 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b01a6d60 con 0x7f02b0108130 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.314+0000 7f02b4812640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02b0108130 0x7f02b0101d90 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f02a000e9c0 tx=0x7f02a000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.314+0000 7f02a67fc640 1 -- 172.21.15.152:0/1514686508 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a000cd80 con 0x7f02b0108130 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.314+0000 7f02a67fc640 1 -- 172.21.15.152:0/1514686508 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02a0005500 con 0x7f02b0108130 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.314+0000 7f02b7277640 1 -- 172.21.15.152:0/1514686508 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b01a6ff0 con 0x7f02b0108130 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.314+0000 7f02a67fc640 1 -- 172.21.15.152:0/1514686508 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a0010690 con 0x7f02b0108130 2024-09-11T22:20:52.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.314+0000 7f02b7277640 1 -- 172.21.15.152:0/1514686508 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b01a7560 con 0x7f02b0108130 2024-09-11T22:20:52.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.315+0000 7f02b7277640 1 -- 172.21.15.152:0/1514686508 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b0100cc0 con 0x7f02b0108130 2024-09-11T22:20:52.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.316+0000 7f02a67fc640 1 -- 172.21.15.152:0/1514686508 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f02a00046c0 con 0x7f02b0108130 2024-09-11T22:20:52.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.316+0000 7f02a67fc640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f029c0a2db0 0x7f029c0a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.317+0000 7f02b5013640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f029c0a2db0 0x7f029c0a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.317+0000 7f02a67fc640 1 -- 172.21.15.152:0/1514686508 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f02a00cf790 con 0x7f02b0108130 2024-09-11T22:20:52.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.317+0000 7f02b5013640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f029c0a2db0 0x7f029c0a5270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f02ac005fd0 tx=0x7f02ac005850 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.321+0000 7f02a67fc640 1 -- 172.21.15.152:0/1514686508 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f02a009c350 con 0x7f02b0108130 2024-09-11T22:20:52.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.489+0000 7f02b7277640 1 -- 172.21.15.152:0/1514686508 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f02b0101290 con 0x7f02b0108130 2024-09-11T22:20:52.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.489+0000 7f02a67fc640 1 -- 172.21.15.152:0/1514686508 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) ==== 93+0+10 (secure 0 0 0) 0x7f02a009bc50 con 0x7f02b0108130 2024-09-11T22:20:52.490 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-09-11T22:20:52.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.491+0000 7f02b7277640 1 -- 172.21.15.152:0/1514686508 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f029c0a2db0 msgr2=0x7f029c0a5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.491+0000 7f02b7277640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f029c0a2db0 0x7f029c0a5270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f02ac005fd0 tx=0x7f02ac005850 comp rx=0 tx=0).stop 2024-09-11T22:20:52.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.491+0000 7f02b7277640 1 -- 172.21.15.152:0/1514686508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02b0108130 msgr2=0x7f02b0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.491+0000 7f02b7277640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02b0108130 0x7f02b0101d90 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f02a000e9c0 tx=0x7f02a000ee80 comp rx=0 tx=0).stop 2024-09-11T22:20:52.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.492+0000 7f02b7277640 1 -- 172.21.15.152:0/1514686508 shutdown_connections 2024-09-11T22:20:52.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.492+0000 7f02b7277640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f029c0a2db0 0x7f029c0a5270 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.492+0000 7f02b7277640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02b01022d0 0x7f02b01a6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.492+0000 7f02b7277640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02b0108130 0x7f02b0101d90 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.492+0000 7f02b7277640 1 --2- 172.21.15.152:0/1514686508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b01008e0 0x7f02b0101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.492+0000 7f02b7277640 1 -- 172.21.15.152:0/1514686508 >> 172.21.15.152:0/1514686508 conn(0x7f02b0075e00 msgr2=0x7f02b0105be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.492+0000 7f02b7277640 1 -- 172.21.15.152:0/1514686508 shutdown_connections 2024-09-11T22:20:52.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.492+0000 7f02b7277640 1 -- 172.21.15.152:0/1514686508 wait complete. 2024-09-11T22:20:52.503 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T22:20:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.606+0000 7f57a6042640 1 -- 172.21.15.152:0/505567438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a01069a0 msgr2=0x7f57a0106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.606+0000 7f57a6042640 1 --2- 172.21.15.152:0/505567438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a01069a0 0x7f57a0106d80 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f5790009930 tx=0x7f579002a420 comp rx=0 tx=0).stop 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.606+0000 7f57a6042640 1 -- 172.21.15.152:0/505567438 shutdown_connections 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.606+0000 7f57a6042640 1 --2- 172.21.15.152:0/505567438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a0101330 0x7f57a010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.606+0000 7f57a6042640 1 --2- 172.21.15.152:0/505567438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57a0100990 0x7f57a0100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.606+0000 7f57a6042640 1 --2- 172.21.15.152:0/505567438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a01069a0 0x7f57a0106d80 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.606+0000 7f57a6042640 1 -- 172.21.15.152:0/505567438 >> 172.21.15.152:0/505567438 conn(0x7f57a00fc6b0 msgr2=0x7f57a00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.606+0000 7f57a6042640 1 -- 172.21.15.152:0/505567438 shutdown_connections 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.606+0000 7f57a6042640 1 -- 172.21.15.152:0/505567438 wait complete. 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f57a6042640 1 Processor -- start 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f57a6042640 1 -- start start 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f57a6042640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a0100990 0x7f57a01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f57a6042640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a0101330 0x7f57a0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f57a6042640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57a01069a0 0x7f57a019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f57a6042640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f57a0111fd0 con 0x7f57a0101330 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f57a6042640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f57a0111e50 con 0x7f57a0100990 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f57a6042640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57a0112150 con 0x7f57a01069a0 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f5797fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a0101330 0x7f57a0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f5797fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a0101330 0x7f57a0198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58884/0 (socket says 172.21.15.152:58884) 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f5797fff640 1 -- 172.21.15.152:0/794776922 learned_addr learned my addr 172.21.15.152:0/794776922 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f579ffff640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57a01069a0 0x7f57a019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f579f7fe640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a0100990 0x7f57a01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f5797fff640 1 -- 172.21.15.152:0/794776922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57a01069a0 msgr2=0x7f57a019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f5797fff640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57a01069a0 0x7f57a019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f5797fff640 1 -- 172.21.15.152:0/794776922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a0100990 msgr2=0x7f57a01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f5797fff640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a0100990 0x7f57a01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.607+0000 7f5797fff640 1 -- 172.21.15.152:0/794776922 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a019d3c0 con 0x7f57a0101330 2024-09-11T22:20:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.608+0000 7f5797fff640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a0101330 0x7f57a0198910 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f578800d770 tx=0x7f578800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.608+0000 7f579d7fa640 1 -- 172.21.15.152:0/794776922 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788017070 con 0x7f57a0101330 2024-09-11T22:20:52.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.608+0000 7f579d7fa640 1 -- 172.21.15.152:0/794776922 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5788005500 con 0x7f57a0101330 2024-09-11T22:20:52.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.608+0000 7f57a6042640 1 -- 172.21.15.152:0/794776922 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a019d6b0 con 0x7f57a0101330 2024-09-11T22:20:52.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.608+0000 7f579d7fa640 1 -- 172.21.15.152:0/794776922 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788004e00 con 0x7f57a0101330 2024-09-11T22:20:52.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.608+0000 7f57a6042640 1 -- 172.21.15.152:0/794776922 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a01a4f40 con 0x7f57a0101330 2024-09-11T22:20:52.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.609+0000 7f57a6042640 1 -- 172.21.15.152:0/794776922 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a0100df0 con 0x7f57a0101330 2024-09-11T22:20:52.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.610+0000 7f579d7fa640 1 -- 172.21.15.152:0/794776922 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f5788004fa0 con 0x7f57a0101330 2024-09-11T22:20:52.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.610+0000 7f579d7fa640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f578c0a2d80 0x7f578c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.611+0000 7f579f7fe640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f578c0a2d80 0x7f578c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.611+0000 7f579d7fa640 1 -- 172.21.15.152:0/794776922 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f57880ceec0 con 0x7f57a0101330 2024-09-11T22:20:52.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.611+0000 7f579f7fe640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f578c0a2d80 0x7f578c0a5240 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5790000c00 tx=0x7f5790005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.615+0000 7f579d7fa640 1 -- 172.21.15.152:0/794776922 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f578809ba80 con 0x7f57a0101330 2024-09-11T22:20:52.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.782+0000 7f57a6042640 1 -- 172.21.15.152:0/794776922 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f57a002d7c0 con 0x7f57a0101330 2024-09-11T22:20:52.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.783+0000 7f579d7fa640 1 -- 172.21.15.152:0/794776922 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v105) ==== 104+0+11 (secure 0 0 0) 0x7f578809b380 con 0x7f57a0101330 2024-09-11T22:20:52.784 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-09-11T22:20:52.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 -- 172.21.15.152:0/794776922 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f578c0a2d80 msgr2=0x7f578c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f578c0a2d80 0x7f578c0a5240 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5790000c00 tx=0x7f5790005a20 comp rx=0 tx=0).stop 2024-09-11T22:20:52.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 -- 172.21.15.152:0/794776922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a0101330 msgr2=0x7f57a0198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a0101330 0x7f57a0198910 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f578800d770 tx=0x7f578800dc30 comp rx=0 tx=0).stop 2024-09-11T22:20:52.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 -- 172.21.15.152:0/794776922 shutdown_connections 2024-09-11T22:20:52.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f578c0a2d80 0x7f578c0a5240 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57a01069a0 0x7f57a019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a0101330 0x7f57a0198910 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 --2- 172.21.15.152:0/794776922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a0100990 0x7f57a01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 -- 172.21.15.152:0/794776922 >> 172.21.15.152:0/794776922 conn(0x7f57a00fc6b0 msgr2=0x7f57a00fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 -- 172.21.15.152:0/794776922 shutdown_connections 2024-09-11T22:20:52.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.785+0000 7f57a6042640 1 -- 172.21.15.152:0/794776922 wait complete. 2024-09-11T22:20:52.797 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T22:20:52.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.899+0000 7f974c4e4640 1 -- 172.21.15.152:0/2952093577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97441069c0 msgr2=0x7f9744106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.899+0000 7f974c4e4640 1 --2- 172.21.15.152:0/2952093577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97441069c0 0x7f9744106da0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f9740009930 tx=0x7f974002a420 comp rx=0 tx=0).stop 2024-09-11T22:20:52.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.899+0000 7f974c4e4640 1 -- 172.21.15.152:0/2952093577 shutdown_connections 2024-09-11T22:20:52.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.899+0000 7f974c4e4640 1 --2- 172.21.15.152:0/2952093577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9744101350 0x7f974410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.899+0000 7f974c4e4640 1 --2- 172.21.15.152:0/2952093577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97441009b0 0x7f9744100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.899+0000 7f974c4e4640 1 --2- 172.21.15.152:0/2952093577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97441069c0 0x7f9744106da0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.899+0000 7f974c4e4640 1 -- 172.21.15.152:0/2952093577 >> 172.21.15.152:0/2952093577 conn(0x7f97440fc690 msgr2=0x7f97440feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.899+0000 7f974c4e4640 1 -- 172.21.15.152:0/2952093577 shutdown_connections 2024-09-11T22:20:52.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.899+0000 7f974c4e4640 1 -- 172.21.15.152:0/2952093577 wait complete. 2024-09-11T22:20:52.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974c4e4640 1 Processor -- start 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974c4e4640 1 -- start start 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974c4e4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97441009b0 0x7f9744197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974c4e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9744101350 0x7f9744197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974c4e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97441069c0 0x7f974419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974c4e4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9744110e00 con 0x7f97441009b0 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974c4e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9744110c80 con 0x7f97441069c0 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974c4e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9744110f80 con 0x7f9744101350 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974a280640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97441009b0 0x7f9744197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974a280640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97441009b0 0x7f9744197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58900/0 (socket says 172.21.15.152:58900) 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974a280640 1 -- 172.21.15.152:0/3957640384 learned_addr learned my addr 172.21.15.152:0/3957640384 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974aa81640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97441069c0 0x7f974419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974a280640 1 -- 172.21.15.152:0/3957640384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9744101350 msgr2=0x7f9744197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974a280640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9744101350 0x7f9744197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974a280640 1 -- 172.21.15.152:0/3957640384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97441069c0 msgr2=0x7f974419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974a280640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97441069c0 0x7f974419bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.900+0000 7f974a280640 1 -- 172.21.15.152:0/3957640384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974419c300 con 0x7f97441009b0 2024-09-11T22:20:52.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.901+0000 7f974a280640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97441009b0 0x7f9744197310 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f9740009230 tx=0x7f9740004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.901+0000 7f973b7fe640 1 -- 172.21.15.152:0/3957640384 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974003f030 con 0x7f97441009b0 2024-09-11T22:20:52.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.901+0000 7f973b7fe640 1 -- 172.21.15.152:0/3957640384 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9740003ad0 con 0x7f97441009b0 2024-09-11T22:20:52.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.901+0000 7f973b7fe640 1 -- 172.21.15.152:0/3957640384 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740035070 con 0x7f97441009b0 2024-09-11T22:20:52.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.901+0000 7f974c4e4640 1 -- 172.21.15.152:0/3957640384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974419c590 con 0x7f97441009b0 2024-09-11T22:20:52.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.901+0000 7f974c4e4640 1 -- 172.21.15.152:0/3957640384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97441a3e80 con 0x7f97441009b0 2024-09-11T22:20:52.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.902+0000 7f974c4e4640 1 -- 172.21.15.152:0/3957640384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9744100e10 con 0x7f97441009b0 2024-09-11T22:20:52.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.903+0000 7f973b7fe640 1 -- 172.21.15.152:0/3957640384 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9740042030 con 0x7f97441009b0 2024-09-11T22:20:52.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.904+0000 7f973b7fe640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97300a2d00 0x7f97300a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.904+0000 7f9749a7f640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97300a2d00 0x7f97300a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.904+0000 7f973b7fe640 1 -- 172.21.15.152:0/3957640384 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f97400eff70 con 0x7f97441009b0 2024-09-11T22:20:52.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.904+0000 7f9749a7f640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97300a2d00 0x7f97300a51c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f97440ffde0 tx=0x7f9734005bf0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:52.907+0000 7f973b7fe640 1 -- 172.21.15.152:0/3957640384 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97400bcb30 con 0x7f97441009b0 2024-09-11T22:20:53.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:52 smithi179 ceph-mon[35603]: from='client.19608 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:53.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:52 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2794821259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:20:53.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:52 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1514686508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:20:53.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.072+0000 7f974c4e4640 1 -- 172.21.15.152:0/3957640384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9744108f20 con 0x7f97441009b0 2024-09-11T22:20:53.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.073+0000 7f973b7fe640 1 -- 172.21.15.152:0/3957640384 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v105) ==== 100+0+11 (secure 0 0 0) 0x7f97400bc430 con 0x7f97441009b0 2024-09-11T22:20:53.074 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-09-11T22:20:53.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 -- 172.21.15.152:0/3957640384 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97300a2d00 msgr2=0x7f97300a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97300a2d00 0x7f97300a51c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f97440ffde0 tx=0x7f9734005bf0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 -- 172.21.15.152:0/3957640384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97441009b0 msgr2=0x7f9744197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97441009b0 0x7f9744197310 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f9740009230 tx=0x7f9740004270 comp rx=0 tx=0).stop 2024-09-11T22:20:53.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 -- 172.21.15.152:0/3957640384 shutdown_connections 2024-09-11T22:20:53.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f97300a2d00 0x7f97300a51c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97441069c0 0x7f974419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9744101350 0x7f9744197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 --2- 172.21.15.152:0/3957640384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97441009b0 0x7f9744197310 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 -- 172.21.15.152:0/3957640384 >> 172.21.15.152:0/3957640384 conn(0x7f97440fc690 msgr2=0x7f97440fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:53.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 -- 172.21.15.152:0/3957640384 shutdown_connections 2024-09-11T22:20:53.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.075+0000 7f974c4e4640 1 -- 172.21.15.152:0/3957640384 wait complete. 2024-09-11T22:20:53.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:52 smithi193 ceph-mon[35545]: from='client.19608 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:53.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:52 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2794821259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:20:53.077 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:52 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1514686508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:20:53.086 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:52 smithi152 ceph-mon[31188]: from='client.19608 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:53.086 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:52 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2794821259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:20:53.086 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:52 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1514686508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:20:53.087 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-11T22:20:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.186+0000 7f63e709b640 1 -- 172.21.15.152:0/3679111179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e0102440 msgr2=0x7f63e010e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.186+0000 7f63e709b640 1 --2- 172.21.15.152:0/3679111179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e0102440 0x7f63e010e970 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009cd0 tx=0x7f63d802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.186+0000 7f63e709b640 1 -- 172.21.15.152:0/3679111179 shutdown_connections 2024-09-11T22:20:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.186+0000 7f63e709b640 1 --2- 172.21.15.152:0/3679111179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e0102440 0x7f63e010e970 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.186+0000 7f63e709b640 1 --2- 172.21.15.152:0/3679111179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e0101aa0 0x7f63e0101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.186+0000 7f63e709b640 1 --2- 172.21.15.152:0/3679111179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e0107ab0 0x7f63e0107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.186+0000 7f63e709b640 1 -- 172.21.15.152:0/3679111179 >> 172.21.15.152:0/3679111179 conn(0x7f63e00fd7c0 msgr2=0x7f63e00ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.186+0000 7f63e709b640 1 -- 172.21.15.152:0/3679111179 shutdown_connections 2024-09-11T22:20:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.186+0000 7f63e709b640 1 -- 172.21.15.152:0/3679111179 wait complete. 2024-09-11T22:20:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e709b640 1 Processor -- start 2024-09-11T22:20:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e709b640 1 -- start start 2024-09-11T22:20:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e709b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e0101aa0 0x7f63e0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e709b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e0102440 0x7f63e0198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e709b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e0107ab0 0x7f63e019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e709b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0111ef0 con 0x7f63e0101aa0 2024-09-11T22:20:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e709b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0111d70 con 0x7f63e0102440 2024-09-11T22:20:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e709b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0112070 con 0x7f63e0107ab0 2024-09-11T22:20:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e4e37640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e0101aa0 0x7f63e0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e4e37640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e0101aa0 0x7f63e0198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58932/0 (socket says 172.21.15.152:58932) 2024-09-11T22:20:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e4e37640 1 -- 172.21.15.152:0/3816555790 learned_addr learned my addr 172.21.15.152:0/3816555790 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:20:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63dffff640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e0102440 0x7f63e0198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e5638640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e0107ab0 0x7f63e019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e4e37640 1 -- 172.21.15.152:0/3816555790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e0107ab0 msgr2=0x7f63e019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e4e37640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e0107ab0 0x7f63e019cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e4e37640 1 -- 172.21.15.152:0/3816555790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e0102440 msgr2=0x7f63e0198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e4e37640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e0102440 0x7f63e0198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.187+0000 7f63e4e37640 1 -- 172.21.15.152:0/3816555790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e019d310 con 0x7f63e0101aa0 2024-09-11T22:20:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.188+0000 7f63e4e37640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e0101aa0 0x7f63e0198320 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f63d400d770 tx=0x7f63d400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:53.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.188+0000 7f63ddffb640 1 -- 172.21.15.152:0/3816555790 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4017070 con 0x7f63e0101aa0 2024-09-11T22:20:53.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.188+0000 7f63ddffb640 1 -- 172.21.15.152:0/3816555790 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63d4009820 con 0x7f63e0101aa0 2024-09-11T22:20:53.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.188+0000 7f63e709b640 1 -- 172.21.15.152:0/3816555790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e019d600 con 0x7f63e0101aa0 2024-09-11T22:20:53.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.188+0000 7f63ddffb640 1 -- 172.21.15.152:0/3816555790 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4004cd0 con 0x7f63e0101aa0 2024-09-11T22:20:53.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.188+0000 7f63e709b640 1 -- 172.21.15.152:0/3816555790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e01a4e90 con 0x7f63e0101aa0 2024-09-11T22:20:53.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.189+0000 7f63e709b640 1 -- 172.21.15.152:0/3816555790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e0101f00 con 0x7f63e0101aa0 2024-09-11T22:20:53.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.190+0000 7f63ddffb640 1 -- 172.21.15.152:0/3816555790 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f63d40099d0 con 0x7f63e0101aa0 2024-09-11T22:20:53.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.191+0000 7f63ddffb640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63d00a2d80 0x7f63d00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.191+0000 7f63ddffb640 1 -- 172.21.15.152:0/3816555790 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8614+0+0 (secure 0 0 0) 0x7f63d40cee20 con 0x7f63e0101aa0 2024-09-11T22:20:53.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.191+0000 7f63dffff640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63d00a2d80 0x7f63d00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.191+0000 7f63dffff640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63d00a2d80 0x7f63d00a5240 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f63e00ffd80 tx=0x7f63cc00a2d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:53.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.195+0000 7f63ddffb640 1 -- 172.21.15.152:0/3816555790 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63d409b9e0 con 0x7f63e0101aa0 2024-09-11T22:20:53.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.406+0000 7f63e709b640 1 -- 172.21.15.152:0/3816555790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f63e01a5100 con 0x7f63e0101aa0 2024-09-11T22:20:53.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.414+0000 7f63ddffb640 1 -- 172.21.15.152:0/3816555790 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+740913 (secure 0 0 0) 0x7f63d409b2e0 con 0x7f63e0101aa0 2024-09-11T22:20:53.426 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:20:53.426 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:20:53.426 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 25, 2024-09-11T22:20:53.426 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.426 INFO:teuthology.orchestra.run.smithi152.stdout: "active_gid": 15129, 2024-09-11T22:20:53.426 INFO:teuthology.orchestra.run.smithi152.stdout: "active_name": "x", 2024-09-11T22:20:53.426 INFO:teuthology.orchestra.run.smithi152.stdout: "active_addrs": { 2024-09-11T22:20:53.427 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2024-09-11T22:20:53.427 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.427 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v2", 2024-09-11T22:20:53.427 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6800", 2024-09-11T22:20:53.427 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 4276759886 2024-09-11T22:20:53.427 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.427 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.427 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2024-09-11T22:20:53.427 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6801", 2024-09-11T22:20:53.427 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 4276759886 2024-09-11T22:20:53.427 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.428 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T22:20:53.428 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.428 INFO:teuthology.orchestra.run.smithi152.stdout: "active_addr": "172.21.15.152:6801/4276759886", 2024-09-11T22:20:53.428 INFO:teuthology.orchestra.run.smithi152.stdout: "active_change": "2024-09-11T22:04:17.346753+0000", 2024-09-11T22:20:53.428 INFO:teuthology.orchestra.run.smithi152.stdout: "active_mgr_features": 4540701547738038271, 2024-09-11T22:20:53.428 INFO:teuthology.orchestra.run.smithi152.stdout: "available": true, 2024-09-11T22:20:53.428 INFO:teuthology.orchestra.run.smithi152.stdout: "standbys": [ 2024-09-11T22:20:53.428 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.428 INFO:teuthology.orchestra.run.smithi152.stdout: "gid": 24749, 2024-09-11T22:20:53.428 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "y", 2024-09-11T22:20:53.428 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr_features": 4540701547738038271, 2024-09-11T22:20:53.429 INFO:teuthology.orchestra.run.smithi152.stdout: "available_modules": [ 2024-09-11T22:20:53.429 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.429 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "alerts", 2024-09-11T22:20:53.429 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.429 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.429 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.429 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:53.429 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:53.429 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.429 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.431 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.431 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.431 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.431 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.431 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.431 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.431 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.431 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.431 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.431 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.431 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.432 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.433 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.434 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.435 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_destination": { 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_destination", 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.436 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Email address to send alerts to", 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_from_name": { 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_from_name", 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.437 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "Ceph", 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Email From: name", 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_host": { 2024-09-11T22:20:53.438 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_host", 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SMTP server", 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_password": { 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_password", 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Password to authenticate with", 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.440 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_port": { 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_port", 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "465", 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SMTP port", 2024-09-11T22:20:53.441 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.442 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.442 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.442 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_sender": { 2024-09-11T22:20:53.442 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_sender", 2024-09-11T22:20:53.442 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.442 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.442 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.442 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.442 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.442 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.443 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.443 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SMTP envelope sender", 2024-09-11T22:20:53.443 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.443 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.443 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.443 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_ssl": { 2024-09-11T22:20:53.443 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_ssl", 2024-09-11T22:20:53.443 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.443 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T22:20:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_user": { 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_user", 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "User to authenticate as", 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.445 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "balancer", 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: "active": { 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "active", 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.446 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "begin_time": { 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "begin_time", 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.447 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0000", 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "begin_weekday": { 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "begin_weekday", 2024-09-11T22:20:53.448 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:53.449 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.449 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.449 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:53.449 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "0", 2024-09-11T22:20:53.449 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "6", 2024-09-11T22:20:53.449 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.449 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T22:20:53.449 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:20:53.449 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.449 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_compat_max_iterations": { 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crush_compat_max_iterations", 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "25", 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "250", 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T22:20:53.450 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_compat_metrics": { 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crush_compat_metrics", 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_compat_step": { 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crush_compat_step", 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0.5", 2024-09-11T22:20:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "0.001", 2024-09-11T22:20:53.453 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "0.999", 2024-09-11T22:20:53.453 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.453 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "aggressiveness of optimization", 2024-09-11T22:20:53.453 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T22:20:53.453 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.453 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.453 INFO:teuthology.orchestra.run.smithi152.stdout: "end_time": { 2024-09-11T22:20:53.453 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "end_time", 2024-09-11T22:20:53.454 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.454 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.454 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.454 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "2359", 2024-09-11T22:20:53.454 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.454 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.454 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.454 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T22:20:53.454 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:20:53.455 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.456 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.456 INFO:teuthology.orchestra.run.smithi152.stdout: "end_weekday": { 2024-09-11T22:20:53.456 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "end_weekday", 2024-09-11T22:20:53.456 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:53.456 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.456 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.456 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:53.456 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "0", 2024-09-11T22:20:53.457 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "6", 2024-09-11T22:20:53.457 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.457 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T22:20:53.457 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:20:53.457 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.457 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.457 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.458 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.459 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.460 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.460 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.460 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.460 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.460 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.460 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.460 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.460 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.461 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.461 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.461 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.461 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.461 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.461 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.461 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.461 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.461 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.461 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.462 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "min_score": { 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "min_score", 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.464 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": { 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mode", 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "upmap", 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.465 INFO:teuthology.orchestra.run.smithi152.stdout: "crush-compat", 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: "none", 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: "read", 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap", 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap-read" 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Balancer mode", 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: "pool_ids": { 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pool_ids", 2024-09-11T22:20:53.466 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.467 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:53.468 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:53.468 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.468 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.468 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.468 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:53.468 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.468 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.468 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.468 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T22:20:53.468 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.468 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap_max_deviation": { 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "upmap_max_deviation", 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T22:20:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap_max_optimizations": { 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "upmap_max_optimizations", 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.470 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cephadm", 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: "agent_down_multiplier": { 2024-09-11T22:20:53.471 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "agent_down_multiplier", 2024-09-11T22:20:53.472 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:53.472 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.472 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.472 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "3.0", 2024-09-11T22:20:53.472 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.472 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.472 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.472 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T22:20:53.472 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.472 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.473 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.473 INFO:teuthology.orchestra.run.smithi152.stdout: "agent_refresh_rate": { 2024-09-11T22:20:53.473 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "agent_refresh_rate", 2024-09-11T22:20:53.473 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.473 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.473 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.473 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "20", 2024-09-11T22:20:53.473 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.473 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.473 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: "agent_starting_port": { 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "agent_starting_port", 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "4721", 2024-09-11T22:20:53.474 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.475 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.475 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.475 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T22:20:53.475 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.475 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.475 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.476 INFO:teuthology.orchestra.run.smithi152.stdout: "allow_ptrace": { 2024-09-11T22:20:53.476 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "allow_ptrace", 2024-09-11T22:20:53.476 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.476 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.476 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.476 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi152.stdout: "autotune_interval": { 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "autotune_interval", 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "autotune_memory_target_ratio": { 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0.7", 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: "cephadm_log_destination": { 2024-09-11T22:20:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cephadm_log_destination", 2024-09-11T22:20:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: "file", 2024-09-11T22:20:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: "file,syslog", 2024-09-11T22:20:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: "syslog" 2024-09-11T22:20:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T22:20:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "cgroups_split": { 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cgroups_split", 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "config_checks_enabled": { 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "config_checks_enabled", 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "config_dashboard": { 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "config_dashboard", 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_alertmanager": { 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_alertmanager", 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:53.486 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_base": { 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_base", 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Container image name, without the tag", 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_elasticsearch": { 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_elasticsearch", 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T22:20:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "elasticsearch container image", 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_grafana": { 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_grafana", 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.489 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.490 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T22:20:53.490 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.490 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.490 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.490 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:53.490 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.490 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.490 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_haproxy": { 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_haproxy", 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "HAproxy container image", 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.491 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_jaeger_agent": { 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_jaeger_agent", 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Jaeger agent container image", 2024-09-11T22:20:53.492 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_jaeger_collector": { 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_jaeger_collector", 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.493 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Jaeger collector container image", 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_jaeger_query": { 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_jaeger_query", 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T22:20:53.494 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Jaeger query container image", 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_keepalived": { 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_keepalived", 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.495 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T22:20:53.496 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.496 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.496 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.496 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Keepalived container image", 2024-09-11T22:20:53.496 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.496 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.496 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.496 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_loki": { 2024-09-11T22:20:53.496 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_loki", 2024-09-11T22:20:53.496 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Loki container image", 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.497 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_node_exporter": { 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_node_exporter", 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.498 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_nvmeof": { 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_nvmeof", 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Nvme-of container image", 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_prometheus": { 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_prometheus", 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.500 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_promtail": { 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_promtail", 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.501 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Promtail container image", 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_samba": { 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_samba", 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Samba/SMB container image", 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_snmp_gateway": { 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_snmp_gateway", 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T22:20:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SNMP Gateway container image", 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "container_init": { 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_init", 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.504 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: "daemon_cache_timeout": { 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "daemon_cache_timeout", 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "default_cephadm_command_timeout": { 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T22:20:53.506 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "900", 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "default_registry": { 2024-09-11T22:20:53.507 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "default_registry", 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io", 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "device_cache_timeout": { 2024-09-11T22:20:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "device_cache_timeout", 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "1800", 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "seconds to cache device inventory", 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "device_enhanced_scan": { 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "device_enhanced_scan", 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.510 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "facts_cache_timeout": { 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "facts_cache_timeout", 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "seconds to cache host facts data", 2024-09-11T22:20:53.511 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.512 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.512 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.512 INFO:teuthology.orchestra.run.smithi152.stdout: "grafana_dashboards_path": { 2024-09-11T22:20:53.512 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "grafana_dashboards_path", 2024-09-11T22:20:53.512 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.512 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.512 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.512 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T22:20:53.513 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.513 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.513 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.513 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T22:20:53.513 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.514 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.514 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.514 INFO:teuthology.orchestra.run.smithi152.stdout: "host_check_interval": { 2024-09-11T22:20:53.514 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "host_check_interval", 2024-09-11T22:20:53.514 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.514 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.515 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.515 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:53.515 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.515 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.515 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.515 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to perform a host check", 2024-09-11T22:20:53.516 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.516 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.516 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.516 INFO:teuthology.orchestra.run.smithi152.stdout: "hw_monitoring": { 2024-09-11T22:20:53.516 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "hw_monitoring", 2024-09-11T22:20:53.516 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.516 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.516 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.516 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "inventory_list_all": { 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "inventory_list_all", 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.517 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.518 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: "log_refresh_metadata": { 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_refresh_metadata", 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.520 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.521 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.522 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.523 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.524 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.525 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.526 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "*", 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "max_count_per_host": { 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_count_per_host", 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.527 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.528 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.528 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:53.528 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.528 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.528 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.528 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "max number of daemons per service per host", 2024-09-11T22:20:53.528 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.528 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.528 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.529 INFO:teuthology.orchestra.run.smithi152.stdout: "max_osd_draining_count": { 2024-09-11T22:20:53.529 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_osd_draining_count", 2024-09-11T22:20:53.529 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.529 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.529 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.529 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:53.529 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.529 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.530 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.530 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T22:20:53.530 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.530 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.530 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.530 INFO:teuthology.orchestra.run.smithi152.stdout: "migration_current": { 2024-09-11T22:20:53.530 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "migration_current", 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "internal - do not modify", 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.532 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": { 2024-09-11T22:20:53.532 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mode", 2024-09-11T22:20:53.532 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.532 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.532 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.532 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "root", 2024-09-11T22:20:53.532 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.532 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.532 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.532 INFO:teuthology.orchestra.run.smithi152.stdout: "cephadm-package", 2024-09-11T22:20:53.532 INFO:teuthology.orchestra.run.smithi152.stdout: "root" 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: "oob_default_addr": { 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "oob_default_addr", 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.533 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "169.254.1.1", 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: "prometheus_alerts_path": { 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "prometheus_alerts_path", 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.534 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_insecure": { 2024-09-11T22:20:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_insecure", 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.537 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_password": { 2024-09-11T22:20:53.537 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_password", 2024-09-11T22:20:53.537 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.537 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.537 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.537 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_url": { 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_url", 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.538 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.539 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.539 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.539 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.539 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.539 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T22:20:53.539 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.539 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.539 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.540 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_username": { 2024-09-11T22:20:53.540 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_username", 2024-09-11T22:20:53.540 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.540 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.540 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.541 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.541 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.541 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.541 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.541 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T22:20:53.541 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.541 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.541 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.541 INFO:teuthology.orchestra.run.smithi152.stdout: "secure_monitoring_stack": { 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "secure_monitoring_stack", 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.542 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "service_discovery_port": { 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "service_discovery_port", 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8765", 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "cephadm service discovery port", 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.543 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "ssh_config_file": { 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssh_config_file", 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T22:20:53.544 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "use_agent": { 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "use_agent", 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.545 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "use_repo_digest": { 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "use_repo_digest", 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.546 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_on_failed_host_check": { 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_on_failed_host_check", 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.547 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_on_stray_daemons": { 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_on_stray_daemons", 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.548 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.549 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.549 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T22:20:53.549 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.549 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.549 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.549 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_on_stray_hosts": { 2024-09-11T22:20:53.549 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_on_stray_hosts", 2024-09-11T22:20:53.549 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.550 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.550 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.550 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.550 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.550 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.550 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.550 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T22:20:53.550 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.550 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.550 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.550 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.551 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.551 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crash", 2024-09-11T22:20:53.551 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.551 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.551 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.551 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.551 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.551 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.552 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.553 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.553 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.553 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.553 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.553 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.553 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.553 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.553 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.554 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.554 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.554 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.554 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.554 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.554 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.554 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.554 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.554 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.555 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.555 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.555 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.555 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.555 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.556 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.557 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.557 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.557 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.557 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.557 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.557 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.557 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.557 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.557 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.557 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: "retain_interval": { 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "retain_interval", 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.559 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "31536000", 2024-09-11T22:20:53.559 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.559 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.559 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.559 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T22:20:53.559 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.559 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.559 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.559 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_recent_interval": { 2024-09-11T22:20:53.559 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_recent_interval", 2024-09-11T22:20:53.560 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.560 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.560 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.560 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "1209600", 2024-09-11T22:20:53.560 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.560 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.560 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.560 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T22:20:53.560 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.560 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "dashboard", 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T22:20:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T22:20:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T22:20:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "AUDIT_API_ENABLED": { 2024-09-11T22:20:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T22:20:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T22:20:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T22:20:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T22:20:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T22:20:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T22:20:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T22:20:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T22:20:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T22:20:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T22:20:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T22:20:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T22:20:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T22:20:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T22:20:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T22:20:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T22:20:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "admin", 2024-09-11T22:20:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T22:20:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T22:20:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_URL": { 2024-09-11T22:20:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_URL", 2024-09-11T22:20:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "admin", 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T22:20:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T22:20:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T22:20:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T22:20:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T22:20:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T22:20:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T22:20:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T22:20:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T22:20:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T22:20:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T22:20:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8", 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "45", 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "admin", 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T22:20:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T22:20:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T22:20:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "cross_origin_url": { 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cross_origin_url", 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "crt_file": { 2024-09-11T22:20:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crt_file", 2024-09-11T22:20:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "debug": { 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "debug", 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Enable/disable debug options", 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "jwt_token_ttl": { 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "jwt_token_ttl", 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "28800", 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "key_file": { 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "key_file", 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "motd": { 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "motd", 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "The message of the day", 2024-09-11T22:20:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "redirect_resolve_ip_addr": { 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "server_addr": { 2024-09-11T22:20:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_addr", 2024-09-11T22:20:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "::", 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "server_port": { 2024-09-11T22:20:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_port", 2024-09-11T22:20:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8080", 2024-09-11T22:20:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "ssl": { 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssl", 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "ssl_server_port": { 2024-09-11T22:20:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssl_server_port", 2024-09-11T22:20:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8443", 2024-09-11T22:20:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_behaviour": { 2024-09-11T22:20:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_behaviour", 2024-09-11T22:20:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "redirect", 2024-09-11T22:20:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "redirect" 2024-09-11T22:20:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_error_status_code": { 2024-09-11T22:20:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_error_status_code", 2024-09-11T22:20:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "500", 2024-09-11T22:20:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "400", 2024-09-11T22:20:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "599", 2024-09-11T22:20:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "url_prefix": { 2024-09-11T22:20:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "url_prefix", 2024-09-11T22:20:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "devicehealth", 2024-09-11T22:20:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "enable_monitoring": { 2024-09-11T22:20:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enable_monitoring", 2024-09-11T22:20:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "monitor device health metrics", 2024-09-11T22:20:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "mark_out_threshold": { 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mark_out_threshold", 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "2419200", 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T22:20:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "pool_name": { 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pool_name", 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "device_health_metrics", 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T22:20:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "retention_period": { 2024-09-11T22:20:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "retention_period", 2024-09-11T22:20:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "15552000", 2024-09-11T22:20:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how long to retain device health metrics", 2024-09-11T22:20:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "scrape_frequency": { 2024-09-11T22:20:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "scrape_frequency", 2024-09-11T22:20:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "86400", 2024-09-11T22:20:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T22:20:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "self_heal": { 2024-09-11T22:20:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "self_heal", 2024-09-11T22:20:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T22:20:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_threshold": { 2024-09-11T22:20:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_threshold", 2024-09-11T22:20:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "7257600", 2024-09-11T22:20:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T22:20:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "diskprediction_local", 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "predict_interval": { 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "predict_interval", 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "86400", 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "predictor_model": { 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "predictor_model", 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "prophetstor", 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.669 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.669 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "influx", 2024-09-11T22:20:53.669 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": false, 2024-09-11T22:20:53.669 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "influxdb python module not found", 2024-09-11T22:20:53.669 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.669 INFO:teuthology.orchestra.run.smithi152.stdout: "batch_size": { 2024-09-11T22:20:53.670 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "batch_size", 2024-09-11T22:20:53.670 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.670 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.670 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.670 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5000", 2024-09-11T22:20:53.670 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.670 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.670 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.670 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T22:20:53.671 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.671 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.671 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.671 INFO:teuthology.orchestra.run.smithi152.stdout: "database": { 2024-09-11T22:20:53.671 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "database", 2024-09-11T22:20:53.671 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.671 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.672 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.672 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "ceph", 2024-09-11T22:20:53.672 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.672 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.672 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.672 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T22:20:53.672 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": { 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "hostname", 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.674 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.674 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.674 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.674 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.674 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "InfluxDB server hostname", 2024-09-11T22:20:53.674 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.674 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.674 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.675 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:53.675 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:53.675 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.675 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.675 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.675 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "30", 2024-09-11T22:20:53.675 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "5", 2024-09-11T22:20:53.676 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.676 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.676 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T22:20:53.676 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.676 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.676 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.677 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.677 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.677 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.677 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.677 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.677 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.677 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.677 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.678 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.678 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.678 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.678 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.678 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.678 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.678 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.678 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.678 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.679 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.679 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.679 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.679 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.679 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.679 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.680 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.680 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.680 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.680 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.680 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.680 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.680 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.680 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.680 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.681 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.681 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.681 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.681 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.681 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.681 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.681 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.681 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.682 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.682 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.682 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.682 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.682 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.682 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.682 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.682 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.682 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.682 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.683 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "password": { 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "password", 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.684 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "password of InfluxDB server user", 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: "port": { 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "port", 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8086", 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "InfluxDB server port", 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "ssl": { 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssl", 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.686 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "false", 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "threads": { 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "threads", 2024-09-11T22:20:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "32", 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.688 INFO:teuthology.orchestra.run.smithi152.stdout: "username": { 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "username", 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "username of InfluxDB server user", 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "verify_ssl": { 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "verify_ssl", 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "true", 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.690 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "insights", 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.691 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.692 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.693 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.694 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.695 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.695 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.695 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.695 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.695 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.695 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.695 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.695 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.695 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.695 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.695 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.696 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "iostat", 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.697 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.698 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.699 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.700 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.700 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.700 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.700 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.700 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.700 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.700 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.700 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.700 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.702 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "k8sevents", 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_event_retention_days": { 2024-09-11T22:20:53.703 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ceph_event_retention_days", 2024-09-11T22:20:53.704 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.704 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.704 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.704 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "7", 2024-09-11T22:20:53.704 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.704 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.704 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.704 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T22:20:53.704 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.704 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.704 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "config_check_secs": { 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "config_check_secs", 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "10", 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.705 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.706 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.707 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.708 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.709 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.710 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.710 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.710 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.710 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.710 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.710 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.710 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.710 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.710 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.710 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.711 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "localpool", 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: "failure_domain": { 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "failure_domain", 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.712 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "host", 2024-09-11T22:20:53.713 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.713 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.713 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.713 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "failure domain for any created local pool", 2024-09-11T22:20:53.713 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T22:20:53.713 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.713 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.713 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.713 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.713 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.714 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.714 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.714 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.714 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.714 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.714 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.714 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.714 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.714 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.714 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.715 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.716 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.717 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.718 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "min_size": { 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "min_size", 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "default min_size for any created local pool", 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: "num_rep": { 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "num_rep", 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "3", 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "default replica count for any created local pool", 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: "pg_num": { 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pg_num", 2024-09-11T22:20:53.721 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "128", 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.722 INFO:teuthology.orchestra.run.smithi152.stdout: "prefix": { 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "prefix", 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "name prefix for any created local pool", 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "subtree": { 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "subtree", 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "rack", 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.724 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mds_autoscaler", 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.725 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.726 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.727 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.728 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.729 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.729 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.729 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.729 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.729 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.729 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.729 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.729 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.729 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.729 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.731 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.731 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.731 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.731 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.731 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.731 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.731 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mirroring", 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.732 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.733 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.735 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.736 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "nfs", 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.738 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.740 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.741 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.742 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "orchestrator", 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "fail_fs": { 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "fail_fs", 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.744 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.745 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.746 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.747 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: "orchestrator": { 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "orchestrator", 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: "cephadm", 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: "rook", 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: "test_orchestrator" 2024-09-11T22:20:53.751 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Orchestrator backend", 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "osd_perf_query", 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.752 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.753 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.754 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.754 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.754 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.754 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.754 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.754 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.754 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.754 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.756 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.756 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.756 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.756 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.756 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.756 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.756 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.757 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.758 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "osd_support", 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.759 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.760 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.761 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.761 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.761 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.761 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.761 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.761 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.761 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.761 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.761 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.762 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.763 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.764 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pg_autoscaler", 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.765 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.766 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.767 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.768 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.771 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: "threshold": { 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "threshold", 2024-09-11T22:20:53.772 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "3.0", 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1.0", 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "scaling threshold", 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "progress", 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: "allow_pg_recovery_event": { 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "allow_pg_recovery_event", 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.774 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: "enabled": { 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enabled", 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.775 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.777 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.778 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.779 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.781 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: "max_completed_events": { 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_completed_events", 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "50", 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.782 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "number of past completed events to remember", 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.783 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how long the module is going to sleep", 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "prometheus", 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "cache": { 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cache", 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.785 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "exclude_perf_counters": { 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "exclude_perf_counters", 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T22:20:53.786 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.787 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.788 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.789 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.789 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.789 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.789 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.789 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.789 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.789 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.789 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.789 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.789 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.791 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: "rbd_stats_pools": { 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rbd_stats_pools", 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.792 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.793 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "300", 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "scrape_interval": { 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "scrape_interval", 2024-09-11T22:20:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "15.0", 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: "server_addr": { 2024-09-11T22:20:53.796 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_addr", 2024-09-11T22:20:53.796 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.796 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.796 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.796 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "::", 2024-09-11T22:20:53.796 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.796 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.796 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.796 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T22:20:53.796 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.796 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: "server_port": { 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_port", 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "9283", 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.797 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T22:20:53.798 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.798 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.798 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.798 INFO:teuthology.orchestra.run.smithi152.stdout: "stale_cache_strategy": { 2024-09-11T22:20:53.798 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "stale_cache_strategy", 2024-09-11T22:20:53.798 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.798 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.798 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.798 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "log", 2024-09-11T22:20:53.798 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_behaviour": { 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_behaviour", 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.799 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "default", 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: "default", 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: "error" 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.800 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_error_status_code": { 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_error_status_code", 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "500", 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "400", 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "599", 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.801 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rbd_support", 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.802 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.803 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.804 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.805 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.806 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.807 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.807 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.807 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.807 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.807 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.808 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.808 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.808 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.808 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.808 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.808 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.809 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.809 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.809 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.809 INFO:teuthology.orchestra.run.smithi152.stdout: "max_concurrent_snap_create": { 2024-09-11T22:20:53.809 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_concurrent_snap_create", 2024-09-11T22:20:53.810 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.810 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.810 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.810 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:53.810 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.810 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.810 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.811 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.811 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.811 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.811 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.811 INFO:teuthology.orchestra.run.smithi152.stdout: "mirror_snapshot_schedule": { 2024-09-11T22:20:53.811 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T22:20:53.811 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.812 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.812 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.812 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.812 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.812 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.813 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.813 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.813 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.813 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.813 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.814 INFO:teuthology.orchestra.run.smithi152.stdout: "trash_purge_schedule": { 2024-09-11T22:20:53.814 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "trash_purge_schedule", 2024-09-11T22:20:53.814 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.814 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.814 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.814 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.814 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.815 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.815 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.815 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.815 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.815 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.815 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "restful", 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: "enable_auth": { 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enable_auth", 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.816 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.817 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.817 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.817 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.817 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.817 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.817 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.817 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.817 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.817 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.817 INFO:teuthology.orchestra.run.smithi152.stdout: "key_file": { 2024-09-11T22:20:53.818 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "key_file", 2024-09-11T22:20:53.818 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.818 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.818 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.818 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.818 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.818 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.818 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.818 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.818 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.819 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.819 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.819 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.819 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.819 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.819 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.819 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.819 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.820 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.821 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.822 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.823 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "server_addr": { 2024-09-11T22:20:53.824 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_addr", 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.825 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "server_port": { 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_port", 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.826 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rgw", 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.827 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.828 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.829 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.829 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.829 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.829 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.829 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.829 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.829 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.829 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.829 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.829 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.830 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.830 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.830 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.830 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.830 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.830 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.830 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.830 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.830 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.830 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.832 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.833 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.833 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.833 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.833 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.833 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.833 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.833 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.833 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.833 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.833 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rook", 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.834 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.835 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.835 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.835 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.835 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.835 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.835 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.836 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.836 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.836 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.836 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.836 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.836 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.837 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.837 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.837 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.837 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.837 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.837 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.837 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.837 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.837 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.837 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.837 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.838 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.839 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.839 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.839 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.839 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.839 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.839 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.839 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.839 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.840 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.840 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.840 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.840 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.841 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.841 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.841 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.841 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.841 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.841 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.841 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.841 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.841 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.841 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.842 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.842 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.842 INFO:teuthology.orchestra.run.smithi152.stdout: "storage_class": { 2024-09-11T22:20:53.842 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "storage_class", 2024-09-11T22:20:53.842 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.842 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.842 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.843 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "local", 2024-09-11T22:20:53.843 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.843 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.843 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.843 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T22:20:53.843 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.843 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.843 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "selftest", 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.844 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.845 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.846 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.847 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.848 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.849 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "roption1": { 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "roption1", 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.850 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "roption2": { 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "roption2", 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "xyz", 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.851 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption1": { 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption1", 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.852 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption2": { 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption2", 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.853 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.854 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.854 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.854 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.854 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.854 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.854 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.854 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption3": { 2024-09-11T22:20:53.854 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption3", 2024-09-11T22:20:53.854 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:53.854 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption4": { 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption4", 2024-09-11T22:20:53.855 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.856 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.856 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.856 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.856 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.856 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.856 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.856 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption5": { 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption5", 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.857 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption6": { 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption6", 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.858 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption7": { 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption7", 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:53.859 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "42", 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "testkey": { 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "testkey", 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.860 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.861 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.861 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.861 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.861 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.861 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.861 INFO:teuthology.orchestra.run.smithi152.stdout: "testlkey": { 2024-09-11T22:20:53.861 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "testlkey", 2024-09-11T22:20:53.861 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.861 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.861 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: "testnewline": { 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "testnewline", 2024-09-11T22:20:53.862 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "snap_schedule", 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "allow_m_granularity": { 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "allow_m_granularity", 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.864 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.865 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T22:20:53.865 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.865 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.865 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.865 INFO:teuthology.orchestra.run.smithi152.stdout: "dump_on_update": { 2024-09-11T22:20:53.865 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "dump_on_update", 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "dump database to debug log on update", 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.866 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.867 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.868 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.868 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.868 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.868 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.868 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.868 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.868 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.868 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.868 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.869 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.869 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.869 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.869 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.869 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.869 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.869 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.869 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.869 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.871 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.871 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.871 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.871 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.871 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.872 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.872 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.872 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.872 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.872 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.872 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.872 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.872 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.872 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.873 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.873 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.873 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.873 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.873 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.873 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.873 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.873 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.873 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.873 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "stats", 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.874 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.875 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.875 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.875 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.875 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.875 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.875 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.875 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.875 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.875 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.876 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.877 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.877 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.877 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.877 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.877 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.877 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.877 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.877 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.877 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.877 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.878 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.878 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.878 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.878 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.878 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.878 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.878 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.878 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.878 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.878 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.878 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "status", 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.882 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.882 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.882 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.882 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.882 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.882 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.882 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.882 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.882 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.882 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.883 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.883 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.883 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.883 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.883 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.883 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.883 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.884 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.884 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.884 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.884 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.884 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.884 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.884 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.884 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.884 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.884 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.885 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.886 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.887 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "telegraf", 2024-09-11T22:20:53.888 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.888 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.888 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.888 INFO:teuthology.orchestra.run.smithi152.stdout: "address": { 2024-09-11T22:20:53.888 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "address", 2024-09-11T22:20:53.888 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.888 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.888 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.888 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T22:20:53.888 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.888 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "15", 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.890 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.891 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.892 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.893 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.894 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.894 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.894 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.894 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.894 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.894 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.894 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.894 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.895 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.895 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.895 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.895 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.895 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.895 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.895 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.895 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.895 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.895 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.895 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.896 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "telemetry", 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_basic": { 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_basic", 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_crash": { 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_crash", 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.898 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_device": { 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_device", 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.899 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_ident": { 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_ident", 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_perf": { 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_perf", 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.901 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "contact": { 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "contact", 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.903 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.903 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.903 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.903 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.903 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.903 INFO:teuthology.orchestra.run.smithi152.stdout: "description": { 2024-09-11T22:20:53.903 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "description", 2024-09-11T22:20:53.903 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.903 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.903 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.903 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.904 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.904 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.904 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.904 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.904 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.904 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.904 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.904 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.904 INFO:teuthology.orchestra.run.smithi152.stdout: "device_url": { 2024-09-11T22:20:53.904 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "device_url", 2024-09-11T22:20:53.905 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.905 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.905 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.905 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T22:20:53.905 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.905 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.905 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.905 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.905 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: "enabled": { 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enabled", 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.906 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "24", 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "8", 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.907 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "last_opt_revision": { 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "last_opt_revision", 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "1", 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.908 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "leaderboard": { 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "leaderboard", 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.909 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "leaderboard_description": { 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "leaderboard_description", 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.910 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.912 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.912 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.912 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.912 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.912 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.912 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.912 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.912 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.912 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.912 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.912 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.913 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.913 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.913 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.913 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.913 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.913 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.913 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.913 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.913 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.913 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.913 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.914 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.915 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.915 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.915 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.915 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.915 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.915 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.915 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.915 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.915 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.915 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.916 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.916 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.916 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.916 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.916 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.916 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.916 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.916 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.916 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.916 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.917 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "organization": { 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "organization", 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.918 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "proxy": { 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "proxy", 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.919 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.920 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.920 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.920 INFO:teuthology.orchestra.run.smithi152.stdout: "url": { 2024-09-11T22:20:53.920 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "url", 2024-09-11T22:20:53.920 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.920 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.920 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.920 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T22:20:53.920 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.920 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.920 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "test_orchestrator", 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.921 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.922 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.923 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.924 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.925 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.925 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.925 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.925 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.925 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.925 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.925 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.925 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.925 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.925 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.925 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.926 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "volumes", 2024-09-11T22:20:53.927 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.928 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.929 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.929 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.929 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.929 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.929 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.929 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.929 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.929 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.929 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.929 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.930 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.930 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.930 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.930 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.930 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.930 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.930 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.930 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.930 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.931 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.933 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "max_concurrent_clones": { 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_concurrent_clones", 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "4", 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.934 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "periodic_async_work": { 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "periodic_async_work", 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Periodically check for async work", 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.935 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: "snapshot_clone_delay": { 2024-09-11T22:20:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "snapshot_clone_delay", 2024-09-11T22:20:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "snapshot_clone_no_wait": { 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.937 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix", 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.938 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "discovery_interval": { 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "discovery_interval", 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "100", 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: "identifier": { 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "identifier", 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.940 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.941 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:53.941 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:53.941 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.941 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.941 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.941 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:53.941 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.941 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.942 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.943 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.944 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.945 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.946 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.947 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "zabbix_host": { 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix_host", 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.948 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: "zabbix_port": { 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix_port", 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10051", 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.950 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.950 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.950 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.950 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.950 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.950 INFO:teuthology.orchestra.run.smithi152.stdout: "zabbix_sender": { 2024-09-11T22:20:53.950 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix_sender", 2024-09-11T22:20:53.950 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.950 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.950 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.950 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "gid": 24874, 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "z", 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr_features": 4540701547738038271, 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "available_modules": [ 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "alerts", 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.952 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.953 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.954 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.955 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.956 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.957 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.957 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.957 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.957 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.957 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.957 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.957 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.957 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.957 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.957 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.957 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.958 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_destination": { 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_destination", 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Email address to send alerts to", 2024-09-11T22:20:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_from_name": { 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_from_name", 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "Ceph", 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.960 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Email From: name", 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_host": { 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_host", 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.962 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.962 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SMTP server", 2024-09-11T22:20:53.962 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.962 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.962 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.962 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_password": { 2024-09-11T22:20:53.962 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_password", 2024-09-11T22:20:53.962 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.962 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.962 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Password to authenticate with", 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_port": { 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_port", 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.963 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "465", 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SMTP port", 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_sender": { 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_sender", 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.964 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SMTP envelope sender", 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_ssl": { 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_ssl", 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_user": { 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_user", 2024-09-11T22:20:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.967 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.967 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.967 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.967 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.967 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.967 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.967 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "User to authenticate as", 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "balancer", 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: "active": { 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "active", 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "begin_time": { 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "begin_time", 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0000", 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.970 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: "begin_weekday": { 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "begin_weekday", 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "0", 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "6", 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T22:20:53.971 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_compat_max_iterations": { 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crush_compat_max_iterations", 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "25", 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "250", 2024-09-11T22:20:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.973 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T22:20:53.973 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.973 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.973 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.974 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_compat_metrics": { 2024-09-11T22:20:53.974 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crush_compat_metrics", 2024-09-11T22:20:53.974 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.974 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.974 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.974 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T22:20:53.974 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.975 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.975 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.975 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T22:20:53.975 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T22:20:53.975 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.975 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.975 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_compat_step": { 2024-09-11T22:20:53.976 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crush_compat_step", 2024-09-11T22:20:53.976 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:53.976 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.976 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.976 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0.5", 2024-09-11T22:20:53.976 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "0.001", 2024-09-11T22:20:53.977 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "0.999", 2024-09-11T22:20:53.977 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.977 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "aggressiveness of optimization", 2024-09-11T22:20:53.977 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T22:20:53.977 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.977 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.977 INFO:teuthology.orchestra.run.smithi152.stdout: "end_time": { 2024-09-11T22:20:53.977 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "end_time", 2024-09-11T22:20:53.977 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.978 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.978 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.978 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "2359", 2024-09-11T22:20:53.978 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.978 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.978 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.978 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T22:20:53.978 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:20:53.978 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.978 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: "end_weekday": { 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "end_weekday", 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "0", 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "6", 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T22:20:53.979 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.980 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:53.981 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:53.983 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.984 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.985 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.985 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.985 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.985 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.985 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.985 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:53.985 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.985 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.985 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.985 INFO:teuthology.orchestra.run.smithi152.stdout: "min_score": { 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "min_score", 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.987 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": { 2024-09-11T22:20:53.987 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mode", 2024-09-11T22:20:53.987 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.987 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.987 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.987 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "upmap", 2024-09-11T22:20:53.987 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.987 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.987 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:53.987 INFO:teuthology.orchestra.run.smithi152.stdout: "crush-compat", 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: "none", 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: "read", 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap", 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap-read" 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Balancer mode", 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: "pool_ids": { 2024-09-11T22:20:53.988 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pool_ids", 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap_max_deviation": { 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "upmap_max_deviation", 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.991 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap_max_optimizations": { 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "upmap_max_optimizations", 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.992 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cephadm", 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: "agent_down_multiplier": { 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "agent_down_multiplier", 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:53.993 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "3.0", 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: "agent_refresh_rate": { 2024-09-11T22:20:53.994 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "agent_refresh_rate", 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "20", 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.995 INFO:teuthology.orchestra.run.smithi152.stdout: "agent_starting_port": { 2024-09-11T22:20:53.996 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "agent_starting_port", 2024-09-11T22:20:53.996 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:53.996 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.996 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.996 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "4721", 2024-09-11T22:20:53.996 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.996 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.996 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.996 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T22:20:53.996 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.996 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: "allow_ptrace": { 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "allow_ptrace", 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.997 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T22:20:53.998 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T22:20:53.998 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.998 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.998 INFO:teuthology.orchestra.run.smithi152.stdout: "autotune_interval": { 2024-09-11T22:20:53.998 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "autotune_interval", 2024-09-11T22:20:53.998 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:53.998 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:53.998 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:53.998 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: "autotune_memory_target_ratio": { 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:53.999 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.000 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.000 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0.7", 2024-09-11T22:20:54.000 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.000 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.000 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.000 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T22:20:54.000 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.000 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: "cephadm_log_destination": { 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cephadm_log_destination", 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: "file", 2024-09-11T22:20:54.002 INFO:teuthology.orchestra.run.smithi152.stdout: "file,syslog", 2024-09-11T22:20:54.002 INFO:teuthology.orchestra.run.smithi152.stdout: "syslog" 2024-09-11T22:20:54.002 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.002 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T22:20:54.002 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.003 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.003 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.003 INFO:teuthology.orchestra.run.smithi152.stdout: "cgroups_split": { 2024-09-11T22:20:54.003 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cgroups_split", 2024-09-11T22:20:54.003 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.003 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: "config_checks_enabled": { 2024-09-11T22:20:54.004 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "config_checks_enabled", 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.005 INFO:teuthology.orchestra.run.smithi152.stdout: "config_dashboard": { 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "config_dashboard", 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.006 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.007 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_alertmanager": { 2024-09-11T22:20:54.007 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_alertmanager", 2024-09-11T22:20:54.008 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.008 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.008 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.008 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T22:20:54.008 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.008 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.008 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.008 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_base": { 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_base", 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.009 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Container image name, without the tag", 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_elasticsearch": { 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_elasticsearch", 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "elasticsearch container image", 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_grafana": { 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_grafana", 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:54.012 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.012 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.012 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.012 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_haproxy": { 2024-09-11T22:20:54.012 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_haproxy", 2024-09-11T22:20:54.012 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.012 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.012 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.012 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T22:20:54.012 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "HAproxy container image", 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_jaeger_agent": { 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_jaeger_agent", 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.013 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T22:20:54.014 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.014 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.014 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.014 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Jaeger agent container image", 2024-09-11T22:20:54.014 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.014 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.014 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.014 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.014 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_jaeger_collector": { 2024-09-11T22:20:54.014 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_jaeger_collector", 2024-09-11T22:20:54.014 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Jaeger collector container image", 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_jaeger_query": { 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_jaeger_query", 2024-09-11T22:20:54.015 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Jaeger query container image", 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_keepalived": { 2024-09-11T22:20:54.016 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_keepalived", 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Keepalived container image", 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_loki": { 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_loki", 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Loki container image", 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.018 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.019 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_node_exporter": { 2024-09-11T22:20:54.019 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_node_exporter", 2024-09-11T22:20:54.019 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.019 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.019 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.019 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T22:20:54.019 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.019 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.019 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.019 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_nvmeof": { 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_nvmeof", 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Nvme-of container image", 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_prometheus": { 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_prometheus", 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T22:20:54.021 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_promtail": { 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_promtail", 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.022 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T22:20:54.023 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.023 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.023 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.023 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Promtail container image", 2024-09-11T22:20:54.023 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.023 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.023 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.023 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_samba": { 2024-09-11T22:20:54.023 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_samba", 2024-09-11T22:20:54.023 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T22:20:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Samba/SMB container image", 2024-09-11T22:20:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.025 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_snmp_gateway": { 2024-09-11T22:20:54.025 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_snmp_gateway", 2024-09-11T22:20:54.025 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.025 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.025 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.025 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T22:20:54.025 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.025 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.025 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.025 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SNMP Gateway container image", 2024-09-11T22:20:54.025 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: "container_init": { 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_init", 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.026 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.027 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T22:20:54.027 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.027 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.027 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.027 INFO:teuthology.orchestra.run.smithi152.stdout: "daemon_cache_timeout": { 2024-09-11T22:20:54.027 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "daemon_cache_timeout", 2024-09-11T22:20:54.027 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.027 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.027 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.027 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:54.028 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.028 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.028 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.028 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T22:20:54.028 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.028 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.028 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.028 INFO:teuthology.orchestra.run.smithi152.stdout: "default_cephadm_command_timeout": { 2024-09-11T22:20:54.028 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T22:20:54.028 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.029 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.029 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.029 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "900", 2024-09-11T22:20:54.029 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.029 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.029 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.029 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T22:20:54.029 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.029 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.030 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.030 INFO:teuthology.orchestra.run.smithi152.stdout: "default_registry": { 2024-09-11T22:20:54.030 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "default_registry", 2024-09-11T22:20:54.030 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.030 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.030 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.030 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io", 2024-09-11T22:20:54.030 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "device_cache_timeout": { 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "device_cache_timeout", 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.031 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "1800", 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "seconds to cache device inventory", 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: "device_enhanced_scan": { 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "device_enhanced_scan", 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.032 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: "facts_cache_timeout": { 2024-09-11T22:20:54.033 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "facts_cache_timeout", 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "seconds to cache host facts data", 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.034 INFO:teuthology.orchestra.run.smithi152.stdout: "grafana_dashboards_path": { 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "grafana_dashboards_path", 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.035 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.036 INFO:teuthology.orchestra.run.smithi152.stdout: "host_check_interval": { 2024-09-11T22:20:54.036 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "host_check_interval", 2024-09-11T22:20:54.036 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.036 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.036 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.036 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:54.036 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.036 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.036 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.036 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to perform a host check", 2024-09-11T22:20:54.036 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.037 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.037 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.037 INFO:teuthology.orchestra.run.smithi152.stdout: "hw_monitoring": { 2024-09-11T22:20:54.037 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "hw_monitoring", 2024-09-11T22:20:54.037 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.037 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.038 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.038 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.038 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.038 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.038 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.038 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T22:20:54.038 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.038 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.039 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.039 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.039 INFO:teuthology.orchestra.run.smithi152.stdout: "inventory_list_all": { 2024-09-11T22:20:54.039 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "inventory_list_all", 2024-09-11T22:20:54.039 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.039 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.039 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.039 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.039 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.039 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.039 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.040 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T22:20:54.040 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.040 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.040 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.040 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.040 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.040 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.040 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.040 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.042 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.042 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.042 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.042 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.042 INFO:teuthology.orchestra.run.smithi152.stdout: "log_refresh_metadata": { 2024-09-11T22:20:54.042 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_refresh_metadata", 2024-09-11T22:20:54.042 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.042 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.042 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.042 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.042 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.043 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.043 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.043 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T22:20:54.043 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.043 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.043 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.043 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.043 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.043 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.043 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.044 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.045 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.046 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.047 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.048 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "*", 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "max_count_per_host": { 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_count_per_host", 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.049 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.050 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.050 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.050 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.050 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.050 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.050 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "max number of daemons per service per host", 2024-09-11T22:20:54.050 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.050 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.050 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: "max_osd_draining_count": { 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_osd_draining_count", 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T22:20:54.051 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: "migration_current": { 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "migration_current", 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.052 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.053 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "internal - do not modify", 2024-09-11T22:20:54.053 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.053 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.053 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.053 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": { 2024-09-11T22:20:54.053 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mode", 2024-09-11T22:20:54.053 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.053 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.053 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.054 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "root", 2024-09-11T22:20:54.054 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.054 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.054 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.054 INFO:teuthology.orchestra.run.smithi152.stdout: "cephadm-package", 2024-09-11T22:20:54.054 INFO:teuthology.orchestra.run.smithi152.stdout: "root" 2024-09-11T22:20:54.055 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.055 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T22:20:54.055 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.055 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.055 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.056 INFO:teuthology.orchestra.run.smithi152.stdout: "oob_default_addr": { 2024-09-11T22:20:54.056 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "oob_default_addr", 2024-09-11T22:20:54.056 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.056 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.056 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.056 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "169.254.1.1", 2024-09-11T22:20:54.056 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.057 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.057 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.057 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T22:20:54.057 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.057 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.057 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.058 INFO:teuthology.orchestra.run.smithi152.stdout: "prometheus_alerts_path": { 2024-09-11T22:20:54.058 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "prometheus_alerts_path", 2024-09-11T22:20:54.058 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.058 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.058 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.058 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T22:20:54.058 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.058 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.059 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.059 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T22:20:54.059 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.059 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.059 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.060 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_insecure": { 2024-09-11T22:20:54.060 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_insecure", 2024-09-11T22:20:54.060 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.060 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.060 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.060 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.060 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.061 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.061 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.061 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T22:20:54.061 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.061 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.062 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.062 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_password": { 2024-09-11T22:20:54.062 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_password", 2024-09-11T22:20:54.062 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.062 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.062 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.062 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_url": { 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_url", 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_username": { 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_username", 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.064 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "secure_monitoring_stack": { 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "secure_monitoring_stack", 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.065 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "service_discovery_port": { 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "service_discovery_port", 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8765", 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "cephadm service discovery port", 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: "ssh_config_file": { 2024-09-11T22:20:54.067 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssh_config_file", 2024-09-11T22:20:54.068 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.068 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.068 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.068 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.068 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.069 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.069 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.069 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T22:20:54.069 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.069 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.069 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.069 INFO:teuthology.orchestra.run.smithi152.stdout: "use_agent": { 2024-09-11T22:20:54.069 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "use_agent", 2024-09-11T22:20:54.070 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.070 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.070 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.070 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.070 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.070 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.070 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.070 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T22:20:54.070 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.070 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "use_repo_digest": { 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "use_repo_digest", 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T22:20:54.071 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_on_failed_host_check": { 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_on_failed_host_check", 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.072 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_on_stray_daemons": { 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_on_stray_daemons", 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.073 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_on_stray_hosts": { 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_on_stray_hosts", 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.074 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T22:20:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crash", 2024-09-11T22:20:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.076 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.076 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.076 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.076 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.076 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.076 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.076 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.076 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.076 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.077 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.077 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.077 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.077 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.077 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.077 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.077 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.078 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.078 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.078 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.078 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.078 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.078 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.078 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.079 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.079 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.079 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.079 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.079 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.079 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.079 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.080 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.080 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.080 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.080 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.080 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.080 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.080 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.081 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.081 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.081 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.081 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.081 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.081 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.081 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.081 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.082 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.082 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.082 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.082 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.082 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.082 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.082 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.082 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.083 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.083 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.083 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.083 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.083 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.083 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.083 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.084 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.084 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.084 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.084 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.084 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.084 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.084 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.085 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.085 INFO:teuthology.orchestra.run.smithi152.stdout: "retain_interval": { 2024-09-11T22:20:54.085 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "retain_interval", 2024-09-11T22:20:54.085 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.085 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.085 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.086 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "31536000", 2024-09-11T22:20:54.086 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.086 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.086 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.086 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T22:20:54.086 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.086 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.086 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.087 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_recent_interval": { 2024-09-11T22:20:54.087 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_recent_interval", 2024-09-11T22:20:54.087 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.087 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.087 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.087 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "1209600", 2024-09-11T22:20:54.087 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.088 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.088 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.088 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T22:20:54.088 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.088 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.088 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.088 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.088 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.089 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "dashboard", 2024-09-11T22:20:54.089 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.089 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.089 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.089 INFO:teuthology.orchestra.run.smithi152.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T22:20:54.089 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T22:20:54.090 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.090 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.090 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.090 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.090 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.090 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.090 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.090 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.090 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.091 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.092 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.092 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.092 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.092 INFO:teuthology.orchestra.run.smithi152.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T22:20:54.092 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T22:20:54.092 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.092 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.092 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.092 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.092 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.093 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.093 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.093 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.093 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.093 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.093 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.093 INFO:teuthology.orchestra.run.smithi152.stdout: "AUDIT_API_ENABLED": { 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.095 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.096 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.096 INFO:teuthology.orchestra.run.smithi152.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T22:20:54.096 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T22:20:54.096 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.096 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.096 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.096 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.096 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.096 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.096 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.096 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.098 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.099 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.100 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T22:20:54.101 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T22:20:54.102 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T22:20:54.103 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.103 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.103 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.103 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.103 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.103 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.103 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.103 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.103 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.103 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.103 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.104 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T22:20:54.104 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T22:20:54.104 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.104 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.104 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.105 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.105 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.105 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.105 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.105 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.105 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.106 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.107 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.107 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.107 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.107 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T22:20:54.108 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T22:20:54.108 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.108 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.108 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.108 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "admin", 2024-09-11T22:20:54.108 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.108 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.108 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.108 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.108 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_URL": { 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_URL", 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.110 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "admin", 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.111 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.112 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.113 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.113 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.113 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.113 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T22:20:54.113 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T22:20:54.113 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.113 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.113 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.113 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.113 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.114 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T22:20:54.116 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.117 INFO:teuthology.orchestra.run.smithi152.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T22:20:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T22:20:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T22:20:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T22:20:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T22:20:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T22:20:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T22:20:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T22:20:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T22:20:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8", 2024-09-11T22:20:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "45", 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T22:20:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T22:20:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "admin", 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "cross_origin_url": { 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cross_origin_url", 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "crt_file": { 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crt_file", 2024-09-11T22:20:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "debug": { 2024-09-11T22:20:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "debug", 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Enable/disable debug options", 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "jwt_token_ttl": { 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "jwt_token_ttl", 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "28800", 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "key_file": { 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "key_file", 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "motd": { 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "motd", 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "The message of the day", 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "redirect_resolve_ip_addr": { 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "server_addr": { 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_addr", 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "::", 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "server_port": { 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_port", 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8080", 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.154 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "ssl": { 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssl", 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.155 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "ssl_server_port": { 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssl_server_port", 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8443", 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_behaviour": { 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_behaviour", 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "redirect", 2024-09-11T22:20:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "redirect" 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_error_status_code": { 2024-09-11T22:20:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_error_status_code", 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "500", 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "400", 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "599", 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "url_prefix": { 2024-09-11T22:20:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "url_prefix", 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "devicehealth", 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "enable_monitoring": { 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enable_monitoring", 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "monitor device health metrics", 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "mark_out_threshold": { 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mark_out_threshold", 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "2419200", 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "pool_name": { 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pool_name", 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "device_health_metrics", 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "retention_period": { 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "retention_period", 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "15552000", 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how long to retain device health metrics", 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "scrape_frequency": { 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "scrape_frequency", 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "86400", 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "self_heal": { 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "self_heal", 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T22:20:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_threshold": { 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_threshold", 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "7257600", 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "diskprediction_local", 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "predict_interval": { 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "predict_interval", 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.181 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "86400", 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "predictor_model": { 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "predictor_model", 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.182 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "prophetstor", 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.183 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:54.184 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.184 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.184 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.184 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.184 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.184 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.184 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.184 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.184 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.185 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "influx", 2024-09-11T22:20:54.185 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": false, 2024-09-11T22:20:54.185 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "influxdb python module not found", 2024-09-11T22:20:54.185 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.185 INFO:teuthology.orchestra.run.smithi152.stdout: "batch_size": { 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "batch_size", 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5000", 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.186 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.187 INFO:teuthology.orchestra.run.smithi152.stdout: "database": { 2024-09-11T22:20:54.187 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "database", 2024-09-11T22:20:54.187 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.187 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.187 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "ceph", 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": { 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "hostname", 2024-09-11T22:20:54.188 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "InfluxDB server hostname", 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:54.189 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "30", 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "5", 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.190 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.191 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.193 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.193 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.193 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.193 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.193 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.193 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.193 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.193 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.193 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.193 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.194 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.195 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.195 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.195 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.195 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.195 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.195 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.195 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.195 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.195 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.195 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: "password": { 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "password", 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.196 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.197 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.197 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.197 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.197 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.197 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "password of InfluxDB server user", 2024-09-11T22:20:54.197 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.197 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.197 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.197 INFO:teuthology.orchestra.run.smithi152.stdout: "port": { 2024-09-11T22:20:54.197 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "port", 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8086", 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "InfluxDB server port", 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.198 INFO:teuthology.orchestra.run.smithi152.stdout: "ssl": { 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssl", 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "false", 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.199 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "threads": { 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "threads", 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "32", 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.200 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: "username": { 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "username", 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.201 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "username of InfluxDB server user", 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "verify_ssl": { 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "verify_ssl", 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "true", 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:20:54.202 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "insights", 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.203 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.204 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.205 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.206 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.207 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.208 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "iostat", 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.210 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.210 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.210 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.210 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.210 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.210 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.210 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.210 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.210 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.210 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.210 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.211 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.211 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.211 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.211 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.211 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.212 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.212 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.212 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.212 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.212 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.212 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.213 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.214 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "k8sevents", 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.216 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_event_retention_days": { 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ceph_event_retention_days", 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "7", 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "config_check_secs": { 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "config_check_secs", 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "10", 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.218 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.220 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.221 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.222 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.223 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "localpool", 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.224 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "failure_domain": { 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "failure_domain", 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "host", 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "failure domain for any created local pool", 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.225 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.226 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.228 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.229 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.230 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.231 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.231 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.231 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.231 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.231 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.231 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.231 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.231 INFO:teuthology.orchestra.run.smithi152.stdout: "min_size": { 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "min_size", 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "default min_size for any created local pool", 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.233 INFO:teuthology.orchestra.run.smithi152.stdout: "num_rep": { 2024-09-11T22:20:54.233 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "num_rep", 2024-09-11T22:20:54.233 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.233 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.233 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.233 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "3", 2024-09-11T22:20:54.233 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.233 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.233 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.233 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "default replica count for any created local pool", 2024-09-11T22:20:54.234 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.234 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.234 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.234 INFO:teuthology.orchestra.run.smithi152.stdout: "pg_num": { 2024-09-11T22:20:54.234 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pg_num", 2024-09-11T22:20:54.234 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.234 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.234 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.234 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "128", 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "prefix": { 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "prefix", 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.235 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "name prefix for any created local pool", 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: "subtree": { 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "subtree", 2024-09-11T22:20:54.236 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "rack", 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mds_autoscaler", 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.238 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.239 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.240 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.240 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.240 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.240 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.240 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.240 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.240 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.240 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.240 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.240 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.241 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.241 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.241 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.241 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.241 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.241 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.241 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.241 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.241 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.241 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.242 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.243 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.244 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.244 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.244 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.244 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.244 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mirroring", 2024-09-11T22:20:54.245 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.245 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.245 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.245 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.245 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.245 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.246 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.246 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.246 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.246 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.246 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.246 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.246 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.246 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.246 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.247 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.247 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.247 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.247 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.247 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.247 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.247 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.247 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.247 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.247 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.249 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.249 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.249 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.249 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.249 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.249 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.249 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.249 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.249 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.249 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.250 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.251 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.251 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.251 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.251 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.251 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.251 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.251 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.251 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.251 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.251 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.252 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.252 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.252 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.252 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.253 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.253 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "nfs", 2024-09-11T22:20:54.253 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.253 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.253 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.253 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.254 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.254 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.254 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.254 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.254 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.254 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.257 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.257 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.257 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.257 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.258 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.258 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.258 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.258 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.258 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.258 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "orchestrator", 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: "fail_fs": { 2024-09-11T22:20:54.262 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "fail_fs", 2024-09-11T22:20:54.263 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.263 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.263 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.263 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.263 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.263 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.263 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.263 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T22:20:54.263 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.263 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.264 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.265 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.266 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.267 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.268 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: "orchestrator": { 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "orchestrator", 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.269 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: "cephadm", 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: "rook", 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: "test_orchestrator" 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Orchestrator backend", 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.270 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "osd_perf_query", 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.272 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.273 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.274 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.275 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.276 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.276 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.276 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.276 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.276 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.276 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.276 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.276 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "osd_support", 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.277 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.278 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.279 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.279 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.279 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.279 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.279 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.279 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.279 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.279 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.279 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.280 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.281 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.284 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.284 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pg_autoscaler", 2024-09-11T22:20:54.284 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.284 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.284 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.284 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.284 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.285 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.285 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.285 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.285 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.285 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.285 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.285 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.286 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.286 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.286 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.286 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.286 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.286 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.286 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.286 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.287 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.287 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.287 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.287 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.287 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.287 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.287 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.288 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.288 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.288 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.288 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.288 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.288 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.288 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.288 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.289 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.289 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.289 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.289 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.289 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.289 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.290 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.290 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.290 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.290 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.290 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.290 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.290 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.290 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.290 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.291 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.291 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.291 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.291 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.291 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.291 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.292 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.292 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.292 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.292 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.292 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.292 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.292 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.292 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.293 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.293 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.293 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.293 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.293 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.293 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:54.293 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:54.294 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.294 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.294 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.294 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:54.294 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.294 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.294 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.294 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.295 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.295 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.295 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.295 INFO:teuthology.orchestra.run.smithi152.stdout: "threshold": { 2024-09-11T22:20:54.295 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "threshold", 2024-09-11T22:20:54.295 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:54.295 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.296 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.296 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "3.0", 2024-09-11T22:20:54.296 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1.0", 2024-09-11T22:20:54.296 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.296 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.296 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "scaling threshold", 2024-09-11T22:20:54.296 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T22:20:54.296 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.297 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.297 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.297 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.297 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "progress", 2024-09-11T22:20:54.297 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.297 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.297 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "allow_pg_recovery_event": { 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "allow_pg_recovery_event", 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: "enabled": { 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enabled", 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.299 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.300 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.301 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.303 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.305 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.305 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.305 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.305 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.305 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.305 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.305 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.305 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.305 INFO:teuthology.orchestra.run.smithi152.stdout: "max_completed_events": { 2024-09-11T22:20:54.305 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_completed_events", 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "50", 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "number of past completed events to remember", 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how long the module is going to sleep", 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "prometheus", 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "cache": { 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cache", 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.308 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "exclude_perf_counters": { 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "exclude_perf_counters", 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.309 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.310 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.311 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.312 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.312 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.312 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.312 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.312 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.312 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.312 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.312 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.312 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.312 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.313 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.314 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.315 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "rbd_stats_pools": { 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rbd_stats_pools", 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.316 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "300", 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "scrape_interval": { 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "scrape_interval", 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.318 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "15.0", 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: "server_addr": { 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_addr", 2024-09-11T22:20:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "::", 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.320 INFO:teuthology.orchestra.run.smithi152.stdout: "server_port": { 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_port", 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "9283", 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.321 INFO:teuthology.orchestra.run.smithi152.stdout: "stale_cache_strategy": { 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "stale_cache_strategy", 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "log", 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_behaviour": { 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_behaviour", 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "default", 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "default", 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "error" 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.323 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_error_status_code": { 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_error_status_code", 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "500", 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "400", 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "599", 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.324 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rbd_support", 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.325 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.326 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.327 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.328 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.331 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.331 INFO:teuthology.orchestra.run.smithi152.stdout: "max_concurrent_snap_create": { 2024-09-11T22:20:54.331 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_concurrent_snap_create", 2024-09-11T22:20:54.331 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.331 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.331 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.331 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.331 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: "mirror_snapshot_schedule": { 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: "trash_purge_schedule": { 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "trash_purge_schedule", 2024-09-11T22:20:54.333 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.334 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.334 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.334 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.334 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.334 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.334 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.334 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.334 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.334 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "restful", 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: "enable_auth": { 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enable_auth", 2024-09-11T22:20:54.335 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "key_file": { 2024-09-11T22:20:54.336 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "key_file", 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.338 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.339 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.339 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.339 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.339 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.339 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.339 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.340 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.340 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.340 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.340 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.340 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.340 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.340 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.340 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.340 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.342 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.342 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.342 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.342 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.342 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.342 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.343 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.343 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.343 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.343 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.343 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.343 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.343 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.343 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.343 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "server_addr": { 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_addr", 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.345 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "server_port": { 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_port", 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.346 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rgw", 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.347 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.348 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.349 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.349 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.349 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.349 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.349 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.349 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.349 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.349 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.349 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.349 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.350 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.350 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.350 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.350 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rook", 2024-09-11T22:20:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.354 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.355 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.357 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.357 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.357 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.357 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.357 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.358 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.358 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.358 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.358 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.358 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.358 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.358 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.358 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.359 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "storage_class": { 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "storage_class", 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.360 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "local", 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.362 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "selftest", 2024-09-11T22:20:54.362 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.362 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.362 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.362 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.362 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.362 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.362 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.362 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.363 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.363 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.363 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.363 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.363 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.363 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.363 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.363 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.363 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.364 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.364 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.364 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.364 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.364 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.364 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.365 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.365 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.365 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.365 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.365 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.366 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.366 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.366 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.366 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.366 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.367 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.367 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.367 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.367 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.368 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.368 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.368 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.368 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.368 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.369 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.370 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "roption1": { 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "roption1", 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.372 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.372 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.372 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.372 INFO:teuthology.orchestra.run.smithi152.stdout: "roption2": { 2024-09-11T22:20:54.372 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "roption2", 2024-09-11T22:20:54.373 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.373 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.373 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.373 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "xyz", 2024-09-11T22:20:54.373 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.373 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.373 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.373 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.373 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption1": { 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption1", 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.374 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.375 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.375 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.375 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.375 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.375 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption2": { 2024-09-11T22:20:54.375 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption2", 2024-09-11T22:20:54.375 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.375 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.375 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.375 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption3": { 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption3", 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.376 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.377 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.377 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.377 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.377 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.377 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.377 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.377 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.377 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.377 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption4": { 2024-09-11T22:20:54.378 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption4", 2024-09-11T22:20:54.378 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.378 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.378 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.378 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.378 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.378 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.379 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.379 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.379 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.379 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.379 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.379 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption5": { 2024-09-11T22:20:54.380 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption5", 2024-09-11T22:20:54.380 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.380 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.380 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.380 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.380 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.380 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.380 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.380 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.380 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption6": { 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption6", 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption7": { 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption7", 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "42", 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "testkey": { 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "testkey", 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: "testlkey": { 2024-09-11T22:20:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "testlkey", 2024-09-11T22:20:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.385 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.385 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.385 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.385 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.385 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.385 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "testnewline": { 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "testnewline", 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "snap_schedule", 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: "allow_m_granularity": { 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "allow_m_granularity", 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "dump_on_update": { 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "dump_on_update", 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "dump database to debug log on update", 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.391 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.391 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.391 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.391 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.391 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "stats", 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.397 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.397 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.397 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.397 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.397 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "status", 2024-09-11T22:20:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.403 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.403 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.403 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.403 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.403 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.403 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.403 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.410 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.410 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "telegraf", 2024-09-11T22:20:54.410 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.410 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.410 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.410 INFO:teuthology.orchestra.run.smithi152.stdout: "address": { 2024-09-11T22:20:54.410 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "address", 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "15", 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.415 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.415 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.415 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.415 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.415 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.415 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.415 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.415 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.415 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.418 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "telemetry", 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_basic": { 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_basic", 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_crash": { 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_crash", 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.422 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.422 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.422 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.422 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.422 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T22:20:54.422 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.423 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.423 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.423 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.423 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_device": { 2024-09-11T22:20:54.423 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_device", 2024-09-11T22:20:54.423 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.423 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.423 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.423 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.423 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_ident": { 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_ident", 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_perf": { 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_perf", 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.425 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: "contact": { 2024-09-11T22:20:54.426 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "contact", 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.427 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.428 INFO:teuthology.orchestra.run.smithi152.stdout: "description": { 2024-09-11T22:20:54.428 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "description", 2024-09-11T22:20:54.428 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.428 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.428 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: "device_url": { 2024-09-11T22:20:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "device_url", 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.430 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: "enabled": { 2024-09-11T22:20:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enabled", 2024-09-11T22:20:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.432 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.432 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.432 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:54.432 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:54.432 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.432 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.432 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.432 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "24", 2024-09-11T22:20:54.432 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "8", 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "last_opt_revision": { 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "last_opt_revision", 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.433 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "1", 2024-09-11T22:20:54.434 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.434 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.434 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.434 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.434 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.434 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.434 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.434 INFO:teuthology.orchestra.run.smithi152.stdout: "leaderboard": { 2024-09-11T22:20:54.434 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "leaderboard", 2024-09-11T22:20:54.435 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.435 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.435 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.435 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.435 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.436 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.436 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.436 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.436 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.436 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.436 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.436 INFO:teuthology.orchestra.run.smithi152.stdout: "leaderboard_description": { 2024-09-11T22:20:54.436 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "leaderboard_description", 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.438 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.440 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.440 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.440 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.440 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.440 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.440 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.440 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.441 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.441 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.441 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.441 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.441 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.441 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.441 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.441 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.442 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.442 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.442 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.442 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.442 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.443 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.443 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.443 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.443 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.443 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.443 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.443 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "organization": { 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "organization", 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.445 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "proxy": { 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "proxy", 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.446 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "url": { 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "url", 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.447 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.448 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.448 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.448 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "test_orchestrator", 2024-09-11T22:20:54.448 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.448 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.448 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.448 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.449 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.449 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.449 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.449 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.449 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.450 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.451 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.451 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.451 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.451 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.451 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.451 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.452 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.452 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.452 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.452 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.452 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.452 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.453 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.453 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.453 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.453 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.453 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.453 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.453 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.453 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.453 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.454 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.456 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.456 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.456 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.457 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "volumes", 2024-09-11T22:20:54.457 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.457 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.457 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.457 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.457 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.457 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.457 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.457 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.457 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.458 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.458 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.458 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.458 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.458 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.458 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.458 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.458 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.458 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.458 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.459 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.460 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.462 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.463 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.463 INFO:teuthology.orchestra.run.smithi152.stdout: "max_concurrent_clones": { 2024-09-11T22:20:54.463 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_concurrent_clones", 2024-09-11T22:20:54.463 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.463 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.464 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.464 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "4", 2024-09-11T22:20:54.464 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.464 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.464 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.464 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "periodic_async_work": { 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "periodic_async_work", 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Periodically check for async work", 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "snapshot_clone_delay": { 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "snapshot_clone_delay", 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "snapshot_clone_no_wait": { 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T22:20:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix", 2024-09-11T22:20:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "discovery_interval": { 2024-09-11T22:20:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "discovery_interval", 2024-09-11T22:20:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "100", 2024-09-11T22:20:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "identifier": { 2024-09-11T22:20:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "identifier", 2024-09-11T22:20:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "zabbix_host": { 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix_host", 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "zabbix_port": { 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix_port", 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10051", 2024-09-11T22:20:54.482 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "zabbix_sender": { 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix_sender", 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.483 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.484 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.485 INFO:teuthology.orchestra.run.smithi152.stdout: "modules": [ 2024-09-11T22:20:54.485 INFO:teuthology.orchestra.run.smithi152.stdout: "cephadm", 2024-09-11T22:20:54.485 INFO:teuthology.orchestra.run.smithi152.stdout: "dashboard", 2024-09-11T22:20:54.485 INFO:teuthology.orchestra.run.smithi152.stdout: "iostat", 2024-09-11T22:20:54.485 INFO:teuthology.orchestra.run.smithi152.stdout: "nfs", 2024-09-11T22:20:54.486 INFO:teuthology.orchestra.run.smithi152.stdout: "restful", 2024-09-11T22:20:54.486 INFO:teuthology.orchestra.run.smithi152.stdout: "snap_schedule" 2024-09-11T22:20:54.486 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.486 INFO:teuthology.orchestra.run.smithi152.stdout: "available_modules": [ 2024-09-11T22:20:54.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.486 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "alerts", 2024-09-11T22:20:54.486 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.486 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.486 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.486 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.488 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.488 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.488 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.488 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.488 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.488 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.488 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.488 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.488 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.488 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.489 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.489 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.489 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.489 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.489 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.489 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.489 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.489 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.489 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.489 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.490 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.491 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.491 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.491 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.491 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.491 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.491 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.491 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.491 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.492 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.492 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.492 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.492 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.492 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.492 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.492 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.493 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_destination": { 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_destination", 2024-09-11T22:20:54.494 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Email address to send alerts to", 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_from_name": { 2024-09-11T22:20:54.495 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_from_name", 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "Ceph", 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Email From: name", 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.496 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_host": { 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_host", 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SMTP server", 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_password": { 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_password", 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Password to authenticate with", 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.498 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_port": { 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_port", 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "465", 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.499 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SMTP port", 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_sender": { 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_sender", 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.500 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SMTP envelope sender", 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_ssl": { 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_ssl", 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.501 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "smtp_user": { 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "smtp_user", 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.502 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "User to authenticate as", 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "balancer", 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.503 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "active": { 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "active", 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: "begin_time": { 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "begin_time", 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0000", 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.505 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: "begin_weekday": { 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "begin_weekday", 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "0", 2024-09-11T22:20:54.506 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "6", 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_compat_max_iterations": { 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crush_compat_max_iterations", 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "25", 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "250", 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_compat_metrics": { 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crush_compat_metrics", 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.508 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_compat_step": { 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crush_compat_step", 2024-09-11T22:20:54.509 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0.5", 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "0.001", 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "0.999", 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "aggressiveness of optimization", 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "end_time": { 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "end_time", 2024-09-11T22:20:54.510 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "2359", 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "end_weekday": { 2024-09-11T22:20:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "end_weekday", 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "0", 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "6", 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.512 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.514 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.517 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "min_score": { 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "min_score", 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.518 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": { 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mode", 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "upmap", 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "crush-compat", 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "none", 2024-09-11T22:20:54.519 INFO:teuthology.orchestra.run.smithi152.stdout: "read", 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap", 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap-read" 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Balancer mode", 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "pool_ids": { 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pool_ids", 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.520 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.521 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap_max_deviation": { 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "upmap_max_deviation", 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.522 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "upmap_max_optimizations": { 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "upmap_max_optimizations", 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.523 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cephadm", 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "agent_down_multiplier": { 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "agent_down_multiplier", 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "3.0", 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.525 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: "agent_refresh_rate": { 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "agent_refresh_rate", 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "20", 2024-09-11T22:20:54.526 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "agent_starting_port": { 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "agent_starting_port", 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.527 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "4721", 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "allow_ptrace": { 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "allow_ptrace", 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.528 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "autotune_interval": { 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "autotune_interval", 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.529 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "autotune_memory_target_ratio": { 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T22:20:54.530 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0.7", 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "cephadm_log_destination": { 2024-09-11T22:20:54.531 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cephadm_log_destination", 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "file", 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "file,syslog", 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "syslog" 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T22:20:54.532 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: "cgroups_split": { 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cgroups_split", 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.533 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "config_checks_enabled": { 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "config_checks_enabled", 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.534 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "config_dashboard": { 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "config_dashboard", 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.535 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_alertmanager": { 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_alertmanager", 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T22:20:54.536 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_base": { 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_base", 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.537 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Container image name, without the tag", 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_elasticsearch": { 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_elasticsearch", 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.538 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "elasticsearch container image", 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_grafana": { 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_grafana", 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.539 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_haproxy": { 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_haproxy", 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.540 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "HAproxy container image", 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_jaeger_agent": { 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_jaeger_agent", 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.541 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Jaeger agent container image", 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_jaeger_collector": { 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_jaeger_collector", 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.542 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Jaeger collector container image", 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_jaeger_query": { 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_jaeger_query", 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.543 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Jaeger query container image", 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_keepalived": { 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_keepalived", 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.544 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Keepalived container image", 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_loki": { 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_loki", 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.545 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Loki container image", 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_node_exporter": { 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_node_exporter", 2024-09-11T22:20:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_nvmeof": { 2024-09-11T22:20:54.547 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_nvmeof", 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Nvme-of container image", 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_prometheus": { 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_prometheus", 2024-09-11T22:20:54.548 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Prometheus container image", 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_promtail": { 2024-09-11T22:20:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_promtail", 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Promtail container image", 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.550 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_samba": { 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_samba", 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Samba/SMB container image", 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.551 INFO:teuthology.orchestra.run.smithi152.stdout: "container_image_snmp_gateway": { 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_image_snmp_gateway", 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "SNMP Gateway container image", 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "container_init": { 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "container_init", 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.553 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "daemon_cache_timeout": { 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "daemon_cache_timeout", 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.554 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "default_cephadm_command_timeout": { 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "900", 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.555 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: "default_registry": { 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "default_registry", 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "docker.io", 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.556 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "device_cache_timeout": { 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "device_cache_timeout", 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "1800", 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.557 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "seconds to cache device inventory", 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "device_enhanced_scan": { 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "device_enhanced_scan", 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.558 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "facts_cache_timeout": { 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "facts_cache_timeout", 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:54.559 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "seconds to cache host facts data", 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "grafana_dashboards_path": { 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "grafana_dashboards_path", 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.560 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "host_check_interval": { 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "host_check_interval", 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.561 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to perform a host check", 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "hw_monitoring": { 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "hw_monitoring", 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "inventory_list_all": { 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "inventory_list_all", 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.563 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.564 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.565 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "log_refresh_metadata": { 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_refresh_metadata", 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.566 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.567 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.568 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.570 INFO:teuthology.orchestra.run.smithi152.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.571 INFO:teuthology.orchestra.run.smithi152.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "*", 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "max_count_per_host": { 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_count_per_host", 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "max number of daemons per service per host", 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "max_osd_draining_count": { 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_osd_draining_count", 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "migration_current": { 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "migration_current", 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "internal - do not modify", 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "mode": { 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mode", 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "root", 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "cephadm-package", 2024-09-11T22:20:54.576 INFO:teuthology.orchestra.run.smithi152.stdout: "root" 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: "oob_default_addr": { 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "oob_default_addr", 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "169.254.1.1", 2024-09-11T22:20:54.577 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "prometheus_alerts_path": { 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "prometheus_alerts_path", 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.578 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_insecure": { 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_insecure", 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.579 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_password": { 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_password", 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.580 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_url": { 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_url", 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.581 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "registry_username": { 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "registry_username", 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.582 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "secure_monitoring_stack": { 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "secure_monitoring_stack", 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.583 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "service_discovery_port": { 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "service_discovery_port", 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8765", 2024-09-11T22:20:54.584 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "cephadm service discovery port", 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "ssh_config_file": { 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssh_config_file", 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.585 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "use_agent": { 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "use_agent", 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.586 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "use_repo_digest": { 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "use_repo_digest", 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.587 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_on_failed_host_check": { 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_on_failed_host_check", 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.588 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_on_stray_daemons": { 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_on_stray_daemons", 2024-09-11T22:20:54.589 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_on_stray_hosts": { 2024-09-11T22:20:54.590 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_on_stray_hosts", 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crash", 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.592 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.593 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: "retain_interval": { 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "retain_interval", 2024-09-11T22:20:54.597 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "31536000", 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_recent_interval": { 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_recent_interval", 2024-09-11T22:20:54.598 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "1209600", 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "dashboard", 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.600 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "AUDIT_API_ENABLED": { 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.603 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.604 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.605 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.606 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.608 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.609 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.610 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.611 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.612 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.613 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.614 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "admin", 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_URL": { 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_URL", 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.616 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "admin", 2024-09-11T22:20:54.617 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.618 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.619 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.620 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.621 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.622 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.623 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.624 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T22:20:54.626 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.626 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.628 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.628 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.628 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.628 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.628 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.628 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.628 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.628 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.628 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.628 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.631 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.633 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T22:20:54.635 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.636 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.637 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8", 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.638 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "45", 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T22:20:54.639 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T22:20:54.640 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "admin", 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T22:20:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.642 INFO:teuthology.orchestra.run.smithi152.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.643 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.646 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: "cross_origin_url": { 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cross_origin_url", 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.647 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "crt_file": { 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "crt_file", 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.648 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "debug": { 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "debug", 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Enable/disable debug options", 2024-09-11T22:20:54.649 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "jwt_token_ttl": { 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "jwt_token_ttl", 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "28800", 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.650 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "key_file": { 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "key_file", 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.651 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.652 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.653 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.655 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.656 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "motd": { 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "motd", 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "The message of the day", 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.658 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "redirect_resolve_ip_addr": { 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "server_addr": { 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_addr", 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "::", 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: "server_port": { 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_port", 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8080", 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "ssl": { 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssl", 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.662 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "ssl_server_port": { 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssl_server_port", 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8443", 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.663 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_behaviour": { 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_behaviour", 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "redirect", 2024-09-11T22:20:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: "redirect" 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_error_status_code": { 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_error_status_code", 2024-09-11T22:20:54.665 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "500", 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "400", 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "599", 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "url_prefix": { 2024-09-11T22:20:54.666 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "url_prefix", 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "devicehealth", 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: "enable_monitoring": { 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enable_monitoring", 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "monitor device health metrics", 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.669 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.670 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.671 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.674 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "mark_out_threshold": { 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mark_out_threshold", 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "2419200", 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.675 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: "pool_name": { 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pool_name", 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "device_health_metrics", 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.676 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: "retention_period": { 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "retention_period", 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "15552000", 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.677 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how long to retain device health metrics", 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "scrape_frequency": { 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "scrape_frequency", 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "86400", 2024-09-11T22:20:54.678 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "self_heal": { 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "self_heal", 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.680 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "warn_threshold": { 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "warn_threshold", 2024-09-11T22:20:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "7257600", 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "diskprediction_local", 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.684 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.686 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.687 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: "predict_interval": { 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "predict_interval", 2024-09-11T22:20:54.688 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.689 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.689 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.689 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "86400", 2024-09-11T22:20:54.689 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.689 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.689 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.689 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.689 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.689 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.689 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: "predictor_model": { 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "predictor_model", 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "prophetstor", 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.690 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "600", 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.691 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "influx", 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": false, 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "influxdb python module not found", 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.692 INFO:teuthology.orchestra.run.smithi152.stdout: "batch_size": { 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "batch_size", 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5000", 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.693 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "database": { 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "database", 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "ceph", 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": { 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "hostname", 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "InfluxDB server hostname", 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "30", 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "5", 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.697 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.698 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.699 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.700 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.701 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: "password": { 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "password", 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "password of InfluxDB server user", 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "port": { 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "port", 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "8086", 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "InfluxDB server port", 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.704 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: "ssl": { 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ssl", 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "false", 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:20:54.705 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "threads": { 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "threads", 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "32", 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.706 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "username": { 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "username", 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.707 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "username of InfluxDB server user", 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "verify_ssl": { 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "verify_ssl", 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "true", 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "insights", 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.709 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.710 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.711 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.712 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.713 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.714 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "iostat", 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.715 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.716 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.717 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.718 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.719 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.720 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "k8sevents", 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_event_retention_days": { 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "ceph_event_retention_days", 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.721 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "7", 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "config_check_secs": { 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "config_check_secs", 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.722 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "10", 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.723 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.724 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.725 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.726 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.727 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.728 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "localpool", 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.729 INFO:teuthology.orchestra.run.smithi152.stdout: "failure_domain": { 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "failure_domain", 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "host", 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "failure domain for any created local pool", 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.731 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.732 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.733 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.734 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.735 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "min_size": { 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "min_size", 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.736 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "default min_size for any created local pool", 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "num_rep": { 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "num_rep", 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.737 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "3", 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "default replica count for any created local pool", 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "pg_num": { 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pg_num", 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.738 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "128", 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "prefix": { 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "prefix", 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.739 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "name prefix for any created local pool", 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "subtree": { 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "subtree", 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.740 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "rack", 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mds_autoscaler", 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.741 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.742 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.743 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.744 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.746 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mirroring", 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.747 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.748 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.749 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.750 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.751 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.752 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "nfs", 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.753 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.754 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.755 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.756 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.757 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "orchestrator", 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "fail_fs": { 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "fail_fs", 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.759 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.760 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.761 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.763 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.764 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "orchestrator": { 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "orchestrator", 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.765 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "cephadm", 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "rook", 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "test_orchestrator" 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Orchestrator backend", 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.766 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "osd_perf_query", 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.767 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.768 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.769 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.770 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.771 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "osd_support", 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.773 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "pg_autoscaler", 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.779 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.780 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.781 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.782 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.784 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "threshold": { 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "threshold", 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "3.0", 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1.0", 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "scaling threshold", 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.786 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "progress", 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: "allow_pg_recovery_event": { 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "allow_pg_recovery_event", 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.787 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: "enabled": { 2024-09-11T22:20:54.788 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enabled", 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.789 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.791 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.793 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.794 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "max_completed_events": { 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_completed_events", 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "50", 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "number of past completed events to remember", 2024-09-11T22:20:54.795 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "sleep_interval": { 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "sleep_interval", 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "5", 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.796 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "how long the module is going to sleep", 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "prometheus", 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: "cache": { 2024-09-11T22:20:54.797 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "cache", 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.798 INFO:teuthology.orchestra.run.smithi152.stdout: "exclude_perf_counters": { 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "exclude_perf_counters", 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.800 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.801 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.802 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: "rbd_stats_pools": { 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rbd_stats_pools", 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.805 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "300", 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.806 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "scrape_interval": { 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "scrape_interval", 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "15.0", 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.807 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "server_addr": { 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_addr", 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "::", 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.808 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "server_port": { 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_port", 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "9283", 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.809 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "stale_cache_strategy": { 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "stale_cache_strategy", 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "log", 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.810 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_behaviour": { 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_behaviour", 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "default", 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.811 INFO:teuthology.orchestra.run.smithi152.stdout: "default", 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: "error" 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: "standby_error_status_code": { 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "standby_error_status_code", 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.812 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "500", 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "400", 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "599", 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rbd_support", 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.813 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.814 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.815 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.816 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.817 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.818 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: "max_concurrent_snap_create": { 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_concurrent_snap_create", 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.819 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10", 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "mirror_snapshot_schedule": { 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.820 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: "trash_purge_schedule": { 2024-09-11T22:20:54.821 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "trash_purge_schedule", 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "restful", 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "enable_auth": { 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enable_auth", 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.823 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "key_file": { 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "key_file", 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.824 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.827 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.828 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.829 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "server_addr": { 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_addr", 2024-09-11T22:20:54.830 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "server_port": { 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "server_port", 2024-09-11T22:20:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rgw", 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.833 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.836 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.837 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rook", 2024-09-11T22:20:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.839 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.840 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.841 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.842 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.843 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "storage_class": { 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "storage_class", 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "local", 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.844 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "selftest", 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.845 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.846 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.847 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.848 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.849 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "roption1": { 2024-09-11T22:20:54.850 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "roption1", 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.851 INFO:teuthology.orchestra.run.smithi152.stdout: "roption2": { 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "roption2", 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "xyz", 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption1": { 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption1", 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.853 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption2": { 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption2", 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.854 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption3": { 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption3", 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "float", 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.855 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption4": { 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption4", 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.856 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption5": { 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption5", 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.857 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption6": { 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption6", 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.858 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "rwoption7": { 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rwoption7", 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.859 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "1", 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "42", 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "testkey": { 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "testkey", 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.860 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "testlkey": { 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "testlkey", 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.861 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "testnewline": { 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "testnewline", 2024-09-11T22:20:54.862 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "snap_schedule", 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "allow_m_granularity": { 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "allow_m_granularity", 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.864 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: "dump_on_update": { 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "dump_on_update", 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.865 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "dump database to debug log on update", 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.866 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.867 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.868 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.869 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.871 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "stats", 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.872 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.873 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.874 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.875 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.876 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "status", 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.878 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.879 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.880 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.881 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.882 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "telegraf", 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: "address": { 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "address", 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T22:20:54.884 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.885 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "15", 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.886 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.887 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.888 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.889 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.890 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.891 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "telemetry", 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_basic": { 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_basic", 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.892 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_crash": { 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_crash", 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.893 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_device": { 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_device", 2024-09-11T22:20:54.894 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_ident": { 2024-09-11T22:20:54.895 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_ident", 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.896 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "channel_perf": { 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "channel_perf", 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.897 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "contact": { 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "contact", 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.898 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "description": { 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "description", 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.899 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "device_url": { 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "device_url", 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.900 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.901 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.901 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.901 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.901 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.901 INFO:teuthology.orchestra.run.smithi152.stdout: "enabled": { 2024-09-11T22:20:54.901 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "enabled", 2024-09-11T22:20:54.901 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.901 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.901 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.901 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.901 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.902 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "24", 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "8", 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "last_opt_revision": { 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "last_opt_revision", 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "1", 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "leaderboard": { 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "leaderboard", 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.904 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: "leaderboard_description": { 2024-09-11T22:20:54.905 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "leaderboard_description", 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.907 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.908 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.909 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.910 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.911 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "organization": { 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "organization", 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.912 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "proxy": { 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "proxy", 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "url": { 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "url", 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T22:20:54.914 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "test_orchestrator", 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.916 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.916 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.916 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.916 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.916 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.916 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.916 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.916 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.916 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.916 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.916 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.917 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.918 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.919 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.920 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "volumes", 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.922 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.923 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.924 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.925 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.926 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "max_concurrent_clones": { 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "max_concurrent_clones", 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "4", 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.927 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "periodic_async_work": { 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "periodic_async_work", 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.928 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Periodically check for async work", 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: "snapshot_clone_delay": { 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "snapshot_clone_delay", 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "0", 2024-09-11T22:20:54.929 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "snapshot_clone_no_wait": { 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.930 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "True", 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix", 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: "can_run": true, 2024-09-11T22:20:54.931 INFO:teuthology.orchestra.run.smithi152.stdout: "error_string": "", 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "module_options": { 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "discovery_interval": { 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "discovery_interval", 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "uint", 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "100", 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.932 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: "identifier": { 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "identifier", 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.933 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "interval": { 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "interval", 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "secs", 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "60", 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.934 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "log_level": { 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_level", 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.935 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.936 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster": { 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster", 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.937 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_cluster_level": { 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_cluster_level", 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "info", 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [ 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "", 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "critical", 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "debug", 2024-09-11T22:20:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: "error", 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "info", 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "warning" 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "log_to_file": { 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "log_to_file", 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "bool", 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 1, 2024-09-11T22:20:54.939 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "False", 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "zabbix_host": { 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix_host", 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.940 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "", 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "zabbix_port": { 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix_port", 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "int", 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.941 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "10051", 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "zabbix_sender": { 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "zabbix_sender", 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "str", 2024-09-11T22:20:54.942 INFO:teuthology.orchestra.run.smithi152.stdout: "level": "advanced", 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: "flags": 0, 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: "min": "", 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: "max": "", 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: "enum_allowed": [], 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: "desc": "", 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: "long_desc": "", 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: "tags": [], 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: "see_also": [] 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.943 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: "services": { 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: "dashboard": "https://172.21.15.152:8443/" 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: "always_on_modules": { 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus": [ 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: "balancer", 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: "crash", 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: "devicehealth", 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: "orchestrator", 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: "pg_autoscaler", 2024-09-11T22:20:54.944 INFO:teuthology.orchestra.run.smithi152.stdout: "progress", 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "rbd_support", 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "status", 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "telemetry", 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "volumes" 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific": [ 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "balancer", 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "crash", 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "devicehealth", 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "orchestrator", 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "pg_autoscaler", 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "progress", 2024-09-11T22:20:54.945 INFO:teuthology.orchestra.run.smithi152.stdout: "rbd_support", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "status", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "telemetry", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "volumes" 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy": [ 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "balancer", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "crash", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "devicehealth", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "orchestrator", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "pg_autoscaler", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "progress", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "rbd_support", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "status", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "telemetry", 2024-09-11T22:20:54.946 INFO:teuthology.orchestra.run.smithi152.stdout: "volumes" 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "reef": [ 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "balancer", 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "crash", 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "devicehealth", 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "orchestrator", 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "pg_autoscaler", 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "progress", 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "rbd_support", 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "status", 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "telemetry", 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "volumes" 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-09-11T22:20:54.947 INFO:teuthology.orchestra.run.smithi152.stdout: "squid": [ 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: "balancer", 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: "crash", 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: "devicehealth", 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: "orchestrator", 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: "pg_autoscaler", 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: "progress", 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: "rbd_support", 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: "status", 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: "telemetry", 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: "volumes" 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: "last_failure_osd_epoch": 85, 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: "active_clients": [ 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "devicehealth", 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v2", 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 3201756362 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "libcephsqlite", 2024-09-11T22:20:54.949 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v2", 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 4021354379 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "rbd_support", 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v2", 2024-09-11T22:20:54.950 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 4059636238 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "snap_schedule", 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v2", 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 3881492060 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T22:20:54.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "snap_schedule", 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v2", 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2236452685 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "volumes", 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-11T22:20:54.952 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v2", 2024-09-11T22:20:54.953 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2024-09-11T22:20:54.953 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 1425561804 2024-09-11T22:20:54.953 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.953 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T22:20:54.953 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:54.953 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-11T22:20:54.953 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:20:54.954 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:53 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/794776922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:20:54.954 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:53 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3957640384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:20:54.954 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:53 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3816555790' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T22:20:54.954 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:53 smithi193 ceph-mon[35545]: pgmap v521: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 18 MiB/s wr, 1.35k op/s 2024-09-11T22:20:54.955 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:53 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/794776922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:20:54.955 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:53 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3957640384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:20:54.955 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:53 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3816555790' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T22:20:54.955 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:53 smithi179 ceph-mon[35603]: pgmap v521: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 18 MiB/s wr, 1.35k op/s 2024-09-11T22:20:54.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 -- 172.21.15.152:0/3816555790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63d00a2d80 msgr2=0x7f63d00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63d00a2d80 0x7f63d00a5240 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f63e00ffd80 tx=0x7f63cc00a2d0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 -- 172.21.15.152:0/3816555790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e0101aa0 msgr2=0x7f63e0198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e0101aa0 0x7f63e0198320 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f63d400d770 tx=0x7f63d400db70 comp rx=0 tx=0).stop 2024-09-11T22:20:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 -- 172.21.15.152:0/3816555790 shutdown_connections 2024-09-11T22:20:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f63d00a2d80 0x7f63d00a5240 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63e0107ab0 0x7f63e019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63e0102440 0x7f63e0198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 --2- 172.21.15.152:0/3816555790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e0101aa0 0x7f63e0198320 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 -- 172.21.15.152:0/3816555790 >> 172.21.15.152:0/3816555790 conn(0x7f63e00fd7c0 msgr2=0x7f63e00fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 -- 172.21.15.152:0/3816555790 shutdown_connections 2024-09-11T22:20:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:20:53.420+0000 7f63e709b640 1 -- 172.21.15.152:0/3816555790 wait complete. 2024-09-11T22:20:54.962 DEBUG:tasks.check_counter:Getting stats from a 2024-09-11T22:20:54.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-11T22:20:54.963 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:53 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/794776922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:20:54.963 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:53 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3957640384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:20:54.963 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:53 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3816555790' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T22:20:54.963 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:53 smithi152 ceph-mon[31188]: pgmap v521: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 18 MiB/s wr, 1.35k op/s 2024-09-11T22:20:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:55.809 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:20:55.809 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 311, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 299, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1470992, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 183408, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 4, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 0, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.050885290, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.020533907, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.040867460, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 299, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.022647021, 2024-09-11T22:20:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000075742 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1470992, 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 183408 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 3, 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 228, 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 480, 2024-09-11T22:20:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 276432, 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 6, 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 3, 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.016921692, 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.011973502, 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.002442706, 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 225, 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.019213369, 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000085392 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:55.812 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 276432 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 0, 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 2, 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 0, 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 2, 2024-09-11T22:20:55.813 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 1, 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.000241123, 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.000177491, 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 0, 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:20:55.815 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:20:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-11T22:20:55.817 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 148692, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 30, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-11T22:20:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 0, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 0, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 928, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 2, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-11T22:20:55.819 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 310, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 1424637, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 310, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 310, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 1424637, 2024-09-11T22:20:55.820 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-11T22:20:55.821 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:55.821 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:55.821 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:55.821 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:55.821 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:55.821 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:20:55.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:55 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:20:55.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:55 smithi152 ceph-mon[31188]: pgmap v522: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 17 MiB/s wr, 1.25k op/s 2024-09-11T22:20:56.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:55 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:20:56.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:55 smithi179 ceph-mon[35603]: pgmap v522: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 17 MiB/s wr, 1.25k op/s 2024-09-11T22:20:56.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:55 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:20:56.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:55 smithi193 ceph-mon[35545]: pgmap v522: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 17 MiB/s wr, 1.25k op/s 2024-09-11T22:20:56.469 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-11T22:20:56.469 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-11T22:20:56.469 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-11T22:20:56.469 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-11T22:20:56.469 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-11T22:20:56.469 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-11T22:20:56.469 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-11T22:20:56.469 DEBUG:tasks.check_counter:Getting stats from d 2024-09-11T22:20:56.470 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-11T22:20:56.718 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:57.259 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:20:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:20:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 4, 2024-09-11T22:20:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 4, 2024-09-11T22:20:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 3072, 2024-09-11T22:20:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 448, 2024-09-11T22:20:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 4, 2024-09-11T22:20:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 0, 2024-09-11T22:20:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.003066839, 2024-09-11T22:20:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.000038535, 2024-09-11T22:20:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.002138696, 2024-09-11T22:20:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:20:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:20:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3, 2024-09-11T22:20:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.004002517, 2024-09-11T22:20:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001334172 2024-09-11T22:20:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:20:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 3, 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 232, 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 480, 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 277136, 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 6, 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 3, 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.018564084, 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.012387812, 2024-09-11T22:20:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.003432254, 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 229, 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.011484579, 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000050151 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 277136 2024-09-11T22:20:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 312, 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 302, 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1469280, 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 186160, 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 2, 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 1, 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.051653523, 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.020946279, 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.043169563, 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:20:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:20:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 301, 2024-09-11T22:20:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.021664955, 2024-09-11T22:20:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000071976 2024-09-11T22:20:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:20:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1469280, 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 186160 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 0, 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:20:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:20:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:20:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:20:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:20:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:20:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:20:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:20:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:20:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:20:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:20:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:20:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-11T22:20:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:20:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-11T22:20:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:20:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:20:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:20:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:20:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:20:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:20:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:20:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-11T22:20:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:20:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:20:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:20:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-11T22:20:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-11T22:20:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-11T22:20:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:20:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 148714, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 30, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 0, 2024-09-11T22:20:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 0, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 928, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 2, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-11T22:20:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 315, 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 1425287, 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 315, 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 315, 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 1425287, 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:57.273 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:20:57.839 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:20:57 smithi152 ceph-mon[31188]: pgmap v523: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 270 KiB/s wr, 21 op/s 2024-09-11T22:20:57.867 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-11T22:20:57.868 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-11T22:20:57.868 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-11T22:20:57.868 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-11T22:20:57.868 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-11T22:20:57.868 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-11T22:20:57.868 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-11T22:20:57.868 DEBUG:tasks.check_counter:Getting stats from g 2024-09-11T22:20:57.868 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-11T22:20:58.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:20:57 smithi179 ceph-mon[35603]: pgmap v523: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 270 KiB/s wr, 21 op/s 2024-09-11T22:20:58.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:20:57 smithi193 ceph-mon[35545]: pgmap v523: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 270 KiB/s wr, 21 op/s 2024-09-11T22:20:58.116 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:58.635 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:20:58.636 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:20:58.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 0, 2024-09-11T22:20:58.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 2, 2024-09-11T22:20:58.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:20:58.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 0, 2024-09-11T22:20:58.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 4, 2024-09-11T22:20:58.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 0, 2024-09-11T22:20:58.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.001305297, 2024-09-11T22:20:58.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:20:58.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.000212112, 2024-09-11T22:20:58.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:20:58.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 3, 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 230, 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 480, 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 276784, 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 6, 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 3, 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.017251597, 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.012008707, 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.002386639, 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:20:58.638 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 227, 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.018190808, 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000080135 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 276784 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 313, 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 301, 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1471536, 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 184688, 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 2, 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 1, 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.052863013, 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.021562455, 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.043048424, 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 301, 2024-09-11T22:20:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.020337661, 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000067566 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1471536, 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 184688 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 0, 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 148714, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 30, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-11T22:20:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 0, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 0, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 928, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 2, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 312, 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 1424897, 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 312, 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 312, 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 1424897, 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:20:59.343 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-11T22:20:59.344 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-11T22:20:59.344 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-11T22:20:59.344 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-11T22:20:59.344 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-11T22:20:59.344 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-11T22:20:59.344 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-11T22:20:59.344 DEBUG:tasks.check_counter:Getting stats from j 2024-09-11T22:20:59.344 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-11T22:20:59.590 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:00.054 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-11T22:21:00.054 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:21:00.054 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 0, 2024-09-11T22:21:00.054 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 2, 2024-09-11T22:21:00.054 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:21:00.054 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 0, 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 4, 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 0, 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.001324082, 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.000437404, 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:00.055 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 7, 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 235, 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 3552, 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 277760, 2024-09-11T22:21:00.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 6, 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 3, 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.020823165, 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.013213685, 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.004979424, 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 233, 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.024006323, 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000103031 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:00.057 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 3552, 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 277760 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 313, 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 303, 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1469552, 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 186800, 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 2, 2024-09-11T22:21:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 1, 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.051061899, 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.021262506, 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.042050332, 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 302, 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.023744469, 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000078624 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:21:00.059 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1469552, 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 186800 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 0, 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:21:00.060 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:21:00.061 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:21:00.062 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 148731, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 31, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-11T22:21:00.063 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 0, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 0, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 928, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 2, 2024-09-11T22:21:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 316, 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 1425417, 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 316, 2024-09-11T22:21:00.065 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-11T22:21:00.066 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-11T22:21:00.066 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 316, 2024-09-11T22:21:00.066 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 1425417, 2024-09-11T22:21:00.066 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-11T22:21:00.066 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-11T22:21:00.066 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-11T22:21:00.066 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-11T22:21:00.066 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:21:00.066 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-11T22:21:00.066 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-11T22:21:00.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:00 smithi152 ceph-mon[31188]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:21:00.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:00 smithi152 ceph-mon[31188]: pgmap v524: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 298 KiB/s wr, 25 op/s 2024-09-11T22:21:00.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:00 smithi179 ceph-mon[35603]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:21:00.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:00 smithi179 ceph-mon[35603]: pgmap v524: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 298 KiB/s wr, 25 op/s 2024-09-11T22:21:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:00 smithi193 ceph-mon[35545]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:21:00.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:00 smithi193 ceph-mon[35545]: pgmap v524: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 298 KiB/s wr, 25 op/s 2024-09-11T22:21:00.917 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-11T22:21:00.917 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-11T22:21:00.917 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-11T22:21:00.917 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-11T22:21:00.917 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-11T22:21:00.917 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-11T22:21:00.917 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-11T22:21:00.917 DEBUG:tasks.check_counter:Getting stats from b 2024-09-11T22:21:00.917 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-11T22:21:01.177 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:21:01.757 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-11T22:21:01.757 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:21:01.757 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 1371, 2024-09-11T22:21:01.757 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 1407, 2024-09-11T22:21:01.757 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 395368, 2024-09-11T22:21:01.757 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 1050734, 2024-09-11T22:21:01.757 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 10, 2024-09-11T22:21:01.757 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 4, 2024-09-11T22:21:01.757 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.118672036, 2024-09-11T22:21:01.757 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.046867498, 2024-09-11T22:21:01.757 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.067271431, 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.006679033, 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1407, 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.090202019, 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000064109 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 2473, 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000455194, 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000184 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 2368, 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 458304 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 2314, 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 1119, 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 1059850, 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 899640, 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 61, 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 8, 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.122002173, 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.036879760, 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.114507251, 2024-09-11T22:21:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000547618, 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1115, 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.032982098, 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000029580 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 3277, 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000507315, 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000154 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 7584, 2024-09-11T22:21:01.760 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 127024 2024-09-11T22:21:01.761 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.761 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:21:01.761 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 607, 2024-09-11T22:21:01.761 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 651, 2024-09-11T22:21:01.761 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 1625599, 2024-09-11T22:21:01.761 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 324840, 2024-09-11T22:21:01.761 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 11, 2024-09-11T22:21:01.761 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 5, 2024-09-11T22:21:01.761 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.085998409, 2024-09-11T22:21:01.761 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.033200745, 2024-09-11T22:21:01.761 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.069865798, 2024-09-11T22:21:01.762 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000695595, 2024-09-11T22:21:01.762 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:01.762 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 650, 2024-09-11T22:21:01.762 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.045477395, 2024-09-11T22:21:01.762 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000069965 2024-09-11T22:21:01.762 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.762 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:01.762 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 450, 2024-09-11T22:21:01.762 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000065245, 2024-09-11T22:21:01.762 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000144 2024-09-11T22:21:01.762 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 1619296, 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 260224 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 71, 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.002686637, 2024-09-11T22:21:01.763 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000037839 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 2, 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000015811, 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000007905 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-09-11T22:21:01.764 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 152, 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 8, 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 8, 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.002766497, 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000345812 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 144, 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 0, 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 11, 2024-09-11T22:21:01.765 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 0, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 40, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 11, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 29, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 0, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 25, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 4, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 4, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 4, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 5, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 253, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 88, 2024-09-11T22:21:01.766 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 144, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 21, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 0, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 0, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 0, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 1, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 6, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 1030, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 1722449962, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 6, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:21:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 0, 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 30, 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 28, 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 42, 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 0, 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 3, 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 2 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-09-11T22:21:01.769 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-09-11T22:21:01.770 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 106, 2024-09-11T22:21:01.770 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 63, 2024-09-11T22:21:01.770 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 63, 2024-09-11T22:21:01.770 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 0, 2024-09-11T22:21:01.770 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 0, 2024-09-11T22:21:01.770 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-09-11T22:21:01.770 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:21:01.770 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 0, 2024-09-11T22:21:01.770 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 0, 2024-09-11T22:21:01.770 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-09-11T22:21:01.770 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_path": 15, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_inode": 335, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 0, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-09-11T22:21:01.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "evlrg": 0, 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 12, 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 0, 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 0, 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 12, 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 0, 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 2, 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 0, 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 0, 2024-09-11T22:21:01.772 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 2, 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: "segmjr": 2, 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 0, 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 4194304, 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 4206789, 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 0, 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 11, 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.025643663, 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.002331242 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 0 2024-09-11T22:21:01.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 41, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 43, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 2, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 100, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 110, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 10, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 40, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 44, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 4, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 4, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 10, 2024-09-11T22:21:01.774 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 6, 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 52028, 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 223520 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 154, 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 0, 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 152, 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 37, 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 1, 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.775 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1, 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000643593, 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000643593 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 7, 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.002122904, 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000303272 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.779 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.780 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-09-11T22:21:01.780 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.780 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.780 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.781 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.782 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.783 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.784 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 2, 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 5, 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 3, 2024-09-11T22:21:01.788 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 2, 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 2, 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 1, 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 961, 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:21:01.789 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-09-11T22:21:01.790 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:21:01.791 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 272436, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 119, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-09-11T22:21:01.792 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-09-11T22:21:01.793 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:21:01.793 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-09-11T22:21:01.793 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:21:01.793 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-09-11T22:21:01.793 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 8384, 2024-09-11T22:21:01.793 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 184, 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 266750, 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 1305, 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 61, 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 24811, 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 29, 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 61, 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 61, 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.282993580, 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.004639239 2024-09-11T22:21:01.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 61, 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 95 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 61, 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 0, 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 61, 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 0, 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 10, 2024-09-11T22:21:01.798 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 0, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 11, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 9, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 0, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 6, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 0, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 20, 2024-09-11T22:21:01.799 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-09-11T22:21:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-09-11T22:21:01.801 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-09-11T22:21:01.801 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-09-11T22:21:01.801 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-09-11T22:21:01.801 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-09-11T22:21:01.801 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-09-11T22:21:01.801 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-09-11T22:21:01.801 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-09-11T22:21:01.801 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-09-11T22:21:01.801 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-09-11T22:21:01.801 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-09-11T22:21:01.801 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 105, 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 23, 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 10, 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 13, 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 3, 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 33, 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 0, 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 6 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 1, 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 325 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-09-11T22:21:01.803 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 0, 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed_ops": 0, 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 0, 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 4288, 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 2661588, 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 4288, 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 4288, 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 2661588, 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:01.805 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 61, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 24811, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 61, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 24811, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.806 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 61, 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 61, 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 61, 2024-09-11T22:21:01.807 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 61, 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-11T22:21:01.808 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-11T22:21:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-11T22:21:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-09-11T22:21:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-09-11T22:21:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:01.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55f1470a2960": { 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 12, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 12485, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 12, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 11, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 12485, 2024-09-11T22:21:01.810 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:01.811 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:01.811 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:01.811 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:01.811 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:01.811 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:01.811 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-11T22:21:02.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:01 smithi179 ceph-mon[35603]: pgmap v525: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 32 KiB/s wr, 11 op/s 2024-09-11T22:21:02.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:01 smithi193 ceph-mon[35545]: pgmap v525: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 32 KiB/s wr, 11 op/s 2024-09-11T22:21:02.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:01 smithi152 ceph-mon[31188]: pgmap v525: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 32 KiB/s wr, 11 op/s 2024-09-11T22:21:02.706 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-11T22:21:02.706 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-11T22:21:02.706 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=0 2024-09-11T22:21:02.706 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=106 2024-09-11T22:21:02.706 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-11T22:21:02.706 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-11T22:21:02.706 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T22:21:02.706 DEBUG:tasks.check_counter:Getting stats from e 2024-09-11T22:21:02.707 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-11T22:21:02.955 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:21:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-11T22:21:03.403 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:21:03.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 589, 2024-09-11T22:21:03.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 567, 2024-09-11T22:21:03.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 5798536, 2024-09-11T22:21:03.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 266546, 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 7, 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 2, 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.075081470, 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.024896115, 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.055776846, 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.006022655, 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 567, 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.030323650, 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000053480 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:03.404 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 1544272, 2024-09-11T22:21:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 192128 2024-09-11T22:21:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:21:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 1101, 2024-09-11T22:21:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 1331, 2024-09-11T22:21:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 26323116, 2024-09-11T22:21:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 1008225, 2024-09-11T22:21:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 9, 2024-09-11T22:21:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 6, 2024-09-11T22:21:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.119611347, 2024-09-11T22:21:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.031939104, 2024-09-11T22:21:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.047990698, 2024-09-11T22:21:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.029426496, 2024-09-11T22:21:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1328, 2024-09-11T22:21:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.057036542, 2024-09-11T22:21:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000042949 2024-09-11T22:21:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 659056 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 2267, 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 2269, 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 21637295, 2024-09-11T22:21:03.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 720964, 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 5, 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 4, 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.211084885, 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.062968516, 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.064547813, 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.066263583, 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 2267, 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.095274225, 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000042026 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-11T22:21:03.409 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 6120, 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.148685474, 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000024295 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 0, 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 0, 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 0, 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 0, 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-09-11T22:21:03.411 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 0, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 0, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 2732, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 0, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 2732, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 0, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 2731, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 0, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 0, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 0, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 4, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 0, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 0, 2024-09-11T22:21:03.412 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 0, 2024-09-11T22:21:03.413 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 0, 2024-09-11T22:21:03.413 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:21:03.413 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-09-11T22:21:03.413 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 0, 2024-09-11T22:21:03.413 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-09-11T22:21:03.413 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-09-11T22:21:03.413 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 0, 2024-09-11T22:21:03.413 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 0, 2024-09-11T22:21:03.413 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 0, 2024-09-11T22:21:03.414 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 0, 2024-09-11T22:21:03.414 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-09-11T22:21:03.414 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:21:03.414 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-09-11T22:21:03.414 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 0, 2024-09-11T22:21:03.414 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 0, 2024-09-11T22:21:03.414 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 0, 2024-09-11T22:21:03.414 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:21:03.414 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-09-11T22:21:03.414 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:21:03.415 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:21:03.415 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:21:03.415 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:21:03.415 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:21:03.415 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 0, 2024-09-11T22:21:03.415 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 0, 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 0, 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 0, 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 0, 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 0 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-09-11T22:21:03.416 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-09-11T22:21:03.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "evlrg": 0, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 0, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 0, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 0, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 8034, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 0, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 0, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 0, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 0, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 16, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "segmjr": 2, 2024-09-11T22:21:03.419 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-09-11T22:21:03.420 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 0, 2024-09-11T22:21:03.420 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 4194304, 2024-09-11T22:21:03.420 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 55313493, 2024-09-11T22:21:03.420 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 55301388, 2024-09-11T22:21:03.420 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-09-11T22:21:03.420 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.420 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.420 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.420 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 8034 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 1893, 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 2164, 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 271, 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 108, 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 118, 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 10, 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 2732, 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 2742, 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 10, 2024-09-11T22:21:03.421 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 0, 2024-09-11T22:21:03.422 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 0, 2024-09-11T22:21:03.422 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 0, 2024-09-11T22:21:03.422 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 59324, 2024-09-11T22:21:03.422 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 215328 2024-09-11T22:21:03.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.422 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-09-11T22:21:03.422 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 0, 2024-09-11T22:21:03.422 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 0, 2024-09-11T22:21:03.422 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 0, 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 0, 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 0, 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-09-11T22:21:03.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-09-11T22:21:03.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-09-11T22:21:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-09-11T22:21:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.427 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.428 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.429 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-09-11T22:21:03.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.431 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.433 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-09-11T22:21:03.433 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.433 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.433 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.433 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-09-11T22:21:03.433 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.433 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.433 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.434 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-09-11T22:21:03.434 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.434 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.434 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.434 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:21:03.434 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:21:03.434 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-09-11T22:21:03.435 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.435 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.435 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.435 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:03.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.436 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-09-11T22:21:03.436 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 2, 2024-09-11T22:21:03.436 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 6, 2024-09-11T22:21:03.436 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 4, 2024-09-11T22:21:03.436 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 5, 2024-09-11T22:21:03.436 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-09-11T22:21:03.436 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 0, 2024-09-11T22:21:03.437 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 0, 2024-09-11T22:21:03.437 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 4243, 2024-09-11T22:21:03.437 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-09-11T22:21:03.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.437 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-09-11T22:21:03.437 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:21:03.437 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-09-11T22:21:03.437 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:21:03.437 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:21:03.437 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:21:03.437 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:21:03.438 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:21:03.438 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:21:03.438 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:21:03.438 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:21:03.438 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:21:03.438 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:21:03.438 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:21:03.438 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:21:03.438 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:21:03.438 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-09-11T22:21:03.438 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:21:03.439 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-09-11T22:21:03.439 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:21:03.439 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:21:03.439 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:21:03.439 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:21:03.439 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:21:03.439 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:21:03.439 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:21:03.439 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-09-11T22:21:03.439 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:21:03.439 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:21:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:21:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-09-11T22:21:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-09-11T22:21:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-09-11T22:21:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:21:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:21:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:21:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:21:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 301428, 2024-09-11T22:21:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 2359, 2024-09-11T22:21:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 8384, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 184, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-09-11T22:21:03.441 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 6858139, 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 115343, 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 3599, 2024-09-11T22:21:03.442 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 21, 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 3, 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 3599, 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 3599, 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 8.506808668, 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.002363658 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 3599, 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 3600 2024-09-11T22:21:03.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 3599, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 3599, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 0, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 2095, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 0, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 1502, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 0, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 0, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-09-11T22:21:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 0, 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 0, 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 1, 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 0, 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 0, 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-09-11T22:21:03.447 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 105, 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 23, 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 8, 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 9, 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 1, 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 0, 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 2, 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 0 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 0, 2024-09-11T22:21:03.448 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 0 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 0, 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed_ops": 0, 2024-09-11T22:21:03.449 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 0, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 3953, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 53382145, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 3953, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 3953, 2024-09-11T22:21:03.450 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 53382145, 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-11T22:21:03.451 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:03.452 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:03.452 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 3599, 2024-09-11T22:21:03.452 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 51210623, 2024-09-11T22:21:03.452 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 3599, 2024-09-11T22:21:03.452 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 51210623, 2024-09-11T22:21:03.452 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:03.453 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.453 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.453 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.453 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:03.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.453 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-09-11T22:21:03.453 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:03.453 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-09-11T22:21:03.453 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:03.453 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-11T22:21:03.453 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-11T22:21:03.454 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:03.454 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:03.454 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 3599, 2024-09-11T22:21:03.454 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 3599, 2024-09-11T22:21:03.454 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 3599, 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 3599, 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.457 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55a44d908b40": { 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-11T22:21:03.458 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-11T22:21:03.459 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-09-11T22:21:03.459 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-09-11T22:21:03.459 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:03.459 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:03.459 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:03.459 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:03.459 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:03.459 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-11T22:21:04.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:03 smithi179 ceph-mon[35603]: pgmap v526: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-11T22:21:04.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:03 smithi193 ceph-mon[35545]: pgmap v526: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-11T22:21:04.139 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-11T22:21:04.139 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-11T22:21:04.139 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-11T22:21:04.139 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-11T22:21:04.139 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-11T22:21:04.139 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-11T22:21:04.139 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T22:21:04.139 DEBUG:tasks.check_counter:Getting stats from h 2024-09-11T22:21:04.139 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-11T22:21:04.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:03 smithi152 ceph-mon[31188]: pgmap v526: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-11T22:21:04.396 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:21:04.857 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-11T22:21:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:21:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 3206, 2024-09-11T22:21:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 3208, 2024-09-11T22:21:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 917960, 2024-09-11T22:21:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 1019515, 2024-09-11T22:21:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 6, 2024-09-11T22:21:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 2, 2024-09-11T22:21:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.214303601, 2024-09-11T22:21:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.066481238, 2024-09-11T22:21:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.055122117, 2024-09-11T22:21:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.076613691, 2024-09-11T22:21:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 3206, 2024-09-11T22:21:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.097339573, 2024-09-11T22:21:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000030361 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 5, 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 234, 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 1036, 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 661194, 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 7, 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 4, 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.012517068, 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.008142022, 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.002137420, 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000061137, 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 231, 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.021829810, 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000094501 2024-09-11T22:21:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 660496 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 355, 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 333, 2024-09-11T22:21:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 1544268, 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 191806, 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 4, 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 2, 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.053618106, 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.019284711, 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.047523314, 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000037618, 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 333, 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.023857976, 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000071645 2024-09-11T22:21:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 1544000, 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 191488 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-09-11T22:21:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-11T22:21:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-11T22:21:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 5319, 2024-09-11T22:21:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.114378588, 2024-09-11T22:21:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000021503 2024-09-11T22:21:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-09-11T22:21:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-11T22:21:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-11T22:21:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-09-11T22:21:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 0, 2024-09-11T22:21:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 0, 2024-09-11T22:21:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-09-11T22:21:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 0, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 0, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 0, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 0, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 13, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 0, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 13, 2024-09-11T22:21:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 13, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 3, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-09-11T22:21:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:21:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 0, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 0, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 0, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 0 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 0, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 0, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 0, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 0, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 0, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-09-11T22:21:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:21:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 0, 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "evlrg": 0, 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 0, 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 0, 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 0, 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 12, 2024-09-11T22:21:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-09-11T22:21:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 0, 2024-09-11T22:21:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 0, 2024-09-11T22:21:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 0, 2024-09-11T22:21:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 0, 2024-09-11T22:21:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 2, 2024-09-11T22:21:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "segmjr": 2, 2024-09-11T22:21:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-09-11T22:21:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 0, 2024-09-11T22:21:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 4194304, 2024-09-11T22:21:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 4206789, 2024-09-11T22:21:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 4206728, 2024-09-11T22:21:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-09-11T22:21:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 12 2024-09-11T22:21:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-09-11T22:21:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 13, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 13, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 0, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 9, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 9, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 0, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 13, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 13, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 0, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 0, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 0, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 0, 2024-09-11T22:21:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 49040, 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 215328 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 0, 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 0, 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 0, 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 0, 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 0, 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-09-11T22:21:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-09-11T22:21:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-09-11T22:21:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-09-11T22:21:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-09-11T22:21:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-09-11T22:21:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-09-11T22:21:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-09-11T22:21:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-09-11T22:21:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 2, 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 5, 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 3, 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 4, 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 0, 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 0, 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 3596, 2024-09-11T22:21:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:21:04.890 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:21:04.891 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 182346, 2024-09-11T22:21:04.892 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 55, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 8384, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 184, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 51980, 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 298, 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-09-11T22:21:04.894 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 3209, 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 21, 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 3, 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 3209, 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 3209, 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 4.364901877, 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001360206 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 3209, 2024-09-11T22:21:04.895 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 3210 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 3209, 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 3209, 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 0, 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 2100, 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 0, 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 1107, 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 0, 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 0, 2024-09-11T22:21:04.896 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 1, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:21:04.897 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-09-11T22:21:04.898 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 105, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 23, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 4, 2024-09-11T22:21:04.899 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 5, 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 1, 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 0, 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 2, 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 0 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 0, 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.900 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 0 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 0, 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed_ops": 0, 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 0, 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.901 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 3562, 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 2121704, 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 3562, 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 3562, 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 2121704, 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:04.903 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 3209, 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 12490, 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 3209, 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 12490, 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:04.904 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 3209, 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 3209, 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 3209, 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 3209, 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.905 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55aa31bc0b40": { 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:04.907 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:04.908 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-11T22:21:05.610 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-11T22:21:05.610 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-11T22:21:05.610 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-11T22:21:05.610 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-11T22:21:05.610 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-11T22:21:05.610 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-11T22:21:05.611 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T22:21:05.611 DEBUG:tasks.check_counter:Getting stats from k 2024-09-11T22:21:05.611 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-11T22:21:05.857 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:21:05.977 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:05 smithi179 ceph-mon[35603]: pgmap v527: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 79 KiB/s wr, 31 op/s 2024-09-11T22:21:06.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:05 smithi193 ceph-mon[35545]: pgmap v527: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 79 KiB/s wr, 31 op/s 2024-09-11T22:21:06.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:05 smithi152 ceph-mon[31188]: pgmap v527: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 79 KiB/s wr, 31 op/s 2024-09-11T22:21:06.820 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-11T22:21:06.821 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:21:06.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 0, 2024-09-11T22:21:06.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 2, 2024-09-11T22:21:06.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:21:06.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 0, 2024-09-11T22:21:06.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 4, 2024-09-11T22:21:06.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 0, 2024-09-11T22:21:06.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.001060908, 2024-09-11T22:21:06.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:21:06.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.000268128, 2024-09-11T22:21:06.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:21:06.822 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:06.822 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:06.822 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:06.822 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:06.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:06.822 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:06.822 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:06.822 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:06.822 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:06.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:06.822 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 316, 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 306, 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 1470368, 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 188720, 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 2, 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 1, 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.050758187, 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.018170814, 2024-09-11T22:21:06.823 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.045809727, 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 305, 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.016858607, 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000055274 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:06.824 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 1470368, 2024-09-11T22:21:06.825 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 188720 2024-09-11T22:21:06.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:06.825 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:21:06.825 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 7, 2024-09-11T22:21:06.825 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 237, 2024-09-11T22:21:06.825 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 3552, 2024-09-11T22:21:06.825 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 278112, 2024-09-11T22:21:06.825 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 6, 2024-09-11T22:21:06.825 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 3, 2024-09-11T22:21:06.825 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.015829219, 2024-09-11T22:21:06.825 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.009396774, 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.003834249, 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 235, 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.031809950, 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000135361 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:06.826 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 3552, 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 278112 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 0, 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:21:06.829 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 148754, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 31, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-09-11T22:21:06.830 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 0, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 0, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 928, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 2, 2024-09-11T22:21:06.831 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-09-11T22:21:06.832 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-09-11T22:21:06.832 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-09-11T22:21:06.832 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-09-11T22:21:06.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-11T22:21:06.832 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:21:06.832 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-11T22:21:06.832 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-11T22:21:06.832 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-11T22:21:06.832 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 319, 2024-09-11T22:21:06.832 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 1425807, 2024-09-11T22:21:06.832 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:06.833 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 319, 2024-09-11T22:21:06.833 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-11T22:21:06.833 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-11T22:21:06.833 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 319, 2024-09-11T22:21:06.833 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 1425807, 2024-09-11T22:21:06.833 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-11T22:21:06.833 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-11T22:21:06.833 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-11T22:21:06.833 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-11T22:21:06.833 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:06.833 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-11T22:21:06.834 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-11T22:21:07.576 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-11T22:21:07.577 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-11T22:21:07.577 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-11T22:21:07.577 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-11T22:21:07.577 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-11T22:21:07.577 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-11T22:21:07.577 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-11T22:21:07.577 DEBUG:tasks.check_counter:Getting stats from c 2024-09-11T22:21:07.577 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-11T22:21:07.836 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:07.956 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:07 smithi193 ceph-mon[35545]: pgmap v528: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 75 KiB/s wr, 24 op/s 2024-09-11T22:21:08.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:07 smithi179 ceph-mon[35603]: pgmap v528: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 75 KiB/s wr, 24 op/s 2024-09-11T22:21:08.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:07 smithi152 ceph-mon[31188]: pgmap v528: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 75 KiB/s wr, 24 op/s 2024-09-11T22:21:08.396 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-11T22:21:08.396 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:21:08.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 23781, 2024-09-11T22:21:08.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 30740, 2024-09-11T22:21:08.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 9160785, 2024-09-11T22:21:08.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 27866555, 2024-09-11T22:21:08.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 14, 2024-09-11T22:21:08.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 5, 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 1.432023790, 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.616388489, 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 1.375836800, 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.145348170, 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 30741, 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 1.456811651, 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000047389 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 32757, 2024-09-11T22:21:08.397 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.004808279, 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000146 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 6250960, 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 10841216 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 11587, 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 13038, 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 2900582, 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 27553413, 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 15, 2024-09-11T22:21:08.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 6, 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.713141438, 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.280965553, 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.183469621, 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.197514888, 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 13036, 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.458229988, 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000035151 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3126, 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000638209, 2024-09-11T22:21:08.399 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000204 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 4320, 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 573088 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 9242, 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 9277, 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 2362204, 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 20468877, 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 53, 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 9, 2024-09-11T22:21:08.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.514645278, 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.172278498, 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.131834720, 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.171802190, 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 9273, 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.311533156, 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000033595 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 134, 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000024804, 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000185 2024-09-11T22:21:08.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 7936, 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 16976 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 1, 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-MDSRank": { 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 23758, 2024-09-11T22:21:08.402 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 7.906235461, 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000332782 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-PurgeQueue": { 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1050, 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.035796329, 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000034091 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.403 INFO:teuthology.orchestra.run.smithi193.stdout: "mds": { 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: "request": 4985, 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: "reply": 4983, 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: "reply_latency": { 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 4983, 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 73.616865824, 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.014773603 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_reply": 0, 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: "forward": 2, 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_complete": 0, 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_keys": 0, 2024-09-11T22:21:08.404 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_commit": 79, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_split": 8, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_merge": 0, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes": 2380, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_top": 257, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_bottom": 2094, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pin_tail": 29, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pinned": 2012, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_expired": 9, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_with_caps": 74, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "caps": 74, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "subtrees": 5, 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse": 8955, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_hit": 7404, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_forward": 0, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_discover": 21, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_remote_ino": 0, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_lock": 447, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "load_cent": 0, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "q": 0, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "exported": 11, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "exported_inodes": 6, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "imported": 27, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "imported_inodes": 259, 2024-09-11T22:21:08.406 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_dir_fetch": 0, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_backtrace_fetch": 21966, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_peer_discover": 0, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rfiles": 1030, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rbytes": 1722449962, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rsnaps": 6, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_fetch": 21966, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_set_tag": 0, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_inodes": 587, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dirfrag_rstats": 587, 2024-09-11T22:21:08.407 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_file_inodes": 21379, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_inode_file_caps": 61, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_revoke": 4162, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_grant": 5082, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_trunc": 6, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flushsnap_ack": 1, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps": 7228, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps_dirty": 2323, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_cap_release": 271, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "process_request_cap_release": 1381 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_cache": { 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update": 58, 2024-09-11T22:21:08.408 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update_receipt": 12, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_try_discover": 8, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_send_discover": 26, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_handle_discover": 81, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays": 0, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_delayed": 0, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_created": 497, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_enqueued": 269, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_reintegrated": 228, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_migrated": 0, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_processing": 0, 2024-09-11T22:21:08.409 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_started": 0, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_completed": 0, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_path": 15, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_inode": 15782, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_exportdir": 11, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_flush": 0, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragmentdir": 8, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragstats": 0, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_inodestats": 0 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.410 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_log": { 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "evlrg": 0, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "evadd": 8039, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "evex": 0, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "evtrm": 0, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "ev": 8039, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "evexg": 0, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "evexd": 0, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "segadd": 16, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "segex": 0, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "segtrm": 0, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "seg": 16, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "segmjr": 2, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "segexg": 0, 2024-09-11T22:21:08.411 INFO:teuthology.orchestra.run.smithi193.stdout: "segexd": 0, 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: "expos": 4194304, 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: "wrpos": 55344727, 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: "rdpos": 0, 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: "jlat": { 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 4390, 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 98.383963620, 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.022410925 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: "replayed": 0 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_mem": { 2024-09-11T22:21:08.412 INFO:teuthology.orchestra.run.smithi193.stdout: "ino": 1890, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "ino+": 2165, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "ino-": 275, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "dir": 108, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "dir+": 120, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "dir-": 12, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "dn": 2379, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "dn+": 3018, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "dn-": 639, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "cap": 73, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "cap+": 2956, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "cap-": 2883, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "rss": 73896, 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: "heap": 223520 2024-09-11T22:21:08.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_server": { 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_client_request": 6264, 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_server_request": 2, 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_request": 4985, 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_session": 503, 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_peer_request": 7, 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: "req_create_latency": { 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1081, 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 29.435314797, 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.027229708 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getattr_latency": { 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 257, 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 15.196129153, 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.059128907 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getfilelock_latency": { 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: "req_link_latency": { 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 228, 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 19.762611533, 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.086678120 2024-09-11T22:21:08.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookup_latency": { 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1606, 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 5.214867455, 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.003247115 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookuphash_latency": { 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupino_latency": { 2024-09-11T22:21:08.416 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupname_latency": { 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupparent_latency": { 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.418 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupsnap_latency": { 2024-09-11T22:21:08.418 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.418 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.418 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.418 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lssnap_latency": { 2024-09-11T22:21:08.418 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mkdir_latency": { 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 6, 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.356125611, 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.059354268 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mknod_latency": { 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.419 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mksnap_latency": { 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: "req_open_latency": { 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 911, 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.567901430, 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000623382 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.420 INFO:teuthology.orchestra.run.smithi193.stdout: "req_readdir_latency": { 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 151, 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.369807778, 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.002449058 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rename_latency": { 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 460, 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 1.949251970, 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.004237504 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: "req_renamesnap_latency": { 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.421 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: "req_snapdiff_latency": { 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmdir_latency": { 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2, 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.011159312, 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.005579656 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmsnap_latency": { 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmxattr_latency": { 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setattr_latency": { 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 6, 2024-09-11T22:21:08.423 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.338587610, 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.056431268 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setdirlayout_latency": { 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setfilelock_latency": { 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setlayout_latency": { 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setxattr_latency": { 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: "req_symlink_latency": { 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.425 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: "req_unlink_latency": { 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 275, 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.415109175, 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001509487 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getvxattr_latency": { 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.426 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_sessions": { 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: "session_count": 2, 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: "session_add": 6, 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: "session_remove": 4, 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_open": 2, 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_stale": 0, 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: "total_load": 553, 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: "average_load": 276, 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: "avg_session_uptime": 984, 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: "mdthresh_evicted": 0 2024-09-11T22:21:08.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:21:08.428 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:21:08.429 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 934655, 2024-09-11T22:21:08.430 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 1385, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 0, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 8384, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 184, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:21:08.431 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 6655688, 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 118404, 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: "objecter": { 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: "op_active": 0, 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi193.stdout: "op_laggy": 0, 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send": 27578, 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send_bytes": 52326365, 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "op_resend": 28, 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "op_reply": 27578, 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "op_latency": { 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 27578, 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 115.580060601, 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.004191024 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "op_inflight": 0, 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "oplen_avg": { 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 27578, 2024-09-11T22:21:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 28109 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "op": 27578, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "op_r": 22101, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "op_w": 5477, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "op_rmw": 0, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "op_pg": 0, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_stat": 0, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_create": 10, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_read": 135, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_write": 4525, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writefull": 164, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writesame": 0, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_append": 0, 2024-09-11T22:21:08.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_zero": 0, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_truncate": 4, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_delete": 311, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_mapext": 0, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_sparse_read": 0, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_clonerange": 0, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_getxattr": 21966, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_setxattr": 20, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_rmxattr": 0, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_call": 0, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_watch": 0, 2024-09-11T22:21:08.435 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_notify": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_other": 7, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_active": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_send": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_resend": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_ping": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_active": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_send": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_resend": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_active": 0, 2024-09-11T22:21:08.436 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_send": 0, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_resend": 0, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_active": 0, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_send": 0, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_resend": 0, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "command_active": 0, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "command_send": 0, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "command_resend": 0, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "map_epoch": 105, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "map_full": 0, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "map_inc": 23, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_sessions": 12, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_open": 12, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_close": 0, 2024-09-11T22:21:08.437 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_laggy": 0, 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_wr": 790, 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_rd": 0, 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_del": 177 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: "oft": { 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_objs": 1, 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_updates": 0, 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_removes": 0 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osd-slow-ops": { 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_ops_count": 14742 2024-09-11T22:21:08.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "purge_queue": { 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops": 0, 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops_high_water": 17, 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing": 0, 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_high_water": 10, 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed_ops": 283, 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed": 269, 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_item_in_journal": 0 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-11T22:21:08.439 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 44606, 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 9754388, 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 44606, 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 44606, 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 9754388, 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.440 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_bytes": { 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 27578, 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 52354782, 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 27578, 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 52354782, 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_ops": { 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 1024, 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-11T22:21:08.442 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 27578, 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 27578, 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 27578, 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 27578, 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:21:08.443 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:08.444 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-11T22:21:08.444 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:08.444 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 269, 2024-09-11T22:21:08.444 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 28417, 2024-09-11T22:21:08.444 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:08.444 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 269, 2024-09-11T22:21:08.444 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-11T22:21:08.444 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-11T22:21:08.444 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 135, 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 28417, 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle-0x56107c294960": { 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 574, 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 8039, 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 51150423, 2024-09-11T22:21:08.445 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 8039, 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 4390, 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 51149849, 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:08.446 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-11T22:21:09.175 INFO:tasks.check_counter:Daemon mds.c mds.exported=11 2024-09-11T22:21:09.175 INFO:tasks.check_counter:Daemon mds.c mds.imported=27 2024-09-11T22:21:09.175 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=58 2024-09-11T22:21:09.176 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=12 2024-09-11T22:21:09.176 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-11T22:21:09.176 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-11T22:21:09.176 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T22:21:09.176 DEBUG:tasks.check_counter:Getting stats from f 2024-09-11T22:21:09.176 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-11T22:21:09.459 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:09.979 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-11T22:21:09.979 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:21:09.979 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 2364, 2024-09-11T22:21:09.979 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 2364, 2024-09-11T22:21:09.979 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 4894235, 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 750938, 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 6, 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 2, 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.200217144, 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.059217725, 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.058162630, 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.065229744, 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2363, 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.117403285, 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000049683 2024-09-11T22:21:09.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 409, 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 389, 2024-09-11T22:21:09.981 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 1556698, 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 210212, 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 5, 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 3, 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.053785594, 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.020199910, 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.044852884, 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.001871826, 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 388, 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.024014027, 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000061891 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:09.982 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 1542496, 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 192656 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 1105, 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 1336, 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 455840, 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 1012901, 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 7, 2024-09-11T22:21:09.983 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 4, 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.107031775, 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.040219342, 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.021614188, 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.033285107, 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1333, 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.058943782, 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000044218 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:09.984 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 662464 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 1, 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-MDSRank": { 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 5831, 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.157945367, 2024-09-11T22:21:09.985 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000027087 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-PurgeQueue": { 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: "mds": { 2024-09-11T22:21:09.986 INFO:teuthology.orchestra.run.smithi193.stdout: "request": 0, 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "reply": 0, 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "reply_latency": { 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_reply": 0, 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "forward": 0, 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_complete": 0, 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_keys": 0, 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_commit": 0, 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_split": 0, 2024-09-11T22:21:09.987 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_merge": 0, 2024-09-11T22:21:09.988 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes": 17, 2024-09-11T22:21:09.988 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_top": 4, 2024-09-11T22:21:09.988 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_bottom": 13, 2024-09-11T22:21:09.988 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pin_tail": 0, 2024-09-11T22:21:09.988 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pinned": 7, 2024-09-11T22:21:09.988 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_expired": 0, 2024-09-11T22:21:09.988 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_with_caps": 0, 2024-09-11T22:21:09.989 INFO:teuthology.orchestra.run.smithi193.stdout: "caps": 0, 2024-09-11T22:21:09.989 INFO:teuthology.orchestra.run.smithi193.stdout: "subtrees": 3, 2024-09-11T22:21:09.989 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse": 0, 2024-09-11T22:21:09.989 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_hit": 0, 2024-09-11T22:21:09.989 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_forward": 0, 2024-09-11T22:21:09.989 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_discover": 0, 2024-09-11T22:21:09.989 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:21:09.989 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_remote_ino": 0, 2024-09-11T22:21:09.989 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_lock": 0, 2024-09-11T22:21:09.989 INFO:teuthology.orchestra.run.smithi193.stdout: "load_cent": 0, 2024-09-11T22:21:09.990 INFO:teuthology.orchestra.run.smithi193.stdout: "q": 0, 2024-09-11T22:21:09.990 INFO:teuthology.orchestra.run.smithi193.stdout: "exported": 0, 2024-09-11T22:21:09.990 INFO:teuthology.orchestra.run.smithi193.stdout: "exported_inodes": 0, 2024-09-11T22:21:09.990 INFO:teuthology.orchestra.run.smithi193.stdout: "imported": 0, 2024-09-11T22:21:09.990 INFO:teuthology.orchestra.run.smithi193.stdout: "imported_inodes": 0, 2024-09-11T22:21:09.990 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_dir_fetch": 0, 2024-09-11T22:21:09.990 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:21:09.990 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_peer_discover": 0, 2024-09-11T22:21:09.990 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rfiles": 1026, 2024-09-11T22:21:09.990 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rbytes": 1724790867, 2024-09-11T22:21:09.990 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rsnaps": 6, 2024-09-11T22:21:09.991 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:21:09.991 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_set_tag": 0, 2024-09-11T22:21:09.991 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:21:09.991 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:21:09.991 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:21:09.991 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:21:09.991 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:21:09.991 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_file_inodes": 0, 2024-09-11T22:21:09.991 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_grant": 0, 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps": 0, 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps_dirty": 0, 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_cap_release": 0, 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: "process_request_cap_release": 0 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_cache": { 2024-09-11T22:21:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update_receipt": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_try_discover": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_send_discover": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_handle_discover": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_delayed": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_created": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_enqueued": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_reintegrated": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_migrated": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_processing": 0, 2024-09-11T22:21:09.993 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_started": 0, 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_completed": 0, 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_exportdir": 0, 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_flush": 0, 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragstats": 0, 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_inodestats": 0 2024-09-11T22:21:09.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.995 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_log": { 2024-09-11T22:21:09.995 INFO:teuthology.orchestra.run.smithi193.stdout: "evlrg": 0, 2024-09-11T22:21:09.995 INFO:teuthology.orchestra.run.smithi193.stdout: "evadd": 0, 2024-09-11T22:21:09.995 INFO:teuthology.orchestra.run.smithi193.stdout: "evex": 0, 2024-09-11T22:21:09.995 INFO:teuthology.orchestra.run.smithi193.stdout: "evtrm": 0, 2024-09-11T22:21:09.995 INFO:teuthology.orchestra.run.smithi193.stdout: "ev": 666, 2024-09-11T22:21:09.995 INFO:teuthology.orchestra.run.smithi193.stdout: "evexg": 0, 2024-09-11T22:21:09.995 INFO:teuthology.orchestra.run.smithi193.stdout: "evexd": 0, 2024-09-11T22:21:09.995 INFO:teuthology.orchestra.run.smithi193.stdout: "segadd": 0, 2024-09-11T22:21:09.995 INFO:teuthology.orchestra.run.smithi193.stdout: "segex": 0, 2024-09-11T22:21:09.995 INFO:teuthology.orchestra.run.smithi193.stdout: "segtrm": 0, 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "seg": 2, 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "segmjr": 75, 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "segexg": 0, 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "segexd": 0, 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "expos": 8471343, 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "wrpos": 8571989, 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "rdpos": 8546434, 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "jlat": { 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.996 INFO:teuthology.orchestra.run.smithi193.stdout: "replayed": 666 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_mem": { 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "ino": 15, 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "ino+": 270, 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "ino-": 255, 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "dir": 10, 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "dir+": 53, 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "dir-": 43, 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "dn": 17, 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "dn+": 271, 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "dn-": 254, 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "cap": 0, 2024-09-11T22:21:09.997 INFO:teuthology.orchestra.run.smithi193.stdout: "cap+": 0, 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: "cap-": 0, 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: "rss": 50028, 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: "heap": 215328 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_server": { 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_client_request": 0, 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_server_request": 0, 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_request": 0, 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_session": 0, 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_peer_request": 0, 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: "req_create_latency": { 2024-09-11T22:21:09.998 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getattr_latency": { 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getfilelock_latency": { 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:09.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: "req_link_latency": { 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookup_latency": { 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookuphash_latency": { 2024-09-11T22:21:10.000 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupino_latency": { 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupname_latency": { 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.001 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.002 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupparent_latency": { 2024-09-11T22:21:10.002 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.002 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.002 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.002 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupsnap_latency": { 2024-09-11T22:21:10.002 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.002 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.002 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.003 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lssnap_latency": { 2024-09-11T22:21:10.003 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.003 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.003 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.003 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mkdir_latency": { 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mknod_latency": { 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mksnap_latency": { 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.004 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: "req_open_latency": { 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: "req_readdir_latency": { 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.005 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rename_latency": { 2024-09-11T22:21:10.006 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.006 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.006 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.006 INFO:teuthology.orchestra.run.smithi193.stdout: "req_renamesnap_latency": { 2024-09-11T22:21:10.006 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.006 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.006 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.006 INFO:teuthology.orchestra.run.smithi193.stdout: "req_snapdiff_latency": { 2024-09-11T22:21:10.006 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmdir_latency": { 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmsnap_latency": { 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmxattr_latency": { 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setattr_latency": { 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setdirlayout_latency": { 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setfilelock_latency": { 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setlayout_latency": { 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.009 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setxattr_latency": { 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: "req_symlink_latency": { 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.010 INFO:teuthology.orchestra.run.smithi193.stdout: "req_unlink_latency": { 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getvxattr_latency": { 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.011 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_sessions": { 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "session_count": 2, 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "session_add": 6, 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "session_remove": 4, 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_open": 5, 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_stale": 0, 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "total_load": 0, 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "average_load": 0, 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "avg_session_uptime": 7316, 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "mdthresh_evicted": 0 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:21:10.012 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-11T22:21:10.013 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:21:10.013 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:21:10.013 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:21:10.013 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:21:10.013 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:21:10.013 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:21:10.013 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:21:10.013 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:21:10.013 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:21:10.013 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:21:10.013 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:21:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 190481, 2024-09-11T22:21:10.015 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 61, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 0, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 8384, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 184, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:21:10.016 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:21:10.017 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-11T22:21:10.017 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-11T22:21:10.017 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 90410, 2024-09-11T22:21:10.017 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 461, 2024-09-11T22:21:10.017 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-11T22:21:10.017 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-11T22:21:10.017 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-11T22:21:10.017 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-11T22:21:10.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.017 INFO:teuthology.orchestra.run.smithi193.stdout: "objecter": { 2024-09-11T22:21:10.017 INFO:teuthology.orchestra.run.smithi193.stdout: "op_active": 0, 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: "op_laggy": 0, 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send": 3517, 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send_bytes": 26, 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: "op_resend": 4, 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: "op_reply": 3517, 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: "op_latency": { 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3517, 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 5.165913906, 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001468841 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: "op_inflight": 0, 2024-09-11T22:21:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: "oplen_avg": { 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3517, 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 3518 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: "op": 3517, 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: "op_r": 3517, 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: "op_w": 0, 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: "op_rmw": 0, 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: "op_pg": 0, 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_stat": 2190, 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_create": 0, 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_read": 1324, 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_write": 0, 2024-09-11T22:21:10.020 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writefull": 0, 2024-09-11T22:21:10.020 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writesame": 0, 2024-09-11T22:21:10.020 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_append": 0, 2024-09-11T22:21:10.020 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_zero": 0, 2024-09-11T22:21:10.020 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_truncate": 0, 2024-09-11T22:21:10.020 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_delete": 0, 2024-09-11T22:21:10.020 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_mapext": 0, 2024-09-11T22:21:10.020 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_sparse_read": 0, 2024-09-11T22:21:10.020 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_clonerange": 0, 2024-09-11T22:21:10.020 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_getxattr": 2, 2024-09-11T22:21:10.021 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_setxattr": 0, 2024-09-11T22:21:10.021 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:21:10.021 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_rmxattr": 0, 2024-09-11T22:21:10.021 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:21:10.021 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_call": 0, 2024-09-11T22:21:10.021 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_watch": 0, 2024-09-11T22:21:10.021 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_notify": 0, 2024-09-11T22:21:10.021 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:21:10.021 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls": 0, 2024-09-11T22:21:10.021 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:21:10.021 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_other": 0, 2024-09-11T22:21:10.022 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_active": 0, 2024-09-11T22:21:10.022 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_send": 0, 2024-09-11T22:21:10.022 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_resend": 0, 2024-09-11T22:21:10.022 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_ping": 0, 2024-09-11T22:21:10.022 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_active": 0, 2024-09-11T22:21:10.022 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_send": 0, 2024-09-11T22:21:10.022 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_resend": 0, 2024-09-11T22:21:10.022 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_active": 0, 2024-09-11T22:21:10.022 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_send": 0, 2024-09-11T22:21:10.023 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_resend": 0, 2024-09-11T22:21:10.023 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_active": 0, 2024-09-11T22:21:10.023 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_send": 0, 2024-09-11T22:21:10.023 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_resend": 0, 2024-09-11T22:21:10.023 INFO:teuthology.orchestra.run.smithi193.stdout: "command_active": 0, 2024-09-11T22:21:10.023 INFO:teuthology.orchestra.run.smithi193.stdout: "command_send": 0, 2024-09-11T22:21:10.023 INFO:teuthology.orchestra.run.smithi193.stdout: "command_resend": 0, 2024-09-11T22:21:10.023 INFO:teuthology.orchestra.run.smithi193.stdout: "map_epoch": 106, 2024-09-11T22:21:10.023 INFO:teuthology.orchestra.run.smithi193.stdout: "map_full": 0, 2024-09-11T22:21:10.023 INFO:teuthology.orchestra.run.smithi193.stdout: "map_inc": 24, 2024-09-11T22:21:10.024 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_sessions": 5, 2024-09-11T22:21:10.024 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_open": 6, 2024-09-11T22:21:10.024 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_close": 1, 2024-09-11T22:21:10.024 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_laggy": 0, 2024-09-11T22:21:10.024 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_wr": 0, 2024-09-11T22:21:10.024 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_rd": 2, 2024-09-11T22:21:10.024 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_del": 0 2024-09-11T22:21:10.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.024 INFO:teuthology.orchestra.run.smithi193.stdout: "oft": { 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_objs": 0, 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_updates": 0, 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_removes": 0 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: "osd-slow-ops": { 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_ops_count": 0 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: "purge_queue": { 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops": 0, 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T22:21:10.025 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing": 0, 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_high_water": 0, 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed_ops": 0, 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed": 0, 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_item_in_journal": 0 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 3874, 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 6536932, 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:10.026 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 3874, 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 3874, 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 6536932, 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_bytes": { 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 3517, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 4377695, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 3517, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 4377695, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.029 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.029 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:10.029 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.029 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_ops": { 2024-09-11T22:21:10.029 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:10.029 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 1024, 2024-09-11T22:21:10.029 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:10.029 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-11T22:21:10.029 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-11T22:21:10.029 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:10.029 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 3517, 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 3517, 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 3517, 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 3517, 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:10.030 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 0, 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 0, 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.031 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.032 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.032 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:10.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:10.032 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle-0x563c48f22b40": { 2024-09-11T22:21:10.032 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:10.032 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-11T22:21:10.032 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:10.032 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-11T22:21:10.032 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-11T22:21:10.032 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:10.032 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:10.033 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-11T22:21:10.033 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-11T22:21:10.033 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 0, 2024-09-11T22:21:10.033 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 0, 2024-09-11T22:21:10.033 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:10.033 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:10.033 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:10.033 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:10.033 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:10.033 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:10.033 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-11T22:21:10.034 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:09 smithi193 ceph-mon[35545]: osdmap e106: 12 total, 12 up, 12 in 2024-09-11T22:21:10.034 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:09 smithi193 ceph-mon[35545]: pgmap v530: 97 pgs: 9 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 76 active+clean; 4.3 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 KiB/s wr, 28 op/s 2024-09-11T22:21:10.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:09 smithi152 ceph-mon[31188]: osdmap e106: 12 total, 12 up, 12 in 2024-09-11T22:21:10.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:09 smithi152 ceph-mon[31188]: pgmap v530: 97 pgs: 9 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 76 active+clean; 4.3 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 KiB/s wr, 28 op/s 2024-09-11T22:21:10.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:09 smithi179 ceph-mon[35603]: osdmap e106: 12 total, 12 up, 12 in 2024-09-11T22:21:10.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:09 smithi179 ceph-mon[35603]: pgmap v530: 97 pgs: 9 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 76 active+clean; 4.3 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 KiB/s wr, 28 op/s 2024-09-11T22:21:10.648 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-11T22:21:10.649 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-11T22:21:10.649 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-11T22:21:10.649 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-11T22:21:10.649 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-11T22:21:10.649 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-11T22:21:10.649 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T22:21:10.649 DEBUG:tasks.check_counter:Getting stats from i 2024-09-11T22:21:10.649 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-11T22:21:10.899 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:11.398 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-11T22:21:11.398 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:21:11.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 6371, 2024-09-11T22:21:11.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 4122, 2024-09-11T22:21:11.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 2707763, 2024-09-11T22:21:11.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 6550194, 2024-09-11T22:21:11.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 23, 2024-09-11T22:21:11.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 4, 2024-09-11T22:21:11.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.475210167, 2024-09-11T22:21:11.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.157107113, 2024-09-11T22:21:11.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.251055817, 2024-09-11T22:21:11.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.085442859, 2024-09-11T22:21:11.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:11.399 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 4121, 2024-09-11T22:21:11.399 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.528738824, 2024-09-11T22:21:11.399 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000128303 2024-09-11T22:21:11.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:11.399 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 8124, 2024-09-11T22:21:11.400 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.001294640, 2024-09-11T22:21:11.400 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000159 2024-09-11T22:21:11.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 570480, 2024-09-11T22:21:11.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 177872 2024-09-11T22:21:11.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.400 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:21:11.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 1386, 2024-09-11T22:21:11.400 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 1420, 2024-09-11T22:21:11.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 1826430, 2024-09-11T22:21:11.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 5620252, 2024-09-11T22:21:11.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 381, 2024-09-11T22:21:11.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 7, 2024-09-11T22:21:11.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.243658990, 2024-09-11T22:21:11.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.051844163, 2024-09-11T22:21:11.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.172984292, 2024-09-11T22:21:11.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.020729444, 2024-09-11T22:21:11.401 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:11.401 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1418, 2024-09-11T22:21:11.401 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 1.111929384, 2024-09-11T22:21:11.402 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000784153 2024-09-11T22:21:11.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.402 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:11.402 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 654, 2024-09-11T22:21:11.402 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000080173, 2024-09-11T22:21:11.402 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000122 2024-09-11T22:21:11.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.402 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 1666752, 2024-09-11T22:21:11.402 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 715424 2024-09-11T22:21:11.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.402 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 3641, 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 3563, 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 1539137, 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 2232540, 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 17, 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 6, 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.345776015, 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.105953821, 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.178408957, 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.074986290, 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:11.403 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3560, 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 1.209925542, 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000339866 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 5724, 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.001024617, 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000179 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 788416, 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 836848 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-11T22:21:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 1, 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-MDSRank": { 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2043, 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.415952629, 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000203598 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-PurgeQueue": { 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-11T22:21:11.405 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 13, 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.003139801, 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000241523 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: "mds": { 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: "request": 777, 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: "reply": 580, 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: "reply_latency": { 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 580, 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 2.369811874, 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.004085882 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.406 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_reply": 0, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "forward": 197, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_complete": 4, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_keys": 1, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_commit": 389, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_split": 1, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_merge": 0, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes": 47, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_top": 15, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_bottom": 21, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pin_tail": 11, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pinned": 20, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_expired": 254, 2024-09-11T22:21:11.407 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_with_caps": 6, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "caps": 7, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "subtrees": 4, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse": 957, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_hit": 707, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_forward": 196, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_discover": 7, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_remote_ino": 0, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_lock": 1, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "load_cent": 0, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "q": 0, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "exported": 27, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "exported_inodes": 259, 2024-09-11T22:21:11.408 INFO:teuthology.orchestra.run.smithi193.stdout: "imported": 10, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "imported_inodes": 0, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_dir_fetch": 0, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_backtrace_fetch": 263, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_peer_discover": 0, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rfiles": 1026, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rbytes": 1724790867, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rsnaps": 6, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_fetch": 263, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_set_tag": 0, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:21:11.409 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_inodes": 175, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_base_inodes": 22, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dirfrag_rstats": 153, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_file_inodes": 88, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_inode_file_caps": 5, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_revoke": 161, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_grant": 341, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps": 281, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps_dirty": 98, 2024-09-11T22:21:11.410 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_cap_release": 15, 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "process_request_cap_release": 40 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_cache": { 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update": 10, 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update_receipt": 49, 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_try_discover": 28, 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_send_discover": 28, 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_handle_discover": 36, 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays": 0, 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_delayed": 0, 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_created": 3, 2024-09-11T22:21:11.411 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_enqueued": 2, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_reintegrated": 1, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_migrated": 0, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_processing": 0, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_started": 0, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_completed": 0, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_path": 15, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_quiesce_inode": 545, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_enqueue_scrub": 22, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_exportdir": 27, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_flush": 0, 2024-09-11T22:21:11.412 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragmentdir": 1, 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragstats": 0, 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_inodestats": 0 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_log": { 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "evlrg": 0, 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "evadd": 667, 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "evex": 654, 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "evtrm": 654, 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "ev": 13, 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "evexg": 0, 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "evexd": 2, 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "segadd": 76, 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi193.stdout: "segex": 75, 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "segtrm": 75, 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "seg": 1, 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "segmjr": 1, 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "segexg": 0, 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "segexd": 1, 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "expos": 8471343, 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "wrpos": 8572101, 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "rdpos": 0, 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "jlat": { 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 361, 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 1.752350478, 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.004854156 2024-09-11T22:21:11.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "replayed": 0 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_mem": { 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "ino": 51, 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "ino+": 305, 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "ino-": 254, 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "dir": 108, 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "dir+": 124, 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "dir-": 16, 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "dn": 47, 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "dn+": 304, 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "dn-": 257, 2024-09-11T22:21:11.415 INFO:teuthology.orchestra.run.smithi193.stdout: "cap": 7, 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi193.stdout: "cap+": 294, 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi193.stdout: "cap-": 287, 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi193.stdout: "rss": 59496, 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi193.stdout: "heap": 231712 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_server": { 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_client_request": 858, 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_server_request": 4, 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_request": 777, 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_session": 50, 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_peer_request": 8, 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: "req_create_latency": { 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 224, 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.244784133, 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001092786 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getattr_latency": { 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 183, 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 1.797030056, 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.009819836 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getfilelock_latency": { 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: "req_link_latency": { 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1, 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000818137, 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000818137 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookup_latency": { 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 36, 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.009942135, 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000276170 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookuphash_latency": { 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupino_latency": { 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2, 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000352109, 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000176054 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupname_latency": { 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupparent_latency": { 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupsnap_latency": { 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.421 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lssnap_latency": { 2024-09-11T22:21:11.421 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 17, 2024-09-11T22:21:11.421 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.002487992, 2024-09-11T22:21:11.421 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000146352 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mkdir_latency": { 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 31, 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.036050984, 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001162934 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mknod_latency": { 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mksnap_latency": { 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 17, 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.114306711, 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.006723924 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: "req_open_latency": { 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 41, 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.007035350, 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000171593 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: "req_readdir_latency": { 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2, 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000894285, 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000447142 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rename_latency": { 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3, 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.081249385, 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.027083128 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: "req_renamesnap_latency": { 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi193.stdout: "req_snapdiff_latency": { 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmdir_latency": { 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmsnap_latency": { 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 11, 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.050127903, 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.004557082 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmxattr_latency": { 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setattr_latency": { 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1, 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.001159121, 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001159121 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setdirlayout_latency": { 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setfilelock_latency": { 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setlayout_latency": { 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.427 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setxattr_latency": { 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 8, 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.020087260, 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.002510907 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: "req_symlink_latency": { 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.428 INFO:teuthology.orchestra.run.smithi193.stdout: "req_unlink_latency": { 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3, 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.003486313, 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001162104 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getvxattr_latency": { 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:11.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_sessions": { 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "session_count": 2, 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "session_add": 6, 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "session_remove": 4, 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_open": 2, 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_stale": 0, 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "total_load": 35, 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "average_load": 17, 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "avg_session_uptime": 990, 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "mdthresh_evicted": 0 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-11T22:21:11.430 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 311923, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 135, 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 0, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 8384, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 184, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 343509, 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 2439, 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: "objecter": { 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: "op_active": 0, 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: "op_laggy": 0, 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send": 2002, 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send_bytes": 5925827, 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi193.stdout: "op_resend": 37, 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi193.stdout: "op_reply": 2002, 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi193.stdout: "op_latency": { 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2002, 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 22.345627285, 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.011161651 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi193.stdout: "op_inflight": 0, 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "oplen_avg": { 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2002, 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 2853 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "op": 2002, 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "op_r": 313, 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "op_w": 1689, 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "op_rmw": 0, 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "op_pg": 0, 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_stat": 360, 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_create": 26, 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_read": 23, 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_write": 362, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writefull": 258, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writesame": 0, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_append": 0, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_zero": 0, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_truncate": 1, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_delete": 516, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_mapext": 0, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_sparse_read": 0, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_clonerange": 0, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_getxattr": 290, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_setxattr": 52, 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_rmxattr": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_call": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_watch": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_notify": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_other": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_active": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_send": 0, 2024-09-11T22:21:11.439 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_resend": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_ping": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_active": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_send": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_resend": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_active": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_send": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_resend": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_active": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_send": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_resend": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "command_active": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "command_send": 0, 2024-09-11T22:21:11.440 INFO:teuthology.orchestra.run.smithi193.stdout: "command_resend": 0, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "map_epoch": 106, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "map_full": 0, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "map_inc": 24, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_sessions": 12, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_open": 12, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_close": 0, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_laggy": 0, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_wr": 932, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_rd": 10, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_del": 23 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "oft": { 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_objs": 1, 2024-09-11T22:21:11.441 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_updates": 0, 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_removes": 0 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: "osd-slow-ops": { 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_ops_count": 522 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: "purge_queue": { 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops": 0, 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops_high_water": 2, 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing": 0, 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_high_water": 2, 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed_ops": 2, 2024-09-11T22:21:11.442 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed": 2, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_item_in_journal": 0 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 11394, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 4862136, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 11394, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 11394, 2024-09-11T22:21:11.443 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 4862136, 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_bytes": { 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:11.444 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 2002, 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 5925961, 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 2002, 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 5925961, 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_ops": { 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:11.445 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 1024, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 2002, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 2002, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 2002, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 2002, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.446 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 2, 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 202, 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 2, 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 1, 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 202, 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle-0x560e712ae960": { 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 112, 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:11.448 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 667, 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 4377797, 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 667, 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 361, 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 4377685, 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-11T22:21:12.021 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:11 smithi193 ceph-mon[35545]: pgmap v531: 97 pgs: 9 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 76 active+clean; 4.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 KiB/s wr, 28 op/s 2024-09-11T22:21:12.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:11 smithi179 ceph-mon[35603]: pgmap v531: 97 pgs: 9 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 76 active+clean; 4.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 KiB/s wr, 28 op/s 2024-09-11T22:21:12.048 INFO:tasks.check_counter:Daemon mds.i mds.exported=27 2024-09-11T22:21:12.048 INFO:tasks.check_counter:Daemon mds.i mds.imported=10 2024-09-11T22:21:12.048 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=10 2024-09-11T22:21:12.049 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=49 2024-09-11T22:21:12.049 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-11T22:21:12.049 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=17 2024-09-11T22:21:12.049 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=11 2024-09-11T22:21:12.049 DEBUG:tasks.check_counter:Getting stats from l 2024-09-11T22:21:12.049 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-11T22:21:12.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:11 smithi152 ceph-mon[31188]: pgmap v531: 97 pgs: 9 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 76 active+clean; 4.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 KiB/s wr, 28 op/s 2024-09-11T22:21:12.301 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:12.807 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-11T22:21:12.807 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:21:12.807 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 0, 2024-09-11T22:21:12.807 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 2, 2024-09-11T22:21:12.807 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 0, 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 4, 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 0, 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.001285234, 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.000247901, 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:12.808 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 3, 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 236, 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 480, 2024-09-11T22:21:12.809 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 277840, 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 6, 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 3, 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.013610334, 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.009343460, 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.001619899, 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 233, 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.019611032, 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000084167 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:12.810 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 277840 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 322, 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 310, 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 1473984, 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 190448, 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 2, 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 1, 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.050193650, 2024-09-11T22:21:12.811 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.018037006, 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.046498090, 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 310, 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.019240788, 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000062067 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:12.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 1473984, 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 190448 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 0, 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:21:12.813 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-11T22:21:12.814 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-11T22:21:12.815 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 148704, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 29, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 0, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-11T22:21:12.816 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 0, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 0, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 928, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 2, 2024-09-11T22:21:12.817 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 321, 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 1426067, 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 321, 2024-09-11T22:21:12.818 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-11T22:21:12.819 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-11T22:21:12.819 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 321, 2024-09-11T22:21:12.819 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 1426067, 2024-09-11T22:21:12.819 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-11T22:21:12.819 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-11T22:21:12.819 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-11T22:21:12.820 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-11T22:21:12.820 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:12.820 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-11T22:21:12.820 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-11T22:21:13.579 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-11T22:21:13.579 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-11T22:21:13.579 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-11T22:21:13.579 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-11T22:21:13.579 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-11T22:21:13.579 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-11T22:21:13.579 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-11T22:21:13.580 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-11T22:21:13.590 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-11T22:21:13.591 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T22:21:13.591 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:21:13.608 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-11T22:21:13.608 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:21:13.665 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T22:21:13.952 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:13.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:13 smithi152 ceph-mon[31188]: pgmap v532: 97 pgs: 9 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 76 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 KiB/s wr, 28 op/s 2024-09-11T22:21:14.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:13 smithi179 ceph-mon[35603]: pgmap v532: 97 pgs: 9 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 76 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 KiB/s wr, 28 op/s 2024-09-11T22:21:14.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:13 smithi193 ceph-mon[35545]: pgmap v532: 97 pgs: 9 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 76 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 KiB/s wr, 28 op/s 2024-09-11T22:21:14.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.494+0000 7f003967e640 1 -- 172.21.15.152:0/992843458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0034074e30 msgr2=0x7f003410df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:14.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.494+0000 7f003967e640 1 --2- 172.21.15.152:0/992843458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0034074e30 0x7f003410df10 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f001c009900 tx=0x7f001c02a480 comp rx=0 tx=0).stop 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 -- 172.21.15.152:0/992843458 shutdown_connections 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 --2- 172.21.15.152:0/992843458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f003410e450 0x7f0034110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 --2- 172.21.15.152:0/992843458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0034074e30 0x7f003410df10 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 --2- 172.21.15.152:0/992843458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0034074510 0x7f00340748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 -- 172.21.15.152:0/992843458 >> 172.21.15.152:0/992843458 conn(0x7f00340fd8f0 msgr2=0x7f00340ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 -- 172.21.15.152:0/992843458 shutdown_connections 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 -- 172.21.15.152:0/992843458 wait complete. 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 Processor -- start 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 -- start start 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034074510 0x7f003419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0034074e30 0x7f003419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:14.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003410e450 0x7f003419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:14.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0034114150 con 0x7f003410e450 2024-09-11T22:21:14.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0034113fd0 con 0x7f0034074e30 2024-09-11T22:21:14.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.495+0000 7f003967e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f00341142d0 con 0x7f0034074510 2024-09-11T22:21:14.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f00337fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003410e450 0x7f003419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:14.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f0032ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034074510 0x7f003419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:14.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f00337fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003410e450 0x7f003419efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50854/0 (socket says 172.21.15.152:50854) 2024-09-11T22:21:14.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f00337fe640 1 -- 172.21.15.152:0/318797721 learned_addr learned my addr 172.21.15.152:0/318797721 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:21:14.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f002bfff640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0034074e30 0x7f003419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:14.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f0032ffd640 1 -- 172.21.15.152:0/318797721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0034074e30 msgr2=0x7f003419ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:14.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f0032ffd640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0034074e30 0x7f003419ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f0032ffd640 1 -- 172.21.15.152:0/318797721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003410e450 msgr2=0x7f003419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f0032ffd640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003410e450 0x7f003419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f0032ffd640 1 -- 172.21.15.152:0/318797721 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003419f680 con 0x7f0034074510 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f002bfff640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0034074e30 0x7f003419ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f00337fe640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003410e450 0x7f003419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f0032ffd640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034074510 0x7f003419a6d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f002400e9f0 tx=0x7f002400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f0030ff9640 1 -- 172.21.15.152:0/318797721 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002400ccc0 con 0x7f0034074510 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f003967e640 1 -- 172.21.15.152:0/318797721 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003419f970 con 0x7f0034074510 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f0030ff9640 1 -- 172.21.15.152:0/318797721 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0024010910 con 0x7f0034074510 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f0030ff9640 1 -- 172.21.15.152:0/318797721 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024018960 con 0x7f0034074510 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.496+0000 7f003967e640 1 -- 172.21.15.152:0/318797721 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00341a7250 con 0x7f0034074510 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.498+0000 7f003967e640 1 -- 172.21.15.152:0/318797721 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00340748f0 con 0x7f0034074510 2024-09-11T22:21:14.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.499+0000 7f0030ff9640 1 -- 172.21.15.152:0/318797721 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0024010ac0 con 0x7f0034074510 2024-09-11T22:21:14.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.499+0000 7f0030ff9640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00200a2cf0 0x7f00200a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:14.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.499+0000 7f0030ff9640 1 -- 172.21.15.152:0/318797721 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8658+0+0 (secure 0 0 0) 0x7f00240cf870 con 0x7f0034074510 2024-09-11T22:21:14.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.499+0000 7f002bfff640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00200a2cf0 0x7f00200a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:14.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.500+0000 7f002bfff640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00200a2cf0 0x7f00200a51b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f001c009230 tx=0x7f001c0058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:14.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.504+0000 7f0030ff9640 1 -- 172.21.15.152:0/318797721 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f002409bdb0 con 0x7f0034074510 2024-09-11T22:21:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.700+0000 7f003967e640 1 -- 172.21.15.152:0/318797721 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f00341095d0 con 0x7f0034074510 2024-09-11T22:21:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.701+0000 7f0030ff9640 1 -- 172.21.15.152:0/318797721 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v106) ==== 81+0+1019 (secure 0 0 0) 0x7f00240a00b0 con 0x7f0034074510 2024-09-11T22:21:14.702 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2394077400 2024-09-12T22:04:17.346534+0000 2024-09-11T22:21:14.702 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1809855628 2024-09-12T22:04:17.346534+0000 2024-09-11T22:21:14.702 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/3828412393 2024-09-12T22:04:17.346534+0000 2024-09-11T22:21:14.702 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1558176271 2024-09-12T21:55:30.179334+0000 2024-09-11T22:21:14.702 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/1144560416 2024-09-12T21:55:54.195284+0000 2024-09-11T22:21:14.702 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/3828412393 2024-09-12T22:04:17.346534+0000 2024-09-11T22:21:14.702 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/1349026414 2024-09-12T21:55:30.179334+0000 2024-09-11T22:21:14.702 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2661528324 2024-09-12T22:04:17.346534+0000 2024-09-11T22:21:14.702 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/321546578 2024-09-12T22:04:17.346534+0000 2024-09-11T22:21:14.702 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/1349026414 2024-09-12T21:55:30.179334+0000 2024-09-11T22:21:14.703 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/567593116 2024-09-12T21:55:30.179334+0000 2024-09-11T22:21:14.703 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1096456467 2024-09-12T22:04:17.346534+0000 2024-09-11T22:21:14.703 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/4115778297 2024-09-12T21:55:30.179334+0000 2024-09-11T22:21:14.703 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/3392108712 2024-09-12T21:55:54.195284+0000 2024-09-11T22:21:14.703 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/1144560416 2024-09-12T21:55:54.195284+0000 2024-09-11T22:21:14.703 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/3449685640 2024-09-12T21:55:54.195284+0000 2024-09-11T22:21:14.703 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2046084258 2024-09-12T21:55:54.195284+0000 2024-09-11T22:21:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:listed 17 entries 2024-09-11T22:21:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 -- 172.21.15.152:0/318797721 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00200a2cf0 msgr2=0x7f00200a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00200a2cf0 0x7f00200a51b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f001c009230 tx=0x7f001c0058d0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 -- 172.21.15.152:0/318797721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034074510 msgr2=0x7f003419a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034074510 0x7f003419a6d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f002400e9f0 tx=0x7f002400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 -- 172.21.15.152:0/318797721 shutdown_connections 2024-09-11T22:21:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f00200a2cf0 0x7f00200a51b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003410e450 0x7f003419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0034074e30 0x7f003419ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 --2- 172.21.15.152:0/318797721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034074510 0x7f003419a6d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 -- 172.21.15.152:0/318797721 >> 172.21.15.152:0/318797721 conn(0x7f00340fd8f0 msgr2=0x7f00340ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 -- 172.21.15.152:0/318797721 shutdown_connections 2024-09-11T22:21:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:14.703+0000 7f003967e640 1 -- 172.21.15.152:0/318797721 wait complete. 2024-09-11T22:21:14.979 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:14 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/318797721' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:21:15.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:14 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/318797721' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:21:15.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:14 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/318797721' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:21:15.434 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:21:15.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:15.435 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /tmp/cephfs 2024-09-11T22:21:15.593 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T22:21:15.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:15.594 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-11T22:21:15.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:15.643 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-09-11T22:21:15.690 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-11T22:21:15.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:15.691 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-11T22:21:15.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:15.801 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-09-11T22:21:15.908 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-11T22:21:15.920 INFO:tasks.cephadm:Teardown begin 2024-09-11T22:21:15.921 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:21:15.921 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:21:16.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:15 smithi179 ceph-mon[35603]: pgmap v533: 97 pgs: 97 active+clean; 3.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-11T22:21:16.076 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:15 smithi193 ceph-mon[35545]: pgmap v533: 97 pgs: 97 active+clean; 3.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-11T22:21:16.230 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:15 smithi152 ceph-mon[31188]: pgmap v533: 97 pgs: 97 active+clean; 3.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-11T22:21:16.238 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.725+0000 7f17caedf640 1 -- 172.21.15.152:0/522636983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17c4102570 msgr2=0x7f17c41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.725+0000 7f17caedf640 1 --2- 172.21.15.152:0/522636983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17c4102570 0x7f17c41029b0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009ca0 tx=0x7f17b802a950 comp rx=0 tx=0).stop 2024-09-11T22:21:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.725+0000 7f17caedf640 1 -- 172.21.15.152:0/522636983 shutdown_connections 2024-09-11T22:21:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.725+0000 7f17caedf640 1 --2- 172.21.15.152:0/522636983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17c4102ef0 0x7f17c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.725+0000 7f17caedf640 1 --2- 172.21.15.152:0/522636983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17c4102570 0x7f17c41029b0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.725+0000 7f17caedf640 1 --2- 172.21.15.152:0/522636983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17c4100e20 0x7f17c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.725+0000 7f17caedf640 1 -- 172.21.15.152:0/522636983 >> 172.21.15.152:0/522636983 conn(0x7f17c40fc7d0 msgr2=0x7f17c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.725+0000 7f17caedf640 1 -- 172.21.15.152:0/522636983 shutdown_connections 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.725+0000 7f17caedf640 1 -- 172.21.15.152:0/522636983 wait complete. 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.725+0000 7f17caedf640 1 Processor -- start 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.725+0000 7f17caedf640 1 -- start start 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17caedf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17c4100e20 0x7f17c41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17caedf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17c4102570 0x7f17c4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17caedf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17c4102ef0 0x7f17c419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17caedf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4110f80 con 0x7f17c4102ef0 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17caedf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4110e00 con 0x7f17c4102570 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17caedf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4111100 con 0x7f17c4100e20 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17c947c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17c4102ef0 0x7f17c419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17c947c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17c4102ef0 0x7f17c419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50880/0 (socket says 172.21.15.152:50880) 2024-09-11T22:21:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17c947c640 1 -- 172.21.15.152:0/3000299165 learned_addr learned my addr 172.21.15.152:0/3000299165 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:21:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17c8c7b640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17c4100e20 0x7f17c41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17c3fff640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17c4102570 0x7f17c4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17c947c640 1 -- 172.21.15.152:0/3000299165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17c4100e20 msgr2=0x7f17c41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17c947c640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17c4100e20 0x7f17c41984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17c947c640 1 -- 172.21.15.152:0/3000299165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17c4102570 msgr2=0x7f17c4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17c947c640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17c4102570 0x7f17c4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17c947c640 1 -- 172.21.15.152:0/3000299165 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c419d480 con 0x7f17c4102ef0 2024-09-11T22:21:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.726+0000 7f17c947c640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17c4102ef0 0x7f17c419cda0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00e970 tx=0x7f17bc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.727+0000 7f17c1ffb640 1 -- 172.21.15.152:0/3000299165 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00ccc0 con 0x7f17c4102ef0 2024-09-11T22:21:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.727+0000 7f17c1ffb640 1 -- 172.21.15.152:0/3000299165 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17bc00ce60 con 0x7f17c4102ef0 2024-09-11T22:21:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.727+0000 7f17caedf640 1 -- 172.21.15.152:0/3000299165 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c419d770 con 0x7f17c4102ef0 2024-09-11T22:21:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.727+0000 7f17c1ffb640 1 -- 172.21.15.152:0/3000299165 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc010490 con 0x7f17c4102ef0 2024-09-11T22:21:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.727+0000 7f17caedf640 1 -- 172.21.15.152:0/3000299165 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c41a5050 con 0x7f17c4102ef0 2024-09-11T22:21:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.728+0000 7f17caedf640 1 -- 172.21.15.152:0/3000299165 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c4101200 con 0x7f17c4102ef0 2024-09-11T22:21:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.729+0000 7f17c1ffb640 1 -- 172.21.15.152:0/3000299165 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f17bc005020 con 0x7f17c4102ef0 2024-09-11T22:21:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.730+0000 7f17c1ffb640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f17ac0a2cf0 0x7f17ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.730+0000 7f17c8c7b640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f17ac0a2cf0 0x7f17ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.730+0000 7f17c1ffb640 1 -- 172.21.15.152:0/3000299165 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8658+0+0 (secure 0 0 0) 0x7f17bc0cf930 con 0x7f17c4102ef0 2024-09-11T22:21:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.730+0000 7f17c8c7b640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f17ac0a2cf0 0x7f17ac0a51b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f17b4005fd0 tx=0x7f17b400b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.734+0000 7f17c1ffb640 1 -- 172.21.15.152:0/3000299165 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17bc09c4c0 con 0x7f17c4102ef0 2024-09-11T22:21:16.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.934+0000 7f17caedf640 1 -- 172.21.15.152:0/3000299165 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17c410a0a0 con 0x7f17c4102ef0 2024-09-11T22:21:16.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.934+0000 7f17c1ffb640 1 -- 172.21.15.152:0/3000299165 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11926 (secure 0 0 0) 0x7f17bc09bdc0 con 0x7f17c4102ef0 2024-09-11T22:21:16.935 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:21:16.935 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":32,"btime":"2024-09-11T22:20:59:137412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:20:59.087273+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:21:16.936 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 32 2024-09-11T22:21:16.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 -- 172.21.15.152:0/3000299165 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f17ac0a2cf0 msgr2=0x7f17ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:16.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f17ac0a2cf0 0x7f17ac0a51b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f17b4005fd0 tx=0x7f17b400b390 comp rx=0 tx=0).stop 2024-09-11T22:21:16.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 -- 172.21.15.152:0/3000299165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17c4102ef0 msgr2=0x7f17c419cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:16.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17c4102ef0 0x7f17c419cda0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00e970 tx=0x7f17bc00ed70 comp rx=0 tx=0).stop 2024-09-11T22:21:16.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 -- 172.21.15.152:0/3000299165 shutdown_connections 2024-09-11T22:21:16.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f17ac0a2cf0 0x7f17ac0a51b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17c4102ef0 0x7f17c419cda0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17c4102570 0x7f17c4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 --2- 172.21.15.152:0/3000299165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17c4100e20 0x7f17c41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 -- 172.21.15.152:0/3000299165 >> 172.21.15.152:0/3000299165 conn(0x7f17c40fc7d0 msgr2=0x7f17c406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:16.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 -- 172.21.15.152:0/3000299165 shutdown_connections 2024-09-11T22:21:16.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:16.937+0000 7f17caedf640 1 -- 172.21.15.152:0/3000299165 wait complete. 2024-09-11T22:21:17.229 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:16 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3000299165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:21:17.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:16 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3000299165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:21:17.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:16 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3000299165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:21:17.669 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:21:17.928 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:18.293 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:17 smithi152 ceph-mon[31188]: pgmap v534: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-11T22:21:18.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:17 smithi179 ceph-mon[35603]: pgmap v534: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-11T22:21:18.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:17 smithi193 ceph-mon[35545]: pgmap v534: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-11T22:21:18.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.372+0000 7f806b724640 1 -- 172.21.15.152:0/1304484069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064102ef0 msgr2=0x7f806410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.372+0000 7f806b724640 1 --2- 172.21.15.152:0/1304484069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064102ef0 0x7f806410da40 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f805c009ca0 tx=0x7f805c02a950 comp rx=0 tx=0).stop 2024-09-11T22:21:18.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.372+0000 7f806b724640 1 -- 172.21.15.152:0/1304484069 shutdown_connections 2024-09-11T22:21:18.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.372+0000 7f806b724640 1 --2- 172.21.15.152:0/1304484069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064102ef0 0x7f806410da40 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.372+0000 7f806b724640 1 --2- 172.21.15.152:0/1304484069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8064102570 0x7f80641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.372+0000 7f806b724640 1 --2- 172.21.15.152:0/1304484069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8064100e20 0x7f8064101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.372+0000 7f806b724640 1 -- 172.21.15.152:0/1304484069 >> 172.21.15.152:0/1304484069 conn(0x7f80640fc7d0 msgr2=0x7f80640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:18.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.372+0000 7f806b724640 1 -- 172.21.15.152:0/1304484069 shutdown_connections 2024-09-11T22:21:18.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.372+0000 7f806b724640 1 -- 172.21.15.152:0/1304484069 wait complete. 2024-09-11T22:21:18.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.372+0000 7f806b724640 1 Processor -- start 2024-09-11T22:21:18.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.372+0000 7f806b724640 1 -- start start 2024-09-11T22:21:18.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f806b724640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8064100e20 0x7f80640fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:18.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f806b724640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064102570 0x7f80640fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f806b724640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8064102ef0 0x7f80640fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f806b724640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8064110fa0 con 0x7f8064102570 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f806b724640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8064110e20 con 0x7f8064100e20 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f806b724640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8064111120 con 0x7f8064102ef0 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f8068cbf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064102570 0x7f80640fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f8068cbf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064102570 0x7f80640fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50892/0 (socket says 172.21.15.152:50892) 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f8068cbf640 1 -- 172.21.15.152:0/3696680549 learned_addr learned my addr 172.21.15.152:0/3696680549 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f80694c0640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8064100e20 0x7f80640fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f8069cc1640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8064102ef0 0x7f80640fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f8068cbf640 1 -- 172.21.15.152:0/3696680549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8064102ef0 msgr2=0x7f80640fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f8068cbf640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8064102ef0 0x7f80640fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f8068cbf640 1 -- 172.21.15.152:0/3696680549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8064100e20 msgr2=0x7f80640fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f8068cbf640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8064100e20 0x7f80640fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f8068cbf640 1 -- 172.21.15.152:0/3696680549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80641a6910 con 0x7f8064102570 2024-09-11T22:21:18.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f8068cbf640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064102570 0x7f80640fd1c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f805400b4a0 tx=0x7f805400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:18.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f805a7fc640 1 -- 172.21.15.152:0/3696680549 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8054015020 con 0x7f8064102570 2024-09-11T22:21:18.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f806b724640 1 -- 172.21.15.152:0/3696680549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80641a6c00 con 0x7f8064102570 2024-09-11T22:21:18.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f805a7fc640 1 -- 172.21.15.152:0/3696680549 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8054011d10 con 0x7f8064102570 2024-09-11T22:21:18.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f805a7fc640 1 -- 172.21.15.152:0/3696680549 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805400f2e0 con 0x7f8064102570 2024-09-11T22:21:18.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.373+0000 7f806b724640 1 -- 172.21.15.152:0/3696680549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80641a7140 con 0x7f8064102570 2024-09-11T22:21:18.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.374+0000 7f806b724640 1 -- 172.21.15.152:0/3696680549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8064101200 con 0x7f8064102570 2024-09-11T22:21:18.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.376+0000 7f805a7fc640 1 -- 172.21.15.152:0/3696680549 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8054018020 con 0x7f8064102570 2024-09-11T22:21:18.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.376+0000 7f805a7fc640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f80500a2cf0 0x7f80500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:18.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.376+0000 7f80694c0640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f80500a2cf0 0x7f80500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:18.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.376+0000 7f805a7fc640 1 -- 172.21.15.152:0/3696680549 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8658+0+0 (secure 0 0 0) 0x7f80540cf260 con 0x7f8064102570 2024-09-11T22:21:18.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.377+0000 7f80694c0640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f80500a2cf0 0x7f80500a51b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f806000abe0 tx=0x7f806000a2d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:18.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.380+0000 7f805a7fc640 1 -- 172.21.15.152:0/3696680549 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f805401f020 con 0x7f8064102570 2024-09-11T22:21:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.580+0000 7f806b724640 1 -- 172.21.15.152:0/3696680549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f806410a0a0 con 0x7f8064102570 2024-09-11T22:21:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.581+0000 7f805a7fc640 1 -- 172.21.15.152:0/3696680549 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11926 (secure 0 0 0) 0x7f805409bf00 con 0x7f8064102570 2024-09-11T22:21:18.582 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:21:18.582 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":32,"btime":"2024-09-11T22:20:59:137412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1074313081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1074313081},{"type":"v1","addr":"172.21.15.152:6835","nonce":1074313081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1959199383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1959199383},{"type":"v1","addr":"172.21.15.152:6837","nonce":1959199383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/2282340650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":2282340650},{"type":"v1","addr":"172.21.15.152:6839","nonce":2282340650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6841/1149066093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6840","nonce":1149066093},{"type":"v1","addr":"172.21.15.152:6841","nonce":1149066093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2338711359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2338711359},{"type":"v1","addr":"172.21.15.179:6833","nonce":2338711359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1533120685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1533120685},{"type":"v1","addr":"172.21.15.193:6833","nonce":1533120685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:02:36.537273+0000","modified":"2024-09-11T22:20:59.087273+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24472,"mds_1":24470,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/161011948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":161011948},{"type":"v1","addr":"172.21.15.179:6835","nonce":161011948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/4020116810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4020116810},{"type":"v1","addr":"172.21.15.179:6837","nonce":4020116810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/714804093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":714804093},{"type":"v1","addr":"172.21.15.193:6835","nonce":714804093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.193:6837/3273726370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":3273726370},{"type":"v1","addr":"172.21.15.193:6837","nonce":3273726370}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/7269368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":7269368},{"type":"v1","addr":"172.21.15.179:6839","nonce":7269368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/1925980452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":1925980452},{"type":"v1","addr":"172.21.15.193:6839","nonce":1925980452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24470,24457]},"id":1}]} 2024-09-11T22:21:18.582 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 32 2024-09-11T22:21:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 -- 172.21.15.152:0/3696680549 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f80500a2cf0 msgr2=0x7f80500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f80500a2cf0 0x7f80500a51b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f806000abe0 tx=0x7f806000a2d0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 -- 172.21.15.152:0/3696680549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064102570 msgr2=0x7f80640fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064102570 0x7f80640fd1c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f805400b4a0 tx=0x7f805400b8a0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 -- 172.21.15.152:0/3696680549 shutdown_connections 2024-09-11T22:21:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f80500a2cf0 0x7f80500a51b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8064102ef0 0x7f80640fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064102570 0x7f80640fd1c0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 --2- 172.21.15.152:0/3696680549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8064100e20 0x7f80640fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 -- 172.21.15.152:0/3696680549 >> 172.21.15.152:0/3696680549 conn(0x7f80640fc7d0 msgr2=0x7f806406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 -- 172.21.15.152:0/3696680549 shutdown_connections 2024-09-11T22:21:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:18.583+0000 7f806b724640 1 -- 172.21.15.152:0/3696680549 wait complete. 2024-09-11T22:21:19.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:18 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3696680549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:21:19.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:18 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3696680549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:21:19.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:18 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3696680549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:21:19.621 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:21:19.873 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:20.286 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:20 smithi152 ceph-mon[31188]: osdmap e107: 12 total, 12 up, 12 in 2024-09-11T22:21:20.286 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:20 smithi152 ceph-mon[31188]: pgmap v536: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-09-11T22:21:20.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.366+0000 7f69cf8f5640 1 -- 172.21.15.152:0/590899835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c8101420 msgr2=0x7f69c810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:20.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.366+0000 7f69cf8f5640 1 --2- 172.21.15.152:0/590899835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c8101420 0x7f69c810d950 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009cd0 tx=0x7f69c002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.366+0000 7f69cf8f5640 1 -- 172.21.15.152:0/590899835 shutdown_connections 2024-09-11T22:21:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.366+0000 7f69cf8f5640 1 --2- 172.21.15.152:0/590899835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c8101420 0x7f69c810d950 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.366+0000 7f69cf8f5640 1 --2- 172.21.15.152:0/590899835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69c8100a80 0x7f69c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.366+0000 7f69cf8f5640 1 --2- 172.21.15.152:0/590899835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69c8106a80 0x7f69c8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.366+0000 7f69cf8f5640 1 -- 172.21.15.152:0/590899835 >> 172.21.15.152:0/590899835 conn(0x7f69c80fc7a0 msgr2=0x7f69c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:20.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.366+0000 7f69cf8f5640 1 -- 172.21.15.152:0/590899835 shutdown_connections 2024-09-11T22:21:20.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.366+0000 7f69cf8f5640 1 -- 172.21.15.152:0/590899835 wait complete. 2024-09-11T22:21:20.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cf8f5640 1 Processor -- start 2024-09-11T22:21:20.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cf8f5640 1 -- start start 2024-09-11T22:21:20.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cf8f5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69c8100a80 0x7f69c8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:20.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cf8f5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69c8101420 0x7f69c8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:20.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cf8f5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c8106a80 0x7f69c819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:20.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cf8f5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f69c8110e80 con 0x7f69c8106a80 2024-09-11T22:21:20.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cf8f5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f69c8110d00 con 0x7f69c8100a80 2024-09-11T22:21:20.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cf8f5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69c8111000 con 0x7f69c8101420 2024-09-11T22:21:20.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cde92640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c8106a80 0x7f69c819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cde92640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c8106a80 0x7f69c819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50910/0 (socket says 172.21.15.152:50910) 2024-09-11T22:21:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cde92640 1 -- 172.21.15.152:0/2979199309 learned_addr learned my addr 172.21.15.152:0/2979199309 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:21:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cd691640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69c8100a80 0x7f69c8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.367+0000 7f69cce90640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69c8101420 0x7f69c8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.368+0000 7f69cde92640 1 -- 172.21.15.152:0/2979199309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69c8101420 msgr2=0x7f69c8198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.368+0000 7f69cde92640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69c8101420 0x7f69c8198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.368+0000 7f69cde92640 1 -- 172.21.15.152:0/2979199309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69c8100a80 msgr2=0x7f69c8198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.368+0000 7f69cde92640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69c8100a80 0x7f69c8198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.368+0000 7f69cde92640 1 -- 172.21.15.152:0/2979199309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c819d3e0 con 0x7f69c8106a80 2024-09-11T22:21:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.368+0000 7f69cde92640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c8106a80 0x7f69c819cd00 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f69c0005cc0 tx=0x7f69c0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.368+0000 7f69be7fc640 1 -- 172.21.15.152:0/2979199309 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c0004040 con 0x7f69c8106a80 2024-09-11T22:21:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.368+0000 7f69cf8f5640 1 -- 172.21.15.152:0/2979199309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c819d670 con 0x7f69c8106a80 2024-09-11T22:21:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.368+0000 7f69be7fc640 1 -- 172.21.15.152:0/2979199309 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69c00046c0 con 0x7f69c8106a80 2024-09-11T22:21:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.368+0000 7f69be7fc640 1 -- 172.21.15.152:0/2979199309 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c0046480 con 0x7f69c8106a80 2024-09-11T22:21:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.368+0000 7f69cf8f5640 1 -- 172.21.15.152:0/2979199309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c81a4fb0 con 0x7f69c8106a80 2024-09-11T22:21:20.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.369+0000 7f69cf8f5640 1 -- 172.21.15.152:0/2979199309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c8100ee0 con 0x7f69c8106a80 2024-09-11T22:21:20.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.371+0000 7f69be7fc640 1 -- 172.21.15.152:0/2979199309 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f69c00305a0 con 0x7f69c8106a80 2024-09-11T22:21:20.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.371+0000 7f69be7fc640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69b40a2cf0 0x7f69b40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:20.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.372+0000 7f69cd691640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69b40a2cf0 0x7f69b40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:20.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.372+0000 7f69be7fc640 1 -- 172.21.15.152:0/2979199309 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8614+0+0 (secure 0 0 0) 0x7f69c002e030 con 0x7f69c8106a80 2024-09-11T22:21:20.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.372+0000 7f69cd691640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69b40a2cf0 0x7f69b40a51b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f69c400bb60 tx=0x7f69c400b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:20.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.375+0000 7f69be7fc640 1 -- 172.21.15.152:0/2979199309 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69c004b060 con 0x7f69c8106a80 2024-09-11T22:21:20.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.540+0000 7f69cf8f5640 1 -- 172.21.15.152:0/2979199309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69c81a5210 con 0x7f69c8106a80 2024-09-11T22:21:20.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.541+0000 7f69be7fc640 1 -- 172.21.15.152:0/2979199309 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+23360 (secure 0 0 0) 0x7f69c00bda60 con 0x7f69c8106a80 2024-09-11T22:21:20.542 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-11T22:21:20.543 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":107,"fsid":"5c140ed8-7088-11ef-bcea-c7b262605968","created":"2024-09-11T21:55:03.865078+0000","modified":"2024-09-11T22:21:19.135807+0000","last_up_change":"2024-09-11T22:01:49.898612+0000","last_in_change":"2024-09-11T22:01:26.470032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T21:58:10.500177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:02:33.014997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:02:34.841069+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":29,"snap_epoch":106,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90c6f283-df62-405d-921a-5a8144b114f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6803","nonce":1398794293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6805","nonce":1398794293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6809","nonce":1398794293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1398794293},{"type":"v1","addr":"172.21.15.152:6807","nonce":1398794293}]},"public_addr":"172.21.15.152:6803/1398794293","cluster_addr":"172.21.15.152:6805/1398794293","heartbeat_back_addr":"172.21.15.152:6809/1398794293","heartbeat_front_addr":"172.21.15.152:6807/1398794293","state":["exists","up"]},{"osd":1,"uuid":"36bae9c7-4c9c-499c-a480-3c2a5817269c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6801","nonce":1697561273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6803","nonce":1697561273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6807","nonce":1697561273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1697561273},{"type":"v1","addr":"172.21.15.179:6805","nonce":1697561273}]},"public_addr":"172.21.15.179:6801/1697561273","cluster_addr":"172.21.15.179:6803/1697561273","heartbeat_back_addr":"172.21.15.179:6807/1697561273","heartbeat_front_addr":"172.21.15.179:6805/1697561273","state":["exists","up"]},{"osd":2,"uuid":"707f080b-8903-43a4-ae5a-75a4b32e1842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6801","nonce":885545263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6803","nonce":885545263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6807","nonce":885545263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":885545263},{"type":"v1","addr":"172.21.15.193:6805","nonce":885545263}]},"public_addr":"172.21.15.193:6801/885545263","cluster_addr":"172.21.15.193:6803/885545263","heartbeat_back_addr":"172.21.15.193:6807/885545263","heartbeat_front_addr":"172.21.15.193:6805/885545263","state":["exists","up"]},{"osd":3,"uuid":"8e9e11a6-41be-4ea6-824b-295fdf0430b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6811","nonce":1387225450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6813","nonce":1387225450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6817","nonce":1387225450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1387225450},{"type":"v1","addr":"172.21.15.152:6815","nonce":1387225450}]},"public_addr":"172.21.15.152:6811/1387225450","cluster_addr":"172.21.15.152:6813/1387225450","heartbeat_back_addr":"172.21.15.152:6817/1387225450","heartbeat_front_addr":"172.21.15.152:6815/1387225450","state":["exists","up"]},{"osd":4,"uuid":"cb5c9ac5-985a-42db-8bd3-805d3122d3a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6809","nonce":2976574024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6811","nonce":2976574024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6815","nonce":2976574024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2976574024},{"type":"v1","addr":"172.21.15.179:6813","nonce":2976574024}]},"public_addr":"172.21.15.179:6809/2976574024","cluster_addr":"172.21.15.179:6811/2976574024","heartbeat_back_addr":"172.21.15.179:6815/2976574024","heartbeat_front_addr":"172.21.15.179:6813/2976574024","state":["exists","up"]},{"osd":5,"uuid":"8500e2aa-d805-460a-9a18-f74bef94f647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6809","nonce":2237502713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6811","nonce":2237502713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6815","nonce":2237502713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2237502713},{"type":"v1","addr":"172.21.15.193:6813","nonce":2237502713}]},"public_addr":"172.21.15.193:6809/2237502713","cluster_addr":"172.21.15.193:6811/2237502713","heartbeat_back_addr":"172.21.15.193:6815/2237502713","heartbeat_front_addr":"172.21.15.193:6813/2237502713","state":["exists","up"]},{"osd":6,"uuid":"7efd5367-8d24-4036-81b2-b58b801435dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6819","nonce":3410412290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6821","nonce":3410412290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6825","nonce":3410412290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3410412290},{"type":"v1","addr":"172.21.15.152:6823","nonce":3410412290}]},"public_addr":"172.21.15.152:6819/3410412290","cluster_addr":"172.21.15.152:6821/3410412290","heartbeat_back_addr":"172.21.15.152:6825/3410412290","heartbeat_front_addr":"172.21.15.152:6823/3410412290","state":["exists","up"]},{"osd":7,"uuid":"a3a68129-77a1-49ce-a517-862c73892209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6817","nonce":2484200699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6819","nonce":2484200699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6823","nonce":2484200699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2484200699},{"type":"v1","addr":"172.21.15.179:6821","nonce":2484200699}]},"public_addr":"172.21.15.179:6817/2484200699","cluster_addr":"172.21.15.179:6819/2484200699","heartbeat_back_addr":"172.21.15.179:6823/2484200699","heartbeat_front_addr":"172.21.15.179:6821/2484200699","state":["exists","up"]},{"osd":8,"uuid":"7d9b684e-3bb8-4aee-abc2-1e654068425d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6817","nonce":207210713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6819","nonce":207210713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6823","nonce":207210713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":207210713},{"type":"v1","addr":"172.21.15.193:6821","nonce":207210713}]},"public_addr":"172.21.15.193:6817/207210713","cluster_addr":"172.21.15.193:6819/207210713","heartbeat_back_addr":"172.21.15.193:6823/207210713","heartbeat_front_addr":"172.21.15.193:6821/207210713","state":["exists","up"]},{"osd":9,"uuid":"8e04aa14-c831-4546-bae0-c4fa460b8d9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6827","nonce":863570769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6829","nonce":863570769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6833","nonce":863570769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":863570769},{"type":"v1","addr":"172.21.15.152:6831","nonce":863570769}]},"public_addr":"172.21.15.152:6827/863570769","cluster_addr":"172.21.15.152:6829/863570769","heartbeat_back_addr":"172.21.15.152:6833/863570769","heartbeat_front_addr":"172.21.15.152:6831/863570769","state":["exists","up"]},{"osd":10,"uuid":"ded37595-f1a3-4d43-a4be-d84ead52418e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6825","nonce":1793292047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6827","nonce":1793292047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6831","nonce":1793292047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1793292047},{"type":"v1","addr":"172.21.15.179:6829","nonce":1793292047}]},"public_addr":"172.21.15.179:6825/1793292047","cluster_addr":"172.21.15.179:6827/1793292047","heartbeat_back_addr":"172.21.15.179:6831/1793292047","heartbeat_front_addr":"172.21.15.179:6829/1793292047","state":["exists","up"]},{"osd":11,"uuid":"98e6a47b-2ec0-43d7-aa2e-76a751b4579d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6825","nonce":4019851791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6827","nonce":4019851791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6831","nonce":4019851791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4019851791},{"type":"v1","addr":"172.21.15.193:6829","nonce":4019851791}]},"public_addr":"172.21.15.193:6825/4019851791","cluster_addr":"172.21.15.193:6827/4019851791","heartbeat_back_addr":"172.21.15.193:6831/4019851791","heartbeat_front_addr":"172.21.15.193:6829/4019851791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:16.459287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:57:41.901629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:06.617399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:31.990820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:58:56.884627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:20.895560+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T21:59:45.808551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:10.437872+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:34.932022+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:00:59.941257+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:23.930112+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:01:47.618181+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2394077400":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/1809855628":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6801/3828412393":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/1558176271":"2024-09-12T21:55:30.179334+0000","172.21.15.152:6800/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6800/3828412393":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6800/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/2661528324":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/321546578":"2024-09-12T22:04:17.346534+0000","172.21.15.152:6801/1349026414":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/567593116":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/1096456467":"2024-09-12T22:04:17.346534+0000","172.21.15.152:0/4115778297":"2024-09-12T21:55:30.179334+0000","172.21.15.152:0/3392108712":"2024-09-12T21:55:54.195284+0000","172.21.15.152:6801/1144560416":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/3449685640":"2024-09-12T21:55:54.195284+0000","172.21.15.152:0/2046084258":"2024-09-12T21:55:54.195284+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":16,"length":1},{"begin":29,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:21:20.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.543+0000 7f69cf8f5640 1 -- 172.21.15.152:0/2979199309 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69b40a2cf0 msgr2=0x7f69b40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:20.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.543+0000 7f69cf8f5640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69b40a2cf0 0x7f69b40a51b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f69c400bb60 tx=0x7f69c400b390 comp rx=0 tx=0).stop 2024-09-11T22:21:20.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.543+0000 7f69cf8f5640 1 -- 172.21.15.152:0/2979199309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c8106a80 msgr2=0x7f69c819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:20.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.543+0000 7f69cf8f5640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c8106a80 0x7f69c819cd00 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f69c0005cc0 tx=0x7f69c0003970 comp rx=0 tx=0).stop 2024-09-11T22:21:20.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.544+0000 7f69cf8f5640 1 -- 172.21.15.152:0/2979199309 shutdown_connections 2024-09-11T22:21:20.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.544+0000 7f69cf8f5640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f69b40a2cf0 0x7f69b40a51b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.544+0000 7f69cf8f5640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c8106a80 0x7f69c819cd00 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.544+0000 7f69cf8f5640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69c8101420 0x7f69c8198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.544+0000 7f69cf8f5640 1 --2- 172.21.15.152:0/2979199309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69c8100a80 0x7f69c8198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.544+0000 7f69cf8f5640 1 -- 172.21.15.152:0/2979199309 >> 172.21.15.152:0/2979199309 conn(0x7f69c80fc7a0 msgr2=0x7f69c806a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:20.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.544+0000 7f69cf8f5640 1 -- 172.21.15.152:0/2979199309 shutdown_connections 2024-09-11T22:21:20.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:20.544+0000 7f69cf8f5640 1 -- 172.21.15.152:0/2979199309 wait complete. 2024-09-11T22:21:20.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:20 smithi179 ceph-mon[35603]: osdmap e107: 12 total, 12 up, 12 in 2024-09-11T22:21:20.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:20 smithi179 ceph-mon[35603]: pgmap v536: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-09-11T22:21:20.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:20 smithi193 ceph-mon[35545]: osdmap e107: 12 total, 12 up, 12 in 2024-09-11T22:21:20.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:20 smithi193 ceph-mon[35545]: pgmap v536: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-09-11T22:21:21.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-11T22:21:21.384 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:21.479 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:21 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2979199309' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:21:21.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:21 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2979199309' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:21:21.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:21 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2979199309' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:21:21.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.833+0000 7f2c411c3640 1 -- 172.21.15.152:0/945142235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c101420 msgr2=0x7f2c3c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:21.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.833+0000 7f2c411c3640 1 --2- 172.21.15.152:0/945142235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c101420 0x7f2c3c10d950 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009cd0 tx=0x7f2c3402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:21:21.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.833+0000 7f2c411c3640 1 -- 172.21.15.152:0/945142235 shutdown_connections 2024-09-11T22:21:21.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.833+0000 7f2c411c3640 1 --2- 172.21.15.152:0/945142235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c101420 0x7f2c3c10d950 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:21.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.833+0000 7f2c411c3640 1 --2- 172.21.15.152:0/945142235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c3c100a80 0x7f2c3c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:21.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.833+0000 7f2c411c3640 1 --2- 172.21.15.152:0/945142235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c3c106a80 0x7f2c3c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:21.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.833+0000 7f2c411c3640 1 -- 172.21.15.152:0/945142235 >> 172.21.15.152:0/945142235 conn(0x7f2c3c0fc7a0 msgr2=0x7f2c3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:21.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.833+0000 7f2c411c3640 1 -- 172.21.15.152:0/945142235 shutdown_connections 2024-09-11T22:21:21.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.833+0000 7f2c411c3640 1 -- 172.21.15.152:0/945142235 wait complete. 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.833+0000 7f2c411c3640 1 Processor -- start 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c411c3640 1 -- start start 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c411c3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c100a80 0x7f2c3c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c411c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c3c101420 0x7f2c3c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c411c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c3c106a80 0x7f2c3c1a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c411c3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c110e80 con 0x7f2c3c100a80 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c411c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c110d00 con 0x7f2c3c101420 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c411c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c111000 con 0x7f2c3c106a80 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c3ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c100a80 0x7f2c3c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c3ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c100a80 0x7f2c3c199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50920/0 (socket says 172.21.15.152:50920) 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c3ad9d640 1 -- 172.21.15.152:0/1568721447 learned_addr learned my addr 172.21.15.152:0/1568721447 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:21:21.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c3b59e640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c3c106a80 0x7f2c3c1a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c3a59c640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c3c101420 0x7f2c3c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c3ad9d640 1 -- 172.21.15.152:0/1568721447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c3c106a80 msgr2=0x7f2c3c1a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c3ad9d640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c3c106a80 0x7f2c3c1a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c3ad9d640 1 -- 172.21.15.152:0/1568721447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c3c101420 msgr2=0x7f2c3c1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c3ad9d640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c3c101420 0x7f2c3c1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.834+0000 7f2c3ad9d640 1 -- 172.21.15.152:0/1568721447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3c1a4850 con 0x7f2c3c100a80 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.835+0000 7f2c3ad9d640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c100a80 0x7f2c3c199290 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00d950 tx=0x7f2c2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.835+0000 7f2c23fff640 1 -- 172.21.15.152:0/1568721447 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c017070 con 0x7f2c3c100a80 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.835+0000 7f2c23fff640 1 -- 172.21.15.152:0/1568721447 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c2c009c30 con 0x7f2c3c100a80 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.835+0000 7f2c411c3640 1 -- 172.21.15.152:0/1568721447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3c1a4a20 con 0x7f2c3c100a80 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.835+0000 7f2c23fff640 1 -- 172.21.15.152:0/1568721447 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00f6b0 con 0x7f2c3c100a80 2024-09-11T22:21:21.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.835+0000 7f2c411c3640 1 -- 172.21.15.152:0/1568721447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3c1a4f30 con 0x7f2c3c100a80 2024-09-11T22:21:21.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.836+0000 7f2c411c3640 1 -- 172.21.15.152:0/1568721447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c3c100ee0 con 0x7f2c3c100a80 2024-09-11T22:21:21.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.837+0000 7f2c23fff640 1 -- 172.21.15.152:0/1568721447 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f2c2c0109d0 con 0x7f2c3c100a80 2024-09-11T22:21:21.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.837+0000 7f2c23fff640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c240a2cf0 0x7f2c240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:21.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.838+0000 7f2c3a59c640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c240a2cf0 0x7f2c240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:21.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.838+0000 7f2c23fff640 1 -- 172.21.15.152:0/1568721447 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8614+0+0 (secure 0 0 0) 0x7f2c2c0cf110 con 0x7f2c3c100a80 2024-09-11T22:21:21.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.838+0000 7f2c3a59c640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c240a2cf0 0x7f2c240a51b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c30005fd0 tx=0x7f2c30005850 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:21.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:21.841+0000 7f2c23fff640 1 -- 172.21.15.152:0/1568721447 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c2c009de0 con 0x7f2c3c100a80 2024-09-11T22:21:22.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.041+0000 7f2c411c3640 1 -- 172.21.15.152:0/1568721447 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2c3c1a5160 con 0x7f2c3c100a80 2024-09-11T22:21:22.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.043+0000 7f2c23fff640 1 -- 172.21.15.152:0/1568721447 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7f2c2c09bcd0 con 0x7f2c3c100a80 2024-09-11T22:21:22.044 INFO:teuthology.orchestra.run.smithi152.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:21:22.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.046+0000 7f2c411c3640 1 -- 172.21.15.152:0/1568721447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c240a2cf0 msgr2=0x7f2c240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:22.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.046+0000 7f2c411c3640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c240a2cf0 0x7f2c240a51b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c30005fd0 tx=0x7f2c30005850 comp rx=0 tx=0).stop 2024-09-11T22:21:22.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.046+0000 7f2c411c3640 1 -- 172.21.15.152:0/1568721447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c100a80 msgr2=0x7f2c3c199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:22.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.046+0000 7f2c411c3640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c100a80 0x7f2c3c199290 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00d950 tx=0x7f2c2c00de10 comp rx=0 tx=0).stop 2024-09-11T22:21:22.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.046+0000 7f2c411c3640 1 -- 172.21.15.152:0/1568721447 shutdown_connections 2024-09-11T22:21:22.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.046+0000 7f2c411c3640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f2c240a2cf0 0x7f2c240a51b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:22.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.046+0000 7f2c411c3640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2c3c106a80 0x7f2c3c1a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:22.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.046+0000 7f2c411c3640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c3c101420 0x7f2c3c1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:22.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.046+0000 7f2c411c3640 1 --2- 172.21.15.152:0/1568721447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c100a80 0x7f2c3c199290 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:22.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.046+0000 7f2c411c3640 1 -- 172.21.15.152:0/1568721447 >> 172.21.15.152:0/1568721447 conn(0x7f2c3c0fc7a0 msgr2=0x7f2c3c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:22.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.047+0000 7f2c411c3640 1 -- 172.21.15.152:0/1568721447 shutdown_connections 2024-09-11T22:21:22.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:22.047+0000 7f2c411c3640 1 -- 172.21.15.152:0/1568721447 wait complete. 2024-09-11T22:21:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:22 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a[31184]: 2024-09-11T22:21:22.042+0000 7fc00e3cc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:21:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:22 smithi152 ceph-mon[31188]: pgmap v537: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-09-11T22:21:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:22 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1568721447' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T22:21:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:22 smithi152 ceph-mon[31188]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T22:21:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:22 smithi152 ceph-mon[31188]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:21:22.480 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:22 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1568721447' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T22:21:22.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:22 smithi152 ceph-mon[31188]: osdmap e108: 12 total, 12 up, 12 in 2024-09-11T22:21:22.481 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:22 smithi152 ceph-mon[31188]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T22:21:22.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-mon[35603]: pgmap v537: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-09-11T22:21:22.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1568721447' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T22:21:22.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-mon[35603]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T22:21:22.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-mon[35603]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:21:22.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1568721447' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T22:21:22.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-mon[35603]: osdmap e108: 12 total, 12 up, 12 in 2024-09-11T22:21:22.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-mon[35603]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T22:21:22.547 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h[65592]: ignoring --setuser ceph since I am not root 2024-09-11T22:21:22.547 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h[65592]: ignoring --setgroup ceph since I am not root 2024-09-11T22:21:22.547 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-mds[65596]: -- 172.21.15.179:0/2271429775 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559970003c20 con 0x55996ffe1000 2024-09-11T22:21:22.548 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h[65592]: starting mds.h at 2024-09-11T22:21:22.548 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b[65894]: ignoring --setuser ceph since I am not root 2024-09-11T22:21:22.548 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b[65894]: ignoring --setgroup ceph since I am not root 2024-09-11T22:21:22.548 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-mds[65898]: -- 172.21.15.179:0/1875723897 <== mon.0 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555a8bf0d860 con 0x555a8beea800 2024-09-11T22:21:22.548 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b[65894]: starting mds.b at 2024-09-11T22:21:22.548 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e[65292]: ignoring --setuser ceph since I am not root 2024-09-11T22:21:22.549 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e[65292]: ignoring --setgroup ceph since I am not root 2024-09-11T22:21:22.549 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-mds[65296]: -- 172.21.15.179:0/3743847127 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564596a4f860 con 0x564596a2c800 2024-09-11T22:21:22.549 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:21:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e[65292]: starting mds.e at 2024-09-11T22:21:22.576 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f[66116]: ignoring --setuser ceph since I am not root 2024-09-11T22:21:22.576 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f[66116]: ignoring --setgroup ceph since I am not root 2024-09-11T22:21:22.576 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-mds[66120]: -- 172.21.15.193:0/3754102192 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572eaa0d860 con 0x5572ea9ea800 2024-09-11T22:21:22.576 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f[66116]: starting mds.f at 2024-09-11T22:21:22.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-mon[35545]: pgmap v537: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-09-11T22:21:22.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1568721447' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T22:21:22.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-mon[35545]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T22:21:22.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-mon[35545]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:21:22.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1568721447' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T22:21:22.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-mon[35545]: osdmap e108: 12 total, 12 up, 12 in 2024-09-11T22:21:22.577 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-mon[35545]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T22:21:22.578 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-i[66721]: ignoring --setuser ceph since I am not root 2024-09-11T22:21:22.578 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-i[66721]: ignoring --setgroup ceph since I am not root 2024-09-11T22:21:22.578 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-mds[66725]: -- 172.21.15.193:0/2624013810 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce47f81c20 con 0x55ce47f5e800 2024-09-11T22:21:22.578 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-i[66721]: starting mds.i at 2024-09-11T22:21:22.578 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-c[66418]: ignoring --setuser ceph since I am not root 2024-09-11T22:21:22.578 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-c[66418]: ignoring --setgroup ceph since I am not root 2024-09-11T22:21:22.578 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-mds[66422]: -- 172.21.15.193:0/663346440 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d9ea2d5860 con 0x55d9ea2b3000 2024-09-11T22:21:22.578 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 11 22:21:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-c[66418]: starting mds.c at 2024-09-11T22:21:22.736 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:21:22.984 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:23.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.426+0000 7f7e43e4c640 1 -- 172.21.15.152:0/992013942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3c103780 msgr2=0x7f7e3c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:23.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.426+0000 7f7e43e4c640 1 --2- 172.21.15.152:0/992013942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3c103780 0x7f7e3c107bc0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c009cd0 tx=0x7f7e2c02a8d0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.426+0000 7f7e43e4c640 1 -- 172.21.15.152:0/992013942 shutdown_connections 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.426+0000 7f7e43e4c640 1 --2- 172.21.15.152:0/992013942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c108300 0x7f7e3c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.426+0000 7f7e43e4c640 1 --2- 172.21.15.152:0/992013942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3c103780 0x7f7e3c107bc0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.426+0000 7f7e43e4c640 1 --2- 172.21.15.152:0/992013942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e3c102dd0 0x7f7e3c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.426+0000 7f7e43e4c640 1 -- 172.21.15.152:0/992013942 >> 172.21.15.152:0/992013942 conn(0x7f7e3c0fc7d0 msgr2=0x7f7e3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.426+0000 7f7e43e4c640 1 -- 172.21.15.152:0/992013942 shutdown_connections 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.426+0000 7f7e43e4c640 1 -- 172.21.15.152:0/992013942 wait complete. 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.426+0000 7f7e43e4c640 1 Processor -- start 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.426+0000 7f7e43e4c640 1 -- start start 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e43e4c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3c102dd0 0x7f7e3c100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e43e4c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c103780 0x7f7e3c100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:23.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e43e4c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e3c108300 0x7f7e3c1014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e43e4c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c112070 con 0x7f7e3c102dd0 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e43e4c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c111ef0 con 0x7f7e3c108300 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e43e4c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c1121f0 con 0x7f7e3c103780 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e41be8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3c102dd0 0x7f7e3c100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e41be8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3c102dd0 0x7f7e3c100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39978/0 (socket says 172.21.15.152:39978) 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e41be8640 1 -- 172.21.15.152:0/1622776866 learned_addr learned my addr 172.21.15.152:0/1622776866 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e413e7640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c103780 0x7f7e3c100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e423e9640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e3c108300 0x7f7e3c1014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e41be8640 1 -- 172.21.15.152:0/1622776866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c103780 msgr2=0x7f7e3c100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e41be8640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c103780 0x7f7e3c100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e41be8640 1 -- 172.21.15.152:0/1622776866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e3c108300 msgr2=0x7f7e3c1014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e41be8640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e3c108300 0x7f7e3c1014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e41be8640 1 -- 172.21.15.152:0/1622776866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3c1a6ab0 con 0x7f7e3c102dd0 2024-09-11T22:21:23.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e423e9640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e3c108300 0x7f7e3c1014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:23.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.427+0000 7f7e41be8640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3c102dd0 0x7f7e3c100a30 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c890 tx=0x7f7e3800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:23.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.428+0000 7f7e32ffd640 1 -- 172.21.15.152:0/1622776866 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38004220 con 0x7f7e3c102dd0 2024-09-11T22:21:23.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.428+0000 7f7e32ffd640 1 -- 172.21.15.152:0/1622776866 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e380043c0 con 0x7f7e3c102dd0 2024-09-11T22:21:23.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.428+0000 7f7e43e4c640 1 -- 172.21.15.152:0/1622776866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3c1a6da0 con 0x7f7e3c102dd0 2024-09-11T22:21:23.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.428+0000 7f7e32ffd640 1 -- 172.21.15.152:0/1622776866 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e380049e0 con 0x7f7e3c102dd0 2024-09-11T22:21:23.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.428+0000 7f7e43e4c640 1 -- 172.21.15.152:0/1622776866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e3c1a7250 con 0x7f7e3c102dd0 2024-09-11T22:21:23.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.429+0000 7f7e43e4c640 1 -- 172.21.15.152:0/1622776866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3c1031b0 con 0x7f7e3c102dd0 2024-09-11T22:21:23.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.430+0000 7f7e32ffd640 1 -- 172.21.15.152:0/1622776866 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f7e380079b0 con 0x7f7e3c102dd0 2024-09-11T22:21:23.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.431+0000 7f7e32ffd640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e240a2cf0 0x7f7e240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:23.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.431+0000 7f7e413e7640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e240a2cf0 0x7f7e240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:23.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.431+0000 7f7e32ffd640 1 -- 172.21.15.152:0/1622776866 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8828+0+0 (secure 0 0 0) 0x7f7e380cf860 con 0x7f7e3c102dd0 2024-09-11T22:21:23.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.431+0000 7f7e413e7640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e240a2cf0 0x7f7e240a51b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c006010 tx=0x7f7e2c000f40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:23.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.434+0000 7f7e32ffd640 1 -- 172.21.15.152:0/1622776866 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e38014030 con 0x7f7e3c102dd0 2024-09-11T22:21:23.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:23.634+0000 7f7e43e4c640 1 -- 172.21.15.152:0/1622776866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7e3c10a290 con 0x7f7e3c102dd0 2024-09-11T22:21:24.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.051+0000 7f7e32ffd640 1 -- 172.21.15.152:0/1622776866 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7f7e3809c2f0 con 0x7f7e3c102dd0 2024-09-11T22:21:24.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.054+0000 7f7e43e4c640 1 -- 172.21.15.152:0/1622776866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e240a2cf0 msgr2=0x7f7e240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:24.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.054+0000 7f7e43e4c640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e240a2cf0 0x7f7e240a51b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c006010 tx=0x7f7e2c000f40 comp rx=0 tx=0).stop 2024-09-11T22:21:24.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.054+0000 7f7e43e4c640 1 -- 172.21.15.152:0/1622776866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3c102dd0 msgr2=0x7f7e3c100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:24.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.054+0000 7f7e43e4c640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3c102dd0 0x7f7e3c100a30 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c890 tx=0x7f7e3800cd50 comp rx=0 tx=0).stop 2024-09-11T22:21:24.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.054+0000 7f7e43e4c640 1 -- 172.21.15.152:0/1622776866 shutdown_connections 2024-09-11T22:21:24.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.054+0000 7f7e43e4c640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f7e240a2cf0 0x7f7e240a51b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:24.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.054+0000 7f7e43e4c640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e3c108300 0x7f7e3c1014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:24.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.054+0000 7f7e43e4c640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e3c103780 0x7f7e3c100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:24.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.054+0000 7f7e43e4c640 1 --2- 172.21.15.152:0/1622776866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3c102dd0 0x7f7e3c100a30 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:24.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.054+0000 7f7e43e4c640 1 -- 172.21.15.152:0/1622776866 >> 172.21.15.152:0/1622776866 conn(0x7f7e3c0fc7d0 msgr2=0x7f7e3c105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:24.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.055+0000 7f7e43e4c640 1 -- 172.21.15.152:0/1622776866 shutdown_connections 2024-09-11T22:21:24.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:24.055+0000 7f7e43e4c640 1 -- 172.21.15.152:0/1622776866 wait complete. 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.193:6834/3850896639,v1:172.21.15.193:6837/3850896639] up:boot 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.193:6835/2158566075,v1:172.21.15.193:6838/2158566075] up:boot 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.179:6834/3163510680,v1:172.21.15.179:6835/3163510680] up:boot 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.193:6836/3795726649,v1:172.21.15.193:6839/3795726649] up:boot 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.179:6836/765679351,v1:172.21.15.179:6838/765679351] up:boot 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: mds.? [v2:172.21.15.179:6837/4215797752,v1:172.21.15.179:6839/4215797752] up:boot 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:21:24.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:21:24.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:21:24.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1622776866' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:21:24.328 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:24 smithi193 ceph-mon[35545]: pgmap v539: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 110 KiB/s wr, 6 op/s 2024-09-11T22:21:24.473 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.193:6834/3850896639,v1:172.21.15.193:6837/3850896639] up:boot 2024-09-11T22:21:24.473 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.193:6835/2158566075,v1:172.21.15.193:6838/2158566075] up:boot 2024-09-11T22:21:24.473 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.179:6834/3163510680,v1:172.21.15.179:6835/3163510680] up:boot 2024-09-11T22:21:24.473 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.193:6836/3795726649,v1:172.21.15.193:6839/3795726649] up:boot 2024-09-11T22:21:24.473 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.179:6836/765679351,v1:172.21.15.179:6838/765679351] up:boot 2024-09-11T22:21:24.473 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: mds.? [v2:172.21.15.179:6837/4215797752,v1:172.21.15.179:6839/4215797752] up:boot 2024-09-11T22:21:24.473 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T22:21:24.474 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:21:24.474 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:21:24.474 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:21:24.474 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:21:24.474 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:21:24.474 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:21:24.474 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1622776866' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:21:24.474 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:24 smithi152 ceph-mon[31188]: pgmap v539: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 110 KiB/s wr, 6 op/s 2024-09-11T22:21:24.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.193:6834/3850896639,v1:172.21.15.193:6837/3850896639] up:boot 2024-09-11T22:21:24.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.193:6835/2158566075,v1:172.21.15.193:6838/2158566075] up:boot 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.179:6834/3163510680,v1:172.21.15.179:6835/3163510680] up:boot 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.193:6836/3795726649,v1:172.21.15.193:6839/3795726649] up:boot 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.179:6836/765679351,v1:172.21.15.179:6838/765679351] up:boot 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: mds.? [v2:172.21.15.179:6837/4215797752,v1:172.21.15.179:6839/4215797752] up:boot 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: from='mgr.15129 172.21.15.152:0/1801835797' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1622776866' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:21:24.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:24 smithi179 ceph-mon[35603]: pgmap v539: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 110 KiB/s wr, 6 op/s 2024-09-11T22:21:24.850 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:21:25.100 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:25.220 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:25 smithi152 ceph-mon[31188]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T22:21:25.220 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:25 smithi152 ceph-mon[31188]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T22:21:25.220 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:25 smithi152 ceph-mon[31188]: Cluster is now healthy 2024-09-11T22:21:25.220 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:25 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/1622776866' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:21:25.221 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:25 smithi152 ceph-mon[31188]: fsmap 12 up:standby 2024-09-11T22:21:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:25 smithi193 ceph-mon[35545]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T22:21:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:25 smithi193 ceph-mon[35545]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T22:21:25.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:25 smithi193 ceph-mon[35545]: Cluster is now healthy 2024-09-11T22:21:25.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:25 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/1622776866' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:21:25.327 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:25 smithi193 ceph-mon[35545]: fsmap 12 up:standby 2024-09-11T22:21:25.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:25 smithi179 ceph-mon[35603]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T22:21:25.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:25 smithi179 ceph-mon[35603]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T22:21:25.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:25 smithi179 ceph-mon[35603]: Cluster is now healthy 2024-09-11T22:21:25.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:25 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/1622776866' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:21:25.547 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:25 smithi179 ceph-mon[35603]: fsmap 12 up:standby 2024-09-11T22:21:25.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.553+0000 7f0bfc446640 1 -- 172.21.15.152:0/2739005022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf4100a80 msgr2=0x7f0bf4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:25.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.553+0000 7f0bfc446640 1 --2- 172.21.15.152:0/2739005022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf4100a80 0x7f0bf4100ee0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009930 tx=0x7f0be402a420 comp rx=0 tx=0).stop 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.553+0000 7f0bfc446640 1 -- 172.21.15.152:0/2739005022 shutdown_connections 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.553+0000 7f0bfc446640 1 --2- 172.21.15.152:0/2739005022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bf4101420 0x7f0bf410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.553+0000 7f0bfc446640 1 --2- 172.21.15.152:0/2739005022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf4100a80 0x7f0bf4100ee0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.553+0000 7f0bfc446640 1 --2- 172.21.15.152:0/2739005022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bf4106a80 0x7f0bf4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.553+0000 7f0bfc446640 1 -- 172.21.15.152:0/2739005022 >> 172.21.15.152:0/2739005022 conn(0x7f0bf40fc7a0 msgr2=0x7f0bf40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.553+0000 7f0bfc446640 1 -- 172.21.15.152:0/2739005022 shutdown_connections 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.553+0000 7f0bfc446640 1 -- 172.21.15.152:0/2739005022 wait complete. 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfc446640 1 Processor -- start 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfc446640 1 -- start start 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfc446640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf4100a80 0x7f0bf4197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfc446640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bf4101420 0x7f0bf41978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfc446640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bf4106a80 0x7f0bf419bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfc446640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf4110e40 con 0x7f0bf4100a80 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfc446640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf4110cc0 con 0x7f0bf4106a80 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfc446640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf4110fc0 con 0x7f0bf4101420 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfa1e2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf4100a80 0x7f0bf4197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfa1e2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf4100a80 0x7f0bf4197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39998/0 (socket says 172.21.15.152:39998) 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfa1e2640 1 -- 172.21.15.152:0/2260095380 learned_addr learned my addr 172.21.15.152:0/2260095380 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfa9e3640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bf4106a80 0x7f0bf419bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bfa1e2640 1 -- 172.21.15.152:0/2260095380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bf4101420 msgr2=0x7f0bf41978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.554+0000 7f0bf99e1640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bf4101420 0x7f0bf41978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.555+0000 7f0bfa1e2640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bf4101420 0x7f0bf41978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.555+0000 7f0bfa1e2640 1 -- 172.21.15.152:0/2260095380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bf4106a80 msgr2=0x7f0bf419bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.555+0000 7f0bfa1e2640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bf4106a80 0x7f0bf419bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.555+0000 7f0bfa1e2640 1 -- 172.21.15.152:0/2260095380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf419c330 con 0x7f0bf4100a80 2024-09-11T22:21:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.555+0000 7f0bf99e1640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bf4101420 0x7f0bf41978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.555+0000 7f0bfa1e2640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf4100a80 0x7f0bf4197380 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c890 tx=0x7f0bf000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.555+0000 7f0beb7fe640 1 -- 172.21.15.152:0/2260095380 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0004220 con 0x7f0bf4100a80 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.555+0000 7f0bfc446640 1 -- 172.21.15.152:0/2260095380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf419c620 con 0x7f0bf4100a80 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.555+0000 7f0beb7fe640 1 -- 172.21.15.152:0/2260095380 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bf00043c0 con 0x7f0bf4100a80 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.555+0000 7f0beb7fe640 1 -- 172.21.15.152:0/2260095380 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0004a00 con 0x7f0bf4100a80 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.555+0000 7f0bfc446640 1 -- 172.21.15.152:0/2260095380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf41a3f00 con 0x7f0bf4100a80 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.556+0000 7f0bfc446640 1 -- 172.21.15.152:0/2260095380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf4100ee0 con 0x7f0bf4100a80 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.557+0000 7f0beb7fe640 1 -- 172.21.15.152:0/2260095380 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0bf00079b0 con 0x7f0bf4100a80 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.557+0000 7f0beb7fe640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0be00a2cf0 0x7f0be00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.558+0000 7f0bf99e1640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0be00a2cf0 0x7f0be00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.558+0000 7f0beb7fe640 1 -- 172.21.15.152:0/2260095380 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8828+0+0 (secure 0 0 0) 0x7f0bf00cf220 con 0x7f0bf4100a80 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.558+0000 7f0bf99e1640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0be00a2cf0 0x7f0be00a51b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0be4000c00 tx=0x7f0be4032c70 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:25.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.562+0000 7f0beb7fe640 1 -- 172.21.15.152:0/2260095380 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0bf0014030 con 0x7f0bf4100a80 2024-09-11T22:21:25.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:25.729+0000 7f0bfc446640 1 -- 172.21.15.152:0/2260095380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0bf402d7c0 con 0x7f0bf4100a80 2024-09-11T22:21:26.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.060+0000 7f0beb7fe640 1 -- 172.21.15.152:0/2260095380 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) ==== 181+0+0 (secure 0 0 0) 0x7f0bf009bdb0 con 0x7f0bf4100a80 2024-09-11T22:21:26.061 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:21:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.063+0000 7f0bfc446640 1 -- 172.21.15.152:0/2260095380 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0be00a2cf0 msgr2=0x7f0be00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.063+0000 7f0bfc446640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0be00a2cf0 0x7f0be00a51b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0be4000c00 tx=0x7f0be4032c70 comp rx=0 tx=0).stop 2024-09-11T22:21:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.064+0000 7f0bfc446640 1 -- 172.21.15.152:0/2260095380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf4100a80 msgr2=0x7f0bf4197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.064+0000 7f0bfc446640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf4100a80 0x7f0bf4197380 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c890 tx=0x7f0bf000cd50 comp rx=0 tx=0).stop 2024-09-11T22:21:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.064+0000 7f0bfc446640 1 -- 172.21.15.152:0/2260095380 shutdown_connections 2024-09-11T22:21:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.064+0000 7f0bfc446640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f0be00a2cf0 0x7f0be00a51b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.064+0000 7f0bfc446640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bf4106a80 0x7f0bf419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.064+0000 7f0bfc446640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bf4101420 0x7f0bf41978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.064+0000 7f0bfc446640 1 --2- 172.21.15.152:0/2260095380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf4100a80 0x7f0bf4197380 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.064+0000 7f0bfc446640 1 -- 172.21.15.152:0/2260095380 >> 172.21.15.152:0/2260095380 conn(0x7f0bf40fc7a0 msgr2=0x7f0bf40fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.065+0000 7f0bfc446640 1 -- 172.21.15.152:0/2260095380 shutdown_connections 2024-09-11T22:21:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:26.065+0000 7f0bfc446640 1 -- 172.21.15.152:0/2260095380 wait complete. 2024-09-11T22:21:26.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:26 smithi193 ceph-mon[35545]: pgmap v540: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 115 KiB/s wr, 9 op/s 2024-09-11T22:21:26.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:26 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2260095380' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:21:26.382 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:26 smithi152 ceph-mon[31188]: pgmap v540: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 115 KiB/s wr, 9 op/s 2024-09-11T22:21:26.382 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:26 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2260095380' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:21:26.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:26 smithi179 ceph-mon[35603]: pgmap v540: 97 pgs: 97 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 115 KiB/s wr, 9 op/s 2024-09-11T22:21:26.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:26 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2260095380' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:21:26.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:21:26.950 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:27.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:27 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/2260095380' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:21:27.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:27 smithi193 ceph-mon[35545]: osdmap e109: 12 total, 12 up, 12 in 2024-09-11T22:21:27.377 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:27 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/2260095380' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:21:27.377 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:27 smithi152 ceph-mon[31188]: osdmap e109: 12 total, 12 up, 12 in 2024-09-11T22:21:27.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.384+0000 7f1836e68640 1 -- 172.21.15.152:0/2685331677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1830100a80 msgr2=0x7f1830100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:27.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.384+0000 7f1836e68640 1 --2- 172.21.15.152:0/2685331677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1830100a80 0x7f1830100ee0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f181c009930 tx=0x7f181c02a420 comp rx=0 tx=0).stop 2024-09-11T22:21:27.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.384+0000 7f1836e68640 1 -- 172.21.15.152:0/2685331677 shutdown_connections 2024-09-11T22:21:27.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.384+0000 7f1836e68640 1 --2- 172.21.15.152:0/2685331677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1830101420 0x7f183010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:27.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.384+0000 7f1836e68640 1 --2- 172.21.15.152:0/2685331677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1830100a80 0x7f1830100ee0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:27.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.384+0000 7f1836e68640 1 --2- 172.21.15.152:0/2685331677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1830106a80 0x7f1830106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:27.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.384+0000 7f1836e68640 1 -- 172.21.15.152:0/2685331677 >> 172.21.15.152:0/2685331677 conn(0x7f18300fc7a0 msgr2=0x7f18300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:27.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.384+0000 7f1836e68640 1 -- 172.21.15.152:0/2685331677 shutdown_connections 2024-09-11T22:21:27.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.384+0000 7f1836e68640 1 -- 172.21.15.152:0/2685331677 wait complete. 2024-09-11T22:21:27.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1836e68640 1 Processor -- start 2024-09-11T22:21:27.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1836e68640 1 -- start start 2024-09-11T22:21:27.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1836e68640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1830100a80 0x7f1830198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:27.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1836e68640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1830101420 0x7f1830198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:27.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1836e68640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1830106a80 0x7f183019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1836e68640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1830110ea0 con 0x7f1830106a80 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1836e68640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1830110d20 con 0x7f1830100a80 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1836e68640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1830111020 con 0x7f1830101420 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1835405640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1830106a80 0x7f183019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1835405640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1830106a80 0x7f183019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40012/0 (socket says 172.21.15.152:40012) 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1835405640 1 -- 172.21.15.152:0/3149246039 learned_addr learned my addr 172.21.15.152:0/3149246039 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f182ffff640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1830101420 0x7f1830198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.385+0000 7f1834c04640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1830100a80 0x7f1830198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.386+0000 7f1835405640 1 -- 172.21.15.152:0/3149246039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1830101420 msgr2=0x7f1830198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.386+0000 7f1835405640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1830101420 0x7f1830198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.386+0000 7f1835405640 1 -- 172.21.15.152:0/3149246039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1830100a80 msgr2=0x7f1830198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.386+0000 7f1835405640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1830100a80 0x7f1830198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:27.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.386+0000 7f1835405640 1 -- 172.21.15.152:0/3149246039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183019d4c0 con 0x7f1830106a80 2024-09-11T22:21:27.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.386+0000 7f1835405640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1830106a80 0x7f183019cde0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f182800b970 tx=0x7f182800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:27.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.386+0000 7f182dffb640 1 -- 172.21.15.152:0/3149246039 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1828019070 con 0x7f1830106a80 2024-09-11T22:21:27.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.386+0000 7f182dffb640 1 -- 172.21.15.152:0/3149246039 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f182800cb40 con 0x7f1830106a80 2024-09-11T22:21:27.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.387+0000 7f182dffb640 1 -- 172.21.15.152:0/3149246039 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1828007650 con 0x7f1830106a80 2024-09-11T22:21:27.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.387+0000 7f1836e68640 1 -- 172.21.15.152:0/3149246039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183019d7b0 con 0x7f1830106a80 2024-09-11T22:21:27.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.387+0000 7f1836e68640 1 -- 172.21.15.152:0/3149246039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18301a5090 con 0x7f1830106a80 2024-09-11T22:21:27.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.388+0000 7f1836e68640 1 -- 172.21.15.152:0/3149246039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1830106e60 con 0x7f1830106a80 2024-09-11T22:21:27.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.389+0000 7f182dffb640 1 -- 172.21.15.152:0/3149246039 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f182801c070 con 0x7f1830106a80 2024-09-11T22:21:27.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.390+0000 7f182dffb640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18200a2d70 0x7f18200a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:27.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.390+0000 7f1834c04640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18200a2d70 0x7f18200a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:27.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.390+0000 7f182dffb640 1 -- 172.21.15.152:0/3149246039 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 8274+0+0 (secure 0 0 0) 0x7f18280ce820 con 0x7f1830106a80 2024-09-11T22:21:27.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.390+0000 7f1834c04640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18200a2d70 0x7f18200a5230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f18240058c0 tx=0x7f182400a2d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:27.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.394+0000 7f182dffb640 1 -- 172.21.15.152:0/3149246039 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f182809aff0 con 0x7f1830106a80 2024-09-11T22:21:27.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:27 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/2260095380' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:21:27.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:27 smithi179 ceph-mon[35603]: osdmap e109: 12 total, 12 up, 12 in 2024-09-11T22:21:27.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:27.560+0000 7f1836e68640 1 -- 172.21.15.152:0/3149246039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f18301a5260 con 0x7f1830106a80 2024-09-11T22:21:28.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.067+0000 7f182dffb640 1 -- 172.21.15.152:0/3149246039 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) ==== 169+0+0 (secure 0 0 0) 0x7f182809f2f0 con 0x7f1830106a80 2024-09-11T22:21:28.067 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' removed 2024-09-11T22:21:28.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.070+0000 7f1836e68640 1 -- 172.21.15.152:0/3149246039 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18200a2d70 msgr2=0x7f18200a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.070+0000 7f1836e68640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18200a2d70 0x7f18200a5230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f18240058c0 tx=0x7f182400a2d0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.070+0000 7f1836e68640 1 -- 172.21.15.152:0/3149246039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1830106a80 msgr2=0x7f183019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.070+0000 7f1836e68640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1830106a80 0x7f183019cde0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f182800b970 tx=0x7f182800be30 comp rx=0 tx=0).stop 2024-09-11T22:21:28.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.070+0000 7f1836e68640 1 -- 172.21.15.152:0/3149246039 shutdown_connections 2024-09-11T22:21:28.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.070+0000 7f1836e68640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.152:6800/4276759886,v1:172.21.15.152:6801/4276759886] conn(0x7f18200a2d70 0x7f18200a5230 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.070+0000 7f1836e68640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1830106a80 0x7f183019cde0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.070+0000 7f1836e68640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1830101420 0x7f1830198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.070+0000 7f1836e68640 1 --2- 172.21.15.152:0/3149246039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1830100a80 0x7f1830198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.070+0000 7f1836e68640 1 -- 172.21.15.152:0/3149246039 >> 172.21.15.152:0/3149246039 conn(0x7f18300fc7a0 msgr2=0x7f18300fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:28.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.070+0000 7f1836e68640 1 -- 172.21.15.152:0/3149246039 shutdown_connections 2024-09-11T22:21:28.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-11T22:21:28.071+0000 7f1836e68640 1 -- 172.21.15.152:0/3149246039 wait complete. 2024-09-11T22:21:28.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:28 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3149246039' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:21:28.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:28 smithi193 ceph-mon[35545]: pgmap v542: 65 pgs: 65 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:21:28.420 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:28 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3149246039' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:21:28.420 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:28 smithi152 ceph-mon[31188]: pgmap v542: 65 pgs: 65 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:21:28.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:28 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3149246039' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:21:28.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:28 smithi179 ceph-mon[35603]: pgmap v542: 65 pgs: 65 active+clean; 3.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:21:28.835 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:28.900 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:28.927 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:28.957 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-11T22:21:28.957 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T22:21:28.972 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T22:21:28.987 DEBUG:teuthology.orchestra.run.smithi193:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T22:21:29.011 INFO:tasks.cephadm:Stopping all daemons... 2024-09-11T22:21:29.011 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-11T22:21:29.012 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.a 2024-09-11T22:21:29.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:29 smithi179 ceph-mon[35603]: from='client.? 172.21.15.152:0/3149246039' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:21:29.296 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:29 smithi179 ceph-mon[35603]: osdmap e110: 12 total, 12 up, 12 in 2024-09-11T22:21:29.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:29 smithi193 ceph-mon[35545]: from='client.? 172.21.15.152:0/3149246039' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:21:29.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:29 smithi193 ceph-mon[35545]: osdmap e110: 12 total, 12 up, 12 in 2024-09-11T22:21:29.345 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:29 smithi152 systemd[1]: Stopping Ceph mon.a for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:21:29.346 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:29 smithi152 ceph-mon[31188]: from='client.? 172.21.15.152:0/3149246039' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:21:29.346 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:29 smithi152 ceph-mon[31188]: osdmap e110: 12 total, 12 up, 12 in 2024-09-11T22:21:29.346 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a[31184]: 2024-09-11T22:21:29.294+0000 7fc013bd7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:21:29.346 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a[31184]: 2024-09-11T22:21:29.294+0000 7fc013bd7640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-11T22:21:29.697 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:29 smithi152 podman[122224]: 2024-09-11 22:21:29.345806532 +0000 UTC m=+0.136015060 container died 0cc5c0da4320a4b5642c808bb332e2a458e1abab2be4993c02f02c68666b8034 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-11T22:21:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:29 smithi152 podman[122224]: 2024-09-11 22:21:29.794778737 +0000 UTC m=+0.584987264 container cleanup 0cc5c0da4320a4b5642c808bb332e2a458e1abab2be4993c02f02c68666b8034 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:21:29.980 INFO:journalctl@ceph.mon.a.smithi152.stdout:Sep 11 22:21:29 smithi152 bash[122224]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-a 2024-09-11T22:21:30.480 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.a.service' 2024-09-11T22:21:30.528 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:21:30.528 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-11T22:21:30.528 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-11T22:21:30.528 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.b 2024-09-11T22:21:30.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:30 smithi179 systemd[1]: Stopping Ceph mon.b for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:21:31.187 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:30 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-b[35599]: 2024-09-11T22:21:30.827+0000 7f3b85e40640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:21:31.187 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:30 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-b[35599]: 2024-09-11T22:21:30.827+0000 7f3b85e40640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-11T22:21:31.187 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:30 smithi179 podman[72323]: 2024-09-11 22:21:30.899539272 +0000 UTC m=+0.179912359 container died cbe9b448ac45f1b6859740997f137826d01d025cca37329878e847194383aa27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-11T22:21:31.495 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:31 smithi179 podman[72323]: 2024-09-11 22:21:31.286155177 +0000 UTC m=+0.566528265 container cleanup cbe9b448ac45f1b6859740997f137826d01d025cca37329878e847194383aa27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-11T22:21:31.495 INFO:journalctl@ceph.mon.b.smithi179.stdout:Sep 11 22:21:31 smithi179 bash[72323]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-b 2024-09-11T22:21:31.623 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.b.service' 2024-09-11T22:21:31.668 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:21:31.668 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-11T22:21:31.668 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-11T22:21:31.668 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.c 2024-09-11T22:21:31.981 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:31 smithi193 systemd[1]: Stopping Ceph mon.c for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:21:32.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:31 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-c[35541]: 2024-09-11T22:21:31.980+0000 7f27f210e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:21:32.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:31 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-c[35541]: 2024-09-11T22:21:31.980+0000 7f27f210e640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-11T22:21:32.326 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:32 smithi193 podman[73024]: 2024-09-11 22:21:32.224811828 +0000 UTC m=+0.365875819 container died 842f227654d01dcd06dc570ec86244a86422b21f315facb8c00a3a173eec49f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-c, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:21:32.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:32 smithi193 podman[73024]: 2024-09-11 22:21:32.614629002 +0000 UTC m=+0.755692995 container cleanup 842f227654d01dcd06dc570ec86244a86422b21f315facb8c00a3a173eec49f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-11T22:21:32.826 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 11 22:21:32 smithi193 bash[73024]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mon-c 2024-09-11T22:21:33.108 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mon.c.service' 2024-09-11T22:21:33.148 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:21:33.149 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-11T22:21:33.149 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-11T22:21:33.149 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.x 2024-09-11T22:21:33.459 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:21:33 smithi152 systemd[1]: Stopping Ceph mgr.x for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:21:33.730 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:21:33 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x[31412]: 2024-09-11T22:21:33.457+0000 7f7a6eb1b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:21:33.730 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:21:33 smithi152 podman[122343]: 2024-09-11 22:21:33.489006338 +0000 UTC m=+0.156064094 container died 9a399836b4ff06ef50f4e63eb623f83dcc1e3d8835a04b0c94b699923d7c1376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T22:21:34.109 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:21:33 smithi152 podman[122343]: 2024-09-11 22:21:33.891823956 +0000 UTC m=+0.558881705 container cleanup 9a399836b4ff06ef50f4e63eb623f83dcc1e3d8835a04b0c94b699923d7c1376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-11T22:21:34.109 INFO:journalctl@ceph.mgr.x.smithi152.stdout:Sep 11 22:21:33 smithi152 bash[122343]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-x 2024-09-11T22:21:34.249 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-11T22:21:34.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:21:34.284 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-11T22:21:34.285 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-11T22:21:34.285 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.y 2024-09-11T22:21:34.577 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:21:34 smithi179 systemd[1]: Stopping Ceph mgr.y for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:21:34.883 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:21:34 smithi179 podman[72447]: 2024-09-11 22:21:34.629900851 +0000 UTC m=+0.152579290 container died ad81e25ae915ac667d7e39c05e16bd72fefee6c69d23d256bda3e09cb476e83a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T22:21:35.258 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:21:34 smithi179 podman[72447]: 2024-09-11 22:21:34.990654457 +0000 UTC m=+0.513332896 container cleanup ad81e25ae915ac667d7e39c05e16bd72fefee6c69d23d256bda3e09cb476e83a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-11T22:21:35.259 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Sep 11 22:21:34 smithi179 bash[72447]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-y 2024-09-11T22:21:35.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-11T22:21:35.441 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:21:35.441 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-11T22:21:35.441 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-11T22:21:35.441 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.z 2024-09-11T22:21:35.783 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:21:35 smithi193 systemd[1]: Stopping Ceph mgr.z for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:21:36.076 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:21:35 smithi193 podman[73161]: 2024-09-11 22:21:35.800613736 +0000 UTC m=+0.136615480 container died 1e1903b35b26499d458f09a4b59eb0eedf05b3978c8954ebb3b30c7febe8cc14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-11T22:21:36.395 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:21:36 smithi193 podman[73161]: 2024-09-11 22:21:36.194611264 +0000 UTC m=+0.530613049 container cleanup 1e1903b35b26499d458f09a4b59eb0eedf05b3978c8954ebb3b30c7febe8cc14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T22:21:36.396 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 11 22:21:36 smithi193 bash[73161]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mgr-z 2024-09-11T22:21:36.548 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-11T22:21:36.584 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:21:36.584 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-11T22:21:36.584 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-11T22:21:36.584 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.0 2024-09-11T22:21:36.879 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:36 smithi152 systemd[1]: Stopping Ceph osd.0 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:21:37.230 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:36 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0[44734]: 2024-09-11T22:21:36.877+0000 7f973a021640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:21:37.230 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:36 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0[44734]: 2024-09-11T22:21:36.877+0000 7f973a021640 -1 osd.0 110 *** Got signal Terminated *** 2024-09-11T22:21:37.230 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:36 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0[44734]: 2024-09-11T22:21:36.877+0000 7f973a021640 -1 osd.0 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:21:47.303 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:47 smithi152 podman[122467]: 2024-09-11 22:21:47.012626596 +0000 UTC m=+10.238707124 container died e1aa02447d1962506a399b01facd3d26b2689dcf54bc2a27adb1f2f2ef670638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T22:21:47.730 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:47 smithi152 podman[122467]: 2024-09-11 22:21:47.50445417 +0000 UTC m=+10.730534695 container cleanup e1aa02447d1962506a399b01facd3d26b2689dcf54bc2a27adb1f2f2ef670638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-11T22:21:47.730 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:47 smithi152 bash[122467]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0 2024-09-11T22:21:48.070 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:47 smithi152 podman[122487]: 2024-09-11 22:21:47.74725845 +0000 UTC m=+0.736585848 container remove e1aa02447d1962506a399b01facd3d26b2689dcf54bc2a27adb1f2f2ef670638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T22:21:48.334 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:48 smithi152 podman[122576]: 2024-09-11 22:21:47.972777753 +0000 UTC m=+0.015968643 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:21:48.334 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:48 smithi152 podman[122576]: 2024-09-11 22:21:48.090027827 +0000 UTC m=+0.133218711 container create 1cbe489aa2e86fd802d534d958a6fa0d2e986bd98591f373506b2da3cb0c96bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-11T22:21:48.334 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:48 smithi152 podman[122576]: 2024-09-11 22:21:48.33429202 +0000 UTC m=+0.377482912 container init 1cbe489aa2e86fd802d534d958a6fa0d2e986bd98591f373506b2da3cb0c96bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T22:21:48.730 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:48 smithi152 podman[122576]: 2024-09-11 22:21:48.337767659 +0000 UTC m=+0.380958538 container start 1cbe489aa2e86fd802d534d958a6fa0d2e986bd98591f373506b2da3cb0c96bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:21:48.730 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:48 smithi152 podman[122576]: 2024-09-11 22:21:48.434503863 +0000 UTC m=+0.477694780 container attach 1cbe489aa2e86fd802d534d958a6fa0d2e986bd98591f373506b2da3cb0c96bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-11T22:21:48.730 INFO:journalctl@ceph.osd.0.smithi152.stdout:Sep 11 22:21:48 smithi152 podman[122576]: 2024-09-11 22:21:48.526061704 +0000 UTC m=+0.569252591 container died 1cbe489aa2e86fd802d534d958a6fa0d2e986bd98591f373506b2da3cb0c96bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T22:21:49.141 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.0.service' 2024-09-11T22:21:49.183 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:21:49.184 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-11T22:21:49.184 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-11T22:21:49.184 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.1 2024-09-11T22:21:49.504 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:49 smithi179 systemd[1]: Stopping Ceph osd.1 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:21:49.796 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:49 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1[40102]: 2024-09-11T22:21:49.503+0000 7f1089c9a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:21:49.797 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:49 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1[40102]: 2024-09-11T22:21:49.503+0000 7f1089c9a640 -1 osd.1 110 *** Got signal Terminated *** 2024-09-11T22:21:49.797 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:49 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1[40102]: 2024-09-11T22:21:49.503+0000 7f1089c9a640 -1 osd.1 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:21:55.411 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:55 smithi179 podman[72587]: 2024-09-11 22:21:55.096015763 +0000 UTC m=+5.715925762 container died d9f80a2c980366cabd6c994c7d4c572fcb6699fa29005be5880208ad28932010 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T22:21:55.797 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:55 smithi179 podman[72587]: 2024-09-11 22:21:55.411686205 +0000 UTC m=+6.031596203 container cleanup d9f80a2c980366cabd6c994c7d4c572fcb6699fa29005be5880208ad28932010 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T22:21:55.797 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:55 smithi179 bash[72587]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1 2024-09-11T22:21:55.797 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:55 smithi179 podman[72603]: 2024-09-11 22:21:55.612983076 +0000 UTC m=+0.512199849 container remove d9f80a2c980366cabd6c994c7d4c572fcb6699fa29005be5880208ad28932010 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T22:21:56.296 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:56 smithi179 podman[72694]: 2024-09-11 22:21:55.93433769 +0000 UTC m=+0.015499352 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:21:56.297 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:56 smithi179 podman[72694]: 2024-09-11 22:21:56.038882741 +0000 UTC m=+0.120044393 container create af25e8a94f66b054c6159c8c255f99018c1a7efb9877d87137de9a18043f8b66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:21:56.297 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:56 smithi179 podman[72694]: 2024-09-11 22:21:56.249622662 +0000 UTC m=+0.330784316 container init af25e8a94f66b054c6159c8c255f99018c1a7efb9877d87137de9a18043f8b66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:21:56.297 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:56 smithi179 podman[72694]: 2024-09-11 22:21:56.252895353 +0000 UTC m=+0.334057008 container start af25e8a94f66b054c6159c8c255f99018c1a7efb9877d87137de9a18043f8b66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T22:21:56.711 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:56 smithi179 podman[72694]: 2024-09-11 22:21:56.34126898 +0000 UTC m=+0.422430645 container attach af25e8a94f66b054c6159c8c255f99018c1a7efb9877d87137de9a18043f8b66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-11T22:21:56.711 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:56 smithi179 podman[72694]: 2024-09-11 22:21:56.444753912 +0000 UTC m=+0.525915563 container died af25e8a94f66b054c6159c8c255f99018c1a7efb9877d87137de9a18043f8b66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-11T22:21:56.974 INFO:journalctl@ceph.osd.1.smithi179.stdout:Sep 11 22:21:56 smithi179 podman[72717]: 2024-09-11 22:21:56.953300744 +0000 UTC m=+0.503159055 container remove af25e8a94f66b054c6159c8c255f99018c1a7efb9877d87137de9a18043f8b66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T22:21:56.981 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.1.service' 2024-09-11T22:21:57.020 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:21:57.020 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-11T22:21:57.021 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-11T22:21:57.021 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.2 2024-09-11T22:21:57.314 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:21:57 smithi193 systemd[1]: Stopping Ceph osd.2 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:21:57.576 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:21:57 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2[40518]: 2024-09-11T22:21:57.313+0000 7f7d9af3c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:21:57.576 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:21:57 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2[40518]: 2024-09-11T22:21:57.313+0000 7f7d9af3c640 -1 osd.2 110 *** Got signal Terminated *** 2024-09-11T22:21:57.576 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:21:57 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2[40518]: 2024-09-11T22:21:57.313+0000 7f7d9af3c640 -1 osd.2 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:22:03.181 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:22:02 smithi193 podman[73287]: 2024-09-11 22:22:02.921170983 +0000 UTC m=+5.703901111 container died b06f2e13fa8366602208aec0f1cd244323fd444fa02caa24e847fc08ba6443bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T22:22:03.548 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:22:03 smithi193 podman[73287]: 2024-09-11 22:22:03.280186284 +0000 UTC m=+6.062916412 container cleanup b06f2e13fa8366602208aec0f1cd244323fd444fa02caa24e847fc08ba6443bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-11T22:22:03.548 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:22:03 smithi193 bash[73287]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2 2024-09-11T22:22:03.826 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:22:03 smithi193 podman[73302]: 2024-09-11 22:22:03.547944431 +0000 UTC m=+0.622967259 container remove b06f2e13fa8366602208aec0f1cd244323fd444fa02caa24e847fc08ba6443bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-11T22:22:04.226 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:22:03 smithi193 podman[73392]: 2024-09-11 22:22:03.794618607 +0000 UTC m=+0.015810122 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:22:04.227 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:22:03 smithi193 podman[73392]: 2024-09-11 22:22:03.916075881 +0000 UTC m=+0.137267394 container create f30013392b37d24ba032bd215ced6a57b2e39f299eac48e9ab14f7f2a9c8a008 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-11T22:22:04.227 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:22:04 smithi193 podman[73392]: 2024-09-11 22:22:04.134998085 +0000 UTC m=+0.356189604 container init f30013392b37d24ba032bd215ced6a57b2e39f299eac48e9ab14f7f2a9c8a008 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T22:22:04.227 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:22:04 smithi193 podman[73392]: 2024-09-11 22:22:04.138312431 +0000 UTC m=+0.359503945 container start f30013392b37d24ba032bd215ced6a57b2e39f299eac48e9ab14f7f2a9c8a008 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-11T22:22:04.227 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:22:04 smithi193 podman[73392]: 2024-09-11 22:22:04.226623596 +0000 UTC m=+0.447815112 container attach f30013392b37d24ba032bd215ced6a57b2e39f299eac48e9ab14f7f2a9c8a008 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-11T22:22:04.576 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 11 22:22:04 smithi193 podman[73392]: 2024-09-11 22:22:04.33071477 +0000 UTC m=+0.551906294 container died f30013392b37d24ba032bd215ced6a57b2e39f299eac48e9ab14f7f2a9c8a008 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-11T22:22:04.954 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.2.service' 2024-09-11T22:22:04.997 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:22:04.997 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-11T22:22:04.997 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-11T22:22:04.997 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.3 2024-09-11T22:22:05.341 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:05 smithi152 systemd[1]: Stopping Ceph osd.3 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:22:05.730 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:05 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3[51231]: 2024-09-11T22:22:05.340+0000 7fb50ab49640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:22:05.730 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:05 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3[51231]: 2024-09-11T22:22:05.340+0000 7fb50ab49640 -1 osd.3 110 *** Got signal Terminated *** 2024-09-11T22:22:05.730 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:05 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3[51231]: 2024-09-11T22:22:05.340+0000 7fb50ab49640 -1 osd.3 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:22:08.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:08 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:08.146+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:08.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:08 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:08.552+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:09.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:09 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:09.135+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:09.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:09 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:09.470+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:09.979 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:09 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:09.544+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:10.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:10 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:10.121+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:10.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:10 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:10.472+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:10.826 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:10 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:10.496+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:10.959 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:10 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:10.559+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:11.230 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:10 smithi152 podman[122689]: 2024-09-11 22:22:10.959286332 +0000 UTC m=+5.753377348 container died b7b798a487179f4e2325733bc5b2b5108e43c2cd3bae520eeb06d2851252110c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T22:22:11.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:11 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:11.141+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:11.531 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:11 smithi152 podman[122689]: 2024-09-11 22:22:11.415778795 +0000 UTC m=+6.209869800 container cleanup b7b798a487179f4e2325733bc5b2b5108e43c2cd3bae520eeb06d2851252110c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T22:22:11.531 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:11 smithi152 bash[122689]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3 2024-09-11T22:22:11.826 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:11 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:11.461+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:11.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:11 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:11.494+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:11.981 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:11 smithi152 podman[122705]: 2024-09-11 22:22:11.584397197 +0000 UTC m=+0.619432936 container remove b7b798a487179f4e2325733bc5b2b5108e43c2cd3bae520eeb06d2851252110c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-11T22:22:11.981 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:11 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:11.530+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:12.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:11 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:11.627+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:12.337 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:12 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:12.135+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:12.338 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:12 smithi152 podman[122793]: 2024-09-11 22:22:11.931810126 +0000 UTC m=+0.015809113 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:22:12.338 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:12 smithi152 podman[122793]: 2024-09-11 22:22:12.043644848 +0000 UTC m=+0.127643867 container create 03883a94401bcd272761e9348ebd05ab5fa0d2e539b314acab3f00c570a6d56f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T22:22:12.338 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:12 smithi152 podman[122793]: 2024-09-11 22:22:12.254719673 +0000 UTC m=+0.338718670 container init 03883a94401bcd272761e9348ebd05ab5fa0d2e539b314acab3f00c570a6d56f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:22:12.338 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:12 smithi152 podman[122793]: 2024-09-11 22:22:12.258129785 +0000 UTC m=+0.342128763 container start 03883a94401bcd272761e9348ebd05ab5fa0d2e539b314acab3f00c570a6d56f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T22:22:12.338 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:12 smithi152 podman[122793]: 2024-09-11 22:22:12.33796482 +0000 UTC m=+0.421963800 container attach 03883a94401bcd272761e9348ebd05ab5fa0d2e539b314acab3f00c570a6d56f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-11T22:22:12.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:12 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:12.486+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:12.730 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 11 22:22:12 smithi152 podman[122793]: 2024-09-11 22:22:12.450934133 +0000 UTC m=+0.534933121 container died 03883a94401bcd272761e9348ebd05ab5fa0d2e539b314acab3f00c570a6d56f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-11T22:22:12.826 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:12.477+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:12.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:12.476+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:13.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:12 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:12.651+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:13.049 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.3.service' 2024-09-11T22:22:13.089 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:22:13.089 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-11T22:22:13.089 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-11T22:22:13.089 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.4 2024-09-11T22:22:13.414 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:13 smithi179 systemd[1]: Stopping Ceph osd.4 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:22:13.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:13 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:13.143+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:13.796 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:13 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:13.656+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:13.796 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:13 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4[47038]: 2024-09-11T22:22:13.413+0000 7f9ff6ad3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:22:13.797 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:13 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4[47038]: 2024-09-11T22:22:13.413+0000 7f9ff6ad3640 -1 osd.4 110 *** Got signal Terminated *** 2024-09-11T22:22:13.797 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:13 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4[47038]: 2024-09-11T22:22:13.413+0000 7f9ff6ad3640 -1 osd.4 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:22:13.826 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:13 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:13.459+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:13.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:13 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:13.446+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:13.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:13 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:13.530+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:14.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:14.121+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:14.826 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:14 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:14.495+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:14.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:14 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:14.397+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:14.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:14 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:14.523+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:15.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:14 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:14.663+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:15.479 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:15 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:15.087+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:15.771 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:15 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:15.515+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:15.771 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:15 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:15.409+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:15.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:15 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:15.555+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:16.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:15 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:15.797+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:16.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:15 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:15.680+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:16.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:16.054+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:16.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:16.054+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:16.691 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:16 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:16.417+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:16.691 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:16 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:16.502+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:16.691 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:16 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:16.502+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.728501+0000 front 2024-09-11T22:21:52.728422+0000 (oldest deadline 2024-09-11T22:22:15.628397+0000) 2024-09-11T22:22:16.979 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:16.588+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:17.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:16 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:16.813+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:17.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:16 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:16.706+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:17.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:16 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:16.706+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:17.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:16 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:16.690+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:17.479 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:17.044+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:17.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:17.044+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:17.546 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:17 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4[47038]: 2024-09-11T22:22:17.285+0000 7f9fef0d0640 -1 osd.4 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.498726+0000 front 2024-09-11T22:21:53.498809+0000 (oldest deadline 2024-09-11T22:22:16.998916+0000) 2024-09-11T22:22:17.713 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:17 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:17.462+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:17.713 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:17 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:17.462+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.728501+0000 front 2024-09-11T22:21:52.728422+0000 (oldest deadline 2024-09-11T22:22:15.628397+0000) 2024-09-11T22:22:17.713 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:17 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:17.387+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:17.714 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:17 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:17.387+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:17.752 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:17 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:17.551+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:18.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:17 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:17.801+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:18.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:17 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:17.747+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:18.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:17 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:17.747+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:18.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:17 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:17.712+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:18.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:18 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:18.072+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:18.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:18 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:18.072+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:18.546 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:18 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4[47038]: 2024-09-11T22:22:18.243+0000 7f9fef0d0640 -1 osd.4 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.498726+0000 front 2024-09-11T22:21:53.498809+0000 (oldest deadline 2024-09-11T22:22:16.998916+0000) 2024-09-11T22:22:18.672 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:18 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:18.412+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:18.673 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:18 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:18.412+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:18.673 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:18 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:18.494+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:18.673 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:18 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:18.494+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.728501+0000 front 2024-09-11T22:21:52.728422+0000 (oldest deadline 2024-09-11T22:22:15.628397+0000) 2024-09-11T22:22:18.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:18 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:18.576+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:18.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:18 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:18.576+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:19.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:18 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:18.851+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:19.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:18 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:18.712+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:19.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:18 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:18.712+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:19.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:18 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:18.671+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:19.389 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:19 smithi179 podman[72813]: 2024-09-11 22:22:19.086134078 +0000 UTC m=+5.796887849 container died 69c23a4875fc7bc20ab89322b32026423f042cf8454e7f9e0ca968c27e48439b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T22:22:19.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:19.077+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:19.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:19.077+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:19.673 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:19 smithi179 podman[72813]: 2024-09-11 22:22:19.497267033 +0000 UTC m=+6.208020803 container cleanup 69c23a4875fc7bc20ab89322b32026423f042cf8454e7f9e0ca968c27e48439b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T22:22:19.673 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:19 smithi179 bash[72813]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4 2024-09-11T22:22:19.717 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:19 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:19.388+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:19.718 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:19 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:19.388+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:19.718 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:19 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:19.540+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:19.718 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:19 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:19.540+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.728501+0000 front 2024-09-11T22:21:52.728422+0000 (oldest deadline 2024-09-11T22:22:15.628397+0000) 2024-09-11T22:22:19.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:19.601+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:19.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:19 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:19.601+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:19.990 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:19 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:19.820+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:19.991 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:19 smithi179 podman[72829]: 2024-09-11 22:22:19.673617276 +0000 UTC m=+0.589729783 container remove 69c23a4875fc7bc20ab89322b32026423f042cf8454e7f9e0ca968c27e48439b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T22:22:19.991 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:19 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:19.732+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:19.991 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:19 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:19.732+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:20.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:19 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:19.716+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:20.276 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:19 smithi179 podman[72915]: 2024-09-11 22:22:19.991023909 +0000 UTC m=+0.106092338 container create a3f29d3355bd131d03c2f3018be6013034bccc9cdfb9c8ba9eb07589364b9035 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-11T22:22:20.277 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:19 smithi179 podman[72915]: 2024-09-11 22:22:19.900814449 +0000 UTC m=+0.015882879 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:22:20.277 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:20 smithi179 podman[72915]: 2024-09-11 22:22:20.201711339 +0000 UTC m=+0.316779772 container init a3f29d3355bd131d03c2f3018be6013034bccc9cdfb9c8ba9eb07589364b9035 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T22:22:20.277 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:20 smithi179 podman[72915]: 2024-09-11 22:22:20.204886367 +0000 UTC m=+0.319954798 container start a3f29d3355bd131d03c2f3018be6013034bccc9cdfb9c8ba9eb07589364b9035 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-11T22:22:20.277 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:20 smithi179 podman[72915]: 2024-09-11 22:22:20.276557008 +0000 UTC m=+0.391625446 container attach a3f29d3355bd131d03c2f3018be6013034bccc9cdfb9c8ba9eb07589364b9035 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-11T22:22:20.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:20 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:20.091+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:20.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:20 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:20.091+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:20.546 INFO:journalctl@ceph.osd.4.smithi179.stdout:Sep 11 22:22:20 smithi179 podman[72915]: 2024-09-11 22:22:20.393634465 +0000 UTC m=+0.508702910 container died a3f29d3355bd131d03c2f3018be6013034bccc9cdfb9c8ba9eb07589364b9035 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:22:20.713 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:20 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:20.433+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:20.713 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:20 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:20.433+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:20.714 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:20 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:20.537+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:20.714 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:20 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:20.537+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.728501+0000 front 2024-09-11T22:21:52.728422+0000 (oldest deadline 2024-09-11T22:22:15.628397+0000) 2024-09-11T22:22:20.884 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.4.service' 2024-09-11T22:22:20.921 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:20 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:20.809+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:20.924 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:20 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:20.751+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:20.924 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:20 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:20.751+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:20.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:22:20.926 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-11T22:22:20.926 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-11T22:22:20.927 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.5 2024-09-11T22:22:20.973 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:20 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:20.712+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:20.979 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:20 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:20.648+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:20.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:20 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:20.648+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:21.241 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:20 smithi193 systemd[1]: Stopping Ceph osd.5 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:22:21.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:21 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:21.043+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:21.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:21 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:21.043+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:21.574 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:21 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:21.480+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:21.574 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:21 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:21.480+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:21.574 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:21 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:21.240+0000 7f29d1b2f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:22:21.574 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:21 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:21.240+0000 7f29d1b2f640 -1 osd.5 110 *** Got signal Terminated *** 2024-09-11T22:22:21.574 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:21 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:21.240+0000 7f29d1b2f640 -1 osd.5 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:22:21.575 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:21 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:21.573+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:21.575 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:21 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:21.573+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.728501+0000 front 2024-09-11T22:21:52.728422+0000 (oldest deadline 2024-09-11T22:22:15.628397+0000) 2024-09-11T22:22:21.826 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:21 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:21.753+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:21.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:21 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:21.694+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:21.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:21 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:21.694+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:22.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:21 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:21.814+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:22.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:21 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:21.744+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:22.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:21 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:21.744+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:22.479 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:22 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:22.045+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:22.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:22 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:22.045+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:22.789 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:22.594+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:22.789 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:22.594+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.728501+0000 front 2024-09-11T22:21:52.728422+0000 (oldest deadline 2024-09-11T22:22:15.628397+0000) 2024-09-11T22:22:22.790 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:22.449+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:22.790 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:22.449+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:22.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:22 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:22.664+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:22.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:22 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:22.664+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:23.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:22.858+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:23.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:22.725+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:23.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:22 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:22.725+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:23.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:22 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:22.788+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:23.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:23 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:23.001+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:23.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:23 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:23.001+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:23.752 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:23 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:23.416+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:23.752 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:23 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:23.416+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:23.753 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:23 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:23.560+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:23.753 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:23 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:23.560+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.728501+0000 front 2024-09-11T22:21:52.728422+0000 (oldest deadline 2024-09-11T22:22:15.628397+0000) 2024-09-11T22:22:23.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:23 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:23.664+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:23.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:23 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:23.664+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:24.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:23 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:23.860+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:24.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:23 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:23.712+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:24.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:23 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:23.712+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:24.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:23 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:23.752+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:24.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:23 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:23.995+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:24.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:23 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:23.995+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:24.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:23 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:23.995+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:02.029019+0000 front 2024-09-11T22:22:02.029168+0000 (oldest deadline 2024-09-11T22:22:23.729114+0000) 2024-09-11T22:22:24.780 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:24 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:24.530+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:24.780 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:24 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:24.530+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.728501+0000 front 2024-09-11T22:21:52.728422+0000 (oldest deadline 2024-09-11T22:22:15.628397+0000) 2024-09-11T22:22:24.781 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:24 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:24.418+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:24.781 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:24 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:24.418+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:24.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:24 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:24.657+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:24.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:24 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:24.657+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:25.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:24 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:24.894+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:25.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:24 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:24.755+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:25.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:24 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:24.755+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:25.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:24 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:24.779+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:25.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:25.039+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:25.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:25.039+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:25.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:25.039+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:02.029019+0000 front 2024-09-11T22:22:02.029168+0000 (oldest deadline 2024-09-11T22:22:23.729114+0000) 2024-09-11T22:22:25.810 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:25 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:25.552+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:38.126358+0000 front 2024-09-11T22:21:38.126403+0000 (oldest deadline 2024-09-11T22:22:09.927012+0000) 2024-09-11T22:22:25.811 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:25 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5[47299]: 2024-09-11T22:22:25.552+0000 7f29ce134640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.728501+0000 front 2024-09-11T22:21:52.728422+0000 (oldest deadline 2024-09-11T22:22:15.628397+0000) 2024-09-11T22:22:25.811 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:25 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:25.407+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:25.811 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:25 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:25.407+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:25.811 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:25 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:25.407+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:25.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:25.648+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:25.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:25.648+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:25.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:25 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:25.648+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:26.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:25 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:25.943+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:26.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:25 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:25.782+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:26.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:25 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:25.782+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:26.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:25 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:25.782+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:26.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:25 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:25.810+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:26.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:25 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:25.810+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:26.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:26.015+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:26.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:26.015+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:26.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:26.015+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:02.029019+0000 front 2024-09-11T22:22:02.029168+0000 (oldest deadline 2024-09-11T22:22:23.729114+0000) 2024-09-11T22:22:26.776 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:26 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:26.445+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:26.776 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:26 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:26.445+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:26.776 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:26 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:26.445+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:26.971 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:26.613+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:26.971 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:26.613+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:26.971 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:26.613+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:27.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:26 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:26.966+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:27.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:26 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:26.781+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:27.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:26 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:26.781+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:27.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:26 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:26.781+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:27.066 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:26 smithi193 podman[73508]: 2024-09-11 22:22:26.775935322 +0000 UTC m=+5.654964410 container died 60ec5612dc7a7b802ad36748a19fe32e301840c37a44360878c65f04a5c82be2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:22:27.066 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:26 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:26.789+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:27.066 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:26 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:26.789+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:27.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:26.970+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:27.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:26.970+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:27.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:26 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:26.970+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:02.029019+0000 front 2024-09-11T22:22:02.029168+0000 (oldest deadline 2024-09-11T22:22:23.729114+0000) 2024-09-11T22:22:27.326 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:27 smithi193 podman[73508]: 2024-09-11 22:22:27.165110248 +0000 UTC m=+6.044139333 container cleanup 60ec5612dc7a7b802ad36748a19fe32e301840c37a44360878c65f04a5c82be2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T22:22:27.326 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:27 smithi193 bash[73508]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5 2024-09-11T22:22:27.726 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:27 smithi193 podman[73522]: 2024-09-11 22:22:27.416671768 +0000 UTC m=+0.636432776 container remove 60ec5612dc7a7b802ad36748a19fe32e301840c37a44360878c65f04a5c82be2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T22:22:27.726 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:27 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:27.479+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:27.726 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:27 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:27.479+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:27.726 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:27 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:27.479+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:27.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:27 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:27.595+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:27.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:27 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:27.595+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:27.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:27 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:27.595+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:28.028 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:27 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:27.820+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:28.029 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:27 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:27.820+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:28.029 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:27 smithi193 podman[73607]: 2024-09-11 22:22:27.628789153 +0000 UTC m=+0.015621651 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:22:28.029 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:27 smithi193 podman[73607]: 2024-09-11 22:22:27.734092008 +0000 UTC m=+0.120924541 container create 74b407464503fbb19bf88225975bef679767497b2a6440cc47ab5dc3afba541a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T22:22:28.029 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:27 smithi193 podman[73607]: 2024-09-11 22:22:27.953259576 +0000 UTC m=+0.340092074 container init 74b407464503fbb19bf88225975bef679767497b2a6440cc47ab5dc3afba541a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T22:22:28.029 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:27 smithi193 podman[73607]: 2024-09-11 22:22:27.956542991 +0000 UTC m=+0.343375489 container start 74b407464503fbb19bf88225975bef679767497b2a6440cc47ab5dc3afba541a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T22:22:28.029 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:28 smithi193 podman[73607]: 2024-09-11 22:22:28.028078124 +0000 UTC m=+0.414910616 container attach 74b407464503fbb19bf88225975bef679767497b2a6440cc47ab5dc3afba541a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=) 2024-09-11T22:22:28.296 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:27 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:27.953+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:28.297 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:27 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:27.953+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:28.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:27 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:27.807+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:28.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:27 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:27.807+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:28.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:27 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:27.807+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:28.326 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 11 22:22:28 smithi193 podman[73631]: 2024-09-11 22:22:28.168535496 +0000 UTC m=+0.016691093 container died 74b407464503fbb19bf88225975bef679767497b2a6440cc47ab5dc3afba541a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-11T22:22:28.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:28.006+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:28.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:28.006+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:28.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:28.006+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:02.029019+0000 front 2024-09-11T22:22:02.029168+0000 (oldest deadline 2024-09-11T22:22:23.729114+0000) 2024-09-11T22:22:28.698 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:28 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:28.462+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:28.698 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:28 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:28.462+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:28.698 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:28 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:28.462+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:28.713 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.5.service' 2024-09-11T22:22:28.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:22:28.753 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-11T22:22:28.753 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-11T22:22:28.753 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.6 2024-09-11T22:22:28.977 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:28 smithi152 systemd[1]: Stopping Ceph osd.6 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:22:28.977 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:28.643+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:28.977 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:28.643+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:28.977 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:28.643+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:29.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:28 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:28.952+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:29.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:28 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:28.952+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:29.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:28 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:28.777+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:29.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:28 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:28.777+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:29.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:28 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:28.777+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:29.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:28 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:28.775+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:29.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:28 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:28.775+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:29.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:28.976+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:29.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:28.976+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:29.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:28 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:28.976+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:02.029019+0000 front 2024-09-11T22:22:02.029168+0000 (oldest deadline 2024-09-11T22:22:23.729114+0000) 2024-09-11T22:22:29.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:29.077+0000 7fe393b28640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:22:29.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:29.077+0000 7fe393b28640 -1 osd.6 110 *** Got signal Terminated *** 2024-09-11T22:22:29.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:29.077+0000 7fe393b28640 -1 osd.6 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:22:29.771 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:29 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:29.504+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:29.771 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:29 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:29.504+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:29.771 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:29 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:29.504+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:29.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:29.608+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:29.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:29.608+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:29.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:29.608+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:30.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:29 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:29.912+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:30.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:29 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:29.912+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:30.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:29 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:29.736+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:30.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:29 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:29.736+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:30.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:29 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:29.736+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:30.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:29 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:29.770+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:30.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:29 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:29.770+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:30.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:29.980+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:30.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:29.980+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:30.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:29 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:29.980+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:02.029019+0000 front 2024-09-11T22:22:02.029168+0000 (oldest deadline 2024-09-11T22:22:23.729114+0000) 2024-09-11T22:22:30.791 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:30 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:30.476+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:30.791 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:30 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:30.476+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:30.792 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:30 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:30.476+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:30.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:30 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:30.598+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:30.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:30 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:30.598+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:30.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:30 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:30.598+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:31.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:30 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:30.875+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:31.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:30 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:30.875+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:31.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:30 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:30.775+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:31.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:30 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:30.775+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:31.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:30 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:30.775+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:31.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:30 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:30.790+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:31.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:30 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:30.790+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:31.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:31.025+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:31.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:31.025+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:31.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:31.025+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:02.029019+0000 front 2024-09-11T22:22:02.029168+0000 (oldest deadline 2024-09-11T22:22:23.729114+0000) 2024-09-11T22:22:31.795 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:31 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:31.495+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:31.795 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:31 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:31.495+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:31.796 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:31 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:31.495+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:31.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:31.629+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:31.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:31.629+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:31.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:31.629+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:32.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:31 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:31.828+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:32.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:31 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:31.828+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:32.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:31 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:31.767+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:32.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:31 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:31.767+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:32.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:31 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:31.767+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:32.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:31 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:31.767+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:32.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:31 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:31.794+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:32.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:31 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:31.794+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:32.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:31 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:31.794+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:32.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:31.996+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:32.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:31.996+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:32.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:31.996+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:02.029019+0000 front 2024-09-11T22:22:02.029168+0000 (oldest deadline 2024-09-11T22:22:23.729114+0000) 2024-09-11T22:22:32.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:31 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:31.996+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.230870+0000 front 2024-09-11T22:22:08.230908+0000 (oldest deadline 2024-09-11T22:22:31.730929+0000) 2024-09-11T22:22:32.758 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:32 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:32.506+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:32.758 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:32 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:32.506+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:32.758 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:32 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:32.506+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:32.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:32 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:32.634+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:32.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:32 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:32.634+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:32.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:32 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:32.634+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:33.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:32 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:32.849+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:33.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:32 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:32.849+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:33.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:32 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:32.849+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.265154+0000 front 2024-09-11T22:22:09.265127+0000 (oldest deadline 2024-09-11T22:22:32.165149+0000) 2024-09-11T22:22:33.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:32 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:32.795+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:33.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:32 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:32.795+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:33.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:32 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:32.795+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:33.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:32 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:32.795+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:33.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:32 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:32.757+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:33.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:32 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:32.757+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:33.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:32 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:32.757+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:33.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:33 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:33.026+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:33.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:33 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:33.026+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:33.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:33 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:33.026+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:02.029019+0000 front 2024-09-11T22:22:02.029168+0000 (oldest deadline 2024-09-11T22:22:23.729114+0000) 2024-09-11T22:22:33.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:33 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:33.026+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.230870+0000 front 2024-09-11T22:22:08.230908+0000 (oldest deadline 2024-09-11T22:22:31.730929+0000) 2024-09-11T22:22:33.800 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:33 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:33.506+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:33.800 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:33 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:33.506+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:33.800 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:33 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:33.506+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:33.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:33 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:33.612+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:33.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:33 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:33.612+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:33.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:33 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:33.612+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:33.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:33 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:33.612+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:34.068 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:33 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:33.799+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:34.068 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:33 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:33.799+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:34.068 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:33 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:33.799+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:34.296 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:33 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:33.822+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:34.297 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:33 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:33.822+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:34.297 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:33 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:33.822+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.265154+0000 front 2024-09-11T22:22:09.265127+0000 (oldest deadline 2024-09-11T22:22:32.165149+0000) 2024-09-11T22:22:34.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:33 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:33.800+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:34.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:33 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:33.800+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:34.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:33 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:33.800+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:34.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:33 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:33.800+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:34.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:34 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:34.071+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:41.725654+0000 front 2024-09-11T22:21:41.725692+0000 (oldest deadline 2024-09-11T22:22:07.526083+0000) 2024-09-11T22:22:34.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:34 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:34.071+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.827311+0000 front 2024-09-11T22:21:52.827361+0000 (oldest deadline 2024-09-11T22:22:15.727042+0000) 2024-09-11T22:22:34.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:34 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:34.071+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:02.029019+0000 front 2024-09-11T22:22:02.029168+0000 (oldest deadline 2024-09-11T22:22:23.729114+0000) 2024-09-11T22:22:34.480 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:34 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6[58043]: 2024-09-11T22:22:34.071+0000 7fe38c125640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.230870+0000 front 2024-09-11T22:22:08.230908+0000 (oldest deadline 2024-09-11T22:22:31.730929+0000) 2024-09-11T22:22:34.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:34 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:34.489+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:34.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:34 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:34.489+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:34.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:34 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:34.489+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:34.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:34 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:34.489+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:34.961 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:34 smithi152 podman[122906]: 2024-09-11 22:22:34.687143325 +0000 UTC m=+5.737617064 container died e4e6a223e6efa4b672f80c7a9a8d4b8834088dac0bd0f8f0350cb833393bb80a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:22:34.962 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:34 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:34.594+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:34.962 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:34 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:34.595+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:34.962 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:34 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:34.595+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:34.962 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:34 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:34.595+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:35.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:34 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:34.836+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:35.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:34 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:34.836+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:35.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:34 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:34.836+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.265154+0000 front 2024-09-11T22:22:09.265127+0000 (oldest deadline 2024-09-11T22:22:32.165149+0000) 2024-09-11T22:22:35.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:34 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:34.766+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:35.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:34 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:34.766+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:35.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:34 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:34.766+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:35.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:34 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:34.766+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:35.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:35 smithi152 podman[122906]: 2024-09-11 22:22:35.060857105 +0000 UTC m=+6.111330840 container cleanup e4e6a223e6efa4b672f80c7a9a8d4b8834088dac0bd0f8f0350cb833393bb80a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-11T22:22:35.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:35 smithi152 bash[122906]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6 2024-09-11T22:22:35.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:34 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:34.836+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:35.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:34 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:34.837+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:35.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:34 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:34.837+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:35.639 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:35 smithi152 podman[122923]: 2024-09-11 22:22:35.328914941 +0000 UTC m=+0.635959610 container remove e4e6a223e6efa4b672f80c7a9a8d4b8834088dac0bd0f8f0350cb833393bb80a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T22:22:35.640 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:35.567+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:35.640 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:35.567+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:35.640 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:35.567+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:35.640 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:35 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:35.567+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:35.802 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:35 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:35.483+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:35.803 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:35 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:35.483+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:35.803 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:35 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:35.483+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:35.803 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:35 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:35.483+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:35.971 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:35 smithi152 podman[123011]: 2024-09-11 22:22:35.542610021 +0000 UTC m=+0.015943068 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:22:35.971 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:35 smithi152 podman[123011]: 2024-09-11 22:22:35.663412468 +0000 UTC m=+0.136745506 container create adeeae1f8742328c27035013a76a28ac51f60d8a868c8d0227650a17ab04a851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:22:35.971 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:35 smithi152 podman[123011]: 2024-09-11 22:22:35.874297332 +0000 UTC m=+0.347630370 container init adeeae1f8742328c27035013a76a28ac51f60d8a868c8d0227650a17ab04a851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:22:35.971 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:35 smithi152 podman[123011]: 2024-09-11 22:22:35.8776529 +0000 UTC m=+0.350985949 container start adeeae1f8742328c27035013a76a28ac51f60d8a868c8d0227650a17ab04a851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-11T22:22:36.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:35 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:35.848+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:36.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:35 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:35.848+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:36.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:35 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:35.848+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.265154+0000 front 2024-09-11T22:22:09.265127+0000 (oldest deadline 2024-09-11T22:22:32.165149+0000) 2024-09-11T22:22:36.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:35 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:35.726+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:36.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:35 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:35.726+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:36.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:35 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:35.726+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:36.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:35 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:35.726+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:36.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:35 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:35.802+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:36.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:35 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:35.802+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:36.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:35 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:35.802+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:36.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:35 smithi152 podman[123011]: 2024-09-11 22:22:35.970932528 +0000 UTC m=+0.444265574 container attach adeeae1f8742328c27035013a76a28ac51f60d8a868c8d0227650a17ab04a851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:22:36.230 INFO:journalctl@ceph.osd.6.smithi152.stdout:Sep 11 22:22:36 smithi152 podman[123011]: 2024-09-11 22:22:36.074190705 +0000 UTC m=+0.547523743 container died adeeae1f8742328c27035013a76a28ac51f60d8a868c8d0227650a17ab04a851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-11T22:22:36.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:36 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:36.538+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:36.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:36 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:36.538+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:36.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:36 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:36.538+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:36.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:36 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:36.538+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:36.757 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.6.service' 2024-09-11T22:22:36.798 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:22:36.798 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-11T22:22:36.798 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-11T22:22:36.799 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.7 2024-09-11T22:22:36.810 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:36 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:36.505+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:36.810 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:36 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:36.505+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:36.810 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:36 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:36.505+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:36.810 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:36 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:36.505+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:37.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:36 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:36.813+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:37.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:36 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:36.813+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:37.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:36 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:36.813+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.265154+0000 front 2024-09-11T22:22:09.265127+0000 (oldest deadline 2024-09-11T22:22:32.165149+0000) 2024-09-11T22:22:37.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:36 smithi179 systemd[1]: Stopping Ceph osd.7 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:22:37.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:36 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:36.750+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:37.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:36 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:36.750+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:37.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:36 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:36.750+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:37.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:36 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:36.750+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:37.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:36 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:36.809+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:37.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:36 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:36.809+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:37.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:36 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:36.809+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:37.546 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:37 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:37.082+0000 7f89f22d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:22:37.547 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:37 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:37.082+0000 7f89f22d1640 -1 osd.7 110 *** Got signal Terminated *** 2024-09-11T22:22:37.547 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:37 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:37.082+0000 7f89f22d1640 -1 osd.7 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:22:37.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:37 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:37.561+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:37.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:37 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:37.561+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:37.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:37 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:37.561+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:37.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:37 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:37.561+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:37.774 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:37 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:37.465+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:37.774 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:37 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:37.465+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:37.774 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:37 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:37.465+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:37.774 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:37 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:37.465+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:38.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:37 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:37.859+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:38.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:37 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:37.859+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:38.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:37 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:37.859+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.265154+0000 front 2024-09-11T22:22:09.265127+0000 (oldest deadline 2024-09-11T22:22:32.165149+0000) 2024-09-11T22:22:38.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:37 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:37.770+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:38.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:37 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:37.770+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:38.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:37 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:37.770+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:38.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:37 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:37.770+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:38.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:37 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:37.773+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:38.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:37 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:37.773+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:38.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:37 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:37.773+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:38.826 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:38 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:38.728+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:38.827 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:38 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:38.728+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:38.827 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:38 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:38.728+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:38.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:38 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:38.505+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:38.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:38 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:38.505+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:38.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:38 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:38.505+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:38.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:38 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:38.505+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:38.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:38 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:38.588+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:38.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:38 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:38.588+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:38.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:38 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:38.588+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:38.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:38 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:38.588+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:39.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:38 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:38.899+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:39.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:38 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:38.899+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:39.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:38 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:38.899+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.265154+0000 front 2024-09-11T22:22:09.265127+0000 (oldest deadline 2024-09-11T22:22:32.165149+0000) 2024-09-11T22:22:39.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:38 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:38.760+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:39.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:38 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:38.760+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:39.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:38 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:38.760+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:39.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:38 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:38.760+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:39.826 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:39 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:39.773+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:39.827 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:39 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:39.773+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:39.827 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:39 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:39.773+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:39.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:39 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:39.554+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:39.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:39 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:39.554+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:39.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:39 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:39.554+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:39.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:39 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:39.554+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:39.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:39 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:39.588+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:39.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:39 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:39.588+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:39.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:39 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:39.588+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:39.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:39 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:39.588+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:40.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:39 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:39.746+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:40.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:39 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:39.746+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:40.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:39 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:39.746+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:40.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:39 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:39.746+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:40.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:39 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:39.950+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:40.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:39 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:39.950+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:40.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:39 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:39.950+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.265154+0000 front 2024-09-11T22:22:09.265127+0000 (oldest deadline 2024-09-11T22:22:32.165149+0000) 2024-09-11T22:22:40.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:40 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:40.583+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:40.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:40 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:40.583+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:40.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:40 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:40.583+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:40.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:40 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:40.583+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:41.046 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:40 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:40.991+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:41.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:40 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:40.991+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:41.047 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:40 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:40.991+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.265154+0000 front 2024-09-11T22:22:09.265127+0000 (oldest deadline 2024-09-11T22:22:32.165149+0000) 2024-09-11T22:22:41.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:40 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:40.773+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:41.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:40 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:40.773+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:41.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:40 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:40.773+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:41.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:40 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:40.773+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:41.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:40 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:40.780+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:41.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:40 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:40.780+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:41.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:40 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:40.780+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:41.076 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:40 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:40.586+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:41.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:40 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:40.586+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:41.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:40 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:40.586+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:41.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:40 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:40.586+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:41.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:41 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:41.616+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:41.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:41 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:41.616+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:41.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:41 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:41.616+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:41.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:41 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:41.616+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:42.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:41 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:41.790+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:42.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:41 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:41.790+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:42.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:41 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:41.790+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:42.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:41 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:41.790+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.374742+0000 front 2024-09-11T22:22:17.374852+0000 (oldest deadline 2024-09-11T22:22:40.874606+0000) 2024-09-11T22:22:42.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:41 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:41.612+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:42.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:41 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:41.612+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:42.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:41 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:41.612+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:42.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:41 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:41.612+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:42.296 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:42 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:42.037+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.260190+0000 front 2024-09-11T22:21:49.260377+0000 (oldest deadline 2024-09-11T22:22:15.160280+0000) 2024-09-11T22:22:42.297 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:42 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:42.037+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.863482+0000 front 2024-09-11T22:22:01.863211+0000 (oldest deadline 2024-09-11T22:22:27.063777+0000) 2024-09-11T22:22:42.297 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:42 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7[53584]: 2024-09-11T22:22:42.037+0000 7f89ea8ce640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.265154+0000 front 2024-09-11T22:22:09.265127+0000 (oldest deadline 2024-09-11T22:22:32.165149+0000) 2024-09-11T22:22:42.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:41 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:41.820+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:42.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:41 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:41.820+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:42.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:41 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:41.820+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:42.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:41 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:41.820+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:42.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:41 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:41.820+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:42.975 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:42 smithi179 podman[73018]: 2024-09-11 22:22:42.687899368 +0000 UTC m=+5.693947427 container died 12e2f035b75f070a53da93c26d01adb463069a90cf243971bf69948457298c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T22:22:42.976 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:42 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:42.784+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:42.976 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:42 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:42.784+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:42.976 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:42 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:42.784+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:42.976 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:42 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:42.784+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:42.976 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:42 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:42.784+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:42.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:42 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:42.590+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:42.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:42 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:42.590+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:42.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:42 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:42.590+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:42.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:42 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:42.590+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:43.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:42 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:42.821+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:43.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:42 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:42.821+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:43.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:42 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:42.821+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:43.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:42 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:42.821+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.374742+0000 front 2024-09-11T22:22:17.374852+0000 (oldest deadline 2024-09-11T22:22:40.874606+0000) 2024-09-11T22:22:43.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:42 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:42.581+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:43.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:42 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:42.581+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:43.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:42 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:42.581+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:43.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:42 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:42.581+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:43.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:42 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:42.581+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:43.291 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:43 smithi179 podman[73018]: 2024-09-11 22:22:43.073733434 +0000 UTC m=+6.079781482 container cleanup 12e2f035b75f070a53da93c26d01adb463069a90cf243971bf69948457298c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-11T22:22:43.292 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:43 smithi179 bash[73018]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7 2024-09-11T22:22:43.546 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:43 smithi179 podman[73045]: 2024-09-11 22:22:43.291576665 +0000 UTC m=+0.604570711 container remove 12e2f035b75f070a53da93c26d01adb463069a90cf243971bf69948457298c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-11T22:22:43.937 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:43 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:43.770+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:43.937 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:43 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:43.771+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:43.937 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:43 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:43.771+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:43.937 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:43 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:43.771+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:43.937 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:43 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:43.771+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:43.937 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:43 smithi179 podman[73134]: 2024-09-11 22:22:43.524559706 +0000 UTC m=+0.016017246 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:22:43.937 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:43 smithi179 podman[73134]: 2024-09-11 22:22:43.650963654 +0000 UTC m=+0.142421184 container create 402726294c65aa13876a7b6bb5bb4469b6d8adbcd29797677bd0f54893066b80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:22:43.938 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:43 smithi179 podman[73134]: 2024-09-11 22:22:43.853313441 +0000 UTC m=+0.344770972 container init 402726294c65aa13876a7b6bb5bb4469b6d8adbcd29797677bd0f54893066b80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-11T22:22:43.938 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:43 smithi179 podman[73134]: 2024-09-11 22:22:43.856489541 +0000 UTC m=+0.347947072 container start 402726294c65aa13876a7b6bb5bb4469b6d8adbcd29797677bd0f54893066b80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T22:22:43.938 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:43 smithi179 podman[73134]: 2024-09-11 22:22:43.936314709 +0000 UTC m=+0.427772258 container attach 402726294c65aa13876a7b6bb5bb4469b6d8adbcd29797677bd0f54893066b80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T22:22:43.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:43 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:43.547+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:43.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:43 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:43.547+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:43.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:43 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:43.547+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:43.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:43 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:43.547+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:43.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:43 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:43.547+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:44.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:43 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:43.792+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:44.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:43 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:43.792+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:44.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:43 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:43.792+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:44.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:43 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:43.792+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.374742+0000 front 2024-09-11T22:22:17.374852+0000 (oldest deadline 2024-09-11T22:22:40.874606+0000) 2024-09-11T22:22:44.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:43 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:43.626+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:44.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:43 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:43.626+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:44.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:43 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:43.626+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:44.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:43 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:43.626+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:44.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:43 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:43.626+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:44.296 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:44 smithi179 podman[73134]: 2024-09-11 22:22:44.0428845 +0000 UTC m=+0.534342031 container died 402726294c65aa13876a7b6bb5bb4469b6d8adbcd29797677bd0f54893066b80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T22:22:44.597 INFO:journalctl@ceph.osd.7.smithi179.stdout:Sep 11 22:22:44 smithi179 podman[73157]: 2024-09-11 22:22:44.57321944 +0000 UTC m=+0.519679149 container remove 402726294c65aa13876a7b6bb5bb4469b6d8adbcd29797677bd0f54893066b80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T22:22:44.603 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.7.service' 2024-09-11T22:22:44.643 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:22:44.643 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-11T22:22:44.643 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-11T22:22:44.643 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.8 2024-09-11T22:22:44.790 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:44 smithi193 systemd[1]: Stopping Ceph osd.8 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:22:44.791 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:44.599+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:44.791 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:44.599+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:44.791 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:44.600+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:44.791 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:44.600+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:44.791 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:44.600+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:44.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:44 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:44.544+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:44.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:44 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:44.544+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:44.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:44 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:44.544+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:44.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:44 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:44.544+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:44.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:44 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:44.544+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:45.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:44 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:44.738+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:45.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:44 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:44.738+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:45.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:44 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:44.738+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:45.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:44 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:44.738+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:45.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:44 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:44.738+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:45.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:44.789+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:45.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:44.789+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:45.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:44.789+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:45.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:44.789+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.374742+0000 front 2024-09-11T22:22:17.374852+0000 (oldest deadline 2024-09-11T22:22:40.874606+0000) 2024-09-11T22:22:45.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:44.941+0000 7fb0999fc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:22:45.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:44.941+0000 7fb0999fc640 -1 osd.8 110 *** Got signal Terminated *** 2024-09-11T22:22:45.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:44 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:44.941+0000 7fb0999fc640 -1 osd.8 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:22:45.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:45 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:45.509+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:45.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:45 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:45.509+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:45.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:45 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:45.509+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:45.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:45 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:45.509+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:45.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:45 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:45.509+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:46.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:45 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:45.693+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:46.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:45 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:45.693+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:46.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:45 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:45.693+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:46.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:45 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:45.693+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:46.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:45 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:45.693+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:46.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:45 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:45.818+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:46.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:45 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:45.818+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:46.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:45 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:45.818+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:46.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:45 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:45.818+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.374742+0000 front 2024-09-11T22:22:17.374852+0000 (oldest deadline 2024-09-11T22:22:40.874606+0000) 2024-09-11T22:22:46.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:45 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:45.622+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:46.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:45 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:45.622+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:46.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:45 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:45.622+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:46.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:45 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:45.622+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:46.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:45 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:45.622+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:46.831 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:46 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:46.501+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:46.831 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:46 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:46.501+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:46.831 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:46 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:46.501+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:46.831 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:46 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:46.501+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:46.831 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:46 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:46.501+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:47.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:46 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:46.696+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:47.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:46 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:46.696+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:47.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:46 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:46.696+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:47.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:46 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:46.696+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:47.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:46 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:46.696+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:47.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:46.848+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:47.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:46.848+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:47.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:46.848+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:47.077 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:46.848+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.374742+0000 front 2024-09-11T22:22:17.374852+0000 (oldest deadline 2024-09-11T22:22:40.874606+0000) 2024-09-11T22:22:47.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:46.598+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:47.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:46.598+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:47.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:46.598+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:47.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:46.598+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:47.077 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:46.598+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:47.873 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:47 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:47.491+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:47.873 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:47 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:47.491+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:47.873 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:47 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:47.491+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:47.873 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:47 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:47.491+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:47.873 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:47 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:47.491+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:47.887 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:47 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:47.610+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:47.887 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:47 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:47.610+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:47.887 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:47 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:47.610+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:47.887 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:47 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:47.610+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:47.887 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:47 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:47.610+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:48.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:47 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:47.679+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:48.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:47 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:47.679+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:48.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:47 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:47.679+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:48.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:47 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:47.679+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:48.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:47 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:47.679+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:48.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:47 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:47.886+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:48.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:47 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:47.886+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:48.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:47 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:47.886+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:48.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:47 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:47.886+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.374742+0000 front 2024-09-11T22:22:17.374852+0000 (oldest deadline 2024-09-11T22:22:40.874606+0000) 2024-09-11T22:22:48.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:47 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:47.886+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.175360+0000 front 2024-09-11T22:22:26.175377+0000 (oldest deadline 2024-09-11T22:22:47.875373+0000) 2024-09-11T22:22:48.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:48 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:48.473+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:48.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:48 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:48.473+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:48.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:48 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:48.473+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:48.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:48 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:48.473+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:48.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:48 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:48.473+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:48.868 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:48.591+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:48.868 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:48.591+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:48.868 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:48.591+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:48.868 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:48.591+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:48.868 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:48.591+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:48.869 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:48.591+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:49.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:48 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:48.677+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:49.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:48 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:48.677+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:49.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:48 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:48.677+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:49.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:48 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:48.677+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:49.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:48 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:48.677+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:49.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:48.867+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:49.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:48.867+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:49.327 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:48.867+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:49.327 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:48.867+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.374742+0000 front 2024-09-11T22:22:17.374852+0000 (oldest deadline 2024-09-11T22:22:40.874606+0000) 2024-09-11T22:22:49.327 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:48 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:48.867+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.175360+0000 front 2024-09-11T22:22:26.175377+0000 (oldest deadline 2024-09-11T22:22:47.875373+0000) 2024-09-11T22:22:49.838 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:49.577+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:49.839 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:49.577+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:49.839 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:49.577+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:49.839 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:49.577+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:49.839 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:49.577+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:49.839 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:49.577+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:49.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:49.498+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:49.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:49.498+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:49.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:49.498+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:49.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:49.498+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:49.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:49 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:49.498+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:50.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:49 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:49.650+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:50.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:49 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:49.650+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:50.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:49 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:49.650+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:50.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:49 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:49.650+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:50.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:49 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:49.650+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:50.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:49 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:49.650+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:22:50.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:49.838+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:52.871477+0000 front 2024-09-11T22:21:52.871648+0000 (oldest deadline 2024-09-11T22:22:15.771487+0000) 2024-09-11T22:22:50.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:49.838+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.072418+0000 front 2024-09-11T22:22:01.072432+0000 (oldest deadline 2024-09-11T22:22:25.672912+0000) 2024-09-11T22:22:50.326 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:49.838+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:05.673327+0000 front 2024-09-11T22:22:05.673229+0000 (oldest deadline 2024-09-11T22:22:30.973277+0000) 2024-09-11T22:22:50.327 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:49.838+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.374742+0000 front 2024-09-11T22:22:17.374852+0000 (oldest deadline 2024-09-11T22:22:40.874606+0000) 2024-09-11T22:22:50.327 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:49 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8[54233]: 2024-09-11T22:22:49.838+0000 7fb091ff9640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.175360+0000 front 2024-09-11T22:22:26.175377+0000 (oldest deadline 2024-09-11T22:22:47.875373+0000) 2024-09-11T22:22:50.782 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:50 smithi193 podman[73722]: 2024-09-11 22:22:50.45810041 +0000 UTC m=+5.624962707 container died d6d66cf5e93baa273e40e374340cf1d944052a86f92115ca6cf0e80ce4f5d71b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-11T22:22:50.783 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:50 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:50.575+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:50.783 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:50 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:50.575+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:50.783 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:50 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:50.575+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:50.783 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:50 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:50.575+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:50.783 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:50 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:50.575+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:50.783 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:50 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:50.575+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:50.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:50 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:50.480+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:50.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:50 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:50.480+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:50.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:50 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:50.480+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:50.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:50 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:50.480+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:50.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:50 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:50.480+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:51.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:50 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:50.665+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:51.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:50 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:50.665+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:51.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:50 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:50.665+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:51.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:50 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:50.665+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:51.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:50 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:50.665+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:51.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:50 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:50.665+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:22:51.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:50 smithi193 podman[73722]: 2024-09-11 22:22:50.783032549 +0000 UTC m=+5.949894835 container cleanup d6d66cf5e93baa273e40e374340cf1d944052a86f92115ca6cf0e80ce4f5d71b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:22:51.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:50 smithi193 bash[73722]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8 2024-09-11T22:22:51.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:50 smithi193 podman[73737]: 2024-09-11 22:22:50.975896805 +0000 UTC m=+0.521221139 container remove d6d66cf5e93baa273e40e374340cf1d944052a86f92115ca6cf0e80ce4f5d71b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-11T22:22:51.696 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:51 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:51.530+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:51.697 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:51 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:51.530+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:51.697 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:51 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:51.530+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:51.697 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:51 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:51.530+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:51.697 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:51 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:51.531+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:51.697 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:51 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:51.531+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:51.697 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:51 smithi193 podman[73832]: 2024-09-11 22:22:51.287266742 +0000 UTC m=+0.016064309 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:22:51.697 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:51 smithi193 podman[73832]: 2024-09-11 22:22:51.39321144 +0000 UTC m=+0.122009008 container create bf6d2a8fc62395c9eb565a62e0a135289b0baadd7ab6e3b9b8cc7a69996fbfa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-11T22:22:51.697 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:51 smithi193 podman[73832]: 2024-09-11 22:22:51.612213685 +0000 UTC m=+0.341011252 container init bf6d2a8fc62395c9eb565a62e0a135289b0baadd7ab6e3b9b8cc7a69996fbfa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-11T22:22:51.698 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:51 smithi193 podman[73832]: 2024-09-11 22:22:51.615460896 +0000 UTC m=+0.344258463 container start bf6d2a8fc62395c9eb565a62e0a135289b0baadd7ab6e3b9b8cc7a69996fbfa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-11T22:22:51.698 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:51 smithi193 podman[73832]: 2024-09-11 22:22:51.696396759 +0000 UTC m=+0.425194335 container attach bf6d2a8fc62395c9eb565a62e0a135289b0baadd7ab6e3b9b8cc7a69996fbfa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:22:51.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:51 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:51.517+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:51.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:51 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:51.517+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:51.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:51 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:51.517+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:51.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:51 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:51.517+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:51.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:51 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:51.517+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:52.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:51 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:51.644+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:52.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:51 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:51.644+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:52.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:51 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:51.644+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:52.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:51 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:51.644+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:52.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:51 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:51.644+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:52.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:51 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:51.644+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:22:52.076 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 11 22:22:51 smithi193 podman[73832]: 2024-09-11 22:22:51.799190118 +0000 UTC m=+0.527987689 container died bf6d2a8fc62395c9eb565a62e0a135289b0baadd7ab6e3b9b8cc7a69996fbfa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-11T22:22:52.384 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.8.service' 2024-09-11T22:22:52.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:22:52.423 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-11T22:22:52.423 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-11T22:22:52.423 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.9 2024-09-11T22:22:52.631 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:52.522+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:52.631 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:52.522+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:52.631 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:52.522+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:52.631 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:52.522+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:52.631 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:52.522+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:52.631 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:52 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:52.522+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:52.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:52 smithi152 systemd[1]: Stopping Ceph osd.9 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:22:52.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:52.476+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:52.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:52.476+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:52.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:52.476+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:52.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:52.476+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:52.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:52.476+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:52.731 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:52.476+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:22.817898+0000 front 2024-09-11T22:22:22.818024+0000 (oldest deadline 2024-09-11T22:22:51.618169+0000) 2024-09-11T22:22:53.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:52.693+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:53.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:52.693+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:53.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:52.693+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:53.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:52.693+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:53.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:52.693+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:53.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:52 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:52.693+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:22:53.230 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:52.730+0000 7fe5198cf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:22:53.230 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:52.730+0000 7fe5198cf640 -1 osd.9 110 *** Got signal Terminated *** 2024-09-11T22:22:53.230 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:52 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:52.730+0000 7fe5198cf640 -1 osd.9 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:22:53.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:53.463+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:53.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:53.463+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:53.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:53.463+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:53.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:53.463+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:53.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:53.463+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:53.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:53 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:53.463+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:22.817898+0000 front 2024-09-11T22:22:22.818024+0000 (oldest deadline 2024-09-11T22:22:51.618169+0000) 2024-09-11T22:22:53.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:53.486+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:53.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:53.486+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:53.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:53.486+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:53.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:53.486+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:53.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:53.486+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:53.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:53 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:53.486+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:54.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:53 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:53.678+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:54.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:53 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:53.678+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:54.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:53 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:53.678+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:54.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:53 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:53.678+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:54.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:53 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:53.678+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:54.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:53 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:53.678+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:22:54.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:54 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:54.441+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:54.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:54 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:54.441+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:54.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:54 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:54.441+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:54.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:54 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:54.441+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:54.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:54 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:54.441+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:54.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:54 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:54.441+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:22.817898+0000 front 2024-09-11T22:22:22.818024+0000 (oldest deadline 2024-09-11T22:22:51.618169+0000) 2024-09-11T22:22:54.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:54 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:54.447+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:54.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:54 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:54.447+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:54.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:54 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:54.447+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:54.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:54 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:54.447+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:54.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:54 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:54.447+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:54.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:54 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:54.447+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:55.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:54 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:54.699+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:55.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:54 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:54.699+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:55.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:54 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:54.699+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:55.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:54 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:54.699+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:55.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:54 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:54.699+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:55.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:54 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:54.699+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:22:55.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:55.435+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:55.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:55.435+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:55.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:55.435+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:55.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:55.435+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:55.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:55.435+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:55.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:55 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:55.435+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:22.817898+0000 front 2024-09-11T22:22:22.818024+0000 (oldest deadline 2024-09-11T22:22:51.618169+0000) 2024-09-11T22:22:55.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:55 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:55.439+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:55.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:55 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:55.439+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:55.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:55 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:55.439+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:55.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:55 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:55.439+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:55.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:55 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:55.439+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:55.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:55 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:55.439+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:56.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:55.729+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:56.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:55.729+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:56.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:55.729+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:56.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:55.729+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:56.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:55.729+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:56.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:55 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:55.729+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:22:56.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:56 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:56.440+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:56.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:56 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:56.440+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:56.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:56 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:56.440+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:56.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:56 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:56.440+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:56.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:56 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:56.440+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:56.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:56 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:56.440+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:22.817898+0000 front 2024-09-11T22:22:22.818024+0000 (oldest deadline 2024-09-11T22:22:51.618169+0000) 2024-09-11T22:22:56.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:56 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:56.394+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:56.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:56 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:56.394+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:56.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:56 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:56.394+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:56.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:56 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:56.394+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:56.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:56 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:56.394+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:56.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:56 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:56.394+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:57.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:56 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:56.732+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:57.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:56 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:56.732+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:57.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:56 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:56.732+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:57.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:56 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:56.732+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:57.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:56 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:56.732+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:57.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:56 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:56.732+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:22:57.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:57 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:57.469+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.510395+0000 front 2024-09-11T22:21:37.510349+0000 (oldest deadline 2024-09-11T22:22:08.011262+0000) 2024-09-11T22:22:57.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:57 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:57.469+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:53.812724+0000 front 2024-09-11T22:21:53.812945+0000 (oldest deadline 2024-09-11T22:22:17.912749+0000) 2024-09-11T22:22:57.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:57 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:57.470+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.314361+0000 front 2024-09-11T22:22:01.314399+0000 (oldest deadline 2024-09-11T22:22:25.414347+0000) 2024-09-11T22:22:57.730 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:57 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:57.470+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:10.015934+0000 front 2024-09-11T22:22:10.015951+0000 (oldest deadline 2024-09-11T22:22:32.916013+0000) 2024-09-11T22:22:57.731 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:57 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:57.470+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:13.416766+0000 front 2024-09-11T22:22:13.416799+0000 (oldest deadline 2024-09-11T22:22:42.817301+0000) 2024-09-11T22:22:57.731 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:57 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9[64891]: 2024-09-11T22:22:57.470+0000 7fe515ed4640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:22.817898+0000 front 2024-09-11T22:22:22.818024+0000 (oldest deadline 2024-09-11T22:22:51.618169+0000) 2024-09-11T22:22:57.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:57 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:57.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:57.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:57 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:57.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:57.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:57 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:57.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:57.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:57 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:57.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:57.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:57 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:57.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:57.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:57 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:57.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:58.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:57 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:57.683+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:58.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:57 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:57.683+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:58.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:57 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:57.683+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:58.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:57 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:57.683+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:58.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:57 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:57.683+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:58.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:57 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:57.683+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:22:58.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:57 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:57.683+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6822 osd.6 since back 2024-09-11T22:22:32.376878+0000 front 2024-09-11T22:22:32.376950+0000 (oldest deadline 2024-09-11T22:22:57.676729+0000) 2024-09-11T22:22:58.480 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:58 smithi152 podman[123138]: 2024-09-11 22:22:58.257414164 +0000 UTC m=+5.632394099 container died 17187ca777257166a2076dea3a5c70afddd376bbf8e457cf346ad54d117558e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-11T22:22:58.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:58 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:58.393+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:58.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:58 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:58.393+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:58.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:58 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:58.393+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:58.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:58 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:58.393+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:58.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:58 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:58.393+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:58.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:58 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:58.393+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:58.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:58 smithi152 podman[123138]: 2024-09-11 22:22:58.722170137 +0000 UTC m=+6.097150071 container cleanup 17187ca777257166a2076dea3a5c70afddd376bbf8e457cf346ad54d117558e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-11T22:22:58.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:58 smithi152 bash[123138]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9 2024-09-11T22:22:59.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:58 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:58.731+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:22:59.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:58 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:58.731+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:22:59.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:58 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:58.731+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:22:59.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:58 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:58.731+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:22:59.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:58 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:58.731+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:22:59.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:58 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:58.731+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:22:59.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:58 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:58.731+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6822 osd.6 since back 2024-09-11T22:22:32.376878+0000 front 2024-09-11T22:22:32.376950+0000 (oldest deadline 2024-09-11T22:22:57.676729+0000) 2024-09-11T22:22:59.333 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:59 smithi152 podman[123155]: 2024-09-11 22:22:59.007146528 +0000 UTC m=+0.752960561 container remove 17187ca777257166a2076dea3a5c70afddd376bbf8e457cf346ad54d117558e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T22:22:59.627 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:59 smithi152 podman[123241]: 2024-09-11 22:22:59.333086874 +0000 UTC m=+0.106073782 container create 05f14aefd4a8b8c517e39f9f72758ccc91bae242ad40e48905eb516cd06c8e85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9-deactivate, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-11T22:22:59.627 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:59 smithi152 podman[123241]: 2024-09-11 22:22:59.242980627 +0000 UTC m=+0.015967508 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:22:59.628 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:59 smithi152 podman[123241]: 2024-09-11 22:22:59.536039134 +0000 UTC m=+0.309026000 container init 05f14aefd4a8b8c517e39f9f72758ccc91bae242ad40e48905eb516cd06c8e85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:22:59.628 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:59 smithi152 podman[123241]: 2024-09-11 22:22:59.53978385 +0000 UTC m=+0.312770727 container start 05f14aefd4a8b8c517e39f9f72758ccc91bae242ad40e48905eb516cd06c8e85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-09-11T22:22:59.628 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:59 smithi152 podman[123241]: 2024-09-11 22:22:59.627407381 +0000 UTC m=+0.400394259 container attach 05f14aefd4a8b8c517e39f9f72758ccc91bae242ad40e48905eb516cd06c8e85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-11T22:22:59.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:59 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:59.406+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:22:59.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:59 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:59.406+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:22:59.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:59 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:59.406+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:22:59.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:59 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:59.406+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:22:59.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:59 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:59.406+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:22:59.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:22:59 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:22:59.406+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:22:59.980 INFO:journalctl@ceph.osd.9.smithi152.stdout:Sep 11 22:22:59 smithi152 podman[123241]: 2024-09-11 22:22:59.730500219 +0000 UTC m=+0.503487095 container died 05f14aefd4a8b8c517e39f9f72758ccc91bae242ad40e48905eb516cd06c8e85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-9-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:23:00.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:59 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:59.763+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:23:00.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:59 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:59.763+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:23:00.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:59 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:59.763+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:23:00.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:59 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:59.763+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:23:00.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:59 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:59.763+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:23:00.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:59 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:59.763+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:23:00.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:22:59 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:22:59.763+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6822 osd.6 since back 2024-09-11T22:22:32.376878+0000 front 2024-09-11T22:22:32.376950+0000 (oldest deadline 2024-09-11T22:22:57.676729+0000) 2024-09-11T22:23:00.349 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.9.service' 2024-09-11T22:23:00.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:00.389 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-11T22:23:00.389 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-11T22:23:00.389 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.10 2024-09-11T22:23:00.676 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:00 smithi179 systemd[1]: Stopping Ceph osd.10 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:00.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:00 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:00.400+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:00.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:00 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:00.400+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:00.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:00 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:00.400+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:00.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:00 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:00.400+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:00.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:00 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:00.400+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:00.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:00 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:00.400+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:01.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:00 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:00.675+0000 7fc896ba0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:01.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:00 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:00.675+0000 7fc896ba0640 -1 osd.10 110 *** Got signal Terminated *** 2024-09-11T22:23:01.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:00 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:00.675+0000 7fc896ba0640 -1 osd.10 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:23:01.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:00 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:00.744+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:23:01.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:00 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:00.744+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:23:01.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:00 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:00.744+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:23:01.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:00 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:00.744+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:23:01.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:00 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:00.744+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:23:01.048 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:00 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:00.744+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:23:01.048 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:00 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:00.744+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6822 osd.6 since back 2024-09-11T22:22:32.376878+0000 front 2024-09-11T22:22:32.376950+0000 (oldest deadline 2024-09-11T22:22:57.676729+0000) 2024-09-11T22:23:01.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:01 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:01.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:01.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:01 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:01.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:01.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:01 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:01.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:01.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:01 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:01.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:01.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:01 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:01.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:01.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:01 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:01.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:02.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:01 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:01.700+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:23:02.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:01 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:01.700+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:23:02.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:01 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:01.700+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:23:02.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:01 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:01.700+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:23:02.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:01 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:01.700+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:23:02.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:01 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:01.700+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:23:02.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:01 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:01.700+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6822 osd.6 since back 2024-09-11T22:22:32.376878+0000 front 2024-09-11T22:22:32.376950+0000 (oldest deadline 2024-09-11T22:22:57.676729+0000) 2024-09-11T22:23:02.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:02 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:02.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:02.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:02 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:02.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:02.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:02 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:02.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:02.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:02 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:02.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:02.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:02 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:02.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:02.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:02 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:02.381+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:03.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:02 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:02.727+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:23:03.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:02 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:02.727+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:23:03.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:02 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:02.727+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:23:03.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:02 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:02.727+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:23:03.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:02 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:02.727+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:23:03.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:02 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:02.727+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:23:03.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:02 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:02.727+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6822 osd.6 since back 2024-09-11T22:22:32.376878+0000 front 2024-09-11T22:22:32.376950+0000 (oldest deadline 2024-09-11T22:22:57.676729+0000) 2024-09-11T22:23:03.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:03 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:03.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:03.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:03 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:03.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:03.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:03 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:03.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:03.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:03 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:03.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:03.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:03 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:03.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:03.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:03 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:03.420+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:04.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:03 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:03.771+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:23:04.046 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:03 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:03.771+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:23:04.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:03 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:03.771+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:23:04.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:03 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:03.771+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:23:04.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:03 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:03.771+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:23:04.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:03 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:03.771+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:23:04.047 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:03 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:03.771+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6822 osd.6 since back 2024-09-11T22:22:32.376878+0000 front 2024-09-11T22:22:32.376950+0000 (oldest deadline 2024-09-11T22:22:57.676729+0000) 2024-09-11T22:23:04.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:04 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:04.379+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:04.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:04 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:04.379+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:04.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:04 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:04.379+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:04.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:04 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:04.379+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:04.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:04 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:04.379+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:04.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:04 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:04.379+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:04.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:04 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:04.379+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-09-11T22:22:41.742484+0000 front 2024-09-11T22:22:41.742434+0000 (oldest deadline 2024-09-11T22:23:04.042389+0000) 2024-09-11T22:23:05.296 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:04 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:04.799+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:37.768039+0000 front 2024-09-11T22:21:37.768082+0000 (oldest deadline 2024-09-11T22:22:11.269137+0000) 2024-09-11T22:23:05.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:04 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:04.799+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:54.170026+0000 front 2024-09-11T22:21:54.169957+0000 (oldest deadline 2024-09-11T22:22:15.870077+0000) 2024-09-11T22:23:05.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:04 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:04.799+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:21:59.371289+0000 front 2024-09-11T22:21:59.371058+0000 (oldest deadline 2024-09-11T22:22:25.271034+0000) 2024-09-11T22:23:05.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:04 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:04.799+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:08.172125+0000 front 2024-09-11T22:22:08.172159+0000 (oldest deadline 2024-09-11T22:22:30.972314+0000) 2024-09-11T22:23:05.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:04 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:04.799+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:17.874294+0000 front 2024-09-11T22:22:17.874254+0000 (oldest deadline 2024-09-11T22:22:41.274901+0000) 2024-09-11T22:23:05.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:04 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:04.799+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:24.175965+0000 front 2024-09-11T22:22:24.176036+0000 (oldest deadline 2024-09-11T22:22:48.875832+0000) 2024-09-11T22:23:05.297 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:04 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10[60647]: 2024-09-11T22:23:04.799+0000 7fc8931a5640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.152:6822 osd.6 since back 2024-09-11T22:22:32.376878+0000 front 2024-09-11T22:22:32.376950+0000 (oldest deadline 2024-09-11T22:22:57.676729+0000) 2024-09-11T22:23:05.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:05 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:05.384+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:05.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:05 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:05.384+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:05.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:05 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:05.384+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:05.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:05 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:05.384+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:05.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:05 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:05.384+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:05.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:05 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:05.384+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:05.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:05 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:05.384+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-09-11T22:22:41.742484+0000 front 2024-09-11T22:22:41.742434+0000 (oldest deadline 2024-09-11T22:23:04.042389+0000) 2024-09-11T22:23:06.525 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:06 smithi179 podman[73239]: 2024-09-11 22:23:06.236158196 +0000 UTC m=+5.654758171 container died a2e130a1df0dbf4ff02971cd5270bf18f5bd91eb650e5a2d20ac7ddec6cd0080 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T22:23:06.796 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:06 smithi179 podman[73239]: 2024-09-11 22:23:06.525083017 +0000 UTC m=+5.943682983 container cleanup a2e130a1df0dbf4ff02971cd5270bf18f5bd91eb650e5a2d20ac7ddec6cd0080 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T22:23:06.796 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:06 smithi179 bash[73239]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10 2024-09-11T22:23:06.797 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:06 smithi179 podman[73259]: 2024-09-11 22:23:06.751355077 +0000 UTC m=+0.516255120 container remove a2e130a1df0dbf4ff02971cd5270bf18f5bd91eb650e5a2d20ac7ddec6cd0080 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T22:23:06.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:06 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:06.361+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:06.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:06 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:06.361+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:06.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:06 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:06.361+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:06.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:06 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:06.361+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:06.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:06 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:06.361+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:06.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:06 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:06.361+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:06.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:06 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:06.361+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-09-11T22:22:41.742484+0000 front 2024-09-11T22:22:41.742434+0000 (oldest deadline 2024-09-11T22:23:04.042389+0000) 2024-09-11T22:23:07.379 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:07 smithi179 podman[73345]: 2024-09-11 22:23:07.06880327 +0000 UTC m=+0.106678529 container create 163d9c7003cdd9653e3816285ab5b36190f7c49f8bb0491bb3aa04a26cac8867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-11T22:23:07.379 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:07 smithi179 podman[73345]: 2024-09-11 22:23:06.977653771 +0000 UTC m=+0.015529032 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:23:07.379 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:07 smithi179 podman[73345]: 2024-09-11 22:23:07.287722792 +0000 UTC m=+0.325598055 container init 163d9c7003cdd9653e3816285ab5b36190f7c49f8bb0491bb3aa04a26cac8867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-11T22:23:07.380 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:07 smithi179 podman[73345]: 2024-09-11 22:23:07.291040494 +0000 UTC m=+0.328915759 container start 163d9c7003cdd9653e3816285ab5b36190f7c49f8bb0491bb3aa04a26cac8867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-11T22:23:07.380 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:07 smithi179 podman[73345]: 2024-09-11 22:23:07.379220598 +0000 UTC m=+0.417095871 container attach 163d9c7003cdd9653e3816285ab5b36190f7c49f8bb0491bb3aa04a26cac8867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-11T22:23:07.715 INFO:journalctl@ceph.osd.10.smithi179.stdout:Sep 11 22:23:07 smithi179 podman[73345]: 2024-09-11 22:23:07.476309435 +0000 UTC m=+0.514184695 container died 163d9c7003cdd9653e3816285ab5b36190f7c49f8bb0491bb3aa04a26cac8867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T22:23:07.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:07 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:07.334+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:07.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:07 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:07.334+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:07.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:07 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:07.334+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:07.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:07 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:07.334+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:07.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:07 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:07.334+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:07.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:07 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:07.334+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:07.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:07 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:07.334+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-09-11T22:22:41.742484+0000 front 2024-09-11T22:22:41.742434+0000 (oldest deadline 2024-09-11T22:23:04.042389+0000) 2024-09-11T22:23:07.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.10.service' 2024-09-11T22:23:08.029 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:08.029 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-11T22:23:08.030 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-11T22:23:08.030 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.11 2024-09-11T22:23:08.326 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:08 smithi193 systemd[1]: Stopping Ceph osd.11 for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:08.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:08.325+0000 7f8d5d069640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:08.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:08.325+0000 7f8d5d069640 -1 osd.11 110 *** Got signal Terminated *** 2024-09-11T22:23:08.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:08.325+0000 7f8d5d069640 -1 osd.11 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:23:08.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:08.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:08.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:08.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:08.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:08.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:08.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:08.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:08.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:08.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:08.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:08.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:08.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:08 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:08.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-09-11T22:22:41.742484+0000 front 2024-09-11T22:22:41.742434+0000 (oldest deadline 2024-09-11T22:23:04.042389+0000) 2024-09-11T22:23:09.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:09 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:09.343+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:09.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:09 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:09.343+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:09.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:09 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:09.343+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:09.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:09 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:09.343+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:09.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:09 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:09.343+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:09.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:09 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:09.343+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:09.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:09 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:09.343+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-09-11T22:22:41.742484+0000 front 2024-09-11T22:22:41.742434+0000 (oldest deadline 2024-09-11T22:23:04.042389+0000) 2024-09-11T22:23:10.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:10 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:10.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:10.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:10 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:10.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:10.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:10 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:10.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:10.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:10 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:10.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:10.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:10 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:10.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:10.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:10 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:10.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:10.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:10 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:10.333+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-09-11T22:22:41.742484+0000 front 2024-09-11T22:22:41.742434+0000 (oldest deadline 2024-09-11T22:23:04.042389+0000) 2024-09-11T22:23:11.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:11 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:11.340+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:11.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:11 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:11.340+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:11.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:11 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:11.340+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:11.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:11 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:11.340+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:11.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:11 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:11.340+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:11.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:11 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:11.340+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:11.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:11 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:11.340+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-09-11T22:22:41.742484+0000 front 2024-09-11T22:22:41.742434+0000 (oldest deadline 2024-09-11T22:23:04.042389+0000) 2024-09-11T22:23:12.826 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:12.391+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-09-11T22:21:39.631371+0000 front 2024-09-11T22:21:39.631350+0000 (oldest deadline 2024-09-11T22:22:08.932599+0000) 2024-09-11T22:23:12.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:12.391+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-09-11T22:21:49.433898+0000 front 2024-09-11T22:21:49.433974+0000 (oldest deadline 2024-09-11T22:22:17.034156+0000) 2024-09-11T22:23:12.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:12.391+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-11T22:22:01.635756+0000 front 2024-09-11T22:22:01.635781+0000 (oldest deadline 2024-09-11T22:22:25.136007+0000) 2024-09-11T22:23:12.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:12.391+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.152:6814 osd.3 since back 2024-09-11T22:22:09.737523+0000 front 2024-09-11T22:22:09.737611+0000 (oldest deadline 2024-09-11T22:22:33.837492+0000) 2024-09-11T22:23:12.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:12.391+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-09-11T22:22:16.738730+0000 front 2024-09-11T22:22:16.738762+0000 (oldest deadline 2024-09-11T22:22:42.038709+0000) 2024-09-11T22:23:12.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:12.391+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-11T22:22:26.040094+0000 front 2024-09-11T22:22:26.040159+0000 (oldest deadline 2024-09-11T22:22:48.340136+0000) 2024-09-11T22:23:12.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:12.391+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-09-11T22:22:41.742484+0000 front 2024-09-11T22:22:41.742434+0000 (oldest deadline 2024-09-11T22:23:04.042389+0000) 2024-09-11T22:23:12.827 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:12 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11[61145]: 2024-09-11T22:23:12.391+0000 7f8d55666640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.193:6820 osd.8 since back 2024-09-11T22:22:49.343336+0000 front 2024-09-11T22:22:49.343358+0000 (oldest deadline 2024-09-11T22:23:11.643342+0000) 2024-09-11T22:23:14.292 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:14 smithi193 podman[73948]: 2024-09-11 22:23:14.013019631 +0000 UTC m=+5.790412881 container died a3045b9e6e22d4f750fd6d65099c9b4078bb08d60bbf572620fdbb8fb16f43a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:23:14.576 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:14 smithi193 podman[73948]: 2024-09-11 22:23:14.383583494 +0000 UTC m=+6.160976743 container cleanup a3045b9e6e22d4f750fd6d65099c9b4078bb08d60bbf572620fdbb8fb16f43a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-11T22:23:14.576 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:14 smithi193 bash[73948]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11 2024-09-11T22:23:15.000 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:14 smithi193 podman[73965]: 2024-09-11 22:23:14.693481876 +0000 UTC m=+0.670950958 container remove a3045b9e6e22d4f750fd6d65099c9b4078bb08d60bbf572620fdbb8fb16f43a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-11T22:23:15.288 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:15 smithi193 podman[74054]: 2024-09-11 22:23:14.903937337 +0000 UTC m=+0.016109842 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:23:15.289 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:15 smithi193 podman[74054]: 2024-09-11 22:23:15.010881815 +0000 UTC m=+0.123054324 container create 4d2b7f554c1300b14ae4d261f01c3a2273e6c4267eaa00923be7797572b0ce5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T22:23:15.289 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:15 smithi193 podman[74054]: 2024-09-11 22:23:15.213462928 +0000 UTC m=+0.325635429 container init 4d2b7f554c1300b14ae4d261f01c3a2273e6c4267eaa00923be7797572b0ce5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-11T22:23:15.289 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:15 smithi193 podman[74054]: 2024-09-11 22:23:15.216656717 +0000 UTC m=+0.328829222 container start 4d2b7f554c1300b14ae4d261f01c3a2273e6c4267eaa00923be7797572b0ce5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-11T22:23:15.289 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:15 smithi193 podman[74054]: 2024-09-11 22:23:15.288314286 +0000 UTC m=+0.400486793 container attach 4d2b7f554c1300b14ae4d261f01c3a2273e6c4267eaa00923be7797572b0ce5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:23:15.576 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:15 smithi193 podman[74054]: 2024-09-11 22:23:15.403520324 +0000 UTC m=+0.515692827 container died 4d2b7f554c1300b14ae4d261f01c3a2273e6c4267eaa00923be7797572b0ce5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:23:15.936 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 11 22:23:15 smithi193 podman[74077]: 2024-09-11 22:23:15.932977229 +0000 UTC m=+0.523862038 container remove 4d2b7f554c1300b14ae4d261f01c3a2273e6c4267eaa00923be7797572b0ce5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-11T22:23:15.962 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@osd.11.service' 2024-09-11T22:23:16.001 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:16.002 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-11T22:23:16.002 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-11T22:23:16.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.a 2024-09-11T22:23:16.291 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:23:16 smithi152 systemd[1]: Stopping Ceph mds.a for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:16.730 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:23:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-a[71567]: 2024-09-11T22:23:16.290+0000 7f74b3812640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:16.730 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:23:16 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-a[71567]: 2024-09-11T22:23:16.290+0000 7f74b3812640 -1 mds.a *** got signal Terminated *** 2024-09-11T22:23:20.566 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:23:20 smithi152 podman[123344]: 2024-09-11 22:23:20.306535494 +0000 UTC m=+4.111840811 container died c77ce75b8c2129c7f8d7360765616921c6217c4ede32dcd9609188fee695e161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:23:20.966 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:23:20 smithi152 podman[123344]: 2024-09-11 22:23:20.757655235 +0000 UTC m=+4.562960551 container cleanup c77ce75b8c2129c7f8d7360765616921c6217c4ede32dcd9609188fee695e161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-11T22:23:20.966 INFO:journalctl@ceph.mds.a.smithi152.stdout:Sep 11 22:23:20 smithi152 bash[123344]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-a 2024-09-11T22:23:21.185 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.a.service' 2024-09-11T22:23:21.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:21.221 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-11T22:23:21.221 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-11T22:23:21.221 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.d 2024-09-11T22:23:21.480 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:23:21 smithi152 systemd[1]: Stopping Ceph mds.d for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:21.980 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:23:21 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-d[70472]: 2024-09-11T22:23:21.620+0000 7f7d3c26d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:21.980 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:23:21 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-d[70472]: 2024-09-11T22:23:21.620+0000 7f7d3c26d640 -1 mds.d *** got signal Terminated *** 2024-09-11T22:23:23.230 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:23:22 smithi152 podman[123476]: 2024-09-11 22:23:22.967091886 +0000 UTC m=+1.506895606 container died c016c6646b4b125093e49a5101de54c837725c41bd3e0e3ddc72e1e37b4c3442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T22:23:23.629 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:23:23 smithi152 podman[123476]: 2024-09-11 22:23:23.337543777 +0000 UTC m=+1.877347496 container cleanup c016c6646b4b125093e49a5101de54c837725c41bd3e0e3ddc72e1e37b4c3442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-11T22:23:23.629 INFO:journalctl@ceph.mds.d.smithi152.stdout:Sep 11 22:23:23 smithi152 bash[123476]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-d 2024-09-11T22:23:23.780 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.d.service' 2024-09-11T22:23:23.814 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:23.815 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-11T22:23:23.815 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-11T22:23:23.815 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.g 2024-09-11T22:23:24.230 INFO:journalctl@ceph.mds.g.smithi152.stdout:Sep 11 22:23:24 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-g[71243]: 2024-09-11T22:23:24.149+0000 7f9dd971e640 -1 mds.g *** got signal Terminated *** 2024-09-11T22:23:26.230 INFO:journalctl@ceph.mds.g.smithi152.stdout:Sep 11 22:23:25 smithi152 podman[123600]: 2024-09-11 22:23:25.872241224 +0000 UTC m=+1.829493469 container stop 00a6db86fd27c40f613c39712a8c2cde9511543722eda756313e37a68e5ed0b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T22:23:26.230 INFO:journalctl@ceph.mds.g.smithi152.stdout:Sep 11 22:23:25 smithi152 podman[123600]: 2024-09-11 22:23:25.89790521 +0000 UTC m=+1.855157455 container died 00a6db86fd27c40f613c39712a8c2cde9511543722eda756313e37a68e5ed0b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-g, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T22:23:26.730 INFO:journalctl@ceph.mds.g.smithi152.stdout:Sep 11 22:23:26 smithi152 podman[123600]: 2024-09-11 22:23:26.441717332 +0000 UTC m=+2.398969577 container cleanup 00a6db86fd27c40f613c39712a8c2cde9511543722eda756313e37a68e5ed0b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-11T22:23:26.730 INFO:journalctl@ceph.mds.g.smithi152.stdout:Sep 11 22:23:26 smithi152 bash[123600]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-g 2024-09-11T22:23:26.730 INFO:journalctl@ceph.mds.g.smithi152.stdout:Sep 11 22:23:26 smithi152 podman[123612]: 2024-09-11 22:23:26.60147885 +0000 UTC m=+0.721760766 container remove 00a6db86fd27c40f613c39712a8c2cde9511543722eda756313e37a68e5ed0b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:23:26.818 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.g.service' 2024-09-11T22:23:26.851 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:26.851 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-11T22:23:26.852 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-11T22:23:26.852 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.j 2024-09-11T22:23:27.213 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:23:26 smithi152 systemd[1]: Stopping Ceph mds.j for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:27.480 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:23:27 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-j[70053]: 2024-09-11T22:23:27.212+0000 7f22f832f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:27.480 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:23:27 smithi152 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-j[70053]: 2024-09-11T22:23:27.212+0000 7f22f832f640 -1 mds.j *** got signal Terminated *** 2024-09-11T22:23:31.480 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:23:31 smithi152 podman[123721]: 2024-09-11 22:23:31.229107774 +0000 UTC m=+4.162054081 container died 9332532f2cac758cf29f4c0b574d64a380198b634ce2ce446994e03344837f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T22:23:31.824 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:23:31 smithi152 podman[123721]: 2024-09-11 22:23:31.654221337 +0000 UTC m=+4.587167679 container cleanup 9332532f2cac758cf29f4c0b574d64a380198b634ce2ce446994e03344837f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-j, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-11T22:23:31.825 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:23:31 smithi152 bash[123721]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-j 2024-09-11T22:23:32.075 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.j.service' 2024-09-11T22:23:32.096 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:23:31 smithi152 podman[123733]: 2024-09-11 22:23:31.857718976 +0000 UTC m=+0.631294910 container remove 9332532f2cac758cf29f4c0b574d64a380198b634ce2ce446994e03344837f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-11T22:23:32.097 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:23:32 smithi152 systemd[1]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.j.service: Deactivated successfully. 2024-09-11T22:23:32.097 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:23:32 smithi152 systemd[1]: Stopped Ceph mds.j for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:23:32.097 INFO:journalctl@ceph.mds.j.smithi152.stdout:Sep 11 22:23:32 smithi152 systemd[1]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.j.service: Consumed 1.104s CPU time. 2024-09-11T22:23:32.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:32.108 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-11T22:23:32.108 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-11T22:23:32.108 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.b 2024-09-11T22:23:32.417 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:23:32 smithi179 systemd[1]: Stopping Ceph mds.b for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:32.796 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:23:32 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b[65894]: 2024-09-11T22:23:32.415+0000 7fd8bbdd8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:32.796 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:23:32 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b[65894]: 2024-09-11T22:23:32.415+0000 7fd8bbdd8640 -1 mds.b *** got signal Terminated *** 2024-09-11T22:23:34.417 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:23:34 smithi179 podman[73460]: 2024-09-11 22:23:34.125642578 +0000 UTC m=+1.822690878 container died 4f2170899399d5c1a823a3f93213d3894b23b7d796abeced7fbedf21f67cd4e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T22:23:34.693 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:23:34 smithi179 podman[73460]: 2024-09-11 22:23:34.516351334 +0000 UTC m=+2.213399641 container cleanup 4f2170899399d5c1a823a3f93213d3894b23b7d796abeced7fbedf21f67cd4e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-11T22:23:34.693 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:23:34 smithi179 bash[73460]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b 2024-09-11T22:23:34.941 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.b.service' 2024-09-11T22:23:34.963 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:23:34 smithi179 podman[73472]: 2024-09-11 22:23:34.692640854 +0000 UTC m=+0.569515266 container remove 4f2170899399d5c1a823a3f93213d3894b23b7d796abeced7fbedf21f67cd4e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T22:23:34.963 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:23:34 smithi179 systemd[1]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-11T22:23:34.963 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:23:34 smithi179 systemd[1]: Stopped Ceph mds.b for 5c140ed8-7088-11ef-bcea-c7b262605968. 2024-09-11T22:23:34.964 INFO:journalctl@ceph.mds.b.smithi179.stdout:Sep 11 22:23:34 smithi179 systemd[1]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.b.service: Consumed 2.799s CPU time. 2024-09-11T22:23:34.976 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:34.976 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-11T22:23:34.976 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-11T22:23:34.976 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.e 2024-09-11T22:23:35.297 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:23:35 smithi179 systemd[1]: Stopping Ceph mds.e for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:35.796 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:23:35 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e[65292]: 2024-09-11T22:23:35.303+0000 7f4b64757640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:35.796 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:23:35 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e[65292]: 2024-09-11T22:23:35.303+0000 7f4b64757640 -1 mds.e *** got signal Terminated *** 2024-09-11T22:23:38.387 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:23:38 smithi179 podman[73582]: 2024-09-11 22:23:38.11987971 +0000 UTC m=+2.925204189 container died f274f0b373cf82d47351f2cdc29c968e704e517be0af11022b85c4d9b4fa1cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T22:23:38.771 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:23:38 smithi179 podman[73582]: 2024-09-11 22:23:38.495083233 +0000 UTC m=+3.300407712 container cleanup f274f0b373cf82d47351f2cdc29c968e704e517be0af11022b85c4d9b4fa1cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:23:38.771 INFO:journalctl@ceph.mds.e.smithi179.stdout:Sep 11 22:23:38 smithi179 bash[73582]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-e 2024-09-11T22:23:38.918 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.e.service' 2024-09-11T22:23:38.951 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:38.951 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-11T22:23:38.951 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-11T22:23:38.952 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.h 2024-09-11T22:23:39.296 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:23:39 smithi179 systemd[1]: Stopping Ceph mds.h for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:39.300 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:23:39 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h[65592]: 2024-09-11T22:23:39.265+0000 7f99fa756640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:39.300 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:23:39 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h[65592]: 2024-09-11T22:23:39.265+0000 7f99fa756640 -1 mds.h *** got signal Terminated *** 2024-09-11T22:23:42.383 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:23:42 smithi179 podman[73703]: 2024-09-11 22:23:42.109224315 +0000 UTC m=+2.940969007 container died 94f6f814d27f5843842a3e68c407dfacbcd9090975062de2cf538972866659f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T22:23:42.733 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:23:42 smithi179 podman[73703]: 2024-09-11 22:23:42.48230119 +0000 UTC m=+3.314045873 container cleanup 94f6f814d27f5843842a3e68c407dfacbcd9090975062de2cf538972866659f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T22:23:42.733 INFO:journalctl@ceph.mds.h.smithi179.stdout:Sep 11 22:23:42 smithi179 bash[73703]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-h 2024-09-11T22:23:42.859 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.h.service' 2024-09-11T22:23:42.894 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:42.894 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-11T22:23:42.894 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-11T22:23:42.894 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.k 2024-09-11T22:23:43.046 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:23:42 smithi179 systemd[1]: Stopping Ceph mds.k for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:43.546 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:23:43 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-k[64979]: 2024-09-11T22:23:43.219+0000 7f276f500640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:43.546 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:23:43 smithi179 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-k[64979]: 2024-09-11T22:23:43.219+0000 7f276f500640 -1 mds.k *** got signal Terminated *** 2024-09-11T22:23:45.470 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:23:45 smithi179 podman[73835]: 2024-09-11 22:23:45.154988512 +0000 UTC m=+2.040304764 container died e46abef58b78925693846486f496cd60a712963eda2aca7e345530aa78d5f6f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:23:45.778 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:23:45 smithi179 podman[73835]: 2024-09-11 22:23:45.544532568 +0000 UTC m=+2.429848816 container cleanup e46abef58b78925693846486f496cd60a712963eda2aca7e345530aa78d5f6f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:23:45.779 INFO:journalctl@ceph.mds.k.smithi179.stdout:Sep 11 22:23:45 smithi179 bash[73835]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-k 2024-09-11T22:23:45.914 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.k.service' 2024-09-11T22:23:45.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:45.946 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-11T22:23:45.946 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-11T22:23:45.947 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.c 2024-09-11T22:23:46.258 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 11 22:23:45 smithi193 systemd[1]: Stopping Ceph mds.c for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:46.576 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 11 22:23:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-c[66418]: 2024-09-11T22:23:46.257+0000 7f9482f65640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:46.576 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 11 22:23:46 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-c[66418]: 2024-09-11T22:23:46.257+0000 7f9482f65640 -1 mds.c *** got signal Terminated *** 2024-09-11T22:23:50.577 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 11 22:23:50 smithi193 podman[74156]: 2024-09-11 22:23:50.112379004 +0000 UTC m=+3.968214753 container died 36a37c05aaa9b609fd44ec3f21193015680c782d496e1e0dfa36daaf15787fd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:23:51.057 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 11 22:23:50 smithi193 podman[74156]: 2024-09-11 22:23:50.773356333 +0000 UTC m=+4.629192084 container cleanup 36a37c05aaa9b609fd44ec3f21193015680c782d496e1e0dfa36daaf15787fd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T22:23:51.057 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 11 22:23:50 smithi193 bash[74156]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-c 2024-09-11T22:23:51.209 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.c.service' 2024-09-11T22:23:51.244 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:51.245 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-11T22:23:51.245 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-11T22:23:51.245 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.f 2024-09-11T22:23:51.569 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:23:51 smithi193 systemd[1]: Stopping Ceph mds.f for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:51.826 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:23:51 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f[66116]: 2024-09-11T22:23:51.568+0000 7f025acb2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:51.826 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:23:51 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f[66116]: 2024-09-11T22:23:51.568+0000 7f025acb2640 -1 mds.f *** got signal Terminated *** 2024-09-11T22:23:54.428 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:23:54 smithi193 podman[74290]: 2024-09-11 22:23:54.107055839 +0000 UTC m=+2.642221541 container died caf2fc941a9df7e546bf89f4a1bf5c7dfd5777b7c051e33303433e11e54d49bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-11T22:23:54.428 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:23:54 smithi193 podman[74290]: 2024-09-11 22:23:54.426851705 +0000 UTC m=+2.962017404 container cleanup caf2fc941a9df7e546bf89f4a1bf5c7dfd5777b7c051e33303433e11e54d49bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:23:54.826 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:23:54 smithi193 bash[74290]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f 2024-09-11T22:23:54.827 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 11 22:23:54 smithi193 podman[74302]: 2024-09-11 22:23:54.628205797 +0000 UTC m=+0.516821195 container remove caf2fc941a9df7e546bf89f4a1bf5c7dfd5777b7c051e33303433e11e54d49bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-f, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T22:23:54.854 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.f.service' 2024-09-11T22:23:54.887 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:54.887 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-11T22:23:54.887 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-11T22:23:54.887 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.i 2024-09-11T22:23:55.206 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:23:54 smithi193 systemd[1]: Stopping Ceph mds.i for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:55.576 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:23:55 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-i[66721]: 2024-09-11T22:23:55.205+0000 7ff242878640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:55.576 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:23:55 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-i[66721]: 2024-09-11T22:23:55.205+0000 7ff242878640 -1 mds.i *** got signal Terminated *** 2024-09-11T22:23:58.367 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:23:58 smithi193 podman[74412]: 2024-09-11 22:23:58.105164595 +0000 UTC m=+3.000490359 container died 889c170855d81085567cf12aaef731f3069646b1ad2d7166e41263a9b239b97e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:23:58.706 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:23:58 smithi193 podman[74412]: 2024-09-11 22:23:58.505455993 +0000 UTC m=+3.400781756 container cleanup 889c170855d81085567cf12aaef731f3069646b1ad2d7166e41263a9b239b97e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T22:23:58.706 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 11 22:23:58 smithi193 bash[74412]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-i 2024-09-11T22:23:58.853 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.i.service' 2024-09-11T22:23:58.886 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:23:58.887 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-11T22:23:58.887 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-11T22:23:58.887 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.l 2024-09-11T22:23:59.326 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 11 22:23:58 smithi193 systemd[1]: Stopping Ceph mds.l for 5c140ed8-7088-11ef-bcea-c7b262605968... 2024-09-11T22:23:59.326 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 11 22:23:59 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-l[65814]: 2024-09-11T22:23:59.208+0000 7f70da61d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:23:59.327 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 11 22:23:59 smithi193 ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-l[65814]: 2024-09-11T22:23:59.208+0000 7f70da61d640 -1 mds.l *** got signal Terminated *** 2024-09-11T22:24:02.984 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 11 22:24:02 smithi193 podman[74532]: 2024-09-11 22:24:02.641584692 +0000 UTC m=+3.531924584 container died 02bd6f43374bdc5de02f2e1dd24e90861a32d842fe33d5eadb3ed3e713519928 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-l, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T22:24:03.251 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 11 22:24:03 smithi193 podman[74532]: 2024-09-11 22:24:03.050086515 +0000 UTC m=+3.940426395 container cleanup 02bd6f43374bdc5de02f2e1dd24e90861a32d842fe33d5eadb3ed3e713519928 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:24:03.251 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 11 22:24:03 smithi193 bash[74532]: ceph-5c140ed8-7088-11ef-bcea-c7b262605968-mds-l 2024-09-11T22:24:03.386 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5c140ed8-7088-11ef-bcea-c7b262605968@mds.l.service' 2024-09-11T22:24:03.418 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:24:03.418 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-11T22:24:03.418 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T22:24:03.620 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T22:24:06.373 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T22:24:06.575 INFO:teuthology.orchestra.run.smithi179.stdout:Deleting cluster with fsid: 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T22:24:08.926 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T22:24:09.126 INFO:teuthology.orchestra.run.smithi193.stdout:Deleting cluster with fsid: 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T22:24:11.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:24:11.529 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:24:11.556 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:24:11.584 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-11T22:24:11.587 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411/remote/smithi152/crash 2024-09-11T22:24:11.588 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/crash -- . 2024-09-11T22:24:11.627 INFO:teuthology.orchestra.run.smithi152.stderr:tar: /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T22:24:11.627 INFO:teuthology.orchestra.run.smithi152.stderr:tar: Error is not recoverable: exiting now 2024-09-11T22:24:11.629 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411/remote/smithi179/crash 2024-09-11T22:24:11.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/crash -- . 2024-09-11T22:24:11.668 INFO:teuthology.orchestra.run.smithi179.stderr:tar: /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T22:24:11.668 INFO:teuthology.orchestra.run.smithi179.stderr:tar: Error is not recoverable: exiting now 2024-09-11T22:24:11.670 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411/remote/smithi193/crash 2024-09-11T22:24:11.671 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/crash -- . 2024-09-11T22:24:11.702 INFO:teuthology.orchestra.run.smithi193.stderr:tar: /var/lib/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T22:24:11.703 INFO:teuthology.orchestra.run.smithi193.stderr:tar: Error is not recoverable: exiting now 2024-09-11T22:24:11.704 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-11T22:24:11.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T22:24:11.742 INFO:tasks.cephadm:Compressing logs... 2024-09-11T22:24:11.742 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:24:11.785 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:24:11.787 DEBUG:teuthology.orchestra.run.smithi193:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:24:11.808 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-11T22:24:11.808 INFO:teuthology.orchestra.run.smithi152.stderr:: No such file or directory 2024-09-11T22:24:11.808 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi179.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi179.stderr:: No such file or directory 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-11T22:24:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T22:24:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T22:24:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-11T22:24:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T22:24:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-11T22:24:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-11T22:24:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mon.a.log: 84.5%gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-11T22:24:11.815 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T22:24:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.log 2024-09-11T22:24:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.4% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.k.log: /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi179.stderr: 94.4% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi152.stderr: 94.5% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-11T22:24:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-11T22:24:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mgr.x.log: 87.0% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T22:24:11.823 INFO:teuthology.orchestra.run.smithi193.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T22:24:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:: No such file or directory 2024-09-11T22:24:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T22:24:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-11T22:24:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-11T22:24:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T22:24:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-11T22:24:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-11T22:24:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-11T22:24:11.824 INFO:teuthology.orchestra.run.smithi193.stderr: 82.0% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T22:24:11.824 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.log 2024-09-11T22:24:11.825 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-11T22:24:11.825 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T22:24:11.825 INFO:teuthology.orchestra.run.smithi193.stderr: 87.0% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T22:24:11.825 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-11T22:24:11.825 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-11T22:24:11.826 INFO:teuthology.orchestra.run.smithi179.stderr: 91.0% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T22:24:11.827 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.8.log: 94.6% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-11T22:24:11.827 INFO:teuthology.orchestra.run.smithi193.stderr: 91.0% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T22:24:11.828 INFO:teuthology.orchestra.run.smithi152.stderr: 94.6% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-11T22:24:11.828 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-11T22:24:11.828 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip 91.1% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T22:24:11.828 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T22:24:11.829 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T22:24:11.829 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-11T22:24:11.829 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.0% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T22:24:11.830 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-11T22:24:11.831 INFO:teuthology.orchestra.run.smithi179.stderr: 90.5% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T22:24:11.831 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.log 2024-09-11T22:24:11.832 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-11T22:24:11.834 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-11T22:24:11.834 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-11T22:24:11.835 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.log: 87.0% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T22:24:11.836 INFO:teuthology.orchestra.run.smithi152.stderr: 94.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T22:24:11.842 INFO:teuthology.orchestra.run.smithi179.stderr: 92.2% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-11T22:24:11.843 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-11T22:24:11.843 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-11T22:24:11.845 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.c.log: 92.2% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-11T22:24:11.845 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T22:24:11.861 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T22:24:11.863 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T22:24:11.877 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T22:24:11.931 INFO:teuthology.orchestra.run.smithi179.stderr: 94.6% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-11T22:24:12.007 INFO:teuthology.orchestra.run.smithi193.stderr: 93.2% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-11T22:24:12.086 INFO:teuthology.orchestra.run.smithi179.stderr: 93.4% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi152.stderr: 90.4% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-11T22:24:12.363 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-11T22:24:12.386 INFO:teuthology.orchestra.run.smithi179.stderr: 91.5% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-11T22:24:12.416 INFO:teuthology.orchestra.run.smithi179.stderr: 94.8% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-11T22:24:12.842 INFO:teuthology.orchestra.run.smithi152.stderr: 90.4% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-11T22:24:13.082 INFO:teuthology.orchestra.run.smithi193.stderr: 93.0% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-11T22:24:21.316 INFO:teuthology.orchestra.run.smithi152.stderr: 94.7% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-11T22:24:22.613 INFO:teuthology.orchestra.run.smithi193.stderr: 95.0% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-11T22:24:25.901 INFO:teuthology.orchestra.run.smithi193.stderr: 94.2% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-11T22:24:27.288 INFO:teuthology.orchestra.run.smithi179.stderr: 94.2% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-11T22:24:27.329 INFO:teuthology.orchestra.run.smithi179.stderr: 94.1% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-11T22:24:27.566 INFO:teuthology.orchestra.run.smithi179.stderr: 94.4% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-11T22:24:28.008 INFO:teuthology.orchestra.run.smithi152.stderr: 94.2% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-11T22:24:28.471 INFO:teuthology.orchestra.run.smithi152.stderr: 94.3% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-11T22:24:28.620 INFO:teuthology.orchestra.run.smithi193.stderr: 94.0% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-11T22:24:29.000 INFO:teuthology.orchestra.run.smithi179.stderr: 94.1% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-11T22:24:29.002 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-09-11T22:24:29.002 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m17.203s 2024-09-11T22:24:29.002 INFO:teuthology.orchestra.run.smithi179.stderr:user 1m2.839s 2024-09-11T22:24:29.002 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m2.426s 2024-09-11T22:24:30.477 INFO:teuthology.orchestra.run.smithi152.stderr: 94.1% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-11T22:24:30.479 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-09-11T22:24:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m18.681s 2024-09-11T22:24:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:user 1m0.066s 2024-09-11T22:24:30.479 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m2.412s 2024-09-11T22:24:33.607 INFO:teuthology.orchestra.run.smithi193.stderr: 93.9% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-11T22:24:35.272 INFO:teuthology.orchestra.run.smithi193.stderr: 94.1% -- replaced with /var/log/ceph/5c140ed8-7088-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-11T22:24:35.274 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-09-11T22:24:35.274 INFO:teuthology.orchestra.run.smithi193.stderr:real 0m23.473s 2024-09-11T22:24:35.274 INFO:teuthology.orchestra.run.smithi193.stderr:user 1m25.729s 2024-09-11T22:24:35.274 INFO:teuthology.orchestra.run.smithi193.stderr:sys 0m3.061s 2024-09-11T22:24:35.275 INFO:tasks.cephadm:Archiving logs... 2024-09-11T22:24:35.275 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411/remote/smithi152/log 2024-09-11T22:24:35.276 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T22:24:44.906 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411/remote/smithi179/log 2024-09-11T22:24:44.907 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T22:24:54.001 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411/remote/smithi193/log 2024-09-11T22:24:54.003 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T22:25:07.194 INFO:tasks.cephadm:Removing cluster... 2024-09-11T22:25:07.194 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 --force 2024-09-11T22:25:07.397 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T22:25:07.731 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 --force 2024-09-11T22:25:07.934 INFO:teuthology.orchestra.run.smithi179.stdout:Deleting cluster with fsid: 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T22:25:08.273 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5c140ed8-7088-11ef-bcea-c7b262605968 --force 2024-09-11T22:25:08.465 INFO:teuthology.orchestra.run.smithi193.stdout:Deleting cluster with fsid: 5c140ed8-7088-11ef-bcea-c7b262605968 2024-09-11T22:25:08.827 INFO:tasks.cephadm:Removing cephadm ... 2024-09-11T22:25:08.827 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T22:25:08.847 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T22:25:08.863 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T22:25:08.879 INFO:tasks.cephadm:Teardown complete 2024-09-11T22:25:08.879 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T22:25:08.890 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T22:25:08.890 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T22:25:08.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T22:25:08.906 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T22:25:09.006 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T22:25:09.017 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T22:25:09.017 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:25:09.020 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:25:09.023 DEBUG:teuthology.orchestra.run.smithi193:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:25:09.035 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:25:09.035 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:25:09.037 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:25:09.038 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:25:09.038 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-09-11T22:25:09.038 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +1022us[+1057us] +/- 44ms 2024-09-11T22:25:09.038 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -83us[ -47us] +/- 64ms 2024-09-11T22:25:09.039 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -1615us[-1579us] +/- 71ms 2024-09-11T22:25:09.039 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:25:09.040 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:25:09.040 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-11T22:25:09.041 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv01.front.sepia.ceph.com 3 6 377 24 +1042us[+1013us] +/- 44ms 2024-09-11T22:25:09.041 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -55us[ -55us] +/- 64ms 2024-09-11T22:25:09.041 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 -1598us[-1598us] +/- 71ms 2024-09-11T22:25:09.041 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:25:09.042 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:25:09.042 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-09-11T22:25:09.042 INFO:teuthology.orchestra.run.smithi193.stdout:^* hv01.front.sepia.ceph.com 3 6 377 24 +1051us[+1041us] +/- 44ms 2024-09-11T22:25:09.042 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -61us[ -61us] +/- 64ms 2024-09-11T22:25:09.043 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 -1585us[-1585us] +/- 71ms 2024-09-11T22:25:09.043 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:25:09.043 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T22:25:09.054 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T22:25:09.054 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T22:25:09.065 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T22:25:09.173 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T22:25:09.240 DEBUG:teuthology.orchestra.run.smithi193:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T22:25:09.307 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:25:09.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:25:09.340 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:25:09.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:25:09.368 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:25:09.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:25:09.397 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T22:25:09.408 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T22:25:09.419 INFO:teuthology.task.internal:Duration was 2217.386552 seconds 2024-09-11T22:25:09.419 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T22:25:09.430 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T22:25:09.430 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T22:25:09.433 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T22:25:09.435 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T22:25:09.471 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:25:09.471 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:25:09.475 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:25:09.838 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T22:25:09.838 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-09-11T22:25:09.839 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T22:25:09.860 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-09-11T22:25:09.860 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T22:25:09.906 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi193.front.sepia.ceph.com 2024-09-11T22:25:09.906 DEBUG:teuthology.orchestra.run.smithi193:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T22:25:09.936 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T22:25:09.936 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T22:25:09.938 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T22:25:09.951 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T22:25:10.002 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T22:25:10.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T22:25:10.006 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T22:25:10.017 DEBUG:teuthology.orchestra.run.smithi193:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T22:25:11.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T22:25:11.489 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T22:25:11.490 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T22:25:11.514 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T22:25:11.546 DEBUG:teuthology.orchestra.run.smithi193:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T22:25:11.576 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T22:25:11.588 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:25:11.591 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:25:11.593 DEBUG:teuthology.orchestra.run.smithi193:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:25:11.611 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-09-11T22:25:11.619 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-09-11T22:25:11.644 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = core 2024-09-11T22:25:11.771 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:25:11.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:25:11.787 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:25:11.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:25:11.805 DEBUG:teuthology.orchestra.run.smithi193:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:25:11.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:25:11.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T22:25:11.842 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T22:25:11.842 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411/remote/smithi152 2024-09-11T22:25:11.843 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T22:25:11.921 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411/remote/smithi179 2024-09-11T22:25:11.922 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T22:25:11.962 DEBUG:teuthology.misc:Transferring archived files from smithi193:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901411/remote/smithi193 2024-09-11T22:25:11.963 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T22:25:12.005 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T22:25:12.005 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T22:25:12.008 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T22:25:12.010 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T22:25:12.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T22:25:12.070 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T22:25:12.070 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T22:25:12.082 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T22:25:12.082 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T22:25:12.084 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T22:25:12.087 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T22:25:12.097 INFO:teuthology.orchestra.run.smithi152.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 22:25 /home/ubuntu/cephtest 2024-09-11T22:25:12.102 INFO:teuthology.orchestra.run.smithi179.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 22:25 /home/ubuntu/cephtest 2024-09-11T22:25:12.113 INFO:teuthology.orchestra.run.smithi193.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 22:25 /home/ubuntu/cephtest 2024-09-11T22:25:12.114 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T22:25:12.126 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T22:25:12.154 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} duration: 2217.3865518569946 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-11T22:25:12.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T22:25:12.248 INFO:teuthology.run:pass